-- Logs begin at Wed 2022-07-20 02:19:16 UTC, end at Wed 2022-07-20 05:47:16 UTC. -- Jul 20 03:58:22.676735 n-d-826526-5 systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 03:58:22.685600 n-d-826526-5 devstack@n-api.service[112522]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 03:58:22.687593 n-d-826526-5 devstack@n-api.service[112522]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 03:58:22 2022] *** Jul 20 03:58:22.687593 n-d-826526-5 devstack@n-api.service[112522]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 03:58:22.687593 n-d-826526-5 devstack@n-api.service[112522]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 03:58:22.687593 n-d-826526-5 devstack@n-api.service[112522]: nodename: n-d-826526-5 Jul 20 03:58:22.687593 n-d-826526-5 devstack@n-api.service[112522]: machine: x86_64 Jul 20 03:58:22.687593 n-d-826526-5 devstack@n-api.service[112522]: clock source: unix Jul 20 03:58:22.687593 n-d-826526-5 devstack@n-api.service[112522]: pcre jit disabled Jul 20 03:58:22.687593 n-d-826526-5 devstack@n-api.service[112522]: detected number of CPU cores: 4 Jul 20 03:58:22.687593 n-d-826526-5 devstack@n-api.service[112522]: current working directory: / Jul 20 03:58:22.687593 n-d-826526-5 devstack@n-api.service[112522]: detected binary path: /usr/bin/uwsgi-core Jul 20 03:58:22.688302 n-d-826526-5 devstack@n-api.service[112522]: your processes number limit is 47680 Jul 20 03:58:22.688302 n-d-826526-5 devstack@n-api.service[112522]: your memory page size is 4096 bytes Jul 20 03:58:22.688302 n-d-826526-5 devstack@n-api.service[112522]: detected max file descriptor number: 2048 Jul 20 03:58:22.688302 n-d-826526-5 devstack@n-api.service[112522]: lock engine: pthread robust mutexes Jul 20 03:58:22.688302 n-d-826526-5 devstack@n-api.service[112522]: thunder lock: enabled Jul 20 03:58:22.688302 n-d-826526-5 devstack@n-api.service[112522]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 03:58:22.688302 n-d-826526-5 devstack@n-api.service[112522]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 03:58:22.730773 n-d-826526-5 devstack@n-api.service[112522]: Python main interpreter initialized at 0x5564d46e49c0 Jul 20 03:58:22.730773 n-d-826526-5 devstack@n-api.service[112522]: python threads support enabled Jul 20 03:58:22.730773 n-d-826526-5 devstack@n-api.service[112522]: your server socket listen backlog is limited to 100 connections Jul 20 03:58:22.730773 n-d-826526-5 devstack@n-api.service[112522]: your mercy for graceful operations on workers is 90 seconds Jul 20 03:58:22.731252 n-d-826526-5 devstack@n-api.service[112522]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 03:58:22.731252 n-d-826526-5 devstack@n-api.service[112522]: *** Operational MODE: preforking *** Jul 20 03:58:22.731474 n-d-826526-5 devstack@n-api.service[112522]: *** uWSGI is running in multiple interpreter mode *** Jul 20 03:58:22.731474 n-d-826526-5 devstack@n-api.service[112522]: spawned uWSGI master process (pid: 112522) Jul 20 03:58:22.731726 n-d-826526-5 systemd[1]: Started Devstack devstack@n-api.service. Jul 20 03:58:22.732654 n-d-826526-5 devstack@n-api.service[112522]: spawned uWSGI worker 1 (pid: 112523, cores: 1) Jul 20 03:58:22.732654 n-d-826526-5 devstack@n-api.service[112522]: spawned uWSGI worker 2 (pid: 112524, cores: 1) Jul 20 03:58:22.732654 n-d-826526-5 devstack@n-api.service[112522]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 03:58:23.383217 n-d-826526-5 devstack@n-api.service[112523]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 03:58:23.394627 n-d-826526-5 devstack@n-api.service[112524]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 03:58:24.488032 n-d-826526-5 devstack@n-api.service[112524]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 03:58:24.488032 n-d-826526-5 devstack@n-api.service[112524]: from cryptography.utils import int_from_bytes Jul 20 03:58:24.488916 n-d-826526-5 devstack@n-api.service[112524]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 03:58:24.488916 n-d-826526-5 devstack@n-api.service[112524]: from cryptography.utils import int_from_bytes Jul 20 03:58:24.489030 n-d-826526-5 devstack@n-api.service[112523]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 03:58:24.489030 n-d-826526-5 devstack@n-api.service[112523]: from cryptography.utils import int_from_bytes Jul 20 03:58:24.489030 n-d-826526-5 devstack@n-api.service[112523]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 03:58:24.489030 n-d-826526-5 devstack@n-api.service[112523]: from cryptography.utils import int_from_bytes Jul 20 03:58:26.938541 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 03:58:26.939173 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 03:58:26.939173 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 03:58:26.939531 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 03:58:26.939753 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 03:58:26.940163 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.940318 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 03:58:26.940684 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 03:58:26.940783 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.940783 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.940992 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 03:58:26.941159 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.941332 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 03:58:26.941462 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.941580 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 03:58:26.941676 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.941998 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.942139 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.942321 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.942462 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.942641 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.942782 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.942880 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.942972 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.943191 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.943336 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.943512 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-826526-5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.943659 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.943828 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.943960 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.944129 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.944295 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.944409 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.944500 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.944726 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.944816 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.945019 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.945106 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.945335 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.945424 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-826526-5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.945633 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.945721 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.945937 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.946124 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.946241 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.947296 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.947429 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.947538 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.947623 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.947767 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.947852 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.947931 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.948015 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.948015 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.948221 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.948354 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.948436 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.948519 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.948644 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.948766 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.948886 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.949012 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.949156 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.949244 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.949455 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.949649 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-826526-5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.949744 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.949960 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.950194 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.950291 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.950479 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.950569 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.950800 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.950944 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.951110 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.951208 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.951509 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-826526-5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.951639 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.951821 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.951948 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.952125 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.952251 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.952445 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.952552 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.952769 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.952938 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.953083 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.953230 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.953399 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.953536 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.953713 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.953857 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.954009 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.954179 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.954315 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.954483 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.954616 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.954808 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.954927 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.955128 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.955228 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.955444 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.955537 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.955745 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.955835 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.956042 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.956137 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.956364 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.956457 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.956675 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.956772 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.956992 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.957130 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.957238 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.957329 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.957486 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.957573 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.957802 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.957895 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.958108 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.958191 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.958411 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.958501 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.958717 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.958853 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.959020 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.959106 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.959277 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.959368 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.959526 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.959612 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.959843 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.959928 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.960163 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.960272 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.960497 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.960582 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.960802 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.960888 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.961109 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.961201 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.961416 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.961500 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.961717 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.961807 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.962020 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.962116 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.962327 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.962432 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.962628 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.962720 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.962930 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.963100 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.963244 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.963329 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.963561 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.963644 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.963888 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.963980 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.964227 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.964349 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.964567 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.964651 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.964871 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.964964 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.965170 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.965264 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.965470 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.965555 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.965783 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.965918 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.966111 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.966229 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.966411 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.966548 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.966641 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.966867 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.966952 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.967176 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.967260 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.967481 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.967575 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.967786 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.967871 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.968088 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.968171 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.968414 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.968502 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.968710 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.968795 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.968970 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.969055 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.969269 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.969356 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.969570 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.969663 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.969866 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.969949 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.970166 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.970253 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.970466 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.970558 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.970765 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.970857 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.971061 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.971143 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.971359 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.971443 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.971659 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.971751 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.971962 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.972046 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.972348 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.972445 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.972587 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.972684 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.972886 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.972969 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.973184 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.973274 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.973483 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.973575 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.973785 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.973868 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.974087 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.974172 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.974404 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.974501 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.974704 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.974788 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.975004 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.975095 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.975306 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.975401 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.975607 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.975699 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.975909 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.976007 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.976211 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.976327 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.976531 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.976625 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.976833 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.976918 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.977143 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.977239 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.977444 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.977531 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.977744 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.977829 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.978039 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.978124 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.978337 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.978422 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.978631 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.978716 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.978928 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.979015 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.979222 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.979317 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.979541 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.979625 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.979835 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.979921 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.980144 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.980228 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.980469 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.980555 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.980770 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.980855 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.981069 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.981154 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.981363 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.981481 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.981676 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.981768 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.982004 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.982103 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.982329 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.982498 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.982655 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.982746 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.982960 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.983043 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.983264 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.983357 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.983570 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.983656 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.983873 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.983958 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.984185 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.984312 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:58:26.984531 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.984617 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.984852 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.984938 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.985159 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.985252 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.985463 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.985548 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.985768 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.985851 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.986081 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.986166 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.986394 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.986483 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.986713 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.986804 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.987021 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.987114 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.987333 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.987417 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.987638 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.987814 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.987942 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.988027 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.988248 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.988404 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.988584 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.988679 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.988898 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.988982 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.989203 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.989287 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.989525 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.989617 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.989840 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.989933 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.990160 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.990243 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.990468 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.990565 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.990779 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.990862 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.991083 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.991167 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.991385 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.991484 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.991689 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.991773 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.992001 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.992086 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.992357 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.992464 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.992667 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.992754 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.992977 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.993061 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.993283 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.993378 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.993590 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.993676 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.993893 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.993978 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.994197 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.994283 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.994499 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.994583 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.994827 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.994912 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.995235 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.995340 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.995544 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.995775 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.995868 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.996151 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.996303 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.996489 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.996761 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.996859 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.997091 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.997182 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.997392 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.997523 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.997691 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.997784 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.997993 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.998098 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.998298 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.998417 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.998597 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.998735 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.998912 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.999049 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.999232 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.999359 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.999533 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.999665 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.999857 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:26.999981 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.000157 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.000322 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.000486 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.001049 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.001150 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.001360 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.001495 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.001665 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.001750 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.001973 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.002057 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.002278 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.002372 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.002576 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.002694 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.002896 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.002993 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.003200 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.003286 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.003499 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.003584 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.003818 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.003910 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.004117 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.004201 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.004445 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.004533 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.004753 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.004848 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.005056 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.005139 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.005360 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.005443 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.005667 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.005763 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.005968 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.006051 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.006283 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.006378 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.006587 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.006672 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.006890 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.006976 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.007209 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.007295 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.007511 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.007639 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.007811 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.007904 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.008123 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.008208 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.008453 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.008541 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.008764 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.008847 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.009067 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.009151 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.009374 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.009459 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.009674 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.009760 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.009973 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.010066 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.010274 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.010366 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.010577 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.010662 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.010900 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.010993 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.011201 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.011284 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.011501 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.011587 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.011803 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.011896 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.012100 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.012231 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.012445 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.012542 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.012784 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.012960 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.013052 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.013170 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.013328 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.013474 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.013627 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.013784 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.013963 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.014089 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.014263 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.014390 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.014595 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.014691 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.014922 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.015008 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.015236 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.015324 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.015552 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.015639 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.015857 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.015942 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.016161 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.016252 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.016487 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.016582 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.016791 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.016884 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.017094 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.017189 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.017434 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.017520 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.017737 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.017834 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.018035 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.018128 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.018350 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.018436 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.018653 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.018737 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.018969 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.019063 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.019270 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.019355 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.019586 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.019682 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.019881 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.019978 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.020184 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.020298 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.020515 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.020600 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.020824 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.020912 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.021139 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.021226 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.021450 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.021542 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.021755 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.021842 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.022059 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.022143 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.022365 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.022457 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.022670 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.022757 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.022976 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.023082 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.023274 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.023363 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.023583 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.023674 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.023887 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.023973 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.024198 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.024316 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.024526 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.024623 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.024841 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.024926 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.025141 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.025247 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.025453 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.025537 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.025747 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.025837 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.026053 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.026146 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.026406 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.026535 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.026717 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.026831 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.027031 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.027160 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.027339 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.027463 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.027651 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.027782 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.027959 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.028083 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.028301 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.028394 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.028589 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.028674 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.028890 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.028985 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.029191 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.029283 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.029494 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.029579 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.029803 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.029890 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.030107 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.030198 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.030411 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.030497 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.030712 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.030798 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.031019 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.031103 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.031322 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.031407 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.031621 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.031714 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.031917 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.032002 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.032229 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.032356 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.032566 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.032651 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.032871 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.032989 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.033218 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.033371 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.033471 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.033559 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.033777 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.033865 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.034070 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.034163 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.034381 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.034465 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.034680 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.034763 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.034978 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.035071 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.035272 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.035356 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.035563 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.035647 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.035885 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.035970 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.036184 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.036292 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.036506 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.036688 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.036813 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.037015 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.037124 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.037317 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.037426 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.037617 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.037733 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.037938 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.038163 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.038255 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.038343 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.038532 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.038628 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.038831 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.038919 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.039129 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.039223 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.039467 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.039563 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.039791 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.039878 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.040072 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.040172 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.040398 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.040488 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.040713 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.040797 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.041012 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.041109 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.041314 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.041410 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.041616 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.041700 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.041910 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.042001 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.042242 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.042329 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.042549 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.042640 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.042854 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.043118 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.043249 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.043449 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.043545 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.043761 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.043846 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.044075 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.044162 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.044415 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.044504 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.044732 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.044820 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.045059 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.045146 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.045361 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.045452 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.045664 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.045750 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.045968 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.046071 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.046281 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.046366 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.046580 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.046847 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.046982 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.047168 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.047254 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.047467 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.047552 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.047764 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.047850 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.048061 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.048154 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.048393 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.048482 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.048692 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.048788 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.048988 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.049073 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.049285 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.049371 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.049582 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.049677 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.049908 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.050048 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.050188 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.050282 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.050493 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.050579 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.050788 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.050882 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.051101 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.051186 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.051400 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.051491 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.051697 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.051791 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.051991 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.052075 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.052344 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.052433 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.052608 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.052695 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.052908 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.052993 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.053213 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.053340 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.053524 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.053613 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.053825 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.053910 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.054132 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.054231 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.054432 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.054518 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.054747 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.054831 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.055047 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.055145 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.055342 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.055427 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.055638 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.055722 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.055939 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.056032 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.056236 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.056347 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.056556 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.056649 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.056861 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.056947 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.057162 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.057247 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.057463 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.057548 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.057815 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.057914 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.058110 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.058197 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.058410 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.058504 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.058705 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.058802 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.059050 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.059319 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.059443 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.059620 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.059869 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.059963 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.060182 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.060341 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.060509 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.060666 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.060795 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.060930 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.061101 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.061239 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.061369 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.061511 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.061648 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.061776 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.061943 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.062073 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.062241 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.062379 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.062526 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.062656 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.062821 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.062959 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.063122 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.063260 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.063467 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.063648 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.063777 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.063906 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.064053 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.064181 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.064313 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.064509 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.064639 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.064798 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.065103 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.065323 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.065541 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.065765 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.065765 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.066161 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.066380 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.066596 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.066807 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.066972 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.067129 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.067271 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.067416 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.067549 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.067549 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.067799 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.067930 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.068070 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.068204 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.068204 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.068454 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.068579 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.068579 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.068859 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.068859 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.069111 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.069430 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.069765 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.070011 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.070255 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.070416 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.070556 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.070700 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.070841 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.070977 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.071126 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.071462 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.071649 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.071792 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.072064 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.072286 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.072432 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.072689 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.072875 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.073053 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.073274 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.073554 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.073876 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.074109 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.074109 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.074545 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.074764 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.074998 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.075228 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.075376 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.075517 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.075650 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.075789 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.075930 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.076098 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.076390 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.076632 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.076632 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.077067 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.077279 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.077494 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.077725 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.077940 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.078168 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.078410 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.078637 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.078783 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.078920 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.079053 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.079198 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.079346 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.079480 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.079619 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.079760 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.079921 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.080048 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.080189 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.080293 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.080293 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.080546 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.080679 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.080679 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.080954 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.081088 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.081088 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.081343 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.081469 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.081469 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.081728 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.081862 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.082001 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.082134 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.082267 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.082432 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.082582 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.082717 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.082851 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.082983 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.083115 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.083256 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.083389 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.083528 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.083617 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.083739 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.083896 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.084036 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.084167 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.084345 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.084486 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.084617 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.084756 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.084888 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.085017 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.085156 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.085295 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.085425 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.085564 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.085696 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.085824 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.085955 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.086106 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.086245 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.086384 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.086514 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.086693 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.086825 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.086997 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.087133 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.087305 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.087445 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.087608 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.087738 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.087890 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.088033 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.088198 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.088348 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.088527 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.088657 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.088879 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.089037 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.089186 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.089349 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.089620 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.089705 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.089934 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.090029 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.090238 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.090322 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.090554 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.090699 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.090864 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.091007 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.091165 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.091295 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.091547 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.091674 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.091862 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.091993 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.092167 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.092337 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.092483 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.092612 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.092790 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.092924 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.093089 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.093234 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.093397 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.093545 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.093718 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.093846 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.094021 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.094138 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.094322 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.094444 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.094623 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.094768 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.094940 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.095071 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.095242 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.095407 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.095561 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.095647 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.095963 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.096049 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.096305 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.096412 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.096588 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.096673 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.096996 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.097090 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.097300 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.097394 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.097601 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.097687 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.097915 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.097998 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.098233 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.098328 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.098553 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.098639 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.098853 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.098938 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.099162 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.099249 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.099466 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.099570 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.099785 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.099872 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.100102 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.100185 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.100433 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.100532 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.100741 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.100825 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.101043 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.101129 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.101361 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.101449 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.101678 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.101767 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.101987 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.102072 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.102305 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.102392 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.102656 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.102741 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.102968 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.103053 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.103288 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.103375 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.103609 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.103694 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.103929 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.104023 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.104231 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.104373 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.104578 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.104676 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.104885 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.104985 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.105188 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.105280 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.105489 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.105574 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.105805 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.105974 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.106107 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.106205 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.106405 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.106489 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.106709 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.106806 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.107012 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.107097 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.107311 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.107403 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.107611 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.107705 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.107916 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.108004 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.108212 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.108326 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.108534 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.108619 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.108855 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.108981 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.109154 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.109238 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.109474 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.109568 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.109771 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.109855 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.110088 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.110172 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.110389 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.110473 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.110690 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.110775 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.110989 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.111084 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.111286 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.111370 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.111582 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.111665 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.111883 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.111983 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.112183 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.112347 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.112540 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.112626 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.112867 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.112968 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.113173 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.113260 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.113499 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.113586 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.113822 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.113930 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.114127 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.114247 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.114436 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.114520 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.114754 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.114841 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.115052 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.115137 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.115349 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.115435 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.115653 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.115739 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.115950 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.116036 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.116246 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.116351 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.116565 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.116653 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.116863 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.116955 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.117154 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.117239 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.117451 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.117539 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.117745 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.117831 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.118041 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.118139 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.118343 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.118429 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.118643 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.118735 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.118940 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.119066 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.119238 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.119324 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.119536 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.119622 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.119832 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.119926 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.120192 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.120330 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.120595 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.120694 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.120908 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.121007 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.121225 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.121310 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.121532 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.121615 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.121853 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.121938 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.122157 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.122243 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.122474 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.122559 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.122793 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.122880 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.123099 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.123183 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.123408 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.123492 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.123720 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.123807 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.124029 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.124117 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.124364 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.124455 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.124676 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.124771 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.124980 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.125065 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.125289 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.125381 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.125906 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.125998 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.126220 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.126304 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.126759 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.126911 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.127083 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.127185 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.127393 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.127499 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.127701 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.127996 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.128093 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.128324 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.128422 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.128637 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.128733 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.128944 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.129069 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.129249 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.129345 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.129552 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.129661 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.129855 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.129958 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.130161 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.130255 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.130471 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.130580 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.130779 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.130887 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.131089 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.131187 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.131401 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.131497 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.131711 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.131797 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.132021 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.132108 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.132356 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.132448 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.132687 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.132773 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.133000 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.133088 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.133299 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.133385 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.133610 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.133697 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.133919 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.134014 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.134232 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.134331 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.134538 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.134632 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.134842 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.135004 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.135153 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.135240 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.135460 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.135547 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.135853 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.135948 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.136166 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.136281 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.136501 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.136590 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.136808 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.136894 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.137116 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.137202 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.137444 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.137529 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.137762 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.137849 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.138073 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.138159 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.138385 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.138480 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.138702 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.138789 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.139064 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.139213 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.139376 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.139523 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.139687 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.139847 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.140001 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.140154 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.140499 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.140603 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.140815 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.140902 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.141130 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.141224 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.141453 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.141555 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.141755 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.141841 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.142054 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.142140 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.142359 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.142446 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.142665 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.142760 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.142962 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.143048 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.143262 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.143347 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.143567 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.143651 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.143865 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.143951 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.144166 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.144291 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.144494 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.144590 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.144803 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.145020 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.145136 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.145365 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.145450 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.145678 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.145764 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.146002 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.146213 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.146336 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.146557 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.146642 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.146870 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.146984 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.147195 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.147294 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.147499 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.147646 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.147801 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.147896 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.148105 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.148189 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.148433 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.148520 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.148734 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.148834 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.149032 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.149119 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.149338 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.149426 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.149642 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.149728 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.149938 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.150032 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.150238 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.150330 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.150532 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.150618 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.150837 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.150930 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.151138 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.151230 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.151466 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.151559 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.151764 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.151849 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.152070 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.152157 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.152391 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.152494 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.152697 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.152782 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.152994 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.153088 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.153291 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.153410 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.153597 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.153716 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.153895 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.154022 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.154198 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.154326 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.154496 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.154630 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.154801 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.154942 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.155098 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.155242 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.155400 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.155547 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.155741 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.155835 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.156060 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.156146 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.156393 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.156492 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.156693 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.156779 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.157006 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.157091 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.157311 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.157405 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.157627 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.157714 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.157935 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.158023 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.158241 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.158326 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.158552 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.158637 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.158875 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.158960 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.159186 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.159544 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.159684 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.159790 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.159906 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.160016 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.160124 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.160368 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.160682 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.160769 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.160981 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.161077 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.161282 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.161387 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.161580 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.161674 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.161898 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.161986 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.162204 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.162299 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.162517 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.162608 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.162820 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.162906 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.163127 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.163222 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.163432 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.163519 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.163735 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.163822 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.164040 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.164127 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.164364 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.164463 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.164669 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.164751 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.164972 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.165059 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.165274 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.165360 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.165579 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.165665 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.165876 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.165962 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.166177 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.166262 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.166484 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.166578 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.166791 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.166878 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.167143 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.167235 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.167457 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.167553 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.167769 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.167854 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.168077 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.168216 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.168394 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.168534 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.168697 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.168828 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.169000 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.169139 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.169312 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.169447 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.169637 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.169778 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.169944 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.170084 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.170227 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.170361 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.170613 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.170745 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.170936 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.171069 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.171244 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.171373 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.171545 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.171675 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.171850 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.172002 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.172166 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.172315 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.172513 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.172643 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.172820 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.172976 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.173139 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.173272 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.173446 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.173583 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.173773 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.173925 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.174091 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.174221 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.174411 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.174540 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.174721 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.174863 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.175017 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.175146 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.175318 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.175449 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.175616 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.175751 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.175923 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.176059 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.176235 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.176399 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.176634 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.176728 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.176934 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.177027 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.177232 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.177327 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.177535 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.177627 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.177832 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.177919 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.178129 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.178227 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.178423 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.178511 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.178720 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.178815 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.179017 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.179113 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.179309 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.179394 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.179606 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.179740 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.179901 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.179994 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.180196 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.180318 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.180517 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.180601 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.180810 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.180896 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.181105 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.181188 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.181397 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.181483 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.181694 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.181780 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.181987 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.182080 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.182286 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.182371 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.182606 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.182703 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.182906 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.182998 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.183206 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.183299 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.183507 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.183596 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.183806 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.183899 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.184126 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.184220 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.184467 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.184587 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.184774 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.184902 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.185088 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.185226 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.185405 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.185538 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.185712 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.185861 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.186016 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.186168 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.186339 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.186489 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.186642 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.186811 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.186946 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.187126 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.187277 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.187476 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.187630 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.187801 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.187947 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.188081 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.188214 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.188413 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.188502 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.188773 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.188878 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.189036 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.189125 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.189343 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.189431 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.189652 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.189750 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.189965 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.190050 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.190275 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.190369 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.190577 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.190662 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.190894 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.190988 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.191201 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.191287 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.191507 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.191594 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.191811 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.191898 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.192118 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.192202 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.192454 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.192542 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.192765 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.192850 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.193070 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.193166 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.193375 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.193459 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.193684 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.193771 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.193991 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.194088 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.194301 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.194386 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.194609 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.194704 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.194913 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.195010 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.195226 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.195361 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.195537 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.195679 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.195863 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.196005 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.196168 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.196327 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.196506 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.196634 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.196832 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.196974 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.197138 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.197282 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.197445 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.197581 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.197745 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.197880 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.198012 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 03:58:27.198148 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.198475 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.198789 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.199101 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.199408 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:58:27.199651 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 03:58:27.258599 n-d-826526-5 devstack@n-api.service[112523]: INFO dbcounter [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] Registered counter for database nova_api Jul 20 03:58:27.260545 n-d-826526-5 devstack@n-api.service[112524]: INFO dbcounter [None req-a91bf6ef-9f08-46d7-a32b-8eda0487845a None None] Registered counter for database nova_api Jul 20 03:58:27.371324 n-d-826526-5 devstack@n-api.service[112523]: DEBUG oslo_db.sqlalchemy.engines [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:58:27.373125 n-d-826526-5 devstack@n-api.service[112524]: DEBUG oslo_db.sqlalchemy.engines [None req-a91bf6ef-9f08-46d7-a32b-8eda0487845a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:58:27.378990 n-d-826526-5 devstack@n-api.service[112523]: DEBUG dbcounter [-] [112523] Writer thread running {{(pid=112523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:58:27.380199 n-d-826526-5 devstack@n-api.service[112524]: DEBUG dbcounter [-] [112524] Writer thread running {{(pid=112524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:58:27.434542 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.context [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbf41b76-8148-4f7f-88f5-d6fd988c2859(cell1) {{(pid=112523) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 03:58:27.434990 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.context [None req-a91bf6ef-9f08-46d7-a32b-8eda0487845a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbf41b76-8148-4f7f-88f5-d6fd988c2859(cell1) {{(pid=112524) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 03:58:27.438477 n-d-826526-5 devstack@n-api.service[112523]: DEBUG oslo_concurrency.lockutils [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 03:58:27.438948 n-d-826526-5 devstack@n-api.service[112524]: DEBUG oslo_concurrency.lockutils [None req-a91bf6ef-9f08-46d7-a32b-8eda0487845a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 03:58:27.440057 n-d-826526-5 devstack@n-api.service[112523]: DEBUG oslo_concurrency.lockutils [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 03:58:27.440495 n-d-826526-5 devstack@n-api.service[112524]: DEBUG oslo_concurrency.lockutils [None req-a91bf6ef-9f08-46d7-a32b-8eda0487845a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 03:58:27.440847 n-d-826526-5 devstack@n-api.service[112523]: DEBUG oslo_concurrency.lockutils [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 03:58:27.441266 n-d-826526-5 devstack@n-api.service[112524]: DEBUG oslo_concurrency.lockutils [None req-a91bf6ef-9f08-46d7-a32b-8eda0487845a None None] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 03:58:27.442927 n-d-826526-5 devstack@n-api.service[112523]: DEBUG oslo_concurrency.lockutils [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 03:58:27.443337 n-d-826526-5 devstack@n-api.service[112524]: DEBUG oslo_concurrency.lockutils [None req-a91bf6ef-9f08-46d7-a32b-8eda0487845a None None] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 03:58:27.444897 n-d-826526-5 devstack@n-api.service[112523]: INFO dbcounter [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] Registered counter for database nova_cell0 Jul 20 03:58:27.445321 n-d-826526-5 devstack@n-api.service[112524]: INFO dbcounter [None req-a91bf6ef-9f08-46d7-a32b-8eda0487845a None None] Registered counter for database nova_cell0 Jul 20 03:58:27.448891 n-d-826526-5 devstack@n-api.service[112523]: INFO dbcounter [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] Registered counter for database nova_cell1 Jul 20 03:58:27.449074 n-d-826526-5 devstack@n-api.service[112524]: INFO dbcounter [None req-a91bf6ef-9f08-46d7-a32b-8eda0487845a None None] Registered counter for database nova_cell1 Jul 20 03:58:27.456118 n-d-826526-5 devstack@n-api.service[112523]: DEBUG oslo_db.sqlalchemy.engines [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:58:27.460306 n-d-826526-5 devstack@n-api.service[112524]: DEBUG oslo_db.sqlalchemy.engines [None req-a91bf6ef-9f08-46d7-a32b-8eda0487845a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:58:27.460461 n-d-826526-5 devstack@n-api.service[112523]: DEBUG oslo_db.sqlalchemy.engines [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:58:27.462444 n-d-826526-5 devstack@n-api.service[112523]: DEBUG dbcounter [-] [112523] Writer thread running {{(pid=112523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:58:27.463512 n-d-826526-5 devstack@n-api.service[112524]: DEBUG oslo_db.sqlalchemy.engines [None req-a91bf6ef-9f08-46d7-a32b-8eda0487845a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:58:27.466000 n-d-826526-5 devstack@n-api.service[112524]: DEBUG dbcounter [-] [112524] Writer thread running {{(pid=112524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:58:27.600873 n-d-826526-5 devstack@n-api.service[112523]: DEBUG dbcounter [-] [112523] Writer thread running {{(pid=112523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:58:27.604368 n-d-826526-5 devstack@n-api.service[112524]: DEBUG dbcounter [-] [112524] Writer thread running {{(pid=112524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:58:27.613788 n-d-826526-5 devstack@n-api.service[112523]: INFO dbcounter [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] Registered counter for database nova_cell0 Jul 20 03:58:27.618764 n-d-826526-5 devstack@n-api.service[112524]: INFO dbcounter [None req-a91bf6ef-9f08-46d7-a32b-8eda0487845a None None] Registered counter for database nova_cell0 Jul 20 03:58:27.623700 n-d-826526-5 devstack@n-api.service[112523]: DEBUG oslo_db.sqlalchemy.engines [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:58:27.629751 n-d-826526-5 devstack@n-api.service[112523]: DEBUG dbcounter [-] [112523] Writer thread running {{(pid=112523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:58:27.632065 n-d-826526-5 devstack@n-api.service[112524]: DEBUG oslo_db.sqlalchemy.engines [None req-a91bf6ef-9f08-46d7-a32b-8eda0487845a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:58:27.636932 n-d-826526-5 devstack@n-api.service[112524]: DEBUG dbcounter [-] [112524] Writer thread running {{(pid=112524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:58:27.958916 n-d-826526-5 devstack@n-api.service[112523]: WARNING keystonemiddleware.auth_token [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 03:58:27.961377 n-d-826526-5 devstack@n-api.service[112524]: WARNING keystonemiddleware.auth_token [None req-a91bf6ef-9f08-46d7-a32b-8eda0487845a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 03:58:27.966385 n-d-826526-5 devstack@n-api.service[112523]: WARNING keystonemiddleware.auth_token [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 03:58:27.968895 n-d-826526-5 devstack@n-api.service[112524]: WARNING keystonemiddleware.auth_token [None req-a91bf6ef-9f08-46d7-a32b-8eda0487845a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 03:58:28.302245 n-d-826526-5 devstack@n-api.service[112523]: WARNING keystonemiddleware.auth_token [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 03:58:28.305952 n-d-826526-5 devstack@n-api.service[112524]: WARNING keystonemiddleware.auth_token [None req-a91bf6ef-9f08-46d7-a32b-8eda0487845a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 03:58:28.308226 n-d-826526-5 devstack@n-api.service[112523]: WARNING keystonemiddleware.auth_token [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 03:58:28.311953 n-d-826526-5 devstack@n-api.service[112524]: WARNING keystonemiddleware.auth_token [None req-a91bf6ef-9f08-46d7-a32b-8eda0487845a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 03:58:28.313479 n-d-826526-5 devstack@n-api.service[112523]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5564d46e49c0 pid: 112523 (default app) Jul 20 03:58:28.315539 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:28.316753 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001750 Jul 20 03:58:28.317159 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Wed Jul 20 03:58:28 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:58:28.317316 n-d-826526-5 devstack@n-api.service[112524]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5564d46e49c0 pid: 112524 (default app) Jul 20 03:59:44.837269 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:59:44.838900 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Jul 20 03:59:44.839286 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 03:59:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:59:44.851264 n-d-826526-5 devstack@n-api.service[112524]: DEBUG dbcounter [-] [112524] Writing DB stats nova_api:SELECT=3 {{(pid=112524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 03:59:44.854822 n-d-826526-5 devstack@n-api.service[112524]: DEBUG dbcounter [-] [112524] Writing DB stats nova_cell0:SELECT=3 {{(pid=112524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 03:59:44.855807 n-d-826526-5 devstack@n-api.service[112524]: DEBUG dbcounter [-] [112524] Writing DB stats nova_cell1:SELECT=3 {{(pid=112524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 03:59:44.856787 n-d-826526-5 devstack@n-api.service[112524]: DEBUG dbcounter [-] [112524] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 03:59:45.711115 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-cde608f4-b89f-405c-aee5-fb23a4f3a3f3 admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:59:45.741842 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-cde608f4-b89f-405c-aee5-fb23a4f3a3f3 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.895536 Jul 20 03:59:45.742936 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Jul 20 03:59:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 03:59:47.979140 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:59:47.980455 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-4a4fddb5-a22b-4411-8dfd-e3440d632b79 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jul 20 03:59:47.985494 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 03:59:47 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:59:48.412436 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-9edafdc6-f197-40b1-8707-7f64225a19f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:59:48.430870 n-d-826526-5 devstack@n-api.service[112524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 03:59:48.430870 n-d-826526-5 devstack@n-api.service[112524]: warnings.warn(msg) Jul 20 03:59:48.463626 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-9edafdc6-f197-40b1-8707-7f64225a19f2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.477033 Jul 20 03:59:48.468354 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 03:59:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 03:59:48.687767 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-4c164015-5544-430f-bdee-d1aa28063249 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:59:48.690257 n-d-826526-5 devstack@n-api.service[112523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 03:59:48.690257 n-d-826526-5 devstack@n-api.service[112523]: warnings.warn(msg) Jul 20 03:59:48.692980 n-d-826526-5 devstack@n-api.service[112523]: DEBUG dbcounter [-] [112523] Writing DB stats nova_api:SELECT=3 {{(pid=112523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 03:59:48.693880 n-d-826526-5 devstack@n-api.service[112523]: DEBUG dbcounter [-] [112523] Writing DB stats nova_cell1:SELECT=3 {{(pid=112523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 03:59:48.694619 n-d-826526-5 devstack@n-api.service[112523]: DEBUG dbcounter [-] [112523] Writing DB stats nova_cell0:SELECT=3 {{(pid=112523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 03:59:48.695337 n-d-826526-5 devstack@n-api.service[112523]: DEBUG dbcounter [-] [112523] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 03:59:48.756690 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-4c164015-5544-430f-bdee-d1aa28063249 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283599 Jul 20 03:59:48.757565 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Jul 20 03:59:48 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 03:59:51.038443 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-9edafdc6-f197-40b1-8707-7f64225a19f2 admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:59:51.039499 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-9edafdc6-f197-40b1-8707-7f64225a19f2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jul 20 03:59:51.039896 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 03:59:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:59:51.806191 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-d11104ec-ac6c-4e8f-9714-7c34b6c9cdb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "id": "d1", "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0}} {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:59:51.825464 n-d-826526-5 devstack@n-api.service[112523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 03:59:51.825464 n-d-826526-5 devstack@n-api.service[112523]: warnings.warn(msg) Jul 20 03:59:51.848952 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-d11104ec-ac6c-4e8f-9714-7c34b6c9cdb8 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.802771 Jul 20 03:59:51.849618 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 03:59:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 03:59:51.861687 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-3681dccb-1260-4237-b2f0-50b86ce64a06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:59:51.863277 n-d-826526-5 devstack@n-api.service[112524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 03:59:51.863277 n-d-826526-5 devstack@n-api.service[112524]: warnings.warn(msg) Jul 20 03:59:51.897566 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-3681dccb-1260-4237-b2f0-50b86ce64a06 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039704 Jul 20 03:59:51.898499 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Jul 20 03:59:51 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 03:59:54.373065 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-d11104ec-ac6c-4e8f-9714-7c34b6c9cdb8 admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:59:54.374074 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-d11104ec-ac6c-4e8f-9714-7c34b6c9cdb8 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001819 Jul 20 03:59:54.384584 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 03:59:54 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:59:54.949706 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-472b679a-f58c-4ece-a6bf-e14801d2e781 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 1024, "id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:59:54.971479 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-472b679a-f58c-4ece-a6bf-e14801d2e781 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.590846 Jul 20 03:59:54.979429 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 03:59:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 03:59:54.985336 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-e40138bf-953f-49d8-bbab-66714865972b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:59:55.013561 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-e40138bf-953f-49d8-bbab-66714865972b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031889 Jul 20 03:59:55.022886 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Jul 20 03:59:54 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 03:59:57.434037 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-472b679a-f58c-4ece-a6bf-e14801d2e781 admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:59:57.435180 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-472b679a-f58c-4ece-a6bf-e14801d2e781 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Jul 20 03:59:57.435662 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 03:59:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:59:57.871390 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-2e6d3b0b-3541-4dea-94e8-735fdec6bff0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "id": "d3", "disk": 10, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:59:57.895359 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-2e6d3b0b-3541-4dea-94e8-735fdec6bff0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.453681 Jul 20 03:59:57.905652 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 03:59:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 03:59:57.909285 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-65b53f0c-7b05-4083-8780-c0a82e9e775a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:59:57.944387 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-65b53f0c-7b05-4083-8780-c0a82e9e775a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039557 Jul 20 03:59:57.945111 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Jul 20 03:59:57 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:00:00.188991 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-2e6d3b0b-3541-4dea-94e8-735fdec6bff0 admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:00.190038 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-2e6d3b0b-3541-4dea-94e8-735fdec6bff0 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Jul 20 04:00:00.190670 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 04:00:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:00:00.689667 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-2251e101-74e7-418d-aaac-168ebd9b43bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4"}} {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:00:00.708915 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-2251e101-74e7-418d-aaac-168ebd9b43bb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.512385 Jul 20 04:00:00.709476 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 04:00:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:00:00.724866 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-7af07677-4a1d-47e8-ac58-14ed3edad3da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:00:00.765992 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-7af07677-4a1d-47e8-ac58-14ed3edad3da admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045343 Jul 20 04:00:00.767248 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Jul 20 04:00:00 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:00:03.087252 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-2251e101-74e7-418d-aaac-168ebd9b43bb admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:03.088934 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-2251e101-74e7-418d-aaac-168ebd9b43bb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Jul 20 04:00:03.094619 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 04:00:03 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:00:03.552494 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-e6407f46-a0ea-41fb-ba0e-c171c1901512 admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:03.576488 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-e6407f46-a0ea-41fb-ba0e-c171c1901512 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.480807 Jul 20 04:00:03.577657 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Jul 20 04:00:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:00:05.994441 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-2251e101-74e7-418d-aaac-168ebd9b43bb admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:05.995450 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-2251e101-74e7-418d-aaac-168ebd9b43bb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 20 04:00:05.996009 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 04:00:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:00:06.436693 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-7ade76f8-4010-41c3-96e2-13c47d8d4253 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "id": "1", "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny"}} {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:00:06.456221 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-7ade76f8-4010-41c3-96e2-13c47d8d4253 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.453351 Jul 20 04:00:06.456821 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 04:00:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:00:06.471358 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-bb58d72a-d472-4dfe-a5bf-22228184017d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:00:06.495594 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-bb58d72a-d472-4dfe-a5bf-22228184017d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028179 Jul 20 04:00:06.496239 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Jul 20 04:00:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:00:08.967613 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-7ade76f8-4010-41c3-96e2-13c47d8d4253 admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:08.968771 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-7ade76f8-4010-41c3-96e2-13c47d8d4253 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001748 Jul 20 04:00:08.969228 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 04:00:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:00:09.389776 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-a14efb10-8404-44c9-bf68-0b7f4285952d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 20, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:00:09.408446 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-a14efb10-8404-44c9-bf68-0b7f4285952d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.433349 Jul 20 04:00:09.408992 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 04:00:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:00:09.423205 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-07ba23d2-4f63-4508-b3e4-8a171e73fa62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:00:09.446939 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-07ba23d2-4f63-4508-b3e4-8a171e73fa62 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027388 Jul 20 04:00:09.447454 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Jul 20 04:00:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:00:11.974525 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-a14efb10-8404-44c9-bf68-0b7f4285952d admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:11.975802 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-a14efb10-8404-44c9-bf68-0b7f4285952d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001974 Jul 20 04:00:11.976280 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 04:00:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:00:12.377365 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-81b6d8b4-75d7-42a6-9990-d2343dd040bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2, "swap": 0, "id": "3", "os-flavor-access:is_public": true, "disk": 40}} {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:00:12.396352 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-81b6d8b4-75d7-42a6-9990-d2343dd040bb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.413998 Jul 20 04:00:12.396897 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 04:00:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:00:12.408860 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-3d773646-7031-4fcb-b254-f53b090163ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:00:12.433590 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-3d773646-7031-4fcb-b254-f53b090163ff admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028539 Jul 20 04:00:12.434166 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Jul 20 04:00:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:00:14.649934 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-81b6d8b4-75d7-42a6-9990-d2343dd040bb admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:14.650896 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-81b6d8b4-75d7-42a6-9990-d2343dd040bb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 20 04:00:14.651296 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 04:00:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:00:15.053089 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-4075aedd-4cb0-4481-8461-f7a559584cf3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "disk": 80}} {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:00:15.057838 n-d-826526-5 devstack@n-api.service[112524]: DEBUG dbcounter [-] [112524] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:00:15.088475 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-4075aedd-4cb0-4481-8461-f7a559584cf3 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.430826 Jul 20 04:00:15.092375 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 04:00:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:00:15.102022 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-714eeb65-8213-4af3-b417-8f017e4a84ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:00:15.131630 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-714eeb65-8213-4af3-b417-8f017e4a84ac admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033880 Jul 20 04:00:15.132213 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Jul 20 04:00:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:00:17.393219 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-4075aedd-4cb0-4481-8461-f7a559584cf3 admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:17.394859 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-4075aedd-4cb0-4481-8461-f7a559584cf3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002062 Jul 20 04:00:17.395694 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 04:00:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:00:17.813269 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-96e13b04-52a6-48a3-b174-d3d65556aab5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge", "vcpus": 8, "id": "5"}} {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:00:17.831773 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-96e13b04-52a6-48a3-b174-d3d65556aab5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.430181 Jul 20 04:00:17.833074 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 04:00:17 2022] POST /compute/v2.1/flavors => generated 408 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:00:17.845106 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-ffd11cb4-1faa-4db7-935e-c84ac9ba8593 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:00:17.872510 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-ffd11cb4-1faa-4db7-935e-c84ac9ba8593 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031560 Jul 20 04:00:17.873121 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Jul 20 04:00:17 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:00:40.879867 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-96e13b04-52a6-48a3-b174-d3d65556aab5 admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:40.880878 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-96e13b04-52a6-48a3-b174-d3d65556aab5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001640 Jul 20 04:00:40.881275 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 04:00:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:00:40.895291 n-d-826526-5 devstack@n-api.service[112524]: DEBUG dbcounter [-] [112524] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:00:41.322135 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-ca3bdb12-aa2c-49a6-9e2d-9d2d8a667d05 admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:41.339052 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-ca3bdb12-aa2c-49a6-9e2d-9d2d8a667d05 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.451158 Jul 20 04:00:41.339586 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Jul 20 04:00:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:00:42.427533 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-96e13b04-52a6-48a3-b174-d3d65556aab5 admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:42.428558 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-96e13b04-52a6-48a3-b174-d3d65556aab5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 20 04:00:42.428950 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 04:00:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:00:42.987682 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-2a750ae9-8cd1-4894-b36f-7ab9f6901efe admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:42.993332 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.wsgi [None req-2a750ae9-8cd1-4894-b36f-7ab9f6901efe admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-2a750ae9-8cd1-4894-b36f-7ab9f6901efe admin admin] Request method failure captured: Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: Accept: application/json Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: Accept-Encoding: gzip, deflate Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: Connection: keep-alive Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: Content-Length: 0 Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: Host: 10.222.0.17 Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: Openstack-Api-Version: compute 2.90 Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: Openstack-System-Scope: None Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: User-Agent: python-novaclient Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: X-Auth-Token: gAAAAABi133q-1Kq0d50pFQ7Mh3Y5-l_g3D6p5_3p8uaaLjTKuM_Q4q6n5H0QFM_MJjUushxqZN9TEYOoBzsMHlByQy-XxU0vatOtNMD473zJpIdxggeRWISYlakA5ScrCKHdNlOh9YYEzCgzWH928kUTBnEI3-7FjZbwZlYoekrj6lfKSzr39s Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: X-Domain-Id: None Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: X-Domain-Name: None Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: X-Identity-Status: Confirmed Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: X-Is-Admin-Project: True Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: X-Project-Domain-Id: default Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: X-Project-Domain-Name: Default Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: X-Project-Id: 4e097fcfa05c4ea78191e1232beed157 Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: X-Project-Name: admin Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: X-Role: reader,member,admin Jul 20 04:00:42.996637 n-d-826526-5 devstack@n-api.service[112524]: X-Roles: reader,member,admin Jul 20 04:00:42.998639 n-d-826526-5 devstack@n-api.service[112524]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e097fcfa05c4ea78191e1232beed157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4e097fcfa05c4ea78191e1232beed157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4e097fcfa05c4ea78191e1232beed157", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e097fcfa05c4ea78191e1232beed157"}]}] Jul 20 04:00:42.998639 n-d-826526-5 devstack@n-api.service[112524]: X-Tenant: admin Jul 20 04:00:42.998639 n-d-826526-5 devstack@n-api.service[112524]: X-Tenant-Id: 4e097fcfa05c4ea78191e1232beed157 Jul 20 04:00:42.998639 n-d-826526-5 devstack@n-api.service[112524]: X-Tenant-Name: admin Jul 20 04:00:42.998639 n-d-826526-5 devstack@n-api.service[112524]: X-User: admin Jul 20 04:00:42.998639 n-d-826526-5 devstack@n-api.service[112524]: X-User-Domain-Id: default Jul 20 04:00:42.998639 n-d-826526-5 devstack@n-api.service[112524]: X-User-Domain-Name: Default Jul 20 04:00:42.998639 n-d-826526-5 devstack@n-api.service[112524]: X-User-Id: 7701f78c3c4a48af926d71e8c850352c Jul 20 04:00:42.998639 n-d-826526-5 devstack@n-api.service[112524]: X-User-Name: admin Jul 20 04:00:42.998639 n-d-826526-5 devstack@n-api.service[112524]: method: > Jul 20 04:00:42.998639 n-d-826526-5 devstack@n-api.service[112524]: exception: Flavor 42 could not be found. Jul 20 04:00:42.998639 n-d-826526-5 devstack@n-api.service[112524]: action_args: {'id': '42'} Jul 20 04:00:42.998639 n-d-826526-5 devstack@n-api.service[112524]: {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:00:42.998639 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:00:43.000001 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:00:43.001467 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:00:43.001467 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:00:43.001467 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:00:43.001467 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:00:43.001467 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 04:00:43.001467 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:00:43.001467 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 04:00:43.001467 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Jul 20 04:00:43.001467 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:00:43.001467 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Jul 20 04:00:43.001467 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:00:43.001467 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:00:43.001467 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:00:43.001467 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:00:43.001467 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:00:43.001467 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 04:00:43.001467 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Jul 20 04:00:43.001467 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-2a750ae9-8cd1-4894-b36f-7ab9f6901efe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:00:43.002767 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-2a750ae9-8cd1-4894-b36f-7ab9f6901efe admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.421955 Jul 20 04:00:43.002767 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 04:00:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:00:43.008518 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-4e0aa8c8-0b1d-4da8-9653-33a23e37e0ca admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:43.011540 n-d-826526-5 devstack@n-api.service[112523]: DEBUG dbcounter [-] [112523] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:00:43.032077 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-4e0aa8c8-0b1d-4da8-9653-33a23e37e0ca admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027433 Jul 20 04:00:43.032681 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jul 20 04:00:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:00:43.042971 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-eeab8dba-249d-491b-9ae2-fd640bd91ef6 admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:43.067794 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-eeab8dba-249d-491b-9ae2-fd640bd91ef6 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027979 Jul 20 04:00:43.068637 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jul 20 04:00:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:00:43.078059 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-6082d833-c8eb-45c4-9d12-fc3d4abd11cd admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:43.084478 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.wsgi [None req-6082d833-c8eb-45c4-9d12-fc3d4abd11cd admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-6082d833-c8eb-45c4-9d12-fc3d4abd11cd admin admin] Request method failure captured: Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: Accept: application/json Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: Accept-Encoding: gzip, deflate Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: Connection: keep-alive Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: Content-Length: 0 Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: Host: 10.222.0.17 Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: Openstack-Api-Version: compute 2.90 Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: Openstack-System-Scope: None Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: User-Agent: python-novaclient Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: X-Auth-Token: gAAAAABi133q-1Kq0d50pFQ7Mh3Y5-l_g3D6p5_3p8uaaLjTKuM_Q4q6n5H0QFM_MJjUushxqZN9TEYOoBzsMHlByQy-XxU0vatOtNMD473zJpIdxggeRWISYlakA5ScrCKHdNlOh9YYEzCgzWH928kUTBnEI3-7FjZbwZlYoekrj6lfKSzr39s Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: X-Domain-Id: None Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: X-Domain-Name: None Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: X-Identity-Status: Confirmed Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: X-Is-Admin-Project: True Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: X-Project-Domain-Id: default Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: X-Project-Domain-Name: Default Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: X-Project-Id: 4e097fcfa05c4ea78191e1232beed157 Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: X-Project-Name: admin Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: X-Role: reader,member,admin Jul 20 04:00:43.088104 n-d-826526-5 devstack@n-api.service[112523]: X-Roles: reader,member,admin Jul 20 04:00:43.089597 n-d-826526-5 devstack@n-api.service[112523]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e097fcfa05c4ea78191e1232beed157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4e097fcfa05c4ea78191e1232beed157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4e097fcfa05c4ea78191e1232beed157", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e097fcfa05c4ea78191e1232beed157"}]}] Jul 20 04:00:43.089597 n-d-826526-5 devstack@n-api.service[112523]: X-Tenant: admin Jul 20 04:00:43.089597 n-d-826526-5 devstack@n-api.service[112523]: X-Tenant-Id: 4e097fcfa05c4ea78191e1232beed157 Jul 20 04:00:43.089597 n-d-826526-5 devstack@n-api.service[112523]: X-Tenant-Name: admin Jul 20 04:00:43.089597 n-d-826526-5 devstack@n-api.service[112523]: X-User: admin Jul 20 04:00:43.089597 n-d-826526-5 devstack@n-api.service[112523]: X-User-Domain-Id: default Jul 20 04:00:43.089597 n-d-826526-5 devstack@n-api.service[112523]: X-User-Domain-Name: Default Jul 20 04:00:43.089597 n-d-826526-5 devstack@n-api.service[112523]: X-User-Id: 7701f78c3c4a48af926d71e8c850352c Jul 20 04:00:43.089597 n-d-826526-5 devstack@n-api.service[112523]: X-User-Name: admin Jul 20 04:00:43.089597 n-d-826526-5 devstack@n-api.service[112523]: method: > Jul 20 04:00:43.089597 n-d-826526-5 devstack@n-api.service[112523]: exception: Flavor 42 could not be found. Jul 20 04:00:43.089597 n-d-826526-5 devstack@n-api.service[112523]: action_args: {'id': '42'} Jul 20 04:00:43.089597 n-d-826526-5 devstack@n-api.service[112523]: {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:00:43.089597 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:00:43.090782 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:00:43.092454 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:00:43.092454 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:00:43.092454 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:00:43.092454 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:00:43.092454 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 04:00:43.092454 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:00:43.092454 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 04:00:43.092454 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Jul 20 04:00:43.092454 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:00:43.092454 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Jul 20 04:00:43.092454 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:00:43.092454 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:00:43.092454 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:00:43.092454 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:00:43.092454 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:00:43.092454 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 04:00:43.092454 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Jul 20 04:00:43.092454 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-6082d833-c8eb-45c4-9d12-fc3d4abd11cd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:00:43.094155 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-6082d833-c8eb-45c4-9d12-fc3d4abd11cd admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015084 Jul 20 04:00:43.094155 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 04:00:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:00:44.079190 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-eeab8dba-249d-491b-9ae2-fd640bd91ef6 admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:44.080718 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-eeab8dba-249d-491b-9ae2-fd640bd91ef6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001898 Jul 20 04:00:44.081326 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 04:00:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:00:44.651203 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-ae679f0a-f920-4979-8c02-96bfe62bd0d8 admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:44.657294 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.wsgi [None req-ae679f0a-f920-4979-8c02-96bfe62bd0d8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-ae679f0a-f920-4979-8c02-96bfe62bd0d8 admin admin] Request method failure captured: Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: Accept: application/json Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: Accept-Encoding: gzip, deflate Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: Connection: keep-alive Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: Content-Length: 0 Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: Host: 10.222.0.17 Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: Openstack-Api-Version: compute 2.90 Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: Openstack-System-Scope: None Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: User-Agent: python-novaclient Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: X-Auth-Token: gAAAAABi133rgZHCajEXjkM6kNEW3M37IC3CpI4p98FnVyAS95UzSZJt6iV0zSKaPjQuTfmw_KY702a1HGLAn93ztcKH1H4Er9jk_73-JoX7SI3CUNPnun9Zq0pHXr_J179iWGKKIdfv7SHEbuL_CYqT_AKEXwZvQuR13Vx57_FtjDftL2AX1k8 Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: X-Domain-Id: None Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: X-Domain-Name: None Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: X-Identity-Status: Confirmed Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: X-Is-Admin-Project: True Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: X-Project-Domain-Id: default Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: X-Project-Domain-Name: Default Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: X-Project-Id: 4e097fcfa05c4ea78191e1232beed157 Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: X-Project-Name: admin Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: X-Role: reader,member,admin Jul 20 04:00:44.658813 n-d-826526-5 devstack@n-api.service[112523]: X-Roles: reader,member,admin Jul 20 04:00:44.660401 n-d-826526-5 devstack@n-api.service[112523]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e097fcfa05c4ea78191e1232beed157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4e097fcfa05c4ea78191e1232beed157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4e097fcfa05c4ea78191e1232beed157", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e097fcfa05c4ea78191e1232beed157"}]}] Jul 20 04:00:44.660401 n-d-826526-5 devstack@n-api.service[112523]: X-Tenant: admin Jul 20 04:00:44.660401 n-d-826526-5 devstack@n-api.service[112523]: X-Tenant-Id: 4e097fcfa05c4ea78191e1232beed157 Jul 20 04:00:44.660401 n-d-826526-5 devstack@n-api.service[112523]: X-Tenant-Name: admin Jul 20 04:00:44.660401 n-d-826526-5 devstack@n-api.service[112523]: X-User: admin Jul 20 04:00:44.660401 n-d-826526-5 devstack@n-api.service[112523]: X-User-Domain-Id: default Jul 20 04:00:44.660401 n-d-826526-5 devstack@n-api.service[112523]: X-User-Domain-Name: Default Jul 20 04:00:44.660401 n-d-826526-5 devstack@n-api.service[112523]: X-User-Id: 7701f78c3c4a48af926d71e8c850352c Jul 20 04:00:44.660401 n-d-826526-5 devstack@n-api.service[112523]: X-User-Name: admin Jul 20 04:00:44.660401 n-d-826526-5 devstack@n-api.service[112523]: method: > Jul 20 04:00:44.660401 n-d-826526-5 devstack@n-api.service[112523]: exception: Flavor 84 could not be found. Jul 20 04:00:44.660401 n-d-826526-5 devstack@n-api.service[112523]: action_args: {'id': '84'} Jul 20 04:00:44.660401 n-d-826526-5 devstack@n-api.service[112523]: {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:00:44.660401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:00:44.661401 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:00:44.662559 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:00:44.662559 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:00:44.662559 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:00:44.662559 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:00:44.662559 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 04:00:44.662559 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:00:44.662559 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 04:00:44.662559 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Jul 20 04:00:44.662559 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:00:44.662559 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Jul 20 04:00:44.662559 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:00:44.662559 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:00:44.662559 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:00:44.662559 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:00:44.662559 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:00:44.662559 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 04:00:44.662559 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Jul 20 04:00:44.662559 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-ae679f0a-f920-4979-8c02-96bfe62bd0d8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:00:44.663642 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-ae679f0a-f920-4979-8c02-96bfe62bd0d8 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.439895 Jul 20 04:00:44.663642 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 04:00:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:00:44.670598 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-345e3776-18cd-42e6-8048-e56bb9a5fdbc admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:44.684279 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-345e3776-18cd-42e6-8048-e56bb9a5fdbc admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017480 Jul 20 04:00:44.684841 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jul 20 04:00:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:00:44.694257 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-9c6250a9-3bce-4a81-a0db-928cc92f8602 admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:44.708091 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-9c6250a9-3bce-4a81-a0db-928cc92f8602 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017474 Jul 20 04:00:44.708620 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jul 20 04:00:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:00:44.717921 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-11fa0956-ee2b-4fb2-b624-f35521318bd0 admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:44.723572 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.wsgi [None req-11fa0956-ee2b-4fb2-b624-f35521318bd0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-11fa0956-ee2b-4fb2-b624-f35521318bd0 admin admin] Request method failure captured: Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: Accept: application/json Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: Accept-Encoding: gzip, deflate Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: Connection: keep-alive Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: Content-Length: 0 Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: Host: 10.222.0.17 Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: Openstack-Api-Version: compute 2.90 Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: Openstack-System-Scope: None Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: User-Agent: python-novaclient Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: X-Auth-Token: gAAAAABi133rgZHCajEXjkM6kNEW3M37IC3CpI4p98FnVyAS95UzSZJt6iV0zSKaPjQuTfmw_KY702a1HGLAn93ztcKH1H4Er9jk_73-JoX7SI3CUNPnun9Zq0pHXr_J179iWGKKIdfv7SHEbuL_CYqT_AKEXwZvQuR13Vx57_FtjDftL2AX1k8 Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: X-Domain-Id: None Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: X-Domain-Name: None Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: X-Identity-Status: Confirmed Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: X-Is-Admin-Project: True Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: X-Project-Domain-Id: default Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: X-Project-Domain-Name: Default Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: X-Project-Id: 4e097fcfa05c4ea78191e1232beed157 Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: X-Project-Name: admin Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: X-Role: reader,member,admin Jul 20 04:00:44.725159 n-d-826526-5 devstack@n-api.service[112524]: X-Roles: reader,member,admin Jul 20 04:00:44.726658 n-d-826526-5 devstack@n-api.service[112524]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e097fcfa05c4ea78191e1232beed157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4e097fcfa05c4ea78191e1232beed157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4e097fcfa05c4ea78191e1232beed157", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e097fcfa05c4ea78191e1232beed157"}]}] Jul 20 04:00:44.726658 n-d-826526-5 devstack@n-api.service[112524]: X-Tenant: admin Jul 20 04:00:44.726658 n-d-826526-5 devstack@n-api.service[112524]: X-Tenant-Id: 4e097fcfa05c4ea78191e1232beed157 Jul 20 04:00:44.726658 n-d-826526-5 devstack@n-api.service[112524]: X-Tenant-Name: admin Jul 20 04:00:44.726658 n-d-826526-5 devstack@n-api.service[112524]: X-User: admin Jul 20 04:00:44.726658 n-d-826526-5 devstack@n-api.service[112524]: X-User-Domain-Id: default Jul 20 04:00:44.726658 n-d-826526-5 devstack@n-api.service[112524]: X-User-Domain-Name: Default Jul 20 04:00:44.726658 n-d-826526-5 devstack@n-api.service[112524]: X-User-Id: 7701f78c3c4a48af926d71e8c850352c Jul 20 04:00:44.726658 n-d-826526-5 devstack@n-api.service[112524]: X-User-Name: admin Jul 20 04:00:44.726658 n-d-826526-5 devstack@n-api.service[112524]: method: > Jul 20 04:00:44.726658 n-d-826526-5 devstack@n-api.service[112524]: exception: Flavor 84 could not be found. Jul 20 04:00:44.726658 n-d-826526-5 devstack@n-api.service[112524]: action_args: {'id': '84'} Jul 20 04:00:44.726658 n-d-826526-5 devstack@n-api.service[112524]: {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:00:44.726658 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:00:44.727609 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:00:44.728910 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:00:44.728910 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:00:44.728910 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:00:44.728910 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:00:44.728910 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 04:00:44.728910 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:00:44.728910 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 04:00:44.728910 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Jul 20 04:00:44.728910 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:00:44.728910 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Jul 20 04:00:44.728910 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:00:44.728910 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:00:44.728910 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:00:44.728910 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:00:44.728910 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:00:44.728910 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 04:00:44.728910 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Jul 20 04:00:44.728910 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-11fa0956-ee2b-4fb2-b624-f35521318bd0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:00:44.729941 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-11fa0956-ee2b-4fb2-b624-f35521318bd0 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012056 Jul 20 04:00:44.729941 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 04:00:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:00:45.724889 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-9c6250a9-3bce-4a81-a0db-928cc92f8602 admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:45.725895 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-9c6250a9-3bce-4a81-a0db-928cc92f8602 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 20 04:00:45.726297 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 04:00:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:00:46.290957 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-8852a77e-ebaf-472c-8e5e-1ee7967cec29 admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:46.297059 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.wsgi [None req-8852a77e-ebaf-472c-8e5e-1ee7967cec29 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-8852a77e-ebaf-472c-8e5e-1ee7967cec29 admin admin] Request method failure captured: Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: Accept: application/json Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: Accept-Encoding: gzip, deflate Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: Connection: keep-alive Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: Content-Length: 0 Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: Host: 10.222.0.17 Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: Openstack-Api-Version: compute 2.90 Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: Openstack-System-Scope: None Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: User-Agent: python-novaclient Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: X-Auth-Token: gAAAAABi133tEu5X2dqdS0sVOgNc2b4Pn0Q-jW8a3JDMxGGZqGwAk_hkhBBh-rwYGC1gPaxceFNbM1JBMjrN_OjumI3pvdTqmZbEe3gJfOs9Fc151PNEbzwl-zHJ_Z7v10nGvQeBEBB5Ge-lkm31g0PV9gyUnXIAawdanNf3jCoQTL0Z1C_Ekdc Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: X-Domain-Id: None Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: X-Domain-Name: None Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: X-Identity-Status: Confirmed Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: X-Is-Admin-Project: True Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: X-Project-Domain-Id: default Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: X-Project-Domain-Name: Default Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: X-Project-Id: 4e097fcfa05c4ea78191e1232beed157 Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: X-Project-Name: admin Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: X-Role: reader,member,admin Jul 20 04:00:46.298561 n-d-826526-5 devstack@n-api.service[112524]: X-Roles: reader,member,admin Jul 20 04:00:46.300140 n-d-826526-5 devstack@n-api.service[112524]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e097fcfa05c4ea78191e1232beed157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4e097fcfa05c4ea78191e1232beed157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4e097fcfa05c4ea78191e1232beed157", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e097fcfa05c4ea78191e1232beed157"}]}] Jul 20 04:00:46.300140 n-d-826526-5 devstack@n-api.service[112524]: X-Tenant: admin Jul 20 04:00:46.300140 n-d-826526-5 devstack@n-api.service[112524]: X-Tenant-Id: 4e097fcfa05c4ea78191e1232beed157 Jul 20 04:00:46.300140 n-d-826526-5 devstack@n-api.service[112524]: X-Tenant-Name: admin Jul 20 04:00:46.300140 n-d-826526-5 devstack@n-api.service[112524]: X-User: admin Jul 20 04:00:46.300140 n-d-826526-5 devstack@n-api.service[112524]: X-User-Domain-Id: default Jul 20 04:00:46.300140 n-d-826526-5 devstack@n-api.service[112524]: X-User-Domain-Name: Default Jul 20 04:00:46.300140 n-d-826526-5 devstack@n-api.service[112524]: X-User-Id: 7701f78c3c4a48af926d71e8c850352c Jul 20 04:00:46.300140 n-d-826526-5 devstack@n-api.service[112524]: X-User-Name: admin Jul 20 04:00:46.300140 n-d-826526-5 devstack@n-api.service[112524]: method: > Jul 20 04:00:46.300140 n-d-826526-5 devstack@n-api.service[112524]: exception: Flavor 451 could not be found. Jul 20 04:00:46.300140 n-d-826526-5 devstack@n-api.service[112524]: action_args: {'id': '451'} Jul 20 04:00:46.300140 n-d-826526-5 devstack@n-api.service[112524]: {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:00:46.300140 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:00:46.301028 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:00:46.302133 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:00:46.302133 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:00:46.302133 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:00:46.302133 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:00:46.302133 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 04:00:46.302133 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:00:46.302133 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 04:00:46.302133 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Jul 20 04:00:46.302133 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:00:46.302133 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Jul 20 04:00:46.302133 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:00:46.302133 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:00:46.302133 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:00:46.302133 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:00:46.302133 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:00:46.302133 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 04:00:46.302133 n-d-826526-5 devstack@n-api.service[112524]: ERROR nova.api.openstack.wsgi Jul 20 04:00:46.302133 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-8852a77e-ebaf-472c-8e5e-1ee7967cec29 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:00:46.303188 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-8852a77e-ebaf-472c-8e5e-1ee7967cec29 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.438382 Jul 20 04:00:46.303188 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 04:00:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 440 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:00:46.310109 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-bf48b1f9-c203-4148-a816-7ebc4769dfc8 admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:46.326586 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-bf48b1f9-c203-4148-a816-7ebc4769dfc8 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020060 Jul 20 04:00:46.327117 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jul 20 04:00:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:00:46.339586 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-b6b72450-2089-4351-96c5-690d641bbfdf admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:46.356291 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-b6b72450-2089-4351-96c5-690d641bbfdf admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020267 Jul 20 04:00:46.356889 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jul 20 04:00:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:00:46.366757 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-a184fae5-3ca8-45c4-9628-0d0755f92d0a admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:46.373253 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.wsgi [None req-a184fae5-3ca8-45c4-9628-0d0755f92d0a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-a184fae5-3ca8-45c4-9628-0d0755f92d0a admin admin] Request method failure captured: Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: Accept: application/json Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: Accept-Encoding: gzip, deflate Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: Connection: keep-alive Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: Content-Length: 0 Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: Host: 10.222.0.17 Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: Openstack-Api-Version: compute 2.90 Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: Openstack-System-Scope: None Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: User-Agent: python-novaclient Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: X-Auth-Token: gAAAAABi133tEu5X2dqdS0sVOgNc2b4Pn0Q-jW8a3JDMxGGZqGwAk_hkhBBh-rwYGC1gPaxceFNbM1JBMjrN_OjumI3pvdTqmZbEe3gJfOs9Fc151PNEbzwl-zHJ_Z7v10nGvQeBEBB5Ge-lkm31g0PV9gyUnXIAawdanNf3jCoQTL0Z1C_Ekdc Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: X-Domain-Id: None Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: X-Domain-Name: None Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: X-Identity-Status: Confirmed Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: X-Is-Admin-Project: True Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: X-Project-Domain-Id: default Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: X-Project-Domain-Name: Default Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: X-Project-Id: 4e097fcfa05c4ea78191e1232beed157 Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: X-Project-Name: admin Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: X-Role: reader,member,admin Jul 20 04:00:46.374772 n-d-826526-5 devstack@n-api.service[112523]: X-Roles: reader,member,admin Jul 20 04:00:46.376308 n-d-826526-5 devstack@n-api.service[112523]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e097fcfa05c4ea78191e1232beed157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4e097fcfa05c4ea78191e1232beed157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4e097fcfa05c4ea78191e1232beed157", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e097fcfa05c4ea78191e1232beed157"}]}] Jul 20 04:00:46.376308 n-d-826526-5 devstack@n-api.service[112523]: X-Tenant: admin Jul 20 04:00:46.376308 n-d-826526-5 devstack@n-api.service[112523]: X-Tenant-Id: 4e097fcfa05c4ea78191e1232beed157 Jul 20 04:00:46.376308 n-d-826526-5 devstack@n-api.service[112523]: X-Tenant-Name: admin Jul 20 04:00:46.376308 n-d-826526-5 devstack@n-api.service[112523]: X-User: admin Jul 20 04:00:46.376308 n-d-826526-5 devstack@n-api.service[112523]: X-User-Domain-Id: default Jul 20 04:00:46.376308 n-d-826526-5 devstack@n-api.service[112523]: X-User-Domain-Name: Default Jul 20 04:00:46.376308 n-d-826526-5 devstack@n-api.service[112523]: X-User-Id: 7701f78c3c4a48af926d71e8c850352c Jul 20 04:00:46.376308 n-d-826526-5 devstack@n-api.service[112523]: X-User-Name: admin Jul 20 04:00:46.376308 n-d-826526-5 devstack@n-api.service[112523]: method: > Jul 20 04:00:46.376308 n-d-826526-5 devstack@n-api.service[112523]: exception: Flavor 451 could not be found. Jul 20 04:00:46.376308 n-d-826526-5 devstack@n-api.service[112523]: action_args: {'id': '451'} Jul 20 04:00:46.376308 n-d-826526-5 devstack@n-api.service[112523]: {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:00:46.376308 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:00:46.377225 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:00:46.378257 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:00:46.378257 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:00:46.378257 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:00:46.378257 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:00:46.378257 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 04:00:46.378257 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:00:46.378257 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 04:00:46.378257 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Jul 20 04:00:46.378257 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:00:46.378257 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Jul 20 04:00:46.378257 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:00:46.378257 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:00:46.378257 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:00:46.378257 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:00:46.378257 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:00:46.378257 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 04:00:46.378257 n-d-826526-5 devstack@n-api.service[112523]: ERROR nova.api.openstack.wsgi Jul 20 04:00:46.378257 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-a184fae5-3ca8-45c4-9628-0d0755f92d0a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:00:46.379331 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-a184fae5-3ca8-45c4-9628-0d0755f92d0a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013074 Jul 20 04:00:46.379331 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 04:00:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:00:47.403003 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-b6b72450-2089-4351-96c5-690d641bbfdf admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:47.404010 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-b6b72450-2089-4351-96c5-690d641bbfdf admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 20 04:00:47.404469 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 04:00:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:00:47.973103 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-3f746967-bddc-43de-bcfe-ab9f9a91c1c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:00:47.995180 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-3f746967-bddc-43de-bcfe-ab9f9a91c1c7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.451443 Jul 20 04:00:47.995743 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Jul 20 04:00:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:00:48.998756 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-b6b72450-2089-4351-96c5-690d641bbfdf admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:49.000157 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-b6b72450-2089-4351-96c5-690d641bbfdf admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002149 Jul 20 04:00:49.000613 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 04:00:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:00:49.684100 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-10e85ba2-fb49-42b8-83f7-06cde18f228c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:00:49.707902 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-10e85ba2-fb49-42b8-83f7-06cde18f228c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.569546 Jul 20 04:00:49.708752 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Jul 20 04:00:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:00:50.713875 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-b6b72450-2089-4351-96c5-690d641bbfdf admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:50.714896 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-b6b72450-2089-4351-96c5-690d641bbfdf admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 20 04:00:50.715271 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 04:00:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:00:51.302066 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-e6562c7e-b540-4cbf-8cd6-8c37918e41b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:00:51.326238 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-e6562c7e-b540-4cbf-8cd6-8c37918e41b1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.472591 Jul 20 04:00:51.326915 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Jul 20 04:00:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:00:52.355211 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-b6b72450-2089-4351-96c5-690d641bbfdf admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:52.356237 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-b6b72450-2089-4351-96c5-690d641bbfdf admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 20 04:00:52.356657 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 04:00:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:00:52.931216 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-e6f342ae-74c2-4c3f-b472-3bf194e9076c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:00:52.951190 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-e6f342ae-74c2-4c3f-b472-3bf194e9076c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.451745 Jul 20 04:00:52.951790 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Jul 20 04:00:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:00:53.946006 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-b6b72450-2089-4351-96c5-690d641bbfdf admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:53.947005 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-b6b72450-2089-4351-96c5-690d641bbfdf admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 20 04:00:53.947396 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 04:00:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:00:54.498882 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-c02794ed-5bb2-4701-99ae-b14b55278b94 admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:54.523276 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-c02794ed-5bb2-4701-99ae-b14b55278b94 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.440041 Jul 20 04:00:54.523741 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Wed Jul 20 04:00:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:01:46.864542 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-b6b72450-2089-4351-96c5-690d641bbfdf admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:46.865550 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-b6b72450-2089-4351-96c5-690d641bbfdf admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jul 20 04:01:46.865939 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 04:01:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:01:46.880368 n-d-826526-5 devstack@n-api.service[112523]: DEBUG dbcounter [-] [112523] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:01:47.338630 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-9b246137-e96f-44bc-94ea-f5399df84d87 admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:47.358354 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-9b246137-e96f-44bc-94ea-f5399df84d87 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.485797 Jul 20 04:01:47.358897 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Jul 20 04:01:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:01:47.384785 n-d-826526-5 devstack@n-api.service[112524]: DEBUG dbcounter [-] [112524] Writing DB stats nova_api:SELECT=14 {{(pid=112524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:01:47.388921 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-60f99176-2ab9-425d-9583-c3715fbcf631 admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:47.397544 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-60f99176-2ab9-425d-9583-c3715fbcf631 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015037 Jul 20 04:01:47.398038 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1282 bytes} [Wed Jul 20 04:01:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:01:47.416068 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-5704d28f-d423-403b-8e03-f7b97164c27b admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:47.424685 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-5704d28f-d423-403b-8e03-f7b97164c27b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013161 Jul 20 04:01:47.425234 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1285 bytes} [Wed Jul 20 04:01:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:01:47.437190 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-9699343a-9b68-41b9-8fc1-6d748739e084 admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:47.445407 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-9699343a-9b68-41b9-8fc1-6d748739e084 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011869 Jul 20 04:01:47.445930 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1285 bytes} [Wed Jul 20 04:01:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:01:47.458766 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-d25aef17-5056-47ab-9cea-6defc3d8b7b2 admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:47.466849 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-d25aef17-5056-47ab-9cea-6defc3d8b7b2 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011800 Jul 20 04:01:47.467365 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1282 bytes} [Wed Jul 20 04:01:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:14.317850 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-9699343a-9b68-41b9-8fc1-6d748739e084 admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:14.318891 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-9699343a-9b68-41b9-8fc1-6d748739e084 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Jul 20 04:07:14.319262 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 04:07:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:14.460167 n-d-826526-5 devstack@n-api.service[112523]: DEBUG dbcounter [-] [112523] Writing DB stats nova_api:SELECT=6 {{(pid=112523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:14.621855 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-09f2e708-c0c7-4d47-b429-45a356783a35 admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:14.623051 n-d-826526-5 devstack@n-api.service[112523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:14.623051 n-d-826526-5 devstack@n-api.service[112523]: warnings.warn(msg) Jul 20 04:07:14.624249 n-d-826526-5 devstack@n-api.service[112523]: DEBUG oslo_concurrency.lockutils [None req-09f2e708-c0c7-4d47-b429-45a356783a35 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:14.624754 n-d-826526-5 devstack@n-api.service[112523]: DEBUG oslo_concurrency.lockutils [None req-09f2e708-c0c7-4d47-b429-45a356783a35 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:14.625532 n-d-826526-5 devstack@n-api.service[112523]: DEBUG oslo_concurrency.lockutils [None req-09f2e708-c0c7-4d47-b429-45a356783a35 admin admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:14.626085 n-d-826526-5 devstack@n-api.service[112523]: DEBUG oslo_concurrency.lockutils [None req-09f2e708-c0c7-4d47-b429-45a356783a35 admin admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:14.666760 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-09f2e708-c0c7-4d47-b429-45a356783a35 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.209224 Jul 20 04:07:14.667343 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 04:07:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:07:15.522207 n-d-826526-5 devstack@n-api.service[112524]: DEBUG nova.api.openstack.wsgi [None req-9699343a-9b68-41b9-8fc1-6d748739e084 admin admin] Calling method '>' {{(pid=112524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:15.523206 n-d-826526-5 devstack@n-api.service[112524]: INFO nova.api.openstack.requestlog [None req-9699343a-9b68-41b9-8fc1-6d748739e084 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 20 04:07:15.523583 n-d-826526-5 devstack@n-api.service[112524]: [pid: 112524|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 04:07:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:15.718167 n-d-826526-5 devstack@n-api.service[112523]: DEBUG nova.api.openstack.wsgi [None req-ea6258ea-bc45-4e8f-bf61-81a8362ff492 admin admin] Calling method '>' {{(pid=112523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:15.719356 n-d-826526-5 devstack@n-api.service[112523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:15.719356 n-d-826526-5 devstack@n-api.service[112523]: warnings.warn(msg) Jul 20 04:07:15.720569 n-d-826526-5 devstack@n-api.service[112523]: DEBUG oslo_concurrency.lockutils [None req-ea6258ea-bc45-4e8f-bf61-81a8362ff492 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:15.721116 n-d-826526-5 devstack@n-api.service[112523]: DEBUG oslo_concurrency.lockutils [None req-ea6258ea-bc45-4e8f-bf61-81a8362ff492 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:15.721817 n-d-826526-5 devstack@n-api.service[112523]: DEBUG oslo_concurrency.lockutils [None req-ea6258ea-bc45-4e8f-bf61-81a8362ff492 admin admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:15.722230 n-d-826526-5 devstack@n-api.service[112523]: DEBUG oslo_concurrency.lockutils [None req-ea6258ea-bc45-4e8f-bf61-81a8362ff492 admin admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:15.745249 n-d-826526-5 devstack@n-api.service[112523]: INFO nova.api.openstack.requestlog [None req-ea6258ea-bc45-4e8f-bf61-81a8362ff492 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.084252 Jul 20 04:07:15.745803 n-d-826526-5 devstack@n-api.service[112523]: [pid: 112523|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 04:07:15 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:02.642986 n-d-826526-5 devstack@n-api.service[112522]: Wed Jul 20 04:08:02 2022 - graceful shutdown triggered... Jul 20 04:08:02.643126 n-d-826526-5 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 20 04:08:02.644041 n-d-826526-5 devstack@n-api.service[112524]: Gracefully killing worker 2 (pid: 112524)... Jul 20 04:08:02.644475 n-d-826526-5 devstack@n-api.service[112523]: Gracefully killing worker 1 (pid: 112523)... Jul 20 04:08:03.645150 n-d-826526-5 devstack@n-api.service[112522]: worker 1 buried after 1 seconds Jul 20 04:08:03.645150 n-d-826526-5 devstack@n-api.service[112522]: worker 2 buried after 1 seconds Jul 20 04:08:03.645150 n-d-826526-5 devstack@n-api.service[112522]: goodbye to uWSGI. Jul 20 04:08:03.646744 n-d-826526-5 systemd[1]: devstack@n-api.service: Succeeded. Jul 20 04:08:03.647349 n-d-826526-5 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 20 04:08:03.650375 n-d-826526-5 systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 04:08:03.666419 n-d-826526-5 devstack@n-api.service[127859]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 04:08:03.762976 n-d-826526-5 devstack@n-api.service[127859]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 04:08:03 2022] *** Jul 20 04:08:03.762976 n-d-826526-5 devstack@n-api.service[127859]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 04:08:03.762976 n-d-826526-5 devstack@n-api.service[127859]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 04:08:03.762976 n-d-826526-5 devstack@n-api.service[127859]: nodename: n-d-826526-5 Jul 20 04:08:03.762976 n-d-826526-5 devstack@n-api.service[127859]: machine: x86_64 Jul 20 04:08:03.762976 n-d-826526-5 devstack@n-api.service[127859]: clock source: unix Jul 20 04:08:03.762976 n-d-826526-5 devstack@n-api.service[127859]: pcre jit disabled Jul 20 04:08:03.762976 n-d-826526-5 devstack@n-api.service[127859]: detected number of CPU cores: 4 Jul 20 04:08:03.762976 n-d-826526-5 devstack@n-api.service[127859]: current working directory: / Jul 20 04:08:03.762976 n-d-826526-5 devstack@n-api.service[127859]: detected binary path: /usr/bin/uwsgi-core Jul 20 04:08:03.762976 n-d-826526-5 devstack@n-api.service[127859]: your processes number limit is 47680 Jul 20 04:08:03.762976 n-d-826526-5 devstack@n-api.service[127859]: your memory page size is 4096 bytes Jul 20 04:08:03.762976 n-d-826526-5 devstack@n-api.service[127859]: detected max file descriptor number: 2048 Jul 20 04:08:03.762976 n-d-826526-5 devstack@n-api.service[127859]: lock engine: pthread robust mutexes Jul 20 04:08:03.764141 n-d-826526-5 devstack@n-api.service[127859]: thunder lock: enabled Jul 20 04:08:03.764141 n-d-826526-5 devstack@n-api.service[127859]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 04:08:03.764141 n-d-826526-5 devstack@n-api.service[127859]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 04:08:03.810425 n-d-826526-5 devstack@n-api.service[127859]: Python main interpreter initialized at 0x55e96cefb9c0 Jul 20 04:08:03.810425 n-d-826526-5 devstack@n-api.service[127859]: python threads support enabled Jul 20 04:08:03.810425 n-d-826526-5 devstack@n-api.service[127859]: your server socket listen backlog is limited to 100 connections Jul 20 04:08:03.810425 n-d-826526-5 devstack@n-api.service[127859]: your mercy for graceful operations on workers is 90 seconds Jul 20 04:08:03.810897 n-d-826526-5 devstack@n-api.service[127859]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 04:08:03.810897 n-d-826526-5 devstack@n-api.service[127859]: *** Operational MODE: preforking *** Jul 20 04:08:03.811137 n-d-826526-5 devstack@n-api.service[127859]: *** uWSGI is running in multiple interpreter mode *** Jul 20 04:08:03.811137 n-d-826526-5 devstack@n-api.service[127859]: spawned uWSGI master process (pid: 127859) Jul 20 04:08:03.811324 n-d-826526-5 systemd[1]: Started Devstack devstack@n-api.service. Jul 20 04:08:03.811920 n-d-826526-5 devstack@n-api.service[127859]: spawned uWSGI worker 1 (pid: 127870, cores: 1) Jul 20 04:08:03.827774 n-d-826526-5 devstack@n-api.service[127859]: spawned uWSGI worker 2 (pid: 127871, cores: 1) Jul 20 04:08:03.827774 n-d-826526-5 devstack@n-api.service[127859]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 04:08:04.477587 n-d-826526-5 devstack@n-api.service[127871]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 04:08:04.485878 n-d-826526-5 devstack@n-api.service[127870]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 04:08:05.668095 n-d-826526-5 devstack@n-api.service[127871]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:08:05.668095 n-d-826526-5 devstack@n-api.service[127871]: from cryptography.utils import int_from_bytes Jul 20 04:08:05.668868 n-d-826526-5 devstack@n-api.service[127871]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:08:05.668868 n-d-826526-5 devstack@n-api.service[127871]: from cryptography.utils import int_from_bytes Jul 20 04:08:05.675706 n-d-826526-5 devstack@n-api.service[127870]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:08:05.675706 n-d-826526-5 devstack@n-api.service[127870]: from cryptography.utils import int_from_bytes Jul 20 04:08:05.676198 n-d-826526-5 devstack@n-api.service[127870]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:08:05.676198 n-d-826526-5 devstack@n-api.service[127870]: from cryptography.utils import int_from_bytes Jul 20 04:08:07.972361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 04:08:07.972945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 04:08:07.973165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 04:08:07.973532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 04:08:07.973760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 04:08:07.974178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.974475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.974828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.975149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.975489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.975767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.976111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.976453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.976779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.977098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.977506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.977830 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-826526-5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.978156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.978442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.978748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.979066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.979367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.979692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.979998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.980514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.981172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.981483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.981795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.982134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.982456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.982771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.983105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.983407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.983730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.984042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.984469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-826526-5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.984793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.985106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.985421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.985832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.986146 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.986458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.986783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.987116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.987433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.987759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.988077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.988196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 04:08:07.988635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.988736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 04:08:07.988824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.989008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 04:08:07.989148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.989315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.989431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 04:08:07.989621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 04:08:07.989738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.989934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.990033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.990239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.990340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.990546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.990670 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.990787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.990937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.991092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.991267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.991411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.991581 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.991733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.991903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.992054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.992224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.992342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.992605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.992700 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.992871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.992973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.993188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.993289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.993514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-826526-5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.993623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.993826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.993926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.994132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.994228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.994437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.994536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.994746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.994861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.995054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.995154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.995358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.995462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.995667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.995775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.995981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.996164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.996330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.996506 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.996655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.996814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.996978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.997130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.997277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.997465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.997674 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.997777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.997927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.998084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.998235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.998407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.998571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.998723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.998888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.999049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.999249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.999413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.999559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.999742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-826526-5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:07.999894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.000062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.000205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.000396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.000563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.000713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.000812 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.001023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.001134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.001361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.001530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.001681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.001837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.001983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.002127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.002265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.002412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.002555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.002701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.002846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.002992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.003136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.003273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.003428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.003650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.003881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.004022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.004160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.004329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.004477 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.004629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.004767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.004905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.005041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.005219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.005328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.005414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.005504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.005637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.005733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.005888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.006030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.006195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.006335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.006525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.006660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.006858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.006970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.007213 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.007413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.007519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.007608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.007706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.008168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.008433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.008769 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.009080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.009396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.009705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.009856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.010018 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.010121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.010306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.010444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.010616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.010769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.010922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.011032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.011186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.011325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.011543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.011727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.011838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.011943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.012167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.012355 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.012460 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.012558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.012814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.012978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.013196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.013343 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.013437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.013529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.013746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.014109 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.014224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.014321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.014415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.014507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.014687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.014837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.014945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.015031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.015290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.015428 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.015576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.015686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.015904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.016042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.016184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.016340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.016543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.016681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.016822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.016930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.017167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.017328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.017422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.017507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.017706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.017843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.018014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.018171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.018334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.018483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.018613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.018713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.018956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.019119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.019220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.019307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.019548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.019685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.019823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.019933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.020159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.020346 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.020452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.020604 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.020763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.021027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.021164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.021292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.021445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.021544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.021650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.021880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.022019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.022171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.022310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.022507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.022663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.022804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.022914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.023144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.023282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.023466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.023602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.023746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.023898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.024118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.024374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.024501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.024591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.024751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.024909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.025003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.025088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.025356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.025494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.025650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.025761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.025957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.026060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.026268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.026360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.026580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.026687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.026889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.026983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.027207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.027301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.027512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.027614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.027818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.027911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.028134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.028236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.028468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.028564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.028775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.028874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.029079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.029172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.029384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.029486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.029688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.029792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.029991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.030086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.030296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.030394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.030599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.030702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.030900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.031221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.031323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.031535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.031628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.031828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.031962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.032136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.032234 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.032469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.032576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.032838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:08:08.032929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.033168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.033265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.033487 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.033585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.033804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.033895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.034120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.034223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.034434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.034541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.034742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.034844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.035049 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.035154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.035356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.035491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.035668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.035766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.035973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.036236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.036378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.036635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.036856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.036949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.037263 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.037424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.037570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.037848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.037938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.038177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.038277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.038495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.038583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.039851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.040009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.040108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.040205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.040375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.040465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.040558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.040650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.040741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.040838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.040924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.041008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.041098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.041098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.041278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.041364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.041556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.041809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.041900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.042166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.042401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.042501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.042777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.042982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.043160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.043347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.043448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.043676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.043767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.043998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.044088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.044819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.044945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.044945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.045113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.045113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.045282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.045282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.045452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.045624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.045730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.045909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.046001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.046215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.046307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.048709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.048856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.048988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.049108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.049216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.049303 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.049394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.049486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.049578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.049669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.049812 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.049936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.050028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.050120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.050212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.050310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.050430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.050534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.050626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.050717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.050809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.050905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.050996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.051080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.051080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.051239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.051358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.051484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.051594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.051703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.051821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.051929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.052016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.052111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.052199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.052433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.052536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.052536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.052704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.052796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.052945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.053036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.053280 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.053371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.053590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.053683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.053903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.053992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.054216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.054305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.054527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.054659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.054834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.054925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.055195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.055291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.055511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.055601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.055820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.055913 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.056141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.056230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.056482 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.056581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.056793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.056892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.057111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.057208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.057418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.057507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.057728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.057860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.058044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.058150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.058357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.058449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.058669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.058760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.058987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.059088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.059300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.059391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.059614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.059703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.059930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.060062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.060240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.060379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.060577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.060675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.060889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.060981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.061206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.061296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.061527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.061624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.061837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.061926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.062155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.062246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.062463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.062602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.062775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.062881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.063081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.063185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.063391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.063494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.063695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.063805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.064002 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.064103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.064332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.064450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.064659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.064753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.064950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.065051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.065254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.065364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.065560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.065661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.065879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.065981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.066182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.066292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.066491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.066590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.066795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.066902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.067098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.067207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.067409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.067504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.067725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.067837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.068039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.068148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.068389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.068488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.068702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.068808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.069020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.069123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.069332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.069426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.069636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.069735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.069951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.070070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.070257 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.070393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.070570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.070836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.070949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.071035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.071213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.071304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.071529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.071632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.071833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.071921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.072142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.072233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.072514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.072669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.072810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.072926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.073137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.073239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.073446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.073550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.073747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.073837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.074090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.074180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.074404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.074503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.074715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.074828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.075037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.075147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.075343 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.075442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.075656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.075869 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.075962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.076045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.076281 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.076433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.076596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.076696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.076908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.076999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.077218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.077316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.077527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.077623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.077838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.077954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.078146 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.078245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.078461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.078557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.078768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.078865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.079086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.079175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.079388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.079493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.079697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.079794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.080006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.080140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.080333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.080427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.080647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.080793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.080966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.081068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.081286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.081548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.081647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.081884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.081983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.082198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.082288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.082505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.082604 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.082813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.082907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.083126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.083276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.083444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.083544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.083756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.083858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.084070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.084161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.084401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.084513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.084724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.084854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.085024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.085188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.085329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.085419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.085636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.085726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.085940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.086071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.086248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.086366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.086606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.086696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.086915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.087006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.087221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.087312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.087528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.087616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.087830 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.087929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.088134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.088232 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.088475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.088598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.088778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.088900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.089080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.089201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.089381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.089507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.089703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.089818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.090010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.090133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.090314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.090437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.090616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.090728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.090930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.091053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.091263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.091413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.091540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.091651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.091840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.091956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.092150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.092299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.092497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.092605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.092815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.092906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.093124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.093224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.093436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.093528 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.093739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.093828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.094049 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.094141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.094360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.094489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.094675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.094784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.094982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.095096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.095285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.095390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.095622 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.095782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.095886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.095983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.096224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.096382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.096531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.096651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.096868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.097135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.097288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.097470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.097610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.097765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.097879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.098099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.098241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.098376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.098496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.098705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.098848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.098985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.099117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.099325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.099480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.099598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.099687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.099937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.100105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.100202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.100319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.100545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.100660 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.100847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.101024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.101166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.101255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.101430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.101523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.101740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.101832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.102121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.102224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.102374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.102464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.102676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.102774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.102985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.103075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.103286 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.103375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.103591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.103683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.103899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.103999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.104250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.104381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.104533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.104632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.104837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.104925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.105156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.105245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.105469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.105616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.105771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.105876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.106081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.106200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.106388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.106496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.106691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.106794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.106998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.107101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.107308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.107443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.107611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.107701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.107919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.108024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.108226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.108416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.108554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.108653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.108857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.108949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.109179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.109278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.109487 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.109588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.109793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.109891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.110095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.110184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.110398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.110488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.110702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.110793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.111016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.111113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.111328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.111421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.111641 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.111786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.111952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.112051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.112285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.112403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.112594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.112720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.112899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.113018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.113219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.113338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.113523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.113642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.113861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.113983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.114124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.114241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.114437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.114535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.114739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.114831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.115042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.115143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.115356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.115451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.115663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.115762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.115974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.116094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.116307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.116418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.116606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.116708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.116912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.117023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.117225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.117327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.117556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.117721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.117894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.117983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.118204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.118415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.118508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.118811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.118969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.119123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.119434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.119528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.119747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.119987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.120094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.120383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.120604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.120698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.120994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.121116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.121307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.121484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.121645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.121799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.121940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.122089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.122228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.122514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.122679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.122838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.122981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.123132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.123276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.123412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.123634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.123769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.123958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.124112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.124414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.124563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.124747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.124984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.125128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.125352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.125530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.125673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.125967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.126143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.126387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.126557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.126700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.126840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.126990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.127129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.127281 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.127426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.127563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.127708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.127852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.127998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.128149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.128348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.128451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.128537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.128757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.128862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.129077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.129168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.129380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.129471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.129683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.129789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.129985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.130076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.130305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.130396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.130608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.130713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.130929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.131020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.131303 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.131392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.131619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.131765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.131934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.132025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.132248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.132409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.132588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.132683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.133232 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.133339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.133547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.133641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.133874 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.133976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.134192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.134290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.134508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.134608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.134817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.134916 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.135126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.135224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.135452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.135567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.135764 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.135963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.136114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.136310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.136639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.136753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.136930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.137040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.137246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.137345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.137565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.137670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.137877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.137986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.138190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.138291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.138508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.138611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.138826 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.138939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.139142 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.139244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.139452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.139558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.139769 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.139872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.140082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.140183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.140429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.140526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.140738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.140843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.141044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.141135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.141349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.141461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.141654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.141759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.141962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.142065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.142271 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.142365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.142698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.142821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.142907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.143071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.143261 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.143425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.143578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.143715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.143856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.144016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.144170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.144339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.144488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.144633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.144785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.144940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.145081 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.145226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.145452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.145602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.145750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.145897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.146037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.146184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.146328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.146474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.146619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.146781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.146993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.147152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.147344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.147516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.147656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.147795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.147933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.148071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.148209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.148423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.148522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.148615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.148710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.148905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.149037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.149237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.149349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.149550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.149661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.149873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.149990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.150258 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.150406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.150584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.150728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.150881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.151039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.151202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.151347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.151491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.151632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.151814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.151970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.152114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.152285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.152436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.152585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.152866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.153020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.153112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.153198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.153291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.153439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.153569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.153751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.153848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.154073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.154175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.154400 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.154564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.154707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.154858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.155005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.155144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.155283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.155436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.155585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.155723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.155908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.156048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.156195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.156363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.156557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.156702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.156878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.157058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.157200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.157293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.157532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.157632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.157846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.157937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.158169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.158262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.158484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.158577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.158789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.158889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.159100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.159193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.159406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.159497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.159713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.159817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.160024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.160122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.160353 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.160463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.160663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.160767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.160972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.161069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.161287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.161387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.161606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.161836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.162160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.162357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.162496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.162792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.163122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.163277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.163442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.163584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.163725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.164004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.164150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.164341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.164679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.164830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.164982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.165288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.165443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.165616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.165900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.166045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.166250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.166473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.166632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.166888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.167055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.167282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.167511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.167692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.167887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.168060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.168327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.168536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.168752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.168949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.169184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.169383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.169605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.169812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.170014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.170228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.170431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.170619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.170831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.171035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.171267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.171490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.171688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.171904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.172143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.172401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.172644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.172860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.173285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.173442 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.173594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.173736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.173963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.174086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.174177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.174272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.174360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.174458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.174546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.174636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.174712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.174815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.174905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.175007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.175096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.175182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.175269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.175362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.175449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.175544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.175544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.175704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.175798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.175896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.176046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.176149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.176245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.176365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.176465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.176553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.176654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.176743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.176866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.176969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.177196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.177367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.177508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.177663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.177814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.177910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.178116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.178208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.178431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.178577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.178734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.178829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.179038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.179140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.179358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.179453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.179667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.179768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.179991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.180253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.180415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.180633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.180731 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.180952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.181051 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.181279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.181372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.181611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.181711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.181932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.182077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.182241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.182332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.182555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.182645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.182871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.183053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.183235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.183472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.183632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.183786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.183937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.184098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.184297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.184449 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.184608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.184750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.184889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.184993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.185090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.185274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.185377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.185583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.185677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.185889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.185984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.186199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.186299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.186508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.186609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.186816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.186912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.187130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.187224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.187444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.187623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.187772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.187873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.188042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.188146 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.188374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.188493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.188681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.188776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.188994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.189097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.189298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.189402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.189612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.189714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.189915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.190010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.190229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.190331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.190535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.190630 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.190846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.190939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.191165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.191267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.191482 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.191620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.191795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.191887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.192102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.192249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.192437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.192538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.192747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.192853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.193059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.193175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.193409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.193503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.193661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.193766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.193992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.194147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.194308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.194400 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.194636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.194836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.194967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.195172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.195274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.195500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.195609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.195859 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.196090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.196194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.196435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.196545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.196771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.196866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.197100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.197200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.197426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.197554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.197739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.197841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.198052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.198160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.198366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.198469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.198678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.198777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.198986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.199088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.199293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.199396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.199603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.199696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.199906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.199998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.200214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.200353 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.200552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.200654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.200862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.200958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.201176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.201284 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.201486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.201589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.201799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.202052 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.202160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.202409 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.202514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.202731 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.202825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.203057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.203194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.203444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.203584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.203721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.203821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.203984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.204087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.204316 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.204417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.204633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.204726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.204947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.205096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.205270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.205371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.205584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.205677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.205890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.205991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.206199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.206298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.206514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.206611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.206843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.206947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.207135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.207230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.207448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.207552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.207760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.207857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.208072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.208174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.208405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.208519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.208716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.208817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.209025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.209126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.209339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.230804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.231161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.231801 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.232192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.235147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.235488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.235890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.236229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.236600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.236825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.237080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.237373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.237373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.237976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.238180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.238457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.238710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.240536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.240840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.241301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.241580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.241795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.241985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.242065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.242404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.242573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.242847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.242847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.243156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.243156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.243274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.243373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.243450 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.243575 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.243693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.243883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.243975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.244043 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.244430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.244561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.244701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.244826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.244970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.245126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.245126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.245534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.245609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.245672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.245817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.245944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.246084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.246194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.246267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.246431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.246519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.246627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.246719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.246793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.246860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.246926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.246926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.247127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.247195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.247261 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.247327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.247393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.247468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.247536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.247604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.247671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.247737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.247811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.247879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.247945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.248011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.248078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.248144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.248144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.248290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.248397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.248489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.248611 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.248686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.248753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.248753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.248880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.248949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.249016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.249082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.249148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.249222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.249289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.249356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.249356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.249474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.249541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.249614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.249682 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.249750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.249816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.249883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.249949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.250022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.250091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.250157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.250223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.250289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.250355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.250430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.250498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.250565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.250632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.250697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.250770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.250838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.250905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.250972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.251091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.251163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.251230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.251305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.251375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.251443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.251510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.251579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.251646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.251723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.251792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.251861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.251929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.251997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.252072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.252141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.252210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.252304 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.252376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.252444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.252524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.252595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.252664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.252775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.252886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.252959 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.253036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.253036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.253160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.253228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.253295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.253362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.253436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.253436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.253560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.253560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.253680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.253755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.253825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.253893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.253950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.253950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.254132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.254232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.254232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 04:08:08.254607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.254607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.254607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.254607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.254607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.254607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.254607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.254607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.255025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.255025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.255025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.255025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.255025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.255025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.255025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.255025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.255663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.255663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.255663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.255663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.255663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.255663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.255663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.255663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.256070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.256070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.256070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.256070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.256070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.256070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.256070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.256070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.257121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.257121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.257121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.257121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.257121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.257121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.257121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.257121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.257560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.257560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.257560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.257560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.257560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.257560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.257560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.257560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.258324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.258324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.258324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.258324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.258324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.258324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.258324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.258324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.258818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.258818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.258818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.258818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.258818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.258818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.258818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.258818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.259245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:08:08.259245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 04:08:08.389707 n-d-826526-5 devstack@n-api.service[127871]: INFO dbcounter [None req-b9ae756b-6eba-486d-aa32-ff07cffffdd5 None None] Registered counter for database nova_api Jul 20 04:08:08.410219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_db.sqlalchemy.engines [None req-b9ae756b-6eba-486d-aa32-ff07cffffdd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:08:08.410931 n-d-826526-5 devstack@n-api.service[127870]: INFO dbcounter [None req-bbe83bdf-eb04-49f9-b883-48419eabefd0 None None] Registered counter for database nova_api Jul 20 04:08:08.417824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writer thread running {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:08:08.431133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_db.sqlalchemy.engines [None req-bbe83bdf-eb04-49f9-b883-48419eabefd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:08:08.438289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writer thread running {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:08:08.474510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.context [None req-b9ae756b-6eba-486d-aa32-ff07cffffdd5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbf41b76-8148-4f7f-88f5-d6fd988c2859(cell1) {{(pid=127871) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 04:08:08.478776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9ae756b-6eba-486d-aa32-ff07cffffdd5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:08.480336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9ae756b-6eba-486d-aa32-ff07cffffdd5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:08.481164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9ae756b-6eba-486d-aa32-ff07cffffdd5 None None] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:08.483177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9ae756b-6eba-486d-aa32-ff07cffffdd5 None None] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:08.485203 n-d-826526-5 devstack@n-api.service[127871]: INFO dbcounter [None req-b9ae756b-6eba-486d-aa32-ff07cffffdd5 None None] Registered counter for database nova_cell0 Jul 20 04:08:08.489386 n-d-826526-5 devstack@n-api.service[127871]: INFO dbcounter [None req-b9ae756b-6eba-486d-aa32-ff07cffffdd5 None None] Registered counter for database nova_cell1 Jul 20 04:08:08.494411 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.context [None req-bbe83bdf-eb04-49f9-b883-48419eabefd0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbf41b76-8148-4f7f-88f5-d6fd988c2859(cell1) {{(pid=127870) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 04:08:08.496855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_db.sqlalchemy.engines [None req-b9ae756b-6eba-486d-aa32-ff07cffffdd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:08:08.498676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bbe83bdf-eb04-49f9-b883-48419eabefd0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:08.499830 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_db.sqlalchemy.engines [None req-b9ae756b-6eba-486d-aa32-ff07cffffdd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:08:08.500495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bbe83bdf-eb04-49f9-b883-48419eabefd0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:08.501362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bbe83bdf-eb04-49f9-b883-48419eabefd0 None None] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:08.502954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writer thread running {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:08:08.503396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bbe83bdf-eb04-49f9-b883-48419eabefd0 None None] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:08.505490 n-d-826526-5 devstack@n-api.service[127870]: INFO dbcounter [None req-bbe83bdf-eb04-49f9-b883-48419eabefd0 None None] Registered counter for database nova_cell0 Jul 20 04:08:08.510067 n-d-826526-5 devstack@n-api.service[127870]: INFO dbcounter [None req-bbe83bdf-eb04-49f9-b883-48419eabefd0 None None] Registered counter for database nova_cell1 Jul 20 04:08:08.517375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_db.sqlalchemy.engines [None req-bbe83bdf-eb04-49f9-b883-48419eabefd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:08:08.519833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_db.sqlalchemy.engines [None req-bbe83bdf-eb04-49f9-b883-48419eabefd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:08:08.527005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writer thread running {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:08:08.528284 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writer thread running {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:08:08.642049 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writer thread running {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:08:08.651383 n-d-826526-5 devstack@n-api.service[127871]: INFO dbcounter [None req-b9ae756b-6eba-486d-aa32-ff07cffffdd5 None None] Registered counter for database nova_cell0 Jul 20 04:08:08.657915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_db.sqlalchemy.engines [None req-b9ae756b-6eba-486d-aa32-ff07cffffdd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:08:08.662159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writer thread running {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:08:08.670244 n-d-826526-5 devstack@n-api.service[127870]: INFO dbcounter [None req-bbe83bdf-eb04-49f9-b883-48419eabefd0 None None] Registered counter for database nova_cell0 Jul 20 04:08:08.683100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_db.sqlalchemy.engines [None req-bbe83bdf-eb04-49f9-b883-48419eabefd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:08:08.687903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writer thread running {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:08:08.974048 n-d-826526-5 devstack@n-api.service[127871]: WARNING keystonemiddleware.auth_token [None req-b9ae756b-6eba-486d-aa32-ff07cffffdd5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:08:08.981559 n-d-826526-5 devstack@n-api.service[127871]: WARNING keystonemiddleware.auth_token [None req-b9ae756b-6eba-486d-aa32-ff07cffffdd5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:08:08.996933 n-d-826526-5 devstack@n-api.service[127870]: WARNING keystonemiddleware.auth_token [None req-bbe83bdf-eb04-49f9-b883-48419eabefd0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:08:09.004155 n-d-826526-5 devstack@n-api.service[127870]: WARNING keystonemiddleware.auth_token [None req-bbe83bdf-eb04-49f9-b883-48419eabefd0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:08:09.328743 n-d-826526-5 devstack@n-api.service[127871]: WARNING keystonemiddleware.auth_token [None req-b9ae756b-6eba-486d-aa32-ff07cffffdd5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:08:09.334749 n-d-826526-5 devstack@n-api.service[127871]: WARNING keystonemiddleware.auth_token [None req-b9ae756b-6eba-486d-aa32-ff07cffffdd5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:08:09.340852 n-d-826526-5 devstack@n-api.service[127871]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e96cefb9c0 pid: 127871 (default app) Jul 20 04:08:09.341849 n-d-826526-5 devstack@n-api.service[127870]: WARNING keystonemiddleware.auth_token [None req-bbe83bdf-eb04-49f9-b883-48419eabefd0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:08:09.347835 n-d-826526-5 devstack@n-api.service[127870]: WARNING keystonemiddleware.auth_token [None req-bbe83bdf-eb04-49f9-b883-48419eabefd0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:08:09.354071 n-d-826526-5 devstack@n-api.service[127870]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e96cefb9c0 pid: 127870 (default app) Jul 20 04:08:53.629463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:53.630569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:53.631636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:53.633188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:53.833835 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:53.835345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:53.836138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:53.837113 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:54.918373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d0762013-50a8-4d80-aaf6-ef2f34de37bb tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '.version_select at 0x7f06c4b85c10>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:54.919819 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:54.919819 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:08:54.926435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d0762013-50a8-4d80-aaf6-ef2f34de37bb tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbf41b76-8148-4f7f-88f5-d6fd988c2859(cell1) {{(pid=127871) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 20 04:08:54.927476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0762013-50a8-4d80-aaf6-ef2f34de37bb tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:54.927918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0762013-50a8-4d80-aaf6-ef2f34de37bb tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:54.954434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0762013-50a8-4d80-aaf6-ef2f34de37bb tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:54.954907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0762013-50a8-4d80-aaf6-ef2f34de37bb tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:54.968177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0762013-50a8-4d80-aaf6-ef2f34de37bb tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:54.969018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0762013-50a8-4d80-aaf6-ef2f34de37bb tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:54.976533 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d0762013-50a8-4d80-aaf6-ef2f34de37bb tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.353417 Jul 20 04:08:54.977254 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1/1] 10.222.0.17 () {58 vars in 1166 bytes} [Wed Jul 20 04:08:53 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:54.982242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8de10701-c194-4b89-953c-4d81664161ec tempest-FlavorsV261TestJSON-318789966 tempest-FlavorsV261TestJSON-318789966-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1800186939", "id": 943650048, "os-flavor-access:is_public": "True"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:55.002050 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:55.002050 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:08:55.052934 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8de10701-c194-4b89-953c-4d81664161ec tempest-FlavorsV261TestJSON-318789966 tempest-FlavorsV261TestJSON-318789966-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 1.225217 Jul 20 04:08:55.053527 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1/2] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 04:08:53 2022] POST /compute/v2.1/flavors => generated 465 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:08:55.058368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e18fa1d3-3f83-438d-ace3-c74ec9f6d234 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1371813997", "name": "tempest-test_aggregate-1745670473"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:55.076950 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:55.076950 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:08:55.078034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.aggregate [None req-e18fa1d3-3f83-438d-ace3-c74ec9f6d234 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Generated uuid 391f446a-062a-44e3-9d6f-987e9e25b949 for aggregate {{(pid=127870) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:08:55.174106 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e18fa1d3-3f83-438d-ace3-c74ec9f6d234 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.119260 Jul 20 04:08:55.176905 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2/3] 10.222.0.17 () {60 vars in 1164 bytes} [Wed Jul 20 04:08:55 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:55.365604 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-97a88fb0-740f-4ec7-a2c8-c0d0b055d2c5 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1869077858", "id": 1581497740, "os-flavor-access:is_public": "True"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:55.384467 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:55.384467 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:08:55.415339 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-97a88fb0-740f-4ec7-a2c8-c0d0b055d2c5 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.436816 Jul 20 04:08:55.416099 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2/4] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:54 2022] POST /compute/v2.1/flavors => generated 430 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:55.420745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e88ec946-cc5c-40cf-b966-b6d55f609c5d tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:55.421567 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:55.421567 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:08:55.437074 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e88ec946-cc5c-40cf-b966-b6d55f609c5d tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.019612 Jul 20 04:08:55.437903 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3/5] 10.222.0.17 () {58 vars in 1142 bytes} [Wed Jul 20 04:08:55 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:55.442269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-798d2590-8ec6-495a-8293-f3027214f688 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:55.443292 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:55.443292 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:08:55.472409 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-798d2590-8ec6-495a-8293-f3027214f688 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1581497740" status: 202 len: 0 microversion: 2.1 time: 0.033158 Jul 20 04:08:55.473215 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 4/6] 10.222.0.17 () {58 vars in 1160 bytes} [Wed Jul 20 04:08:55 2022] DELETE /compute/v2.1/flavors/1581497740 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:08:55.636478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9284587c-1fa5-496a-a231-e4e33c6ac10e tempest-FlavorsV261TestJSON-493576126 tempest-FlavorsV261TestJSON-493576126-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:55.660093 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9284587c-1fa5-496a-a231-e4e33c6ac10e tempest-FlavorsV261TestJSON-493576126 tempest-FlavorsV261TestJSON-493576126-project] 10.222.0.17 "GET /compute/v2.1/flavors/943650048" status: 200 len: 465 microversion: 2.61 time: 0.481953 Jul 20 04:08:55.667354 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3/7] 10.222.0.17 () {60 vars in 1195 bytes} [Wed Jul 20 04:08:55 2022] GET /compute/v2.1/flavors/943650048 => generated 465 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:08:55.672308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cc540bf6-31e6-481b-8e5c-9245e4f18c10 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-826526-5"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:55.674240 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:55.674240 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:08:55.690954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc540bf6-31e6-481b-8e5c-9245e4f18c10 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:55.691758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc540bf6-31e6-481b-8e5c-9245e4f18c10 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:55.832719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ffc76b7f-1866-4eba-bddc-3a51e513f99f tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:55.834166 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:55.834166 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:08:55.835396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffc76b7f-1866-4eba-bddc-3a51e513f99f tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:55.835835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffc76b7f-1866-4eba-bddc-3a51e513f99f tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:55.836634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffc76b7f-1866-4eba-bddc-3a51e513f99f tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:55.837061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffc76b7f-1866-4eba-bddc-3a51e513f99f tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:55.874039 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ffc76b7f-1866-4eba-bddc-3a51e513f99f tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.399136 Jul 20 04:08:55.880387 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 5/8] 10.222.0.17 () {58 vars in 1175 bytes} [Wed Jul 20 04:08:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:55.885586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-025f16d3-1d31-467b-9ab5-22aa0efb174d tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:55.915783 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-025f16d3-1d31-467b-9ab5-22aa0efb174d tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.034182 Jul 20 04:08:55.916397 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 6/9] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:08:55 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:56.021826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3107acb6-eb9f-4dcb-80ba-d07b532fdf11 tempest-AZAdminNegativeTestJSON-797112420 tempest-AZAdminNegativeTestJSON-797112420-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:56.022586 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:56.022586 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:08:56.023579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3107acb6-eb9f-4dcb-80ba-d07b532fdf11 tempest-AZAdminNegativeTestJSON-797112420 tempest-AZAdminNegativeTestJSON-797112420-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '3e8dfd87fba546b8889bdbf3e7f1b061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a37815b213483a98f617d0f88340e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3107acb6-eb9f-4dcb-80ba-d07b532fdf11 tempest-AZAdminNegativeTestJSON-797112420 tempest-AZAdminNegativeTestJSON-797112420-project] Request method failure captured: Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_VaqE9Ej-w3wrC2OQ36aiy14Ga9BCNuWd2y93Boz63qpV42GHeHKRd8YevG86SxkqhH2Jt4VMn8Zl2_0o3xl7e9lFdhRJsLddVowgmKwhuG8Bl2aZO4m85CL0qqPSy6TJYLmzmjpslsNq6qMPzGMWuxOQiLolrz3fsMkKFZVhMPZg Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 88a37815b213483a98f617d0f88340e7 Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AZAdminNegativeTestJSON-797112420 Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:08:56.026458 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:08:56.027540 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/88a37815b213483a98f617d0f88340e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/88a37815b213483a98f617d0f88340e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_88a37815b213483a98f617d0f88340e7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/88a37815b213483a98f617d0f88340e7"}]}] Jul 20 04:08:56.027540 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AZAdminNegativeTestJSON-797112420 Jul 20 04:08:56.027540 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 88a37815b213483a98f617d0f88340e7 Jul 20 04:08:56.027540 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-797112420 Jul 20 04:08:56.027540 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AZAdminNegativeTestJSON-797112420-project Jul 20 04:08:56.027540 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:08:56.027540 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:08:56.027540 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 3e8dfd87fba546b8889bdbf3e7f1b061 Jul 20 04:08:56.027540 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AZAdminNegativeTestJSON-797112420-project Jul 20 04:08:56.027540 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:08:56.027540 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 20 04:08:56.027540 n-d-826526-5 devstack@n-api.service[127871]: action_args: {} Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:08:56.028283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:08:56.029300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:08:56.029300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:08:56.029300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:08:56.029300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:08:56.029300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:08:56.029300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 20 04:08:56.029300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:08:56.029300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:56.029300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:08:56.029300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:56.029300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:56.029300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:56.029300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:08:56.029300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:08:56.029300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 20 04:08:56.029300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:08:56.029300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3107acb6-eb9f-4dcb-80ba-d07b532fdf11 tempest-AZAdminNegativeTestJSON-797112420 tempest-AZAdminNegativeTestJSON-797112420-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:56.030231 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3107acb6-eb9f-4dcb-80ba-d07b532fdf11 tempest-AZAdminNegativeTestJSON-797112420 tempest-AZAdminNegativeTestJSON-797112420-project] 10.222.0.17 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.110529 Jul 20 04:08:56.032434 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 7/10] 10.222.0.17 () {58 vars in 1184 bytes} [Wed Jul 20 04:08:55 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 115 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:08:56.039344 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cc540bf6-31e6-481b-8e5c-9245e4f18c10 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 0.370356 Jul 20 04:08:56.040565 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 4/11] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 04:08:55 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:56.040775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bd7c092d-bba2-4c44-b5b5-3f7780a496af tempest-FlavorsV261TestJSON-318789966 tempest-FlavorsV261TestJSON-318789966-project-admin] Action: 'update', calling method: .version_select at 0x7f06c4f42b80>, body: {"flavor": {"description": "new"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:56.050956 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:56.050956 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:08:56.088644 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bd7c092d-bba2-4c44-b5b5-3f7780a496af tempest-FlavorsV261TestJSON-318789966 tempest-FlavorsV261TestJSON-318789966-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/943650048" status: 200 len: 466 microversion: 2.61 time: 0.052353 Jul 20 04:08:56.089504 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 8/12] 10.222.0.17 () {62 vars in 1215 bytes} [Wed Jul 20 04:08:56 2022] PUT /compute/v2.1/flavors/943650048 => generated 466 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:08:56.098398 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cc1282cf-c2f0-4aad-bb57-c8ba6877c31f tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Calling method '.version_select at 0x7f06c4179af0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:56.099799 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:56.099799 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:08:56.106169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cc1282cf-c2f0-4aad-bb57-c8ba6877c31f tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbf41b76-8148-4f7f-88f5-d6fd988c2859(cell1) {{(pid=127870) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 20 04:08:56.107138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc1282cf-c2f0-4aad-bb57-c8ba6877c31f tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:56.107722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc1282cf-c2f0-4aad-bb57-c8ba6877c31f tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:56.125646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc1282cf-c2f0-4aad-bb57-c8ba6877c31f tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:56.126376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc1282cf-c2f0-4aad-bb57-c8ba6877c31f tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:56.137324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc1282cf-c2f0-4aad-bb57-c8ba6877c31f tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:56.137766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc1282cf-c2f0-4aad-bb57-c8ba6877c31f tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:56.144722 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cc1282cf-c2f0-4aad-bb57-c8ba6877c31f tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.102413 Jul 20 04:08:56.145839 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 5/13] 10.222.0.17 () {60 vars in 1207 bytes} [Wed Jul 20 04:08:56 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:56.228598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8a2ebe28-8e19-496e-8605-8a7bbc7a67fe tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1813824333", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:56.400305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e9e1e67b-2dcb-48d6-9e40-e3fec3112d21 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1198572790", "ram": 512, "vcpus": 1, "disk": 10, "id": 786330090, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:56.402022 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:56.402022 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:08:56.419560 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e9e1e67b-2dcb-48d6-9e40-e3fec3112d21 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.272503 Jul 20 04:08:56.420152 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 6/14] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:56 2022] POST /compute/v2.1/flavors => generated 413 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:56.425049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5a09f4a2-a23b-4fae-b910-88776f7e2029 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-827731081", "id": 883160133, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:56.443334 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5a09f4a2-a23b-4fae-b910-88776f7e2029 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.021576 Jul 20 04:08:56.444415 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 7/15] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:56 2022] POST /compute/v2.1/flavors => generated 413 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:56.449053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fd0342dc-caf3-4916-a2f6-83f9312737ae tempest-FlavorsV261TestJSON-493576126 tempest-FlavorsV261TestJSON-493576126-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:56.481643 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fd0342dc-caf3-4916-a2f6-83f9312737ae tempest-FlavorsV261TestJSON-493576126 tempest-FlavorsV261TestJSON-493576126-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 7133 microversion: 2.61 time: 0.036049 Jul 20 04:08:56.482694 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 8/16] 10.222.0.17 () {60 vars in 1186 bytes} [Wed Jul 20 04:08:56 2022] GET /compute/v2.1/flavors/detail => generated 7133 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:56.596554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-8a2ebe28-8e19-496e-8605-8a7bbc7a67fe tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:08:56.601018 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-323653788", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "availability_zone": "tempest-test_az-1371813997"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:56.618430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:56.618908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:56.619703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:56.620137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:56.851484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] validate_networks() for None {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:08:56.924812 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8a2ebe28-8e19-496e-8605-8a7bbc7a67fe tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:56.925238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8a2ebe28-8e19-496e-8605-8a7bbc7a67fe tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:56.925766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8a2ebe28-8e19-496e-8605-8a7bbc7a67fe tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:56.926182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8a2ebe28-8e19-496e-8605-8a7bbc7a67fe tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:56.926591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8a2ebe28-8e19-496e-8605-8a7bbc7a67fe tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:56.941339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a2ebe28-8e19-496e-8605-8a7bbc7a67fe tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:56.941792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a2ebe28-8e19-496e-8605-8a7bbc7a67fe tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:56.942600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a2ebe28-8e19-496e-8605-8a7bbc7a67fe tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:56.943038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a2ebe28-8e19-496e-8605-8a7bbc7a67fe tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:56.973133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-8a2ebe28-8e19-496e-8605-8a7bbc7a67fe tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Getting quotas for project 9c3880edc93c4226bc33da852c29549d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:56.979255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-8a2ebe28-8e19-496e-8605-8a7bbc7a67fe tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Getting quotas for user f013a3858af9433889e60ea288757de2 and project 9c3880edc93c4226bc33da852c29549d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:56.990908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8a2ebe28-8e19-496e-8605-8a7bbc7a67fe tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:08:56.993943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8a2ebe28-8e19-496e-8605-8a7bbc7a67fe tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:08:57.084587 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8a2ebe28-8e19-496e-8605-8a7bbc7a67fe tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989076 Jul 20 04:08:57.086030 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 9/17] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:08:57.094310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ee63cbda-1f49-4194-811c-da17f232df90 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:57.096711 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:57.096711 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:08:57.139131 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ee63cbda-1f49-4194-811c-da17f232df90 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/786330090/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.051228 Jul 20 04:08:57.140445 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 10/18] 10.222.0.17 () {60 vars in 1220 bytes} [Wed Jul 20 04:08:57 2022] POST /compute/v2.1/flavors/786330090/os-extra_specs => generated 66 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:08:57.147206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-819e9d01-63ea-461d-a347-101c75aa1fc6 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.177201 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-819e9d01-63ea-461d-a347-101c75aa1fc6 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 6212 microversion: 2.1 time: 0.034872 Jul 20 04:08:57.178077 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 11/19] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:08:57 2022] GET /compute/v2.1/flavors/detail => generated 6212 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:57.191445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-abb00860-a767-48f4-9fa5-efb8fbceea5d tempest-FlavorsV261TestJSON-493576126 tempest-FlavorsV261TestJSON-493576126-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.216983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:57.218296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:57.219177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:57.220149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:57.220837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:57.235203 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-abb00860-a767-48f4-9fa5-efb8fbceea5d tempest-FlavorsV261TestJSON-493576126 tempest-FlavorsV261TestJSON-493576126-project] 10.222.0.17 "GET /compute/v2.1/flavors" status: 200 len: 3654 microversion: 2.61 time: 0.055556 Jul 20 04:08:57.237242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:57.237906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:57.238901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:57.239434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:57.245177 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 12/20] 10.222.0.17 () {60 vars in 1165 bytes} [Wed Jul 20 04:08:57 2022] GET /compute/v2.1/flavors => generated 3654 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:57.256537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e0e4a29f-a45b-4f0a-bcfc-b12d8a05d704 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.257259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e0e4a29f-a45b-4f0a-bcfc-b12d8a05d704 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:57.276847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Getting quotas for project 269ec7045cb7428faa0427f65b46754b. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:57.285688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Getting quotas for user 84e044297c454f508bde607ae3eee5a7 and project 269ec7045cb7428faa0427f65b46754b. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:57.308012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:08:57.312243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:08:57.376623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e0e4a29f-a45b-4f0a-bcfc-b12d8a05d704 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:57.396278 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e0e4a29f-a45b-4f0a-bcfc-b12d8a05d704 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1220 microversion: 2.1 time: 0.147116 Jul 20 04:08:57.397229 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6a325f22-027c-4542-a8b3-aa1bee0dd964 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.910381 Jul 20 04:08:57.398196 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 9/21] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:08:57.400645 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 13/22] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:57 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1220 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:57.408747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f40767c7-a916-46ea-890f-222ae4027d2d tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.409553 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:57.409553 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:08:57.429232 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f40767c7-a916-46ea-890f-222ae4027d2d tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/883160133" status: 202 len: 0 microversion: 2.1 time: 0.027317 Jul 20 04:08:57.430021 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 14/23] 10.222.0.17 () {58 vars in 1157 bytes} [Wed Jul 20 04:08:57 2022] DELETE /compute/v2.1/flavors/883160133 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:08:57.435491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-24320570-b8b5-49b0-94e5-ca6824888ad6 tempest-FlavorsV261TestJSON-318789966 tempest-FlavorsV261TestJSON-318789966-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.473348 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-24320570-b8b5-49b0-94e5-ca6824888ad6 tempest-FlavorsV261TestJSON-318789966 tempest-FlavorsV261TestJSON-318789966-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/943650048" status: 202 len: 0 microversion: 2.61 time: 0.041872 Jul 20 04:08:57.475998 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 15/24] 10.222.0.17 () {60 vars in 1198 bytes} [Wed Jul 20 04:08:57 2022] DELETE /compute/v2.1/flavors/943650048 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:08:57.481139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-adab91e1-91fd-462f-aafe-24d5a594a267 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.481749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-adab91e1-91fd-462f-aafe-24d5a594a267 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:57.592120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-adab91e1-91fd-462f-aafe-24d5a594a267 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:57.599854 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-adab91e1-91fd-462f-aafe-24d5a594a267 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1242 microversion: 2.1 time: 0.122593 Jul 20 04:08:57.604748 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 16/25] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:57 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1242 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:57.611220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b5b20538-52ae-47dd-ac98-ecf689bb96ab tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.637690 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b5b20538-52ae-47dd-ac98-ecf689bb96ab tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.031519 Jul 20 04:08:57.642335 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 17/26] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:08:57 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:57.646166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3c35349c-3ad9-4c3b-9bae-1395bad2d653 tempest-FlavorsV261TestJSON-318789966 tempest-FlavorsV261TestJSON-318789966-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.674942 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3c35349c-3ad9-4c3b-9bae-1395bad2d653 tempest-FlavorsV261TestJSON-318789966 tempest-FlavorsV261TestJSON-318789966-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 6281 microversion: 2.61 time: 0.035123 Jul 20 04:08:57.688290 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 18/27] 10.222.0.17 () {60 vars in 1186 bytes} [Wed Jul 20 04:08:57 2022] GET /compute/v2.1/flavors/detail => generated 6281 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:57.693558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e66812f1-ff5d-42b8-8013-a2ae0d3fcf6b tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-717947322", "id": 1337322438, "os-flavor-access:is_public": "True"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:57.699384 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:57.699384 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:08:57.728367 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e66812f1-ff5d-42b8-8013-a2ae0d3fcf6b tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.051180 Jul 20 04:08:57.734448 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 19/28] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:57 2022] POST /compute/v2.1/flavors => generated 428 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:57.739684 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e463ea21-2920-4336-bc59-4f0fadf4ba17 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.740752 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:57.740752 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:08:57.752778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=7,nova_api:DELETE=11,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:57.764050 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e463ea21-2920-4336-bc59-4f0fadf4ba17 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1337322438" status: 202 len: 0 microversion: 2.1 time: 0.028147 Jul 20 04:08:57.767708 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 20/29] 10.222.0.17 () {58 vars in 1160 bytes} [Wed Jul 20 04:08:57 2022] DELETE /compute/v2.1/flavors/1337322438 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:08:57.772784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-70de2c0a-f473-4cd9-994e-b37a4f876a07 tempest-FlavorsExtraSpecsTestJSON-117757437 tempest-FlavorsExtraSpecsTestJSON-117757437-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.774407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f508195e-9a7d-47ba-bbbc-59e7a347b82f tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.798054 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-70de2c0a-f473-4cd9-994e-b37a4f876a07 tempest-FlavorsExtraSpecsTestJSON-117757437 tempest-FlavorsExtraSpecsTestJSON-117757437-project] 10.222.0.17 "GET /compute/v2.1/flavors/786330090/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.398279 Jul 20 04:08:57.811633 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f508195e-9a7d-47ba-bbbc-59e7a347b82f tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.041521 Jul 20 04:08:57.812308 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 10/30] 10.222.0.17 () {58 vars in 1199 bytes} [Wed Jul 20 04:08:57 2022] GET /compute/v2.1/flavors/786330090/os-extra_specs => generated 66 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:08:57.813149 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 21/31] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:08:57 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:57.828193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7623993b-fa11-447c-994d-1caa455b9c27 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-582590264", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:57.830469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-89205eed-008d-4304-9f02-7e79dbde4009 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:57.832064 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:57.832064 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:08:57.834785 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:57.834785 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:08:57.868916 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-89205eed-008d-4304-9f02-7e79dbde4009 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/786330090/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040105 Jul 20 04:08:57.868916 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 22/32] 10.222.0.17 () {60 vars in 1220 bytes} [Wed Jul 20 04:08:57 2022] POST /compute/v2.1/flavors/786330090/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:08:57.871646 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7623993b-fa11-447c-994d-1caa455b9c27 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.046921 Jul 20 04:08:57.872582 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 11/33] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:57 2022] POST /compute/v2.1/flavors => generated 506 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:57.880600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-09d57539-5129-4eca-a40d-d75fd926fb1a tempest-FlavorsExtraSpecsTestJSON-117757437 tempest-FlavorsExtraSpecsTestJSON-117757437-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.889526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-03572141-0f22-4cf7-a790-9c9ad26ed474 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.890894 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:57.890894 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:08:57.907171 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-09d57539-5129-4eca-a40d-d75fd926fb1a tempest-FlavorsExtraSpecsTestJSON-117757437 tempest-FlavorsExtraSpecsTestJSON-117757437-project] 10.222.0.17 "GET /compute/v2.1/flavors/786330090/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.036587 Jul 20 04:08:57.908054 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 23/34] 10.222.0.17 () {58 vars in 1241 bytes} [Wed Jul 20 04:08:57 2022] GET /compute/v2.1/flavors/786330090/os-extra_specs/hw:numa_nodes => generated 22 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:08:57.918073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-58c5aaa3-e990-48cf-aa68-b1a82015eb29 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:57.937121 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-03572141-0f22-4cf7-a790-9c9ad26ed474 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/28c52c76-a552-414a-9c0d-288c674464f4" status: 202 len: 0 microversion: 2.1 time: 0.054813 Jul 20 04:08:57.939516 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 12/35] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:08:57 2022] DELETE /compute/v2.1/flavors/28c52c76-a552-414a-9c0d-288c674464f4 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:08:57.953529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2df64c5f-283d-4727-9ccb-9c99c19c0023 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.969674 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-58c5aaa3-e990-48cf-aa68-b1a82015eb29 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/786330090/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.055554 Jul 20 04:08:57.970577 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 24/36] 10.222.0.17 () {60 vars in 1220 bytes} [Wed Jul 20 04:08:57 2022] POST /compute/v2.1/flavors/786330090/os-extra_specs => generated 66 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:08:57.984243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-14e933f8-cfa0-461e-8dd9-8432efe33830 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.995046 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-14e933f8-cfa0-461e-8dd9-8432efe33830 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/786330090/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.018701 Jul 20 04:08:58.008317 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 25/37] 10.222.0.17 () {58 vars in 1199 bytes} [Wed Jul 20 04:08:57 2022] GET /compute/v2.1/flavors/786330090/os-extra_specs => generated 66 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:08:58.014083 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2df64c5f-283d-4727-9ccb-9c99c19c0023 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.069563 Jul 20 04:08:58.015092 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 13/38] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:08:57 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:58.030354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8356376c-5661-4c90-abd3-95462f44e319 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:58.031684 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:58.031684 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:08:58.034034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eb51a267-e19b-4916-9a79-d5a252ec529b tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-879307027", "id": "e679175a-6bb7-4169-9496-6531147a29c5", "os-flavor-access:is_public": "True"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:58.067595 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eb51a267-e19b-4916-9a79-d5a252ec529b tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.040604 Jul 20 04:08:58.068975 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 14/39] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:58 2022] POST /compute/v2.1/flavors => generated 506 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:58.085079 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8356376c-5661-4c90-abd3-95462f44e319 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/786330090/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.058345 Jul 20 04:08:58.087803 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 26/40] 10.222.0.17 () {60 vars in 1261 bytes} [Wed Jul 20 04:08:58 2022] PUT /compute/v2.1/flavors/786330090/os-extra_specs/hw:numa_nodes => generated 22 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:08:58.089643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4e708e86-8c0a-4e85-894e-9b8c6366be9a tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.097817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ede42795-3f57-4715-8591-8371c1fb5d59 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.107394 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ede42795-3f57-4715-8591-8371c1fb5d59 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/786330090/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014343 Jul 20 04:08:58.108172 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 27/41] 10.222.0.17 () {58 vars in 1199 bytes} [Wed Jul 20 04:08:58 2022] GET /compute/v2.1/flavors/786330090/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:08:58.121642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-982c222e-4864-4e7e-97a8-ad6c7124d50b tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.122543 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:58.122543 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:08:58.135763 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4e708e86-8c0a-4e85-894e-9b8c6366be9a tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/e679175a-6bb7-4169-9496-6531147a29c5" status: 202 len: 0 microversion: 2.1 time: 0.057438 Jul 20 04:08:58.139344 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 15/42] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:08:58 2022] DELETE /compute/v2.1/flavors/e679175a-6bb7-4169-9496-6531147a29c5 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:08:58.147741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b8e7061c-6f51-4139-a54c-beb319c39b3d tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.172790 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b8e7061c-6f51-4139-a54c-beb319c39b3d tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.028873 Jul 20 04:08:58.173649 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 16/43] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:08:58 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:58.194596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0df8ef32-258e-480f-9c5a-8160bf9f6aef tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-653606461", "id": 1681546612, "os-flavor-access:is_public": "True"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:58.216041 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0df8ef32-258e-480f-9c5a-8160bf9f6aef tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.028900 Jul 20 04:08:58.221298 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-982c222e-4864-4e7e-97a8-ad6c7124d50b tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/786330090/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.107441 Jul 20 04:08:58.222114 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 28/44] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:08:58 2022] DELETE /compute/v2.1/flavors/786330090/os-extra_specs/hw:numa_nodes => generated 0 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:08:58.222995 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 17/45] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:58 2022] POST /compute/v2.1/flavors => generated 413 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:58.234919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-450a46f0-d00b-4c8d-adbb-c74f96a92aff tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.242277 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-40a4a8b0-4c55-4f71-a5ee-d1195707d670 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.243101 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-450a46f0-d00b-4c8d-adbb-c74f96a92aff tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/1681546612" status: 200 len: 413 microversion: 2.1 time: 0.019133 Jul 20 04:08:58.243486 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:58.243486 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:08:58.248822 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 29/46] 10.222.0.17 () {58 vars in 1157 bytes} [Wed Jul 20 04:08:58 2022] GET /compute/v2.1/flavors/1681546612 => generated 413 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:08:58.304204 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-40a4a8b0-4c55-4f71-a5ee-d1195707d670 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/786330090/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.074311 Jul 20 04:08:58.306101 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 18/47] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:08:58 2022] DELETE /compute/v2.1/flavors/786330090/os-extra_specs/hw:cpu_policy => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:08:58.314362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4bf636c2-30a7-4509-aa20-46dabab8de69 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.322931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=12,nova_api:DELETE=7 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:58.325412 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4bf636c2-30a7-4509-aa20-46dabab8de69 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/786330090/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015267 Jul 20 04:08:58.326336 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 19/48] 10.222.0.17 () {58 vars in 1199 bytes} [Wed Jul 20 04:08:58 2022] GET /compute/v2.1/flavors/786330090/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:08:58.340943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8105c42e-d12b-4682-b81b-ad2d0b70b6ea tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.369289 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8105c42e-d12b-4682-b81b-ad2d0b70b6ea tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/786330090" status: 202 len: 0 microversion: 2.1 time: 0.034436 Jul 20 04:08:58.370381 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 20/49] 10.222.0.17 () {58 vars in 1157 bytes} [Wed Jul 20 04:08:58 2022] DELETE /compute/v2.1/flavors/786330090 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:08:58.379655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8c541f29-a5bb-4480-bc38-21afa3d485b9 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.408874 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8c541f29-a5bb-4480-bc38-21afa3d485b9 tempest-FlavorsExtraSpecsTestJSON-1618148344 tempest-FlavorsExtraSpecsTestJSON-1618148344-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.033569 Jul 20 04:08:58.409880 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 21/50] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:08:58 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:58.429059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e647161b-bd8c-4266-ac2f-c06b466ffd79 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.429900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e647161b-bd8c-4266-ac2f-c06b466ffd79 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:58.529735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e647161b-bd8c-4266-ac2f-c06b466ffd79 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:58.544943 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e647161b-bd8c-4266-ac2f-c06b466ffd79 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1220 microversion: 2.1 time: 0.133545 Jul 20 04:08:58.545564 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 22/51] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:58 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:58.621657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aac91328-b782-48ce-ac84-e1793b96034f tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.622965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aac91328-b782-48ce-ac84-e1793b96034f tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:58.679560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-624c108f-f9d5-4dea-aa5d-8340b3c13432 tempest-FlavorsAdminTestJSON-151711 tempest-FlavorsAdminTestJSON-151711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.711744 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-624c108f-f9d5-4dea-aa5d-8340b3c13432 tempest-FlavorsAdminTestJSON-151711 tempest-FlavorsAdminTestJSON-151711-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.457615 Jul 20 04:08:58.722154 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 30/52] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:08:58 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:58.728481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-53affb58-a178-4db9-9859-e30b368c823f tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.748868 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-53affb58-a178-4db9-9859-e30b368c823f tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1681546612" status: 202 len: 0 microversion: 2.1 time: 0.025095 Jul 20 04:08:58.749595 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 31/53] 10.222.0.17 () {58 vars in 1160 bytes} [Wed Jul 20 04:08:58 2022] DELETE /compute/v2.1/flavors/1681546612 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:08:58.759192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dc7de1ec-5e2c-4d17-a5ae-06ab4f4b6c10 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.784022 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dc7de1ec-5e2c-4d17-a5ae-06ab4f4b6c10 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029174 Jul 20 04:08:58.784649 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 32/54] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:08:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:58.801066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e912e54e-40fa-45fa-8a29-1fb7d7b95de6 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1578082768", "id": 66702989, "os-flavor-access:is_public": "False"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:58.812771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aac91328-b782-48ce-ac84-e1793b96034f tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:58.821867 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aac91328-b782-48ce-ac84-e1793b96034f tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1242 microversion: 2.1 time: 0.206613 Jul 20 04:08:58.822455 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 23/55] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:58 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1242 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:58.828679 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e912e54e-40fa-45fa-8a29-1fb7d7b95de6 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.031177 Jul 20 04:08:58.836760 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 33/56] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:58 2022] POST /compute/v2.1/flavors => generated 424 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:58.841166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a9d4bd35-2bbf-4373-ba30-9cb5f90c0134 tempest-FlavorsAdminTestJSON-151711 tempest-FlavorsAdminTestJSON-151711-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "66702989"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:58.865086 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-a9d4bd35-2bbf-4373-ba30-9cb5f90c0134 tempest-FlavorsAdminTestJSON-151711 tempest-FlavorsAdminTestJSON-151711-project] HTTP exception thrown: Flavor 66702989 could not be found. Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a9d4bd35-2bbf-4373-ba30-9cb5f90c0134 tempest-FlavorsAdminTestJSON-151711 tempest-FlavorsAdminTestJSON-151711-project] Request method failure captured: Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 105 Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_Uu4DuC0XQTM7mhhnzTyygHrMxaMAdUnq5OPjoKBtEte_krgeUe_MwSQ5itW03mcMBs1D41hpFVfkLAjBPjZilYB67J1pcz-hv7LimvuX3YPgKWA2c90zTnNdZ6I79MjaHQuWajSL42yIT_N5xsnSPv8TCvt1IESj07D4rWUuEmCY Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 9607768a62824c1e96da2904329ea2d2 Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-FlavorsAdminTestJSON-151711 Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:08:58.876305 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:08:58.877776 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9607768a62824c1e96da2904329ea2d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9607768a62824c1e96da2904329ea2d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9607768a62824c1e96da2904329ea2d2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9607768a62824c1e96da2904329ea2d2"}]}] Jul 20 04:08:58.877776 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-FlavorsAdminTestJSON-151711 Jul 20 04:08:58.877776 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 9607768a62824c1e96da2904329ea2d2 Jul 20 04:08:58.877776 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-151711 Jul 20 04:08:58.877776 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-FlavorsAdminTestJSON-151711-project Jul 20 04:08:58.877776 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:08:58.877776 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:08:58.877776 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: af02f0e969174c5eb0e105336dd29465 Jul 20 04:08:58.877776 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-FlavorsAdminTestJSON-151711-project Jul 20 04:08:58.877776 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:08:58.877776 n-d-826526-5 devstack@n-api.service[127870]: {"server": {"name": "test", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "66702989"}} Jul 20 04:08:58.877776 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:08:58.877776 n-d-826526-5 devstack@n-api.service[127870]: exception: Flavor 66702989 could not be found. Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '66702989'}}} Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 66702989 could not be found. Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:08:58.878722 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 66702989 could not be found. Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:58.879828 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:58.881093 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:58.881093 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:08:58.881093 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:08:58.881093 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 66702989 could not be found. Jul 20 04:08:58.881093 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:08:58.881093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a9d4bd35-2bbf-4373-ba30-9cb5f90c0134 tempest-FlavorsAdminTestJSON-151711 tempest-FlavorsAdminTestJSON-151711-project] Returning 400 to user: Flavor 66702989 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:58.881093 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a9d4bd35-2bbf-4373-ba30-9cb5f90c0134 tempest-FlavorsAdminTestJSON-151711 tempest-FlavorsAdminTestJSON-151711-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 79 microversion: 2.1 time: 0.041985 Jul 20 04:08:58.881093 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 24/57] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:58 2022] POST /compute/v2.1/servers => generated 79 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:08:58.888437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-16f1fd9e-78cb-428f-809b-fae267cbef00 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.914812 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-16f1fd9e-78cb-428f-809b-fae267cbef00 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/66702989" status: 202 len: 0 microversion: 2.1 time: 0.030997 Jul 20 04:08:58.916316 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 34/58] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jul 20 04:08:58 2022] DELETE /compute/v2.1/flavors/66702989 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:08:58.924782 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d5fa8c0c-7213-48ae-b5a6-62a83d4848ed tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.954360 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d5fa8c0c-7213-48ae-b5a6-62a83d4848ed tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033864 Jul 20 04:08:58.973867 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 25/59] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:08:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:58.982516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7580bb8d-6bad-4d5d-81b8-ffa675a693c6 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-93069382", "id": 1680227851, "os-flavor-access:is_public": "False"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:59.015898 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7580bb8d-6bad-4d5d-81b8-ffa675a693c6 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.040387 Jul 20 04:08:59.021749 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 35/60] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:58 2022] POST /compute/v2.1/flavors => generated 413 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:59.028235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9075d9df-b9a0-4d30-bbe7-2c59224e23f8 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1503463102", "id": 945109069, "os-flavor-access:is_public": "True"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:59.030052 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:59.030052 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:08:59.077448 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9075d9df-b9a0-4d30-bbe7-2c59224e23f8 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.034757 Jul 20 04:08:59.078323 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 26/61] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:59 2022] POST /compute/v2.1/flavors => generated 411 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:59.088927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bcac381f-8dae-45f0-8024-52e3f30b3bb0 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.117022 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bcac381f-8dae-45f0-8024-52e3f30b3bb0 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 416 microversion: 2.1 time: 0.032253 Jul 20 04:08:59.118161 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 36/62] 10.222.0.17 () {58 vars in 1168 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 416 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:59.130591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6c23b57e-d45c-4de6-845a-e5936f86ef42 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.176497 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6c23b57e-d45c-4de6-845a-e5936f86ef42 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 416 microversion: 2.1 time: 0.050643 Jul 20 04:08:59.180912 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 27/63] 10.222.0.17 () {58 vars in 1176 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 416 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:59.192232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5d60f5cb-13e5-460a-a928-fa8a2b66cb9b tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.209014 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5d60f5cb-13e5-460a-a928-fa8a2b66cb9b tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 416 microversion: 2.1 time: 0.020690 Jul 20 04:08:59.211970 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 37/64] 10.222.0.17 () {58 vars in 1170 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 416 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:59.223210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-59932389-6d5e-4df6-8a7a-62f7fb577cd2 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.254731 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-59932389-6d5e-4df6-8a7a-62f7fb577cd2 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 416 microversion: 2.1 time: 0.036755 Jul 20 04:08:59.255349 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 28/65] 10.222.0.17 () {58 vars in 1168 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 416 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:59.267837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f22737ab-f222-44c2-a132-32717bcffba5 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.293628 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f22737ab-f222-44c2-a132-32717bcffba5 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.030687 Jul 20 04:08:59.294255 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 38/66] 10.222.0.17 () {58 vars in 1168 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:59.310139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f2bef28a-593d-4dc8-a582-68cdfe00e578 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.331135 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f2bef28a-593d-4dc8-a582-68cdfe00e578 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.025200 Jul 20 04:08:59.336926 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 29/67] 10.222.0.17 () {58 vars in 1174 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:59.346749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-adbb40c1-3c30-4dab-a2a7-4722a5afad6c tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.370938 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-adbb40c1-3c30-4dab-a2a7-4722a5afad6c tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.028333 Jul 20 04:08:59.371518 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 39/68] 10.222.0.17 () {58 vars in 1172 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:59.386600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9f163482-0004-4abf-a4f4-e73df0144087 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.409062 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9f163482-0004-4abf-a4f4-e73df0144087 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.026329 Jul 20 04:08:59.410786 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 30/69] 10.222.0.17 () {58 vars in 1168 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:59.432650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-929df4b3-0d63-45bb-91a9-8dc5ab4e6f58 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.470701 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-929df4b3-0d63-45bb-91a9-8dc5ab4e6f58 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/945109069" status: 202 len: 0 microversion: 2.1 time: 0.048902 Jul 20 04:08:59.474653 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 40/70] 10.222.0.17 () {58 vars in 1157 bytes} [Wed Jul 20 04:08:59 2022] DELETE /compute/v2.1/flavors/945109069 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:08:59.482203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9127a318-7592-472c-990c-413eaa904523 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.527220 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9127a318-7592-472c-990c-413eaa904523 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047300 Jul 20 04:08:59.529015 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 31/71] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:59.543756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-67017994-513f-48e9-ac97-69cdfb55315e tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.562307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:DELETE=14,nova_api:SELECT=69,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:59.565513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94cf5405-f0f5-4aff-8cb3-078251475c43 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.566567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-94cf5405-f0f5-4aff-8cb3-078251475c43 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:59.574423 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-67017994-513f-48e9-ac97-69cdfb55315e tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1680227851" status: 202 len: 0 microversion: 2.1 time: 0.032781 Jul 20 04:08:59.575548 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 41/72] 10.222.0.17 () {58 vars in 1160 bytes} [Wed Jul 20 04:08:59 2022] DELETE /compute/v2.1/flavors/1680227851 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:08:59.584059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94cf5405-f0f5-4aff-8cb3-078251475c43 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:59.585947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94cf5405-f0f5-4aff-8cb3-078251475c43 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:59.587655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94cf5405-f0f5-4aff-8cb3-078251475c43 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:59.589227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-340b4d28-251e-40b1-b00e-2c780399f76c tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.590032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94cf5405-f0f5-4aff-8cb3-078251475c43 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:59.630537 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-340b4d28-251e-40b1-b00e-2c780399f76c tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047030 Jul 20 04:08:59.631370 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 42/73] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:59.648837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-95a4196d-dc8f-4857-9d69-51b8c3fe8679 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-510371836", "id": 2052529309, "os-flavor-access:is_public": "False"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:59.671690 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-95a4196d-dc8f-4857-9d69-51b8c3fe8679 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.027099 Jul 20 04:08:59.679695 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 43/74] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:59 2022] POST /compute/v2.1/flavors => generated 414 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:59.692345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d4500154-07f1-4899-b1d3-24aac05e2a95 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.737141 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d4500154-07f1-4899-b1d3-24aac05e2a95 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048248 Jul 20 04:08:59.738890 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 44/75] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:59.753352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e659c5e2-555f-4fd6-bb4b-65234daf1194 tempest-FlavorsAdminTestJSON-151711 tempest-FlavorsAdminTestJSON-151711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.780760 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e659c5e2-555f-4fd6-bb4b-65234daf1194 tempest-FlavorsAdminTestJSON-151711 tempest-FlavorsAdminTestJSON-151711-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031278 Jul 20 04:08:59.781614 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 45/76] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:59.797556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c32a5233-9fdf-40be-bdcd-07084bef51df tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.820943 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c32a5233-9fdf-40be-bdcd-07084bef51df tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/2052529309" status: 202 len: 0 microversion: 2.1 time: 0.027250 Jul 20 04:08:59.821928 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 46/77] 10.222.0.17 () {58 vars in 1160 bytes} [Wed Jul 20 04:08:59 2022] DELETE /compute/v2.1/flavors/2052529309 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:08:59.830012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-eeded419-dfd0-4771-9885-8258b8751deb tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.854407 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-eeded419-dfd0-4771-9885-8258b8751deb tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028210 Jul 20 04:08:59.855608 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 47/78] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:59.880118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e8f1a8ca-60be-4c29-bf07-c232342e8f7a tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.885331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e8f1a8ca-60be-4c29-bf07-c232342e8f7a tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:59.899427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8f1a8ca-60be-4c29-bf07-c232342e8f7a tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:59.899879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8f1a8ca-60be-4c29-bf07-c232342e8f7a tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:59.904034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8f1a8ca-60be-4c29-bf07-c232342e8f7a tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:59.904723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8f1a8ca-60be-4c29-bf07-c232342e8f7a tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:00.078542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-94cf5405-f0f5-4aff-8cb3-078251475c43 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:00.092331 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-94cf5405-f0f5-4aff-8cb3-078251475c43 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1302 microversion: 2.1 time: 0.532233 Jul 20 04:09:00.093756 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 32/79] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1302 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:00.108037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b2afa847-57b9-438e-874f-444b39042169 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1389062230", "id": 1250501416, "os-flavor-access:is_public": "True"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:00.109619 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:00.109619 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:00.113771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e8f1a8ca-60be-4c29-bf07-c232342e8f7a tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:00.127346 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e8f1a8ca-60be-4c29-bf07-c232342e8f7a tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1298 microversion: 2.1 time: 0.256633 Jul 20 04:09:00.130986 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 48/80] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1298 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:00.163811 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b2afa847-57b9-438e-874f-444b39042169 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.061009 Jul 20 04:09:00.164824 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 33/81] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:09:00 2022] POST /compute/v2.1/flavors => generated 414 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:00.178262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-807ac4ff-2dc2-4fe0-bd02-6d738518b165 tempest-FlavorsAdminTestJSON-151711 tempest-FlavorsAdminTestJSON-151711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:00.211981 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-807ac4ff-2dc2-4fe0-bd02-6d738518b165 tempest-FlavorsAdminTestJSON-151711 tempest-FlavorsAdminTestJSON-151711-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.039446 Jul 20 04:09:00.214372 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 34/82] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:00 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:00.232041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f12a448e-8fcb-434d-b04d-b5e9f3bb8bdb tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:00.234602 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:00.234602 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:00.260351 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f12a448e-8fcb-434d-b04d-b5e9f3bb8bdb tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1250501416" status: 202 len: 0 microversion: 2.1 time: 0.034893 Jul 20 04:09:00.261609 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 35/83] 10.222.0.17 () {58 vars in 1160 bytes} [Wed Jul 20 04:09:00 2022] DELETE /compute/v2.1/flavors/1250501416 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:09:00.271055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8f30dcfa-daf8-40dd-a745-61cee6e12554 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:00.300377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4b47c198-61fa-456f-82ca-99ec08575449 tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Calling method '.version_select at 0x7f06bf7b85e0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:00.301690 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8f30dcfa-daf8-40dd-a745-61cee6e12554 tempest-FlavorsAdminTestJSON-350885641 tempest-FlavorsAdminTestJSON-350885641-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035444 Jul 20 04:09:00.302439 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:00.302439 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:00.302600 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 36/84] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:00.303987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b47c198-61fa-456f-82ca-99ec08575449 tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:00.304461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b47c198-61fa-456f-82ca-99ec08575449 tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:00.305718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b47c198-61fa-456f-82ca-99ec08575449 tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:00.306288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b47c198-61fa-456f-82ca-99ec08575449 tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:00.339814 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4b47c198-61fa-456f-82ca-99ec08575449 tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.206992 Jul 20 04:09:00.341011 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 49/85] 10.222.0.17 () {58 vars in 1127 bytes} [Wed Jul 20 04:09:00 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:00.867530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-88ee40c1-5a69-4e3f-a6ac-959446a70be9 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Calling method '.version_select at 0x7f06bef48ca0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:00.869417 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:00.869417 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:00.870340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-88ee40c1-5a69-4e3f-a6ac-959446a70be9 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '7aa1264ab5184ba68231282cb06303c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3420319e24741d6ab46e76b5efe380f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-88ee40c1-5a69-4e3f-a6ac-959446a70be9 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Request method failure captured: Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_aU4p2ccMu6AEirfMPmB_X5BTDDqWpmHOyevShYjwc1eyitpSEl0nCgfHm1ja_Ep3JUtouPdZkmjxTcvF15Ye0W-fdtcTagzXdLxx5SriUeXEQlceWrhKykh9DuYtcV42IbVBR0NaQiC8arR4xX0uOSQ3ICvi5xi6X1dK8vP5kJLA Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: d3420319e24741d6ab46e76b5efe380f Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-647498807 Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:09:00.872871 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:09:00.874121 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3420319e24741d6ab46e76b5efe380f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3420319e24741d6ab46e76b5efe380f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3420319e24741d6ab46e76b5efe380f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3420319e24741d6ab46e76b5efe380f"}]}] Jul 20 04:09:00.874121 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-HostsAdminNegativeTestJSON-647498807 Jul 20 04:09:00.874121 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: d3420319e24741d6ab46e76b5efe380f Jul 20 04:09:00.874121 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-647498807 Jul 20 04:09:00.874121 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-HostsAdminNegativeTestJSON-647498807-project Jul 20 04:09:00.874121 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:09:00.874121 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:09:00.874121 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 7aa1264ab5184ba68231282cb06303c7 Jul 20 04:09:00.874121 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-HostsAdminNegativeTestJSON-647498807-project Jul 20 04:09:00.874121 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:09:00.874121 n-d-826526-5 devstack@n-api.service[127870]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 20 04:09:00.874121 n-d-826526-5 devstack@n-api.service[127870]: action_args: {} Jul 20 04:09:00.874121 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:00.874864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 20 04:09:00.875917 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:00.876898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-88ee40c1-5a69-4e3f-a6ac-959446a70be9 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:00.876898 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-88ee40c1-5a69-4e3f-a6ac-959446a70be9 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.523775 Jul 20 04:09:00.876898 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 37/86] 10.222.0.17 () {58 vars in 1127 bytes} [Wed Jul 20 04:09:00 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 525 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:00.886475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5d04261b-a74f-4b53-a360-3c58f588b474 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Calling method '.version_select at 0x7f06c4063dc0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:00.887390 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:00.887390 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:00.888677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5d04261b-a74f-4b53-a360-3c58f588b474 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '7aa1264ab5184ba68231282cb06303c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3420319e24741d6ab46e76b5efe380f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5d04261b-a74f-4b53-a360-3c58f588b474 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Request method failure captured: Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-hosts/n-d-826526-5/reboot HTTP/1.1 Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_aU4p2ccMu6AEirfMPmB_X5BTDDqWpmHOyevShYjwc1eyitpSEl0nCgfHm1ja_Ep3JUtouPdZkmjxTcvF15Ye0W-fdtcTagzXdLxx5SriUeXEQlceWrhKykh9DuYtcV42IbVBR0NaQiC8arR4xX0uOSQ3ICvi5xi6X1dK8vP5kJLA Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: d3420319e24741d6ab46e76b5efe380f Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-647498807 Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:09:00.891681 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:09:00.893211 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3420319e24741d6ab46e76b5efe380f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3420319e24741d6ab46e76b5efe380f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3420319e24741d6ab46e76b5efe380f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3420319e24741d6ab46e76b5efe380f"}]}] Jul 20 04:09:00.893211 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-647498807 Jul 20 04:09:00.893211 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: d3420319e24741d6ab46e76b5efe380f Jul 20 04:09:00.893211 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-647498807 Jul 20 04:09:00.893211 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-HostsAdminNegativeTestJSON-647498807-project Jul 20 04:09:00.893211 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:00.893211 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:00.893211 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 7aa1264ab5184ba68231282cb06303c7 Jul 20 04:09:00.893211 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-647498807-project Jul 20 04:09:00.893211 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:09:00.893211 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 20 04:09:00.893211 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'n-d-826526-5'} Jul 20 04:09:00.893211 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:00.893970 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:00.895041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:00.895041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:00.895041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:00.895041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:00.895041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:00.895041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:00.895041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 20 04:09:00.895041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:00.895041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:00.895041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:00.895041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:00.895041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:00.895041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:00.895041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:00.895041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:00.895041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 20 04:09:00.895041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:00.897518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5d04261b-a74f-4b53-a360-3c58f588b474 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:00.902638 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5d04261b-a74f-4b53-a360-3c58f588b474 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] 10.222.0.17 "GET /compute/v2.1/os-hosts/n-d-826526-5/reboot" status: 403 len: 111 microversion: 2.1 time: 0.021550 Jul 20 04:09:00.903703 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 50/87] 10.222.0.17 () {58 vars in 1187 bytes} [Wed Jul 20 04:09:00 2022] GET /compute/v2.1/os-hosts/n-d-826526-5/reboot => generated 111 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:00.915128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-be7d15b4-403d-41da-8d39-2670597aa76f tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Calling method '.version_select at 0x7f06beeb8820>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:00.916583 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:00.916583 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:00.939784 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-be7d15b4-403d-41da-8d39-2670597aa76f tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-be7d15b4-403d-41da-8d39-2670597aa76f tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Request method failure captured: Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_bVg8u04DLERGV5zTPuZPuHSfOYLyYzWGjhG0IKUXfuQ7lw9fqVa-2WSOg0OOT6JpetfsCZeHKgA3t3drdFtkOLrFmxtFQfJAi1ebP3DO6aEw7rq8vbwnq-wl5fTnp2FZvwIU4HP8nCMJUXK1-esIVr52cn22AiBFvZRqYLUwMc3A Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 9c34853abfdb45c3b35bb4cfc0c63960 Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member,admin Jul 20 04:09:00.957030 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member,admin Jul 20 04:09:00.958392 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c34853abfdb45c3b35bb4cfc0c63960"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c34853abfdb45c3b35bb4cfc0c63960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c34853abfdb45c3b35bb4cfc0c63960", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c34853abfdb45c3b35bb4cfc0c63960"}]}] Jul 20 04:09:00.958392 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:00.958392 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 9c34853abfdb45c3b35bb4cfc0c63960 Jul 20 04:09:00.958392 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:00.958392 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-HostsAdminNegativeTestJSON-1433667115-project-admin Jul 20 04:09:00.958392 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:09:00.958392 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:09:00.958392 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 5b2b3aedadb64b8a91e5703a6859d26a Jul 20 04:09:00.958392 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1433667115-project-admin Jul 20 04:09:00.958392 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:09:00.958392 n-d-826526-5 devstack@n-api.service[127870]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:00.958392 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'nonexistent_hostname'} Jul 20 04:09:00.958392 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:09:00.959050 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 20 04:09:00.960040 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:00.961016 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:00.961016 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:00.961016 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:00.961016 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:00.961016 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:00.961016 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:00.961016 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:00.961016 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:00.961016 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:00.961016 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:00.961016 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:00.961016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-be7d15b4-403d-41da-8d39-2670597aa76f tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:00.962137 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-be7d15b4-403d-41da-8d39-2670597aa76f tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.051867 Jul 20 04:09:00.963089 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 38/88] 10.222.0.17 () {58 vars in 1211 bytes} [Wed Jul 20 04:09:00 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:09:00.973271 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f178516f-423f-47fb-b804-d0f693791555 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Calling method '.version_select at 0x7f06bf74a820>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:00.975048 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:00.975048 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:00.977275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f178516f-423f-47fb-b804-d0f693791555 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '7aa1264ab5184ba68231282cb06303c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3420319e24741d6ab46e76b5efe380f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f178516f-423f-47fb-b804-d0f693791555 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Request method failure captured: Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-hosts/n-d-826526-5 HTTP/1.1 Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_aU4p2ccMu6AEirfMPmB_X5BTDDqWpmHOyevShYjwc1eyitpSEl0nCgfHm1ja_Ep3JUtouPdZkmjxTcvF15Ye0W-fdtcTagzXdLxx5SriUeXEQlceWrhKykh9DuYtcV42IbVBR0NaQiC8arR4xX0uOSQ3ICvi5xi6X1dK8vP5kJLA Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: d3420319e24741d6ab46e76b5efe380f Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-647498807 Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:09:00.979916 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:09:00.981323 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3420319e24741d6ab46e76b5efe380f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3420319e24741d6ab46e76b5efe380f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3420319e24741d6ab46e76b5efe380f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3420319e24741d6ab46e76b5efe380f"}]}] Jul 20 04:09:00.981323 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-647498807 Jul 20 04:09:00.981323 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: d3420319e24741d6ab46e76b5efe380f Jul 20 04:09:00.981323 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-647498807 Jul 20 04:09:00.981323 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-HostsAdminNegativeTestJSON-647498807-project Jul 20 04:09:00.981323 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:00.981323 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:00.981323 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 7aa1264ab5184ba68231282cb06303c7 Jul 20 04:09:00.981323 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-647498807-project Jul 20 04:09:00.981323 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:09:00.981323 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 20 04:09:00.981323 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'n-d-826526-5'} Jul 20 04:09:00.981323 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:00.982016 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:00.983133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:00.983133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:00.983133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:00.983133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:00.983133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:00.983133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:00.983133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 20 04:09:00.983133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:00.983133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:00.983133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:00.983133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:00.983133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:00.983133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:00.983133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:00.983133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:00.983133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 20 04:09:00.983133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:00.984124 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f178516f-423f-47fb-b804-d0f693791555 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:00.984124 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f178516f-423f-47fb-b804-d0f693791555 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] 10.222.0.17 "GET /compute/v2.1/os-hosts/n-d-826526-5" status: 403 len: 109 microversion: 2.1 time: 0.013167 Jul 20 04:09:00.984124 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 51/89] 10.222.0.17 () {58 vars in 1166 bytes} [Wed Jul 20 04:09:00 2022] GET /compute/v2.1/os-hosts/n-d-826526-5 => generated 109 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:00.995338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fca8fdcf-ba03-4783-b940-a96ef2f0193f tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Calling method '.version_select at 0x7f06beda9310>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:00.996334 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:00.996334 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:01.006405 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-fca8fdcf-ba03-4783-b940-a96ef2f0193f tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fca8fdcf-ba03-4783-b940-a96ef2f0193f tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Request method failure captured: Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_bVg8u04DLERGV5zTPuZPuHSfOYLyYzWGjhG0IKUXfuQ7lw9fqVa-2WSOg0OOT6JpetfsCZeHKgA3t3drdFtkOLrFmxtFQfJAi1ebP3DO6aEw7rq8vbwnq-wl5fTnp2FZvwIU4HP8nCMJUXK1-esIVr52cn22AiBFvZRqYLUwMc3A Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 9c34853abfdb45c3b35bb4cfc0c63960 Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member,admin Jul 20 04:09:01.012551 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member,admin Jul 20 04:09:01.013681 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c34853abfdb45c3b35bb4cfc0c63960"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c34853abfdb45c3b35bb4cfc0c63960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c34853abfdb45c3b35bb4cfc0c63960", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c34853abfdb45c3b35bb4cfc0c63960"}]}] Jul 20 04:09:01.013681 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.013681 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 9c34853abfdb45c3b35bb4cfc0c63960 Jul 20 04:09:01.013681 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.013681 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-HostsAdminNegativeTestJSON-1433667115-project-admin Jul 20 04:09:01.013681 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:09:01.013681 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:09:01.013681 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 5b2b3aedadb64b8a91e5703a6859d26a Jul 20 04:09:01.013681 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1433667115-project-admin Jul 20 04:09:01.013681 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:09:01.013681 n-d-826526-5 devstack@n-api.service[127870]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.013681 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'nonexistent_hostname'} Jul 20 04:09:01.013681 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.014380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:01.015443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:01.015443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:01.015443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:01.015443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:01.015443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:01.015443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 20 04:09:01.015443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:01.015443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.015443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.015443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.015443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.015443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.015443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.015443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.015443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:01.015443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:01.015443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.015443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.016568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fca8fdcf-ba03-4783-b940-a96ef2f0193f tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:01.017616 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fca8fdcf-ba03-4783-b940-a96ef2f0193f tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.027229 Jul 20 04:09:01.017616 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 39/90] 10.222.0.17 () {58 vars in 1190 bytes} [Wed Jul 20 04:09:00 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:09:01.029493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-44de8add-112f-4128-a0b2-75fb0fbcd1b6 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Calling method '.version_select at 0x7f06c49f8ca0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:01.030330 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:01.030330 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:01.031477 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-44de8add-112f-4128-a0b2-75fb0fbcd1b6 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '7aa1264ab5184ba68231282cb06303c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3420319e24741d6ab46e76b5efe380f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-44de8add-112f-4128-a0b2-75fb0fbcd1b6 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Request method failure captured: Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-hosts/n-d-826526-5/shutdown HTTP/1.1 Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_aU4p2ccMu6AEirfMPmB_X5BTDDqWpmHOyevShYjwc1eyitpSEl0nCgfHm1ja_Ep3JUtouPdZkmjxTcvF15Ye0W-fdtcTagzXdLxx5SriUeXEQlceWrhKykh9DuYtcV42IbVBR0NaQiC8arR4xX0uOSQ3ICvi5xi6X1dK8vP5kJLA Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: d3420319e24741d6ab46e76b5efe380f Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-647498807 Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:09:01.033179 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:09:01.034248 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3420319e24741d6ab46e76b5efe380f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3420319e24741d6ab46e76b5efe380f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3420319e24741d6ab46e76b5efe380f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3420319e24741d6ab46e76b5efe380f"}]}] Jul 20 04:09:01.034248 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-647498807 Jul 20 04:09:01.034248 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: d3420319e24741d6ab46e76b5efe380f Jul 20 04:09:01.034248 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-647498807 Jul 20 04:09:01.034248 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-HostsAdminNegativeTestJSON-647498807-project Jul 20 04:09:01.034248 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:01.034248 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:01.034248 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 7aa1264ab5184ba68231282cb06303c7 Jul 20 04:09:01.034248 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-647498807-project Jul 20 04:09:01.034248 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:09:01.034248 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 20 04:09:01.034248 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'n-d-826526-5'} Jul 20 04:09:01.034248 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:01.034875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:01.035864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:01.035864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:01.035864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:01.035864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:01.035864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:01.035864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:01.035864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 20 04:09:01.035864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.035864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.035864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.035864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.035864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.035864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.035864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:01.035864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:01.035864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 20 04:09:01.035864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.036746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-44de8add-112f-4128-a0b2-75fb0fbcd1b6 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:01.036746 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-44de8add-112f-4128-a0b2-75fb0fbcd1b6 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] 10.222.0.17 "GET /compute/v2.1/os-hosts/n-d-826526-5/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.010069 Jul 20 04:09:01.041279 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 52/91] 10.222.0.17 () {58 vars in 1193 bytes} [Wed Jul 20 04:09:01 2022] GET /compute/v2.1/os-hosts/n-d-826526-5/shutdown => generated 113 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:01.050537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-05c22dea-4631-4970-972d-435dcb53d2ab tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Calling method '.version_select at 0x7f06bede8ee0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:01.051541 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:01.051541 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:01.062931 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-05c22dea-4631-4970-972d-435dcb53d2ab tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-05c22dea-4631-4970-972d-435dcb53d2ab tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Request method failure captured: Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_bVg8u04DLERGV5zTPuZPuHSfOYLyYzWGjhG0IKUXfuQ7lw9fqVa-2WSOg0OOT6JpetfsCZeHKgA3t3drdFtkOLrFmxtFQfJAi1ebP3DO6aEw7rq8vbwnq-wl5fTnp2FZvwIU4HP8nCMJUXK1-esIVr52cn22AiBFvZRqYLUwMc3A Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 9c34853abfdb45c3b35bb4cfc0c63960 Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member,admin Jul 20 04:09:01.065303 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member,admin Jul 20 04:09:01.066436 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c34853abfdb45c3b35bb4cfc0c63960"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c34853abfdb45c3b35bb4cfc0c63960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c34853abfdb45c3b35bb4cfc0c63960", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c34853abfdb45c3b35bb4cfc0c63960"}]}] Jul 20 04:09:01.066436 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.066436 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 9c34853abfdb45c3b35bb4cfc0c63960 Jul 20 04:09:01.066436 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.066436 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-HostsAdminNegativeTestJSON-1433667115-project-admin Jul 20 04:09:01.066436 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:09:01.066436 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:09:01.066436 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 5b2b3aedadb64b8a91e5703a6859d26a Jul 20 04:09:01.066436 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1433667115-project-admin Jul 20 04:09:01.066436 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:09:01.066436 n-d-826526-5 devstack@n-api.service[127870]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.066436 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'nonexistent_hostname'} Jul 20 04:09:01.066436 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:09:01.067111 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 20 04:09:01.068037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:01.069069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.069069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.069069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.069069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.069069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.069069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.069069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.069069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:01.069069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:01.069069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.069069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.069069 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-05c22dea-4631-4970-972d-435dcb53d2ab tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:01.069069 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-05c22dea-4631-4970-972d-435dcb53d2ab tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.024719 Jul 20 04:09:01.069069 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 40/92] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jul 20 04:09:01 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:09:01.077982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2ef55f63-2f4e-47b9-a685-ea7f9423a263 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Calling method '.version_select at 0x7f06bf74a280>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:01.079254 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:01.079254 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:01.081645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2ef55f63-2f4e-47b9-a685-ea7f9423a263 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '7aa1264ab5184ba68231282cb06303c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3420319e24741d6ab46e76b5efe380f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2ef55f63-2f4e-47b9-a685-ea7f9423a263 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Request method failure captured: Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-hosts/n-d-826526-5/startup HTTP/1.1 Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_aU4p2ccMu6AEirfMPmB_X5BTDDqWpmHOyevShYjwc1eyitpSEl0nCgfHm1ja_Ep3JUtouPdZkmjxTcvF15Ye0W-fdtcTagzXdLxx5SriUeXEQlceWrhKykh9DuYtcV42IbVBR0NaQiC8arR4xX0uOSQ3ICvi5xi6X1dK8vP5kJLA Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: d3420319e24741d6ab46e76b5efe380f Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-647498807 Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:09:01.083655 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:09:01.085056 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3420319e24741d6ab46e76b5efe380f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3420319e24741d6ab46e76b5efe380f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3420319e24741d6ab46e76b5efe380f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3420319e24741d6ab46e76b5efe380f"}]}] Jul 20 04:09:01.085056 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-647498807 Jul 20 04:09:01.085056 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: d3420319e24741d6ab46e76b5efe380f Jul 20 04:09:01.085056 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-647498807 Jul 20 04:09:01.085056 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-HostsAdminNegativeTestJSON-647498807-project Jul 20 04:09:01.085056 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:01.085056 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:01.085056 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 7aa1264ab5184ba68231282cb06303c7 Jul 20 04:09:01.085056 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-647498807-project Jul 20 04:09:01.085056 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:09:01.085056 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 20 04:09:01.085056 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'n-d-826526-5'} Jul 20 04:09:01.085056 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:01.085794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:01.086706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:01.086706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:01.086706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:01.086706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:01.086706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:01.086706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:01.086706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 20 04:09:01.086706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.086706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.086706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.086706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.086706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.086706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.086706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:01.086706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:01.086706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 20 04:09:01.086706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.088928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2ef55f63-2f4e-47b9-a685-ea7f9423a263 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:01.092191 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2ef55f63-2f4e-47b9-a685-ea7f9423a263 tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] 10.222.0.17 "GET /compute/v2.1/os-hosts/n-d-826526-5/startup" status: 403 len: 110 microversion: 2.1 time: 0.018714 Jul 20 04:09:01.092926 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 53/93] 10.222.0.17 () {58 vars in 1190 bytes} [Wed Jul 20 04:09:01 2022] GET /compute/v2.1/os-hosts/n-d-826526-5/startup => generated 110 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:01.104719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2d5e97f2-4ebc-4d82-8e00-5f2a6ee88b0d tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Calling method '.version_select at 0x7f06beda9430>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:01.106677 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:01.106677 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:01.133906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-51241c48-1b36-49cd-b45a-b353f1cbf458 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:01.134672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-51241c48-1b36-49cd-b45a-b353f1cbf458 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:01.159503 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-2d5e97f2-4ebc-4d82-8e00-5f2a6ee88b0d tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2d5e97f2-4ebc-4d82-8e00-5f2a6ee88b0d tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Request method failure captured: Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_bVg8u04DLERGV5zTPuZPuHSfOYLyYzWGjhG0IKUXfuQ7lw9fqVa-2WSOg0OOT6JpetfsCZeHKgA3t3drdFtkOLrFmxtFQfJAi1ebP3DO6aEw7rq8vbwnq-wl5fTnp2FZvwIU4HP8nCMJUXK1-esIVr52cn22AiBFvZRqYLUwMc3A Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 9c34853abfdb45c3b35bb4cfc0c63960 Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member,admin Jul 20 04:09:01.168114 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member,admin Jul 20 04:09:01.169653 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c34853abfdb45c3b35bb4cfc0c63960"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c34853abfdb45c3b35bb4cfc0c63960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c34853abfdb45c3b35bb4cfc0c63960", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c34853abfdb45c3b35bb4cfc0c63960"}]}] Jul 20 04:09:01.169653 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.169653 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 9c34853abfdb45c3b35bb4cfc0c63960 Jul 20 04:09:01.169653 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.169653 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-HostsAdminNegativeTestJSON-1433667115-project-admin Jul 20 04:09:01.169653 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:09:01.169653 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:09:01.169653 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 5b2b3aedadb64b8a91e5703a6859d26a Jul 20 04:09:01.169653 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1433667115-project-admin Jul 20 04:09:01.169653 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:09:01.169653 n-d-826526-5 devstack@n-api.service[127870]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.169653 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'nonexistent_hostname'} Jul 20 04:09:01.169653 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:09:01.170471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 20 04:09:01.171611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:01.172771 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.172771 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.172771 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.172771 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.172771 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.172771 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.172771 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.172771 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:01.172771 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:01.172771 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.172771 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.174190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51241c48-1b36-49cd-b45a-b353f1cbf458 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.174845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51241c48-1b36-49cd-b45a-b353f1cbf458 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.175445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51241c48-1b36-49cd-b45a-b353f1cbf458 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.175886 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51241c48-1b36-49cd-b45a-b353f1cbf458 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.176920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2d5e97f2-4ebc-4d82-8e00-5f2a6ee88b0d tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:01.179036 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2d5e97f2-4ebc-4d82-8e00-5f2a6ee88b0d tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.080630 Jul 20 04:09:01.184546 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 41/94] 10.222.0.17 () {58 vars in 1214 bytes} [Wed Jul 20 04:09:01 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:09:01.197245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3dc1ecfa-adba-4ce8-9e90-d1071952aa63 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:01.197886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3dc1ecfa-adba-4ce8-9e90-d1071952aa63 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:01.220166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3dc1ecfa-adba-4ce8-9e90-d1071952aa63 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.221867 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3dc1ecfa-adba-4ce8-9e90-d1071952aa63 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.222710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3dc1ecfa-adba-4ce8-9e90-d1071952aa63 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.223169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3dc1ecfa-adba-4ce8-9e90-d1071952aa63 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.297761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-51241c48-1b36-49cd-b45a-b353f1cbf458 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:01.308908 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-51241c48-1b36-49cd-b45a-b353f1cbf458 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1300 microversion: 2.1 time: 0.202293 Jul 20 04:09:01.312369 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 54/95] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:01 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1300 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:01.326285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d87331b-a376-43d9-8ca9-abdec8797389 tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Action: 'update', calling method: .version_select at 0x7f06bf74a280>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d87331b-a376-43d9-8ca9-abdec8797389 tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Request method failure captured: Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: request: PUT /compute/v2.1/os-hosts/n-d-826526-5 HTTP/1.1 Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 51 Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_bVg8u04DLERGV5zTPuZPuHSfOYLyYzWGjhG0IKUXfuQ7lw9fqVa-2WSOg0OOT6JpetfsCZeHKgA3t3drdFtkOLrFmxtFQfJAi1ebP3DO6aEw7rq8vbwnq-wl5fTnp2FZvwIU4HP8nCMJUXK1-esIVr52cn22AiBFvZRqYLUwMc3A Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 9c34853abfdb45c3b35bb4cfc0c63960 Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:09:01.353540 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:09:01.354819 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c34853abfdb45c3b35bb4cfc0c63960"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c34853abfdb45c3b35bb4cfc0c63960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c34853abfdb45c3b35bb4cfc0c63960", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c34853abfdb45c3b35bb4cfc0c63960"}]}] Jul 20 04:09:01.354819 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.354819 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 9c34853abfdb45c3b35bb4cfc0c63960 Jul 20 04:09:01.354819 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.354819 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-HostsAdminNegativeTestJSON-1433667115-project-admin Jul 20 04:09:01.354819 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:01.354819 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:01.354819 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 5b2b3aedadb64b8a91e5703a6859d26a Jul 20 04:09:01.354819 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1433667115-project-admin Jul 20 04:09:01.354819 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:09:01.354819 n-d-826526-5 devstack@n-api.service[127871]: {"status": "enable", "maintenance_mode": "invalid"} Jul 20 04:09:01.354819 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:09:01.354819 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'n-d-826526-5', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'disable', Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'Enable', Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'Disable', Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance: Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.355478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.358789 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.360138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.360138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:09:01.360138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:09:01.360138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:09:01.360138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.360138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d87331b-a376-43d9-8ca9-abdec8797389 tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:01.360138 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4d87331b-a376-43d9-8ca9-abdec8797389 tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-hosts/n-d-826526-5" status: 400 len: 199 microversion: 2.1 time: 0.041560 Jul 20 04:09:01.360138 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 55/96] 10.222.0.17 () {60 vars in 1186 bytes} [Wed Jul 20 04:09:01 2022] PUT /compute/v2.1/os-hosts/n-d-826526-5 => generated 199 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:09:01.380582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0486139e-96e4-49a5-9bea-d6944bce881f tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Action: 'update', calling method: .version_select at 0x7f06c40635e0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0486139e-96e4-49a5-9bea-d6944bce881f tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Request method failure captured: Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: request: PUT /compute/v2.1/os-hosts/n-d-826526-5 HTTP/1.1 Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 51 Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_bVg8u04DLERGV5zTPuZPuHSfOYLyYzWGjhG0IKUXfuQ7lw9fqVa-2WSOg0OOT6JpetfsCZeHKgA3t3drdFtkOLrFmxtFQfJAi1ebP3DO6aEw7rq8vbwnq-wl5fTnp2FZvwIU4HP8nCMJUXK1-esIVr52cn22AiBFvZRqYLUwMc3A Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 9c34853abfdb45c3b35bb4cfc0c63960 Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:09:01.387417 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:09:01.388672 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c34853abfdb45c3b35bb4cfc0c63960"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c34853abfdb45c3b35bb4cfc0c63960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c34853abfdb45c3b35bb4cfc0c63960", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c34853abfdb45c3b35bb4cfc0c63960"}]}] Jul 20 04:09:01.388672 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.388672 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 9c34853abfdb45c3b35bb4cfc0c63960 Jul 20 04:09:01.388672 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.388672 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-HostsAdminNegativeTestJSON-1433667115-project-admin Jul 20 04:09:01.388672 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:01.388672 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:01.388672 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 5b2b3aedadb64b8a91e5703a6859d26a Jul 20 04:09:01.388672 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1433667115-project-admin Jul 20 04:09:01.388672 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:09:01.388672 n-d-826526-5 devstack@n-api.service[127871]: {"status": "invalid", "maintenance_mode": "enable"} Jul 20 04:09:01.388672 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:09:01.388672 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'n-d-826526-5', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'disable', Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'Enable', Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'Disable', Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance: Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.389353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.390669 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.391582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.391582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:09:01.391582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:09:01.391582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:09:01.391582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.391582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0486139e-96e4-49a5-9bea-d6944bce881f tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:01.391582 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0486139e-96e4-49a5-9bea-d6944bce881f tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-hosts/n-d-826526-5" status: 400 len: 189 microversion: 2.1 time: 0.013760 Jul 20 04:09:01.391582 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 56/97] 10.222.0.17 () {60 vars in 1186 bytes} [Wed Jul 20 04:09:01 2022] PUT /compute/v2.1/os-hosts/n-d-826526-5 => generated 189 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:09:01.408735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1a2c3ec7-0af9-4922-a2e1-d765e988acac tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Action: 'update', calling method: .version_select at 0x7f06c408cd30>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:01.409964 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:01.409964 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:01.411485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1a2c3ec7-0af9-4922-a2e1-d765e988acac tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '7aa1264ab5184ba68231282cb06303c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3420319e24741d6ab46e76b5efe380f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1a2c3ec7-0af9-4922-a2e1-d765e988acac tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Request method failure captured: Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: request: PUT /compute/v2.1/os-hosts/n-d-826526-5 HTTP/1.1 Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 50 Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_aU4p2ccMu6AEirfMPmB_X5BTDDqWpmHOyevShYjwc1eyitpSEl0nCgfHm1ja_Ep3JUtouPdZkmjxTcvF15Ye0W-fdtcTagzXdLxx5SriUeXEQlceWrhKykh9DuYtcV42IbVBR0NaQiC8arR4xX0uOSQ3ICvi5xi6X1dK8vP5kJLA Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: d3420319e24741d6ab46e76b5efe380f Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-647498807 Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:09:01.413671 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:09:01.414805 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3420319e24741d6ab46e76b5efe380f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3420319e24741d6ab46e76b5efe380f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3420319e24741d6ab46e76b5efe380f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3420319e24741d6ab46e76b5efe380f"}]}] Jul 20 04:09:01.414805 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-647498807 Jul 20 04:09:01.414805 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: d3420319e24741d6ab46e76b5efe380f Jul 20 04:09:01.414805 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-647498807 Jul 20 04:09:01.414805 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-HostsAdminNegativeTestJSON-647498807-project Jul 20 04:09:01.414805 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:01.414805 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:01.414805 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 7aa1264ab5184ba68231282cb06303c7 Jul 20 04:09:01.414805 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-647498807-project Jul 20 04:09:01.414805 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:09:01.414805 n-d-826526-5 devstack@n-api.service[127871]: {"status": "enable", "maintenance_mode": "enable"} Jul 20 04:09:01.414805 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:09:01.414805 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 20 04:09:01.414805 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'n-d-826526-5', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:01.415584 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 20 04:09:01.416653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.417641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1a2c3ec7-0af9-4922-a2e1-d765e988acac tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:01.417641 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1a2c3ec7-0af9-4922-a2e1-d765e988acac tempest-HostsAdminNegativeTestJSON-647498807 tempest-HostsAdminNegativeTestJSON-647498807-project] 10.222.0.17 "PUT /compute/v2.1/os-hosts/n-d-826526-5" status: 403 len: 111 microversion: 2.1 time: 0.012938 Jul 20 04:09:01.417641 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 57/98] 10.222.0.17 () {60 vars in 1186 bytes} [Wed Jul 20 04:09:01 2022] PUT /compute/v2.1/os-hosts/n-d-826526-5 => generated 111 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:01.427720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a5675ba4-9efb-45ec-9365-cc370e1e08ce tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Action: 'update', calling method: .version_select at 0x7f06bf74a820>, body: {"status": null, "maintenance_mode": null} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a5675ba4-9efb-45ec-9365-cc370e1e08ce tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Request method failure captured: Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: request: PUT /compute/v2.1/os-hosts/n-d-826526-5 HTTP/1.1 Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 42 Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_bVg8u04DLERGV5zTPuZPuHSfOYLyYzWGjhG0IKUXfuQ7lw9fqVa-2WSOg0OOT6JpetfsCZeHKgA3t3drdFtkOLrFmxtFQfJAi1ebP3DO6aEw7rq8vbwnq-wl5fTnp2FZvwIU4HP8nCMJUXK1-esIVr52cn22AiBFvZRqYLUwMc3A Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 9c34853abfdb45c3b35bb4cfc0c63960 Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:09:01.430174 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:09:01.431336 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c34853abfdb45c3b35bb4cfc0c63960"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c34853abfdb45c3b35bb4cfc0c63960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c34853abfdb45c3b35bb4cfc0c63960", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c34853abfdb45c3b35bb4cfc0c63960"}]}] Jul 20 04:09:01.431336 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.431336 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 9c34853abfdb45c3b35bb4cfc0c63960 Jul 20 04:09:01.431336 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.431336 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-HostsAdminNegativeTestJSON-1433667115-project-admin Jul 20 04:09:01.431336 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:01.431336 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:01.431336 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 5b2b3aedadb64b8a91e5703a6859d26a Jul 20 04:09:01.431336 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1433667115-project-admin Jul 20 04:09:01.431336 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:09:01.431336 n-d-826526-5 devstack@n-api.service[127871]: {"status": null, "maintenance_mode": null} Jul 20 04:09:01.431336 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:09:01.431336 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 20 04:09:01.431336 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'n-d-826526-5', 'body': {'status': None, 'maintenance_mode': None}} Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'disable', Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'Enable', Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'Disable', Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance: Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi None Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.432061 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.433317 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.434229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:09:01.434229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:09:01.434229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 20 04:09:01.434229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.437167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a5675ba4-9efb-45ec-9365-cc370e1e08ce tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:01.437377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3dc1ecfa-adba-4ce8-9e90-d1071952aa63 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:01.438332 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a5675ba4-9efb-45ec-9365-cc370e1e08ce tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-hosts/n-d-826526-5" status: 400 len: 127 microversion: 2.1 time: 0.015043 Jul 20 04:09:01.439106 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 58/99] 10.222.0.17 () {60 vars in 1186 bytes} [Wed Jul 20 04:09:01 2022] PUT /compute/v2.1/os-hosts/n-d-826526-5 => generated 127 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:09:01.456373 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3dc1ecfa-adba-4ce8-9e90-d1071952aa63 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1296 microversion: 2.1 time: 0.269075 Jul 20 04:09:01.466603 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 42/100] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:01 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1296 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:01.468734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5905f61d-2a40-4482-aa62-5739532cc55b tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Action: 'update', calling method: .version_select at 0x7f06bf712700>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:01.474071 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.hosts [None req-5905f61d-2a40-4482-aa62-5739532cc55b tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Enabling host nonexistent_hostname. Jul 20 04:09:01.510072 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-5905f61d-2a40-4482-aa62-5739532cc55b tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5905f61d-2a40-4482-aa62-5739532cc55b tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Request method failure captured: Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 50 Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_bVg8u04DLERGV5zTPuZPuHSfOYLyYzWGjhG0IKUXfuQ7lw9fqVa-2WSOg0OOT6JpetfsCZeHKgA3t3drdFtkOLrFmxtFQfJAi1ebP3DO6aEw7rq8vbwnq-wl5fTnp2FZvwIU4HP8nCMJUXK1-esIVr52cn22AiBFvZRqYLUwMc3A Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 9c34853abfdb45c3b35bb4cfc0c63960 Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:09:01.519969 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:09:01.521105 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c34853abfdb45c3b35bb4cfc0c63960"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c34853abfdb45c3b35bb4cfc0c63960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c34853abfdb45c3b35bb4cfc0c63960", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c34853abfdb45c3b35bb4cfc0c63960"}]}] Jul 20 04:09:01.521105 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.521105 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 9c34853abfdb45c3b35bb4cfc0c63960 Jul 20 04:09:01.521105 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1433667115 Jul 20 04:09:01.521105 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-HostsAdminNegativeTestJSON-1433667115-project-admin Jul 20 04:09:01.521105 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:01.521105 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:01.521105 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 5b2b3aedadb64b8a91e5703a6859d26a Jul 20 04:09:01.521105 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1433667115-project-admin Jul 20 04:09:01.521105 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:09:01.521105 n-d-826526-5 devstack@n-api.service[127871]: {"status": "enable", "maintenance_mode": "enable"} Jul 20 04:09:01.521105 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:09:01.521105 n-d-826526-5 devstack@n-api.service[127871]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.521105 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 20 04:09:01.521794 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:01.521794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.521794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 20 04:09:01.521794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 20 04:09:01.521794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:09:01.521794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:09:01.521794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:01.521794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:01.521794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:01.521794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:01.521794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:09:01.521794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:09:01.521794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 04:09:01.521794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 04:09:01.521794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:09:01.521794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:09:01.521794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:09:01.521794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:01.522747 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 20 04:09:01.523763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 20 04:09:01.523763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 20 04:09:01.523763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:01.523763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.523763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.523763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.523763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.523763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.523763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.523763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.523763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:01.523763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:01.523763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:09:01.523763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.528815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5905f61d-2a40-4482-aa62-5739532cc55b tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:01.530108 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5905f61d-2a40-4482-aa62-5739532cc55b tempest-HostsAdminNegativeTestJSON-1433667115 tempest-HostsAdminNegativeTestJSON-1433667115-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.085009 Jul 20 04:09:01.530955 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 59/101] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jul 20 04:09:01 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:09:02.336979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6a129a58-451d-42ae-bb4d-88fbfc77b5d3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:02.339015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6a129a58-451d-42ae-bb4d-88fbfc77b5d3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:02.386391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a129a58-451d-42ae-bb4d-88fbfc77b5d3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:02.387113 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a129a58-451d-42ae-bb4d-88fbfc77b5d3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:02.392933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a129a58-451d-42ae-bb4d-88fbfc77b5d3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:02.393835 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a129a58-451d-42ae-bb4d-88fbfc77b5d3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:02.476823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e16d09ca-d8a8-459a-95d6-91af3d7eaa52 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:02.477894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e16d09ca-d8a8-459a-95d6-91af3d7eaa52 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:02.505118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e16d09ca-d8a8-459a-95d6-91af3d7eaa52 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:02.506982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e16d09ca-d8a8-459a-95d6-91af3d7eaa52 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:02.508791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e16d09ca-d8a8-459a-95d6-91af3d7eaa52 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:02.509308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e16d09ca-d8a8-459a-95d6-91af3d7eaa52 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:02.673139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e16d09ca-d8a8-459a-95d6-91af3d7eaa52 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:02.686994 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e16d09ca-d8a8-459a-95d6-91af3d7eaa52 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1296 microversion: 2.1 time: 0.215680 Jul 20 04:09:02.698144 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 60/102] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:02 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1296 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:02.879710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6a129a58-451d-42ae-bb4d-88fbfc77b5d3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:02.892657 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6a129a58-451d-42ae-bb4d-88fbfc77b5d3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1342 microversion: 2.1 time: 0.559833 Jul 20 04:09:02.893723 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 43/103] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:02 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1342 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:03.706321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-abf84ecd-6ad3-4d23-8eef-8091b4329c92 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:03.707920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-abf84ecd-6ad3-4d23-8eef-8091b4329c92 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:03.720757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abf84ecd-6ad3-4d23-8eef-8091b4329c92 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:03.721322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abf84ecd-6ad3-4d23-8eef-8091b4329c92 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:03.722137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abf84ecd-6ad3-4d23-8eef-8091b4329c92 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:03.722564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abf84ecd-6ad3-4d23-8eef-8091b4329c92 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:03.910096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d5a420fa-7025-41f9-9302-d15527b2c8a8 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:03.911279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d5a420fa-7025-41f9-9302-d15527b2c8a8 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:03.926256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5a420fa-7025-41f9-9302-d15527b2c8a8 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:03.930840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5a420fa-7025-41f9-9302-d15527b2c8a8 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:03.934672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5a420fa-7025-41f9-9302-d15527b2c8a8 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:03.941588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5a420fa-7025-41f9-9302-d15527b2c8a8 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:03.968794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-abf84ecd-6ad3-4d23-8eef-8091b4329c92 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:03.979242 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-abf84ecd-6ad3-4d23-8eef-8091b4329c92 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1338 microversion: 2.1 time: 0.276953 Jul 20 04:09:03.980353 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 61/104] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:03 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1338 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:04.314316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d5a420fa-7025-41f9-9302-d15527b2c8a8 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:04.329026 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d5a420fa-7025-41f9-9302-d15527b2c8a8 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1342 microversion: 2.1 time: 0.422307 Jul 20 04:09:04.341680 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 44/105] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:03 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1342 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:05.003178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-abe91947-5a12-45d6-a1fd-5cb9995db5c7 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:05.004532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-abe91947-5a12-45d6-a1fd-5cb9995db5c7 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:05.016217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abe91947-5a12-45d6-a1fd-5cb9995db5c7 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:05.018933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abe91947-5a12-45d6-a1fd-5cb9995db5c7 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:05.020499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abe91947-5a12-45d6-a1fd-5cb9995db5c7 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:05.022887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abe91947-5a12-45d6-a1fd-5cb9995db5c7 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:05.349779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-50046a3b-2337-40f0-ad75-0aeff31c3b36 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:05.350541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-50046a3b-2337-40f0-ad75-0aeff31c3b36 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:05.359579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50046a3b-2337-40f0-ad75-0aeff31c3b36 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:05.360443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50046a3b-2337-40f0-ad75-0aeff31c3b36 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:05.361593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50046a3b-2337-40f0-ad75-0aeff31c3b36 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:05.362183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50046a3b-2337-40f0-ad75-0aeff31c3b36 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:05.405442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-abe91947-5a12-45d6-a1fd-5cb9995db5c7 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:05.420340 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-abe91947-5a12-45d6-a1fd-5cb9995db5c7 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1338 microversion: 2.1 time: 0.419006 Jul 20 04:09:05.421387 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 62/106] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:04 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1338 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:06.034097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-50046a3b-2337-40f0-ad75-0aeff31c3b36 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:06.046501 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-50046a3b-2337-40f0-ad75-0aeff31c3b36 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1342 microversion: 2.1 time: 0.703143 Jul 20 04:09:06.050656 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 45/107] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:05 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1342 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:06.438346 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a0a81fa1-9258-483e-8cc2-ec9ee2cdef8b tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:06.438965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a0a81fa1-9258-483e-8cc2-ec9ee2cdef8b tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:06.453927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0a81fa1-9258-483e-8cc2-ec9ee2cdef8b tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:06.454731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0a81fa1-9258-483e-8cc2-ec9ee2cdef8b tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:06.455715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0a81fa1-9258-483e-8cc2-ec9ee2cdef8b tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:06.460517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0a81fa1-9258-483e-8cc2-ec9ee2cdef8b tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:06.909001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a0a81fa1-9258-483e-8cc2-ec9ee2cdef8b tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:06.934340 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a0a81fa1-9258-483e-8cc2-ec9ee2cdef8b tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1338 microversion: 2.1 time: 0.484984 Jul 20 04:09:06.945687 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 63/108] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:06 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1338 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:07.070039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ff5236cd-809c-459b-813b-a5b3aa2d7fea tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:07.071231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ff5236cd-809c-459b-813b-a5b3aa2d7fea tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:07.082468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff5236cd-809c-459b-813b-a5b3aa2d7fea tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.083394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff5236cd-809c-459b-813b-a5b3aa2d7fea tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.084649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff5236cd-809c-459b-813b-a5b3aa2d7fea tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.087055 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff5236cd-809c-459b-813b-a5b3aa2d7fea tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.260830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:07.393671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f48e9f4e-acc6-4a54-932c-776138f2dee0 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Calling method '.version_select at 0x7f06beda94c0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:07.399876 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:07.399876 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:07.402312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f48e9f4e-acc6-4a54-932c-776138f2dee0 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.402932 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f48e9f4e-acc6-4a54-932c-776138f2dee0 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.438444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f48e9f4e-acc6-4a54-932c-776138f2dee0 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.443899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f48e9f4e-acc6-4a54-932c-776138f2dee0 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.476279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f48e9f4e-acc6-4a54-932c-776138f2dee0 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.477298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f48e9f4e-acc6-4a54-932c-776138f2dee0 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.501728 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f48e9f4e-acc6-4a54-932c-776138f2dee0 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.905011 Jul 20 04:09:07.511808 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 46/109] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:07.516883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-41cfdd72-42c8-4f11-970e-7b682a375bdc tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Calling method '.version_select at 0x7f06beda9ee0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:07.522989 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:07.522989 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:07.525957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41cfdd72-42c8-4f11-970e-7b682a375bdc tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.527816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41cfdd72-42c8-4f11-970e-7b682a375bdc tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.562233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41cfdd72-42c8-4f11-970e-7b682a375bdc tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.565577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41cfdd72-42c8-4f11-970e-7b682a375bdc tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.567028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ff5236cd-809c-459b-813b-a5b3aa2d7fea tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:07.576377 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ff5236cd-809c-459b-813b-a5b3aa2d7fea tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1342 microversion: 2.1 time: 0.512025 Jul 20 04:09:07.599448 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 64/110] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:07 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1342 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:07.604499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41cfdd72-42c8-4f11-970e-7b682a375bdc tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.607483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41cfdd72-42c8-4f11-970e-7b682a375bdc tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.620413 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-41cfdd72-42c8-4f11-970e-7b682a375bdc tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.107064 Jul 20 04:09:07.624918 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 47/111] 10.222.0.17 () {58 vars in 1166 bytes} [Wed Jul 20 04:09:07 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:07.640816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d4bbabb7-174e-49a5-85eb-ab42296e07ce tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Calling method '.version_select at 0x7f06bee2d670>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:07.641626 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:07.641626 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:07.642798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4bbabb7-174e-49a5-85eb-ab42296e07ce tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.643252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4bbabb7-174e-49a5-85eb-ab42296e07ce tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.649036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=10 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:07.693142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4bbabb7-174e-49a5-85eb-ab42296e07ce tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.693602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4bbabb7-174e-49a5-85eb-ab42296e07ce tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.740459 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4bbabb7-174e-49a5-85eb-ab42296e07ce tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.740970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4bbabb7-174e-49a5-85eb-ab42296e07ce tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.755031 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d4bbabb7-174e-49a5-85eb-ab42296e07ce tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.116041 Jul 20 04:09:07.758080 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 65/112] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:07.780927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-430c1ec6-5c46-437b-8694-e0a16ad9d577 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Calling method '.version_select at 0x7f06beda9670>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:07.782189 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:07.782189 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:07.783677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-430c1ec6-5c46-437b-8694-e0a16ad9d577 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.784846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-430c1ec6-5c46-437b-8694-e0a16ad9d577 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.848218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-430c1ec6-5c46-437b-8694-e0a16ad9d577 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.850960 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-430c1ec6-5c46-437b-8694-e0a16ad9d577 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.872584 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-430c1ec6-5c46-437b-8694-e0a16ad9d577 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.109369 Jul 20 04:09:07.875096 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 48/113] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:09:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:07.894784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-36b0f04e-29b3-4912-bf7d-04f2e79dfb9c tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Calling method '.version_select at 0x7f06beda9dc0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:07.897500 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:07.897500 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:07.899373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36b0f04e-29b3-4912-bf7d-04f2e79dfb9c tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.901720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36b0f04e-29b3-4912-bf7d-04f2e79dfb9c tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.934783 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-36b0f04e-29b3-4912-bf7d-04f2e79dfb9c tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.049221 Jul 20 04:09:07.943709 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 49/114] 10.222.0.17 () {58 vars in 1178 bytes} [Wed Jul 20 04:09:07 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:07.956466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-203262ee-77bb-4099-9c60-9d2956cc2b1e tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Calling method '.version_select at 0x7f06beda9ee0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:07.958997 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:07.958997 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:07.962750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-203262ee-77bb-4099-9c60-9d2956cc2b1e tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.964618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-203262ee-77bb-4099-9c60-9d2956cc2b1e tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.994466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-203262ee-77bb-4099-9c60-9d2956cc2b1e tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.997030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-203262ee-77bb-4099-9c60-9d2956cc2b1e tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.022290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-203262ee-77bb-4099-9c60-9d2956cc2b1e tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.028833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-203262ee-77bb-4099-9c60-9d2956cc2b1e tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.057965 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-203262ee-77bb-4099-9c60-9d2956cc2b1e tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.106033 Jul 20 04:09:08.062489 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 50/115] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:08.069778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b25cc29d-8a29-4c10-88f2-2bb315b9c145 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:08.072607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b25cc29d-8a29-4c10-88f2-2bb315b9c145 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:08.083260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b25cc29d-8a29-4c10-88f2-2bb315b9c145 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.084188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b25cc29d-8a29-4c10-88f2-2bb315b9c145 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.085602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b25cc29d-8a29-4c10-88f2-2bb315b9c145 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.086227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b25cc29d-8a29-4c10-88f2-2bb315b9c145 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.375962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-92f97a2e-88d0-4ade-8a4f-7f2482c8e47c req-8370d31e-9245-44c4-852b-ccca89f3722d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaceccec-6030-408a-8b3e-94b704473d0a", "tag": "dc0b81fd-f0fe-4fe9-9d09-782ea8e4a1be"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:08.412027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-92f97a2e-88d0-4ade-8a4f-7f2482c8e47c req-8370d31e-9245-44c4-852b-ccca89f3722d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.413007 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-92f97a2e-88d0-4ade-8a4f-7f2482c8e47c req-8370d31e-9245-44c4-852b-ccca89f3722d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.483800 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-92f97a2e-88d0-4ade-8a4f-7f2482c8e47c req-8370d31e-9245-44c4-852b-ccca89f3722d service nova] Creating event network-changed:dc0b81fd-f0fe-4fe9-9d09-782ea8e4a1be for instance eaceccec-6030-408a-8b3e-94b704473d0a on n-h2-826526-5 Jul 20 04:09:08.486549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-92f97a2e-88d0-4ade-8a4f-7f2482c8e47c req-8370d31e-9245-44c4-852b-ccca89f3722d service nova] Acquired lock "compute-rpcapi-router" {{(pid=127871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:09:08.489791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-844c1fc8-33ea-4d8c-88a0-8eba9950323a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.490577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-844c1fc8-33ea-4d8c-88a0-8eba9950323a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.493460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-844c1fc8-33ea-4d8c-88a0-8eba9950323a None None] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.494090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-844c1fc8-33ea-4d8c-88a0-8eba9950323a None None] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.521395 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.compute.rpcapi [None req-844c1fc8-33ea-4d8c-88a0-8eba9950323a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 04:09:08.522772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-844c1fc8-33ea-4d8c-88a0-8eba9950323a None None] Releasing lock "compute-rpcapi-router" {{(pid=127871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:09:08.552746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b25cc29d-8a29-4c10-88f2-2bb315b9c145 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:08.563803 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b25cc29d-8a29-4c10-88f2-2bb315b9c145 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1338 microversion: 2.1 time: 0.497743 Jul 20 04:09:08.568687 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 51/116] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:08 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1338 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:08.579358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-87943940-6368-4617-b569-63fd5a1cb3f8 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Calling method '.version_select at 0x7f06bed40040>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:08.585580 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:08.585580 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:08.591103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87943940-6368-4617-b569-63fd5a1cb3f8 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.595204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87943940-6368-4617-b569-63fd5a1cb3f8 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.601275 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-844c1fc8-33ea-4d8c-88a0-8eba9950323a None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.737063 Jul 20 04:09:08.602387 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 66/117] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:08.636979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87943940-6368-4617-b569-63fd5a1cb3f8 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.643237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87943940-6368-4617-b569-63fd5a1cb3f8 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.659213 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-87943940-6368-4617-b569-63fd5a1cb3f8 tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.086466 Jul 20 04:09:08.675514 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 52/118] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:09:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:08.681895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1cd3c0e7-325a-4217-ad6f-9265297d0b3d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:08.682806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1cd3c0e7-325a-4217-ad6f-9265297d0b3d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:08.690694 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cd3c0e7-325a-4217-ad6f-9265297d0b3d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.691492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cd3c0e7-325a-4217-ad6f-9265297d0b3d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.692551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cd3c0e7-325a-4217-ad6f-9265297d0b3d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.693823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cd3c0e7-325a-4217-ad6f-9265297d0b3d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.817140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=10 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:08.901073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1cd3c0e7-325a-4217-ad6f-9265297d0b3d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:08.910619 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1cd3c0e7-325a-4217-ad6f-9265297d0b3d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1342 microversion: 2.1 time: 0.232624 Jul 20 04:09:08.926573 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 53/119] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:08 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1342 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:08.931844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bb7735f1-db6b-43a2-b873-cb5dc75732ea tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Calling method '.version_select at 0x7f06beda9280>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:08.932883 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:08.932883 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:08.934341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb7735f1-db6b-43a2-b873-cb5dc75732ea tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.935227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb7735f1-db6b-43a2-b873-cb5dc75732ea tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.955410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb7735f1-db6b-43a2-b873-cb5dc75732ea tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.962756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb7735f1-db6b-43a2-b873-cb5dc75732ea tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.972399 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bb7735f1-db6b-43a2-b873-cb5dc75732ea tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.044176 Jul 20 04:09:08.989128 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 54/120] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:09:08 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:08.996714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b6c9d019-9c70-4df2-a1f9-32f4efb65ffa tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Calling method '.version_select at 0x7f06beda95e0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:08.997763 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:08.997763 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:08.999180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6c9d019-9c70-4df2-a1f9-32f4efb65ffa tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.999732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6c9d019-9c70-4df2-a1f9-32f4efb65ffa tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:09.034670 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6c9d019-9c70-4df2-a1f9-32f4efb65ffa tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:09.035244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6c9d019-9c70-4df2-a1f9-32f4efb65ffa tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:09.047430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6c9d019-9c70-4df2-a1f9-32f4efb65ffa tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:09.048020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6c9d019-9c70-4df2-a1f9-32f4efb65ffa tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:09.064767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6c9d019-9c70-4df2-a1f9-32f4efb65ffa tempest-HypervisorAdminTestJSON-313408388 tempest-HypervisorAdminTestJSON-313408388-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=127870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:09:09.066213 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81cce1b9-0712-46d2-b30a-8f22ac8d6ee3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:09.066754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81cce1b9-0712-46d2-b30a-8f22ac8d6ee3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:09.067748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81cce1b9-0712-46d2-b30a-8f22ac8d6ee3 None None] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:09.068484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81cce1b9-0712-46d2-b30a-8f22ac8d6ee3 None None] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:09.090726 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.compute.rpcapi [None req-81cce1b9-0712-46d2-b30a-8f22ac8d6ee3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 04:09:09.091865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81cce1b9-0712-46d2-b30a-8f22ac8d6ee3 None None] Releasing lock "compute-rpcapi-router" {{(pid=127870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:09:09.170932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c95ba914-1acf-4f11-9c67-fe5d4b643f0a tempest-HypervisorAdminV228Test-1156555436 tempest-HypervisorAdminV228Test-1156555436-project-admin] Calling method '.version_select at 0x7f06bf712820>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:09.171790 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:09.171790 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:09.173284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c95ba914-1acf-4f11-9c67-fe5d4b643f0a tempest-HypervisorAdminV228Test-1156555436 tempest-HypervisorAdminV228Test-1156555436-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:09.173813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c95ba914-1acf-4f11-9c67-fe5d4b643f0a tempest-HypervisorAdminV228Test-1156555436 tempest-HypervisorAdminV228Test-1156555436-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:09.195918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c95ba914-1acf-4f11-9c67-fe5d4b643f0a tempest-HypervisorAdminV228Test-1156555436 tempest-HypervisorAdminV228Test-1156555436-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:09.196421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c95ba914-1acf-4f11-9c67-fe5d4b643f0a tempest-HypervisorAdminV228Test-1156555436 tempest-HypervisorAdminV228Test-1156555436-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:09.209122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c95ba914-1acf-4f11-9c67-fe5d4b643f0a tempest-HypervisorAdminV228Test-1156555436 tempest-HypervisorAdminV228Test-1156555436-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:09.209607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c95ba914-1acf-4f11-9c67-fe5d4b643f0a tempest-HypervisorAdminV228Test-1156555436 tempest-HypervisorAdminV228Test-1156555436-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:09.216235 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c95ba914-1acf-4f11-9c67-fe5d4b643f0a tempest-HypervisorAdminV228Test-1156555436 tempest-HypervisorAdminV228Test-1156555436-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.612683 Jul 20 04:09:09.217152 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 67/121] 10.222.0.17 () {60 vars in 1186 bytes} [Wed Jul 20 04:09:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:09:09.228064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bfed396b-28c5-4def-ba9a-29e26034a48b tempest-HypervisorAdminV228Test-1156555436 tempest-HypervisorAdminV228Test-1156555436-project-admin] Calling method '.version_select at 0x7f06bf712f70>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:09.229265 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:09.229265 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:09.231262 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bfed396b-28c5-4def-ba9a-29e26034a48b tempest-HypervisorAdminV228Test-1156555436 tempest-HypervisorAdminV228Test-1156555436-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:09.231777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bfed396b-28c5-4def-ba9a-29e26034a48b tempest-HypervisorAdminV228Test-1156555436 tempest-HypervisorAdminV228Test-1156555436-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:09.253399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bfed396b-28c5-4def-ba9a-29e26034a48b tempest-HypervisorAdminV228Test-1156555436 tempest-HypervisorAdminV228Test-1156555436-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:09.253953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bfed396b-28c5-4def-ba9a-29e26034a48b tempest-HypervisorAdminV228Test-1156555436 tempest-HypervisorAdminV228Test-1156555436-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:09.261888 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bfed396b-28c5-4def-ba9a-29e26034a48b tempest-HypervisorAdminV228Test-1156555436 tempest-HypervisorAdminV228Test-1156555436-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.038083 Jul 20 04:09:09.263186 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 68/122] 10.222.0.17 () {60 vars in 1192 bytes} [Wed Jul 20 04:09:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:09:09.853841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e2b820d8-a40e-4f96-9508-9f10359bdd30 tempest-FlavorsV255TestJSON-920297064 tempest-FlavorsV255TestJSON-920297064-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-56189096", "id": 1794671223, "os-flavor-access:is_public": "True"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:09.856622 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:09.856622 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:09.875950 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e2b820d8-a40e-4f96-9508-9f10359bdd30 tempest-FlavorsV255TestJSON-920297064 tempest-FlavorsV255TestJSON-920297064-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 447 microversion: 2.55 time: 0.403271 Jul 20 04:09:09.877368 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 69/123] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 04:09:09 2022] POST /compute/v2.1/flavors => generated 447 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:09:09.884827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3e914fa0-cf14-4fd1-b6c3-d9784f9c42b3 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:09.885958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3e914fa0-cf14-4fd1-b6c3-d9784f9c42b3 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:09.893151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e914fa0-cf14-4fd1-b6c3-d9784f9c42b3 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:09.913240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e914fa0-cf14-4fd1-b6c3-d9784f9c42b3 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:09.914671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e914fa0-cf14-4fd1-b6c3-d9784f9c42b3 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:09.915387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e914fa0-cf14-4fd1-b6c3-d9784f9c42b3 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:10.105010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3e914fa0-cf14-4fd1-b6c3-d9784f9c42b3 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:10.124654 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3e914fa0-cf14-4fd1-b6c3-d9784f9c42b3 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1338 microversion: 2.1 time: 0.245619 Jul 20 04:09:10.125696 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 70/124] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:09 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1338 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:10.557087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f3a63619-109f-4c7b-a534-d43b307c3f38 tempest-FlavorsV255TestJSON-1074034853 tempest-FlavorsV255TestJSON-1074034853-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:10.568168 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f3a63619-109f-4c7b-a534-d43b307c3f38 tempest-FlavorsV255TestJSON-1074034853 tempest-FlavorsV255TestJSON-1074034853-project] 10.222.0.17 "GET /compute/v2.1/flavors/1794671223" status: 200 len: 447 microversion: 2.55 time: 0.440725 Jul 20 04:09:10.576560 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 71/125] 10.222.0.17 () {60 vars in 1198 bytes} [Wed Jul 20 04:09:10 2022] GET /compute/v2.1/flavors/1794671223 => generated 447 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:09:10.586916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-de8a78b0-dc72-4627-9807-f664fcaabcbb tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:10.590354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-de8a78b0-dc72-4627-9807-f664fcaabcbb tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:10.598217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de8a78b0-dc72-4627-9807-f664fcaabcbb tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:10.598907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de8a78b0-dc72-4627-9807-f664fcaabcbb tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:10.599807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de8a78b0-dc72-4627-9807-f664fcaabcbb tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:10.600533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de8a78b0-dc72-4627-9807-f664fcaabcbb tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:10.759960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-de8a78b0-dc72-4627-9807-f664fcaabcbb tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:10.771326 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-de8a78b0-dc72-4627-9807-f664fcaabcbb tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1342 microversion: 2.1 time: 0.193231 Jul 20 04:09:10.771928 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 72/126] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:10 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1342 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:11.048386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c605985d-6ea8-419b-a0e0-478ae33a7ea6 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Calling method '.version_select at 0x7f06beddf040>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:11.049312 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:11.049312 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:11.050716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c605985d-6ea8-419b-a0e0-478ae33a7ea6 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.051167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c605985d-6ea8-419b-a0e0-478ae33a7ea6 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.066712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c605985d-6ea8-419b-a0e0-478ae33a7ea6 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.067167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c605985d-6ea8-419b-a0e0-478ae33a7ea6 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.077587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c605985d-6ea8-419b-a0e0-478ae33a7ea6 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.078033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c605985d-6ea8-419b-a0e0-478ae33a7ea6 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.083768 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c605985d-6ea8-419b-a0e0-478ae33a7ea6 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.310783 Jul 20 04:09:11.084329 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 73/127] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:11.089254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5527cbab-89dd-402c-b164-85c44694cd7a tempest-FlavorsV255TestJSON-920297064 tempest-FlavorsV255TestJSON-920297064-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:11.090709 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:11.090709 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:11.113559 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5527cbab-89dd-402c-b164-85c44694cd7a tempest-FlavorsV255TestJSON-920297064 tempest-FlavorsV255TestJSON-920297064-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/1794671223" status: 200 len: 448 microversion: 2.55 time: 0.027928 Jul 20 04:09:11.114172 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 74/128] 10.222.0.17 () {62 vars in 1218 bytes} [Wed Jul 20 04:09:11 2022] PUT /compute/v2.1/flavors/1794671223 => generated 448 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:09:11.118706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-0f0e7b90-6786-4ad2-ba17-e6df702521b8 req-1f9687f1-8257-4cc8-bfc1-23009d89ee02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b5032fa-799c-4a49-8963-67342c39903e", "tag": "57dd3618-045a-4b8c-8b6b-eaafcdf0e9d5"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:11.126913 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-0f0e7b90-6786-4ad2-ba17-e6df702521b8 req-1f9687f1-8257-4cc8-bfc1-23009d89ee02 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.127350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-0f0e7b90-6786-4ad2-ba17-e6df702521b8 req-1f9687f1-8257-4cc8-bfc1-23009d89ee02 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.139122 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-0f0e7b90-6786-4ad2-ba17-e6df702521b8 req-1f9687f1-8257-4cc8-bfc1-23009d89ee02 service nova] Creating event network-changed:57dd3618-045a-4b8c-8b6b-eaafcdf0e9d5 for instance 0b5032fa-799c-4a49-8963-67342c39903e on n-h2-826526-5 Jul 20 04:09:11.143956 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-0f0e7b90-6786-4ad2-ba17-e6df702521b8 req-1f9687f1-8257-4cc8-bfc1-23009d89ee02 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028689 Jul 20 04:09:11.144777 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 75/129] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:11.149699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6cf51974-08f7-4950-9947-9e5d6d6f76e7 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Calling method '.version_select at 0x7f06bedec3a0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:11.151305 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:11.151305 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:11.152579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6cf51974-08f7-4950-9947-9e5d6d6f76e7 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.153022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6cf51974-08f7-4950-9947-9e5d6d6f76e7 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.173369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6cf51974-08f7-4950-9947-9e5d6d6f76e7 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.174085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6cf51974-08f7-4950-9947-9e5d6d6f76e7 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.199029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:11.211157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6cf51974-08f7-4950-9947-9e5d6d6f76e7 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.211612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6cf51974-08f7-4950-9947-9e5d6d6f76e7 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.217914 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6cf51974-08f7-4950-9947-9e5d6d6f76e7 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/n-h2-826526-5/servers" status: 200 len: 275 microversion: 2.1 time: 0.071996 Jul 20 04:09:11.218697 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 76/130] 10.222.0.17 () {58 vars in 1211 bytes} [Wed Jul 20 04:09:11 2022] GET /compute/v2.1/os-hypervisors/n-h2-826526-5/servers => generated 275 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:11.223150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6c7cd077-59a6-4243-be37-291a71132458 tempest-FlavorsV255TestJSON-1074034853 tempest-FlavorsV255TestJSON-1074034853-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:11.242985 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6c7cd077-59a6-4243-be37-291a71132458 tempest-FlavorsV255TestJSON-1074034853 tempest-FlavorsV255TestJSON-1074034853-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5723 microversion: 2.55 time: 0.023355 Jul 20 04:09:11.243894 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 77/131] 10.222.0.17 () {60 vars in 1186 bytes} [Wed Jul 20 04:09:11 2022] GET /compute/v2.1/flavors/detail => generated 5723 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:11.248443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4bd5977e-1511-4680-b5d2-041c5b2a69f3 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:11.249161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4bd5977e-1511-4680-b5d2-041c5b2a69f3 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:11.256364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4bd5977e-1511-4680-b5d2-041c5b2a69f3 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.256815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4bd5977e-1511-4680-b5d2-041c5b2a69f3 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.257904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4bd5977e-1511-4680-b5d2-041c5b2a69f3 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.258341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4bd5977e-1511-4680-b5d2-041c5b2a69f3 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.354877 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-81cce1b9-0712-46d2-b30a-8f22ac8d6ee3 None None] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 2.364257 Jul 20 04:09:11.356579 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 55/132] 10.222.0.17 () {58 vars in 1172 bytes} [Wed Jul 20 04:09:08 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 2367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:11.367574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-82766de3-b10f-4a97-9457-cdf594de08af tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Calling method '.version_select at 0x7f06bed7dc10>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:11.368637 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:11.368637 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:11.370005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82766de3-b10f-4a97-9457-cdf594de08af tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.370608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82766de3-b10f-4a97-9457-cdf594de08af tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.392242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82766de3-b10f-4a97-9457-cdf594de08af tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.393545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82766de3-b10f-4a97-9457-cdf594de08af tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.400233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:11.405431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4bd5977e-1511-4680-b5d2-041c5b2a69f3 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:11.409804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82766de3-b10f-4a97-9457-cdf594de08af tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.410441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82766de3-b10f-4a97-9457-cdf594de08af tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.415155 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4bd5977e-1511-4680-b5d2-041c5b2a69f3 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1338 microversion: 2.1 time: 0.170123 Jul 20 04:09:11.416306 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 78/133] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:11 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1338 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:11.418524 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-82766de3-b10f-4a97-9457-cdf594de08af tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.060261 Jul 20 04:09:11.419261 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 56/134] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:11.422761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f9c57f7e-cdb3-4a32-a31c-a878d33bb256 tempest-FlavorsV255TestJSON-1074034853 tempest-FlavorsV255TestJSON-1074034853-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:11.435670 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-168e8ff2-7a5d-4436-849d-3ec1900b7cb0 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Calling method '.version_select at 0x7f06becc5820>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:11.437091 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:11.437091 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:11.438457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-168e8ff2-7a5d-4436-849d-3ec1900b7cb0 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.439538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-168e8ff2-7a5d-4436-849d-3ec1900b7cb0 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.447341 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f9c57f7e-cdb3-4a32-a31c-a878d33bb256 tempest-FlavorsV255TestJSON-1074034853 tempest-FlavorsV255TestJSON-1074034853-project] 10.222.0.17 "GET /compute/v2.1/flavors" status: 200 len: 3155 microversion: 2.55 time: 0.029521 Jul 20 04:09:11.448761 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 79/135] 10.222.0.17 () {60 vars in 1165 bytes} [Wed Jul 20 04:09:11 2022] GET /compute/v2.1/flavors => generated 3155 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:11.458913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=6,nova_api:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:11.463922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-168e8ff2-7a5d-4436-849d-3ec1900b7cb0 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.464420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-168e8ff2-7a5d-4436-849d-3ec1900b7cb0 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.469390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-de7c7290-3f3d-47ea-86de-defc01850cac tempest-FlavorsV255TestJSON-920297064 tempest-FlavorsV255TestJSON-920297064-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:11.472384 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-168e8ff2-7a5d-4436-849d-3ec1900b7cb0 tempest-HypervisorAdminUnderV252Test-790655931 tempest-HypervisorAdminUnderV252Test-790655931-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/n-h2-826526-5/search" status: 200 len: 104 microversion: 2.1 time: 0.041327 Jul 20 04:09:11.478669 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:11.478669 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:11.478896 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 57/136] 10.222.0.17 () {58 vars in 1208 bytes} [Wed Jul 20 04:09:11 2022] GET /compute/v2.1/os-hypervisors/n-h2-826526-5/search => generated 104 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:11.499611 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-de7c7290-3f3d-47ea-86de-defc01850cac tempest-FlavorsV255TestJSON-920297064 tempest-FlavorsV255TestJSON-920297064-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1794671223" status: 202 len: 0 microversion: 2.55 time: 0.040308 Jul 20 04:09:11.503589 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 80/137] 10.222.0.17 () {60 vars in 1201 bytes} [Wed Jul 20 04:09:11 2022] DELETE /compute/v2.1/flavors/1794671223 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:09:11.509966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-518a4104-aef3-4fb2-9a75-f5ecd0359549 tempest-FlavorsV255TestJSON-920297064 tempest-FlavorsV255TestJSON-920297064-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:11.534112 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-518a4104-aef3-4fb2-9a75-f5ecd0359549 tempest-FlavorsV255TestJSON-920297064 tempest-FlavorsV255TestJSON-920297064-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.029314 Jul 20 04:09:11.535623 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 58/138] 10.222.0.17 () {60 vars in 1186 bytes} [Wed Jul 20 04:09:11 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:11.792242 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-55759826-019a-42fd-a73a-f3eb4790a90f tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:11.792553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-55759826-019a-42fd-a73a-f3eb4790a90f tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:11.800512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55759826-019a-42fd-a73a-f3eb4790a90f tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.800967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55759826-019a-42fd-a73a-f3eb4790a90f tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.801743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55759826-019a-42fd-a73a-f3eb4790a90f tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.802216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55759826-019a-42fd-a73a-f3eb4790a90f tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.965745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-55759826-019a-42fd-a73a-f3eb4790a90f tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:11.975127 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-55759826-019a-42fd-a73a-f3eb4790a90f tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1342 microversion: 2.1 time: 0.190087 Jul 20 04:09:11.978458 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 81/139] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:11 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1342 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:12.432678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2c55ac1a-8594-4245-bcb5-bb83c41bfff8 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:12.434053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2c55ac1a-8594-4245-bcb5-bb83c41bfff8 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:12.441583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c55ac1a-8594-4245-bcb5-bb83c41bfff8 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:12.442216 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c55ac1a-8594-4245-bcb5-bb83c41bfff8 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:12.443140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c55ac1a-8594-4245-bcb5-bb83c41bfff8 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:12.443855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c55ac1a-8594-4245-bcb5-bb83c41bfff8 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:12.657947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2c55ac1a-8594-4245-bcb5-bb83c41bfff8 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:12.672883 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2c55ac1a-8594-4245-bcb5-bb83c41bfff8 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1338 microversion: 2.1 time: 0.244777 Jul 20 04:09:12.676185 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 59/140] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:12 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1338 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:12.993557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-33a1a515-f7b4-494b-9025-d55c8324746e tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:12.995214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-33a1a515-f7b4-494b-9025-d55c8324746e tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:13.004472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33a1a515-f7b4-494b-9025-d55c8324746e tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:13.004918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33a1a515-f7b4-494b-9025-d55c8324746e tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:13.005678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33a1a515-f7b4-494b-9025-d55c8324746e tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:13.006106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33a1a515-f7b4-494b-9025-d55c8324746e tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:13.149961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-33a1a515-f7b4-494b-9025-d55c8324746e tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:13.158096 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-33a1a515-f7b4-494b-9025-d55c8324746e tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1342 microversion: 2.1 time: 0.169682 Jul 20 04:09:13.159233 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 82/141] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:12 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1342 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:13.692009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0d64de44-e8fc-4e6e-a006-4ff47cb296a4 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:13.692760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0d64de44-e8fc-4e6e-a006-4ff47cb296a4 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:13.700205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d64de44-e8fc-4e6e-a006-4ff47cb296a4 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:13.701340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d64de44-e8fc-4e6e-a006-4ff47cb296a4 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:13.702541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d64de44-e8fc-4e6e-a006-4ff47cb296a4 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:13.703774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d64de44-e8fc-4e6e-a006-4ff47cb296a4 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:14.032028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0d64de44-e8fc-4e6e-a006-4ff47cb296a4 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:14.047049 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0d64de44-e8fc-4e6e-a006-4ff47cb296a4 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1338 microversion: 2.1 time: 0.358406 Jul 20 04:09:14.059242 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 60/142] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:13 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1338 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:14.174877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-90cbe3dc-b149-4b01-928e-dbee88262289 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:14.175701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-90cbe3dc-b149-4b01-928e-dbee88262289 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:14.182371 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90cbe3dc-b149-4b01-928e-dbee88262289 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:14.183128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90cbe3dc-b149-4b01-928e-dbee88262289 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:14.184017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90cbe3dc-b149-4b01-928e-dbee88262289 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:14.184598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90cbe3dc-b149-4b01-928e-dbee88262289 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:14.290504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2002ff64-9e7d-4f8a-861e-2e888b655eef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-86248693", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:14.350432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-2002ff64-9e7d-4f8a-861e-2e888b655eef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:09:14.480114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-90cbe3dc-b149-4b01-928e-dbee88262289 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:14.489414 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-90cbe3dc-b149-4b01-928e-dbee88262289 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1342 microversion: 2.1 time: 0.318244 Jul 20 04:09:14.493245 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 61/143] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:14 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1342 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:14.579918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2002ff64-9e7d-4f8a-861e-2e888b655eef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:09:14.580370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2002ff64-9e7d-4f8a-861e-2e888b655eef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:09:14.580846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2002ff64-9e7d-4f8a-861e-2e888b655eef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:09:14.581257 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2002ff64-9e7d-4f8a-861e-2e888b655eef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:09:14.581672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2002ff64-9e7d-4f8a-861e-2e888b655eef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:09:14.592509 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2002ff64-9e7d-4f8a-861e-2e888b655eef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:14.593082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2002ff64-9e7d-4f8a-861e-2e888b655eef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:14.593834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2002ff64-9e7d-4f8a-861e-2e888b655eef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:14.594445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2002ff64-9e7d-4f8a-861e-2e888b655eef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:14.608222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=2,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:14.631615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-2002ff64-9e7d-4f8a-861e-2e888b655eef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Getting quotas for project 6c73d55e6bc740d0aec2ba67f0491099. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:09:14.637210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-2002ff64-9e7d-4f8a-861e-2e888b655eef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Getting quotas for user b4f8b49fd45944a384836a1459e4e7e9 and project 6c73d55e6bc740d0aec2ba67f0491099. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:09:14.652608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2002ff64-9e7d-4f8a-861e-2e888b655eef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:09:14.655154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2002ff64-9e7d-4f8a-861e-2e888b655eef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:09:14.707566 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2002ff64-9e7d-4f8a-861e-2e888b655eef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793058 Jul 20 04:09:14.708010 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 83/144] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:09:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:09:14.717844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-00e1bd6b-8a36-4b5a-b591-688fd0dc59d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:14.719304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-00e1bd6b-8a36-4b5a-b591-688fd0dc59d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:14.799809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-00e1bd6b-8a36-4b5a-b591-688fd0dc59d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:14.808045 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-00e1bd6b-8a36-4b5a-b591-688fd0dc59d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1211 microversion: 2.1 time: 0.093950 Jul 20 04:09:14.819257 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 62/145] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:14 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1211 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:15.065480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ca13bea5-fd00-429b-95d9-9ede21264524 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:15.066094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ca13bea5-fd00-429b-95d9-9ede21264524 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:15.074174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca13bea5-fd00-429b-95d9-9ede21264524 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:15.074806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca13bea5-fd00-429b-95d9-9ede21264524 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:15.075878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca13bea5-fd00-429b-95d9-9ede21264524 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:15.076481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca13bea5-fd00-429b-95d9-9ede21264524 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:15.261002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ca13bea5-fd00-429b-95d9-9ede21264524 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:15.276555 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ca13bea5-fd00-429b-95d9-9ede21264524 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1338 microversion: 2.1 time: 0.214778 Jul 20 04:09:15.285964 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 84/146] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:15 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1338 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:15.512109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-71e2678b-078f-48da-a207-edec8fc8a25a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:15.513733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-71e2678b-078f-48da-a207-edec8fc8a25a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:15.525982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71e2678b-078f-48da-a207-edec8fc8a25a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:15.526822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71e2678b-078f-48da-a207-edec8fc8a25a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:15.528432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71e2678b-078f-48da-a207-edec8fc8a25a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:15.530290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71e2678b-078f-48da-a207-edec8fc8a25a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:15.692193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-71e2678b-078f-48da-a207-edec8fc8a25a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:15.700382 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-71e2678b-078f-48da-a207-edec8fc8a25a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1342 microversion: 2.1 time: 0.194197 Jul 20 04:09:15.700950 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 63/147] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:15 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1342 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:15.828580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-26acdbf3-964e-4b2c-b341-68215f2a835c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:15.830311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-26acdbf3-964e-4b2c-b341-68215f2a835c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:15.840249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26acdbf3-964e-4b2c-b341-68215f2a835c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:15.840887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26acdbf3-964e-4b2c-b341-68215f2a835c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:15.842192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26acdbf3-964e-4b2c-b341-68215f2a835c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:15.842866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26acdbf3-964e-4b2c-b341-68215f2a835c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:15.945407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-26acdbf3-964e-4b2c-b341-68215f2a835c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:15.957496 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-26acdbf3-964e-4b2c-b341-68215f2a835c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1263 microversion: 2.1 time: 0.134620 Jul 20 04:09:15.958711 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 85/148] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:15 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1263 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:16.293882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c39ba211-60e3-4b83-85a1-c25af620b436 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:16.294921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c39ba211-60e3-4b83-85a1-c25af620b436 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:16.304057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c39ba211-60e3-4b83-85a1-c25af620b436 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:16.304886 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c39ba211-60e3-4b83-85a1-c25af620b436 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:16.306690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c39ba211-60e3-4b83-85a1-c25af620b436 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:16.307552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c39ba211-60e3-4b83-85a1-c25af620b436 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:16.333256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4870c367-5bab-466d-b32d-95d72d5cc16c tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Calling method '.version_select at 0x7f06bed1ab80>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:16.336134 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:16.336134 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:16.338205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4870c367-5bab-466d-b32d-95d72d5cc16c tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '5f03b16bd99e4806b544aee09ee2d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb49f78e9764c908ea0a790246c342c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4870c367-5bab-466d-b32d-95d72d5cc16c tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Request method failure captured: Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_q8u-3fYx5XBVcLRqr_IdvDjecMhMbOJfQ6MiPfwF8qSNLVsQ9aRNM9hK_ViA1mRVVg6qxHsVWNAt2meZqGgnMEcOJtRWNhY3RPNILf7HLXAGtTNv3PTGtJTqXk6197x1cBtYj8NCTdDzkF1NaWC26VocbciURD3iv7pQG3ggCJbA Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 0fb49f78e9764c908ea0a790246c342c Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1907945192 Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:09:16.341116 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:09:16.342270 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fb49f78e9764c908ea0a790246c342c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0fb49f78e9764c908ea0a790246c342c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0fb49f78e9764c908ea0a790246c342c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fb49f78e9764c908ea0a790246c342c"}]}] Jul 20 04:09:16.342270 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1907945192 Jul 20 04:09:16.342270 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 0fb49f78e9764c908ea0a790246c342c Jul 20 04:09:16.342270 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1907945192 Jul 20 04:09:16.342270 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-HypervisorAdminNegativeTestJSON-1907945192-project Jul 20 04:09:16.342270 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:09:16.342270 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:09:16.342270 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 5f03b16bd99e4806b544aee09ee2d2cc Jul 20 04:09:16.342270 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1907945192-project Jul 20 04:09:16.342270 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:09:16.342270 n-d-826526-5 devstack@n-api.service[127870]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 20 04:09:16.342270 n-d-826526-5 devstack@n-api.service[127870]: action_args: {} Jul 20 04:09:16.342270 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:16.342969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 20 04:09:16.343939 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:16.346407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4870c367-5bab-466d-b32d-95d72d5cc16c tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:16.347889 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4870c367-5bab-466d-b32d-95d72d5cc16c tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.445997 Jul 20 04:09:16.348982 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 64/149] 10.222.0.17 () {58 vars in 1166 bytes} [Wed Jul 20 04:09:15 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 448 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:09:16.451434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c49bf454-c81e-451b-a48a-76a94ab90bab tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Calling method '.version_select at 0x7f06becc8e50>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:16.452665 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:16.452665 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:16.454332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c49bf454-c81e-451b-a48a-76a94ab90bab tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:16.454615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c49bf454-c81e-451b-a48a-76a94ab90bab tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:16.473975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c49bf454-c81e-451b-a48a-76a94ab90bab tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:16.474802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c49bf454-c81e-451b-a48a-76a94ab90bab tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:16.487321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c49bf454-c81e-451b-a48a-76a94ab90bab tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:16.488125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c49bf454-c81e-451b-a48a-76a94ab90bab tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:16.496774 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c49bf454-c81e-451b-a48a-76a94ab90bab tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.146306 Jul 20 04:09:16.508295 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 65/150] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:16.514490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-685813ec-19fa-47da-b78c-5f2883ab91e7 tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Calling method '.version_select at 0x7f06bed1a700>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:16.518035 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:16.518035 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:16.519350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-685813ec-19fa-47da-b78c-5f2883ab91e7 tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '5f03b16bd99e4806b544aee09ee2d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb49f78e9764c908ea0a790246c342c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-685813ec-19fa-47da-b78c-5f2883ab91e7 tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Request method failure captured: Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_q8u-3fYx5XBVcLRqr_IdvDjecMhMbOJfQ6MiPfwF8qSNLVsQ9aRNM9hK_ViA1mRVVg6qxHsVWNAt2meZqGgnMEcOJtRWNhY3RPNILf7HLXAGtTNv3PTGtJTqXk6197x1cBtYj8NCTdDzkF1NaWC26VocbciURD3iv7pQG3ggCJbA Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 0fb49f78e9764c908ea0a790246c342c Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1907945192 Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:09:16.521676 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:09:16.522838 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fb49f78e9764c908ea0a790246c342c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0fb49f78e9764c908ea0a790246c342c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0fb49f78e9764c908ea0a790246c342c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fb49f78e9764c908ea0a790246c342c"}]}] Jul 20 04:09:16.522838 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1907945192 Jul 20 04:09:16.522838 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 0fb49f78e9764c908ea0a790246c342c Jul 20 04:09:16.522838 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1907945192 Jul 20 04:09:16.522838 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-HypervisorAdminNegativeTestJSON-1907945192-project Jul 20 04:09:16.522838 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:09:16.522838 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:09:16.522838 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 5f03b16bd99e4806b544aee09ee2d2cc Jul 20 04:09:16.522838 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1907945192-project Jul 20 04:09:16.522838 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:09:16.522838 n-d-826526-5 devstack@n-api.service[127870]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 20 04:09:16.522838 n-d-826526-5 devstack@n-api.service[127870]: action_args: {} Jul 20 04:09:16.522838 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:16.523492 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 20 04:09:16.525778 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:16.526690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-685813ec-19fa-47da-b78c-5f2883ab91e7 tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:16.526690 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-685813ec-19fa-47da-b78c-5f2883ab91e7 tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.015273 Jul 20 04:09:16.526690 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 66/151] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:16 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:16.675471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c39ba211-60e3-4b83-85a1-c25af620b436 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:16.676573 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0443745c-9fff-4f82-a694-b1f9d1cf644d tempest-HypervisorAdminNegativeUnderV252Test-1884801678 tempest-HypervisorAdminNegativeUnderV252Test-1884801678-project] Calling method '.version_select at 0x7f06bed7d160>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:16.677357 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:16.677357 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:16.678460 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0443745c-9fff-4f82-a694-b1f9d1cf644d tempest-HypervisorAdminNegativeUnderV252Test-1884801678 tempest-HypervisorAdminNegativeUnderV252Test-1884801678-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '2ad6a385d7ab4510a7dc267519b7b5f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e230c758e92f4231b8a694fb9ef70d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0443745c-9fff-4f82-a694-b1f9d1cf644d tempest-HypervisorAdminNegativeUnderV252Test-1884801678 tempest-HypervisorAdminNegativeUnderV252Test-1884801678-project] Request method failure captured: Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/os-hypervisors/n-h2-826526-5/search HTTP/1.1 Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_rI1ykoKGjsTSn8-AIb5TQ0n-riIIADNoiLW9LwWZjWDCi70BbW01nK4J2cvdwX0MKwppbyMcXmKgnP9d60usuHqWmadG6ojPyPeo91qmSZC4x0fD_6UO79XJSHn9406mi9suniJ4dUu8njlAYiHAiB2lxdAXA3WoS5E8ZGSYoyyg Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: e230c758e92f4231b8a694fb9ef70d73 Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1884801678 Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:09:16.679979 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:09:16.681350 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e230c758e92f4231b8a694fb9ef70d73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e230c758e92f4231b8a694fb9ef70d73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e230c758e92f4231b8a694fb9ef70d73", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e230c758e92f4231b8a694fb9ef70d73"}]}] Jul 20 04:09:16.681350 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1884801678 Jul 20 04:09:16.681350 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: e230c758e92f4231b8a694fb9ef70d73 Jul 20 04:09:16.681350 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1884801678 Jul 20 04:09:16.681350 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1884801678-project Jul 20 04:09:16.681350 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:09:16.681350 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:09:16.681350 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 2ad6a385d7ab4510a7dc267519b7b5f4 Jul 20 04:09:16.681350 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1884801678-project Jul 20 04:09:16.681350 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:09:16.681350 n-d-826526-5 devstack@n-api.service[127870]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 20 04:09:16.681350 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'n-h2-826526-5'} Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:16.682092 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:16.683232 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:16.683232 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:16.683232 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:16.683232 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:16.683232 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:16.683232 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:16.683232 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:16.683232 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 20 04:09:16.683232 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:16.683232 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:16.683232 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:16.683232 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:16.683232 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:16.683232 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:16.683232 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:16.683232 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:16.683232 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 20 04:09:16.683232 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:16.685709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0443745c-9fff-4f82-a694-b1f9d1cf644d tempest-HypervisorAdminNegativeUnderV252Test-1884801678 tempest-HypervisorAdminNegativeUnderV252Test-1884801678-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:16.689462 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0443745c-9fff-4f82-a694-b1f9d1cf644d tempest-HypervisorAdminNegativeUnderV252Test-1884801678 tempest-HypervisorAdminNegativeUnderV252Test-1884801678-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/n-h2-826526-5/search" status: 403 len: 117 microversion: 2.1 time: 0.164603 Jul 20 04:09:16.690542 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 67/152] 10.222.0.17 () {58 vars in 1208 bytes} [Wed Jul 20 04:09:16 2022] GET /compute/v2.1/os-hypervisors/n-h2-826526-5/search => generated 117 bytes in 166 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:16.694087 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c39ba211-60e3-4b83-85a1-c25af620b436 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1338 microversion: 2.1 time: 0.403930 Jul 20 04:09:16.695007 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 86/153] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:16 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1338 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:16.696494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d7fa7a7a-1b7e-432d-8841-e65298cbb4f6 tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Calling method '.version_select at 0x7f06bed1a790>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:16.697470 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:16.697470 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:16.698825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d7fa7a7a-1b7e-432d-8841-e65298cbb4f6 tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '5f03b16bd99e4806b544aee09ee2d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb49f78e9764c908ea0a790246c342c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d7fa7a7a-1b7e-432d-8841-e65298cbb4f6 tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Request method failure captured: Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_q8u-3fYx5XBVcLRqr_IdvDjecMhMbOJfQ6MiPfwF8qSNLVsQ9aRNM9hK_ViA1mRVVg6qxHsVWNAt2meZqGgnMEcOJtRWNhY3RPNILf7HLXAGtTNv3PTGtJTqXk6197x1cBtYj8NCTdDzkF1NaWC26VocbciURD3iv7pQG3ggCJbA Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 0fb49f78e9764c908ea0a790246c342c Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1907945192 Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:09:16.700596 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:09:16.701669 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fb49f78e9764c908ea0a790246c342c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0fb49f78e9764c908ea0a790246c342c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0fb49f78e9764c908ea0a790246c342c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fb49f78e9764c908ea0a790246c342c"}]}] Jul 20 04:09:16.701669 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1907945192 Jul 20 04:09:16.701669 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 0fb49f78e9764c908ea0a790246c342c Jul 20 04:09:16.701669 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1907945192 Jul 20 04:09:16.701669 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-HypervisorAdminNegativeTestJSON-1907945192-project Jul 20 04:09:16.701669 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:09:16.701669 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:09:16.701669 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 5f03b16bd99e4806b544aee09ee2d2cc Jul 20 04:09:16.701669 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1907945192-project Jul 20 04:09:16.701669 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:09:16.701669 n-d-826526-5 devstack@n-api.service[127870]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 20 04:09:16.701669 n-d-826526-5 devstack@n-api.service[127870]: action_args: {} Jul 20 04:09:16.701669 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:16.702309 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:16.703219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:16.703219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:16.703219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:16.703219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:16.703219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:16.703219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:16.703219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 20 04:09:16.703219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:16.703219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:16.703219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:16.703219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:16.703219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:16.703219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:16.703219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:16.703219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:16.703219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 20 04:09:16.703219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:16.705621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d7fa7a7a-1b7e-432d-8841-e65298cbb4f6 tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:16.706732 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d7fa7a7a-1b7e-432d-8841-e65298cbb4f6 tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.015101 Jul 20 04:09:16.707732 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 68/154] 10.222.0.17 () {58 vars in 1178 bytes} [Wed Jul 20 04:09:16 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:16.710779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-507b2141-619d-49b0-b56e-71969a0891f2 tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Calling method '.version_select at 0x7f06bedecf70>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:16.715228 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:16.715228 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:16.718208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-507b2141-619d-49b0-b56e-71969a0891f2 tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:16.719487 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-507b2141-619d-49b0-b56e-71969a0891f2 tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:16.728093 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-507b2141-619d-49b0-b56e-71969a0891f2 tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-507b2141-619d-49b0-b56e-71969a0891f2 tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Request method failure captured: Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_stQ5tkpmmg9koYJ5Tqore1ryH-kh9OeTl0CkYgKqrnMyKRexFrkPzBjL9SErcToMvV9VxDc5dATlKVTPAucYO3ZUu1HKkhlz4migGS5SlLmx3C0_4J_c4dB5smj1FVmxdvyEB_tKtGZ8mkkPTxhDO-3LvQj3oZUbH-NOQJFr4QtY Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 0e9d3ac764ab45d9a44e76dbc9a528e6 Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2096398293 Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:09:16.730172 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:09:16.731306 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0e9d3ac764ab45d9a44e76dbc9a528e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0e9d3ac764ab45d9a44e76dbc9a528e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0e9d3ac764ab45d9a44e76dbc9a528e6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0e9d3ac764ab45d9a44e76dbc9a528e6"}]}] Jul 20 04:09:16.731306 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2096398293 Jul 20 04:09:16.731306 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 0e9d3ac764ab45d9a44e76dbc9a528e6 Jul 20 04:09:16.731306 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2096398293 Jul 20 04:09:16.731306 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin Jul 20 04:09:16.731306 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:16.731306 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:16.731306 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: db46a18b378547e0ba2f1466f8c3b3a4 Jul 20 04:09:16.731306 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin Jul 20 04:09:16.731306 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:09:16.731306 n-d-826526-5 devstack@n-api.service[127871]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 04:09:16.731306 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:16.732124 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:16.735034 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:16.735034 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:16.735034 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:16.735034 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 04:09:16.735034 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:16.735034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-507b2141-619d-49b0-b56e-71969a0891f2 tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:16.735034 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-507b2141-619d-49b0-b56e-71969a0891f2 tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.026056 Jul 20 04:09:16.735034 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 87/155] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 04:09:16 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:16.737645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2f14a1b6-d94a-4c28-bd32-40b4fc881931 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:16.738456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2f14a1b6-d94a-4c28-bd32-40b4fc881931 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:16.745935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f14a1b6-d94a-4c28-bd32-40b4fc881931 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:16.746378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f14a1b6-d94a-4c28-bd32-40b4fc881931 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:16.747131 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f14a1b6-d94a-4c28-bd32-40b4fc881931 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:16.747711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f14a1b6-d94a-4c28-bd32-40b4fc881931 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:16.937548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-22c3f428-8022-4e1b-b0b5-163490e63bd1 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Calling method '.version_select at 0x7f06c5431f70>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:16.940345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22c3f428-8022-4e1b-b0b5-163490e63bd1 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:16.941005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22c3f428-8022-4e1b-b0b5-163490e63bd1 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:16.959182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22c3f428-8022-4e1b-b0b5-163490e63bd1 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:16.960006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22c3f428-8022-4e1b-b0b5-163490e63bd1 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:16.973766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22c3f428-8022-4e1b-b0b5-163490e63bd1 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:16.974490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22c3f428-8022-4e1b-b0b5-163490e63bd1 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:16.981627 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-22c3f428-8022-4e1b-b0b5-163490e63bd1 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.268847 Jul 20 04:09:16.982868 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 69/156] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:16.987653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e66bb9b6-3126-499c-b51f-57b3ffc49a36 tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Calling method '.version_select at 0x7f06bed1aaf0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:16.988790 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:16.988790 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:16.990563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e66bb9b6-3126-499c-b51f-57b3ffc49a36 tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:16.991234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e66bb9b6-3126-499c-b51f-57b3ffc49a36 tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.006011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e66bb9b6-3126-499c-b51f-57b3ffc49a36 tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.006911 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e66bb9b6-3126-499c-b51f-57b3ffc49a36 tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.019209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e66bb9b6-3126-499c-b51f-57b3ffc49a36 tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.020038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e66bb9b6-3126-499c-b51f-57b3ffc49a36 tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.026805 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e66bb9b6-3126-499c-b51f-57b3ffc49a36 tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.042651 Jul 20 04:09:17.027797 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 70/157] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:17.032761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fe02cf9d-5939-47c4-91ab-45c91aad335f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:17.033814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fe02cf9d-5939-47c4-91ab-45c91aad335f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:17.040481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe02cf9d-5939-47c4-91ab-45c91aad335f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.041256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe02cf9d-5939-47c4-91ab-45c91aad335f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.042307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe02cf9d-5939-47c4-91ab-45c91aad335f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.042940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe02cf9d-5939-47c4-91ab-45c91aad335f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.055106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2f14a1b6-d94a-4c28-bd32-40b4fc881931 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:17.072616 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2f14a1b6-d94a-4c28-bd32-40b4fc881931 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1342 microversion: 2.1 time: 0.331269 Jul 20 04:09:17.073946 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 88/158] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:16 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1342 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:17.078945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7adec2fe-8277-485a-b95e-1c3859beae1a tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Calling method '.version_select at 0x7f06bedfcca0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:17.080019 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:17.080019 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:17.081423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7adec2fe-8277-485a-b95e-1c3859beae1a tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '5f03b16bd99e4806b544aee09ee2d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb49f78e9764c908ea0a790246c342c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7adec2fe-8277-485a-b95e-1c3859beae1a tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Request method failure captured: Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_q8u-3fYx5XBVcLRqr_IdvDjecMhMbOJfQ6MiPfwF8qSNLVsQ9aRNM9hK_ViA1mRVVg6qxHsVWNAt2meZqGgnMEcOJtRWNhY3RPNILf7HLXAGtTNv3PTGtJTqXk6197x1cBtYj8NCTdDzkF1NaWC26VocbciURD3iv7pQG3ggCJbA Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 0fb49f78e9764c908ea0a790246c342c Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1907945192 Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:09:17.087119 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:09:17.088422 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fb49f78e9764c908ea0a790246c342c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0fb49f78e9764c908ea0a790246c342c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0fb49f78e9764c908ea0a790246c342c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fb49f78e9764c908ea0a790246c342c"}]}] Jul 20 04:09:17.088422 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1907945192 Jul 20 04:09:17.088422 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 0fb49f78e9764c908ea0a790246c342c Jul 20 04:09:17.088422 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1907945192 Jul 20 04:09:17.088422 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-HypervisorAdminNegativeTestJSON-1907945192-project Jul 20 04:09:17.088422 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:17.088422 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:17.088422 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 5f03b16bd99e4806b544aee09ee2d2cc Jul 20 04:09:17.088422 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1907945192-project Jul 20 04:09:17.088422 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:09:17.088422 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 20 04:09:17.088422 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '1'} Jul 20 04:09:17.088422 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:17.089133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:17.090177 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:17.090177 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:17.090177 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:17.090177 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:17.090177 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:17.090177 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:17.090177 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 20 04:09:17.090177 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.090177 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:17.090177 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.090177 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.090177 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:17.090177 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:17.090177 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:17.090177 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:17.090177 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 20 04:09:17.090177 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.091091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7adec2fe-8277-485a-b95e-1c3859beae1a tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:17.091091 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7adec2fe-8277-485a-b95e-1c3859beae1a tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.013321 Jul 20 04:09:17.091674 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 89/159] 10.222.0.17 () {58 vars in 1172 bytes} [Wed Jul 20 04:09:17 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:17.097313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1e749c24-1d11-4638-9341-dcb33f28d3de tempest-HypervisorAdminNegativeUnderV252Test-1884801678 tempest-HypervisorAdminNegativeUnderV252Test-1884801678-project] Calling method '.version_select at 0x7f06bed5eca0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:17.106253 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:17.106253 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:17.107781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1e749c24-1d11-4638-9341-dcb33f28d3de tempest-HypervisorAdminNegativeUnderV252Test-1884801678 tempest-HypervisorAdminNegativeUnderV252Test-1884801678-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '2ad6a385d7ab4510a7dc267519b7b5f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e230c758e92f4231b8a694fb9ef70d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1e749c24-1d11-4638-9341-dcb33f28d3de tempest-HypervisorAdminNegativeUnderV252Test-1884801678 tempest-HypervisorAdminNegativeUnderV252Test-1884801678-project] Request method failure captured: Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_rI1ykoKGjsTSn8-AIb5TQ0n-riIIADNoiLW9LwWZjWDCi70BbW01nK4J2cvdwX0MKwppbyMcXmKgnP9d60usuHqWmadG6ojPyPeo91qmSZC4x0fD_6UO79XJSHn9406mi9suniJ4dUu8njlAYiHAiB2lxdAXA3WoS5E8ZGSYoyyg Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: e230c758e92f4231b8a694fb9ef70d73 Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1884801678 Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:09:17.109564 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:09:17.110715 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e230c758e92f4231b8a694fb9ef70d73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e230c758e92f4231b8a694fb9ef70d73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e230c758e92f4231b8a694fb9ef70d73", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e230c758e92f4231b8a694fb9ef70d73"}]}] Jul 20 04:09:17.110715 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1884801678 Jul 20 04:09:17.110715 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: e230c758e92f4231b8a694fb9ef70d73 Jul 20 04:09:17.110715 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1884801678 Jul 20 04:09:17.110715 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1884801678-project Jul 20 04:09:17.110715 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:17.110715 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:17.110715 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 2ad6a385d7ab4510a7dc267519b7b5f4 Jul 20 04:09:17.110715 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1884801678-project Jul 20 04:09:17.110715 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:09:17.110715 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 20 04:09:17.110715 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '1'} Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:17.111412 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:17.112381 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:17.112381 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:17.112381 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:17.112381 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:17.112381 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:17.112381 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:17.112381 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:17.112381 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 20 04:09:17.112381 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.112381 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:17.112381 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.112381 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.112381 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:17.112381 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:17.112381 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:17.112381 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:17.112381 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 20 04:09:17.112381 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.114864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1e749c24-1d11-4638-9341-dcb33f28d3de tempest-HypervisorAdminNegativeUnderV252Test-1884801678 tempest-HypervisorAdminNegativeUnderV252Test-1884801678-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:17.118494 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1e749c24-1d11-4638-9341-dcb33f28d3de tempest-HypervisorAdminNegativeUnderV252Test-1884801678 tempest-HypervisorAdminNegativeUnderV252Test-1884801678-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.025639 Jul 20 04:09:17.119602 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 90/160] 10.222.0.17 () {58 vars in 1175 bytes} [Wed Jul 20 04:09:17 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:17.125306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d72ab633-9e58-4ddc-adca-adc6c863671b tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Calling method '.version_select at 0x7f06bf7b8b80>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:17.127235 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-d72ab633-9e58-4ddc-adca-adc6c863671b tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] HTTP exception thrown: Hypervisor with ID 'b2e23da6-3400-402b-8ddd-a2b4dbdfd795' could not be found. Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d72ab633-9e58-4ddc-adca-adc6c863671b tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Request method failure captured: Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-hypervisors/b2e23da6-3400-402b-8ddd-a2b4dbdfd795/uptime HTTP/1.1 Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_rMR4pfICOpeBfyPErwOhIZr_FcePQ30B-T0OnT14JiWlDaXv89-O3zCeHKuqdyF9vOMTAYnHYsSyOQrlLaao9Pr_Ix6AR9nRz1jVAx70frsi0ulJbdkjuPdUhmu5Ps7nP4OBiOgHena8yhIQSiDBpmZl2ieS0t-h8TdIzpiURG_E Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ccbb01dc9b3f455088e8114a612495d4 Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-341797892 Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:09:17.134235 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:09:17.135414 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ccbb01dc9b3f455088e8114a612495d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ccbb01dc9b3f455088e8114a612495d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ccbb01dc9b3f455088e8114a612495d4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ccbb01dc9b3f455088e8114a612495d4"}]}] Jul 20 04:09:17.135414 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-341797892 Jul 20 04:09:17.135414 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ccbb01dc9b3f455088e8114a612495d4 Jul 20 04:09:17.135414 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-341797892 Jul 20 04:09:17.135414 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin Jul 20 04:09:17.135414 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:17.135414 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:17.135414 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 0ffba4deb6c846cbabb16e10d808722c Jul 20 04:09:17.135414 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin Jul 20 04:09:17.135414 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:09:17.135414 n-d-826526-5 devstack@n-api.service[127871]: exception: Hypervisor with ID 'b2e23da6-3400-402b-8ddd-a2b4dbdfd795' could not be found. Jul 20 04:09:17.135414 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'b2e23da6-3400-402b-8ddd-a2b4dbdfd795'} Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'b2e23da6-3400-402b-8ddd-a2b4dbdfd795' Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 20 04:09:17.136050 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'b2e23da6-3400-402b-8ddd-a2b4dbdfd795' could not be found. Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:17.137493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.138551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.138551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:17.138551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:17.138551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:17.138551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:17.138551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'b2e23da6-3400-402b-8ddd-a2b4dbdfd795' could not be found. Jul 20 04:09:17.138551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.140007 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d72ab633-9e58-4ddc-adca-adc6c863671b tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Returning 404 to user: Hypervisor with ID 'b2e23da6-3400-402b-8ddd-a2b4dbdfd795' could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:17.141358 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d72ab633-9e58-4ddc-adca-adc6c863671b tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/b2e23da6-3400-402b-8ddd-a2b4dbdfd795/uptime" status: 404 len: 123 microversion: 2.1 time: 0.020192 Jul 20 04:09:17.142099 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 91/161] 10.222.0.17 () {58 vars in 1277 bytes} [Wed Jul 20 04:09:17 2022] GET /compute/v2.1/os-hypervisors/b2e23da6-3400-402b-8ddd-a2b4dbdfd795/uptime => generated 123 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:17.146967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7807c806-84d0-4056-8579-f539baf41eba tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Calling method '.version_select at 0x7f06bedfc9d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:17.149539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7807c806-84d0-4056-8579-f539baf41eba tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.150206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7807c806-84d0-4056-8579-f539baf41eba tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.157326 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-7807c806-84d0-4056-8579-f539baf41eba tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] HTTP exception thrown: No hypervisor matching 'e3d1884f-1644-40fb-a55e-5bb970218b92' could be found. Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7807c806-84d0-4056-8579-f539baf41eba tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Request method failure captured: Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-hypervisors/e3d1884f-1644-40fb-a55e-5bb970218b92/servers HTTP/1.1 Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_stQ5tkpmmg9koYJ5Tqore1ryH-kh9OeTl0CkYgKqrnMyKRexFrkPzBjL9SErcToMvV9VxDc5dATlKVTPAucYO3ZUu1HKkhlz4migGS5SlLmx3C0_4J_c4dB5smj1FVmxdvyEB_tKtGZ8mkkPTxhDO-3LvQj3oZUbH-NOQJFr4QtY Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 0e9d3ac764ab45d9a44e76dbc9a528e6 Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2096398293 Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:09:17.158955 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:09:17.160092 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0e9d3ac764ab45d9a44e76dbc9a528e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0e9d3ac764ab45d9a44e76dbc9a528e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0e9d3ac764ab45d9a44e76dbc9a528e6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0e9d3ac764ab45d9a44e76dbc9a528e6"}]}] Jul 20 04:09:17.160092 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2096398293 Jul 20 04:09:17.160092 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 0e9d3ac764ab45d9a44e76dbc9a528e6 Jul 20 04:09:17.160092 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2096398293 Jul 20 04:09:17.160092 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin Jul 20 04:09:17.160092 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:17.160092 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:17.160092 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: db46a18b378547e0ba2f1466f8c3b3a4 Jul 20 04:09:17.160092 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin Jul 20 04:09:17.160092 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:09:17.160092 n-d-826526-5 devstack@n-api.service[127871]: exception: No hypervisor matching 'e3d1884f-1644-40fb-a55e-5bb970218b92' could be found. Jul 20 04:09:17.160092 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'e3d1884f-1644-40fb-a55e-5bb970218b92'} Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'e3d1884f-1644-40fb-a55e-5bb970218b92' could be found. Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.160776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.161876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:17.161876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:17.161876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:17.161876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:17.161876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'e3d1884f-1644-40fb-a55e-5bb970218b92' could be found. Jul 20 04:09:17.161876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.166858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fe02cf9d-5939-47c4-91ab-45c91aad335f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:17.171529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7807c806-84d0-4056-8579-f539baf41eba tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] Returning 404 to user: No hypervisor matching 'e3d1884f-1644-40fb-a55e-5bb970218b92' could be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:17.172737 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7807c806-84d0-4056-8579-f539baf41eba tempest-HypervisorAdminNegativeUnderV252Test-2096398293 tempest-HypervisorAdminNegativeUnderV252Test-2096398293-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/e3d1884f-1644-40fb-a55e-5bb970218b92/servers" status: 404 len: 123 microversion: 2.1 time: 0.029426 Jul 20 04:09:17.174017 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 92/162] 10.222.0.17 () {58 vars in 1280 bytes} [Wed Jul 20 04:09:17 2022] GET /compute/v2.1/os-hypervisors/e3d1884f-1644-40fb-a55e-5bb970218b92/servers => generated 123 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:17.178830 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-da54f528-bc19-4a23-a83a-4f80e6dacee2 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Calling method '.version_select at 0x7f06bed05ca0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:17.180528 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:17.180528 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:17.182396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da54f528-bc19-4a23-a83a-4f80e6dacee2 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.183069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da54f528-bc19-4a23-a83a-4f80e6dacee2 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.187610 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fe02cf9d-5939-47c4-91ab-45c91aad335f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1269 microversion: 2.1 time: 0.149566 Jul 20 04:09:17.199125 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 71/163] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:17 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:17.210368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da54f528-bc19-4a23-a83a-4f80e6dacee2 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.210940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da54f528-bc19-4a23-a83a-4f80e6dacee2 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.235132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da54f528-bc19-4a23-a83a-4f80e6dacee2 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.235594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da54f528-bc19-4a23-a83a-4f80e6dacee2 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.243122 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-da54f528-bc19-4a23-a83a-4f80e6dacee2 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.067532 Jul 20 04:09:17.244748 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 93/164] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:17.255096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-684c1145-4844-4ad9-a88e-ffd3ed76c825 tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Calling method '.version_select at 0x7f06c5431a60>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:17.255990 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:17.255990 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:17.257238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-684c1145-4844-4ad9-a88e-ffd3ed76c825 tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '5f03b16bd99e4806b544aee09ee2d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb49f78e9764c908ea0a790246c342c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-684c1145-4844-4ad9-a88e-ffd3ed76c825 tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Request method failure captured: Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_q8u-3fYx5XBVcLRqr_IdvDjecMhMbOJfQ6MiPfwF8qSNLVsQ9aRNM9hK_ViA1mRVVg6qxHsVWNAt2meZqGgnMEcOJtRWNhY3RPNILf7HLXAGtTNv3PTGtJTqXk6197x1cBtYj8NCTdDzkF1NaWC26VocbciURD3iv7pQG3ggCJbA Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 0fb49f78e9764c908ea0a790246c342c Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1907945192 Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:09:17.261413 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:09:17.262604 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fb49f78e9764c908ea0a790246c342c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0fb49f78e9764c908ea0a790246c342c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0fb49f78e9764c908ea0a790246c342c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fb49f78e9764c908ea0a790246c342c"}]}] Jul 20 04:09:17.262604 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1907945192 Jul 20 04:09:17.262604 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 0fb49f78e9764c908ea0a790246c342c Jul 20 04:09:17.262604 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1907945192 Jul 20 04:09:17.262604 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-HypervisorAdminNegativeTestJSON-1907945192-project Jul 20 04:09:17.262604 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:09:17.262604 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:09:17.262604 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 5f03b16bd99e4806b544aee09ee2d2cc Jul 20 04:09:17.262604 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1907945192-project Jul 20 04:09:17.262604 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:09:17.262604 n-d-826526-5 devstack@n-api.service[127870]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 20 04:09:17.262604 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '1'} Jul 20 04:09:17.262604 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:17.263278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 20 04:09:17.264360 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.265949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-684c1145-4844-4ad9-a88e-ffd3ed76c825 tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:17.265949 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-684c1145-4844-4ad9-a88e-ffd3ed76c825 tempest-HypervisorAdminNegativeTestJSON-1907945192 tempest-HypervisorAdminNegativeTestJSON-1907945192-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.011912 Jul 20 04:09:17.265949 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 72/165] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:09:17 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:17.277848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e992b4f4-02ff-4c76-892f-dadbfc4f5cc8 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Calling method '.version_select at 0x7f06bf7b8b80>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:17.280966 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:17.280966 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:17.282232 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-e992b4f4-02ff-4c76-892f-dadbfc4f5cc8 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] HTTP exception thrown: Hypervisor with ID '329875f1-c637-4c96-9d16-cf655b0db349' could not be found. Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e992b4f4-02ff-4c76-892f-dadbfc4f5cc8 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Request method failure captured: Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-hypervisors/329875f1-c637-4c96-9d16-cf655b0db349 HTTP/1.1 Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_rMR4pfICOpeBfyPErwOhIZr_FcePQ30B-T0OnT14JiWlDaXv89-O3zCeHKuqdyF9vOMTAYnHYsSyOQrlLaao9Pr_Ix6AR9nRz1jVAx70frsi0ulJbdkjuPdUhmu5Ps7nP4OBiOgHena8yhIQSiDBpmZl2ieS0t-h8TdIzpiURG_E Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ccbb01dc9b3f455088e8114a612495d4 Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-341797892 Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:09:17.284032 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:09:17.285309 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ccbb01dc9b3f455088e8114a612495d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ccbb01dc9b3f455088e8114a612495d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ccbb01dc9b3f455088e8114a612495d4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ccbb01dc9b3f455088e8114a612495d4"}]}] Jul 20 04:09:17.285309 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-341797892 Jul 20 04:09:17.285309 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ccbb01dc9b3f455088e8114a612495d4 Jul 20 04:09:17.285309 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-341797892 Jul 20 04:09:17.285309 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin Jul 20 04:09:17.285309 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:17.285309 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:17.285309 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 0ffba4deb6c846cbabb16e10d808722c Jul 20 04:09:17.285309 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin Jul 20 04:09:17.285309 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:09:17.285309 n-d-826526-5 devstack@n-api.service[127871]: exception: Hypervisor with ID '329875f1-c637-4c96-9d16-cf655b0db349' could not be found. Jul 20 04:09:17.285309 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '329875f1-c637-4c96-9d16-cf655b0db349'} Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '329875f1-c637-4c96-9d16-cf655b0db349' Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 20 04:09:17.285960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:09:17.287154 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '329875f1-c637-4c96-9d16-cf655b0db349' could not be found. Jul 20 04:09:17.289332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.289332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:17.289332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.289332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.289332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:17.289332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:17.289332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:17.289332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:17.289332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '329875f1-c637-4c96-9d16-cf655b0db349' could not be found. Jul 20 04:09:17.289332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.289332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e992b4f4-02ff-4c76-892f-dadbfc4f5cc8 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] Returning 404 to user: Hypervisor with ID '329875f1-c637-4c96-9d16-cf655b0db349' could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:17.289332 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e992b4f4-02ff-4c76-892f-dadbfc4f5cc8 tempest-HypervisorAdminNegativeTestJSON-341797892 tempest-HypervisorAdminNegativeTestJSON-341797892-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/329875f1-c637-4c96-9d16-cf655b0db349" status: 404 len: 123 microversion: 2.1 time: 0.013323 Jul 20 04:09:17.289332 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 94/166] 10.222.0.17 () {58 vars in 1256 bytes} [Wed Jul 20 04:09:17 2022] GET /compute/v2.1/os-hypervisors/329875f1-c637-4c96-9d16-cf655b0db349 => generated 123 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:17.714075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-11f42548-b73c-4823-9d58-1daa2da5a063 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:17.714840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-11f42548-b73c-4823-9d58-1daa2da5a063 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:17.731116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11f42548-b73c-4823-9d58-1daa2da5a063 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.739023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11f42548-b73c-4823-9d58-1daa2da5a063 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.742015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11f42548-b73c-4823-9d58-1daa2da5a063 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.742737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11f42548-b73c-4823-9d58-1daa2da5a063 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.971802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-11f42548-b73c-4823-9d58-1daa2da5a063 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:17.984756 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-11f42548-b73c-4823-9d58-1daa2da5a063 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1338 microversion: 2.1 time: 0.273582 Jul 20 04:09:17.994864 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 73/167] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:17 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1338 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:18.092171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b22f4bc-d142-4062-bc21-f257b2ac3337 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:18.096004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9b22f4bc-d142-4062-bc21-f257b2ac3337 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:18.107508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b22f4bc-d142-4062-bc21-f257b2ac3337 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:18.111906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b22f4bc-d142-4062-bc21-f257b2ac3337 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:18.113449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b22f4bc-d142-4062-bc21-f257b2ac3337 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:18.114106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b22f4bc-d142-4062-bc21-f257b2ac3337 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:18.212373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-08cf8fd9-9db9-4782-a8f5-00130cdc9159 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:18.215260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-08cf8fd9-9db9-4782-a8f5-00130cdc9159 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:18.232412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08cf8fd9-9db9-4782-a8f5-00130cdc9159 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:18.233446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08cf8fd9-9db9-4782-a8f5-00130cdc9159 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:18.234254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08cf8fd9-9db9-4782-a8f5-00130cdc9159 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:18.235087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08cf8fd9-9db9-4782-a8f5-00130cdc9159 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:18.403037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-08cf8fd9-9db9-4782-a8f5-00130cdc9159 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:18.414576 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-08cf8fd9-9db9-4782-a8f5-00130cdc9159 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1311 microversion: 2.1 time: 0.210765 Jul 20 04:09:18.415866 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 74/168] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:18 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1311 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:18.486955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-67d0a2f6-8392-4262-a2e7-e28b8fa76c53 req-6ad011c9-78fe-4bae-9aa4-18d1fd86858d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b5032fa-799c-4a49-8963-67342c39903e", "name": "network-vif-plugged", "status": "completed", "tag": "57dd3618-045a-4b8c-8b6b-eaafcdf0e9d5"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:18.512722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-67d0a2f6-8392-4262-a2e7-e28b8fa76c53 req-6ad011c9-78fe-4bae-9aa4-18d1fd86858d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:18.513628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-67d0a2f6-8392-4262-a2e7-e28b8fa76c53 req-6ad011c9-78fe-4bae-9aa4-18d1fd86858d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:18.549749 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-67d0a2f6-8392-4262-a2e7-e28b8fa76c53 req-6ad011c9-78fe-4bae-9aa4-18d1fd86858d service nova] Creating event network-vif-plugged:57dd3618-045a-4b8c-8b6b-eaafcdf0e9d5 for instance 0b5032fa-799c-4a49-8963-67342c39903e on n-h2-826526-5 Jul 20 04:09:18.556730 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-67d0a2f6-8392-4262-a2e7-e28b8fa76c53 req-6ad011c9-78fe-4bae-9aa4-18d1fd86858d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139383 Jul 20 04:09:18.557745 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 75/169] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:18.564927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9b22f4bc-d142-4062-bc21-f257b2ac3337 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:18.580377 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9b22f4bc-d142-4062-bc21-f257b2ac3337 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1342 microversion: 2.1 time: 0.493259 Jul 20 04:09:18.591892 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 95/170] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:18 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1342 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:19.004943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ee21c9a1-fe67-40e2-ab04-c6063dde0f6a tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:19.006908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ee21c9a1-fe67-40e2-ab04-c6063dde0f6a tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:19.024938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee21c9a1-fe67-40e2-ab04-c6063dde0f6a tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:19.025745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee21c9a1-fe67-40e2-ab04-c6063dde0f6a tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:19.057878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee21c9a1-fe67-40e2-ab04-c6063dde0f6a tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:19.058431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee21c9a1-fe67-40e2-ab04-c6063dde0f6a tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:19.084176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:19.432194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-866fd39b-15e6-4556-93db-c96b3fee36f1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:19.433985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-866fd39b-15e6-4556-93db-c96b3fee36f1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:19.445568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-866fd39b-15e6-4556-93db-c96b3fee36f1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:19.446272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-866fd39b-15e6-4556-93db-c96b3fee36f1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:19.447089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-866fd39b-15e6-4556-93db-c96b3fee36f1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:19.447504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-866fd39b-15e6-4556-93db-c96b3fee36f1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:19.502889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ee21c9a1-fe67-40e2-ab04-c6063dde0f6a tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:19.514087 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ee21c9a1-fe67-40e2-ab04-c6063dde0f6a tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1338 microversion: 2.1 time: 0.515922 Jul 20 04:09:19.516581 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 76/171] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:18 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1338 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:19.601633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf052464-b22d-4e57-9ba5-ea63eaa8fde1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:19.602630 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf052464-b22d-4e57-9ba5-ea63eaa8fde1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:19.609689 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf052464-b22d-4e57-9ba5-ea63eaa8fde1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:19.610404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf052464-b22d-4e57-9ba5-ea63eaa8fde1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:19.611470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf052464-b22d-4e57-9ba5-ea63eaa8fde1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:19.612104 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf052464-b22d-4e57-9ba5-ea63eaa8fde1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:19.857656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-866fd39b-15e6-4556-93db-c96b3fee36f1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:19.870335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bf052464-b22d-4e57-9ba5-ea63eaa8fde1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:19.871772 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-866fd39b-15e6-4556-93db-c96b3fee36f1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1311 microversion: 2.1 time: 0.443612 Jul 20 04:09:19.875454 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 96/172] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:19 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1311 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:19.890061 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf052464-b22d-4e57-9ba5-ea63eaa8fde1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1342 microversion: 2.1 time: 0.295021 Jul 20 04:09:19.893179 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 77/173] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:19 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1342 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:20.533238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-82c59990-0c66-4d35-a767-bc127605cc0c tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:20.534596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-82c59990-0c66-4d35-a767-bc127605cc0c tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:20.553465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82c59990-0c66-4d35-a767-bc127605cc0c tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:20.554465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82c59990-0c66-4d35-a767-bc127605cc0c tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:20.559086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82c59990-0c66-4d35-a767-bc127605cc0c tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:20.561579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82c59990-0c66-4d35-a767-bc127605cc0c tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:20.619300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-0207f93f-bf14-498d-8c7b-1000d92bf5b4 req-4f0a5f9c-5e82-40d3-9c95-3a7a87695385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaceccec-6030-408a-8b3e-94b704473d0a", "name": "network-vif-plugged", "status": "completed", "tag": "dc0b81fd-f0fe-4fe9-9d09-782ea8e4a1be"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:20.648364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0207f93f-bf14-498d-8c7b-1000d92bf5b4 req-4f0a5f9c-5e82-40d3-9c95-3a7a87695385 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:20.648802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0207f93f-bf14-498d-8c7b-1000d92bf5b4 req-4f0a5f9c-5e82-40d3-9c95-3a7a87695385 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:20.689243 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-0207f93f-bf14-498d-8c7b-1000d92bf5b4 req-4f0a5f9c-5e82-40d3-9c95-3a7a87695385 service nova] Creating event network-vif-plugged:dc0b81fd-f0fe-4fe9-9d09-782ea8e4a1be for instance eaceccec-6030-408a-8b3e-94b704473d0a on n-h2-826526-5 Jul 20 04:09:20.706307 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-0207f93f-bf14-498d-8c7b-1000d92bf5b4 req-4f0a5f9c-5e82-40d3-9c95-3a7a87695385 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090878 Jul 20 04:09:20.709848 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 78/174] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:20.894086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-87eb8d4a-938b-4a2e-8ae7-5c953901058c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:20.895134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-87eb8d4a-938b-4a2e-8ae7-5c953901058c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:20.906113 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87eb8d4a-938b-4a2e-8ae7-5c953901058c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:20.908597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87eb8d4a-938b-4a2e-8ae7-5c953901058c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:20.910928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87eb8d4a-938b-4a2e-8ae7-5c953901058c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:20.911626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87eb8d4a-938b-4a2e-8ae7-5c953901058c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:21.104461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-82c59990-0c66-4d35-a767-bc127605cc0c tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:21.117951 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-82c59990-0c66-4d35-a767-bc127605cc0c tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1338 microversion: 2.1 time: 0.588111 Jul 20 04:09:21.120782 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 97/175] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:20 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1338 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:21.130197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c00d53e6-f337-4f6c-9395-4eedc9722a40 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:21.133378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c00d53e6-f337-4f6c-9395-4eedc9722a40 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:21.148665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c00d53e6-f337-4f6c-9395-4eedc9722a40 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:21.151684 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c00d53e6-f337-4f6c-9395-4eedc9722a40 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:21.154701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c00d53e6-f337-4f6c-9395-4eedc9722a40 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:21.156144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c00d53e6-f337-4f6c-9395-4eedc9722a40 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:21.292318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-87eb8d4a-938b-4a2e-8ae7-5c953901058c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:21.300662 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-87eb8d4a-938b-4a2e-8ae7-5c953901058c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1311 microversion: 2.1 time: 0.413186 Jul 20 04:09:21.301257 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 79/176] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:20 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1311 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:21.780611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c00d53e6-f337-4f6c-9395-4eedc9722a40 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:21.804722 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c00d53e6-f337-4f6c-9395-4eedc9722a40 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1342 microversion: 2.1 time: 0.682382 Jul 20 04:09:21.805335 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 98/177] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:21 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1342 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:22.138320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-21cc8f81-b4aa-43f4-b874-498d0244ed5b tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:22.139923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-21cc8f81-b4aa-43f4-b874-498d0244ed5b tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:22.154381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21cc8f81-b4aa-43f4-b874-498d0244ed5b tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:22.155251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21cc8f81-b4aa-43f4-b874-498d0244ed5b tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:22.156191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21cc8f81-b4aa-43f4-b874-498d0244ed5b tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:22.156876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21cc8f81-b4aa-43f4-b874-498d0244ed5b tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:22.317502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-43337440-b55a-4ad8-a73c-b6a75e6568e5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:22.319061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-43337440-b55a-4ad8-a73c-b6a75e6568e5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:22.330555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43337440-b55a-4ad8-a73c-b6a75e6568e5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:22.331184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43337440-b55a-4ad8-a73c-b6a75e6568e5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:22.333141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43337440-b55a-4ad8-a73c-b6a75e6568e5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:22.336649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43337440-b55a-4ad8-a73c-b6a75e6568e5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:22.803047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-21cc8f81-b4aa-43f4-b874-498d0244ed5b tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:22.813263 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-21cc8f81-b4aa-43f4-b874-498d0244ed5b tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1488 microversion: 2.1 time: 0.679610 Jul 20 04:09:22.813851 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 80/178] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:22 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1488 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:22.837646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-88bac260-cd17-4db8-a9b1-05fa6872369a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:22.840544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-88bac260-cd17-4db8-a9b1-05fa6872369a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:22.854727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-88bac260-cd17-4db8-a9b1-05fa6872369a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:22.856049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-88bac260-cd17-4db8-a9b1-05fa6872369a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:22.857083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-88bac260-cd17-4db8-a9b1-05fa6872369a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:22.857734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-88bac260-cd17-4db8-a9b1-05fa6872369a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:23.218156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-43337440-b55a-4ad8-a73c-b6a75e6568e5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:23.227679 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-43337440-b55a-4ad8-a73c-b6a75e6568e5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1311 microversion: 2.1 time: 0.912426 Jul 20 04:09:23.228669 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 99/179] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:22 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1311 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:23.237300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a64d30ca-901b-497e-99c4-199075e7a495 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:23.237915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a64d30ca-901b-497e-99c4-199075e7a495 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:23.271483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a64d30ca-901b-497e-99c4-199075e7a495 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:23.271974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a64d30ca-901b-497e-99c4-199075e7a495 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:23.272866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a64d30ca-901b-497e-99c4-199075e7a495 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:23.273452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a64d30ca-901b-497e-99c4-199075e7a495 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:23.291783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-88bac260-cd17-4db8-a9b1-05fa6872369a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:23.300797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:23.306138 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-88bac260-cd17-4db8-a9b1-05fa6872369a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1492 microversion: 2.1 time: 0.485714 Jul 20 04:09:23.319342 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 81/180] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:22 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1492 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:23.326907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-ceee4147-5f91-4644-9067-34e9c0455d08 req-f979bd8e-6616-4efe-89ec-f154dcdf6488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cb300df-ffbd-4b36-88f0-cb0e17340221", "tag": "40ec11f2-83c0-4550-8566-1e9b3ffdcae2"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:23.338027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ceee4147-5f91-4644-9067-34e9c0455d08 req-f979bd8e-6616-4efe-89ec-f154dcdf6488 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:23.338820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ceee4147-5f91-4644-9067-34e9c0455d08 req-f979bd8e-6616-4efe-89ec-f154dcdf6488 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:23.374859 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-ceee4147-5f91-4644-9067-34e9c0455d08 req-f979bd8e-6616-4efe-89ec-f154dcdf6488 service nova] Creating event network-changed:40ec11f2-83c0-4550-8566-1e9b3ffdcae2 for instance 0cb300df-ffbd-4b36-88f0-cb0e17340221 on n-h1-826526-5 Jul 20 04:09:23.387864 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-ceee4147-5f91-4644-9067-34e9c0455d08 req-f979bd8e-6616-4efe-89ec-f154dcdf6488 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063788 Jul 20 04:09:23.389682 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 82/181] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:23.817116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bd3ed831-412d-476c-af82-9c4a4bd29a17 tempest-InstanceUsageAuditLogTestJSON-2057611622 tempest-InstanceUsageAuditLogTestJSON-2057611622-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:23.818640 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:23.818640 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:23.841239 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bd3ed831-412d-476c-af82-9c4a4bd29a17 tempest-InstanceUsageAuditLogTestJSON-2057611622 tempest-InstanceUsageAuditLogTestJSON-2057611622-project-admin] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20 04:09:23" status: 200 len: 318 microversion: 2.1 time: 0.449916 Jul 20 04:09:23.842344 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 83/182] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 04:09:23 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20%2004%3A09%3A23 => generated 318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:23.969547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9e354dab-7e0d-4ff4-9b1c-f3b1d8b94ef7 tempest-DeleteServersAdminTestJSON-455418741 tempest-DeleteServersAdminTestJSON-455418741-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:23.970204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9e354dab-7e0d-4ff4-9b1c-f3b1d8b94ef7 tempest-DeleteServersAdminTestJSON-455418741 tempest-DeleteServersAdminTestJSON-455418741-project-admin] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:23.976769 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e354dab-7e0d-4ff4-9b1c-f3b1d8b94ef7 tempest-DeleteServersAdminTestJSON-455418741 tempest-DeleteServersAdminTestJSON-455418741-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:23.977220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e354dab-7e0d-4ff4-9b1c-f3b1d8b94ef7 tempest-DeleteServersAdminTestJSON-455418741 tempest-DeleteServersAdminTestJSON-455418741-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:23.977999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e354dab-7e0d-4ff4-9b1c-f3b1d8b94ef7 tempest-DeleteServersAdminTestJSON-455418741 tempest-DeleteServersAdminTestJSON-455418741-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:23.978430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e354dab-7e0d-4ff4-9b1c-f3b1d8b94ef7 tempest-DeleteServersAdminTestJSON-455418741 tempest-DeleteServersAdminTestJSON-455418741-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:23.985369 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a64d30ca-901b-497e-99c4-199075e7a495 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1639 microversion: 2.1 time: 0.755590 Jul 20 04:09:23.986301 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 100/183] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:23 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1639 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:24.056674 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-94415265-0acc-4ae8-a4de-b9b37d568429 tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] Action: 'create', calling method: .version_select at 0x7f06bedecd30>, body: {"keypair": {"name": "tempest-keypair-453652551", "type": "ssh", "user_id": "a2cdfe7191fd46ae84648c8567c6f2c1", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALhUrgCZYYk1QtYGky2Jo1NrgoSro6iLmzIuFDPN1A7pKrJRQQNGsefYQ/0GvD/ijFTn82WWwY5x11WwlbkUnwrS5JugS0FvWkazGzFhO1nuwaqNMXIrWtt3MRfjDCfVg=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:24.076184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9e354dab-7e0d-4ff4-9b1c-f3b1d8b94ef7 tempest-DeleteServersAdminTestJSON-455418741 tempest-DeleteServersAdminTestJSON-455418741-project-admin] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:09:24.079502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-94415265-0acc-4ae8-a4de-b9b37d568429 tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] Getting quotas for project 681b337f9a4c40d680231196bd2c47a4. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:09:24.084071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-94415265-0acc-4ae8-a4de-b9b37d568429 tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] Getting quotas for user d1a04a0dbcf44bb09caec5ba318fc031 and project 681b337f9a4c40d680231196bd2c47a4. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:09:24.117940 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-94415265-0acc-4ae8-a4de-b9b37d568429 tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.128954 Jul 20 04:09:24.119497 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 101/184] 10.222.0.17 () {62 vars in 1199 bytes} [Wed Jul 20 04:09:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:09:24.131700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b78f377-2505-475d-9834-42ed1355072c tempest-InstanceUsageAuditLogTestJSON-2057611622 tempest-InstanceUsageAuditLogTestJSON-2057611622-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:24.133212 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:24.133212 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:24.155695 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9b78f377-2505-475d-9834-42ed1355072c tempest-InstanceUsageAuditLogTestJSON-2057611622 tempest-InstanceUsageAuditLogTestJSON-2057611622-project-admin] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.031905 Jul 20 04:09:24.163219 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 102/185] 10.222.0.17 () {58 vars in 1184 bytes} [Wed Jul 20 04:09:24 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:24.163391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c32242fe-d442-4a0b-8c2a-1c1028186313 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:24.163773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c32242fe-d442-4a0b-8c2a-1c1028186313 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:24.171088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c32242fe-d442-4a0b-8c2a-1c1028186313 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:24.171533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c32242fe-d442-4a0b-8c2a-1c1028186313 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:24.172325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c32242fe-d442-4a0b-8c2a-1c1028186313 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:24.173000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c32242fe-d442-4a0b-8c2a-1c1028186313 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:24.200340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c32242fe-d442-4a0b-8c2a-1c1028186313 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:09:24.249274 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:24.261418 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9e354dab-7e0d-4ff4-9b1c-f3b1d8b94ef7 tempest-DeleteServersAdminTestJSON-455418741 tempest-DeleteServersAdminTestJSON-455418741-project-admin] 10.222.0.17 "DELETE /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 204 len: 0 microversion: 2.1 time: 0.417468 Jul 20 04:09:24.266948 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 84/186] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:09:23 2022] DELETE /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:09:24.274897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-31960c8d-b7e7-4584-b78a-c9852b1787e5 tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] Action: 'create', calling method: .version_select at 0x7f06bed5d280>, body: {"keypair": {"name": "tempest-keypair-1666268614", "type": "ssh", "user_id": "a2cdfe7191fd46ae84648c8567c6f2c1", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgOOSLB5w3V1uC4ZGN3NMJ8NMuJSQEDoYeqeY7EzcAPcJ93IeXSZw432YmW5eJhmhXFEfG7RK9jzmy7MpBbvkAK7xCaeufR0bJ/qtfTrQaPOU4TAji/QdKLjXOr5EiXMA=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:24.301650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-31960c8d-b7e7-4584-b78a-c9852b1787e5 tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] Getting quotas for project 681b337f9a4c40d680231196bd2c47a4. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:09:24.309484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-31960c8d-b7e7-4584-b78a-c9852b1787e5 tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] Getting quotas for user d1a04a0dbcf44bb09caec5ba318fc031 and project 681b337f9a4c40d680231196bd2c47a4. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:09:24.393920 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-31960c8d-b7e7-4584-b78a-c9852b1787e5 tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.125429 Jul 20 04:09:24.394803 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 85/187] 10.222.0.17 () {62 vars in 1199 bytes} [Wed Jul 20 04:09:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 127 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:09:24.404167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6311d604-8bfb-47c4-8649-0f755219dab9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:24.404635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6311d604-8bfb-47c4-8649-0f755219dab9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:24.404999 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c32242fe-d442-4a0b-8c2a-1c1028186313 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 204 len: 0 microversion: 2.1 time: 0.246947 Jul 20 04:09:24.407431 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 103/188] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:09:24 2022] DELETE /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:09:24.417909 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6311d604-8bfb-47c4-8649-0f755219dab9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:24.418359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6311d604-8bfb-47c4-8649-0f755219dab9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:24.421528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6311d604-8bfb-47c4-8649-0f755219dab9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:24.423805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6311d604-8bfb-47c4-8649-0f755219dab9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:24.426937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b17a566a-a61f-4c90-8f35-ded09bed480c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:24.427702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b17a566a-a61f-4c90-8f35-ded09bed480c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:24.436638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b17a566a-a61f-4c90-8f35-ded09bed480c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:24.437292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b17a566a-a61f-4c90-8f35-ded09bed480c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:24.438183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b17a566a-a61f-4c90-8f35-ded09bed480c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:24.438734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b17a566a-a61f-4c90-8f35-ded09bed480c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:24.605435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=10 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:24.713309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b17a566a-a61f-4c90-8f35-ded09bed480c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:24.726230 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b17a566a-a61f-4c90-8f35-ded09bed480c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1498 microversion: 2.1 time: 0.317249 Jul 20 04:09:24.726827 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 104/189] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:24 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1498 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:24.730435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6311d604-8bfb-47c4-8649-0f755219dab9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:24.741432 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6311d604-8bfb-47c4-8649-0f755219dab9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1311 microversion: 2.1 time: 0.345358 Jul 20 04:09:24.742140 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 86/190] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:24 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1311 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:24.742792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-34f4f958-d711-4f28-a453-f25c13122faf tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] Calling method '.version_select at 0x7f06becb59d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:24.750471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-40da673e-ce60-490c-a3b6-f47873e79142 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:24.753071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-40da673e-ce60-490c-a3b6-f47873e79142 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:24.760032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40da673e-ce60-490c-a3b6-f47873e79142 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:24.760708 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40da673e-ce60-490c-a3b6-f47873e79142 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:24.761676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40da673e-ce60-490c-a3b6-f47873e79142 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:24.762393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40da673e-ce60-490c-a3b6-f47873e79142 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:24.767138 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-34f4f958-d711-4f28-a453-f25c13122faf tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-453652551?user_id=a2cdfe7191fd46ae84648c8567c6f2c1" status: 200 len: 511 microversion: 2.10 time: 0.038556 Jul 20 04:09:24.770953 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 105/191] 10.222.0.17 () {60 vars in 1336 bytes} [Wed Jul 20 04:09:24 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-453652551?user_id=a2cdfe7191fd46ae84648c8567c6f2c1 => generated 511 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:09:24.786333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d1b39cbd-62ba-4b3f-b692-ea75cb933b5a tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] Action: 'create', calling method: .version_select at 0x7f06becb5430>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-2034490239", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCIjJxcSNTY7YGXRT7TbW8eTEtSY8udNwiFQxC+N1s67DaAoBY2OdAghPtOBcqcXkdlRRU7/DPxNX7BX26Aw1ZN+uRCKpZuuR9PsGmqrHv5Y2J6zi8mZrUDJyfFy9DTyA=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:24.807891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-d1b39cbd-62ba-4b3f-b692-ea75cb933b5a tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] Getting quotas for project 681b337f9a4c40d680231196bd2c47a4. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:09:24.820064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-d1b39cbd-62ba-4b3f-b692-ea75cb933b5a tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] Getting quotas for user d1a04a0dbcf44bb09caec5ba318fc031 and project 681b337f9a4c40d680231196bd2c47a4. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:09:24.854069 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d1b39cbd-62ba-4b3f-b692-ea75cb933b5a tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.072066 Jul 20 04:09:24.854985 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 106/192] 10.222.0.17 () {62 vars in 1199 bytes} [Wed Jul 20 04:09:24 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:09:24.865559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4a44efa9-d363-4f7b-97a4-e4d3c2714449 tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] Calling method '.version_select at 0x7f06bec45c10>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:24.869299 n-d-826526-5 devstack@n-api.service[127871]: WARNING oslo_db.sqlalchemy.utils [None req-4a44efa9-d363-4f7b-97a4-e4d3c2714449 tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:09:24.890906 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4a44efa9-d363-4f7b-97a4-e4d3c2714449 tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] 10.222.0.17 "GET /compute/v2.1/os-keypairs?user_id=a2cdfe7191fd46ae84648c8567c6f2c1" status: 200 len: 725 microversion: 2.10 time: 0.029242 Jul 20 04:09:24.891484 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 107/193] 10.222.0.17 () {60 vars in 1258 bytes} [Wed Jul 20 04:09:24 2022] GET /compute/v2.1/os-keypairs?user_id=a2cdfe7191fd46ae84648c8567c6f2c1 => generated 725 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:09:24.906145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-740911d6-90eb-48b1-8e0e-802072f94d8b tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] Calling method '.version_select at 0x7f06becb5820>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:24.926516 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-740911d6-90eb-48b1-8e0e-802072f94d8b tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2034490239" status: 204 len: 0 microversion: 2.10 time: 0.028113 Jul 20 04:09:24.928312 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 108/194] 10.222.0.17 () {60 vars in 1324 bytes} [Wed Jul 20 04:09:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2034490239 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:09:24.939349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-40da673e-ce60-490c-a3b6-f47873e79142 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:24.943453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-103b7ed0-35bb-4786-865c-64df3e48bed9 tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] Calling method '.version_select at 0x7f06bebc03a0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:24.950058 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-40da673e-ce60-490c-a3b6-f47873e79142 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1494 microversion: 2.1 time: 0.206067 Jul 20 04:09:24.950841 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 87/195] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:24 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1494 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:24.981282 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-103b7ed0-35bb-4786-865c-64df3e48bed9 tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666268614?user_id=a2cdfe7191fd46ae84648c8567c6f2c1" status: 204 len: 0 microversion: 2.10 time: 0.043039 Jul 20 04:09:24.984311 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 109/196] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:09:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666268614?user_id=a2cdfe7191fd46ae84648c8567c6f2c1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:09:24.992502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-096c4bf5-b6a1-40e6-8dfb-13d859175ceb tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] Calling method '.version_select at 0x7f06bebb8160>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:25.023843 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-096c4bf5-b6a1-40e6-8dfb-13d859175ceb tempest-KeyPairsV210TestJSON-718817306 tempest-KeyPairsV210TestJSON-718817306-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-453652551?user_id=a2cdfe7191fd46ae84648c8567c6f2c1" status: 204 len: 0 microversion: 2.10 time: 0.036187 Jul 20 04:09:25.025585 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 88/197] 10.222.0.17 () {60 vars in 1339 bytes} [Wed Jul 20 04:09:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-453652551?user_id=a2cdfe7191fd46ae84648c8567c6f2c1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:09:25.747436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-65545600-78b3-4471-bfd1-2071b233012d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:25.748797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-65545600-78b3-4471-bfd1-2071b233012d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:25.758316 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65545600-78b3-4471-bfd1-2071b233012d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:25.759657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-17f1913c-c77f-4e80-9916-a9253fbb234d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:25.761055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-17f1913c-c77f-4e80-9916-a9253fbb234d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:25.761544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65545600-78b3-4471-bfd1-2071b233012d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:25.762667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65545600-78b3-4471-bfd1-2071b233012d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:25.763467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65545600-78b3-4471-bfd1-2071b233012d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:25.789821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17f1913c-c77f-4e80-9916-a9253fbb234d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:25.790278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17f1913c-c77f-4e80-9916-a9253fbb234d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:25.792412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17f1913c-c77f-4e80-9916-a9253fbb234d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:25.793018 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17f1913c-c77f-4e80-9916-a9253fbb234d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:26.020651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-65545600-78b3-4471-bfd1-2071b233012d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:26.032663 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-65545600-78b3-4471-bfd1-2071b233012d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1498 microversion: 2.1 time: 0.292597 Jul 20 04:09:26.033273 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 110/198] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:25 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1498 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:26.046532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c3b6ec16-20da-4790-ad1c-f8977c8eeed6 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:26.047145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c3b6ec16-20da-4790-ad1c-f8977c8eeed6 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:26.055658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3b6ec16-20da-4790-ad1c-f8977c8eeed6 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:26.056105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3b6ec16-20da-4790-ad1c-f8977c8eeed6 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:26.057619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3b6ec16-20da-4790-ad1c-f8977c8eeed6 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:26.058049 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3b6ec16-20da-4790-ad1c-f8977c8eeed6 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:26.377356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-17f1913c-c77f-4e80-9916-a9253fbb234d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:26.392612 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-17f1913c-c77f-4e80-9916-a9253fbb234d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1311 microversion: 2.1 time: 0.632440 Jul 20 04:09:26.402071 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 89/199] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:25 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1311 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:26.443068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c3b6ec16-20da-4790-ad1c-f8977c8eeed6 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:26.452806 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c3b6ec16-20da-4790-ad1c-f8977c8eeed6 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1494 microversion: 2.1 time: 0.418470 Jul 20 04:09:26.453479 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 111/200] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:26 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1494 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:27.052689 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-29416f6c-8c37-4265-8e24-8e4763a17a84 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:27.053221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-29416f6c-8c37-4265-8e24-8e4763a17a84 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:27.061101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29416f6c-8c37-4265-8e24-8e4763a17a84 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:27.061652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29416f6c-8c37-4265-8e24-8e4763a17a84 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:27.062441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29416f6c-8c37-4265-8e24-8e4763a17a84 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:27.062880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29416f6c-8c37-4265-8e24-8e4763a17a84 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:27.410930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c9cb22fb-eb01-4e9c-87a3-b06a784c757b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:27.412247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c9cb22fb-eb01-4e9c-87a3-b06a784c757b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:27.423942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9cb22fb-eb01-4e9c-87a3-b06a784c757b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:27.424797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9cb22fb-eb01-4e9c-87a3-b06a784c757b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:27.425767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9cb22fb-eb01-4e9c-87a3-b06a784c757b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:27.426388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9cb22fb-eb01-4e9c-87a3-b06a784c757b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:27.538969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-29416f6c-8c37-4265-8e24-8e4763a17a84 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:27.555897 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-29416f6c-8c37-4265-8e24-8e4763a17a84 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1498 microversion: 2.1 time: 0.508822 Jul 20 04:09:27.557193 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 90/201] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:27 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1498 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:27.570732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c426905e-e2f4-4653-9930-b5ac3b460570 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:27.575658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c426905e-e2f4-4653-9930-b5ac3b460570 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:27.596110 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c426905e-e2f4-4653-9930-b5ac3b460570 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:27.597161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c426905e-e2f4-4653-9930-b5ac3b460570 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:27.599986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c426905e-e2f4-4653-9930-b5ac3b460570 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:27.604148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c426905e-e2f4-4653-9930-b5ac3b460570 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:28.065640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c426905e-e2f4-4653-9930-b5ac3b460570 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:28.076959 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c426905e-e2f4-4653-9930-b5ac3b460570 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1494 microversion: 2.1 time: 0.513844 Jul 20 04:09:28.097366 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 91/202] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:27 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1494 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:28.442831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-ebf4e29b-a9e8-4b0d-9cc2-ef5f372ecc56 req-5ef3a2c6-fcab-4202-9986-411173d58978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaceccec-6030-408a-8b3e-94b704473d0a", "name": "network-vif-deleted", "tag": "dc0b81fd-f0fe-4fe9-9d09-782ea8e4a1be"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:28.458454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ebf4e29b-a9e8-4b0d-9cc2-ef5f372ecc56 req-5ef3a2c6-fcab-4202-9986-411173d58978 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:28.481832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ebf4e29b-a9e8-4b0d-9cc2-ef5f372ecc56 req-5ef3a2c6-fcab-4202-9986-411173d58978 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:28.499524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c9cb22fb-eb01-4e9c-87a3-b06a784c757b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:28.510066 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c9cb22fb-eb01-4e9c-87a3-b06a784c757b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1311 microversion: 2.1 time: 1.105696 Jul 20 04:09:28.520394 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-ebf4e29b-a9e8-4b0d-9cc2-ef5f372ecc56 req-5ef3a2c6-fcab-4202-9986-411173d58978 service nova] Creating event network-vif-deleted:dc0b81fd-f0fe-4fe9-9d09-782ea8e4a1be for instance eaceccec-6030-408a-8b3e-94b704473d0a on n-h2-826526-5 Jul 20 04:09:28.525725 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 112/203] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:27 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1311 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:28.539524 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-ebf4e29b-a9e8-4b0d-9cc2-ef5f372ecc56 req-5ef3a2c6-fcab-4202-9986-411173d58978 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103152 Jul 20 04:09:28.546218 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 92/204] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:09:28.575298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d89ebd53-5a0f-4a3d-abea-45396491c3b1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:28.576042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d89ebd53-5a0f-4a3d-abea-45396491c3b1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:28.590862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d89ebd53-5a0f-4a3d-abea-45396491c3b1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:28.591304 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d89ebd53-5a0f-4a3d-abea-45396491c3b1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:28.592098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d89ebd53-5a0f-4a3d-abea-45396491c3b1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:28.592549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d89ebd53-5a0f-4a3d-abea-45396491c3b1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:28.801676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d89ebd53-5a0f-4a3d-abea-45396491c3b1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:28.812176 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d89ebd53-5a0f-4a3d-abea-45396491c3b1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 200 len: 1327 microversion: 2.1 time: 0.240967 Jul 20 04:09:28.827612 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 113/205] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:28 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 1327 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:29.100374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f57ff77a-4fd9-45a1-ba35-04a6f5adf916 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:29.101177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f57ff77a-4fd9-45a1-ba35-04a6f5adf916 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:29.112516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f57ff77a-4fd9-45a1-ba35-04a6f5adf916 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:29.112977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f57ff77a-4fd9-45a1-ba35-04a6f5adf916 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:29.113774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f57ff77a-4fd9-45a1-ba35-04a6f5adf916 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:29.120079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f57ff77a-4fd9-45a1-ba35-04a6f5adf916 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:29.242129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f57ff77a-4fd9-45a1-ba35-04a6f5adf916 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:29.242588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f57ff77a-4fd9-45a1-ba35-04a6f5adf916 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:29.243068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-f57ff77a-4fd9-45a1-ba35-04a6f5adf916 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lazy-loading 'fault' on Instance uuid 0b5032fa-799c-4a49-8963-67342c39903e {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:29.328678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f57ff77a-4fd9-45a1-ba35-04a6f5adf916 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e044297c454f508bde607ae3eee5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269ec7045cb7428faa0427f65b46754b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:29.341732 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f57ff77a-4fd9-45a1-ba35-04a6f5adf916 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 200 len: 1328 microversion: 2.1 time: 0.247077 Jul 20 04:09:29.342320 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 93/206] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:29 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 1328 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:29.530320 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ec0c1ae6-fd79-4571-8d0d-90e6b77cbea8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:29.530937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ec0c1ae6-fd79-4571-8d0d-90e6b77cbea8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:29.544974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec0c1ae6-fd79-4571-8d0d-90e6b77cbea8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:29.545391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec0c1ae6-fd79-4571-8d0d-90e6b77cbea8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:29.546218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec0c1ae6-fd79-4571-8d0d-90e6b77cbea8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:29.562696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec0c1ae6-fd79-4571-8d0d-90e6b77cbea8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:29.946168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8e8d69f1-d6d0-465c-a56c-d9a6ef38e7ee tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-704540229", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:30.013037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ec0c1ae6-fd79-4571-8d0d-90e6b77cbea8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:30.035840 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ec0c1ae6-fd79-4571-8d0d-90e6b77cbea8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1311 microversion: 2.1 time: 0.508548 Jul 20 04:09:30.038122 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 114/207] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:29 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1311 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:30.041362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-8e8d69f1-d6d0-465c-a56c-d9a6ef38e7ee tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] validate_networks() for None {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:09:30.048709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9739dde8-93a1-485d-a7c5-d49ff1e1b909 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:30.051949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9739dde8-93a1-485d-a7c5-d49ff1e1b909 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:30.062394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9739dde8-93a1-485d-a7c5-d49ff1e1b909 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:30.062915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9739dde8-93a1-485d-a7c5-d49ff1e1b909 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:30.063764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9739dde8-93a1-485d-a7c5-d49ff1e1b909 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:30.064458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9739dde8-93a1-485d-a7c5-d49ff1e1b909 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:30.088494 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-9739dde8-93a1-485d-a7c5-d49ff1e1b909 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] HTTP exception thrown: Instance eaceccec-6030-408a-8b3e-94b704473d0a could not be found. Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9739dde8-93a1-485d-a7c5-d49ff1e1b909 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Request method failure captured: Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a HTTP/1.1 Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_UUzUhZktEE2tdIkAHOH9vRdqe1txcvLILauq-rUgGpaATHExKC8tauOhURHra2BCsn_3zhXnoodmGVbOUY2vwofok0-2LHqx7QUVt-0SiEbBOhKwWsam4wcMKhXoysEjtjNqtW8SwNnIc4tckbveN6ql_ICZXzPrEfVy5T1IxmlY Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 9c3880edc93c4226bc33da852c29549d Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersAdminTestJSON-83504900 Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:09:30.091207 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:09:30.092735 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c3880edc93c4226bc33da852c29549d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c3880edc93c4226bc33da852c29549d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c3880edc93c4226bc33da852c29549d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c3880edc93c4226bc33da852c29549d"}]}] Jul 20 04:09:30.092735 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersAdminTestJSON-83504900 Jul 20 04:09:30.092735 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 9c3880edc93c4226bc33da852c29549d Jul 20 04:09:30.092735 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-83504900 Jul 20 04:09:30.092735 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersAdminTestJSON-83504900-project Jul 20 04:09:30.092735 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:30.092735 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:30.092735 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f013a3858af9433889e60ea288757de2 Jul 20 04:09:30.092735 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersAdminTestJSON-83504900-project Jul 20 04:09:30.092735 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:09:30.092735 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance eaceccec-6030-408a-8b3e-94b704473d0a could not be found. Jul 20 04:09:30.092735 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'eaceccec-6030-408a-8b3e-94b704473d0a'} Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaceccec-6030-408a-8b3e-94b704473d0a could not be found. Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:30.093451 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:30.094505 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:30.094505 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:09:30.094505 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:09:30.094505 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:09:30.094505 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:09:30.094505 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:09:30.094505 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:30.094505 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaceccec-6030-408a-8b3e-94b704473d0a could not be found. Jul 20 04:09:30.094505 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:30.094505 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:30.094505 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:30.094505 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:30.094505 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:30.094505 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:30.094505 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:30.094505 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:30.094505 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaceccec-6030-408a-8b3e-94b704473d0a could not be found. Jul 20 04:09:30.094505 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:30.097197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9739dde8-93a1-485d-a7c5-d49ff1e1b909 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Returning 404 to user: Instance eaceccec-6030-408a-8b3e-94b704473d0a could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:30.098239 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9739dde8-93a1-485d-a7c5-d49ff1e1b909 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 404 len: 111 microversion: 2.1 time: 0.059108 Jul 20 04:09:30.099362 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 115/208] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:30 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:30.265353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-73a565fa-df19-4703-9c15-52b655c4a3c6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1202913295", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:30.329617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-73a565fa-df19-4703-9c15-52b655c4a3c6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:09:30.705048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8e8d69f1-d6d0-465c-a56c-d9a6ef38e7ee tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:09:30.705472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8e8d69f1-d6d0-465c-a56c-d9a6ef38e7ee tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:09:30.705979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8e8d69f1-d6d0-465c-a56c-d9a6ef38e7ee tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:09:30.706749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8e8d69f1-d6d0-465c-a56c-d9a6ef38e7ee tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:09:30.707173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8e8d69f1-d6d0-465c-a56c-d9a6ef38e7ee tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:09:30.731361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e8d69f1-d6d0-465c-a56c-d9a6ef38e7ee tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:30.732007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e8d69f1-d6d0-465c-a56c-d9a6ef38e7ee tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:30.733172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e8d69f1-d6d0-465c-a56c-d9a6ef38e7ee tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:30.733850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e8d69f1-d6d0-465c-a56c-d9a6ef38e7ee tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:30.780713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8e8d69f1-d6d0-465c-a56c-d9a6ef38e7ee tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Getting quotas for project f2a267e50d30497d93400d593631d3e7. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:09:30.785547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8e8d69f1-d6d0-465c-a56c-d9a6ef38e7ee tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Getting quotas for user c2eb773226944c408149ae7f33b12dbe and project f2a267e50d30497d93400d593631d3e7. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:09:30.818843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:30.820422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8e8d69f1-d6d0-465c-a56c-d9a6ef38e7ee tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:09:30.829905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8e8d69f1-d6d0-465c-a56c-d9a6ef38e7ee tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:09:30.857139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-73a565fa-df19-4703-9c15-52b655c4a3c6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:09:30.858167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-73a565fa-df19-4703-9c15-52b655c4a3c6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:09:30.859091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-73a565fa-df19-4703-9c15-52b655c4a3c6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:09:30.859721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-73a565fa-df19-4703-9c15-52b655c4a3c6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:09:30.860366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-73a565fa-df19-4703-9c15-52b655c4a3c6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:09:30.879749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73a565fa-df19-4703-9c15-52b655c4a3c6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:30.888352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73a565fa-df19-4703-9c15-52b655c4a3c6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:30.889571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73a565fa-df19-4703-9c15-52b655c4a3c6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:30.890212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73a565fa-df19-4703-9c15-52b655c4a3c6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:30.926720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-73a565fa-df19-4703-9c15-52b655c4a3c6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Getting quotas for project 9c3880edc93c4226bc33da852c29549d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:09:30.931644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:30.949047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-73a565fa-df19-4703-9c15-52b655c4a3c6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Getting quotas for user f013a3858af9433889e60ea288757de2 and project 9c3880edc93c4226bc33da852c29549d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:09:30.951527 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8e8d69f1-d6d0-465c-a56c-d9a6ef38e7ee tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.242980 Jul 20 04:09:30.954461 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 94/209] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:09:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:09:30.968551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4ecc54bd-339a-4497-9522-cbf18016d503 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:30.969751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4ecc54bd-339a-4497-9522-cbf18016d503 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:30.980596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ecc54bd-339a-4497-9522-cbf18016d503 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:30.981395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ecc54bd-339a-4497-9522-cbf18016d503 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:30.982944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ecc54bd-339a-4497-9522-cbf18016d503 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:30.983629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ecc54bd-339a-4497-9522-cbf18016d503 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:30.989063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-73a565fa-df19-4703-9c15-52b655c4a3c6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:09:30.991393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-73a565fa-df19-4703-9c15-52b655c4a3c6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:09:31.007010 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-4ecc54bd-339a-4497-9522-cbf18016d503 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] HTTP exception thrown: Instance 0b5032fa-799c-4a49-8963-67342c39903e could not be found. Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4ecc54bd-339a-4497-9522-cbf18016d503 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Request method failure captured: Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e HTTP/1.1 Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_TunmVd0vqodBdPuWhQCLma30OR7j03I5Hd6u-ySefi_4IdCeRU8KinQIgNMU3RhBqJBlQTxTQwgDeXRPc1C-NBDneO95uZwl4zxqc3dllbo1phCzoOLh1q4iiW-2R6jK0-OrmbRSn0fnXnLDmfpjzVvokUH_Rqt9PRzR2D7p11Tc Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 269ec7045cb7428faa0427f65b46754b Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AggregatesAdminTestJSON-486901790 Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:09:31.009736 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:09:31.010924 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/269ec7045cb7428faa0427f65b46754b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/269ec7045cb7428faa0427f65b46754b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_269ec7045cb7428faa0427f65b46754b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/269ec7045cb7428faa0427f65b46754b"}]}] Jul 20 04:09:31.010924 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AggregatesAdminTestJSON-486901790 Jul 20 04:09:31.010924 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 269ec7045cb7428faa0427f65b46754b Jul 20 04:09:31.010924 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-486901790 Jul 20 04:09:31.010924 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AggregatesAdminTestJSON-486901790-project Jul 20 04:09:31.010924 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:09:31.010924 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:09:31.010924 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 84e044297c454f508bde607ae3eee5a7 Jul 20 04:09:31.010924 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AggregatesAdminTestJSON-486901790-project Jul 20 04:09:31.010924 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:09:31.010924 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 0b5032fa-799c-4a49-8963-67342c39903e could not be found. Jul 20 04:09:31.010924 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '0b5032fa-799c-4a49-8963-67342c39903e'} Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b5032fa-799c-4a49-8963-67342c39903e could not be found. Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:31.011601 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:31.012787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:31.012787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:09:31.012787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:09:31.012787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:09:31.012787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:09:31.012787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:09:31.012787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:31.012787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b5032fa-799c-4a49-8963-67342c39903e could not be found. Jul 20 04:09:31.012787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:31.012787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:31.012787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:31.012787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:31.012787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:31.012787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:31.012787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:31.012787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:31.012787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b5032fa-799c-4a49-8963-67342c39903e could not be found. Jul 20 04:09:31.012787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:31.015629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4ecc54bd-339a-4497-9522-cbf18016d503 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Returning 404 to user: Instance 0b5032fa-799c-4a49-8963-67342c39903e could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:31.016898 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4ecc54bd-339a-4497-9522-cbf18016d503 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 404 len: 111 microversion: 2.1 time: 0.059973 Jul 20 04:09:31.017783 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 95/210] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:30 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:31.028933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-3195c4b1-631b-4348-afb6-4ceb32e9bda8 req-2265d4e7-4355-4dee-830d-00ae255330b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b5032fa-799c-4a49-8963-67342c39903e", "name": "network-vif-deleted", "tag": "57dd3618-045a-4b8c-8b6b-eaafcdf0e9d5"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:31.046556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-3195c4b1-631b-4348-afb6-4ceb32e9bda8 req-2265d4e7-4355-4dee-830d-00ae255330b4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:31.047693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-3195c4b1-631b-4348-afb6-4ceb32e9bda8 req-2265d4e7-4355-4dee-830d-00ae255330b4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:31.068342 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-3195c4b1-631b-4348-afb6-4ceb32e9bda8 req-2265d4e7-4355-4dee-830d-00ae255330b4 service nova] Creating event network-vif-deleted:57dd3618-045a-4b8c-8b6b-eaafcdf0e9d5 for instance 0b5032fa-799c-4a49-8963-67342c39903e on n-h2-826526-5 Jul 20 04:09:31.080206 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-3195c4b1-631b-4348-afb6-4ceb32e9bda8 req-2265d4e7-4355-4dee-830d-00ae255330b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060693 Jul 20 04:09:31.082149 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 96/211] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:31.090413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b5e6ef2a-e157-4b68-89e6-2481b953f8a3 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:31.092203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b5e6ef2a-e157-4b68-89e6-2481b953f8a3 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:31.132107 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-73a565fa-df19-4703-9c15-52b655c4a3c6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876302 Jul 20 04:09:31.133433 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 116/212] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:09:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:09:31.140004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-addcd5e5-7c08-4ee3-a33c-6804266ccbb9 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-826526-5"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:31.155097 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:31.155097 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:31.174587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-addcd5e5-7c08-4ee3-a33c-6804266ccbb9 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:31.175202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-addcd5e5-7c08-4ee3-a33c-6804266ccbb9 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:31.186652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b5e6ef2a-e157-4b68-89e6-2481b953f8a3 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:31.196014 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b5e6ef2a-e157-4b68-89e6-2481b953f8a3 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1218 microversion: 2.1 time: 0.111903 Jul 20 04:09:31.210889 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 97/213] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:31 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:31.210889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a2166406-505a-4f1f-9fb1-3c5f78cba3d5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:31.210889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a2166406-505a-4f1f-9fb1-3c5f78cba3d5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:31.243263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2166406-505a-4f1f-9fb1-3c5f78cba3d5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:31.243719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2166406-505a-4f1f-9fb1-3c5f78cba3d5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:31.246711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2166406-505a-4f1f-9fb1-3c5f78cba3d5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:31.247157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2166406-505a-4f1f-9fb1-3c5f78cba3d5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:31.945784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a2166406-505a-4f1f-9fb1-3c5f78cba3d5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:31.960182 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a2166406-505a-4f1f-9fb1-3c5f78cba3d5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1311 microversion: 2.1 time: 0.755792 Jul 20 04:09:31.961865 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 98/214] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:31 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1311 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:31.974607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e9151958-1b62-4697-afeb-3a0cd14c17e1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:31.975772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e9151958-1b62-4697-afeb-3a0cd14c17e1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:32.007887 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-addcd5e5-7c08-4ee3-a33c-6804266ccbb9 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.872868 Jul 20 04:09:32.014201 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 117/215] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 04:09:31 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:32.021675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-35142855-bde6-40d2-b5f4-8dfe844659a8 req-7971727f-ea33-450d-80d9-a41e8275f9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb300df-ffbd-4b36-88f0-cb0e17340221", "name": "network-vif-plugged", "status": "completed", "tag": "40ec11f2-83c0-4550-8566-1e9b3ffdcae2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:32.057535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-35142855-bde6-40d2-b5f4-8dfe844659a8 req-7971727f-ea33-450d-80d9-a41e8275f9d9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:32.058247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-35142855-bde6-40d2-b5f4-8dfe844659a8 req-7971727f-ea33-450d-80d9-a41e8275f9d9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:32.087354 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-35142855-bde6-40d2-b5f4-8dfe844659a8 req-7971727f-ea33-450d-80d9-a41e8275f9d9 service nova] Creating event network-vif-plugged:40ec11f2-83c0-4550-8566-1e9b3ffdcae2 for instance 0cb300df-ffbd-4b36-88f0-cb0e17340221 on n-h1-826526-5 Jul 20 04:09:32.101974 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-35142855-bde6-40d2-b5f4-8dfe844659a8 req-7971727f-ea33-450d-80d9-a41e8275f9d9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085394 Jul 20 04:09:32.102862 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 118/216] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:32.119363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b93399b9-824e-4f60-be62-81dbb100f942 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:32.122309 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:32.122309 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:32.178779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e9151958-1b62-4697-afeb-3a0cd14c17e1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:32.187543 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e9151958-1b62-4697-afeb-3a0cd14c17e1 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1220 microversion: 2.1 time: 0.220722 Jul 20 04:09:32.189307 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b93399b9-824e-4f60-be62-81dbb100f942 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.081362 Jul 20 04:09:32.195362 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 119/217] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:09:32 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:09:32.207150 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 99/218] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:31 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1220 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:32.219734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-82ef0e66-eee6-47bc-af3d-a36232b1e056 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:32.223336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-01adad49-9800-4c98-8d10-d605cf5b63f8 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1997565563"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:32.224182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-82ef0e66-eee6-47bc-af3d-a36232b1e056 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:32.229695 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:32.229695 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:32.234258 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.aggregate [None req-01adad49-9800-4c98-8d10-d605cf5b63f8 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Generated uuid 23681f71-b1cd-4989-b42e-a00de8706421 for aggregate {{(pid=127871) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:09:32.248410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82ef0e66-eee6-47bc-af3d-a36232b1e056 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:32.249368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82ef0e66-eee6-47bc-af3d-a36232b1e056 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:32.250388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82ef0e66-eee6-47bc-af3d-a36232b1e056 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:32.251017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82ef0e66-eee6-47bc-af3d-a36232b1e056 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:32.330724 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-01adad49-9800-4c98-8d10-d605cf5b63f8 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.120420 Jul 20 04:09:32.332984 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 120/219] 10.222.0.17 () {60 vars in 1163 bytes} [Wed Jul 20 04:09:32 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:32.347171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-00756941-4bc9-453c-b518-0da323fbf7b1 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-826526-5"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:32.350454 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:32.350454 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:32.382546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00756941-4bc9-453c-b518-0da323fbf7b1 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:32.385631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00756941-4bc9-453c-b518-0da323fbf7b1 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:32.495821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-82ef0e66-eee6-47bc-af3d-a36232b1e056 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:32.504738 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-82ef0e66-eee6-47bc-af3d-a36232b1e056 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1236 microversion: 2.1 time: 0.290619 Jul 20 04:09:32.512237 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 100/220] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:32 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1236 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:32.634319 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-00756941-4bc9-453c-b518-0da323fbf7b1 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.295591 Jul 20 04:09:32.635624 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 121/221] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 04:09:32 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:32.649603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0ffc07fb-9ab5-4074-ae6c-5d98d0ccf3bb tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:32.651569 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:32.651569 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:32.663526 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0ffc07fb-9ab5-4074-ae6c-5d98d0ccf3bb tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.021571 Jul 20 04:09:32.665483 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 101/222] 10.222.0.17 () {58 vars in 1148 bytes} [Wed Jul 20 04:09:32 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:32.682358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-987913ba-51a5-4089-9004-1045a4a4a290 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-826526-5"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:32.685673 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:32.685673 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:32.703752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-987913ba-51a5-4089-9004-1045a4a4a290 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:32.704992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-987913ba-51a5-4089-9004-1045a4a4a290 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:32.944527 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-987913ba-51a5-4089-9004-1045a4a4a290 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.270400 Jul 20 04:09:32.949094 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 122/223] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 04:09:32 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:09:32.960014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-082ca7b0-8de1-4543-a154-2102cf4e5a5b tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:32.962362 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:32.962362 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:32.984777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d2e6c06c-0e67-487d-a46e-d49915c59ac1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:32.986254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d2e6c06c-0e67-487d-a46e-d49915c59ac1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:33.009022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2e6c06c-0e67-487d-a46e-d49915c59ac1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:33.011464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2e6c06c-0e67-487d-a46e-d49915c59ac1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:33.013764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2e6c06c-0e67-487d-a46e-d49915c59ac1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:33.015299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2e6c06c-0e67-487d-a46e-d49915c59ac1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:33.024248 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-082ca7b0-8de1-4543-a154-2102cf4e5a5b tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.069795 Jul 20 04:09:33.027234 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 102/224] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:09:32 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 20 04:09:33.042345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8b327818-0767-4d1e-b77a-2ff56d502d4a tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-791857232"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:33.045643 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:33.045643 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:33.050406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.aggregate [None req-8b327818-0767-4d1e-b77a-2ff56d502d4a tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Generated uuid 7215863f-7480-4c35-b7e2-49411147b1aa for aggregate {{(pid=127870) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:09:33.107704 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8b327818-0767-4d1e-b77a-2ff56d502d4a tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.074036 Jul 20 04:09:33.110418 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 103/225] 10.222.0.17 () {60 vars in 1163 bytes} [Wed Jul 20 04:09:33 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:09:33.126215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6b173b42-252f-4b0f-a03b-78459c686dc5 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-826526-5"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:33.132570 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:33.132570 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:33.153862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b173b42-252f-4b0f-a03b-78459c686dc5 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:33.160823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b173b42-252f-4b0f-a03b-78459c686dc5 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:33.408430 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6b173b42-252f-4b0f-a03b-78459c686dc5 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.291460 Jul 20 04:09:33.413079 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 104/226] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 04:09:33 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:33.419670 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-50a767e6-fc64-4caf-b7d3-d5b77f8a7f99 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:33.420772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-50a767e6-fc64-4caf-b7d3-d5b77f8a7f99 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:33.431891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50a767e6-fc64-4caf-b7d3-d5b77f8a7f99 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:33.432736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50a767e6-fc64-4caf-b7d3-d5b77f8a7f99 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:33.433819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50a767e6-fc64-4caf-b7d3-d5b77f8a7f99 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:33.434392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50a767e6-fc64-4caf-b7d3-d5b77f8a7f99 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:33.556724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d2e6c06c-0e67-487d-a46e-d49915c59ac1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:33.567810 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d2e6c06c-0e67-487d-a46e-d49915c59ac1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1311 microversion: 2.1 time: 0.591578 Jul 20 04:09:33.580572 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 123/227] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:32 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1311 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:33.580997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-50a767e6-fc64-4caf-b7d3-d5b77f8a7f99 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:33.588176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b0266b15-7a81-4dd4-b6f9-747e9ce69957 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:33.589579 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:33.589579 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:33.596092 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-50a767e6-fc64-4caf-b7d3-d5b77f8a7f99 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1280 microversion: 2.1 time: 0.181692 Jul 20 04:09:33.598564 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 105/228] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:33 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1280 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:33.599884 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b0266b15-7a81-4dd4-b6f9-747e9ce69957 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.017739 Jul 20 04:09:33.607525 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 124/229] 10.222.0.17 () {58 vars in 1142 bytes} [Wed Jul 20 04:09:33 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:33.616024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d5623540-cdb7-43f9-af47-451dc0660af1 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:33.617955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d5623540-cdb7-43f9-af47-451dc0660af1 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:33.629419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e284033a-51e2-4a8e-8b6d-e7ef9de9b0ec tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-826526-5"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:33.631106 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:33.631106 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:33.637889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5623540-cdb7-43f9-af47-451dc0660af1 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:33.640189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5623540-cdb7-43f9-af47-451dc0660af1 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:33.641402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e284033a-51e2-4a8e-8b6d-e7ef9de9b0ec tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:33.641611 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5623540-cdb7-43f9-af47-451dc0660af1 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:33.642095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e284033a-51e2-4a8e-8b6d-e7ef9de9b0ec tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:33.644645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5623540-cdb7-43f9-af47-451dc0660af1 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:33.809677 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e284033a-51e2-4a8e-8b6d-e7ef9de9b0ec tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.200652 Jul 20 04:09:33.810627 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 125/230] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 04:09:33 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:33.821827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f57ef950-6bc4-4806-8195-d439abbd0df9 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:33.822884 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:33.822884 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:33.855123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d5623540-cdb7-43f9-af47-451dc0660af1 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:33.866841 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f57ef950-6bc4-4806-8195-d439abbd0df9 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.049969 Jul 20 04:09:33.867444 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 126/231] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:09:33 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 20 04:09:33.883501 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d5623540-cdb7-43f9-af47-451dc0660af1 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1276 microversion: 2.1 time: 0.283567 Jul 20 04:09:33.884402 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 106/232] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:33 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1276 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:33.886086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f6ef7dc7-e1c0-489b-99bc-3996f3c85ca5 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-604275386"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:33.887656 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:33.887656 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:33.888792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.aggregate [None req-f6ef7dc7-e1c0-489b-99bc-3996f3c85ca5 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Generated uuid efb1d76d-5e2a-49b3-aba8-66f34bc44fa5 for aggregate {{(pid=127871) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:09:33.919141 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f6ef7dc7-e1c0-489b-99bc-3996f3c85ca5 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.040441 Jul 20 04:09:33.919771 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 127/233] 10.222.0.17 () {60 vars in 1163 bytes} [Wed Jul 20 04:09:33 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:33.930797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5184b9fe-23ff-4465-869b-d007450b36be tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-826526-5"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:33.932997 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:33.932997 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:33.944504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5184b9fe-23ff-4465-869b-d007450b36be tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:33.945320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5184b9fe-23ff-4465-869b-d007450b36be tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:34.103029 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5184b9fe-23ff-4465-869b-d007450b36be tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.176067 Jul 20 04:09:34.115672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-edaa9cba-bbbd-4d42-8296-8c8a7b39a7de tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-826526-5"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:34.117188 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 107/234] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 04:09:33 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:34.118031 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:34.118031 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:34.132970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edaa9cba-bbbd-4d42-8296-8c8a7b39a7de tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:34.133424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edaa9cba-bbbd-4d42-8296-8c8a7b39a7de tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:34.307836 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-edaa9cba-bbbd-4d42-8296-8c8a7b39a7de tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.195121 Jul 20 04:09:34.315013 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 128/235] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 04:09:34 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:34.323598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-253a080a-ed98-4ac4-bcd2-500d1fe248fc tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:34.324793 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:34.324793 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:34.379364 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-253a080a-ed98-4ac4-bcd2-500d1fe248fc tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.061588 Jul 20 04:09:34.403721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8f79ee7f-bbb7-4575-9b85-25e4d40e8565 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-389771360"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:34.405376 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:34.405376 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:34.406501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.aggregate [None req-8f79ee7f-bbb7-4575-9b85-25e4d40e8565 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Generated uuid 91acfc95-8775-4afc-ac23-facce19c8e2b for aggregate {{(pid=127871) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:09:34.411214 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 108/236] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:09:34 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:09:34.427847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-19d88531-4864-42fd-bf88-b8a04d716a84 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1786302115"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:34.429816 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:34.429816 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:34.430746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.aggregate [None req-19d88531-4864-42fd-bf88-b8a04d716a84 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Generated uuid a61f1688-9a9b-417d-bdb3-a8f2d8853262 for aggregate {{(pid=127870) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:09:34.473727 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8f79ee7f-bbb7-4575-9b85-25e4d40e8565 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.080720 Jul 20 04:09:34.481246 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 129/237] 10.222.0.17 () {60 vars in 1163 bytes} [Wed Jul 20 04:09:34 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:34.491946 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-26df07c9-0d98-46a5-8d3b-e4061ea7e915 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:34.494957 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:34.494957 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:34.511309 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-19d88531-4864-42fd-bf88-b8a04d716a84 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.095337 Jul 20 04:09:34.519277 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 109/238] 10.222.0.17 () {60 vars in 1163 bytes} [Wed Jul 20 04:09:34 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:34.537112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-106b698a-4512-43b2-a452-2748798ffefa tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-826526-5"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:34.541795 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:34.541795 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:34.561285 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-26df07c9-0d98-46a5-8d3b-e4061ea7e915 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.077699 Jul 20 04:09:34.565918 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 130/239] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:09:34 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:09:34.569862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-106b698a-4512-43b2-a452-2748798ffefa tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:34.570549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-106b698a-4512-43b2-a452-2748798ffefa tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:34.586327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f123560d-ddbc-4d71-a494-307afa3eccec tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:34.588648 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:34.588648 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:34.611427 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-f123560d-ddbc-4d71-a494-307afa3eccec tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f123560d-ddbc-4d71-a494-307afa3eccec tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Request method failure captured: Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_VnzbfUXgaeegSDs2SCoKf69uYmdaBAgsS-vyHGsgpcN2DCWTfckIsXR6uCFxzYr11egpCICCgs_qnm3bJPpZi9Gq_9k4hMb5iWxVpNgOgEwP0gXcoq8_r7P5tgrVXagHLkdVkF8-bY5jMjPcm_vZO95sPheqeugz8hSax0zOZeOc Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 2f79284cbc364fba87be483ba9779c36 Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AggregatesAdminTestJSON-779184344 Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:09:34.625401 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:09:34.626729 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f79284cbc364fba87be483ba9779c36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2f79284cbc364fba87be483ba9779c36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2f79284cbc364fba87be483ba9779c36", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f79284cbc364fba87be483ba9779c36"}]}] Jul 20 04:09:34.626729 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AggregatesAdminTestJSON-779184344 Jul 20 04:09:34.626729 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 2f79284cbc364fba87be483ba9779c36 Jul 20 04:09:34.626729 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-779184344 Jul 20 04:09:34.626729 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AggregatesAdminTestJSON-779184344-project-admin Jul 20 04:09:34.626729 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:34.626729 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:34.626729 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1e3d5f5b439c46bb976e2a496f755d4b Jul 20 04:09:34.626729 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AggregatesAdminTestJSON-779184344-project-admin Jul 20 04:09:34.626729 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:09:34.626729 n-d-826526-5 devstack@n-api.service[127871]: exception: Aggregate 5 could not be found. Jul 20 04:09:34.626729 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '5'} Jul 20 04:09:34.626729 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:34.627556 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:34.628876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f123560d-ddbc-4d71-a494-307afa3eccec tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:34.631966 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f123560d-ddbc-4d71-a494-307afa3eccec tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.060451 Jul 20 04:09:34.634617 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 131/240] 10.222.0.17 () {58 vars in 1148 bytes} [Wed Jul 20 04:09:34 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:09:34.666374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bd71e574-5582-492f-9da3-c2369d2085e8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:34.666995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bd71e574-5582-492f-9da3-c2369d2085e8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:34.671281 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:34.678659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd71e574-5582-492f-9da3-c2369d2085e8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:34.683247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd71e574-5582-492f-9da3-c2369d2085e8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:34.684168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd71e574-5582-492f-9da3-c2369d2085e8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:34.686463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd71e574-5582-492f-9da3-c2369d2085e8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:34.875758 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-106b698a-4512-43b2-a452-2748798ffefa tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 242 microversion: 2.1 time: 0.350830 Jul 20 04:09:34.879780 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 110/241] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 04:09:34 2022] POST /compute/v2.1/os-aggregates/6/action => generated 242 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:34.888070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1446f635-e4f0-49dd-9e60-42e6d374a83e tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:34.888790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1446f635-e4f0-49dd-9e60-42e6d374a83e tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:34.919951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1446f635-e4f0-49dd-9e60-42e6d374a83e tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:34.920452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1446f635-e4f0-49dd-9e60-42e6d374a83e tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:34.925261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1446f635-e4f0-49dd-9e60-42e6d374a83e tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:34.925720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1446f635-e4f0-49dd-9e60-42e6d374a83e tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:35.314399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bd71e574-5582-492f-9da3-c2369d2085e8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:35.324213 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bd71e574-5582-492f-9da3-c2369d2085e8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1460 microversion: 2.1 time: 0.682705 Jul 20 04:09:35.325474 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 132/242] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:34 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1460 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:35.330276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f903a181-2172-465f-8232-84f8dad66542 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:35.331176 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:35.331176 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:35.344102 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-f903a181-2172-465f-8232-84f8dad66542 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f903a181-2172-465f-8232-84f8dad66542 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Request method failure captured: Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_VnzbfUXgaeegSDs2SCoKf69uYmdaBAgsS-vyHGsgpcN2DCWTfckIsXR6uCFxzYr11egpCICCgs_qnm3bJPpZi9Gq_9k4hMb5iWxVpNgOgEwP0gXcoq8_r7P5tgrVXagHLkdVkF8-bY5jMjPcm_vZO95sPheqeugz8hSax0zOZeOc Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 2f79284cbc364fba87be483ba9779c36 Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AggregatesAdminTestJSON-779184344 Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:09:35.346356 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:09:35.347647 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f79284cbc364fba87be483ba9779c36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2f79284cbc364fba87be483ba9779c36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2f79284cbc364fba87be483ba9779c36", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f79284cbc364fba87be483ba9779c36"}]}] Jul 20 04:09:35.347647 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AggregatesAdminTestJSON-779184344 Jul 20 04:09:35.347647 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 2f79284cbc364fba87be483ba9779c36 Jul 20 04:09:35.347647 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-779184344 Jul 20 04:09:35.347647 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AggregatesAdminTestJSON-779184344-project-admin Jul 20 04:09:35.347647 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:35.347647 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:35.347647 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1e3d5f5b439c46bb976e2a496f755d4b Jul 20 04:09:35.347647 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AggregatesAdminTestJSON-779184344-project-admin Jul 20 04:09:35.347647 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:09:35.347647 n-d-826526-5 devstack@n-api.service[127871]: exception: Aggregate 5 could not be found. Jul 20 04:09:35.347647 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '5'} Jul 20 04:09:35.347647 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:09:35.348996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:35.350028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:35.351127 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:35.351127 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:35.351127 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:35.351127 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 20 04:09:35.351127 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:35.351127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f903a181-2172-465f-8232-84f8dad66542 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:35.352318 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f903a181-2172-465f-8232-84f8dad66542 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.025576 Jul 20 04:09:35.359352 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 133/243] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:09:35 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:09:35.370180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a76c1271-81cd-4744-8134-235b93b3f51e tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-826526-5"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:35.376317 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:35.376317 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:35.390267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a76c1271-81cd-4744-8134-235b93b3f51e tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:35.392308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a76c1271-81cd-4744-8134-235b93b3f51e tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:35.427722 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-a76c1271-81cd-4744-8134-235b93b3f51e tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] HTTP exception thrown: Aggregate 6 already has host n-h2-826526-5. Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a76c1271-81cd-4744-8134-235b93b3f51e tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Request method failure captured: Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 39 Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_X5G-5s-KoDLf3N0ztZj4CnkLGms0TJ5ZhNskP4232s1V14zBsydxcSkjPaa_9T_0rZy7HVZSGj3rU8scEyiu8lRGR9c5DhEMSCJH7AB9oEI-iecDzI2eGjNhgrSgv86oMU3IzNSeXR-xYs0UEXez4dlXXDK5v6LSVY4sUXxanFqY Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 107e173468da4271942b3c3e5563ab10 Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:09:35.447314 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:09:35.449000 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/107e173468da4271942b3c3e5563ab10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/107e173468da4271942b3c3e5563ab10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_107e173468da4271942b3c3e5563ab10", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/107e173468da4271942b3c3e5563ab10"}]}] Jul 20 04:09:35.449000 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:35.449000 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 107e173468da4271942b3c3e5563ab10 Jul 20 04:09:35.449000 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:35.449000 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin Jul 20 04:09:35.449000 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:35.449000 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:35.449000 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f5d91332649249aead77dd00375795ff Jul 20 04:09:35.449000 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin Jul 20 04:09:35.449000 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:09:35.449000 n-d-826526-5 devstack@n-api.service[127871]: {"add_host": {"host": "n-h2-826526-5"}} Jul 20 04:09:35.449000 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:09:35.449000 n-d-826526-5 devstack@n-api.service[127871]: exception: Aggregate 6 already has host n-h2-826526-5. Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h2-826526-5'}}} Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:09:35.449702 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-826526-5-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi session.flush() Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 04:09:35.450721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 20 04:09:35.451697 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:09:35.451697 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:09:35.451697 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 04:09:35.451697 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 20 04:09:35.451697 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 04:09:35.451697 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 20 04:09:35.451697 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 04:09:35.451697 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 20 04:09:35.451697 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 04:09:35.451697 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 20 04:09:35.451697 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 04:09:35.451697 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 20 04:09:35.451697 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 04:09:35.451697 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 04:09:35.451697 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 04:09:35.451697 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 20 04:09:35.451697 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 04:09:35.451697 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 20 04:09:35.452668 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 04:09:35.452668 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 20 04:09:35.452668 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 04:09:35.452668 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 04:09:35.452668 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:09:35.452668 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:09:35.452668 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:09:35.452668 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:09:35.452668 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:09:35.452668 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:09:35.452668 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:09:35.452668 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:09:35.452668 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:09:35.452668 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:09:35.452668 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:09:35.452668 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:09:35.452668 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:09:35.452668 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:09:35.453569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:09:35.453569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:09:35.453569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:09:35.453569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:09:35.453569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:09:35.453569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:09:35.453569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:09:35.453569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:09:35.453569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-826526-5-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 20 04:09:35.453569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 20 04:09:35.453569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 20, 4, 9, 35, 417822), 'updated_at': None, 'host': 'n-h2-826526-5', 'aggregate_id': 6}] Jul 20 04:09:35.453569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 04:09:35.453569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:35.453569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:35.453569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:35.453569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:35.453569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host n-h2-826526-5. Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:35.454431 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host n-h2-826526-5. Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:35.455471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:35.459062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host n-h2-826526-5. Jul 20 04:09:35.459062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:35.460347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a76c1271-81cd-4744-8134-235b93b3f51e tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Returning 409 to user: Aggregate 6 already has host n-h2-826526-5. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:35.462031 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a76c1271-81cd-4744-8134-235b93b3f51e tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 95 microversion: 2.1 time: 0.107746 Jul 20 04:09:35.463021 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 134/244] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 04:09:35 2022] POST /compute/v2.1/os-aggregates/6/action => generated 95 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 20 04:09:35.468981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-08b5a386-3c71-4c0a-aadd-5ceab3bce665 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:35.474928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-08b5a386-3c71-4c0a-aadd-5ceab3bce665 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:35.483551 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08b5a386-3c71-4c0a-aadd-5ceab3bce665 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:35.484151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08b5a386-3c71-4c0a-aadd-5ceab3bce665 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:35.485198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08b5a386-3c71-4c0a-aadd-5ceab3bce665 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:35.485795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08b5a386-3c71-4c0a-aadd-5ceab3bce665 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:35.583108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1446f635-e4f0-49dd-9e60-42e6d374a83e tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:35.595344 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1446f635-e4f0-49dd-9e60-42e6d374a83e tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1278 microversion: 2.1 time: 0.714363 Jul 20 04:09:35.605582 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 111/245] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:34 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1278 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:35.648491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-08b5a386-3c71-4c0a-aadd-5ceab3bce665 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:35.659593 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-08b5a386-3c71-4c0a-aadd-5ceab3bce665 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1276 microversion: 2.1 time: 0.195230 Jul 20 04:09:35.661489 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 135/246] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:35 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:35.673484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-46076d56-f916-49dc-95ba-ab26ab9b8dba tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-123579958", "name": "tempest-test_aggregate-1023885082"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:35.717765 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:35.717765 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:35.718936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.aggregate [None req-46076d56-f916-49dc-95ba-ab26ab9b8dba tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Generated uuid aa8a994b-a022-47e1-b696-9e2be0efa308 for aggregate {{(pid=127871) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:09:35.725414 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=8,nova_api:DELETE=10 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:35.793725 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-46076d56-f916-49dc-95ba-ab26ab9b8dba tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.129368 Jul 20 04:09:35.801857 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 136/247] 10.222.0.17 () {60 vars in 1164 bytes} [Wed Jul 20 04:09:35 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:35.808069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-eb118e52-6547-4249-9a75-3cc97c43d3bd tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-826526-5"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:35.812956 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:35.812956 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:35.833933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb118e52-6547-4249-9a75-3cc97c43d3bd tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:35.834429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb118e52-6547-4249-9a75-3cc97c43d3bd tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:35.860696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d91dce2b-e46f-4bb9-ba91-72fb4a9d4aca tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:35.861312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d91dce2b-e46f-4bb9-ba91-72fb4a9d4aca tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:35.875572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d91dce2b-e46f-4bb9-ba91-72fb4a9d4aca tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:35.876020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d91dce2b-e46f-4bb9-ba91-72fb4a9d4aca tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:35.876952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d91dce2b-e46f-4bb9-ba91-72fb4a9d4aca tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:35.877403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d91dce2b-e46f-4bb9-ba91-72fb4a9d4aca tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:35.984880 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-eb118e52-6547-4249-9a75-3cc97c43d3bd tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 227 microversion: 2.1 time: 0.181724 Jul 20 04:09:35.985981 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 137/248] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 04:09:35 2022] POST /compute/v2.1/os-aggregates/6/action => generated 227 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:35.992722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-02a28139-62ae-43ce-8fbd-981e7cb3b275 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:35.994128 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:35.994128 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:36.030984 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-02a28139-62ae-43ce-8fbd-981e7cb3b275 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.043122 Jul 20 04:09:36.032137 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 138/249] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:09:35 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:09:36.037951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1c3730ee-6a64-410e-bb8a-a7ff26eb0f48 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:36.039097 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:36.039097 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:36.067586 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1c3730ee-6a64-410e-bb8a-a7ff26eb0f48 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.033772 Jul 20 04:09:36.068792 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 139/250] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:09:36 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:09:36.076001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ee2bc9e2-af0a-4947-b55d-ed3d9f1f36e9 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:36.077081 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:36.077081 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:36.086017 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-ee2bc9e2-af0a-4947-b55d-ed3d9f1f36e9 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ee2bc9e2-af0a-4947-b55d-ed3d9f1f36e9 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Request method failure captured: Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_VnzbfUXgaeegSDs2SCoKf69uYmdaBAgsS-vyHGsgpcN2DCWTfckIsXR6uCFxzYr11egpCICCgs_qnm3bJPpZi9Gq_9k4hMb5iWxVpNgOgEwP0gXcoq8_r7P5tgrVXagHLkdVkF8-bY5jMjPcm_vZO95sPheqeugz8hSax0zOZeOc Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 2f79284cbc364fba87be483ba9779c36 Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AggregatesAdminTestJSON-779184344 Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:09:36.089479 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:09:36.090844 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f79284cbc364fba87be483ba9779c36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2f79284cbc364fba87be483ba9779c36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2f79284cbc364fba87be483ba9779c36", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f79284cbc364fba87be483ba9779c36"}]}] Jul 20 04:09:36.090844 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AggregatesAdminTestJSON-779184344 Jul 20 04:09:36.090844 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 2f79284cbc364fba87be483ba9779c36 Jul 20 04:09:36.090844 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-779184344 Jul 20 04:09:36.090844 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AggregatesAdminTestJSON-779184344-project-admin Jul 20 04:09:36.090844 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:36.090844 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:36.090844 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1e3d5f5b439c46bb976e2a496f755d4b Jul 20 04:09:36.090844 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AggregatesAdminTestJSON-779184344-project-admin Jul 20 04:09:36.090844 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:09:36.090844 n-d-826526-5 devstack@n-api.service[127871]: exception: Aggregate 7 could not be found. Jul 20 04:09:36.090844 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '7'} Jul 20 04:09:36.090844 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:36.091848 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:36.093019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ee2bc9e2-af0a-4947-b55d-ed3d9f1f36e9 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:36.094032 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ee2bc9e2-af0a-4947-b55d-ed3d9f1f36e9 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.020440 Jul 20 04:09:36.094032 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 140/251] 10.222.0.17 () {58 vars in 1148 bytes} [Wed Jul 20 04:09:36 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:09:36.101773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7b5171b7-b4cb-4b22-95ae-21426f4fea79 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1166197769"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:36.103677 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:36.103677 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:36.104724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.aggregate [None req-7b5171b7-b4cb-4b22-95ae-21426f4fea79 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Generated uuid 23fadbaa-65ad-42c7-9af9-06f9c4766084 for aggregate {{(pid=127871) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:09:36.141848 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7b5171b7-b4cb-4b22-95ae-21426f4fea79 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048712 Jul 20 04:09:36.142626 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 141/252] 10.222.0.17 () {60 vars in 1163 bytes} [Wed Jul 20 04:09:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:36.150136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6dbca1dc-1221-4f5e-92e8-b66447eef905 tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1739994157"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:36.151774 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:36.151774 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:36.153373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.aggregate [None req-6dbca1dc-1221-4f5e-92e8-b66447eef905 tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Generated uuid d4d56597-1599-4905-b76c-f4cd3a938b89 for aggregate {{(pid=127871) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:09:36.181316 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6dbca1dc-1221-4f5e-92e8-b66447eef905 tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.037389 Jul 20 04:09:36.182008 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 142/253] 10.222.0.17 () {62 vars in 1204 bytes} [Wed Jul 20 04:09:36 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:09:36.196157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-75de73c3-dc86-4176-8f1e-3b4049c36b27 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:36.196938 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:36.196938 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:36.210004 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-75de73c3-dc86-4176-8f1e-3b4049c36b27 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-75de73c3-dc86-4176-8f1e-3b4049c36b27 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Request method failure captured: Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_VnzbfUXgaeegSDs2SCoKf69uYmdaBAgsS-vyHGsgpcN2DCWTfckIsXR6uCFxzYr11egpCICCgs_qnm3bJPpZi9Gq_9k4hMb5iWxVpNgOgEwP0gXcoq8_r7P5tgrVXagHLkdVkF8-bY5jMjPcm_vZO95sPheqeugz8hSax0zOZeOc Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 2f79284cbc364fba87be483ba9779c36 Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AggregatesAdminTestJSON-779184344 Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:09:36.212794 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:09:36.214173 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f79284cbc364fba87be483ba9779c36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2f79284cbc364fba87be483ba9779c36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2f79284cbc364fba87be483ba9779c36", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f79284cbc364fba87be483ba9779c36"}]}] Jul 20 04:09:36.214173 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AggregatesAdminTestJSON-779184344 Jul 20 04:09:36.214173 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 2f79284cbc364fba87be483ba9779c36 Jul 20 04:09:36.214173 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-779184344 Jul 20 04:09:36.214173 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AggregatesAdminTestJSON-779184344-project-admin Jul 20 04:09:36.214173 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:36.214173 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:36.214173 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1e3d5f5b439c46bb976e2a496f755d4b Jul 20 04:09:36.214173 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AggregatesAdminTestJSON-779184344-project-admin Jul 20 04:09:36.214173 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:09:36.214173 n-d-826526-5 devstack@n-api.service[127871]: exception: Aggregate 7 could not be found. Jul 20 04:09:36.214173 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '7'} Jul 20 04:09:36.214173 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:09:36.214947 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:36.216014 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:36.217120 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:36.217120 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:36.217120 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:36.217120 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jul 20 04:09:36.217120 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:36.217120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-75de73c3-dc86-4176-8f1e-3b4049c36b27 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:36.217120 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-75de73c3-dc86-4176-8f1e-3b4049c36b27 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.021750 Jul 20 04:09:36.217120 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 143/254] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:09:36 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:09:36.366734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-431cc8cc-3bf4-49a0-951c-7aad98c13287 tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-826526-5"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:36.370420 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:36.370420 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:36.374133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-431cc8cc-3bf4-49a0-951c-7aad98c13287 tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'c488cb1e830d4d4884f7c8b726c15ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f106cc599f4c098b10a6ac7e7bc0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-431cc8cc-3bf4-49a0-951c-7aad98c13287 tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Request method failure captured: Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/os-aggregates/8/action HTTP/1.1 Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 39 Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_V-YEMFcG6cmxoW-5-0DyMAf53Pt6yeUux8KkjvRnuJM0ywOQBGPYX2QfmpRbIoqRyAFooa5QPuR2o5JalXKemPAc8r1CWnAnqybB1D7CqzKkuEidgYBKUiw1Ejdxb_5vXywMeb7iG1CFcA7-OWFnke2pHS6WFqbzyL6SI0khsvcY Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 33f106cc599f4c098b10a6ac7e7bc0b8 Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1020034161 Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:09:36.378140 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:09:36.379532 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33f106cc599f4c098b10a6ac7e7bc0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33f106cc599f4c098b10a6ac7e7bc0b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33f106cc599f4c098b10a6ac7e7bc0b8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33f106cc599f4c098b10a6ac7e7bc0b8"}]}] Jul 20 04:09:36.379532 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1020034161 Jul 20 04:09:36.379532 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 33f106cc599f4c098b10a6ac7e7bc0b8 Jul 20 04:09:36.379532 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1020034161 Jul 20 04:09:36.379532 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AggregatesAdminNegativeTestJSON-1020034161-project Jul 20 04:09:36.379532 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:36.379532 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:36.379532 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c488cb1e830d4d4884f7c8b726c15ba7 Jul 20 04:09:36.379532 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1020034161-project Jul 20 04:09:36.379532 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:09:36.379532 n-d-826526-5 devstack@n-api.service[127871]: {"add_host": {"host": "n-h2-826526-5"}} Jul 20 04:09:36.379532 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:09:36.379532 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '8', 'body': {'add_host': {'host': 'n-h2-826526-5'}}} Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:36.380549 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 20 04:09:36.381744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:36.385821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-431cc8cc-3bf4-49a0-951c-7aad98c13287 tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:36.389523 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-431cc8cc-3bf4-49a0-951c-7aad98c13287 tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] 10.222.0.17 "POST /compute/v2.1/os-aggregates/8/action" status: 403 len: 118 microversion: 2.1 time: 0.173918 Jul 20 04:09:36.390290 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 144/255] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 04:09:36 2022] POST /compute/v2.1/os-aggregates/8/action => generated 118 bytes in 175 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:36.404236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a340b428-83dc-416d-97e3-c3e477be35be tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-330369879"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:36.565579 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:36.565579 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:36.608601 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a340b428-83dc-416d-97e3-c3e477be35be tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 298 microversion: 2.41 time: 0.211090 Jul 20 04:09:36.610574 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 145/256] 10.222.0.17 () {62 vars in 1209 bytes} [Wed Jul 20 04:09:36 2022] PUT /compute/v2.1/os-aggregates/9 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:09:36.616650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b63cc93b-87fa-4591-a8b0-fbedd1202aae tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1268078729"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:36.618985 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:36.618985 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:36.620942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.aggregate [None req-b63cc93b-87fa-4591-a8b0-fbedd1202aae tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Generated uuid c2da7b32-4f78-4212-b06c-7fe778400d00 for aggregate {{(pid=127871) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:09:36.649132 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b63cc93b-87fa-4591-a8b0-fbedd1202aae tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.037171 Jul 20 04:09:36.655418 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 146/257] 10.222.0.17 () {60 vars in 1163 bytes} [Wed Jul 20 04:09:36 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:36.660130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2d71ac2e-3fd4-40e7-a723-99413fe1bff6 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:36.670052 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d91dce2b-e46f-4bb9-ba91-72fb4a9d4aca tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1611 microversion: 2.1 time: 1.072189 Jul 20 04:09:36.672159 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:36.672159 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:36.675430 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 112/258] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:35 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1611 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:36.690019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4e5370e0-0d6f-4218-bc81-d08d3217c4a7 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:36.690633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4e5370e0-0d6f-4218-bc81-d08d3217c4a7 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:36.713791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e5370e0-0d6f-4218-bc81-d08d3217c4a7 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:36.715045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e5370e0-0d6f-4218-bc81-d08d3217c4a7 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:36.716083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e5370e0-0d6f-4218-bc81-d08d3217c4a7 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:36.716755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e5370e0-0d6f-4218-bc81-d08d3217c4a7 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:36.735373 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2d71ac2e-3fd4-40e7-a723-99413fe1bff6 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.078759 Jul 20 04:09:36.735964 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 147/259] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:09:36 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:09:36.760004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8832229e-4331-48fd-9693-fa6ff15fa025 tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:36.761221 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:36.761221 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:36.784103 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8832229e-4331-48fd-9693-fa6ff15fa025 tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 298 microversion: 2.41 time: 0.036495 Jul 20 04:09:36.787516 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 148/260] 10.222.0.17 () {60 vars in 1189 bytes} [Wed Jul 20 04:09:36 2022] GET /compute/v2.1/os-aggregates/9 => generated 298 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:09:36.798003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-458afdbd-54a4-457a-ac4c-99452b74fbf2 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:36.800847 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:36.800847 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:36.822273 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-458afdbd-54a4-457a-ac4c-99452b74fbf2 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 228 microversion: 2.1 time: 0.032570 Jul 20 04:09:36.823202 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 149/261] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:09:36 2022] GET /compute/v2.1/os-aggregates/10 => generated 228 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:36.832191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-669c10be-9bf8-4b7b-b63b-a8489073fdd2 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:36.834072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-669c10be-9bf8-4b7b-b63b-a8489073fdd2 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:36.840061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-669c10be-9bf8-4b7b-b63b-a8489073fdd2 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:36.840612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-669c10be-9bf8-4b7b-b63b-a8489073fdd2 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:36.841393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-669c10be-9bf8-4b7b-b63b-a8489073fdd2 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:36.841961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-669c10be-9bf8-4b7b-b63b-a8489073fdd2 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:37.009764 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4e5370e0-0d6f-4218-bc81-d08d3217c4a7 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:37.017736 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4e5370e0-0d6f-4218-bc81-d08d3217c4a7 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1278 microversion: 2.1 time: 0.341049 Jul 20 04:09:37.021144 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 113/262] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:36 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1278 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:37.028381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-099800cf-a81c-4767-95e4-1b5d6cd78288 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:37.029513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-099800cf-a81c-4767-95e4-1b5d6cd78288 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:37.038112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-099800cf-a81c-4767-95e4-1b5d6cd78288 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:37.038563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-099800cf-a81c-4767-95e4-1b5d6cd78288 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:37.039341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-099800cf-a81c-4767-95e4-1b5d6cd78288 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:37.039777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-099800cf-a81c-4767-95e4-1b5d6cd78288 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:37.184482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-669c10be-9bf8-4b7b-b63b-a8489073fdd2 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:37.190710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:37.195580 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-669c10be-9bf8-4b7b-b63b-a8489073fdd2 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1318 microversion: 2.1 time: 0.371323 Jul 20 04:09:37.208083 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 150/263] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:36 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:37.213226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c8100468-fc5f-4269-beb1-8c71e7955bf2 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1171202334"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:37.221581 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:37.221581 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:37.225426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.aggregate [None req-c8100468-fc5f-4269-beb1-8c71e7955bf2 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Generated uuid ec80561f-b0c6-4240-9df3-deaa78cbd112 for aggregate {{(pid=127871) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:09:37.282606 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c8100468-fc5f-4269-beb1-8c71e7955bf2 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.072078 Jul 20 04:09:37.283267 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 151/264] 10.222.0.17 () {60 vars in 1163 bytes} [Wed Jul 20 04:09:37 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:37.296613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d4c1e953-945d-42c1-a4de-912d56d58741 tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-826526-5"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:37.299467 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:37.299467 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:37.311272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4c1e953-945d-42c1-a4de-912d56d58741 tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:37.311780 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4c1e953-945d-42c1-a4de-912d56d58741 tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:37.476375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-099800cf-a81c-4767-95e4-1b5d6cd78288 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '28c19f2964444c4783b18ae6023226d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f352c241604ee79fc6830c89403173', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:37.477003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-099800cf-a81c-4767-95e4-1b5d6cd78288 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] flavor_id is None. Assuming migration. {{(pid=127870) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 04:09:37.477502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-099800cf-a81c-4767-95e4-1b5d6cd78288 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127870) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:09:37.540160 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d4c1e953-945d-42c1-a4de-912d56d58741 tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 313 microversion: 2.41 time: 0.248358 Jul 20 04:09:37.548664 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 152/265] 10.222.0.17 () {62 vars in 1231 bytes} [Wed Jul 20 04:09:37 2022] POST /compute/v2.1/os-aggregates/9/action => generated 313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:09:37.554688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-76ba1f5c-3d05-497c-b663-2f2d9f8245ca tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:37.556606 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:37.556606 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:37.607975 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-76ba1f5c-3d05-497c-b663-2f2d9f8245ca tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 266 microversion: 2.1 time: 0.052907 Jul 20 04:09:37.616074 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 153/266] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 04:09:37 2022] POST /compute/v2.1/os-aggregates/10/action => generated 266 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:37.636440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c4175caa-f74a-41f3-8c1a-f581e26acb84 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-228581855"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:37.638961 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:37.638961 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:37.660775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4175caa-f74a-41f3-8c1a-f581e26acb84 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:37.662342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4175caa-f74a-41f3-8c1a-f581e26acb84 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:37.678030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4175caa-f74a-41f3-8c1a-f581e26acb84 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:37.678477 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4175caa-f74a-41f3-8c1a-f581e26acb84 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:37.704564 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-c4175caa-f74a-41f3-8c1a-f581e26acb84 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-228581855 could not be found. Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c4175caa-f74a-41f3-8c1a-f581e26acb84 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Request method failure captured: Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 57 Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_X5G-5s-KoDLf3N0ztZj4CnkLGms0TJ5ZhNskP4232s1V14zBsydxcSkjPaa_9T_0rZy7HVZSGj3rU8scEyiu8lRGR9c5DhEMSCJH7AB9oEI-iecDzI2eGjNhgrSgv86oMU3IzNSeXR-xYs0UEXez4dlXXDK5v6LSVY4sUXxanFqY Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 107e173468da4271942b3c3e5563ab10 Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:09:37.707362 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:09:37.708670 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/107e173468da4271942b3c3e5563ab10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/107e173468da4271942b3c3e5563ab10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_107e173468da4271942b3c3e5563ab10", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/107e173468da4271942b3c3e5563ab10"}]}] Jul 20 04:09:37.708670 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:37.708670 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 107e173468da4271942b3c3e5563ab10 Jul 20 04:09:37.708670 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:37.708670 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin Jul 20 04:09:37.708670 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:37.708670 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:37.708670 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f5d91332649249aead77dd00375795ff Jul 20 04:09:37.708670 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin Jul 20 04:09:37.708670 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:09:37.708670 n-d-826526-5 devstack@n-api.service[127871]: {"add_host": {"host": "tempest-nonexist_host-228581855"}} Jul 20 04:09:37.708670 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:09:37.708670 n-d-826526-5 devstack@n-api.service[127871]: exception: Compute host tempest-nonexist_host-228581855 could not be found. Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-228581855'}}} Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-228581855' is not mapped to any cell Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:37.709867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 20 04:09:37.711028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-228581855 could not be found. Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-228581855 could not be found. Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:37.713113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:37.714404 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:37.714404 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:37.714404 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:37.714404 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:37.714404 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:37.714404 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-228581855 could not be found. Jul 20 04:09:37.714404 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:37.717386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c4175caa-f74a-41f3-8c1a-f581e26acb84 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-228581855 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:37.718611 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c4175caa-f74a-41f3-8c1a-f581e26acb84 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.101253 Jul 20 04:09:37.719736 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 154/267] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 04:09:37 2022] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:37.726851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2e25e12c-73b6-4e77-801f-2054ee4222bf tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-826526-5"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:37.728565 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:37.728565 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:37.743094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e25e12c-73b6-4e77-801f-2054ee4222bf tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:37.747653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e25e12c-73b6-4e77-801f-2054ee4222bf tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:37.976968 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2e25e12c-73b6-4e77-801f-2054ee4222bf tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 298 microversion: 2.41 time: 0.251518 Jul 20 04:09:37.978004 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 155/268] 10.222.0.17 () {62 vars in 1231 bytes} [Wed Jul 20 04:09:37 2022] POST /compute/v2.1/os-aggregates/9/action => generated 298 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:09:38.000328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5f9c2123-4c8b-4a85-afbe-6667724e7d28 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:38.001972 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:38.001972 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:38.027090 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5f9c2123-4c8b-4a85-afbe-6667724e7d28 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 242 microversion: 2.1 time: 0.032516 Jul 20 04:09:38.029202 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 156/269] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:09:37 2022] GET /compute/v2.1/os-aggregates/10 => generated 242 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:38.044798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f1ef9bb8-bb3d-449c-8728-7d2288ae9c31 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:38.045581 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:38.045581 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:38.087967 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f1ef9bb8-bb3d-449c-8728-7d2288ae9c31 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.047716 Jul 20 04:09:38.088891 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 157/270] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jul 20 04:09:38 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:09:38.098899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3577f2f8-93ac-47de-8348-8483b32e7638 tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:38.101600 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:38.101600 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:38.124847 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-099800cf-a81c-4767-95e4-1b5d6cd78288 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221/action" status: 202 len: 0 microversion: 2.1 time: 1.102235 Jul 20 04:09:38.126944 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 114/271] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:09:37 2022] POST /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221/action => generated 0 bytes in 1105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:09:38.137021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fc4f3d9a-e829-46c7-98cc-17563d61cdb3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:38.137843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fc4f3d9a-e829-46c7-98cc-17563d61cdb3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:38.151652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc4f3d9a-e829-46c7-98cc-17563d61cdb3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:38.151652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc4f3d9a-e829-46c7-98cc-17563d61cdb3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:38.152705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc4f3d9a-e829-46c7-98cc-17563d61cdb3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:38.154117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=8,nova_api:DELETE=12,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:38.154626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc4f3d9a-e829-46c7-98cc-17563d61cdb3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:38.171365 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3577f2f8-93ac-47de-8348-8483b32e7638 tempest-AggregatesAdminTestV241-1475791656 tempest-AggregatesAdminTestV241-1475791656-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.41 time: 0.081270 Jul 20 04:09:38.172099 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 158/272] 10.222.0.17 () {60 vars in 1192 bytes} [Wed Jul 20 04:09:38 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:38.183501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c356b206-20e1-425b-9f68-f94285fdfe42 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:38.184419 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:38.184419 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:38.229807 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c356b206-20e1-425b-9f68-f94285fdfe42 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.055999 Jul 20 04:09:38.236119 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 159/273] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jul 20 04:09:38 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:09:38.247406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-95d52685-b265-4503-ac70-484e07e6e208 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-95d52685-b265-4503-ac70-484e07e6e208 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Request method failure captured: Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 283 Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_X5G-5s-KoDLf3N0ztZj4CnkLGms0TJ5ZhNskP4232s1V14zBsydxcSkjPaa_9T_0rZy7HVZSGj3rU8scEyiu8lRGR9c5DhEMSCJH7AB9oEI-iecDzI2eGjNhgrSgv86oMU3IzNSeXR-xYs0UEXez4dlXXDK5v6LSVY4sUXxanFqY Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 107e173468da4271942b3c3e5563ab10 Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:09:38.254190 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:09:38.255881 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/107e173468da4271942b3c3e5563ab10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/107e173468da4271942b3c3e5563ab10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_107e173468da4271942b3c3e5563ab10", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/107e173468da4271942b3c3e5563ab10"}]}] Jul 20 04:09:38.255881 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:38.255881 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 107e173468da4271942b3c3e5563ab10 Jul 20 04:09:38.255881 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:38.255881 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin Jul 20 04:09:38.255881 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:38.255881 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:38.255881 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f5d91332649249aead77dd00375795ff Jul 20 04:09:38.255881 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin Jul 20 04:09:38.255881 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:09:38.255881 n-d-826526-5 devstack@n-api.service[127871]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 20 04:09:38.256629 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:09:38.256629 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:09:38.256629 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 20 04:09:38.256629 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:38.256629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:38.256629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:09:38.256629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:09:38.256629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:09:38.256629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:09:38.256629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:09:38.256629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:09:38.257651 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:09:38.258808 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:09:38.258808 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:09:38.258808 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:09:38.258808 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:09:38.258808 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:09:38.258808 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:38.258808 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:38.258808 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:38.258808 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:38.258808 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:38.258808 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:38.258808 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:09:38.258808 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:09:38.259635 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:09:38.259635 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:38.259635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-95d52685-b265-4503-ac70-484e07e6e208 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:38.259635 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-95d52685-b265-4503-ac70-484e07e6e208 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.021006 Jul 20 04:09:38.261501 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 160/274] 10.222.0.17 () {60 vars in 1164 bytes} [Wed Jul 20 04:09:38 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:09:38.268093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-45d1c95d-51cd-40cd-9ddb-b4268a46ff7f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:38.268872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-45d1c95d-51cd-40cd-9ddb-b4268a46ff7f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:38.277182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-45d1c95d-51cd-40cd-9ddb-b4268a46ff7f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:38.277764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-45d1c95d-51cd-40cd-9ddb-b4268a46ff7f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:38.278662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-45d1c95d-51cd-40cd-9ddb-b4268a46ff7f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:38.279170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-45d1c95d-51cd-40cd-9ddb-b4268a46ff7f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:38.874292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-45d1c95d-51cd-40cd-9ddb-b4268a46ff7f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:38.894765 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-45d1c95d-51cd-40cd-9ddb-b4268a46ff7f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1469 microversion: 2.1 time: 0.631725 Jul 20 04:09:38.895354 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 161/275] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:38 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1469 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:38.907546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6efc8b77-2d53-42b3-8821-2614e2558e3b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:38.911185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6efc8b77-2d53-42b3-8821-2614e2558e3b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:38.933497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6efc8b77-2d53-42b3-8821-2614e2558e3b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:38.933955 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6efc8b77-2d53-42b3-8821-2614e2558e3b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:38.934737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6efc8b77-2d53-42b3-8821-2614e2558e3b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:38.935172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6efc8b77-2d53-42b3-8821-2614e2558e3b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:39.225466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fc4f3d9a-e829-46c7-98cc-17563d61cdb3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:39.241828 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fc4f3d9a-e829-46c7-98cc-17563d61cdb3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1320 microversion: 2.1 time: 1.111842 Jul 20 04:09:39.244202 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 115/276] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:38 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1320 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:39.256007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9130ada4-b621-4269-b9da-671574c964d4 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-541362700", "availability_zone": "tempest-test_az-1047275057"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:39.262777 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:39.262777 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:39.266971 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.aggregate [None req-9130ada4-b621-4269-b9da-671574c964d4 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Generated uuid f508fdec-5b1e-4fb7-affc-31098ff20e7e for aggregate {{(pid=127870) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:09:39.325269 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9130ada4-b621-4269-b9da-671574c964d4 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.079222 Jul 20 04:09:39.326460 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 116/277] 10.222.0.17 () {60 vars in 1164 bytes} [Wed Jul 20 04:09:39 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:39.337329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-21649e9b-d3dc-4b70-9e9a-1e4246ea803f tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-21649e9b-d3dc-4b70-9e9a-1e4246ea803f tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Request method failure captured: Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 27 Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_X5G-5s-KoDLf3N0ztZj4CnkLGms0TJ5ZhNskP4232s1V14zBsydxcSkjPaa_9T_0rZy7HVZSGj3rU8scEyiu8lRGR9c5DhEMSCJH7AB9oEI-iecDzI2eGjNhgrSgv86oMU3IzNSeXR-xYs0UEXez4dlXXDK5v6LSVY4sUXxanFqY Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 107e173468da4271942b3c3e5563ab10 Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member,admin Jul 20 04:09:39.358123 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member,admin Jul 20 04:09:39.359617 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/107e173468da4271942b3c3e5563ab10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/107e173468da4271942b3c3e5563ab10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_107e173468da4271942b3c3e5563ab10", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/107e173468da4271942b3c3e5563ab10"}]}] Jul 20 04:09:39.359617 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:39.359617 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 107e173468da4271942b3c3e5563ab10 Jul 20 04:09:39.359617 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:39.359617 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin Jul 20 04:09:39.359617 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:09:39.359617 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:09:39.359617 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f5d91332649249aead77dd00375795ff Jul 20 04:09:39.359617 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin Jul 20 04:09:39.359617 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:09:39.359617 n-d-826526-5 devstack@n-api.service[127870]: {"aggregate": {"name": ""}} Jul 20 04:09:39.359617 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:09:39.359617 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi '' Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:39.360512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:09:39.362022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.366801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-21649e9b-d3dc-4b70-9e9a-1e4246ea803f tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:39.369462 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-21649e9b-d3dc-4b70-9e9a-1e4246ea803f tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.038084 Jul 20 04:09:39.377015 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 117/278] 10.222.0.17 () {60 vars in 1163 bytes} [Wed Jul 20 04:09:39 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:09:39.384843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9c6694a3-d76a-49be-b71f-ca8825240ef3 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-541362700_new", "availability_zone": "tempest-test_az-1047275057_new"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:39.440966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6efc8b77-2d53-42b3-8821-2614e2558e3b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:39.452448 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6efc8b77-2d53-42b3-8821-2614e2558e3b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1318 microversion: 2.1 time: 0.555633 Jul 20 04:09:39.455779 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 162/279] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:38 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1318 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:39.471687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b014cb3b-c3f5-4a56-8efc-74d05124aae6 tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-983817248"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:39.475771 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:39.475771 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:39.478640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b014cb3b-c3f5-4a56-8efc-74d05124aae6 tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'c488cb1e830d4d4884f7c8b726c15ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f106cc599f4c098b10a6ac7e7bc0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b014cb3b-c3f5-4a56-8efc-74d05124aae6 tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Request method failure captured: Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 59 Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_V-YEMFcG6cmxoW-5-0DyMAf53Pt6yeUux8KkjvRnuJM0ywOQBGPYX2QfmpRbIoqRyAFooa5QPuR2o5JalXKemPAc8r1CWnAnqybB1D7CqzKkuEidgYBKUiw1Ejdxb_5vXywMeb7iG1CFcA7-OWFnke2pHS6WFqbzyL6SI0khsvcY Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 33f106cc599f4c098b10a6ac7e7bc0b8 Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1020034161 Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:09:39.485616 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:09:39.487129 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33f106cc599f4c098b10a6ac7e7bc0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33f106cc599f4c098b10a6ac7e7bc0b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33f106cc599f4c098b10a6ac7e7bc0b8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33f106cc599f4c098b10a6ac7e7bc0b8"}]}] Jul 20 04:09:39.487129 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1020034161 Jul 20 04:09:39.487129 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 33f106cc599f4c098b10a6ac7e7bc0b8 Jul 20 04:09:39.487129 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1020034161 Jul 20 04:09:39.487129 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AggregatesAdminNegativeTestJSON-1020034161-project Jul 20 04:09:39.487129 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:39.487129 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:39.487129 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c488cb1e830d4d4884f7c8b726c15ba7 Jul 20 04:09:39.487129 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1020034161-project Jul 20 04:09:39.487129 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:09:39.487129 n-d-826526-5 devstack@n-api.service[127871]: {"aggregate": {"name": "tempest-test_aggregate-983817248"}} Jul 20 04:09:39.487129 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:09:39.487129 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-983817248'}}} Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:39.487827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:39.488959 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 20 04:09:39.490265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.490265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b014cb3b-c3f5-4a56-8efc-74d05124aae6 tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:39.490265 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b014cb3b-c3f5-4a56-8efc-74d05124aae6 tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.031629 Jul 20 04:09:39.495042 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 163/280] 10.222.0.17 () {60 vars in 1163 bytes} [Wed Jul 20 04:09:39 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:39.510245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e4bdd6b7-6ff2-4ecd-a06a-bca9a543366e tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-389432522"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:39.512531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.aggregate [None req-e4bdd6b7-6ff2-4ecd-a06a-bca9a543366e tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Generated uuid cc9ec31c-970a-4290-9a8b-7235063653e6 for aggregate {{(pid=127871) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:09:39.564542 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e4bdd6b7-6ff2-4ecd-a06a-bca9a543366e tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068301 Jul 20 04:09:39.568686 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 164/281] 10.222.0.17 () {60 vars in 1163 bytes} [Wed Jul 20 04:09:39 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:39.581443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ed720481-3c3a-4a0f-923b-cb53890df694 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-389432522"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:39.588134 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:39.588134 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:39.589665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.aggregate [None req-ed720481-3c3a-4a0f-923b-cb53890df694 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Generated uuid c56851cc-fa74-435d-924a-2b5dc28977d2 for aggregate {{(pid=127871) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:09:39.614434 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-ed720481-3c3a-4a0f-923b-cb53890df694 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-389432522 already exists. Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ed720481-3c3a-4a0f-923b-cb53890df694 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Request method failure captured: Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 59 Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_X5G-5s-KoDLf3N0ztZj4CnkLGms0TJ5ZhNskP4232s1V14zBsydxcSkjPaa_9T_0rZy7HVZSGj3rU8scEyiu8lRGR9c5DhEMSCJH7AB9oEI-iecDzI2eGjNhgrSgv86oMU3IzNSeXR-xYs0UEXez4dlXXDK5v6LSVY4sUXxanFqY Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 107e173468da4271942b3c3e5563ab10 Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:09:39.616508 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:09:39.617843 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/107e173468da4271942b3c3e5563ab10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/107e173468da4271942b3c3e5563ab10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_107e173468da4271942b3c3e5563ab10", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/107e173468da4271942b3c3e5563ab10"}]}] Jul 20 04:09:39.617843 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:39.617843 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 107e173468da4271942b3c3e5563ab10 Jul 20 04:09:39.617843 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:39.617843 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin Jul 20 04:09:39.617843 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:39.617843 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:39.617843 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f5d91332649249aead77dd00375795ff Jul 20 04:09:39.617843 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin Jul 20 04:09:39.617843 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:09:39.617843 n-d-826526-5 devstack@n-api.service[127871]: {"aggregate": {"name": "tempest-test_aggregate-389432522"}} Jul 20 04:09:39.617843 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:09:39.617843 n-d-826526-5 devstack@n-api.service[127871]: exception: Aggregate tempest-test_aggregate-389432522 already exists. Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-389432522'}}} Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 20 04:09:39.618566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-389432522 already exists. Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:39.619715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 20 04:09:39.620993 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 20 04:09:39.620993 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-389432522 already exists. Jul 20 04:09:39.620993 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.620993 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:39.620993 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.620993 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:39.620993 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:39.620993 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:39.620993 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:39.620993 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:39.620993 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-389432522 already exists. Jul 20 04:09:39.620993 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.622453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ed720481-3c3a-4a0f-923b-cb53890df694 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-389432522 already exists. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:39.623608 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ed720481-3c3a-4a0f-923b-cb53890df694 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.048250 Jul 20 04:09:39.625517 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 165/282] 10.222.0.17 () {60 vars in 1163 bytes} [Wed Jul 20 04:09:39 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:09:39.639890 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:39.639890 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:39.641708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ad9bc5ca-cb00-4613-b3dc-8ffc69f4384d tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:39.642870 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:39.642870 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:39.657403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=10,nova_api:DELETE=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:39.687368 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ad9bc5ca-cb00-4613-b3dc-8ffc69f4384d tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.058217 Jul 20 04:09:39.688540 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 166/283] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jul 20 04:09:39 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:09:39.701581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a6da1d77-12ab-4958-8006-54fc940e3285 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1318526314"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:39.704488 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:39.704488 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:39.712734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c6694a3-d76a-49be-b71f-ca8825240ef3 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:39.714177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.aggregate [None req-a6da1d77-12ab-4958-8006-54fc940e3285 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Generated uuid f6d25b41-6ce8-4bd4-8366-e8b8bcfa21ff for aggregate {{(pid=127871) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:09:39.715461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c6694a3-d76a-49be-b71f-ca8825240ef3 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:39.750863 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a6da1d77-12ab-4958-8006-54fc940e3285 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.056457 Jul 20 04:09:39.752244 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 167/284] 10.222.0.17 () {60 vars in 1163 bytes} [Wed Jul 20 04:09:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:39.766815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ad28ebe2-5758-4128-a7dc-acc6faeb73bd tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:39.767897 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:39.767897 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:39.770537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ad28ebe2-5758-4128-a7dc-acc6faeb73bd tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'c488cb1e830d4d4884f7c8b726c15ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f106cc599f4c098b10a6ac7e7bc0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ad28ebe2-5758-4128-a7dc-acc6faeb73bd tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Request method failure captured: Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_V-YEMFcG6cmxoW-5-0DyMAf53Pt6yeUux8KkjvRnuJM0ywOQBGPYX2QfmpRbIoqRyAFooa5QPuR2o5JalXKemPAc8r1CWnAnqybB1D7CqzKkuEidgYBKUiw1Ejdxb_5vXywMeb7iG1CFcA7-OWFnke2pHS6WFqbzyL6SI0khsvcY Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 33f106cc599f4c098b10a6ac7e7bc0b8 Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1020034161 Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:09:39.777365 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:09:39.779100 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33f106cc599f4c098b10a6ac7e7bc0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33f106cc599f4c098b10a6ac7e7bc0b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33f106cc599f4c098b10a6ac7e7bc0b8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33f106cc599f4c098b10a6ac7e7bc0b8"}]}] Jul 20 04:09:39.779100 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1020034161 Jul 20 04:09:39.779100 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 33f106cc599f4c098b10a6ac7e7bc0b8 Jul 20 04:09:39.779100 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1020034161 Jul 20 04:09:39.779100 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AggregatesAdminNegativeTestJSON-1020034161-project Jul 20 04:09:39.779100 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:39.779100 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:39.779100 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c488cb1e830d4d4884f7c8b726c15ba7 Jul 20 04:09:39.779100 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1020034161-project Jul 20 04:09:39.779100 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:09:39.779100 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 20 04:09:39.779100 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '14'} Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:39.779893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:39.781166 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:39.781166 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:39.781166 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:39.781166 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:39.781166 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:39.781166 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 20 04:09:39.781166 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.781166 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:39.781166 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.781166 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:39.781166 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:39.781166 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:39.781166 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:39.781166 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:39.781166 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 20 04:09:39.781166 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.784903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ad28ebe2-5758-4128-a7dc-acc6faeb73bd tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:39.789837 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9c6694a3-d76a-49be-b71f-ca8825240ef3 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 336 microversion: 2.1 time: 0.412293 Jul 20 04:09:39.790836 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ad28ebe2-5758-4128-a7dc-acc6faeb73bd tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/14" status: 403 len: 116 microversion: 2.1 time: 0.027180 Jul 20 04:09:39.793022 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 118/285] 10.222.0.17 () {60 vars in 1172 bytes} [Wed Jul 20 04:09:39 2022] PUT /compute/v2.1/os-aggregates/12 => generated 336 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:39.793522 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 168/286] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jul 20 04:09:39 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 116 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:09:39.806169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a3b81294-2aca-4374-9f5e-704aba22e6ec tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:39.807065 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:39.807065 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:39.811185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2a26d372-8457-483f-a6c4-72558b907796 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:39.812025 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:39.812025 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:39.829835 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2a26d372-8457-483f-a6c4-72558b907796 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 554 microversion: 2.1 time: 0.026765 Jul 20 04:09:39.836549 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 169/287] 10.222.0.17 () {58 vars in 1142 bytes} [Wed Jul 20 04:09:39 2022] GET /compute/v2.1/os-aggregates => generated 554 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:39.847374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c01a409c-6958-4282-a3c4-2c4c748e6a75 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:39.849971 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:39.849971 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:39.861838 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a3b81294-2aca-4374-9f5e-704aba22e6ec tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.063855 Jul 20 04:09:39.869340 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 119/288] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jul 20 04:09:39 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:09:39.874585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6521b474-b366-4093-a1b2-07332e9ef42c tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:39.875366 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:39.875366 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:39.894613 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-6521b474-b366-4093-a1b2-07332e9ef42c tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6521b474-b366-4093-a1b2-07332e9ef42c tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Request method failure captured: Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_X5G-5s-KoDLf3N0ztZj4CnkLGms0TJ5ZhNskP4232s1V14zBsydxcSkjPaa_9T_0rZy7HVZSGj3rU8scEyiu8lRGR9c5DhEMSCJH7AB9oEI-iecDzI2eGjNhgrSgv86oMU3IzNSeXR-xYs0UEXez4dlXXDK5v6LSVY4sUXxanFqY Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 107e173468da4271942b3c3e5563ab10 Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member,admin Jul 20 04:09:39.903609 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member,admin Jul 20 04:09:39.905284 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/107e173468da4271942b3c3e5563ab10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/107e173468da4271942b3c3e5563ab10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_107e173468da4271942b3c3e5563ab10", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/107e173468da4271942b3c3e5563ab10"}]}] Jul 20 04:09:39.905284 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:39.905284 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 107e173468da4271942b3c3e5563ab10 Jul 20 04:09:39.905284 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:39.905284 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin Jul 20 04:09:39.905284 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:09:39.905284 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:09:39.905284 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f5d91332649249aead77dd00375795ff Jul 20 04:09:39.905284 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin Jul 20 04:09:39.905284 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:09:39.905284 n-d-826526-5 devstack@n-api.service[127870]: exception: Aggregate -1 could not be found. Jul 20 04:09:39.905284 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '-1'} Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:09:39.906041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.908114 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:39.915278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:39.915278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:39.915278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:39.915278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:39.915278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 20 04:09:39.915278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:39.915721 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c01a409c-6958-4282-a3c4-2c4c748e6a75 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.065799 Jul 20 04:09:39.915721 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 170/289] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jul 20 04:09:39 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 20 04:09:39.915721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-20f21b60-85e5-48b7-9cbc-b2b171be3c48 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:39.917840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6521b474-b366-4093-a1b2-07332e9ef42c tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:39.920145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-20f21b60-85e5-48b7-9cbc-b2b171be3c48 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:39.923022 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6521b474-b366-4093-a1b2-07332e9ef42c tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.052559 Jul 20 04:09:39.923665 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 120/290] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jul 20 04:09:39 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:09:39.931243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20f21b60-85e5-48b7-9cbc-b2b171be3c48 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:39.931687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20f21b60-85e5-48b7-9cbc-b2b171be3c48 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:39.937630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20f21b60-85e5-48b7-9cbc-b2b171be3c48 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:39.938144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20f21b60-85e5-48b7-9cbc-b2b171be3c48 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:39.941973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d3db2470-8250-485a-a9f8-a7716cd0e732 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2143137770"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:39.947832 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:39.947832 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:39.949404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.aggregate [None req-d3db2470-8250-485a-a9f8-a7716cd0e732 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Generated uuid 898da77c-b4d1-4dc1-8b74-324c604bade9 for aggregate {{(pid=127870) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:09:39.997488 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d3db2470-8250-485a-a9f8-a7716cd0e732 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.070289 Jul 20 04:09:39.999519 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 121/291] 10.222.0.17 () {60 vars in 1163 bytes} [Wed Jul 20 04:09:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:40.013404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bd74d49b-a3ac-48b3-a61d-719239a3fd76 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-621766287"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:40.015168 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:40.015168 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:40.016351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.aggregate [None req-bd74d49b-a3ac-48b3-a61d-719239a3fd76 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Generated uuid f3d7b8b3-313a-4934-9775-9de4d8d21880 for aggregate {{(pid=127870) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:09:40.056632 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bd74d49b-a3ac-48b3-a61d-719239a3fd76 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.046891 Jul 20 04:09:40.057968 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 122/292] 10.222.0.17 () {60 vars in 1163 bytes} [Wed Jul 20 04:09:39 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:40.070448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0955839f-3fde-4db5-9b1d-b3130120d7c7 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:40.071513 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:40.071513 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:40.098781 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0955839f-3fde-4db5-9b1d-b3130120d7c7 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 445 microversion: 2.1 time: 0.039387 Jul 20 04:09:40.100030 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 123/293] 10.222.0.17 () {58 vars in 1142 bytes} [Wed Jul 20 04:09:40 2022] GET /compute/v2.1/os-aggregates => generated 445 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:40.106973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-03bd014d-ecc9-473f-93ba-5b8602cb4789 tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:40.108041 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:40.108041 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:40.110023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-03bd014d-ecc9-473f-93ba-5b8602cb4789 tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'c488cb1e830d4d4884f7c8b726c15ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f106cc599f4c098b10a6ac7e7bc0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-03bd014d-ecc9-473f-93ba-5b8602cb4789 tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Request method failure captured: Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_V-YEMFcG6cmxoW-5-0DyMAf53Pt6yeUux8KkjvRnuJM0ywOQBGPYX2QfmpRbIoqRyAFooa5QPuR2o5JalXKemPAc8r1CWnAnqybB1D7CqzKkuEidgYBKUiw1Ejdxb_5vXywMeb7iG1CFcA7-OWFnke2pHS6WFqbzyL6SI0khsvcY Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 33f106cc599f4c098b10a6ac7e7bc0b8 Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1020034161 Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:09:40.112292 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:09:40.113707 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33f106cc599f4c098b10a6ac7e7bc0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33f106cc599f4c098b10a6ac7e7bc0b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33f106cc599f4c098b10a6ac7e7bc0b8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33f106cc599f4c098b10a6ac7e7bc0b8"}]}] Jul 20 04:09:40.113707 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1020034161 Jul 20 04:09:40.113707 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 33f106cc599f4c098b10a6ac7e7bc0b8 Jul 20 04:09:40.113707 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1020034161 Jul 20 04:09:40.113707 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AggregatesAdminNegativeTestJSON-1020034161-project Jul 20 04:09:40.113707 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:09:40.113707 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:09:40.113707 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: c488cb1e830d4d4884f7c8b726c15ba7 Jul 20 04:09:40.113707 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1020034161-project Jul 20 04:09:40.113707 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:09:40.113707 n-d-826526-5 devstack@n-api.service[127870]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 20 04:09:40.113707 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '16'} Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:40.114491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:40.115763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:40.115763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:40.115763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:40.115763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:40.115763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:40.115763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 20 04:09:40.115763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.115763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:40.115763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.115763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:40.115763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:40.115763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:40.115763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:40.115763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:40.115763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 20 04:09:40.115763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.118698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-03bd014d-ecc9-473f-93ba-5b8602cb4789 tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:40.119838 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-03bd014d-ecc9-473f-93ba-5b8602cb4789 tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] 10.222.0.17 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.018154 Jul 20 04:09:40.120836 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 124/294] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:09:40 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:40.126548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6e48fff9-528a-4aab-a5df-b1bf15a8dc90 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:40.128314 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:40.128314 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:40.187486 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6e48fff9-528a-4aab-a5df-b1bf15a8dc90 tempest-AggregatesAdminTestJSON-779184344 tempest-AggregatesAdminTestJSON-779184344-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.064647 Jul 20 04:09:40.188763 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 125/295] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jul 20 04:09:40 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:09:40.194756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-67ad7823-7c5a-437c-a7fa-965ceabe07db tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:40.196076 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:40.196076 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:40.231967 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-67ad7823-7c5a-437c-a7fa-965ceabe07db tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.041816 Jul 20 04:09:40.235232 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 126/296] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jul 20 04:09:40 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:09:40.244406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d7e03177-864a-4522-9a88-559eb1b4d1d4 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:40.245444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d7e03177-864a-4522-9a88-559eb1b4d1d4 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:40.256041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7e03177-864a-4522-9a88-559eb1b4d1d4 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:40.257548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7e03177-864a-4522-9a88-559eb1b4d1d4 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:40.258585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7e03177-864a-4522-9a88-559eb1b4d1d4 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:40.258981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7e03177-864a-4522-9a88-559eb1b4d1d4 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:40.313258 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-d7e03177-864a-4522-9a88-559eb1b4d1d4 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] HTTP exception thrown: Instance 0b5032fa-799c-4a49-8963-67342c39903e could not be found. Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d7e03177-864a-4522-9a88-559eb1b4d1d4 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Request method failure captured: Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e HTTP/1.1 Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_TunmVd0vqodBdPuWhQCLma30OR7j03I5Hd6u-ySefi_4IdCeRU8KinQIgNMU3RhBqJBlQTxTQwgDeXRPc1C-NBDneO95uZwl4zxqc3dllbo1phCzoOLh1q4iiW-2R6jK0-OrmbRSn0fnXnLDmfpjzVvokUH_Rqt9PRzR2D7p11Tc Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 269ec7045cb7428faa0427f65b46754b Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AggregatesAdminTestJSON-486901790 Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:09:40.316422 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:09:40.317760 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/269ec7045cb7428faa0427f65b46754b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/269ec7045cb7428faa0427f65b46754b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_269ec7045cb7428faa0427f65b46754b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/269ec7045cb7428faa0427f65b46754b"}]}] Jul 20 04:09:40.317760 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AggregatesAdminTestJSON-486901790 Jul 20 04:09:40.317760 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 269ec7045cb7428faa0427f65b46754b Jul 20 04:09:40.317760 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-486901790 Jul 20 04:09:40.317760 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AggregatesAdminTestJSON-486901790-project Jul 20 04:09:40.317760 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:09:40.317760 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:09:40.317760 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 84e044297c454f508bde607ae3eee5a7 Jul 20 04:09:40.317760 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AggregatesAdminTestJSON-486901790-project Jul 20 04:09:40.317760 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:09:40.317760 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 0b5032fa-799c-4a49-8963-67342c39903e could not be found. Jul 20 04:09:40.317760 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '0b5032fa-799c-4a49-8963-67342c39903e'} Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b5032fa-799c-4a49-8963-67342c39903e could not be found. Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:40.318417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b5032fa-799c-4a49-8963-67342c39903e could not be found. Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b5032fa-799c-4a49-8963-67342c39903e could not be found. Jul 20 04:09:40.319463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.329244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d7e03177-864a-4522-9a88-559eb1b4d1d4 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Returning 404 to user: Instance 0b5032fa-799c-4a49-8963-67342c39903e could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:40.330538 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d7e03177-864a-4522-9a88-559eb1b4d1d4 tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 404 len: 111 microversion: 2.1 time: 0.093467 Jul 20 04:09:40.331601 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 127/297] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:09:40 2022] DELETE /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:40.338122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-483412aa-2426-4029-b200-7c4ce2345107 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:40.341865 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:40.341865 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:40.368171 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-483412aa-2426-4029-b200-7c4ce2345107 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-483412aa-2426-4029-b200-7c4ce2345107 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Request method failure captured: Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_X5G-5s-KoDLf3N0ztZj4CnkLGms0TJ5ZhNskP4232s1V14zBsydxcSkjPaa_9T_0rZy7HVZSGj3rU8scEyiu8lRGR9c5DhEMSCJH7AB9oEI-iecDzI2eGjNhgrSgv86oMU3IzNSeXR-xYs0UEXez4dlXXDK5v6LSVY4sUXxanFqY Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 107e173468da4271942b3c3e5563ab10 Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member,admin Jul 20 04:09:40.375259 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member,admin Jul 20 04:09:40.376671 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/107e173468da4271942b3c3e5563ab10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/107e173468da4271942b3c3e5563ab10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_107e173468da4271942b3c3e5563ab10", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/107e173468da4271942b3c3e5563ab10"}]}] Jul 20 04:09:40.376671 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:40.376671 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 107e173468da4271942b3c3e5563ab10 Jul 20 04:09:40.376671 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:40.376671 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin Jul 20 04:09:40.376671 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:09:40.376671 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:09:40.376671 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f5d91332649249aead77dd00375795ff Jul 20 04:09:40.376671 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin Jul 20 04:09:40.376671 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:09:40.376671 n-d-826526-5 devstack@n-api.service[127870]: exception: Aggregate -1 could not be found. Jul 20 04:09:40.376671 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '-1'} Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:40.377494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:40.378741 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:40.378741 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:40.378741 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:40.378741 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:40.378741 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:40.378741 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 20 04:09:40.378741 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:40.378741 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 20 04:09:40.378741 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.378741 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:40.378741 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.378741 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:40.378741 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:40.378741 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:40.378741 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:40.378741 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:40.378741 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 20 04:09:40.378741 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.381215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-483412aa-2426-4029-b200-7c4ce2345107 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:40.382702 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-483412aa-2426-4029-b200-7c4ce2345107 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.049686 Jul 20 04:09:40.389767 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 128/298] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:09:40 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:09:40.394836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-46c541f2-5374-4642-b580-3a2b183c6959 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:40.395455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-46c541f2-5374-4642-b580-3a2b183c6959 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:40.415095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46c541f2-5374-4642-b580-3a2b183c6959 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:40.415741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46c541f2-5374-4642-b580-3a2b183c6959 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:40.416901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46c541f2-5374-4642-b580-3a2b183c6959 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:40.417331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46c541f2-5374-4642-b580-3a2b183c6959 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:40.551695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-20f21b60-85e5-48b7-9cbc-b2b171be3c48 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:40.564692 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-20f21b60-85e5-48b7-9cbc-b2b171be3c48 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1469 microversion: 2.1 time: 0.653528 Jul 20 04:09:40.567678 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 171/299] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:39 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1469 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:40.575413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-36d3de57-c350-470d-8893-740b11ac7cdd tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:40.577721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-36d3de57-c350-470d-8893-740b11ac7cdd tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] [instance: 0b5032fa-799c-4a49-8963-67342c39903e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:40.591464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36d3de57-c350-470d-8893-740b11ac7cdd tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:40.593173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36d3de57-c350-470d-8893-740b11ac7cdd tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:40.596304 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36d3de57-c350-470d-8893-740b11ac7cdd tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:40.596916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36d3de57-c350-470d-8893-740b11ac7cdd tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:40.634934 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-36d3de57-c350-470d-8893-740b11ac7cdd tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] HTTP exception thrown: Instance 0b5032fa-799c-4a49-8963-67342c39903e could not be found. Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-36d3de57-c350-470d-8893-740b11ac7cdd tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Request method failure captured: Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e HTTP/1.1 Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_TunmVd0vqodBdPuWhQCLma30OR7j03I5Hd6u-ySefi_4IdCeRU8KinQIgNMU3RhBqJBlQTxTQwgDeXRPc1C-NBDneO95uZwl4zxqc3dllbo1phCzoOLh1q4iiW-2R6jK0-OrmbRSn0fnXnLDmfpjzVvokUH_Rqt9PRzR2D7p11Tc Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 269ec7045cb7428faa0427f65b46754b Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AggregatesAdminTestJSON-486901790 Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:09:40.647248 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:09:40.648713 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/269ec7045cb7428faa0427f65b46754b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/269ec7045cb7428faa0427f65b46754b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_269ec7045cb7428faa0427f65b46754b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/269ec7045cb7428faa0427f65b46754b"}]}] Jul 20 04:09:40.648713 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AggregatesAdminTestJSON-486901790 Jul 20 04:09:40.648713 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 269ec7045cb7428faa0427f65b46754b Jul 20 04:09:40.648713 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-486901790 Jul 20 04:09:40.648713 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AggregatesAdminTestJSON-486901790-project Jul 20 04:09:40.648713 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:40.648713 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:40.648713 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 84e044297c454f508bde607ae3eee5a7 Jul 20 04:09:40.648713 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AggregatesAdminTestJSON-486901790-project Jul 20 04:09:40.648713 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:09:40.648713 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 0b5032fa-799c-4a49-8963-67342c39903e could not be found. Jul 20 04:09:40.648713 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '0b5032fa-799c-4a49-8963-67342c39903e'} Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b5032fa-799c-4a49-8963-67342c39903e could not be found. Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:40.649449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:40.650670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:40.650670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:09:40.650670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:09:40.650670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:09:40.650670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:09:40.650670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:09:40.650670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:40.650670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b5032fa-799c-4a49-8963-67342c39903e could not be found. Jul 20 04:09:40.650670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.650670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:40.650670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.650670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:40.650670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:40.650670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:40.650670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:40.650670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:40.650670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b5032fa-799c-4a49-8963-67342c39903e could not be found. Jul 20 04:09:40.650670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.655265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-36d3de57-c350-470d-8893-740b11ac7cdd tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] Returning 404 to user: Instance 0b5032fa-799c-4a49-8963-67342c39903e could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:40.661524 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-36d3de57-c350-470d-8893-740b11ac7cdd tempest-AggregatesAdminTestJSON-486901790 tempest-AggregatesAdminTestJSON-486901790-project] 10.222.0.17 "GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e" status: 404 len: 111 microversion: 2.1 time: 0.092475 Jul 20 04:09:40.668429 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 172/300] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:40 2022] GET /compute/v2.1/servers/0b5032fa-799c-4a49-8963-67342c39903e => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:40.683536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8318e5c2-8039-4efb-82ee-be97b11f264e tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:40.684702 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:40.684702 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:40.685840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8318e5c2-8039-4efb-82ee-be97b11f264e tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'c488cb1e830d4d4884f7c8b726c15ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f106cc599f4c098b10a6ac7e7bc0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8318e5c2-8039-4efb-82ee-be97b11f264e tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Request method failure captured: Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_V-YEMFcG6cmxoW-5-0DyMAf53Pt6yeUux8KkjvRnuJM0ywOQBGPYX2QfmpRbIoqRyAFooa5QPuR2o5JalXKemPAc8r1CWnAnqybB1D7CqzKkuEidgYBKUiw1Ejdxb_5vXywMeb7iG1CFcA7-OWFnke2pHS6WFqbzyL6SI0khsvcY Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 33f106cc599f4c098b10a6ac7e7bc0b8 Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1020034161 Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:09:40.687719 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:09:40.689100 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33f106cc599f4c098b10a6ac7e7bc0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33f106cc599f4c098b10a6ac7e7bc0b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33f106cc599f4c098b10a6ac7e7bc0b8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33f106cc599f4c098b10a6ac7e7bc0b8"}]}] Jul 20 04:09:40.689100 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1020034161 Jul 20 04:09:40.689100 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 33f106cc599f4c098b10a6ac7e7bc0b8 Jul 20 04:09:40.689100 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1020034161 Jul 20 04:09:40.689100 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AggregatesAdminNegativeTestJSON-1020034161-project Jul 20 04:09:40.689100 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:40.689100 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:40.689100 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c488cb1e830d4d4884f7c8b726c15ba7 Jul 20 04:09:40.689100 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1020034161-project Jul 20 04:09:40.689100 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:09:40.689100 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 20 04:09:40.689100 n-d-826526-5 devstack@n-api.service[127871]: action_args: {} Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:40.689875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:40.691077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:40.691077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:40.691077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:40.691077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:40.691077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:40.691077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 20 04:09:40.691077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.691077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:40.691077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.691077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:40.691077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:40.691077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:40.691077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:40.691077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:40.691077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 20 04:09:40.691077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:40.697724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8318e5c2-8039-4efb-82ee-be97b11f264e tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:40.699007 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8318e5c2-8039-4efb-82ee-be97b11f264e tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.029296 Jul 20 04:09:40.700074 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 173/301] 10.222.0.17 () {58 vars in 1142 bytes} [Wed Jul 20 04:09:40 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:40.713646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-82acf799-b0b0-44d2-b1fa-b799cbf904c5 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:40.716837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-82acf799-b0b0-44d2-b1fa-b799cbf904c5 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:40.730139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82acf799-b0b0-44d2-b1fa-b799cbf904c5 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:40.731703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82acf799-b0b0-44d2-b1fa-b799cbf904c5 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:40.732709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82acf799-b0b0-44d2-b1fa-b799cbf904c5 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:40.736905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82acf799-b0b0-44d2-b1fa-b799cbf904c5 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:40.751326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:40.967346 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=24 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:41.037639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-46c541f2-5374-4642-b580-3a2b183c6959 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:41.054666 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-46c541f2-5374-4642-b580-3a2b183c6959 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1320 microversion: 2.1 time: 0.663589 Jul 20 04:09:41.065374 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 129/302] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:40 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1320 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:41.100644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f57372f7-4772-4195-9b13-bec29646810f tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1737237798"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:41.105605 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:41.105605 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:41.114550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.aggregate [None req-f57372f7-4772-4195-9b13-bec29646810f tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Generated uuid 1346eb9f-ff19-438e-99a3-cbca25664187 for aggregate {{(pid=127870) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:09:41.160415 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f57372f7-4772-4195-9b13-bec29646810f tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.091845 Jul 20 04:09:41.163563 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 130/303] 10.222.0.17 () {60 vars in 1163 bytes} [Wed Jul 20 04:09:41 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:41.173746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-24af6bd8-33da-42f6-a91d-b9ce871725a8 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-826526-5"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:41.174992 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:41.174992 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:41.202638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24af6bd8-33da-42f6-a91d-b9ce871725a8 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:41.205357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24af6bd8-33da-42f6-a91d-b9ce871725a8 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:41.359643 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-82acf799-b0b0-44d2-b1fa-b799cbf904c5 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:41.384208 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-82acf799-b0b0-44d2-b1fa-b799cbf904c5 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1318 microversion: 2.1 time: 0.682435 Jul 20 04:09:41.388373 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 174/304] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:40 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1318 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:41.484199 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-24af6bd8-33da-42f6-a91d-b9ce871725a8 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.314431 Jul 20 04:09:41.485675 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 131/305] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 04:09:41 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:41.495786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ebaa1c20-1efb-4cf5-8578-56079173284e tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-826526-5"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:41.497082 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:41.497082 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:41.497948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ebaa1c20-1efb-4cf5-8578-56079173284e tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'c488cb1e830d4d4884f7c8b726c15ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f106cc599f4c098b10a6ac7e7bc0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ebaa1c20-1efb-4cf5-8578-56079173284e tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Request method failure captured: Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 42 Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_V-YEMFcG6cmxoW-5-0DyMAf53Pt6yeUux8KkjvRnuJM0ywOQBGPYX2QfmpRbIoqRyAFooa5QPuR2o5JalXKemPAc8r1CWnAnqybB1D7CqzKkuEidgYBKUiw1Ejdxb_5vXywMeb7iG1CFcA7-OWFnke2pHS6WFqbzyL6SI0khsvcY Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 33f106cc599f4c098b10a6ac7e7bc0b8 Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1020034161 Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:09:41.499549 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:09:41.500994 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33f106cc599f4c098b10a6ac7e7bc0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33f106cc599f4c098b10a6ac7e7bc0b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33f106cc599f4c098b10a6ac7e7bc0b8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33f106cc599f4c098b10a6ac7e7bc0b8"}]}] Jul 20 04:09:41.500994 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1020034161 Jul 20 04:09:41.500994 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 33f106cc599f4c098b10a6ac7e7bc0b8 Jul 20 04:09:41.500994 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1020034161 Jul 20 04:09:41.500994 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AggregatesAdminNegativeTestJSON-1020034161-project Jul 20 04:09:41.500994 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:41.500994 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:41.500994 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c488cb1e830d4d4884f7c8b726c15ba7 Jul 20 04:09:41.500994 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1020034161-project Jul 20 04:09:41.500994 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:09:41.500994 n-d-826526-5 devstack@n-api.service[127871]: {"remove_host": {"host": "n-h2-826526-5"}} Jul 20 04:09:41.500994 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:09:41.500994 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-826526-5'}}} Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:41.501782 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 20 04:09:41.503109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:41.504220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ebaa1c20-1efb-4cf5-8578-56079173284e tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:41.512630 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ebaa1c20-1efb-4cf5-8578-56079173284e tempest-AggregatesAdminNegativeTestJSON-1020034161 tempest-AggregatesAdminNegativeTestJSON-1020034161-project] 10.222.0.17 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.020667 Jul 20 04:09:41.513229 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 175/306] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 04:09:41 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:41.529057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7b922f67-efcf-4c47-a90d-711b3421bb9c tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-826526-5"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:41.530517 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:41.530517 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:41.541376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b922f67-efcf-4c47-a90d-711b3421bb9c tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:41.542067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b922f67-efcf-4c47-a90d-711b3421bb9c tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:41.582950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5a776761-f9df-48d6-a46f-7ec7c6957894 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:41.583707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5a776761-f9df-48d6-a46f-7ec7c6957894 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:41.596432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a776761-f9df-48d6-a46f-7ec7c6957894 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:41.600584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a776761-f9df-48d6-a46f-7ec7c6957894 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:41.601545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a776761-f9df-48d6-a46f-7ec7c6957894 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:41.602192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a776761-f9df-48d6-a46f-7ec7c6957894 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:41.760782 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7b922f67-efcf-4c47-a90d-711b3421bb9c tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.242203 Jul 20 04:09:41.761743 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 132/307] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 04:09:41 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:41.772381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f77f706d-0de6-483b-8bb3-81618f30796d tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:41.773306 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:41.773306 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:41.839181 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f77f706d-0de6-483b-8bb3-81618f30796d tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.070594 Jul 20 04:09:41.845375 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 133/308] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jul 20 04:09:41 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:09:41.859224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-26caf419-718e-4197-bd5d-5a1c25ee349f tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-555981131"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:41.861088 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:41.861088 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:41.862714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.aggregate [None req-26caf419-718e-4197-bd5d-5a1c25ee349f tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Generated uuid 3e3fb3e0-08cd-45ec-982d-b745916bbf5d for aggregate {{(pid=127870) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:09:41.905310 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-26caf419-718e-4197-bd5d-5a1c25ee349f tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057550 Jul 20 04:09:41.906889 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 134/309] 10.222.0.17 () {60 vars in 1163 bytes} [Wed Jul 20 04:09:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:41.919337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4f4004fd-7418-47bc-ba3b-28ce487aa626 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:41.921481 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:41.921481 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:41.935336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f4004fd-7418-47bc-ba3b-28ce487aa626 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:41.935791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f4004fd-7418-47bc-ba3b-28ce487aa626 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:41.949430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f4004fd-7418-47bc-ba3b-28ce487aa626 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:41.949958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f4004fd-7418-47bc-ba3b-28ce487aa626 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:41.960812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.compute.aggregates [None req-4f4004fd-7418-47bc-ba3b-28ce487aa626 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 20 04:09:41.961461 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-4f4004fd-7418-47bc-ba3b-28ce487aa626 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4f4004fd-7418-47bc-ba3b-28ce487aa626 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Request method failure captured: Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 42 Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_X5G-5s-KoDLf3N0ztZj4CnkLGms0TJ5ZhNskP4232s1V14zBsydxcSkjPaa_9T_0rZy7HVZSGj3rU8scEyiu8lRGR9c5DhEMSCJH7AB9oEI-iecDzI2eGjNhgrSgv86oMU3IzNSeXR-xYs0UEXez4dlXXDK5v6LSVY4sUXxanFqY Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 107e173468da4271942b3c3e5563ab10 Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member,admin Jul 20 04:09:41.963882 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member,admin Jul 20 04:09:41.965300 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/107e173468da4271942b3c3e5563ab10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/107e173468da4271942b3c3e5563ab10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_107e173468da4271942b3c3e5563ab10", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/107e173468da4271942b3c3e5563ab10"}]}] Jul 20 04:09:41.965300 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:41.965300 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 107e173468da4271942b3c3e5563ab10 Jul 20 04:09:41.965300 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986 Jul 20 04:09:41.965300 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin Jul 20 04:09:41.965300 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:09:41.965300 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:09:41.965300 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f5d91332649249aead77dd00375795ff Jul 20 04:09:41.965300 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin Jul 20 04:09:41.965300 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:09:41.965300 n-d-826526-5 devstack@n-api.service[127870]: {"remove_host": {"host": "nonexist_host"}} Jul 20 04:09:41.965300 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:09:41.965300 n-d-826526-5 devstack@n-api.service[127870]: exception: Cannot remove host nonexist_host in aggregate 18 Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 20 04:09:41.966038 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 20 04:09:41.967195 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:41.968358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:41.969493 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:41.969493 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:41.969493 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:41.969493 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:41.969493 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jul 20 04:09:41.969493 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:09:41.969493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4f4004fd-7418-47bc-ba3b-28ce487aa626 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:41.969493 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4f4004fd-7418-47bc-ba3b-28ce487aa626 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.050975 Jul 20 04:09:41.969959 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 135/310] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 04:09:41 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:09:41.975986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b608e99d-d4ba-4dcd-8742-e54a5767d205 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:41.977013 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:41.977013 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:42.025204 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b608e99d-d4ba-4dcd-8742-e54a5767d205 tempest-AggregatesAdminNegativeTestJSON-2137966986 tempest-AggregatesAdminNegativeTestJSON-2137966986-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.053695 Jul 20 04:09:42.025861 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 136/311] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jul 20 04:09:41 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:09:42.036119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-72c4ee83-91f4-4e4f-adca-a6d6b4bcd1f6 req-8ac1a044-0d3a-416a-9107-b5e546098d99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b121be-5714-4811-bee9-784322e4e43b", "tag": "1ee2808f-7853-44ea-b6c8-1a298396ca2b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:42.049735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-72c4ee83-91f4-4e4f-adca-a6d6b4bcd1f6 req-8ac1a044-0d3a-416a-9107-b5e546098d99 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:42.050184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-72c4ee83-91f4-4e4f-adca-a6d6b4bcd1f6 req-8ac1a044-0d3a-416a-9107-b5e546098d99 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:42.065161 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-72c4ee83-91f4-4e4f-adca-a6d6b4bcd1f6 req-8ac1a044-0d3a-416a-9107-b5e546098d99 service nova] Creating event network-changed:1ee2808f-7853-44ea-b6c8-1a298396ca2b for instance d6b121be-5714-4811-bee9-784322e4e43b on n-h2-826526-5 Jul 20 04:09:42.077690 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-72c4ee83-91f4-4e4f-adca-a6d6b4bcd1f6 req-8ac1a044-0d3a-416a-9107-b5e546098d99 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044908 Jul 20 04:09:42.078472 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 137/312] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:42.085517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-854d3a05-d91b-43a9-9826-2ee33e2bc953 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:42.086413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-854d3a05-d91b-43a9-9826-2ee33e2bc953 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:42.100781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-854d3a05-d91b-43a9-9826-2ee33e2bc953 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:42.101328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-854d3a05-d91b-43a9-9826-2ee33e2bc953 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:42.102380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-854d3a05-d91b-43a9-9826-2ee33e2bc953 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:42.104484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-854d3a05-d91b-43a9-9826-2ee33e2bc953 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:42.196579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=20 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:42.391690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5a776761-f9df-48d6-a46f-7ec7c6957894 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:42.401981 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5a776761-f9df-48d6-a46f-7ec7c6957894 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1469 microversion: 2.1 time: 0.822814 Jul 20 04:09:42.403379 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 176/313] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:41 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1469 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:42.411700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-56390fda-1310-48e5-896f-6834c116e0b1 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:42.412689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-56390fda-1310-48e5-896f-6834c116e0b1 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:42.426160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56390fda-1310-48e5-896f-6834c116e0b1 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:42.431762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56390fda-1310-48e5-896f-6834c116e0b1 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:42.432839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56390fda-1310-48e5-896f-6834c116e0b1 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:42.437364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56390fda-1310-48e5-896f-6834c116e0b1 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:42.875851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-56390fda-1310-48e5-896f-6834c116e0b1 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:42.894208 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-56390fda-1310-48e5-896f-6834c116e0b1 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1318 microversion: 2.1 time: 0.489506 Jul 20 04:09:42.898623 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 177/314] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:42 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:43.419564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-42959872-691d-484f-8c43-dae517d9814a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:43.421518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-42959872-691d-484f-8c43-dae517d9814a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:43.429057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42959872-691d-484f-8c43-dae517d9814a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:43.435333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42959872-691d-484f-8c43-dae517d9814a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:43.436507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42959872-691d-484f-8c43-dae517d9814a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:43.437137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42959872-691d-484f-8c43-dae517d9814a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:43.988203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-854d3a05-d91b-43a9-9826-2ee33e2bc953 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:43.997883 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-854d3a05-d91b-43a9-9826-2ee33e2bc953 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1320 microversion: 2.1 time: 1.918190 Jul 20 04:09:44.011159 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 138/315] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:42 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1320 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:44.018009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-842573f4-cc5c-47e9-9af5-65dcc989962f tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:44.018743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-842573f4-cc5c-47e9-9af5-65dcc989962f tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:44.026060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-842573f4-cc5c-47e9-9af5-65dcc989962f tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:44.026643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-842573f4-cc5c-47e9-9af5-65dcc989962f tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:44.027830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-842573f4-cc5c-47e9-9af5-65dcc989962f tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:44.031364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-842573f4-cc5c-47e9-9af5-65dcc989962f tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:44.353813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-42959872-691d-484f-8c43-dae517d9814a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:44.367857 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-42959872-691d-484f-8c43-dae517d9814a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1469 microversion: 2.1 time: 0.949983 Jul 20 04:09:44.368945 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 178/316] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:43 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1469 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:44.373567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-1e72ac16-a07a-4c7a-bc22-458871970f82 req-19bd5415-1fda-4fc8-9ed7-3cf87849fd2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b6078c1-237a-4580-a06e-07c3e671ffc9", "tag": "7bdf5925-4923-4c2b-892d-3e9f038865fa"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:44.401584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1e72ac16-a07a-4c7a-bc22-458871970f82 req-19bd5415-1fda-4fc8-9ed7-3cf87849fd2b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:44.401832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1e72ac16-a07a-4c7a-bc22-458871970f82 req-19bd5415-1fda-4fc8-9ed7-3cf87849fd2b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:44.429897 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-1e72ac16-a07a-4c7a-bc22-458871970f82 req-19bd5415-1fda-4fc8-9ed7-3cf87849fd2b service nova] Creating event network-changed:7bdf5925-4923-4c2b-892d-3e9f038865fa for instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 on n-h2-826526-5 Jul 20 04:09:44.442948 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-1e72ac16-a07a-4c7a-bc22-458871970f82 req-19bd5415-1fda-4fc8-9ed7-3cf87849fd2b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072300 Jul 20 04:09:44.444777 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 179/317] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:45.016738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-272fa513-c810-4cfd-9541-2b0ff9bf33af tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:45.017595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-272fa513-c810-4cfd-9541-2b0ff9bf33af tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:45.078000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-272fa513-c810-4cfd-9541-2b0ff9bf33af tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:45.078467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-272fa513-c810-4cfd-9541-2b0ff9bf33af tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:45.081559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-272fa513-c810-4cfd-9541-2b0ff9bf33af tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:45.084437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-272fa513-c810-4cfd-9541-2b0ff9bf33af tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:45.104091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-842573f4-cc5c-47e9-9af5-65dcc989962f tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:45.115817 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-842573f4-cc5c-47e9-9af5-65dcc989962f tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1318 microversion: 2.1 time: 1.103234 Jul 20 04:09:45.121324 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 139/318] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:44 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1318 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:45.392629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7eaf00b4-7226-476e-9ae8-3c1196987734 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:45.398840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7eaf00b4-7226-476e-9ae8-3c1196987734 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:45.413126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7eaf00b4-7226-476e-9ae8-3c1196987734 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:45.414842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7eaf00b4-7226-476e-9ae8-3c1196987734 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:45.417141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7eaf00b4-7226-476e-9ae8-3c1196987734 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:45.417815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7eaf00b4-7226-476e-9ae8-3c1196987734 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:45.659596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-272fa513-c810-4cfd-9541-2b0ff9bf33af tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:45.675167 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-272fa513-c810-4cfd-9541-2b0ff9bf33af tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1320 microversion: 2.1 time: 0.663197 Jul 20 04:09:45.677463 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 180/319] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:45 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1320 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:46.139462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-69a902f6-9131-4465-b684-e14e3281b76e tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:46.140499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-69a902f6-9131-4465-b684-e14e3281b76e tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:46.148779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69a902f6-9131-4465-b684-e14e3281b76e tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:46.149256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69a902f6-9131-4465-b684-e14e3281b76e tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:46.150264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69a902f6-9131-4465-b684-e14e3281b76e tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:46.150792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69a902f6-9131-4465-b684-e14e3281b76e tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:46.248667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7eaf00b4-7226-476e-9ae8-3c1196987734 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:46.266075 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7eaf00b4-7226-476e-9ae8-3c1196987734 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1469 microversion: 2.1 time: 0.883853 Jul 20 04:09:46.267024 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 140/320] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:45 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1469 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:46.548651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-69a902f6-9131-4465-b684-e14e3281b76e tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:46.567137 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-69a902f6-9131-4465-b684-e14e3281b76e tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1318 microversion: 2.1 time: 0.432282 Jul 20 04:09:46.568941 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 181/321] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:46 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:46.707590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4bf59137-1f31-44fc-ad2b-ce442d470d2c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:46.711330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4bf59137-1f31-44fc-ad2b-ce442d470d2c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:46.729591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4bf59137-1f31-44fc-ad2b-ce442d470d2c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:46.730045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4bf59137-1f31-44fc-ad2b-ce442d470d2c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:46.733627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4bf59137-1f31-44fc-ad2b-ce442d470d2c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:46.734604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4bf59137-1f31-44fc-ad2b-ce442d470d2c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:47.011382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4bf59137-1f31-44fc-ad2b-ce442d470d2c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:47.022063 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4bf59137-1f31-44fc-ad2b-ce442d470d2c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1320 microversion: 2.1 time: 0.331066 Jul 20 04:09:47.023464 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 141/322] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:46 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1320 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:47.284349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cf2235a2-619f-4f02-a3f7-75e4c4f7689a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:47.286114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cf2235a2-619f-4f02-a3f7-75e4c4f7689a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:47.298957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf2235a2-619f-4f02-a3f7-75e4c4f7689a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:47.301276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf2235a2-619f-4f02-a3f7-75e4c4f7689a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:47.303327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf2235a2-619f-4f02-a3f7-75e4c4f7689a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:47.305731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf2235a2-619f-4f02-a3f7-75e4c4f7689a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:47.584894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b1514321-78c5-40a4-b743-2a500eabc095 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:47.586199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b1514321-78c5-40a4-b743-2a500eabc095 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:47.589239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:DELETE=11,nova_api:INSERT=5 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:47.600491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1514321-78c5-40a4-b743-2a500eabc095 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:47.601194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1514321-78c5-40a4-b743-2a500eabc095 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:47.601978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1514321-78c5-40a4-b743-2a500eabc095 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:47.602420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1514321-78c5-40a4-b743-2a500eabc095 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:47.671572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:47.753457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cf2235a2-619f-4f02-a3f7-75e4c4f7689a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:47.770005 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cf2235a2-619f-4f02-a3f7-75e4c4f7689a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1474 microversion: 2.1 time: 0.487259 Jul 20 04:09:47.770005 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 182/323] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:47 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1474 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:48.039941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-95d07513-10b0-4eed-80c4-12b8c6a23517 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:48.040741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-95d07513-10b0-4eed-80c4-12b8c6a23517 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:48.069513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-95d07513-10b0-4eed-80c4-12b8c6a23517 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:48.069979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-95d07513-10b0-4eed-80c4-12b8c6a23517 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:48.072362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-95d07513-10b0-4eed-80c4-12b8c6a23517 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:48.072979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-95d07513-10b0-4eed-80c4-12b8c6a23517 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:48.545558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b1514321-78c5-40a4-b743-2a500eabc095 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:48.560698 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b1514321-78c5-40a4-b743-2a500eabc095 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1318 microversion: 2.1 time: 0.980288 Jul 20 04:09:48.561555 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 142/324] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:47 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1318 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:48.574427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-95d07513-10b0-4eed-80c4-12b8c6a23517 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:48.582808 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-95d07513-10b0-4eed-80c4-12b8c6a23517 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1320 microversion: 2.1 time: 0.547281 Jul 20 04:09:48.583780 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 183/325] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:48 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1320 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:48.784798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e6c76db6-2ad4-4bd1-9b57-3087b0a4af56 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:48.785988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e6c76db6-2ad4-4bd1-9b57-3087b0a4af56 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:48.799267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6c76db6-2ad4-4bd1-9b57-3087b0a4af56 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:48.805125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6c76db6-2ad4-4bd1-9b57-3087b0a4af56 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:48.807894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6c76db6-2ad4-4bd1-9b57-3087b0a4af56 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:48.809344 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6c76db6-2ad4-4bd1-9b57-3087b0a4af56 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:49.373087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e6c76db6-2ad4-4bd1-9b57-3087b0a4af56 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:49.398369 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e6c76db6-2ad4-4bd1-9b57-3087b0a4af56 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1474 microversion: 2.1 time: 0.617232 Jul 20 04:09:49.412177 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 143/326] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:48 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1474 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:49.578739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c68efa14-b7fe-465d-bb07-d8429905a7cc tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:49.582527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c68efa14-b7fe-465d-bb07-d8429905a7cc tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:49.601674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8525ceed-5faa-42b9-8c5a-8ea0e59cd173 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:49.602380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8525ceed-5faa-42b9-8c5a-8ea0e59cd173 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:49.615302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c68efa14-b7fe-465d-bb07-d8429905a7cc tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:49.623272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c68efa14-b7fe-465d-bb07-d8429905a7cc tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:49.624098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c68efa14-b7fe-465d-bb07-d8429905a7cc tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:49.624561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c68efa14-b7fe-465d-bb07-d8429905a7cc tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:49.637554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8525ceed-5faa-42b9-8c5a-8ea0e59cd173 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:49.638055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8525ceed-5faa-42b9-8c5a-8ea0e59cd173 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:49.638886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8525ceed-5faa-42b9-8c5a-8ea0e59cd173 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:49.643937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8525ceed-5faa-42b9-8c5a-8ea0e59cd173 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:49.696582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:50.091718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c68efa14-b7fe-465d-bb07-d8429905a7cc tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:50.100828 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c68efa14-b7fe-465d-bb07-d8429905a7cc tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1318 microversion: 2.1 time: 0.527394 Jul 20 04:09:50.101423 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 184/327] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:49 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:50.116225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8525ceed-5faa-42b9-8c5a-8ea0e59cd173 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:50.126078 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8525ceed-5faa-42b9-8c5a-8ea0e59cd173 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1320 microversion: 2.1 time: 0.529351 Jul 20 04:09:50.126668 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 144/328] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:49 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1320 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:50.433148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d1c66a89-94d2-42e0-a622-30ea770a2d10 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:50.434256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d1c66a89-94d2-42e0-a622-30ea770a2d10 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:50.442763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d1c66a89-94d2-42e0-a622-30ea770a2d10 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:50.443218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d1c66a89-94d2-42e0-a622-30ea770a2d10 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:50.450425 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d1c66a89-94d2-42e0-a622-30ea770a2d10 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:50.451482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d1c66a89-94d2-42e0-a622-30ea770a2d10 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:51.235101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d1c66a89-94d2-42e0-a622-30ea770a2d10 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:51.250316 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d1c66a89-94d2-42e0-a622-30ea770a2d10 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1474 microversion: 2.1 time: 0.818856 Jul 20 04:09:51.251124 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 185/329] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:50 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1474 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:51.277553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-65cbf380-a1b5-4643-a6dc-fe79f21c44c4 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:51.280212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-65cbf380-a1b5-4643-a6dc-fe79f21c44c4 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:51.299691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65cbf380-a1b5-4643-a6dc-fe79f21c44c4 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:51.301530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65cbf380-a1b5-4643-a6dc-fe79f21c44c4 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:51.304623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65cbf380-a1b5-4643-a6dc-fe79f21c44c4 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:51.305484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65cbf380-a1b5-4643-a6dc-fe79f21c44c4 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:51.559658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b4ab9de5-48c2-4b9b-99f1-5018194dc6a6 tempest-FlavorsAccessTestJSON-562909681 tempest-FlavorsAccessTestJSON-562909681-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-675333447", "id": 1095483033, "os-flavor-access:is_public": "False"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:51.562274 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:51.562274 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:51.589387 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b4ab9de5-48c2-4b9b-99f1-5018194dc6a6 tempest-FlavorsAccessTestJSON-562909681 tempest-FlavorsAccessTestJSON-562909681-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.618909 Jul 20 04:09:51.590724 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 145/330] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:09:50 2022] POST /compute/v2.1/flavors => generated 430 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:51.601248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-751dd695-8db4-4e6f-b5c9-3c9701498f37 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:51.602538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-751dd695-8db4-4e6f-b5c9-3c9701498f37 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:51.612540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-751dd695-8db4-4e6f-b5c9-3c9701498f37 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:51.613579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-751dd695-8db4-4e6f-b5c9-3c9701498f37 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:51.614654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-751dd695-8db4-4e6f-b5c9-3c9701498f37 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:51.615337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-751dd695-8db4-4e6f-b5c9-3c9701498f37 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:51.908581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-65cbf380-a1b5-4643-a6dc-fe79f21c44c4 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:51.937975 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-65cbf380-a1b5-4643-a6dc-fe79f21c44c4 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1318 microversion: 2.1 time: 0.668398 Jul 20 04:09:51.940145 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 186/331] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:51 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1318 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:51.946139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:51.951921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6d697ac1-b303-4de2-ae96-462bfacab29b tempest-FlavorsAccessTestJSON-562909681 tempest-FlavorsAccessTestJSON-562909681-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2e290cb48790482bbc4af967a610b5c9"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:51.955802 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:51.955802 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:52.077966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-751dd695-8db4-4e6f-b5c9-3c9701498f37 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:52.095159 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-751dd695-8db4-4e6f-b5c9-3c9701498f37 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1320 microversion: 2.1 time: 0.498310 Jul 20 04:09:52.097826 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 146/332] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:51 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1320 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:52.468722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ef4d001e-cd42-4ede-a3f8-86e9aeb951a3 tempest-FlavorMetadataValidation-559341282 tempest-FlavorMetadataValidation-559341282-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-643363922", "id": 930146747, "os-flavor-access:is_public": "True"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:52.471265 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:52.471265 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:52.504686 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6d697ac1-b303-4de2-ae96-462bfacab29b tempest-FlavorsAccessTestJSON-562909681 tempest-FlavorsAccessTestJSON-562909681-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1095483033/action" status: 200 len: 97 microversion: 2.1 time: 0.562238 Jul 20 04:09:52.506655 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 187/333] 10.222.0.17 () {60 vars in 1199 bytes} [Wed Jul 20 04:09:51 2022] POST /compute/v2.1/flavors/1095483033/action => generated 97 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:09:52.516864 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ef4d001e-cd42-4ede-a3f8-86e9aeb951a3 tempest-FlavorMetadataValidation-559341282 tempest-FlavorMetadataValidation-559341282-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.416917 Jul 20 04:09:52.518525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c8730653-6d5a-4ec3-afd7-a60569322860 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:52.519631 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 147/334] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 04:09:52 2022] POST /compute/v2.1/flavors => generated 467 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:09:52.520228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c8730653-6d5a-4ec3-afd7-a60569322860 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:52.531628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8730653-6d5a-4ec3-afd7-a60569322860 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:52.532773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8730653-6d5a-4ec3-afd7-a60569322860 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:52.533707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8730653-6d5a-4ec3-afd7-a60569322860 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:52.534387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8730653-6d5a-4ec3-afd7-a60569322860 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:52.548209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:52.911992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c8730653-6d5a-4ec3-afd7-a60569322860 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:52.948254 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c8730653-6d5a-4ec3-afd7-a60569322860 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1474 microversion: 2.1 time: 0.434418 Jul 20 04:09:52.951719 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 188/335] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:52 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1474 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:52.960403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a056d829-02df-40c5-9cdb-374d50f4ac22 tempest-FlavorMetadataValidation-559341282 tempest-FlavorMetadataValidation-559341282-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:52.964662 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:52.964662 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:53.001762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-275599bd-56af-4f83-a21d-dd5e0fb758e5 tempest-FlavorsAccessTestJSON-1118463104 tempest-FlavorsAccessTestJSON-1118463104-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:53.068633 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-275599bd-56af-4f83-a21d-dd5e0fb758e5 tempest-FlavorsAccessTestJSON-1118463104 tempest-FlavorsAccessTestJSON-1118463104-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5829 microversion: 2.1 time: 0.545742 Jul 20 04:09:53.082485 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 148/336] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:52 2022] GET /compute/v2.1/flavors/detail => generated 5829 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:53.096184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-22eca4d2-6e4a-4e50-a128-ce02964cd687 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:53.096871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-22eca4d2-6e4a-4e50-a128-ce02964cd687 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:53.113696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22eca4d2-6e4a-4e50-a128-ce02964cd687 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:53.114139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22eca4d2-6e4a-4e50-a128-ce02964cd687 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:53.116851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22eca4d2-6e4a-4e50-a128-ce02964cd687 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:53.118764 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22eca4d2-6e4a-4e50-a128-ce02964cd687 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:53.225605 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a056d829-02df-40c5-9cdb-374d50f4ac22 tempest-FlavorMetadataValidation-559341282 tempest-FlavorMetadataValidation-559341282-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/930146747/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.269932 Jul 20 04:09:53.227845 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 189/337] 10.222.0.17 () {62 vars in 1261 bytes} [Wed Jul 20 04:09:52 2022] POST /compute/v2.1/flavors/930146747/os-extra_specs => generated 62 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:53.235122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1c11f5ec-6e56-4cd9-9be7-ea35a75ff9a3 tempest-FlavorsAccessTestJSON-562909681 tempest-FlavorsAccessTestJSON-562909681-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2e290cb48790482bbc4af967a610b5c9"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:53.236375 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:53.236375 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:53.452088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-22eca4d2-6e4a-4e50-a128-ce02964cd687 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:53.466629 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-22eca4d2-6e4a-4e50-a128-ce02964cd687 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1318 microversion: 2.1 time: 0.379767 Jul 20 04:09:53.468576 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 149/338] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:53 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:53.481022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ec59aba5-35cc-4fa7-923f-fa08906fd13a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:53.481900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ec59aba5-35cc-4fa7-923f-fa08906fd13a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:53.498352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec59aba5-35cc-4fa7-923f-fa08906fd13a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:53.498804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec59aba5-35cc-4fa7-923f-fa08906fd13a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:53.499583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec59aba5-35cc-4fa7-923f-fa08906fd13a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:53.500018 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec59aba5-35cc-4fa7-923f-fa08906fd13a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:53.748905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=6,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:53.778423 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1c11f5ec-6e56-4cd9-9be7-ea35a75ff9a3 tempest-FlavorsAccessTestJSON-562909681 tempest-FlavorsAccessTestJSON-562909681-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1095483033/action" status: 200 len: 21 microversion: 2.1 time: 0.546960 Jul 20 04:09:53.781194 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 190/339] 10.222.0.17 () {60 vars in 1199 bytes} [Wed Jul 20 04:09:53 2022] POST /compute/v2.1/flavors/1095483033/action => generated 21 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:09:53.799338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-967666da-38bc-405d-9946-da4f9fcd6e12 tempest-FlavorMetadataValidation-559341282 tempest-FlavorMetadataValidation-559341282-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:53.801243 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:53.801243 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:53.812120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ec59aba5-35cc-4fa7-923f-fa08906fd13a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:53.823331 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ec59aba5-35cc-4fa7-923f-fa08906fd13a tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1320 microversion: 2.1 time: 0.353251 Jul 20 04:09:53.824470 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 150/340] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:53 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1320 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:53.835852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3f6a5b23-2282-45b9-9311-9ae49342cf1d tempest-FlavorsAccessTestJSON-1118463104 tempest-FlavorsAccessTestJSON-1118463104-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:53.840355 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-967666da-38bc-405d-9946-da4f9fcd6e12 tempest-FlavorMetadataValidation-559341282 tempest-FlavorMetadataValidation-559341282-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/930146747" status: 202 len: 0 microversion: 2.86 time: 0.056721 Jul 20 04:09:53.844563 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 191/341] 10.222.0.17 () {60 vars in 1198 bytes} [Wed Jul 20 04:09:53 2022] DELETE /compute/v2.1/flavors/930146747 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:09:53.853840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-400fb5cd-5030-4ef4-bd2f-fd21e10b26f5 tempest-FlavorMetadataValidation-559341282 tempest-FlavorMetadataValidation-559341282-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:53.875477 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3f6a5b23-2282-45b9-9311-9ae49342cf1d tempest-FlavorsAccessTestJSON-1118463104 tempest-FlavorsAccessTestJSON-1118463104-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048269 Jul 20 04:09:53.885236 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 151/342] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:53.893500 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-400fb5cd-5030-4ef4-bd2f-fd21e10b26f5 tempest-FlavorMetadataValidation-559341282 tempest-FlavorMetadataValidation-559341282-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.043055 Jul 20 04:09:53.894277 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 192/343] 10.222.0.17 () {60 vars in 1186 bytes} [Wed Jul 20 04:09:53 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:53.900174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-686335c2-7071-4421-95ea-bdd0269e0a41 tempest-FlavorsAccessTestJSON-562909681 tempest-FlavorsAccessTestJSON-562909681-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:53.900956 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:53.900956 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:09:53.936297 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-686335c2-7071-4421-95ea-bdd0269e0a41 tempest-FlavorsAccessTestJSON-562909681 tempest-FlavorsAccessTestJSON-562909681-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1095483033" status: 202 len: 0 microversion: 2.1 time: 0.039570 Jul 20 04:09:53.937265 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 152/344] 10.222.0.17 () {58 vars in 1160 bytes} [Wed Jul 20 04:09:53 2022] DELETE /compute/v2.1/flavors/1095483033 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:09:53.946364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-49a9d9f6-2ace-4111-9e6e-501fcfdb672f tempest-FlavorsAccessTestJSON-562909681 tempest-FlavorsAccessTestJSON-562909681-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:53.993963 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-49a9d9f6-2ace-4111-9e6e-501fcfdb672f tempest-FlavorsAccessTestJSON-562909681 tempest-FlavorsAccessTestJSON-562909681-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052476 Jul 20 04:09:54.002054 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 153/345] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:54.016849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5bebab13-a741-4794-b733-bc4630b769f4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:54.017755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5bebab13-a741-4794-b733-bc4630b769f4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:54.030227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5bebab13-a741-4794-b733-bc4630b769f4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:54.031118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5bebab13-a741-4794-b733-bc4630b769f4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:54.032178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5bebab13-a741-4794-b733-bc4630b769f4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:54.032814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5bebab13-a741-4794-b733-bc4630b769f4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:54.422148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-016fbbbf-2815-4aa2-ba9e-2890b1cfc302 tempest-AZAdminV2TestJSON-447185048 tempest-AZAdminV2TestJSON-447185048-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:54.424452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-016fbbbf-2815-4aa2-ba9e-2890b1cfc302 tempest-AZAdminV2TestJSON-447185048 tempest-AZAdminV2TestJSON-447185048-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:54.425405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-016fbbbf-2815-4aa2-ba9e-2890b1cfc302 tempest-AZAdminV2TestJSON-447185048 tempest-AZAdminV2TestJSON-447185048-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:54.426368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-016fbbbf-2815-4aa2-ba9e-2890b1cfc302 tempest-AZAdminV2TestJSON-447185048 tempest-AZAdminV2TestJSON-447185048-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:54.427356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-016fbbbf-2815-4aa2-ba9e-2890b1cfc302 tempest-AZAdminV2TestJSON-447185048 tempest-AZAdminV2TestJSON-447185048-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:54.486073 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-016fbbbf-2815-4aa2-ba9e-2890b1cfc302 tempest-AZAdminV2TestJSON-447185048 tempest-AZAdminV2TestJSON-447185048-project-admin] 10.222.0.17 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.575529 Jul 20 04:09:54.487012 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 193/346] 10.222.0.17 () {58 vars in 1163 bytes} [Wed Jul 20 04:09:53 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:09:54.493246 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-4af98698-cdc8-4f3a-a552-d26717c6e15e req-c1634a9c-2938-49f2-a731-72827edeaaee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b121be-5714-4811-bee9-784322e4e43b", "name": "network-vif-plugged", "status": "completed", "tag": "1ee2808f-7853-44ea-b6c8-1a298396ca2b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:54.502236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4af98698-cdc8-4f3a-a552-d26717c6e15e req-c1634a9c-2938-49f2-a731-72827edeaaee service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:54.502870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4af98698-cdc8-4f3a-a552-d26717c6e15e req-c1634a9c-2938-49f2-a731-72827edeaaee service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:54.517820 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-4af98698-cdc8-4f3a-a552-d26717c6e15e req-c1634a9c-2938-49f2-a731-72827edeaaee service nova] Creating event network-vif-plugged:1ee2808f-7853-44ea-b6c8-1a298396ca2b for instance d6b121be-5714-4811-bee9-784322e4e43b on n-h2-826526-5 Jul 20 04:09:54.527388 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-4af98698-cdc8-4f3a-a552-d26717c6e15e req-c1634a9c-2938-49f2-a731-72827edeaaee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039114 Jul 20 04:09:54.529467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5bebab13-a741-4794-b733-bc4630b769f4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:54.532498 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 194/347] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:54.544036 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5bebab13-a741-4794-b733-bc4630b769f4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1474 microversion: 2.1 time: 0.538935 Jul 20 04:09:54.550830 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e86a44eb-746d-4a8b-85ec-70e04c7bbca1 tempest-FlavorsAccessTestJSON-562909681 tempest-FlavorsAccessTestJSON-562909681-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-504060099", "id": 1039127673, "os-flavor-access:is_public": "False"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:54.557924 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 154/348] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:54 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1474 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:54.572788 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:54.572788 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:54.573539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-317bb2e6-a26f-4033-8c5a-fb39534e2c6c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:54.582226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-317bb2e6-a26f-4033-8c5a-fb39534e2c6c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:54.596864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-317bb2e6-a26f-4033-8c5a-fb39534e2c6c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:54.600375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-317bb2e6-a26f-4033-8c5a-fb39534e2c6c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:54.601585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-317bb2e6-a26f-4033-8c5a-fb39534e2c6c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:54.602081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-317bb2e6-a26f-4033-8c5a-fb39534e2c6c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:54.619266 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e86a44eb-746d-4a8b-85ec-70e04c7bbca1 tempest-FlavorsAccessTestJSON-562909681 tempest-FlavorsAccessTestJSON-562909681-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.084427 Jul 20 04:09:54.620221 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 195/349] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:09:54 2022] POST /compute/v2.1/flavors => generated 430 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:54.642189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e6938950-06e6-4a5b-b746-39883d357f95 tempest-AZAdminV2TestJSON-447185048 tempest-AZAdminV2TestJSON-447185048-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:54.644238 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:54.644238 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:54.647773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6938950-06e6-4a5b-b746-39883d357f95 tempest-AZAdminV2TestJSON-447185048 tempest-AZAdminV2TestJSON-447185048-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:54.653282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6938950-06e6-4a5b-b746-39883d357f95 tempest-AZAdminV2TestJSON-447185048 tempest-AZAdminV2TestJSON-447185048-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:54.658813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6938950-06e6-4a5b-b746-39883d357f95 tempest-AZAdminV2TestJSON-447185048 tempest-AZAdminV2TestJSON-447185048-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:54.659513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6938950-06e6-4a5b-b746-39883d357f95 tempest-AZAdminV2TestJSON-447185048 tempest-AZAdminV2TestJSON-447185048-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:54.722960 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e6938950-06e6-4a5b-b746-39883d357f95 tempest-AZAdminV2TestJSON-447185048 tempest-AZAdminV2TestJSON-447185048-project-admin] 10.222.0.17 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.099905 Jul 20 04:09:54.727305 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 196/350] 10.222.0.17 () {58 vars in 1184 bytes} [Wed Jul 20 04:09:54 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:54.733113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fbc11c10-42e8-4903-b723-40a48728da69 tempest-FlavorsAccessTestJSON-562909681 tempest-FlavorsAccessTestJSON-562909681-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:54.733113 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:54.733113 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:54.761475 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fbc11c10-42e8-4903-b723-40a48728da69 tempest-FlavorsAccessTestJSON-562909681 tempest-FlavorsAccessTestJSON-562909681-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/1039127673/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.032856 Jul 20 04:09:54.766846 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 197/351] 10.222.0.17 () {58 vars in 1208 bytes} [Wed Jul 20 04:09:54 2022] GET /compute/v2.1/flavors/1039127673/os-flavor-access => generated 21 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:09:54.773948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7fae42ad-a638-4464-860c-f9f6afbfab6c tempest-FlavorsAccessTestJSON-562909681 tempest-FlavorsAccessTestJSON-562909681-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:54.779112 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:54.779112 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:09:54.834094 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7fae42ad-a638-4464-860c-f9f6afbfab6c tempest-FlavorsAccessTestJSON-562909681 tempest-FlavorsAccessTestJSON-562909681-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1039127673" status: 202 len: 0 microversion: 2.1 time: 0.065125 Jul 20 04:09:54.837537 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 198/352] 10.222.0.17 () {58 vars in 1160 bytes} [Wed Jul 20 04:09:54 2022] DELETE /compute/v2.1/flavors/1039127673 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:09:54.851082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-51d76f6d-aca8-4c60-bc3d-d4f297fd99c3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:54.853822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-51d76f6d-aca8-4c60-bc3d-d4f297fd99c3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:54.875214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51d76f6d-aca8-4c60-bc3d-d4f297fd99c3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:54.875898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51d76f6d-aca8-4c60-bc3d-d4f297fd99c3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:54.877091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51d76f6d-aca8-4c60-bc3d-d4f297fd99c3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:54.880579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51d76f6d-aca8-4c60-bc3d-d4f297fd99c3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:55.233270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-317bb2e6-a26f-4033-8c5a-fb39534e2c6c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:55.247620 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-317bb2e6-a26f-4033-8c5a-fb39534e2c6c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1318 microversion: 2.1 time: 0.687538 Jul 20 04:09:55.254377 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 155/353] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:54 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1318 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:55.269776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d0955cda-0e3f-4058-98ba-a2f46f2c5f53 tempest-FlavorsAccessTestJSON-562909681 tempest-FlavorsAccessTestJSON-562909681-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:55.326156 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d0955cda-0e3f-4058-98ba-a2f46f2c5f53 tempest-FlavorsAccessTestJSON-562909681 tempest-FlavorsAccessTestJSON-562909681-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067910 Jul 20 04:09:55.333743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-51d76f6d-aca8-4c60-bc3d-d4f297fd99c3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:55.336759 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 156/354] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:55.350511 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-51d76f6d-aca8-4c60-bc3d-d4f297fd99c3 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1320 microversion: 2.1 time: 0.510327 Jul 20 04:09:55.354285 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 199/355] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:54 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1320 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:55.562460 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c5b04008-67da-44ff-90fd-125a95b61ed3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:55.563292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c5b04008-67da-44ff-90fd-125a95b61ed3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:55.572711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5b04008-67da-44ff-90fd-125a95b61ed3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:55.573383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5b04008-67da-44ff-90fd-125a95b61ed3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:55.574322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5b04008-67da-44ff-90fd-125a95b61ed3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:55.574903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5b04008-67da-44ff-90fd-125a95b61ed3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:55.841073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c5b04008-67da-44ff-90fd-125a95b61ed3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:55.850952 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c5b04008-67da-44ff-90fd-125a95b61ed3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1474 microversion: 2.1 time: 0.292893 Jul 20 04:09:55.854000 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 157/356] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:55 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1474 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:56.273483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-874689ce-a192-497a-9c0d-114af6464270 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:56.274442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-874689ce-a192-497a-9c0d-114af6464270 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:56.294095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-874689ce-a192-497a-9c0d-114af6464270 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:56.294513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-874689ce-a192-497a-9c0d-114af6464270 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:56.299774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-874689ce-a192-497a-9c0d-114af6464270 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:56.301826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-874689ce-a192-497a-9c0d-114af6464270 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:56.373153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-acf6d37e-4fc4-4ba5-a9d1-9c1c68bd20e6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:56.373829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-acf6d37e-4fc4-4ba5-a9d1-9c1c68bd20e6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:56.387074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-acf6d37e-4fc4-4ba5-a9d1-9c1c68bd20e6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:56.387074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-acf6d37e-4fc4-4ba5-a9d1-9c1c68bd20e6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:56.387814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-acf6d37e-4fc4-4ba5-a9d1-9c1c68bd20e6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:56.399786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-acf6d37e-4fc4-4ba5-a9d1-9c1c68bd20e6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:56.738184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-acf6d37e-4fc4-4ba5-a9d1-9c1c68bd20e6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:56.755941 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-acf6d37e-4fc4-4ba5-a9d1-9c1c68bd20e6 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1320 microversion: 2.1 time: 0.386647 Jul 20 04:09:56.760497 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 158/357] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:56 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1320 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:56.768789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-00f6c647-5197-4e52-a2d9-04ae79c98f6b req-85a0aad5-cfdb-4989-bd20-11c45f7957a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b6078c1-237a-4580-a06e-07c3e671ffc9", "name": "network-vif-plugged", "status": "completed", "tag": "7bdf5925-4923-4c2b-892d-3e9f038865fa"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:56.786812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-00f6c647-5197-4e52-a2d9-04ae79c98f6b req-85a0aad5-cfdb-4989-bd20-11c45f7957a9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:56.787804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-00f6c647-5197-4e52-a2d9-04ae79c98f6b req-85a0aad5-cfdb-4989-bd20-11c45f7957a9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:56.810235 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-00f6c647-5197-4e52-a2d9-04ae79c98f6b req-85a0aad5-cfdb-4989-bd20-11c45f7957a9 service nova] Creating event network-vif-plugged:7bdf5925-4923-4c2b-892d-3e9f038865fa for instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 on n-h2-826526-5 Jul 20 04:09:56.819879 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-00f6c647-5197-4e52-a2d9-04ae79c98f6b req-85a0aad5-cfdb-4989-bd20-11c45f7957a9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057027 Jul 20 04:09:56.820928 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 159/358] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:56.887705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e7722a67-bd6a-4f43-86a7-76dfe9875ad9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:56.891503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e7722a67-bd6a-4f43-86a7-76dfe9875ad9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:56.912770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7722a67-bd6a-4f43-86a7-76dfe9875ad9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:56.913329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7722a67-bd6a-4f43-86a7-76dfe9875ad9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:56.914555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7722a67-bd6a-4f43-86a7-76dfe9875ad9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:56.915094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7722a67-bd6a-4f43-86a7-76dfe9875ad9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:57.066343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-874689ce-a192-497a-9c0d-114af6464270 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:57.080540 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-874689ce-a192-497a-9c0d-114af6464270 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1468 microversion: 2.1 time: 0.813152 Jul 20 04:09:57.081376 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 200/359] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:56 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1468 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:57.281479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e7722a67-bd6a-4f43-86a7-76dfe9875ad9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:57.291809 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e7722a67-bd6a-4f43-86a7-76dfe9875ad9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1474 microversion: 2.1 time: 0.422128 Jul 20 04:09:57.296165 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 160/360] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:56 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1474 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:57.691098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b36d27a2-636f-455b-bdf6-7c0481f9c06e tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1589279559", "block_migration": true, "disk_over_commit": false}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:57.693640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b36d27a2-636f-455b-bdf6-7c0481f9c06e tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:57.702046 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b36d27a2-636f-455b-bdf6-7c0481f9c06e tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:57.702759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b36d27a2-636f-455b-bdf6-7c0481f9c06e tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:57.703717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b36d27a2-636f-455b-bdf6-7c0481f9c06e tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:57.704388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b36d27a2-636f-455b-bdf6-7c0481f9c06e tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:57.777264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-692c7538-652a-4e2c-b7f5-639ef9a2926c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:57.778074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-692c7538-652a-4e2c-b7f5-639ef9a2926c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:57.793979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-692c7538-652a-4e2c-b7f5-639ef9a2926c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:57.798260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-692c7538-652a-4e2c-b7f5-639ef9a2926c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:57.799089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-692c7538-652a-4e2c-b7f5-639ef9a2926c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:57.799568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-692c7538-652a-4e2c-b7f5-639ef9a2926c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:58.412000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-692c7538-652a-4e2c-b7f5-639ef9a2926c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:58.422697 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-692c7538-652a-4e2c-b7f5-639ef9a2926c tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1320 microversion: 2.1 time: 0.650351 Jul 20 04:09:58.432883 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 161/361] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:57 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1320 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:58.441166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a159bf03-db6b-4eea-a967-0a561e5a2910 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:58.453678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a159bf03-db6b-4eea-a967-0a561e5a2910 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:58.468655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a159bf03-db6b-4eea-a967-0a561e5a2910 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:58.469290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a159bf03-db6b-4eea-a967-0a561e5a2910 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:58.470242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a159bf03-db6b-4eea-a967-0a561e5a2910 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:58.470817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a159bf03-db6b-4eea-a967-0a561e5a2910 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:58.807324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-b36d27a2-636f-455b-bdf6-7c0481f9c06e tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lazy-loading 'flavor' on Instance uuid d6b121be-5714-4811-bee9-784322e4e43b {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:58.922351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b36d27a2-636f-455b-bdf6-7c0481f9c06e tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Going to try to live migrate instance to tempest-host-1589279559 {{(pid=127871) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:09:58.934512 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-b36d27a2-636f-455b-bdf6-7c0481f9c06e tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] HTTP exception thrown: Compute host tempest-host-1589279559 could not be found. Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b36d27a2-636f-455b-bdf6-7c0481f9c06e tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Request method failure captured: Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b/action HTTP/1.1 Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 107 Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_5O2gm3oGJIwjw7IDyjn8U92GqqzSeN61J79X9Kp9csUV1kzeUOk3aDB_rC9_azODqgtDL7ySqtQhsRDvD-yqA7gtQ9DF48Wlqvn3WveRAuu_zLp6RsgL9jQjgk2nBPQENls_JzKtQMzIM3kvVh0WGrjvk5Mbr7JsgH2qX-7pPENs Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 6a3909cf0d5542ab884943fd817f5965 Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-LiveMigrationNegativeTest-1597177836 Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:09:58.961379 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:09:58.963024 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6a3909cf0d5542ab884943fd817f5965"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6a3909cf0d5542ab884943fd817f5965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6a3909cf0d5542ab884943fd817f5965", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6a3909cf0d5542ab884943fd817f5965"}]}] Jul 20 04:09:58.963024 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-LiveMigrationNegativeTest-1597177836 Jul 20 04:09:58.963024 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 6a3909cf0d5542ab884943fd817f5965 Jul 20 04:09:58.963024 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1597177836 Jul 20 04:09:58.963024 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-LiveMigrationNegativeTest-1597177836-project-admin Jul 20 04:09:58.963024 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:09:58.963024 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:09:58.963024 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: e7524ff2433245ab9c1eb7b37567bd5e Jul 20 04:09:58.963024 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-LiveMigrationNegativeTest-1597177836-project-admin Jul 20 04:09:58.963024 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:09:58.963024 n-d-826526-5 devstack@n-api.service[127871]: {"os-migrateLive": {"host": "tempest-host-1589279559", "block_migration": true, "disk_over_commit": false}} Jul 20 04:09:58.963024 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: exception: Compute host tempest-host-1589279559 could not be found. Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'd6b121be-5714-4811-bee9-784322e4e43b', 'body': {'os-migrateLive': {'host': 'tempest-host-1589279559', 'block_migration': True, 'disk_over_commit': False}}} Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:09:58.964098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1589279559 could not be found. Jul 20 04:09:58.965468 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1589279559 could not be found. Jul 20 04:09:58.966777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:58.968237 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:58.968237 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:58.968237 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:58.968237 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:58.968237 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:58.968237 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:58.968237 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:58.968237 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1589279559 could not be found. Jul 20 04:09:58.968237 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:09:58.975508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b36d27a2-636f-455b-bdf6-7c0481f9c06e tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Returning 400 to user: Compute host tempest-host-1589279559 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:58.978632 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b36d27a2-636f-455b-bdf6-7c0481f9c06e tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b/action" status: 400 len: 100 microversion: 2.1 time: 1.880324 Jul 20 04:09:58.987543 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 201/362] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Jul 20 04:09:57 2022] POST /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b/action => generated 100 bytes in 1891 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:09:59.007137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-659cc934-0160-4997-88df-83d2138eb24d tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:59.008178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-659cc934-0160-4997-88df-83d2138eb24d tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:59.023746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-659cc934-0160-4997-88df-83d2138eb24d tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:59.024541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-659cc934-0160-4997-88df-83d2138eb24d tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:59.025740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-659cc934-0160-4997-88df-83d2138eb24d tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:59.026456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-659cc934-0160-4997-88df-83d2138eb24d tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:59.049016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a159bf03-db6b-4eea-a967-0a561e5a2910 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:59.060480 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a159bf03-db6b-4eea-a967-0a561e5a2910 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1474 microversion: 2.1 time: 0.632424 Jul 20 04:09:59.063570 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 162/363] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:58 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1474 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:59.441746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3684ec96-9b65-41ab-9071-24a415bb6f23 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:59.442825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3684ec96-9b65-41ab-9071-24a415bb6f23 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:59.457644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3684ec96-9b65-41ab-9071-24a415bb6f23 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:59.458449 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3684ec96-9b65-41ab-9071-24a415bb6f23 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:59.459728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3684ec96-9b65-41ab-9071-24a415bb6f23 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:59.460615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3684ec96-9b65-41ab-9071-24a415bb6f23 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:59.608754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-659cc934-0160-4997-88df-83d2138eb24d tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:59.621450 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-659cc934-0160-4997-88df-83d2138eb24d tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1468 microversion: 2.1 time: 0.628574 Jul 20 04:09:59.625286 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 202/364] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:58 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1468 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:59.703643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3684ec96-9b65-41ab-9071-24a415bb6f23 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:59.716483 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3684ec96-9b65-41ab-9071-24a415bb6f23 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1470 microversion: 2.1 time: 0.279473 Jul 20 04:09:59.717927 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 163/365] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:59 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:59.741267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-91196104-863e-478d-9dcc-8f997da40570 tempest-DeleteServersAdminTestJSON-455418741 tempest-DeleteServersAdminTestJSON-455418741-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:59.746498 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-91196104-863e-478d-9dcc-8f997da40570 tempest-DeleteServersAdminTestJSON-455418741 tempest-DeleteServersAdminTestJSON-455418741-project-admin] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:59.758207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91196104-863e-478d-9dcc-8f997da40570 tempest-DeleteServersAdminTestJSON-455418741 tempest-DeleteServersAdminTestJSON-455418741-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:59.761767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91196104-863e-478d-9dcc-8f997da40570 tempest-DeleteServersAdminTestJSON-455418741 tempest-DeleteServersAdminTestJSON-455418741-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:59.762993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91196104-863e-478d-9dcc-8f997da40570 tempest-DeleteServersAdminTestJSON-455418741 tempest-DeleteServersAdminTestJSON-455418741-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:59.765035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91196104-863e-478d-9dcc-8f997da40570 tempest-DeleteServersAdminTestJSON-455418741 tempest-DeleteServersAdminTestJSON-455418741-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:00.011335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9f1fbb62-1906-4a53-8f05-d44b93a3b62b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2053306087", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:00.086112 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-91196104-863e-478d-9dcc-8f997da40570 tempest-DeleteServersAdminTestJSON-455418741 tempest-DeleteServersAdminTestJSON-455418741-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9/action" status: 202 len: 0 microversion: 2.1 time: 0.348291 Jul 20 04:10:00.094880 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 203/366] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:09:59 2022] POST /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:00.104915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9d2688b1-3756-4816-b73d-d9cb7b8a9c16 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:00.109499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9d2688b1-3756-4816-b73d-d9cb7b8a9c16 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:00.123795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d2688b1-3756-4816-b73d-d9cb7b8a9c16 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:00.127769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d2688b1-3756-4816-b73d-d9cb7b8a9c16 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:00.129052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d2688b1-3756-4816-b73d-d9cb7b8a9c16 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:00.132720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d2688b1-3756-4816-b73d-d9cb7b8a9c16 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:00.133735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-9f1fbb62-1906-4a53-8f05-d44b93a3b62b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] validate_networks() for None {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:10:00.613481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-9f1fbb62-1906-4a53-8f05-d44b93a3b62b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:00.614269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-9f1fbb62-1906-4a53-8f05-d44b93a3b62b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:00.614987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-9f1fbb62-1906-4a53-8f05-d44b93a3b62b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:00.616177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-9f1fbb62-1906-4a53-8f05-d44b93a3b62b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:00.616836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-9f1fbb62-1906-4a53-8f05-d44b93a3b62b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:00.651276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f1fbb62-1906-4a53-8f05-d44b93a3b62b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:00.655218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f1fbb62-1906-4a53-8f05-d44b93a3b62b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:00.659039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f1fbb62-1906-4a53-8f05-d44b93a3b62b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:00.662787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f1fbb62-1906-4a53-8f05-d44b93a3b62b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:00.708575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-9f1fbb62-1906-4a53-8f05-d44b93a3b62b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Getting quotas for project f2a267e50d30497d93400d593631d3e7. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:00.723719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-9f1fbb62-1906-4a53-8f05-d44b93a3b62b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Getting quotas for user c2eb773226944c408149ae7f33b12dbe and project f2a267e50d30497d93400d593631d3e7. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:00.753055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9f1fbb62-1906-4a53-8f05-d44b93a3b62b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:10:00.757075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9f1fbb62-1906-4a53-8f05-d44b93a3b62b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:10:00.775259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9d2688b1-3756-4816-b73d-d9cb7b8a9c16 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:00.786433 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9d2688b1-3756-4816-b73d-d9cb7b8a9c16 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1474 microversion: 2.1 time: 0.690341 Jul 20 04:10:00.809241 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 204/367] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:00 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1474 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:00.815271 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1ae02694-c259-41ae-bc0a-fcfcec118a66 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:00.816070 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1ae02694-c259-41ae-bc0a-fcfcec118a66 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:00.823114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ae02694-c259-41ae-bc0a-fcfcec118a66 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:00.823726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ae02694-c259-41ae-bc0a-fcfcec118a66 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:00.824910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ae02694-c259-41ae-bc0a-fcfcec118a66 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:00.825490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ae02694-c259-41ae-bc0a-fcfcec118a66 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:00.886861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ae02694-c259-41ae-bc0a-fcfcec118a66 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:00.887578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ae02694-c259-41ae-bc0a-fcfcec118a66 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:00.889033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-1ae02694-c259-41ae-bc0a-fcfcec118a66 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lazy-loading 'fault' on Instance uuid 7b6078c1-237a-4580-a06e-07c3e671ffc9 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:10:00.932474 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9f1fbb62-1906-4a53-8f05-d44b93a3b62b tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.926160 Jul 20 04:10:00.943018 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 164/368] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:10:00.969228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cded2e79-6089-41a8-9096-3e8775988b70 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:00.970547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cded2e79-6089-41a8-9096-3e8775988b70 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:01.046904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cded2e79-6089-41a8-9096-3e8775988b70 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:01.060016 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cded2e79-6089-41a8-9096-3e8775988b70 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1219 microversion: 2.1 time: 0.114139 Jul 20 04:10:01.060858 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 165/369] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:00 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1219 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:01.170059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1ae02694-c259-41ae-bc0a-fcfcec118a66 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:01.183344 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1ae02694-c259-41ae-bc0a-fcfcec118a66 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1453 microversion: 2.1 time: 0.372983 Jul 20 04:10:01.195916 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 205/370] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:00 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1453 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:01.203159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b06c63fd-783a-4f56-a6b7-515d977b06fa tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:01.203814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b06c63fd-783a-4f56-a6b7-515d977b06fa tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:01.212552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b06c63fd-783a-4f56-a6b7-515d977b06fa tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.213007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b06c63fd-783a-4f56-a6b7-515d977b06fa tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.214558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b06c63fd-783a-4f56-a6b7-515d977b06fa tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.215221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b06c63fd-783a-4f56-a6b7-515d977b06fa tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.261011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b06c63fd-783a-4f56-a6b7-515d977b06fa tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:10:01.547623 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b06c63fd-783a-4f56-a6b7-515d977b06fa tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 204 len: 0 microversion: 2.1 time: 0.350594 Jul 20 04:10:01.548325 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 166/371] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:10:01 2022] DELETE /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:10:01.557200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-be582fe9-4b53-47b1-acb5-4435cd84d336 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:01.557917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-be582fe9-4b53-47b1-acb5-4435cd84d336 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:01.581045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be582fe9-4b53-47b1-acb5-4435cd84d336 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.582221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be582fe9-4b53-47b1-acb5-4435cd84d336 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.584470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be582fe9-4b53-47b1-acb5-4435cd84d336 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.587123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be582fe9-4b53-47b1-acb5-4435cd84d336 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.693454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:01.709571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be582fe9-4b53-47b1-acb5-4435cd84d336 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.713575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be582fe9-4b53-47b1-acb5-4435cd84d336 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.714692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-be582fe9-4b53-47b1-acb5-4435cd84d336 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lazy-loading 'fault' on Instance uuid 7b6078c1-237a-4580-a06e-07c3e671ffc9 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:10:02.014965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-31d8e25c-c5d2-45f1-8a1d-d6d343b67bac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-165937239", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "08ef3e3e-6870-4bac-a7ee-1dba3bc5da77"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:02.019684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-be582fe9-4b53-47b1-acb5-4435cd84d336 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:02.041052 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-be582fe9-4b53-47b1-acb5-4435cd84d336 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1459 microversion: 2.1 time: 0.484383 Jul 20 04:10:02.042955 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 167/372] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:01 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1459 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:02.059218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-96e3161d-919f-4966-8c4e-78f161e06b3e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:02.059949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-96e3161d-919f-4966-8c4e-78f161e06b3e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:02.076738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96e3161d-919f-4966-8c4e-78f161e06b3e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:02.077418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96e3161d-919f-4966-8c4e-78f161e06b3e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:02.078556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96e3161d-919f-4966-8c4e-78f161e06b3e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:02.079161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96e3161d-919f-4966-8c4e-78f161e06b3e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:02.086269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:02.135388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-31d8e25c-c5d2-45f1-8a1d-d6d343b67bac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] validate_networks() for [('08ef3e3e-6870-4bac-a7ee-1dba3bc5da77', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:10:02.299060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-96e3161d-919f-4966-8c4e-78f161e06b3e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:02.312086 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-96e3161d-919f-4966-8c4e-78f161e06b3e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1474 microversion: 2.1 time: 0.267824 Jul 20 04:10:02.313095 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 168/373] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:02 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1474 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:02.409396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-61ebad4d-525d-419c-836e-c6e351ca3633 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-592007648", "ram": 512, "vcpus": 1, "disk": 10, "id": 1379730885, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:02.411183 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:02.411183 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:02.443391 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-61ebad4d-525d-419c-836e-c6e351ca3633 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.129019 Jul 20 04:10:02.454515 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 169/374] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:02 2022] POST /compute/v2.1/flavors => generated 415 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:02.460326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-107e6b02-8790-4179-b279-9c4ededac52a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:02.461191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-107e6b02-8790-4179-b279-9c4ededac52a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:02.470448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-107e6b02-8790-4179-b279-9c4ededac52a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:02.471091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-107e6b02-8790-4179-b279-9c4ededac52a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:02.472119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-107e6b02-8790-4179-b279-9c4ededac52a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:02.473068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-107e6b02-8790-4179-b279-9c4ededac52a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:02.732247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-107e6b02-8790-4179-b279-9c4ededac52a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:02.743580 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-107e6b02-8790-4179-b279-9c4ededac52a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1223 microversion: 2.1 time: 0.287680 Jul 20 04:10:02.756700 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 170/375] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:02 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1223 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:03.329682 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0fb88cb1-7196-4847-830f-79214400cb49 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:03.340780 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-0fb88cb1-7196-4847-830f-79214400cb49 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] HTTP exception thrown: Flavor 1379730885 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0fb88cb1-7196-4847-830f-79214400cb49 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] Request method failure captured: Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/flavors/1379730885/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14AXXyUD9LbtMdcSHxn2rc3Lm70pxTHrHApw31S_RsJe8SY7wls6TN3oZqtOV7Gz0kP2cv5kCOyMG0Bz9DQRgHfGrnrcPbHsb0D8qz9Vzc_LHEV0TQlqwxgGz6YnthwYy74GeQwflG9ZmMYnUt86MpPQnBur3K6lbny8ioVNTCHbfuo Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 42e94f61eef244e6ae39dee66a3724ba Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:10:03.342924 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:10:03.344380 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42e94f61eef244e6ae39dee66a3724ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/42e94f61eef244e6ae39dee66a3724ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_42e94f61eef244e6ae39dee66a3724ba", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42e94f61eef244e6ae39dee66a3724ba"}]}] Jul 20 04:10:03.344380 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 Jul 20 04:10:03.344380 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 42e94f61eef244e6ae39dee66a3724ba Jul 20 04:10:03.344380 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 Jul 20 04:10:03.344380 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project Jul 20 04:10:03.344380 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:10:03.344380 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:10:03.344380 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 551672afcd384225b9af913a72fbe622 Jul 20 04:10:03.344380 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project Jul 20 04:10:03.344380 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:10:03.344380 n-d-826526-5 devstack@n-api.service[127870]: exception: Flavor 1379730885 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'flavor_id': '1379730885', 'id': 'hw:cpu_thread_policy'} Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1379730885 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:03.344991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:03.346215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:03.346215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:03.346215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:03.346215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:03.346215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:03.346215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1379730885 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:10:03.346215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:03.347812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0fb88cb1-7196-4847-830f-79214400cb49 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] Returning 404 to user: Flavor 1379730885 has no extra specs with key hw:cpu_thread_policy. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:03.348964 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0fb88cb1-7196-4847-830f-79214400cb49 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] 10.222.0.17 "GET /compute/v2.1/flavors/1379730885/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.588549 Jul 20 04:10:03.350012 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 171/376] 10.222.0.17 () {58 vars in 1265 bytes} [Wed Jul 20 04:10:02 2022] GET /compute/v2.1/flavors/1379730885/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 591 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:03.356071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea15f39c-2301-43eb-b172-c7380396a342 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:03.357040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ea15f39c-2301-43eb-b172-c7380396a342 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:03.365951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea15f39c-2301-43eb-b172-c7380396a342 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:03.366664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea15f39c-2301-43eb-b172-c7380396a342 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:03.368612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea15f39c-2301-43eb-b172-c7380396a342 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:03.369250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea15f39c-2301-43eb-b172-c7380396a342 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:03.434632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea15f39c-2301-43eb-b172-c7380396a342 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:03.435281 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea15f39c-2301-43eb-b172-c7380396a342 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:03.437239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-ea15f39c-2301-43eb-b172-c7380396a342 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lazy-loading 'fault' on Instance uuid 7b6078c1-237a-4580-a06e-07c3e671ffc9 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:10:03.831102 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ea15f39c-2301-43eb-b172-c7380396a342 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:03.851258 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ea15f39c-2301-43eb-b172-c7380396a342 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1459 microversion: 2.1 time: 0.499943 Jul 20 04:10:03.852566 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 172/377] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:03 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1459 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:03.857722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e48597fc-04aa-4993-a75d-2368378ebb0f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:03.859200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e48597fc-04aa-4993-a75d-2368378ebb0f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:03.867840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e48597fc-04aa-4993-a75d-2368378ebb0f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:03.868666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e48597fc-04aa-4993-a75d-2368378ebb0f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:03.870021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e48597fc-04aa-4993-a75d-2368378ebb0f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:03.870659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e48597fc-04aa-4993-a75d-2368378ebb0f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:03.967029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-31d8e25c-c5d2-45f1-8a1d-d6d343b67bac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:03.968507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-31d8e25c-c5d2-45f1-8a1d-d6d343b67bac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:03.968986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-31d8e25c-c5d2-45f1-8a1d-d6d343b67bac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:03.969467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-31d8e25c-c5d2-45f1-8a1d-d6d343b67bac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:03.971025 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-31d8e25c-c5d2-45f1-8a1d-d6d343b67bac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:03.983937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31d8e25c-c5d2-45f1-8a1d-d6d343b67bac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:03.984675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31d8e25c-c5d2-45f1-8a1d-d6d343b67bac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:03.986319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31d8e25c-c5d2-45f1-8a1d-d6d343b67bac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:03.987278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31d8e25c-c5d2-45f1-8a1d-d6d343b67bac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:04.023993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-31d8e25c-c5d2-45f1-8a1d-d6d343b67bac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Getting quotas for project 8d4037629b9e4e6fa92e2a8d89cf0311. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:04.032650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-31d8e25c-c5d2-45f1-8a1d-d6d343b67bac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Getting quotas for user 45a9bfefde81473d88610b03e0de9bf4 and project 8d4037629b9e4e6fa92e2a8d89cf0311. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:04.051779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-31d8e25c-c5d2-45f1-8a1d-d6d343b67bac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:10:04.055912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-31d8e25c-c5d2-45f1-8a1d-d6d343b67bac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:10:04.136791 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-31d8e25c-c5d2-45f1-8a1d-d6d343b67bac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.784880 Jul 20 04:10:04.138631 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 206/378] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 04:10:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2788 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:10:04.145709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a69ba945-7dd2-4f53-bfac-fe592425ff5f tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:04.148579 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:04.148579 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:10:04.150015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a69ba945-7dd2-4f53-bfac-fe592425ff5f tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '551672afcd384225b9af913a72fbe622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e94f61eef244e6ae39dee66a3724ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a69ba945-7dd2-4f53-bfac-fe592425ff5f tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] Request method failure captured: Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/flavors/1379730885/os-extra_specs HTTP/1.1 Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 66 Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14AXXyUD9LbtMdcSHxn2rc3Lm70pxTHrHApw31S_RsJe8SY7wls6TN3oZqtOV7Gz0kP2cv5kCOyMG0Bz9DQRgHfGrnrcPbHsb0D8qz9Vzc_LHEV0TQlqwxgGz6YnthwYy74GeQwflG9ZmMYnUt86MpPQnBur3K6lbny8ioVNTCHbfuo Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 42e94f61eef244e6ae39dee66a3724ba Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:10:04.153778 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:10:04.155315 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42e94f61eef244e6ae39dee66a3724ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/42e94f61eef244e6ae39dee66a3724ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_42e94f61eef244e6ae39dee66a3724ba", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42e94f61eef244e6ae39dee66a3724ba"}]}] Jul 20 04:10:04.155315 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 Jul 20 04:10:04.155315 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 42e94f61eef244e6ae39dee66a3724ba Jul 20 04:10:04.155315 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 Jul 20 04:10:04.155315 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project Jul 20 04:10:04.155315 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:10:04.155315 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:10:04.155315 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 551672afcd384225b9af913a72fbe622 Jul 20 04:10:04.155315 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project Jul 20 04:10:04.155315 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:10:04.155315 n-d-826526-5 devstack@n-api.service[127871]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 20 04:10:04.155315 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'flavor_id': '1379730885', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:04.156122 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 20 04:10:04.157593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:04.161814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a69ba945-7dd2-4f53-bfac-fe592425ff5f tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:04.163614 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a69ba945-7dd2-4f53-bfac-fe592425ff5f tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] 10.222.0.17 "POST /compute/v2.1/flavors/1379730885/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.023646 Jul 20 04:10:04.166304 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 207/379] 10.222.0.17 () {60 vars in 1223 bytes} [Wed Jul 20 04:10:04 2022] POST /compute/v2.1/flavors/1379730885/os-extra_specs => generated 124 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:04.481350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-714cc4fb-fb90-4304-973b-1925ebc15ab3 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Calling method '.version_select at 0x7f06be745a60>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:04.483647 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:04.483647 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:10:04.485899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-714cc4fb-fb90-4304-973b-1925ebc15ab3 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:04.489051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-714cc4fb-fb90-4304-973b-1925ebc15ab3 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:04.490574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-714cc4fb-fb90-4304-973b-1925ebc15ab3 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:04.492493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-714cc4fb-fb90-4304-973b-1925ebc15ab3 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:04.524584 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-714cc4fb-fb90-4304-973b-1925ebc15ab3 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.356886 Jul 20 04:10:04.530910 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 208/380] 10.222.0.17 () {58 vars in 1127 bytes} [Wed Jul 20 04:10:04 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:04.531049 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-682d95ee-a657-4c34-80ae-f7f125cd3400 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:04.531974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-682d95ee-a657-4c34-80ae-f7f125cd3400 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:04.540690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-682d95ee-a657-4c34-80ae-f7f125cd3400 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:04.541347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-682d95ee-a657-4c34-80ae-f7f125cd3400 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:04.542556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-682d95ee-a657-4c34-80ae-f7f125cd3400 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:04.543358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-682d95ee-a657-4c34-80ae-f7f125cd3400 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:05.242675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e48597fc-04aa-4993-a75d-2368378ebb0f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:05.248868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-682d95ee-a657-4c34-80ae-f7f125cd3400 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:05.252658 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e48597fc-04aa-4993-a75d-2368378ebb0f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1473 microversion: 2.1 time: 1.398736 Jul 20 04:10:05.253261 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 173/381] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:03 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1473 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:05.272429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9f2ae1f4-b776-4eea-8259-143efb4dd063 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:05.278488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9f2ae1f4-b776-4eea-8259-143efb4dd063 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:05.280302 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-682d95ee-a657-4c34-80ae-f7f125cd3400 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1277 microversion: 2.1 time: 0.753548 Jul 20 04:10:05.281834 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 209/382] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:04 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1277 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:05.294351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a19ee4cb-73b0-45ae-ac2a-df502c57add9 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:05.297342 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:05.297342 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:10:05.312707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f2ae1f4-b776-4eea-8259-143efb4dd063 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.314814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f2ae1f4-b776-4eea-8259-143efb4dd063 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:05.320621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f2ae1f4-b776-4eea-8259-143efb4dd063 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.322354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f2ae1f4-b776-4eea-8259-143efb4dd063 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:05.370154 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a19ee4cb-73b0-45ae-ac2a-df502c57add9 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1379730885/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.084932 Jul 20 04:10:05.373291 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 210/383] 10.222.0.17 () {60 vars in 1223 bytes} [Wed Jul 20 04:10:05 2022] POST /compute/v2.1/flavors/1379730885/os-extra_specs => generated 66 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:10:05.406442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-866cc72d-8b34-4bec-a697-9a677677e097 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Calling method '.version_select at 0x7f06be7459d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:05.407681 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:05.407681 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:10:05.416586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-866cc72d-8b34-4bec-a697-9a677677e097 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.417057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-866cc72d-8b34-4bec-a697-9a677677e097 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:05.420335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-866cc72d-8b34-4bec-a697-9a677677e097 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.424382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-866cc72d-8b34-4bec-a697-9a677677e097 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:05.526966 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-866cc72d-8b34-4bec-a697-9a677677e097 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.151676 Jul 20 04:10:05.528880 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 211/384] 10.222.0.17 () {58 vars in 1138 bytes} [Wed Jul 20 04:10:05 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:05.556975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3c7a2451-9788-427e-be94-8d4eef137ce4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:05.557596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3c7a2451-9788-427e-be94-8d4eef137ce4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:05.575760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=83,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:05.583074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c7a2451-9788-427e-be94-8d4eef137ce4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.583530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c7a2451-9788-427e-be94-8d4eef137ce4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:05.588678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c7a2451-9788-427e-be94-8d4eef137ce4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.589267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c7a2451-9788-427e-be94-8d4eef137ce4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:05.614317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9f2ae1f4-b776-4eea-8259-143efb4dd063 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:05.631575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9f2ae1f4-b776-4eea-8259-143efb4dd063 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:05.655419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9f2ae1f4-b776-4eea-8259-143efb4dd063 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:05.656616 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9f2ae1f4-b776-4eea-8259-143efb4dd063 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1257 microversion: 2.25 time: 0.402407 Jul 20 04:10:05.667068 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 174/385] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:05 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1257 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:05.671540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-075a878f-1786-48bc-95cf-dcf72742c77d tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:05.683320 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:05.683320 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:05.684530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-075a878f-1786-48bc-95cf-dcf72742c77d tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '551672afcd384225b9af913a72fbe622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e94f61eef244e6ae39dee66a3724ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-075a878f-1786-48bc-95cf-dcf72742c77d tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] Request method failure captured: Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/flavors/1379730885/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14AXXyUD9LbtMdcSHxn2rc3Lm70pxTHrHApw31S_RsJe8SY7wls6TN3oZqtOV7Gz0kP2cv5kCOyMG0Bz9DQRgHfGrnrcPbHsb0D8qz9Vzc_LHEV0TQlqwxgGz6YnthwYy74GeQwflG9ZmMYnUt86MpPQnBur3K6lbny8ioVNTCHbfuo Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 42e94f61eef244e6ae39dee66a3724ba Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:10:05.686180 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:10:05.687427 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42e94f61eef244e6ae39dee66a3724ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/42e94f61eef244e6ae39dee66a3724ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_42e94f61eef244e6ae39dee66a3724ba", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42e94f61eef244e6ae39dee66a3724ba"}]}] Jul 20 04:10:05.687427 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 Jul 20 04:10:05.687427 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 42e94f61eef244e6ae39dee66a3724ba Jul 20 04:10:05.687427 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 Jul 20 04:10:05.687427 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project Jul 20 04:10:05.687427 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:10:05.687427 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:10:05.687427 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 551672afcd384225b9af913a72fbe622 Jul 20 04:10:05.687427 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project Jul 20 04:10:05.687427 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:10:05.687427 n-d-826526-5 devstack@n-api.service[127870]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'flavor_id': '1379730885', 'id': 'hw:numa_nodes'} Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:05.688156 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:05.690234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:05.690234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:05.690234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:05.690234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:05.690234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:05.690234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 20 04:10:05.690234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:05.690234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:05.690234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:05.690234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:05.690234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:05.690234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:05.690234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:05.690234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:05.690234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 20 04:10:05.690234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:05.690234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-075a878f-1786-48bc-95cf-dcf72742c77d tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:05.691356 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-075a878f-1786-48bc-95cf-dcf72742c77d tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] 10.222.0.17 "DELETE /compute/v2.1/flavors/1379730885/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.029113 Jul 20 04:10:05.691356 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 175/386] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 04:10:05 2022] DELETE /compute/v2.1/flavors/1379730885/os-extra_specs/hw:numa_nodes => generated 124 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:05.719149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8b0a8137-ff80-45a7-8352-5a7b08bf2c7e tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Calling method '.version_select at 0x7f06be970dc0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:05.720677 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:05.720677 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:05.726831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b0a8137-ff80-45a7-8352-5a7b08bf2c7e tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.737304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b0a8137-ff80-45a7-8352-5a7b08bf2c7e tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:05.738407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b0a8137-ff80-45a7-8352-5a7b08bf2c7e tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.740568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b0a8137-ff80-45a7-8352-5a7b08bf2c7e tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:05.741561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c7a2451-9788-427e-be94-8d4eef137ce4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.746532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c7a2451-9788-427e-be94-8d4eef137ce4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:05.747176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-3c7a2451-9788-427e-be94-8d4eef137ce4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lazy-loading 'fault' on Instance uuid 7b6078c1-237a-4580-a06e-07c3e671ffc9 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:10:05.795194 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8b0a8137-ff80-45a7-8352-5a7b08bf2c7e tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.087910 Jul 20 04:10:05.798501 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 176/387] 10.222.0.17 () {58 vars in 1144 bytes} [Wed Jul 20 04:10:05 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:10:05.815330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ad6e6338-984d-459b-9fdd-1d2e2316a5a1 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:05.817416 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:05.817416 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:05.912506 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ad6e6338-984d-459b-9fdd-1d2e2316a5a1 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1379730885/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.110794 Jul 20 04:10:05.929699 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 177/388] 10.222.0.17 () {60 vars in 1223 bytes} [Wed Jul 20 04:10:05 2022] POST /compute/v2.1/flavors/1379730885/os-extra_specs => generated 66 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:10:05.943085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-45506fa4-bf39-4fb8-9141-f28edb861461 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Calling method '.version_select at 0x7f06beb6be50>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:05.951604 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:05.951604 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:05.953307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45506fa4-bf39-4fb8-9141-f28edb861461 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.953934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45506fa4-bf39-4fb8-9141-f28edb861461 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:05.956772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45506fa4-bf39-4fb8-9141-f28edb861461 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.961249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45506fa4-bf39-4fb8-9141-f28edb861461 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:06.043018 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-45506fa4-bf39-4fb8-9141-f28edb861461 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.110184 Jul 20 04:10:06.047994 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 178/389] 10.222.0.17 () {58 vars in 1127 bytes} [Wed Jul 20 04:10:05 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:06.070076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5107b6cb-fba4-4502-9c2c-b0ba6391b005 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:06.071564 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:06.071564 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:06.072533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5107b6cb-fba4-4502-9c2c-b0ba6391b005 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '551672afcd384225b9af913a72fbe622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e94f61eef244e6ae39dee66a3724ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5107b6cb-fba4-4502-9c2c-b0ba6391b005 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] Request method failure captured: Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: request: PUT /compute/v2.1/flavors/1379730885/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 22 Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14AXXyUD9LbtMdcSHxn2rc3Lm70pxTHrHApw31S_RsJe8SY7wls6TN3oZqtOV7Gz0kP2cv5kCOyMG0Bz9DQRgHfGrnrcPbHsb0D8qz9Vzc_LHEV0TQlqwxgGz6YnthwYy74GeQwflG9ZmMYnUt86MpPQnBur3K6lbny8ioVNTCHbfuo Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 42e94f61eef244e6ae39dee66a3724ba Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:10:06.074197 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:10:06.075376 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42e94f61eef244e6ae39dee66a3724ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/42e94f61eef244e6ae39dee66a3724ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_42e94f61eef244e6ae39dee66a3724ba", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42e94f61eef244e6ae39dee66a3724ba"}]}] Jul 20 04:10:06.075376 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 Jul 20 04:10:06.075376 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 42e94f61eef244e6ae39dee66a3724ba Jul 20 04:10:06.075376 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 Jul 20 04:10:06.075376 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project Jul 20 04:10:06.075376 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:10:06.075376 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:10:06.075376 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 551672afcd384225b9af913a72fbe622 Jul 20 04:10:06.075376 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project Jul 20 04:10:06.075376 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:10:06.075376 n-d-826526-5 devstack@n-api.service[127870]: {"hw:numa_nodes": "1"} Jul 20 04:10:06.075376 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:10:06.075376 n-d-826526-5 devstack@n-api.service[127870]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'flavor_id': '1379730885', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:06.076084 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 20 04:10:06.077139 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:06.078121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5107b6cb-fba4-4502-9c2c-b0ba6391b005 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:06.078121 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5107b6cb-fba4-4502-9c2c-b0ba6391b005 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427 tempest-FlavorsExtraSpecsNegativeTestJSON-627296427-project] 10.222.0.17 "PUT /compute/v2.1/flavors/1379730885/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.030158 Jul 20 04:10:06.082163 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 179/390] 10.222.0.17 () {60 vars in 1264 bytes} [Wed Jul 20 04:10:06 2022] PUT /compute/v2.1/flavors/1379730885/os-extra_specs/hw:numa_nodes => generated 124 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:06.087717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d85e5819-cea4-4526-aff3-a857f0794061 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Calling method '.version_select at 0x7f06be981160>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:06.089247 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:06.089247 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:06.090769 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d85e5819-cea4-4526-aff3-a857f0794061 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:06.091371 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d85e5819-cea4-4526-aff3-a857f0794061 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:06.092362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d85e5819-cea4-4526-aff3-a857f0794061 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:06.092941 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d85e5819-cea4-4526-aff3-a857f0794061 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:06.125478 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d85e5819-cea4-4526-aff3-a857f0794061 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.041862 Jul 20 04:10:06.126674 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 180/391] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jul 20 04:10:06 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:06.136997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c129db33-4088-474d-8b60-5107b649e496 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:06.142023 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:06.142023 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:06.149769 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-c129db33-4088-474d-8b60-5107b649e496 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] HTTP exception thrown: Flavor 1379730885 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c129db33-4088-474d-8b60-5107b649e496 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] Request method failure captured: Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/flavors/1379730885/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14AZDUkibpD0oCo0Hpv8maNF3zmNe04o3m5zYPEhd_5UMOtCWAQvOjjLfTmK-YdsQImn18Ci2b6WcfgOt_UWaA4L9uW6sUKKtdggqZrPvexf6zMfaCsiRBgO7Lb2Ohdb7nZsNYokSnaPVsvHMtUjxzxcerxLxTeAhOi3NYMhk7EG8-4 Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: e1d82a0ac96a4b11bfad96a7b645b5b7 Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member,admin Jul 20 04:10:06.151555 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member,admin Jul 20 04:10:06.152760 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e1d82a0ac96a4b11bfad96a7b645b5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e1d82a0ac96a4b11bfad96a7b645b5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e1d82a0ac96a4b11bfad96a7b645b5b7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e1d82a0ac96a4b11bfad96a7b645b5b7"}]}] Jul 20 04:10:06.152760 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 Jul 20 04:10:06.152760 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: e1d82a0ac96a4b11bfad96a7b645b5b7 Jul 20 04:10:06.152760 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 Jul 20 04:10:06.152760 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin Jul 20 04:10:06.152760 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:10:06.152760 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:10:06.152760 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 604740b3c4254a6697bcd9077aa49f35 Jul 20 04:10:06.152760 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin Jul 20 04:10:06.152760 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:10:06.152760 n-d-826526-5 devstack@n-api.service[127870]: exception: Flavor 1379730885 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'flavor_id': '1379730885', 'id': 'hw:cpu_thread_policy'} Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1379730885 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:06.153372 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:06.154515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:06.154515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:06.154515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:06.154515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:06.154515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:06.154515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1379730885 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:10:06.154515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:06.156159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c129db33-4088-474d-8b60-5107b649e496 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] Returning 404 to user: Flavor 1379730885 has no extra specs with key hw:cpu_thread_policy. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:06.157295 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c129db33-4088-474d-8b60-5107b649e496 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1379730885/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.029464 Jul 20 04:10:06.164769 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 181/392] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 04:10:06 2022] DELETE /compute/v2.1/flavors/1379730885/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:06.169872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f0fba69f-1195-4866-9e96-7df9fa372597 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Calling method '.version_select at 0x7f06be970af0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:06.171929 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:06.171929 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:06.173526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f0fba69f-1195-4866-9e96-7df9fa372597 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:06.174272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f0fba69f-1195-4866-9e96-7df9fa372597 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:06.175301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f0fba69f-1195-4866-9e96-7df9fa372597 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:06.175946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f0fba69f-1195-4866-9e96-7df9fa372597 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:06.203336 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f0fba69f-1195-4866-9e96-7df9fa372597 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.037049 Jul 20 04:10:06.204942 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 182/393] 10.222.0.17 () {58 vars in 1127 bytes} [Wed Jul 20 04:10:06 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:06.210122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d27c03c9-bbf4-4b8c-beb4-8b7a98790b15 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:06.211706 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:06.211706 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:06.212940 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-d27c03c9-bbf4-4b8c-beb4-8b7a98790b15 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d27c03c9-bbf4-4b8c-beb4-8b7a98790b15 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] Request method failure captured: Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: request: PUT /compute/v2.1/flavors/1379730885/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 27 Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14AZDUkibpD0oCo0Hpv8maNF3zmNe04o3m5zYPEhd_5UMOtCWAQvOjjLfTmK-YdsQImn18Ci2b6WcfgOt_UWaA4L9uW6sUKKtdggqZrPvexf6zMfaCsiRBgO7Lb2Ohdb7nZsNYokSnaPVsvHMtUjxzxcerxLxTeAhOi3NYMhk7EG8-4 Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: e1d82a0ac96a4b11bfad96a7b645b5b7 Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member,admin Jul 20 04:10:06.215281 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member,admin Jul 20 04:10:06.216795 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e1d82a0ac96a4b11bfad96a7b645b5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e1d82a0ac96a4b11bfad96a7b645b5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e1d82a0ac96a4b11bfad96a7b645b5b7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e1d82a0ac96a4b11bfad96a7b645b5b7"}]}] Jul 20 04:10:06.216795 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 Jul 20 04:10:06.216795 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: e1d82a0ac96a4b11bfad96a7b645b5b7 Jul 20 04:10:06.216795 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 Jul 20 04:10:06.216795 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin Jul 20 04:10:06.216795 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:10:06.216795 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:10:06.216795 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 604740b3c4254a6697bcd9077aa49f35 Jul 20 04:10:06.216795 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin Jul 20 04:10:06.216795 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:10:06.216795 n-d-826526-5 devstack@n-api.service[127870]: {"hw:cpu_policy": "shared"} Jul 20 04:10:06.216795 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:10:06.216795 n-d-826526-5 devstack@n-api.service[127870]: exception: Request body and URI mismatch Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'flavor_id': '1379730885', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:06.217740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:06.218966 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:06.218966 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:06.218966 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 20 04:10:06.218966 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:06.222017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d27c03c9-bbf4-4b8c-beb4-8b7a98790b15 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:06.229186 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d27c03c9-bbf4-4b8c-beb4-8b7a98790b15 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/1379730885/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.022857 Jul 20 04:10:06.232878 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 183/394] 10.222.0.17 () {60 vars in 1264 bytes} [Wed Jul 20 04:10:06 2022] PUT /compute/v2.1/flavors/1379730885/os-extra_specs/hw:numa_nodes => generated 73 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:10:06.243864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-93dbe4ad-cd2c-4485-9daf-02f8aac023e1 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Calling method '.version_select at 0x7f06be970ca0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:06.258470 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:06.258470 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:06.278158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93dbe4ad-cd2c-4485-9daf-02f8aac023e1 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:06.278958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93dbe4ad-cd2c-4485-9daf-02f8aac023e1 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:06.321599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93dbe4ad-cd2c-4485-9daf-02f8aac023e1 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:06.328750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93dbe4ad-cd2c-4485-9daf-02f8aac023e1 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:06.377214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3c7a2451-9788-427e-be94-8d4eef137ce4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f013a3858af9433889e60ea288757de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3880edc93c4226bc33da852c29549d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:06.386271 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3c7a2451-9788-427e-be94-8d4eef137ce4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 200 len: 1417 microversion: 2.1 time: 0.854945 Jul 20 04:10:06.402870 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 212/395] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:05 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 1417 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:06.407920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dee44850-80bb-4691-8cd8-cb4aaefad2ac tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dee44850-80bb-4691-8cd8-cb4aaefad2ac tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] Request method failure captured: Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: request: PUT /compute/v2.1/flavors/1379730885/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 49 Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14AZDUkibpD0oCo0Hpv8maNF3zmNe04o3m5zYPEhd_5UMOtCWAQvOjjLfTmK-YdsQImn18Ci2b6WcfgOt_UWaA4L9uW6sUKKtdggqZrPvexf6zMfaCsiRBgO7Lb2Ohdb7nZsNYokSnaPVsvHMtUjxzxcerxLxTeAhOi3NYMhk7EG8-4 Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: e1d82a0ac96a4b11bfad96a7b645b5b7 Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:10:06.418148 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:10:06.419416 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e1d82a0ac96a4b11bfad96a7b645b5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e1d82a0ac96a4b11bfad96a7b645b5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e1d82a0ac96a4b11bfad96a7b645b5b7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e1d82a0ac96a4b11bfad96a7b645b5b7"}]}] Jul 20 04:10:06.419416 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 Jul 20 04:10:06.419416 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: e1d82a0ac96a4b11bfad96a7b645b5b7 Jul 20 04:10:06.419416 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 Jul 20 04:10:06.419416 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin Jul 20 04:10:06.419416 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:10:06.419416 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:10:06.419416 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 604740b3c4254a6697bcd9077aa49f35 Jul 20 04:10:06.419416 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin Jul 20 04:10:06.419416 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:10:06.419416 n-d-826526-5 devstack@n-api.service[127871]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 20 04:10:06.419416 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'flavor_id': '1379730885', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance: Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 20 04:10:06.420104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:06.421349 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:06.422400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:06.422400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:06.422400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:10:06.422400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:10:06.422400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 04:10:06.422400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:06.428238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dee44850-80bb-4691-8cd8-cb4aaefad2ac tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:06.431362 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dee44850-80bb-4691-8cd8-cb4aaefad2ac tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/1379730885/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.025189 Jul 20 04:10:06.432536 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 213/396] 10.222.0.17 () {60 vars in 1264 bytes} [Wed Jul 20 04:10:06 2022] PUT /compute/v2.1/flavors/1379730885/os-extra_specs/hw:numa_nodes => generated 117 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:10:06.447884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f52b2cb0-f1c7-42bf-9cb3-de059e77f6fa tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:06.448850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f52b2cb0-f1c7-42bf-9cb3-de059e77f6fa tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:06.459987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f52b2cb0-f1c7-42bf-9cb3-de059e77f6fa tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:06.469435 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-93dbe4ad-cd2c-4485-9daf-02f8aac023e1 tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/n-h2-826526-5" status: 200 len: 729 microversion: 2.1 time: 0.235161 Jul 20 04:10:06.470394 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 184/397] 10.222.0.17 () {58 vars in 1169 bytes} [Wed Jul 20 04:10:06 2022] GET /compute/v2.1/os-hosts/n-h2-826526-5 => generated 729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:06.471026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f52b2cb0-f1c7-42bf-9cb3-de059e77f6fa tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:06.472222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f52b2cb0-f1c7-42bf-9cb3-de059e77f6fa tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:06.472788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f52b2cb0-f1c7-42bf-9cb3-de059e77f6fa tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:06.493160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e3d63035-6ea9-4f64-8d58-8ca3b7f61496 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:06.493789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e3d63035-6ea9-4f64-8d58-8ca3b7f61496 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:06.508144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3d63035-6ea9-4f64-8d58-8ca3b7f61496 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:06.508778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3d63035-6ea9-4f64-8d58-8ca3b7f61496 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:06.509708 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3d63035-6ea9-4f64-8d58-8ca3b7f61496 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:06.510144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3d63035-6ea9-4f64-8d58-8ca3b7f61496 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:06.924696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e3d63035-6ea9-4f64-8d58-8ca3b7f61496 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:06.937494 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e3d63035-6ea9-4f64-8d58-8ca3b7f61496 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1277 microversion: 2.1 time: 0.459397 Jul 20 04:10:06.939206 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 185/398] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:06 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1277 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:06.947559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3220e914-ca38-415f-8b35-3c04f2411141 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:06.948334 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:06.948334 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:06.995966 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3220e914-ca38-415f-8b35-3c04f2411141 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1379730885" status: 202 len: 0 microversion: 2.1 time: 0.055189 Jul 20 04:10:06.997509 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 186/399] 10.222.0.17 () {58 vars in 1160 bytes} [Wed Jul 20 04:10:06 2022] DELETE /compute/v2.1/flavors/1379730885 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:07.009145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-21f6c5ed-f556-4935-aa4c-801fc3039d0f tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Calling method '.version_select at 0x7f06bea2e790>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:07.010365 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:07.010365 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:07.021564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21f6c5ed-f556-4935-aa4c-801fc3039d0f tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.022263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21f6c5ed-f556-4935-aa4c-801fc3039d0f tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.038309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21f6c5ed-f556-4935-aa4c-801fc3039d0f tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.038994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21f6c5ed-f556-4935-aa4c-801fc3039d0f tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.070030 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-21f6c5ed-f556-4935-aa4c-801fc3039d0f tempest-HostsAdminTestJSON-1899404996 tempest-HostsAdminTestJSON-1899404996-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/n-h1-826526-5" status: 200 len: 598 microversion: 2.1 time: 0.070689 Jul 20 04:10:07.071395 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 187/400] 10.222.0.17 () {58 vars in 1169 bytes} [Wed Jul 20 04:10:06 2022] GET /compute/v2.1/os-hosts/n-h1-826526-5 => generated 598 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:07.076816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d8de858e-35c8-4363-a4a6-cbfdefb78dcb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:07.086364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d8de858e-35c8-4363-a4a6-cbfdefb78dcb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:07.095945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8de858e-35c8-4363-a4a6-cbfdefb78dcb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.096690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8de858e-35c8-4363-a4a6-cbfdefb78dcb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.097680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8de858e-35c8-4363-a4a6-cbfdefb78dcb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.098694 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8de858e-35c8-4363-a4a6-cbfdefb78dcb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.403822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d8de858e-35c8-4363-a4a6-cbfdefb78dcb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:07.419450 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d8de858e-35c8-4363-a4a6-cbfdefb78dcb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:07.430604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d8de858e-35c8-4363-a4a6-cbfdefb78dcb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:07.435497 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d8de858e-35c8-4363-a4a6-cbfdefb78dcb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1319 microversion: 2.25 time: 0.359418 Jul 20 04:10:07.437705 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 188/401] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:07 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:07.463505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-52fa7b53-1efe-4d68-824f-d6365b0e65e4 req-2a845494-577f-48c8-8ef5-0fffc9013fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b6078c1-237a-4580-a06e-07c3e671ffc9", "name": "network-vif-deleted", "tag": "7bdf5925-4923-4c2b-892d-3e9f038865fa"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:07.468657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f52b2cb0-f1c7-42bf-9cb3-de059e77f6fa tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:07.481882 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f52b2cb0-f1c7-42bf-9cb3-de059e77f6fa tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1473 microversion: 2.1 time: 1.044981 Jul 20 04:10:07.482970 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 214/402] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:06 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1473 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:07.487510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8892f652-eccc-4f65-a0d4-074d3456ad52 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:07.513914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-52fa7b53-1efe-4d68-824f-d6365b0e65e4 req-2a845494-577f-48c8-8ef5-0fffc9013fdc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.514401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-52fa7b53-1efe-4d68-824f-d6365b0e65e4 req-2a845494-577f-48c8-8ef5-0fffc9013fdc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.565644 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-52fa7b53-1efe-4d68-824f-d6365b0e65e4 req-2a845494-577f-48c8-8ef5-0fffc9013fdc service nova] Creating event network-vif-deleted:7bdf5925-4923-4c2b-892d-3e9f038865fa for instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 on n-h2-826526-5 Jul 20 04:10:07.574231 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-52fa7b53-1efe-4d68-824f-d6365b0e65e4 req-2a845494-577f-48c8-8ef5-0fffc9013fdc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134712 Jul 20 04:10:07.579904 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 189/403] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:07.590192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-812f09a7-7b19-411a-aa1c-ef3c3b6625ab tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:07.590889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-812f09a7-7b19-411a-aa1c-ef3c3b6625ab tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:07.599431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-812f09a7-7b19-411a-aa1c-ef3c3b6625ab tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.599873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-812f09a7-7b19-411a-aa1c-ef3c3b6625ab tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.601027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-812f09a7-7b19-411a-aa1c-ef3c3b6625ab tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.602316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-812f09a7-7b19-411a-aa1c-ef3c3b6625ab tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.641111 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8892f652-eccc-4f65-a0d4-074d3456ad52 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885 tempest-FlavorsExtraSpecsNegativeTestJSON-1402310885-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.156628 Jul 20 04:10:07.642590 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 215/404] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:10:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:07.648968 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-812f09a7-7b19-411a-aa1c-ef3c3b6625ab tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] HTTP exception thrown: Instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 could not be found. Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-812f09a7-7b19-411a-aa1c-ef3c3b6625ab tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Request method failure captured: Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 HTTP/1.1 Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_UUzUhZktEE2tdIkAHOH9vRdqe1txcvLILauq-rUgGpaATHExKC8tauOhURHra2BCsn_3zhXnoodmGVbOUY2vwofok0-2LHqx7QUVt-0SiEbBOhKwWsam4wcMKhXoysEjtjNqtW8SwNnIc4tckbveN6ql_ICZXzPrEfVy5T1IxmlY Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 9c3880edc93c4226bc33da852c29549d Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-DeleteServersAdminTestJSON-83504900 Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:10:07.650676 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:10:07.651905 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c3880edc93c4226bc33da852c29549d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c3880edc93c4226bc33da852c29549d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c3880edc93c4226bc33da852c29549d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c3880edc93c4226bc33da852c29549d"}]}] Jul 20 04:10:07.651905 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-DeleteServersAdminTestJSON-83504900 Jul 20 04:10:07.651905 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 9c3880edc93c4226bc33da852c29549d Jul 20 04:10:07.651905 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-83504900 Jul 20 04:10:07.651905 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-DeleteServersAdminTestJSON-83504900-project Jul 20 04:10:07.651905 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:10:07.651905 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:10:07.651905 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f013a3858af9433889e60ea288757de2 Jul 20 04:10:07.651905 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-DeleteServersAdminTestJSON-83504900-project Jul 20 04:10:07.651905 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:10:07.651905 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 could not be found. Jul 20 04:10:07.651905 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '7b6078c1-237a-4580-a06e-07c3e671ffc9'} Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 could not be found. Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:07.652611 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:07.654292 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:07.654292 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:10:07.654292 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:10:07.654292 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:10:07.654292 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:10:07.654292 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:10:07.654292 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:07.654292 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 could not be found. Jul 20 04:10:07.654292 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:07.654292 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:07.654292 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:07.654292 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:07.654292 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:07.654292 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:07.654292 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:07.654292 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:07.654292 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 could not be found. Jul 20 04:10:07.654292 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:07.655367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-812f09a7-7b19-411a-aa1c-ef3c3b6625ab tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Returning 404 to user: Instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:07.655367 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-812f09a7-7b19-411a-aa1c-ef3c3b6625ab tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 404 len: 111 microversion: 2.1 time: 0.070922 Jul 20 04:10:07.655367 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 190/405] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:07 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:07.674913 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-17c3f190-5442-4e16-9776-441e23c2ebd4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:07.675923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-17c3f190-5442-4e16-9776-441e23c2ebd4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:07.715671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17c3f190-5442-4e16-9776-441e23c2ebd4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.718419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17c3f190-5442-4e16-9776-441e23c2ebd4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.731400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17c3f190-5442-4e16-9776-441e23c2ebd4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.735300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17c3f190-5442-4e16-9776-441e23c2ebd4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.805147 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-17c3f190-5442-4e16-9776-441e23c2ebd4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] HTTP exception thrown: Instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 could not be found. Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-17c3f190-5442-4e16-9776-441e23c2ebd4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Request method failure captured: Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 HTTP/1.1 Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_UUzUhZktEE2tdIkAHOH9vRdqe1txcvLILauq-rUgGpaATHExKC8tauOhURHra2BCsn_3zhXnoodmGVbOUY2vwofok0-2LHqx7QUVt-0SiEbBOhKwWsam4wcMKhXoysEjtjNqtW8SwNnIc4tckbveN6ql_ICZXzPrEfVy5T1IxmlY Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 9c3880edc93c4226bc33da852c29549d Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersAdminTestJSON-83504900 Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:10:07.812846 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:10:07.814261 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c3880edc93c4226bc33da852c29549d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c3880edc93c4226bc33da852c29549d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c3880edc93c4226bc33da852c29549d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c3880edc93c4226bc33da852c29549d"}]}] Jul 20 04:10:07.814261 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersAdminTestJSON-83504900 Jul 20 04:10:07.814261 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 9c3880edc93c4226bc33da852c29549d Jul 20 04:10:07.814261 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-83504900 Jul 20 04:10:07.814261 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersAdminTestJSON-83504900-project Jul 20 04:10:07.814261 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:10:07.814261 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:10:07.814261 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f013a3858af9433889e60ea288757de2 Jul 20 04:10:07.814261 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersAdminTestJSON-83504900-project Jul 20 04:10:07.814261 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:10:07.814261 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 could not be found. Jul 20 04:10:07.814261 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '7b6078c1-237a-4580-a06e-07c3e671ffc9'} Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 could not be found. Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:07.818285 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 could not be found. Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 could not be found. Jul 20 04:10:07.819632 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:07.822354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-17c3f190-5442-4e16-9776-441e23c2ebd4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Returning 404 to user: Instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:07.822354 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-17c3f190-5442-4e16-9776-441e23c2ebd4 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 404 len: 111 microversion: 2.1 time: 0.149151 Jul 20 04:10:07.823164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-99bf2515-ae80-41dd-a530-05557117bb32 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:07.823298 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 216/406] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:10:07 2022] DELETE /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:07.823787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-99bf2515-ae80-41dd-a530-05557117bb32 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: 7b6078c1-237a-4580-a06e-07c3e671ffc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:07.844139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-99bf2515-ae80-41dd-a530-05557117bb32 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.844679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-99bf2515-ae80-41dd-a530-05557117bb32 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.851235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-99bf2515-ae80-41dd-a530-05557117bb32 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.853844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-99bf2515-ae80-41dd-a530-05557117bb32 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.930257 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-99bf2515-ae80-41dd-a530-05557117bb32 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] HTTP exception thrown: Instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 could not be found. Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-99bf2515-ae80-41dd-a530-05557117bb32 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Request method failure captured: Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 HTTP/1.1 Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_UUzUhZktEE2tdIkAHOH9vRdqe1txcvLILauq-rUgGpaATHExKC8tauOhURHra2BCsn_3zhXnoodmGVbOUY2vwofok0-2LHqx7QUVt-0SiEbBOhKwWsam4wcMKhXoysEjtjNqtW8SwNnIc4tckbveN6ql_ICZXzPrEfVy5T1IxmlY Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 9c3880edc93c4226bc33da852c29549d Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-DeleteServersAdminTestJSON-83504900 Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:10:07.938360 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:10:07.939875 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c3880edc93c4226bc33da852c29549d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c3880edc93c4226bc33da852c29549d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c3880edc93c4226bc33da852c29549d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c3880edc93c4226bc33da852c29549d"}]}] Jul 20 04:10:07.939875 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-DeleteServersAdminTestJSON-83504900 Jul 20 04:10:07.939875 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 9c3880edc93c4226bc33da852c29549d Jul 20 04:10:07.939875 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-83504900 Jul 20 04:10:07.939875 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-DeleteServersAdminTestJSON-83504900-project Jul 20 04:10:07.939875 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:10:07.939875 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:10:07.939875 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f013a3858af9433889e60ea288757de2 Jul 20 04:10:07.939875 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-DeleteServersAdminTestJSON-83504900-project Jul 20 04:10:07.939875 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:10:07.939875 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 could not be found. Jul 20 04:10:07.939875 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '7b6078c1-237a-4580-a06e-07c3e671ffc9'} Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 could not be found. Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:07.940581 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:07.942625 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:07.942625 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:10:07.942625 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:10:07.942625 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:10:07.942625 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:10:07.942625 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:10:07.942625 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:07.942625 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 could not be found. Jul 20 04:10:07.942625 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:07.942625 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:07.942625 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:07.942625 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:07.942625 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:07.942625 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:07.942625 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:07.942625 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:07.942625 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 could not be found. Jul 20 04:10:07.942625 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:07.945350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-99bf2515-ae80-41dd-a530-05557117bb32 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Returning 404 to user: Instance 7b6078c1-237a-4580-a06e-07c3e671ffc9 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:07.949833 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-99bf2515-ae80-41dd-a530-05557117bb32 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9" status: 404 len: 111 microversion: 2.1 time: 0.130127 Jul 20 04:10:07.952979 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 191/407] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:07 2022] GET /compute/v2.1/servers/7b6078c1-237a-4580-a06e-07c3e671ffc9 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:07.955009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-131d94fa-1b12-472b-bedd-1b0331bc9cea tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:07.955680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-131d94fa-1b12-472b-bedd-1b0331bc9cea tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:07.965890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cb34892f-4518-4aec-bac2-6fbce0c853b2 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:07.966401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cb34892f-4518-4aec-bac2-6fbce0c853b2 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:07.971141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-131d94fa-1b12-472b-bedd-1b0331bc9cea tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.971592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-131d94fa-1b12-472b-bedd-1b0331bc9cea tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.974324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-131d94fa-1b12-472b-bedd-1b0331bc9cea tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.974721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-131d94fa-1b12-472b-bedd-1b0331bc9cea tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.989626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb34892f-4518-4aec-bac2-6fbce0c853b2 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.991945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb34892f-4518-4aec-bac2-6fbce0c853b2 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.993698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb34892f-4518-4aec-bac2-6fbce0c853b2 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.994669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb34892f-4518-4aec-bac2-6fbce0c853b2 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:08.042873 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-cb34892f-4518-4aec-bac2-6fbce0c853b2 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] HTTP exception thrown: Instance eaceccec-6030-408a-8b3e-94b704473d0a could not be found. Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cb34892f-4518-4aec-bac2-6fbce0c853b2 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Request method failure captured: Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a HTTP/1.1 Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_UUzUhZktEE2tdIkAHOH9vRdqe1txcvLILauq-rUgGpaATHExKC8tauOhURHra2BCsn_3zhXnoodmGVbOUY2vwofok0-2LHqx7QUVt-0SiEbBOhKwWsam4wcMKhXoysEjtjNqtW8SwNnIc4tckbveN6ql_ICZXzPrEfVy5T1IxmlY Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 9c3880edc93c4226bc33da852c29549d Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-DeleteServersAdminTestJSON-83504900 Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:10:08.045226 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:10:08.046442 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c3880edc93c4226bc33da852c29549d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c3880edc93c4226bc33da852c29549d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c3880edc93c4226bc33da852c29549d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c3880edc93c4226bc33da852c29549d"}]}] Jul 20 04:10:08.046442 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-DeleteServersAdminTestJSON-83504900 Jul 20 04:10:08.046442 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 9c3880edc93c4226bc33da852c29549d Jul 20 04:10:08.046442 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-83504900 Jul 20 04:10:08.046442 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-DeleteServersAdminTestJSON-83504900-project Jul 20 04:10:08.046442 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:10:08.046442 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:10:08.046442 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f013a3858af9433889e60ea288757de2 Jul 20 04:10:08.046442 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-DeleteServersAdminTestJSON-83504900-project Jul 20 04:10:08.046442 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:10:08.046442 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance eaceccec-6030-408a-8b3e-94b704473d0a could not be found. Jul 20 04:10:08.046442 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'eaceccec-6030-408a-8b3e-94b704473d0a'} Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaceccec-6030-408a-8b3e-94b704473d0a could not be found. Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:08.047085 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaceccec-6030-408a-8b3e-94b704473d0a could not be found. Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaceccec-6030-408a-8b3e-94b704473d0a could not be found. Jul 20 04:10:08.048158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:08.049265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cb34892f-4518-4aec-bac2-6fbce0c853b2 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Returning 404 to user: Instance eaceccec-6030-408a-8b3e-94b704473d0a could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:08.049265 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cb34892f-4518-4aec-bac2-6fbce0c853b2 tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "DELETE /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 404 len: 111 microversion: 2.1 time: 0.091078 Jul 20 04:10:08.055329 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 192/408] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:10:07 2022] DELETE /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:08.076792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bd0c1a71-e494-4c2a-b32b-3e384edc5e4d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:08.077674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bd0c1a71-e494-4c2a-b32b-3e384edc5e4d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] [instance: eaceccec-6030-408a-8b3e-94b704473d0a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:08.089846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd0c1a71-e494-4c2a-b32b-3e384edc5e4d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:08.092498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd0c1a71-e494-4c2a-b32b-3e384edc5e4d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:08.093457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd0c1a71-e494-4c2a-b32b-3e384edc5e4d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:08.095279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd0c1a71-e494-4c2a-b32b-3e384edc5e4d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:08.113377 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-bd0c1a71-e494-4c2a-b32b-3e384edc5e4d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] HTTP exception thrown: Instance eaceccec-6030-408a-8b3e-94b704473d0a could not be found. Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bd0c1a71-e494-4c2a-b32b-3e384edc5e4d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Request method failure captured: Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a HTTP/1.1 Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_UUzUhZktEE2tdIkAHOH9vRdqe1txcvLILauq-rUgGpaATHExKC8tauOhURHra2BCsn_3zhXnoodmGVbOUY2vwofok0-2LHqx7QUVt-0SiEbBOhKwWsam4wcMKhXoysEjtjNqtW8SwNnIc4tckbveN6ql_ICZXzPrEfVy5T1IxmlY Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 9c3880edc93c4226bc33da852c29549d Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-DeleteServersAdminTestJSON-83504900 Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:10:08.115173 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:10:08.116651 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c3880edc93c4226bc33da852c29549d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c3880edc93c4226bc33da852c29549d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c3880edc93c4226bc33da852c29549d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c3880edc93c4226bc33da852c29549d"}]}] Jul 20 04:10:08.116651 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-DeleteServersAdminTestJSON-83504900 Jul 20 04:10:08.116651 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 9c3880edc93c4226bc33da852c29549d Jul 20 04:10:08.116651 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-83504900 Jul 20 04:10:08.116651 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-DeleteServersAdminTestJSON-83504900-project Jul 20 04:10:08.116651 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:10:08.116651 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:10:08.116651 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f013a3858af9433889e60ea288757de2 Jul 20 04:10:08.116651 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-DeleteServersAdminTestJSON-83504900-project Jul 20 04:10:08.116651 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:10:08.116651 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance eaceccec-6030-408a-8b3e-94b704473d0a could not be found. Jul 20 04:10:08.116651 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'eaceccec-6030-408a-8b3e-94b704473d0a'} Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaceccec-6030-408a-8b3e-94b704473d0a could not be found. Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:08.117334 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:08.118450 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:08.118450 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:10:08.118450 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:10:08.118450 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:10:08.118450 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:10:08.118450 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:10:08.118450 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:08.118450 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaceccec-6030-408a-8b3e-94b704473d0a could not be found. Jul 20 04:10:08.118450 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:08.118450 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:08.118450 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:08.118450 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:08.118450 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:08.118450 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:08.118450 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:08.118450 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:08.118450 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaceccec-6030-408a-8b3e-94b704473d0a could not be found. Jul 20 04:10:08.118450 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:08.120822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bd0c1a71-e494-4c2a-b32b-3e384edc5e4d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] Returning 404 to user: Instance eaceccec-6030-408a-8b3e-94b704473d0a could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:08.122229 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bd0c1a71-e494-4c2a-b32b-3e384edc5e4d tempest-DeleteServersAdminTestJSON-83504900 tempest-DeleteServersAdminTestJSON-83504900-project] 10.222.0.17 "GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a" status: 404 len: 111 microversion: 2.1 time: 0.065022 Jul 20 04:10:08.123445 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 193/409] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:08 2022] GET /compute/v2.1/servers/eaceccec-6030-408a-8b3e-94b704473d0a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:08.180208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-131d94fa-1b12-472b-bedd-1b0331bc9cea tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:08.197789 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-131d94fa-1b12-472b-bedd-1b0331bc9cea tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1277 microversion: 2.1 time: 0.242408 Jul 20 04:10:08.205574 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 217/410] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:07 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1277 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:08.456742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6fb07615-ccd9-41b1-9880-c3aa2c879006 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:08.458143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6fb07615-ccd9-41b1-9880-c3aa2c879006 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:08.472551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6fb07615-ccd9-41b1-9880-c3aa2c879006 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:08.477334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6fb07615-ccd9-41b1-9880-c3aa2c879006 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:08.483117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6fb07615-ccd9-41b1-9880-c3aa2c879006 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:08.483577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6fb07615-ccd9-41b1-9880-c3aa2c879006 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:08.500782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c89a457-ddc3-4ea6-874d-a27a7f8a9bbc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:08.501391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0c89a457-ddc3-4ea6-874d-a27a7f8a9bbc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:08.514420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c89a457-ddc3-4ea6-874d-a27a7f8a9bbc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:08.520091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c89a457-ddc3-4ea6-874d-a27a7f8a9bbc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:08.525940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c89a457-ddc3-4ea6-874d-a27a7f8a9bbc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:08.527246 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c89a457-ddc3-4ea6-874d-a27a7f8a9bbc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:08.548426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:08.841317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6fb07615-ccd9-41b1-9880-c3aa2c879006 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:08.851858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6fb07615-ccd9-41b1-9880-c3aa2c879006 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:08.873548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6fb07615-ccd9-41b1-9880-c3aa2c879006 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:08.874739 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6fb07615-ccd9-41b1-9880-c3aa2c879006 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1319 microversion: 2.25 time: 0.423250 Jul 20 04:10:08.875292 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 194/411] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:08 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1319 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:09.224424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3306efa5-7b01-4fbe-b239-fead290afa69 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:09.225383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3306efa5-7b01-4fbe-b239-fead290afa69 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:09.240508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3306efa5-7b01-4fbe-b239-fead290afa69 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:09.241239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3306efa5-7b01-4fbe-b239-fead290afa69 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:09.242454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3306efa5-7b01-4fbe-b239-fead290afa69 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:09.243068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3306efa5-7b01-4fbe-b239-fead290afa69 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:09.582461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0c89a457-ddc3-4ea6-874d-a27a7f8a9bbc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:09.608659 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0c89a457-ddc3-4ea6-874d-a27a7f8a9bbc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1473 microversion: 2.1 time: 1.110100 Jul 20 04:10:09.611874 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 218/412] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:08 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1473 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:09.711933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-b3fd38a9-5157-4d16-9aba-054cefc81794 req-25d67872-2219-4948-a2ff-6eaf0d1c1665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb300df-ffbd-4b36-88f0-cb0e17340221", "name": "network-vif-unplugged", "status": "completed", "tag": "40ec11f2-83c0-4550-8566-1e9b3ffdcae2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:09.733352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-b3fd38a9-5157-4d16-9aba-054cefc81794 req-25d67872-2219-4948-a2ff-6eaf0d1c1665 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:09.733810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-b3fd38a9-5157-4d16-9aba-054cefc81794 req-25d67872-2219-4948-a2ff-6eaf0d1c1665 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:09.766041 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-b3fd38a9-5157-4d16-9aba-054cefc81794 req-25d67872-2219-4948-a2ff-6eaf0d1c1665 service nova] Creating event network-vif-unplugged:40ec11f2-83c0-4550-8566-1e9b3ffdcae2 for instance 0cb300df-ffbd-4b36-88f0-cb0e17340221 on n-h2-826526-5 Jul 20 04:10:09.796310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-b3fd38a9-5157-4d16-9aba-054cefc81794 req-25d67872-2219-4948-a2ff-6eaf0d1c1665 service nova] Instance 0cb300df-ffbd-4b36-88f0-cb0e17340221 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:10:09.824790 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-b3fd38a9-5157-4d16-9aba-054cefc81794 req-25d67872-2219-4948-a2ff-6eaf0d1c1665 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116241 Jul 20 04:10:09.828634 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 219/413] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:10:09.894489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-aa0dfdb3-8d57-418e-b627-b32ceee9f3b6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:09.895420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-aa0dfdb3-8d57-418e-b627-b32ceee9f3b6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:09.909314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa0dfdb3-8d57-418e-b627-b32ceee9f3b6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:09.909772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa0dfdb3-8d57-418e-b627-b32ceee9f3b6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:09.910630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa0dfdb3-8d57-418e-b627-b32ceee9f3b6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:09.911068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa0dfdb3-8d57-418e-b627-b32ceee9f3b6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:10.325684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3306efa5-7b01-4fbe-b239-fead290afa69 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:10.334326 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3306efa5-7b01-4fbe-b239-fead290afa69 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1319 microversion: 2.1 time: 1.115461 Jul 20 04:10:10.346797 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 195/414] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:09 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1319 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:10.634081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-daf4498b-3564-4568-b7fd-8dc65cfa01bf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:10.635029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-daf4498b-3564-4568-b7fd-8dc65cfa01bf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:10.646270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-daf4498b-3564-4568-b7fd-8dc65cfa01bf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:10.651214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-daf4498b-3564-4568-b7fd-8dc65cfa01bf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:10.652121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-daf4498b-3564-4568-b7fd-8dc65cfa01bf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:10.652605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-daf4498b-3564-4568-b7fd-8dc65cfa01bf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:10.735003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-aa0dfdb3-8d57-418e-b627-b32ceee9f3b6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:10.751422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-aa0dfdb3-8d57-418e-b627-b32ceee9f3b6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:10.753256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-aa0dfdb3-8d57-418e-b627-b32ceee9f3b6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:10.762335 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-aa0dfdb3-8d57-418e-b627-b32ceee9f3b6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1361 microversion: 2.25 time: 0.865914 Jul 20 04:10:10.763650 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 220/415] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:09 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1361 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:10:11.063369 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:11.263363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-daf4498b-3564-4568-b7fd-8dc65cfa01bf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:11.279169 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-daf4498b-3564-4568-b7fd-8dc65cfa01bf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1473 microversion: 2.1 time: 0.653322 Jul 20 04:10:11.280023 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 196/416] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:10 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1473 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:11.354827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f8ca8b26-b92d-4469-9ec3-0bc2f2348135 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:11.355692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f8ca8b26-b92d-4469-9ec3-0bc2f2348135 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:11.366767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8ca8b26-b92d-4469-9ec3-0bc2f2348135 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:11.368950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8ca8b26-b92d-4469-9ec3-0bc2f2348135 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:11.369967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8ca8b26-b92d-4469-9ec3-0bc2f2348135 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:11.373226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8ca8b26-b92d-4469-9ec3-0bc2f2348135 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:11.781111 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-934be891-5858-489d-85e6-dce3614e2ca5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:11.782515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-934be891-5858-489d-85e6-dce3614e2ca5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:11.789199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-934be891-5858-489d-85e6-dce3614e2ca5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:11.789873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-934be891-5858-489d-85e6-dce3614e2ca5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:11.790830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-934be891-5858-489d-85e6-dce3614e2ca5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:11.791420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-934be891-5858-489d-85e6-dce3614e2ca5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:12.010263 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f8ca8b26-b92d-4469-9ec3-0bc2f2348135 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:12.050158 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f8ca8b26-b92d-4469-9ec3-0bc2f2348135 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1319 microversion: 2.1 time: 0.697282 Jul 20 04:10:12.056201 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 221/417] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:11 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1319 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:12.150085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-af725a4b-c304-486e-8bc2-d8985e7e54f6 req-11d07b60-0e43-46be-8ef5-46b6c62e1eac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cb300df-ffbd-4b36-88f0-cb0e17340221", "tag": "40ec11f2-83c0-4550-8566-1e9b3ffdcae2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:12.169095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-af725a4b-c304-486e-8bc2-d8985e7e54f6 req-11d07b60-0e43-46be-8ef5-46b6c62e1eac service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:12.172601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-af725a4b-c304-486e-8bc2-d8985e7e54f6 req-11d07b60-0e43-46be-8ef5-46b6c62e1eac service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:12.210128 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-af725a4b-c304-486e-8bc2-d8985e7e54f6 req-11d07b60-0e43-46be-8ef5-46b6c62e1eac service nova] Creating event network-changed:40ec11f2-83c0-4550-8566-1e9b3ffdcae2 for instance 0cb300df-ffbd-4b36-88f0-cb0e17340221 on n-h2-826526-5 Jul 20 04:10:12.231298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-af725a4b-c304-486e-8bc2-d8985e7e54f6 req-11d07b60-0e43-46be-8ef5-46b6c62e1eac service nova] Instance 0cb300df-ffbd-4b36-88f0-cb0e17340221 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:10:12.247957 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-af725a4b-c304-486e-8bc2-d8985e7e54f6 req-11d07b60-0e43-46be-8ef5-46b6c62e1eac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101428 Jul 20 04:10:12.249988 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 222/418] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:12.304165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-89db9dfa-36d4-4a27-b5ba-0ffa58ba79c6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:12.304908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-89db9dfa-36d4-4a27-b5ba-0ffa58ba79c6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:12.317004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89db9dfa-36d4-4a27-b5ba-0ffa58ba79c6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:12.320909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89db9dfa-36d4-4a27-b5ba-0ffa58ba79c6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:12.322136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89db9dfa-36d4-4a27-b5ba-0ffa58ba79c6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:12.324101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89db9dfa-36d4-4a27-b5ba-0ffa58ba79c6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:12.597949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-934be891-5858-489d-85e6-dce3614e2ca5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:12.613930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-934be891-5858-489d-85e6-dce3614e2ca5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:12.623476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-934be891-5858-489d-85e6-dce3614e2ca5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:12.625054 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-934be891-5858-489d-85e6-dce3614e2ca5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1361 microversion: 2.25 time: 0.848121 Jul 20 04:10:12.630764 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 197/419] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:11 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1361 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:10:13.040868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-89db9dfa-36d4-4a27-b5ba-0ffa58ba79c6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:13.052859 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-89db9dfa-36d4-4a27-b5ba-0ffa58ba79c6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1473 microversion: 2.1 time: 0.753891 Jul 20 04:10:13.055107 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 223/420] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:12 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1473 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:13.074426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-59a80dc8-60b4-4e30-b688-8649592d801c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:13.076384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-59a80dc8-60b4-4e30-b688-8649592d801c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:13.117685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59a80dc8-60b4-4e30-b688-8649592d801c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:13.120317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59a80dc8-60b4-4e30-b688-8649592d801c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:13.123881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59a80dc8-60b4-4e30-b688-8649592d801c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:13.125806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59a80dc8-60b4-4e30-b688-8649592d801c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:13.175316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:13.647417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-06c4ab45-7716-48e1-92e4-3e80452278ff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:13.648534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-06c4ab45-7716-48e1-92e4-3e80452278ff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:13.659396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06c4ab45-7716-48e1-92e4-3e80452278ff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:13.660681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06c4ab45-7716-48e1-92e4-3e80452278ff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:13.662627 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06c4ab45-7716-48e1-92e4-3e80452278ff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:13.665003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06c4ab45-7716-48e1-92e4-3e80452278ff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:14.044844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:14.581120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-06c4ab45-7716-48e1-92e4-3e80452278ff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:14.598949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-06c4ab45-7716-48e1-92e4-3e80452278ff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:14.602735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-06c4ab45-7716-48e1-92e4-3e80452278ff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:14.603901 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-06c4ab45-7716-48e1-92e4-3e80452278ff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1361 microversion: 2.25 time: 0.960713 Jul 20 04:10:14.616987 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 224/421] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:13 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1361 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:14.642217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2a84bcca-7bcc-43df-91d8-dc68fc8bdd93 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:14.642850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2a84bcca-7bcc-43df-91d8-dc68fc8bdd93 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:14.666563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2a84bcca-7bcc-43df-91d8-dc68fc8bdd93 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:14.667005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2a84bcca-7bcc-43df-91d8-dc68fc8bdd93 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:14.674773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2a84bcca-7bcc-43df-91d8-dc68fc8bdd93 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:14.675266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2a84bcca-7bcc-43df-91d8-dc68fc8bdd93 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.424314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-59a80dc8-60b4-4e30-b688-8649592d801c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:15.437428 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-59a80dc8-60b4-4e30-b688-8649592d801c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1319 microversion: 2.1 time: 2.374234 Jul 20 04:10:15.456569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=10 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:15.458310 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 198/422] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:13 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1319 bytes in 2383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:15.480956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-db5f90c1-2e20-486a-bccb-13dca4c93f14 req-8954c4ce-1814-41ef-b1b4-9351f5feb25b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c9781b4-eca7-4c87-a044-605ac40a855d", "tag": "8a4ccdfa-1052-4ec9-80dc-c7009d86a1ba"}, {"name": "network-changed", "server_uuid": "ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a", "tag": "ac5fffab-5b76-4774-b5dc-86edfb73fa2e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:15.514650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-db5f90c1-2e20-486a-bccb-13dca4c93f14 req-8954c4ce-1814-41ef-b1b4-9351f5feb25b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.515985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-db5f90c1-2e20-486a-bccb-13dca4c93f14 req-8954c4ce-1814-41ef-b1b4-9351f5feb25b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.574090 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-db5f90c1-2e20-486a-bccb-13dca4c93f14 req-8954c4ce-1814-41ef-b1b4-9351f5feb25b service nova] Creating event network-changed:8a4ccdfa-1052-4ec9-80dc-c7009d86a1ba for instance 0c9781b4-eca7-4c87-a044-605ac40a855d on n-h1-826526-5 Jul 20 04:10:15.576282 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-db5f90c1-2e20-486a-bccb-13dca4c93f14 req-8954c4ce-1814-41ef-b1b4-9351f5feb25b service nova] Creating event network-changed:ac5fffab-5b76-4774-b5dc-86edfb73fa2e for instance ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a on n-h1-826526-5 Jul 20 04:10:15.604608 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-db5f90c1-2e20-486a-bccb-13dca4c93f14 req-8954c4ce-1814-41ef-b1b4-9351f5feb25b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.140802 Jul 20 04:10:15.605812 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 199/423] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:15.639532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b92336d6-7a25-4afc-91c4-ff983bfb9ac2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:15.641177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b92336d6-7a25-4afc-91c4-ff983bfb9ac2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:15.654953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b92336d6-7a25-4afc-91c4-ff983bfb9ac2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.662253 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b92336d6-7a25-4afc-91c4-ff983bfb9ac2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.663300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b92336d6-7a25-4afc-91c4-ff983bfb9ac2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.667508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b92336d6-7a25-4afc-91c4-ff983bfb9ac2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:16.009877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2a84bcca-7bcc-43df-91d8-dc68fc8bdd93 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:16.048402 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2a84bcca-7bcc-43df-91d8-dc68fc8bdd93 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1471 microversion: 2.1 time: 1.425707 Jul 20 04:10:16.052053 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 225/424] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:14 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1471 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:16.185529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=10 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:16.391394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b6300545-709b-40d6-a3d7-48be90699391 tempest-InstanceUsageAuditLogNegativeTestJSON-1753784547 tempest-InstanceUsageAuditLogNegativeTestJSON-1753784547-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:16.394789 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:16.394789 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:10:16.399771 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-b6300545-709b-40d6-a3d7-48be90699391 tempest-InstanceUsageAuditLogNegativeTestJSON-1753784547 tempest-InstanceUsageAuditLogNegativeTestJSON-1753784547-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b6300545-709b-40d6-a3d7-48be90699391 tempest-InstanceUsageAuditLogNegativeTestJSON-1753784547 tempest-InstanceUsageAuditLogNegativeTestJSON-1753784547-project-admin] Request method failure captured: Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14AnDLTl_MfbsNGr_gfCtUhckuzDakxCi1tFhXYmfgFeWG1b1UhlR3I67x_XoEEdFzZ02vUQ_wXf5jnrQjgfavBVLYR40_k0YYeUYAXqEh4t_UkNHdq6ZBCzNcm67NGXO_qmmxFC5mkScaSRpriStNxuM65_MlnquR2-25O2yNS6IcY Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 15d6fe165fb840e3879230af091f536c Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1753784547 Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:10:16.414457 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:10:16.416020 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15d6fe165fb840e3879230af091f536c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/15d6fe165fb840e3879230af091f536c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_15d6fe165fb840e3879230af091f536c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15d6fe165fb840e3879230af091f536c"}]}] Jul 20 04:10:16.416020 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1753784547 Jul 20 04:10:16.416020 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 15d6fe165fb840e3879230af091f536c Jul 20 04:10:16.416020 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1753784547 Jul 20 04:10:16.416020 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1753784547-project-admin Jul 20 04:10:16.416020 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:10:16.416020 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:10:16.416020 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: e8938b2634854f3f856ccf5a4671dd8f Jul 20 04:10:16.416020 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1753784547-project-admin Jul 20 04:10:16.416020 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:10:16.416020 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid timestamp for date invalid_time Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'invalid_time'} Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:16.416817 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:16.418113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 20 04:10:16.418113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 20 04:10:16.418113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 20 04:10:16.418113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:16.418113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:16.418113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:16.418113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:16.418113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:16.418113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:16.418113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:16.418113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:16.418113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 20 04:10:16.418113 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:16.418113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b6300545-709b-40d6-a3d7-48be90699391 tempest-InstanceUsageAuditLogNegativeTestJSON-1753784547 tempest-InstanceUsageAuditLogNegativeTestJSON-1753784547-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:16.418113 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b6300545-709b-40d6-a3d7-48be90699391 tempest-InstanceUsageAuditLogNegativeTestJSON-1753784547 tempest-InstanceUsageAuditLogNegativeTestJSON-1753784547-project-admin] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.362689 Jul 20 04:10:16.421202 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 226/425] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 04:10:16 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 367 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:10:16.569218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b92336d6-7a25-4afc-91c4-ff983bfb9ac2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:16.590174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b92336d6-7a25-4afc-91c4-ff983bfb9ac2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:16.600638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b92336d6-7a25-4afc-91c4-ff983bfb9ac2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:16.605361 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b92336d6-7a25-4afc-91c4-ff983bfb9ac2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1361 microversion: 2.25 time: 0.970514 Jul 20 04:10:16.606694 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 200/426] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:15 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1361 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:16.622014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-db7ef321-1acd-4b55-b72c-1463350430ac tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:16.623034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-db7ef321-1acd-4b55-b72c-1463350430ac tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:16.662010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db7ef321-1acd-4b55-b72c-1463350430ac tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:16.664169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db7ef321-1acd-4b55-b72c-1463350430ac tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:16.668633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db7ef321-1acd-4b55-b72c-1463350430ac tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:16.670900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db7ef321-1acd-4b55-b72c-1463350430ac tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:16.942943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-afa2381a-4d8f-4f82-a4ba-d88baa8f180a tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026 tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:16.944734 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:16.944734 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:10:16.946133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-afa2381a-4d8f-4f82-a4ba-d88baa8f180a tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026 tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'cdfbb4bb11d942e49fb144efb1bcbc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bff8b76f074b929ba070d31d70b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-afa2381a-4d8f-4f82-a4ba-d88baa8f180a tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026 tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026-project] Request method failure captured: Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Am9NoPIP5mRgTOxMnGLhKKbczakKafL4Yfgd0F923UfgpTZ-PEmlBWYm7t-uv4WTGhxkb5KiBtE-JLPb4iuGXy3hgWx76mvrsQZmhjW5FepyNDXj2zDuUhB1YYFpkjgx6NqQFPLqzhNjaPlZdz1my1yom6ORkvwtLVQo01E_OAB84 Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b3bff8b76f074b929ba070d31d70b776 Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026 Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:10:16.948236 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:10:16.949468 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b3bff8b76f074b929ba070d31d70b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b3bff8b76f074b929ba070d31d70b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b3bff8b76f074b929ba070d31d70b776", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b3bff8b76f074b929ba070d31d70b776"}]}] Jul 20 04:10:16.949468 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026 Jul 20 04:10:16.949468 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b3bff8b76f074b929ba070d31d70b776 Jul 20 04:10:16.949468 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026 Jul 20 04:10:16.949468 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026-project Jul 20 04:10:16.949468 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:10:16.949468 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:10:16.949468 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: cdfbb4bb11d942e49fb144efb1bcbc0b Jul 20 04:10:16.949468 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026-project Jul 20 04:10:16.949468 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:10:16.949468 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: action_args: {} Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:16.950165 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:16.951245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:16.951245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:16.951245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:16.951245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:16.951245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:16.951245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 20 04:10:16.951245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:16.951245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:16.951245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:16.951245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:16.951245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:16.951245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:16.951245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:16.951245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:16.951245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 20 04:10:16.951245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:16.960088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-afa2381a-4d8f-4f82-a4ba-d88baa8f180a tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026 tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:16.962397 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-afa2381a-4d8f-4f82-a4ba-d88baa8f180a tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026 tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026-project] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.539294 Jul 20 04:10:16.971957 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 227/427] 10.222.0.17 () {58 vars in 1184 bytes} [Wed Jul 20 04:10:16 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 549 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:16.985959 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-473c610f-e2eb-4e08-a32c-3fbd0c05f251 tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026 tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:16.989470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-473c610f-e2eb-4e08-a32c-3fbd0c05f251 tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026 tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'cdfbb4bb11d942e49fb144efb1bcbc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bff8b76f074b929ba070d31d70b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-473c610f-e2eb-4e08-a32c-3fbd0c05f251 tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026 tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026-project] Request method failure captured: Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20%2004:10:16 HTTP/1.1 Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Am9NoPIP5mRgTOxMnGLhKKbczakKafL4Yfgd0F923UfgpTZ-PEmlBWYm7t-uv4WTGhxkb5KiBtE-JLPb4iuGXy3hgWx76mvrsQZmhjW5FepyNDXj2zDuUhB1YYFpkjgx6NqQFPLqzhNjaPlZdz1my1yom6ORkvwtLVQo01E_OAB84 Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b3bff8b76f074b929ba070d31d70b776 Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026 Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:10:16.997053 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:10:16.998249 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b3bff8b76f074b929ba070d31d70b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b3bff8b76f074b929ba070d31d70b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b3bff8b76f074b929ba070d31d70b776", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b3bff8b76f074b929ba070d31d70b776"}]}] Jul 20 04:10:16.998249 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026 Jul 20 04:10:16.998249 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b3bff8b76f074b929ba070d31d70b776 Jul 20 04:10:16.998249 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026 Jul 20 04:10:16.998249 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026-project Jul 20 04:10:16.998249 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:10:16.998249 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:10:16.998249 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: cdfbb4bb11d942e49fb144efb1bcbc0b Jul 20 04:10:16.998249 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026-project Jul 20 04:10:16.998249 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:10:16.998249 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '2022-07-20 04:10:16'} Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:16.998854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:16.999881 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:16.999881 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:16.999881 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:16.999881 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:16.999881 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:16.999881 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 20 04:10:16.999881 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:16.999881 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:16.999881 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:16.999881 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:16.999881 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:16.999881 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:16.999881 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:16.999881 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:16.999881 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 20 04:10:16.999881 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:17.002654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-473c610f-e2eb-4e08-a32c-3fbd0c05f251 tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026 tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:17.003784 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-473c610f-e2eb-4e08-a32c-3fbd0c05f251 tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026 tempest-InstanceUsageAuditLogNegativeTestJSON-1733759026-project] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20 04:10:16" status: 403 len: 128 microversion: 2.1 time: 0.030362 Jul 20 04:10:17.009578 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 228/428] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 04:10:16 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20%2004%3A10%3A16 => generated 128 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:17.068459 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9864006f-385e-4235-9cb2-0f4eaf4b6b5a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:17.069173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9864006f-385e-4235-9cb2-0f4eaf4b6b5a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:17.082239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9864006f-385e-4235-9cb2-0f4eaf4b6b5a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:17.087747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9864006f-385e-4235-9cb2-0f4eaf4b6b5a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:17.092875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9864006f-385e-4235-9cb2-0f4eaf4b6b5a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:17.093478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9864006f-385e-4235-9cb2-0f4eaf4b6b5a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:17.364729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-db7ef321-1acd-4b55-b72c-1463350430ac tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:17.376360 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-db7ef321-1acd-4b55-b72c-1463350430ac tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1319 microversion: 2.1 time: 0.764590 Jul 20 04:10:17.378343 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 201/429] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:16 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1319 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:17.639857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4ffa668c-b202-4e61-9bcf-716c6ffdae25 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:17.641126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4ffa668c-b202-4e61-9bcf-716c6ffdae25 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:17.654700 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ffa668c-b202-4e61-9bcf-716c6ffdae25 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:17.669202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ffa668c-b202-4e61-9bcf-716c6ffdae25 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:17.670509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ffa668c-b202-4e61-9bcf-716c6ffdae25 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:17.671188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ffa668c-b202-4e61-9bcf-716c6ffdae25 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:17.843417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9864006f-385e-4235-9cb2-0f4eaf4b6b5a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:17.859625 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9864006f-385e-4235-9cb2-0f4eaf4b6b5a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1468 microversion: 2.1 time: 0.796404 Jul 20 04:10:17.876828 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 229/430] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:17 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1468 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:17.883912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0aefc569-e3e3-4ac0-a611-b74549521399 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:17.890555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0aefc569-e3e3-4ac0-a611-b74549521399 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:17.905988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0aefc569-e3e3-4ac0-a611-b74549521399 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:17.920024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0aefc569-e3e3-4ac0-a611-b74549521399 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:17.926198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0aefc569-e3e3-4ac0-a611-b74549521399 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:17.927051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0aefc569-e3e3-4ac0-a611-b74549521399 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:18.010297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4ffa668c-b202-4e61-9bcf-716c6ffdae25 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:18.032059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4ffa668c-b202-4e61-9bcf-716c6ffdae25 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:18.039793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4ffa668c-b202-4e61-9bcf-716c6ffdae25 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:18.047611 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4ffa668c-b202-4e61-9bcf-716c6ffdae25 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1361 microversion: 2.25 time: 0.415609 Jul 20 04:10:18.049211 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 202/431] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:17 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1361 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:10:18.074247 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0aefc569-e3e3-4ac0-a611-b74549521399 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "POST /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221/action" status: 204 len: 0 microversion: 2.1 time: 0.193601 Jul 20 04:10:18.080126 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 230/432] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:10:17 2022] POST /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221/action => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:10:18.086317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-464de9a9-1bda-4ff8-bee7-957c18dc87f0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:18.087056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-464de9a9-1bda-4ff8-bee7-957c18dc87f0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:18.096020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:18.099361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-464de9a9-1bda-4ff8-bee7-957c18dc87f0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:18.099812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-464de9a9-1bda-4ff8-bee7-957c18dc87f0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:18.101344 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-464de9a9-1bda-4ff8-bee7-957c18dc87f0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:18.101846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-464de9a9-1bda-4ff8-bee7-957c18dc87f0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:18.396475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6e792912-e76d-4753-9ef3-71810bb615af tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:18.397187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6e792912-e76d-4753-9ef3-71810bb615af tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:18.412188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e792912-e76d-4753-9ef3-71810bb615af tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:18.412804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e792912-e76d-4753-9ef3-71810bb615af tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:18.413652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e792912-e76d-4753-9ef3-71810bb615af tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:18.414282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e792912-e76d-4753-9ef3-71810bb615af tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:19.246594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-464de9a9-1bda-4ff8-bee7-957c18dc87f0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:19.264888 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-464de9a9-1bda-4ff8-bee7-957c18dc87f0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1468 microversion: 2.1 time: 1.184414 Jul 20 04:10:19.265798 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 203/433] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:18 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1468 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:19.281838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d0468c31-9287-497d-b3ff-734058925ce3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:19.282682 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d0468c31-9287-497d-b3ff-734058925ce3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:19.289826 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0468c31-9287-497d-b3ff-734058925ce3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:19.293271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0468c31-9287-497d-b3ff-734058925ce3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:19.294284 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0468c31-9287-497d-b3ff-734058925ce3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:19.298486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0468c31-9287-497d-b3ff-734058925ce3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:19.547574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6e792912-e76d-4753-9ef3-71810bb615af tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:19.561998 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6e792912-e76d-4753-9ef3-71810bb615af tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1319 microversion: 2.1 time: 1.170089 Jul 20 04:10:19.564901 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 231/434] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:18 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1319 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:19.841832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d0468c31-9287-497d-b3ff-734058925ce3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:19.850906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0046dc46-b0be-4317-921c-7b4a8ebdd270 tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Action: 'update', calling method: .version_select at 0x7f06be6dbb80>, body: {"quota_set": {"ram": "5120"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:19.855044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d0468c31-9287-497d-b3ff-734058925ce3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:19.856880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d0468c31-9287-497d-b3ff-734058925ce3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:19.861397 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d0468c31-9287-497d-b3ff-734058925ce3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1361 microversion: 2.25 time: 0.594456 Jul 20 04:10:19.862180 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 204/435] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:19 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1361 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:20.164130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0046dc46-b0be-4317-921c-7b4a8ebdd270 tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:20.164889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0046dc46-b0be-4317-921c-7b4a8ebdd270 tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:20.166397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0046dc46-b0be-4317-921c-7b4a8ebdd270 tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:20.167214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0046dc46-b0be-4317-921c-7b4a8ebdd270 tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:20.282590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8125db4a-2498-4fa5-8136-47b225eb1ea5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:20.283356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8125db4a-2498-4fa5-8136-47b225eb1ea5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:20.300799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8125db4a-2498-4fa5-8136-47b225eb1ea5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:20.301314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8125db4a-2498-4fa5-8136-47b225eb1ea5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:20.302120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8125db4a-2498-4fa5-8136-47b225eb1ea5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:20.304963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8125db4a-2498-4fa5-8136-47b225eb1ea5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:20.341261 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0046dc46-b0be-4317-921c-7b4a8ebdd270 tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/66e54da7c3a947f2b252bf46ffe38e73" status: 200 len: 148 microversion: 2.57 time: 0.774409 Jul 20 04:10:20.345405 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 232/436] 10.222.0.17 () {62 vars in 1302 bytes} [Wed Jul 20 04:10:19 2022] PUT /compute/v2.1/os-quota-sets/66e54da7c3a947f2b252bf46ffe38e73 => generated 148 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:10:20.361102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1483f59c-2a37-4972-89c0-e14a63950b1c tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Calling method '.version_select at 0x7f06be91d550>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:21.032380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1483f59c-2a37-4972-89c0-e14a63950b1c tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:21.036089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1483f59c-2a37-4972-89c0-e14a63950b1c tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:21.038604 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1483f59c-2a37-4972-89c0-e14a63950b1c tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:21.040064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1483f59c-2a37-4972-89c0-e14a63950b1c tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:21.102261 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1483f59c-2a37-4972-89c0-e14a63950b1c tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/66e54da7c3a947f2b252bf46ffe38e73/detail" status: 200 len: 463 microversion: 2.57 time: 0.748816 Jul 20 04:10:21.113916 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 233/437] 10.222.0.17 () {60 vars in 1303 bytes} [Wed Jul 20 04:10:20 2022] GET /compute/v2.1/os-quota-sets/66e54da7c3a947f2b252bf46ffe38e73/detail => generated 463 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:10:21.132066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ba96074d-8104-47da-bea6-cc6fe8b71707 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:21.133247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ba96074d-8104-47da-bea6-cc6fe8b71707 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:21.146104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba96074d-8104-47da-bea6-cc6fe8b71707 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:21.147710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba96074d-8104-47da-bea6-cc6fe8b71707 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:21.149163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba96074d-8104-47da-bea6-cc6fe8b71707 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:21.149805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba96074d-8104-47da-bea6-cc6fe8b71707 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:21.231391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8125db4a-2498-4fa5-8136-47b225eb1ea5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:21.248777 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8125db4a-2498-4fa5-8136-47b225eb1ea5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1468 microversion: 2.1 time: 0.969918 Jul 20 04:10:21.253945 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 205/438] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:20 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1468 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:21.266304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-398d655a-9314-45c8-bc1c-8514ef75f87d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:21.267262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-398d655a-9314-45c8-bc1c-8514ef75f87d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:21.281793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-398d655a-9314-45c8-bc1c-8514ef75f87d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:21.282611 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-398d655a-9314-45c8-bc1c-8514ef75f87d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:21.283601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-398d655a-9314-45c8-bc1c-8514ef75f87d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:21.284833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-398d655a-9314-45c8-bc1c-8514ef75f87d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:21.698758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ba96074d-8104-47da-bea6-cc6fe8b71707 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:21.711246 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ba96074d-8104-47da-bea6-cc6fe8b71707 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1319 microversion: 2.1 time: 0.595342 Jul 20 04:10:21.712177 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 234/439] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:21 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1319 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:21.718388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-557da372-2f02-4a93-a72f-b100a5b79ccc tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Action: 'update', calling method: .version_select at 0x7f06be6c68b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:21.940418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-557da372-2f02-4a93-a72f-b100a5b79ccc tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:21.942644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-557da372-2f02-4a93-a72f-b100a5b79ccc tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:21.946469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-557da372-2f02-4a93-a72f-b100a5b79ccc tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:21.947230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-557da372-2f02-4a93-a72f-b100a5b79ccc tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:22.128653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-557da372-2f02-4a93-a72f-b100a5b79ccc tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:22.129751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-557da372-2f02-4a93-a72f-b100a5b79ccc tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:22.134994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-557da372-2f02-4a93-a72f-b100a5b79ccc tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:22.137742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-557da372-2f02-4a93-a72f-b100a5b79ccc tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:22.160395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-398d655a-9314-45c8-bc1c-8514ef75f87d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:22.170846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-398d655a-9314-45c8-bc1c-8514ef75f87d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:22.179230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-398d655a-9314-45c8-bc1c-8514ef75f87d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:22.185948 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-398d655a-9314-45c8-bc1c-8514ef75f87d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1361 microversion: 2.25 time: 0.930492 Jul 20 04:10:22.197214 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 206/440] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:21 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1361 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:22.274186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c8eac6c0-7d5f-4b6e-a274-25d4eab5d013 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:22.275039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c8eac6c0-7d5f-4b6e-a274-25d4eab5d013 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:22.283643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8eac6c0-7d5f-4b6e-a274-25d4eab5d013 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:22.285495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8eac6c0-7d5f-4b6e-a274-25d4eab5d013 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:22.286508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8eac6c0-7d5f-4b6e-a274-25d4eab5d013 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:22.287161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8eac6c0-7d5f-4b6e-a274-25d4eab5d013 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:22.346968 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-557da372-2f02-4a93-a72f-b100a5b79ccc tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/66e54da7c3a947f2b252bf46ffe38e73?user_id=a53f9511d5ea4a3b810ddd2f5d3da19d" status: 200 len: 148 microversion: 2.57 time: 0.632893 Jul 20 04:10:22.347650 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 235/441] 10.222.0.17 () {62 vars in 1383 bytes} [Wed Jul 20 04:10:21 2022] PUT /compute/v2.1/os-quota-sets/66e54da7c3a947f2b252bf46ffe38e73?user_id=a53f9511d5ea4a3b810ddd2f5d3da19d => generated 148 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:10:22.360761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-169ef8d4-5446-4d13-a8ce-1b04771fd97b tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] Calling method '.version_select at 0x7f06be68a700>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:22.924223 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-169ef8d4-5446-4d13-a8ce-1b04771fd97b tempest-QuotasAdminTestV257-1427963491 tempest-QuotasAdminTestV257-1427963491-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/66e54da7c3a947f2b252bf46ffe38e73?user_id=a53f9511d5ea4a3b810ddd2f5d3da19d" status: 200 len: 190 microversion: 2.57 time: 0.568619 Jul 20 04:10:22.925394 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 236/442] 10.222.0.17 () {60 vars in 1363 bytes} [Wed Jul 20 04:10:22 2022] GET /compute/v2.1/os-quota-sets/66e54da7c3a947f2b252bf46ffe38e73?user_id=a53f9511d5ea4a3b810ddd2f5d3da19d => generated 190 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:10:22.942249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-64a91a7f-a58d-432d-b99c-87354fdfd99a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:22.947171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-64a91a7f-a58d-432d-b99c-87354fdfd99a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:22.985287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64a91a7f-a58d-432d-b99c-87354fdfd99a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:22.988677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64a91a7f-a58d-432d-b99c-87354fdfd99a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:22.991328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64a91a7f-a58d-432d-b99c-87354fdfd99a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:22.995041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64a91a7f-a58d-432d-b99c-87354fdfd99a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:23.559057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c8eac6c0-7d5f-4b6e-a274-25d4eab5d013 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:23.575086 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c8eac6c0-7d5f-4b6e-a274-25d4eab5d013 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1468 microversion: 2.1 time: 1.307153 Jul 20 04:10:23.578636 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 207/443] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:22 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1468 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:23.597086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-191ac356-21d8-4e93-ae02-60cd3e9a8904 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:23.597844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-191ac356-21d8-4e93-ae02-60cd3e9a8904 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:23.631225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-191ac356-21d8-4e93-ae02-60cd3e9a8904 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:23.636095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-191ac356-21d8-4e93-ae02-60cd3e9a8904 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:23.637117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-191ac356-21d8-4e93-ae02-60cd3e9a8904 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:23.637571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-191ac356-21d8-4e93-ae02-60cd3e9a8904 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:23.866156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-64a91a7f-a58d-432d-b99c-87354fdfd99a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:23.878419 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-64a91a7f-a58d-432d-b99c-87354fdfd99a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1319 microversion: 2.1 time: 0.950201 Jul 20 04:10:23.879951 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 237/444] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:22 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1319 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:23.894897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-94a4d1ae-cc63-4f73-96a4-eebbdfeef926 req-b58fac3e-0b7b-475b-8ff3-4e9e31466bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb300df-ffbd-4b36-88f0-cb0e17340221", "name": "network-vif-plugged", "status": "completed", "tag": "40ec11f2-83c0-4550-8566-1e9b3ffdcae2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:23.922605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-94a4d1ae-cc63-4f73-96a4-eebbdfeef926 req-b58fac3e-0b7b-475b-8ff3-4e9e31466bbc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:23.930542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-94a4d1ae-cc63-4f73-96a4-eebbdfeef926 req-b58fac3e-0b7b-475b-8ff3-4e9e31466bbc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:23.957870 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-94a4d1ae-cc63-4f73-96a4-eebbdfeef926 req-b58fac3e-0b7b-475b-8ff3-4e9e31466bbc service nova] Creating event network-vif-plugged:40ec11f2-83c0-4550-8566-1e9b3ffdcae2 for instance 0cb300df-ffbd-4b36-88f0-cb0e17340221 on n-h2-826526-5 Jul 20 04:10:23.970304 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-94a4d1ae-cc63-4f73-96a4-eebbdfeef926 req-b58fac3e-0b7b-475b-8ff3-4e9e31466bbc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086695 Jul 20 04:10:23.971608 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 238/445] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:24.033646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-191ac356-21d8-4e93-ae02-60cd3e9a8904 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:24.071970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-191ac356-21d8-4e93-ae02-60cd3e9a8904 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:24.077185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-191ac356-21d8-4e93-ae02-60cd3e9a8904 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:24.082180 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-191ac356-21d8-4e93-ae02-60cd3e9a8904 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1361 microversion: 2.25 time: 0.502358 Jul 20 04:10:24.084200 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 208/446] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:23 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1361 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:24.593715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-639a7094-95c7-4068-aca1-03205d8d733b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:24.594418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-639a7094-95c7-4068-aca1-03205d8d733b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:24.607283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-639a7094-95c7-4068-aca1-03205d8d733b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:24.607792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-639a7094-95c7-4068-aca1-03205d8d733b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:24.608662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-639a7094-95c7-4068-aca1-03205d8d733b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:24.609101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-639a7094-95c7-4068-aca1-03205d8d733b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:24.902253 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3ee7bf53-6992-452c-9ac4-739579c02fe4 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:24.902906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3ee7bf53-6992-452c-9ac4-739579c02fe4 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:24.916631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ee7bf53-6992-452c-9ac4-739579c02fe4 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:24.918996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ee7bf53-6992-452c-9ac4-739579c02fe4 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:24.919788 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ee7bf53-6992-452c-9ac4-739579c02fe4 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:24.923196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ee7bf53-6992-452c-9ac4-739579c02fe4 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:25.240968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-639a7094-95c7-4068-aca1-03205d8d733b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:25.263074 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-639a7094-95c7-4068-aca1-03205d8d733b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1460 microversion: 2.1 time: 0.673986 Jul 20 04:10:25.264044 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 239/447] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:24 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1460 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:25.278001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-99597b16-3203-4849-a346-413bda1be8de tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:25.278980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-99597b16-3203-4849-a346-413bda1be8de tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:25.287821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-99597b16-3203-4849-a346-413bda1be8de tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:25.294950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-99597b16-3203-4849-a346-413bda1be8de tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:25.296300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-99597b16-3203-4849-a346-413bda1be8de tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:25.297070 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-99597b16-3203-4849-a346-413bda1be8de tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:25.328273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:25.501441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3ee7bf53-6992-452c-9ac4-739579c02fe4 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:25.514240 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3ee7bf53-6992-452c-9ac4-739579c02fe4 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1319 microversion: 2.1 time: 0.621846 Jul 20 04:10:25.525250 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 209/448] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:24 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1319 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:25.655573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-99597b16-3203-4849-a346-413bda1be8de tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:25.671281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-99597b16-3203-4849-a346-413bda1be8de tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:25.678276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-99597b16-3203-4849-a346-413bda1be8de tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:25.679618 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-99597b16-3203-4849-a346-413bda1be8de tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1361 microversion: 2.25 time: 0.414412 Jul 20 04:10:25.682927 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 240/449] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:25 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1361 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:25.697204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8cfc2721-d6e7-4f60-b5d7-ef7adc356376 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:25.698086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8cfc2721-d6e7-4f60-b5d7-ef7adc356376 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:25.717664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8cfc2721-d6e7-4f60-b5d7-ef7adc356376 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:25.718549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8cfc2721-d6e7-4f60-b5d7-ef7adc356376 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:25.719585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8cfc2721-d6e7-4f60-b5d7-ef7adc356376 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:25.722175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8cfc2721-d6e7-4f60-b5d7-ef7adc356376 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:25.740749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-86958a42-2e15-474e-8ee8-82aec03205a4 tempest-NetworksTest-1690268070 tempest-NetworksTest-1690268070-project-admin] Calling method '.version_select at 0x7f06bea2e940>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:26.195510 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-86958a42-2e15-474e-8ee8-82aec03205a4 tempest-NetworksTest-1690268070 tempest-NetworksTest-1690268070-project-admin] 10.222.0.17 "GET /compute/v2.1/os-networks" status: 200 len: 6760 microversion: 2.1 time: 0.668729 Jul 20 04:10:26.200389 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 210/450] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:10:25 2022] GET /compute/v2.1/os-networks => generated 6760 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:26.205880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-b1036d08-cf30-41ff-b2ee-e4b30bf2714b req-a9f02bde-7d74-4f74-ba26-e437b111d867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a", "name": "network-vif-plugged", "status": "completed", "tag": "ac5fffab-5b76-4774-b5dc-86edfb73fa2e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:26.217616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b1036d08-cf30-41ff-b2ee-e4b30bf2714b req-a9f02bde-7d74-4f74-ba26-e437b111d867 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:26.218228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b1036d08-cf30-41ff-b2ee-e4b30bf2714b req-a9f02bde-7d74-4f74-ba26-e437b111d867 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:26.233071 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-b1036d08-cf30-41ff-b2ee-e4b30bf2714b req-a9f02bde-7d74-4f74-ba26-e437b111d867 service nova] Creating event network-vif-plugged:ac5fffab-5b76-4774-b5dc-86edfb73fa2e for instance ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a on n-h1-826526-5 Jul 20 04:10:26.245345 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-b1036d08-cf30-41ff-b2ee-e4b30bf2714b req-a9f02bde-7d74-4f74-ba26-e437b111d867 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038533 Jul 20 04:10:26.248856 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 211/451] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:26.263208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-46262552-bdc7-4b07-a8d6-8b24b0186692 tempest-NetworksTest-1690268070 tempest-NetworksTest-1690268070-project-admin] Calling method '.version_select at 0x7f06bea71550>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:26.768435 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8cfc2721-d6e7-4f60-b5d7-ef7adc356376 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1611 microversion: 2.1 time: 1.083408 Jul 20 04:10:26.776242 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 241/452] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:25 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1611 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:26.786475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f88ef5ae-143a-4ea1-b86b-081a5e75f8ae tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:26.792791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f88ef5ae-143a-4ea1-b86b-081a5e75f8ae tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:26.819682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f88ef5ae-143a-4ea1-b86b-081a5e75f8ae tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:26.820102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f88ef5ae-143a-4ea1-b86b-081a5e75f8ae tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:26.830878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f88ef5ae-143a-4ea1-b86b-081a5e75f8ae tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:26.831328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f88ef5ae-143a-4ea1-b86b-081a5e75f8ae tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:27.119109 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-46262552-bdc7-4b07-a8d6-8b24b0186692 tempest-NetworksTest-1690268070 tempest-NetworksTest-1690268070-project-admin] 10.222.0.17 "GET /compute/v2.1/os-networks/802b4524-5322-4d85-a63f-cab8cf79b0d6" status: 200 len: 652 microversion: 2.1 time: 0.854170 Jul 20 04:10:27.121382 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 212/453] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 04:10:26 2022] GET /compute/v2.1/os-networks/802b4524-5322-4d85-a63f-cab8cf79b0d6 => generated 652 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:27.143809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3e839845-8519-4333-aae9-03e23e5e4119 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:27.145047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3e839845-8519-4333-aae9-03e23e5e4119 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:27.153454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e839845-8519-4333-aae9-03e23e5e4119 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:27.154794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e839845-8519-4333-aae9-03e23e5e4119 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:27.157886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e839845-8519-4333-aae9-03e23e5e4119 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:27.158691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e839845-8519-4333-aae9-03e23e5e4119 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:27.370726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3e839845-8519-4333-aae9-03e23e5e4119 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:27.391919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3e839845-8519-4333-aae9-03e23e5e4119 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:27.394249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3e839845-8519-4333-aae9-03e23e5e4119 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:27.395531 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3e839845-8519-4333-aae9-03e23e5e4119 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1361 microversion: 2.25 time: 0.272703 Jul 20 04:10:27.396286 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 213/454] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:27 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1361 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:27.410629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cfc5a7bb-18df-4cbc-b941-cd1b8820f9f2 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Calling method '.version_select at 0x7f06be8b3a60>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:27.413787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cfc5a7bb-18df-4cbc-b941-cd1b8820f9f2 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:27.414416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cfc5a7bb-18df-4cbc-b941-cd1b8820f9f2 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:27.433458 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cfc5a7bb-18df-4cbc-b941-cd1b8820f9f2 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.026110 Jul 20 04:10:27.434983 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 214/455] 10.222.0.17 () {58 vars in 1142 bytes} [Wed Jul 20 04:10:27 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:27.478033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9f5ea988-415d-4ebe-a62d-d881c4e7c5ac tempest-NetworksTest-1690268070 tempest-NetworksTest-1690268070-project-admin] Calling method '.version_select at 0x7f06be8b23a0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:27.570299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f88ef5ae-143a-4ea1-b86b-081a5e75f8ae tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:27.583428 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f88ef5ae-143a-4ea1-b86b-081a5e75f8ae tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1319 microversion: 2.1 time: 0.805439 Jul 20 04:10:27.587841 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 242/456] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:26 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1319 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:27.696417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bcdfda76-8b75-4b49-bfc9-d2794ff3805a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1143127318", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:27.729321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:27.796915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-bcdfda76-8b75-4b49-bfc9-d2794ff3805a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:10:28.112635 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9f5ea988-415d-4ebe-a62d-d881c4e7c5ac tempest-NetworksTest-1690268070 tempest-NetworksTest-1690268070-project-admin] 10.222.0.17 "GET /compute/v2.1/os-networks" status: 200 len: 6760 microversion: 2.1 time: 0.676003 Jul 20 04:10:28.113800 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 215/457] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:10:27 2022] GET /compute/v2.1/os-networks => generated 6760 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:28.413664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-86e41708-26c5-46e9-8510-89acc12194eb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:28.414291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-86e41708-26c5-46e9-8510-89acc12194eb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:28.417776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-bcdfda76-8b75-4b49-bfc9-d2794ff3805a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:28.418483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-bcdfda76-8b75-4b49-bfc9-d2794ff3805a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:28.419520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-bcdfda76-8b75-4b49-bfc9-d2794ff3805a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:28.420554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-bcdfda76-8b75-4b49-bfc9-d2794ff3805a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:28.422043 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-bcdfda76-8b75-4b49-bfc9-d2794ff3805a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:28.440141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86e41708-26c5-46e9-8510-89acc12194eb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.441408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86e41708-26c5-46e9-8510-89acc12194eb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.444427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86e41708-26c5-46e9-8510-89acc12194eb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.448748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86e41708-26c5-46e9-8510-89acc12194eb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.449212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bcdfda76-8b75-4b49-bfc9-d2794ff3805a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.449793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bcdfda76-8b75-4b49-bfc9-d2794ff3805a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.450734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bcdfda76-8b75-4b49-bfc9-d2794ff3805a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.452702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bcdfda76-8b75-4b49-bfc9-d2794ff3805a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.505028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-bcdfda76-8b75-4b49-bfc9-d2794ff3805a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Getting quotas for project 6c73d55e6bc740d0aec2ba67f0491099. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:28.519432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-bcdfda76-8b75-4b49-bfc9-d2794ff3805a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Getting quotas for user b4f8b49fd45944a384836a1459e4e7e9 and project 6c73d55e6bc740d0aec2ba67f0491099. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:28.554178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bcdfda76-8b75-4b49-bfc9-d2794ff3805a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:10:28.557461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bcdfda76-8b75-4b49-bfc9-d2794ff3805a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:10:28.662504 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bcdfda76-8b75-4b49-bfc9-d2794ff3805a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976120 Jul 20 04:10:28.668101 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 243/458] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:10:28.675606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-60b2bfc0-e6ae-4f29-a5f7-a7bba7d15518 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:28.682210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-60b2bfc0-e6ae-4f29-a5f7-a7bba7d15518 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:28.718015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60b2bfc0-e6ae-4f29-a5f7-a7bba7d15518 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.720166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60b2bfc0-e6ae-4f29-a5f7-a7bba7d15518 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.721318 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60b2bfc0-e6ae-4f29-a5f7-a7bba7d15518 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.721902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60b2bfc0-e6ae-4f29-a5f7-a7bba7d15518 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:29.160023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-86e41708-26c5-46e9-8510-89acc12194eb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:29.192591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-86e41708-26c5-46e9-8510-89acc12194eb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:29.208131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-86e41708-26c5-46e9-8510-89acc12194eb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:29.210474 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-86e41708-26c5-46e9-8510-89acc12194eb tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1558 microversion: 2.25 time: 0.801897 Jul 20 04:10:29.211401 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 216/459] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:28 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1558 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:10:29.233761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6b721123-7fbc-434e-b464-fbbc8dd6217c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:29.234517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6b721123-7fbc-434e-b464-fbbc8dd6217c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:29.482315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-60b2bfc0-e6ae-4f29-a5f7-a7bba7d15518 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:29.497564 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-60b2bfc0-e6ae-4f29-a5f7-a7bba7d15518 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1319 microversion: 2.1 time: 0.823201 Jul 20 04:10:29.507291 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 244/460] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:28 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1319 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:29.603999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6b721123-7fbc-434e-b464-fbbc8dd6217c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:29.612925 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6b721123-7fbc-434e-b464-fbbc8dd6217c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1213 microversion: 2.1 time: 0.395071 Jul 20 04:10:29.624749 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 217/461] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:29 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1213 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:29.946584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3176cc6c-10c6-419e-bc92-02792aaa13f8 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:29.947495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3176cc6c-10c6-419e-bc92-02792aaa13f8 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:29.973578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3176cc6c-10c6-419e-bc92-02792aaa13f8 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:29.974297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3176cc6c-10c6-419e-bc92-02792aaa13f8 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:29.977207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3176cc6c-10c6-419e-bc92-02792aaa13f8 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:29.982952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3176cc6c-10c6-419e-bc92-02792aaa13f8 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:30.010832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-12a3f0e7-2b80-4cee-b57b-b5130cae3af6 req-b0425fe6-7a97-49cd-b6dc-330f82780e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9781b4-eca7-4c87-a044-605ac40a855d", "name": "network-vif-plugged", "status": "completed", "tag": "8a4ccdfa-1052-4ec9-80dc-c7009d86a1ba"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:30.032812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-12a3f0e7-2b80-4cee-b57b-b5130cae3af6 req-b0425fe6-7a97-49cd-b6dc-330f82780e35 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:30.037033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-12a3f0e7-2b80-4cee-b57b-b5130cae3af6 req-b0425fe6-7a97-49cd-b6dc-330f82780e35 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:30.113344 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-12a3f0e7-2b80-4cee-b57b-b5130cae3af6 req-b0425fe6-7a97-49cd-b6dc-330f82780e35 service nova] Creating event network-vif-plugged:8a4ccdfa-1052-4ec9-80dc-c7009d86a1ba for instance 0c9781b4-eca7-4c87-a044-605ac40a855d on n-h1-826526-5 Jul 20 04:10:30.131096 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-12a3f0e7-2b80-4cee-b57b-b5130cae3af6 req-b0425fe6-7a97-49cd-b6dc-330f82780e35 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124608 Jul 20 04:10:30.149264 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 218/462] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:10:30.519990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eaf6563b-7869-4161-a118-c6753bc2e861 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:30.520818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eaf6563b-7869-4161-a118-c6753bc2e861 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:30.538434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eaf6563b-7869-4161-a118-c6753bc2e861 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:30.539206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eaf6563b-7869-4161-a118-c6753bc2e861 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:30.542518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eaf6563b-7869-4161-a118-c6753bc2e861 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:30.543314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eaf6563b-7869-4161-a118-c6753bc2e861 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:30.835177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-3176cc6c-10c6-419e-bc92-02792aaa13f8 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'services' on Instance uuid ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:10:31.104126 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3176cc6c-10c6-419e-bc92-02792aaa13f8 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 2050 microversion: 2.25 time: 1.600887 Jul 20 04:10:31.122400 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 245/463] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:29 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 2050 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:31.142246 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ea6b57b0-02b0-4341-84b5-0cd51eadc2d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:31.143939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ea6b57b0-02b0-4341-84b5-0cd51eadc2d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:31.169668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea6b57b0-02b0-4341-84b5-0cd51eadc2d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:31.172976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea6b57b0-02b0-4341-84b5-0cd51eadc2d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:31.174688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea6b57b0-02b0-4341-84b5-0cd51eadc2d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:31.187865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea6b57b0-02b0-4341-84b5-0cd51eadc2d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:31.751864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ea6b57b0-02b0-4341-84b5-0cd51eadc2d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:31.776619 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ea6b57b0-02b0-4341-84b5-0cd51eadc2d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1283 microversion: 2.1 time: 0.651499 Jul 20 04:10:31.777488 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 246/464] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:31 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1283 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:31.782963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-30a935d9-aa7e-4c1c-9bce-5c4b6455007b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:31.783956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-30a935d9-aa7e-4c1c-9bce-5c4b6455007b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:31.801919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30a935d9-aa7e-4c1c-9bce-5c4b6455007b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:31.805558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30a935d9-aa7e-4c1c-9bce-5c4b6455007b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:31.808893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30a935d9-aa7e-4c1c-9bce-5c4b6455007b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:31.810367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30a935d9-aa7e-4c1c-9bce-5c4b6455007b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.055160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eaf6563b-7869-4161-a118-c6753bc2e861 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:32.120518 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eaf6563b-7869-4161-a118-c6753bc2e861 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1319 microversion: 2.1 time: 1.554145 Jul 20 04:10:32.128872 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 219/465] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:30 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1319 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:32.796422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-606e7a2f-279a-4a5a-8af7-3517cb933340 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:32.797408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-606e7a2f-279a-4a5a-8af7-3517cb933340 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:32.814843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-606e7a2f-279a-4a5a-8af7-3517cb933340 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.818349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-606e7a2f-279a-4a5a-8af7-3517cb933340 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.821998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-606e7a2f-279a-4a5a-8af7-3517cb933340 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.831274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-606e7a2f-279a-4a5a-8af7-3517cb933340 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:33.274762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-606e7a2f-279a-4a5a-8af7-3517cb933340 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:33.297735 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-606e7a2f-279a-4a5a-8af7-3517cb933340 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1271 microversion: 2.1 time: 0.500063 Jul 20 04:10:33.302553 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 220/466] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:32 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1271 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:33.811942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-30a935d9-aa7e-4c1c-9bce-5c4b6455007b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'services' on Instance uuid ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:10:33.852940 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-30a935d9-aa7e-4c1c-9bce-5c4b6455007b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 2050 microversion: 2.25 time: 2.073354 Jul 20 04:10:33.854501 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 247/467] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:31 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 2050 bytes in 2076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:33.880856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7ddc5d1a-61b6-4b3b-aea5-52d2d378f53f tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:33.884610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7ddc5d1a-61b6-4b3b-aea5-52d2d378f53f tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:33.897898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ddc5d1a-61b6-4b3b-aea5-52d2d378f53f tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:33.898521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ddc5d1a-61b6-4b3b-aea5-52d2d378f53f tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:33.899453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ddc5d1a-61b6-4b3b-aea5-52d2d378f53f tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:33.900600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ddc5d1a-61b6-4b3b-aea5-52d2d378f53f tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:34.098219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1f9afc3e-6daf-48ae-9aaf-9c612d956fe4 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Calling method '.version_select at 0x7f06be86b670>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:34.208179 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1f9afc3e-6daf-48ae-9aaf-9c612d956fe4 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d" status: 200 len: 371 microversion: 2.1 time: 0.904148 Jul 20 04:10:34.209483 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 221/468] 10.222.0.17 () {58 vars in 1241 bytes} [Wed Jul 20 04:10:33 2022] GET /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d => generated 371 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:34.224403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-10b96622-64e6-4ffd-8241-305b31aec878 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:34.231860 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:34.231860 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:34.241715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10b96622-64e6-4ffd-8241-305b31aec878 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:34.243697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10b96622-64e6-4ffd-8241-305b31aec878 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:34.245025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10b96622-64e6-4ffd-8241-305b31aec878 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:34.245903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10b96622-64e6-4ffd-8241-305b31aec878 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:34.344586 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-10b96622-64e6-4ffd-8241-305b31aec878 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.129174 Jul 20 04:10:34.353607 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 222/469] 10.222.0.17 () {60 vars in 1216 bytes} [Wed Jul 20 04:10:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:10:34.369957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1ef0f34d-67a9-4cea-a143-c2e99030b84e tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Action: 'update', calling method: .version_select at 0x7f06be895dc0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:34.519767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ef0f34d-67a9-4cea-a143-c2e99030b84e tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:34.526316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ef0f34d-67a9-4cea-a143-c2e99030b84e tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:34.530451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ef0f34d-67a9-4cea-a143-c2e99030b84e tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:34.530931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ef0f34d-67a9-4cea-a143-c2e99030b84e tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:34.723048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7ddc5d1a-61b6-4b3b-aea5-52d2d378f53f tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:34.731556 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7ddc5d1a-61b6-4b3b-aea5-52d2d378f53f tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1469 microversion: 2.1 time: 0.875602 Jul 20 04:10:34.732147 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 248/470] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:33 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1469 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:34.739111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cf7651c4-6760-4ac8-a517-a0e2baafaa29 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:34.760296 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1ef0f34d-67a9-4cea-a143-c2e99030b84e tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d" status: 200 len: 328 microversion: 2.1 time: 0.404908 Jul 20 04:10:34.762638 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 223/471] 10.222.0.17 () {60 vars in 1261 bytes} [Wed Jul 20 04:10:34 2022] PUT /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d => generated 328 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:34.770847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cf7651c4-6760-4ac8-a517-a0e2baafaa29 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:34.796746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-96815ff0-96ff-48f2-aa95-03a5e1116a6a tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826526-5", "block_migration": "auto"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:34.797791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-96815ff0-96ff-48f2-aa95-03a5e1116a6a tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:34.816047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf7651c4-6760-4ac8-a517-a0e2baafaa29 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:34.816585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf7651c4-6760-4ac8-a517-a0e2baafaa29 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:34.817308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf7651c4-6760-4ac8-a517-a0e2baafaa29 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:34.818980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96815ff0-96ff-48f2-aa95-03a5e1116a6a tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:34.819475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96815ff0-96ff-48f2-aa95-03a5e1116a6a tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:34.824092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96815ff0-96ff-48f2-aa95-03a5e1116a6a tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:34.832223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96815ff0-96ff-48f2-aa95-03a5e1116a6a tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:34.835342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf7651c4-6760-4ac8-a517-a0e2baafaa29 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:35.019712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:35.140786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-96815ff0-96ff-48f2-aa95-03a5e1116a6a tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'flavor' on Instance uuid ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:10:35.358812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-96815ff0-96ff-48f2-aa95-03a5e1116a6a tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Going to try to live migrate instance to n-h2-826526-5 {{(pid=127870) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:10:36.096694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cf7651c4-6760-4ac8-a517-a0e2baafaa29 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:36.119201 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cf7651c4-6760-4ac8-a517-a0e2baafaa29 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1313 microversion: 2.1 time: 1.373279 Jul 20 04:10:36.119872 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 249/472] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:34 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1313 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:36.137444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ac342d57-3f6d-4a6e-a9e3-6ebc2f92179f tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:36.138022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ac342d57-3f6d-4a6e-a9e3-6ebc2f92179f tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:36.193007 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac342d57-3f6d-4a6e-a9e3-6ebc2f92179f tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:36.193358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac342d57-3f6d-4a6e-a9e3-6ebc2f92179f tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:36.194160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac342d57-3f6d-4a6e-a9e3-6ebc2f92179f tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:36.194599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac342d57-3f6d-4a6e-a9e3-6ebc2f92179f tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:36.332876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-ac342d57-3f6d-4a6e-a9e3-6ebc2f92179f tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lazy-loading 'flavor' on Instance uuid 0c9781b4-eca7-4c87-a044-605ac40a855d {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:10:36.694012 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ac342d57-3f6d-4a6e-a9e3-6ebc2f92179f tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d/action" status: 202 len: 0 microversion: 2.1 time: 0.560241 Jul 20 04:10:36.696492 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 250/473] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:10:36 2022] POST /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:37.792473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fb85d070-1c46-4668-bf8a-7b4168ec398b tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-388685756", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:37.984009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-fb85d070-1c46-4668-bf8a-7b4168ec398b tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:10:38.474157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=11 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:38.533737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=32 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:39.124232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-fb85d070-1c46-4668-bf8a-7b4168ec398b tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:39.124912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-fb85d070-1c46-4668-bf8a-7b4168ec398b tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:39.125112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-fb85d070-1c46-4668-bf8a-7b4168ec398b tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:39.125694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-fb85d070-1c46-4668-bf8a-7b4168ec398b tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:39.126324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-fb85d070-1c46-4668-bf8a-7b4168ec398b tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:39.199119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb85d070-1c46-4668-bf8a-7b4168ec398b tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:39.199634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb85d070-1c46-4668-bf8a-7b4168ec398b tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:39.200431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb85d070-1c46-4668-bf8a-7b4168ec398b tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:39.200861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb85d070-1c46-4668-bf8a-7b4168ec398b tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:39.249345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-fb85d070-1c46-4668-bf8a-7b4168ec398b tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Getting quotas for project 68bc57edfbf547ecbfd7aabf7aef6a2d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:39.266104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-fb85d070-1c46-4668-bf8a-7b4168ec398b tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Getting quotas for user 91b47bd6807945849d2b52a04c8f475e and project 68bc57edfbf547ecbfd7aabf7aef6a2d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:39.317818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.utils [None req-fb85d070-1c46-4668-bf8a-7b4168ec398b tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] cores quota exceeded for 68bc57edfbf547ecbfd7aabf7aef6a2d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127871) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 20 04:10:39.319053 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-fb85d070-1c46-4668-bf8a-7b4168ec398b tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fb85d070-1c46-4668-bf8a-7b4168ec398b tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Request method failure captured: Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 144 Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14A29-H03jLXYHQQ4Gj_yk_nN1IORX6EmXQGHmZSFFHr1G9RbUfc0SdhVl_yPn3iSMW7v6ibpzWgdTsNLQ1Byl_kViCpkgIGCJbAtmX8n0OipQDMJhT9Wut_rbBssOD16YyImx3pJLomrdrpq1reeaIxkCB6noNKrfRCxsgl8bzfG2A Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 68bc57edfbf547ecbfd7aabf7aef6a2d Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-QuotasAdminNegativeTest-376269360 Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:10:39.325166 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:10:39.326534 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/68bc57edfbf547ecbfd7aabf7aef6a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/68bc57edfbf547ecbfd7aabf7aef6a2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_68bc57edfbf547ecbfd7aabf7aef6a2d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/68bc57edfbf547ecbfd7aabf7aef6a2d"}]}] Jul 20 04:10:39.326534 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-QuotasAdminNegativeTest-376269360 Jul 20 04:10:39.326534 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 68bc57edfbf547ecbfd7aabf7aef6a2d Jul 20 04:10:39.326534 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-376269360 Jul 20 04:10:39.326534 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-QuotasAdminNegativeTest-376269360-project Jul 20 04:10:39.326534 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:10:39.326534 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:10:39.326534 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 91b47bd6807945849d2b52a04c8f475e Jul 20 04:10:39.326534 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-QuotasAdminNegativeTest-376269360-project Jul 20 04:10:39.326534 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:10:39.326534 n-d-826526-5 devstack@n-api.service[127871]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-388685756", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} Jul 20 04:10:39.326534 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:10:39.327371 n-d-826526-5 devstack@n-api.service[127871]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:10:39.327371 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-388685756', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452'}}} Jul 20 04:10:39.327371 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:39.327371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:39.327371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 20 04:10:39.327371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 20 04:10:39.327371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:39.327371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:39.327371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 04:10:39.327371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc Jul 20 04:10:39.327371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 04:10:39.327371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 04:10:39.327371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:39.327371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:39.327371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 04:10:39.327371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 04:10:39.327371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 04:10:39.327371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:39.328466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:39.329665 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:39.332015 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:39.332015 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:39.332015 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:39.332015 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:39.332015 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:10:39.332015 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:39.333930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fb85d070-1c46-4668-bf8a-7b4168ec398b tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:39.336608 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fb85d070-1c46-4668-bf8a-7b4168ec398b tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.638136 Jul 20 04:10:39.339560 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 251/474] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:36 2022] POST /compute/v2.1/servers => generated 111 bytes in 2642 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:39.350434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f8877afc-eedc-4216-bccf-39eb07a250a0 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:39.354269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f8877afc-eedc-4216-bccf-39eb07a250a0 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:39.376483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8877afc-eedc-4216-bccf-39eb07a250a0 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:39.379841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8877afc-eedc-4216-bccf-39eb07a250a0 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:39.383672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8877afc-eedc-4216-bccf-39eb07a250a0 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:39.383762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8877afc-eedc-4216-bccf-39eb07a250a0 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:40.449080 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-96815ff0-96ff-48f2-aa95-03a5e1116a6a tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a/action" status: 202 len: 0 microversion: 2.25 time: 5.684248 Jul 20 04:10:40.453962 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 224/475] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jul 20 04:10:34 2022] POST /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a/action => generated 0 bytes in 5691 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:10:40.459593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-44a607c4-939c-4da6-8f65-3f7a508ddef2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:40.460468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-44a607c4-939c-4da6-8f65-3f7a508ddef2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:40.462478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f8877afc-eedc-4216-bccf-39eb07a250a0 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:40.479300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44a607c4-939c-4da6-8f65-3f7a508ddef2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:40.480061 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44a607c4-939c-4da6-8f65-3f7a508ddef2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:40.481125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44a607c4-939c-4da6-8f65-3f7a508ddef2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:40.481702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44a607c4-939c-4da6-8f65-3f7a508ddef2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:40.482257 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f8877afc-eedc-4216-bccf-39eb07a250a0 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1460 microversion: 2.1 time: 1.135870 Jul 20 04:10:40.483300 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 252/476] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:39 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1460 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:40.499005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-53c10f41-b0ee-427a-a5b9-f3aec831ef0b req-4b46efbf-bace-4c79-be96-24000c505376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367d7c6a-04c7-4d70-9afd-bbc8d97c9247", "tag": "10cee44f-babb-4437-935e-ea2811233f2e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:40.537707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-53c10f41-b0ee-427a-a5b9-f3aec831ef0b req-4b46efbf-bace-4c79-be96-24000c505376 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:40.541097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-53c10f41-b0ee-427a-a5b9-f3aec831ef0b req-4b46efbf-bace-4c79-be96-24000c505376 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:40.575463 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-53c10f41-b0ee-427a-a5b9-f3aec831ef0b req-4b46efbf-bace-4c79-be96-24000c505376 service nova] Creating event network-changed:10cee44f-babb-4437-935e-ea2811233f2e for instance 367d7c6a-04c7-4d70-9afd-bbc8d97c9247 on n-h2-826526-5 Jul 20 04:10:40.590354 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-53c10f41-b0ee-427a-a5b9-f3aec831ef0b req-4b46efbf-bace-4c79-be96-24000c505376 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105518 Jul 20 04:10:40.590987 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 253/477] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:40.752847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-69d76b76-b525-4c61-9b9b-369b4d20df5f tempest-QuotaClassesAdminTestJSON-136713946 tempest-QuotaClassesAdminTestJSON-136713946-project-admin] Calling method '.version_select at 0x7f06be9aa820>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:40.753806 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:40.753806 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:10:40.824836 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-69d76b76-b525-4c61-9b9b-369b4d20df5f tempest-QuotaClassesAdminTestJSON-136713946 tempest-QuotaClassesAdminTestJSON-136713946-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.226800 Jul 20 04:10:40.829047 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 254/478] 10.222.0.17 () {58 vars in 1184 bytes} [Wed Jul 20 04:10:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:40.836671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a9d0b75f-dbe9-4931-8805-aad854b8a7bd tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Action: 'update', calling method: .version_select at 0x7f06be6c6ca0>, body: {"quota_set": {"cores": 20}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:41.085525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-44a607c4-939c-4da6-8f65-3f7a508ddef2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:41.102888 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-44a607c4-939c-4da6-8f65-3f7a508ddef2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1313 microversion: 2.1 time: 0.647485 Jul 20 04:10:41.107126 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 225/479] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:40 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1313 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:41.129233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d2d0b69a-b1b1-4e84-a62c-075995135b97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:41.131683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d2d0b69a-b1b1-4e84-a62c-075995135b97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:41.165353 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2d0b69a-b1b1-4e84-a62c-075995135b97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.172606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2d0b69a-b1b1-4e84-a62c-075995135b97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.174826 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2d0b69a-b1b1-4e84-a62c-075995135b97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.178633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2d0b69a-b1b1-4e84-a62c-075995135b97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.209610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9d0b75f-dbe9-4931-8805-aad854b8a7bd tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.213386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9d0b75f-dbe9-4931-8805-aad854b8a7bd tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.221958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9d0b75f-dbe9-4931-8805-aad854b8a7bd tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.222738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9d0b75f-dbe9-4931-8805-aad854b8a7bd tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.416960 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a9d0b75f-dbe9-4931-8805-aad854b8a7bd tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d" status: 200 len: 329 microversion: 2.1 time: 0.586230 Jul 20 04:10:41.417552 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 255/480] 10.222.0.17 () {60 vars in 1261 bytes} [Wed Jul 20 04:10:40 2022] PUT /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d => generated 329 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:41.430949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a5dcf2d7-3dac-46dd-a273-611771ae48e5 tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:41.431950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a5dcf2d7-3dac-46dd-a273-611771ae48e5 tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:41.450855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5dcf2d7-3dac-46dd-a273-611771ae48e5 tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.453361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5dcf2d7-3dac-46dd-a273-611771ae48e5 tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.455360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5dcf2d7-3dac-46dd-a273-611771ae48e5 tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.456846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5dcf2d7-3dac-46dd-a273-611771ae48e5 tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.954062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d2d0b69a-b1b1-4e84-a62c-075995135b97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:41.994379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d2d0b69a-b1b1-4e84-a62c-075995135b97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:41.997390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d2d0b69a-b1b1-4e84-a62c-075995135b97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:42.000253 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d2d0b69a-b1b1-4e84-a62c-075995135b97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1568 microversion: 2.25 time: 0.891104 Jul 20 04:10:42.005714 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 226/481] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:41 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1568 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:42.015450 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7c42816b-f512-45f2-8d16-9157be2738fb tempest-QuotaClassesAdminTestJSON-136713946 tempest-QuotaClassesAdminTestJSON-136713946-project-admin] Action: 'update', calling method: .version_select at 0x7f06be8714c0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:42.017492 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:42.017492 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:42.740793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9,nova_api:UPDATE=9 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:42.995731 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a5dcf2d7-3dac-46dd-a273-611771ae48e5 tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1611 microversion: 2.1 time: 1.574940 Jul 20 04:10:43.006764 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 256/482] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:41 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1611 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:43.014777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1ee7b383-e62c-40c8-8ae7-fe19c5766ea1 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Calling method '.version_select at 0x7f06be6a3280>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:43.017027 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7c42816b-f512-45f2-8d16-9157be2738fb tempest-QuotaClassesAdminTestJSON-136713946 tempest-QuotaClassesAdminTestJSON-136713946-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.009194 Jul 20 04:10:43.017657 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 227/483] 10.222.0.17 () {60 vars in 1205 bytes} [Wed Jul 20 04:10:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:43.031470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-37b5521b-91a4-4617-8fc2-69a07cd60efb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:43.035122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-37b5521b-91a4-4617-8fc2-69a07cd60efb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:43.061276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37b5521b-91a4-4617-8fc2-69a07cd60efb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:43.061737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37b5521b-91a4-4617-8fc2-69a07cd60efb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:43.062611 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37b5521b-91a4-4617-8fc2-69a07cd60efb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:43.063397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37b5521b-91a4-4617-8fc2-69a07cd60efb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:43.153029 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1ee7b383-e62c-40c8-8ae7-fe19c5766ea1 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d" status: 200 len: 374 microversion: 2.1 time: 0.144568 Jul 20 04:10:43.153640 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 257/484] 10.222.0.17 () {58 vars in 1241 bytes} [Wed Jul 20 04:10:43 2022] GET /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d => generated 374 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:43.166592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a09d0a57-a937-4209-9011-f4a218d429db tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:43.170260 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:43.170260 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:10:43.173296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a09d0a57-a937-4209-9011-f4a218d429db tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:43.174026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a09d0a57-a937-4209-9011-f4a218d429db tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:43.177025 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a09d0a57-a937-4209-9011-f4a218d429db tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:43.177482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a09d0a57-a937-4209-9011-f4a218d429db tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:43.267475 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a09d0a57-a937-4209-9011-f4a218d429db tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.111957 Jul 20 04:10:43.276071 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 258/485] 10.222.0.17 () {58 vars in 1175 bytes} [Wed Jul 20 04:10:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:43.293100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2e2e8526-b3b0-491b-8a98-bdeacc2f960a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:43.293722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2e2e8526-b3b0-491b-8a98-bdeacc2f960a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:43.312810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e2e8526-b3b0-491b-8a98-bdeacc2f960a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:43.313276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e2e8526-b3b0-491b-8a98-bdeacc2f960a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:43.318470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e2e8526-b3b0-491b-8a98-bdeacc2f960a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:43.318998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e2e8526-b3b0-491b-8a98-bdeacc2f960a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:43.576329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-37b5521b-91a4-4617-8fc2-69a07cd60efb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:43.585340 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-37b5521b-91a4-4617-8fc2-69a07cd60efb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1313 microversion: 2.1 time: 0.566489 Jul 20 04:10:43.600675 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 228/486] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:43 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1313 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:43.628438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-25f6f0f9-a698-4914-9770-9c9480235f83 tempest-QuotaClassesAdminTestJSON-136713946 tempest-QuotaClassesAdminTestJSON-136713946-project-admin] Calling method '.version_select at 0x7f06be7a65e0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:43.629354 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:43.629354 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:43.655354 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-25f6f0f9-a698-4914-9770-9c9480235f83 tempest-QuotaClassesAdminTestJSON-136713946 tempest-QuotaClassesAdminTestJSON-136713946-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.051944 Jul 20 04:10:43.656360 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 229/487] 10.222.0.17 () {58 vars in 1184 bytes} [Wed Jul 20 04:10:43 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:43.661801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a33884a3-5af1-49a1-ad77-1704859e3825 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Action: 'update', calling method: .version_select at 0x7f06be7abca0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:43.815869 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a33884a3-5af1-49a1-ad77-1704859e3825 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:43.825313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a33884a3-5af1-49a1-ad77-1704859e3825 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:43.829302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a33884a3-5af1-49a1-ad77-1704859e3825 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:43.829768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a33884a3-5af1-49a1-ad77-1704859e3825 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:43.964465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2e2e8526-b3b0-491b-8a98-bdeacc2f960a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:43.990579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2e2e8526-b3b0-491b-8a98-bdeacc2f960a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:43.997841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2e2e8526-b3b0-491b-8a98-bdeacc2f960a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:44.001234 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2e2e8526-b3b0-491b-8a98-bdeacc2f960a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1568 microversion: 2.25 time: 0.724046 Jul 20 04:10:44.005361 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 259/488] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:43 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1568 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:44.023086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-64b8dd05-233c-4184-95c5-3d761670e9b8 tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826526-5", "block_migration": true, "disk_over_commit": false}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:44.026993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-64b8dd05-233c-4184-95c5-3d761670e9b8 tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:44.044615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64b8dd05-233c-4184-95c5-3d761670e9b8 tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:44.048896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64b8dd05-233c-4184-95c5-3d761670e9b8 tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:44.049719 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a33884a3-5af1-49a1-ad77-1704859e3825 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d" status: 200 len: 330 microversion: 2.1 time: 0.392119 Jul 20 04:10:44.050939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64b8dd05-233c-4184-95c5-3d761670e9b8 tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:44.051795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64b8dd05-233c-4184-95c5-3d761670e9b8 tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:44.055009 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 230/489] 10.222.0.17 () {60 vars in 1261 bytes} [Wed Jul 20 04:10:43 2022] PUT /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d => generated 330 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:44.059517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:44.059773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-17cfb597-d832-4490-a527-bf58ef6c383c tempest-QuotaClassesAdminTestJSON-136713946 tempest-QuotaClassesAdminTestJSON-136713946-project-admin] Action: 'update', calling method: .version_select at 0x7f06be7a04c0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:44.088813 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:44.088813 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:44.201106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-64b8dd05-233c-4184-95c5-3d761670e9b8 tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Lazy-loading 'flavor' on Instance uuid 0c9781b4-eca7-4c87-a044-605ac40a855d {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:10:44.255149 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-64b8dd05-233c-4184-95c5-3d761670e9b8 tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 0c9781b4-eca7-4c87-a044-605ac40a855d while it is in vm_state suspended Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-64b8dd05-233c-4184-95c5-3d761670e9b8 tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Request method failure captured: Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d/action HTTP/1.1 Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 97 Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_5O2gm3oGJIwjw7IDyjn8U92GqqzSeN61J79X9Kp9csUV1kzeUOk3aDB_rC9_azODqgtDL7ySqtQhsRDvD-yqA7gtQ9DF48Wlqvn3WveRAuu_zLp6RsgL9jQjgk2nBPQENls_JzKtQMzIM3kvVh0WGrjvk5Mbr7JsgH2qX-7pPENs Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 6a3909cf0d5542ab884943fd817f5965 Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-LiveMigrationNegativeTest-1597177836 Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:10:44.263462 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:10:44.264927 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6a3909cf0d5542ab884943fd817f5965"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6a3909cf0d5542ab884943fd817f5965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6a3909cf0d5542ab884943fd817f5965", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6a3909cf0d5542ab884943fd817f5965"}]}] Jul 20 04:10:44.264927 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-LiveMigrationNegativeTest-1597177836 Jul 20 04:10:44.264927 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 6a3909cf0d5542ab884943fd817f5965 Jul 20 04:10:44.264927 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1597177836 Jul 20 04:10:44.264927 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-LiveMigrationNegativeTest-1597177836-project-admin Jul 20 04:10:44.264927 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:10:44.264927 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:10:44.264927 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: e7524ff2433245ab9c1eb7b37567bd5e Jul 20 04:10:44.264927 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-LiveMigrationNegativeTest-1597177836-project-admin Jul 20 04:10:44.264927 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:10:44.264927 n-d-826526-5 devstack@n-api.service[127871]: {"os-migrateLive": {"host": "n-h2-826526-5", "block_migration": true, "disk_over_commit": false}} Jul 20 04:10:44.264927 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:10:44.265653 n-d-826526-5 devstack@n-api.service[127871]: exception: Cannot 'os-migrateLive' instance 0c9781b4-eca7-4c87-a044-605ac40a855d while it is in vm_state suspended Jul 20 04:10:44.265653 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '0c9781b4-eca7-4c87-a044-605ac40a855d', 'body': {'os-migrateLive': {'host': 'n-h2-826526-5', 'block_migration': True, 'disk_over_commit': False}}} Jul 20 04:10:44.265653 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:44.265653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:44.265653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 20 04:10:44.265653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 20 04:10:44.265653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 04:10:44.265653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:10:44.265653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:10:44.265653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:10:44.265653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:10:44.265653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:10:44.265653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:10:44.265653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:10:44.265653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:10:44.265653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:10:44.265653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 20 04:10:44.265653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c9781b4-eca7-4c87-a044-605ac40a855d in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:44.267248 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:44.268479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:44.268479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:10:44.268479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 20 04:10:44.268479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:10:44.268479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:10:44.268479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:10:44.268479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 0c9781b4-eca7-4c87-a044-605ac40a855d while it is in vm_state suspended Jul 20 04:10:44.268479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:44.268479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:44.268479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:44.268479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:44.268479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:44.268479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:44.268479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:44.268479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:44.268479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 0c9781b4-eca7-4c87-a044-605ac40a855d while it is in vm_state suspended Jul 20 04:10:44.268479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:44.269549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-64b8dd05-233c-4184-95c5-3d761670e9b8 tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 0c9781b4-eca7-4c87-a044-605ac40a855d while it is in vm_state suspended {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:44.273271 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-64b8dd05-233c-4184-95c5-3d761670e9b8 tempest-LiveMigrationNegativeTest-1597177836 tempest-LiveMigrationNegativeTest-1597177836-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d/action" status: 409 len: 155 microversion: 2.1 time: 0.262993 Jul 20 04:10:44.274124 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 260/490] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:10:44 2022] POST /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d/action => generated 155 bytes in 268 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:10:44.291565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-19f2ca34-115b-4371-b404-c56e40f52254 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:44.292077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-19f2ca34-115b-4371-b404-c56e40f52254 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:44.316179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19f2ca34-115b-4371-b404-c56e40f52254 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:44.327228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19f2ca34-115b-4371-b404-c56e40f52254 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:44.333663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19f2ca34-115b-4371-b404-c56e40f52254 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:44.334622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19f2ca34-115b-4371-b404-c56e40f52254 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:44.409393 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-17cfb597-d832-4490-a527-bf58ef6c383c tempest-QuotaClassesAdminTestJSON-136713946 tempest-QuotaClassesAdminTestJSON-136713946-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.353162 Jul 20 04:10:44.410709 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 231/491] 10.222.0.17 () {60 vars in 1205 bytes} [Wed Jul 20 04:10:44 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:44.426329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dccaee65-3be7-45d2-8f8e-db5ebee39c01 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1026379612", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:44.446597 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-19f2ca34-115b-4371-b404-c56e40f52254 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:10:44.588301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-dccaee65-3be7-45d2-8f8e-db5ebee39c01 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] validate_networks() for None {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:10:44.728787 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-19f2ca34-115b-4371-b404-c56e40f52254 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 204 len: 0 microversion: 2.1 time: 0.441035 Jul 20 04:10:44.734544 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 261/492] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:10:44 2022] DELETE /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:10:44.744634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e6477743-ea4c-44e7-9d26-11ae7a7f0b1d req-c711b5ee-f31b-4429-802e-711967428374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a", "name": "network-vif-unplugged", "status": "completed", "tag": "ac5fffab-5b76-4774-b5dc-86edfb73fa2e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:44.768585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e6477743-ea4c-44e7-9d26-11ae7a7f0b1d req-c711b5ee-f31b-4429-802e-711967428374 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:44.771501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e6477743-ea4c-44e7-9d26-11ae7a7f0b1d req-c711b5ee-f31b-4429-802e-711967428374 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:44.802689 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e6477743-ea4c-44e7-9d26-11ae7a7f0b1d req-c711b5ee-f31b-4429-802e-711967428374 service nova] Creating event network-vif-unplugged:ac5fffab-5b76-4774-b5dc-86edfb73fa2e for instance ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a on n-h1-826526-5 Jul 20 04:10:44.826903 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e6477743-ea4c-44e7-9d26-11ae7a7f0b1d req-c711b5ee-f31b-4429-802e-711967428374 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092593 Jul 20 04:10:44.836452 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 262/493] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:44.867234 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-17e77eba-7b0f-4981-92e2-678e3a4a9158 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:44.868140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-17e77eba-7b0f-4981-92e2-678e3a4a9158 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:44.888451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17e77eba-7b0f-4981-92e2-678e3a4a9158 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:44.889207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17e77eba-7b0f-4981-92e2-678e3a4a9158 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:44.890980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17e77eba-7b0f-4981-92e2-678e3a4a9158 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:44.892578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17e77eba-7b0f-4981-92e2-678e3a4a9158 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:45.726021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-dccaee65-3be7-45d2-8f8e-db5ebee39c01 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:45.727250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-dccaee65-3be7-45d2-8f8e-db5ebee39c01 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:45.728622 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-dccaee65-3be7-45d2-8f8e-db5ebee39c01 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:45.729249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-dccaee65-3be7-45d2-8f8e-db5ebee39c01 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:45.730241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-dccaee65-3be7-45d2-8f8e-db5ebee39c01 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:45.764835 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dccaee65-3be7-45d2-8f8e-db5ebee39c01 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:45.765312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dccaee65-3be7-45d2-8f8e-db5ebee39c01 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:45.766117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dccaee65-3be7-45d2-8f8e-db5ebee39c01 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:45.766570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dccaee65-3be7-45d2-8f8e-db5ebee39c01 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:45.818830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-dccaee65-3be7-45d2-8f8e-db5ebee39c01 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Getting quotas for project 68bc57edfbf547ecbfd7aabf7aef6a2d. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:45.834632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-dccaee65-3be7-45d2-8f8e-db5ebee39c01 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Getting quotas for user 91b47bd6807945849d2b52a04c8f475e and project 68bc57edfbf547ecbfd7aabf7aef6a2d. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:45.867047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.utils [None req-dccaee65-3be7-45d2-8f8e-db5ebee39c01 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] instances quota exceeded for 68bc57edfbf547ecbfd7aabf7aef6a2d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127870) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 20 04:10:45.868069 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-dccaee65-3be7-45d2-8f8e-db5ebee39c01 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dccaee65-3be7-45d2-8f8e-db5ebee39c01 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Request method failure captured: Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 145 Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14A29-H03jLXYHQQ4Gj_yk_nN1IORX6EmXQGHmZSFFHr1G9RbUfc0SdhVl_yPn3iSMW7v6ibpzWgdTsNLQ1Byl_kViCpkgIGCJbAtmX8n0OipQDMJhT9Wut_rbBssOD16YyImx3pJLomrdrpq1reeaIxkCB6noNKrfRCxsgl8bzfG2A Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 68bc57edfbf547ecbfd7aabf7aef6a2d Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-QuotasAdminNegativeTest-376269360 Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:10:45.873118 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:10:45.874555 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/68bc57edfbf547ecbfd7aabf7aef6a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/68bc57edfbf547ecbfd7aabf7aef6a2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_68bc57edfbf547ecbfd7aabf7aef6a2d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/68bc57edfbf547ecbfd7aabf7aef6a2d"}]}] Jul 20 04:10:45.874555 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-QuotasAdminNegativeTest-376269360 Jul 20 04:10:45.874555 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 68bc57edfbf547ecbfd7aabf7aef6a2d Jul 20 04:10:45.874555 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-376269360 Jul 20 04:10:45.874555 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-QuotasAdminNegativeTest-376269360-project Jul 20 04:10:45.874555 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:10:45.874555 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:10:45.874555 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 91b47bd6807945849d2b52a04c8f475e Jul 20 04:10:45.874555 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-QuotasAdminNegativeTest-376269360-project Jul 20 04:10:45.874555 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:10:45.874555 n-d-826526-5 devstack@n-api.service[127870]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1026379612", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} Jul 20 04:10:45.874555 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:10:45.875256 n-d-826526-5 devstack@n-api.service[127870]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:10:45.875256 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1026379612', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452'}}} Jul 20 04:10:45.875256 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:45.875256 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:45.875256 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 20 04:10:45.875256 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 20 04:10:45.875256 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:45.875256 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:45.875256 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 04:10:45.875256 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc Jul 20 04:10:45.875256 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 04:10:45.875256 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 04:10:45.875256 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:45.875256 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:45.875256 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 04:10:45.875256 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 04:10:45.875256 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 04:10:45.875256 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:45.876677 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:45.878197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:45.879362 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:45.879362 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:45.879362 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:45.879362 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:45.879362 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:10:45.879362 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:45.889751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dccaee65-3be7-45d2-8f8e-db5ebee39c01 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:45.894538 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dccaee65-3be7-45d2-8f8e-db5ebee39c01 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.477654 Jul 20 04:10:45.895219 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 232/494] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:44 2022] POST /compute/v2.1/servers => generated 119 bytes in 1484 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:45.905522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fcaf85b1-c55c-4a4a-99dc-63997c057a26 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:45.907395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fcaf85b1-c55c-4a4a-99dc-63997c057a26 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:45.926114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fcaf85b1-c55c-4a4a-99dc-63997c057a26 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:45.927353 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fcaf85b1-c55c-4a4a-99dc-63997c057a26 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:45.928363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fcaf85b1-c55c-4a4a-99dc-63997c057a26 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:45.928936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fcaf85b1-c55c-4a4a-99dc-63997c057a26 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:46.272042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-17e77eba-7b0f-4981-92e2-678e3a4a9158 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:46.281440 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-17e77eba-7b0f-4981-92e2-678e3a4a9158 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1313 microversion: 2.1 time: 1.443613 Jul 20 04:10:46.292227 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 263/495] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:44 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1313 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:46.292227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3ce2f2c4-961a-4443-80c6-23f0af4bd6d2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:46.292227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3ce2f2c4-961a-4443-80c6-23f0af4bd6d2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:46.306645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ce2f2c4-961a-4443-80c6-23f0af4bd6d2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:46.311948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ce2f2c4-961a-4443-80c6-23f0af4bd6d2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:46.312943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ce2f2c4-961a-4443-80c6-23f0af4bd6d2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:46.313674 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ce2f2c4-961a-4443-80c6-23f0af4bd6d2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:46.634541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fcaf85b1-c55c-4a4a-99dc-63997c057a26 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:46.643705 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fcaf85b1-c55c-4a4a-99dc-63997c057a26 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1466 microversion: 2.1 time: 0.747064 Jul 20 04:10:46.661607 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 233/496] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:45 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1466 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:46.684776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1cd84498-4541-4cdb-9f50-1d63bafdda76 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Action: 'update', calling method: .version_select at 0x7f06beeb8670>, body: {"quota_set": {"instances": 110}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:47.187785 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cd84498-4541-4cdb-9f50-1d63bafdda76 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:47.188984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cd84498-4541-4cdb-9f50-1d63bafdda76 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:47.190034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cd84498-4541-4cdb-9f50-1d63bafdda76 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:47.190716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cd84498-4541-4cdb-9f50-1d63bafdda76 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:47.327581 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1cd84498-4541-4cdb-9f50-1d63bafdda76 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d" status: 200 len: 330 microversion: 2.1 time: 0.661283 Jul 20 04:10:47.328383 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 234/497] 10.222.0.17 () {60 vars in 1261 bytes} [Wed Jul 20 04:10:46 2022] PUT /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d => generated 330 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:47.341492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-6b7290a8-c581-4370-bede-29e4760a8fcd req-2d6c3cbc-c79b-485c-a3c9-1a9b0541e922 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a", "tag": "ac5fffab-5b76-4774-b5dc-86edfb73fa2e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:47.351455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6b7290a8-c581-4370-bede-29e4760a8fcd req-2d6c3cbc-c79b-485c-a3c9-1a9b0541e922 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:47.352320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6b7290a8-c581-4370-bede-29e4760a8fcd req-2d6c3cbc-c79b-485c-a3c9-1a9b0541e922 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:47.370475 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-6b7290a8-c581-4370-bede-29e4760a8fcd req-2d6c3cbc-c79b-485c-a3c9-1a9b0541e922 service nova] Creating event network-changed:ac5fffab-5b76-4774-b5dc-86edfb73fa2e for instance ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a on n-h1-826526-5 Jul 20 04:10:47.386729 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-6b7290a8-c581-4370-bede-29e4760a8fcd req-2d6c3cbc-c79b-485c-a3c9-1a9b0541e922 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050854 Jul 20 04:10:47.388049 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 235/498] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:47.393657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e17d0698-6d03-40c5-a96f-4085d43f2057 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:47.394690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e17d0698-6d03-40c5-a96f-4085d43f2057 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:47.408136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e17d0698-6d03-40c5-a96f-4085d43f2057 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:47.409199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e17d0698-6d03-40c5-a96f-4085d43f2057 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:47.416067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e17d0698-6d03-40c5-a96f-4085d43f2057 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:47.416787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e17d0698-6d03-40c5-a96f-4085d43f2057 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:47.446929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3ce2f2c4-961a-4443-80c6-23f0af4bd6d2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:47.481791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3ce2f2c4-961a-4443-80c6-23f0af4bd6d2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:47.496042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3ce2f2c4-961a-4443-80c6-23f0af4bd6d2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:47.498000 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3ce2f2c4-961a-4443-80c6-23f0af4bd6d2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1568 microversion: 2.25 time: 1.210989 Jul 20 04:10:47.511715 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 264/499] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:46 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1568 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:47.517754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fa13aaf3-3948-43b6-bfbd-8eb7ecf5c31d tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Calling method '.version_select at 0x7f06be5aa550>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:47.700964 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fa13aaf3-3948-43b6-bfbd-8eb7ecf5c31d tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d" status: 200 len: 372 microversion: 2.1 time: 0.187528 Jul 20 04:10:47.706735 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 265/500] 10.222.0.17 () {58 vars in 1241 bytes} [Wed Jul 20 04:10:47 2022] GET /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d => generated 372 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:47.714517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-32c04ae8-564d-4717-86f3-e27a34280ac7 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:47.715141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-32c04ae8-564d-4717-86f3-e27a34280ac7 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:47.736307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32c04ae8-564d-4717-86f3-e27a34280ac7 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:47.736759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32c04ae8-564d-4717-86f3-e27a34280ac7 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:47.737923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32c04ae8-564d-4717-86f3-e27a34280ac7 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:47.738560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32c04ae8-564d-4717-86f3-e27a34280ac7 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:48.282822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-32c04ae8-564d-4717-86f3-e27a34280ac7 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:48.292899 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-32c04ae8-564d-4717-86f3-e27a34280ac7 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1466 microversion: 2.1 time: 0.582854 Jul 20 04:10:48.293487 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 266/501] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:47 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1466 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:48.302843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-abf1427d-e780-456e-9bda-93af54fb014f tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Action: 'update', calling method: .version_select at 0x7f06be5a6c10>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:48.946509 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abf1427d-e780-456e-9bda-93af54fb014f tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:48.948600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abf1427d-e780-456e-9bda-93af54fb014f tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:48.949495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abf1427d-e780-456e-9bda-93af54fb014f tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:48.949918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abf1427d-e780-456e-9bda-93af54fb014f tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:49.063791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:49.127732 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-abf1427d-e780-456e-9bda-93af54fb014f tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d" status: 200 len: 326 microversion: 2.1 time: 0.828483 Jul 20 04:10:49.143939 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 267/502] 10.222.0.17 () {60 vars in 1261 bytes} [Wed Jul 20 04:10:48 2022] PUT /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d => generated 326 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:49.536530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e17d0698-6d03-40c5-a96f-4085d43f2057 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:49.546486 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e17d0698-6d03-40c5-a96f-4085d43f2057 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1313 microversion: 2.1 time: 2.156834 Jul 20 04:10:49.552702 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 236/503] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:47 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1313 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:49.557591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-801366ba-4e0b-4593-a301-aada0c1c5fc6 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:49.561972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e57741a6-c6a5-429f-bb91-22a0058f0988 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:49.572063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e57741a6-c6a5-429f-bb91-22a0058f0988 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:49.573773 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-801366ba-4e0b-4593-a301-aada0c1c5fc6 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.438954 Jul 20 04:10:49.574893 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 268/504] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:10:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:49.585840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b9189135-1108-4aa9-b44b-b0815bf5476c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:49.590358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b9189135-1108-4aa9-b44b-b0815bf5476c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:49.592408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:UPDATE=16 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:49.616552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9189135-1108-4aa9-b44b-b0815bf5476c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:49.617243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9189135-1108-4aa9-b44b-b0815bf5476c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:49.617672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e57741a6-c6a5-429f-bb91-22a0058f0988 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:49.618370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9189135-1108-4aa9-b44b-b0815bf5476c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:49.618943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9189135-1108-4aa9-b44b-b0815bf5476c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:49.619059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e57741a6-c6a5-429f-bb91-22a0058f0988 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:49.624534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e57741a6-c6a5-429f-bb91-22a0058f0988 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:49.629824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e57741a6-c6a5-429f-bb91-22a0058f0988 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:49.877641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b9189135-1108-4aa9-b44b-b0815bf5476c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:49.893454 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b9189135-1108-4aa9-b44b-b0815bf5476c tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 200 len: 1424 microversion: 2.1 time: 0.317257 Jul 20 04:10:49.904939 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 269/505] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:49 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 1424 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:49.906594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-375620ce-48b8-4013-9533-427850dd8d07 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-882236344", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:50.050394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-375620ce-48b8-4013-9533-427850dd8d07 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:10:50.090548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e57741a6-c6a5-429f-bb91-22a0058f0988 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:50.099286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e57741a6-c6a5-429f-bb91-22a0058f0988 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:50.115077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e57741a6-c6a5-429f-bb91-22a0058f0988 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:50.121430 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e57741a6-c6a5-429f-bb91-22a0058f0988 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1568 microversion: 2.25 time: 0.561174 Jul 20 04:10:50.122383 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 237/506] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:49 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1568 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:50.575186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-71e0020c-cfc3-4898-8cee-80df9bb92e7a tempest-ServersWithSpecificFlavorTestJSON-244217629 tempest-ServersWithSpecificFlavorTestJSON-244217629-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1898068520", "id": 1067554771, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:50.577723 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:50.577723 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:50.624355 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-71e0020c-cfc3-4898-8cee-80df9bb92e7a tempest-ServersWithSpecificFlavorTestJSON-244217629 tempest-ServersWithSpecificFlavorTestJSON-244217629-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.498447 Jul 20 04:10:50.628139 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 238/507] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:50 2022] POST /compute/v2.1/flavors => generated 425 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:50.645515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-5b387aec-6213-4db1-b419-501a82bdd351 req-dbea385e-dbf1-465b-bf38-cf6375946153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9781b4-eca7-4c87-a044-605ac40a855d", "name": "network-vif-deleted", "tag": "8a4ccdfa-1052-4ec9-80dc-c7009d86a1ba"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:50.672965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5b387aec-6213-4db1-b419-501a82bdd351 req-dbea385e-dbf1-465b-bf38-cf6375946153 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:50.682263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5b387aec-6213-4db1-b419-501a82bdd351 req-dbea385e-dbf1-465b-bf38-cf6375946153 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:50.710882 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-5b387aec-6213-4db1-b419-501a82bdd351 req-dbea385e-dbf1-465b-bf38-cf6375946153 service nova] Creating event network-vif-deleted:8a4ccdfa-1052-4ec9-80dc-c7009d86a1ba for instance 0c9781b4-eca7-4c87-a044-605ac40a855d on n-h1-826526-5 Jul 20 04:10:50.730742 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-5b387aec-6213-4db1-b419-501a82bdd351 req-dbea385e-dbf1-465b-bf38-cf6375946153 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094349 Jul 20 04:10:50.732100 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 239/508] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:50.745480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-84a4d465-0f57-4a27-8fce-bd237b84f895 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:50.746494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-84a4d465-0f57-4a27-8fce-bd237b84f895 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:50.762589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84a4d465-0f57-4a27-8fce-bd237b84f895 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:50.763327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84a4d465-0f57-4a27-8fce-bd237b84f895 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:50.764321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84a4d465-0f57-4a27-8fce-bd237b84f895 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:50.764910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84a4d465-0f57-4a27-8fce-bd237b84f895 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:51.209368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-84a4d465-0f57-4a27-8fce-bd237b84f895 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:51.225679 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-84a4d465-0f57-4a27-8fce-bd237b84f895 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1313 microversion: 2.1 time: 0.490617 Jul 20 04:10:51.242233 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 240/509] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:50 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:51.264356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-017dbc31-27e0-485d-9b41-4a19ec42d464 tempest-ServersWithSpecificFlavorTestJSON-244217629 tempest-ServersWithSpecificFlavorTestJSON-244217629-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:51.289733 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-017dbc31-27e0-485d-9b41-4a19ec42d464 tempest-ServersWithSpecificFlavorTestJSON-244217629 tempest-ServersWithSpecificFlavorTestJSON-244217629-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.045292 Jul 20 04:10:51.290497 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 241/510] 10.222.0.17 () {58 vars in 1181 bytes} [Wed Jul 20 04:10:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:10:51.301545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2e9ae12b-0da4-47d2-a30d-570bf92cfb50 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:51.304134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2e9ae12b-0da4-47d2-a30d-570bf92cfb50 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: 0c9781b4-eca7-4c87-a044-605ac40a855d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:51.321603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e9ae12b-0da4-47d2-a30d-570bf92cfb50 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:51.322661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e9ae12b-0da4-47d2-a30d-570bf92cfb50 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:51.326390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e9ae12b-0da4-47d2-a30d-570bf92cfb50 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:51.328073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e9ae12b-0da4-47d2-a30d-570bf92cfb50 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:51.375223 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-2e9ae12b-0da4-47d2-a30d-570bf92cfb50 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] HTTP exception thrown: Instance 0c9781b4-eca7-4c87-a044-605ac40a855d could not be found. Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2e9ae12b-0da4-47d2-a30d-570bf92cfb50 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Request method failure captured: Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d HTTP/1.1 Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_4zZzadMv0L3ta93EDWPQMP8-9uEuF4BdXbIs5n33E6U1e2zSVS9uphDwPhkl_CyWMMRoZvXY8o19weyLSlltTc0eBLqu9UKp4UEpT7-2QKl8teNSmUsoFFXZXVOSF9lObwCYvdUBd1FmRlwhAX1w4-fipFiiWY1JHTTfqEGWuTWI Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: f2a267e50d30497d93400d593631d3e7 Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-LiveMigrationNegativeTest-146660810 Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:10:51.377828 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:10:51.379156 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2a267e50d30497d93400d593631d3e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f2a267e50d30497d93400d593631d3e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f2a267e50d30497d93400d593631d3e7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2a267e50d30497d93400d593631d3e7"}]}] Jul 20 04:10:51.379156 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-LiveMigrationNegativeTest-146660810 Jul 20 04:10:51.379156 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: f2a267e50d30497d93400d593631d3e7 Jul 20 04:10:51.379156 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-146660810 Jul 20 04:10:51.379156 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-LiveMigrationNegativeTest-146660810-project Jul 20 04:10:51.379156 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:10:51.379156 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:10:51.379156 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: c2eb773226944c408149ae7f33b12dbe Jul 20 04:10:51.379156 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-LiveMigrationNegativeTest-146660810-project Jul 20 04:10:51.379156 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:10:51.379156 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 0c9781b4-eca7-4c87-a044-605ac40a855d could not be found. Jul 20 04:10:51.379156 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '0c9781b4-eca7-4c87-a044-605ac40a855d'} Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c9781b4-eca7-4c87-a044-605ac40a855d could not be found. Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:51.379955 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:51.381549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:51.381549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:10:51.381549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:10:51.381549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:10:51.381549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:10:51.381549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:10:51.381549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:51.381549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c9781b4-eca7-4c87-a044-605ac40a855d could not be found. Jul 20 04:10:51.381549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.381549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:51.381549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.381549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:51.381549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:51.381549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:51.381549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:51.381549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:51.381549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c9781b4-eca7-4c87-a044-605ac40a855d could not be found. Jul 20 04:10:51.381549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.384772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2e9ae12b-0da4-47d2-a30d-570bf92cfb50 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Returning 404 to user: Instance 0c9781b4-eca7-4c87-a044-605ac40a855d could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:51.388057 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2e9ae12b-0da4-47d2-a30d-570bf92cfb50 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d" status: 404 len: 111 microversion: 2.1 time: 0.096460 Jul 20 04:10:51.396497 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 242/511] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:51 2022] GET /compute/v2.1/servers/0c9781b4-eca7-4c87-a044-605ac40a855d => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:51.406310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ef6216a2-c697-482c-b65e-b5cc2e97658c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:51.409413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ef6216a2-c697-482c-b65e-b5cc2e97658c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:51.422553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef6216a2-c697-482c-b65e-b5cc2e97658c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:51.426687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef6216a2-c697-482c-b65e-b5cc2e97658c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:51.440936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef6216a2-c697-482c-b65e-b5cc2e97658c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:51.445217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef6216a2-c697-482c-b65e-b5cc2e97658c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:51.659036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-375620ce-48b8-4013-9533-427850dd8d07 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:51.661763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-375620ce-48b8-4013-9533-427850dd8d07 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:51.662775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-375620ce-48b8-4013-9533-427850dd8d07 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:51.663535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-375620ce-48b8-4013-9533-427850dd8d07 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:51.664995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-375620ce-48b8-4013-9533-427850dd8d07 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:51.716842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-375620ce-48b8-4013-9533-427850dd8d07 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:51.724921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-375620ce-48b8-4013-9533-427850dd8d07 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:51.727662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-375620ce-48b8-4013-9533-427850dd8d07 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:51.729967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-375620ce-48b8-4013-9533-427850dd8d07 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:51.789988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-375620ce-48b8-4013-9533-427850dd8d07 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Getting quotas for project 68bc57edfbf547ecbfd7aabf7aef6a2d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:51.816735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-375620ce-48b8-4013-9533-427850dd8d07 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Getting quotas for user 91b47bd6807945849d2b52a04c8f475e and project 68bc57edfbf547ecbfd7aabf7aef6a2d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:51.868227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.utils [None req-375620ce-48b8-4013-9533-427850dd8d07 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] ram quota exceeded for 68bc57edfbf547ecbfd7aabf7aef6a2d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127871) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 20 04:10:51.868795 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-375620ce-48b8-4013-9533-427850dd8d07 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-375620ce-48b8-4013-9533-427850dd8d07 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Request method failure captured: Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 144 Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14A29-H03jLXYHQQ4Gj_yk_nN1IORX6EmXQGHmZSFFHr1G9RbUfc0SdhVl_yPn3iSMW7v6ibpzWgdTsNLQ1Byl_kViCpkgIGCJbAtmX8n0OipQDMJhT9Wut_rbBssOD16YyImx3pJLomrdrpq1reeaIxkCB6noNKrfRCxsgl8bzfG2A Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 68bc57edfbf547ecbfd7aabf7aef6a2d Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-QuotasAdminNegativeTest-376269360 Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:10:51.870879 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:10:51.872280 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/68bc57edfbf547ecbfd7aabf7aef6a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/68bc57edfbf547ecbfd7aabf7aef6a2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_68bc57edfbf547ecbfd7aabf7aef6a2d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/68bc57edfbf547ecbfd7aabf7aef6a2d"}]}] Jul 20 04:10:51.872280 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-QuotasAdminNegativeTest-376269360 Jul 20 04:10:51.872280 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 68bc57edfbf547ecbfd7aabf7aef6a2d Jul 20 04:10:51.872280 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-376269360 Jul 20 04:10:51.872280 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-QuotasAdminNegativeTest-376269360-project Jul 20 04:10:51.872280 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:10:51.872280 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:10:51.872280 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 91b47bd6807945849d2b52a04c8f475e Jul 20 04:10:51.872280 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-QuotasAdminNegativeTest-376269360-project Jul 20 04:10:51.872280 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:10:51.872280 n-d-826526-5 devstack@n-api.service[127871]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-882236344", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} Jul 20 04:10:51.872280 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:10:51.873017 n-d-826526-5 devstack@n-api.service[127871]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:10:51.873017 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-882236344', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452'}}} Jul 20 04:10:51.873017 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:51.873017 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:51.873017 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 20 04:10:51.873017 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 20 04:10:51.873017 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:51.873017 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:51.873017 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 04:10:51.873017 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc Jul 20 04:10:51.873017 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 04:10:51.873017 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 04:10:51.873017 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:51.873017 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:51.873017 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 04:10:51.873017 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 04:10:51.873017 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 04:10:51.873017 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:51.874074 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.875344 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:51.878329 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:51.878329 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:51.878329 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:51.878329 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:51.878329 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:10:51.878329 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.878329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-375620ce-48b8-4013-9533-427850dd8d07 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:51.885792 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-375620ce-48b8-4013-9533-427850dd8d07 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.982949 Jul 20 04:10:51.886580 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 270/512] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:49 2022] POST /compute/v2.1/servers => generated 110 bytes in 1984 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:51.894626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0d0566f1-dcf6-4830-bea6-cb00f4c3a916 tempest-ServersWithSpecificFlavorTestJSON-244217629 tempest-ServersWithSpecificFlavorTestJSON-244217629-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1840173187", "id": 455043314, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:51.896363 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:51.896363 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:10:51.933401 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0d0566f1-dcf6-4830-bea6-cb00f4c3a916 tempest-ServersWithSpecificFlavorTestJSON-244217629 tempest-ServersWithSpecificFlavorTestJSON-244217629-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.042475 Jul 20 04:10:51.934178 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 271/513] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:51 2022] POST /compute/v2.1/flavors => generated 422 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:51.965073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f2f6bd10-494e-4acb-85e5-c0c6c1a43591 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:51.965565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f2f6bd10-494e-4acb-85e5-c0c6c1a43591 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:52.017510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2f6bd10-494e-4acb-85e5-c0c6c1a43591 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:52.017968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2f6bd10-494e-4acb-85e5-c0c6c1a43591 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:52.020014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2f6bd10-494e-4acb-85e5-c0c6c1a43591 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:52.020576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2f6bd10-494e-4acb-85e5-c0c6c1a43591 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:52.082942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f2f6bd10-494e-4acb-85e5-c0c6c1a43591 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:10:52.328512 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f2f6bd10-494e-4acb-85e5-c0c6c1a43591 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 204 len: 0 microversion: 2.1 time: 0.392775 Jul 20 04:10:52.329667 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 272/514] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:10:51 2022] DELETE /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:10:52.342843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1f50c147-4cce-44be-945a-0e0850cee588 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Action: 'update', calling method: .version_select at 0x7f06be9aac10>, body: {"quota_set": {"ram": 51200}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:52.427894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ef6216a2-c697-482c-b65e-b5cc2e97658c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:52.444859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ef6216a2-c697-482c-b65e-b5cc2e97658c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:52.449398 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ef6216a2-c697-482c-b65e-b5cc2e97658c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:52.452989 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ef6216a2-c697-482c-b65e-b5cc2e97658c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1568 microversion: 2.25 time: 1.052728 Jul 20 04:10:52.463814 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 243/515] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:51 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1568 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:52.478891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d9bec230-1a6e-4440-8e93-5f09e7acec56 tempest-ServersWithSpecificFlavorTestJSON-244217629 tempest-ServersWithSpecificFlavorTestJSON-244217629-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:52.514200 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d9bec230-1a6e-4440-8e93-5f09e7acec56 tempest-ServersWithSpecificFlavorTestJSON-244217629 tempest-ServersWithSpecificFlavorTestJSON-244217629-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.055119 Jul 20 04:10:52.537139 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 244/516] 10.222.0.17 () {58 vars in 1181 bytes} [Wed Jul 20 04:10:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:10:52.548775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0ced66a0-803c-4554-b7de-2b2fbc09b8b4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:52.556528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0ced66a0-803c-4554-b7de-2b2fbc09b8b4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:52.581776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ced66a0-803c-4554-b7de-2b2fbc09b8b4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:52.586317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ced66a0-803c-4554-b7de-2b2fbc09b8b4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:52.587501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ced66a0-803c-4554-b7de-2b2fbc09b8b4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:52.588135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ced66a0-803c-4554-b7de-2b2fbc09b8b4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:53.015177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f50c147-4cce-44be-945a-0e0850cee588 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:53.018085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f50c147-4cce-44be-945a-0e0850cee588 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:53.019188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f50c147-4cce-44be-945a-0e0850cee588 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:53.020670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f50c147-4cce-44be-945a-0e0850cee588 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:53.207317 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1f50c147-4cce-44be-945a-0e0850cee588 tempest-QuotasAdminNegativeTest-28726736 tempest-QuotasAdminNegativeTest-28726736-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d" status: 200 len: 330 microversion: 2.1 time: 0.870275 Jul 20 04:10:53.209099 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 273/517] 10.222.0.17 () {60 vars in 1261 bytes} [Wed Jul 20 04:10:52 2022] PUT /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d => generated 330 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:53.242279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-45490b59-58e0-4733-bb0a-b1f0e4df350a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:53.245800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-45490b59-58e0-4733-bb0a-b1f0e4df350a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:53.259296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-45490b59-58e0-4733-bb0a-b1f0e4df350a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:53.262136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-45490b59-58e0-4733-bb0a-b1f0e4df350a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:53.269426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-45490b59-58e0-4733-bb0a-b1f0e4df350a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:53.270993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-45490b59-58e0-4733-bb0a-b1f0e4df350a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:53.780557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0ced66a0-803c-4554-b7de-2b2fbc09b8b4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:53.793769 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0ced66a0-803c-4554-b7de-2b2fbc09b8b4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1313 microversion: 2.1 time: 1.254625 Jul 20 04:10:53.795825 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 245/518] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:52 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1313 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:53.815232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-45490b59-58e0-4733-bb0a-b1f0e4df350a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:53.848553 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-45490b59-58e0-4733-bb0a-b1f0e4df350a tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1474 microversion: 2.1 time: 0.628785 Jul 20 04:10:53.850508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bc2bb07d-6e38-4235-8230-23fddc366945 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Action: 'create', calling method: .version_select at 0x7f06be7a2c10>, body: {"keypair": {"name": "tempest-keypair-1546201336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKx4Y7x17+G5pCO6ltG3XjtaxZD4M43jo4IokcIi8J28gwjYnqPACPGtS8XZ3N6a/+DvPAsPyi2qgmGDvT+fTXuNLvZ/0R12+eipOrJjXQmgzqLStL/0GCN3bLMeDRLsvQ=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:53.866887 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 274/519] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:53 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1474 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:53.888676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-203af6f9-790d-45ba-baff-a595539a3883 req-00ea0ab1-d07c-4ae1-b069-570a83aa4deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367d7c6a-04c7-4d70-9afd-bbc8d97c9247", "name": "network-vif-plugged", "status": "completed", "tag": "10cee44f-babb-4437-935e-ea2811233f2e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:53.949459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=77,nova_cell0:UPDATE=12 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:53.977227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-bc2bb07d-6e38-4235-8230-23fddc366945 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Getting quotas for project bc39197e171c40638322c4ca85d73305. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:53.978669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-203af6f9-790d-45ba-baff-a595539a3883 req-00ea0ab1-d07c-4ae1-b069-570a83aa4deb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:53.980860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-203af6f9-790d-45ba-baff-a595539a3883 req-00ea0ab1-d07c-4ae1-b069-570a83aa4deb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:53.991485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-bc2bb07d-6e38-4235-8230-23fddc366945 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Getting quotas for user f4a6e471d9ee4ab1af6781800903c74b and project bc39197e171c40638322c4ca85d73305. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:54.018194 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-203af6f9-790d-45ba-baff-a595539a3883 req-00ea0ab1-d07c-4ae1-b069-570a83aa4deb service nova] Creating event network-vif-plugged:10cee44f-babb-4437-935e-ea2811233f2e for instance 367d7c6a-04c7-4d70-9afd-bbc8d97c9247 on n-h2-826526-5 Jul 20 04:10:54.030634 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-203af6f9-790d-45ba-baff-a595539a3883 req-00ea0ab1-d07c-4ae1-b069-570a83aa4deb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161858 Jul 20 04:10:54.032753 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 275/520] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:54.039066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dd13b180-6c6e-4582-9bb1-7d7310576708 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Action: 'update', calling method: .version_select at 0x7f06be5a6e50>, body: {"quota_set": {"ram": 0}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:54.044041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dd13b180-6c6e-4582-9bb1-7d7310576708 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '91b47bd6807945849d2b52a04c8f475e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bc57edfbf547ecbfd7aabf7aef6a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dd13b180-6c6e-4582-9bb1-7d7310576708 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Request method failure captured: Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: request: PUT /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d HTTP/1.1 Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 25 Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14A29-H03jLXYHQQ4Gj_yk_nN1IORX6EmXQGHmZSFFHr1G9RbUfc0SdhVl_yPn3iSMW7v6ibpzWgdTsNLQ1Byl_kViCpkgIGCJbAtmX8n0OipQDMJhT9Wut_rbBssOD16YyImx3pJLomrdrpq1reeaIxkCB6noNKrfRCxsgl8bzfG2A Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 68bc57edfbf547ecbfd7aabf7aef6a2d Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-QuotasAdminNegativeTest-376269360 Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:10:54.071520 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:10:54.073114 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/68bc57edfbf547ecbfd7aabf7aef6a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/68bc57edfbf547ecbfd7aabf7aef6a2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_68bc57edfbf547ecbfd7aabf7aef6a2d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/68bc57edfbf547ecbfd7aabf7aef6a2d"}]}] Jul 20 04:10:54.073114 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-QuotasAdminNegativeTest-376269360 Jul 20 04:10:54.073114 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 68bc57edfbf547ecbfd7aabf7aef6a2d Jul 20 04:10:54.073114 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-376269360 Jul 20 04:10:54.073114 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-QuotasAdminNegativeTest-376269360-project Jul 20 04:10:54.073114 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:10:54.073114 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:10:54.073114 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 91b47bd6807945849d2b52a04c8f475e Jul 20 04:10:54.073114 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-QuotasAdminNegativeTest-376269360-project Jul 20 04:10:54.073114 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:10:54.073114 n-d-826526-5 devstack@n-api.service[127871]: {"quota_set": {"ram": 0}} Jul 20 04:10:54.073114 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:10:54.073114 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 20 04:10:54.073114 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '68bc57edfbf547ecbfd7aabf7aef6a2d', 'body': {'quota_set': {'ram': 0}}} Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:54.073988 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:54.075110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:54.076323 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:54.076323 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:54.076323 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:54.076323 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:54.076323 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 20 04:10:54.076323 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:54.078785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dd13b180-6c6e-4582-9bb1-7d7310576708 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:54.080085 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dd13b180-6c6e-4582-9bb1-7d7310576708 tempest-QuotasAdminNegativeTest-376269360 tempest-QuotasAdminNegativeTest-376269360-project] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d" status: 403 len: 116 microversion: 2.1 time: 0.045673 Jul 20 04:10:54.086874 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 276/521] 10.222.0.17 () {60 vars in 1261 bytes} [Wed Jul 20 04:10:54 2022] PUT /compute/v2.1/os-quota-sets/68bc57edfbf547ecbfd7aabf7aef6a2d => generated 116 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:54.093726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-57d8e30a-750e-49ae-b3f8-2108b8c3e5d0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:54.094603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-57d8e30a-750e-49ae-b3f8-2108b8c3e5d0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:54.102801 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bc2bb07d-6e38-4235-8230-23fddc366945 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.293158 Jul 20 04:10:54.103490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57d8e30a-750e-49ae-b3f8-2108b8c3e5d0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:54.104134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57d8e30a-750e-49ae-b3f8-2108b8c3e5d0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:54.104347 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 246/522] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:10:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:54.105239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57d8e30a-750e-49ae-b3f8-2108b8c3e5d0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:54.105767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57d8e30a-750e-49ae-b3f8-2108b8c3e5d0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:54.109484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-3df7413c-1a5b-4afd-b705-b016d042697e req-62b17e23-a299-49c8-a858-c0a2b875535d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a", "name": "network-vif-unplugged", "status": "completed", "tag": "ac5fffab-5b76-4774-b5dc-86edfb73fa2e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:54.131901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-3df7413c-1a5b-4afd-b705-b016d042697e req-62b17e23-a299-49c8-a858-c0a2b875535d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:54.132394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-3df7413c-1a5b-4afd-b705-b016d042697e req-62b17e23-a299-49c8-a858-c0a2b875535d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:54.159225 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-3df7413c-1a5b-4afd-b705-b016d042697e req-62b17e23-a299-49c8-a858-c0a2b875535d service nova] Creating event network-vif-unplugged:ac5fffab-5b76-4774-b5dc-86edfb73fa2e for instance ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a on n-h1-826526-5 Jul 20 04:10:54.178127 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-3df7413c-1a5b-4afd-b705-b016d042697e req-62b17e23-a299-49c8-a858-c0a2b875535d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072356 Jul 20 04:10:54.182728 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 247/523] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:54.859741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-57d8e30a-750e-49ae-b3f8-2108b8c3e5d0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:54.877072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-57d8e30a-750e-49ae-b3f8-2108b8c3e5d0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:54.883008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-57d8e30a-750e-49ae-b3f8-2108b8c3e5d0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:54.887460 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-57d8e30a-750e-49ae-b3f8-2108b8c3e5d0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1568 microversion: 2.25 time: 0.798811 Jul 20 04:10:54.891273 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 277/524] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:54 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1568 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:54.908803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-deee1727-dce0-4b51-b82d-75b4345c72eb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:54.912187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-deee1727-dce0-4b51-b82d-75b4345c72eb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:54.926454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-deee1727-dce0-4b51-b82d-75b4345c72eb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:54.928588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-deee1727-dce0-4b51-b82d-75b4345c72eb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:54.929692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-deee1727-dce0-4b51-b82d-75b4345c72eb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:54.932209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-deee1727-dce0-4b51-b82d-75b4345c72eb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.191873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-07a0bca3-16e5-4fd0-9da6-a8bab9cf8633 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Action: 'update', calling method: .version_select at 0x7f06be6e0e50>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:55.195061 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:55.195061 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:55.196685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07a0bca3-16e5-4fd0-9da6-a8bab9cf8633 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.197489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07a0bca3-16e5-4fd0-9da6-a8bab9cf8633 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.206091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07a0bca3-16e5-4fd0-9da6-a8bab9cf8633 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.207502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07a0bca3-16e5-4fd0-9da6-a8bab9cf8633 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.216751 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-07a0bca3-16e5-4fd0-9da6-a8bab9cf8633 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] HTTP exception thrown: Service 0344ff43-ec65-49e1-bccf-bed044440689 could not be found. Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-07a0bca3-16e5-4fd0-9da6-a8bab9cf8633 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Request method failure captured: Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: request: PUT /compute/v2.1/os-services/0344ff43-ec65-49e1-bccf-bed044440689 HTTP/1.1 Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 56 Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14BOeF3jA2QYgrWk6pfylqhkEFcFPCCptcDMNxaPC1ECCNsfEGxvVF1x2nKkETzRdT2xpId4Pv_mYHYLRMgeOqbULllMTxqt2zNFg305bnrXCjviCjkAgkkw7e1Czr6o38ZMUQ7ZPjX-nil3KnGhMcUsTTFg9JA014JnCZKl-ToMmxM Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: aa3c890dddf24891b80b749e067441e5 Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1588396104 Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member,admin Jul 20 04:10:55.235840 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member,admin Jul 20 04:10:55.237694 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa3c890dddf24891b80b749e067441e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aa3c890dddf24891b80b749e067441e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aa3c890dddf24891b80b749e067441e5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa3c890dddf24891b80b749e067441e5"}]}] Jul 20 04:10:55.237694 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1588396104 Jul 20 04:10:55.237694 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: aa3c890dddf24891b80b749e067441e5 Jul 20 04:10:55.237694 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1588396104 Jul 20 04:10:55.237694 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin Jul 20 04:10:55.237694 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:10:55.237694 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:10:55.237694 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 8fdfa36b6efc44b3a732f9feb56ccac2 Jul 20 04:10:55.237694 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin Jul 20 04:10:55.237694 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:10:55.237694 n-d-826526-5 devstack@n-api.service[127870]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 20 04:10:55.237694 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:10:55.237694 n-d-826526-5 devstack@n-api.service[127870]: exception: Service 0344ff43-ec65-49e1-bccf-bed044440689 could not be found. Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '0344ff43-ec65-49e1-bccf-bed044440689', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 0344ff43-ec65-49e1-bccf-bed044440689 could not be found. Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.238566 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 0344ff43-ec65-49e1-bccf-bed044440689 could not be found. Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:55.239768 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:55.243411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:55.243411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 0344ff43-ec65-49e1-bccf-bed044440689 could not be found. Jul 20 04:10:55.243411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.246212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-07a0bca3-16e5-4fd0-9da6-a8bab9cf8633 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Returning 404 to user: Service 0344ff43-ec65-49e1-bccf-bed044440689 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:55.247969 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-07a0bca3-16e5-4fd0-9da6-a8bab9cf8633 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-services/0344ff43-ec65-49e1-bccf-bed044440689" status: 404 len: 110 microversion: 2.53 time: 0.751841 Jul 20 04:10:55.249470 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 248/525] 10.222.0.17 () {62 vars in 1308 bytes} [Wed Jul 20 04:10:54 2022] PUT /compute/v2.1/os-services/0344ff43-ec65-49e1-bccf-bed044440689 => generated 110 bytes in 754 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:10:55.258109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ae68d520-88a7-4013-8e6d-a6a3fd6f7395 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:55.259365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ae68d520-88a7-4013-8e6d-a6a3fd6f7395 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:55.270708 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae68d520-88a7-4013-8e6d-a6a3fd6f7395 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.271536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae68d520-88a7-4013-8e6d-a6a3fd6f7395 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.274500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae68d520-88a7-4013-8e6d-a6a3fd6f7395 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.275717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae68d520-88a7-4013-8e6d-a6a3fd6f7395 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.455850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-deee1727-dce0-4b51-b82d-75b4345c72eb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:55.467244 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-deee1727-dce0-4b51-b82d-75b4345c72eb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1313 microversion: 2.1 time: 0.574574 Jul 20 04:10:55.468175 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 278/526] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:54 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1313 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:55.483666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a8143b53-7fdd-4fa4-8a95-eff2597abafc tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Action: 'update', calling method: .version_select at 0x7f06be5aa940>, body: {"status": "disabled"} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:55.488094 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:55.488094 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:10:55.493580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8143b53-7fdd-4fa4-8a95-eff2597abafc tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.494470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8143b53-7fdd-4fa4-8a95-eff2597abafc tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.514980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8143b53-7fdd-4fa4-8a95-eff2597abafc tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.518457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8143b53-7fdd-4fa4-8a95-eff2597abafc tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.535133 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-a8143b53-7fdd-4fa4-8a95-eff2597abafc tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] HTTP exception thrown: Service 0344ff43-ec65-49e1-bccf-bed044440689 could not be found. Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a8143b53-7fdd-4fa4-8a95-eff2597abafc tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Request method failure captured: Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: request: PUT /compute/v2.1/os-services/0344ff43-ec65-49e1-bccf-bed044440689 HTTP/1.1 Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 22 Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14BOeF3jA2QYgrWk6pfylqhkEFcFPCCptcDMNxaPC1ECCNsfEGxvVF1x2nKkETzRdT2xpId4Pv_mYHYLRMgeOqbULllMTxqt2zNFg305bnrXCjviCjkAgkkw7e1Czr6o38ZMUQ7ZPjX-nil3KnGhMcUsTTFg9JA014JnCZKl-ToMmxM Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: aa3c890dddf24891b80b749e067441e5 Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1588396104 Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:10:55.546201 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:10:55.547642 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa3c890dddf24891b80b749e067441e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aa3c890dddf24891b80b749e067441e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aa3c890dddf24891b80b749e067441e5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa3c890dddf24891b80b749e067441e5"}]}] Jul 20 04:10:55.547642 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1588396104 Jul 20 04:10:55.547642 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: aa3c890dddf24891b80b749e067441e5 Jul 20 04:10:55.547642 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1588396104 Jul 20 04:10:55.547642 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin Jul 20 04:10:55.547642 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:10:55.547642 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:10:55.547642 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 8fdfa36b6efc44b3a732f9feb56ccac2 Jul 20 04:10:55.547642 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin Jul 20 04:10:55.547642 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:10:55.547642 n-d-826526-5 devstack@n-api.service[127871]: {"status": "disabled"} Jul 20 04:10:55.547642 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:10:55.547642 n-d-826526-5 devstack@n-api.service[127871]: exception: Service 0344ff43-ec65-49e1-bccf-bed044440689 could not be found. Jul 20 04:10:55.547642 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '0344ff43-ec65-49e1-bccf-bed044440689', 'body': {'status': 'disabled'}} Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 0344ff43-ec65-49e1-bccf-bed044440689 could not be found. Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:55.548554 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 0344ff43-ec65-49e1-bccf-bed044440689 could not be found. Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:55.549811 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:55.550952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 0344ff43-ec65-49e1-bccf-bed044440689 could not be found. Jul 20 04:10:55.550952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.552114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a8143b53-7fdd-4fa4-8a95-eff2597abafc tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Returning 404 to user: Service 0344ff43-ec65-49e1-bccf-bed044440689 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:55.553251 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a8143b53-7fdd-4fa4-8a95-eff2597abafc tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-services/0344ff43-ec65-49e1-bccf-bed044440689" status: 404 len: 110 microversion: 2.53 time: 0.080862 Jul 20 04:10:55.554542 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 279/527] 10.222.0.17 () {62 vars in 1308 bytes} [Wed Jul 20 04:10:55 2022] PUT /compute/v2.1/os-services/0344ff43-ec65-49e1-bccf-bed044440689 => generated 110 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:10:55.564767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c8cf82c4-9114-427d-8810-f2d35019cd2f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Action: 'update', calling method: .version_select at 0x7f06be6c63a0>, body: {"status": "enabled"} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:55.569624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8cf82c4-9114-427d-8810-f2d35019cd2f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.570086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8cf82c4-9114-427d-8810-f2d35019cd2f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.586518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8cf82c4-9114-427d-8810-f2d35019cd2f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.587026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8cf82c4-9114-427d-8810-f2d35019cd2f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.600144 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-c8cf82c4-9114-427d-8810-f2d35019cd2f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] HTTP exception thrown: Service 0344ff43-ec65-49e1-bccf-bed044440689 could not be found. Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c8cf82c4-9114-427d-8810-f2d35019cd2f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Request method failure captured: Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: request: PUT /compute/v2.1/os-services/0344ff43-ec65-49e1-bccf-bed044440689 HTTP/1.1 Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 21 Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14BOeF3jA2QYgrWk6pfylqhkEFcFPCCptcDMNxaPC1ECCNsfEGxvVF1x2nKkETzRdT2xpId4Pv_mYHYLRMgeOqbULllMTxqt2zNFg305bnrXCjviCjkAgkkw7e1Czr6o38ZMUQ7ZPjX-nil3KnGhMcUsTTFg9JA014JnCZKl-ToMmxM Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: aa3c890dddf24891b80b749e067441e5 Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1588396104 Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:10:55.605717 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:10:55.607427 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa3c890dddf24891b80b749e067441e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aa3c890dddf24891b80b749e067441e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aa3c890dddf24891b80b749e067441e5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa3c890dddf24891b80b749e067441e5"}]}] Jul 20 04:10:55.607427 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1588396104 Jul 20 04:10:55.607427 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: aa3c890dddf24891b80b749e067441e5 Jul 20 04:10:55.607427 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1588396104 Jul 20 04:10:55.607427 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin Jul 20 04:10:55.607427 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:10:55.607427 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:10:55.607427 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 8fdfa36b6efc44b3a732f9feb56ccac2 Jul 20 04:10:55.607427 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin Jul 20 04:10:55.607427 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:10:55.607427 n-d-826526-5 devstack@n-api.service[127871]: {"status": "enabled"} Jul 20 04:10:55.607427 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:10:55.607427 n-d-826526-5 devstack@n-api.service[127871]: exception: Service 0344ff43-ec65-49e1-bccf-bed044440689 could not be found. Jul 20 04:10:55.607427 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '0344ff43-ec65-49e1-bccf-bed044440689', 'body': {'status': 'enabled'}} Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 0344ff43-ec65-49e1-bccf-bed044440689 could not be found. Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:55.608454 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 0344ff43-ec65-49e1-bccf-bed044440689 could not be found. Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:55.609695 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:55.610832 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 0344ff43-ec65-49e1-bccf-bed044440689 could not be found. Jul 20 04:10:55.610832 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.610832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c8cf82c4-9114-427d-8810-f2d35019cd2f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Returning 404 to user: Service 0344ff43-ec65-49e1-bccf-bed044440689 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:55.610832 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c8cf82c4-9114-427d-8810-f2d35019cd2f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-services/0344ff43-ec65-49e1-bccf-bed044440689" status: 404 len: 110 microversion: 2.53 time: 0.047761 Jul 20 04:10:55.612044 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 280/528] 10.222.0.17 () {62 vars in 1308 bytes} [Wed Jul 20 04:10:55 2022] PUT /compute/v2.1/os-services/0344ff43-ec65-49e1-bccf-bed044440689 => generated 110 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:10:55.620114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3a719805-36fb-4964-b319-93728770f063 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:55.621496 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:55.621496 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:10:55.622761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a719805-36fb-4964-b319-93728770f063 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.623211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a719805-36fb-4964-b319-93728770f063 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.624011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a719805-36fb-4964-b319-93728770f063 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.624471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a719805-36fb-4964-b319-93728770f063 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.654809 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3a719805-36fb-4964-b319-93728770f063 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.040849 Jul 20 04:10:55.655625 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 281/529] 10.222.0.17 () {60 vars in 1177 bytes} [Wed Jul 20 04:10:55 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:55.692812 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fa229586-2292-4603-8a1c-f31424ea73e8 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:55.697233 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:55.697233 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:10:55.702237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa229586-2292-4603-8a1c-f31424ea73e8 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.702701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa229586-2292-4603-8a1c-f31424ea73e8 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.703525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa229586-2292-4603-8a1c-f31424ea73e8 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.706130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa229586-2292-4603-8a1c-f31424ea73e8 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.787551 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fa229586-2292-4603-8a1c-f31424ea73e8 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.108100 Jul 20 04:10:55.793907 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 282/530] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jul 20 04:10:55 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:55.814398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f73827e0-f887-462c-85a7-29a42890b31f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:55.818218 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:55.818218 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:10:55.818449 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ae68d520-88a7-4013-8e6d-a6a3fd6f7395 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:55.822996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f73827e0-f887-462c-85a7-29a42890b31f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.824574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f73827e0-f887-462c-85a7-29a42890b31f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.826911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f73827e0-f887-462c-85a7-29a42890b31f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.828067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f73827e0-f887-462c-85a7-29a42890b31f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.833121 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ae68d520-88a7-4013-8e6d-a6a3fd6f7395 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1474 microversion: 2.1 time: 0.580517 Jul 20 04:10:55.846158 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 249/531] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:55 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1474 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:55.872713 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f73827e0-f887-462c-85a7-29a42890b31f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.066339 Jul 20 04:10:55.874365 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 283/532] 10.222.0.17 () {60 vars in 1177 bytes} [Wed Jul 20 04:10:55 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:55.885384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-49519b09-8c67-4722-aaac-8527cd3a2df5 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:55.886749 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:55.886749 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:10:55.888026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49519b09-8c67-4722-aaac-8527cd3a2df5 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.889202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49519b09-8c67-4722-aaac-8527cd3a2df5 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.890785 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49519b09-8c67-4722-aaac-8527cd3a2df5 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.892189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49519b09-8c67-4722-aaac-8527cd3a2df5 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.912908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-16c96c6f-5591-4dc8-8c9f-70f5bdd7759b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:55.913541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-16c96c6f-5591-4dc8-8c9f-70f5bdd7759b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:55.924771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-16c96c6f-5591-4dc8-8c9f-70f5bdd7759b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.925524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-16c96c6f-5591-4dc8-8c9f-70f5bdd7759b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.926897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-16c96c6f-5591-4dc8-8c9f-70f5bdd7759b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.926897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-16c96c6f-5591-4dc8-8c9f-70f5bdd7759b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.948235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:55.981623 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-49519b09-8c67-4722-aaac-8527cd3a2df5 tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=n-d-826526-5&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.100246 Jul 20 04:10:55.982826 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 250/533] 10.222.0.17 () {60 vars in 1234 bytes} [Wed Jul 20 04:10:55 2022] GET /compute/v2.1/os-services?host=n-d-826526-5&binary=xxx => generated 16 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:56.122255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2c71f6bd-15ee-4528-8ff4-849f12b9207e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-377440951", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "d596c209-8ad5-47de-87f3-e30c0a431c35"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:56.284044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-2c71f6bd-15ee-4528-8ff4-849f12b9207e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] validate_networks() for [('d596c209-8ad5-47de-87f3-e30c0a431c35', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:10:56.299411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-16c96c6f-5591-4dc8-8c9f-70f5bdd7759b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:56.318776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-16c96c6f-5591-4dc8-8c9f-70f5bdd7759b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:56.320352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-16c96c6f-5591-4dc8-8c9f-70f5bdd7759b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:56.325746 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-16c96c6f-5591-4dc8-8c9f-70f5bdd7759b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1568 microversion: 2.25 time: 0.421299 Jul 20 04:10:56.342456 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 284/534] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:55 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1568 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:56.349138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f1aef816-8eac-4337-a6e2-3d1b56defd6f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:56.351266 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:56.351266 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:10:56.353339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1aef816-8eac-4337-a6e2-3d1b56defd6f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:56.354337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1aef816-8eac-4337-a6e2-3d1b56defd6f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:56.355325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1aef816-8eac-4337-a6e2-3d1b56defd6f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:56.357824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1aef816-8eac-4337-a6e2-3d1b56defd6f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:56.396875 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f1aef816-8eac-4337-a6e2-3d1b56defd6f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.052693 Jul 20 04:10:56.397994 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 285/535] 10.222.0.17 () {60 vars in 1177 bytes} [Wed Jul 20 04:10:56 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:56.412042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-58baa515-fb89-41ee-a074-6595547a840f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:56.413619 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:56.413619 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:10:56.416469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58baa515-fb89-41ee-a074-6595547a840f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:56.417756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58baa515-fb89-41ee-a074-6595547a840f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:56.419237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58baa515-fb89-41ee-a074-6595547a840f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:56.419879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58baa515-fb89-41ee-a074-6595547a840f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:56.461756 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-58baa515-fb89-41ee-a074-6595547a840f tempest-ServicesAdminNegativeV253TestJSON-1588396104 tempest-ServicesAdminNegativeV253TestJSON-1588396104-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.055709 Jul 20 04:10:56.469893 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 286/536] 10.222.0.17 () {60 vars in 1238 bytes} [Wed Jul 20 04:10:56 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:56.665655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f2ff5a37-96d6-4d92-b484-42f000bd12e6 tempest-ServicesAdminNegativeV253TestJSON-435107392 tempest-ServicesAdminNegativeV253TestJSON-435107392-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:56.668223 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:56.668223 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:10:56.671634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f2ff5a37-96d6-4d92-b484-42f000bd12e6 tempest-ServicesAdminNegativeV253TestJSON-435107392 tempest-ServicesAdminNegativeV253TestJSON-435107392-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '3f7e4c872c6f4be9adb09771f60f3097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd9d266f2f42bba4ec7b937b3596b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f2ff5a37-96d6-4d92-b484-42f000bd12e6 tempest-ServicesAdminNegativeV253TestJSON-435107392 tempest-ServicesAdminNegativeV253TestJSON-435107392-project] Request method failure captured: Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14BM8OnhwHkgqIjlOSwFplZfRKRJj2yw5j7Ioae8WoxyTGwHMzpA4FEPGpi0hbAQHcm1EWRaEqsjK537MlENAlWkkbALDbHG_RkdY1I3h_8NmnkoiFs_i3sOz8pDDVDAdHUZojAPLA006rW0Q8MN1G7VbwsdynuKifUfOa76pmeebjo Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 60dd9d266f2f42bba4ec7b937b3596b9 Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-435107392 Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:10:56.677001 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:10:56.678390 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/60dd9d266f2f42bba4ec7b937b3596b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/60dd9d266f2f42bba4ec7b937b3596b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_60dd9d266f2f42bba4ec7b937b3596b9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/60dd9d266f2f42bba4ec7b937b3596b9"}]}] Jul 20 04:10:56.678390 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-435107392 Jul 20 04:10:56.678390 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 60dd9d266f2f42bba4ec7b937b3596b9 Jul 20 04:10:56.678390 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-435107392 Jul 20 04:10:56.678390 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServicesAdminNegativeV253TestJSON-435107392-project Jul 20 04:10:56.678390 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:10:56.678390 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:10:56.678390 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 3f7e4c872c6f4be9adb09771f60f3097 Jul 20 04:10:56.678390 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-435107392-project Jul 20 04:10:56.678390 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:10:56.678390 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:10:56.678390 n-d-826526-5 devstack@n-api.service[127871]: action_args: {} Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:56.679441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:10:56.680663 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:10:56.684406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f2ff5a37-96d6-4d92-b484-42f000bd12e6 tempest-ServicesAdminNegativeV253TestJSON-435107392 tempest-ServicesAdminNegativeV253TestJSON-435107392-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:56.686283 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f2ff5a37-96d6-4d92-b484-42f000bd12e6 tempest-ServicesAdminNegativeV253TestJSON-435107392 tempest-ServicesAdminNegativeV253TestJSON-435107392-project] 10.222.0.17 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.211850 Jul 20 04:10:56.687362 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 287/537] 10.222.0.17 () {60 vars in 1177 bytes} [Wed Jul 20 04:10:56 2022] GET /compute/v2.1/os-services => generated 112 bytes in 213 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:10:56.701645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bb5d338f-f00f-4250-ae44-5c018755c2da tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:56.703121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bb5d338f-f00f-4250-ae44-5c018755c2da tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:56.711779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bb5d338f-f00f-4250-ae44-5c018755c2da tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:56.712215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bb5d338f-f00f-4250-ae44-5c018755c2da tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:56.713592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bb5d338f-f00f-4250-ae44-5c018755c2da tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:56.714406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bb5d338f-f00f-4250-ae44-5c018755c2da tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:57.038416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bb5d338f-f00f-4250-ae44-5c018755c2da tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:57.049972 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bb5d338f-f00f-4250-ae44-5c018755c2da tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1463 microversion: 2.1 time: 0.359090 Jul 20 04:10:57.050634 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 288/538] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:56 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1463 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:57.065658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ba100e95-86b3-489a-b216-6daf138f17ba tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:57.066281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ba100e95-86b3-489a-b216-6daf138f17ba tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:57.082386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba100e95-86b3-489a-b216-6daf138f17ba tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:57.082841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba100e95-86b3-489a-b216-6daf138f17ba tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:57.086492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba100e95-86b3-489a-b216-6daf138f17ba tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:57.087030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba100e95-86b3-489a-b216-6daf138f17ba tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:57.276106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ba100e95-86b3-489a-b216-6daf138f17ba tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb773226944c408149ae7f33b12dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a267e50d30497d93400d593631d3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:57.290263 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ba100e95-86b3-489a-b216-6daf138f17ba tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 200 len: 1432 microversion: 2.1 time: 0.238260 Jul 20 04:10:57.301223 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 289/539] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:57 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 1432 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:57.318248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8734d645-5633-4357-a388-d954b6dec3ee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:57.319706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8734d645-5633-4357-a388-d954b6dec3ee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:57.338596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8734d645-5633-4357-a388-d954b6dec3ee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:57.340782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8734d645-5633-4357-a388-d954b6dec3ee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:57.345008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8734d645-5633-4357-a388-d954b6dec3ee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:57.349041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8734d645-5633-4357-a388-d954b6dec3ee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:57.641881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8734d645-5633-4357-a388-d954b6dec3ee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:57.650646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8734d645-5633-4357-a388-d954b6dec3ee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Old instance type m1.heat2, new instance type m1.heat {{(pid=127871) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:10:57.672496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8734d645-5633-4357-a388-d954b6dec3ee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:57.673715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8734d645-5633-4357-a388-d954b6dec3ee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:57.674192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8734d645-5633-4357-a388-d954b6dec3ee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:57.674675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8734d645-5633-4357-a388-d954b6dec3ee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:57.675091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8734d645-5633-4357-a388-d954b6dec3ee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:57.963099 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8734d645-5633-4357-a388-d954b6dec3ee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "POST /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247/action" status: 202 len: 0 microversion: 2.1 time: 0.660046 Jul 20 04:10:57.965502 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 290/540] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:10:57 2022] POST /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247/action => generated 0 bytes in 663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:57.991047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-512110be-579d-4a1f-9e72-bdf61fc81f3c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:57.991752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-512110be-579d-4a1f-9e72-bdf61fc81f3c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:58.007485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:58.024864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-512110be-579d-4a1f-9e72-bdf61fc81f3c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:58.026060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-512110be-579d-4a1f-9e72-bdf61fc81f3c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:58.027923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-512110be-579d-4a1f-9e72-bdf61fc81f3c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:58.029358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-512110be-579d-4a1f-9e72-bdf61fc81f3c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:58.764508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-512110be-579d-4a1f-9e72-bdf61fc81f3c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:58.784248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-512110be-579d-4a1f-9e72-bdf61fc81f3c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:58.786362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-512110be-579d-4a1f-9e72-bdf61fc81f3c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:58.790283 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-512110be-579d-4a1f-9e72-bdf61fc81f3c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1568 microversion: 2.25 time: 0.823663 Jul 20 04:10:58.791406 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 291/541] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:57 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1568 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:58.811301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-166a3b0a-10a4-4dc9-8e53-0cf05df7af53 req-6ba38daf-4a99-4de8-bbf7-eb98a32cfa0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b121be-5714-4811-bee9-784322e4e43b", "name": "network-vif-deleted", "tag": "1ee2808f-7853-44ea-b6c8-1a298396ca2b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:58.839820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-166a3b0a-10a4-4dc9-8e53-0cf05df7af53 req-6ba38daf-4a99-4de8-bbf7-eb98a32cfa0d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:58.842141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-166a3b0a-10a4-4dc9-8e53-0cf05df7af53 req-6ba38daf-4a99-4de8-bbf7-eb98a32cfa0d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:58.869084 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-166a3b0a-10a4-4dc9-8e53-0cf05df7af53 req-6ba38daf-4a99-4de8-bbf7-eb98a32cfa0d service nova] Creating event network-vif-deleted:1ee2808f-7853-44ea-b6c8-1a298396ca2b for instance d6b121be-5714-4811-bee9-784322e4e43b on n-h2-826526-5 Jul 20 04:10:58.884593 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-166a3b0a-10a4-4dc9-8e53-0cf05df7af53 req-6ba38daf-4a99-4de8-bbf7-eb98a32cfa0d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089923 Jul 20 04:10:58.885793 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 292/542] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:58.891193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-617cd03b-e44f-42b4-b1c2-4abeb8dd2096 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:58.897543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-617cd03b-e44f-42b4-b1c2-4abeb8dd2096 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:58.907722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-617cd03b-e44f-42b4-b1c2-4abeb8dd2096 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:58.914747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-617cd03b-e44f-42b4-b1c2-4abeb8dd2096 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:58.915951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-617cd03b-e44f-42b4-b1c2-4abeb8dd2096 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:58.916688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-617cd03b-e44f-42b4-b1c2-4abeb8dd2096 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:59.180948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-2c71f6bd-15ee-4528-8ff4-849f12b9207e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:59.181956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-2c71f6bd-15ee-4528-8ff4-849f12b9207e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:59.182690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-2c71f6bd-15ee-4528-8ff4-849f12b9207e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:59.183301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-2c71f6bd-15ee-4528-8ff4-849f12b9207e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:59.183984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-2c71f6bd-15ee-4528-8ff4-849f12b9207e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:59.202693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c71f6bd-15ee-4528-8ff4-849f12b9207e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:59.203130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c71f6bd-15ee-4528-8ff4-849f12b9207e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:59.205854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c71f6bd-15ee-4528-8ff4-849f12b9207e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:59.220296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c71f6bd-15ee-4528-8ff4-849f12b9207e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:59.253958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=15 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:59.279988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-2c71f6bd-15ee-4528-8ff4-849f12b9207e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Getting quotas for project 6295769a840d437c9deed641966fd143. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:59.295634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-2c71f6bd-15ee-4528-8ff4-849f12b9207e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Getting quotas for user 106afc4bcfc04122b9afb3cc2b17cc03 and project 6295769a840d437c9deed641966fd143. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:59.333692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2c71f6bd-15ee-4528-8ff4-849f12b9207e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:10:59.345363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2c71f6bd-15ee-4528-8ff4-849f12b9207e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:10:59.473282 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2c71f6bd-15ee-4528-8ff4-849f12b9207e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.488410 Jul 20 04:10:59.474824 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 251/543] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:10:59.485001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-55471594-900e-44a9-991c-bb4d4f4e4810 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:59.486352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-55471594-900e-44a9-991c-bb4d4f4e4810 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] [instance: d6b121be-5714-4811-bee9-784322e4e43b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:59.543205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-55471594-900e-44a9-991c-bb4d4f4e4810 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:59.544619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-55471594-900e-44a9-991c-bb4d4f4e4810 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:59.545891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-55471594-900e-44a9-991c-bb4d4f4e4810 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:59.547435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-55471594-900e-44a9-991c-bb4d4f4e4810 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:59.578591 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-55471594-900e-44a9-991c-bb4d4f4e4810 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] HTTP exception thrown: Instance d6b121be-5714-4811-bee9-784322e4e43b could not be found. Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-55471594-900e-44a9-991c-bb4d4f4e4810 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Request method failure captured: Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b HTTP/1.1 Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi13_4zZzadMv0L3ta93EDWPQMP8-9uEuF4BdXbIs5n33E6U1e2zSVS9uphDwPhkl_CyWMMRoZvXY8o19weyLSlltTc0eBLqu9UKp4UEpT7-2QKl8teNSmUsoFFXZXVOSF9lObwCYvdUBd1FmRlwhAX1w4-fipFiiWY1JHTTfqEGWuTWI Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: f2a267e50d30497d93400d593631d3e7 Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-LiveMigrationNegativeTest-146660810 Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:10:59.586728 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:10:59.588702 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2a267e50d30497d93400d593631d3e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f2a267e50d30497d93400d593631d3e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f2a267e50d30497d93400d593631d3e7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2a267e50d30497d93400d593631d3e7"}]}] Jul 20 04:10:59.588702 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-LiveMigrationNegativeTest-146660810 Jul 20 04:10:59.588702 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: f2a267e50d30497d93400d593631d3e7 Jul 20 04:10:59.588702 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-146660810 Jul 20 04:10:59.588702 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-LiveMigrationNegativeTest-146660810-project Jul 20 04:10:59.588702 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:10:59.588702 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:10:59.588702 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: c2eb773226944c408149ae7f33b12dbe Jul 20 04:10:59.588702 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-LiveMigrationNegativeTest-146660810-project Jul 20 04:10:59.588702 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:10:59.588702 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance d6b121be-5714-4811-bee9-784322e4e43b could not be found. Jul 20 04:10:59.588702 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'd6b121be-5714-4811-bee9-784322e4e43b'} Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6b121be-5714-4811-bee9-784322e4e43b could not be found. Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:59.589943 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:59.591310 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:59.591310 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:10:59.591310 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:10:59.591310 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:10:59.591310 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:10:59.591310 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:10:59.591310 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:59.591310 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6b121be-5714-4811-bee9-784322e4e43b could not be found. Jul 20 04:10:59.591310 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:59.591310 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:59.591310 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:59.591310 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:59.591310 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:59.591310 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:59.591310 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:59.591310 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:59.591310 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6b121be-5714-4811-bee9-784322e4e43b could not be found. Jul 20 04:10:59.591310 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:10:59.596348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-55471594-900e-44a9-991c-bb4d4f4e4810 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] Returning 404 to user: Instance d6b121be-5714-4811-bee9-784322e4e43b could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:59.600904 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-55471594-900e-44a9-991c-bb4d4f4e4810 tempest-LiveMigrationNegativeTest-146660810 tempest-LiveMigrationNegativeTest-146660810-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b" status: 404 len: 111 microversion: 2.1 time: 0.124259 Jul 20 04:10:59.604969 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 252/544] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:59 2022] GET /compute/v2.1/servers/d6b121be-5714-4811-bee9-784322e4e43b => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:59.617973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bca3bad9-b772-415d-8b4e-9fa139b445b9 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:59.620786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bca3bad9-b772-415d-8b4e-9fa139b445b9 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:59.699601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-617cd03b-e44f-42b4-b1c2-4abeb8dd2096 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:59.712243 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-617cd03b-e44f-42b4-b1c2-4abeb8dd2096 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1472 microversion: 2.1 time: 0.824971 Jul 20 04:10:59.719911 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 293/545] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:58 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1472 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:59.811326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d07f3da1-1116-46c3-a006-94c2cf82702a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:59.815215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d07f3da1-1116-46c3-a006-94c2cf82702a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:59.821985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d07f3da1-1116-46c3-a006-94c2cf82702a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:59.822526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d07f3da1-1116-46c3-a006-94c2cf82702a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:59.823267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d07f3da1-1116-46c3-a006-94c2cf82702a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:59.823634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d07f3da1-1116-46c3-a006-94c2cf82702a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:59.926162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bca3bad9-b772-415d-8b4e-9fa139b445b9 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:59.936653 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bca3bad9-b772-415d-8b4e-9fa139b445b9 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1210 microversion: 2.1 time: 0.330235 Jul 20 04:10:59.940001 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 253/546] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:59 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1210 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:00.732438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a379e152-029f-4c72-9df3-705588b43f9e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:00.733873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a379e152-029f-4c72-9df3-705588b43f9e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:00.747272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a379e152-029f-4c72-9df3-705588b43f9e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:00.748430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a379e152-029f-4c72-9df3-705588b43f9e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:00.749444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a379e152-029f-4c72-9df3-705588b43f9e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:00.750094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a379e152-029f-4c72-9df3-705588b43f9e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:00.780895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:01.056942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d07f3da1-1116-46c3-a006-94c2cf82702a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:01.073549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d07f3da1-1116-46c3-a006-94c2cf82702a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:01.075162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d07f3da1-1116-46c3-a006-94c2cf82702a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:01.089169 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d07f3da1-1116-46c3-a006-94c2cf82702a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1558 microversion: 2.25 time: 1.278470 Jul 20 04:11:01.089804 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 294/547] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:10:59 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1558 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:01.115952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ebf6db3a-6bee-49e6-a0c0-230ffdd43da0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:01.118741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ebf6db3a-6bee-49e6-a0c0-230ffdd43da0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:01.154160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebf6db3a-6bee-49e6-a0c0-230ffdd43da0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:01.160906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebf6db3a-6bee-49e6-a0c0-230ffdd43da0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:01.163824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebf6db3a-6bee-49e6-a0c0-230ffdd43da0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:01.164616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebf6db3a-6bee-49e6-a0c0-230ffdd43da0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:01.381631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a379e152-029f-4c72-9df3-705588b43f9e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:01.391349 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a379e152-029f-4c72-9df3-705588b43f9e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1472 microversion: 2.1 time: 0.663707 Jul 20 04:11:01.391942 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 254/548] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:00 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1472 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:01.411998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ebf6db3a-6bee-49e6-a0c0-230ffdd43da0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:01.419369 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b257a81f-a274-442c-9a65-fa6253706370 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '.version_select at 0x7f06be699670>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:01.425859 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ebf6db3a-6bee-49e6-a0c0-230ffdd43da0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1262 microversion: 2.1 time: 0.334887 Jul 20 04:11:01.432092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b257a81f-a274-442c-9a65-fa6253706370 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:01.432805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b257a81f-a274-442c-9a65-fa6253706370 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:01.436080 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 295/549] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:01 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1262 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:01.455845 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b257a81f-a274-442c-9a65-fa6253706370 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 1230 microversion: 2.25 time: 0.060130 Jul 20 04:11:01.471544 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 255/550] 10.222.0.17 () {60 vars in 1183 bytes} [Wed Jul 20 04:11:01 2022] GET /compute/v2.1/os-migrations => generated 1230 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:01.475463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-aeb62251-ab66-4a4b-9941-fe8aab35609c tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:01.476086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-aeb62251-ab66-4a4b-9941-fe8aab35609c tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:01.484433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aeb62251-ab66-4a4b-9941-fe8aab35609c tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:01.484883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aeb62251-ab66-4a4b-9941-fe8aab35609c tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:01.487534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aeb62251-ab66-4a4b-9941-fe8aab35609c tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:01.487975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aeb62251-ab66-4a4b-9941-fe8aab35609c tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:01.922686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-aeb62251-ab66-4a4b-9941-fe8aab35609c tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'services' on Instance uuid ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:11:01.977530 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-aeb62251-ab66-4a4b-9941-fe8aab35609c tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 2050 microversion: 2.25 time: 0.503589 Jul 20 04:11:01.981812 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 296/551] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:01 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 2050 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:02.325607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8602dd20-fd4c-4eb0-9c1a-0e4472091ad8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1793091621", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "08ef3e3e-6870-4bac-a7ee-1dba3bc5da77"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:02.411727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d46a77d7-cd1d-4578-93d8-38632db277df tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:02.412881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d46a77d7-cd1d-4578-93d8-38632db277df tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:02.431351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d46a77d7-cd1d-4578-93d8-38632db277df tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:02.442702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d46a77d7-cd1d-4578-93d8-38632db277df tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:02.443891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d46a77d7-cd1d-4578-93d8-38632db277df tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:02.449332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d46a77d7-cd1d-4578-93d8-38632db277df tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:02.451054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-8602dd20-fd4c-4eb0-9c1a-0e4472091ad8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] validate_networks() for [('08ef3e3e-6870-4bac-a7ee-1dba3bc5da77', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:03.234133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=42 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:03.435590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d46a77d7-cd1d-4578-93d8-38632db277df tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:03.495337 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d46a77d7-cd1d-4578-93d8-38632db277df tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1472 microversion: 2.1 time: 1.089751 Jul 20 04:11:03.495934 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 297/552] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:02 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1472 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:03.542591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1dc69365-0048-4553-861c-ab0464848a81 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:03.542591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1dc69365-0048-4553-861c-ab0464848a81 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:03.577847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1dc69365-0048-4553-861c-ab0464848a81 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:03.578168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1dc69365-0048-4553-861c-ab0464848a81 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:03.578964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1dc69365-0048-4553-861c-ab0464848a81 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:03.579393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1dc69365-0048-4553-861c-ab0464848a81 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:03.824791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1dc69365-0048-4553-861c-ab0464848a81 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:03.833831 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1dc69365-0048-4553-861c-ab0464848a81 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1268 microversion: 2.1 time: 0.328106 Jul 20 04:11:03.845067 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 298/553] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:03 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1268 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:03.867058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-26f655ba-7741-4f14-8ac7-b1f19bf9b23a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1787592472", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "455043314", "adminPass": "***", "networks": [{"uuid": "72f5452b-77fa-4c50-bcf2-19dad2a4da9c"}], "security_groups": [{"name": "tempest-securitygroup--219770565"}], "key_name": "tempest-keypair-1546201336", "user_data": "}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:04.234631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8602dd20-fd4c-4eb0-9c1a-0e4472091ad8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:04.236425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8602dd20-fd4c-4eb0-9c1a-0e4472091ad8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:04.237292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8602dd20-fd4c-4eb0-9c1a-0e4472091ad8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:04.237867 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8602dd20-fd4c-4eb0-9c1a-0e4472091ad8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:04.238661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8602dd20-fd4c-4eb0-9c1a-0e4472091ad8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:04.280666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8602dd20-fd4c-4eb0-9c1a-0e4472091ad8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:04.281536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8602dd20-fd4c-4eb0-9c1a-0e4472091ad8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:04.284312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8602dd20-fd4c-4eb0-9c1a-0e4472091ad8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:04.287360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8602dd20-fd4c-4eb0-9c1a-0e4472091ad8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:04.360881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8602dd20-fd4c-4eb0-9c1a-0e4472091ad8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Getting quotas for project 8d4037629b9e4e6fa92e2a8d89cf0311. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:04.361855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-26f655ba-7741-4f14-8ac7-b1f19bf9b23a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] validate_networks() for [('72f5452b-77fa-4c50-bcf2-19dad2a4da9c', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:04.384468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8602dd20-fd4c-4eb0-9c1a-0e4472091ad8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Getting quotas for user 45a9bfefde81473d88610b03e0de9bf4 and project 8d4037629b9e4e6fa92e2a8d89cf0311. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:04.419323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8602dd20-fd4c-4eb0-9c1a-0e4472091ad8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:11:04.422086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8602dd20-fd4c-4eb0-9c1a-0e4472091ad8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:04.583681 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8602dd20-fd4c-4eb0-9c1a-0e4472091ad8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.250112 Jul 20 04:11:04.588426 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 256/554] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 04:11:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2267 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 20 04:11:04.640393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-056beaf8-4c09-48e6-b017-e669ed325b5f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:04.646465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-056beaf8-4c09-48e6-b017-e669ed325b5f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:04.708316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-056beaf8-4c09-48e6-b017-e669ed325b5f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:04.709908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-056beaf8-4c09-48e6-b017-e669ed325b5f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:04.713099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-056beaf8-4c09-48e6-b017-e669ed325b5f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:04.716045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-056beaf8-4c09-48e6-b017-e669ed325b5f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:05.843914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-26f655ba-7741-4f14-8ac7-b1f19bf9b23a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:05.844870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-26f655ba-7741-4f14-8ac7-b1f19bf9b23a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:05.845347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-26f655ba-7741-4f14-8ac7-b1f19bf9b23a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:05.846035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-26f655ba-7741-4f14-8ac7-b1f19bf9b23a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:05.846941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-26f655ba-7741-4f14-8ac7-b1f19bf9b23a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:05.872071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26f655ba-7741-4f14-8ac7-b1f19bf9b23a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:05.872778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26f655ba-7741-4f14-8ac7-b1f19bf9b23a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:05.873764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26f655ba-7741-4f14-8ac7-b1f19bf9b23a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:05.875358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26f655ba-7741-4f14-8ac7-b1f19bf9b23a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:05.937274 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-26f655ba-7741-4f14-8ac7-b1f19bf9b23a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Getting quotas for project bc39197e171c40638322c4ca85d73305. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:05.947844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-26f655ba-7741-4f14-8ac7-b1f19bf9b23a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Getting quotas for user f4a6e471d9ee4ab1af6781800903c74b and project bc39197e171c40638322c4ca85d73305. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:05.989951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-26f655ba-7741-4f14-8ac7-b1f19bf9b23a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:11:05.997626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-26f655ba-7741-4f14-8ac7-b1f19bf9b23a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:06.191168 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-26f655ba-7741-4f14-8ac7-b1f19bf9b23a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.328803 Jul 20 04:11:06.208955 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 299/555] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 2347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:11:06.222336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-acd6fec4-beda-4bef-81df-d43ecccf0c79 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:06.238621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-acd6fec4-beda-4bef-81df-d43ecccf0c79 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:06.280979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-acd6fec4-beda-4bef-81df-d43ecccf0c79 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:06.282792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-acd6fec4-beda-4bef-81df-d43ecccf0c79 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:06.284822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-acd6fec4-beda-4bef-81df-d43ecccf0c79 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:06.286304 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-acd6fec4-beda-4bef-81df-d43ecccf0c79 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:06.427942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-056beaf8-4c09-48e6-b017-e669ed325b5f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:06.437985 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-056beaf8-4c09-48e6-b017-e669ed325b5f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1472 microversion: 2.1 time: 1.847968 Jul 20 04:11:06.449527 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 257/556] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:04 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1472 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:06.478475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-acd6fec4-beda-4bef-81df-d43ecccf0c79 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:06.493672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-acd6fec4-beda-4bef-81df-d43ecccf0c79 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:06.497795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-acd6fec4-beda-4bef-81df-d43ecccf0c79 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:06.505063 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-acd6fec4-beda-4bef-81df-d43ecccf0c79 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1258 microversion: 2.25 time: 0.292927 Jul 20 04:11:06.507805 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 300/557] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:06 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1258 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:06.516460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5efefd65-dc20-412b-89e0-2478bb0ed269 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:06.518724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5efefd65-dc20-412b-89e0-2478bb0ed269 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:06.531778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5efefd65-dc20-412b-89e0-2478bb0ed269 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:06.533565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5efefd65-dc20-412b-89e0-2478bb0ed269 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:06.538538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5efefd65-dc20-412b-89e0-2478bb0ed269 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:06.539111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5efefd65-dc20-412b-89e0-2478bb0ed269 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:06.900409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5efefd65-dc20-412b-89e0-2478bb0ed269 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:06.920022 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5efefd65-dc20-412b-89e0-2478bb0ed269 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1310 microversion: 2.1 time: 0.399273 Jul 20 04:11:06.922991 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 301/558] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:06 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1310 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:06.940704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-11a08993-68a0-4cb2-92a7-bd8ce74d1145 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:06.943776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-11a08993-68a0-4cb2-92a7-bd8ce74d1145 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:07.127990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-11a08993-68a0-4cb2-92a7-bd8ce74d1145 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:07.146792 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-11a08993-68a0-4cb2-92a7-bd8ce74d1145 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216" status: 200 len: 1263 microversion: 2.1 time: 0.211031 Jul 20 04:11:07.147481 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 302/559] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:06 2022] GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 => generated 1263 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:07.223594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2096a551-0e5d-4619-91b7-7d79deff42a5 tempest-ListImageFiltersNegativeTestJSON-1344421021 tempest-ListImageFiltersNegativeTestJSON-1344421021-project] Calling method '.version_select at 0x7f06be6bb280>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:07.261811 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-2096a551-0e5d-4619-91b7-7d79deff42a5 tempest-ListImageFiltersNegativeTestJSON-1344421021 tempest-ListImageFiltersNegativeTestJSON-1344421021-project] HTTP exception thrown: Image not found. Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2096a551-0e5d-4619-91b7-7d79deff42a5 tempest-ListImageFiltersNegativeTestJSON-1344421021 tempest-ListImageFiltersNegativeTestJSON-1344421021-project] Request method failure captured: Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/images/3a96d39a-713d-44c5-9ac1-d2393127a405 HTTP/1.1 Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14BYpvP3I1Ec4BhT2z3z_32zQ4eSWz91NRPRDcK1yqDQsZnlQGTaw3gK8fUT0WFroD_zr_-TIJcOOPG-syegLr9LHznAUjqq6gIvF-sdvQY3YoJPQYt-qaIuy9btTsqco_xbSPUIEWrLTPsnb9E2PlyZkYR8PXIvpttzrK3UWj4CZ2U Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: fbb57a8fc41648e480bffb50ee27ee0e Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1344421021 Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:11:07.302783 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:11:07.304385 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fbb57a8fc41648e480bffb50ee27ee0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fbb57a8fc41648e480bffb50ee27ee0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fbb57a8fc41648e480bffb50ee27ee0e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fbb57a8fc41648e480bffb50ee27ee0e"}]}] Jul 20 04:11:07.304385 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1344421021 Jul 20 04:11:07.304385 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: fbb57a8fc41648e480bffb50ee27ee0e Jul 20 04:11:07.304385 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1344421021 Jul 20 04:11:07.304385 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ListImageFiltersNegativeTestJSON-1344421021-project Jul 20 04:11:07.304385 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:11:07.304385 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:11:07.304385 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: e61a3b84133b43ac8704fd1b07878b49 Jul 20 04:11:07.304385 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1344421021-project Jul 20 04:11:07.304385 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:11:07.304385 n-d-826526-5 devstack@n-api.service[127870]: exception: Image not found. Jul 20 04:11:07.304385 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '3a96d39a-713d-44c5-9ac1-d2393127a405'} Jul 20 04:11:07.304385 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:07.305347 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:07.305347 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:11:07.305347 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:11:07.305347 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:11:07.305347 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:11:07.305347 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:11:07.305347 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:11:07.305347 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:11:07.305347 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:11:07.305347 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:11:07.305347 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:11:07.305347 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:11:07.305347 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:11:07.305347 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:11:07.305347 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:11:07.305347 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:11:07.305347 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:11:07.305347 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3a96d39a-713d-44c5-9ac1-d2393127a405 Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:11:07.306649 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3a96d39a-713d-44c5-9ac1-d2393127a405 could not be found. Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:11:07.308083 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:11:07.309435 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:07.309435 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:07.309435 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 04:11:07.309435 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:11:07.309435 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:11:07.309435 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:11:07.309435 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:07.309435 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:11:07.309435 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:07.309435 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:07.309435 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:07.309435 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:07.309435 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:07.309435 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:11:07.309435 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:11:07.311487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2096a551-0e5d-4619-91b7-7d79deff42a5 tempest-ListImageFiltersNegativeTestJSON-1344421021 tempest-ListImageFiltersNegativeTestJSON-1344421021-project] Returning 404 to user: Image not found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:07.312635 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2096a551-0e5d-4619-91b7-7d79deff42a5 tempest-ListImageFiltersNegativeTestJSON-1344421021 tempest-ListImageFiltersNegativeTestJSON-1344421021-project] 10.222.0.17 "GET /compute/v2.1/images/3a96d39a-713d-44c5-9ac1-d2393127a405" status: 404 len: 62 microversion: 2.1 time: 0.861786 Jul 20 04:11:07.313675 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 258/560] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:11:06 2022] GET /compute/v2.1/images/3a96d39a-713d-44c5-9ac1-d2393127a405 => generated 62 bytes in 863 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:11:07.469828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d1003733-8048-4c1d-a469-15e1e47c8233 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:07.473623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d1003733-8048-4c1d-a469-15e1e47c8233 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:07.512494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1003733-8048-4c1d-a469-15e1e47c8233 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:07.513523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1003733-8048-4c1d-a469-15e1e47c8233 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:07.516323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1003733-8048-4c1d-a469-15e1e47c8233 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:07.516798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1003733-8048-4c1d-a469-15e1e47c8233 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:07.717811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f9a1520b-071a-417f-aa6f-2c8cfa9bf3bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-424565406", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:07.806370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-f9a1520b-071a-417f-aa6f-2c8cfa9bf3bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:08.163522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d1003733-8048-4c1d-a469-15e1e47c8233 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:08.178730 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d1003733-8048-4c1d-a469-15e1e47c8233 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1472 microversion: 2.1 time: 0.715391 Jul 20 04:11:08.181297 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 259/561] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:07 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1472 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:08.195125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c7f878b1-1004-47e2-86cb-26ea68b6cddf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:08.200074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c7f878b1-1004-47e2-86cb-26ea68b6cddf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:08.215309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7f878b1-1004-47e2-86cb-26ea68b6cddf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.218062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7f878b1-1004-47e2-86cb-26ea68b6cddf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.220668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7f878b1-1004-47e2-86cb-26ea68b6cddf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.221972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7f878b1-1004-47e2-86cb-26ea68b6cddf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.226716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f9a1520b-071a-417f-aa6f-2c8cfa9bf3bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:08.227273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f9a1520b-071a-417f-aa6f-2c8cfa9bf3bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:08.227702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f9a1520b-071a-417f-aa6f-2c8cfa9bf3bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:08.228114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f9a1520b-071a-417f-aa6f-2c8cfa9bf3bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:08.228552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f9a1520b-071a-417f-aa6f-2c8cfa9bf3bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:08.244991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9a1520b-071a-417f-aa6f-2c8cfa9bf3bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.247090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9a1520b-071a-417f-aa6f-2c8cfa9bf3bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.248540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9a1520b-071a-417f-aa6f-2c8cfa9bf3bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.251155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9a1520b-071a-417f-aa6f-2c8cfa9bf3bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.301945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-f9a1520b-071a-417f-aa6f-2c8cfa9bf3bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for project 22bcfd2698d047dea07c643970c749eb. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:08.332914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-f9a1520b-071a-417f-aa6f-2c8cfa9bf3bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for user 5e178243e1ed404092e5ea0be39d5c16 and project 22bcfd2698d047dea07c643970c749eb. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:08.374262 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f9a1520b-071a-417f-aa6f-2c8cfa9bf3bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:11:08.390525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f9a1520b-071a-417f-aa6f-2c8cfa9bf3bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:08.441731 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c7f878b1-1004-47e2-86cb-26ea68b6cddf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:08.458924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c7f878b1-1004-47e2-86cb-26ea68b6cddf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:08.464712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c7f878b1-1004-47e2-86cb-26ea68b6cddf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:08.466829 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c7f878b1-1004-47e2-86cb-26ea68b6cddf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1320 microversion: 2.25 time: 0.284271 Jul 20 04:11:08.471024 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 260/562] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:08 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1320 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:08.491413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3b2b433b-4d34-4584-9d04-078e8d6930e6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:08.495276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3b2b433b-4d34-4584-9d04-078e8d6930e6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:08.514824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b2b433b-4d34-4584-9d04-078e8d6930e6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.518252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b2b433b-4d34-4584-9d04-078e8d6930e6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.521299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b2b433b-4d34-4584-9d04-078e8d6930e6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.523772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b2b433b-4d34-4584-9d04-078e8d6930e6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.549185 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f9a1520b-071a-417f-aa6f-2c8cfa9bf3bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.189598 Jul 20 04:11:08.553775 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 303/563] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:11:08.566132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9fe3c405-2daf-4f03-9772-98024870472c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:08.567968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9fe3c405-2daf-4f03-9772-98024870472c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:08.583950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fe3c405-2daf-4f03-9772-98024870472c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.587577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fe3c405-2daf-4f03-9772-98024870472c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.588755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fe3c405-2daf-4f03-9772-98024870472c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.589409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fe3c405-2daf-4f03-9772-98024870472c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.624191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:08.738665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9fe3c405-2daf-4f03-9772-98024870472c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:08.748675 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9fe3c405-2daf-4f03-9772-98024870472c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216" status: 200 len: 1333 microversion: 2.1 time: 0.193244 Jul 20 04:11:08.750778 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 304/564] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:08 2022] GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 => generated 1333 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:08.767338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-648382da-2d16-4263-a6ca-bbc7167458f9 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:08.768012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-648382da-2d16-4263-a6ca-bbc7167458f9 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:08.906598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-648382da-2d16-4263-a6ca-bbc7167458f9 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:08.914834 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-648382da-2d16-4263-a6ca-bbc7167458f9 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 200 len: 1216 microversion: 2.1 time: 0.162924 Jul 20 04:11:08.918746 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 305/565] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:08 2022] GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 1216 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:09.154044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3b2b433b-4d34-4584-9d04-078e8d6930e6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:09.168653 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3b2b433b-4d34-4584-9d04-078e8d6930e6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1310 microversion: 2.1 time: 0.696234 Jul 20 04:11:09.169381 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 261/566] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:08 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1310 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:09.197832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aeefae44-a021-498d-9a65-58f1d995b5ab tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:09.198469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aeefae44-a021-498d-9a65-58f1d995b5ab tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:09.210059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aeefae44-a021-498d-9a65-58f1d995b5ab tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:09.210563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aeefae44-a021-498d-9a65-58f1d995b5ab tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:09.211456 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aeefae44-a021-498d-9a65-58f1d995b5ab tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:09.211902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aeefae44-a021-498d-9a65-58f1d995b5ab tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:09.406650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-19597e8c-e196-437f-bf31-7ac48fb7a6ba tempest-QuotaClassesAdmin257Test-2147090204 tempest-QuotaClassesAdmin257Test-2147090204-project-admin] Calling method '.version_select at 0x7f06be59cdc0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:09.407888 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:09.407888 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:11:09.439316 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-19597e8c-e196-437f-bf31-7ac48fb7a6ba tempest-QuotaClassesAdmin257Test-2147090204 tempest-QuotaClassesAdmin257Test-2147090204-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.519496 Jul 20 04:11:09.440001 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 306/567] 10.222.0.17 () {60 vars in 1225 bytes} [Wed Jul 20 04:11:08 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:11:09.463168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e536c5b4-c1b2-4742-9585-3cd48a5bb123 req-b6826bed-c8e8-40b2-bb85-c7d30121d6bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1a020af-3235-4739-bf57-bea531fa53ca", "tag": "eedf651b-ee24-4854-9080-987fdef37537"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:09.485123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e536c5b4-c1b2-4742-9585-3cd48a5bb123 req-b6826bed-c8e8-40b2-bb85-c7d30121d6bf service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:09.485816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e536c5b4-c1b2-4742-9585-3cd48a5bb123 req-b6826bed-c8e8-40b2-bb85-c7d30121d6bf service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:09.510224 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e536c5b4-c1b2-4742-9585-3cd48a5bb123 req-b6826bed-c8e8-40b2-bb85-c7d30121d6bf service nova] Creating event network-changed:eedf651b-ee24-4854-9080-987fdef37537 for instance c1a020af-3235-4739-bf57-bea531fa53ca on n-h1-826526-5 Jul 20 04:11:09.520084 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e536c5b4-c1b2-4742-9585-3cd48a5bb123 req-b6826bed-c8e8-40b2-bb85-c7d30121d6bf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072319 Jul 20 04:11:09.541042 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 307/568] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:09.547857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-39ac8c31-ae26-4bba-9c60-03d96237301e tempest-QuotaClassesAdmin257Test-2147090204 tempest-QuotaClassesAdmin257Test-2147090204-project-admin] Action: 'update', calling method: .version_select at 0x7f06be7455e0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:09.550334 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:09.550334 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:11:09.780691 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-39ac8c31-ae26-4bba-9c60-03d96237301e tempest-QuotaClassesAdmin257Test-2147090204 tempest-QuotaClassesAdmin257Test-2147090204-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.236549 Jul 20 04:11:09.792208 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 308/569] 10.222.0.17 () {62 vars in 1246 bytes} [Wed Jul 20 04:11:09 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:11:09.803099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-91709fd1-d2b1-4918-805e-6a183eefd5a1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:09.804880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-91709fd1-d2b1-4918-805e-6a183eefd5a1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:09.818802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91709fd1-d2b1-4918-805e-6a183eefd5a1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:09.820226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91709fd1-d2b1-4918-805e-6a183eefd5a1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:09.822692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91709fd1-d2b1-4918-805e-6a183eefd5a1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:09.823357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91709fd1-d2b1-4918-805e-6a183eefd5a1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:10.094943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-91709fd1-d2b1-4918-805e-6a183eefd5a1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:10.108517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-91709fd1-d2b1-4918-805e-6a183eefd5a1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:10.112157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-91709fd1-d2b1-4918-805e-6a183eefd5a1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:10.116500 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-91709fd1-d2b1-4918-805e-6a183eefd5a1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1362 microversion: 2.25 time: 0.319167 Jul 20 04:11:10.117498 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 309/570] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:09 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:10.125189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e3de1682-5618-45dd-a18c-a9e712d81ef8 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:10.128015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e3de1682-5618-45dd-a18c-a9e712d81ef8 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:10.141578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3de1682-5618-45dd-a18c-a9e712d81ef8 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:10.142025 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3de1682-5618-45dd-a18c-a9e712d81ef8 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:10.145748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3de1682-5618-45dd-a18c-a9e712d81ef8 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:10.146206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3de1682-5618-45dd-a18c-a9e712d81ef8 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:10.308414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aeefae44-a021-498d-9a65-58f1d995b5ab tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:10.318299 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aeefae44-a021-498d-9a65-58f1d995b5ab tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1477 microversion: 2.1 time: 1.124413 Jul 20 04:11:10.319391 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 262/571] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:09 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1477 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:10.324160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-64a94314-f4cb-4ecb-83ff-c9288a89bf09 tempest-QuotaClassesAdmin257Test-2147090204 tempest-QuotaClassesAdmin257Test-2147090204-project-admin] Calling method '.version_select at 0x7f06beb6b1f0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:10.325310 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:10.325310 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:11:10.347208 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-64a94314-f4cb-4ecb-83ff-c9288a89bf09 tempest-QuotaClassesAdmin257Test-2147090204 tempest-QuotaClassesAdmin257Test-2147090204-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.026486 Jul 20 04:11:10.348555 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 263/572] 10.222.0.17 () {60 vars in 1225 bytes} [Wed Jul 20 04:11:10 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:11:10.353905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6bc85456-0edc-4480-a1ca-c9a537b5988a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:10.354861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6bc85456-0edc-4480-a1ca-c9a537b5988a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:10.368464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6bc85456-0edc-4480-a1ca-c9a537b5988a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:10.370345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6bc85456-0edc-4480-a1ca-c9a537b5988a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:10.371405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6bc85456-0edc-4480-a1ca-c9a537b5988a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:10.374330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6bc85456-0edc-4480-a1ca-c9a537b5988a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:10.654966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6bc85456-0edc-4480-a1ca-c9a537b5988a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:10.670761 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6bc85456-0edc-4480-a1ca-c9a537b5988a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 200 len: 1276 microversion: 2.1 time: 0.320729 Jul 20 04:11:10.673013 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 264/573] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:10 2022] GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 1276 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:10.688181 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0e3c7164-f55a-47df-9ead-da9815b94c2b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:10.689337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0e3c7164-f55a-47df-9ead-da9815b94c2b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:10.716526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e3c7164-f55a-47df-9ead-da9815b94c2b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:10.720353 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e3c7164-f55a-47df-9ead-da9815b94c2b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:10.722717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e3c7164-f55a-47df-9ead-da9815b94c2b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:10.727241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e3c7164-f55a-47df-9ead-da9815b94c2b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:10.975932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e3de1682-5618-45dd-a18c-a9e712d81ef8 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:10.985566 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e3de1682-5618-45dd-a18c-a9e712d81ef8 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216" status: 200 len: 1388 microversion: 2.1 time: 0.866603 Jul 20 04:11:10.997887 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 310/574] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:10 2022] GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 => generated 1388 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:11.004870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4539f197-3540-4714-a091-072de60f0444 tempest-QuotaClassesAdmin257Test-2147090204 tempest-QuotaClassesAdmin257Test-2147090204-project-admin] Action: 'update', calling method: .version_select at 0x7f06be59c040>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:11.011841 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:11.011841 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:11:11.063578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8,nova_api:UPDATE=11 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:11.134963 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4539f197-3540-4714-a091-072de60f0444 tempest-QuotaClassesAdmin257Test-2147090204 tempest-QuotaClassesAdmin257Test-2147090204-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.131400 Jul 20 04:11:11.141937 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 311/575] 10.222.0.17 () {62 vars in 1246 bytes} [Wed Jul 20 04:11:10 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:11:11.147528 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7575b251-65b6-48d2-ad93-80d07fd666a8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:11.148122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7575b251-65b6-48d2-ad93-80d07fd666a8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:11.155167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7575b251-65b6-48d2-ad93-80d07fd666a8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:11.155599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7575b251-65b6-48d2-ad93-80d07fd666a8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:11.156443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7575b251-65b6-48d2-ad93-80d07fd666a8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:11.156950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7575b251-65b6-48d2-ad93-80d07fd666a8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:11.459616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7575b251-65b6-48d2-ad93-80d07fd666a8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:11.469099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7575b251-65b6-48d2-ad93-80d07fd666a8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:11.470602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7575b251-65b6-48d2-ad93-80d07fd666a8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:11.471802 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7575b251-65b6-48d2-ad93-80d07fd666a8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1362 microversion: 2.25 time: 0.328881 Jul 20 04:11:11.472384 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 312/576] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:11 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:11.490262 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1d36c5e0-29be-4185-91dd-b4da2ffc13b9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:11.491191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1d36c5e0-29be-4185-91dd-b4da2ffc13b9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:11.503609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d36c5e0-29be-4185-91dd-b4da2ffc13b9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:11.507860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d36c5e0-29be-4185-91dd-b4da2ffc13b9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:11.508894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d36c5e0-29be-4185-91dd-b4da2ffc13b9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:11.509554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d36c5e0-29be-4185-91dd-b4da2ffc13b9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:11.841150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1d36c5e0-29be-4185-91dd-b4da2ffc13b9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:11.841150 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1d36c5e0-29be-4185-91dd-b4da2ffc13b9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1477 microversion: 2.1 time: 0.330117 Jul 20 04:11:11.841150 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 313/577] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:11 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1477 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:11.841150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ffb22e2a-ed39-491e-93a8-3a9f56bb5402 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:11.841447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ffb22e2a-ed39-491e-93a8-3a9f56bb5402 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:11.858244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffb22e2a-ed39-491e-93a8-3a9f56bb5402 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:11.858244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffb22e2a-ed39-491e-93a8-3a9f56bb5402 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:11.858244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffb22e2a-ed39-491e-93a8-3a9f56bb5402 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:11.858244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffb22e2a-ed39-491e-93a8-3a9f56bb5402 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:11.900988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0e3c7164-f55a-47df-9ead-da9815b94c2b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:11.932094 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0e3c7164-f55a-47df-9ead-da9815b94c2b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1310 microversion: 2.1 time: 1.249917 Jul 20 04:11:11.957308 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 265/578] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:10 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1310 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:11.990606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ffb22e2a-ed39-491e-93a8-3a9f56bb5402 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:12.005515 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ffb22e2a-ed39-491e-93a8-3a9f56bb5402 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 200 len: 1274 microversion: 2.1 time: 0.188014 Jul 20 04:11:12.006788 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 314/579] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:11 2022] GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 1274 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:12.020622 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-96ccd5ca-5a59-4c26-989d-f1889aabb17f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:12.021239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-96ccd5ca-5a59-4c26-989d-f1889aabb17f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:12.034565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96ccd5ca-5a59-4c26-989d-f1889aabb17f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:12.041058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96ccd5ca-5a59-4c26-989d-f1889aabb17f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:12.042320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96ccd5ca-5a59-4c26-989d-f1889aabb17f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:12.042815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96ccd5ca-5a59-4c26-989d-f1889aabb17f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:12.334717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-96ccd5ca-5a59-4c26-989d-f1889aabb17f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:12.345106 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-96ccd5ca-5a59-4c26-989d-f1889aabb17f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216" status: 200 len: 1388 microversion: 2.1 time: 0.342846 Jul 20 04:11:12.357838 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 266/580] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:12 2022] GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 => generated 1388 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:12.490265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2c51ebfb-7cb6-4ec4-8759-96ef669a8f9b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:12.491458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2c51ebfb-7cb6-4ec4-8759-96ef669a8f9b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:12.505141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c51ebfb-7cb6-4ec4-8759-96ef669a8f9b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:12.508058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c51ebfb-7cb6-4ec4-8759-96ef669a8f9b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:12.511225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c51ebfb-7cb6-4ec4-8759-96ef669a8f9b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:12.513076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c51ebfb-7cb6-4ec4-8759-96ef669a8f9b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:12.835039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-766f728f-3877-4218-bd38-4405a0152c7c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:12.835722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-766f728f-3877-4218-bd38-4405a0152c7c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:12.839392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:12.875049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-766f728f-3877-4218-bd38-4405a0152c7c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:12.876932 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-766f728f-3877-4218-bd38-4405a0152c7c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:12.878006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-766f728f-3877-4218-bd38-4405a0152c7c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:12.879138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-766f728f-3877-4218-bd38-4405a0152c7c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:13.033497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2c51ebfb-7cb6-4ec4-8759-96ef669a8f9b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:13.052985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2c51ebfb-7cb6-4ec4-8759-96ef669a8f9b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:13.056131 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2c51ebfb-7cb6-4ec4-8759-96ef669a8f9b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:13.056681 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2c51ebfb-7cb6-4ec4-8759-96ef669a8f9b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1362 microversion: 2.25 time: 0.570902 Jul 20 04:11:13.057632 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 315/581] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:12 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1362 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:13.065453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6bdb43d4-a7c3-46df-8ba8-c03ace4a38b6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:13.066384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6bdb43d4-a7c3-46df-8ba8-c03ace4a38b6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:13.095871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6bdb43d4-a7c3-46df-8ba8-c03ace4a38b6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.096365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6bdb43d4-a7c3-46df-8ba8-c03ace4a38b6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:13.099531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6bdb43d4-a7c3-46df-8ba8-c03ace4a38b6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.101517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6bdb43d4-a7c3-46df-8ba8-c03ace4a38b6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:13.329824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-766f728f-3877-4218-bd38-4405a0152c7c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:13.338998 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-766f728f-3877-4218-bd38-4405a0152c7c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1477 microversion: 2.1 time: 0.509689 Jul 20 04:11:13.340273 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 267/582] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:12 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1477 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:13.346626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cd527a6b-d23b-4685-b3b3-7ec969f9989a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:13.348517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cd527a6b-d23b-4685-b3b3-7ec969f9989a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:13.357515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd527a6b-d23b-4685-b3b3-7ec969f9989a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.358199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd527a6b-d23b-4685-b3b3-7ec969f9989a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:13.359166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd527a6b-d23b-4685-b3b3-7ec969f9989a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.359769 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd527a6b-d23b-4685-b3b3-7ec969f9989a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:13.636139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6bdb43d4-a7c3-46df-8ba8-c03ace4a38b6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:13.656678 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6bdb43d4-a7c3-46df-8ba8-c03ace4a38b6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1310 microversion: 2.1 time: 0.586570 Jul 20 04:11:13.658000 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 316/583] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:13 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1310 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:13.676378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cd527a6b-d23b-4685-b3b3-7ec969f9989a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:13.723017 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cd527a6b-d23b-4685-b3b3-7ec969f9989a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 200 len: 1274 microversion: 2.1 time: 0.375533 Jul 20 04:11:13.737074 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 268/584] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:13 2022] GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 1274 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:13.745005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-be00a1f8-0ec6-4ad9-b7ed-94052c9b54eb tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:13.747801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-be00a1f8-0ec6-4ad9-b7ed-94052c9b54eb tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:13.757815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be00a1f8-0ec6-4ad9-b7ed-94052c9b54eb tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.759229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be00a1f8-0ec6-4ad9-b7ed-94052c9b54eb tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:13.760588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be00a1f8-0ec6-4ad9-b7ed-94052c9b54eb tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.761459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be00a1f8-0ec6-4ad9-b7ed-94052c9b54eb tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:14.056114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-caa191bb-c68a-499f-a3fd-778a792e977c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Action: 'create', calling method: .version_select at 0x7f06be5a7e50>, body: {"keypair": {"name": "tempest-keypair-225851841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP39rrVrtfbeqzUIAsXV/kQe94mJfOpibohtTCR7fkkAySSWaQvGQfdS8PDxYzgB/5r5xviFfKK+VLh1vSoV801N0VIkGz0sBsRfnZRKhouOgNEdIMqy1XE25rz1Gwo7aQ=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:14.093042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-caa191bb-c68a-499f-a3fd-778a792e977c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Getting quotas for project 4b553064d6374435a814f572cdbaedc2. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:14.106462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-caa191bb-c68a-499f-a3fd-778a792e977c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Getting quotas for user f120f1774f7e409798e0894b71db9e3e and project 4b553064d6374435a814f572cdbaedc2. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:14.142238 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-caa191bb-c68a-499f-a3fd-778a792e977c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.481799 Jul 20 04:11:14.149654 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 317/585] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:11:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:14.159331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-98f9736e-5cdd-415c-a328-ba54e45b0239 req-8f4028a6-54c9-47be-973e-a9060640182c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69", "tag": "ab1206c5-d9dd-462c-a1bb-fc0ceafad15f"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:14.171601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-98f9736e-5cdd-415c-a328-ba54e45b0239 req-8f4028a6-54c9-47be-973e-a9060640182c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:14.174863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-98f9736e-5cdd-415c-a328-ba54e45b0239 req-8f4028a6-54c9-47be-973e-a9060640182c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:14.198569 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-98f9736e-5cdd-415c-a328-ba54e45b0239 req-8f4028a6-54c9-47be-973e-a9060640182c service nova] Creating event network-changed:ab1206c5-d9dd-462c-a1bb-fc0ceafad15f for instance 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 on n-h1-826526-5 Jul 20 04:11:14.205611 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-98f9736e-5cdd-415c-a328-ba54e45b0239 req-8f4028a6-54c9-47be-973e-a9060640182c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052893 Jul 20 04:11:14.206970 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 318/586] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:14.319386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:14.415068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-19da720f-807d-4218-87be-c76492f0463d req-3211bc4a-e2d4-4b2e-94a4-c2327db40b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c220c0a5-011c-4d57-9691-99405d5fe216", "tag": "c0e0b530-be51-4f12-bcbc-b0f85954eebe"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:14.426443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-be00a1f8-0ec6-4ad9-b7ed-94052c9b54eb tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:14.431673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-19da720f-807d-4218-87be-c76492f0463d req-3211bc4a-e2d4-4b2e-94a4-c2327db40b77 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:14.432474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-19da720f-807d-4218-87be-c76492f0463d req-3211bc4a-e2d4-4b2e-94a4-c2327db40b77 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:14.434388 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-be00a1f8-0ec6-4ad9-b7ed-94052c9b54eb tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216" status: 200 len: 1388 microversion: 2.1 time: 0.695158 Jul 20 04:11:14.446012 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 269/587] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:13 2022] GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 => generated 1388 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:14.446012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7ed22931-abf8-413d-82fa-953af7e1166b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:14.463214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7ed22931-abf8-413d-82fa-953af7e1166b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:14.468860 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-19da720f-807d-4218-87be-c76492f0463d req-3211bc4a-e2d4-4b2e-94a4-c2327db40b77 service nova] Creating event network-changed:c0e0b530-be51-4f12-bcbc-b0f85954eebe for instance c220c0a5-011c-4d57-9691-99405d5fe216 on n-h1-826526-5 Jul 20 04:11:14.476707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ed22931-abf8-413d-82fa-953af7e1166b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:14.485423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ed22931-abf8-413d-82fa-953af7e1166b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:14.487268 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-19da720f-807d-4218-87be-c76492f0463d req-3211bc4a-e2d4-4b2e-94a4-c2327db40b77 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.278439 Jul 20 04:11:14.488038 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 319/588] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:14.489572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ed22931-abf8-413d-82fa-953af7e1166b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:14.490187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ed22931-abf8-413d-82fa-953af7e1166b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:14.511191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f2e9514e-9251-49a4-a770-33ebbcd5cd02 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:14.512543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f2e9514e-9251-49a4-a770-33ebbcd5cd02 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:14.524622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2e9514e-9251-49a4-a770-33ebbcd5cd02 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:14.526021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2e9514e-9251-49a4-a770-33ebbcd5cd02 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:14.527004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2e9514e-9251-49a4-a770-33ebbcd5cd02 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:14.527598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2e9514e-9251-49a4-a770-33ebbcd5cd02 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:15.143616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f2e9514e-9251-49a4-a770-33ebbcd5cd02 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:15.153141 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f2e9514e-9251-49a4-a770-33ebbcd5cd02 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1477 microversion: 2.1 time: 0.658409 Jul 20 04:11:15.156959 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 320/589] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:14 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1477 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:15.163759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c64f0091-bf4e-45aa-a11f-5df5a5dae8d6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:15.164658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c64f0091-bf4e-45aa-a11f-5df5a5dae8d6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:15.181500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c64f0091-bf4e-45aa-a11f-5df5a5dae8d6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:15.182168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c64f0091-bf4e-45aa-a11f-5df5a5dae8d6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:15.183110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c64f0091-bf4e-45aa-a11f-5df5a5dae8d6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:15.183797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c64f0091-bf4e-45aa-a11f-5df5a5dae8d6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:15.197195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7ed22931-abf8-413d-82fa-953af7e1166b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:15.227808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7ed22931-abf8-413d-82fa-953af7e1166b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:15.230900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7ed22931-abf8-413d-82fa-953af7e1166b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:15.233140 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7ed22931-abf8-413d-82fa-953af7e1166b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1362 microversion: 2.25 time: 0.794006 Jul 20 04:11:15.234703 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 270/590] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:14 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1362 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:15.240488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2f2d3a23-1407-443e-a189-cdb1c4b58555 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:15.241399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2f2d3a23-1407-443e-a189-cdb1c4b58555 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:15.248867 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2f2d3a23-1407-443e-a189-cdb1c4b58555 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:15.249597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2f2d3a23-1407-443e-a189-cdb1c4b58555 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:15.250823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2f2d3a23-1407-443e-a189-cdb1c4b58555 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:15.251463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2f2d3a23-1407-443e-a189-cdb1c4b58555 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:15.491942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c64f0091-bf4e-45aa-a11f-5df5a5dae8d6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:15.502011 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c64f0091-bf4e-45aa-a11f-5df5a5dae8d6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1310 microversion: 2.1 time: 0.343710 Jul 20 04:11:15.513393 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 321/591] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:15 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1310 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:15.519253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2edc85a6-a9d6-4e19-b0ef-5a059e9f1807 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:15.520224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2edc85a6-a9d6-4e19-b0ef-5a059e9f1807 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:15.527889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2edc85a6-a9d6-4e19-b0ef-5a059e9f1807 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:15.528640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2edc85a6-a9d6-4e19-b0ef-5a059e9f1807 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:15.529662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2edc85a6-a9d6-4e19-b0ef-5a059e9f1807 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:15.530265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2edc85a6-a9d6-4e19-b0ef-5a059e9f1807 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:15.828172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2edc85a6-a9d6-4e19-b0ef-5a059e9f1807 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:15.840817 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2edc85a6-a9d6-4e19-b0ef-5a059e9f1807 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216" status: 200 len: 1388 microversion: 2.1 time: 0.324664 Jul 20 04:11:15.841443 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 322/592] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:15 2022] GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 => generated 1388 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:15.897257 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2f2d3a23-1407-443e-a189-cdb1c4b58555 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:15.908003 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2f2d3a23-1407-443e-a189-cdb1c4b58555 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 200 len: 1316 microversion: 2.1 time: 0.672016 Jul 20 04:11:15.909666 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 271/593] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:15 2022] GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 1316 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:16.175311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b8e3305a-9bfe-4d27-8012-8ba5ca114719 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:16.176070 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b8e3305a-9bfe-4d27-8012-8ba5ca114719 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:16.186696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8e3305a-9bfe-4d27-8012-8ba5ca114719 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:16.187375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8e3305a-9bfe-4d27-8012-8ba5ca114719 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:16.198731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8e3305a-9bfe-4d27-8012-8ba5ca114719 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:16.201175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8e3305a-9bfe-4d27-8012-8ba5ca114719 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:16.252204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fd306cf4-9877-4ae2-b0dc-1d9dc08bb793 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:16.252913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fd306cf4-9877-4ae2-b0dc-1d9dc08bb793 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:16.264544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd306cf4-9877-4ae2-b0dc-1d9dc08bb793 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:16.271715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd306cf4-9877-4ae2-b0dc-1d9dc08bb793 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:16.275446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd306cf4-9877-4ae2-b0dc-1d9dc08bb793 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:16.275988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd306cf4-9877-4ae2-b0dc-1d9dc08bb793 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:16.705295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b8e3305a-9bfe-4d27-8012-8ba5ca114719 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:16.716962 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b8e3305a-9bfe-4d27-8012-8ba5ca114719 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1477 microversion: 2.1 time: 0.546923 Jul 20 04:11:16.717996 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 323/594] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:16 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1477 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:16.731555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8be3e39a-8d61-4010-a829-937c10c511ed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:16.732209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8be3e39a-8d61-4010-a829-937c10c511ed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:16.755098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8be3e39a-8d61-4010-a829-937c10c511ed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:16.755544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8be3e39a-8d61-4010-a829-937c10c511ed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:16.756666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8be3e39a-8d61-4010-a829-937c10c511ed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:16.757103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8be3e39a-8d61-4010-a829-937c10c511ed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.182899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8be3e39a-8d61-4010-a829-937c10c511ed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:17.199071 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8be3e39a-8d61-4010-a829-937c10c511ed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1310 microversion: 2.1 time: 0.478772 Jul 20 04:11:17.201136 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 324/595] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:16 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1310 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:17.208163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-312c93f5-497c-49ba-81fb-213b38dc0808 req-6b7aa1bb-ca25-4966-bddf-60029de6fb05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a020af-3235-4739-bf57-bea531fa53ca", "name": "network-vif-plugged", "status": "completed", "tag": "eedf651b-ee24-4854-9080-987fdef37537"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:17.223792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-312c93f5-497c-49ba-81fb-213b38dc0808 req-6b7aa1bb-ca25-4966-bddf-60029de6fb05 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:17.224495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-312c93f5-497c-49ba-81fb-213b38dc0808 req-6b7aa1bb-ca25-4966-bddf-60029de6fb05 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.239427 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-312c93f5-497c-49ba-81fb-213b38dc0808 req-6b7aa1bb-ca25-4966-bddf-60029de6fb05 service nova] Creating event network-vif-plugged:eedf651b-ee24-4854-9080-987fdef37537 for instance c1a020af-3235-4739-bf57-bea531fa53ca on n-h1-826526-5 Jul 20 04:11:17.246112 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-312c93f5-497c-49ba-81fb-213b38dc0808 req-6b7aa1bb-ca25-4966-bddf-60029de6fb05 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043219 Jul 20 04:11:17.247205 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 325/596] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:17.258387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8d4bb202-9ab9-410c-a02e-58c7972f720f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:17.258903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8d4bb202-9ab9-410c-a02e-58c7972f720f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:17.265929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d4bb202-9ab9-410c-a02e-58c7972f720f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:17.266371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d4bb202-9ab9-410c-a02e-58c7972f720f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.267949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d4bb202-9ab9-410c-a02e-58c7972f720f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:17.268559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d4bb202-9ab9-410c-a02e-58c7972f720f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.275228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fd306cf4-9877-4ae2-b0dc-1d9dc08bb793 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:17.322113 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fd306cf4-9877-4ae2-b0dc-1d9dc08bb793 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:17.329549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fd306cf4-9877-4ae2-b0dc-1d9dc08bb793 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:17.331461 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fd306cf4-9877-4ae2-b0dc-1d9dc08bb793 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1362 microversion: 2.25 time: 1.084403 Jul 20 04:11:17.334498 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 272/597] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:16 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1362 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:11:17.340651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a68db0b6-9e60-4708-80a0-c00e3474fc28 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:17.341550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a68db0b6-9e60-4708-80a0-c00e3474fc28 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:17.363602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a68db0b6-9e60-4708-80a0-c00e3474fc28 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:17.364590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a68db0b6-9e60-4708-80a0-c00e3474fc28 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.365892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a68db0b6-9e60-4708-80a0-c00e3474fc28 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:17.366543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a68db0b6-9e60-4708-80a0-c00e3474fc28 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.737633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8d4bb202-9ab9-410c-a02e-58c7972f720f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:17.747254 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8d4bb202-9ab9-410c-a02e-58c7972f720f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216" status: 200 len: 1388 microversion: 2.1 time: 0.498484 Jul 20 04:11:17.750223 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 326/598] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:17 2022] GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 => generated 1388 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:17.772641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-77a81f3c-8e75-4979-a70b-35e09d5f8251 req-af8da7e1-73e8-42bd-921f-b03c3f2fe93e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23481b1e-fe28-4f48-84fe-f22cae89ac46", "tag": "c0138b21-0419-4d11-b080-80dc6be43c19"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:17.789329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-77a81f3c-8e75-4979-a70b-35e09d5f8251 req-af8da7e1-73e8-42bd-921f-b03c3f2fe93e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:17.789784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-77a81f3c-8e75-4979-a70b-35e09d5f8251 req-af8da7e1-73e8-42bd-921f-b03c3f2fe93e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.815521 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-77a81f3c-8e75-4979-a70b-35e09d5f8251 req-af8da7e1-73e8-42bd-921f-b03c3f2fe93e service nova] Creating event network-changed:c0138b21-0419-4d11-b080-80dc6be43c19 for instance 23481b1e-fe28-4f48-84fe-f22cae89ac46 on n-h2-826526-5 Jul 20 04:11:17.821170 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-77a81f3c-8e75-4979-a70b-35e09d5f8251 req-af8da7e1-73e8-42bd-921f-b03c3f2fe93e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068109 Jul 20 04:11:17.823715 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 327/599] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:17.834274 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3a6dc502-3fdc-42a2-a507-2449ccc95255 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:17.835661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3a6dc502-3fdc-42a2-a507-2449ccc95255 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:17.848182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a6dc502-3fdc-42a2-a507-2449ccc95255 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:17.849629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a6dc502-3fdc-42a2-a507-2449ccc95255 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.851206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a6dc502-3fdc-42a2-a507-2449ccc95255 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:17.852679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a6dc502-3fdc-42a2-a507-2449ccc95255 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.993434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a68db0b6-9e60-4708-80a0-c00e3474fc28 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:18.008893 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a68db0b6-9e60-4708-80a0-c00e3474fc28 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 200 len: 1316 microversion: 2.1 time: 0.672959 Jul 20 04:11:18.009796 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 273/600] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:17 2022] GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 1316 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:18.115191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3a6dc502-3fdc-42a2-a507-2449ccc95255 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:18.147413 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3a6dc502-3fdc-42a2-a507-2449ccc95255 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1477 microversion: 2.1 time: 0.319577 Jul 20 04:11:18.150307 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 328/601] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:17 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1477 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:18.217846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-26e40844-de93-40cc-89b5-fabd7fd66eca tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:18.218463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-26e40844-de93-40cc-89b5-fabd7fd66eca tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:18.227813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26e40844-de93-40cc-89b5-fabd7fd66eca tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:18.228285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26e40844-de93-40cc-89b5-fabd7fd66eca tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:18.229066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26e40844-de93-40cc-89b5-fabd7fd66eca tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:18.229498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26e40844-de93-40cc-89b5-fabd7fd66eca tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:18.233824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:18.350161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dd6bdd0f-9015-425f-937f-682f8c43a876 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:18.350688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dd6bdd0f-9015-425f-937f-682f8c43a876 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:18.353110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=30 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:18.366332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd6bdd0f-9015-425f-937f-682f8c43a876 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:18.367044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd6bdd0f-9015-425f-937f-682f8c43a876 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:18.367979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd6bdd0f-9015-425f-937f-682f8c43a876 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:18.368626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd6bdd0f-9015-425f-937f-682f8c43a876 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:18.401938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:18.724278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dd6bdd0f-9015-425f-937f-682f8c43a876 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:18.733082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dd6bdd0f-9015-425f-937f-682f8c43a876 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:18.734577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dd6bdd0f-9015-425f-937f-682f8c43a876 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:18.735693 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dd6bdd0f-9015-425f-937f-682f8c43a876 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1362 microversion: 2.25 time: 0.389506 Jul 20 04:11:18.752675 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 329/602] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:18 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1362 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:18.977799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c2641380-6ad4-459e-a294-c4c550bb91b2 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Calling method '.version_select at 0x7f06be5a7310>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:19.047844 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c2641380-6ad4-459e-a294-c4c550bb91b2 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/74d9470e6ac94348a9a19eff2ea21da2" status: 200 len: 371 microversion: 2.1 time: 0.293792 Jul 20 04:11:19.053767 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 330/603] 10.222.0.17 () {58 vars in 1241 bytes} [Wed Jul 20 04:11:18 2022] GET /compute/v2.1/os-quota-sets/74d9470e6ac94348a9a19eff2ea21da2 => generated 371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:19.059086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e0792fbf-6210-415b-a169-246a55b3c708 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:19.059695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e0792fbf-6210-415b-a169-246a55b3c708 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:19.066141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0792fbf-6210-415b-a169-246a55b3c708 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.066588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0792fbf-6210-415b-a169-246a55b3c708 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.067432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0792fbf-6210-415b-a169-246a55b3c708 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.067769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0792fbf-6210-415b-a169-246a55b3c708 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.302335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e0792fbf-6210-415b-a169-246a55b3c708 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:19.314528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-26e40844-de93-40cc-89b5-fabd7fd66eca tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:19.323546 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e0792fbf-6210-415b-a169-246a55b3c708 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216" status: 200 len: 1388 microversion: 2.1 time: 0.265144 Jul 20 04:11:19.324117 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 331/604] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:19 2022] GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 => generated 1388 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:19.327461 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-26e40844-de93-40cc-89b5-fabd7fd66eca tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1310 microversion: 2.1 time: 1.113412 Jul 20 04:11:19.337734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-93fa048a-0257-4ac0-b880-4ecbeb5bdc01 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:19.337734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-93fa048a-0257-4ac0-b880-4ecbeb5bdc01 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:19.338543 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 274/605] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:18 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1310 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:19.343466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bcca4146-1d2a-4fef-b016-24de6e44b0f1 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Action: 'update', calling method: .version_select at 0x7f06be6999d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:19.353537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93fa048a-0257-4ac0-b880-4ecbeb5bdc01 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.354078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93fa048a-0257-4ac0-b880-4ecbeb5bdc01 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.354763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93fa048a-0257-4ac0-b880-4ecbeb5bdc01 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.357820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93fa048a-0257-4ac0-b880-4ecbeb5bdc01 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.450820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcca4146-1d2a-4fef-b016-24de6e44b0f1 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.452088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcca4146-1d2a-4fef-b016-24de6e44b0f1 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.453176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcca4146-1d2a-4fef-b016-24de6e44b0f1 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.454649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcca4146-1d2a-4fef-b016-24de6e44b0f1 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.545114 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bcca4146-1d2a-4fef-b016-24de6e44b0f1 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/74d9470e6ac94348a9a19eff2ea21da2" status: 200 len: 328 microversion: 2.1 time: 0.204704 Jul 20 04:11:19.546424 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 275/606] 10.222.0.17 () {60 vars in 1261 bytes} [Wed Jul 20 04:11:19 2022] PUT /compute/v2.1/os-quota-sets/74d9470e6ac94348a9a19eff2ea21da2 => generated 328 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:19.553321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-832a1c4c-aa3a-4dce-9834-902e671a1b26 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:19.554415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-832a1c4c-aa3a-4dce-9834-902e671a1b26 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:19.563178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-832a1c4c-aa3a-4dce-9834-902e671a1b26 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.564340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-832a1c4c-aa3a-4dce-9834-902e671a1b26 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.566595 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-832a1c4c-aa3a-4dce-9834-902e671a1b26 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.567646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-832a1c4c-aa3a-4dce-9834-902e671a1b26 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.697776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-93fa048a-0257-4ac0-b880-4ecbeb5bdc01 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:19.708609 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-93fa048a-0257-4ac0-b880-4ecbeb5bdc01 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 200 len: 1316 microversion: 2.1 time: 0.382362 Jul 20 04:11:19.710271 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 332/607] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:19 2022] GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:19.717021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-bc8ef931-34aa-41b4-9d7a-6f9224ad3c4d req-cec27461-a0c1-4687-a679-159fab017ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c220c0a5-011c-4d57-9691-99405d5fe216", "name": "network-vif-plugged", "status": "completed", "tag": "c0e0b530-be51-4f12-bcbc-b0f85954eebe"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:19.732863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bc8ef931-34aa-41b4-9d7a-6f9224ad3c4d req-cec27461-a0c1-4687-a679-159fab017ecb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.734993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bc8ef931-34aa-41b4-9d7a-6f9224ad3c4d req-cec27461-a0c1-4687-a679-159fab017ecb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.772193 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-bc8ef931-34aa-41b4-9d7a-6f9224ad3c4d req-cec27461-a0c1-4687-a679-159fab017ecb service nova] Creating event network-vif-plugged:c0e0b530-be51-4f12-bcbc-b0f85954eebe for instance c220c0a5-011c-4d57-9691-99405d5fe216 on n-h1-826526-5 Jul 20 04:11:19.786341 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-bc8ef931-34aa-41b4-9d7a-6f9224ad3c4d req-cec27461-a0c1-4687-a679-159fab017ecb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074336 Jul 20 04:11:19.787573 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 333/608] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:19.794002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-060cff65-6bff-4f9e-a052-86dbf09dba79 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:19.822503 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-060cff65-6bff-4f9e-a052-86dbf09dba79 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-quota-sets/74d9470e6ac94348a9a19eff2ea21da2" status: 202 len: 0 microversion: 2.1 time: 0.033257 Jul 20 04:11:19.823348 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 334/609] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:11:19 2022] DELETE /compute/v2.1/os-quota-sets/74d9470e6ac94348a9a19eff2ea21da2 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:19.829053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e767ebca-e858-43de-8d95-0b279ed31d20 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:19.830004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e767ebca-e858-43de-8d95-0b279ed31d20 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:19.849917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e767ebca-e858-43de-8d95-0b279ed31d20 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.850637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e767ebca-e858-43de-8d95-0b279ed31d20 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.851782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e767ebca-e858-43de-8d95-0b279ed31d20 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.854324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e767ebca-e858-43de-8d95-0b279ed31d20 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.902223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-832a1c4c-aa3a-4dce-9834-902e671a1b26 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:19.910430 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-832a1c4c-aa3a-4dce-9834-902e671a1b26 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1477 microversion: 2.1 time: 0.362684 Jul 20 04:11:19.920572 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 276/610] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:19 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1477 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:19.926164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c7a51472-ee91-4b86-9e9b-d86f07e11317 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Calling method '.version_select at 0x7f06be6bb0d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:20.006035 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c7a51472-ee91-4b86-9e9b-d86f07e11317 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/74d9470e6ac94348a9a19eff2ea21da2" status: 200 len: 371 microversion: 2.1 time: 0.083635 Jul 20 04:11:20.007331 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 277/611] 10.222.0.17 () {58 vars in 1241 bytes} [Wed Jul 20 04:11:19 2022] GET /compute/v2.1/os-quota-sets/74d9470e6ac94348a9a19eff2ea21da2 => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:20.197315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6a8bc537-6ebd-45d5-84ae-a7a033df924b tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Calling method '.version_select at 0x7f06be6d70d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:20.222303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e767ebca-e858-43de-8d95-0b279ed31d20 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:20.249106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e767ebca-e858-43de-8d95-0b279ed31d20 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:20.255354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e767ebca-e858-43de-8d95-0b279ed31d20 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:20.257178 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e767ebca-e858-43de-8d95-0b279ed31d20 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1362 microversion: 2.25 time: 0.432570 Jul 20 04:11:20.262603 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 335/612] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:19 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1362 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:20.341535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-98de18e3-1d76-4dc8-a9ed-6c6f1afd6ba6 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:20.342154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-98de18e3-1d76-4dc8-a9ed-6c6f1afd6ba6 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:20.351167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98de18e3-1d76-4dc8-a9ed-6c6f1afd6ba6 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.351618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98de18e3-1d76-4dc8-a9ed-6c6f1afd6ba6 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:20.352437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98de18e3-1d76-4dc8-a9ed-6c6f1afd6ba6 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.352877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98de18e3-1d76-4dc8-a9ed-6c6f1afd6ba6 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:20.598236 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6a8bc537-6ebd-45d5-84ae-a7a033df924b tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/68cf9c6410e84e9299aa5ade7d86cc34/defaults" status: 200 len: 371 microversion: 2.1 time: 0.406332 Jul 20 04:11:20.599445 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 278/613] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 04:11:20 2022] GET /compute/v2.1/os-quota-sets/68cf9c6410e84e9299aa5ade7d86cc34/defaults => generated 371 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:20.612969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6fe977c0-c556-41ae-9b60-3ca3c9969ecf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:20.631769 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6fe977c0-c556-41ae-9b60-3ca3c9969ecf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:20.640666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6fe977c0-c556-41ae-9b60-3ca3c9969ecf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.641307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6fe977c0-c556-41ae-9b60-3ca3c9969ecf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:20.646479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6fe977c0-c556-41ae-9b60-3ca3c9969ecf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.647275 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6fe977c0-c556-41ae-9b60-3ca3c9969ecf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:20.732747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-98de18e3-1d76-4dc8-a9ed-6c6f1afd6ba6 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:20.745198 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-98de18e3-1d76-4dc8-a9ed-6c6f1afd6ba6 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216" status: 200 len: 1388 microversion: 2.1 time: 0.408099 Jul 20 04:11:20.748169 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 336/614] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:20 2022] GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 => generated 1388 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:20.759992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2048a617-915a-46bb-80eb-19d10bdb9d48 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1513940506", "imageRef": "14935da7-d5ce-4715-ba66-5005ff52f052", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7aff739a-4f83-444a-bc4d-49f054888eef"}], "security_groups": [{"name": "tempest-securitygroup--197591360"}], "key_name": "tempest-keypair-225851841", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:20.947147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6fe977c0-c556-41ae-9b60-3ca3c9969ecf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:20.960386 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6fe977c0-c556-41ae-9b60-3ca3c9969ecf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1493 microversion: 2.1 time: 0.358240 Jul 20 04:11:20.968598 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 279/615] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:20 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1493 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:20.972720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a642a44b-082b-4652-b783-c1df19a8d331 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:20.973662 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a642a44b-082b-4652-b783-c1df19a8d331 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:20.979066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-2048a617-915a-46bb-80eb-19d10bdb9d48 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] validate_networks() for [('7aff739a-4f83-444a-bc4d-49f054888eef', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:20.987977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a642a44b-082b-4652-b783-c1df19a8d331 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.988525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a642a44b-082b-4652-b783-c1df19a8d331 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:20.989381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a642a44b-082b-4652-b783-c1df19a8d331 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.989900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a642a44b-082b-4652-b783-c1df19a8d331 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.235377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a642a44b-082b-4652-b783-c1df19a8d331 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:21.252999 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a642a44b-082b-4652-b783-c1df19a8d331 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 200 len: 1316 microversion: 2.1 time: 0.285777 Jul 20 04:11:21.253603 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 280/616] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:20 2022] GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:21.266354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea9a5328-0439-4683-a75c-7598905f3ecb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:21.266970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ea9a5328-0439-4683-a75c-7598905f3ecb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:21.276220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea9a5328-0439-4683-a75c-7598905f3ecb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.276961 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea9a5328-0439-4683-a75c-7598905f3ecb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.278011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea9a5328-0439-4683-a75c-7598905f3ecb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.278445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea9a5328-0439-4683-a75c-7598905f3ecb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.437320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ea9a5328-0439-4683-a75c-7598905f3ecb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:21.456219 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ea9a5328-0439-4683-a75c-7598905f3ecb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1477 microversion: 2.1 time: 0.193079 Jul 20 04:11:21.458926 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 281/617] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:21 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1477 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:21.463918 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5f84e7b2-f31a-4ff3-bd9b-6f0fb17b5cb7 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Action: 'update', calling method: .version_select at 0x7f06be7a2e50>, body: {"quota_set": {"ram": "5120"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:21.620164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f84e7b2-f31a-4ff3-bd9b-6f0fb17b5cb7 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.620696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f84e7b2-f31a-4ff3-bd9b-6f0fb17b5cb7 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.621506 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f84e7b2-f31a-4ff3-bd9b-6f0fb17b5cb7 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.621631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2048a617-915a-46bb-80eb-19d10bdb9d48 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:21.621942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f84e7b2-f31a-4ff3-bd9b-6f0fb17b5cb7 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.622050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2048a617-915a-46bb-80eb-19d10bdb9d48 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:21.622506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2048a617-915a-46bb-80eb-19d10bdb9d48 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:21.623380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2048a617-915a-46bb-80eb-19d10bdb9d48 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:21.623796 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2048a617-915a-46bb-80eb-19d10bdb9d48 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:21.635361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2048a617-915a-46bb-80eb-19d10bdb9d48 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.635809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2048a617-915a-46bb-80eb-19d10bdb9d48 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.636653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2048a617-915a-46bb-80eb-19d10bdb9d48 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.637211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2048a617-915a-46bb-80eb-19d10bdb9d48 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.656805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-2048a617-915a-46bb-80eb-19d10bdb9d48 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Getting quotas for project 4b553064d6374435a814f572cdbaedc2. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:21.662233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-2048a617-915a-46bb-80eb-19d10bdb9d48 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Getting quotas for user f120f1774f7e409798e0894b71db9e3e and project 4b553064d6374435a814f572cdbaedc2. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:21.675262 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2048a617-915a-46bb-80eb-19d10bdb9d48 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:11:21.678185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2048a617-915a-46bb-80eb-19d10bdb9d48 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14935da7-d5ce-4715-ba66-5005ff52f052',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:21.691057 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5f84e7b2-f31a-4ff3-bd9b-6f0fb17b5cb7 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/69ac597cca9f49edb7426a4ec4045725" status: 200 len: 328 microversion: 2.1 time: 0.230800 Jul 20 04:11:21.696800 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 282/618] 10.222.0.17 () {60 vars in 1261 bytes} [Wed Jul 20 04:11:21 2022] PUT /compute/v2.1/os-quota-sets/69ac597cca9f49edb7426a4ec4045725 => generated 328 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:21.725780 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2048a617-915a-46bb-80eb-19d10bdb9d48 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.975209 Jul 20 04:11:21.726641 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 337/619] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:11:21.731607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1143c971-daa4-4b12-9299-f4e7ee61ae78 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:21.732251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1143c971-daa4-4b12-9299-f4e7ee61ae78 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:21.739311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1143c971-daa4-4b12-9299-f4e7ee61ae78 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.740017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1143c971-daa4-4b12-9299-f4e7ee61ae78 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.740826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1143c971-daa4-4b12-9299-f4e7ee61ae78 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.741425 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1143c971-daa4-4b12-9299-f4e7ee61ae78 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.823206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dc72bd5c-07d6-414d-a19e-15fb6d57b8a2 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:21.823830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dc72bd5c-07d6-414d-a19e-15fb6d57b8a2 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:21.830197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc72bd5c-07d6-414d-a19e-15fb6d57b8a2 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.830655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc72bd5c-07d6-414d-a19e-15fb6d57b8a2 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.831440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc72bd5c-07d6-414d-a19e-15fb6d57b8a2 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.831883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc72bd5c-07d6-414d-a19e-15fb6d57b8a2 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.901600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1143c971-daa4-4b12-9299-f4e7ee61ae78 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:21.910087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1143c971-daa4-4b12-9299-f4e7ee61ae78 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:21.911494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1143c971-daa4-4b12-9299-f4e7ee61ae78 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:21.912632 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1143c971-daa4-4b12-9299-f4e7ee61ae78 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1362 microversion: 2.25 time: 0.185260 Jul 20 04:11:21.913190 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 338/620] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:21 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:21.970908 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dc72bd5c-07d6-414d-a19e-15fb6d57b8a2 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1644 microversion: 2.1 time: 0.277466 Jul 20 04:11:21.972093 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 283/621] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:21 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1644 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:21.980909 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ae5ac924-4d13-41b1-ba11-908f7f8f7f10 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Calling method '.version_select at 0x7f06be8711f0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:21.982993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-887b87a2-ad6e-46ed-b56c-ad69b1381e54 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Action: 'create', calling method: .version_select at 0x7f06be5a7040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-702966054", "description": "tempest-description-678227818"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:22.082956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae5ac924-4d13-41b1-ba11-908f7f8f7f10 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.083571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae5ac924-4d13-41b1-ba11-908f7f8f7f10 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.089655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae5ac924-4d13-41b1-ba11-908f7f8f7f10 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.090194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae5ac924-4d13-41b1-ba11-908f7f8f7f10 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.112672 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ae5ac924-4d13-41b1-ba11-908f7f8f7f10 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/69ac597cca9f49edb7426a4ec4045725/detail" status: 200 len: 916 microversion: 2.1 time: 0.138997 Jul 20 04:11:22.122065 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 284/622] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:11:21 2022] GET /compute/v2.1/os-quota-sets/69ac597cca9f49edb7426a4ec4045725/detail => generated 916 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:22.127498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c90e6173-3dd9-4c8d-81d3-8cc037449c0a tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:22.128763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c90e6173-3dd9-4c8d-81d3-8cc037449c0a tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:22.195998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c90e6173-3dd9-4c8d-81d3-8cc037449c0a tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f120f1774f7e409798e0894b71db9e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b553064d6374435a814f572cdbaedc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:22.203581 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-887b87a2-ad6e-46ed-b56c-ad69b1381e54 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.287497 Jul 20 04:11:22.211729 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c90e6173-3dd9-4c8d-81d3-8cc037449c0a tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 200 len: 1245 microversion: 2.1 time: 0.081012 Jul 20 04:11:22.211729 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 285/624] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:22 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:22.215825 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 339/624] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:11:21 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:22.216915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-58528110-98a6-4cb3-9d47-52d16221d28f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:22.218878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-58528110-98a6-4cb3-9d47-52d16221d28f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:22.221488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-03e75ad0-78a7-4516-85fe-b7aa35c372a3 req-25c4c2eb-e177-45d4-8ba8-ef303650f6f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69", "name": "network-vif-plugged", "status": "completed", "tag": "ab1206c5-d9dd-462c-a1bb-fc0ceafad15f"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:22.229516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58528110-98a6-4cb3-9d47-52d16221d28f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.230044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58528110-98a6-4cb3-9d47-52d16221d28f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.230900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58528110-98a6-4cb3-9d47-52d16221d28f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.231629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58528110-98a6-4cb3-9d47-52d16221d28f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.239674 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-03e75ad0-78a7-4516-85fe-b7aa35c372a3 req-25c4c2eb-e177-45d4-8ba8-ef303650f6f0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.240408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-03e75ad0-78a7-4516-85fe-b7aa35c372a3 req-25c4c2eb-e177-45d4-8ba8-ef303650f6f0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.256050 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-03e75ad0-78a7-4516-85fe-b7aa35c372a3 req-25c4c2eb-e177-45d4-8ba8-ef303650f6f0 service nova] Creating event network-vif-plugged:ab1206c5-d9dd-462c-a1bb-fc0ceafad15f for instance 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 on n-h1-826526-5 Jul 20 04:11:22.263765 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-03e75ad0-78a7-4516-85fe-b7aa35c372a3 req-25c4c2eb-e177-45d4-8ba8-ef303650f6f0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046200 Jul 20 04:11:22.265053 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 340/625] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:22.270525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-da49773c-801f-4e85-bb58-46bea8e00090 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:22.271522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-da49773c-801f-4e85-bb58-46bea8e00090 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:22.279250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da49773c-801f-4e85-bb58-46bea8e00090 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.279980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da49773c-801f-4e85-bb58-46bea8e00090 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.281238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da49773c-801f-4e85-bb58-46bea8e00090 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.281838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da49773c-801f-4e85-bb58-46bea8e00090 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.459433 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-da49773c-801f-4e85-bb58-46bea8e00090 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1644 microversion: 2.1 time: 0.192869 Jul 20 04:11:22.460689 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 341/626] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:22 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1644 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:22.468109 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cee1b6de-6e44-48ca-8e3e-6f8cce61ee66 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Action: 'create', calling method: .version_select at 0x7f06be47d040>, body: {"security_group_rule": {"parent_group_id": "b5f88e41-a952-4199-9bac-a7aea2dbdb72", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:22.593219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-58528110-98a6-4cb3-9d47-52d16221d28f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:22.602068 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-58528110-98a6-4cb3-9d47-52d16221d28f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216" status: 200 len: 1586 microversion: 2.1 time: 0.395187 Jul 20 04:11:22.603123 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 286/627] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:22 2022] GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 => generated 1586 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:22.607940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0c049be4-97c0-4a98-83e3-067c6cbe9f3e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:22.608583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0c049be4-97c0-4a98-83e3-067c6cbe9f3e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:22.615497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c049be4-97c0-4a98-83e3-067c6cbe9f3e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.616429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c049be4-97c0-4a98-83e3-067c6cbe9f3e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.617426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c049be4-97c0-4a98-83e3-067c6cbe9f3e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.618079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c049be4-97c0-4a98-83e3-067c6cbe9f3e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.737726 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cee1b6de-6e44-48ca-8e3e-6f8cce61ee66 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.275529 Jul 20 04:11:22.740311 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 342/628] 10.222.0.17 () {60 vars in 1194 bytes} [Wed Jul 20 04:11:22 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:22.745662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-78df6ae0-d049-459d-9cdc-f48a4c11e24c tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Action: 'update', calling method: .version_select at 0x7f06be5a7e50>, body: {"quota_set": {"ram": "2048"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:22.818691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78df6ae0-d049-459d-9cdc-f48a4c11e24c tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.819122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78df6ae0-d049-459d-9cdc-f48a4c11e24c tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.820139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78df6ae0-d049-459d-9cdc-f48a4c11e24c tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.820601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78df6ae0-d049-459d-9cdc-f48a4c11e24c tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.831153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0c049be4-97c0-4a98-83e3-067c6cbe9f3e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:22.837620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:22.841225 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0c049be4-97c0-4a98-83e3-067c6cbe9f3e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 200 len: 1316 microversion: 2.1 time: 0.236928 Jul 20 04:11:22.841985 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 287/629] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:22 2022] GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:22.850851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-70fb7d8e-a11a-45bc-bf8f-2d1c3ff78167 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:22.851803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-70fb7d8e-a11a-45bc-bf8f-2d1c3ff78167 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:22.861168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78df6ae0-d049-459d-9cdc-f48a4c11e24c tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.861614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78df6ae0-d049-459d-9cdc-f48a4c11e24c tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.861903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70fb7d8e-a11a-45bc-bf8f-2d1c3ff78167 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.862547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70fb7d8e-a11a-45bc-bf8f-2d1c3ff78167 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.862713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78df6ae0-d049-459d-9cdc-f48a4c11e24c tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.862996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78df6ae0-d049-459d-9cdc-f48a4c11e24c tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.863490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70fb7d8e-a11a-45bc-bf8f-2d1c3ff78167 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.864101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70fb7d8e-a11a-45bc-bf8f-2d1c3ff78167 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.923134 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-78df6ae0-d049-459d-9cdc-f48a4c11e24c tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/69ac597cca9f49edb7426a4ec4045725?user_id=cfcde9363e5f481abfccec8a18327854" status: 200 len: 328 microversion: 2.1 time: 0.182972 Jul 20 04:11:22.929646 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 343/630] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:11:22 2022] PUT /compute/v2.1/os-quota-sets/69ac597cca9f49edb7426a4ec4045725?user_id=cfcde9363e5f481abfccec8a18327854 => generated 328 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:22.934947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-abf46fdb-38cf-4529-8883-7d2e5fd01aae tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:22.936428 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:22.936428 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:11:22.938003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abf46fdb-38cf-4529-8883-7d2e5fd01aae tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.938602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abf46fdb-38cf-4529-8883-7d2e5fd01aae tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.939522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abf46fdb-38cf-4529-8883-7d2e5fd01aae tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.939979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abf46fdb-38cf-4529-8883-7d2e5fd01aae tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.964164 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-abf46fdb-38cf-4529-8883-7d2e5fd01aae tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.033286 Jul 20 04:11:22.964805 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 344/631] 10.222.0.17 () {58 vars in 1175 bytes} [Wed Jul 20 04:11:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:22.969533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b96ef00-4299-4e78-af62-e8a872ec9c15 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:22.970021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9b96ef00-4299-4e78-af62-e8a872ec9c15 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:22.976574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b96ef00-4299-4e78-af62-e8a872ec9c15 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.977019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b96ef00-4299-4e78-af62-e8a872ec9c15 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.977782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b96ef00-4299-4e78-af62-e8a872ec9c15 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.978449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b96ef00-4299-4e78-af62-e8a872ec9c15 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:23.058430 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9b96ef00-4299-4e78-af62-e8a872ec9c15 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092363 Jul 20 04:11:23.059042 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 345/632] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:11:22 2022] GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:23.064678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a3cd8d9b-0900-4119-8dfa-2aa189cf21cc tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Action: 'create', calling method: .version_select at 0x7f06be47de50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1447158151", "description": "tempest-description-1972913912"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:23.066645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-70fb7d8e-a11a-45bc-bf8f-2d1c3ff78167 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:23.081742 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-70fb7d8e-a11a-45bc-bf8f-2d1c3ff78167 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1477 microversion: 2.1 time: 0.238418 Jul 20 04:11:23.098822 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 288/633] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:22 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1477 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:23.108736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d2e48109-33c3-46b7-a2b7-bea50ebfddff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:23.110174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d2e48109-33c3-46b7-a2b7-bea50ebfddff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:23.120558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2e48109-33c3-46b7-a2b7-bea50ebfddff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:23.121368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2e48109-33c3-46b7-a2b7-bea50ebfddff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:23.122650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2e48109-33c3-46b7-a2b7-bea50ebfddff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:23.123361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2e48109-33c3-46b7-a2b7-bea50ebfddff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:23.348794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d2e48109-33c3-46b7-a2b7-bea50ebfddff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:23.358481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d2e48109-33c3-46b7-a2b7-bea50ebfddff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:23.360361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d2e48109-33c3-46b7-a2b7-bea50ebfddff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:23.362128 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d2e48109-33c3-46b7-a2b7-bea50ebfddff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1362 microversion: 2.25 time: 0.258755 Jul 20 04:11:23.362895 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 289/634] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:23 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:23.378015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-813d3514-a5ab-41ac-90b9-14dfcb492a03 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Calling method '.version_select at 0x7f06be6bb280>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:23.535830 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-813d3514-a5ab-41ac-90b9-14dfcb492a03 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/69ac597cca9f49edb7426a4ec4045725?user_id=cfcde9363e5f481abfccec8a18327854" status: 200 len: 370 microversion: 2.1 time: 0.161498 Jul 20 04:11:23.541821 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 290/635] 10.222.0.17 () {58 vars in 1322 bytes} [Wed Jul 20 04:11:23 2022] GET /compute/v2.1/os-quota-sets/69ac597cca9f49edb7426a4ec4045725?user_id=cfcde9363e5f481abfccec8a18327854 => generated 370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:23.556721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dc0f9d90-2e5f-4824-922e-e7d6f6862b6d tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826526-5", "block_migration": true, "disk_over_commit": false}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:23.558154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dc0f9d90-2e5f-4824-922e-e7d6f6862b6d tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:23.577815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc0f9d90-2e5f-4824-922e-e7d6f6862b6d tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:23.578276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc0f9d90-2e5f-4824-922e-e7d6f6862b6d tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:23.579078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc0f9d90-2e5f-4824-922e-e7d6f6862b6d tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:23.583500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc0f9d90-2e5f-4824-922e-e7d6f6862b6d tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:23.658413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-dc0f9d90-2e5f-4824-922e-e7d6f6862b6d tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lazy-loading 'flavor' on Instance uuid c1a020af-3235-4739-bf57-bea531fa53ca {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:11:23.688877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dc0f9d90-2e5f-4824-922e-e7d6f6862b6d tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Going to try to live migrate instance to n-h2-826526-5 {{(pid=127870) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:11:23.814957 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a3cd8d9b-0900-4119-8dfa-2aa189cf21cc tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.754832 Jul 20 04:11:23.821942 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 346/636] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:11:23 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:23.826990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-02fabafa-adc8-44c5-8b93-025c21c1819c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:23.827879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-02fabafa-adc8-44c5-8b93-025c21c1819c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:23.839052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-02fabafa-adc8-44c5-8b93-025c21c1819c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:23.842250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-02fabafa-adc8-44c5-8b93-025c21c1819c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:23.844169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-02fabafa-adc8-44c5-8b93-025c21c1819c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:23.846148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-02fabafa-adc8-44c5-8b93-025c21c1819c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.111235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-02fabafa-adc8-44c5-8b93-025c21c1819c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f120f1774f7e409798e0894b71db9e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b553064d6374435a814f572cdbaedc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:24.128337 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-02fabafa-adc8-44c5-8b93-025c21c1819c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 200 len: 1303 microversion: 2.1 time: 0.304872 Jul 20 04:11:24.128910 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 347/637] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:23 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 1303 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:24.147893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fe11905b-4cbe-454a-bddb-e1dd2aa00312 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Action: 'create', calling method: .version_select at 0x7f06be453ee0>, body: {"security_group_rule": {"parent_group_id": "7a676745-c08e-4fc1-abbd-0e2f0fe17edf", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:25.104958 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fe11905b-4cbe-454a-bddb-e1dd2aa00312 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.962979 Jul 20 04:11:25.105571 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 348/638] 10.222.0.17 () {60 vars in 1194 bytes} [Wed Jul 20 04:11:24 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:25.119572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-edad5544-9624-4f32-b68c-32827ac3f8b3 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:25.120187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-edad5544-9624-4f32-b68c-32827ac3f8b3 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:25.128108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edad5544-9624-4f32-b68c-32827ac3f8b3 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:25.129240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edad5544-9624-4f32-b68c-32827ac3f8b3 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:25.130473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edad5544-9624-4f32-b68c-32827ac3f8b3 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:25.131281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edad5544-9624-4f32-b68c-32827ac3f8b3 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:25.359980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-edad5544-9624-4f32-b68c-32827ac3f8b3 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:25.376419 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-edad5544-9624-4f32-b68c-32827ac3f8b3 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 200 len: 1316 microversion: 2.1 time: 0.269690 Jul 20 04:11:25.378214 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 349/639] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:25 2022] GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:25.385418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-56bc3e9c-f060-411f-9ac9-131e3f3c4621 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:25.386817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-56bc3e9c-f060-411f-9ac9-131e3f3c4621 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:25.396601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56bc3e9c-f060-411f-9ac9-131e3f3c4621 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:25.397282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56bc3e9c-f060-411f-9ac9-131e3f3c4621 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:25.398755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56bc3e9c-f060-411f-9ac9-131e3f3c4621 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:25.399633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56bc3e9c-f060-411f-9ac9-131e3f3c4621 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:25.601226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-56bc3e9c-f060-411f-9ac9-131e3f3c4621 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:25.609376 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-56bc3e9c-f060-411f-9ac9-131e3f3c4621 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1477 microversion: 2.1 time: 0.229691 Jul 20 04:11:25.609956 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 350/640] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:25 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1477 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:25.614338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-46d04aa3-0552-442e-8a89-8112200a1e99 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Calling method '.version_select at 0x7f06be4aa160>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:25.887185 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-46d04aa3-0552-442e-8a89-8112200a1e99 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/68cf9c6410e84e9299aa5ade7d86cc34/defaults" status: 200 len: 371 microversion: 2.1 time: 0.276101 Jul 20 04:11:25.888069 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 351/641] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 04:11:25 2022] GET /compute/v2.1/os-quota-sets/68cf9c6410e84e9299aa5ade7d86cc34/defaults => generated 371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:25.903314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1eb27e4e-3681-4c22-a269-7ab53ef8a5f4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:25.903930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1eb27e4e-3681-4c22-a269-7ab53ef8a5f4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:25.929025 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1eb27e4e-3681-4c22-a269-7ab53ef8a5f4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:25.929484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1eb27e4e-3681-4c22-a269-7ab53ef8a5f4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:25.930265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1eb27e4e-3681-4c22-a269-7ab53ef8a5f4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:25.930720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1eb27e4e-3681-4c22-a269-7ab53ef8a5f4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.165976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1eb27e4e-3681-4c22-a269-7ab53ef8a5f4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:26.175831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1eb27e4e-3681-4c22-a269-7ab53ef8a5f4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:26.177657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1eb27e4e-3681-4c22-a269-7ab53ef8a5f4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:26.178926 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1eb27e4e-3681-4c22-a269-7ab53ef8a5f4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1558 microversion: 2.25 time: 0.289874 Jul 20 04:11:26.179823 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 352/642] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:25 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1558 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:26.191513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-cb87aa4d-8612-420e-b0d4-6e274db67b1f req-ba2ff69d-f076-416a-9282-b11903aa6038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23481b1e-fe28-4f48-84fe-f22cae89ac46", "name": "network-vif-plugged", "status": "completed", "tag": "c0138b21-0419-4d11-b080-80dc6be43c19"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:26.227735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-cb87aa4d-8612-420e-b0d4-6e274db67b1f req-ba2ff69d-f076-416a-9282-b11903aa6038 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.228253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-cb87aa4d-8612-420e-b0d4-6e274db67b1f req-ba2ff69d-f076-416a-9282-b11903aa6038 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.252186 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-cb87aa4d-8612-420e-b0d4-6e274db67b1f req-ba2ff69d-f076-416a-9282-b11903aa6038 service nova] Creating event network-vif-plugged:c0138b21-0419-4d11-b080-80dc6be43c19 for instance 23481b1e-fe28-4f48-84fe-f22cae89ac46 on n-h2-826526-5 Jul 20 04:11:26.258969 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-cb87aa4d-8612-420e-b0d4-6e274db67b1f req-ba2ff69d-f076-416a-9282-b11903aa6038 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076835 Jul 20 04:11:26.265567 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 353/643] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:26.286495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7e25bed8-4ded-4441-8269-998c71c94578 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Action: 'create', calling method: .version_select at 0x7f06be4533a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-535102545", "description": "tempest-description-964489345"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:26.564861 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7e25bed8-4ded-4441-8269-998c71c94578 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.287091 Jul 20 04:11:26.566013 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 354/644] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:11:26 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:26.572014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-14b106c9-12d5-4cfc-9f5b-d4e2eadd07b2 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:26.579194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-14b106c9-12d5-4cfc-9f5b-d4e2eadd07b2 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:26.593812 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14b106c9-12d5-4cfc-9f5b-d4e2eadd07b2 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.597799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14b106c9-12d5-4cfc-9f5b-d4e2eadd07b2 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.599049 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14b106c9-12d5-4cfc-9f5b-d4e2eadd07b2 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.599826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14b106c9-12d5-4cfc-9f5b-d4e2eadd07b2 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.876560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-14b106c9-12d5-4cfc-9f5b-d4e2eadd07b2 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f120f1774f7e409798e0894b71db9e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b553064d6374435a814f572cdbaedc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:26.890085 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-14b106c9-12d5-4cfc-9f5b-d4e2eadd07b2 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 200 len: 1370 microversion: 2.1 time: 0.322423 Jul 20 04:11:26.901632 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 355/645] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:26 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 1370 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:26.908322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-db744d0f-fc2c-416c-b239-df1d17890dd4 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:26.908954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-db744d0f-fc2c-416c-b239-df1d17890dd4 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:26.918289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db744d0f-fc2c-416c-b239-df1d17890dd4 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.918774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db744d0f-fc2c-416c-b239-df1d17890dd4 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.919562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db744d0f-fc2c-416c-b239-df1d17890dd4 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.919999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db744d0f-fc2c-416c-b239-df1d17890dd4 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:27.198678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-db744d0f-fc2c-416c-b239-df1d17890dd4 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:27.209977 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-db744d0f-fc2c-416c-b239-df1d17890dd4 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216" status: 200 len: 1586 microversion: 2.1 time: 0.306520 Jul 20 04:11:27.222443 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 356/646] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:26 2022] GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 => generated 1586 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:27.222443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-6972b17c-6304-4ad7-96bb-614db87cb1ad req-ce3d9ac1-ebd9-43b6-98ac-e66af9b2e70a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c220c0a5-011c-4d57-9691-99405d5fe216", "tag": "c0e0b530-be51-4f12-bcbc-b0f85954eebe"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:27.237387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-6972b17c-6304-4ad7-96bb-614db87cb1ad req-ce3d9ac1-ebd9-43b6-98ac-e66af9b2e70a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:27.238154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-6972b17c-6304-4ad7-96bb-614db87cb1ad req-ce3d9ac1-ebd9-43b6-98ac-e66af9b2e70a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:27.276680 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-6972b17c-6304-4ad7-96bb-614db87cb1ad req-ce3d9ac1-ebd9-43b6-98ac-e66af9b2e70a service nova] Creating event network-changed:c0e0b530-be51-4f12-bcbc-b0f85954eebe for instance c220c0a5-011c-4d57-9691-99405d5fe216 on n-h1-826526-5 Jul 20 04:11:27.285433 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-6972b17c-6304-4ad7-96bb-614db87cb1ad req-ce3d9ac1-ebd9-43b6-98ac-e66af9b2e70a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072748 Jul 20 04:11:27.300646 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 357/647] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:27.313062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b8cfcb8f-6129-4585-82d9-73ebc824639e tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Action: 'update', calling method: .version_select at 0x7f06be4aa160>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:27.449495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8cfcb8f-6129-4585-82d9-73ebc824639e tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:27.453067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8cfcb8f-6129-4585-82d9-73ebc824639e tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:27.453944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8cfcb8f-6129-4585-82d9-73ebc824639e tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:27.454384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8cfcb8f-6129-4585-82d9-73ebc824639e tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:27.960212 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b8cfcb8f-6129-4585-82d9-73ebc824639e tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/68cf9c6410e84e9299aa5ade7d86cc34" status: 200 len: 329 microversion: 2.1 time: 0.659521 Jul 20 04:11:27.969116 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 358/648] 10.222.0.17 () {60 vars in 1262 bytes} [Wed Jul 20 04:11:27 2022] PUT /compute/v2.1/os-quota-sets/68cf9c6410e84e9299aa5ade7d86cc34 => generated 329 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:27.995496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a39c700f-33a4-4b73-be03-b880bca90ecd tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:27.998039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a39c700f-33a4-4b73-be03-b880bca90ecd tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:28.016158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a39c700f-33a4-4b73-be03-b880bca90ecd tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.017447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a39c700f-33a4-4b73-be03-b880bca90ecd tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.019106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a39c700f-33a4-4b73-be03-b880bca90ecd tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.020694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a39c700f-33a4-4b73-be03-b880bca90ecd tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.074386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:28.462619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-a39c700f-33a4-4b73-be03-b880bca90ecd tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'services' on Instance uuid 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:11:28.492609 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dc0f9d90-2e5f-4824-922e-e7d6f6862b6d tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca/action" status: 202 len: 0 microversion: 2.1 time: 4.952415 Jul 20 04:11:28.493094 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 291/649] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:11:23 2022] POST /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca/action => generated 0 bytes in 4955 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:28.498191 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a39c700f-33a4-4b73-be03-b880bca90ecd tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 2051 microversion: 2.25 time: 0.527720 Jul 20 04:11:28.498939 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 359/650] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:27 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 2051 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:28.515914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0bf1cffb-47e1-4269-a147-a8f2d693cb4f tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Action: 'create', calling method: .version_select at 0x7f06be59caf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1663170851", "description": "tempest-description-1893223783"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:28.516337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-71b8dfff-0251-455b-99fc-ea5c1aad8620 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:28.522384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-71b8dfff-0251-455b-99fc-ea5c1aad8620 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:28.543159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71b8dfff-0251-455b-99fc-ea5c1aad8620 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.546221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71b8dfff-0251-455b-99fc-ea5c1aad8620 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.547999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71b8dfff-0251-455b-99fc-ea5c1aad8620 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.549291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71b8dfff-0251-455b-99fc-ea5c1aad8620 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.804650 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0bf1cffb-47e1-4269-a147-a8f2d693cb4f tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.292595 Jul 20 04:11:28.805357 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 360/651] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:11:28 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:28.817732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-77490c25-a533-4a70-b931-1ba3d82303f9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:28.818350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-77490c25-a533-4a70-b931-1ba3d82303f9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:28.828656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-77490c25-a533-4a70-b931-1ba3d82303f9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.829102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-77490c25-a533-4a70-b931-1ba3d82303f9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.829914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-77490c25-a533-4a70-b931-1ba3d82303f9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.830369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-77490c25-a533-4a70-b931-1ba3d82303f9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:29.000435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-77490c25-a533-4a70-b931-1ba3d82303f9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:29.014452 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-77490c25-a533-4a70-b931-1ba3d82303f9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1476 microversion: 2.1 time: 0.201123 Jul 20 04:11:29.028579 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 361/652] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:28 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1476 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:29.045391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-494f9127-a690-4c11-a724-10c891d46103 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:29.046017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-494f9127-a690-4c11-a724-10c891d46103 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:29.054193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-494f9127-a690-4c11-a724-10c891d46103 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:29.054907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-494f9127-a690-4c11-a724-10c891d46103 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:29.055823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-494f9127-a690-4c11-a724-10c891d46103 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:29.056434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-494f9127-a690-4c11-a724-10c891d46103 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:29.184576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-71b8dfff-0251-455b-99fc-ea5c1aad8620 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:29.201219 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-71b8dfff-0251-455b-99fc-ea5c1aad8620 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 200 len: 1316 microversion: 2.1 time: 0.706846 Jul 20 04:11:29.202379 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 292/653] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:28 2022] GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 1316 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:29.217455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d355abbe-89e9-4102-819e-987025ec2035 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Action: 'update', calling method: .version_select at 0x7f06be895e50>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:29.274556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-494f9127-a690-4c11-a724-10c891d46103 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f120f1774f7e409798e0894b71db9e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b553064d6374435a814f572cdbaedc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:29.283088 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-494f9127-a690-4c11-a724-10c891d46103 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 200 len: 1370 microversion: 2.1 time: 0.250926 Jul 20 04:11:29.293074 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 362/654] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:29 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 1370 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:29.298670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-455ce2f3-92ab-46e9-afe7-3fe726d81181 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:29.299998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-455ce2f3-92ab-46e9-afe7-3fe726d81181 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:29.307218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-455ce2f3-92ab-46e9-afe7-3fe726d81181 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:29.307635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-455ce2f3-92ab-46e9-afe7-3fe726d81181 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:29.308541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-455ce2f3-92ab-46e9-afe7-3fe726d81181 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:29.309090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-455ce2f3-92ab-46e9-afe7-3fe726d81181 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:29.330630 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=46 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:29.332107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d355abbe-89e9-4102-819e-987025ec2035 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:29.334632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d355abbe-89e9-4102-819e-987025ec2035 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:29.338193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d355abbe-89e9-4102-819e-987025ec2035 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:29.339104 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d355abbe-89e9-4102-819e-987025ec2035 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:29.418568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:29.931864 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d355abbe-89e9-4102-819e-987025ec2035 tempest-QuotasAdminTestJSON-1192873135 tempest-QuotasAdminTestJSON-1192873135-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/68cf9c6410e84e9299aa5ade7d86cc34" status: 200 len: 329 microversion: 2.1 time: 0.718001 Jul 20 04:11:29.934950 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 293/655] 10.222.0.17 () {60 vars in 1262 bytes} [Wed Jul 20 04:11:29 2022] PUT /compute/v2.1/os-quota-sets/68cf9c6410e84e9299aa5ade7d86cc34 => generated 329 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:29.946324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-14b0f4dc-d51e-4d8f-ab62-2988102c5c9f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:29.950215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-14b0f4dc-d51e-4d8f-ab62-2988102c5c9f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:29.961445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-455ce2f3-92ab-46e9-afe7-3fe726d81181 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:29.970134 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-455ce2f3-92ab-46e9-afe7-3fe726d81181 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1503 microversion: 2.1 time: 0.675834 Jul 20 04:11:29.970719 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 363/656] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:29 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1503 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:29.975394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14b0f4dc-d51e-4d8f-ab62-2988102c5c9f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:29.980209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14b0f4dc-d51e-4d8f-ab62-2988102c5c9f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:29.982643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14b0f4dc-d51e-4d8f-ab62-2988102c5c9f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:29.994553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bc7d443d-38ba-4752-aef6-28537ce20ba4 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Action: 'create', calling method: .version_select at 0x7f06be59c4c0>, body: {"security_group_rule": {"parent_group_id": "6e4dcf9d-526f-4901-8805-7b0705c6001c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "3e2e1533-2bc1-4f35-b4fc-6a3c7c343b18"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:29.995879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14b0f4dc-d51e-4d8f-ab62-2988102c5c9f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.518838 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bc7d443d-38ba-4752-aef6-28537ce20ba4 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.540375 Jul 20 04:11:30.520287 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 364/657] 10.222.0.17 () {60 vars in 1194 bytes} [Wed Jul 20 04:11:29 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:30.526672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-5e631c41-2e62-4dc2-b75e-dde5245de989 req-58e6759c-6e1c-44ec-a825-2b26eea8d255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367d7c6a-04c7-4d70-9afd-bbc8d97c9247", "name": "network-vif-unplugged", "status": "completed", "tag": "10cee44f-babb-4437-935e-ea2811233f2e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:30.537415 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5e631c41-2e62-4dc2-b75e-dde5245de989 req-58e6759c-6e1c-44ec-a825-2b26eea8d255 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.537829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5e631c41-2e62-4dc2-b75e-dde5245de989 req-58e6759c-6e1c-44ec-a825-2b26eea8d255 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.539830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-14b0f4dc-d51e-4d8f-ab62-2988102c5c9f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'services' on Instance uuid 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:11:30.567842 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-5e631c41-2e62-4dc2-b75e-dde5245de989 req-58e6759c-6e1c-44ec-a825-2b26eea8d255 service nova] Creating event network-vif-unplugged:10cee44f-babb-4437-935e-ea2811233f2e for instance 367d7c6a-04c7-4d70-9afd-bbc8d97c9247 on n-h1-826526-5 Jul 20 04:11:30.609021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-5e631c41-2e62-4dc2-b75e-dde5245de989 req-58e6759c-6e1c-44ec-a825-2b26eea8d255 service nova] Instance 367d7c6a-04c7-4d70-9afd-bbc8d97c9247 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:11:30.626372 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-5e631c41-2e62-4dc2-b75e-dde5245de989 req-58e6759c-6e1c-44ec-a825-2b26eea8d255 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104804 Jul 20 04:11:30.627677 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 365/658] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:30.636736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f7d1c588-a08d-4952-87c6-3443495f1cd7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:30.648111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f7d1c588-a08d-4952-87c6-3443495f1cd7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:30.656351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7d1c588-a08d-4952-87c6-3443495f1cd7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.657082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7d1c588-a08d-4952-87c6-3443495f1cd7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.658119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7d1c588-a08d-4952-87c6-3443495f1cd7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.658759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7d1c588-a08d-4952-87c6-3443495f1cd7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.688741 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-14b0f4dc-d51e-4d8f-ab62-2988102c5c9f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 2051 microversion: 2.25 time: 0.750661 Jul 20 04:11:30.689368 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 294/659] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:29 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 2051 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:30.711858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d27a6061-2714-4e3e-bf81-f034b46f5847 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:30.714178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d27a6061-2714-4e3e-bf81-f034b46f5847 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:30.731185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d27a6061-2714-4e3e-bf81-f034b46f5847 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.731684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d27a6061-2714-4e3e-bf81-f034b46f5847 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.733306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d27a6061-2714-4e3e-bf81-f034b46f5847 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.733753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d27a6061-2714-4e3e-bf81-f034b46f5847 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.815001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:31.126026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f7d1c588-a08d-4952-87c6-3443495f1cd7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:31.135294 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f7d1c588-a08d-4952-87c6-3443495f1cd7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1476 microversion: 2.1 time: 0.503881 Jul 20 04:11:31.138473 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 366/660] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:30 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1476 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:31.149201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d27a6061-2714-4e3e-bf81-f034b46f5847 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:31.157194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f784ac64-ce9e-4f18-a6b4-f4e0c6e12845 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:31.160932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f784ac64-ce9e-4f18-a6b4-f4e0c6e12845 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:31.163829 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d27a6061-2714-4e3e-bf81-f034b46f5847 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 200 len: 1316 microversion: 2.1 time: 0.455583 Jul 20 04:11:31.164769 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 295/661] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:30 2022] GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 1316 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:31.176373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-92f53384-d7a0-48e7-ba17-aebc83e1c15d tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Action: 'create', calling method: .version_select at 0x7f06be65dee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1882224886", "description": "tempest-description-2147144219"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:31.193538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f784ac64-ce9e-4f18-a6b4-f4e0c6e12845 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.194112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f784ac64-ce9e-4f18-a6b4-f4e0c6e12845 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.195447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f784ac64-ce9e-4f18-a6b4-f4e0c6e12845 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.197045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f784ac64-ce9e-4f18-a6b4-f4e0c6e12845 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.636244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f784ac64-ce9e-4f18-a6b4-f4e0c6e12845 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f120f1774f7e409798e0894b71db9e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b553064d6374435a814f572cdbaedc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:31.645136 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f784ac64-ce9e-4f18-a6b4-f4e0c6e12845 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 200 len: 1370 microversion: 2.1 time: 0.505298 Jul 20 04:11:31.646256 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 367/662] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:31 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 1370 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:31.652175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-646f70c5-c446-41c9-9842-a5c49f700ba1 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:31.653984 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:31.653984 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:11:31.655671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-646f70c5-c446-41c9-9842-a5c49f700ba1 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.656518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-646f70c5-c446-41c9-9842-a5c49f700ba1 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.658346 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-646f70c5-c446-41c9-9842-a5c49f700ba1 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.660982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-646f70c5-c446-41c9-9842-a5c49f700ba1 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.689120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=15 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:31.699918 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-646f70c5-c446-41c9-9842-a5c49f700ba1 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.052001 Jul 20 04:11:31.701544 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 368/663] 10.222.0.17 () {60 vars in 1216 bytes} [Wed Jul 20 04:11:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:11:31.707418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-0c24c2ca-6048-4197-9976-ab99314c6a61 req-60dc0233-67df-4be5-8c1b-c0b07c2a2374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609e8037-70aa-40fc-bd6d-1dbbdeabc6d2", "tag": "86019a59-d8ac-45dd-825e-637199de9b86"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:31.720455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-0c24c2ca-6048-4197-9976-ab99314c6a61 req-60dc0233-67df-4be5-8c1b-c0b07c2a2374 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.721750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-0c24c2ca-6048-4197-9976-ab99314c6a61 req-60dc0233-67df-4be5-8c1b-c0b07c2a2374 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.740996 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-0c24c2ca-6048-4197-9976-ab99314c6a61 req-60dc0233-67df-4be5-8c1b-c0b07c2a2374 service nova] Creating event network-changed:86019a59-d8ac-45dd-825e-637199de9b86 for instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 on n-h2-826526-5 Jul 20 04:11:31.748655 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-0c24c2ca-6048-4197-9976-ab99314c6a61 req-60dc0233-67df-4be5-8c1b-c0b07c2a2374 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045221 Jul 20 04:11:31.750373 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 369/664] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:31.760021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-70bb364c-798b-41bb-8a96-628c0b7f4630 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:31.761243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-70bb364c-798b-41bb-8a96-628c0b7f4630 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:31.771414 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70bb364c-798b-41bb-8a96-628c0b7f4630 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.773311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70bb364c-798b-41bb-8a96-628c0b7f4630 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.775889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70bb364c-798b-41bb-8a96-628c0b7f4630 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.777461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70bb364c-798b-41bb-8a96-628c0b7f4630 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.784348 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-92f53384-d7a0-48e7-ba17-aebc83e1c15d tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.618253 Jul 20 04:11:31.785037 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 296/665] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:11:31 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:31.789936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a39ee093-c058-4974-bf2e-be98b0a89436 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:31.790676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a39ee093-c058-4974-bf2e-be98b0a89436 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:31.805372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a39ee093-c058-4974-bf2e-be98b0a89436 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.806204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a39ee093-c058-4974-bf2e-be98b0a89436 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.807227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a39ee093-c058-4974-bf2e-be98b0a89436 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.808750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a39ee093-c058-4974-bf2e-be98b0a89436 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.946157 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a39ee093-c058-4974-bf2e-be98b0a89436 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69/action" status: 202 len: 0 microversion: 2.25 time: 0.159599 Jul 20 04:11:31.956855 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 297/666] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jul 20 04:11:31 2022] POST /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:31.963542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-04e669e8-cd3b-4558-beeb-8f4db1d177c2 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Action: 'create', calling method: .version_select at 0x7f06be699dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-80090959", "description": "tempest-description-1045033981"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:32.054916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-70bb364c-798b-41bb-8a96-628c0b7f4630 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:32.065364 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-70bb364c-798b-41bb-8a96-628c0b7f4630 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1503 microversion: 2.1 time: 0.312727 Jul 20 04:11:32.073618 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 370/667] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:31 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1503 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:32.085658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c959e170-08c6-4092-8b73-410dcda50f90 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:32.086739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c959e170-08c6-4092-8b73-410dcda50f90 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:32.093412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c959e170-08c6-4092-8b73-410dcda50f90 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.104434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c959e170-08c6-4092-8b73-410dcda50f90 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.106589 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c959e170-08c6-4092-8b73-410dcda50f90 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.107414 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c959e170-08c6-4092-8b73-410dcda50f90 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.536924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-c959e170-08c6-4092-8b73-410dcda50f90 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'services' on Instance uuid 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:11:32.575375 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c959e170-08c6-4092-8b73-410dcda50f90 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 2056 microversion: 2.25 time: 0.493893 Jul 20 04:11:32.578898 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 371/668] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:32 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 2056 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:32.585532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-65b13b93-22eb-4498-b50a-c625717761df tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:32.586561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-65b13b93-22eb-4498-b50a-c625717761df tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:32.596438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65b13b93-22eb-4498-b50a-c625717761df tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.597294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65b13b93-22eb-4498-b50a-c625717761df tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.598259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65b13b93-22eb-4498-b50a-c625717761df tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.598853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65b13b93-22eb-4498-b50a-c625717761df tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.656308 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-04e669e8-cd3b-4558-beeb-8f4db1d177c2 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.696907 Jul 20 04:11:32.672544 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 298/669] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:11:31 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:32.682243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-326876e7-0c71-4c30-959d-af0f5d24868b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:32.683279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-326876e7-0c71-4c30-959d-af0f5d24868b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:32.696474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-326876e7-0c71-4c30-959d-af0f5d24868b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.698571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-326876e7-0c71-4c30-959d-af0f5d24868b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.699674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-326876e7-0c71-4c30-959d-af0f5d24868b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.700301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-326876e7-0c71-4c30-959d-af0f5d24868b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.906609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-326876e7-0c71-4c30-959d-af0f5d24868b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:32.917244 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-326876e7-0c71-4c30-959d-af0f5d24868b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 200 len: 1464 microversion: 2.1 time: 0.242782 Jul 20 04:11:32.918487 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 299/670] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:32 2022] GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 1464 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:32.926001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3bef67e7-99d1-4edf-9451-c3d1df30ada4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:32.927518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3bef67e7-99d1-4edf-9451-c3d1df30ada4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:32.932473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-65b13b93-22eb-4498-b50a-c625717761df tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:32.935208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3bef67e7-99d1-4edf-9451-c3d1df30ada4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.935951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3bef67e7-99d1-4edf-9451-c3d1df30ada4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.937109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3bef67e7-99d1-4edf-9451-c3d1df30ada4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.938151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3bef67e7-99d1-4edf-9451-c3d1df30ada4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.943489 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-65b13b93-22eb-4498-b50a-c625717761df tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1476 microversion: 2.1 time: 0.363106 Jul 20 04:11:32.947053 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 372/671] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:32 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1476 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:32.961581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e45e15bb-27e2-489a-b60c-bf8d0bef9a0b tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Action: 'create', calling method: .version_select at 0x7f06be453ca0>, body: {"security_group_rule": {"parent_group_id": "6a94857e-aa18-467e-89cd-e543451d8a10", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "d320ce70-5b5e-49bb-a274-d18b2c2e0e31"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:33.166335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3bef67e7-99d1-4edf-9451-c3d1df30ada4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f120f1774f7e409798e0894b71db9e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b553064d6374435a814f572cdbaedc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:33.177435 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3bef67e7-99d1-4edf-9451-c3d1df30ada4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 200 len: 1370 microversion: 2.1 time: 0.256982 Jul 20 04:11:33.188867 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 300/672] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:32 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 1370 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:33.451259 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e45e15bb-27e2-489a-b60c-bf8d0bef9a0b tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 0.492998 Jul 20 04:11:33.452248 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 373/673] 10.222.0.17 () {60 vars in 1194 bytes} [Wed Jul 20 04:11:32 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:33.459217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e559dcd6-6dc7-4b13-b110-867322df1f43 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:33.460105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e559dcd6-6dc7-4b13-b110-867322df1f43 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:33.475189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e559dcd6-6dc7-4b13-b110-867322df1f43 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:33.476450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e559dcd6-6dc7-4b13-b110-867322df1f43 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:33.478279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e559dcd6-6dc7-4b13-b110-867322df1f43 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:33.479628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e559dcd6-6dc7-4b13-b110-867322df1f43 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:33.696577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d5ef647e-8484-4dd9-aeaa-4d06122f59ff tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:33.698027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d5ef647e-8484-4dd9-aeaa-4d06122f59ff tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:33.705260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5ef647e-8484-4dd9-aeaa-4d06122f59ff tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:33.705860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5ef647e-8484-4dd9-aeaa-4d06122f59ff tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:33.711908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5ef647e-8484-4dd9-aeaa-4d06122f59ff tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:33.712570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5ef647e-8484-4dd9-aeaa-4d06122f59ff tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:33.762535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e559dcd6-6dc7-4b13-b110-867322df1f43 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:33.771612 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e559dcd6-6dc7-4b13-b110-867322df1f43 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1503 microversion: 2.1 time: 0.317913 Jul 20 04:11:33.773544 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 374/674] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:33 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1503 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:33.779687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d2239f50-7baa-4e47-a2ed-b96daa5f3d7f tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Calling method '.version_select at 0x7f06be5a78b0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:34.110317 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d5ef647e-8484-4dd9-aeaa-4d06122f59ff tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 200 len: 1615 microversion: 2.1 time: 0.917484 Jul 20 04:11:34.112572 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 301/675] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:33 2022] GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 1615 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:34.126813 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d2239f50-7baa-4e47-a2ed-b96daa5f3d7f tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/d320ce70-5b5e-49bb-a274-d18b2c2e0e31" status: 202 len: 0 microversion: 2.1 time: 0.348727 Jul 20 04:11:34.126813 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 375/676] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:11:33 2022] DELETE /compute/v2.1/os-security-groups/d320ce70-5b5e-49bb-a274-d18b2c2e0e31 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:34.133158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-3fbe51c8-0c44-4a5e-bf09-859099a89ce9 req-e480da22-0e9f-4bcf-8f4e-ab784c6f7d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367d7c6a-04c7-4d70-9afd-bbc8d97c9247", "tag": "10cee44f-babb-4437-935e-ea2811233f2e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:34.144891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-09c6467e-40a5-4597-b6a3-d6383dd7480b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:34.145701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-09c6467e-40a5-4597-b6a3-d6383dd7480b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:34.159970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3fbe51c8-0c44-4a5e-bf09-859099a89ce9 req-e480da22-0e9f-4bcf-8f4e-ab784c6f7d5d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:34.161342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3fbe51c8-0c44-4a5e-bf09-859099a89ce9 req-e480da22-0e9f-4bcf-8f4e-ab784c6f7d5d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:34.168705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09c6467e-40a5-4597-b6a3-d6383dd7480b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:34.169503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09c6467e-40a5-4597-b6a3-d6383dd7480b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:34.170737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09c6467e-40a5-4597-b6a3-d6383dd7480b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:34.171285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09c6467e-40a5-4597-b6a3-d6383dd7480b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:34.215631 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-3fbe51c8-0c44-4a5e-bf09-859099a89ce9 req-e480da22-0e9f-4bcf-8f4e-ab784c6f7d5d service nova] Creating event network-changed:10cee44f-babb-4437-935e-ea2811233f2e for instance 367d7c6a-04c7-4d70-9afd-bbc8d97c9247 on n-h1-826526-5 Jul 20 04:11:34.232218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-3fbe51c8-0c44-4a5e-bf09-859099a89ce9 req-e480da22-0e9f-4bcf-8f4e-ab784c6f7d5d service nova] Instance 367d7c6a-04c7-4d70-9afd-bbc8d97c9247 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:11:34.257567 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-3fbe51c8-0c44-4a5e-bf09-859099a89ce9 req-e480da22-0e9f-4bcf-8f4e-ab784c6f7d5d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131585 Jul 20 04:11:34.258742 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 376/677] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:34.264754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1ca40f28-9083-4398-b2f1-5572e790f48b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:34.265677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1ca40f28-9083-4398-b2f1-5572e790f48b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:34.272579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ca40f28-9083-4398-b2f1-5572e790f48b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:34.274454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ca40f28-9083-4398-b2f1-5572e790f48b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:34.275064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ca40f28-9083-4398-b2f1-5572e790f48b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:34.275963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ca40f28-9083-4398-b2f1-5572e790f48b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:34.411974 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-09c6467e-40a5-4597-b6a3-d6383dd7480b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'services' on Instance uuid 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:11:34.433977 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-09c6467e-40a5-4597-b6a3-d6383dd7480b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 2036 microversion: 2.25 time: 0.319591 Jul 20 04:11:34.434762 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 302/678] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:34 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 2036 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:34.439931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-51373b44-8f82-4ed7-9f02-f815a8e60197 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Action: 'create', calling method: .version_select at 0x7f06be6d75e0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1800996211", "policies": ["affinity"]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:34.460147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-51373b44-8f82-4ed7-9f02-f815a8e60197 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_groups'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:34.468325 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-51373b44-8f82-4ed7-9f02-f815a8e60197 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for user 5e178243e1ed404092e5ea0be39d5c16 and project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_groups'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:34.520647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1ca40f28-9083-4398-b2f1-5572e790f48b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:34.530563 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1ca40f28-9083-4398-b2f1-5572e790f48b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1474 microversion: 2.1 time: 0.270069 Jul 20 04:11:34.531933 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 377/679] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:34 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1474 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:34.532822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-51373b44-8f82-4ed7-9f02-f815a8e60197 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_groups'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:34.537494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9f26e3ac-e9ef-444e-8e41-7548f2604821 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Calling method '.version_select at 0x7f06be5a7160>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:34.538674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-51373b44-8f82-4ed7-9f02-f815a8e60197 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for user 5e178243e1ed404092e5ea0be39d5c16 and project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_groups'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:34.580523 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-51373b44-8f82-4ed7-9f02-f815a8e60197 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.141681 Jul 20 04:11:34.581489 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 303/680] 10.222.0.17 () {60 vars in 1173 bytes} [Wed Jul 20 04:11:34 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:34.599769 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-40155c25-8a6a-4a59-ad39-0340b992fe25 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:34.608311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-40155c25-8a6a-4a59-ad39-0340b992fe25 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:34.621255 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9f26e3ac-e9ef-444e-8e41-7548f2604821 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/6a94857e-aa18-467e-89cd-e543451d8a10" status: 200 len: 248 microversion: 2.1 time: 0.088016 Jul 20 04:11:34.629439 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 378/681] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 04:11:34 2022] GET /compute/v2.1/os-security-groups/6a94857e-aa18-467e-89cd-e543451d8a10 => generated 248 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:34.638852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40155c25-8a6a-4a59-ad39-0340b992fe25 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:34.639366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40155c25-8a6a-4a59-ad39-0340b992fe25 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:34.640544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40155c25-8a6a-4a59-ad39-0340b992fe25 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:34.640984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40155c25-8a6a-4a59-ad39-0340b992fe25 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:34.807418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7adeceff-e3e8-4656-93ae-c890dbacffa6 tempest-FlavorsV2NegativeTest-1307745957 tempest-FlavorsV2NegativeTest-1307745957-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:34.821840 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7adeceff-e3e8-4656-93ae-c890dbacffa6 tempest-FlavorsV2NegativeTest-1307745957 tempest-FlavorsV2NegativeTest-1307745957-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.190978 Jul 20 04:11:34.822488 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 379/682] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:11:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:34.827571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-897c3403-c497-417f-943d-1168f194ab61 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826526-5", "block_migration": "auto"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:34.829477 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-897c3403-c497-417f-943d-1168f194ab61 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:34.837698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-897c3403-c497-417f-943d-1168f194ab61 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:34.837698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-897c3403-c497-417f-943d-1168f194ab61 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:34.838524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-897c3403-c497-417f-943d-1168f194ab61 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:34.838912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-897c3403-c497-417f-943d-1168f194ab61 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:34.870796 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-897c3403-c497-417f-943d-1168f194ab61 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'flavor' on Instance uuid 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:11:34.890521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-897c3403-c497-417f-943d-1168f194ab61 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Going to try to live migrate instance to n-h2-826526-5 {{(pid=127871) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:11:34.952886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-40155c25-8a6a-4a59-ad39-0340b992fe25 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f120f1774f7e409798e0894b71db9e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b553064d6374435a814f572cdbaedc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:34.963488 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-40155c25-8a6a-4a59-ad39-0340b992fe25 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 200 len: 1370 microversion: 2.1 time: 0.380725 Jul 20 04:11:34.973605 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 304/683] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:34 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 1370 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:34.979590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5698908c-6567-4e52-8e47-adf28c20ec9b tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Action: 'create', calling method: .version_select at 0x7f06be65ddc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-122382581", "description": "tempest-description-2102507694"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:35.307737 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5698908c-6567-4e52-8e47-adf28c20ec9b tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.332389 Jul 20 04:11:35.308765 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 305/684] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:11:34 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:35.313493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1672659784", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "88729079-fa5f-46ba-b340-24992af9bb57"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:35.319778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=15,nova_api:UPDATE=13 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:35.413286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] validate_networks() for None {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:36.448855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:36.449462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:36.449740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:36.450147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:36.450557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:36.476038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:36.476517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:36.477317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:36.477749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:36.495615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for project 22bcfd2698d047dea07c643970c749eb. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:36.501892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for user 5e178243e1ed404092e5ea0be39d5c16 and project 22bcfd2698d047dea07c643970c749eb. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:36.515449 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Going to run 2 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:11:36.518696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 3572b1fb-62bb-4279-94d0-73fefdbb8b25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:36.564145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127870) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 20 04:11:36.583459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_group_members'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:36.588861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for user 5e178243e1ed404092e5ea0be39d5c16 and project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_group_members'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:36.636307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_group_members'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:36.641553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for user 5e178243e1ed404092e5ea0be39d5c16 and project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_group_members'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:36.658209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=3572b1fb-62bb-4279-94d0-73fefdbb8b25,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:36.717348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_group_members'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:36.723331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for user 5e178243e1ed404092e5ea0be39d5c16 and project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_group_members'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:36.768496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_group_members'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:36.774568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for user 5e178243e1ed404092e5ea0be39d5c16 and project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_group_members'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:36.818737 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-82a4823b-edbc-4734-8974-711589d6b254 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.508859 Jul 20 04:11:36.820494 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 306/685] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:35 2022] POST /compute/v2.1/servers => generated 32 bytes in 1511 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:11:36.826111 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b8486440-eca0-4362-89e8-900e92a6d767 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:36.827000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b8486440-eca0-4362-89e8-900e92a6d767 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:36.834474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b8486440-eca0-4362-89e8-900e92a6d767 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:36.835252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b8486440-eca0-4362-89e8-900e92a6d767 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:36.836089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b8486440-eca0-4362-89e8-900e92a6d767 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:36.836549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b8486440-eca0-4362-89e8-900e92a6d767 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:36.911862 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-897c3403-c497-417f-943d-1168f194ab61 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69/action" status: 202 len: 0 microversion: 2.25 time: 2.088021 Jul 20 04:11:36.912684 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 380/686] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jul 20 04:11:34 2022] POST /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69/action => generated 0 bytes in 2089 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:36.917729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-552f7f82-cf3c-4927-82f5-e7f12f09ed17 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Action: 'create', calling method: .version_select at 0x7f06be3ee9d0>, body: {"security_group_rule": {"parent_group_id": "95df0cb3-6ed4-4308-ad2f-eba0094ae83a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:37.027156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b8486440-eca0-4362-89e8-900e92a6d767 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:37.035643 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b8486440-eca0-4362-89e8-900e92a6d767 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1503 microversion: 2.1 time: 0.213794 Jul 20 04:11:37.036499 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 307/687] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:36 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1503 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:37.046878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e440bab5-6826-462e-9935-63962459c8e2 tempest-FlavorsV2NegativeTest-1307745957 tempest-FlavorsV2NegativeTest-1307745957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-84202604", "imageRef": "965fd55d-ac76-4367-ac3d-e9118a7a7871", "flavorRef": "452"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:37.098883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-e440bab5-6826-462e-9935-63962459c8e2 tempest-FlavorsV2NegativeTest-1307745957 tempest-FlavorsV2NegativeTest-1307745957-project] validate_networks() for None {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:37.143245 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-552f7f82-cf3c-4927-82f5-e7f12f09ed17 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.229261 Jul 20 04:11:37.144197 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 381/688] 10.222.0.17 () {60 vars in 1194 bytes} [Wed Jul 20 04:11:36 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:37.151657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e10e2e10-eb04-475c-9726-5a46bec1a75d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:37.152641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e10e2e10-eb04-475c-9726-5a46bec1a75d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:37.160652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e10e2e10-eb04-475c-9726-5a46bec1a75d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.161157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e10e2e10-eb04-475c-9726-5a46bec1a75d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.162681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e10e2e10-eb04-475c-9726-5a46bec1a75d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.163122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e10e2e10-eb04-475c-9726-5a46bec1a75d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.168035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:37.309262 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e10e2e10-eb04-475c-9726-5a46bec1a75d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:37.316957 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e10e2e10-eb04-475c-9726-5a46bec1a75d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1471 microversion: 2.1 time: 0.171412 Jul 20 04:11:37.327924 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 382/689] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:37 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:37.328137 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-e440bab5-6826-462e-9935-63962459c8e2 tempest-FlavorsV2NegativeTest-1307745957 tempest-FlavorsV2NegativeTest-1307745957-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 20 04:11:37.328229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-aa97fefb-5bb0-4be4-81c5-e84c38d81d7f tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:37.328229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-aa97fefb-5bb0-4be4-81c5-e84c38d81d7f tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e440bab5-6826-462e-9935-63962459c8e2 tempest-FlavorsV2NegativeTest-1307745957 tempest-FlavorsV2NegativeTest-1307745957-project] Request method failure captured: Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 141 Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14B2RoAeziL2bf5IY92lT809tYltRvRfN-5VT0b1qnjv2iWpMxf0x-_C6Tu5SQ5C4jLbC6KaAX992WdcmZfW0US669RoI7OQ-6AcNJxcVqcSud31PM2d4zMGCgoM34dUcaVa_IbsZqPgZtM1SExu4kWACfjiimQ-hqEdWf67xyI5Lq4 Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 1d3de60ce0ac481bbc7ed1c73745db83 Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-FlavorsV2NegativeTest-1307745957 Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:11:37.328416 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:11:37.329833 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1d3de60ce0ac481bbc7ed1c73745db83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1d3de60ce0ac481bbc7ed1c73745db83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1d3de60ce0ac481bbc7ed1c73745db83", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1d3de60ce0ac481bbc7ed1c73745db83"}]}] Jul 20 04:11:37.329833 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-FlavorsV2NegativeTest-1307745957 Jul 20 04:11:37.329833 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 1d3de60ce0ac481bbc7ed1c73745db83 Jul 20 04:11:37.329833 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1307745957 Jul 20 04:11:37.329833 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-FlavorsV2NegativeTest-1307745957-project Jul 20 04:11:37.329833 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:11:37.329833 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:11:37.329833 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 3ad124df53684b8789f882a7c0d0a8b7 Jul 20 04:11:37.329833 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-FlavorsV2NegativeTest-1307745957-project Jul 20 04:11:37.329833 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:11:37.329833 n-d-826526-5 devstack@n-api.service[127870]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-84202604", "imageRef": "965fd55d-ac76-4367-ac3d-e9118a7a7871", "flavorRef": "452"}} Jul 20 04:11:37.329833 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:11:37.329833 n-d-826526-5 devstack@n-api.service[127870]: exception: Flavor's memory is too small for requested image. Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-84202604', 'imageRef': '965fd55d-ac76-4367-ac3d-e9118a7a7871', 'flavorRef': '452'}}} Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:11:37.330650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:11:37.331864 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:37.333148 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:37.333148 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:37.333148 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:37.333148 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:37.333148 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 20 04:11:37.333148 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:11:37.333148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e440bab5-6826-462e-9935-63962459c8e2 tempest-FlavorsV2NegativeTest-1307745957 tempest-FlavorsV2NegativeTest-1307745957-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:37.333148 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e440bab5-6826-462e-9935-63962459c8e2 tempest-FlavorsV2NegativeTest-1307745957 tempest-FlavorsV2NegativeTest-1307745957-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.288781 Jul 20 04:11:37.334093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa97fefb-5bb0-4be4-81c5-e84c38d81d7f tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.334093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa97fefb-5bb0-4be4-81c5-e84c38d81d7f tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.334516 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 308/690] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:37 2022] POST /compute/v2.1/servers => generated 93 bytes in 294 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:11:37.334700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa97fefb-5bb0-4be4-81c5-e84c38d81d7f tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.334700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa97fefb-5bb0-4be4-81c5-e84c38d81d7f tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.340937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c898c613-63cb-4ae6-81bc-8bd999748b10 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:37.345357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c898c613-63cb-4ae6-81bc-8bd999748b10 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:37.346210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c898c613-63cb-4ae6-81bc-8bd999748b10 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Searching by: {'deleted': False, 'project_id': '22bcfd2698d047dea07c643970c749eb'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:11:37.366857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c898c613-63cb-4ae6-81bc-8bd999748b10 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.367321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c898c613-63cb-4ae6-81bc-8bd999748b10 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.368116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c898c613-63cb-4ae6-81bc-8bd999748b10 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.368592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c898c613-63cb-4ae6-81bc-8bd999748b10 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.480186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-c898c613-63cb-4ae6-81bc-8bd999748b10 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:11:37.516627 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-aa97fefb-5bb0-4be4-81c5-e84c38d81d7f tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f120f1774f7e409798e0894b71db9e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b553064d6374435a814f572cdbaedc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:37.525782 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-aa97fefb-5bb0-4be4-81c5-e84c38d81d7f tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 200 len: 1370 microversion: 2.1 time: 0.206750 Jul 20 04:11:37.526953 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 383/691] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:37 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:37.532585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bb65f0a6-c2ea-4403-bd29-28e965535655 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:37.533241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bb65f0a6-c2ea-4403-bd29-28e965535655 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:37.540050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bb65f0a6-c2ea-4403-bd29-28e965535655 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.540654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bb65f0a6-c2ea-4403-bd29-28e965535655 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.541497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bb65f0a6-c2ea-4403-bd29-28e965535655 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.541974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bb65f0a6-c2ea-4403-bd29-28e965535655 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.637116 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c898c613-63cb-4ae6-81bc-8bd999748b10 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.302602 Jul 20 04:11:37.638334 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 309/692] 10.222.0.17 () {58 vars in 1124 bytes} [Wed Jul 20 04:11:37 2022] GET /compute/v2.1/servers => generated 1003 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:37.650187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1ca7b79a-ab11-45fb-8b73-363347c5cd2e tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Action: 'create', calling method: .version_select at 0x7f06be6e0ca0>, body: {"security_group_rule": {"parent_group_id": "95df0cb3-6ed4-4308-ad2f-eba0094ae83a", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:37.757120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bb65f0a6-c2ea-4403-bd29-28e965535655 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:37.768249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bb65f0a6-c2ea-4403-bd29-28e965535655 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:37.771057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bb65f0a6-c2ea-4403-bd29-28e965535655 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:37.773461 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bb65f0a6-c2ea-4403-bd29-28e965535655 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 0.245274 Jul 20 04:11:37.785266 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 384/693] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:37 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:37.792498 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-575cc4c6-389d-43a2-b474-c784fa4f26c1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:37.794012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-575cc4c6-389d-43a2-b474-c784fa4f26c1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:37.802800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-575cc4c6-389d-43a2-b474-c784fa4f26c1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.803592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-575cc4c6-389d-43a2-b474-c784fa4f26c1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.804618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-575cc4c6-389d-43a2-b474-c784fa4f26c1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.805347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-575cc4c6-389d-43a2-b474-c784fa4f26c1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.889059 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-575cc4c6-389d-43a2-b474-c784fa4f26c1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "POST /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247/action" status: 204 len: 0 microversion: 2.1 time: 0.101799 Jul 20 04:11:37.895529 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 385/694] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:11:37 2022] POST /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247/action => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:37.913309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6c70e8dd-16b9-4f30-9088-d97d74fe530a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:37.915623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6c70e8dd-16b9-4f30-9088-d97d74fe530a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:37.921641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=86,nova_cell0:UPDATE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:37.928531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c70e8dd-16b9-4f30-9088-d97d74fe530a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.929018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c70e8dd-16b9-4f30-9088-d97d74fe530a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.931880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c70e8dd-16b9-4f30-9088-d97d74fe530a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.932368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c70e8dd-16b9-4f30-9088-d97d74fe530a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:38.077927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6c70e8dd-16b9-4f30-9088-d97d74fe530a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:38.086892 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6c70e8dd-16b9-4f30-9088-d97d74fe530a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6" status: 200 len: 1215 microversion: 2.1 time: 0.193192 Jul 20 04:11:38.088044 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 386/695] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:37 2022] GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6 => generated 1215 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:38.095378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-27d1ec5d-b46a-451a-82d9-3d715de6ceba tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:38.096139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-27d1ec5d-b46a-451a-82d9-3d715de6ceba tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:38.115824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27d1ec5d-b46a-451a-82d9-3d715de6ceba tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:38.116279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27d1ec5d-b46a-451a-82d9-3d715de6ceba tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:38.118888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27d1ec5d-b46a-451a-82d9-3d715de6ceba tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:38.120783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27d1ec5d-b46a-451a-82d9-3d715de6ceba tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:38.148082 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1ca7b79a-ab11-45fb-8b73-363347c5cd2e tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.508336 Jul 20 04:11:38.150322 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 310/696] 10.222.0.17 () {60 vars in 1194 bytes} [Wed Jul 20 04:11:37 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:38.156016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-07e8a44b-1c15-4ebf-9d60-d079ff4bad7e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:38.156841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-07e8a44b-1c15-4ebf-9d60-d079ff4bad7e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:38.177868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07e8a44b-1c15-4ebf-9d60-d079ff4bad7e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:38.183852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07e8a44b-1c15-4ebf-9d60-d079ff4bad7e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:38.187365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07e8a44b-1c15-4ebf-9d60-d079ff4bad7e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:38.195521 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07e8a44b-1c15-4ebf-9d60-d079ff4bad7e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:38.517961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-27d1ec5d-b46a-451a-82d9-3d715de6ceba tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:38.528098 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-27d1ec5d-b46a-451a-82d9-3d715de6ceba tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1471 microversion: 2.1 time: 0.438178 Jul 20 04:11:38.529708 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 387/697] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:38 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1471 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:38.543597 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-397282d9-2338-4b3e-aedd-a1f339ab8dff tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Calling method '.version_select at 0x7f06be6b7700>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:38.661086 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-397282d9-2338-4b3e-aedd-a1f339ab8dff tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/95df0cb3-6ed4-4308-ad2f-eba0094ae83a" status: 200 len: 664 microversion: 2.1 time: 0.129201 Jul 20 04:11:38.668747 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 388/698] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 04:11:38 2022] GET /compute/v2.1/os-security-groups/95df0cb3-6ed4-4308-ad2f-eba0094ae83a => generated 664 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:38.674504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-7243d3a0-862c-4c78-9d7f-2a6463ffaa53 req-63295e7c-ec20-4187-964c-f68742bfa9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367d7c6a-04c7-4d70-9afd-bbc8d97c9247", "name": "network-vif-plugged", "status": "completed", "tag": "10cee44f-babb-4437-935e-ea2811233f2e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:38.683648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7243d3a0-862c-4c78-9d7f-2a6463ffaa53 req-63295e7c-ec20-4187-964c-f68742bfa9e6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:38.684456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7243d3a0-862c-4c78-9d7f-2a6463ffaa53 req-63295e7c-ec20-4187-964c-f68742bfa9e6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:38.698824 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-7243d3a0-862c-4c78-9d7f-2a6463ffaa53 req-63295e7c-ec20-4187-964c-f68742bfa9e6 service nova] Creating event network-vif-plugged:10cee44f-babb-4437-935e-ea2811233f2e for instance 367d7c6a-04c7-4d70-9afd-bbc8d97c9247 on n-h1-826526-5 Jul 20 04:11:38.707184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-7243d3a0-862c-4c78-9d7f-2a6463ffaa53 req-63295e7c-ec20-4187-964c-f68742bfa9e6 service nova] Instance 367d7c6a-04c7-4d70-9afd-bbc8d97c9247 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:11:38.723180 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-7243d3a0-862c-4c78-9d7f-2a6463ffaa53 req-63295e7c-ec20-4187-964c-f68742bfa9e6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052835 Jul 20 04:11:38.724283 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 389/699] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:38.731248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-55a8a875-6920-45d0-8cfb-68bd3a5997a2 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:38.732174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-55a8a875-6920-45d0-8cfb-68bd3a5997a2 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:38.740412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55a8a875-6920-45d0-8cfb-68bd3a5997a2 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:38.741158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55a8a875-6920-45d0-8cfb-68bd3a5997a2 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:38.742211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55a8a875-6920-45d0-8cfb-68bd3a5997a2 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:38.743321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55a8a875-6920-45d0-8cfb-68bd3a5997a2 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:39.031918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-55a8a875-6920-45d0-8cfb-68bd3a5997a2 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f120f1774f7e409798e0894b71db9e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b553064d6374435a814f572cdbaedc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:39.042285 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-55a8a875-6920-45d0-8cfb-68bd3a5997a2 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 200 len: 1370 microversion: 2.1 time: 0.316554 Jul 20 04:11:39.042940 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 390/700] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:38 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 1370 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:39.054047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bd8b28b0-5416-4141-af82-58a9c0cd031b tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Calling method '.version_select at 0x7f06be59cee0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:39.341730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-07e8a44b-1c15-4ebf-9d60-d079ff4bad7e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:39.355435 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-07e8a44b-1c15-4ebf-9d60-d079ff4bad7e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1503 microversion: 2.1 time: 1.203853 Jul 20 04:11:39.360367 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 311/701] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:38 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1503 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:39.365348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7bfcf516-cdb1-43ca-bc5e-e886d9cc243a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:39.365955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7bfcf516-cdb1-43ca-bc5e-e886d9cc243a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:39.369579 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bd8b28b0-5416-4141-af82-58a9c0cd031b tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-group-rules/ea814090-ab22-49ab-9484-ca3582249336" status: 202 len: 0 microversion: 2.1 time: 0.324957 Jul 20 04:11:39.397711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7bfcf516-cdb1-43ca-bc5e-e886d9cc243a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:39.399238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7bfcf516-cdb1-43ca-bc5e-e886d9cc243a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:39.406402 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 391/702] 10.222.0.17 () {58 vars in 1286 bytes} [Wed Jul 20 04:11:39 2022] DELETE /compute/v2.1/os-security-group-rules/ea814090-ab22-49ab-9484-ca3582249336 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:39.412328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7bfcf516-cdb1-43ca-bc5e-e886d9cc243a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:39.412328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7bfcf516-cdb1-43ca-bc5e-e886d9cc243a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:39.441111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-245bf05a-b976-4831-b234-109468789a28 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:39.447256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-245bf05a-b976-4831-b234-109468789a28 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:39.462444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-245bf05a-b976-4831-b234-109468789a28 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:39.463237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-245bf05a-b976-4831-b234-109468789a28 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:39.465069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-245bf05a-b976-4831-b234-109468789a28 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:39.466162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-245bf05a-b976-4831-b234-109468789a28 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:39.573094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-245bf05a-b976-4831-b234-109468789a28 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:39.581797 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-245bf05a-b976-4831-b234-109468789a28 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6" status: 200 len: 1277 microversion: 2.1 time: 0.174155 Jul 20 04:11:39.582615 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 392/703] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:39 2022] GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:39.593695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dc80a62d-5f8b-46cc-9922-9b4c25542dd7 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Calling method '.version_select at 0x7f06be5a75e0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:39.784945 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dc80a62d-5f8b-46cc-9922-9b4c25542dd7 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/95df0cb3-6ed4-4308-ad2f-eba0094ae83a" status: 202 len: 0 microversion: 2.1 time: 0.195318 Jul 20 04:11:39.785879 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 393/704] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:11:39 2022] DELETE /compute/v2.1/os-security-groups/95df0cb3-6ed4-4308-ad2f-eba0094ae83a => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:39.792650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8c8f0379-80dc-4543-a38e-c93e75a3174e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:39.793469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8c8f0379-80dc-4543-a38e-c93e75a3174e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:39.800093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c8f0379-80dc-4543-a38e-c93e75a3174e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:39.800634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c8f0379-80dc-4543-a38e-c93e75a3174e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:39.801606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c8f0379-80dc-4543-a38e-c93e75a3174e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:39.802110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c8f0379-80dc-4543-a38e-c93e75a3174e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:39.962377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8c8f0379-80dc-4543-a38e-c93e75a3174e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:39.973596 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8c8f0379-80dc-4543-a38e-c93e75a3174e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1471 microversion: 2.1 time: 0.186066 Jul 20 04:11:39.975231 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 394/705] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:39 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1471 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:39.990345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-4fd06fc2-8bc7-4a28-8419-5d3546737e19 req-3a86ddeb-3e79-4b1c-bb99-6b5ab5574305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a020af-3235-4739-bf57-bea531fa53ca", "name": "network-vif-unplugged", "status": "completed", "tag": "eedf651b-ee24-4854-9080-987fdef37537"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:40.002326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4fd06fc2-8bc7-4a28-8419-5d3546737e19 req-3a86ddeb-3e79-4b1c-bb99-6b5ab5574305 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.002956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4fd06fc2-8bc7-4a28-8419-5d3546737e19 req-3a86ddeb-3e79-4b1c-bb99-6b5ab5574305 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.018911 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-4fd06fc2-8bc7-4a28-8419-5d3546737e19 req-3a86ddeb-3e79-4b1c-bb99-6b5ab5574305 service nova] Creating event network-vif-unplugged:eedf651b-ee24-4854-9080-987fdef37537 for instance c1a020af-3235-4739-bf57-bea531fa53ca on n-h1-826526-5 Jul 20 04:11:40.024142 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-4fd06fc2-8bc7-4a28-8419-5d3546737e19 req-3a86ddeb-3e79-4b1c-bb99-6b5ab5574305 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037886 Jul 20 04:11:40.026427 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 395/706] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:40.033389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-225f98a7-177e-4bf3-97bc-37828efcfa7b tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Calling method '.version_select at 0x7f06be47d820>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.065133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG neutronclient.v2_0.client [None req-225f98a7-177e-4bf3-97bc-37828efcfa7b tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d320ce70-5b5e-49bb-a274-d18b2c2e0e31 does not exist", "detail": ""}} {{(pid=127871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:11:40.066386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.security_group_api [None req-225f98a7-177e-4bf3-97bc-37828efcfa7b tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Neutron security group d320ce70-5b5e-49bb-a274-d18b2c2e0e31 not found {{(pid=127871) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:11:40.067290 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-225f98a7-177e-4bf3-97bc-37828efcfa7b tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] HTTP exception thrown: Security group d320ce70-5b5e-49bb-a274-d18b2c2e0e31 does not exist Jul 20 04:11:40.067290 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-2777e3a6-016a-4bba-9c39-fe1c557255a8'] Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-225f98a7-177e-4bf3-97bc-37828efcfa7b tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Request method failure captured: Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/os-security-groups/d320ce70-5b5e-49bb-a274-d18b2c2e0e31 HTTP/1.1 Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14BpLIcfDahrDmAQhpki8EmL3OsWwH1pf-cppgPHCvrV6xR5FR_X0PaI_M2O7oaE1Al8NqEjYv0MLf3AUlwnL9dqmJDGTBvlAlGUTvGbOm7GBmjnx3FBgs70ebr3hnFKRfgnA-zpWs9N3ZLBkr7_E6WojzOmCw7D-7sTrUzEtD_tu84 Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: aa4f7fecd1a84013b3467d0c96ad209d Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-587703443 Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:11:40.097443 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:11:40.099058 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa4f7fecd1a84013b3467d0c96ad209d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aa4f7fecd1a84013b3467d0c96ad209d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aa4f7fecd1a84013b3467d0c96ad209d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa4f7fecd1a84013b3467d0c96ad209d"}]}] Jul 20 04:11:40.099058 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-SecurityGroupRulesTestJSON-587703443 Jul 20 04:11:40.099058 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: aa4f7fecd1a84013b3467d0c96ad209d Jul 20 04:11:40.099058 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-587703443 Jul 20 04:11:40.099058 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-SecurityGroupRulesTestJSON-587703443-project Jul 20 04:11:40.099058 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:11:40.099058 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:11:40.099058 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 8afe06bb319a4a73ac4f0dc302f11e05 Jul 20 04:11:40.099058 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-SecurityGroupRulesTestJSON-587703443-project Jul 20 04:11:40.099058 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:11:40.099058 n-d-826526-5 devstack@n-api.service[127871]: exception: Security group d320ce70-5b5e-49bb-a274-d18b2c2e0e31 does not exist Jul 20 04:11:40.099058 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-2777e3a6-016a-4bba-9c39-fe1c557255a8'] Jul 20 04:11:40.099058 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'd320ce70-5b5e-49bb-a274-d18b2c2e0e31'} Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:11:40.100118 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:11:40.101641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:11:40.101641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:11:40.101641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:11:40.101641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:11:40.101641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:11:40.101641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:11:40.101641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:11:40.101641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d320ce70-5b5e-49bb-a274-d18b2c2e0e31 does not exist Jul 20 04:11:40.101641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2777e3a6-016a-4bba-9c39-fe1c557255a8'] Jul 20 04:11:40.101641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:40.101641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:40.101641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:40.101641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:40.101641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:11:40.101641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:11:40.101641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:11:40.101641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:11:40.101641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d320ce70-5b5e-49bb-a274-d18b2c2e0e31 does not exist Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2777e3a6-016a-4bba-9c39-fe1c557255a8'] Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d320ce70-5b5e-49bb-a274-d18b2c2e0e31 does not exist Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2777e3a6-016a-4bba-9c39-fe1c557255a8'] Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:40.102999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:40.104461 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:40.104461 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:40.104461 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:40.104461 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:40.104461 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d320ce70-5b5e-49bb-a274-d18b2c2e0e31 does not exist Jul 20 04:11:40.104461 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2777e3a6-016a-4bba-9c39-fe1c557255a8'] Jul 20 04:11:40.104461 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:40.104461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-225f98a7-177e-4bf3-97bc-37828efcfa7b tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Returning 404 to user: Security group d320ce70-5b5e-49bb-a274-d18b2c2e0e31 does not exist Jul 20 04:11:40.104461 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-2777e3a6-016a-4bba-9c39-fe1c557255a8'] {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:40.104461 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-225f98a7-177e-4bf3-97bc-37828efcfa7b tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/d320ce70-5b5e-49bb-a274-d18b2c2e0e31" status: 404 len: 194 microversion: 2.1 time: 0.073705 Jul 20 04:11:40.105604 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 396/707] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:11:40 2022] DELETE /compute/v2.1/os-security-groups/d320ce70-5b5e-49bb-a274-d18b2c2e0e31 => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:40.111148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-85d200b8-531b-4d35-9002-909c187d63c0 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.111957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-85d200b8-531b-4d35-9002-909c187d63c0 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:40.122183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85d200b8-531b-4d35-9002-909c187d63c0 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.122635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85d200b8-531b-4d35-9002-909c187d63c0 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.124833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85d200b8-531b-4d35-9002-909c187d63c0 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.125520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85d200b8-531b-4d35-9002-909c187d63c0 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.288296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-85d200b8-531b-4d35-9002-909c187d63c0 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f120f1774f7e409798e0894b71db9e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b553064d6374435a814f572cdbaedc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:40.296172 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-85d200b8-531b-4d35-9002-909c187d63c0 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 200 len: 1370 microversion: 2.1 time: 0.189809 Jul 20 04:11:40.297017 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 397/708] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:40 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:40.308492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fceb50e0-3043-43c1-ac95-d1d99ad46b69 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Calling method '.version_select at 0x7f06be521820>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.321594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7bfcf516-cdb1-43ca-bc5e-e886d9cc243a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:40.331680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7bfcf516-cdb1-43ca-bc5e-e886d9cc243a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:40.333261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7bfcf516-cdb1-43ca-bc5e-e886d9cc243a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:40.334673 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7bfcf516-cdb1-43ca-bc5e-e886d9cc243a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 0.973298 Jul 20 04:11:40.348101 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 312/709] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:39 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:40.390656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1452804d-9926-4cba-b42c-04e9c8b18732 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.391635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1452804d-9926-4cba-b42c-04e9c8b18732 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:40.424820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1452804d-9926-4cba-b42c-04e9c8b18732 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.425962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1452804d-9926-4cba-b42c-04e9c8b18732 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.427245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1452804d-9926-4cba-b42c-04e9c8b18732 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.427910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1452804d-9926-4cba-b42c-04e9c8b18732 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.567619 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fceb50e0-3043-43c1-ac95-d1d99ad46b69 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/6a94857e-aa18-467e-89cd-e543451d8a10" status: 202 len: 0 microversion: 2.1 time: 0.269146 Jul 20 04:11:40.568682 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 398/710] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:11:40 2022] DELETE /compute/v2.1/os-security-groups/6a94857e-aa18-467e-89cd-e543451d8a10 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:40.578185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-553c2870-ab56-40dd-a3f4-8ef0252b12a5 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Calling method '.version_select at 0x7f06be3eea60>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.854069 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-553c2870-ab56-40dd-a3f4-8ef0252b12a5 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/3e2e1533-2bc1-4f35-b4fc-6a3c7c343b18" status: 202 len: 0 microversion: 2.1 time: 0.279874 Jul 20 04:11:40.859131 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 399/711] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:11:40 2022] DELETE /compute/v2.1/os-security-groups/3e2e1533-2bc1-4f35-b4fc-6a3c7c343b18 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:40.862680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1452804d-9926-4cba-b42c-04e9c8b18732 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:40.867418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7081a596-0648-44e0-894a-4069cfc5640a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.869661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7081a596-0648-44e0-894a-4069cfc5640a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:40.879108 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1452804d-9926-4cba-b42c-04e9c8b18732 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1503 microversion: 2.1 time: 0.508669 Jul 20 04:11:40.882150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7081a596-0648-44e0-894a-4069cfc5640a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.883006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7081a596-0648-44e0-894a-4069cfc5640a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.883330 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 313/712] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:40 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1503 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:40.884371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7081a596-0648-44e0-894a-4069cfc5640a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.885019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7081a596-0648-44e0-894a-4069cfc5640a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.888015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7e87764e-7fb8-411e-bb2d-6df1fa7a757c tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Calling method '.version_select at 0x7f06be62ea60>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:41.024708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7081a596-0648-44e0-894a-4069cfc5640a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:41.038677 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7081a596-0648-44e0-894a-4069cfc5640a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6" status: 200 len: 1277 microversion: 2.1 time: 0.177145 Jul 20 04:11:41.040547 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 400/713] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:40 2022] GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6 => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:41.054050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4c498d27-36a7-4de0-9e67-5dcc71f31fcd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:41.054857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4c498d27-36a7-4de0-9e67-5dcc71f31fcd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:41.070863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c498d27-36a7-4de0-9e67-5dcc71f31fcd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.072806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c498d27-36a7-4de0-9e67-5dcc71f31fcd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.077534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c498d27-36a7-4de0-9e67-5dcc71f31fcd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.078926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c498d27-36a7-4de0-9e67-5dcc71f31fcd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.311695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4c498d27-36a7-4de0-9e67-5dcc71f31fcd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:41.323459 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4c498d27-36a7-4de0-9e67-5dcc71f31fcd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1463 microversion: 2.1 time: 0.281605 Jul 20 04:11:41.325182 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 401/714] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:41 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1463 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:41.337423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-452af05c-ccfd-41b7-b8f5-f5bcf5ab56d4 req-b8c833c2-62a5-4b3d-b477-134eac07f3ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609e8037-70aa-40fc-bd6d-1dbbdeabc6d2", "name": "network-vif-plugged", "status": "completed", "tag": "86019a59-d8ac-45dd-825e-637199de9b86"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:41.347731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-452af05c-ccfd-41b7-b8f5-f5bcf5ab56d4 req-b8c833c2-62a5-4b3d-b477-134eac07f3ab service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.348086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-452af05c-ccfd-41b7-b8f5-f5bcf5ab56d4 req-b8c833c2-62a5-4b3d-b477-134eac07f3ab service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.383536 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-452af05c-ccfd-41b7-b8f5-f5bcf5ab56d4 req-b8c833c2-62a5-4b3d-b477-134eac07f3ab service nova] Creating event network-vif-plugged:86019a59-d8ac-45dd-825e-637199de9b86 for instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 on n-h2-826526-5 Jul 20 04:11:41.391765 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-452af05c-ccfd-41b7-b8f5-f5bcf5ab56d4 req-b8c833c2-62a5-4b3d-b477-134eac07f3ab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064691 Jul 20 04:11:41.393178 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 402/715] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:41.401739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-36fdd7fb-fd81-4498-8f9a-54825f0dcceb tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:41.403558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-36fdd7fb-fd81-4498-8f9a-54825f0dcceb tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:41.412820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36fdd7fb-fd81-4498-8f9a-54825f0dcceb tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.413557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36fdd7fb-fd81-4498-8f9a-54825f0dcceb tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.415784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36fdd7fb-fd81-4498-8f9a-54825f0dcceb tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.416454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36fdd7fb-fd81-4498-8f9a-54825f0dcceb tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.536725 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7e87764e-7fb8-411e-bb2d-6df1fa7a757c tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/6e4dcf9d-526f-4901-8805-7b0705c6001c" status: 202 len: 0 microversion: 2.1 time: 0.652253 Jul 20 04:11:41.537981 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 314/716] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:11:40 2022] DELETE /compute/v2.1/os-security-groups/6e4dcf9d-526f-4901-8805-7b0705c6001c => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:41.544959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-385679a2-6d17-48da-bb5b-bb07a4568a13 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:41.545719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-385679a2-6d17-48da-bb5b-bb07a4568a13 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:41.566086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-385679a2-6d17-48da-bb5b-bb07a4568a13 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.566666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-385679a2-6d17-48da-bb5b-bb07a4568a13 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.567601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-385679a2-6d17-48da-bb5b-bb07a4568a13 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.571554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-385679a2-6d17-48da-bb5b-bb07a4568a13 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.673122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=13 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:41.688845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-36fdd7fb-fd81-4498-8f9a-54825f0dcceb tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f120f1774f7e409798e0894b71db9e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b553064d6374435a814f572cdbaedc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:41.701857 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-36fdd7fb-fd81-4498-8f9a-54825f0dcceb tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 200 len: 1370 microversion: 2.1 time: 0.306873 Jul 20 04:11:41.706399 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 403/717] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:41 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 1370 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:41.711488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2ecac8a0-1117-4ec8-ad69-78ab6a69ed92 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:41.711968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2ecac8a0-1117-4ec8-ad69-78ab6a69ed92 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:41.731530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ecac8a0-1117-4ec8-ad69-78ab6a69ed92 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.732507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ecac8a0-1117-4ec8-ad69-78ab6a69ed92 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.733577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ecac8a0-1117-4ec8-ad69-78ab6a69ed92 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.734498 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ecac8a0-1117-4ec8-ad69-78ab6a69ed92 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.953059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2ecac8a0-1117-4ec8-ad69-78ab6a69ed92 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:41.966856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2ecac8a0-1117-4ec8-ad69-78ab6a69ed92 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:41.969046 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2ecac8a0-1117-4ec8-ad69-78ab6a69ed92 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:41.970671 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2ecac8a0-1117-4ec8-ad69-78ab6a69ed92 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 0.262909 Jul 20 04:11:41.988212 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 404/718] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:41 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:41.993749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ea04c073-e6ba-42b6-9a51-dc8c29aed3d8 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Calling method '.version_select at 0x7f06be301af0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:42.215876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-385679a2-6d17-48da-bb5b-bb07a4568a13 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:42.226682 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-385679a2-6d17-48da-bb5b-bb07a4568a13 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1463 microversion: 2.1 time: 0.687211 Jul 20 04:11:42.227546 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 315/719] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:41 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1463 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:42.233921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-10c3d886-0c7d-4675-9943-f9c481149cdf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:42.234686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-10c3d886-0c7d-4675-9943-f9c481149cdf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:42.245740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10c3d886-0c7d-4675-9943-f9c481149cdf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:42.246241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10c3d886-0c7d-4675-9943-f9c481149cdf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:42.247577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10c3d886-0c7d-4675-9943-f9c481149cdf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:42.248428 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10c3d886-0c7d-4675-9943-f9c481149cdf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:42.474803 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ea04c073-e6ba-42b6-9a51-dc8c29aed3d8 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/7a676745-c08e-4fc1-abbd-0e2f0fe17edf" status: 202 len: 0 microversion: 2.1 time: 0.485203 Jul 20 04:11:42.476382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-10c3d886-0c7d-4675-9943-f9c481149cdf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:42.479222 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 405/720] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:11:41 2022] DELETE /compute/v2.1/os-security-groups/7a676745-c08e-4fc1-abbd-0e2f0fe17edf => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:42.485195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4436e001-e218-43da-869a-c1ab167d1c7c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:42.486223 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-10c3d886-0c7d-4675-9943-f9c481149cdf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1503 microversion: 2.1 time: 0.256641 Jul 20 04:11:42.487467 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 316/721] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:42 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1503 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:42.487909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4436e001-e218-43da-869a-c1ab167d1c7c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:42.495596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4436e001-e218-43da-869a-c1ab167d1c7c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:42.496223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4436e001-e218-43da-869a-c1ab167d1c7c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:42.497303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4436e001-e218-43da-869a-c1ab167d1c7c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:42.498067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4436e001-e218-43da-869a-c1ab167d1c7c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:42.503304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-ec610a79-3e0d-4e10-9e31-d3efadf12518 req-ba1b3267-ebc7-41f2-8524-223335dd8b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1a020af-3235-4739-bf57-bea531fa53ca", "tag": "eedf651b-ee24-4854-9080-987fdef37537"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:42.523567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:42.535670 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ec610a79-3e0d-4e10-9e31-d3efadf12518 req-ba1b3267-ebc7-41f2-8524-223335dd8b71 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:42.542258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ec610a79-3e0d-4e10-9e31-d3efadf12518 req-ba1b3267-ebc7-41f2-8524-223335dd8b71 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:42.565961 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-ec610a79-3e0d-4e10-9e31-d3efadf12518 req-ba1b3267-ebc7-41f2-8524-223335dd8b71 service nova] Creating event network-changed:eedf651b-ee24-4854-9080-987fdef37537 for instance c1a020af-3235-4739-bf57-bea531fa53ca on n-h1-826526-5 Jul 20 04:11:42.574990 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-ec610a79-3e0d-4e10-9e31-d3efadf12518 req-ba1b3267-ebc7-41f2-8524-223335dd8b71 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084682 Jul 20 04:11:42.575681 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 317/722] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:42.584597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2b078d09-692b-49de-944d-7c211cff793e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Action: 'create', calling method: .version_select at 0x7f06be6d7b80>, body: {"keypair": {"name": "tempest-keypair-882049605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfALKeynp8WhWg+koORaSXG7S88py+8IZ4W9OpzkCSFEIPJKdmA8j41/O1kr943Ji1DYB+3KKyTeneQ1ZEmCeGsZOyOpsEQ65+3Qh8xuSHvZK3q1/QGjm3e9dRXsF5P6w=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:42.631897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-2b078d09-692b-49de-944d-7c211cff793e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Getting quotas for project 6c73d55e6bc740d0aec2ba67f0491099. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:42.657640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-2b078d09-692b-49de-944d-7c211cff793e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Getting quotas for user b4f8b49fd45944a384836a1459e4e7e9 and project 6c73d55e6bc740d0aec2ba67f0491099. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:42.683753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:42.711500 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2b078d09-692b-49de-944d-7c211cff793e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133476 Jul 20 04:11:42.712506 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 318/723] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:11:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:42.720148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b04271c2-931f-4928-8fb7-00252dc30a75 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] Calling method '.version_select at 0x7f06be76af70>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:43.054397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4436e001-e218-43da-869a-c1ab167d1c7c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:43.063545 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4436e001-e218-43da-869a-c1ab167d1c7c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6" status: 200 len: 1319 microversion: 2.1 time: 0.582528 Jul 20 04:11:43.064552 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 406/724] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:42 2022] GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6 => generated 1319 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:43.073193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7dd829e7-9b34-447a-bbd7-387ea5e2ddb4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:43.074098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7dd829e7-9b34-447a-bbd7-387ea5e2ddb4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:43.086031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7dd829e7-9b34-447a-bbd7-387ea5e2ddb4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:43.089256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7dd829e7-9b34-447a-bbd7-387ea5e2ddb4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:43.090941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7dd829e7-9b34-447a-bbd7-387ea5e2ddb4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:43.091813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7dd829e7-9b34-447a-bbd7-387ea5e2ddb4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:43.546284 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b04271c2-931f-4928-8fb7-00252dc30a75 tempest-SecurityGroupRulesTestJSON-587703443 tempest-SecurityGroupRulesTestJSON-587703443-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/b5f88e41-a952-4199-9bac-a7aea2dbdb72" status: 202 len: 0 microversion: 2.1 time: 0.832479 Jul 20 04:11:43.546893 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 319/725] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:11:42 2022] DELETE /compute/v2.1/os-security-groups/b5f88e41-a952-4199-9bac-a7aea2dbdb72 => generated 0 bytes in 834 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:43.555254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0684b12a-ff28-4920-9fc4-c384f6e38500 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:43.555988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0684b12a-ff28-4920-9fc4-c384f6e38500 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:43.585352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0684b12a-ff28-4920-9fc4-c384f6e38500 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:43.585818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0684b12a-ff28-4920-9fc4-c384f6e38500 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:43.587392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0684b12a-ff28-4920-9fc4-c384f6e38500 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:43.588210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0684b12a-ff28-4920-9fc4-c384f6e38500 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:43.620673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:43.940314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7dd829e7-9b34-447a-bbd7-387ea5e2ddb4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f120f1774f7e409798e0894b71db9e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b553064d6374435a814f572cdbaedc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:43.957741 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7dd829e7-9b34-447a-bbd7-387ea5e2ddb4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 200 len: 1370 microversion: 2.1 time: 0.891826 Jul 20 04:11:43.958605 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 407/726] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:43 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 1370 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:43.965745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-60a583f5-6085-4615-bb27-5e9a7fe19d42 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:43.966592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-60a583f5-6085-4615-bb27-5e9a7fe19d42 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:43.973679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60a583f5-6085-4615-bb27-5e9a7fe19d42 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:43.974306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60a583f5-6085-4615-bb27-5e9a7fe19d42 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:43.975238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60a583f5-6085-4615-bb27-5e9a7fe19d42 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:43.976059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60a583f5-6085-4615-bb27-5e9a7fe19d42 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:44.377989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0684b12a-ff28-4920-9fc4-c384f6e38500 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:44.389485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0684b12a-ff28-4920-9fc4-c384f6e38500 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:44.391290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0684b12a-ff28-4920-9fc4-c384f6e38500 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:44.392949 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0684b12a-ff28-4920-9fc4-c384f6e38500 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 0.845064 Jul 20 04:11:44.403780 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 320/727] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:43 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:44.409185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8076315c-586c-44ff-9a6e-7d5deb95e8c0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:44.416685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8076315c-586c-44ff-9a6e-7d5deb95e8c0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:44.433233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8076315c-586c-44ff-9a6e-7d5deb95e8c0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:44.440559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8076315c-586c-44ff-9a6e-7d5deb95e8c0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:44.441870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8076315c-586c-44ff-9a6e-7d5deb95e8c0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:44.442554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8076315c-586c-44ff-9a6e-7d5deb95e8c0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:44.601802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-60a583f5-6085-4615-bb27-5e9a7fe19d42 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:44.627278 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-60a583f5-6085-4615-bb27-5e9a7fe19d42 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1503 microversion: 2.1 time: 0.667034 Jul 20 04:11:44.629502 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 408/728] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:43 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1503 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:44.645282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-6de2fcf4-d314-4066-b827-debf92420caf req-63a1ecc6-0e87-4164-92e9-f20a3655aaba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3572b1fb-62bb-4279-94d0-73fefdbb8b25", "tag": "884bc047-b533-4f78-aa96-3bf5f6c73757"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:44.657861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-6de2fcf4-d314-4066-b827-debf92420caf req-63a1ecc6-0e87-4164-92e9-f20a3655aaba service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:44.658657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-6de2fcf4-d314-4066-b827-debf92420caf req-63a1ecc6-0e87-4164-92e9-f20a3655aaba service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:44.672911 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-6de2fcf4-d314-4066-b827-debf92420caf req-63a1ecc6-0e87-4164-92e9-f20a3655aaba service nova] Creating event network-changed:884bc047-b533-4f78-aa96-3bf5f6c73757 for instance 3572b1fb-62bb-4279-94d0-73fefdbb8b25 on n-h1-826526-5 Jul 20 04:11:44.688636 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-6de2fcf4-d314-4066-b827-debf92420caf req-63a1ecc6-0e87-4164-92e9-f20a3655aaba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047235 Jul 20 04:11:44.689555 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 409/729] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:11:44.925083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8076315c-586c-44ff-9a6e-7d5deb95e8c0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:44.938096 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8076315c-586c-44ff-9a6e-7d5deb95e8c0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6" status: 200 len: 1319 microversion: 2.1 time: 0.532666 Jul 20 04:11:44.949321 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 321/730] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:44 2022] GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6 => generated 1319 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:44.981846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-52127af7-c2ff-492c-a238-6f87c0c255ab tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:44.982597 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-52127af7-c2ff-492c-a238-6f87c0c255ab tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:44.992603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52127af7-c2ff-492c-a238-6f87c0c255ab tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:44.993689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52127af7-c2ff-492c-a238-6f87c0c255ab tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:44.995420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52127af7-c2ff-492c-a238-6f87c0c255ab tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:44.996038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52127af7-c2ff-492c-a238-6f87c0c255ab tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.411282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2470c4e9-09d5-43ea-b1c2-6b0c50d10329 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:45.411821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2470c4e9-09d5-43ea-b1c2-6b0c50d10329 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:45.420768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2470c4e9-09d5-43ea-b1c2-6b0c50d10329 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.421445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2470c4e9-09d5-43ea-b1c2-6b0c50d10329 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.422380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2470c4e9-09d5-43ea-b1c2-6b0c50d10329 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.424194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2470c4e9-09d5-43ea-b1c2-6b0c50d10329 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.431909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-52127af7-c2ff-492c-a238-6f87c0c255ab tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f120f1774f7e409798e0894b71db9e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b553064d6374435a814f572cdbaedc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:45.441004 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-52127af7-c2ff-492c-a238-6f87c0c255ab tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 200 len: 1556 microversion: 2.1 time: 0.468583 Jul 20 04:11:45.454478 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 410/731] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:44 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 1556 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:45.462700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7a028937-d556-4d0d-98a4-3106d732e356 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:45.463429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7a028937-d556-4d0d-98a4-3106d732e356 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:45.473907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a028937-d556-4d0d-98a4-3106d732e356 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.475907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a028937-d556-4d0d-98a4-3106d732e356 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.476901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a028937-d556-4d0d-98a4-3106d732e356 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.483086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a028937-d556-4d0d-98a4-3106d732e356 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.645394 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7a028937-d556-4d0d-98a4-3106d732e356 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.186529 Jul 20 04:11:45.646106 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 411/732] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:11:45 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:11:45.656103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1f91fa93-e333-4c58-a20a-9edf8d56a831 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:45.656981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1f91fa93-e333-4c58-a20a-9edf8d56a831 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:45.666274 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f91fa93-e333-4c58-a20a-9edf8d56a831 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.666974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f91fa93-e333-4c58-a20a-9edf8d56a831 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.667936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f91fa93-e333-4c58-a20a-9edf8d56a831 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.668416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f91fa93-e333-4c58-a20a-9edf8d56a831 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.863153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2470c4e9-09d5-43ea-b1c2-6b0c50d10329 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:45.874720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2470c4e9-09d5-43ea-b1c2-6b0c50d10329 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:45.882989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2470c4e9-09d5-43ea-b1c2-6b0c50d10329 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:45.885639 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2470c4e9-09d5-43ea-b1c2-6b0c50d10329 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 0.478360 Jul 20 04:11:45.887665 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 322/733] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:45 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:11:45.958723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aa243ef4-48eb-4980-b423-9e10dec53821 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:45.960669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aa243ef4-48eb-4980-b423-9e10dec53821 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:45.973275 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa243ef4-48eb-4980-b423-9e10dec53821 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.973730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa243ef4-48eb-4980-b423-9e10dec53821 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.974520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa243ef4-48eb-4980-b423-9e10dec53821 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.980595 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa243ef4-48eb-4980-b423-9e10dec53821 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:46.366379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aa243ef4-48eb-4980-b423-9e10dec53821 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:46.375574 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aa243ef4-48eb-4980-b423-9e10dec53821 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6" status: 200 len: 1319 microversion: 2.1 time: 0.422599 Jul 20 04:11:46.385616 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 323/734] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:45 2022] GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6 => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:46.425142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1f91fa93-e333-4c58-a20a-9edf8d56a831 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:46.437006 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1f91fa93-e333-4c58-a20a-9edf8d56a831 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1503 microversion: 2.1 time: 0.789711 Jul 20 04:11:46.447421 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 412/735] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:45 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1503 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:46.658029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a541de4c-a03c-466b-8d5e-e2875a035911 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Calling method '.version_select at 0x7f06be7a0dc0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:46.660488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a541de4c-a03c-466b-8d5e-e2875a035911 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:46.660915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a541de4c-a03c-466b-8d5e-e2875a035911 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:46.671183 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a541de4c-a03c-466b-8d5e-e2875a035911 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 1949 microversion: 2.1 time: 0.016834 Jul 20 04:11:46.686426 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 324/736] 10.222.0.17 () {58 vars in 1142 bytes} [Wed Jul 20 04:11:46 2022] GET /compute/v2.1/os-migrations => generated 1949 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:46.689259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8ed88bb2-a18c-4d8c-b759-b1745a5234ea tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:46.696544 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8ed88bb2-a18c-4d8c-b759-b1745a5234ea tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011559 Jul 20 04:11:46.697370 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 413/737] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:11:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:46.707814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-51d73046-be6d-4aab-998e-3533b02bbff6 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-912139393", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:46.709391 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:46.709391 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:11:46.717012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-11310ad7-71cb-488f-8555-74ec6dc0655c req-3a813819-ebc5-4a15-83aa-c9cf6edb6f10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be0a9e17-8828-4d64-ae7f-b481018a4bc6", "tag": "9a24158e-2bd1-4825-887e-6ad9fe5b7a56"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:46.725521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-11310ad7-71cb-488f-8555-74ec6dc0655c req-3a813819-ebc5-4a15-83aa-c9cf6edb6f10 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:46.726113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-11310ad7-71cb-488f-8555-74ec6dc0655c req-3a813819-ebc5-4a15-83aa-c9cf6edb6f10 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:46.738657 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-51d73046-be6d-4aab-998e-3533b02bbff6 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.034591 Jul 20 04:11:46.739913 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-11310ad7-71cb-488f-8555-74ec6dc0655c req-3a813819-ebc5-4a15-83aa-c9cf6edb6f10 service nova] Creating event network-changed:9a24158e-2bd1-4825-887e-6ad9fe5b7a56 for instance be0a9e17-8828-4d64-ae7f-b481018a4bc6 on n-h1-826526-5 Jul 20 04:11:46.745126 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 325/738] 10.222.0.17 () {60 vars in 1145 bytes} [Wed Jul 20 04:11:46 2022] POST /compute/v2.1/flavors => generated 498 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:11:46.750235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-28832eae-e6cb-47b6-9e2a-fc352cef9151 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:46.752937 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-11310ad7-71cb-488f-8555-74ec6dc0655c req-3a813819-ebc5-4a15-83aa-c9cf6edb6f10 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039288 Jul 20 04:11:46.753971 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 414/739] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:46.763629 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-28832eae-e6cb-47b6-9e2a-fc352cef9151 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017274 Jul 20 04:11:46.773626 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 326/740] 10.222.0.17 () {58 vars in 1181 bytes} [Wed Jul 20 04:11:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:11:46.907520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6bbf7a81-b24c-4952-90b0-0cfd79c031d8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1143716490", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "cee09f8a-6cde-493f-9990-b2fae44285a6"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:46.907711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4c42a0ca-2631-47e3-bb50-202ed61e630b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:46.908545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4c42a0ca-2631-47e3-bb50-202ed61e630b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:46.916969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c42a0ca-2631-47e3-bb50-202ed61e630b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:46.917514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c42a0ca-2631-47e3-bb50-202ed61e630b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:46.918374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c42a0ca-2631-47e3-bb50-202ed61e630b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:46.918885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c42a0ca-2631-47e3-bb50-202ed61e630b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:46.974303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-6bbf7a81-b24c-4952-90b0-0cfd79c031d8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:47.069647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4c42a0ca-2631-47e3-bb50-202ed61e630b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:47.077762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4c42a0ca-2631-47e3-bb50-202ed61e630b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:47.079351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4c42a0ca-2631-47e3-bb50-202ed61e630b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:47.080560 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4c42a0ca-2631-47e3-bb50-202ed61e630b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 0.177264 Jul 20 04:11:47.081125 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 327/741] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:46 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:11:47.393023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e8d63ba7-3270-4ffe-a9b3-090e021750b5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:47.393655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e8d63ba7-3270-4ffe-a9b3-090e021750b5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:47.399897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8d63ba7-3270-4ffe-a9b3-090e021750b5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:47.400375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8d63ba7-3270-4ffe-a9b3-090e021750b5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:47.401154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8d63ba7-3270-4ffe-a9b3-090e021750b5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:47.401593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8d63ba7-3270-4ffe-a9b3-090e021750b5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:47.406891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=12 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:47.540596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e8d63ba7-3270-4ffe-a9b3-090e021750b5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:47.549270 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e8d63ba7-3270-4ffe-a9b3-090e021750b5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6" status: 200 len: 1319 microversion: 2.1 time: 0.160120 Jul 20 04:11:47.549885 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 328/742] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:47 2022] GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:47.554508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c216fcbc-5b6c-42cc-996c-4af6a868cb31 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:47.555085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c216fcbc-5b6c-42cc-996c-4af6a868cb31 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:47.562103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c216fcbc-5b6c-42cc-996c-4af6a868cb31 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:47.562544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c216fcbc-5b6c-42cc-996c-4af6a868cb31 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:47.563419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c216fcbc-5b6c-42cc-996c-4af6a868cb31 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:47.563845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c216fcbc-5b6c-42cc-996c-4af6a868cb31 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:47.716794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c216fcbc-5b6c-42cc-996c-4af6a868cb31 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:47.725245 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c216fcbc-5b6c-42cc-996c-4af6a868cb31 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1503 microversion: 2.1 time: 0.174314 Jul 20 04:11:47.725848 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 329/743] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:47 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:48.032448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-6bbf7a81-b24c-4952-90b0-0cfd79c031d8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:48.033863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-6bbf7a81-b24c-4952-90b0-0cfd79c031d8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:48.034637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-6bbf7a81-b24c-4952-90b0-0cfd79c031d8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:48.035041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-6bbf7a81-b24c-4952-90b0-0cfd79c031d8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:48.036147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-6bbf7a81-b24c-4952-90b0-0cfd79c031d8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:48.046223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6bbf7a81-b24c-4952-90b0-0cfd79c031d8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:48.046904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6bbf7a81-b24c-4952-90b0-0cfd79c031d8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:48.047995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6bbf7a81-b24c-4952-90b0-0cfd79c031d8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:48.048645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6bbf7a81-b24c-4952-90b0-0cfd79c031d8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:48.076667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-6bbf7a81-b24c-4952-90b0-0cfd79c031d8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Getting quotas for project 6c73d55e6bc740d0aec2ba67f0491099. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:48.082249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-6bbf7a81-b24c-4952-90b0-0cfd79c031d8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Getting quotas for user b4f8b49fd45944a384836a1459e4e7e9 and project 6c73d55e6bc740d0aec2ba67f0491099. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:48.094731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6bbf7a81-b24c-4952-90b0-0cfd79c031d8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:11:48.097129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6bbf7a81-b24c-4952-90b0-0cfd79c031d8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:48.099112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-185a92dd-ea6a-481b-9330-226c0b7f04f1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:48.099778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-185a92dd-ea6a-481b-9330-226c0b7f04f1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:48.107440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-185a92dd-ea6a-481b-9330-226c0b7f04f1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:48.107805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-185a92dd-ea6a-481b-9330-226c0b7f04f1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:48.108943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-185a92dd-ea6a-481b-9330-226c0b7f04f1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:48.109375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-185a92dd-ea6a-481b-9330-226c0b7f04f1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:48.144231 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6bbf7a81-b24c-4952-90b0-0cfd79c031d8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.241182 Jul 20 04:11:48.145400 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 415/744] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:11:48.165935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7c52ee92-8323-4ca1-8575-6dde6a54e58c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:48.169452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7c52ee92-8323-4ca1-8575-6dde6a54e58c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:48.295381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7c52ee92-8323-4ca1-8575-6dde6a54e58c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:48.304938 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7c52ee92-8323-4ca1-8575-6dde6a54e58c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1279 microversion: 2.1 time: 0.153892 Jul 20 04:11:48.306912 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 416/745] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:48 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1279 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:48.328387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-185a92dd-ea6a-481b-9330-226c0b7f04f1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:48.341865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-185a92dd-ea6a-481b-9330-226c0b7f04f1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:48.344830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-185a92dd-ea6a-481b-9330-226c0b7f04f1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:48.346543 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-185a92dd-ea6a-481b-9330-226c0b7f04f1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 0.251337 Jul 20 04:11:48.347485 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 330/746] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:48 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:11:48.567050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c36960e2-fdfc-4e45-9119-c799985b609c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:48.567814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c36960e2-fdfc-4e45-9119-c799985b609c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:48.585843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c36960e2-fdfc-4e45-9119-c799985b609c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:48.587743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c36960e2-fdfc-4e45-9119-c799985b609c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:48.589344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c36960e2-fdfc-4e45-9119-c799985b609c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:48.590100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c36960e2-fdfc-4e45-9119-c799985b609c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:48.743997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9e2a1c50-fa98-4fb3-b540-482127a019ab tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:48.744656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9e2a1c50-fa98-4fb3-b540-482127a019ab tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:48.762451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e2a1c50-fa98-4fb3-b540-482127a019ab tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:48.762890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e2a1c50-fa98-4fb3-b540-482127a019ab tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:48.763680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e2a1c50-fa98-4fb3-b540-482127a019ab tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:48.764113 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e2a1c50-fa98-4fb3-b540-482127a019ab tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:49.259767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c36960e2-fdfc-4e45-9119-c799985b609c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:49.276819 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c36960e2-fdfc-4e45-9119-c799985b609c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6" status: 200 len: 1319 microversion: 2.1 time: 0.714527 Jul 20 04:11:49.278013 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 417/747] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:48 2022] GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6 => generated 1319 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:49.323062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fbbdae0e-daa5-4e6b-b3b1-db61d8826eed tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:49.324557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fbbdae0e-daa5-4e6b-b3b1-db61d8826eed tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:49.344210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fbbdae0e-daa5-4e6b-b3b1-db61d8826eed tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:49.345094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fbbdae0e-daa5-4e6b-b3b1-db61d8826eed tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:49.346113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fbbdae0e-daa5-4e6b-b3b1-db61d8826eed tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:49.346760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fbbdae0e-daa5-4e6b-b3b1-db61d8826eed tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:49.678293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fbbdae0e-daa5-4e6b-b3b1-db61d8826eed tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:49.686579 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fbbdae0e-daa5-4e6b-b3b1-db61d8826eed tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1331 microversion: 2.1 time: 0.367336 Jul 20 04:11:49.700652 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 418/748] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:49 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1331 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:49.706220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7a3b047c-b732-44d1-b691-682096595b0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:49.706938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7a3b047c-b732-44d1-b691-682096595b0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:49.716482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a3b047c-b732-44d1-b691-682096595b0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:49.717175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a3b047c-b732-44d1-b691-682096595b0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:49.718059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a3b047c-b732-44d1-b691-682096595b0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:49.718591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a3b047c-b732-44d1-b691-682096595b0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:49.858352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9e2a1c50-fa98-4fb3-b540-482127a019ab tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:49.877524 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9e2a1c50-fa98-4fb3-b540-482127a019ab tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1503 microversion: 2.1 time: 1.138475 Jul 20 04:11:49.882035 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 331/749] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:48 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1503 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:49.973187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-7add8e63-f89d-4ece-ab6f-2677721e2402 req-0cbdfad5-1215-4f79-a635-8c4084df25c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609e8037-70aa-40fc-bd6d-1dbbdeabc6d2", "tag": "86019a59-d8ac-45dd-825e-637199de9b86"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:49.987903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7add8e63-f89d-4ece-ab6f-2677721e2402 req-0cbdfad5-1215-4f79-a635-8c4084df25c0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:50.001404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7add8e63-f89d-4ece-ab6f-2677721e2402 req-0cbdfad5-1215-4f79-a635-8c4084df25c0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:50.026918 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-7add8e63-f89d-4ece-ab6f-2677721e2402 req-0cbdfad5-1215-4f79-a635-8c4084df25c0 service nova] Creating event network-changed:86019a59-d8ac-45dd-825e-637199de9b86 for instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 on n-h2-826526-5 Jul 20 04:11:50.032667 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-7add8e63-f89d-4ece-ab6f-2677721e2402 req-0cbdfad5-1215-4f79-a635-8c4084df25c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064929 Jul 20 04:11:50.033543 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 332/750] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:50.295029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f6af1026-da1f-4ef4-b8cb-65947fd0461f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:50.295737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f6af1026-da1f-4ef4-b8cb-65947fd0461f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:50.312227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6af1026-da1f-4ef4-b8cb-65947fd0461f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:50.312987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6af1026-da1f-4ef4-b8cb-65947fd0461f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:50.313929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6af1026-da1f-4ef4-b8cb-65947fd0461f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:50.314523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6af1026-da1f-4ef4-b8cb-65947fd0461f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:50.367060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7a3b047c-b732-44d1-b691-682096595b0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:50.382113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7a3b047c-b732-44d1-b691-682096595b0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:50.384434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7a3b047c-b732-44d1-b691-682096595b0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:50.385948 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7a3b047c-b732-44d1-b691-682096595b0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 0.684045 Jul 20 04:11:50.388999 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 419/751] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:49 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:50.706669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-aaa9f843-e60e-4776-8513-2ed5facead37 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:50.707394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-aaa9f843-e60e-4776-8513-2ed5facead37 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:50.711020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:50.725158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aaa9f843-e60e-4776-8513-2ed5facead37 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:50.726201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aaa9f843-e60e-4776-8513-2ed5facead37 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:50.731348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aaa9f843-e60e-4776-8513-2ed5facead37 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:50.731905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aaa9f843-e60e-4776-8513-2ed5facead37 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.012364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f6af1026-da1f-4ef4-b8cb-65947fd0461f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:51.032496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-aaa9f843-e60e-4776-8513-2ed5facead37 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:51.038613 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f6af1026-da1f-4ef4-b8cb-65947fd0461f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6" status: 200 len: 1319 microversion: 2.1 time: 0.747635 Jul 20 04:11:51.043297 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-aaa9f843-e60e-4776-8513-2ed5facead37 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1337 microversion: 2.1 time: 0.340759 Jul 20 04:11:51.045563 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 333/752] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:50 2022] GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6 => generated 1319 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:51.046000 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 420/753] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:50 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1337 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:51.055199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ebbe74f2-3ae7-4a27-86c6-48e68ec11088 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:51.056837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ebbe74f2-3ae7-4a27-86c6-48e68ec11088 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:51.075110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebbe74f2-3ae7-4a27-86c6-48e68ec11088 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.075861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebbe74f2-3ae7-4a27-86c6-48e68ec11088 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.076965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebbe74f2-3ae7-4a27-86c6-48e68ec11088 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.080098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebbe74f2-3ae7-4a27-86c6-48e68ec11088 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.100833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-c238fbb2-a639-4477-88ca-acbf83d31119 req-bfee372d-b35d-41a6-bc14-3f7bd34b3b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3572b1fb-62bb-4279-94d0-73fefdbb8b25", "name": "network-vif-plugged", "status": "completed", "tag": "884bc047-b533-4f78-aa96-3bf5f6c73757"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:51.122165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c238fbb2-a639-4477-88ca-acbf83d31119 req-bfee372d-b35d-41a6-bc14-3f7bd34b3b0e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.123523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c238fbb2-a639-4477-88ca-acbf83d31119 req-bfee372d-b35d-41a6-bc14-3f7bd34b3b0e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.164559 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-c238fbb2-a639-4477-88ca-acbf83d31119 req-bfee372d-b35d-41a6-bc14-3f7bd34b3b0e service nova] Creating event network-vif-plugged:884bc047-b533-4f78-aa96-3bf5f6c73757 for instance 3572b1fb-62bb-4279-94d0-73fefdbb8b25 on n-h1-826526-5 Jul 20 04:11:51.176932 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-c238fbb2-a639-4477-88ca-acbf83d31119 req-bfee372d-b35d-41a6-bc14-3f7bd34b3b0e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079772 Jul 20 04:11:51.184994 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 334/754] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:11:51.406922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c38497a0-faab-4f3d-bb62-92beff3486e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:51.407803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c38497a0-faab-4f3d-bb62-92beff3486e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:51.428046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c38497a0-faab-4f3d-bb62-92beff3486e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.428669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c38497a0-faab-4f3d-bb62-92beff3486e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.429576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c38497a0-faab-4f3d-bb62-92beff3486e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.430269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c38497a0-faab-4f3d-bb62-92beff3486e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.736457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ebbe74f2-3ae7-4a27-86c6-48e68ec11088 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:51.745586 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ebbe74f2-3ae7-4a27-86c6-48e68ec11088 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1503 microversion: 2.1 time: 0.698257 Jul 20 04:11:51.757061 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 421/755] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:51 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1503 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:52.061615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-48c3ce64-959f-4e0c-8c47-773d7752f5db tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:52.062547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-48c3ce64-959f-4e0c-8c47-773d7752f5db tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:52.069103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48c3ce64-959f-4e0c-8c47-773d7752f5db tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:52.069768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48c3ce64-959f-4e0c-8c47-773d7752f5db tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:52.071249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48c3ce64-959f-4e0c-8c47-773d7752f5db tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:52.072015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48c3ce64-959f-4e0c-8c47-773d7752f5db tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:52.348052 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c38497a0-faab-4f3d-bb62-92beff3486e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:52.356968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c38497a0-faab-4f3d-bb62-92beff3486e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:52.358926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c38497a0-faab-4f3d-bb62-92beff3486e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:52.360514 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c38497a0-faab-4f3d-bb62-92beff3486e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 0.958549 Jul 20 04:11:52.372102 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 335/756] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:51 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:52.384559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2682d6b0-05a1-412a-acf5-0652cdd0f874 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:52.385875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2682d6b0-05a1-412a-acf5-0652cdd0f874 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:52.392571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2682d6b0-05a1-412a-acf5-0652cdd0f874 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:52.393446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2682d6b0-05a1-412a-acf5-0652cdd0f874 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:52.394827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2682d6b0-05a1-412a-acf5-0652cdd0f874 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:52.395573 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2682d6b0-05a1-412a-acf5-0652cdd0f874 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:52.474789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-48c3ce64-959f-4e0c-8c47-773d7752f5db tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:52.492844 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-48c3ce64-959f-4e0c-8c47-773d7752f5db tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1337 microversion: 2.1 time: 0.434841 Jul 20 04:11:52.498581 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 422/757] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:52 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1337 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:52.505668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-87b2b48f-6ef6-4fbb-88fc-52a84153b8a5 req-d2d13934-8581-4939-a37c-1ccbf5423e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a020af-3235-4739-bf57-bea531fa53ca", "name": "network-vif-unplugged", "status": "completed", "tag": "eedf651b-ee24-4854-9080-987fdef37537"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:52.520214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-87b2b48f-6ef6-4fbb-88fc-52a84153b8a5 req-d2d13934-8581-4939-a37c-1ccbf5423e53 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:52.521140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-87b2b48f-6ef6-4fbb-88fc-52a84153b8a5 req-d2d13934-8581-4939-a37c-1ccbf5423e53 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:52.538338 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-87b2b48f-6ef6-4fbb-88fc-52a84153b8a5 req-d2d13934-8581-4939-a37c-1ccbf5423e53 service nova] Creating event network-vif-unplugged:eedf651b-ee24-4854-9080-987fdef37537 for instance c1a020af-3235-4739-bf57-bea531fa53ca on n-h1-826526-5 Jul 20 04:11:52.543726 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-87b2b48f-6ef6-4fbb-88fc-52a84153b8a5 req-d2d13934-8581-4939-a37c-1ccbf5423e53 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042442 Jul 20 04:11:52.544603 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 423/758] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:52.669987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=67 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:52.777644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-275aa220-591c-4fc5-b100-b9dffacdf2e7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:52.778354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-275aa220-591c-4fc5-b100-b9dffacdf2e7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:52.799001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-275aa220-591c-4fc5-b100-b9dffacdf2e7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:52.799544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-275aa220-591c-4fc5-b100-b9dffacdf2e7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:52.801735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-275aa220-591c-4fc5-b100-b9dffacdf2e7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:52.802289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-275aa220-591c-4fc5-b100-b9dffacdf2e7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:52.950672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2682d6b0-05a1-412a-acf5-0652cdd0f874 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:52.959129 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2682d6b0-05a1-412a-acf5-0652cdd0f874 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6" status: 200 len: 1319 microversion: 2.1 time: 0.585430 Jul 20 04:11:52.969460 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 336/759] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:52 2022] GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6 => generated 1319 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:53.378042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a231a045-2a3d-446b-bb7d-973172e6e809 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:53.378714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a231a045-2a3d-446b-bb7d-973172e6e809 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:53.386269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a231a045-2a3d-446b-bb7d-973172e6e809 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:53.386789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a231a045-2a3d-446b-bb7d-973172e6e809 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:53.387654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a231a045-2a3d-446b-bb7d-973172e6e809 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:53.388093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a231a045-2a3d-446b-bb7d-973172e6e809 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:53.451785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-275aa220-591c-4fc5-b100-b9dffacdf2e7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:53.464959 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-275aa220-591c-4fc5-b100-b9dffacdf2e7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1503 microversion: 2.1 time: 0.693490 Jul 20 04:11:53.465543 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 424/760] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:52 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1503 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:53.511235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d4457c52-00e4-4c25-8c45-f9212abb0efe tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:53.511855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d4457c52-00e4-4c25-8c45-f9212abb0efe tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:53.526231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4457c52-00e4-4c25-8c45-f9212abb0efe tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:53.526596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4457c52-00e4-4c25-8c45-f9212abb0efe tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:53.527376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4457c52-00e4-4c25-8c45-f9212abb0efe tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:53.527804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4457c52-00e4-4c25-8c45-f9212abb0efe tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:53.680622 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a231a045-2a3d-446b-bb7d-973172e6e809 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:53.691602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a231a045-2a3d-446b-bb7d-973172e6e809 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:53.693221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a231a045-2a3d-446b-bb7d-973172e6e809 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:53.701292 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a231a045-2a3d-446b-bb7d-973172e6e809 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 0.327343 Jul 20 04:11:53.702175 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 337/761] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:53 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:11:53.976585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d4457c52-00e4-4c25-8c45-f9212abb0efe tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:53.977572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-da830ae2-68ba-40ca-856a-dd7f4076ce3d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:53.978490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-da830ae2-68ba-40ca-856a-dd7f4076ce3d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:53.987572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da830ae2-68ba-40ca-856a-dd7f4076ce3d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:53.988282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da830ae2-68ba-40ca-856a-dd7f4076ce3d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:53.989255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da830ae2-68ba-40ca-856a-dd7f4076ce3d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:53.990594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da830ae2-68ba-40ca-856a-dd7f4076ce3d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:53.993217 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d4457c52-00e4-4c25-8c45-f9212abb0efe tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1379 microversion: 2.1 time: 0.485309 Jul 20 04:11:53.995815 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 425/762] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:53 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1379 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:54.243598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-3c791b8f-d997-4684-bb87-45031c6376bb req-2f5ddcb4-2f09-4878-afba-8e28771edaff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "944a56a8-87ef-4988-9f97-106c08046fe9", "tag": "63a5fa97-49af-495f-b6c4-80e7f5925cac"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:54.273890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3c791b8f-d997-4684-bb87-45031c6376bb req-2f5ddcb4-2f09-4878-afba-8e28771edaff service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.274495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3c791b8f-d997-4684-bb87-45031c6376bb req-2f5ddcb4-2f09-4878-afba-8e28771edaff service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.291902 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-3c791b8f-d997-4684-bb87-45031c6376bb req-2f5ddcb4-2f09-4878-afba-8e28771edaff service nova] Creating event network-changed:63a5fa97-49af-495f-b6c4-80e7f5925cac for instance 944a56a8-87ef-4988-9f97-106c08046fe9 on n-h2-826526-5 Jul 20 04:11:54.303663 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-3c791b8f-d997-4684-bb87-45031c6376bb req-2f5ddcb4-2f09-4878-afba-8e28771edaff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066177 Jul 20 04:11:54.304608 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 426/763] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:54.475107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-da830ae2-68ba-40ca-856a-dd7f4076ce3d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:54.485879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fb3de07a-b159-4ff2-ae8c-8213cdf90b9d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:54.486738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fb3de07a-b159-4ff2-ae8c-8213cdf90b9d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:54.491694 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-da830ae2-68ba-40ca-856a-dd7f4076ce3d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6" status: 200 len: 1319 microversion: 2.1 time: 0.519361 Jul 20 04:11:54.492765 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 338/764] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:53 2022] GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6 => generated 1319 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:54.515379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb3de07a-b159-4ff2-ae8c-8213cdf90b9d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.516047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb3de07a-b159-4ff2-ae8c-8213cdf90b9d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.518586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb3de07a-b159-4ff2-ae8c-8213cdf90b9d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.525704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb3de07a-b159-4ff2-ae8c-8213cdf90b9d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.739904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-913bec3b-ae09-428a-9d86-8eb945485766 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:54.743630 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-913bec3b-ae09-428a-9d86-8eb945485766 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:54.766731 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-913bec3b-ae09-428a-9d86-8eb945485766 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.768035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-913bec3b-ae09-428a-9d86-8eb945485766 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.771932 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-913bec3b-ae09-428a-9d86-8eb945485766 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.772586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-913bec3b-ae09-428a-9d86-8eb945485766 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.823825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fb3de07a-b159-4ff2-ae8c-8213cdf90b9d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:54.854752 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fb3de07a-b159-4ff2-ae8c-8213cdf90b9d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1493 microversion: 2.1 time: 0.374665 Jul 20 04:11:54.856023 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 427/765] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:54 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1493 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:54.874129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-066eadb3-f20b-4686-97d5-b095b7cd8361 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '.version_select at 0x7f06be337af0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:54.879510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-066eadb3-f20b-4686-97d5-b095b7cd8361 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.882337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-066eadb3-f20b-4686-97d5-b095b7cd8361 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.912935 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-066eadb3-f20b-4686-97d5-b095b7cd8361 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 1949 microversion: 2.1 time: 0.042469 Jul 20 04:11:54.913741 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 428/766] 10.222.0.17 () {58 vars in 1142 bytes} [Wed Jul 20 04:11:54 2022] GET /compute/v2.1/os-migrations => generated 1949 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:54.924911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e3d8ef54-5794-4bb2-8fb9-2e0c579717d8 req-415d5a7d-6415-4e75-b71b-053e33ce2ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be0a9e17-8828-4d64-ae7f-b481018a4bc6", "name": "network-vif-plugged", "status": "completed", "tag": "9a24158e-2bd1-4825-887e-6ad9fe5b7a56"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:54.940738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e3d8ef54-5794-4bb2-8fb9-2e0c579717d8 req-415d5a7d-6415-4e75-b71b-053e33ce2ce4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.941589 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e3d8ef54-5794-4bb2-8fb9-2e0c579717d8 req-415d5a7d-6415-4e75-b71b-053e33ce2ce4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.963138 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e3d8ef54-5794-4bb2-8fb9-2e0c579717d8 req-415d5a7d-6415-4e75-b71b-053e33ce2ce4 service nova] Creating event network-vif-plugged:9a24158e-2bd1-4825-887e-6ad9fe5b7a56 for instance be0a9e17-8828-4d64-ae7f-b481018a4bc6 on n-h1-826526-5 Jul 20 04:11:54.975273 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e3d8ef54-5794-4bb2-8fb9-2e0c579717d8 req-415d5a7d-6415-4e75-b71b-053e33ce2ce4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059541 Jul 20 04:11:54.976804 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 429/767] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:55.011863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d2315bd-4ee1-4e78-b07e-a0c91c4588ec tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:55.013628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4d2315bd-4ee1-4e78-b07e-a0c91c4588ec tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:55.023045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d2315bd-4ee1-4e78-b07e-a0c91c4588ec tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.023856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d2315bd-4ee1-4e78-b07e-a0c91c4588ec tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.026064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d2315bd-4ee1-4e78-b07e-a0c91c4588ec tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.026988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d2315bd-4ee1-4e78-b07e-a0c91c4588ec tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.070446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:55.310871 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4d2315bd-4ee1-4e78-b07e-a0c91c4588ec tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1644 microversion: 2.1 time: 0.331892 Jul 20 04:11:55.332302 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 430/768] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:54 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1644 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:55.340734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a40b90c5-6291-48f9-bcd4-a9326bdd0192 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:55.341671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a40b90c5-6291-48f9-bcd4-a9326bdd0192 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:55.358666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a40b90c5-6291-48f9-bcd4-a9326bdd0192 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.359121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a40b90c5-6291-48f9-bcd4-a9326bdd0192 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.363763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a40b90c5-6291-48f9-bcd4-a9326bdd0192 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.364587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a40b90c5-6291-48f9-bcd4-a9326bdd0192 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.637601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a40b90c5-6291-48f9-bcd4-a9326bdd0192 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:55.647628 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a40b90c5-6291-48f9-bcd4-a9326bdd0192 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1379 microversion: 2.1 time: 0.323749 Jul 20 04:11:55.657653 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 431/769] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:55 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1379 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:55.674056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c034eda6-17c7-4a9d-a090-258cad1eb6f2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:55.675346 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c034eda6-17c7-4a9d-a090-258cad1eb6f2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:55.682916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c034eda6-17c7-4a9d-a090-258cad1eb6f2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.684413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c034eda6-17c7-4a9d-a090-258cad1eb6f2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.685639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c034eda6-17c7-4a9d-a090-258cad1eb6f2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.686306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c034eda6-17c7-4a9d-a090-258cad1eb6f2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.859374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-913bec3b-ae09-428a-9d86-8eb945485766 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:55.867788 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-913bec3b-ae09-428a-9d86-8eb945485766 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:55.869258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-913bec3b-ae09-428a-9d86-8eb945485766 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:55.870437 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-913bec3b-ae09-428a-9d86-8eb945485766 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 1.155305 Jul 20 04:11:55.871005 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 339/770] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:54 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:55.888739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8c4186f0-095f-49fb-933b-bbaf7fe5d6ff tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1547222594", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "d596c209-8ad5-47de-87f3-e30c0a431c35"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:55.916936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c034eda6-17c7-4a9d-a090-258cad1eb6f2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:55.927981 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c034eda6-17c7-4a9d-a090-258cad1eb6f2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6" status: 200 len: 1319 microversion: 2.1 time: 0.267441 Jul 20 04:11:55.928925 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 432/771] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:55 2022] GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:55.950939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-8c4186f0-095f-49fb-933b-bbaf7fe5d6ff tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] validate_networks() for [('d596c209-8ad5-47de-87f3-e30c0a431c35', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:56.107917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a1521037-19cd-4ae3-8b81-600e7a50c59c tempest-FloatingIPsNegativeTestJSON-1023633408 tempest-FloatingIPsNegativeTestJSON-1023633408-project] Calling method '.version_select at 0x7f06be3371f0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:56.205528 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a1521037-19cd-4ae3-8b81-600e7a50c59c tempest-FloatingIPsNegativeTestJSON-1023633408 tempest-FloatingIPsNegativeTestJSON-1023633408-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.275479 Jul 20 04:11:56.206459 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 433/772] 10.222.0.17 () {58 vars in 1148 bytes} [Wed Jul 20 04:11:55 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:11:56.218060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6ab5d812-ee43-4386-b61f-646332c013b8 tempest-FloatingIPsNegativeTestJSON-1023633408 tempest-FloatingIPsNegativeTestJSON-1023633408-project] Action: 'create', calling method: .version_select at 0x7f06be3379d0>, body: {"pool": "non_exist_pool"} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:56.271672 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-6ab5d812-ee43-4386-b61f-646332c013b8 tempest-FloatingIPsNegativeTestJSON-1023633408 tempest-FloatingIPsNegativeTestJSON-1023633408-project] HTTP exception thrown: Floating IP pool not found. Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6ab5d812-ee43-4386-b61f-646332c013b8 tempest-FloatingIPsNegativeTestJSON-1023633408 tempest-FloatingIPsNegativeTestJSON-1023633408-project] Request method failure captured: Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 26 Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14CLQ3BMdowo65l9UcJRqEXzpVAXgJFudS-d31DmoKJuEvaV-VOiiOpXuk7L92Jn0F97TSViakdR_ofhXKkpRM3N6-VLX7cc-EAgjW7WU0Mr6SvwZhnkufc0zV97dIxpZW5qaw40bwjkdqcW5jPXgrEzuwEEQbqV9-UM3n3mW_mVMWw Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 99779014a2ed4cdaaac51501f71a36af Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1023633408 Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:11:56.313487 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:11:56.315122 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99779014a2ed4cdaaac51501f71a36af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99779014a2ed4cdaaac51501f71a36af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99779014a2ed4cdaaac51501f71a36af", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99779014a2ed4cdaaac51501f71a36af"}]}] Jul 20 04:11:56.315122 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1023633408 Jul 20 04:11:56.315122 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 99779014a2ed4cdaaac51501f71a36af Jul 20 04:11:56.315122 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1023633408 Jul 20 04:11:56.315122 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-FloatingIPsNegativeTestJSON-1023633408-project Jul 20 04:11:56.315122 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:11:56.315122 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:11:56.315122 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 6fe3924efee840809aaa5a690ea85d56 Jul 20 04:11:56.315122 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1023633408-project Jul 20 04:11:56.315122 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:11:56.315122 n-d-826526-5 devstack@n-api.service[127871]: {"pool": "non_exist_pool"} Jul 20 04:11:56.315122 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:11:56.315122 n-d-826526-5 devstack@n-api.service[127871]: exception: Floating IP pool not found. Jul 20 04:11:56.315122 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 20 04:11:56.315122 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:56.316190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:56.317759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 20 04:11:56.317759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:56.317759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 20 04:11:56.317759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:56.317759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:56.317759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:56.317759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:56.317759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:56.317759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:56.317759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:56.317759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:56.317759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 20 04:11:56.317759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:56.317759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6ab5d812-ee43-4386-b61f-646332c013b8 tempest-FloatingIPsNegativeTestJSON-1023633408 tempest-FloatingIPsNegativeTestJSON-1023633408-project] Returning 404 to user: Floating IP pool not found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:56.318840 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6ab5d812-ee43-4386-b61f-646332c013b8 tempest-FloatingIPsNegativeTestJSON-1023633408 tempest-FloatingIPsNegativeTestJSON-1023633408-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.104478 Jul 20 04:11:56.325895 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 434/773] 10.222.0.17 () {60 vars in 1169 bytes} [Wed Jul 20 04:11:56 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:11:56.331105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-383a71f8-1d68-4fc8-8278-1bb33962bbcc tempest-FloatingIPsNegativeTestJSON-1023633408 tempest-FloatingIPsNegativeTestJSON-1023633408-project] Calling method '.version_select at 0x7f06be3eb430>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:56.427205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG neutronclient.v2_0.client [None req-383a71f8-1d68-4fc8-8278-1bb33962bbcc tempest-FloatingIPsNegativeTestJSON-1023633408 tempest-FloatingIPsNegativeTestJSON-1023633408-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 39a5b0b1-c03d-4786-8eba-5f4b42c383c3 could not be found", "detail": ""}} {{(pid=127871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:11:56.428245 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-383a71f8-1d68-4fc8-8278-1bb33962bbcc tempest-FloatingIPsNegativeTestJSON-1023633408 tempest-FloatingIPsNegativeTestJSON-1023633408-project] HTTP exception thrown: Floating IP not found for ID 39a5b0b1-c03d-4786-8eba-5f4b42c383c3 Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-383a71f8-1d68-4fc8-8278-1bb33962bbcc tempest-FloatingIPsNegativeTestJSON-1023633408 tempest-FloatingIPsNegativeTestJSON-1023633408-project] Request method failure captured: Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/os-floating-ips/39a5b0b1-c03d-4786-8eba-5f4b42c383c3 HTTP/1.1 Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14CLQ3BMdowo65l9UcJRqEXzpVAXgJFudS-d31DmoKJuEvaV-VOiiOpXuk7L92Jn0F97TSViakdR_ofhXKkpRM3N6-VLX7cc-EAgjW7WU0Mr6SvwZhnkufc0zV97dIxpZW5qaw40bwjkdqcW5jPXgrEzuwEEQbqV9-UM3n3mW_mVMWw Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 99779014a2ed4cdaaac51501f71a36af Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1023633408 Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:11:56.430703 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:11:56.432331 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99779014a2ed4cdaaac51501f71a36af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99779014a2ed4cdaaac51501f71a36af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99779014a2ed4cdaaac51501f71a36af", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99779014a2ed4cdaaac51501f71a36af"}]}] Jul 20 04:11:56.432331 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1023633408 Jul 20 04:11:56.432331 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 99779014a2ed4cdaaac51501f71a36af Jul 20 04:11:56.432331 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1023633408 Jul 20 04:11:56.432331 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-FloatingIPsNegativeTestJSON-1023633408-project Jul 20 04:11:56.432331 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:11:56.432331 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:11:56.432331 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 6fe3924efee840809aaa5a690ea85d56 Jul 20 04:11:56.432331 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1023633408-project Jul 20 04:11:56.432331 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:11:56.432331 n-d-826526-5 devstack@n-api.service[127871]: exception: Floating IP not found for ID 39a5b0b1-c03d-4786-8eba-5f4b42c383c3 Jul 20 04:11:56.432331 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '39a5b0b1-c03d-4786-8eba-5f4b42c383c3'} Jul 20 04:11:56.432331 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:11:56.433231 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 39a5b0b1-c03d-4786-8eba-5f4b42c383c3 could not be found Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5519c608-4a39-4962-90bd-7b39fb10c74e'] Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 39a5b0b1-c03d-4786-8eba-5f4b42c383c3. Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:56.434537 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 39a5b0b1-c03d-4786-8eba-5f4b42c383c3 Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:56.435939 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:56.437413 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 39a5b0b1-c03d-4786-8eba-5f4b42c383c3 Jul 20 04:11:56.437413 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:11:56.439064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-383a71f8-1d68-4fc8-8278-1bb33962bbcc tempest-FloatingIPsNegativeTestJSON-1023633408 tempest-FloatingIPsNegativeTestJSON-1023633408-project] Returning 404 to user: Floating IP not found for ID 39a5b0b1-c03d-4786-8eba-5f4b42c383c3 {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:56.440222 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-383a71f8-1d68-4fc8-8278-1bb33962bbcc tempest-FloatingIPsNegativeTestJSON-1023633408 tempest-FloatingIPsNegativeTestJSON-1023633408-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/39a5b0b1-c03d-4786-8eba-5f4b42c383c3" status: 404 len: 111 microversion: 2.1 time: 0.113417 Jul 20 04:11:56.441005 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 435/774] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:11:56 2022] DELETE /compute/v2.1/os-floating-ips/39a5b0b1-c03d-4786-8eba-5f4b42c383c3 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:56.668860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-388a938a-826d-43e7-95ae-144d849ab9ab tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:56.670411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-388a938a-826d-43e7-95ae-144d849ab9ab tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:56.681600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-388a938a-826d-43e7-95ae-144d849ab9ab tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:56.682322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-388a938a-826d-43e7-95ae-144d849ab9ab tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:56.683253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-388a938a-826d-43e7-95ae-144d849ab9ab tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:56.683789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-388a938a-826d-43e7-95ae-144d849ab9ab tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:56.812634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8c4186f0-095f-49fb-933b-bbaf7fe5d6ff tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:56.813279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8c4186f0-095f-49fb-933b-bbaf7fe5d6ff tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:56.813934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8c4186f0-095f-49fb-933b-bbaf7fe5d6ff tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:56.815086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8c4186f0-095f-49fb-933b-bbaf7fe5d6ff tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:56.815848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8c4186f0-095f-49fb-933b-bbaf7fe5d6ff tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:56.847870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c4186f0-095f-49fb-933b-bbaf7fe5d6ff tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:56.848608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c4186f0-095f-49fb-933b-bbaf7fe5d6ff tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:56.849608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c4186f0-095f-49fb-933b-bbaf7fe5d6ff tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:56.850625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c4186f0-095f-49fb-933b-bbaf7fe5d6ff tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:56.875868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8c4186f0-095f-49fb-933b-bbaf7fe5d6ff tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Getting quotas for project 6295769a840d437c9deed641966fd143. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:56.890324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8c4186f0-095f-49fb-933b-bbaf7fe5d6ff tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Getting quotas for user 106afc4bcfc04122b9afb3cc2b17cc03 and project 6295769a840d437c9deed641966fd143. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:56.918169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8c4186f0-095f-49fb-933b-bbaf7fe5d6ff tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:11:56.920819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8c4186f0-095f-49fb-933b-bbaf7fe5d6ff tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:57.006605 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8c4186f0-095f-49fb-933b-bbaf7fe5d6ff tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.123619 Jul 20 04:11:57.012630 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 340/775] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:11:57.021038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0c46acc6-32cf-4602-bc06-d1d4e8bd4238 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:57.024485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0c46acc6-32cf-4602-bc06-d1d4e8bd4238 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:57.038045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c46acc6-32cf-4602-bc06-d1d4e8bd4238 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.038672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c46acc6-32cf-4602-bc06-d1d4e8bd4238 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.039669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c46acc6-32cf-4602-bc06-d1d4e8bd4238 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.040435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c46acc6-32cf-4602-bc06-d1d4e8bd4238 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.302466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-388a938a-826d-43e7-95ae-144d849ab9ab tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:57.312104 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-388a938a-826d-43e7-95ae-144d849ab9ab tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1379 microversion: 2.1 time: 0.650865 Jul 20 04:11:57.328614 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 436/776] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:56 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1379 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:57.341483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-35750deb-4193-445d-9a6c-59e8e7ecc178 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:57.342392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35750deb-4193-445d-9a6c-59e8e7ecc178 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:57.359740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0c46acc6-32cf-4602-bc06-d1d4e8bd4238 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:57.362289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:57.364612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35750deb-4193-445d-9a6c-59e8e7ecc178 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.367266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35750deb-4193-445d-9a6c-59e8e7ecc178 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.368366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35750deb-4193-445d-9a6c-59e8e7ecc178 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.371379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0c46acc6-32cf-4602-bc06-d1d4e8bd4238 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:57.373208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35750deb-4193-445d-9a6c-59e8e7ecc178 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.373870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0c46acc6-32cf-4602-bc06-d1d4e8bd4238 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:57.375094 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0c46acc6-32cf-4602-bc06-d1d4e8bd4238 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 0.361256 Jul 20 04:11:57.380766 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 341/777] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:57 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:57.388563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cb84b7a0-234b-4d84-8e7e-73df1a605818 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:57.389187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cb84b7a0-234b-4d84-8e7e-73df1a605818 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:57.739806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cb84b7a0-234b-4d84-8e7e-73df1a605818 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:57.750651 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cb84b7a0-234b-4d84-8e7e-73df1a605818 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1211 microversion: 2.1 time: 0.367552 Jul 20 04:11:57.753600 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 342/778] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:57 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1211 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:57.870781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-35750deb-4193-445d-9a6c-59e8e7ecc178 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:57.886268 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-35750deb-4193-445d-9a6c-59e8e7ecc178 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6" status: 200 len: 1319 microversion: 2.1 time: 0.556297 Jul 20 04:11:57.898008 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 437/779] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:57 2022] GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6 => generated 1319 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:58.343664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0c6abf64-879a-4a95-96ae-1d28f69033c6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:58.346053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0c6abf64-879a-4a95-96ae-1d28f69033c6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:58.357907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c6abf64-879a-4a95-96ae-1d28f69033c6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:58.361042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c6abf64-879a-4a95-96ae-1d28f69033c6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:58.364653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c6abf64-879a-4a95-96ae-1d28f69033c6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:58.365340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c6abf64-879a-4a95-96ae-1d28f69033c6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:58.397391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-05e2cdbc-218b-468d-9dad-c22812e403f6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:58.398682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-05e2cdbc-218b-468d-9dad-c22812e403f6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:58.409132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:58.411721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=8 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:58.416766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-05e2cdbc-218b-468d-9dad-c22812e403f6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:58.419226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-05e2cdbc-218b-468d-9dad-c22812e403f6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:58.420474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-05e2cdbc-218b-468d-9dad-c22812e403f6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:58.421078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-05e2cdbc-218b-468d-9dad-c22812e403f6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:58.645344 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0c6abf64-879a-4a95-96ae-1d28f69033c6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:58.668156 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0c6abf64-879a-4a95-96ae-1d28f69033c6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1379 microversion: 2.1 time: 0.325708 Jul 20 04:11:58.669367 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 343/780] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:58 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1379 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:58.774394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eeb3527e-c9db-426e-9555-991206300fb6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:58.775547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eeb3527e-c9db-426e-9555-991206300fb6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:58.789447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-05e2cdbc-218b-468d-9dad-c22812e403f6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:58.799874 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eeb3527e-c9db-426e-9555-991206300fb6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:58.801039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-05e2cdbc-218b-468d-9dad-c22812e403f6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:58.805518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-05e2cdbc-218b-468d-9dad-c22812e403f6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:58.809355 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-05e2cdbc-218b-468d-9dad-c22812e403f6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 0.418213 Jul 20 04:11:58.813390 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 438/781] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:11:58 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:11:58.814251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eeb3527e-c9db-426e-9555-991206300fb6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:58.832778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eeb3527e-c9db-426e-9555-991206300fb6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:58.840948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eeb3527e-c9db-426e-9555-991206300fb6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:58.910187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7820c602-c0ea-4dad-a67b-42fa42689103 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:58.911385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7820c602-c0ea-4dad-a67b-42fa42689103 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:58.925252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7820c602-c0ea-4dad-a67b-42fa42689103 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:58.926892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7820c602-c0ea-4dad-a67b-42fa42689103 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:58.928811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7820c602-c0ea-4dad-a67b-42fa42689103 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:58.930437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7820c602-c0ea-4dad-a67b-42fa42689103 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.022618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eeb3527e-c9db-426e-9555-991206300fb6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:59.037050 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eeb3527e-c9db-426e-9555-991206300fb6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1281 microversion: 2.1 time: 0.268027 Jul 20 04:11:59.037679 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 344/782] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:58 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1281 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:59.265390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-095c6cc2-3d50-49a8-a8ea-e40cb6a2e6c3 req-42939dc2-62ef-4673-a2a2-ed47b5a1deb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69", "name": "network-vif-unplugged", "status": "completed", "tag": "ab1206c5-d9dd-462c-a1bb-fc0ceafad15f"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:59.268748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7820c602-c0ea-4dad-a67b-42fa42689103 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:59.277168 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7820c602-c0ea-4dad-a67b-42fa42689103 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6" status: 200 len: 1468 microversion: 2.1 time: 0.370911 Jul 20 04:11:59.280021 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 439/783] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:58 2022] GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6 => generated 1468 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:59.297350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e9693e06-a905-4940-88ea-0bfeb5f57e33 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:59.303569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e9693e06-a905-4940-88ea-0bfeb5f57e33 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 3572b1fb-62bb-4279-94d0-73fefdbb8b25] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:59.311455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-095c6cc2-3d50-49a8-a8ea-e40cb6a2e6c3 req-42939dc2-62ef-4673-a2a2-ed47b5a1deb6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:59.311982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-095c6cc2-3d50-49a8-a8ea-e40cb6a2e6c3 req-42939dc2-62ef-4673-a2a2-ed47b5a1deb6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.327422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9693e06-a905-4940-88ea-0bfeb5f57e33 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:59.329129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9693e06-a905-4940-88ea-0bfeb5f57e33 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.330343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9693e06-a905-4940-88ea-0bfeb5f57e33 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:59.337437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9693e06-a905-4940-88ea-0bfeb5f57e33 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.366307 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-095c6cc2-3d50-49a8-a8ea-e40cb6a2e6c3 req-42939dc2-62ef-4673-a2a2-ed47b5a1deb6 service nova] Creating event network-vif-unplugged:ab1206c5-d9dd-462c-a1bb-fc0ceafad15f for instance 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 on n-h1-826526-5 Jul 20 04:11:59.382680 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-095c6cc2-3d50-49a8-a8ea-e40cb6a2e6c3 req-42939dc2-62ef-4673-a2a2-ed47b5a1deb6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120192 Jul 20 04:11:59.389547 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 345/784] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:59.687723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-82700b68-4fa2-4a73-9c75-d8274457a461 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:59.688408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-82700b68-4fa2-4a73-9c75-d8274457a461 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:59.696155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82700b68-4fa2-4a73-9c75-d8274457a461 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:59.696824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82700b68-4fa2-4a73-9c75-d8274457a461 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.698578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82700b68-4fa2-4a73-9c75-d8274457a461 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:59.699178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82700b68-4fa2-4a73-9c75-d8274457a461 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.750515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e9693e06-a905-4940-88ea-0bfeb5f57e33 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:59.764489 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e9693e06-a905-4940-88ea-0bfeb5f57e33 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/3572b1fb-62bb-4279-94d0-73fefdbb8b25" status: 200 len: 1469 microversion: 2.1 time: 0.469986 Jul 20 04:11:59.767592 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 440/785] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:59 2022] GET /compute/v2.1/servers/3572b1fb-62bb-4279-94d0-73fefdbb8b25 => generated 1469 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:59.782157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3ca821f1-62e3-41b0-8aae-d768daf09f40 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:59.795075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3ca821f1-62e3-41b0-8aae-d768daf09f40 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:59.795980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3ca821f1-62e3-41b0-8aae-d768daf09f40 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Searching by: {'reservation_id': 'r-as38v3g2', 'deleted': False, 'project_id': '22bcfd2698d047dea07c643970c749eb'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:11:59.804149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ca821f1-62e3-41b0-8aae-d768daf09f40 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:59.804902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ca821f1-62e3-41b0-8aae-d768daf09f40 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.805708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ca821f1-62e3-41b0-8aae-d768daf09f40 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:59.806136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ca821f1-62e3-41b0-8aae-d768daf09f40 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.964707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-3ca821f1-62e3-41b0-8aae-d768daf09f40 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:12:00.155836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-82700b68-4fa2-4a73-9c75-d8274457a461 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:00.176025 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-82700b68-4fa2-4a73-9c75-d8274457a461 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1379 microversion: 2.1 time: 0.492968 Jul 20 04:12:00.176775 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 346/786] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:59 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1379 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:00.181824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-36896856-2c06-4cf7-a8a2-4527ea17d643 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:00.182705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-36896856-2c06-4cf7-a8a2-4527ea17d643 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:00.207228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36896856-2c06-4cf7-a8a2-4527ea17d643 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:00.207975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36896856-2c06-4cf7-a8a2-4527ea17d643 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:00.211691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36896856-2c06-4cf7-a8a2-4527ea17d643 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:00.212180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36896856-2c06-4cf7-a8a2-4527ea17d643 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:00.444664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3ca821f1-62e3-41b0-8aae-d768daf09f40 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:00.460033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ca821f1-62e3-41b0-8aae-d768daf09f40 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:00.460563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ca821f1-62e3-41b0-8aae-d768daf09f40 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:00.547573 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-36896856-2c06-4cf7-a8a2-4527ea17d643 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:00.555850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-36896856-2c06-4cf7-a8a2-4527ea17d643 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:00.557649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-36896856-2c06-4cf7-a8a2-4527ea17d643 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:00.558852 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-36896856-2c06-4cf7-a8a2-4527ea17d643 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 0.381016 Jul 20 04:12:00.568715 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 347/787] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:00 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:00.574664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-38041d09-4408-49c6-9f15-f2374a405837 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:00.575286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-38041d09-4408-49c6-9f15-f2374a405837 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:00.586334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38041d09-4408-49c6-9f15-f2374a405837 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:00.587066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38041d09-4408-49c6-9f15-f2374a405837 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:00.588008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38041d09-4408-49c6-9f15-f2374a405837 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:00.588820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38041d09-4408-49c6-9f15-f2374a405837 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.063465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-38041d09-4408-49c6-9f15-f2374a405837 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:01.078959 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-38041d09-4408-49c6-9f15-f2374a405837 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1311 microversion: 2.1 time: 0.508710 Jul 20 04:12:01.080405 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 348/788] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:00 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1311 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:01.158002 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3ca821f1-62e3-41b0-8aae-d768daf09f40 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?reservation_id=r-as38v3g2" status: 200 len: 2930 microversion: 2.1 time: 1.379441 Jul 20 04:12:01.158908 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 441/789] 10.222.0.17 () {58 vars in 1196 bytes} [Wed Jul 20 04:11:59 2022] GET /compute/v2.1/servers/detail?reservation_id=r-as38v3g2 => generated 2930 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:01.177330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-38316b3f-3ff9-4598-971d-029892b56397 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:01.195470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6d598f37-a6fb-47ab-9d3f-21310150e3fd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:01.196140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6d598f37-a6fb-47ab-9d3f-21310150e3fd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:01.199903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.compute.server_groups [None req-38316b3f-3ff9-4598-971d-029892b56397 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Querying cell fbf41b76-8148-4f7f-88f5-d6fd988c2859(cell1) for 2 instances {{(pid=127870) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:12:01.201037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38316b3f-3ff9-4598-971d-029892b56397 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.201645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38316b3f-3ff9-4598-971d-029892b56397 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.207882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d598f37-a6fb-47ab-9d3f-21310150e3fd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.211446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d598f37-a6fb-47ab-9d3f-21310150e3fd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.216243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d598f37-a6fb-47ab-9d3f-21310150e3fd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.217358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d598f37-a6fb-47ab-9d3f-21310150e3fd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.264923 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-38316b3f-3ff9-4598-971d-029892b56397 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/88729079-fa5f-46ba-b340-24992af9bb57" status: 200 len: 266 microversion: 2.1 time: 0.091382 Jul 20 04:12:01.265783 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 349/790] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:12:01 2022] GET /compute/v2.1/os-server-groups/88729079-fa5f-46ba-b340-24992af9bb57 => generated 266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:01.275797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4bb1c71a-8b15-4cdc-b5e3-a12d381b2fc8 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:01.280318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4bb1c71a-8b15-4cdc-b5e3-a12d381b2fc8 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] [instance: 3572b1fb-62bb-4279-94d0-73fefdbb8b25] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:01.289749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4bb1c71a-8b15-4cdc-b5e3-a12d381b2fc8 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.290440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4bb1c71a-8b15-4cdc-b5e3-a12d381b2fc8 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.291402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4bb1c71a-8b15-4cdc-b5e3-a12d381b2fc8 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.292005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4bb1c71a-8b15-4cdc-b5e3-a12d381b2fc8 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.586977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6d598f37-a6fb-47ab-9d3f-21310150e3fd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:01.600814 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6d598f37-a6fb-47ab-9d3f-21310150e3fd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1379 microversion: 2.1 time: 0.406368 Jul 20 04:12:01.603956 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 442/791] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:01 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1379 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:01.634607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-178d6bc4-d847-4304-b1d7-b4ac7a053373 req-97f8676a-99de-41ee-870b-8be399a7f89b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69", "tag": "ab1206c5-d9dd-462c-a1bb-fc0ceafad15f"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:01.645037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-178d6bc4-d847-4304-b1d7-b4ac7a053373 req-97f8676a-99de-41ee-870b-8be399a7f89b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.646031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-178d6bc4-d847-4304-b1d7-b4ac7a053373 req-97f8676a-99de-41ee-870b-8be399a7f89b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.664915 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-178d6bc4-d847-4304-b1d7-b4ac7a053373 req-97f8676a-99de-41ee-870b-8be399a7f89b service nova] Creating event network-changed:ab1206c5-d9dd-462c-a1bb-fc0ceafad15f for instance 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 on n-h1-826526-5 Jul 20 04:12:01.673492 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-178d6bc4-d847-4304-b1d7-b4ac7a053373 req-97f8676a-99de-41ee-870b-8be399a7f89b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067249 Jul 20 04:12:01.674820 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 443/792] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:01.682703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-86f125c3-270b-4d7e-93bd-2af1ab0df1cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:01.684001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-86f125c3-270b-4d7e-93bd-2af1ab0df1cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:01.693362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86f125c3-270b-4d7e-93bd-2af1ab0df1cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.694366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86f125c3-270b-4d7e-93bd-2af1ab0df1cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.696876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86f125c3-270b-4d7e-93bd-2af1ab0df1cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.698525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86f125c3-270b-4d7e-93bd-2af1ab0df1cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.726308 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4bb1c71a-8b15-4cdc-b5e3-a12d381b2fc8 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/3572b1fb-62bb-4279-94d0-73fefdbb8b25" status: 200 len: 1620 microversion: 2.1 time: 0.451279 Jul 20 04:12:01.726927 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 350/793] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:01 2022] GET /compute/v2.1/servers/3572b1fb-62bb-4279-94d0-73fefdbb8b25 => generated 1620 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:01.754527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-8dc4902e-9c4a-4e48-8226-146f2ce452c0 req-4ff024ab-e901-4d73-bdff-e00fe57427b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944a56a8-87ef-4988-9f97-106c08046fe9", "name": "network-vif-plugged", "status": "completed", "tag": "63a5fa97-49af-495f-b6c4-80e7f5925cac"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:01.779928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8dc4902e-9c4a-4e48-8226-146f2ce452c0 req-4ff024ab-e901-4d73-bdff-e00fe57427b9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.781406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8dc4902e-9c4a-4e48-8226-146f2ce452c0 req-4ff024ab-e901-4d73-bdff-e00fe57427b9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.804998 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-8dc4902e-9c4a-4e48-8226-146f2ce452c0 req-4ff024ab-e901-4d73-bdff-e00fe57427b9 service nova] Creating event network-vif-plugged:63a5fa97-49af-495f-b6c4-80e7f5925cac for instance 944a56a8-87ef-4988-9f97-106c08046fe9 on n-h2-826526-5 Jul 20 04:12:01.813995 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-8dc4902e-9c4a-4e48-8226-146f2ce452c0 req-4ff024ab-e901-4d73-bdff-e00fe57427b9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074604 Jul 20 04:12:01.815437 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 351/794] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:01.824114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6951d727-39a6-41e4-b39c-ac385abcee35 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:01.826043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6951d727-39a6-41e4-b39c-ac385abcee35 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:01.838858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6951d727-39a6-41e4-b39c-ac385abcee35 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.839721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6951d727-39a6-41e4-b39c-ac385abcee35 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.841557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6951d727-39a6-41e4-b39c-ac385abcee35 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.842272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6951d727-39a6-41e4-b39c-ac385abcee35 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.038352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-86f125c3-270b-4d7e-93bd-2af1ab0df1cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:02.061144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-86f125c3-270b-4d7e-93bd-2af1ab0df1cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:02.064752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-86f125c3-270b-4d7e-93bd-2af1ab0df1cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:02.070611 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-86f125c3-270b-4d7e-93bd-2af1ab0df1cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 0.394286 Jul 20 04:12:02.072740 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 444/795] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:01 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:02.079051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ea1fbb68-94a9-4d28-9b93-6ab80672872c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:02.079888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ea1fbb68-94a9-4d28-9b93-6ab80672872c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:02.108647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea1fbb68-94a9-4d28-9b93-6ab80672872c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.109810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea1fbb68-94a9-4d28-9b93-6ab80672872c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.111202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea1fbb68-94a9-4d28-9b93-6ab80672872c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.112734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea1fbb68-94a9-4d28-9b93-6ab80672872c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.153022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ea1fbb68-94a9-4d28-9b93-6ab80672872c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:12:02.301997 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ea1fbb68-94a9-4d28-9b93-6ab80672872c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216" status: 204 len: 0 microversion: 2.1 time: 0.227342 Jul 20 04:12:02.314026 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 445/796] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:12:02 2022] DELETE /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:12:02.316861 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6951d727-39a6-41e4-b39c-ac385abcee35 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6" status: 200 len: 1619 microversion: 2.1 time: 0.498464 Jul 20 04:12:02.316861 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 352/797] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:01 2022] GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6 => generated 1619 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:02.331533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f3f0744c-b990-4f10-b20b-885a35d98c96 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:02.332244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f3f0744c-b990-4f10-b20b-885a35d98c96 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:02.338457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7117e005-ad91-4764-a808-e70780dd2721 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Action: 'create', calling method: .version_select at 0x7f06be65d5e0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-753092970", "policies": ["anti-affinity"]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:02.363702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3f0744c-b990-4f10-b20b-885a35d98c96 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.364302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3f0744c-b990-4f10-b20b-885a35d98c96 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.365016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3f0744c-b990-4f10-b20b-885a35d98c96 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.365450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3f0744c-b990-4f10-b20b-885a35d98c96 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.381563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-7117e005-ad91-4764-a808-e70780dd2721 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_groups'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:02.391262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-7117e005-ad91-4764-a808-e70780dd2721 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for user 5e178243e1ed404092e5ea0be39d5c16 and project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_groups'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:02.438979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:02.501748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-7117e005-ad91-4764-a808-e70780dd2721 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_groups'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:02.522638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-7117e005-ad91-4764-a808-e70780dd2721 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for user 5e178243e1ed404092e5ea0be39d5c16 and project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_groups'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:02.552008 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7117e005-ad91-4764-a808-e70780dd2721 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.216838 Jul 20 04:12:02.556976 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 353/798] 10.222.0.17 () {60 vars in 1173 bytes} [Wed Jul 20 04:12:02 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:02.570207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-712ccb0a-78fe-4161-9a80-eea0ddcf4e88 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-429037079", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "1067554771", "adminPass": "***", "networks": [{"uuid": "72f5452b-77fa-4c50-bcf2-19dad2a4da9c"}], "security_groups": [{"name": "tempest-securitygroup--219770565"}], "key_name": "tempest-keypair-1546201336", "user_data": "}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:02.722454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f3f0744c-b990-4f10-b20b-885a35d98c96 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:02.735062 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f3f0744c-b990-4f10-b20b-885a35d98c96 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1311 microversion: 2.1 time: 0.418835 Jul 20 04:12:02.737443 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 446/799] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:02 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1311 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:02.747768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0fa0d357-ea3b-4bb2-9d2a-7c46cc1902a7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:02.762798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0fa0d357-ea3b-4bb2-9d2a-7c46cc1902a7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:02.785647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0fa0d357-ea3b-4bb2-9d2a-7c46cc1902a7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.786087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0fa0d357-ea3b-4bb2-9d2a-7c46cc1902a7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.797619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0fa0d357-ea3b-4bb2-9d2a-7c46cc1902a7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.798925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0fa0d357-ea3b-4bb2-9d2a-7c46cc1902a7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.905380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-712ccb0a-78fe-4161-9a80-eea0ddcf4e88 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] validate_networks() for [('72f5452b-77fa-4c50-bcf2-19dad2a4da9c', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:03.177749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0fa0d357-ea3b-4bb2-9d2a-7c46cc1902a7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:03.190717 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0fa0d357-ea3b-4bb2-9d2a-7c46cc1902a7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1379 microversion: 2.1 time: 0.452167 Jul 20 04:12:03.191305 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 447/800] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:02 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1379 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:03.202598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-dce4273d-a86e-4533-b565-06e027754003 req-0411af89-c4b3-47fd-bc8c-b1b70497e150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a04f4bb0-5809-44b5-bb51-63bd97076afc", "tag": "754db640-ac88-45b2-8510-52b75fd6b650"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:03.228654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-dce4273d-a86e-4533-b565-06e027754003 req-0411af89-c4b3-47fd-bc8c-b1b70497e150 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:03.238300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-dce4273d-a86e-4533-b565-06e027754003 req-0411af89-c4b3-47fd-bc8c-b1b70497e150 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:03.243592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:03.254840 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-dce4273d-a86e-4533-b565-06e027754003 req-0411af89-c4b3-47fd-bc8c-b1b70497e150 service nova] Creating event network-changed:754db640-ac88-45b2-8510-52b75fd6b650 for instance a04f4bb0-5809-44b5-bb51-63bd97076afc on n-h1-826526-5 Jul 20 04:12:03.261838 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-dce4273d-a86e-4533-b565-06e027754003 req-0411af89-c4b3-47fd-bc8c-b1b70497e150 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067994 Jul 20 04:12:03.262738 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 448/801] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:03.268515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1058247303", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "0fbc3d46-f5df-401f-bbdf-6f1c49042fc6"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:03.344578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:03.852973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:03.853805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:03.855758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:03.857258 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:03.857919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:03.893498 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:03.894287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:03.895273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:03.895892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:03.920777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for project 22bcfd2698d047dea07c643970c749eb. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:03.927818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for user 5e178243e1ed404092e5ea0be39d5c16 and project 22bcfd2698d047dea07c643970c749eb. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:03.943861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Going to run 2 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:03.946618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:03.994807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127871) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 20 04:12:04.025570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_group_members'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:04.034180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for user 5e178243e1ed404092e5ea0be39d5c16 and project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_group_members'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:04.102836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_group_members'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:04.114553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for user 5e178243e1ed404092e5ea0be39d5c16 and project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_group_members'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:04.132103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:04.136428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:04.275266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_group_members'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:04.296232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for user 5e178243e1ed404092e5ea0be39d5c16 and project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_group_members'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:04.388678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_group_members'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:04.400553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for user 5e178243e1ed404092e5ea0be39d5c16 and project 22bcfd2698d047dea07c643970c749eb. Resources: {'server_group_members'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:04.476144 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-544d6894-ec3e-4fe2-8eac-947341f6c74a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.212025 Jul 20 04:12:04.481466 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 449/802] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:03 2022] POST /compute/v2.1/servers => generated 32 bytes in 1218 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:12:04.487354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7c5dcc7b-c8f3-4ceb-92b1-a2c2f0c7ba21 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:04.487976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7c5dcc7b-c8f3-4ceb-92b1-a2c2f0c7ba21 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:04.499847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c5dcc7b-c8f3-4ceb-92b1-a2c2f0c7ba21 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:04.503603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c5dcc7b-c8f3-4ceb-92b1-a2c2f0c7ba21 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:04.505456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c5dcc7b-c8f3-4ceb-92b1-a2c2f0c7ba21 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:04.506080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c5dcc7b-c8f3-4ceb-92b1-a2c2f0c7ba21 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:04.584311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-712ccb0a-78fe-4161-9a80-eea0ddcf4e88 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:04.584870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-712ccb0a-78fe-4161-9a80-eea0ddcf4e88 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:04.585243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-712ccb0a-78fe-4161-9a80-eea0ddcf4e88 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:04.595445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-712ccb0a-78fe-4161-9a80-eea0ddcf4e88 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:04.596043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-712ccb0a-78fe-4161-9a80-eea0ddcf4e88 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:04.646827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-712ccb0a-78fe-4161-9a80-eea0ddcf4e88 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:04.647295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-712ccb0a-78fe-4161-9a80-eea0ddcf4e88 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:04.648138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-712ccb0a-78fe-4161-9a80-eea0ddcf4e88 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:04.650761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-712ccb0a-78fe-4161-9a80-eea0ddcf4e88 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:04.714201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-712ccb0a-78fe-4161-9a80-eea0ddcf4e88 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Getting quotas for project bc39197e171c40638322c4ca85d73305. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:04.721594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-712ccb0a-78fe-4161-9a80-eea0ddcf4e88 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Getting quotas for user f4a6e471d9ee4ab1af6781800903c74b and project bc39197e171c40638322c4ca85d73305. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:04.753976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-712ccb0a-78fe-4161-9a80-eea0ddcf4e88 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:04.758362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-712ccb0a-78fe-4161-9a80-eea0ddcf4e88 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:04.841961 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-712ccb0a-78fe-4161-9a80-eea0ddcf4e88 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.283500 Jul 20 04:12:04.843244 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 354/803] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 2285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:12:04.853244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-68315df1-dfab-45e0-9cb9-a8afc1f88792 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:04.855791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-68315df1-dfab-45e0-9cb9-a8afc1f88792 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:04.868940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68315df1-dfab-45e0-9cb9-a8afc1f88792 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:04.873749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68315df1-dfab-45e0-9cb9-a8afc1f88792 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:04.874726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68315df1-dfab-45e0-9cb9-a8afc1f88792 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:04.875255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68315df1-dfab-45e0-9cb9-a8afc1f88792 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:05.279859 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7c5dcc7b-c8f3-4ceb-92b1-a2c2f0c7ba21 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:05.296006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7c5dcc7b-c8f3-4ceb-92b1-a2c2f0c7ba21 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:05.298076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7c5dcc7b-c8f3-4ceb-92b1-a2c2f0c7ba21 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:05.305102 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7c5dcc7b-c8f3-4ceb-92b1-a2c2f0c7ba21 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 0.817317 Jul 20 04:12:05.305772 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 450/804] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:04 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:05.311571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-239633dc-1f0e-4b82-be61-d97a483cbdeb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:05.312179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-239633dc-1f0e-4b82-be61-d97a483cbdeb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:05.333855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-239633dc-1f0e-4b82-be61-d97a483cbdeb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:05.334305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-239633dc-1f0e-4b82-be61-d97a483cbdeb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:05.335080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-239633dc-1f0e-4b82-be61-d97a483cbdeb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:05.346468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-239633dc-1f0e-4b82-be61-d97a483cbdeb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:05.405316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-68315df1-dfab-45e0-9cb9-a8afc1f88792 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:05.414198 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-68315df1-dfab-45e0-9cb9-a8afc1f88792 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1311 microversion: 2.1 time: 0.569658 Jul 20 04:12:05.415047 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 355/805] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:04 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1311 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:05.428924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7539c851-a68b-4e35-8d39-fdc745acd38c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:05.432435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7539c851-a68b-4e35-8d39-fdc745acd38c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:05.433292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7539c851-a68b-4e35-8d39-fdc745acd38c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Searching by: {'deleted': False, 'project_id': '22bcfd2698d047dea07c643970c749eb'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:12:05.456184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7539c851-a68b-4e35-8d39-fdc745acd38c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:05.461939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7539c851-a68b-4e35-8d39-fdc745acd38c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:05.467893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7539c851-a68b-4e35-8d39-fdc745acd38c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:05.469347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7539c851-a68b-4e35-8d39-fdc745acd38c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:05.534276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-7539c851-a68b-4e35-8d39-fdc745acd38c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Listed batch of 4 results from cell out of 998 limit. Returned 4 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:12:05.572031 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7539c851-a68b-4e35-8d39-fdc745acd38c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.155659 Jul 20 04:12:05.572820 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 356/806] 10.222.0.17 () {58 vars in 1124 bytes} [Wed Jul 20 04:12:05 2022] GET /compute/v2.1/servers => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:05.577721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5b888be8-91f6-410d-a9f8-33e646c97aab tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:05.579107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5b888be8-91f6-410d-a9f8-33e646c97aab tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:05.770254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5b888be8-91f6-410d-a9f8-33e646c97aab tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:05.779440 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5b888be8-91f6-410d-a9f8-33e646c97aab tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1264 microversion: 2.1 time: 0.205429 Jul 20 04:12:05.791691 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 357/807] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:05 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:05.807007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-48faca82-4b78-4506-8abd-32c74212f940 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:05.809490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-48faca82-4b78-4506-8abd-32c74212f940 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:05.975355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-48faca82-4b78-4506-8abd-32c74212f940 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:05.990341 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-48faca82-4b78-4506-8abd-32c74212f940 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d" status: 200 len: 1219 microversion: 2.1 time: 0.197093 Jul 20 04:12:05.995231 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 358/808] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:05 2022] GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d => generated 1219 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:06.034961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-239633dc-1f0e-4b82-be61-d97a483cbdeb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:06.053093 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-239633dc-1f0e-4b82-be61-d97a483cbdeb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1529 microversion: 2.1 time: 0.746219 Jul 20 04:12:06.064546 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 451/809] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:05 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1529 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:06.073716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7f6514e5-9b7a-4c08-b919-444eddc352cc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:06.074669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7f6514e5-9b7a-4c08-b919-444eddc352cc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:06.084569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f6514e5-9b7a-4c08-b919-444eddc352cc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:06.090060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f6514e5-9b7a-4c08-b919-444eddc352cc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:06.091112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f6514e5-9b7a-4c08-b919-444eddc352cc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:06.093285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f6514e5-9b7a-4c08-b919-444eddc352cc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:06.330297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-abd90f65-1f68-45ea-80d9-e8b2d08fe3ce tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:06.331893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-abd90f65-1f68-45ea-80d9-e8b2d08fe3ce tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:06.344352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abd90f65-1f68-45ea-80d9-e8b2d08fe3ce tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:06.345425 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abd90f65-1f68-45ea-80d9-e8b2d08fe3ce tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:06.347163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abd90f65-1f68-45ea-80d9-e8b2d08fe3ce tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:06.348494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abd90f65-1f68-45ea-80d9-e8b2d08fe3ce tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:06.583300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7f6514e5-9b7a-4c08-b919-444eddc352cc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:06.600379 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7f6514e5-9b7a-4c08-b919-444eddc352cc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1529 microversion: 2.1 time: 0.527350 Jul 20 04:12:06.601041 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 359/810] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:06 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1529 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:06.627599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-978b7ef1-b8df-4482-b764-22c9db5feec8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:06.628185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-978b7ef1-b8df-4482-b764-22c9db5feec8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:06.653517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-978b7ef1-b8df-4482-b764-22c9db5feec8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:06.654032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-978b7ef1-b8df-4482-b764-22c9db5feec8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:06.654861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-978b7ef1-b8df-4482-b764-22c9db5feec8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:06.655304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-978b7ef1-b8df-4482-b764-22c9db5feec8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:07.033809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-978b7ef1-b8df-4482-b764-22c9db5feec8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:07.047803 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-978b7ef1-b8df-4482-b764-22c9db5feec8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1311 microversion: 2.1 time: 0.437113 Jul 20 04:12:07.048436 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 360/811] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:06 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1311 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:07.060889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-ae076150-bf48-49c0-a2cf-a9dae1386846 req-a39d2ca8-e247-4603-8fc7-64f3a11e2d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69", "name": "network-vif-unplugged", "status": "completed", "tag": "ab1206c5-d9dd-462c-a1bb-fc0ceafad15f"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:07.069998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ae076150-bf48-49c0-a2cf-a9dae1386846 req-a39d2ca8-e247-4603-8fc7-64f3a11e2d95 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:07.070811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ae076150-bf48-49c0-a2cf-a9dae1386846 req-a39d2ca8-e247-4603-8fc7-64f3a11e2d95 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:07.082730 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-ae076150-bf48-49c0-a2cf-a9dae1386846 req-a39d2ca8-e247-4603-8fc7-64f3a11e2d95 service nova] Creating event network-vif-unplugged:ab1206c5-d9dd-462c-a1bb-fc0ceafad15f for instance 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 on n-h1-826526-5 Jul 20 04:12:07.088309 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-ae076150-bf48-49c0-a2cf-a9dae1386846 req-a39d2ca8-e247-4603-8fc7-64f3a11e2d95 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038675 Jul 20 04:12:07.089251 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 361/812] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:07.094674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cd80875d-60ac-4bcc-8973-703977668bea tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:07.095897 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:07.095897 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:12:07.122457 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cd80875d-60ac-4bcc-8973-703977668bea tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/cee09f8a-6cde-493f-9990-b2fae44285a6" status: 202 len: 0 microversion: 2.1 time: 0.031533 Jul 20 04:12:07.124200 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 362/813] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:12:07 2022] DELETE /compute/v2.1/flavors/cee09f8a-6cde-493f-9990-b2fae44285a6 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:07.132300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-390cb7ca-00ba-4c77-b007-176657b70d74 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:07.135175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-390cb7ca-00ba-4c77-b007-176657b70d74 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:07.141885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-390cb7ca-00ba-4c77-b007-176657b70d74 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:07.142735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-390cb7ca-00ba-4c77-b007-176657b70d74 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:07.143708 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-390cb7ca-00ba-4c77-b007-176657b70d74 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:07.144141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-390cb7ca-00ba-4c77-b007-176657b70d74 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:07.158291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-abd90f65-1f68-45ea-80d9-e8b2d08fe3ce tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:07.175698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-abd90f65-1f68-45ea-80d9-e8b2d08fe3ce tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:07.179032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-abd90f65-1f68-45ea-80d9-e8b2d08fe3ce tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:07.180822 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-abd90f65-1f68-45ea-80d9-e8b2d08fe3ce tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 0.858522 Jul 20 04:12:07.192789 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 452/814] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:06 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:07.199331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-28fe64d9-8522-414d-bc07-24f86722d1be tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:07.200297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-28fe64d9-8522-414d-bc07-24f86722d1be tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:07.207774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28fe64d9-8522-414d-bc07-24f86722d1be tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:07.208497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28fe64d9-8522-414d-bc07-24f86722d1be tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:07.209453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28fe64d9-8522-414d-bc07-24f86722d1be tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:07.210033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28fe64d9-8522-414d-bc07-24f86722d1be tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:07.259721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-390cb7ca-00ba-4c77-b007-176657b70d74 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:07.274034 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-390cb7ca-00ba-4c77-b007-176657b70d74 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1316 microversion: 2.1 time: 0.148221 Jul 20 04:12:07.276358 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 363/815] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:07 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:07.283633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e99965ba-90b4-4b9e-b1fc-bd0064cc0060 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:07.333858 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e99965ba-90b4-4b9e-b1fc-bd0064cc0060 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.055601 Jul 20 04:12:07.338169 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 364/816] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:12:07 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:07.367786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-51ce1bb5-e076-4065-b30c-024056758db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:07.369239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-51ce1bb5-e076-4065-b30c-024056758db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:07.387504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-51ce1bb5-e076-4065-b30c-024056758db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:07.396279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-51ce1bb5-e076-4065-b30c-024056758db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:07.397228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-51ce1bb5-e076-4065-b30c-024056758db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:07.397755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-51ce1bb5-e076-4065-b30c-024056758db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:07.449344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-28fe64d9-8522-414d-bc07-24f86722d1be tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:07.460943 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-28fe64d9-8522-414d-bc07-24f86722d1be tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d" status: 200 len: 1271 microversion: 2.1 time: 0.265623 Jul 20 04:12:07.461661 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 453/817] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:07 2022] GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d => generated 1271 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:07.606388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-51ce1bb5-e076-4065-b30c-024056758db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:07.622082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-51ce1bb5-e076-4065-b30c-024056758db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Old instance type tempest-test_resize_flavor_-912139393, new instance type m1.heat {{(pid=127870) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:12:07.632762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-51ce1bb5-e076-4065-b30c-024056758db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:07.636430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-51ce1bb5-e076-4065-b30c-024056758db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:07.638360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-51ce1bb5-e076-4065-b30c-024056758db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:07.639016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-51ce1bb5-e076-4065-b30c-024056758db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:07.639811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-51ce1bb5-e076-4065-b30c-024056758db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:07.874457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:07.906229 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-51ce1bb5-e076-4065-b30c-024056758db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "POST /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9/action" status: 202 len: 0 microversion: 2.1 time: 0.556113 Jul 20 04:12:07.906858 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 365/818] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:12:07 2022] POST /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:07.914953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9bcddcbd-1c0f-4a71-a3d5-f36a266ea25b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:07.915565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9bcddcbd-1c0f-4a71-a3d5-f36a266ea25b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:07.937754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9bcddcbd-1c0f-4a71-a3d5-f36a266ea25b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:07.938438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9bcddcbd-1c0f-4a71-a3d5-f36a266ea25b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:07.939280 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9bcddcbd-1c0f-4a71-a3d5-f36a266ea25b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:07.939687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9bcddcbd-1c0f-4a71-a3d5-f36a266ea25b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:08.063757 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed4cc2c2-4ba2-4c60-978d-a1ced7d72c37 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:08.064409 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ed4cc2c2-4ba2-4c60-978d-a1ced7d72c37 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:08.080232 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed4cc2c2-4ba2-4c60-978d-a1ced7d72c37 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:08.080716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed4cc2c2-4ba2-4c60-978d-a1ced7d72c37 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:08.081504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed4cc2c2-4ba2-4c60-978d-a1ced7d72c37 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:08.081945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed4cc2c2-4ba2-4c60-978d-a1ced7d72c37 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:08.514517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9bcddcbd-1c0f-4a71-a3d5-f36a266ea25b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:08.522540 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9bcddcbd-1c0f-4a71-a3d5-f36a266ea25b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1538 microversion: 2.1 time: 0.611368 Jul 20 04:12:08.527968 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 454/819] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:07 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1538 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:08.539838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-76b5e3cb-868a-46c8-944d-52962c34817f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:08.540781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-76b5e3cb-868a-46c8-944d-52962c34817f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:08.561538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76b5e3cb-868a-46c8-944d-52962c34817f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:08.563465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76b5e3cb-868a-46c8-944d-52962c34817f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:08.566558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76b5e3cb-868a-46c8-944d-52962c34817f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:08.567122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76b5e3cb-868a-46c8-944d-52962c34817f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:09.512196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ed4cc2c2-4ba2-4c60-978d-a1ced7d72c37 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:09.521268 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ed4cc2c2-4ba2-4c60-978d-a1ced7d72c37 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1311 microversion: 2.1 time: 1.461356 Jul 20 04:12:09.524602 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 366/820] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:08 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1311 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:09.543125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b192eed0-5efb-423c-92fc-9ad2058be2db tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:09.544149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b192eed0-5efb-423c-92fc-9ad2058be2db tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:09.557270 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-76b5e3cb-868a-46c8-944d-52962c34817f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:09.563321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b192eed0-5efb-423c-92fc-9ad2058be2db tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:09.564070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b192eed0-5efb-423c-92fc-9ad2058be2db tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:09.565077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b192eed0-5efb-423c-92fc-9ad2058be2db tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:09.565675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b192eed0-5efb-423c-92fc-9ad2058be2db tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:09.568297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-76b5e3cb-868a-46c8-944d-52962c34817f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:09.574063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-76b5e3cb-868a-46c8-944d-52962c34817f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:09.580129 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-76b5e3cb-868a-46c8-944d-52962c34817f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 1.048757 Jul 20 04:12:09.582193 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 455/821] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:08 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:09.592789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-437e4d6e-3881-450f-a241-f7d746b33110 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:09.600242 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-437e4d6e-3881-450f-a241-f7d746b33110 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:09.608055 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-437e4d6e-3881-450f-a241-f7d746b33110 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:09.610685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-437e4d6e-3881-450f-a241-f7d746b33110 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:09.611661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-437e4d6e-3881-450f-a241-f7d746b33110 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:09.616887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-437e4d6e-3881-450f-a241-f7d746b33110 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:09.802942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b192eed0-5efb-423c-92fc-9ad2058be2db tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:09.814633 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b192eed0-5efb-423c-92fc-9ad2058be2db tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1322 microversion: 2.1 time: 0.288690 Jul 20 04:12:09.815234 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 367/822] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:09 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:09.890056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-437e4d6e-3881-450f-a241-f7d746b33110 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:09.900828 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-437e4d6e-3881-450f-a241-f7d746b33110 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d" status: 200 len: 1277 microversion: 2.1 time: 0.317427 Jul 20 04:12:09.907583 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 456/823] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:09 2022] GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d => generated 1277 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:09.920203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-00379147-60c6-473e-a24b-361a80028691 req-ccb87d3b-6f55-4cc3-b27e-22d895c74d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c220c0a5-011c-4d57-9691-99405d5fe216", "name": "network-vif-deleted", "tag": "c0e0b530-be51-4f12-bcbc-b0f85954eebe"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:09.936817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-00379147-60c6-473e-a24b-361a80028691 req-ccb87d3b-6f55-4cc3-b27e-22d895c74d0f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:09.938435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-00379147-60c6-473e-a24b-361a80028691 req-ccb87d3b-6f55-4cc3-b27e-22d895c74d0f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:09.959993 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-00379147-60c6-473e-a24b-361a80028691 req-ccb87d3b-6f55-4cc3-b27e-22d895c74d0f service nova] Creating event network-vif-deleted:c0e0b530-be51-4f12-bcbc-b0f85954eebe for instance c220c0a5-011c-4d57-9691-99405d5fe216 on n-h1-826526-5 Jul 20 04:12:09.974370 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-00379147-60c6-473e-a24b-361a80028691 req-ccb87d3b-6f55-4cc3-b27e-22d895c74d0f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064853 Jul 20 04:12:09.978352 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 457/824] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:09.986852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5e774514-d685-4d33-ba3b-e18db0fecbc8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:09.994411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5e774514-d685-4d33-ba3b-e18db0fecbc8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:10.012500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e774514-d685-4d33-ba3b-e18db0fecbc8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:10.013874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e774514-d685-4d33-ba3b-e18db0fecbc8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:10.016107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e774514-d685-4d33-ba3b-e18db0fecbc8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:10.017941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e774514-d685-4d33-ba3b-e18db0fecbc8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:10.070894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-92eb2bd6-c4b5-41b2-92b1-a9b40df7a283 tempest-AbsoluteLimitsTestJSON-1056837929 tempest-AbsoluteLimitsTestJSON-1056837929-project] Calling method '.version_select at 0x7f06be8714c0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:10.099422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92eb2bd6-c4b5-41b2-92b1-a9b40df7a283 tempest-AbsoluteLimitsTestJSON-1056837929 tempest-AbsoluteLimitsTestJSON-1056837929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:10.108337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92eb2bd6-c4b5-41b2-92b1-a9b40df7a283 tempest-AbsoluteLimitsTestJSON-1056837929 tempest-AbsoluteLimitsTestJSON-1056837929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:10.109660 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92eb2bd6-c4b5-41b2-92b1-a9b40df7a283 tempest-AbsoluteLimitsTestJSON-1056837929 tempest-AbsoluteLimitsTestJSON-1056837929-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:10.110353 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92eb2bd6-c4b5-41b2-92b1-a9b40df7a283 tempest-AbsoluteLimitsTestJSON-1056837929 tempest-AbsoluteLimitsTestJSON-1056837929-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:10.161511 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-92eb2bd6-c4b5-41b2-92b1-a9b40df7a283 tempest-AbsoluteLimitsTestJSON-1056837929 tempest-AbsoluteLimitsTestJSON-1056837929-project] 10.222.0.17 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.344332 Jul 20 04:12:10.170593 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 368/825] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 04:12:09 2022] GET /compute/v2.1/limits => generated 511 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:10.493903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5e774514-d685-4d33-ba3b-e18db0fecbc8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:10.503920 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5e774514-d685-4d33-ba3b-e18db0fecbc8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1538 microversion: 2.1 time: 0.524145 Jul 20 04:12:10.507817 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 458/826] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:09 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1538 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:10.538633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-81a7b19e-5757-4bdb-8f2d-04b67546c1c1 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:10.539364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-81a7b19e-5757-4bdb-8f2d-04b67546c1c1 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:10.550293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81a7b19e-5757-4bdb-8f2d-04b67546c1c1 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:10.550918 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81a7b19e-5757-4bdb-8f2d-04b67546c1c1 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:10.552076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81a7b19e-5757-4bdb-8f2d-04b67546c1c1 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:10.553293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81a7b19e-5757-4bdb-8f2d-04b67546c1c1 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:10.601568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-89c25879-aa8f-4897-963b-b5d1c5ce051e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:10.602323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-89c25879-aa8f-4897-963b-b5d1c5ce051e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:10.614406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89c25879-aa8f-4897-963b-b5d1c5ce051e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:10.617603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89c25879-aa8f-4897-963b-b5d1c5ce051e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:10.619365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89c25879-aa8f-4897-963b-b5d1c5ce051e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:10.623402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89c25879-aa8f-4897-963b-b5d1c5ce051e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:11.007624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-89c25879-aa8f-4897-963b-b5d1c5ce051e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:11.020121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-89c25879-aa8f-4897-963b-b5d1c5ce051e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:11.024690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-89c25879-aa8f-4897-963b-b5d1c5ce051e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:11.026011 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-89c25879-aa8f-4897-963b-b5d1c5ce051e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 0.428382 Jul 20 04:12:11.040731 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 459/827] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:10 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:12:11.045719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5bb6975f-f758-43fc-b6ae-b2128b89ed11 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:11.046339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5bb6975f-f758-43fc-b6ae-b2128b89ed11 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:11.058683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5bb6975f-f758-43fc-b6ae-b2128b89ed11 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:11.059178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5bb6975f-f758-43fc-b6ae-b2128b89ed11 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:11.060010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5bb6975f-f758-43fc-b6ae-b2128b89ed11 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:11.068858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5bb6975f-f758-43fc-b6ae-b2128b89ed11 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:11.576827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5bb6975f-f758-43fc-b6ae-b2128b89ed11 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:11.588137 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5bb6975f-f758-43fc-b6ae-b2128b89ed11 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1389 microversion: 2.1 time: 0.546196 Jul 20 04:12:11.588771 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 460/828] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:11 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1389 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:11.599669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ea2a1bc2-e531-4fc2-9c63-b0f81e46f0b3 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:11.610534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ea2a1bc2-e531-4fc2-9c63-b0f81e46f0b3 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:11.627400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea2a1bc2-e531-4fc2-9c63-b0f81e46f0b3 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:11.627911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea2a1bc2-e531-4fc2-9c63-b0f81e46f0b3 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:11.633205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea2a1bc2-e531-4fc2-9c63-b0f81e46f0b3 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:11.633898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea2a1bc2-e531-4fc2-9c63-b0f81e46f0b3 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:11.804031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-81a7b19e-5757-4bdb-8f2d-04b67546c1c1 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:11.806416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ea2a1bc2-e531-4fc2-9c63-b0f81e46f0b3 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:11.813970 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-81a7b19e-5757-4bdb-8f2d-04b67546c1c1 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1311 microversion: 2.1 time: 1.279485 Jul 20 04:12:11.818791 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 369/829] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:10 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1311 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:11.831408 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ea2a1bc2-e531-4fc2-9c63-b0f81e46f0b3 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d" status: 200 len: 1277 microversion: 2.1 time: 0.235120 Jul 20 04:12:11.834936 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 461/830] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:11 2022] GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d => generated 1277 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:11.846685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-4419294e-ea3d-4036-ac98-b15a82d441c4 req-aa35489f-eea6-4dd1-a104-5514709a0625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a04f4bb0-5809-44b5-bb51-63bd97076afc", "name": "network-vif-plugged", "status": "completed", "tag": "754db640-ac88-45b2-8510-52b75fd6b650"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:11.855836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4419294e-ea3d-4036-ac98-b15a82d441c4 req-aa35489f-eea6-4dd1-a104-5514709a0625 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:11.856693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4419294e-ea3d-4036-ac98-b15a82d441c4 req-aa35489f-eea6-4dd1-a104-5514709a0625 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:11.868009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b2172386-ec1f-4102-ba30-e3443489351c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:11.868919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b2172386-ec1f-4102-ba30-e3443489351c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:11.878640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b2172386-ec1f-4102-ba30-e3443489351c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:11.879669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b2172386-ec1f-4102-ba30-e3443489351c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:11.881105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b2172386-ec1f-4102-ba30-e3443489351c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:11.883338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b2172386-ec1f-4102-ba30-e3443489351c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:11.885702 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-4419294e-ea3d-4036-ac98-b15a82d441c4 req-aa35489f-eea6-4dd1-a104-5514709a0625 service nova] Creating event network-vif-plugged:754db640-ac88-45b2-8510-52b75fd6b650 for instance a04f4bb0-5809-44b5-bb51-63bd97076afc on n-h1-826526-5 Jul 20 04:12:11.893371 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-4419294e-ea3d-4036-ac98-b15a82d441c4 req-aa35489f-eea6-4dd1-a104-5514709a0625 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060565 Jul 20 04:12:11.895242 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 370/831] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:12.045935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-21626b81-a25b-4c7c-9aa2-57d8f4159a8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:12.047571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-21626b81-a25b-4c7c-9aa2-57d8f4159a8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:12.060397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21626b81-a25b-4c7c-9aa2-57d8f4159a8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:12.060963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21626b81-a25b-4c7c-9aa2-57d8f4159a8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:12.062680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21626b81-a25b-4c7c-9aa2-57d8f4159a8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:12.065805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21626b81-a25b-4c7c-9aa2-57d8f4159a8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:12.719937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-21626b81-a25b-4c7c-9aa2-57d8f4159a8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:12.737367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-21626b81-a25b-4c7c-9aa2-57d8f4159a8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:12.739345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-21626b81-a25b-4c7c-9aa2-57d8f4159a8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:12.741064 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-21626b81-a25b-4c7c-9aa2-57d8f4159a8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1568 microversion: 2.25 time: 0.699473 Jul 20 04:12:12.742461 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 371/832] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:12 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1568 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:12.749715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-93f870aa-1629-4450-84a5-0a9ea701afa4 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:12.750510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-93f870aa-1629-4450-84a5-0a9ea701afa4 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:12.777374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93f870aa-1629-4450-84a5-0a9ea701afa4 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:12.778120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93f870aa-1629-4450-84a5-0a9ea701afa4 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:12.780606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93f870aa-1629-4450-84a5-0a9ea701afa4 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:12.781267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93f870aa-1629-4450-84a5-0a9ea701afa4 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:12.808027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b2172386-ec1f-4102-ba30-e3443489351c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:12.825501 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b2172386-ec1f-4102-ba30-e3443489351c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1538 microversion: 2.1 time: 0.985874 Jul 20 04:12:12.832332 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 462/833] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:11 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1538 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:12.852027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5d887b5a-8d50-48ff-af03-5358c45b87b2 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:12.852676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5d887b5a-8d50-48ff-af03-5358c45b87b2 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:12.868315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d887b5a-8d50-48ff-af03-5358c45b87b2 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:12.869033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d887b5a-8d50-48ff-af03-5358c45b87b2 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:12.870011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d887b5a-8d50-48ff-af03-5358c45b87b2 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:12.870602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d887b5a-8d50-48ff-af03-5358c45b87b2 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.291661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5d887b5a-8d50-48ff-af03-5358c45b87b2 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:13.302437 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5d887b5a-8d50-48ff-af03-5358c45b87b2 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1311 microversion: 2.1 time: 0.468963 Jul 20 04:12:13.307692 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 463/834] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:12 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1311 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:13.318390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-61087c0b-284f-4c5c-9e97-3d0b01eb87f7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:13.319028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-61087c0b-284f-4c5c-9e97-3d0b01eb87f7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:13.332285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61087c0b-284f-4c5c-9e97-3d0b01eb87f7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.335057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61087c0b-284f-4c5c-9e97-3d0b01eb87f7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.336775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61087c0b-284f-4c5c-9e97-3d0b01eb87f7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.338680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61087c0b-284f-4c5c-9e97-3d0b01eb87f7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.677822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-61087c0b-284f-4c5c-9e97-3d0b01eb87f7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:13.686390 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-61087c0b-284f-4c5c-9e97-3d0b01eb87f7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d" status: 200 len: 1319 microversion: 2.1 time: 0.376581 Jul 20 04:12:13.691733 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 464/835] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:13 2022] GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:13.816222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-93f870aa-1629-4450-84a5-0a9ea701afa4 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:13.836915 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-93f870aa-1629-4450-84a5-0a9ea701afa4 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1389 microversion: 2.1 time: 1.090702 Jul 20 04:12:13.841119 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 372/836] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:12 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1389 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:13.866796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5d433ac5-0f01-450b-9756-ae3d45631e45 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:13.867444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5d433ac5-0f01-450b-9756-ae3d45631e45 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:13.878249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5d433ac5-0f01-450b-9756-ae3d45631e45 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.878713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5d433ac5-0f01-450b-9756-ae3d45631e45 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.879638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5d433ac5-0f01-450b-9756-ae3d45631e45 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.897063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5d433ac5-0f01-450b-9756-ae3d45631e45 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.911411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:14.128863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-175b3629-04cf-4836-b701-4380af9b2501 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Action: 'create', calling method: .version_select at 0x7f06be47de50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1068175412", "description": "tempest-description-533653642"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:14.416383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=24 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:14.696381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5d433ac5-0f01-450b-9756-ae3d45631e45 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:14.709700 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5d433ac5-0f01-450b-9756-ae3d45631e45 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:14.711206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5d433ac5-0f01-450b-9756-ae3d45631e45 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:14.717325 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5d433ac5-0f01-450b-9756-ae3d45631e45 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1543 microversion: 2.25 time: 0.875077 Jul 20 04:12:14.733276 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 373/837] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:13 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1543 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:14.743303 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0456aab6-f53b-49e2-8b68-40fb0046f517 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:14.746491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0456aab6-f53b-49e2-8b68-40fb0046f517 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:14.767461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0456aab6-f53b-49e2-8b68-40fb0046f517 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:14.769429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0456aab6-f53b-49e2-8b68-40fb0046f517 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:14.773978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0456aab6-f53b-49e2-8b68-40fb0046f517 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:14.775154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0456aab6-f53b-49e2-8b68-40fb0046f517 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:14.898193 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-175b3629-04cf-4836-b701-4380af9b2501 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.205125 Jul 20 04:12:14.898805 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 465/838] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:12:13 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:14.903257 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-f7f82960-1d23-4402-a0c4-bbbfebab6430 req-9a6e3a41-e5b2-4d45-9054-09f88aa5a80b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2", "tag": "10a828a3-bd43-49e2-a38e-dfa31069d15b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:14.926736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f7f82960-1d23-4402-a0c4-bbbfebab6430 req-9a6e3a41-e5b2-4d45-9054-09f88aa5a80b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:14.928941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f7f82960-1d23-4402-a0c4-bbbfebab6430 req-9a6e3a41-e5b2-4d45-9054-09f88aa5a80b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:14.949339 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-f7f82960-1d23-4402-a0c4-bbbfebab6430 req-9a6e3a41-e5b2-4d45-9054-09f88aa5a80b service nova] Creating event network-changed:10a828a3-bd43-49e2-a38e-dfa31069d15b for instance 8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2 on n-h2-826526-5 Jul 20 04:12:14.956131 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-f7f82960-1d23-4402-a0c4-bbbfebab6430 req-9a6e3a41-e5b2-4d45-9054-09f88aa5a80b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055970 Jul 20 04:12:14.957417 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 466/839] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:14.968305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-359fda9d-19a7-49ae-b357-3c7eecaab3e5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:14.979087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-359fda9d-19a7-49ae-b357-3c7eecaab3e5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:15.001549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-359fda9d-19a7-49ae-b357-3c7eecaab3e5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.002422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-359fda9d-19a7-49ae-b357-3c7eecaab3e5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.003963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-359fda9d-19a7-49ae-b357-3c7eecaab3e5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.004447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-359fda9d-19a7-49ae-b357-3c7eecaab3e5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.433249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-359fda9d-19a7-49ae-b357-3c7eecaab3e5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:15.442463 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-359fda9d-19a7-49ae-b357-3c7eecaab3e5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1494 microversion: 2.1 time: 0.483665 Jul 20 04:12:15.443949 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 467/840] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:14 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1494 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:15.448924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-83d37a15-3d09-42d7-b264-2c17b1d0b786 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:15.449779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-83d37a15-3d09-42d7-b264-2c17b1d0b786 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:15.456579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83d37a15-3d09-42d7-b264-2c17b1d0b786 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.457339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83d37a15-3d09-42d7-b264-2c17b1d0b786 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.458348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83d37a15-3d09-42d7-b264-2c17b1d0b786 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.459090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83d37a15-3d09-42d7-b264-2c17b1d0b786 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.470422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0456aab6-f53b-49e2-8b68-40fb0046f517 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:15.482902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:15.487910 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0456aab6-f53b-49e2-8b68-40fb0046f517 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.751946 Jul 20 04:12:15.488907 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 374/841] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:14 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:15.498665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-361f7cca-a0fb-4053-8439-5b699f154839 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '.version_select at 0x7f06be98adc0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:15.516638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-361f7cca-a0fb-4053-8439-5b699f154839 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.517401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-361f7cca-a0fb-4053-8439-5b699f154839 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.544437 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-361f7cca-a0fb-4053-8439-5b699f154839 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 2542 microversion: 2.25 time: 0.053699 Jul 20 04:12:15.554275 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 375/842] 10.222.0.17 () {60 vars in 1183 bytes} [Wed Jul 20 04:12:15 2022] GET /compute/v2.1/os-migrations => generated 2542 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:15.554275 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b573161f-db97-4366-9996-9241dadf950b tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:15.555310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b573161f-db97-4366-9996-9241dadf950b tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:15.573219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b573161f-db97-4366-9996-9241dadf950b tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.576800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b573161f-db97-4366-9996-9241dadf950b tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.578226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b573161f-db97-4366-9996-9241dadf950b tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.578912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b573161f-db97-4366-9996-9241dadf950b tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.700508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-83d37a15-3d09-42d7-b264-2c17b1d0b786 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:15.709827 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-83d37a15-3d09-42d7-b264-2c17b1d0b786 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d" status: 200 len: 1319 microversion: 2.1 time: 0.264604 Jul 20 04:12:15.721496 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 468/843] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:15 2022] GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:15.726786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5d12dc13-d8ee-46d4-be46-dbd70d5b2a12 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Action: 'create', calling method: .version_select at 0x7f06be337ca0>, body: {"security_group_rule": {"parent_group_id": "0c00a613-9ca9-4136-9a56-519254617a3c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:15.857688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b573161f-db97-4366-9996-9241dadf950b tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:15.869426 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b573161f-db97-4366-9996-9241dadf950b tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1389 microversion: 2.1 time: 0.320946 Jul 20 04:12:15.879110 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 376/844] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:15 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1389 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:15.884863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-4e64f571-7a59-43cf-a6d3-f0b79f555dc2 req-4244a136-cb4c-4885-aed5-21ab4213e22d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd1e4691-aad5-45a9-818f-922c3428d53f", "tag": "e20cfa31-877a-4a68-ba01-74f0bfe7d08b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:15.896446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4e64f571-7a59-43cf-a6d3-f0b79f555dc2 req-4244a136-cb4c-4885-aed5-21ab4213e22d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.897740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4e64f571-7a59-43cf-a6d3-f0b79f555dc2 req-4244a136-cb4c-4885-aed5-21ab4213e22d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.928359 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-4e64f571-7a59-43cf-a6d3-f0b79f555dc2 req-4244a136-cb4c-4885-aed5-21ab4213e22d service nova] Creating event network-changed:e20cfa31-877a-4a68-ba01-74f0bfe7d08b for instance fd1e4691-aad5-45a9-818f-922c3428d53f on n-h2-826526-5 Jul 20 04:12:15.942084 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-4e64f571-7a59-43cf-a6d3-f0b79f555dc2 req-4244a136-cb4c-4885-aed5-21ab4213e22d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058242 Jul 20 04:12:15.943407 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 377/845] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:15.955273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-09f09f6e-32c2-48ff-a844-b37b6cb5f913 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:15.956252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-09f09f6e-32c2-48ff-a844-b37b6cb5f913 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:15.964565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09f09f6e-32c2-48ff-a844-b37b6cb5f913 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.965501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09f09f6e-32c2-48ff-a844-b37b6cb5f913 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.967344 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09f09f6e-32c2-48ff-a844-b37b6cb5f913 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.968007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09f09f6e-32c2-48ff-a844-b37b6cb5f913 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:16.082939 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5d12dc13-d8ee-46d4-be46-dbd70d5b2a12 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.359941 Jul 20 04:12:16.083612 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 469/846] 10.222.0.17 () {60 vars in 1194 bytes} [Wed Jul 20 04:12:15 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:16.089615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-58f425ca-2cd7-4af6-a5d0-856b0cb0d3a0 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:16.090645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-58f425ca-2cd7-4af6-a5d0-856b0cb0d3a0 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:16.099798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58f425ca-2cd7-4af6-a5d0-856b0cb0d3a0 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:16.101321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58f425ca-2cd7-4af6-a5d0-856b0cb0d3a0 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:16.102422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58f425ca-2cd7-4af6-a5d0-856b0cb0d3a0 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:16.103160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58f425ca-2cd7-4af6-a5d0-856b0cb0d3a0 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:16.289815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-58f425ca-2cd7-4af6-a5d0-856b0cb0d3a0 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'services' on Instance uuid 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:12:16.294601 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-09f09f6e-32c2-48ff-a844-b37b6cb5f913 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1645 microversion: 2.1 time: 0.345193 Jul 20 04:12:16.295721 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 378/847] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:15 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1645 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:16.303285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-25cfd3e8-10cd-431f-8032-c3e9c80523ce tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Action: 'create', calling method: .version_select at 0x7f06be98ae50>, body: {"security_group_rule": {"parent_group_id": "0c00a613-9ca9-4136-9a56-519254617a3c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:16.322448 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-58f425ca-2cd7-4af6-a5d0-856b0cb0d3a0 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 2036 microversion: 2.25 time: 0.236699 Jul 20 04:12:16.323096 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 470/848] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:16 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 2036 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:16.332995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-24fb09dd-ffdc-4500-ace7-1b819944f124 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:16.333850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-24fb09dd-ffdc-4500-ace7-1b819944f124 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:16.341992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24fb09dd-ffdc-4500-ace7-1b819944f124 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:16.342705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24fb09dd-ffdc-4500-ace7-1b819944f124 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:16.343761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24fb09dd-ffdc-4500-ace7-1b819944f124 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:16.344921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24fb09dd-ffdc-4500-ace7-1b819944f124 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:16.540220 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-25cfd3e8-10cd-431f-8032-c3e9c80523ce tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] HTTP exception thrown: This rule already exists in group 0c00a613-9ca9-4136-9a56-519254617a3c Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-25cfd3e8-10cd-431f-8032-c3e9c80523ce tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Request method failure captured: Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 138 Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14CdRuocVW4ncBfB2vEDtwbnzTullzN2Zp32NLVwI-qGjAnCubAcwxlj_sJNaPcJzuCNafojAcMJelDJR90qXj6v65Vx_Ih3Nsh1r8jgxWfFhOUHjD-9IyDd0v-3_-8ii_G_O3VqZBr-iVSyhn00xjixKWTkYLQNC5UKde2tgUxdSps Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: aab2a3fa38e046d3b999202b271ee922 Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:12:16.542852 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:12:16.544447 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aab2a3fa38e046d3b999202b271ee922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aab2a3fa38e046d3b999202b271ee922"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aab2a3fa38e046d3b999202b271ee922", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aab2a3fa38e046d3b999202b271ee922"}]}] Jul 20 04:12:16.544447 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:16.544447 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: aab2a3fa38e046d3b999202b271ee922 Jul 20 04:12:16.544447 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:16.544447 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-133318460-project Jul 20 04:12:16.544447 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:12:16.544447 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:12:16.544447 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 97be41cf92b5420c90e53a2a30897a5d Jul 20 04:12:16.544447 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460-project Jul 20 04:12:16.544447 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:12:16.544447 n-d-826526-5 devstack@n-api.service[127870]: {"security_group_rule": {"parent_group_id": "0c00a613-9ca9-4136-9a56-519254617a3c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 20 04:12:16.544447 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: exception: This rule already exists in group 0c00a613-9ca9-4136-9a56-519254617a3c Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0c00a613-9ca9-4136-9a56-519254617a3c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 0c00a613-9ca9-4136-9a56-519254617a3c Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:12:16.545213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:16.546579 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:16.546579 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 20 04:12:16.546579 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:12:16.546579 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 0c00a613-9ca9-4136-9a56-519254617a3c Jul 20 04:12:16.546579 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:16.546579 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:16.546579 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:16.546579 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:16.546579 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:16.546579 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:16.546579 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:16.546579 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:16.546579 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 0c00a613-9ca9-4136-9a56-519254617a3c Jul 20 04:12:16.546579 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:16.546579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-25cfd3e8-10cd-431f-8032-c3e9c80523ce tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Returning 400 to user: This rule already exists in group 0c00a613-9ca9-4136-9a56-519254617a3c {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:16.547490 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-25cfd3e8-10cd-431f-8032-c3e9c80523ce tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.246752 Jul 20 04:12:16.547490 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 379/849] 10.222.0.17 () {60 vars in 1194 bytes} [Wed Jul 20 04:12:16 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 249 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:12:16.559554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-af7841e4-c6cf-409a-b08e-3c351d6772e4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Action: 'create', calling method: .version_select at 0x7f06be620af0>, body: {"keypair": {"name": "tempest-keypair-1934932113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL1tvDffO2nTFNBpaBrUvEnFfVvgy0kUOx/mfccKQNlJUZNsdq7LGUJIC/Vjj+v216u+NU1dKHy19w3Wca9iB9lEEmDf8FTKWC/cC9ULKCAjanCLqS7Ib16UJ5ITLwbZA=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:16.590937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-af7841e4-c6cf-409a-b08e-3c351d6772e4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Getting quotas for project 8d4037629b9e4e6fa92e2a8d89cf0311. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:16.597876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-af7841e4-c6cf-409a-b08e-3c351d6772e4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Getting quotas for user 45a9bfefde81473d88610b03e0de9bf4 and project 8d4037629b9e4e6fa92e2a8d89cf0311. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:16.604121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:16.646734 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-af7841e4-c6cf-409a-b08e-3c351d6772e4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.096931 Jul 20 04:12:16.647691 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 380/850] 10.222.0.17 () {62 vars in 1199 bytes} [Wed Jul 20 04:12:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:12:16.653444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9c7287d1-3e8d-468f-b1fc-13b4b58c885b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:16.656557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9c7287d1-3e8d-468f-b1fc-13b4b58c885b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:16.672683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c7287d1-3e8d-468f-b1fc-13b4b58c885b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:16.673848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c7287d1-3e8d-468f-b1fc-13b4b58c885b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:16.674967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c7287d1-3e8d-468f-b1fc-13b4b58c885b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:16.675561 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c7287d1-3e8d-468f-b1fc-13b4b58c885b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.054051 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9c7287d1-3e8d-468f-b1fc-13b4b58c885b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:17.069989 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9c7287d1-3e8d-468f-b1fc-13b4b58c885b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.420859 Jul 20 04:12:17.072594 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-24fb09dd-ffdc-4500-ace7-1b819944f124 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1645 microversion: 2.1 time: 0.747278 Jul 20 04:12:17.072869 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 381/851] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:16 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:17.073823 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 471/852] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:16 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1645 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:17.078885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-477a6783-cf9b-414b-b6ba-a5da2c03af20 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:17.079759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-477a6783-cf9b-414b-b6ba-a5da2c03af20 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:17.082245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94a33fff-db1b-44c3-81b5-eafcc565f31e tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Calling method '.version_select at 0x7f06be98a9d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:17.089011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-477a6783-cf9b-414b-b6ba-a5da2c03af20 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.090077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-477a6783-cf9b-414b-b6ba-a5da2c03af20 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.091665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-477a6783-cf9b-414b-b6ba-a5da2c03af20 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.092344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-477a6783-cf9b-414b-b6ba-a5da2c03af20 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.443580 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-94a33fff-db1b-44c3-81b5-eafcc565f31e tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-group-rules/c5af2de3-7b34-4651-85da-6340bd391495" status: 202 len: 0 microversion: 2.1 time: 0.369431 Jul 20 04:12:17.449463 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 382/853] 10.222.0.17 () {58 vars in 1286 bytes} [Wed Jul 20 04:12:17 2022] DELETE /compute/v2.1/os-security-group-rules/c5af2de3-7b34-4651-85da-6340bd391495 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:17.455899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-309d5cb9-b021-4509-bb9a-27899641df4f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:17.456892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-309d5cb9-b021-4509-bb9a-27899641df4f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:17.464096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-309d5cb9-b021-4509-bb9a-27899641df4f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.464861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-309d5cb9-b021-4509-bb9a-27899641df4f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.466757 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-309d5cb9-b021-4509-bb9a-27899641df4f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.467486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-309d5cb9-b021-4509-bb9a-27899641df4f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.523326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-477a6783-cf9b-414b-b6ba-a5da2c03af20 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:17.556347 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-477a6783-cf9b-414b-b6ba-a5da2c03af20 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d" status: 200 len: 1319 microversion: 2.1 time: 0.478842 Jul 20 04:12:17.560800 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 472/854] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:17 2022] GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d => generated 1319 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:17.573341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-aa1e070b-7c33-4b88-9e29-4ec4e84a32d0 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:17.575589 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:17.575589 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:12:17.578709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa1e070b-7c33-4b88-9e29-4ec4e84a32d0 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.581564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa1e070b-7c33-4b88-9e29-4ec4e84a32d0 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.582742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa1e070b-7c33-4b88-9e29-4ec4e84a32d0 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.583644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa1e070b-7c33-4b88-9e29-4ec4e84a32d0 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.643368 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-aa1e070b-7c33-4b88-9e29-4ec4e84a32d0 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.080043 Jul 20 04:12:17.645470 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 473/855] 10.222.0.17 () {58 vars in 1175 bytes} [Wed Jul 20 04:12:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:17.657191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-44a406c0-1efc-4035-9c92-e46a912f5458 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Action: 'create', calling method: .version_select at 0x7f06be1c5700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1879566364", "description": "tempest-description-1328468293"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:17.692910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-309d5cb9-b021-4509-bb9a-27899641df4f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:17.702838 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-309d5cb9-b021-4509-bb9a-27899641df4f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1389 microversion: 2.1 time: 0.251923 Jul 20 04:12:17.703433 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 383/856] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:17 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1389 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:17.712440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ffb25da4-8fc4-43ba-97c7-2cbf82671cdb tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:17.713241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ffb25da4-8fc4-43ba-97c7-2cbf82671cdb tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:17.720590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffb25da4-8fc4-43ba-97c7-2cbf82671cdb tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.721273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffb25da4-8fc4-43ba-97c7-2cbf82671cdb tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.722214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffb25da4-8fc4-43ba-97c7-2cbf82671cdb tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.725344 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffb25da4-8fc4-43ba-97c7-2cbf82671cdb tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.875348 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ffb25da4-8fc4-43ba-97c7-2cbf82671cdb tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc/action" status: 202 len: 0 microversion: 2.1 time: 0.169809 Jul 20 04:12:17.876369 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 384/857] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:12:17 2022] POST /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:17.896391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f67e230e-99ea-43a7-aee6-451093317c44 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:17.900967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f67e230e-99ea-43a7-aee6-451093317c44 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:17.916887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f67e230e-99ea-43a7-aee6-451093317c44 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.917613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f67e230e-99ea-43a7-aee6-451093317c44 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.918624 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f67e230e-99ea-43a7-aee6-451093317c44 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.919238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f67e230e-99ea-43a7-aee6-451093317c44 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.978655 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-44a406c0-1efc-4035-9c92-e46a912f5458 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.331440 Jul 20 04:12:17.979887 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 474/858] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:12:17 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:17.990930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-201e7dc3-f9a6-47e4-8afe-f38733fb5f46 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Action: 'create', calling method: .version_select at 0x7f06be453a60>, body: {"security_group_rule": {"parent_group_id": "07e93120-5ea5-4466-bf78-157cb91002db", "ip_protocol": "tcp", "from_port": 389853611, "to_port": 22}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:18.124992 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-201e7dc3-f9a6-47e4-8afe-f38733fb5f46 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] HTTP exception thrown: Invalid port range 389853611:22. Former value cannot be greater than the later Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-201e7dc3-f9a6-47e4-8afe-f38733fb5f46 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Request method failure captured: Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 145 Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14CdRuocVW4ncBfB2vEDtwbnzTullzN2Zp32NLVwI-qGjAnCubAcwxlj_sJNaPcJzuCNafojAcMJelDJR90qXj6v65Vx_Ih3Nsh1r8jgxWfFhOUHjD-9IyDd0v-3_-8ii_G_O3VqZBr-iVSyhn00xjixKWTkYLQNC5UKde2tgUxdSps Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: aab2a3fa38e046d3b999202b271ee922 Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:12:18.127938 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:12:18.130797 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aab2a3fa38e046d3b999202b271ee922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aab2a3fa38e046d3b999202b271ee922"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aab2a3fa38e046d3b999202b271ee922", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aab2a3fa38e046d3b999202b271ee922"}]}] Jul 20 04:12:18.130797 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:18.130797 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: aab2a3fa38e046d3b999202b271ee922 Jul 20 04:12:18.130797 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:18.130797 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-133318460-project Jul 20 04:12:18.130797 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:12:18.130797 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:12:18.130797 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 97be41cf92b5420c90e53a2a30897a5d Jul 20 04:12:18.130797 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460-project Jul 20 04:12:18.130797 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:12:18.130797 n-d-826526-5 devstack@n-api.service[127871]: {"security_group_rule": {"parent_group_id": "07e93120-5ea5-4466-bf78-157cb91002db", "ip_protocol": "tcp", "from_port": 389853611, "to_port": 22}} Jul 20 04:12:18.130797 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid port range 389853611:22. Former value cannot be greater than the later Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'security_group_rule': {'parent_group_id': '07e93120-5ea5-4466-bf78-157cb91002db', 'ip_protocol': 'tcp', 'from_port': 389853611, 'to_port': 22}}} Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 389853611:22. Former value cannot be greater than the later Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:18.131688 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 389853611:22. Former value cannot be greater than the later Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 389853611:22. Former value cannot be greater than the later Jul 20 04:12:18.133946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:18.136543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-201e7dc3-f9a6-47e4-8afe-f38733fb5f46 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Returning 400 to user: Invalid port range 389853611:22. Former value cannot be greater than the later {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:18.137631 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-201e7dc3-f9a6-47e4-8afe-f38733fb5f46 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.150573 Jul 20 04:12:18.138771 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 475/859] 10.222.0.17 () {60 vars in 1194 bytes} [Wed Jul 20 04:12:17 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:12:18.150598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-184535a2-1ab8-4cc8-a2d2-cec8ff85dbcc req-cbf2ba85-069d-4813-86e8-7aca809b83e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f9cbb51-d102-4677-a14a-2837242cf16d", "tag": "de591a0a-a73f-4cbb-b9ac-d9c499ebf844"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:18.177376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-184535a2-1ab8-4cc8-a2d2-cec8ff85dbcc req-cbf2ba85-069d-4813-86e8-7aca809b83e0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:18.180876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-184535a2-1ab8-4cc8-a2d2-cec8ff85dbcc req-cbf2ba85-069d-4813-86e8-7aca809b83e0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:18.209633 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-184535a2-1ab8-4cc8-a2d2-cec8ff85dbcc req-cbf2ba85-069d-4813-86e8-7aca809b83e0 service nova] Creating event network-changed:de591a0a-a73f-4cbb-b9ac-d9c499ebf844 for instance 6f9cbb51-d102-4677-a14a-2837242cf16d on n-h1-826526-5 Jul 20 04:12:18.214858 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-184535a2-1ab8-4cc8-a2d2-cec8ff85dbcc req-cbf2ba85-069d-4813-86e8-7aca809b83e0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074415 Jul 20 04:12:18.215754 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 476/860] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:18.223136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8d8d793a-f05c-461a-910d-088a0616a8e1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:18.224104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8d8d793a-f05c-461a-910d-088a0616a8e1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:18.232759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d8d793a-f05c-461a-910d-088a0616a8e1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:18.233494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d8d793a-f05c-461a-910d-088a0616a8e1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:18.234650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d8d793a-f05c-461a-910d-088a0616a8e1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:18.235244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d8d793a-f05c-461a-910d-088a0616a8e1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:18.368422 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f67e230e-99ea-43a7-aee6-451093317c44 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1650 microversion: 2.1 time: 0.478139 Jul 20 04:12:18.369363 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 385/861] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:17 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1650 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:18.385415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a0b65b44-2888-48f4-8e8c-4ac7e2079bb6 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Action: 'create', calling method: .version_select at 0x7f06be8b24c0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1820494179", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:18.387510 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-a0b65b44-2888-48f4-8e8c-4ac7e2079bb6 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] HTTP exception thrown: Security group id should be uuid Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a0b65b44-2888-48f4-8e8c-4ac7e2079bb6 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Request method failure captured: Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 131 Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14CdRuocVW4ncBfB2vEDtwbnzTullzN2Zp32NLVwI-qGjAnCubAcwxlj_sJNaPcJzuCNafojAcMJelDJR90qXj6v65Vx_Ih3Nsh1r8jgxWfFhOUHjD-9IyDd0v-3_-8ii_G_O3VqZBr-iVSyhn00xjixKWTkYLQNC5UKde2tgUxdSps Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: aab2a3fa38e046d3b999202b271ee922 Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:12:18.389394 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:12:18.391058 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aab2a3fa38e046d3b999202b271ee922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aab2a3fa38e046d3b999202b271ee922"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aab2a3fa38e046d3b999202b271ee922", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aab2a3fa38e046d3b999202b271ee922"}]}] Jul 20 04:12:18.391058 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:18.391058 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: aab2a3fa38e046d3b999202b271ee922 Jul 20 04:12:18.391058 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:18.391058 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-133318460-project Jul 20 04:12:18.391058 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:12:18.391058 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:12:18.391058 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 97be41cf92b5420c90e53a2a30897a5d Jul 20 04:12:18.391058 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460-project Jul 20 04:12:18.391058 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:12:18.391058 n-d-826526-5 devstack@n-api.service[127870]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1820494179", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 20 04:12:18.391058 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:12:18.391058 n-d-826526-5 devstack@n-api.service[127870]: exception: Security group id should be uuid Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1820494179', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:18.391927 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:18.393279 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:12:18.393279 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:12:18.393279 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 20 04:12:18.393279 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:18.393279 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:18.393279 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:18.393279 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:18.393279 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:18.393279 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:18.393279 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:18.393279 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:18.393279 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 20 04:12:18.393279 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:18.395493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a0b65b44-2888-48f4-8e8c-4ac7e2079bb6 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Returning 400 to user: Security group id should be uuid {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:18.396613 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a0b65b44-2888-48f4-8e8c-4ac7e2079bb6 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.015373 Jul 20 04:12:18.397406 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 386/862] 10.222.0.17 () {60 vars in 1194 bytes} [Wed Jul 20 04:12:18 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:12:18.407668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7a0d383a-5f17-4313-90d0-7588f9c4e083 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Action: 'create', calling method: .version_select at 0x7f06be620dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-699743348", "description": "tempest-description-2031362902"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:18.500724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8d8d793a-f05c-461a-910d-088a0616a8e1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:18.515924 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8d8d793a-f05c-461a-910d-088a0616a8e1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.297349 Jul 20 04:12:18.518342 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 477/863] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:18 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:18.577152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2ed0fdf1-4b19-4c26-aec2-67777d519d90 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:18.578281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2ed0fdf1-4b19-4c26-aec2-67777d519d90 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:18.589567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ed0fdf1-4b19-4c26-aec2-67777d519d90 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:18.595635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ed0fdf1-4b19-4c26-aec2-67777d519d90 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:18.597298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ed0fdf1-4b19-4c26-aec2-67777d519d90 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:18.598101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ed0fdf1-4b19-4c26-aec2-67777d519d90 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:18.918550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2ed0fdf1-4b19-4c26-aec2-67777d519d90 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:18.929227 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2ed0fdf1-4b19-4c26-aec2-67777d519d90 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d" status: 200 len: 1319 microversion: 2.1 time: 0.357224 Jul 20 04:12:18.930650 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 478/864] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:18 2022] GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:18.935981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1a5cba6b-1ff3-4679-b65c-21ebda5b341a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:18.936759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1a5cba6b-1ff3-4679-b65c-21ebda5b341a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:18.946363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1a5cba6b-1ff3-4679-b65c-21ebda5b341a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:18.947470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1a5cba6b-1ff3-4679-b65c-21ebda5b341a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:18.948689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1a5cba6b-1ff3-4679-b65c-21ebda5b341a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:18.949270 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1a5cba6b-1ff3-4679-b65c-21ebda5b341a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.306607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1a5cba6b-1ff3-4679-b65c-21ebda5b341a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:19.315821 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1a5cba6b-1ff3-4679-b65c-21ebda5b341a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1389 microversion: 2.1 time: 0.383931 Jul 20 04:12:19.320744 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 479/865] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:18 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1389 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:19.351685 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7a0d383a-5f17-4313-90d0-7588f9c4e083 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.948569 Jul 20 04:12:19.354185 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 387/866] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:12:18 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:19.364744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-68f75828-5526-4ee5-8635-b96ff766f32a tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Action: 'create', calling method: .version_select at 0x7f06be1c5040>, body: {"security_group_rule": {"parent_group_id": "3a30b57d-79d5-4fb6-9d7c-bc8da256d6ba", "ip_protocol": "tempest-999-565745178", "from_port": 22, "to_port": 22}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:19.389761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-189ddee1-9f28-451a-b170-bdfeae8d8aca tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:19.390489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-189ddee1-9f28-451a-b170-bdfeae8d8aca tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:19.398644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-189ddee1-9f28-451a-b170-bdfeae8d8aca tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.399099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-189ddee1-9f28-451a-b170-bdfeae8d8aca tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.403372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-189ddee1-9f28-451a-b170-bdfeae8d8aca tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.403854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-189ddee1-9f28-451a-b170-bdfeae8d8aca tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.608940 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-68f75828-5526-4ee5-8635-b96ff766f32a tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] HTTP exception thrown: Invalid IP protocol tempest-999-565745178. Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-68f75828-5526-4ee5-8635-b96ff766f32a tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Request method failure captured: Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 156 Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14CdRuocVW4ncBfB2vEDtwbnzTullzN2Zp32NLVwI-qGjAnCubAcwxlj_sJNaPcJzuCNafojAcMJelDJR90qXj6v65Vx_Ih3Nsh1r8jgxWfFhOUHjD-9IyDd0v-3_-8ii_G_O3VqZBr-iVSyhn00xjixKWTkYLQNC5UKde2tgUxdSps Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: aab2a3fa38e046d3b999202b271ee922 Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:12:19.611127 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:12:19.612774 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aab2a3fa38e046d3b999202b271ee922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aab2a3fa38e046d3b999202b271ee922"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aab2a3fa38e046d3b999202b271ee922", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aab2a3fa38e046d3b999202b271ee922"}]}] Jul 20 04:12:19.612774 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:19.612774 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: aab2a3fa38e046d3b999202b271ee922 Jul 20 04:12:19.612774 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:19.612774 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-133318460-project Jul 20 04:12:19.612774 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:12:19.612774 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:12:19.612774 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 97be41cf92b5420c90e53a2a30897a5d Jul 20 04:12:19.612774 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460-project Jul 20 04:12:19.612774 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:12:19.612774 n-d-826526-5 devstack@n-api.service[127871]: {"security_group_rule": {"parent_group_id": "3a30b57d-79d5-4fb6-9d7c-bc8da256d6ba", "ip_protocol": "tempest-999-565745178", "from_port": 22, "to_port": 22}} Jul 20 04:12:19.612774 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:12:19.612774 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid IP protocol tempest-999-565745178. Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3a30b57d-79d5-4fb6-9d7c-bc8da256d6ba', 'ip_protocol': 'tempest-999-565745178', 'from_port': 22, 'to_port': 22}}} Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-565745178. Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:19.613712 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:19.615033 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:19.615033 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:12:19.615033 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:12:19.615033 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:19.615033 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:19.615033 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:12:19.615033 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:12:19.615033 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-565745178. Jul 20 04:12:19.615033 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:19.615033 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:19.615033 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:19.615033 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:19.615033 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:19.615033 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:19.615033 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:19.615033 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:19.615033 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-565745178. Jul 20 04:12:19.615033 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:19.616323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-68f75828-5526-4ee5-8635-b96ff766f32a tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Returning 400 to user: Invalid IP protocol tempest-999-565745178. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:19.616323 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-68f75828-5526-4ee5-8635-b96ff766f32a tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.251735 Jul 20 04:12:19.617813 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 480/867] 10.222.0.17 () {60 vars in 1194 bytes} [Wed Jul 20 04:12:19 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 257 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:12:19.622659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9ebb8f0a-2e36-49a1-aa5d-33b562c775cd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:19.623310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9ebb8f0a-2e36-49a1-aa5d-33b562c775cd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:19.639423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ebb8f0a-2e36-49a1-aa5d-33b562c775cd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.640191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ebb8f0a-2e36-49a1-aa5d-33b562c775cd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.641888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ebb8f0a-2e36-49a1-aa5d-33b562c775cd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.642473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ebb8f0a-2e36-49a1-aa5d-33b562c775cd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.852365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9ebb8f0a-2e36-49a1-aa5d-33b562c775cd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:19.863438 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9ebb8f0a-2e36-49a1-aa5d-33b562c775cd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.244421 Jul 20 04:12:19.864039 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 481/868] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:19 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:19.869031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-737906f1-e372-4570-9f6c-03055e4a0cd2 req-48fdda01-5a2a-449b-a861-cf3c3a0a0d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2", "name": "network-vif-plugged", "status": "completed", "tag": "10a828a3-bd43-49e2-a38e-dfa31069d15b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:19.877185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-737906f1-e372-4570-9f6c-03055e4a0cd2 req-48fdda01-5a2a-449b-a861-cf3c3a0a0d19 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.877631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-737906f1-e372-4570-9f6c-03055e4a0cd2 req-48fdda01-5a2a-449b-a861-cf3c3a0a0d19 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.889302 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-737906f1-e372-4570-9f6c-03055e4a0cd2 req-48fdda01-5a2a-449b-a861-cf3c3a0a0d19 service nova] Creating event network-vif-plugged:10a828a3-bd43-49e2-a38e-dfa31069d15b for instance 8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2 on n-h2-826526-5 Jul 20 04:12:19.894435 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-737906f1-e372-4570-9f6c-03055e4a0cd2 req-48fdda01-5a2a-449b-a861-cf3c3a0a0d19 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029161 Jul 20 04:12:19.895442 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 482/869] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:19.901150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-253dbb0c-5727-438c-9a21-649769816992 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Action: 'create', calling method: .version_select at 0x7f06be5a70d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-629933153", "description": "tempest-description-1958610566"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:20.010980 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-189ddee1-9f28-451a-b170-bdfeae8d8aca tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1630 microversion: 2.1 time: 0.626838 Jul 20 04:12:20.012154 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 388/870] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:19 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1630 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:20.036125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fdc599d8-608f-4375-a6e2-53b568ed98db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1682869354", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "08ef3e3e-6870-4bac-a7ee-1dba3bc5da77"}], "security_groups": [{"name": "tempest-securitygroup--2946294"}], "key_name": "tempest-keypair-1934932113", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:20.127451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:20.177543 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-253dbb0c-5727-438c-9a21-649769816992 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.280879 Jul 20 04:12:20.178237 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 483/871] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:12:19 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:20.184376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-57b34686-0a30-4ed5-ae99-0069d3b1fd24 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:20.184376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-57b34686-0a30-4ed5-ae99-0069d3b1fd24 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:20.216917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57b34686-0a30-4ed5-ae99-0069d3b1fd24 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.221514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57b34686-0a30-4ed5-ae99-0069d3b1fd24 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.223374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57b34686-0a30-4ed5-ae99-0069d3b1fd24 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.224365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57b34686-0a30-4ed5-ae99-0069d3b1fd24 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.300067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-fdc599d8-608f-4375-a6e2-53b568ed98db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] validate_networks() for [('08ef3e3e-6870-4bac-a7ee-1dba3bc5da77', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:20.406271 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-57b34686-0a30-4ed5-ae99-0069d3b1fd24 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:20.419043 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-57b34686-0a30-4ed5-ae99-0069d3b1fd24 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d" status: 200 len: 1319 microversion: 2.1 time: 0.239656 Jul 20 04:12:20.429517 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 484/872] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:20 2022] GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:20.435505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-11e2f3f1-a259-416b-b117-f517b9b41199 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826526-5", "block_migration": true, "disk_over_commit": false}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:20.437650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-11e2f3f1-a259-416b-b117-f517b9b41199 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:20.444791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11e2f3f1-a259-416b-b117-f517b9b41199 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.446058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11e2f3f1-a259-416b-b117-f517b9b41199 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.447023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11e2f3f1-a259-416b-b117-f517b9b41199 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.447604 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11e2f3f1-a259-416b-b117-f517b9b41199 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.484441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-11e2f3f1-a259-416b-b117-f517b9b41199 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lazy-loading 'flavor' on Instance uuid a04f4bb0-5809-44b5-bb51-63bd97076afc {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:12:20.503844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-11e2f3f1-a259-416b-b117-f517b9b41199 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Going to try to live migrate instance to n-h2-826526-5 {{(pid=127871) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:12:21.477906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-fdc599d8-608f-4375-a6e2-53b568ed98db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:21.478412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-fdc599d8-608f-4375-a6e2-53b568ed98db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:21.478811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-fdc599d8-608f-4375-a6e2-53b568ed98db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:21.479367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-fdc599d8-608f-4375-a6e2-53b568ed98db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:21.479793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-fdc599d8-608f-4375-a6e2-53b568ed98db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:21.489472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fdc599d8-608f-4375-a6e2-53b568ed98db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:21.489929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fdc599d8-608f-4375-a6e2-53b568ed98db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:21.490918 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fdc599d8-608f-4375-a6e2-53b568ed98db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:21.491567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fdc599d8-608f-4375-a6e2-53b568ed98db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:21.498575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:21.512919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-fdc599d8-608f-4375-a6e2-53b568ed98db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Getting quotas for project 8d4037629b9e4e6fa92e2a8d89cf0311. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:21.518765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-fdc599d8-608f-4375-a6e2-53b568ed98db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Getting quotas for user 45a9bfefde81473d88610b03e0de9bf4 and project 8d4037629b9e4e6fa92e2a8d89cf0311. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:21.533119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fdc599d8-608f-4375-a6e2-53b568ed98db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:21.535715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fdc599d8-608f-4375-a6e2-53b568ed98db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:21.582850 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fdc599d8-608f-4375-a6e2-53b568ed98db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.25 time: 1.568333 Jul 20 04:12:21.588025 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 389/873] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 04:12:20 2022] POST /compute/v2.1/servers => generated 403 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:12:21.592194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b8d77492-fb5e-4cad-b803-d7e946c04792 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Action: 'create', calling method: .version_select at 0x7f06beb6b040>, body: {"security_group_rule": {"parent_group_id": "2b7516b6-bd32-4c4f-b7c5-462412c8ec72", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:21.670644 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-b8d77492-fb5e-4cad-b803-d7e946c04792 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b8d77492-fb5e-4cad-b803-d7e946c04792 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Request method failure captured: Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 138 Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14CdRuocVW4ncBfB2vEDtwbnzTullzN2Zp32NLVwI-qGjAnCubAcwxlj_sJNaPcJzuCNafojAcMJelDJR90qXj6v65Vx_Ih3Nsh1r8jgxWfFhOUHjD-9IyDd0v-3_-8ii_G_O3VqZBr-iVSyhn00xjixKWTkYLQNC5UKde2tgUxdSps Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: aab2a3fa38e046d3b999202b271ee922 Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:12:21.672682 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:12:21.674365 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aab2a3fa38e046d3b999202b271ee922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aab2a3fa38e046d3b999202b271ee922"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aab2a3fa38e046d3b999202b271ee922", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aab2a3fa38e046d3b999202b271ee922"}]}] Jul 20 04:12:21.674365 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:21.674365 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: aab2a3fa38e046d3b999202b271ee922 Jul 20 04:12:21.674365 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:21.674365 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-133318460-project Jul 20 04:12:21.674365 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:12:21.674365 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:12:21.674365 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 97be41cf92b5420c90e53a2a30897a5d Jul 20 04:12:21.674365 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460-project Jul 20 04:12:21.674365 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:12:21.674365 n-d-826526-5 devstack@n-api.service[127870]: {"security_group_rule": {"parent_group_id": "2b7516b6-bd32-4c4f-b7c5-462412c8ec72", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 20 04:12:21.674365 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2b7516b6-bd32-4c4f-b7c5-462412c8ec72', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:21.675254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:12:21.676529 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:21.677875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b8d77492-fb5e-4cad-b803-d7e946c04792 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:21.677875 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b8d77492-fb5e-4cad-b803-d7e946c04792 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.090925 Jul 20 04:12:21.677875 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 390/874] 10.222.0.17 () {60 vars in 1194 bytes} [Wed Jul 20 04:12:21 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:12:21.687670 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2669a429-19fe-4d8a-bc50-1a1ceda4947d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:21.688494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2669a429-19fe-4d8a-bc50-1a1ceda4947d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:21.699399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2669a429-19fe-4d8a-bc50-1a1ceda4947d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:21.699932 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2669a429-19fe-4d8a-bc50-1a1ceda4947d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:21.702682 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2669a429-19fe-4d8a-bc50-1a1ceda4947d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:21.703017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2669a429-19fe-4d8a-bc50-1a1ceda4947d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:21.959139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2669a429-19fe-4d8a-bc50-1a1ceda4947d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:21.968244 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2669a429-19fe-4d8a-bc50-1a1ceda4947d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1389 microversion: 2.1 time: 0.290073 Jul 20 04:12:21.979975 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 391/875] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:21 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1389 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:21.985151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94a0c8f8-7353-4854-9cfd-9c28fc2e797c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:21.985999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-94a0c8f8-7353-4854-9cfd-9c28fc2e797c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:21.992684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94a0c8f8-7353-4854-9cfd-9c28fc2e797c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:21.993415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94a0c8f8-7353-4854-9cfd-9c28fc2e797c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:21.994392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94a0c8f8-7353-4854-9cfd-9c28fc2e797c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:21.995021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94a0c8f8-7353-4854-9cfd-9c28fc2e797c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:22.328464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-94a0c8f8-7353-4854-9cfd-9c28fc2e797c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:22.340584 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-94a0c8f8-7353-4854-9cfd-9c28fc2e797c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.356270 Jul 20 04:12:22.352344 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 392/876] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:21 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:22.358674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2ff77213-6252-46c7-ae1d-20867bf6a491 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:22.359492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2ff77213-6252-46c7-ae1d-20867bf6a491 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:22.373599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ff77213-6252-46c7-ae1d-20867bf6a491 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:22.374303 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ff77213-6252-46c7-ae1d-20867bf6a491 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:22.375286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ff77213-6252-46c7-ae1d-20867bf6a491 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:22.375730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ff77213-6252-46c7-ae1d-20867bf6a491 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:22.562313 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-11e2f3f1-a259-416b-b117-f517b9b41199 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc/action" status: 202 len: 0 microversion: 2.1 time: 2.130574 Jul 20 04:12:22.563477 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 485/877] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:12:20 2022] POST /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc/action => generated 0 bytes in 2133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:22.570391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-486de531-e3a6-43d9-b754-8c1995f0c859 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:22.572177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-486de531-e3a6-43d9-b754-8c1995f0c859 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:22.585192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-486de531-e3a6-43d9-b754-8c1995f0c859 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:22.586226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-486de531-e3a6-43d9-b754-8c1995f0c859 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:22.587940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-486de531-e3a6-43d9-b754-8c1995f0c859 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:22.588812 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-486de531-e3a6-43d9-b754-8c1995f0c859 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:22.624857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2ff77213-6252-46c7-ae1d-20867bf6a491 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:22.634990 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2ff77213-6252-46c7-ae1d-20867bf6a491 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d" status: 200 len: 1319 microversion: 2.1 time: 0.281013 Jul 20 04:12:22.635599 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 393/878] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:22 2022] GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:22.642683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4a145b83-9992-4020-ac86-fca194337ef2 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Action: 'create', calling method: .version_select at 0x7f06bed40310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-57522635", "description": "tempest-description-1484487606"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:22.687807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-486de531-e3a6-43d9-b754-8c1995f0c859 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:22.697970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-486de531-e3a6-43d9-b754-8c1995f0c859 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:22.699630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-486de531-e3a6-43d9-b754-8c1995f0c859 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:22.701125 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-486de531-e3a6-43d9-b754-8c1995f0c859 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1338 microversion: 2.25 time: 0.136323 Jul 20 04:12:22.701806 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 486/879] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:22 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1338 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:22.707102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-f28173b8-9b2e-4c9a-80ca-005dcec0f3a6 req-212bbec0-8870-4a08-9b2c-95ee7bdc39ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9cbb51-d102-4677-a14a-2837242cf16d", "name": "network-vif-plugged", "status": "completed", "tag": "de591a0a-a73f-4cbb-b9ac-d9c499ebf844"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:22.716385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f28173b8-9b2e-4c9a-80ca-005dcec0f3a6 req-212bbec0-8870-4a08-9b2c-95ee7bdc39ca service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:22.717127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f28173b8-9b2e-4c9a-80ca-005dcec0f3a6 req-212bbec0-8870-4a08-9b2c-95ee7bdc39ca service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:22.729326 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-f28173b8-9b2e-4c9a-80ca-005dcec0f3a6 req-212bbec0-8870-4a08-9b2c-95ee7bdc39ca service nova] Creating event network-vif-plugged:de591a0a-a73f-4cbb-b9ac-d9c499ebf844 for instance 6f9cbb51-d102-4677-a14a-2837242cf16d on n-h1-826526-5 Jul 20 04:12:22.734586 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-f28173b8-9b2e-4c9a-80ca-005dcec0f3a6 req-212bbec0-8870-4a08-9b2c-95ee7bdc39ca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031295 Jul 20 04:12:22.735643 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 487/880] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:22.741126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-35489d4f-d9cb-46c3-8ccc-955c3dd4139e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:22.742045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35489d4f-d9cb-46c3-8ccc-955c3dd4139e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:22.749070 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35489d4f-d9cb-46c3-8ccc-955c3dd4139e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:22.749919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35489d4f-d9cb-46c3-8ccc-955c3dd4139e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:22.750982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35489d4f-d9cb-46c3-8ccc-955c3dd4139e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:22.751606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35489d4f-d9cb-46c3-8ccc-955c3dd4139e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:23.040572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-35489d4f-d9cb-46c3-8ccc-955c3dd4139e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:23.056625 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-35489d4f-d9cb-46c3-8ccc-955c3dd4139e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1504 microversion: 2.1 time: 0.318563 Jul 20 04:12:23.060595 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 488/881] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:22 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1504 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:23.065844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-edaef1d4-74f1-4ab2-8814-bf52ea75b86e tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:23.073193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-edaef1d4-74f1-4ab2-8814-bf52ea75b86e tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:23.076892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:23.099622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edaef1d4-74f1-4ab2-8814-bf52ea75b86e tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:23.100086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edaef1d4-74f1-4ab2-8814-bf52ea75b86e tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:23.100941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edaef1d4-74f1-4ab2-8814-bf52ea75b86e tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:23.101386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edaef1d4-74f1-4ab2-8814-bf52ea75b86e tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:23.248122 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4a145b83-9992-4020-ac86-fca194337ef2 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.611084 Jul 20 04:12:23.259625 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 394/882] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:12:22 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:23.265761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2039dd55-35f8-46fe-a141-156e5473a39f tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Action: 'create', calling method: .version_select at 0x7f06bed1aaf0>, body: {"security_group_rule": {"parent_group_id": "99b8270c-1682-433c-b65e-ea8a451045bd", "ip_protocol": "tcp", "from_port": 22, "to_port": 2123884297}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:23.369503 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-edaef1d4-74f1-4ab2-8814-bf52ea75b86e tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:23.379370 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-edaef1d4-74f1-4ab2-8814-bf52ea75b86e tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1389 microversion: 2.1 time: 0.317252 Jul 20 04:12:23.380760 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 489/883] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:23 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1389 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:23.385942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-58c5b859-4325-4d40-ac73-b5845e879964 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:23.386746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-58c5b859-4325-4d40-ac73-b5845e879964 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:23.393370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58c5b859-4325-4d40-ac73-b5845e879964 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:23.394374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58c5b859-4325-4d40-ac73-b5845e879964 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:23.395637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58c5b859-4325-4d40-ac73-b5845e879964 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:23.396226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58c5b859-4325-4d40-ac73-b5845e879964 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:23.414705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:23.482773 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-2039dd55-35f8-46fe-a141-156e5473a39f tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] HTTP exception thrown: Invalid port range 22:2123884297. Valid TCP ports should be between 1-65535 Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2039dd55-35f8-46fe-a141-156e5473a39f tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Request method failure captured: Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 146 Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14CdRuocVW4ncBfB2vEDtwbnzTullzN2Zp32NLVwI-qGjAnCubAcwxlj_sJNaPcJzuCNafojAcMJelDJR90qXj6v65Vx_Ih3Nsh1r8jgxWfFhOUHjD-9IyDd0v-3_-8ii_G_O3VqZBr-iVSyhn00xjixKWTkYLQNC5UKde2tgUxdSps Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: aab2a3fa38e046d3b999202b271ee922 Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:12:23.484561 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:12:23.486099 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aab2a3fa38e046d3b999202b271ee922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aab2a3fa38e046d3b999202b271ee922"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aab2a3fa38e046d3b999202b271ee922", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aab2a3fa38e046d3b999202b271ee922"}]}] Jul 20 04:12:23.486099 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:23.486099 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: aab2a3fa38e046d3b999202b271ee922 Jul 20 04:12:23.486099 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:23.486099 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-133318460-project Jul 20 04:12:23.486099 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:12:23.486099 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:12:23.486099 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 97be41cf92b5420c90e53a2a30897a5d Jul 20 04:12:23.486099 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460-project Jul 20 04:12:23.486099 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:12:23.486099 n-d-826526-5 devstack@n-api.service[127870]: {"security_group_rule": {"parent_group_id": "99b8270c-1682-433c-b65e-ea8a451045bd", "ip_protocol": "tcp", "from_port": 22, "to_port": 2123884297}} Jul 20 04:12:23.486099 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid port range 22:2123884297. Valid TCP ports should be between 1-65535 Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'security_group_rule': {'parent_group_id': '99b8270c-1682-433c-b65e-ea8a451045bd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 2123884297}}} Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:2123884297. Valid TCP ports should be between 1-65535 Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:23.487063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:2123884297. Valid TCP ports should be between 1-65535 Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:2123884297. Valid TCP ports should be between 1-65535 Jul 20 04:12:23.488401 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.491248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2039dd55-35f8-46fe-a141-156e5473a39f tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Returning 400 to user: Invalid port range 22:2123884297. Valid TCP ports should be between 1-65535 {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:23.492095 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2039dd55-35f8-46fe-a141-156e5473a39f tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.230797 Jul 20 04:12:23.492717 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 395/884] 10.222.0.17 () {60 vars in 1194 bytes} [Wed Jul 20 04:12:23 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 232 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:12:23.508987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7f1396df-bc7c-4910-9f8d-ecac8c6d63a3 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Action: 'create', calling method: .version_select at 0x7f06be98a1f0>, body: {"security_group_rule": {"parent_group_id": "586cea97-46d2-4bdb-b7cc-90aa369a7e42", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:23.555121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-58c5b859-4325-4d40-ac73-b5845e879964 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:23.564578 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-58c5b859-4325-4d40-ac73-b5845e879964 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.182667 Jul 20 04:12:23.565176 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 490/885] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:23 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:23.627259 n-d-826526-5 devstack@n-api.service[127870]: DEBUG neutronclient.v2_0.client [None req-7f1396df-bc7c-4910-9f8d-ecac8c6d63a3 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 586cea97-46d2-4bdb-b7cc-90aa369a7e42 does not exist", "detail": ""}} {{(pid=127870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:12:23.627873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.security_group_api [None req-7f1396df-bc7c-4910-9f8d-ecac8c6d63a3 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Neutron security group 586cea97-46d2-4bdb-b7cc-90aa369a7e42 not found {{(pid=127870) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:12:23.628503 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-7f1396df-bc7c-4910-9f8d-ecac8c6d63a3 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] HTTP exception thrown: Security group 586cea97-46d2-4bdb-b7cc-90aa369a7e42 does not exist Jul 20 04:12:23.628503 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-75733463-332f-41d1-b70c-3f69cb41a0b2'] Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7f1396df-bc7c-4910-9f8d-ecac8c6d63a3 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Request method failure captured: Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 138 Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14CdRuocVW4ncBfB2vEDtwbnzTullzN2Zp32NLVwI-qGjAnCubAcwxlj_sJNaPcJzuCNafojAcMJelDJR90qXj6v65Vx_Ih3Nsh1r8jgxWfFhOUHjD-9IyDd0v-3_-8ii_G_O3VqZBr-iVSyhn00xjixKWTkYLQNC5UKde2tgUxdSps Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: aab2a3fa38e046d3b999202b271ee922 Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:12:23.633006 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:12:23.634408 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aab2a3fa38e046d3b999202b271ee922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aab2a3fa38e046d3b999202b271ee922"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aab2a3fa38e046d3b999202b271ee922", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aab2a3fa38e046d3b999202b271ee922"}]}] Jul 20 04:12:23.634408 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:23.634408 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: aab2a3fa38e046d3b999202b271ee922 Jul 20 04:12:23.634408 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:23.634408 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-133318460-project Jul 20 04:12:23.634408 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:12:23.634408 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:12:23.634408 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 97be41cf92b5420c90e53a2a30897a5d Jul 20 04:12:23.634408 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460-project Jul 20 04:12:23.634408 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:12:23.634408 n-d-826526-5 devstack@n-api.service[127870]: {"security_group_rule": {"parent_group_id": "586cea97-46d2-4bdb-b7cc-90aa369a7e42", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 20 04:12:23.634408 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: exception: Security group 586cea97-46d2-4bdb-b7cc-90aa369a7e42 does not exist Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-75733463-332f-41d1-b70c-3f69cb41a0b2'] Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'security_group_rule': {'parent_group_id': '586cea97-46d2-4bdb-b7cc-90aa369a7e42', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:12:23.635300 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 586cea97-46d2-4bdb-b7cc-90aa369a7e42 does not exist Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75733463-332f-41d1-b70c-3f69cb41a0b2'] Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 20 04:12:23.637217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 586cea97-46d2-4bdb-b7cc-90aa369a7e42 does not exist Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75733463-332f-41d1-b70c-3f69cb41a0b2'] Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 586cea97-46d2-4bdb-b7cc-90aa369a7e42 does not exist Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75733463-332f-41d1-b70c-3f69cb41a0b2'] Jul 20 04:12:23.638563 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.639933 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:23.639933 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.639933 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:23.639933 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:23.639933 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:23.639933 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:23.639933 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:23.639933 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 586cea97-46d2-4bdb-b7cc-90aa369a7e42 does not exist Jul 20 04:12:23.639933 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75733463-332f-41d1-b70c-3f69cb41a0b2'] Jul 20 04:12:23.639933 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.639933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7f1396df-bc7c-4910-9f8d-ecac8c6d63a3 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Returning 404 to user: Security group 586cea97-46d2-4bdb-b7cc-90aa369a7e42 does not exist Jul 20 04:12:23.639933 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-75733463-332f-41d1-b70c-3f69cb41a0b2'] {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:23.639933 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7f1396df-bc7c-4910-9f8d-ecac8c6d63a3 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.136122 Jul 20 04:12:23.644303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d3611e50-aab2-48fb-b91f-9f36d25cfd00 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Calling method '.version_select at 0x7f06be7605e0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:23.650300 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 396/886] 10.222.0.17 () {60 vars in 1194 bytes} [Wed Jul 20 04:12:23 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:12:23.655118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-74c62d65-38b5-4fe5-ab3c-4c87ccf7261b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:23.655799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-74c62d65-38b5-4fe5-ab3c-4c87ccf7261b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:23.663138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74c62d65-38b5-4fe5-ab3c-4c87ccf7261b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:23.663590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74c62d65-38b5-4fe5-ab3c-4c87ccf7261b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:23.665995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG neutronclient.v2_0.client [None req-d3611e50-aab2-48fb-b91f-9f36d25cfd00 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 4177767f-d135-47ca-834b-27872043369f does not exist", "detail": ""}} {{(pid=127871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:12:23.666197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.security_group_api [None req-d3611e50-aab2-48fb-b91f-9f36d25cfd00 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Neutron security group rule 4177767f-d135-47ca-834b-27872043369f not found {{(pid=127871) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 20 04:12:23.666722 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-d3611e50-aab2-48fb-b91f-9f36d25cfd00 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] HTTP exception thrown: Security group rule 4177767f-d135-47ca-834b-27872043369f does not exist Jul 20 04:12:23.666722 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-067bc9b6-4abe-4d3e-95c2-0d9c33d24873'] Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d3611e50-aab2-48fb-b91f-9f36d25cfd00 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Request method failure captured: Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/os-security-group-rules/4177767f-d135-47ca-834b-27872043369f HTTP/1.1 Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14CdRuocVW4ncBfB2vEDtwbnzTullzN2Zp32NLVwI-qGjAnCubAcwxlj_sJNaPcJzuCNafojAcMJelDJR90qXj6v65Vx_Ih3Nsh1r8jgxWfFhOUHjD-9IyDd0v-3_-8ii_G_O3VqZBr-iVSyhn00xjixKWTkYLQNC5UKde2tgUxdSps Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: aab2a3fa38e046d3b999202b271ee922 Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:12:23.668688 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:12:23.669997 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aab2a3fa38e046d3b999202b271ee922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aab2a3fa38e046d3b999202b271ee922"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aab2a3fa38e046d3b999202b271ee922", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aab2a3fa38e046d3b999202b271ee922"}]}] Jul 20 04:12:23.669997 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:23.669997 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: aab2a3fa38e046d3b999202b271ee922 Jul 20 04:12:23.669997 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460 Jul 20 04:12:23.669997 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-133318460-project Jul 20 04:12:23.669997 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:12:23.669997 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:12:23.669997 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 97be41cf92b5420c90e53a2a30897a5d Jul 20 04:12:23.669997 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-133318460-project Jul 20 04:12:23.669997 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:12:23.669997 n-d-826526-5 devstack@n-api.service[127871]: exception: Security group rule 4177767f-d135-47ca-834b-27872043369f does not exist Jul 20 04:12:23.669997 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-067bc9b6-4abe-4d3e-95c2-0d9c33d24873'] Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '4177767f-d135-47ca-834b-27872043369f'} Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:23.670801 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:23.672148 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:12:23.672148 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:12:23.672148 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:23.672148 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:23.672148 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:12:23.672148 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:12:23.672148 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:12:23.672148 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:12:23.672148 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 4177767f-d135-47ca-834b-27872043369f does not exist Jul 20 04:12:23.672148 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-067bc9b6-4abe-4d3e-95c2-0d9c33d24873'] Jul 20 04:12:23.672148 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.672148 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:23.672148 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.672148 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:23.672148 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 20 04:12:23.672148 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 20 04:12:23.672148 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 20 04:12:23.672148 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 4177767f-d135-47ca-834b-27872043369f does not exist Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-067bc9b6-4abe-4d3e-95c2-0d9c33d24873'] Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 4177767f-d135-47ca-834b-27872043369f does not exist Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-067bc9b6-4abe-4d3e-95c2-0d9c33d24873'] Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.674396 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:23.675763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.675763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:23.675763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:23.675763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:23.675763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:23.675763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:23.675763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 4177767f-d135-47ca-834b-27872043369f does not exist Jul 20 04:12:23.675763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-067bc9b6-4abe-4d3e-95c2-0d9c33d24873'] Jul 20 04:12:23.675763 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:23.675763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d3611e50-aab2-48fb-b91f-9f36d25cfd00 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Returning 404 to user: Security group rule 4177767f-d135-47ca-834b-27872043369f does not exist Jul 20 04:12:23.675763 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-067bc9b6-4abe-4d3e-95c2-0d9c33d24873'] {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:23.675763 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d3611e50-aab2-48fb-b91f-9f36d25cfd00 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-group-rules/4177767f-d135-47ca-834b-27872043369f" status: 404 len: 199 microversion: 2.1 time: 0.030814 Jul 20 04:12:23.676645 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 491/887] 10.222.0.17 () {58 vars in 1286 bytes} [Wed Jul 20 04:12:23 2022] DELETE /compute/v2.1/os-security-group-rules/4177767f-d135-47ca-834b-27872043369f => generated 199 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:12:23.681004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6d5457b0-0979-4258-8e89-cf1d241b1d7f tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Calling method '.version_select at 0x7f06be1cec10>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:23.682367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74c62d65-38b5-4fe5-ab3c-4c87ccf7261b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:23.682834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74c62d65-38b5-4fe5-ab3c-4c87ccf7261b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:23.928624 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6d5457b0-0979-4258-8e89-cf1d241b1d7f tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/99b8270c-1682-433c-b65e-ea8a451045bd" status: 202 len: 0 microversion: 2.1 time: 0.251282 Jul 20 04:12:23.929642 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 492/888] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:12:23 2022] DELETE /compute/v2.1/os-security-groups/99b8270c-1682-433c-b65e-ea8a451045bd => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:23.937396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0f8224d0-3e56-4b1d-b5b4-de431038717e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:23.938918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0f8224d0-3e56-4b1d-b5b4-de431038717e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:23.949299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f8224d0-3e56-4b1d-b5b4-de431038717e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:23.953062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f8224d0-3e56-4b1d-b5b4-de431038717e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:23.954421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f8224d0-3e56-4b1d-b5b4-de431038717e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:23.955057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f8224d0-3e56-4b1d-b5b4-de431038717e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.053562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0f8224d0-3e56-4b1d-b5b4-de431038717e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:24.063786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0f8224d0-3e56-4b1d-b5b4-de431038717e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:24.065758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0f8224d0-3e56-4b1d-b5b4-de431038717e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:24.067398 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0f8224d0-3e56-4b1d-b5b4-de431038717e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1344 microversion: 2.25 time: 0.136761 Jul 20 04:12:24.076381 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 493/889] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:23 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1344 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:24.078968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4ecd0608-97c6-4658-985a-27bc79ca9fc4 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Calling method '.version_select at 0x7f06be301c10>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:24.145908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-74c62d65-38b5-4fe5-ab3c-4c87ccf7261b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:24.157290 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-74c62d65-38b5-4fe5-ab3c-4c87ccf7261b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d" status: 200 len: 1319 microversion: 2.1 time: 0.505865 Jul 20 04:12:24.158570 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 397/890] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:23 2022] GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d => generated 1319 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:24.165313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8cccd50a-2db2-4322-937b-af57c184eafd tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:24.166131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8cccd50a-2db2-4322-937b-af57c184eafd tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:24.174221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8cccd50a-2db2-4322-937b-af57c184eafd tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.174672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8cccd50a-2db2-4322-937b-af57c184eafd tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.175448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8cccd50a-2db2-4322-937b-af57c184eafd tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.175880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8cccd50a-2db2-4322-937b-af57c184eafd tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.355875 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4ecd0608-97c6-4658-985a-27bc79ca9fc4 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/2b7516b6-bd32-4c4f-b7c5-462412c8ec72" status: 202 len: 0 microversion: 2.1 time: 0.282610 Jul 20 04:12:24.361513 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 494/891] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:12:24 2022] DELETE /compute/v2.1/os-security-groups/2b7516b6-bd32-4c4f-b7c5-462412c8ec72 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:24.373662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a25c0f33-73ed-4b92-891b-46b9322512bd tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Calling method '.version_select at 0x7f06be3e91f0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:24.651581 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a25c0f33-73ed-4b92-891b-46b9322512bd tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/3a30b57d-79d5-4fb6-9d7c-bc8da256d6ba" status: 202 len: 0 microversion: 2.1 time: 0.287863 Jul 20 04:12:24.652349 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 495/892] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:12:24 2022] DELETE /compute/v2.1/os-security-groups/3a30b57d-79d5-4fb6-9d7c-bc8da256d6ba => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:24.658668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cf5439bc-92a9-446f-b061-c70fa547211d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:24.659291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cf5439bc-92a9-446f-b061-c70fa547211d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:24.677870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf5439bc-92a9-446f-b061-c70fa547211d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.678535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf5439bc-92a9-446f-b061-c70fa547211d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.679588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf5439bc-92a9-446f-b061-c70fa547211d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.680224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf5439bc-92a9-446f-b061-c70fa547211d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.758088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8cccd50a-2db2-4322-937b-af57c184eafd tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:24.769200 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8cccd50a-2db2-4322-937b-af57c184eafd tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1504 microversion: 2.1 time: 0.609114 Jul 20 04:12:24.770842 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 398/893] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:24 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1504 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:24.776773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d5659da3-30d0-425e-8318-0081f5f86200 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:24.778042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d5659da3-30d0-425e-8318-0081f5f86200 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:24.786694 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5659da3-30d0-425e-8318-0081f5f86200 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.787876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5659da3-30d0-425e-8318-0081f5f86200 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.789355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5659da3-30d0-425e-8318-0081f5f86200 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.790127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5659da3-30d0-425e-8318-0081f5f86200 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.854694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cf5439bc-92a9-446f-b061-c70fa547211d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:24.863323 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cf5439bc-92a9-446f-b061-c70fa547211d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1389 microversion: 2.1 time: 0.209862 Jul 20 04:12:24.863911 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 496/894] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:24 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1389 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:24.868600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1df18f2b-1206-486f-b763-9df996acaa68 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Calling method '.version_select at 0x7f06be59cca0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:25.061230 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1df18f2b-1206-486f-b763-9df996acaa68 tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/07e93120-5ea5-4466-bf78-157cb91002db" status: 202 len: 0 microversion: 2.1 time: 0.196217 Jul 20 04:12:25.062383 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 497/895] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:12:24 2022] DELETE /compute/v2.1/os-security-groups/07e93120-5ea5-4466-bf78-157cb91002db => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:25.067752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-22d53c95-ab68-4835-8584-72c99648b47a req-c7b2c9de-d3db-47c1-bfa7-96576707706a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd1e4691-aad5-45a9-818f-922c3428d53f", "name": "network-vif-plugged", "status": "completed", "tag": "e20cfa31-877a-4a68-ba01-74f0bfe7d08b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:25.077128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-22d53c95-ab68-4835-8584-72c99648b47a req-c7b2c9de-d3db-47c1-bfa7-96576707706a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.077786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-22d53c95-ab68-4835-8584-72c99648b47a req-c7b2c9de-d3db-47c1-bfa7-96576707706a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:25.092286 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-22d53c95-ab68-4835-8584-72c99648b47a req-c7b2c9de-d3db-47c1-bfa7-96576707706a service nova] Creating event network-vif-plugged:e20cfa31-877a-4a68-ba01-74f0bfe7d08b for instance fd1e4691-aad5-45a9-818f-922c3428d53f on n-h2-826526-5 Jul 20 04:12:25.098484 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-22d53c95-ab68-4835-8584-72c99648b47a req-c7b2c9de-d3db-47c1-bfa7-96576707706a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034563 Jul 20 04:12:25.099398 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 498/896] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:25.105017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bc86f53c-fa3e-460d-803a-6dbf61a1f45c tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] Calling method '.version_select at 0x7f06be3e9310>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:25.380432 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bc86f53c-fa3e-460d-803a-6dbf61a1f45c tempest-SecurityGroupRulesNegativeTestJSON-133318460 tempest-SecurityGroupRulesNegativeTestJSON-133318460-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/0c00a613-9ca9-4136-9a56-519254617a3c" status: 202 len: 0 microversion: 2.1 time: 0.279155 Jul 20 04:12:25.381387 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 499/897] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:12:25 2022] DELETE /compute/v2.1/os-security-groups/0c00a613-9ca9-4136-9a56-519254617a3c => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:25.386950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f7c04461-923a-43fa-ad0d-28604cd86fda tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:25.388306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f7c04461-923a-43fa-ad0d-28604cd86fda tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:25.395914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7c04461-923a-43fa-ad0d-28604cd86fda tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.396711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7c04461-923a-43fa-ad0d-28604cd86fda tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:25.397679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7c04461-923a-43fa-ad0d-28604cd86fda tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.398467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7c04461-923a-43fa-ad0d-28604cd86fda tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:25.409494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d5659da3-30d0-425e-8318-0081f5f86200 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:25.425432 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d5659da3-30d0-425e-8318-0081f5f86200 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.646177 Jul 20 04:12:25.426293 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 399/898] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:24 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:25.438734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8a4afef5-83a1-4ee5-a4e8-9c7cedd2ffc0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:25.439511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8a4afef5-83a1-4ee5-a4e8-9c7cedd2ffc0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:25.455780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a4afef5-83a1-4ee5-a4e8-9c7cedd2ffc0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.457290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a4afef5-83a1-4ee5-a4e8-9c7cedd2ffc0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:25.458972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a4afef5-83a1-4ee5-a4e8-9c7cedd2ffc0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.459954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a4afef5-83a1-4ee5-a4e8-9c7cedd2ffc0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:25.698085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f7c04461-923a-43fa-ad0d-28604cd86fda tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:25.721919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f7c04461-923a-43fa-ad0d-28604cd86fda tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:25.723516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f7c04461-923a-43fa-ad0d-28604cd86fda tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:25.725024 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f7c04461-923a-43fa-ad0d-28604cd86fda tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1409 microversion: 2.25 time: 0.342214 Jul 20 04:12:25.733273 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 500/899] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:25 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1409 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:25.788353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-19e12837-575e-4a5a-a957-f8347819eb08 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:25.789579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-19e12837-575e-4a5a-a957-f8347819eb08 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:25.802187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19e12837-575e-4a5a-a957-f8347819eb08 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.802789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19e12837-575e-4a5a-a957-f8347819eb08 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:25.803956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19e12837-575e-4a5a-a957-f8347819eb08 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.804640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19e12837-575e-4a5a-a957-f8347819eb08 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:25.918209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8a4afef5-83a1-4ee5-a4e8-9c7cedd2ffc0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:25.927616 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8a4afef5-83a1-4ee5-a4e8-9c7cedd2ffc0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d" status: 200 len: 1469 microversion: 2.1 time: 0.498131 Jul 20 04:12:25.939016 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 400/900] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:25 2022] GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d => generated 1469 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:25.958125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6e384933-e185-4187-a39a-870382251482 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:25.959356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6e384933-e185-4187-a39a-870382251482 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:25.970297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e384933-e185-4187-a39a-870382251482 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.971169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e384933-e185-4187-a39a-870382251482 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:25.972561 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e384933-e185-4187-a39a-870382251482 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.973637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e384933-e185-4187-a39a-870382251482 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.075856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-19e12837-575e-4a5a-a957-f8347819eb08 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:26.086551 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-19e12837-575e-4a5a-a957-f8347819eb08 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1504 microversion: 2.1 time: 0.303079 Jul 20 04:12:26.087356 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 501/901] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:25 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:26.092923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-12a6cfe1-dc77-4121-8d6c-9af326e2a755 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:26.093464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-12a6cfe1-dc77-4121-8d6c-9af326e2a755 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:26.107827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-12a6cfe1-dc77-4121-8d6c-9af326e2a755 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:26.114146 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-12a6cfe1-dc77-4121-8d6c-9af326e2a755 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.115115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-12a6cfe1-dc77-4121-8d6c-9af326e2a755 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:26.115635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-12a6cfe1-dc77-4121-8d6c-9af326e2a755 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.383663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-12a6cfe1-dc77-4121-8d6c-9af326e2a755 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:26.395408 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-12a6cfe1-dc77-4121-8d6c-9af326e2a755 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2" status: 200 len: 1469 microversion: 2.1 time: 0.306183 Jul 20 04:12:26.402036 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 502/902] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:26 2022] GET /compute/v2.1/servers/8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2 => generated 1469 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:26.415043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6e384933-e185-4187-a39a-870382251482 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:26.425120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-35346fd1-3a88-4a01-96fc-3a7892eeefd1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:26.430834 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6e384933-e185-4187-a39a-870382251482 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1389 microversion: 2.1 time: 0.491504 Jul 20 04:12:26.431762 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 401/903] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:25 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1389 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:26.445817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-35346fd1-3a88-4a01-96fc-3a7892eeefd1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:26.447030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35346fd1-3a88-4a01-96fc-3a7892eeefd1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Searching by: {'reservation_id': 'r-fk5ypu1x', 'deleted': False, 'project_id': '22bcfd2698d047dea07c643970c749eb'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:12:26.450808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7fb2323e-b895-4395-bac8-0a231a42a82e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:26.451806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7fb2323e-b895-4395-bac8-0a231a42a82e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:26.461073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fb2323e-b895-4395-bac8-0a231a42a82e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:26.461710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35346fd1-3a88-4a01-96fc-3a7892eeefd1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:26.462049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fb2323e-b895-4395-bac8-0a231a42a82e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.462192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35346fd1-3a88-4a01-96fc-3a7892eeefd1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.463185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35346fd1-3a88-4a01-96fc-3a7892eeefd1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:26.463311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fb2323e-b895-4395-bac8-0a231a42a82e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:26.463631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35346fd1-3a88-4a01-96fc-3a7892eeefd1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.463931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fb2323e-b895-4395-bac8-0a231a42a82e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.583233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-35346fd1-3a88-4a01-96fc-3a7892eeefd1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:12:26.661417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-35346fd1-3a88-4a01-96fc-3a7892eeefd1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:26.672425 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35346fd1-3a88-4a01-96fc-3a7892eeefd1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:26.673128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35346fd1-3a88-4a01-96fc-3a7892eeefd1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.902841 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-35346fd1-3a88-4a01-96fc-3a7892eeefd1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?reservation_id=r-fk5ypu1x" status: 200 len: 2931 microversion: 2.1 time: 0.493407 Jul 20 04:12:26.914450 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7fb2323e-b895-4395-bac8-0a231a42a82e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:26.915374 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 503/904] 10.222.0.17 () {58 vars in 1196 bytes} [Wed Jul 20 04:12:26 2022] GET /compute/v2.1/servers/detail?reservation_id=r-fk5ypu1x => generated 2931 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:26.922594 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7fb2323e-b895-4395-bac8-0a231a42a82e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.480872 Jul 20 04:12:26.927564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f01e2bf6-f37c-4177-a387-a2dea4cb0a98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:26.928471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f01e2bf6-f37c-4177-a387-a2dea4cb0a98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:26.929617 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 402/905] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:26 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:26.936430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f01e2bf6-f37c-4177-a387-a2dea4cb0a98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:26.937303 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-986b0824-3263-405a-9352-7a09361e57dd tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:26.937875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f01e2bf6-f37c-4177-a387-a2dea4cb0a98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.942111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f01e2bf6-f37c-4177-a387-a2dea4cb0a98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:26.942561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f01e2bf6-f37c-4177-a387-a2dea4cb0a98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.975615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.compute.server_groups [None req-986b0824-3263-405a-9352-7a09361e57dd tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Querying cell fbf41b76-8148-4f7f-88f5-d6fd988c2859(cell1) for 2 instances {{(pid=127870) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:12:26.976739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-986b0824-3263-405a-9352-7a09361e57dd tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:26.977373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-986b0824-3263-405a-9352-7a09361e57dd tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.024547 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-986b0824-3263-405a-9352-7a09361e57dd tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/0fbc3d46-f5df-401f-bbdf-6f1c49042fc6" status: 200 len: 270 microversion: 2.1 time: 0.090338 Jul 20 04:12:27.025855 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 403/906] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:12:26 2022] GET /compute/v2.1/os-server-groups/0fbc3d46-f5df-401f-bbdf-6f1c49042fc6 => generated 270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:27.046445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9057ea6e-772f-4844-ba1a-25b2e631d985 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:27.047073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9057ea6e-772f-4844-ba1a-25b2e631d985 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:27.054314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9057ea6e-772f-4844-ba1a-25b2e631d985 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.055033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9057ea6e-772f-4844-ba1a-25b2e631d985 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.055990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9057ea6e-772f-4844-ba1a-25b2e631d985 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.061133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9057ea6e-772f-4844-ba1a-25b2e631d985 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.262794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f01e2bf6-f37c-4177-a387-a2dea4cb0a98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:27.277625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f01e2bf6-f37c-4177-a387-a2dea4cb0a98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:27.279430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f01e2bf6-f37c-4177-a387-a2dea4cb0a98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:27.285414 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f01e2bf6-f37c-4177-a387-a2dea4cb0a98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1409 microversion: 2.25 time: 0.368587 Jul 20 04:12:27.296234 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 504/907] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:26 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1409 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:27.298910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-4867282d-84c0-4319-9482-cae53be6b2d0 req-9485cc75-0c49-4315-ac97-dd581f46127b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a04f4bb0-5809-44b5-bb51-63bd97076afc", "name": "network-vif-unplugged", "status": "completed", "tag": "754db640-ac88-45b2-8510-52b75fd6b650"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:27.323972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4867282d-84c0-4319-9482-cae53be6b2d0 req-9485cc75-0c49-4315-ac97-dd581f46127b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.325079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4867282d-84c0-4319-9482-cae53be6b2d0 req-9485cc75-0c49-4315-ac97-dd581f46127b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.338231 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-4867282d-84c0-4319-9482-cae53be6b2d0 req-9485cc75-0c49-4315-ac97-dd581f46127b service nova] Creating event network-vif-unplugged:754db640-ac88-45b2-8510-52b75fd6b650 for instance a04f4bb0-5809-44b5-bb51-63bd97076afc on n-h1-826526-5 Jul 20 04:12:27.356437 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-4867282d-84c0-4319-9482-cae53be6b2d0 req-9485cc75-0c49-4315-ac97-dd581f46127b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061700 Jul 20 04:12:27.358203 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 505/908] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:27.365628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4f3ae3a7-dd2b-42c1-ab30-127faf6b3091 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:27.366580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4f3ae3a7-dd2b-42c1-ab30-127faf6b3091 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:27.374872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f3ae3a7-dd2b-42c1-ab30-127faf6b3091 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.376194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f3ae3a7-dd2b-42c1-ab30-127faf6b3091 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.377179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f3ae3a7-dd2b-42c1-ab30-127faf6b3091 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.377768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f3ae3a7-dd2b-42c1-ab30-127faf6b3091 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.614582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4f3ae3a7-dd2b-42c1-ab30-127faf6b3091 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:27.624797 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4f3ae3a7-dd2b-42c1-ab30-127faf6b3091 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1504 microversion: 2.1 time: 0.265509 Jul 20 04:12:27.629872 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 506/909] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:27 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:27.634849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-044c5c3f-cdd2-4d07-a7ee-17b499169d0f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:27.636584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-044c5c3f-cdd2-4d07-a7ee-17b499169d0f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:27.648408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-044c5c3f-cdd2-4d07-a7ee-17b499169d0f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.649448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-044c5c3f-cdd2-4d07-a7ee-17b499169d0f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.651087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-044c5c3f-cdd2-4d07-a7ee-17b499169d0f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.651731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-044c5c3f-cdd2-4d07-a7ee-17b499169d0f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.886610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-044c5c3f-cdd2-4d07-a7ee-17b499169d0f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:27.900951 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-044c5c3f-cdd2-4d07-a7ee-17b499169d0f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1588 microversion: 2.1 time: 0.269419 Jul 20 04:12:27.914798 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 507/910] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:27 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1588 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:27.920245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3b141747-6934-49b3-9229-8166b83a99ed tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:27.920776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3b141747-6934-49b3-9229-8166b83a99ed tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:27.931929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b141747-6934-49b3-9229-8166b83a99ed tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.932444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b141747-6934-49b3-9229-8166b83a99ed tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.933224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b141747-6934-49b3-9229-8166b83a99ed tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.933663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b141747-6934-49b3-9229-8166b83a99ed tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.951367 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9057ea6e-772f-4844-ba1a-25b2e631d985 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d" status: 200 len: 1620 microversion: 2.1 time: 0.919175 Jul 20 04:12:27.965539 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 404/911] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:27 2022] GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d => generated 1620 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:27.971472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f53ce57f-e4dc-4efd-a92d-06c66acbd380 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:27.972146 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f53ce57f-e4dc-4efd-a92d-06c66acbd380 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:27.985124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f53ce57f-e4dc-4efd-a92d-06c66acbd380 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.990775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f53ce57f-e4dc-4efd-a92d-06c66acbd380 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.992202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f53ce57f-e4dc-4efd-a92d-06c66acbd380 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.992699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f53ce57f-e4dc-4efd-a92d-06c66acbd380 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:28.280420 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3b141747-6934-49b3-9229-8166b83a99ed tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.355348 Jul 20 04:12:28.281908 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 508/912] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:12:27 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f/os-interface => generated 285 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:12:28.291359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-75a56633-9828-4a97-ac46-2e0d30ee60ea tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:28.295331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-75a56633-9828-4a97-ac46-2e0d30ee60ea tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] [instance: 8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:28.309831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-75a56633-9828-4a97-ac46-2e0d30ee60ea tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:28.310961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-75a56633-9828-4a97-ac46-2e0d30ee60ea tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:28.314416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-75a56633-9828-4a97-ac46-2e0d30ee60ea tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:28.315212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-75a56633-9828-4a97-ac46-2e0d30ee60ea tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:28.555346 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f53ce57f-e4dc-4efd-a92d-06c66acbd380 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:28.564343 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f53ce57f-e4dc-4efd-a92d-06c66acbd380 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.597877 Jul 20 04:12:28.577071 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 405/913] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:27 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:28.590326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a26803de-922a-49cb-85bb-accb7be57773 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:28.597133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a26803de-922a-49cb-85bb-accb7be57773 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:28.603852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a26803de-922a-49cb-85bb-accb7be57773 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:28.606945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a26803de-922a-49cb-85bb-accb7be57773 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:28.610964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a26803de-922a-49cb-85bb-accb7be57773 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:28.611546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a26803de-922a-49cb-85bb-accb7be57773 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:28.795057 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-75a56633-9828-4a97-ac46-2e0d30ee60ea tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2" status: 200 len: 1620 microversion: 2.1 time: 0.507243 Jul 20 04:12:28.795653 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 509/914] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:28 2022] GET /compute/v2.1/servers/8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2 => generated 1620 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:29.042773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-07465c37-00ae-43f5-b2d8-ec84ee6faea2 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-595959512", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "65385724-80c3-4ca5-b3ce-61c65c2fb2ee"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:29.154656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-07465c37-00ae-43f5-b2d8-ec84ee6faea2 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] validate_networks() for [('65385724-80c3-4ca5-b3ce-61c65c2fb2ee', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:30.125611 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a26803de-922a-49cb-85bb-accb7be57773 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:30.146517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a26803de-922a-49cb-85bb-accb7be57773 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:30.150637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a26803de-922a-49cb-85bb-accb7be57773 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:30.168339 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a26803de-922a-49cb-85bb-accb7be57773 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1409 microversion: 2.25 time: 1.587046 Jul 20 04:12:30.183610 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 406/915] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:28 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1409 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:30.203977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-904fb493-cfc0-4830-9645-3138ede6188b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.204655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-904fb493-cfc0-4830-9645-3138ede6188b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:30.238254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-904fb493-cfc0-4830-9645-3138ede6188b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.240207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-904fb493-cfc0-4830-9645-3138ede6188b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.241169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-904fb493-cfc0-4830-9645-3138ede6188b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.245347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-904fb493-cfc0-4830-9645-3138ede6188b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.606914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-904fb493-cfc0-4830-9645-3138ede6188b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:30.631983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-07465c37-00ae-43f5-b2d8-ec84ee6faea2 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:30.633536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-07465c37-00ae-43f5-b2d8-ec84ee6faea2 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:30.635985 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-904fb493-cfc0-4830-9645-3138ede6188b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1504 microversion: 2.1 time: 0.447108 Jul 20 04:12:30.637327 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 407/916] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1504 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:30.644490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b780f17d-6cfd-40ca-a0db-f1b5627cbcb7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1053865789", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "23481b1e-fe28-4f48-84fe-f22cae89ac46"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:30.658484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-07465c37-00ae-43f5-b2d8-ec84ee6faea2 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:30.659300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-07465c37-00ae-43f5-b2d8-ec84ee6faea2 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:30.659928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-07465c37-00ae-43f5-b2d8-ec84ee6faea2 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:30.671549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07465c37-00ae-43f5-b2d8-ec84ee6faea2 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.672447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07465c37-00ae-43f5-b2d8-ec84ee6faea2 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.673534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07465c37-00ae-43f5-b2d8-ec84ee6faea2 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.674203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07465c37-00ae-43f5-b2d8-ec84ee6faea2 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.729421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-07465c37-00ae-43f5-b2d8-ec84ee6faea2 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Getting quotas for project ac9ed7d8ff004e9687aba528e0edad98. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:30.738278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-07465c37-00ae-43f5-b2d8-ec84ee6faea2 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Getting quotas for user e91725faefeb4057ba4990810a8fbd25 and project ac9ed7d8ff004e9687aba528e0edad98. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:30.752659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-b780f17d-6cfd-40ca-a0db-f1b5627cbcb7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] validate_networks() for None {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:30.762638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-07465c37-00ae-43f5-b2d8-ec84ee6faea2 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:30.767121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-07465c37-00ae-43f5-b2d8-ec84ee6faea2 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:30.843568 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-07465c37-00ae-43f5-b2d8-ec84ee6faea2 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.046796 Jul 20 04:12:30.851408 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 510/917] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 04:12:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2055 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:12:30.867644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b5303e3a-36ea-425a-bfab-381c5fb331f7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.868808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b5303e3a-36ea-425a-bfab-381c5fb331f7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:30.885708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5303e3a-36ea-425a-bfab-381c5fb331f7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.886513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5303e3a-36ea-425a-bfab-381c5fb331f7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.889672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5303e3a-36ea-425a-bfab-381c5fb331f7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.891311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5303e3a-36ea-425a-bfab-381c5fb331f7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:31.270520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b5303e3a-36ea-425a-bfab-381c5fb331f7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:31.283027 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b5303e3a-36ea-425a-bfab-381c5fb331f7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.427374 Jul 20 04:12:31.285008 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 511/918] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:31.292075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-153d3bc5-578b-46ca-946f-08a39bc0d308 req-96a05403-deee-4242-9a68-7440f9b75c2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b80122a5-6106-4f62-9d72-5623e8ac0ca7", "tag": "7bc8d479-2b71-4938-aa7d-6a3906728f9d"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:31.322532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-153d3bc5-578b-46ca-946f-08a39bc0d308 req-96a05403-deee-4242-9a68-7440f9b75c2a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:31.323181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-153d3bc5-578b-46ca-946f-08a39bc0d308 req-96a05403-deee-4242-9a68-7440f9b75c2a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:31.351813 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-153d3bc5-578b-46ca-946f-08a39bc0d308 req-96a05403-deee-4242-9a68-7440f9b75c2a service nova] Creating event network-changed:7bc8d479-2b71-4938-aa7d-6a3906728f9d for instance b80122a5-6106-4f62-9d72-5623e8ac0ca7 on n-h1-826526-5 Jul 20 04:12:31.362416 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-153d3bc5-578b-46ca-946f-08a39bc0d308 req-96a05403-deee-4242-9a68-7440f9b75c2a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074663 Jul 20 04:12:31.368179 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 512/919] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:31.373780 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-88cad96f-2c75-4ac2-b2aa-a0a6446dffdf tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "119abd92-df58-449e-8ea6-59b9faa46938"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:31.374995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-88cad96f-2c75-4ac2-b2aa-a0a6446dffdf tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:31.409238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88cad96f-2c75-4ac2-b2aa-a0a6446dffdf tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:31.410281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88cad96f-2c75-4ac2-b2aa-a0a6446dffdf tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:31.413356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88cad96f-2c75-4ac2-b2aa-a0a6446dffdf tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:31.417381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88cad96f-2c75-4ac2-b2aa-a0a6446dffdf tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:31.499250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:31.527125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=38 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:32.073200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b780f17d-6cfd-40ca-a0db-f1b5627cbcb7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:32.073845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b780f17d-6cfd-40ca-a0db-f1b5627cbcb7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:32.074462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b780f17d-6cfd-40ca-a0db-f1b5627cbcb7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:32.075016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b780f17d-6cfd-40ca-a0db-f1b5627cbcb7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:32.075607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b780f17d-6cfd-40ca-a0db-f1b5627cbcb7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:32.090477 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-88cad96f-2c75-4ac2-b2aa-a0a6446dffdf tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "POST /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.720168 Jul 20 04:12:32.091535 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 513/920] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 04:12:31 2022] POST /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2/os-volume_attachments => generated 194 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:32.092842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b780f17d-6cfd-40ca-a0db-f1b5627cbcb7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.094662 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b780f17d-6cfd-40ca-a0db-f1b5627cbcb7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.095867 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b780f17d-6cfd-40ca-a0db-f1b5627cbcb7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.098183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b780f17d-6cfd-40ca-a0db-f1b5627cbcb7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.134255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ce55eee4-a3b6-414c-8d6e-b0930a5df056 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:32.134959 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ce55eee4-a3b6-414c-8d6e-b0930a5df056 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:32.155670 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-b780f17d-6cfd-40ca-a0db-f1b5627cbcb7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for project 22bcfd2698d047dea07c643970c749eb. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:32.166915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce55eee4-a3b6-414c-8d6e-b0930a5df056 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.167369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce55eee4-a3b6-414c-8d6e-b0930a5df056 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.168159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce55eee4-a3b6-414c-8d6e-b0930a5df056 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.169711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-b780f17d-6cfd-40ca-a0db-f1b5627cbcb7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for user 5e178243e1ed404092e5ea0be39d5c16 and project 22bcfd2698d047dea07c643970c749eb. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:32.180882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce55eee4-a3b6-414c-8d6e-b0930a5df056 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.184205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:32.211819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b780f17d-6cfd-40ca-a0db-f1b5627cbcb7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:32.214909 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b780f17d-6cfd-40ca-a0db-f1b5627cbcb7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:32.294302 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b780f17d-6cfd-40ca-a0db-f1b5627cbcb7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.656042 Jul 20 04:12:32.295534 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 408/921] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:12:32.307536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9c9a2e3b-d85b-4031-85a3-6685b57883bd tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:32.309251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9c9a2e3b-d85b-4031-85a3-6685b57883bd tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:32.326065 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c9a2e3b-d85b-4031-85a3-6685b57883bd tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.329743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c9a2e3b-d85b-4031-85a3-6685b57883bd tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.331235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c9a2e3b-d85b-4031-85a3-6685b57883bd tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.340881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c9a2e3b-d85b-4031-85a3-6685b57883bd tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.441427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ce55eee4-a3b6-414c-8d6e-b0930a5df056 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:32.455891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ce55eee4-a3b6-414c-8d6e-b0930a5df056 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:32.457977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ce55eee4-a3b6-414c-8d6e-b0930a5df056 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:32.464051 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ce55eee4-a3b6-414c-8d6e-b0930a5df056 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 200 len: 1310 microversion: 2.21 time: 0.370168 Jul 20 04:12:32.472870 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 514/922] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:32 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 1310 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:32.495736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2b5de899-6c95-49a5-89c4-bd09e98f0a36 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:32.497093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2b5de899-6c95-49a5-89c4-bd09e98f0a36 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:32.520590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b5de899-6c95-49a5-89c4-bd09e98f0a36 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.521606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b5de899-6c95-49a5-89c4-bd09e98f0a36 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.522428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b5de899-6c95-49a5-89c4-bd09e98f0a36 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.525789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b5de899-6c95-49a5-89c4-bd09e98f0a36 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.620861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9c9a2e3b-d85b-4031-85a3-6685b57883bd tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:32.637287 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9c9a2e3b-d85b-4031-85a3-6685b57883bd tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:32.641788 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9c9a2e3b-d85b-4031-85a3-6685b57883bd tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:32.644083 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9c9a2e3b-d85b-4031-85a3-6685b57883bd tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1409 microversion: 2.25 time: 0.346818 Jul 20 04:12:32.645324 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 409/923] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:32 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1409 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:32.651488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c92f0ad0-49bd-4366-a506-c8a39841f9d6 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:32.652417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c92f0ad0-49bd-4366-a506-c8a39841f9d6 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:32.660435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c92f0ad0-49bd-4366-a506-c8a39841f9d6 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.661241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c92f0ad0-49bd-4366-a506-c8a39841f9d6 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.662471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c92f0ad0-49bd-4366-a506-c8a39841f9d6 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.663068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c92f0ad0-49bd-4366-a506-c8a39841f9d6 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.942159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c92f0ad0-49bd-4366-a506-c8a39841f9d6 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:32.953498 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c92f0ad0-49bd-4366-a506-c8a39841f9d6 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1588 microversion: 2.1 time: 0.306615 Jul 20 04:12:32.960870 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 410/924] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:32 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1588 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:32.978184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-40146cfb-72fd-4aef-94f0-7a3419208e4f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:32.978811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-40146cfb-72fd-4aef-94f0-7a3419208e4f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:32.991862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40146cfb-72fd-4aef-94f0-7a3419208e4f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.994839 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40146cfb-72fd-4aef-94f0-7a3419208e4f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.995820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40146cfb-72fd-4aef-94f0-7a3419208e4f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.996452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40146cfb-72fd-4aef-94f0-7a3419208e4f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.014113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2b5de899-6c95-49a5-89c4-bd09e98f0a36 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:33.034485 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2b5de899-6c95-49a5-89c4-bd09e98f0a36 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1504 microversion: 2.1 time: 0.546306 Jul 20 04:12:33.036072 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 515/925] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:32 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1504 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:33.042095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e68f1b78-6211-4ba6-a557-ceb39a59a5c8 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:33.043174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e68f1b78-6211-4ba6-a557-ceb39a59a5c8 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:33.059247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:33.124313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e68f1b78-6211-4ba6-a557-ceb39a59a5c8 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:33.134944 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e68f1b78-6211-4ba6-a557-ceb39a59a5c8 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 200 len: 1217 microversion: 2.1 time: 0.097477 Jul 20 04:12:33.141043 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 516/926] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:33 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:33.269567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-40146cfb-72fd-4aef-94f0-7a3419208e4f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:33.279843 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-40146cfb-72fd-4aef-94f0-7a3419208e4f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.317643 Jul 20 04:12:33.281846 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 411/927] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:32 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:33.440536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-7bd2c14b-2ec3-431a-868d-0eeea27f5e92 req-5d7681be-96d2-4ecf-984c-eaa592634e00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a04f4bb0-5809-44b5-bb51-63bd97076afc", "tag": "754db640-ac88-45b2-8510-52b75fd6b650"}, {"name": "network-changed", "server_uuid": "fd1e4691-aad5-45a9-818f-922c3428d53f", "tag": "e20cfa31-877a-4a68-ba01-74f0bfe7d08b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:33.458220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7bd2c14b-2ec3-431a-868d-0eeea27f5e92 req-5d7681be-96d2-4ecf-984c-eaa592634e00 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.459279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7bd2c14b-2ec3-431a-868d-0eeea27f5e92 req-5d7681be-96d2-4ecf-984c-eaa592634e00 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.472477 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-7bd2c14b-2ec3-431a-868d-0eeea27f5e92 req-5d7681be-96d2-4ecf-984c-eaa592634e00 service nova] Creating event network-changed:754db640-ac88-45b2-8510-52b75fd6b650 for instance a04f4bb0-5809-44b5-bb51-63bd97076afc on n-h1-826526-5 Jul 20 04:12:33.473371 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-7bd2c14b-2ec3-431a-868d-0eeea27f5e92 req-5d7681be-96d2-4ecf-984c-eaa592634e00 service nova] Creating event network-changed:e20cfa31-877a-4a68-ba01-74f0bfe7d08b for instance fd1e4691-aad5-45a9-818f-922c3428d53f on n-h2-826526-5 Jul 20 04:12:33.483592 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-7bd2c14b-2ec3-431a-868d-0eeea27f5e92 req-5d7681be-96d2-4ecf-984c-eaa592634e00 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047556 Jul 20 04:12:33.495223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-da2ac6cc-3341-4da6-abed-7815a91e617e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:33.496651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-da2ac6cc-3341-4da6-abed-7815a91e617e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:33.502602 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 517/928] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:33.507591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da2ac6cc-3341-4da6-abed-7815a91e617e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.508339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da2ac6cc-3341-4da6-abed-7815a91e617e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.509527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da2ac6cc-3341-4da6-abed-7815a91e617e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.510442 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da2ac6cc-3341-4da6-abed-7815a91e617e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.605893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-da2ac6cc-3341-4da6-abed-7815a91e617e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:33.618270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-da2ac6cc-3341-4da6-abed-7815a91e617e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:33.621981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-da2ac6cc-3341-4da6-abed-7815a91e617e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:33.623144 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-da2ac6cc-3341-4da6-abed-7815a91e617e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 200 len: 1310 microversion: 2.21 time: 0.135945 Jul 20 04:12:33.623717 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 412/929] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:33 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 1310 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:12:33.667486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ee26df92-34b6-41e5-b8f5-5a81c84abd97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:33.668325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ee26df92-34b6-41e5-b8f5-5a81c84abd97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:33.681057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee26df92-34b6-41e5-b8f5-5a81c84abd97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.681574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee26df92-34b6-41e5-b8f5-5a81c84abd97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.683348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee26df92-34b6-41e5-b8f5-5a81c84abd97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.683999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee26df92-34b6-41e5-b8f5-5a81c84abd97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.002009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ee26df92-34b6-41e5-b8f5-5a81c84abd97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:34.017787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ee26df92-34b6-41e5-b8f5-5a81c84abd97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:34.025632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ee26df92-34b6-41e5-b8f5-5a81c84abd97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:34.030652 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ee26df92-34b6-41e5-b8f5-5a81c84abd97 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1409 microversion: 2.25 time: 0.369430 Jul 20 04:12:34.032284 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 518/930] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:33 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1409 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:34.051772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-598d215c-665a-4aed-b73d-58022a920294 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:34.052415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-598d215c-665a-4aed-b73d-58022a920294 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:34.062585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-598d215c-665a-4aed-b73d-58022a920294 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.063047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-598d215c-665a-4aed-b73d-58022a920294 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.063831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-598d215c-665a-4aed-b73d-58022a920294 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.064291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-598d215c-665a-4aed-b73d-58022a920294 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.159736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-60ce6c61-2d35-4b60-8cb2-807c4d3ca4bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:34.160299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-60ce6c61-2d35-4b60-8cb2-807c4d3ca4bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:34.173684 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60ce6c61-2d35-4b60-8cb2-807c4d3ca4bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.176710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60ce6c61-2d35-4b60-8cb2-807c4d3ca4bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.177653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60ce6c61-2d35-4b60-8cb2-807c4d3ca4bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.178108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60ce6c61-2d35-4b60-8cb2-807c4d3ca4bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.403264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-60ce6c61-2d35-4b60-8cb2-807c4d3ca4bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:34.414775 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-60ce6c61-2d35-4b60-8cb2-807c4d3ca4bc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 200 len: 1269 microversion: 2.1 time: 0.261179 Jul 20 04:12:34.424367 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 519/931] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:34 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 1269 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:34.434043 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-02b9434d-ff54-43c1-bd95-03ce14f57833 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:34.435467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-02b9434d-ff54-43c1-bd95-03ce14f57833 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:34.448402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-02b9434d-ff54-43c1-bd95-03ce14f57833 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.449031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-02b9434d-ff54-43c1-bd95-03ce14f57833 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.449984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-02b9434d-ff54-43c1-bd95-03ce14f57833 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.450788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-02b9434d-ff54-43c1-bd95-03ce14f57833 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.504050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-598d215c-665a-4aed-b73d-58022a920294 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:34.515734 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-598d215c-665a-4aed-b73d-58022a920294 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1504 microversion: 2.1 time: 0.467679 Jul 20 04:12:34.519331 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 413/932] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:34 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1504 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:34.641495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4cd58e4c-dfcf-480a-8ccb-fb40a92fe25e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:34.642792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4cd58e4c-dfcf-480a-8ccb-fb40a92fe25e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:34.650524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cd58e4c-dfcf-480a-8ccb-fb40a92fe25e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.664136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cd58e4c-dfcf-480a-8ccb-fb40a92fe25e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.665254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cd58e4c-dfcf-480a-8ccb-fb40a92fe25e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.665960 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cd58e4c-dfcf-480a-8ccb-fb40a92fe25e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.889578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4cd58e4c-dfcf-480a-8ccb-fb40a92fe25e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:34.902877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4cd58e4c-dfcf-480a-8ccb-fb40a92fe25e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:34.905159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4cd58e4c-dfcf-480a-8ccb-fb40a92fe25e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:34.910652 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4cd58e4c-dfcf-480a-8ccb-fb40a92fe25e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 200 len: 1316 microversion: 2.21 time: 0.273072 Jul 20 04:12:34.914536 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 414/933] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:34 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:12:35.049838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2ac25755-7284-4d09-ab61-c21686067093 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:35.050458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2ac25755-7284-4d09-ab61-c21686067093 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:35.064598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ac25755-7284-4d09-ab61-c21686067093 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:35.065047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ac25755-7284-4d09-ab61-c21686067093 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:35.065818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ac25755-7284-4d09-ab61-c21686067093 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:35.072191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ac25755-7284-4d09-ab61-c21686067093 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:35.253172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-02b9434d-ff54-43c1-bd95-03ce14f57833 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:35.262006 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-02b9434d-ff54-43c1-bd95-03ce14f57833 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.840950 Jul 20 04:12:35.279246 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 520/934] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:34 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:35.432097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e5c1bbee-252b-4753-ba3f-447e5687483d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:35.433056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e5c1bbee-252b-4753-ba3f-447e5687483d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:35.441166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5c1bbee-252b-4753-ba3f-447e5687483d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:35.450712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5c1bbee-252b-4753-ba3f-447e5687483d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:35.451783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5c1bbee-252b-4753-ba3f-447e5687483d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:35.452507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5c1bbee-252b-4753-ba3f-447e5687483d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:35.605011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e5c1bbee-252b-4753-ba3f-447e5687483d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:35.608217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2ac25755-7284-4d09-ab61-c21686067093 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:35.619212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2ac25755-7284-4d09-ab61-c21686067093 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:35.623588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2ac25755-7284-4d09-ab61-c21686067093 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:35.625333 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2ac25755-7284-4d09-ab61-c21686067093 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1409 microversion: 2.25 time: 0.579975 Jul 20 04:12:35.636489 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e5c1bbee-252b-4753-ba3f-447e5687483d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 200 len: 1275 microversion: 2.1 time: 0.203349 Jul 20 04:12:35.636489 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 521/935] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:35 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 1275 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:35.637248 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 415/936] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:35 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1409 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:12:35.650928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6a2aaba9-d786-436f-b500-d28ed4b2e0b3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:35.651548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6a2aaba9-d786-436f-b500-d28ed4b2e0b3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:35.660096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a2aaba9-d786-436f-b500-d28ed4b2e0b3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:35.660660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a2aaba9-d786-436f-b500-d28ed4b2e0b3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:35.662189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a2aaba9-d786-436f-b500-d28ed4b2e0b3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:35.662810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a2aaba9-d786-436f-b500-d28ed4b2e0b3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:35.933059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-55f927ad-fb86-4cdf-9c6f-c58078fd5ecf tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:35.935067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-55f927ad-fb86-4cdf-9c6f-c58078fd5ecf tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:35.949342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-55f927ad-fb86-4cdf-9c6f-c58078fd5ecf tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:35.950771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-55f927ad-fb86-4cdf-9c6f-c58078fd5ecf tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:35.952061 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-55f927ad-fb86-4cdf-9c6f-c58078fd5ecf tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:35.953315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-55f927ad-fb86-4cdf-9c6f-c58078fd5ecf tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.077500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-55f927ad-fb86-4cdf-9c6f-c58078fd5ecf tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:36.085517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-55f927ad-fb86-4cdf-9c6f-c58078fd5ecf tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:36.087022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-55f927ad-fb86-4cdf-9c6f-c58078fd5ecf tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:36.088355 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-55f927ad-fb86-4cdf-9c6f-c58078fd5ecf tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 200 len: 1316 microversion: 2.21 time: 0.161066 Jul 20 04:12:36.089568 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 416/937] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:35 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:12:36.096545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e7731583-a1a9-4a23-8c0c-252225f961c8 req-dba0537d-6df4-4e8d-a55d-fcb0280984f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a04f4bb0-5809-44b5-bb51-63bd97076afc", "name": "network-vif-unplugged", "status": "completed", "tag": "754db640-ac88-45b2-8510-52b75fd6b650"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:36.106633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e7731583-a1a9-4a23-8c0c-252225f961c8 req-dba0537d-6df4-4e8d-a55d-fcb0280984f8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.107401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e7731583-a1a9-4a23-8c0c-252225f961c8 req-dba0537d-6df4-4e8d-a55d-fcb0280984f8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.123120 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e7731583-a1a9-4a23-8c0c-252225f961c8 req-dba0537d-6df4-4e8d-a55d-fcb0280984f8 service nova] Creating event network-vif-unplugged:754db640-ac88-45b2-8510-52b75fd6b650 for instance a04f4bb0-5809-44b5-bb51-63bd97076afc on n-h1-826526-5 Jul 20 04:12:36.130570 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e7731583-a1a9-4a23-8c0c-252225f961c8 req-dba0537d-6df4-4e8d-a55d-fcb0280984f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038907 Jul 20 04:12:36.132381 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 417/938] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:36.306382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c456282d-b22a-4f5c-b2b7-34b016028bfc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:36.318901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c456282d-b22a-4f5c-b2b7-34b016028bfc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:36.330384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c456282d-b22a-4f5c-b2b7-34b016028bfc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.330837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c456282d-b22a-4f5c-b2b7-34b016028bfc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.331705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c456282d-b22a-4f5c-b2b7-34b016028bfc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.332384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c456282d-b22a-4f5c-b2b7-34b016028bfc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.539974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6a2aaba9-d786-436f-b500-d28ed4b2e0b3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:36.567351 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6a2aaba9-d786-436f-b500-d28ed4b2e0b3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1504 microversion: 2.1 time: 0.918537 Jul 20 04:12:36.584837 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 522/939] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:35 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1504 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:36.605372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c456282d-b22a-4f5c-b2b7-34b016028bfc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:36.617635 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c456282d-b22a-4f5c-b2b7-34b016028bfc tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.321388 Jul 20 04:12:36.626999 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 418/940] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:36 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:36.653568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-02c7caf9-6171-41ce-931e-7ca86b33892c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:36.654451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-02c7caf9-6171-41ce-931e-7ca86b33892c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:36.656819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:36.657799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-16d303aa-9954-4b7e-992a-c5cd1b04827c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:36.658594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-16d303aa-9954-4b7e-992a-c5cd1b04827c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:36.679761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02c7caf9-6171-41ce-931e-7ca86b33892c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.681184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-16d303aa-9954-4b7e-992a-c5cd1b04827c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.681417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02c7caf9-6171-41ce-931e-7ca86b33892c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.682121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-16d303aa-9954-4b7e-992a-c5cd1b04827c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.683207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02c7caf9-6171-41ce-931e-7ca86b33892c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.683472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-16d303aa-9954-4b7e-992a-c5cd1b04827c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.684211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-16d303aa-9954-4b7e-992a-c5cd1b04827c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.684978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02c7caf9-6171-41ce-931e-7ca86b33892c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.879719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-02c7caf9-6171-41ce-931e-7ca86b33892c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:36.898219 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-02c7caf9-6171-41ce-931e-7ca86b33892c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 200 len: 1275 microversion: 2.1 time: 0.241483 Jul 20 04:12:36.898349 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 419/941] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:36 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 1275 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:36.962034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-2d876dd9-393c-4e4c-94b9-f25bb4fa9b71 req-38c502de-ba96-4ed6-ab59-d2d45e61fee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80122a5-6106-4f62-9d72-5623e8ac0ca7", "name": "network-vif-plugged", "status": "completed", "tag": "7bc8d479-2b71-4938-aa7d-6a3906728f9d"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:36.979408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2d876dd9-393c-4e4c-94b9-f25bb4fa9b71 req-38c502de-ba96-4ed6-ab59-d2d45e61fee0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.981005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2d876dd9-393c-4e4c-94b9-f25bb4fa9b71 req-38c502de-ba96-4ed6-ab59-d2d45e61fee0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:37.008894 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-2d876dd9-393c-4e4c-94b9-f25bb4fa9b71 req-38c502de-ba96-4ed6-ab59-d2d45e61fee0 service nova] Creating event network-vif-plugged:7bc8d479-2b71-4938-aa7d-6a3906728f9d for instance b80122a5-6106-4f62-9d72-5623e8ac0ca7 on n-h1-826526-5 Jul 20 04:12:37.024323 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-2d876dd9-393c-4e4c-94b9-f25bb4fa9b71 req-38c502de-ba96-4ed6-ab59-d2d45e61fee0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066255 Jul 20 04:12:37.025276 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 420/942] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:37.107376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9c924b44-baf4-4471-a220-1f2a48ed5bb0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:37.108173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9c924b44-baf4-4471-a220-1f2a48ed5bb0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:37.124126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c924b44-baf4-4471-a220-1f2a48ed5bb0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:37.124645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c924b44-baf4-4471-a220-1f2a48ed5bb0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:37.125437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c924b44-baf4-4471-a220-1f2a48ed5bb0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:37.125879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c924b44-baf4-4471-a220-1f2a48ed5bb0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:37.374983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-16d303aa-9954-4b7e-992a-c5cd1b04827c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:37.387824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-16d303aa-9954-4b7e-992a-c5cd1b04827c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:37.392527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-16d303aa-9954-4b7e-992a-c5cd1b04827c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:37.401830 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-16d303aa-9954-4b7e-992a-c5cd1b04827c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1409 microversion: 2.25 time: 0.761535 Jul 20 04:12:37.403026 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 523/943] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:36 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1409 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:37.589417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2c57109f-76e8-434b-89c4-cafd30fe9fb7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:37.590093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2c57109f-76e8-434b-89c4-cafd30fe9fb7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:37.599453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c57109f-76e8-434b-89c4-cafd30fe9fb7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:37.603916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c57109f-76e8-434b-89c4-cafd30fe9fb7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:37.607712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c57109f-76e8-434b-89c4-cafd30fe9fb7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:37.608525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c57109f-76e8-434b-89c4-cafd30fe9fb7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.086719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2c57109f-76e8-434b-89c4-cafd30fe9fb7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:38.097818 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2c57109f-76e8-434b-89c4-cafd30fe9fb7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1504 microversion: 2.1 time: 0.512263 Jul 20 04:12:38.098416 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 524/944] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:37 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1504 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:38.112008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5bed6a47-6b3d-4f82-bda3-01fa1399d3f7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:38.120657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5bed6a47-6b3d-4f82-bda3-01fa1399d3f7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:38.134870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5bed6a47-6b3d-4f82-bda3-01fa1399d3f7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.135598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5bed6a47-6b3d-4f82-bda3-01fa1399d3f7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.136583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5bed6a47-6b3d-4f82-bda3-01fa1399d3f7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.139045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5bed6a47-6b3d-4f82-bda3-01fa1399d3f7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.178605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9c924b44-baf4-4471-a220-1f2a48ed5bb0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:38.188111 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9c924b44-baf4-4471-a220-1f2a48ed5bb0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:38.196555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9c924b44-baf4-4471-a220-1f2a48ed5bb0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:38.197994 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9c924b44-baf4-4471-a220-1f2a48ed5bb0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 200 len: 1358 microversion: 2.21 time: 1.095069 Jul 20 04:12:38.198748 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 421/945] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:37 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 1358 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:12:38.219472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-860553cc-c6dc-4ea3-bebb-9fd093d5310b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:38.223619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-860553cc-c6dc-4ea3-bebb-9fd093d5310b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:38.234627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-860553cc-c6dc-4ea3-bebb-9fd093d5310b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.240056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-860553cc-c6dc-4ea3-bebb-9fd093d5310b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.241124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-860553cc-c6dc-4ea3-bebb-9fd093d5310b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.241725 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-860553cc-c6dc-4ea3-bebb-9fd093d5310b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.407823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5bed6a47-6b3d-4f82-bda3-01fa1399d3f7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:38.419255 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5bed6a47-6b3d-4f82-bda3-01fa1399d3f7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.310795 Jul 20 04:12:38.419884 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 525/946] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:38 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:38.426576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-59dff991-a564-42f8-84b3-6dd946e344ef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:38.427176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-59dff991-a564-42f8-84b3-6dd946e344ef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:38.438397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59dff991-a564-42f8-84b3-6dd946e344ef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.439277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59dff991-a564-42f8-84b3-6dd946e344ef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.440313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59dff991-a564-42f8-84b3-6dd946e344ef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.440960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59dff991-a564-42f8-84b3-6dd946e344ef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.668275 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-860553cc-c6dc-4ea3-bebb-9fd093d5310b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:38.698567 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-860553cc-c6dc-4ea3-bebb-9fd093d5310b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 200 len: 1317 microversion: 2.1 time: 0.488286 Jul 20 04:12:38.701141 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 422/947] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:38 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:38.840058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-59dff991-a564-42f8-84b3-6dd946e344ef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:38.871443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-59dff991-a564-42f8-84b3-6dd946e344ef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:38.876227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-59dff991-a564-42f8-84b3-6dd946e344ef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:38.878033 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-59dff991-a564-42f8-84b3-6dd946e344ef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1409 microversion: 2.25 time: 0.457215 Jul 20 04:12:38.879325 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 526/948] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:38 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1409 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:39.116556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3cc2e66b-1e57-4c1b-818f-4e658dca8fc8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:39.117176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3cc2e66b-1e57-4c1b-818f-4e658dca8fc8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:39.131379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3cc2e66b-1e57-4c1b-818f-4e658dca8fc8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.140625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3cc2e66b-1e57-4c1b-818f-4e658dca8fc8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.142164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3cc2e66b-1e57-4c1b-818f-4e658dca8fc8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.142939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3cc2e66b-1e57-4c1b-818f-4e658dca8fc8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.218212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f005f893-55ed-4050-bca7-0ff9f9e23c9f tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:39.219334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f005f893-55ed-4050-bca7-0ff9f9e23c9f tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:39.233803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f005f893-55ed-4050-bca7-0ff9f9e23c9f tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.235122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f005f893-55ed-4050-bca7-0ff9f9e23c9f tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.235922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f005f893-55ed-4050-bca7-0ff9f9e23c9f tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.236393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f005f893-55ed-4050-bca7-0ff9f9e23c9f tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.688544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3cc2e66b-1e57-4c1b-818f-4e658dca8fc8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:39.700771 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3cc2e66b-1e57-4c1b-818f-4e658dca8fc8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1504 microversion: 2.1 time: 0.586652 Jul 20 04:12:39.702121 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 423/949] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:39 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1504 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:39.707496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-97778fae-2be7-4712-a2c7-9ee41810db23 req-f7005db3-15d2-4898-9bdb-e34cb4574fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ea57023-555a-427d-85a3-e83ea85f6da1", "tag": "5f0b9cd6-bdaa-46d6-b2aa-077e8de38b53"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:39.717391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-97778fae-2be7-4712-a2c7-9ee41810db23 req-f7005db3-15d2-4898-9bdb-e34cb4574fe3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.718012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-97778fae-2be7-4712-a2c7-9ee41810db23 req-f7005db3-15d2-4898-9bdb-e34cb4574fe3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.730532 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-97778fae-2be7-4712-a2c7-9ee41810db23 req-f7005db3-15d2-4898-9bdb-e34cb4574fe3 service nova] Creating event network-changed:5f0b9cd6-bdaa-46d6-b2aa-077e8de38b53 for instance 6ea57023-555a-427d-85a3-e83ea85f6da1 on n-h1-826526-5 Jul 20 04:12:39.739308 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-97778fae-2be7-4712-a2c7-9ee41810db23 req-f7005db3-15d2-4898-9bdb-e34cb4574fe3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035523 Jul 20 04:12:39.741432 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 424/950] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:39.752003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c93df469-cc64-4aa9-bcbd-db4bb5ee1f1e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:39.758222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c93df469-cc64-4aa9-bcbd-db4bb5ee1f1e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:39.772712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c93df469-cc64-4aa9-bcbd-db4bb5ee1f1e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.773173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c93df469-cc64-4aa9-bcbd-db4bb5ee1f1e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.773957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c93df469-cc64-4aa9-bcbd-db4bb5ee1f1e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.774397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c93df469-cc64-4aa9-bcbd-db4bb5ee1f1e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:40.071724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f005f893-55ed-4050-bca7-0ff9f9e23c9f tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:40.084027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f005f893-55ed-4050-bca7-0ff9f9e23c9f tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:40.089123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f005f893-55ed-4050-bca7-0ff9f9e23c9f tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:40.090488 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f005f893-55ed-4050-bca7-0ff9f9e23c9f tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 200 len: 1358 microversion: 2.21 time: 0.877119 Jul 20 04:12:40.093382 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 527/951] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:39 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 1358 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:40.099198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-33b294e9-9809-4c75-88d2-170c8c662f8c req-fd187335-42bc-49b5-aba8-431414747adb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03772705-b1f0-4d7f-ac9c-7f11312e6eb9", "tag": "813369ac-059c-4aea-bc16-799938109783"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:40.114469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-33b294e9-9809-4c75-88d2-170c8c662f8c req-fd187335-42bc-49b5-aba8-431414747adb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:40.115093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-33b294e9-9809-4c75-88d2-170c8c662f8c req-fd187335-42bc-49b5-aba8-431414747adb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:40.142702 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-33b294e9-9809-4c75-88d2-170c8c662f8c req-fd187335-42bc-49b5-aba8-431414747adb service nova] Creating event network-changed:813369ac-059c-4aea-bc16-799938109783 for instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 on n-h1-826526-5 Jul 20 04:12:40.157407 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-33b294e9-9809-4c75-88d2-170c8c662f8c req-fd187335-42bc-49b5-aba8-431414747adb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058946 Jul 20 04:12:40.158161 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 528/952] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:40.166365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8f4b7e27-181f-4b78-9ae0-67f69341e682 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:40.167063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8f4b7e27-181f-4b78-9ae0-67f69341e682 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:40.179287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f4b7e27-181f-4b78-9ae0-67f69341e682 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:40.180021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f4b7e27-181f-4b78-9ae0-67f69341e682 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:40.181086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f4b7e27-181f-4b78-9ae0-67f69341e682 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:40.182544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f4b7e27-181f-4b78-9ae0-67f69341e682 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:40.268091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c93df469-cc64-4aa9-bcbd-db4bb5ee1f1e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:40.288740 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c93df469-cc64-4aa9-bcbd-db4bb5ee1f1e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.545720 Jul 20 04:12:40.289980 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 425/953] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:39 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:40.295959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-990c54ec-d337-4886-a8b7-dee084515053 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:40.297335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-990c54ec-d337-4886-a8b7-dee084515053 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:40.307732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-990c54ec-d337-4886-a8b7-dee084515053 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:40.308748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-990c54ec-d337-4886-a8b7-dee084515053 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:40.309646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-990c54ec-d337-4886-a8b7-dee084515053 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:40.312394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-990c54ec-d337-4886-a8b7-dee084515053 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:40.580712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8f4b7e27-181f-4b78-9ae0-67f69341e682 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:40.598222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-990c54ec-d337-4886-a8b7-dee084515053 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:40.598697 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8f4b7e27-181f-4b78-9ae0-67f69341e682 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 200 len: 1317 microversion: 2.1 time: 0.436204 Jul 20 04:12:40.600371 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 529/954] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:40 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:40.607177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-990c54ec-d337-4886-a8b7-dee084515053 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:40.614552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-990c54ec-d337-4886-a8b7-dee084515053 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:40.616551 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-990c54ec-d337-4886-a8b7-dee084515053 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1605 microversion: 2.25 time: 0.325017 Jul 20 04:12:40.617303 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 426/955] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:40 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1605 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:40.636109 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-69c57f6f-9c8f-4c88-a2ce-8b9e48793367 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:40.636633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-69c57f6f-9c8f-4c88-a2ce-8b9e48793367 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:40.643718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69c57f6f-9c8f-4c88-a2ce-8b9e48793367 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:40.644629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69c57f6f-9c8f-4c88-a2ce-8b9e48793367 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:40.646396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69c57f6f-9c8f-4c88-a2ce-8b9e48793367 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:40.647230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69c57f6f-9c8f-4c88-a2ce-8b9e48793367 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:40.703903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:40.718755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-de5972cc-5e66-4847-8631-30da6f9044ba tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:40.720011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-de5972cc-5e66-4847-8631-30da6f9044ba tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:40.731978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de5972cc-5e66-4847-8631-30da6f9044ba tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:40.732719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de5972cc-5e66-4847-8631-30da6f9044ba tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:40.733784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de5972cc-5e66-4847-8631-30da6f9044ba tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:40.734748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de5972cc-5e66-4847-8631-30da6f9044ba tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:40.793618 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-69c57f6f-9c8f-4c88-a2ce-8b9e48793367 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.161533 Jul 20 04:12:40.794335 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 530/956] 10.222.0.17 () {60 vars in 1315 bytes} [Wed Jul 20 04:12:40 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:12:41.031412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-de5972cc-5e66-4847-8631-30da6f9044ba tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:41.040973 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-de5972cc-5e66-4847-8631-30da6f9044ba tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1479 microversion: 2.1 time: 0.326660 Jul 20 04:12:41.041575 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 427/957] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:40 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1479 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:41.057006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5ccd741e-381b-4cf1-97e1-29f4e4cdb1a9 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '.version_select at 0x7f06be453e50>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:41.059491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ccd741e-381b-4cf1-97e1-29f4e4cdb1a9 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.060042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ccd741e-381b-4cf1-97e1-29f4e4cdb1a9 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.075732 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5ccd741e-381b-4cf1-97e1-29f4e4cdb1a9 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 2729 microversion: 2.1 time: 0.022218 Jul 20 04:12:41.083268 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 531/958] 10.222.0.17 () {58 vars in 1142 bytes} [Wed Jul 20 04:12:41 2022] GET /compute/v2.1/os-migrations => generated 2729 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:41.091055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a1b69da1-a0d9-42fe-b2ba-54c9e281b92c tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:41.091740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a1b69da1-a0d9-42fe-b2ba-54c9e281b92c tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:41.100659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1b69da1-a0d9-42fe-b2ba-54c9e281b92c tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.101121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1b69da1-a0d9-42fe-b2ba-54c9e281b92c tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.101926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1b69da1-a0d9-42fe-b2ba-54c9e281b92c tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.102368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1b69da1-a0d9-42fe-b2ba-54c9e281b92c tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.110601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4db62d93-dce2-4d66-8e13-770e4abb5368 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:41.111568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4db62d93-dce2-4d66-8e13-770e4abb5368 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:41.122856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4db62d93-dce2-4d66-8e13-770e4abb5368 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.123301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4db62d93-dce2-4d66-8e13-770e4abb5368 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.124155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4db62d93-dce2-4d66-8e13-770e4abb5368 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.124614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4db62d93-dce2-4d66-8e13-770e4abb5368 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.387117 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a1b69da1-a0d9-42fe-b2ba-54c9e281b92c tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1630 microversion: 2.1 time: 0.301868 Jul 20 04:12:41.388313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4db62d93-dce2-4d66-8e13-770e4abb5368 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:41.388560 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 428/959] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:41 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1630 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:41.393834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8a2ae0a6-ed81-4a66-b775-d4fd63bc4a6b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:41.394631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8a2ae0a6-ed81-4a66-b775-d4fd63bc4a6b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:41.401686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a2ae0a6-ed81-4a66-b775-d4fd63bc4a6b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.402374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a2ae0a6-ed81-4a66-b775-d4fd63bc4a6b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.403314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a2ae0a6-ed81-4a66-b775-d4fd63bc4a6b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.403933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a2ae0a6-ed81-4a66-b775-d4fd63bc4a6b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.413074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4db62d93-dce2-4d66-8e13-770e4abb5368 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:41.416550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4db62d93-dce2-4d66-8e13-770e4abb5368 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:41.418213 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4db62d93-dce2-4d66-8e13-770e4abb5368 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 200 len: 1358 microversion: 2.21 time: 0.311394 Jul 20 04:12:41.420314 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 532/960] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:41 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 1358 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:12:41.431289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-04cf896d-eaa1-462b-8c22-496c5495b2b7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Action: 'create', calling method: .version_select at 0x7f06be0f05e0>, body: {"keypair": {"name": "tempest-keypair-1964298915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8t/GY370PtV5LQ8+5ExKj6y3OBm3mSeYYPTV74TgFL0qaTksnXnw/ig3unvAOFxm7KpTYgNto+MgE5jGWP2ppvG950fGHSx/VYUght0/YJlmDB4KTf9Ppsk4XjxsZlQg=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:41.479000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-04cf896d-eaa1-462b-8c22-496c5495b2b7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Getting quotas for project 6295769a840d437c9deed641966fd143. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:41.486086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-04cf896d-eaa1-462b-8c22-496c5495b2b7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Getting quotas for user 106afc4bcfc04122b9afb3cc2b17cc03 and project 6295769a840d437c9deed641966fd143. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:41.508651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:41.537824 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-04cf896d-eaa1-462b-8c22-496c5495b2b7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.116028 Jul 20 04:12:41.540207 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 533/961] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:12:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:41.637345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ced8724e-bdab-4cec-a6bc-8029957ac04d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:41.638365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ced8724e-bdab-4cec-a6bc-8029957ac04d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:41.651320 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ced8724e-bdab-4cec-a6bc-8029957ac04d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.652748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ced8724e-bdab-4cec-a6bc-8029957ac04d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.653907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ced8724e-bdab-4cec-a6bc-8029957ac04d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.654532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ced8724e-bdab-4cec-a6bc-8029957ac04d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.859950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8a2ae0a6-ed81-4a66-b775-d4fd63bc4a6b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:41.867652 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8a2ae0a6-ed81-4a66-b775-d4fd63bc4a6b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.477471 Jul 20 04:12:41.868525 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 429/962] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:41 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:42.077789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ced8724e-bdab-4cec-a6bc-8029957ac04d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:42.086669 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ced8724e-bdab-4cec-a6bc-8029957ac04d tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 200 len: 1317 microversion: 2.1 time: 0.470557 Jul 20 04:12:42.087836 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 534/963] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:41 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 1317 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:42.439428 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c8dd22b9-312b-4eb2-b1e1-4f7f5a0fcb18 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:42.440210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c8dd22b9-312b-4eb2-b1e1-4f7f5a0fcb18 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:42.443410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:42.445523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:42.450323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8dd22b9-312b-4eb2-b1e1-4f7f5a0fcb18 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:42.451431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8dd22b9-312b-4eb2-b1e1-4f7f5a0fcb18 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:42.452839 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8dd22b9-312b-4eb2-b1e1-4f7f5a0fcb18 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:42.453276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8dd22b9-312b-4eb2-b1e1-4f7f5a0fcb18 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:42.460109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:42.656505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c8dd22b9-312b-4eb2-b1e1-4f7f5a0fcb18 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:42.668831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c8dd22b9-312b-4eb2-b1e1-4f7f5a0fcb18 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:42.672735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c8dd22b9-312b-4eb2-b1e1-4f7f5a0fcb18 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:42.676101 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c8dd22b9-312b-4eb2-b1e1-4f7f5a0fcb18 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 200 len: 1358 microversion: 2.21 time: 0.238752 Jul 20 04:12:42.676725 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 430/964] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:42 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:42.723379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-030603aa-d342-4fa8-b95d-78491e57a946 req-d78e772c-a43f-4384-b698-6b564d75cb9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b80122a5-6106-4f62-9d72-5623e8ac0ca7", "tag": "7bc8d479-2b71-4938-aa7d-6a3906728f9d"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:42.743281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-030603aa-d342-4fa8-b95d-78491e57a946 req-d78e772c-a43f-4384-b698-6b564d75cb9d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:42.744624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-030603aa-d342-4fa8-b95d-78491e57a946 req-d78e772c-a43f-4384-b698-6b564d75cb9d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:42.759154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:42.780926 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-030603aa-d342-4fa8-b95d-78491e57a946 req-d78e772c-a43f-4384-b698-6b564d75cb9d service nova] Creating event network-changed:7bc8d479-2b71-4938-aa7d-6a3906728f9d for instance b80122a5-6106-4f62-9d72-5623e8ac0ca7 on n-h1-826526-5 Jul 20 04:12:42.786466 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-030603aa-d342-4fa8-b95d-78491e57a946 req-d78e772c-a43f-4384-b698-6b564d75cb9d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077060 Jul 20 04:12:42.788391 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 535/965] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:42.886127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-704c73d3-d793-48ba-af20-17eebea94ea5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:42.886740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-704c73d3-d793-48ba-af20-17eebea94ea5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:42.899532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-704c73d3-d793-48ba-af20-17eebea94ea5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:42.900512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-704c73d3-d793-48ba-af20-17eebea94ea5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:42.901470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-704c73d3-d793-48ba-af20-17eebea94ea5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:42.904156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-704c73d3-d793-48ba-af20-17eebea94ea5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:43.105020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-35b0384a-dfe6-4a46-aff8-80ceefa3a0e5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:43.105741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35b0384a-dfe6-4a46-aff8-80ceefa3a0e5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:43.121346 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35b0384a-dfe6-4a46-aff8-80ceefa3a0e5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:43.122878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35b0384a-dfe6-4a46-aff8-80ceefa3a0e5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:43.126521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35b0384a-dfe6-4a46-aff8-80ceefa3a0e5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:43.128730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35b0384a-dfe6-4a46-aff8-80ceefa3a0e5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:43.324924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-704c73d3-d793-48ba-af20-17eebea94ea5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:43.333644 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-704c73d3-d793-48ba-af20-17eebea94ea5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.451721 Jul 20 04:12:43.337088 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 431/966] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:42 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:43.487646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-35b0384a-dfe6-4a46-aff8-80ceefa3a0e5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:43.496458 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-35b0384a-dfe6-4a46-aff8-80ceefa3a0e5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 200 len: 1317 microversion: 2.1 time: 0.395752 Jul 20 04:12:43.500508 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 536/967] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:43 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 1317 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:43.696639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-247cc567-747e-4e9e-8b91-317f53c920ed tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:43.697610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-247cc567-747e-4e9e-8b91-317f53c920ed tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:43.714199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-247cc567-747e-4e9e-8b91-317f53c920ed tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:43.714811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-247cc567-747e-4e9e-8b91-317f53c920ed tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:43.717098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-247cc567-747e-4e9e-8b91-317f53c920ed tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:43.718008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-247cc567-747e-4e9e-8b91-317f53c920ed tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:44.195575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-247cc567-747e-4e9e-8b91-317f53c920ed tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:44.231734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-247cc567-747e-4e9e-8b91-317f53c920ed tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:44.234506 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-247cc567-747e-4e9e-8b91-317f53c920ed tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:44.236022 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-247cc567-747e-4e9e-8b91-317f53c920ed tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 200 len: 1358 microversion: 2.21 time: 0.545137 Jul 20 04:12:44.238853 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 432/968] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:43 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 1358 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:44.353399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1ee122d1-fc2f-44f0-a10e-016df2b918eb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:44.354020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1ee122d1-fc2f-44f0-a10e-016df2b918eb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:44.369062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ee122d1-fc2f-44f0-a10e-016df2b918eb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:44.376565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ee122d1-fc2f-44f0-a10e-016df2b918eb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:44.377670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ee122d1-fc2f-44f0-a10e-016df2b918eb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:44.378256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ee122d1-fc2f-44f0-a10e-016df2b918eb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:44.517843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d8a1bbfa-3e05-4b55-bae8-b94cc8378011 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:44.518680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d8a1bbfa-3e05-4b55-bae8-b94cc8378011 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:44.531317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8a1bbfa-3e05-4b55-bae8-b94cc8378011 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:44.534708 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8a1bbfa-3e05-4b55-bae8-b94cc8378011 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:44.535894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8a1bbfa-3e05-4b55-bae8-b94cc8378011 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:44.537755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8a1bbfa-3e05-4b55-bae8-b94cc8378011 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:44.686056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1ee122d1-fc2f-44f0-a10e-016df2b918eb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:44.693882 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1ee122d1-fc2f-44f0-a10e-016df2b918eb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.344215 Jul 20 04:12:44.694810 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 537/969] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:44 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:45.041439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d8a1bbfa-3e05-4b55-bae8-b94cc8378011 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:45.054649 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d8a1bbfa-3e05-4b55-bae8-b94cc8378011 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 200 len: 1317 microversion: 2.1 time: 0.542751 Jul 20 04:12:45.055711 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 433/970] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:44 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:45.257884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-89737c2a-a1d6-4006-822f-b88eceb5d1f1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:45.258600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-89737c2a-a1d6-4006-822f-b88eceb5d1f1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:45.275670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89737c2a-a1d6-4006-822f-b88eceb5d1f1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.275670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89737c2a-a1d6-4006-822f-b88eceb5d1f1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:45.275670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89737c2a-a1d6-4006-822f-b88eceb5d1f1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.275670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89737c2a-a1d6-4006-822f-b88eceb5d1f1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:45.305489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-18275979-6b70-4553-a33d-9e7e3458daaf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-525392241", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "d596c209-8ad5-47de-87f3-e30c0a431c35"}], "security_groups": [{"name": "tempest-securitygroup--398387710"}], "key_name": "tempest-keypair-1964298915", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:45.525125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-89737c2a-a1d6-4006-822f-b88eceb5d1f1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:45.525745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-18275979-6b70-4553-a33d-9e7e3458daaf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] validate_networks() for [('d596c209-8ad5-47de-87f3-e30c0a431c35', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:45.534016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-89737c2a-a1d6-4006-822f-b88eceb5d1f1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:45.535652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-89737c2a-a1d6-4006-822f-b88eceb5d1f1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:45.536882 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-89737c2a-a1d6-4006-822f-b88eceb5d1f1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 200 len: 1358 microversion: 2.21 time: 0.285466 Jul 20 04:12:45.537951 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 538/971] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:45 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 1358 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:45.698214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-64808c1a-5e4a-472b-9b00-54faa13e1182 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Action: 'create', calling method: .version_select at 0x7f06be07f700>, body: {"keypair": {"name": "tempest-keypair-225853485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdsDtXZ3RcRMQ8g9DINRpycWDF6Bwy5ewONqJfSZ4VplatUvVUzQ9gT/kpiaKpHQoqKhUqS2LS5DmE3LiRXxpPLePmEt0C6HegMtsUpKU9xfw50KPpIRr0x8ZKpkL46Lw=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:45.716616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-64808c1a-5e4a-472b-9b00-54faa13e1182 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Getting quotas for project e8e6c6d2c2124397b105566e4d908026. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:45.723287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-64808c1a-5e4a-472b-9b00-54faa13e1182 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Getting quotas for user f7b6fd2fc945492d95fb2b19f80ee9a2 and project e8e6c6d2c2124397b105566e4d908026. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:45.750389 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-64808c1a-5e4a-472b-9b00-54faa13e1182 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.211159 Jul 20 04:12:45.751003 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 539/972] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:12:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:45.756790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f33418fa-7a51-4a50-8ca4-a495dc3d186d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:45.757553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f33418fa-7a51-4a50-8ca4-a495dc3d186d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:45.765548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f33418fa-7a51-4a50-8ca4-a495dc3d186d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.766222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f33418fa-7a51-4a50-8ca4-a495dc3d186d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:45.767139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f33418fa-7a51-4a50-8ca4-a495dc3d186d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.767758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f33418fa-7a51-4a50-8ca4-a495dc3d186d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:45.953712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f33418fa-7a51-4a50-8ca4-a495dc3d186d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:45.962936 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f33418fa-7a51-4a50-8ca4-a495dc3d186d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.210859 Jul 20 04:12:45.964314 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 540/973] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:45 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:45.969559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-9165c14a-86ae-4b3e-a2c4-231648748332 req-ca34c768-123b-4b3b-ac48-bef511b5dcab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03772705-b1f0-4d7f-ac9c-7f11312e6eb9", "name": "network-vif-plugged", "status": "completed", "tag": "813369ac-059c-4aea-bc16-799938109783"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:45.979821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9165c14a-86ae-4b3e-a2c4-231648748332 req-ca34c768-123b-4b3b-ac48-bef511b5dcab service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.980470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9165c14a-86ae-4b3e-a2c4-231648748332 req-ca34c768-123b-4b3b-ac48-bef511b5dcab service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.015665 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9165c14a-86ae-4b3e-a2c4-231648748332 req-ca34c768-123b-4b3b-ac48-bef511b5dcab service nova] Creating event network-vif-plugged:813369ac-059c-4aea-bc16-799938109783 for instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 on n-h1-826526-5 Jul 20 04:12:46.021761 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-9165c14a-86ae-4b3e-a2c4-231648748332 req-ca34c768-123b-4b3b-ac48-bef511b5dcab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055977 Jul 20 04:12:46.023132 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 541/974] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:46.071738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-53f3941a-6f73-4baf-811f-d9d2de0d7678 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:46.072694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-53f3941a-6f73-4baf-811f-d9d2de0d7678 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:46.079481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-53f3941a-6f73-4baf-811f-d9d2de0d7678 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.080200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-53f3941a-6f73-4baf-811f-d9d2de0d7678 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.081132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-53f3941a-6f73-4baf-811f-d9d2de0d7678 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.081570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-53f3941a-6f73-4baf-811f-d9d2de0d7678 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.276657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-53f3941a-6f73-4baf-811f-d9d2de0d7678 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:46.286109 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-53f3941a-6f73-4baf-811f-d9d2de0d7678 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 200 len: 1317 microversion: 2.1 time: 0.218375 Jul 20 04:12:46.287075 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 542/975] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:46 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:46.562769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-456a215f-e709-4ee1-bcb5-0d1905aea573 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:46.563241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-456a215f-e709-4ee1-bcb5-0d1905aea573 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:46.570543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-456a215f-e709-4ee1-bcb5-0d1905aea573 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.571247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-456a215f-e709-4ee1-bcb5-0d1905aea573 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.572038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-456a215f-e709-4ee1-bcb5-0d1905aea573 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.572512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-456a215f-e709-4ee1-bcb5-0d1905aea573 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.623757 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-18275979-6b70-4553-a33d-9e7e3458daaf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:46.624900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-18275979-6b70-4553-a33d-9e7e3458daaf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:46.625868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-18275979-6b70-4553-a33d-9e7e3458daaf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:46.626515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-18275979-6b70-4553-a33d-9e7e3458daaf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:46.627365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-18275979-6b70-4553-a33d-9e7e3458daaf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:46.639294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18275979-6b70-4553-a33d-9e7e3458daaf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.639739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18275979-6b70-4553-a33d-9e7e3458daaf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.640735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18275979-6b70-4553-a33d-9e7e3458daaf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.641167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18275979-6b70-4553-a33d-9e7e3458daaf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.658390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-18275979-6b70-4553-a33d-9e7e3458daaf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Getting quotas for project 6295769a840d437c9deed641966fd143. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:46.664244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-18275979-6b70-4553-a33d-9e7e3458daaf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Getting quotas for user 106afc4bcfc04122b9afb3cc2b17cc03 and project 6295769a840d437c9deed641966fd143. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:46.678204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-18275979-6b70-4553-a33d-9e7e3458daaf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:46.681201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-18275979-6b70-4553-a33d-9e7e3458daaf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:46.733601 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-18275979-6b70-4553-a33d-9e7e3458daaf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.432397 Jul 20 04:12:46.734554 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 434/976] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:12:46.745255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-90a7c0e2-f7b4-453e-9bae-0f744244b958 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:46.746158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-90a7c0e2-f7b4-453e-9bae-0f744244b958 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:46.835368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-90a7c0e2-f7b4-453e-9bae-0f744244b958 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:46.844358 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-90a7c0e2-f7b4-453e-9bae-0f744244b958 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1234 microversion: 2.1 time: 0.103646 Jul 20 04:12:46.852317 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 435/977] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:46 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1234 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:46.981610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c4b0220b-e989-4aa0-88c7-f0e9c1a217ef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:46.982258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c4b0220b-e989-4aa0-88c7-f0e9c1a217ef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:46.989918 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4b0220b-e989-4aa0-88c7-f0e9c1a217ef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.990348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4b0220b-e989-4aa0-88c7-f0e9c1a217ef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.991123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4b0220b-e989-4aa0-88c7-f0e9c1a217ef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.991558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4b0220b-e989-4aa0-88c7-f0e9c1a217ef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:47.070223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-456a215f-e709-4ee1-bcb5-0d1905aea573 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:47.079200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-456a215f-e709-4ee1-bcb5-0d1905aea573 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:47.080764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-456a215f-e709-4ee1-bcb5-0d1905aea573 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:47.081902 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-456a215f-e709-4ee1-bcb5-0d1905aea573 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 200 len: 1358 microversion: 2.21 time: 0.523612 Jul 20 04:12:47.103266 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 543/978] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:46 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 1358 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:47.181527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c4b0220b-e989-4aa0-88c7-f0e9c1a217ef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:47.190469 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c4b0220b-e989-4aa0-88c7-f0e9c1a217ef tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1543 microversion: 2.1 time: 0.213610 Jul 20 04:12:47.191100 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 436/979] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:46 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1543 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:47.305936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-85a5ae2c-4aa0-473b-b0eb-7841858da340 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:47.306850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-85a5ae2c-4aa0-473b-b0eb-7841858da340 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:47.313475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85a5ae2c-4aa0-473b-b0eb-7841858da340 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:47.314094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85a5ae2c-4aa0-473b-b0eb-7841858da340 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:47.315187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85a5ae2c-4aa0-473b-b0eb-7841858da340 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:47.315712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85a5ae2c-4aa0-473b-b0eb-7841858da340 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:47.534452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-85a5ae2c-4aa0-473b-b0eb-7841858da340 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:47.544685 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-85a5ae2c-4aa0-473b-b0eb-7841858da340 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 200 len: 1317 microversion: 2.1 time: 0.244265 Jul 20 04:12:47.545381 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 544/980] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:47 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:47.864248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-87a39b6b-7499-4a85-aa1f-50614a4d7592 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:47.869468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-87a39b6b-7499-4a85-aa1f-50614a4d7592 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:47.876381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87a39b6b-7499-4a85-aa1f-50614a4d7592 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:47.876850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87a39b6b-7499-4a85-aa1f-50614a4d7592 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:47.877644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87a39b6b-7499-4a85-aa1f-50614a4d7592 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:47.878054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87a39b6b-7499-4a85-aa1f-50614a4d7592 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.035785 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-87a39b6b-7499-4a85-aa1f-50614a4d7592 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:48.040322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-bd1c84a4-b317-461d-a0b8-d2dfdbc96efd req-e9d5d277-14b9-40d5-82b0-e8547b67f24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ea57023-555a-427d-85a3-e83ea85f6da1", "name": "network-vif-plugged", "status": "completed", "tag": "5f0b9cd6-bdaa-46d6-b2aa-077e8de38b53"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:48.050100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bd1c84a4-b317-461d-a0b8-d2dfdbc96efd req-e9d5d277-14b9-40d5-82b0-e8547b67f24a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.050913 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bd1c84a4-b317-461d-a0b8-d2dfdbc96efd req-e9d5d277-14b9-40d5-82b0-e8547b67f24a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.065370 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-87a39b6b-7499-4a85-aa1f-50614a4d7592 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1286 microversion: 2.1 time: 0.206196 Jul 20 04:12:48.065995 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 437/981] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:47 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1286 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:48.082385 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-bd1c84a4-b317-461d-a0b8-d2dfdbc96efd req-e9d5d277-14b9-40d5-82b0-e8547b67f24a service nova] Creating event network-vif-plugged:5f0b9cd6-bdaa-46d6-b2aa-077e8de38b53 for instance 6ea57023-555a-427d-85a3-e83ea85f6da1 on n-h1-826526-5 Jul 20 04:12:48.087255 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-bd1c84a4-b317-461d-a0b8-d2dfdbc96efd req-e9d5d277-14b9-40d5-82b0-e8547b67f24a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050549 Jul 20 04:12:48.087985 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 545/982] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:12:48.103887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-649708c3-6221-40f0-9f9f-311a9f6528ac tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:48.106068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-649708c3-6221-40f0-9f9f-311a9f6528ac tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:48.113623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-649708c3-6221-40f0-9f9f-311a9f6528ac tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.114204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-649708c3-6221-40f0-9f9f-311a9f6528ac tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.115209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-649708c3-6221-40f0-9f9f-311a9f6528ac tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.116291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-649708c3-6221-40f0-9f9f-311a9f6528ac tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.208383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3fe802b5-5572-49e4-958f-bdc8ce68a593 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:48.209594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3fe802b5-5572-49e4-958f-bdc8ce68a593 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:48.220827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fe802b5-5572-49e4-958f-bdc8ce68a593 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.222703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fe802b5-5572-49e4-958f-bdc8ce68a593 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.224969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fe802b5-5572-49e4-958f-bdc8ce68a593 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.230953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fe802b5-5572-49e4-958f-bdc8ce68a593 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.574884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-649708c3-6221-40f0-9f9f-311a9f6528ac tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:48.588316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-649708c3-6221-40f0-9f9f-311a9f6528ac tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:48.589904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-649708c3-6221-40f0-9f9f-311a9f6528ac tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:48.591078 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-649708c3-6221-40f0-9f9f-311a9f6528ac tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 200 len: 1550 microversion: 2.21 time: 0.493604 Jul 20 04:12:48.602844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3fe802b5-5572-49e4-958f-bdc8ce68a593 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:48.604599 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 438/983] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:48 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 1550 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:48.611933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0cfc7507-bea9-4c63-9c7b-c4d1d4ef03a5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:48.611933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0cfc7507-bea9-4c63-9c7b-c4d1d4ef03a5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:48.633760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0cfc7507-bea9-4c63-9c7b-c4d1d4ef03a5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.633889 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3fe802b5-5572-49e4-958f-bdc8ce68a593 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1542 microversion: 2.1 time: 0.429726 Jul 20 04:12:48.634507 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 546/984] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:48 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1542 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:48.648390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0cfc7507-bea9-4c63-9c7b-c4d1d4ef03a5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.648582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dd45648e-7c79-42b4-b23d-9a488f52a503 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:48.649580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dd45648e-7c79-42b4-b23d-9a488f52a503 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:48.650616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0cfc7507-bea9-4c63-9c7b-c4d1d4ef03a5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.652443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0cfc7507-bea9-4c63-9c7b-c4d1d4ef03a5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.665031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd45648e-7c79-42b4-b23d-9a488f52a503 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.665737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd45648e-7c79-42b4-b23d-9a488f52a503 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.666707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd45648e-7c79-42b4-b23d-9a488f52a503 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.667482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd45648e-7c79-42b4-b23d-9a488f52a503 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.711936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dd45648e-7c79-42b4-b23d-9a488f52a503 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:12:48.859233 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dd45648e-7c79-42b4-b23d-9a488f52a503 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "DELETE /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 204 len: 0 microversion: 2.21 time: 0.221453 Jul 20 04:12:48.860139 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 547/985] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:12:48 2022] DELETE /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:12:48.869236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dcd73066-46dd-487c-a2e8-37fb07d99be0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:48.870592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dcd73066-46dd-487c-a2e8-37fb07d99be0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:48.887887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcd73066-46dd-487c-a2e8-37fb07d99be0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.888235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcd73066-46dd-487c-a2e8-37fb07d99be0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.898227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcd73066-46dd-487c-a2e8-37fb07d99be0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.898785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcd73066-46dd-487c-a2e8-37fb07d99be0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:49.235568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dcd73066-46dd-487c-a2e8-37fb07d99be0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:49.253223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dcd73066-46dd-487c-a2e8-37fb07d99be0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:49.255565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dcd73066-46dd-487c-a2e8-37fb07d99be0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:49.259862 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dcd73066-46dd-487c-a2e8-37fb07d99be0 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 200 len: 1556 microversion: 2.21 time: 0.395671 Jul 20 04:12:49.268677 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 548/986] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:48 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 1556 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:49.279995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bf39acef-f3f4-42d0-914e-d42585511388 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:49.285412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bf39acef-f3f4-42d0-914e-d42585511388 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:49.300873 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf39acef-f3f4-42d0-914e-d42585511388 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:49.303604 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf39acef-f3f4-42d0-914e-d42585511388 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:49.305680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf39acef-f3f4-42d0-914e-d42585511388 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:49.307919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf39acef-f3f4-42d0-914e-d42585511388 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:49.383139 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bf39acef-f3f4-42d0-914e-d42585511388 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110729 Jul 20 04:12:49.386759 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 549/987] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:12:49 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:49.401874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-61107dce-b031-431a-929e-95b09b0d42cd tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:49.402495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-61107dce-b031-431a-929e-95b09b0d42cd tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:49.421482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61107dce-b031-431a-929e-95b09b0d42cd tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:49.422138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61107dce-b031-431a-929e-95b09b0d42cd tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:49.424332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61107dce-b031-431a-929e-95b09b0d42cd tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:49.424950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61107dce-b031-431a-929e-95b09b0d42cd tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:49.558295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-61107dce-b031-431a-929e-95b09b0d42cd tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:49.569495 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-61107dce-b031-431a-929e-95b09b0d42cd tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1292 microversion: 2.1 time: 0.180290 Jul 20 04:12:49.571812 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 550/988] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:49 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1292 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:49.578259 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0cfc7507-bea9-4c63-9c7b-c4d1d4ef03a5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:49.589275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-85e09e42-1be6-4962-9142-57c3146fb1a1 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:49.589504 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0cfc7507-bea9-4c63-9c7b-c4d1d4ef03a5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 200 len: 1317 microversion: 2.1 time: 0.983708 Jul 20 04:12:49.591266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-85e09e42-1be6-4962-9142-57c3146fb1a1 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:49.602295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85e09e42-1be6-4962-9142-57c3146fb1a1 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:49.603100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85e09e42-1be6-4962-9142-57c3146fb1a1 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:49.603855 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 439/989] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:48 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 1317 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:49.605488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85e09e42-1be6-4962-9142-57c3146fb1a1 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:49.606299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85e09e42-1be6-4962-9142-57c3146fb1a1 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:49.656292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-27822ce1-e8a5-44ee-965b-d5ab8992374b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:49.657838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-27822ce1-e8a5-44ee-965b-d5ab8992374b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:49.667390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27822ce1-e8a5-44ee-965b-d5ab8992374b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:49.670488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27822ce1-e8a5-44ee-965b-d5ab8992374b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:49.671513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27822ce1-e8a5-44ee-965b-d5ab8992374b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:49.672878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27822ce1-e8a5-44ee-965b-d5ab8992374b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:49.828286 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-85e09e42-1be6-4962-9142-57c3146fb1a1 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lazy-loading 'services' on Instance uuid 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:12:50.017823 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-85e09e42-1be6-4962-9142-57c3146fb1a1 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "DELETE /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2/os-volume_attachments/119abd92-df58-449e-8ea6-59b9faa46938" status: 202 len: 0 microversion: 2.1 time: 0.444580 Jul 20 04:12:50.018443 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 551/990] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 04:12:49 2022] DELETE /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2/os-volume_attachments/119abd92-df58-449e-8ea6-59b9faa46938 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:50.032026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4e0659b6-e2cc-47f4-abee-06a80fb66564 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-991324747", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "288a1818-7a89-47d9-8b12-468cf7570890"}], "security_groups": [{"name": "tempest-securitygroup--594724721"}], "key_name": "tempest-keypair-225853485", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:50.199031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-27822ce1-e8a5-44ee-965b-d5ab8992374b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:50.207327 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-27822ce1-e8a5-44ee-965b-d5ab8992374b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1542 microversion: 2.1 time: 0.559791 Jul 20 04:12:50.207934 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 440/991] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:49 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1542 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:50.220750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-6fe07874-3505-4436-89b5-e10cad0833ef req-05d3c2aa-c92a-4040-8f07-0afa49c60ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944a56a8-87ef-4988-9f97-106c08046fe9", "name": "network-vif-unplugged", "status": "completed", "tag": "63a5fa97-49af-495f-b6c4-80e7f5925cac"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:50.240484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6fe07874-3505-4436-89b5-e10cad0833ef req-05d3c2aa-c92a-4040-8f07-0afa49c60ad3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:50.241033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6fe07874-3505-4436-89b5-e10cad0833ef req-05d3c2aa-c92a-4040-8f07-0afa49c60ad3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:50.242856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-4e0659b6-e2cc-47f4-abee-06a80fb66564 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] validate_networks() for [('288a1818-7a89-47d9-8b12-468cf7570890', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:50.292452 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-6fe07874-3505-4436-89b5-e10cad0833ef req-05d3c2aa-c92a-4040-8f07-0afa49c60ad3 service nova] Creating event network-vif-unplugged:63a5fa97-49af-495f-b6c4-80e7f5925cac for instance 944a56a8-87ef-4988-9f97-106c08046fe9 on n-h1-826526-5 Jul 20 04:12:50.315549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [req-6fe07874-3505-4436-89b5-e10cad0833ef req-05d3c2aa-c92a-4040-8f07-0afa49c60ad3 service nova] Instance 944a56a8-87ef-4988-9f97-106c08046fe9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:12:50.340692 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-6fe07874-3505-4436-89b5-e10cad0833ef req-05d3c2aa-c92a-4040-8f07-0afa49c60ad3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131283 Jul 20 04:12:50.341578 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 441/992] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:50.349673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6448674b-fca5-4157-b2d8-a4b80a087075 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:50.354024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6448674b-fca5-4157-b2d8-a4b80a087075 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:50.364302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6448674b-fca5-4157-b2d8-a4b80a087075 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:50.364975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6448674b-fca5-4157-b2d8-a4b80a087075 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:50.366252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6448674b-fca5-4157-b2d8-a4b80a087075 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:50.367243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6448674b-fca5-4157-b2d8-a4b80a087075 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:50.617557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6448674b-fca5-4157-b2d8-a4b80a087075 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:50.631437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6448674b-fca5-4157-b2d8-a4b80a087075 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:50.633691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6448674b-fca5-4157-b2d8-a4b80a087075 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:50.635524 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6448674b-fca5-4157-b2d8-a4b80a087075 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 200 len: 1556 microversion: 2.21 time: 0.290430 Jul 20 04:12:50.636866 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 442/993] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:50 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 1556 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:50.642928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2396214a-2096-4f9b-baa4-82a4192608bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:50.644804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2396214a-2096-4f9b-baa4-82a4192608bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:50.652355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2396214a-2096-4f9b-baa4-82a4192608bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:50.653542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2396214a-2096-4f9b-baa4-82a4192608bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:50.654621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2396214a-2096-4f9b-baa4-82a4192608bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:50.655120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2396214a-2096-4f9b-baa4-82a4192608bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.023120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2396214a-2096-4f9b-baa4-82a4192608bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:51.042304 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2396214a-2096-4f9b-baa4-82a4192608bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1359 microversion: 2.1 time: 0.403893 Jul 20 04:12:51.043837 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 443/994] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:50 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1359 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:51.057293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5eb6e832-e16d-4ac6-a125-ae9dfb2e0f18 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:51.058179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5eb6e832-e16d-4ac6-a125-ae9dfb2e0f18 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:51.068487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5eb6e832-e16d-4ac6-a125-ae9dfb2e0f18 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.069652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5eb6e832-e16d-4ac6-a125-ae9dfb2e0f18 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.070593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5eb6e832-e16d-4ac6-a125-ae9dfb2e0f18 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.071224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5eb6e832-e16d-4ac6-a125-ae9dfb2e0f18 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.150734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-4e0659b6-e2cc-47f4-abee-06a80fb66564 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Getting quotas for project e8e6c6d2c2124397b105566e4d908026. Resources: dict_keys(['metadata_items']) {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:51.166057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-4e0659b6-e2cc-47f4-abee-06a80fb66564 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Getting quotas for user f7b6fd2fc945492d95fb2b19f80ee9a2 and project e8e6c6d2c2124397b105566e4d908026. Resources: dict_keys(['metadata_items']) {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:51.187363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-4e0659b6-e2cc-47f4-abee-06a80fb66564 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:51.188272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-4e0659b6-e2cc-47f4-abee-06a80fb66564 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:51.189117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-4e0659b6-e2cc-47f4-abee-06a80fb66564 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:51.189669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-4e0659b6-e2cc-47f4-abee-06a80fb66564 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:51.190226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-4e0659b6-e2cc-47f4-abee-06a80fb66564 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:51.203644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e0659b6-e2cc-47f4-abee-06a80fb66564 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.204424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e0659b6-e2cc-47f4-abee-06a80fb66564 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.205434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e0659b6-e2cc-47f4-abee-06a80fb66564 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.206040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e0659b6-e2cc-47f4-abee-06a80fb66564 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.235534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-4e0659b6-e2cc-47f4-abee-06a80fb66564 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Getting quotas for project e8e6c6d2c2124397b105566e4d908026. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:51.244654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-4e0659b6-e2cc-47f4-abee-06a80fb66564 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Getting quotas for user f7b6fd2fc945492d95fb2b19f80ee9a2 and project e8e6c6d2c2124397b105566e4d908026. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:51.261171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4e0659b6-e2cc-47f4-abee-06a80fb66564 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:51.264750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4e0659b6-e2cc-47f4-abee-06a80fb66564 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:51.329629 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4e0659b6-e2cc-47f4-abee-06a80fb66564 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.309742 Jul 20 04:12:51.331078 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 552/995] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:50 2022] POST /compute/v2.1/servers => generated 408 bytes in 1312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:12:51.336900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ee3a8ee9-efe7-4468-a718-45e412cd080d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:51.338313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ee3a8ee9-efe7-4468-a718-45e412cd080d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:51.346429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee3a8ee9-efe7-4468-a718-45e412cd080d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.347130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee3a8ee9-efe7-4468-a718-45e412cd080d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.348062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee3a8ee9-efe7-4468-a718-45e412cd080d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.348766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee3a8ee9-efe7-4468-a718-45e412cd080d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.396511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:51.758888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ee3a8ee9-efe7-4468-a718-45e412cd080d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:51.770676 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ee3a8ee9-efe7-4468-a718-45e412cd080d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1542 microversion: 2.1 time: 0.438322 Jul 20 04:12:51.773172 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 553/996] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:51 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1542 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:51.786742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d1f2eaf2-afdd-4c20-a01a-92081d5eb325 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:51.787589 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d1f2eaf2-afdd-4c20-a01a-92081d5eb325 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:51.881465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d1f2eaf2-afdd-4c20-a01a-92081d5eb325 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:51.889995 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d1f2eaf2-afdd-4c20-a01a-92081d5eb325 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1276 microversion: 2.1 time: 0.114323 Jul 20 04:12:51.900170 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 554/997] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:51 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:51.906430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f19e928e-a305-459a-9d9e-62f6308b72d1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:51.907381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f19e928e-a305-459a-9d9e-62f6308b72d1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:51.914795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f19e928e-a305-459a-9d9e-62f6308b72d1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.915525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f19e928e-a305-459a-9d9e-62f6308b72d1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.916513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f19e928e-a305-459a-9d9e-62f6308b72d1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.917106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f19e928e-a305-459a-9d9e-62f6308b72d1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:52.004683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5eb6e832-e16d-4ac6-a125-ae9dfb2e0f18 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:52.020794 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5eb6e832-e16d-4ac6-a125-ae9dfb2e0f18 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 200 len: 1317 microversion: 2.1 time: 0.975046 Jul 20 04:12:52.033345 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 444/998] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:51 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 1317 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:52.077278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-35fe17a7-b57e-4b8b-8b49-63a5e7d47aee tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:52.079089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-35fe17a7-b57e-4b8b-8b49-63a5e7d47aee tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:52.107670 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35fe17a7-b57e-4b8b-8b49-63a5e7d47aee tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:52.109498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35fe17a7-b57e-4b8b-8b49-63a5e7d47aee tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:52.111971 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35fe17a7-b57e-4b8b-8b49-63a5e7d47aee tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:52.114064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35fe17a7-b57e-4b8b-8b49-63a5e7d47aee tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:52.198748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f19e928e-a305-459a-9d9e-62f6308b72d1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:52.222541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f19e928e-a305-459a-9d9e-62f6308b72d1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:52.236921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f19e928e-a305-459a-9d9e-62f6308b72d1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:52.238236 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f19e928e-a305-459a-9d9e-62f6308b72d1 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 200 len: 1556 microversion: 2.21 time: 0.336670 Jul 20 04:12:52.244651 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 555/999] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:51 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 1556 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:52.249400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-931671d1-e913-4a32-a1d0-861365a83896 req-14631675-e049-4f6d-a270-a6f64c5ab67d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52df8cf7-6be8-4f22-a0b4-4a5e0b31be04", "tag": "295ab3b5-0949-4953-b868-df3a92dd92e7"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:52.269810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-931671d1-e913-4a32-a1d0-861365a83896 req-14631675-e049-4f6d-a270-a6f64c5ab67d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:52.273813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-931671d1-e913-4a32-a1d0-861365a83896 req-14631675-e049-4f6d-a270-a6f64c5ab67d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:52.302700 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-931671d1-e913-4a32-a1d0-861365a83896 req-14631675-e049-4f6d-a270-a6f64c5ab67d service nova] Creating event network-changed:295ab3b5-0949-4953-b868-df3a92dd92e7 for instance 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 on n-h1-826526-5 Jul 20 04:12:52.330283 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-931671d1-e913-4a32-a1d0-861365a83896 req-14631675-e049-4f6d-a270-a6f64c5ab67d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084275 Jul 20 04:12:52.331497 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 556/1000] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:52.445434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-add09104-280c-43f2-a05f-a4604b1a5915 req-fec2c583-a74e-49ef-b227-57cba42fc42a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "944a56a8-87ef-4988-9f97-106c08046fe9", "tag": "63a5fa97-49af-495f-b6c4-80e7f5925cac"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:52.455766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-add09104-280c-43f2-a05f-a4604b1a5915 req-fec2c583-a74e-49ef-b227-57cba42fc42a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:52.456344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-add09104-280c-43f2-a05f-a4604b1a5915 req-fec2c583-a74e-49ef-b227-57cba42fc42a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:52.487294 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-add09104-280c-43f2-a05f-a4604b1a5915 req-fec2c583-a74e-49ef-b227-57cba42fc42a service nova] Creating event network-changed:63a5fa97-49af-495f-b6c4-80e7f5925cac for instance 944a56a8-87ef-4988-9f97-106c08046fe9 on n-h1-826526-5 Jul 20 04:12:52.501805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-add09104-280c-43f2-a05f-a4604b1a5915 req-fec2c583-a74e-49ef-b227-57cba42fc42a service nova] Instance 944a56a8-87ef-4988-9f97-106c08046fe9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:12:52.517615 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-add09104-280c-43f2-a05f-a4604b1a5915 req-fec2c583-a74e-49ef-b227-57cba42fc42a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076149 Jul 20 04:12:52.519004 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 557/1001] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:12:52.751596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-35fe17a7-b57e-4b8b-8b49-63a5e7d47aee tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:52.759756 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-35fe17a7-b57e-4b8b-8b49-63a5e7d47aee tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1359 microversion: 2.1 time: 0.702292 Jul 20 04:12:52.760341 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 445/1002] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:52 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1359 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:52.789584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-922a9424-8281-48bc-b363-4e44e1efaabd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:52.790280 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-922a9424-8281-48bc-b363-4e44e1efaabd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:52.797128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-922a9424-8281-48bc-b363-4e44e1efaabd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:52.797572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-922a9424-8281-48bc-b363-4e44e1efaabd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:52.798345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-922a9424-8281-48bc-b363-4e44e1efaabd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:52.798776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-922a9424-8281-48bc-b363-4e44e1efaabd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:52.910224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a06e0ea8-1e03-4a75-821d-f2ea298dcb7d tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:52.915549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a06e0ea8-1e03-4a75-821d-f2ea298dcb7d tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:52.933894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a06e0ea8-1e03-4a75-821d-f2ea298dcb7d tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:52.935493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a06e0ea8-1e03-4a75-821d-f2ea298dcb7d tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:52.937151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a06e0ea8-1e03-4a75-821d-f2ea298dcb7d tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:52.943129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a06e0ea8-1e03-4a75-821d-f2ea298dcb7d tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.089553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a06e0ea8-1e03-4a75-821d-f2ea298dcb7d tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:53.099083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-922a9424-8281-48bc-b363-4e44e1efaabd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:53.104158 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a06e0ea8-1e03-4a75-821d-f2ea298dcb7d tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1328 microversion: 2.1 time: 0.200687 Jul 20 04:12:53.105412 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 446/1003] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:52 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1328 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:53.114998 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-922a9424-8281-48bc-b363-4e44e1efaabd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1542 microversion: 2.1 time: 0.322815 Jul 20 04:12:53.114998 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 558/1004] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:52 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1542 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:53.126887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a30c9ddf-28e6-4694-991a-a0882fca9426 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:53.127661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a30c9ddf-28e6-4694-991a-a0882fca9426 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:53.134702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a30c9ddf-28e6-4694-991a-a0882fca9426 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.135200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a30c9ddf-28e6-4694-991a-a0882fca9426 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.136087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a30c9ddf-28e6-4694-991a-a0882fca9426 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.137400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a30c9ddf-28e6-4694-991a-a0882fca9426 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.258404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b0d6baac-6287-41f6-b812-38386577067e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:53.259334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b0d6baac-6287-41f6-b812-38386577067e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:53.269540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0d6baac-6287-41f6-b812-38386577067e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.272725 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0d6baac-6287-41f6-b812-38386577067e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.273739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0d6baac-6287-41f6-b812-38386577067e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.275944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0d6baac-6287-41f6-b812-38386577067e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.359320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0d6baac-6287-41f6-b812-38386577067e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.364137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0d6baac-6287-41f6-b812-38386577067e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.370806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-b0d6baac-6287-41f6-b812-38386577067e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lazy-loading 'fault' on Instance uuid 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:12:53.387384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a30c9ddf-28e6-4694-991a-a0882fca9426 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:53.402187 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a30c9ddf-28e6-4694-991a-a0882fca9426 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 200 len: 1467 microversion: 2.1 time: 0.285237 Jul 20 04:12:53.403144 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 559/1005] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:53 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 1467 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:53.425130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2653175b-ab47-43bd-ac45-0288a27b58ed tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:53.425734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2653175b-ab47-43bd-ac45-0288a27b58ed tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:53.433366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2653175b-ab47-43bd-ac45-0288a27b58ed tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.434207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2653175b-ab47-43bd-ac45-0288a27b58ed tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.436203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2653175b-ab47-43bd-ac45-0288a27b58ed tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.436893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2653175b-ab47-43bd-ac45-0288a27b58ed tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.561436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b0d6baac-6287-41f6-b812-38386577067e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:53.572242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b0d6baac-6287-41f6-b812-38386577067e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:53.574663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b0d6baac-6287-41f6-b812-38386577067e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:53.577225 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b0d6baac-6287-41f6-b812-38386577067e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 200 len: 1348 microversion: 2.21 time: 0.325257 Jul 20 04:12:53.578419 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 447/1006] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:53 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 1348 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:12:53.613636 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2653175b-ab47-43bd-ac45-0288a27b58ed tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 200 len: 1618 microversion: 2.1 time: 0.192518 Jul 20 04:12:53.615184 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 560/1007] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:53 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 1618 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:53.758120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-48b9e331-cc6c-4d73-85a1-1ffafb5a33d6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1940981585", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["23481b1e-fe28-4f48-84fe-f22cae89ac46"]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:53.778359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1f878f52-c17d-4de1-935c-779dbfd69e18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:53.781142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1f878f52-c17d-4de1-935c-779dbfd69e18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:53.784770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:53.788384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f878f52-c17d-4de1-935c-779dbfd69e18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.788974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f878f52-c17d-4de1-935c-779dbfd69e18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.789803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f878f52-c17d-4de1-935c-779dbfd69e18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.790612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f878f52-c17d-4de1-935c-779dbfd69e18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.828567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-48b9e331-cc6c-4d73-85a1-1ffafb5a33d6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] validate_networks() for None {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:53.954104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1f878f52-c17d-4de1-935c-779dbfd69e18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:53.964882 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1f878f52-c17d-4de1-935c-779dbfd69e18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1359 microversion: 2.1 time: 0.191436 Jul 20 04:12:53.965462 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 561/1008] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:53 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:54.054990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-48b9e331-cc6c-4d73-85a1-1ffafb5a33d6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:54.055488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-48b9e331-cc6c-4d73-85a1-1ffafb5a33d6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:54.056030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-48b9e331-cc6c-4d73-85a1-1ffafb5a33d6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:54.056556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-48b9e331-cc6c-4d73-85a1-1ffafb5a33d6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:54.057037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-48b9e331-cc6c-4d73-85a1-1ffafb5a33d6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:54.068036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b9e331-cc6c-4d73-85a1-1ffafb5a33d6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.069052 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b9e331-cc6c-4d73-85a1-1ffafb5a33d6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.069865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b9e331-cc6c-4d73-85a1-1ffafb5a33d6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.070490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b9e331-cc6c-4d73-85a1-1ffafb5a33d6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.088192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-48b9e331-cc6c-4d73-85a1-1ffafb5a33d6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for project 22bcfd2698d047dea07c643970c749eb. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:54.093698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-48b9e331-cc6c-4d73-85a1-1ffafb5a33d6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for user 5e178243e1ed404092e5ea0be39d5c16 and project 22bcfd2698d047dea07c643970c749eb. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:54.107801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-48b9e331-cc6c-4d73-85a1-1ffafb5a33d6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:54.110173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-48b9e331-cc6c-4d73-85a1-1ffafb5a33d6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:54.122820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5e5b137a-8985-40a2-9d9b-43749af80114 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:54.123773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5e5b137a-8985-40a2-9d9b-43749af80114 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:54.131711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e5b137a-8985-40a2-9d9b-43749af80114 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.132524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e5b137a-8985-40a2-9d9b-43749af80114 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.133240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e5b137a-8985-40a2-9d9b-43749af80114 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.134004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e5b137a-8985-40a2-9d9b-43749af80114 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.159634 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-48b9e331-cc6c-4d73-85a1-1ffafb5a33d6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.405760 Jul 20 04:12:54.160566 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 448/1009] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:12:54.172185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8cd80026-3d35-467d-a57d-ad9c6ac97976 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:54.173106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8cd80026-3d35-467d-a57d-ad9c6ac97976 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:54.180150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8cd80026-3d35-467d-a57d-ad9c6ac97976 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.181066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8cd80026-3d35-467d-a57d-ad9c6ac97976 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.182175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8cd80026-3d35-467d-a57d-ad9c6ac97976 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.188655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8cd80026-3d35-467d-a57d-ad9c6ac97976 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.199121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:54.206298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5e5b137a-8985-40a2-9d9b-43749af80114 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:54.215499 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5e5b137a-8985-40a2-9d9b-43749af80114 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1334 microversion: 2.1 time: 0.096788 Jul 20 04:12:54.221587 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 562/1010] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:54 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1334 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:54.229947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8f278ae1-ab5b-4e24-b384-af647ebec21e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:54.230850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8f278ae1-ab5b-4e24-b384-af647ebec21e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:54.298850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8f278ae1-ab5b-4e24-b384-af647ebec21e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:54.307086 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8f278ae1-ab5b-4e24-b384-af647ebec21e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a" status: 200 len: 1217 microversion: 2.1 time: 0.084240 Jul 20 04:12:54.316753 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 563/1011] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:54 2022] GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:54.358769 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8cd80026-3d35-467d-a57d-ad9c6ac97976 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:54.367352 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8cd80026-3d35-467d-a57d-ad9c6ac97976 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1474 microversion: 2.1 time: 0.200155 Jul 20 04:12:54.367874 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 449/1012] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:54 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1474 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:54.540767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-1f5f1346-9576-4622-b579-eb63ec747892 req-a1a4d0b7-7b5a-4e6b-a1bb-dffb115effc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03772705-b1f0-4d7f-ac9c-7f11312e6eb9", "name": "network-vif-deleted", "tag": "813369ac-059c-4aea-bc16-799938109783"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:54.549718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1f5f1346-9576-4622-b579-eb63ec747892 req-a1a4d0b7-7b5a-4e6b-a1bb-dffb115effc3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.550403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1f5f1346-9576-4622-b579-eb63ec747892 req-a1a4d0b7-7b5a-4e6b-a1bb-dffb115effc3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.561861 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-1f5f1346-9576-4622-b579-eb63ec747892 req-a1a4d0b7-7b5a-4e6b-a1bb-dffb115effc3 service nova] Creating event network-vif-deleted:813369ac-059c-4aea-bc16-799938109783 for instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 on n-h1-826526-5 Jul 20 04:12:54.567046 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-1f5f1346-9576-4622-b579-eb63ec747892 req-a1a4d0b7-7b5a-4e6b-a1bb-dffb115effc3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030326 Jul 20 04:12:54.567652 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 564/1013] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:54.597408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f3b8adf7-3ad0-45ba-8949-f0aae3a95322 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:54.598398 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f3b8adf7-3ad0-45ba-8949-f0aae3a95322 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:54.607291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3b8adf7-3ad0-45ba-8949-f0aae3a95322 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.607779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3b8adf7-3ad0-45ba-8949-f0aae3a95322 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.608590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3b8adf7-3ad0-45ba-8949-f0aae3a95322 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.609036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3b8adf7-3ad0-45ba-8949-f0aae3a95322 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.641739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3b8adf7-3ad0-45ba-8949-f0aae3a95322 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.642186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3b8adf7-3ad0-45ba-8949-f0aae3a95322 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.642640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-f3b8adf7-3ad0-45ba-8949-f0aae3a95322 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lazy-loading 'fault' on Instance uuid 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:12:54.685986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f3b8adf7-3ad0-45ba-8949-f0aae3a95322 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:54.693937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f3b8adf7-3ad0-45ba-8949-f0aae3a95322 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:54.695434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f3b8adf7-3ad0-45ba-8949-f0aae3a95322 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e91725faefeb4057ba4990810a8fbd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9ed7d8ff004e9687aba528e0edad98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:54.696673 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f3b8adf7-3ad0-45ba-8949-f0aae3a95322 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 200 len: 1348 microversion: 2.21 time: 0.103757 Jul 20 04:12:54.697308 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 450/1014] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:54 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 1348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:12:54.982239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-63ab7df7-3884-4d96-a0ee-e88c87258658 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:54.982957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-63ab7df7-3884-4d96-a0ee-e88c87258658 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:54.989429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63ab7df7-3884-4d96-a0ee-e88c87258658 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.990109 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63ab7df7-3884-4d96-a0ee-e88c87258658 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.990884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63ab7df7-3884-4d96-a0ee-e88c87258658 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.991315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63ab7df7-3884-4d96-a0ee-e88c87258658 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.162432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-63ab7df7-3884-4d96-a0ee-e88c87258658 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:55.171502 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-63ab7df7-3884-4d96-a0ee-e88c87258658 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1359 microversion: 2.1 time: 0.193354 Jul 20 04:12:55.172695 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 565/1015] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:54 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:55.233170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5356bc19-8b61-4765-bdcf-4e2853ee03fe tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:55.233853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5356bc19-8b61-4765-bdcf-4e2853ee03fe tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:55.236801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:55.242489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5356bc19-8b61-4765-bdcf-4e2853ee03fe tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.243159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5356bc19-8b61-4765-bdcf-4e2853ee03fe tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.244083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5356bc19-8b61-4765-bdcf-4e2853ee03fe tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.244523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5356bc19-8b61-4765-bdcf-4e2853ee03fe tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.324534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-01add969-d118-4f8e-8a69-3ebdf8719ac6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:55.325280 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-01add969-d118-4f8e-8a69-3ebdf8719ac6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:55.331683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-01add969-d118-4f8e-8a69-3ebdf8719ac6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.332135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-01add969-d118-4f8e-8a69-3ebdf8719ac6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.332985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-01add969-d118-4f8e-8a69-3ebdf8719ac6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.333632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-01add969-d118-4f8e-8a69-3ebdf8719ac6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.340870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5356bc19-8b61-4765-bdcf-4e2853ee03fe tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:55.359033 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5356bc19-8b61-4765-bdcf-4e2853ee03fe tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1334 microversion: 2.1 time: 0.129806 Jul 20 04:12:55.370104 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 451/1016] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:55 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1334 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:55.388892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b7bd60f6-c922-4d5e-89e2-631307122f96 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:55.389748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b7bd60f6-c922-4d5e-89e2-631307122f96 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:55.414244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b7bd60f6-c922-4d5e-89e2-631307122f96 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.414764 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b7bd60f6-c922-4d5e-89e2-631307122f96 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.415576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b7bd60f6-c922-4d5e-89e2-631307122f96 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.416015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b7bd60f6-c922-4d5e-89e2-631307122f96 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.437211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-01add969-d118-4f8e-8a69-3ebdf8719ac6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:55.448569 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-01add969-d118-4f8e-8a69-3ebdf8719ac6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a" status: 200 len: 1213 microversion: 2.1 time: 0.127741 Jul 20 04:12:55.449332 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 566/1017] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:55 2022] GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:55.711743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b7bd60f6-c922-4d5e-89e2-631307122f96 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:55.715630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-591ccd47-0c6f-4a26-ac34-5edce762598a tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:55.716415 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-591ccd47-0c6f-4a26-ac34-5edce762598a tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:55.720103 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b7bd60f6-c922-4d5e-89e2-631307122f96 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1474 microversion: 2.1 time: 0.338513 Jul 20 04:12:55.720688 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 452/1018] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:55 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1474 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:55.731236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-591ccd47-0c6f-4a26-ac34-5edce762598a tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.731849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-591ccd47-0c6f-4a26-ac34-5edce762598a tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.732828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-591ccd47-0c6f-4a26-ac34-5edce762598a tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.734026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-591ccd47-0c6f-4a26-ac34-5edce762598a tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.760501 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-591ccd47-0c6f-4a26-ac34-5edce762598a tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] HTTP exception thrown: Instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 could not be found. Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-591ccd47-0c6f-4a26-ac34-5edce762598a tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Request method failure captured: Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 HTTP/1.1 Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14CspKV7BiNV2qAWDMQRCpdvkxkhChQ5oKaUo925B3aJz0l9afB-ly2AR8dxMBde9f7BOT8S493dKvqRWao6-S0T7zfKLV9T5aRq3FuAUL1nTxupob_l9Ffv6ziY6_hbMK3Crm0Z6jq3yBZv4iLTIrPI8k_EJQTiHm97OC4DEqCd1Ho Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: X-Openstack-Nova-Api-Version: 2.21 Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ac9ed7d8ff004e9687aba528e0edad98 Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1779412472 Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:12:55.762363 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:12:55.764150 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ac9ed7d8ff004e9687aba528e0edad98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ac9ed7d8ff004e9687aba528e0edad98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ac9ed7d8ff004e9687aba528e0edad98", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ac9ed7d8ff004e9687aba528e0edad98"}]}] Jul 20 04:12:55.764150 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-InstanceActionsV221TestJSON-1779412472 Jul 20 04:12:55.764150 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ac9ed7d8ff004e9687aba528e0edad98 Jul 20 04:12:55.764150 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1779412472 Jul 20 04:12:55.764150 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-InstanceActionsV221TestJSON-1779412472-project Jul 20 04:12:55.764150 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:12:55.764150 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:12:55.764150 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: e91725faefeb4057ba4990810a8fbd25 Jul 20 04:12:55.764150 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-InstanceActionsV221TestJSON-1779412472-project Jul 20 04:12:55.764150 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:12:55.764150 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 could not be found. Jul 20 04:12:55.764150 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '03772705-b1f0-4d7f-ac9c-7f11312e6eb9'} Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 could not be found. Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:55.765075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:55.766588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:55.766588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:12:55.766588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:12:55.766588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:12:55.766588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:12:55.766588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:12:55.766588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:12:55.766588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 could not be found. Jul 20 04:12:55.766588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:55.766588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:55.766588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:55.766588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:55.766588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:55.766588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:55.766588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:55.766588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:55.766588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 could not be found. Jul 20 04:12:55.766588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:55.767899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-591ccd47-0c6f-4a26-ac34-5edce762598a tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Returning 404 to user: Instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:55.768329 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-591ccd47-0c6f-4a26-ac34-5edce762598a tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 404 len: 111 microversion: 2.21 time: 0.057637 Jul 20 04:12:55.768959 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 567/1019] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:55 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:12:55.777650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-91ada51b-2f36-4491-be1f-78340ba5c6e9 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '.version_select at 0x7f06be2ccf70>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:55.778310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-91ada51b-2f36-4491-be1f-78340ba5c6e9 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:55.785088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91ada51b-2f36-4491-be1f-78340ba5c6e9 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.785537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91ada51b-2f36-4491-be1f-78340ba5c6e9 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.786299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91ada51b-2f36-4491-be1f-78340ba5c6e9 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.786732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91ada51b-2f36-4491-be1f-78340ba5c6e9 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.858277 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-91ada51b-2f36-4491-be1f-78340ba5c6e9 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.084613 Jul 20 04:12:55.859798 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 453/1020] 10.222.0.17 () {60 vars in 1336 bytes} [Wed Jul 20 04:12:55 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9/os-instance-actions => generated 611 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:12:55.873940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-11db1d53-2339-463d-9e93-d5defb97f62e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:55.874677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-11db1d53-2339-463d-9e93-d5defb97f62e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:55.881959 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11db1d53-2339-463d-9e93-d5defb97f62e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.882403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11db1d53-2339-463d-9e93-d5defb97f62e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.883184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11db1d53-2339-463d-9e93-d5defb97f62e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.883601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11db1d53-2339-463d-9e93-d5defb97f62e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.901067 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-11db1d53-2339-463d-9e93-d5defb97f62e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] HTTP exception thrown: Instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 could not be found. Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-11db1d53-2339-463d-9e93-d5defb97f62e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Request method failure captured: Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 HTTP/1.1 Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14CspKV7BiNV2qAWDMQRCpdvkxkhChQ5oKaUo925B3aJz0l9afB-ly2AR8dxMBde9f7BOT8S493dKvqRWao6-S0T7zfKLV9T5aRq3FuAUL1nTxupob_l9Ffv6ziY6_hbMK3Crm0Z6jq3yBZv4iLTIrPI8k_EJQTiHm97OC4DEqCd1Ho Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: X-Openstack-Nova-Api-Version: 2.21 Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ac9ed7d8ff004e9687aba528e0edad98 Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1779412472 Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:12:55.902643 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:12:55.904324 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ac9ed7d8ff004e9687aba528e0edad98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ac9ed7d8ff004e9687aba528e0edad98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ac9ed7d8ff004e9687aba528e0edad98", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ac9ed7d8ff004e9687aba528e0edad98"}]}] Jul 20 04:12:55.904324 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-InstanceActionsV221TestJSON-1779412472 Jul 20 04:12:55.904324 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ac9ed7d8ff004e9687aba528e0edad98 Jul 20 04:12:55.904324 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1779412472 Jul 20 04:12:55.904324 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-InstanceActionsV221TestJSON-1779412472-project Jul 20 04:12:55.904324 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:12:55.904324 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:12:55.904324 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: e91725faefeb4057ba4990810a8fbd25 Jul 20 04:12:55.904324 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-InstanceActionsV221TestJSON-1779412472-project Jul 20 04:12:55.904324 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:12:55.904324 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 could not be found. Jul 20 04:12:55.904324 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '03772705-b1f0-4d7f-ac9c-7f11312e6eb9'} Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 could not be found. Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:55.905239 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 could not be found. Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 could not be found. Jul 20 04:12:55.906672 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:12:55.908255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-11db1d53-2339-463d-9e93-d5defb97f62e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Returning 404 to user: Instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:55.908255 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-11db1d53-2339-463d-9e93-d5defb97f62e tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "DELETE /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 404 len: 111 microversion: 2.21 time: 0.034327 Jul 20 04:12:55.908255 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 568/1021] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:12:55 2022] DELETE /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:12:55.913542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-050ffc67-c940-4c4a-9809-613bb30c6bf4 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:55.914248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-050ffc67-c940-4c4a-9809-613bb30c6bf4 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] [instance: 03772705-b1f0-4d7f-ac9c-7f11312e6eb9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:55.921580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-050ffc67-c940-4c4a-9809-613bb30c6bf4 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.922073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-050ffc67-c940-4c4a-9809-613bb30c6bf4 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.922944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-050ffc67-c940-4c4a-9809-613bb30c6bf4 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.923454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-050ffc67-c940-4c4a-9809-613bb30c6bf4 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.939273 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-050ffc67-c940-4c4a-9809-613bb30c6bf4 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] HTTP exception thrown: Instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 could not be found. Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-050ffc67-c940-4c4a-9809-613bb30c6bf4 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Request method failure captured: Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 HTTP/1.1 Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14CspKV7BiNV2qAWDMQRCpdvkxkhChQ5oKaUo925B3aJz0l9afB-ly2AR8dxMBde9f7BOT8S493dKvqRWao6-S0T7zfKLV9T5aRq3FuAUL1nTxupob_l9Ffv6ziY6_hbMK3Crm0Z6jq3yBZv4iLTIrPI8k_EJQTiHm97OC4DEqCd1Ho Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.21 Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: ac9ed7d8ff004e9687aba528e0edad98 Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1779412472 Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:12:55.941276 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:12:55.942871 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ac9ed7d8ff004e9687aba528e0edad98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ac9ed7d8ff004e9687aba528e0edad98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ac9ed7d8ff004e9687aba528e0edad98", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ac9ed7d8ff004e9687aba528e0edad98"}]}] Jul 20 04:12:55.942871 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-InstanceActionsV221TestJSON-1779412472 Jul 20 04:12:55.942871 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: ac9ed7d8ff004e9687aba528e0edad98 Jul 20 04:12:55.942871 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1779412472 Jul 20 04:12:55.942871 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-InstanceActionsV221TestJSON-1779412472-project Jul 20 04:12:55.942871 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:12:55.942871 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:12:55.942871 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: e91725faefeb4057ba4990810a8fbd25 Jul 20 04:12:55.942871 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-InstanceActionsV221TestJSON-1779412472-project Jul 20 04:12:55.942871 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:12:55.942871 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 could not be found. Jul 20 04:12:55.942871 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '03772705-b1f0-4d7f-ac9c-7f11312e6eb9'} Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 could not be found. Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:55.943735 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:55.945251 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:55.945251 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:12:55.945251 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:12:55.945251 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:12:55.945251 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:12:55.945251 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:12:55.945251 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:12:55.945251 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 could not be found. Jul 20 04:12:55.945251 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:55.945251 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:55.945251 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:55.945251 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:55.945251 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:55.945251 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:55.945251 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:55.945251 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:55.945251 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 could not be found. Jul 20 04:12:55.945251 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:12:55.946498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-050ffc67-c940-4c4a-9809-613bb30c6bf4 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] Returning 404 to user: Instance 03772705-b1f0-4d7f-ac9c-7f11312e6eb9 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:55.946498 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-050ffc67-c940-4c4a-9809-613bb30c6bf4 tempest-InstanceActionsV221TestJSON-1779412472 tempest-InstanceActionsV221TestJSON-1779412472-project] 10.222.0.17 "GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9" status: 404 len: 111 microversion: 2.21 time: 0.035110 Jul 20 04:12:55.946654 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 454/1022] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:55 2022] GET /compute/v2.1/servers/03772705-b1f0-4d7f-ac9c-7f11312e6eb9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:12:56.190953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5632ee04-99fd-4796-b99e-b99b25ffd9bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:56.191721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5632ee04-99fd-4796-b99e-b99b25ffd9bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:56.198821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5632ee04-99fd-4796-b99e-b99b25ffd9bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.199548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5632ee04-99fd-4796-b99e-b99b25ffd9bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.200580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5632ee04-99fd-4796-b99e-b99b25ffd9bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.201291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5632ee04-99fd-4796-b99e-b99b25ffd9bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.344076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5632ee04-99fd-4796-b99e-b99b25ffd9bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:56.351860 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5632ee04-99fd-4796-b99e-b99b25ffd9bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1359 microversion: 2.1 time: 0.164779 Jul 20 04:12:56.352513 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 569/1023] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:56 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:56.376243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eda34ed2-e342-4286-9e08-a2b7e5f50046 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:56.377067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eda34ed2-e342-4286-9e08-a2b7e5f50046 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:56.384397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eda34ed2-e342-4286-9e08-a2b7e5f50046 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.384849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eda34ed2-e342-4286-9e08-a2b7e5f50046 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.385623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eda34ed2-e342-4286-9e08-a2b7e5f50046 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.386060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eda34ed2-e342-4286-9e08-a2b7e5f50046 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.466410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-43dda8a0-74fe-4164-b392-297f584bb83e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:56.467100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-43dda8a0-74fe-4164-b392-297f584bb83e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:56.473945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43dda8a0-74fe-4164-b392-297f584bb83e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.474395 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43dda8a0-74fe-4164-b392-297f584bb83e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.475195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43dda8a0-74fe-4164-b392-297f584bb83e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.475637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43dda8a0-74fe-4164-b392-297f584bb83e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.542289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-43dda8a0-74fe-4164-b392-297f584bb83e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:56.557292 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-43dda8a0-74fe-4164-b392-297f584bb83e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a" status: 200 len: 1213 microversion: 2.1 time: 0.094539 Jul 20 04:12:56.568881 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 570/1024] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:56 2022] GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:56.640420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-523d04f4-c22b-4df2-b376-10b981bb4c24 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:56.641507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-523d04f4-c22b-4df2-b376-10b981bb4c24 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:56.652739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-523d04f4-c22b-4df2-b376-10b981bb4c24 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.653556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-523d04f4-c22b-4df2-b376-10b981bb4c24 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.654492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-523d04f4-c22b-4df2-b376-10b981bb4c24 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.655003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-523d04f4-c22b-4df2-b376-10b981bb4c24 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.688875 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-523d04f4-c22b-4df2-b376-10b981bb4c24 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051874 Jul 20 04:12:56.689533 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 571/1025] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:12:56 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:12:56.740306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-17491b08-c535-4ffb-9f51-86126d6102d9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:56.741014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-17491b08-c535-4ffb-9f51-86126d6102d9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:56.751496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17491b08-c535-4ffb-9f51-86126d6102d9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.751951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17491b08-c535-4ffb-9f51-86126d6102d9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.752775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17491b08-c535-4ffb-9f51-86126d6102d9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.753213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17491b08-c535-4ffb-9f51-86126d6102d9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.937671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-17491b08-c535-4ffb-9f51-86126d6102d9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:56.945539 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-17491b08-c535-4ffb-9f51-86126d6102d9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1474 microversion: 2.1 time: 0.209157 Jul 20 04:12:56.946146 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 572/1026] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:56 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1474 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:56.951934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-353890c8-a487-4f6e-8c0c-b51f9fb5c935 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:56.953698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-353890c8-a487-4f6e-8c0c-b51f9fb5c935 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:56.959963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-353890c8-a487-4f6e-8c0c-b51f9fb5c935 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.960856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-353890c8-a487-4f6e-8c0c-b51f9fb5c935 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.961423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-353890c8-a487-4f6e-8c0c-b51f9fb5c935 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.961858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-353890c8-a487-4f6e-8c0c-b51f9fb5c935 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.990837 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-353890c8-a487-4f6e-8c0c-b51f9fb5c935 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043658 Jul 20 04:12:56.991419 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 573/1027] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:12:56 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:12:57.049766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-74cd5a8b-221b-49c2-aadf-05b0aa3305b4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:57.050260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-74cd5a8b-221b-49c2-aadf-05b0aa3305b4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:57.056451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-74cd5a8b-221b-49c2-aadf-05b0aa3305b4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.056903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-74cd5a8b-221b-49c2-aadf-05b0aa3305b4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.057784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-74cd5a8b-221b-49c2-aadf-05b0aa3305b4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.058094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-74cd5a8b-221b-49c2-aadf-05b0aa3305b4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.071092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eda34ed2-e342-4286-9e08-a2b7e5f50046 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:57.079829 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eda34ed2-e342-4286-9e08-a2b7e5f50046 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1401 microversion: 2.1 time: 0.707419 Jul 20 04:12:57.080637 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 455/1028] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:56 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1401 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:57.083383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-74cd5a8b-221b-49c2-aadf-05b0aa3305b4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:12:57.085433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:57.171318 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-74cd5a8b-221b-49c2-aadf-05b0aa3305b4 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "DELETE /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 204 len: 0 microversion: 2.1 time: 0.125057 Jul 20 04:12:57.172199 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 574/1029] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:12:57 2022] DELETE /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:12:57.183939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1f326083-73b6-4c7a-b5a8-aaac3774e97b tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:57.184980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1f326083-73b6-4c7a-b5a8-aaac3774e97b tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:57.191991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f326083-73b6-4c7a-b5a8-aaac3774e97b tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.192657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f326083-73b6-4c7a-b5a8-aaac3774e97b tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.193917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f326083-73b6-4c7a-b5a8-aaac3774e97b tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.194680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f326083-73b6-4c7a-b5a8-aaac3774e97b tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.371859 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5df65179-8fda-48b4-bc72-6ab812c050c5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:57.373068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5df65179-8fda-48b4-bc72-6ab812c050c5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:57.383621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5df65179-8fda-48b4-bc72-6ab812c050c5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.389541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5df65179-8fda-48b4-bc72-6ab812c050c5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.391107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5df65179-8fda-48b4-bc72-6ab812c050c5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.391763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5df65179-8fda-48b4-bc72-6ab812c050c5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.616950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1f326083-73b6-4c7a-b5a8-aaac3774e97b tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f120f1774f7e409798e0894b71db9e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b553064d6374435a814f572cdbaedc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:57.630616 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1f326083-73b6-4c7a-b5a8-aaac3774e97b tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 200 len: 1681 microversion: 2.1 time: 0.453126 Jul 20 04:12:57.631943 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 456/1030] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:57 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 1681 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:57.640063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a965574d-be26-4a86-92ae-6b45e6e0722c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:57.640913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a965574d-be26-4a86-92ae-6b45e6e0722c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:57.650287 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a965574d-be26-4a86-92ae-6b45e6e0722c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.650944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a965574d-be26-4a86-92ae-6b45e6e0722c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.652057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a965574d-be26-4a86-92ae-6b45e6e0722c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.652712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a965574d-be26-4a86-92ae-6b45e6e0722c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.854306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a965574d-be26-4a86-92ae-6b45e6e0722c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:57.863637 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a965574d-be26-4a86-92ae-6b45e6e0722c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a" status: 200 len: 1275 microversion: 2.1 time: 0.229341 Jul 20 04:12:57.874810 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 457/1031] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:57 2022] GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a => generated 1275 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:57.881939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-a422804b-9e9b-48d7-99b0-93dfc2a1015c req-d751bb2d-e32a-4727-babb-89f244f7c4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52df8cf7-6be8-4f22-a0b4-4a5e0b31be04", "name": "network-vif-plugged", "status": "completed", "tag": "295ab3b5-0949-4953-b868-df3a92dd92e7"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:57.892539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a422804b-9e9b-48d7-99b0-93dfc2a1015c req-d751bb2d-e32a-4727-babb-89f244f7c4b3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.892991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a422804b-9e9b-48d7-99b0-93dfc2a1015c req-d751bb2d-e32a-4727-babb-89f244f7c4b3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.907544 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-a422804b-9e9b-48d7-99b0-93dfc2a1015c req-d751bb2d-e32a-4727-babb-89f244f7c4b3 service nova] Creating event network-vif-plugged:295ab3b5-0949-4953-b868-df3a92dd92e7 for instance 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 on n-h1-826526-5 Jul 20 04:12:57.914368 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-a422804b-9e9b-48d7-99b0-93dfc2a1015c req-d751bb2d-e32a-4727-babb-89f244f7c4b3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036289 Jul 20 04:12:57.916083 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 458/1032] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:57.941131 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5df65179-8fda-48b4-bc72-6ab812c050c5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:57.957607 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5df65179-8fda-48b4-bc72-6ab812c050c5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1359 microversion: 2.1 time: 0.591985 Jul 20 04:12:57.960669 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 575/1033] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:57 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1359 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:57.964369 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6905a0d4-b123-4a50-90a7-d295e3bf56c5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:57.965358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6905a0d4-b123-4a50-90a7-d295e3bf56c5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:57.985167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6905a0d4-b123-4a50-90a7-d295e3bf56c5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.985823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6905a0d4-b123-4a50-90a7-d295e3bf56c5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.989346 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6905a0d4-b123-4a50-90a7-d295e3bf56c5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.990903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6905a0d4-b123-4a50-90a7-d295e3bf56c5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.097552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7ab5806c-15d6-4cac-823d-1668da8c5fce tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:58.098160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7ab5806c-15d6-4cac-823d-1668da8c5fce tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:58.104547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ab5806c-15d6-4cac-823d-1668da8c5fce tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.104987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ab5806c-15d6-4cac-823d-1668da8c5fce tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.105959 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ab5806c-15d6-4cac-823d-1668da8c5fce tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.106394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ab5806c-15d6-4cac-823d-1668da8c5fce tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.350569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6905a0d4-b123-4a50-90a7-d295e3bf56c5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:58.352639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7ab5806c-15d6-4cac-823d-1668da8c5fce tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:58.362445 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6905a0d4-b123-4a50-90a7-d295e3bf56c5 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1471 microversion: 2.1 time: 0.403008 Jul 20 04:12:58.364048 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7ab5806c-15d6-4cac-823d-1668da8c5fce tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1401 microversion: 2.1 time: 0.270355 Jul 20 04:12:58.364224 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 459/1034] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:57 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1471 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:58.367224 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 576/1035] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:58 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1401 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:58.387094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8506263e-7160-4e52-acf4-7643823f9d65 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:58.388098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8506263e-7160-4e52-acf4-7643823f9d65 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:58.400220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8506263e-7160-4e52-acf4-7643823f9d65 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.400894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8506263e-7160-4e52-acf4-7643823f9d65 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.401860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8506263e-7160-4e52-acf4-7643823f9d65 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.402594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8506263e-7160-4e52-acf4-7643823f9d65 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.454383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8506263e-7160-4e52-acf4-7643823f9d65 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.454857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8506263e-7160-4e52-acf4-7643823f9d65 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.455669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8506263e-7160-4e52-acf4-7643823f9d65 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.456109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8506263e-7160-4e52-acf4-7643823f9d65 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.485385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8506263e-7160-4e52-acf4-7643823f9d65 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Getting quotas for project 6c73d55e6bc740d0aec2ba67f0491099. Resources: {'ram', 'cores'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:58.491191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8506263e-7160-4e52-acf4-7643823f9d65 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Getting quotas for user b4f8b49fd45944a384836a1459e4e7e9 and project 6c73d55e6bc740d0aec2ba67f0491099. Resources: {'ram', 'cores'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:58.651296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4ab51289-cb53-440f-aed8-bd8f66e5651c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:58.654041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4ab51289-cb53-440f-aed8-bd8f66e5651c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:58.676766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ab51289-cb53-440f-aed8-bd8f66e5651c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.677636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ab51289-cb53-440f-aed8-bd8f66e5651c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.679603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ab51289-cb53-440f-aed8-bd8f66e5651c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.681276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ab51289-cb53-440f-aed8-bd8f66e5651c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.682287 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8506263e-7160-4e52-acf4-7643823f9d65 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "POST /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9/action" status: 202 len: 0 microversion: 2.1 time: 0.305422 Jul 20 04:12:58.687014 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 460/1036] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:12:58 2022] POST /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:58.699781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9f1ed59b-23e5-4f76-bf3f-06f75c0451bb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:58.706137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9f1ed59b-23e5-4f76-bf3f-06f75c0451bb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:58.725628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f1ed59b-23e5-4f76-bf3f-06f75c0451bb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.730327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f1ed59b-23e5-4f76-bf3f-06f75c0451bb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.734630 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f1ed59b-23e5-4f76-bf3f-06f75c0451bb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.735587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f1ed59b-23e5-4f76-bf3f-06f75c0451bb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:59.078259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4ab51289-cb53-440f-aed8-bd8f66e5651c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f120f1774f7e409798e0894b71db9e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b553064d6374435a814f572cdbaedc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:59.087789 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4ab51289-cb53-440f-aed8-bd8f66e5651c tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 200 len: 1681 microversion: 2.1 time: 0.442034 Jul 20 04:12:59.089344 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 577/1037] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:58 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 1681 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:59.096196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-54626a14-c36d-46b5-bf26-70d8f5e555c0 req-bcf1ac7c-8733-41e5-a4ce-2d9b785ba98a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b459a3ae-fa64-4ffa-a90f-ae87acc75273", "tag": "f98829db-28ce-43b1-91f3-0b5324542e84"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:59.104794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-54626a14-c36d-46b5-bf26-70d8f5e555c0 req-bcf1ac7c-8733-41e5-a4ce-2d9b785ba98a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:59.105526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-54626a14-c36d-46b5-bf26-70d8f5e555c0 req-bcf1ac7c-8733-41e5-a4ce-2d9b785ba98a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:59.118561 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-54626a14-c36d-46b5-bf26-70d8f5e555c0 req-bcf1ac7c-8733-41e5-a4ce-2d9b785ba98a service nova] Creating event network-changed:f98829db-28ce-43b1-91f3-0b5324542e84 for instance b459a3ae-fa64-4ffa-a90f-ae87acc75273 on n-h1-826526-5 Jul 20 04:12:59.123802 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-54626a14-c36d-46b5-bf26-70d8f5e555c0 req-bcf1ac7c-8733-41e5-a4ce-2d9b785ba98a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033079 Jul 20 04:12:59.124772 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 578/1038] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:59.130931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-baae0c73-e055-4672-bf46-5179bab4a977 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:59.131630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-baae0c73-e055-4672-bf46-5179bab4a977 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:59.138184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-baae0c73-e055-4672-bf46-5179bab4a977 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:59.139161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-baae0c73-e055-4672-bf46-5179bab4a977 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:59.139944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-baae0c73-e055-4672-bf46-5179bab4a977 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:59.140403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-baae0c73-e055-4672-bf46-5179bab4a977 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:59.276241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9f1ed59b-23e5-4f76-bf3f-06f75c0451bb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:59.286767 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9f1ed59b-23e5-4f76-bf3f-06f75c0451bb tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1470 microversion: 2.1 time: 0.597138 Jul 20 04:12:59.287682 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 461/1039] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:58 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1470 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:59.300467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dcdd84ee-86db-4fe8-a092-64836f29d0c9 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:59.301244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dcdd84ee-86db-4fe8-a092-64836f29d0c9 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:59.309569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcdd84ee-86db-4fe8-a092-64836f29d0c9 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:59.310180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcdd84ee-86db-4fe8-a092-64836f29d0c9 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:59.311112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcdd84ee-86db-4fe8-a092-64836f29d0c9 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:59.311678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcdd84ee-86db-4fe8-a092-64836f29d0c9 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:59.345986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-baae0c73-e055-4672-bf46-5179bab4a977 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:59.356066 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-baae0c73-e055-4672-bf46-5179bab4a977 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a" status: 200 len: 1317 microversion: 2.1 time: 0.229310 Jul 20 04:12:59.356720 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 579/1040] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:59 2022] GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:59.386104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8c354f4f-ebae-4984-b2f4-20a95d196ea6 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:59.386734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8c354f4f-ebae-4984-b2f4-20a95d196ea6 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:59.397593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c354f4f-ebae-4984-b2f4-20a95d196ea6 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:59.398404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c354f4f-ebae-4984-b2f4-20a95d196ea6 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:59.399450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c354f4f-ebae-4984-b2f4-20a95d196ea6 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:59.400062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c354f4f-ebae-4984-b2f4-20a95d196ea6 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:59.659215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8c354f4f-ebae-4984-b2f4-20a95d196ea6 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:59.693032 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8c354f4f-ebae-4984-b2f4-20a95d196ea6 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1401 microversion: 2.1 time: 0.309613 Jul 20 04:12:59.696010 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 580/1041] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:59 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1401 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:59.936066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-28f2bb73-0b85-40ff-99e6-81709b4a4ea9 req-c083d488-399f-4f31-8ca7-d25e8a40aaff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944a56a8-87ef-4988-9f97-106c08046fe9", "name": "network-vif-plugged", "status": "completed", "tag": "63a5fa97-49af-495f-b6c4-80e7f5925cac"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:59.957846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-28f2bb73-0b85-40ff-99e6-81709b4a4ea9 req-c083d488-399f-4f31-8ca7-d25e8a40aaff service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:59.958325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-28f2bb73-0b85-40ff-99e6-81709b4a4ea9 req-c083d488-399f-4f31-8ca7-d25e8a40aaff service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:59.985599 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-28f2bb73-0b85-40ff-99e6-81709b4a4ea9 req-c083d488-399f-4f31-8ca7-d25e8a40aaff service nova] Creating event network-vif-plugged:63a5fa97-49af-495f-b6c4-80e7f5925cac for instance 944a56a8-87ef-4988-9f97-106c08046fe9 on n-h1-826526-5 Jul 20 04:12:59.998951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-28f2bb73-0b85-40ff-99e6-81709b4a4ea9 req-c083d488-399f-4f31-8ca7-d25e8a40aaff service nova] Instance 944a56a8-87ef-4988-9f97-106c08046fe9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:13:00.023158 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-28f2bb73-0b85-40ff-99e6-81709b4a4ea9 req-c083d488-399f-4f31-8ca7-d25e8a40aaff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092165 Jul 20 04:13:00.028343 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 581/1042] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:13:00.110256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9ae9e389-0e2f-4c83-9076-15e026bc4c12 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:00.111653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9ae9e389-0e2f-4c83-9076-15e026bc4c12 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:00.116931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dcdd84ee-86db-4fe8-a092-64836f29d0c9 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:00.125700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ae9e389-0e2f-4c83-9076-15e026bc4c12 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.126461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ae9e389-0e2f-4c83-9076-15e026bc4c12 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.127469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ae9e389-0e2f-4c83-9076-15e026bc4c12 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.129621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ae9e389-0e2f-4c83-9076-15e026bc4c12 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.133136 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dcdd84ee-86db-4fe8-a092-64836f29d0c9 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1359 microversion: 2.1 time: 0.843854 Jul 20 04:13:00.133762 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 462/1043] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:59 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1359 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:00.248472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-872b6ac5-9d72-4273-9495-ef4f2079d6da req-d0c7dc93-2fc9-42a4-a53d-b936811a5809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "089704fa-0301-45a0-a4d8-3adbc8835f2a", "tag": "0dc711ee-fc2f-40cc-a206-2a3b853708f8"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:00.273714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-872b6ac5-9d72-4273-9495-ef4f2079d6da req-d0c7dc93-2fc9-42a4-a53d-b936811a5809 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.274157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-872b6ac5-9d72-4273-9495-ef4f2079d6da req-d0c7dc93-2fc9-42a4-a53d-b936811a5809 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.295021 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-872b6ac5-9d72-4273-9495-ef4f2079d6da req-d0c7dc93-2fc9-42a4-a53d-b936811a5809 service nova] Creating event network-changed:0dc711ee-fc2f-40cc-a206-2a3b853708f8 for instance 089704fa-0301-45a0-a4d8-3adbc8835f2a on n-h1-826526-5 Jul 20 04:13:00.309819 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-872b6ac5-9d72-4273-9495-ef4f2079d6da req-d0c7dc93-2fc9-42a4-a53d-b936811a5809 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065233 Jul 20 04:13:00.310768 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 463/1044] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:13:00.317039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d0a6acf-80d8-453a-a1f2-422c7c9ccc61 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:00.330480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d0a6acf-80d8-453a-a1f2-422c7c9ccc61 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:00.340983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d0a6acf-80d8-453a-a1f2-422c7c9ccc61 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.342663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d0a6acf-80d8-453a-a1f2-422c7c9ccc61 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.343719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d0a6acf-80d8-453a-a1f2-422c7c9ccc61 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.344820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d0a6acf-80d8-453a-a1f2-422c7c9ccc61 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.374420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:00.507250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9ae9e389-0e2f-4c83-9076-15e026bc4c12 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f120f1774f7e409798e0894b71db9e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b553064d6374435a814f572cdbaedc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:00.518129 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9ae9e389-0e2f-4c83-9076-15e026bc4c12 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 200 len: 1681 microversion: 2.1 time: 0.413656 Jul 20 04:13:00.519069 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 582/1045] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:00 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 1681 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:00.524278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2bdb8d57-051f-4ae9-9c1e-8c1ac6c2274e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:00.524911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2bdb8d57-051f-4ae9-9c1e-8c1ac6c2274e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:00.531764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bdb8d57-051f-4ae9-9c1e-8c1ac6c2274e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.532221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bdb8d57-051f-4ae9-9c1e-8c1ac6c2274e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.533063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bdb8d57-051f-4ae9-9c1e-8c1ac6c2274e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.533506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bdb8d57-051f-4ae9-9c1e-8c1ac6c2274e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.759021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2bdb8d57-051f-4ae9-9c1e-8c1ac6c2274e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:00.768184 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2bdb8d57-051f-4ae9-9c1e-8c1ac6c2274e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a" status: 200 len: 1317 microversion: 2.1 time: 0.248206 Jul 20 04:13:00.768890 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 583/1046] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:00 2022] GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:00.781552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-962560d2-62c1-4aff-9ee4-47d0850c7b59 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:00.782424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-962560d2-62c1-4aff-9ee4-47d0850c7b59 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:00.789167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-962560d2-62c1-4aff-9ee4-47d0850c7b59 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.789624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-962560d2-62c1-4aff-9ee4-47d0850c7b59 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.790404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-962560d2-62c1-4aff-9ee4-47d0850c7b59 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.790844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-962560d2-62c1-4aff-9ee4-47d0850c7b59 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.940133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d0a6acf-80d8-453a-a1f2-422c7c9ccc61 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:00.949432 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d0a6acf-80d8-453a-a1f2-422c7c9ccc61 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1470 microversion: 2.1 time: 0.635933 Jul 20 04:13:00.960402 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 464/1047] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:00 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1470 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:00.987491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-962560d2-62c1-4aff-9ee4-47d0850c7b59 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:00.995445 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-962560d2-62c1-4aff-9ee4-47d0850c7b59 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1401 microversion: 2.1 time: 0.225360 Jul 20 04:13:00.996069 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 584/1048] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:00 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1401 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:01.151108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7fec68c8-4998-4673-bb36-1559a09a6d69 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:01.151715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7fec68c8-4998-4673-bb36-1559a09a6d69 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:01.159239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fec68c8-4998-4673-bb36-1559a09a6d69 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.160033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fec68c8-4998-4673-bb36-1559a09a6d69 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.161426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fec68c8-4998-4673-bb36-1559a09a6d69 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.162225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fec68c8-4998-4673-bb36-1559a09a6d69 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.398780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7fec68c8-4998-4673-bb36-1559a09a6d69 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:01.407054 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7fec68c8-4998-4673-bb36-1559a09a6d69 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1543 microversion: 2.1 time: 0.260037 Jul 20 04:13:01.407874 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 465/1049] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:01 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1543 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:01.424185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9ffa9050-6f0a-43c5-9455-b714e80b524d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:01.425294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9ffa9050-6f0a-43c5-9455-b714e80b524d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:01.427465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:01.433627 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ffa9050-6f0a-43c5-9455-b714e80b524d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.435065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ffa9050-6f0a-43c5-9455-b714e80b524d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.437435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ffa9050-6f0a-43c5-9455-b714e80b524d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.438515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ffa9050-6f0a-43c5-9455-b714e80b524d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.535682 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-637d2caf-0bc5-49ab-ace3-a0ab588d7f81 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:01.536462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-637d2caf-0bc5-49ab-ace3-a0ab588d7f81 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:01.543093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-637d2caf-0bc5-49ab-ace3-a0ab588d7f81 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.543540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-637d2caf-0bc5-49ab-ace3-a0ab588d7f81 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.544363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-637d2caf-0bc5-49ab-ace3-a0ab588d7f81 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.545170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-637d2caf-0bc5-49ab-ace3-a0ab588d7f81 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.563882 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9ffa9050-6f0a-43c5-9455-b714e80b524d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143540 Jul 20 04:13:01.570191 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 585/1050] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:13:01 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:01.787905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e2c512a1-3e29-4cc5-b182-aa8c7bb6e6b0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:01.788984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e2c512a1-3e29-4cc5-b182-aa8c7bb6e6b0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:01.798245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e2c512a1-3e29-4cc5-b182-aa8c7bb6e6b0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.799107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e2c512a1-3e29-4cc5-b182-aa8c7bb6e6b0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.800144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e2c512a1-3e29-4cc5-b182-aa8c7bb6e6b0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.800940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e2c512a1-3e29-4cc5-b182-aa8c7bb6e6b0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:02.047911 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-637d2caf-0bc5-49ab-ace3-a0ab588d7f81 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f120f1774f7e409798e0894b71db9e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b553064d6374435a814f572cdbaedc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:02.057336 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-637d2caf-0bc5-49ab-ace3-a0ab588d7f81 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 200 len: 1614 microversion: 2.1 time: 0.525922 Jul 20 04:13:02.058262 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 466/1051] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:01 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 1614 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:02.063164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-77cf35bf-739d-4297-8535-56c0cae8e8fd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:02.063766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-77cf35bf-739d-4297-8535-56c0cae8e8fd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:02.070535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-77cf35bf-739d-4297-8535-56c0cae8e8fd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:02.072227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e2c512a1-3e29-4cc5-b182-aa8c7bb6e6b0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:02.072553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-77cf35bf-739d-4297-8535-56c0cae8e8fd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:02.073339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-77cf35bf-739d-4297-8535-56c0cae8e8fd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:02.073776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-77cf35bf-739d-4297-8535-56c0cae8e8fd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:02.081233 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e2c512a1-3e29-4cc5-b182-aa8c7bb6e6b0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a" status: 200 len: 1317 microversion: 2.1 time: 0.299292 Jul 20 04:13:02.082101 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 586/1052] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:01 2022] GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:02.099745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-35066a1d-8aca-45ec-a5f5-1ba8d0e44dbe tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:02.100650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35066a1d-8aca-45ec-a5f5-1ba8d0e44dbe tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:02.116124 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35066a1d-8aca-45ec-a5f5-1ba8d0e44dbe tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:02.116697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35066a1d-8aca-45ec-a5f5-1ba8d0e44dbe tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:02.118454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35066a1d-8aca-45ec-a5f5-1ba8d0e44dbe tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:02.119186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35066a1d-8aca-45ec-a5f5-1ba8d0e44dbe tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:02.577153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-35066a1d-8aca-45ec-a5f5-1ba8d0e44dbe tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:02.592015 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-35066a1d-8aca-45ec-a5f5-1ba8d0e44dbe tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1401 microversion: 2.1 time: 0.508230 Jul 20 04:13:02.594269 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 587/1053] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:02 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1401 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:02.606162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-879abaf9-1dfd-45f0-98dc-dedfdfc79877 req-92e972f5-1dd3-4916-97b5-4a739eddab33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609e8037-70aa-40fc-bd6d-1dbbdeabc6d2", "name": "network-vif-deleted", "tag": "86019a59-d8ac-45dd-825e-637199de9b86"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:02.642968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-879abaf9-1dfd-45f0-98dc-dedfdfc79877 req-92e972f5-1dd3-4916-97b5-4a739eddab33 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:02.650991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-879abaf9-1dfd-45f0-98dc-dedfdfc79877 req-92e972f5-1dd3-4916-97b5-4a739eddab33 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:02.670371 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-879abaf9-1dfd-45f0-98dc-dedfdfc79877 req-92e972f5-1dd3-4916-97b5-4a739eddab33 service nova] Creating event network-vif-deleted:86019a59-d8ac-45dd-825e-637199de9b86 for instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 on n-h2-826526-5 Jul 20 04:13:02.677380 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-879abaf9-1dfd-45f0-98dc-dedfdfc79877 req-92e972f5-1dd3-4916-97b5-4a739eddab33 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079523 Jul 20 04:13:02.678008 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 588/1054] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:02.725348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-77cf35bf-739d-4297-8535-56c0cae8e8fd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:02.737496 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-77cf35bf-739d-4297-8535-56c0cae8e8fd tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1470 microversion: 2.1 time: 0.677861 Jul 20 04:13:02.738650 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 467/1055] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:02 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1470 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:03.076004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8b4095a5-da4d-49a0-99eb-3de8fc0fea3e tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:03.077740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8b4095a5-da4d-49a0-99eb-3de8fc0fea3e tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:03.086204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b4095a5-da4d-49a0-99eb-3de8fc0fea3e tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.087753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b4095a5-da4d-49a0-99eb-3de8fc0fea3e tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.088945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b4095a5-da4d-49a0-99eb-3de8fc0fea3e tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.090149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b4095a5-da4d-49a0-99eb-3de8fc0fea3e tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.098738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-06025ed5-bd79-4752-b041-7388336c9db0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:03.099355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-06025ed5-bd79-4752-b041-7388336c9db0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:03.110317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06025ed5-bd79-4752-b041-7388336c9db0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.110776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06025ed5-bd79-4752-b041-7388336c9db0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.111568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06025ed5-bd79-4752-b041-7388336c9db0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.112254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06025ed5-bd79-4752-b041-7388336c9db0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.201017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b4095a5-da4d-49a0-99eb-3de8fc0fea3e tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.202290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b4095a5-da4d-49a0-99eb-3de8fc0fea3e tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.202767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-8b4095a5-da4d-49a0-99eb-3de8fc0fea3e tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lazy-loading 'fault' on Instance uuid 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:13:03.375584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8b4095a5-da4d-49a0-99eb-3de8fc0fea3e tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f120f1774f7e409798e0894b71db9e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b553064d6374435a814f572cdbaedc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:03.383213 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8b4095a5-da4d-49a0-99eb-3de8fc0fea3e tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 200 len: 1331 microversion: 2.1 time: 0.311816 Jul 20 04:13:03.383816 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 589/1056] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:03 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 1331 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:03.453816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-06025ed5-bd79-4752-b041-7388336c9db0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:03.470001 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-06025ed5-bd79-4752-b041-7388336c9db0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a" status: 200 len: 1317 microversion: 2.1 time: 0.375356 Jul 20 04:13:03.470634 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 468/1057] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:03 2022] GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:03.610637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1bbbf6ee-7a63-4d02-8935-4cac5b9293a9 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:03.611253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1bbbf6ee-7a63-4d02-8935-4cac5b9293a9 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:03.626229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1bbbf6ee-7a63-4d02-8935-4cac5b9293a9 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.626561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1bbbf6ee-7a63-4d02-8935-4cac5b9293a9 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.627351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1bbbf6ee-7a63-4d02-8935-4cac5b9293a9 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.627790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1bbbf6ee-7a63-4d02-8935-4cac5b9293a9 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.761487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d3c70f07-2a02-4cc1-9272-2156d012e484 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:03.763246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d3c70f07-2a02-4cc1-9272-2156d012e484 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:03.771251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d3c70f07-2a02-4cc1-9272-2156d012e484 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.771950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d3c70f07-2a02-4cc1-9272-2156d012e484 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.773252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d3c70f07-2a02-4cc1-9272-2156d012e484 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.773893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d3c70f07-2a02-4cc1-9272-2156d012e484 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.835731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1bbbf6ee-7a63-4d02-8935-4cac5b9293a9 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:03.847183 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1bbbf6ee-7a63-4d02-8935-4cac5b9293a9 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1401 microversion: 2.1 time: 0.240163 Jul 20 04:13:03.858320 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 590/1058] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:03 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1401 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:03.972453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d3c70f07-2a02-4cc1-9272-2156d012e484 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:03.981571 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d3c70f07-2a02-4cc1-9272-2156d012e484 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1470 microversion: 2.1 time: 0.230082 Jul 20 04:13:03.982148 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 469/1059] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:03 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1470 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:04.400519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ea093779-4ba6-4047-b033-827230ca8bd0 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:04.401484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ea093779-4ba6-4047-b033-827230ca8bd0 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:04.408134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=32 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:04.410082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea093779-4ba6-4047-b033-827230ca8bd0 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:04.410693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea093779-4ba6-4047-b033-827230ca8bd0 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:04.411770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea093779-4ba6-4047-b033-827230ca8bd0 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:04.412398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea093779-4ba6-4047-b033-827230ca8bd0 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:04.428156 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-ea093779-4ba6-4047-b033-827230ca8bd0 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] HTTP exception thrown: Instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 could not be found. Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ea093779-4ba6-4047-b033-827230ca8bd0 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Request method failure captured: Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 HTTP/1.1 Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14AjJ9bWSvKktHzSOSTB4tW9lfuRIMYkQZJySvphzNigKx4_ekH_goPXUt5m8oeik4UJHPbLRERmTo63WNSq5PMiKZVR4aNFB5qDp2SzS4GSSNcaaWivmHSvsaHXRBrPx5BEVauwkQWvP-5D2AwvStCsfWgomqY2VPnL1NN8u9qlDLg Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4b553064d6374435a814f572cdbaedc2 Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1345218347 Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:13:04.430164 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:13:04.431741 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b553064d6374435a814f572cdbaedc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4b553064d6374435a814f572cdbaedc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4b553064d6374435a814f572cdbaedc2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b553064d6374435a814f572cdbaedc2"}]}] Jul 20 04:13:04.431741 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1345218347 Jul 20 04:13:04.431741 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4b553064d6374435a814f572cdbaedc2 Jul 20 04:13:04.431741 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1345218347 Jul 20 04:13:04.431741 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AttachSCSIVolumeTestJSON-1345218347-project Jul 20 04:13:04.431741 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:13:04.431741 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:13:04.431741 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f120f1774f7e409798e0894b71db9e3e Jul 20 04:13:04.431741 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1345218347-project Jul 20 04:13:04.431741 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:13:04.431741 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 could not be found. Jul 20 04:13:04.431741 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '609e8037-70aa-40fc-bd6d-1dbbdeabc6d2'} Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 could not be found. Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:04.432618 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:04.433962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:04.433962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:04.433962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:04.433962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:04.433962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:04.433962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:04.433962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:04.433962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 could not be found. Jul 20 04:13:04.433962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:04.433962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:04.433962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:04.433962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:04.433962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:04.433962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:04.433962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:04.433962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:04.433962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 could not be found. Jul 20 04:13:04.433962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:04.435373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ea093779-4ba6-4047-b033-827230ca8bd0 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Returning 404 to user: Instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:04.435373 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ea093779-4ba6-4047-b033-827230ca8bd0 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 404 len: 111 microversion: 2.1 time: 0.034904 Jul 20 04:13:04.435373 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 591/1060] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:04 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:04.440821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dae5f096-05c5-47b3-90e7-6c87a7744a24 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '.version_select at 0x7f06be7a2430>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:04.444465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=14 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:04.470492 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dae5f096-05c5-47b3-90e7-6c87a7744a24 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-225851841" status: 202 len: 0 microversion: 2.1 time: 0.033449 Jul 20 04:13:04.471805 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 470/1061] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jul 20 04:13:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-225851841 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:04.488182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-35a89e9e-441f-43b3-9674-f7bed557ddb1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:04.488994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35a89e9e-441f-43b3-9674-f7bed557ddb1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:04.499550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35a89e9e-441f-43b3-9674-f7bed557ddb1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:04.500656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35a89e9e-441f-43b3-9674-f7bed557ddb1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:04.502418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35a89e9e-441f-43b3-9674-f7bed557ddb1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:04.503119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35a89e9e-441f-43b3-9674-f7bed557ddb1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:04.509092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:04.697103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-7b6a99cf-524e-43a1-a4d9-855000cd4334 req-11767f46-b65a-48ba-bf68-717be8e0562a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52df8cf7-6be8-4f22-a0b4-4a5e0b31be04", "tag": "295ab3b5-0949-4953-b868-df3a92dd92e7"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:04.717668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7b6a99cf-524e-43a1-a4d9-855000cd4334 req-11767f46-b65a-48ba-bf68-717be8e0562a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:04.718860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7b6a99cf-524e-43a1-a4d9-855000cd4334 req-11767f46-b65a-48ba-bf68-717be8e0562a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:04.749305 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-7b6a99cf-524e-43a1-a4d9-855000cd4334 req-11767f46-b65a-48ba-bf68-717be8e0562a service nova] Creating event network-changed:295ab3b5-0949-4953-b868-df3a92dd92e7 for instance 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 on n-h1-826526-5 Jul 20 04:13:04.758731 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-7b6a99cf-524e-43a1-a4d9-855000cd4334 req-11767f46-b65a-48ba-bf68-717be8e0562a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066221 Jul 20 04:13:04.761956 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 471/1062] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:13:04.866122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-83e13339-1646-432f-842d-3073d3895544 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:04.867285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-83e13339-1646-432f-842d-3073d3895544 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:04.875003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83e13339-1646-432f-842d-3073d3895544 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:04.875771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83e13339-1646-432f-842d-3073d3895544 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:04.876780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83e13339-1646-432f-842d-3073d3895544 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:04.877748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83e13339-1646-432f-842d-3073d3895544 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:04.936647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-35a89e9e-441f-43b3-9674-f7bed557ddb1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:04.945653 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-35a89e9e-441f-43b3-9674-f7bed557ddb1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a" status: 200 len: 1317 microversion: 2.1 time: 0.462219 Jul 20 04:13:04.946433 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 592/1063] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:04 2022] GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:05.002340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9f18a603-fad2-4f1c-b93b-b89f050c53f6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:05.003118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9f18a603-fad2-4f1c-b93b-b89f050c53f6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:05.016855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f18a603-fad2-4f1c-b93b-b89f050c53f6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:05.017442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f18a603-fad2-4f1c-b93b-b89f050c53f6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:05.020089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f18a603-fad2-4f1c-b93b-b89f050c53f6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:05.021197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f18a603-fad2-4f1c-b93b-b89f050c53f6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:05.126139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-83e13339-1646-432f-842d-3073d3895544 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:05.134915 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-83e13339-1646-432f-842d-3073d3895544 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1401 microversion: 2.1 time: 0.273991 Jul 20 04:13:05.136092 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 472/1064] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:04 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1401 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:05.349652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9f18a603-fad2-4f1c-b93b-b89f050c53f6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:05.357623 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9f18a603-fad2-4f1c-b93b-b89f050c53f6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1470 microversion: 2.1 time: 0.360678 Jul 20 04:13:05.361385 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 593/1065] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:04 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1470 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:05.963005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-91d00b10-28a7-460f-9cd6-5ccc29b0ea6b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:05.963634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-91d00b10-28a7-460f-9cd6-5ccc29b0ea6b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:05.975919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91d00b10-28a7-460f-9cd6-5ccc29b0ea6b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:05.976684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91d00b10-28a7-460f-9cd6-5ccc29b0ea6b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:05.977634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91d00b10-28a7-460f-9cd6-5ccc29b0ea6b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:05.978074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91d00b10-28a7-460f-9cd6-5ccc29b0ea6b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.151421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-96eb5ef1-b626-4ed6-a43a-8acbff0538ba tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:06.152037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-96eb5ef1-b626-4ed6-a43a-8acbff0538ba tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:06.167512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96eb5ef1-b626-4ed6-a43a-8acbff0538ba tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.167938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96eb5ef1-b626-4ed6-a43a-8acbff0538ba tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.169269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96eb5ef1-b626-4ed6-a43a-8acbff0538ba tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.169973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96eb5ef1-b626-4ed6-a43a-8acbff0538ba tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.280584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-91d00b10-28a7-460f-9cd6-5ccc29b0ea6b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:06.296214 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-91d00b10-28a7-460f-9cd6-5ccc29b0ea6b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a" status: 200 len: 1317 microversion: 2.1 time: 0.336945 Jul 20 04:13:06.297527 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 473/1066] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:05 2022] GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:06.306721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-0ca8f729-e005-41d2-a37d-32b12cf2c397 req-9022d7e4-87ff-49f5-8b61-b4afbc49d578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "089704fa-0301-45a0-a4d8-3adbc8835f2a", "name": "network-vif-plugged", "status": "completed", "tag": "0dc711ee-fc2f-40cc-a206-2a3b853708f8"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:06.344628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0ca8f729-e005-41d2-a37d-32b12cf2c397 req-9022d7e4-87ff-49f5-8b61-b4afbc49d578 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.345483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0ca8f729-e005-41d2-a37d-32b12cf2c397 req-9022d7e4-87ff-49f5-8b61-b4afbc49d578 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.367158 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-0ca8f729-e005-41d2-a37d-32b12cf2c397 req-9022d7e4-87ff-49f5-8b61-b4afbc49d578 service nova] Creating event network-vif-plugged:0dc711ee-fc2f-40cc-a206-2a3b853708f8 for instance 089704fa-0301-45a0-a4d8-3adbc8835f2a on n-h1-826526-5 Jul 20 04:13:06.384798 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-0ca8f729-e005-41d2-a37d-32b12cf2c397 req-9022d7e4-87ff-49f5-8b61-b4afbc49d578 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085252 Jul 20 04:13:06.386772 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 474/1067] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:06.393021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c0d6e79e-a305-4a49-8c32-4f75210ccc9f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:06.394044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c0d6e79e-a305-4a49-8c32-4f75210ccc9f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:06.404213 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0d6e79e-a305-4a49-8c32-4f75210ccc9f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.404854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0d6e79e-a305-4a49-8c32-4f75210ccc9f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.405785 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0d6e79e-a305-4a49-8c32-4f75210ccc9f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.407359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0d6e79e-a305-4a49-8c32-4f75210ccc9f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.428249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-96eb5ef1-b626-4ed6-a43a-8acbff0538ba tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:06.458730 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-96eb5ef1-b626-4ed6-a43a-8acbff0538ba tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1401 microversion: 2.1 time: 0.308697 Jul 20 04:13:06.460059 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 594/1068] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:06 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1401 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:06.575029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c0d6e79e-a305-4a49-8c32-4f75210ccc9f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:06.583584 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c0d6e79e-a305-4a49-8c32-4f75210ccc9f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1470 microversion: 2.1 time: 0.195084 Jul 20 04:13:06.592980 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 475/1069] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:06 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:06.649333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-02af806b-4fa6-4bd4-943e-570165324053 tempest-ComputeTenantNetworksTest-686645560 tempest-ComputeTenantNetworksTest-686645560-project] Calling method '.version_select at 0x7f06be043dc0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:07.019553 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-02af806b-4fa6-4bd4-943e-570165324053 tempest-ComputeTenantNetworksTest-686645560 tempest-ComputeTenantNetworksTest-686645560-project] 10.222.0.17 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.521316 Jul 20 04:13:07.020996 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 595/1070] 10.222.0.17 () {58 vars in 1157 bytes} [Wed Jul 20 04:13:06 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:07.036805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fc8342e9-9476-4a4c-83e9-f304d031baa9 tempest-ComputeTenantNetworksTest-686645560 tempest-ComputeTenantNetworksTest-686645560-project] Calling method '.version_select at 0x7f06be7a28b0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:07.142908 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fc8342e9-9476-4a4c-83e9-f304d031baa9 tempest-ComputeTenantNetworksTest-686645560 tempest-ComputeTenantNetworksTest-686645560-project] 10.222.0.17 "GET /compute/v2.1/os-tenant-networks/0fd090bb-2430-48bb-9d30-128f34012c00" status: 200 len: 140 microversion: 2.1 time: 0.109929 Jul 20 04:13:07.143624 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 476/1071] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 04:13:07 2022] GET /compute/v2.1/os-tenant-networks/0fd090bb-2430-48bb-9d30-128f34012c00 => generated 140 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:07.313291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dd282c50-9dc8-4d92-bf17-9565427b00d9 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:07.314522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dd282c50-9dc8-4d92-bf17-9565427b00d9 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:07.322436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd282c50-9dc8-4d92-bf17-9565427b00d9 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.323110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd282c50-9dc8-4d92-bf17-9565427b00d9 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.323882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd282c50-9dc8-4d92-bf17-9565427b00d9 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.324338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd282c50-9dc8-4d92-bf17-9565427b00d9 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.462798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dd282c50-9dc8-4d92-bf17-9565427b00d9 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:07.471462 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dd282c50-9dc8-4d92-bf17-9565427b00d9 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a" status: 200 len: 1317 microversion: 2.1 time: 0.162005 Jul 20 04:13:07.473099 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 596/1072] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:07 2022] GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:07.477202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fb3ad353-1d1c-4887-b96e-0da480232ff5 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:07.477819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fb3ad353-1d1c-4887-b96e-0da480232ff5 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:07.484207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb3ad353-1d1c-4887-b96e-0da480232ff5 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.484683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb3ad353-1d1c-4887-b96e-0da480232ff5 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.485458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb3ad353-1d1c-4887-b96e-0da480232ff5 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.485894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb3ad353-1d1c-4887-b96e-0da480232ff5 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.600889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0d2439c8-4485-4c6f-afb0-a49324613ed7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:07.601939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0d2439c8-4485-4c6f-afb0-a49324613ed7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:07.609157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d2439c8-4485-4c6f-afb0-a49324613ed7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.609888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d2439c8-4485-4c6f-afb0-a49324613ed7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.611002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d2439c8-4485-4c6f-afb0-a49324613ed7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.611786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d2439c8-4485-4c6f-afb0-a49324613ed7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.764701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0d2439c8-4485-4c6f-afb0-a49324613ed7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:07.772888 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0d2439c8-4485-4c6f-afb0-a49324613ed7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1536 microversion: 2.1 time: 0.176116 Jul 20 04:13:07.773780 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 597/1073] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:07 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1536 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:07.831947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fb3ad353-1d1c-4887-b96e-0da480232ff5 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:07.846133 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fb3ad353-1d1c-4887-b96e-0da480232ff5 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1401 microversion: 2.1 time: 0.372812 Jul 20 04:13:07.846972 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 477/1074] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:07 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1401 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:07.984740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-528c8648-af6e-4787-9ceb-146488832614 req-c8ddda35-97ba-42dc-8339-885e72ed627e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944a56a8-87ef-4988-9f97-106c08046fe9", "name": "network-vif-unplugged", "status": "completed", "tag": "63a5fa97-49af-495f-b6c4-80e7f5925cac"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:07.998049 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-528c8648-af6e-4787-9ceb-146488832614 req-c8ddda35-97ba-42dc-8339-885e72ed627e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.001963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-528c8648-af6e-4787-9ceb-146488832614 req-c8ddda35-97ba-42dc-8339-885e72ed627e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.024038 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-528c8648-af6e-4787-9ceb-146488832614 req-c8ddda35-97ba-42dc-8339-885e72ed627e service nova] Creating event network-vif-unplugged:63a5fa97-49af-495f-b6c4-80e7f5925cac for instance 944a56a8-87ef-4988-9f97-106c08046fe9 on n-h2-826526-5 Jul 20 04:13:08.066883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-528c8648-af6e-4787-9ceb-146488832614 req-c8ddda35-97ba-42dc-8339-885e72ed627e service nova] Instance 944a56a8-87ef-4988-9f97-106c08046fe9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:13:08.108589 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-528c8648-af6e-4787-9ceb-146488832614 req-c8ddda35-97ba-42dc-8339-885e72ed627e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128289 Jul 20 04:13:08.113362 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 598/1075] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:08.494235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-001e02aa-447c-4b51-a300-daeef060a0a2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:08.494883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-001e02aa-447c-4b51-a300-daeef060a0a2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:08.510529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=7 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:08.521124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-001e02aa-447c-4b51-a300-daeef060a0a2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.522042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-001e02aa-447c-4b51-a300-daeef060a0a2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.524144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-001e02aa-447c-4b51-a300-daeef060a0a2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.534847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-001e02aa-447c-4b51-a300-daeef060a0a2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.786580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-001e02aa-447c-4b51-a300-daeef060a0a2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:08.792428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c43e6b22-feb8-4ac9-9d99-956f6f7a5bee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:08.797044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c43e6b22-feb8-4ac9-9d99-956f6f7a5bee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:08.802581 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-001e02aa-447c-4b51-a300-daeef060a0a2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a" status: 200 len: 1466 microversion: 2.1 time: 0.317155 Jul 20 04:13:08.813772 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 478/1076] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:08 2022] GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a => generated 1466 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:08.823552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c43e6b22-feb8-4ac9-9d99-956f6f7a5bee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.824300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c43e6b22-feb8-4ac9-9d99-956f6f7a5bee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.825467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c43e6b22-feb8-4ac9-9d99-956f6f7a5bee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.825950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c43e6b22-feb8-4ac9-9d99-956f6f7a5bee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.831609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d9fc16af-49ee-429b-8a08-26bff9d41290 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:08.833034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d9fc16af-49ee-429b-8a08-26bff9d41290 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:08.849153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9fc16af-49ee-429b-8a08-26bff9d41290 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.854466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9fc16af-49ee-429b-8a08-26bff9d41290 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.855617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9fc16af-49ee-429b-8a08-26bff9d41290 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.856324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9fc16af-49ee-429b-8a08-26bff9d41290 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.026294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c43e6b22-feb8-4ac9-9d99-956f6f7a5bee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:09.036803 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c43e6b22-feb8-4ac9-9d99-956f6f7a5bee tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1536 microversion: 2.1 time: 0.248548 Jul 20 04:13:09.037915 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 599/1077] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:08 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1536 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:09.042840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-53c6a574-4560-4547-a982-d13d2fa5a087 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:09.043973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-53c6a574-4560-4547-a982-d13d2fa5a087 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:09.073410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-53c6a574-4560-4547-a982-d13d2fa5a087 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.074391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-53c6a574-4560-4547-a982-d13d2fa5a087 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.078794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-53c6a574-4560-4547-a982-d13d2fa5a087 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.079732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-53c6a574-4560-4547-a982-d13d2fa5a087 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.281455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-53c6a574-4560-4547-a982-d13d2fa5a087 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:09.290790 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-53c6a574-4560-4547-a982-d13d2fa5a087 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1401 microversion: 2.1 time: 0.251602 Jul 20 04:13:09.291377 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 600/1078] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:09 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1401 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:09.444217 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d9fc16af-49ee-429b-8a08-26bff9d41290 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a" status: 200 len: 1617 microversion: 2.1 time: 0.616305 Jul 20 04:13:09.446911 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 479/1079] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:08 2022] GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a => generated 1617 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:09.578879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-53c6a574-4560-4547-a982-d13d2fa5a087 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:09.584104 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-53c6a574-4560-4547-a982-d13d2fa5a087 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001564 Jul 20 04:13:09.584730 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 601/1080] 10.222.0.17 () {56 vars in 885 bytes} [Wed Jul 20 04:13:09 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 04:13:09.590669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5675a98a-6384-4c12-a243-bcc5a81b54d2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1637183098", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "23481b1e-fe28-4f48-84fe-f22cae89ac46"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:09.591823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-53c6a574-4560-4547-a982-d13d2fa5a087 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:09.593080 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-53c6a574-4560-4547-a982-d13d2fa5a087 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001913 Jul 20 04:13:09.598772 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 602/1081] 10.222.0.17 () {54 vars in 1034 bytes} [Wed Jul 20 04:13:09 2022] GET /compute/v2/ => generated 379 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 20 04:13:09.600725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-53c6a574-4560-4547-a982-d13d2fa5a087 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:09.602043 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-53c6a574-4560-4547-a982-d13d2fa5a087 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002008 Jul 20 04:13:09.609103 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 603/1082] 10.222.0.17 () {54 vars in 1040 bytes} [Wed Jul 20 04:13:09 2022] GET /compute/v2.1/ => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:09.611066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-53c6a574-4560-4547-a982-d13d2fa5a087 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:09.613269 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-53c6a574-4560-4547-a982-d13d2fa5a087 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002874 Jul 20 04:13:09.613986 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 604/1083] 10.222.0.17 () {56 vars in 885 bytes} [Wed Jul 20 04:13:09 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 04:13:09.664825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-5675a98a-6384-4c12-a243-bcc5a81b54d2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] validate_networks() for None {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:13:09.784204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-931858fc-2d72-40e6-9bfd-ab82c65cfaf7 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:09.785665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-931858fc-2d72-40e6-9bfd-ab82c65cfaf7 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:09.793157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-931858fc-2d72-40e6-9bfd-ab82c65cfaf7 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.794342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-931858fc-2d72-40e6-9bfd-ab82c65cfaf7 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.795129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-931858fc-2d72-40e6-9bfd-ab82c65cfaf7 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.795727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-931858fc-2d72-40e6-9bfd-ab82c65cfaf7 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.829527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-931858fc-2d72-40e6-9bfd-ab82c65cfaf7 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:09.941676 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-931858fc-2d72-40e6-9bfd-ab82c65cfaf7 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 204 len: 0 microversion: 2.1 time: 0.160941 Jul 20 04:13:09.945809 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 605/1084] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:09 2022] DELETE /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:13:09.950625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5675a98a-6384-4c12-a243-bcc5a81b54d2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:13:09.951249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5675a98a-6384-4c12-a243-bcc5a81b54d2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:13:09.951728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5675a98a-6384-4c12-a243-bcc5a81b54d2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:13:09.952147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5675a98a-6384-4c12-a243-bcc5a81b54d2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:13:09.952568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5675a98a-6384-4c12-a243-bcc5a81b54d2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:13:09.955964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-016c2a25-c3b1-4671-8fd1-07ebe0eb5862 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:09.958912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-016c2a25-c3b1-4671-8fd1-07ebe0eb5862 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:09.961790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5675a98a-6384-4c12-a243-bcc5a81b54d2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.962418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5675a98a-6384-4c12-a243-bcc5a81b54d2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.963394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5675a98a-6384-4c12-a243-bcc5a81b54d2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.967766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5675a98a-6384-4c12-a243-bcc5a81b54d2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.968035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-016c2a25-c3b1-4671-8fd1-07ebe0eb5862 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.968522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-016c2a25-c3b1-4671-8fd1-07ebe0eb5862 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.969448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-016c2a25-c3b1-4671-8fd1-07ebe0eb5862 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.969893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-016c2a25-c3b1-4671-8fd1-07ebe0eb5862 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.989393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-5675a98a-6384-4c12-a243-bcc5a81b54d2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for project 22bcfd2698d047dea07c643970c749eb. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:13:09.996154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-5675a98a-6384-4c12-a243-bcc5a81b54d2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Getting quotas for user 5e178243e1ed404092e5ea0be39d5c16 and project 22bcfd2698d047dea07c643970c749eb. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:13:10.010486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5675a98a-6384-4c12-a243-bcc5a81b54d2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:13:10.013184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5675a98a-6384-4c12-a243-bcc5a81b54d2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:13:10.077169 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5675a98a-6384-4c12-a243-bcc5a81b54d2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491910 Jul 20 04:13:10.078546 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 480/1085] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:13:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:13:10.085417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0033c3b2-d657-4283-95c1-61e26bfdf614 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:10.086421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0033c3b2-d657-4283-95c1-61e26bfdf614 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:10.098123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0033c3b2-d657-4283-95c1-61e26bfdf614 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.098816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0033c3b2-d657-4283-95c1-61e26bfdf614 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.102140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0033c3b2-d657-4283-95c1-61e26bfdf614 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.102749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0033c3b2-d657-4283-95c1-61e26bfdf614 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.269385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-016c2a25-c3b1-4671-8fd1-07ebe0eb5862 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:10.280735 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-016c2a25-c3b1-4671-8fd1-07ebe0eb5862 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1712 microversion: 2.1 time: 0.332338 Jul 20 04:13:10.281476 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 606/1086] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:09 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1712 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:10.288449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6ae31566-7db4-4999-b689-f54d4a0ef897 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:10.289419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6ae31566-7db4-4999-b689-f54d4a0ef897 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:10.320416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:10.357750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0033c3b2-d657-4283-95c1-61e26bfdf614 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:10.367965 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0033c3b2-d657-4283-95c1-61e26bfdf614 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1536 microversion: 2.1 time: 0.288029 Jul 20 04:13:10.368850 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 481/1087] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:10 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1536 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:10.374372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-ed567c88-8b58-44e7-9e9e-e507ca4bb0d5 req-0911da09-ed02-4c25-9565-2bde3a1cd5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "944a56a8-87ef-4988-9f97-106c08046fe9", "tag": "63a5fa97-49af-495f-b6c4-80e7f5925cac"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:10.382673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6ae31566-7db4-4999-b689-f54d4a0ef897 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:10.388583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ed567c88-8b58-44e7-9e9e-e507ca4bb0d5 req-0911da09-ed02-4c25-9565-2bde3a1cd5c5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.389251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ed567c88-8b58-44e7-9e9e-e507ca4bb0d5 req-0911da09-ed02-4c25-9565-2bde3a1cd5c5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.400329 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6ae31566-7db4-4999-b689-f54d4a0ef897 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620" status: 200 len: 1217 microversion: 2.1 time: 0.116216 Jul 20 04:13:10.405487 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-ed567c88-8b58-44e7-9e9e-e507ca4bb0d5 req-0911da09-ed02-4c25-9565-2bde3a1cd5c5 service nova] Creating event network-changed:63a5fa97-49af-495f-b6c4-80e7f5925cac for instance 944a56a8-87ef-4988-9f97-106c08046fe9 on n-h2-826526-5 Jul 20 04:13:10.405917 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 607/1088] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:10 2022] GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 => generated 1217 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:10.412573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-fd2408ce-1a97-4b1a-b29a-5f22353f395e req-fa3a261b-5d54-4ab8-a8e4-fa360e5f4eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b459a3ae-fa64-4ffa-a90f-ae87acc75273", "name": "network-vif-plugged", "status": "completed", "tag": "f98829db-28ce-43b1-91f3-0b5324542e84"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:10.413123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [req-ed567c88-8b58-44e7-9e9e-e507ca4bb0d5 req-0911da09-ed02-4c25-9565-2bde3a1cd5c5 service nova] Instance 944a56a8-87ef-4988-9f97-106c08046fe9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:13:10.430076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-fd2408ce-1a97-4b1a-b29a-5f22353f395e req-fa3a261b-5d54-4ab8-a8e4-fa360e5f4eb4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.430893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-fd2408ce-1a97-4b1a-b29a-5f22353f395e req-fa3a261b-5d54-4ab8-a8e4-fa360e5f4eb4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.437857 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-ed567c88-8b58-44e7-9e9e-e507ca4bb0d5 req-0911da09-ed02-4c25-9565-2bde3a1cd5c5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067560 Jul 20 04:13:10.438488 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 482/1089] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:10.443455 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-fd2408ce-1a97-4b1a-b29a-5f22353f395e req-fa3a261b-5d54-4ab8-a8e4-fa360e5f4eb4 service nova] Creating event network-vif-plugged:f98829db-28ce-43b1-91f3-0b5324542e84 for instance b459a3ae-fa64-4ffa-a90f-ae87acc75273 on n-h1-826526-5 Jul 20 04:13:10.448868 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-fd2408ce-1a97-4b1a-b29a-5f22353f395e req-fa3a261b-5d54-4ab8-a8e4-fa360e5f4eb4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041446 Jul 20 04:13:10.449796 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 608/1090] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:10.455836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1cd0eb24-792c-445c-9681-3dc580aef4be tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:10.456740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1cd0eb24-792c-445c-9681-3dc580aef4be tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:10.467638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cd0eb24-792c-445c-9681-3dc580aef4be tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.468097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cd0eb24-792c-445c-9681-3dc580aef4be tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.469003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cd0eb24-792c-445c-9681-3dc580aef4be tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.469540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cd0eb24-792c-445c-9681-3dc580aef4be tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.697587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1cd0eb24-792c-445c-9681-3dc580aef4be tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:10.709125 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1cd0eb24-792c-445c-9681-3dc580aef4be tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1401 microversion: 2.1 time: 0.262763 Jul 20 04:13:10.709861 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 483/1091] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:10 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1401 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:11.302421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c318fb74-2f4e-4d88-bd1a-5922e30a540a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:11.303227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c318fb74-2f4e-4d88-bd1a-5922e30a540a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:11.321628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-da704d2a-a9e2-4f65-82c8-70d10bbb02a3 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:11.322125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-da704d2a-a9e2-4f65-82c8-70d10bbb02a3 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:11.328699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da704d2a-a9e2-4f65-82c8-70d10bbb02a3 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.329156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da704d2a-a9e2-4f65-82c8-70d10bbb02a3 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.329928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da704d2a-a9e2-4f65-82c8-70d10bbb02a3 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.330368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da704d2a-a9e2-4f65-82c8-70d10bbb02a3 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.335174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c318fb74-2f4e-4d88-bd1a-5922e30a540a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.335617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c318fb74-2f4e-4d88-bd1a-5922e30a540a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.336422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c318fb74-2f4e-4d88-bd1a-5922e30a540a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.336855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c318fb74-2f4e-4d88-bd1a-5922e30a540a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.354816 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-da704d2a-a9e2-4f65-82c8-70d10bbb02a3 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] HTTP exception thrown: Instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 could not be found. Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-da704d2a-a9e2-4f65-82c8-70d10bbb02a3 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Request method failure captured: Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 HTTP/1.1 Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14AjJ9bWSvKktHzSOSTB4tW9lfuRIMYkQZJySvphzNigKx4_ekH_goPXUt5m8oeik4UJHPbLRERmTo63WNSq5PMiKZVR4aNFB5qDp2SzS4GSSNcaaWivmHSvsaHXRBrPx5BEVauwkQWvP-5D2AwvStCsfWgomqY2VPnL1NN8u9qlDLg Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4b553064d6374435a814f572cdbaedc2 Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1345218347 Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:13:11.356921 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:13:11.358378 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b553064d6374435a814f572cdbaedc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4b553064d6374435a814f572cdbaedc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4b553064d6374435a814f572cdbaedc2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b553064d6374435a814f572cdbaedc2"}]}] Jul 20 04:13:11.358378 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1345218347 Jul 20 04:13:11.358378 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4b553064d6374435a814f572cdbaedc2 Jul 20 04:13:11.358378 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1345218347 Jul 20 04:13:11.358378 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AttachSCSIVolumeTestJSON-1345218347-project Jul 20 04:13:11.358378 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:13:11.358378 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:13:11.358378 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f120f1774f7e409798e0894b71db9e3e Jul 20 04:13:11.358378 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1345218347-project Jul 20 04:13:11.358378 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:13:11.358378 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 could not be found. Jul 20 04:13:11.358378 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '609e8037-70aa-40fc-bd6d-1dbbdeabc6d2'} Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 could not be found. Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:11.359175 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 could not be found. Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 could not be found. Jul 20 04:13:11.360546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:11.362265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-da704d2a-a9e2-4f65-82c8-70d10bbb02a3 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Returning 404 to user: Instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:11.362265 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-da704d2a-a9e2-4f65-82c8-70d10bbb02a3 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "DELETE /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 404 len: 111 microversion: 2.1 time: 0.041053 Jul 20 04:13:11.362265 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 484/1092] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:11 2022] DELETE /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:11.367693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed9dee56-bfbe-4780-bfbc-0f4b510933f8 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:11.368387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ed9dee56-bfbe-4780-bfbc-0f4b510933f8 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] [instance: 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:11.374596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed9dee56-bfbe-4780-bfbc-0f4b510933f8 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.375197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed9dee56-bfbe-4780-bfbc-0f4b510933f8 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.376027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed9dee56-bfbe-4780-bfbc-0f4b510933f8 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.376491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed9dee56-bfbe-4780-bfbc-0f4b510933f8 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.397500 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-ed9dee56-bfbe-4780-bfbc-0f4b510933f8 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] HTTP exception thrown: Instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 could not be found. Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed9dee56-bfbe-4780-bfbc-0f4b510933f8 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Request method failure captured: Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 HTTP/1.1 Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14AjJ9bWSvKktHzSOSTB4tW9lfuRIMYkQZJySvphzNigKx4_ekH_goPXUt5m8oeik4UJHPbLRERmTo63WNSq5PMiKZVR4aNFB5qDp2SzS4GSSNcaaWivmHSvsaHXRBrPx5BEVauwkQWvP-5D2AwvStCsfWgomqY2VPnL1NN8u9qlDLg Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4b553064d6374435a814f572cdbaedc2 Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1345218347 Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:13:11.399068 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:13:11.400675 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b553064d6374435a814f572cdbaedc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4b553064d6374435a814f572cdbaedc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4b553064d6374435a814f572cdbaedc2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b553064d6374435a814f572cdbaedc2"}]}] Jul 20 04:13:11.400675 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1345218347 Jul 20 04:13:11.400675 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4b553064d6374435a814f572cdbaedc2 Jul 20 04:13:11.400675 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1345218347 Jul 20 04:13:11.400675 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AttachSCSIVolumeTestJSON-1345218347-project Jul 20 04:13:11.400675 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:13:11.400675 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:13:11.400675 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f120f1774f7e409798e0894b71db9e3e Jul 20 04:13:11.400675 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1345218347-project Jul 20 04:13:11.400675 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:13:11.400675 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 could not be found. Jul 20 04:13:11.400675 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '609e8037-70aa-40fc-bd6d-1dbbdeabc6d2'} Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 could not be found. Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:11.401463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:11.402650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:11.402650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:11.402650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:11.402650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:11.402650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:11.402650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:11.402650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:11.402650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 could not be found. Jul 20 04:13:11.402650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:11.402650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:11.402650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:11.402650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:11.402650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:11.402650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:11.402650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:11.402650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:11.402650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 could not be found. Jul 20 04:13:11.402650 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:11.403876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed9dee56-bfbe-4780-bfbc-0f4b510933f8 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] Returning 404 to user: Instance 609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:11.403876 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ed9dee56-bfbe-4780-bfbc-0f4b510933f8 tempest-AttachSCSIVolumeTestJSON-1345218347 tempest-AttachSCSIVolumeTestJSON-1345218347-project] 10.222.0.17 "GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2" status: 404 len: 111 microversion: 2.1 time: 0.036616 Jul 20 04:13:11.405023 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 485/1093] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:11 2022] GET /compute/v2.1/servers/609e8037-70aa-40fc-bd6d-1dbbdeabc6d2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:11.409869 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-da2101c7-1912-47fe-abc3-c72544145024 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:11.410483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-da2101c7-1912-47fe-abc3-c72544145024 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:11.422404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:11.424788 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da2101c7-1912-47fe-abc3-c72544145024 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.425237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da2101c7-1912-47fe-abc3-c72544145024 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.426020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da2101c7-1912-47fe-abc3-c72544145024 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.426769 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da2101c7-1912-47fe-abc3-c72544145024 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.520653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c318fb74-2f4e-4d88-bd1a-5922e30a540a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:11.536568 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c318fb74-2f4e-4d88-bd1a-5922e30a540a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1712 microversion: 2.1 time: 0.238630 Jul 20 04:13:11.538399 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 609/1094] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:11 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1712 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:11.545225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-19924e8c-0c9b-466f-ad60-896be0f26992 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:11.547706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-19924e8c-0c9b-466f-ad60-896be0f26992 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:11.559541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19924e8c-0c9b-466f-ad60-896be0f26992 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.561809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19924e8c-0c9b-466f-ad60-896be0f26992 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.563037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19924e8c-0c9b-466f-ad60-896be0f26992 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.563692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19924e8c-0c9b-466f-ad60-896be0f26992 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.649871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-19924e8c-0c9b-466f-ad60-896be0f26992 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:11.663163 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-19924e8c-0c9b-466f-ad60-896be0f26992 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620" status: 200 len: 1221 microversion: 2.1 time: 0.123281 Jul 20 04:13:11.663918 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 610/1095] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:11 2022] GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 => generated 1221 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:11.732853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fcc5ca08-109c-415a-b3df-083bf9c4a5b2 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:11.733551 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fcc5ca08-109c-415a-b3df-083bf9c4a5b2 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:11.746784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcc5ca08-109c-415a-b3df-083bf9c4a5b2 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.747682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcc5ca08-109c-415a-b3df-083bf9c4a5b2 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.748706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcc5ca08-109c-415a-b3df-083bf9c4a5b2 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.749442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcc5ca08-109c-415a-b3df-083bf9c4a5b2 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.751192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-da2101c7-1912-47fe-abc3-c72544145024 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:11.757806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:11.760122 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-da2101c7-1912-47fe-abc3-c72544145024 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1536 microversion: 2.1 time: 0.354022 Jul 20 04:13:11.771228 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 486/1096] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:11 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1536 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:11.973165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fcc5ca08-109c-415a-b3df-083bf9c4a5b2 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:11.983443 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fcc5ca08-109c-415a-b3df-083bf9c4a5b2 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1401 microversion: 2.1 time: 0.259967 Jul 20 04:13:11.984253 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 611/1097] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:11 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1401 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:11.986136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-75b4e4e3-7d8e-4098-b8c5-25156225ca0b tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Action: 'create', calling method: .version_select at 0x7f06be1fe9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1981877932"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:12.374841 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-75b4e4e3-7d8e-4098-b8c5-25156225ca0b tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.607976 Jul 20 04:13:12.375778 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 487/1098] 10.222.0.17 () {60 vars in 1154 bytes} [Wed Jul 20 04:13:11 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 609 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 04:13:12.387127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4368db39-a042-4135-932f-8bb543b2fca7 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Calling method '.version_select at 0x7f06bdf74040>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:12.448407 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4368db39-a042-4135-932f-8bb543b2fca7 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114" status: 200 len: 345 microversion: 2.1 time: 0.065067 Jul 20 04:13:12.455122 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 612/1099] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:13:12 2022] GET /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:12.556120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-77fe695a-687a-437f-9112-e007acb7bf25 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:12.556793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-77fe695a-687a-437f-9112-e007acb7bf25 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:12.564075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-77fe695a-687a-437f-9112-e007acb7bf25 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.564652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-77fe695a-687a-437f-9112-e007acb7bf25 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.565648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-77fe695a-687a-437f-9112-e007acb7bf25 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.566335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-77fe695a-687a-437f-9112-e007acb7bf25 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.679261 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bf53e8c8-b896-4c70-ac09-ef501b1d471e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:12.680147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bf53e8c8-b896-4c70-ac09-ef501b1d471e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:12.687801 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf53e8c8-b896-4c70-ac09-ef501b1d471e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.688360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf53e8c8-b896-4c70-ac09-ef501b1d471e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.689265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf53e8c8-b896-4c70-ac09-ef501b1d471e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.690007 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf53e8c8-b896-4c70-ac09-ef501b1d471e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.758409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bf53e8c8-b896-4c70-ac09-ef501b1d471e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:12.767379 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bf53e8c8-b896-4c70-ac09-ef501b1d471e tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620" status: 200 len: 1213 microversion: 2.1 time: 0.092227 Jul 20 04:13:12.777761 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 613/1100] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:12 2022] GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:12.784650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-32c5d0f3-2d65-4e60-94a8-9845b22cd791 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:12.785271 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-32c5d0f3-2d65-4e60-94a8-9845b22cd791 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:12.791478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32c5d0f3-2d65-4e60-94a8-9845b22cd791 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.791862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32c5d0f3-2d65-4e60-94a8-9845b22cd791 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.792673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32c5d0f3-2d65-4e60-94a8-9845b22cd791 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.793367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32c5d0f3-2d65-4e60-94a8-9845b22cd791 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.976243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-32c5d0f3-2d65-4e60-94a8-9845b22cd791 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:12.984935 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-32c5d0f3-2d65-4e60-94a8-9845b22cd791 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1536 microversion: 2.1 time: 0.210257 Jul 20 04:13:12.989084 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 614/1101] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:12 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1536 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:13.008048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-70f3f2b0-f2d4-47d0-a3d2-ddc68e019054 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:13.011443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-70f3f2b0-f2d4-47d0-a3d2-ddc68e019054 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:13.024711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70f3f2b0-f2d4-47d0-a3d2-ddc68e019054 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:13.027455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70f3f2b0-f2d4-47d0-a3d2-ddc68e019054 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:13.028470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70f3f2b0-f2d4-47d0-a3d2-ddc68e019054 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:13.029565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70f3f2b0-f2d4-47d0-a3d2-ddc68e019054 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:13.045841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:13.154900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-77fe695a-687a-437f-9112-e007acb7bf25 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:13.167650 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-77fe695a-687a-437f-9112-e007acb7bf25 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1712 microversion: 2.1 time: 0.616006 Jul 20 04:13:13.168998 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 488/1102] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:12 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1712 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:13.454230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-70f3f2b0-f2d4-47d0-a3d2-ddc68e019054 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:13.463625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-deb38192-b179-4697-be4a-24278ca5eee1 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Calling method '.version_select at 0x7f06be1bc940>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:13.472983 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-70f3f2b0-f2d4-47d0-a3d2-ddc68e019054 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1587 microversion: 2.1 time: 0.475420 Jul 20 04:13:13.479351 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 615/1103] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:12 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1587 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:13.493933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e7322b52-c483-4473-8eb9-88389e934305 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:13.494440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e7322b52-c483-4473-8eb9-88389e934305 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:13.511927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e7322b52-c483-4473-8eb9-88389e934305 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:13.519024 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-deb38192-b179-4697-be4a-24278ca5eee1 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114" status: 200 len: 346 microversion: 2.1 time: 0.060539 Jul 20 04:13:13.520958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e7322b52-c483-4473-8eb9-88389e934305 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:13.522268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e7322b52-c483-4473-8eb9-88389e934305 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:13.526722 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 489/1104] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:13:13 2022] GET /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114 => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:13.527432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e7322b52-c483-4473-8eb9-88389e934305 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:13.534502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a2e55a1a-7f5a-486b-8410-9d84bffcd7b0 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Action: 'create', calling method: .version_select at 0x7f06be1bcf70>, body: {"snapshot": {"volume_id": "1203cb06-ba8a-45aa-a6f1-dc7d848f3114", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1810058597"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:13.730453 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e7322b52-c483-4473-8eb9-88389e934305 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.244167 Jul 20 04:13:13.731448 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 616/1105] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:13:13 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273/os-interface => generated 284 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:13.756550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-9c71a288-ad1e-431e-84c4-dbe05c615527 req-dacdc953-c041-4ee5-b7bd-fa7173402fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944a56a8-87ef-4988-9f97-106c08046fe9", "name": "network-vif-plugged", "status": "completed", "tag": "63a5fa97-49af-495f-b6c4-80e7f5925cac"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:13.772514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9c71a288-ad1e-431e-84c4-dbe05c615527 req-dacdc953-c041-4ee5-b7bd-fa7173402fe8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:13.773222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9c71a288-ad1e-431e-84c4-dbe05c615527 req-dacdc953-c041-4ee5-b7bd-fa7173402fe8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:13.786214 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9c71a288-ad1e-431e-84c4-dbe05c615527 req-dacdc953-c041-4ee5-b7bd-fa7173402fe8 service nova] Creating event network-vif-plugged:63a5fa97-49af-495f-b6c4-80e7f5925cac for instance 944a56a8-87ef-4988-9f97-106c08046fe9 on n-h2-826526-5 Jul 20 04:13:13.793235 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-9c71a288-ad1e-431e-84c4-dbe05c615527 req-dacdc953-c041-4ee5-b7bd-fa7173402fe8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040163 Jul 20 04:13:13.794807 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 617/1106] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:13:13.801313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ac3e0826-63f4-4c01-97d2-86d6628089df tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:13.802480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ac3e0826-63f4-4c01-97d2-86d6628089df tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:13.810671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac3e0826-63f4-4c01-97d2-86d6628089df tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:13.811508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac3e0826-63f4-4c01-97d2-86d6628089df tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:13.812649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac3e0826-63f4-4c01-97d2-86d6628089df tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:13.813246 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac3e0826-63f4-4c01-97d2-86d6628089df tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:13.872189 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a2e55a1a-7f5a-486b-8410-9d84bffcd7b0 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.343791 Jul 20 04:13:13.872881 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 490/1107] 10.222.0.17 () {60 vars in 1161 bytes} [Wed Jul 20 04:13:13 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:13.884539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed4527e9-6e3f-4e58-8893-e6d5d0385d9b tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Calling method '.version_select at 0x7f06be1bc4c0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:14.014230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ac3e0826-63f4-4c01-97d2-86d6628089df tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:14.033804 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ac3e0826-63f4-4c01-97d2-86d6628089df tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620" status: 200 len: 1275 microversion: 2.1 time: 0.231640 Jul 20 04:13:14.035486 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 618/1108] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:13 2022] GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 => generated 1275 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:14.041843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-894bdff7-40ce-4361-99b2-35eea4cc356a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:14.050817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-894bdff7-40ce-4361-99b2-35eea4cc356a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:14.068499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-894bdff7-40ce-4361-99b2-35eea4cc356a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.070432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-894bdff7-40ce-4361-99b2-35eea4cc356a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.073268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-894bdff7-40ce-4361-99b2-35eea4cc356a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.073963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-894bdff7-40ce-4361-99b2-35eea4cc356a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.124140 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ed4527e9-6e3f-4e58-8893-e6d5d0385d9b tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5" status: 200 len: 287 microversion: 2.1 time: 0.243342 Jul 20 04:13:14.125525 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 491/1109] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 04:13:13 2022] GET /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5 => generated 287 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:13:14.137513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2a81b906-1393-4c37-b477-eb7c93609e1d tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Calling method '.version_select at 0x7f06be153e50>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:14.273623 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2a81b906-1393-4c37-b477-eb7c93609e1d tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.139401 Jul 20 04:13:14.276466 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 492/1110] 10.222.0.17 () {58 vars in 1139 bytes} [Wed Jul 20 04:13:14 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:14.290592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c238df5a-1997-4582-9369-d1da8e5b1f3a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:14.291858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c238df5a-1997-4582-9369-d1da8e5b1f3a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:14.313402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c238df5a-1997-4582-9369-d1da8e5b1f3a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.314466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c238df5a-1997-4582-9369-d1da8e5b1f3a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.315401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c238df5a-1997-4582-9369-d1da8e5b1f3a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.316699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c238df5a-1997-4582-9369-d1da8e5b1f3a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.492499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c238df5a-1997-4582-9369-d1da8e5b1f3a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:14.505166 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c238df5a-1997-4582-9369-d1da8e5b1f3a tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1645 microversion: 2.1 time: 0.227437 Jul 20 04:13:14.514291 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 493/1111] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:14 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1645 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:14.520220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1a9337d8-cc88-45af-9eac-52999edb2afa tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Calling method '.version_select at 0x7f06be153af0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:14.581316 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1a9337d8-cc88-45af-9eac-52999edb2afa tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5" status: 200 len: 287 microversion: 2.1 time: 0.065524 Jul 20 04:13:14.582588 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 494/1112] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 04:13:14 2022] GET /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:14.945622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-894bdff7-40ce-4361-99b2-35eea4cc356a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:14.956824 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-894bdff7-40ce-4361-99b2-35eea4cc356a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1529 microversion: 2.1 time: 0.918843 Jul 20 04:13:14.959608 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 619/1113] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:14 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1529 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:14.977470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b5e2fa87-91d7-42ff-9867-1efe582bdff6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:14.978101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b5e2fa87-91d7-42ff-9867-1efe582bdff6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:14.993612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b5e2fa87-91d7-42ff-9867-1efe582bdff6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.994226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b5e2fa87-91d7-42ff-9867-1efe582bdff6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.995389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b5e2fa87-91d7-42ff-9867-1efe582bdff6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.996141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b5e2fa87-91d7-42ff-9867-1efe582bdff6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:15.051792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c1b9a4e9-f1db-45d8-89fa-c4b5faceac74 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:15.052500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c1b9a4e9-f1db-45d8-89fa-c4b5faceac74 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:15.062140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1b9a4e9-f1db-45d8-89fa-c4b5faceac74 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:15.062585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1b9a4e9-f1db-45d8-89fa-c4b5faceac74 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:15.066255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1b9a4e9-f1db-45d8-89fa-c4b5faceac74 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:15.066799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1b9a4e9-f1db-45d8-89fa-c4b5faceac74 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:15.244300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c1b9a4e9-f1db-45d8-89fa-c4b5faceac74 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:15.255297 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c1b9a4e9-f1db-45d8-89fa-c4b5faceac74 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620" status: 200 len: 1275 microversion: 2.1 time: 0.208037 Jul 20 04:13:15.255897 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 620/1114] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:15 2022] GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 => generated 1275 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:15.524479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-866e3141-8000-42ec-b67f-29d61a08085d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:15.525368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-866e3141-8000-42ec-b67f-29d61a08085d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:15.534992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-866e3141-8000-42ec-b67f-29d61a08085d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:15.536343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-866e3141-8000-42ec-b67f-29d61a08085d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:15.538233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-866e3141-8000-42ec-b67f-29d61a08085d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:15.538994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-866e3141-8000-42ec-b67f-29d61a08085d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:15.576048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b5e2fa87-91d7-42ff-9867-1efe582bdff6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:15.602846 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b5e2fa87-91d7-42ff-9867-1efe582bdff6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1529 microversion: 2.1 time: 0.630550 Jul 20 04:13:15.615413 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 495/1115] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:14 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1529 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:15.623908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e14defc3-819b-4e35-ae9a-f5d06f1b5f37 req-60db5d90-eff5-4d8d-b921-3bcd8c92dd3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd1e4691-aad5-45a9-818f-922c3428d53f", "name": "network-vif-deleted", "tag": "e20cfa31-877a-4a68-ba01-74f0bfe7d08b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:15.664215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e14defc3-819b-4e35-ae9a-f5d06f1b5f37 req-60db5d90-eff5-4d8d-b921-3bcd8c92dd3e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:15.664990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e14defc3-819b-4e35-ae9a-f5d06f1b5f37 req-60db5d90-eff5-4d8d-b921-3bcd8c92dd3e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:15.680098 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e14defc3-819b-4e35-ae9a-f5d06f1b5f37 req-60db5d90-eff5-4d8d-b921-3bcd8c92dd3e service nova] Creating event network-vif-deleted:e20cfa31-877a-4a68-ba01-74f0bfe7d08b for instance fd1e4691-aad5-45a9-818f-922c3428d53f on n-h2-826526-5 Jul 20 04:13:15.685823 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e14defc3-819b-4e35-ae9a-f5d06f1b5f37 req-60db5d90-eff5-4d8d-b921-3bcd8c92dd3e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069094 Jul 20 04:13:15.687030 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 496/1116] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:15.707865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0d338fc1-fe07-4132-b6ca-98188f60e849 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Calling method '.version_select at 0x7f06be153e50>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:15.774396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-866e3141-8000-42ec-b67f-29d61a08085d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a6e471d9ee4ab1af6781800903c74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc39197e171c40638322c4ca85d73305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:15.787327 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-866e3141-8000-42ec-b67f-29d61a08085d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 200 len: 1645 microversion: 2.1 time: 0.268220 Jul 20 04:13:15.789741 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 621/1117] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:15 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 1645 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:15.799399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-85fe0679-f7ab-4460-8626-f2c0f36de8a6 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:15.800251 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:15.800251 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:13:15.815582 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-85fe0679-f7ab-4460-8626-f2c0f36de8a6 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] HTTP exception thrown: Flavor cee09f8a-6cde-493f-9990-b2fae44285a6 could not be found. Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-85fe0679-f7ab-4460-8626-f2c0f36de8a6 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Request method failure captured: Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/flavors/cee09f8a-6cde-493f-9990-b2fae44285a6 HTTP/1.1 Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_p1SHhCv-UwXzVisopikBkTRS-wssWgs5PJLbuAyNY4cjYqlCcM9A1fIafZ7ohhCJWwJ99u_45ciS3m30HOBBZMQJXDyTR2c6ldaIcbdNcf4LtXhzLk_6uEfbMxkj6-SMor0vDhbO8oxacMcc3hPEV-pDXcx15uaSr4sZ-w2parvg Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: e1f352c241604ee79fc6830c89403173 Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-MigrationsAdminTest-485766885 Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:13:15.825889 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:13:15.827477 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e1f352c241604ee79fc6830c89403173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e1f352c241604ee79fc6830c89403173"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e1f352c241604ee79fc6830c89403173", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e1f352c241604ee79fc6830c89403173"}]}] Jul 20 04:13:15.827477 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-MigrationsAdminTest-485766885 Jul 20 04:13:15.827477 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: e1f352c241604ee79fc6830c89403173 Jul 20 04:13:15.827477 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-MigrationsAdminTest-485766885 Jul 20 04:13:15.827477 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-MigrationsAdminTest-485766885-project-admin Jul 20 04:13:15.827477 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:13:15.827477 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:13:15.827477 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 28c19f2964444c4783b18ae6023226d3 Jul 20 04:13:15.827477 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-MigrationsAdminTest-485766885-project-admin Jul 20 04:13:15.827477 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:13:15.827477 n-d-826526-5 devstack@n-api.service[127871]: exception: Flavor cee09f8a-6cde-493f-9990-b2fae44285a6 could not be found. Jul 20 04:13:15.827477 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'cee09f8a-6cde-493f-9990-b2fae44285a6'} Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor cee09f8a-6cde-493f-9990-b2fae44285a6 could not be found. Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:15.828401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:15.830707 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:15.830707 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:15.830707 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:15.830707 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:15.830707 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:15.830707 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 20 04:13:15.830707 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:15.830707 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor cee09f8a-6cde-493f-9990-b2fae44285a6 could not be found. Jul 20 04:13:15.830707 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:15.830707 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:15.830707 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:15.830707 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:15.830707 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:15.830707 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:15.830707 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:15.830707 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:15.830707 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor cee09f8a-6cde-493f-9990-b2fae44285a6 could not be found. Jul 20 04:13:15.830707 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:15.833815 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0d338fc1-fe07-4132-b6ca-98188f60e849 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5" status: 200 len: 287 microversion: 2.1 time: 0.141965 Jul 20 04:13:15.835809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-85fe0679-f7ab-4460-8626-f2c0f36de8a6 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Returning 404 to user: Flavor cee09f8a-6cde-493f-9990-b2fae44285a6 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:15.836853 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-85fe0679-f7ab-4460-8626-f2c0f36de8a6 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/cee09f8a-6cde-493f-9990-b2fae44285a6" status: 404 len: 109 microversion: 2.1 time: 0.042055 Jul 20 04:13:15.837830 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 622/1119] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:15 2022] DELETE /compute/v2.1/flavors/cee09f8a-6cde-493f-9990-b2fae44285a6 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:15.841471 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 497/1119] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 04:13:15 2022] GET /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5 => generated 287 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:16.148721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-35badbfe-1414-40d4-a223-f3c3fbb0a4b2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1354554590", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:16.260713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-35badbfe-1414-40d4-a223-f3c3fbb0a4b2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:13:16.274826 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94cdf12a-236f-47f5-b382-e9e162ad1676 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:16.276038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-94cdf12a-236f-47f5-b382-e9e162ad1676 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:16.300234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94cdf12a-236f-47f5-b382-e9e162ad1676 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.307039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94cdf12a-236f-47f5-b382-e9e162ad1676 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.312125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94cdf12a-236f-47f5-b382-e9e162ad1676 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.312919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94cdf12a-236f-47f5-b382-e9e162ad1676 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.757463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-35badbfe-1414-40d4-a223-f3c3fbb0a4b2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:13:16.758276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-35badbfe-1414-40d4-a223-f3c3fbb0a4b2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:13:16.759026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-35badbfe-1414-40d4-a223-f3c3fbb0a4b2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:13:16.759658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-35badbfe-1414-40d4-a223-f3c3fbb0a4b2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:13:16.760313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-35badbfe-1414-40d4-a223-f3c3fbb0a4b2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:13:16.771943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35badbfe-1414-40d4-a223-f3c3fbb0a4b2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.772758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35badbfe-1414-40d4-a223-f3c3fbb0a4b2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.773950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35badbfe-1414-40d4-a223-f3c3fbb0a4b2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.774596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35badbfe-1414-40d4-a223-f3c3fbb0a4b2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.795128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-35badbfe-1414-40d4-a223-f3c3fbb0a4b2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Getting quotas for project 6c73d55e6bc740d0aec2ba67f0491099. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:13:16.802376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-35badbfe-1414-40d4-a223-f3c3fbb0a4b2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Getting quotas for user b4f8b49fd45944a384836a1459e4e7e9 and project 6c73d55e6bc740d0aec2ba67f0491099. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:13:16.827786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35badbfe-1414-40d4-a223-f3c3fbb0a4b2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:13:16.832800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35badbfe-1414-40d4-a223-f3c3fbb0a4b2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:13:16.851220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-94cdf12a-236f-47f5-b382-e9e162ad1676 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:16.865801 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-94cdf12a-236f-47f5-b382-e9e162ad1676 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620" status: 200 len: 1317 microversion: 2.1 time: 0.597000 Jul 20 04:13:16.866744 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 498/1120] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:16 2022] GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 => generated 1317 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:16.886162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-75be0ee2-7b5a-402d-ab2b-4f1b230d018f tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:16.889035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-75be0ee2-7b5a-402d-ab2b-4f1b230d018f tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:16.907152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75be0ee2-7b5a-402d-ab2b-4f1b230d018f tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.919395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75be0ee2-7b5a-402d-ab2b-4f1b230d018f tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.921070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75be0ee2-7b5a-402d-ab2b-4f1b230d018f tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.921690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75be0ee2-7b5a-402d-ab2b-4f1b230d018f tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.935263 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-35badbfe-1414-40d4-a223-f3c3fbb0a4b2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790253 Jul 20 04:13:16.938479 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 623/1121] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:13:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:13:16.952422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1785bce3-8e2c-49f3-af56-31e644cc7266 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:16.953428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1785bce3-8e2c-49f3-af56-31e644cc7266 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:16.972006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1785bce3-8e2c-49f3-af56-31e644cc7266 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.972532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1785bce3-8e2c-49f3-af56-31e644cc7266 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.973362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1785bce3-8e2c-49f3-af56-31e644cc7266 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.976013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1785bce3-8e2c-49f3-af56-31e644cc7266 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:17.015144 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-1785bce3-8e2c-49f3-af56-31e644cc7266 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] HTTP exception thrown: Instance fd1e4691-aad5-45a9-818f-922c3428d53f could not be found. Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1785bce3-8e2c-49f3-af56-31e644cc7266 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Request method failure captured: Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f HTTP/1.1 Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14AsUmITjGLunCFJAhGHYjkbp9QkV_vCZQDjnVAO7F3bVMR4iyEeYcgIis97-PE8pbfw7_xX_4kXRUuAiHnBv0umVtEXI3BJw4JS8XQ9Dxb2R8CQ1jiFCvs8PfYE_-6oZ6CnXo_WvPwp-38z7vRsWXFTcYd9VpFTiGDprbW-HapLdqk Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: bc39197e171c40638322c4ca85d73305 Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:13:17.020792 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:13:17.022623 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bc39197e171c40638322c4ca85d73305"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bc39197e171c40638322c4ca85d73305"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bc39197e171c40638322c4ca85d73305", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bc39197e171c40638322c4ca85d73305"}]}] Jul 20 04:13:17.022623 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:17.022623 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: bc39197e171c40638322c4ca85d73305 Jul 20 04:13:17.022623 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:17.022623 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1700105006-project Jul 20 04:13:17.022623 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:13:17.022623 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:13:17.022623 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f4a6e471d9ee4ab1af6781800903c74b Jul 20 04:13:17.022623 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006-project Jul 20 04:13:17.022623 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:13:17.022623 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance fd1e4691-aad5-45a9-818f-922c3428d53f could not be found. Jul 20 04:13:17.022623 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'fd1e4691-aad5-45a9-818f-922c3428d53f'} Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd1e4691-aad5-45a9-818f-922c3428d53f could not be found. Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:17.023581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:17.030670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:17.030670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:17.030670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:17.030670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:17.030670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:17.030670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:17.030670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:17.030670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd1e4691-aad5-45a9-818f-922c3428d53f could not be found. Jul 20 04:13:17.030670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:17.030670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:17.030670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:17.030670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:17.030670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:17.030670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:17.030670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:17.030670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:17.030670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd1e4691-aad5-45a9-818f-922c3428d53f could not be found. Jul 20 04:13:17.030670 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:17.031942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1785bce3-8e2c-49f3-af56-31e644cc7266 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Returning 404 to user: Instance fd1e4691-aad5-45a9-818f-922c3428d53f could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:17.031942 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1785bce3-8e2c-49f3-af56-31e644cc7266 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 404 len: 111 microversion: 2.1 time: 0.081738 Jul 20 04:13:17.031942 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 624/1122] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:16 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:17.036343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-edbb2b69-d5dd-4453-8eca-3c4717f4a57f tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Calling method '.version_select at 0x7f06bdfa8ee0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:17.096730 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-edbb2b69-d5dd-4453-8eca-3c4717f4a57f tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5" status: 200 len: 288 microversion: 2.1 time: 0.068233 Jul 20 04:13:17.097312 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 625/1123] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 04:13:17 2022] GET /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5 => generated 288 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:17.101882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9d156782-164b-4013-bf30-9488532f092d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:17.102491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9d156782-164b-4013-bf30-9488532f092d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:17.277374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9d156782-164b-4013-bf30-9488532f092d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:17.287354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-75be0ee2-7b5a-402d-ab2b-4f1b230d018f tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:17.304793 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9d156782-164b-4013-bf30-9488532f092d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1213 microversion: 2.1 time: 0.197215 Jul 20 04:13:17.315444 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-75be0ee2-7b5a-402d-ab2b-4f1b230d018f tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1587 microversion: 2.1 time: 0.445104 Jul 20 04:13:17.316325 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 499/1124] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:16 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1587 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:17.328064 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 626/1125] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:17 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1213 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:17.346465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e229d73c-4207-4c46-8ef0-441df8917d0d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:17.347040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e229d73c-4207-4c46-8ef0-441df8917d0d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:17.349018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-930361ef-573d-447f-8b56-5841ee3a04f5 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Calling method '.version_select at 0x7f06bdfaeb80>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:17.370641 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e229d73c-4207-4c46-8ef0-441df8917d0d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:17.371105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e229d73c-4207-4c46-8ef0-441df8917d0d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:17.371894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e229d73c-4207-4c46-8ef0-441df8917d0d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:17.372402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e229d73c-4207-4c46-8ef0-441df8917d0d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:17.399915 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-e229d73c-4207-4c46-8ef0-441df8917d0d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] HTTP exception thrown: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e229d73c-4207-4c46-8ef0-441df8917d0d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Request method failure captured: Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 HTTP/1.1 Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14AsUmITjGLunCFJAhGHYjkbp9QkV_vCZQDjnVAO7F3bVMR4iyEeYcgIis97-PE8pbfw7_xX_4kXRUuAiHnBv0umVtEXI3BJw4JS8XQ9Dxb2R8CQ1jiFCvs8PfYE_-6oZ6CnXo_WvPwp-38z7vRsWXFTcYd9VpFTiGDprbW-HapLdqk Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: bc39197e171c40638322c4ca85d73305 Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:13:17.401659 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:13:17.403078 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bc39197e171c40638322c4ca85d73305"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bc39197e171c40638322c4ca85d73305"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bc39197e171c40638322c4ca85d73305", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bc39197e171c40638322c4ca85d73305"}]}] Jul 20 04:13:17.403078 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:17.403078 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: bc39197e171c40638322c4ca85d73305 Jul 20 04:13:17.403078 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:17.403078 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1700105006-project Jul 20 04:13:17.403078 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:13:17.403078 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:13:17.403078 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f4a6e471d9ee4ab1af6781800903c74b Jul 20 04:13:17.403078 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006-project Jul 20 04:13:17.403078 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:13:17.403078 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:17.403078 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'c220c0a5-011c-4d57-9691-99405d5fe216'} Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:17.403937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:17.405311 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:17.407405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e229d73c-4207-4c46-8ef0-441df8917d0d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Returning 404 to user: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:17.409854 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e229d73c-4207-4c46-8ef0-441df8917d0d tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216" status: 404 len: 111 microversion: 2.1 time: 0.074192 Jul 20 04:13:17.413214 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 500/1126] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:17 2022] DELETE /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:17.421720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d9f40052-28ca-4194-ba34-6f9b7ff116bc tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:17.430360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d9f40052-28ca-4194-ba34-6f9b7ff116bc tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:17.452170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9f40052-28ca-4194-ba34-6f9b7ff116bc tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:17.452662 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9f40052-28ca-4194-ba34-6f9b7ff116bc tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:17.460182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9f40052-28ca-4194-ba34-6f9b7ff116bc tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:17.460974 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9f40052-28ca-4194-ba34-6f9b7ff116bc tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:17.489312 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-d9f40052-28ca-4194-ba34-6f9b7ff116bc tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] HTTP exception thrown: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d9f40052-28ca-4194-ba34-6f9b7ff116bc tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Request method failure captured: Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 HTTP/1.1 Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14AsUmITjGLunCFJAhGHYjkbp9QkV_vCZQDjnVAO7F3bVMR4iyEeYcgIis97-PE8pbfw7_xX_4kXRUuAiHnBv0umVtEXI3BJw4JS8XQ9Dxb2R8CQ1jiFCvs8PfYE_-6oZ6CnXo_WvPwp-38z7vRsWXFTcYd9VpFTiGDprbW-HapLdqk Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: bc39197e171c40638322c4ca85d73305 Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:13:17.492224 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:13:17.493883 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bc39197e171c40638322c4ca85d73305"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bc39197e171c40638322c4ca85d73305"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bc39197e171c40638322c4ca85d73305", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bc39197e171c40638322c4ca85d73305"}]}] Jul 20 04:13:17.493883 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:17.493883 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: bc39197e171c40638322c4ca85d73305 Jul 20 04:13:17.493883 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:17.493883 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1700105006-project Jul 20 04:13:17.493883 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:13:17.493883 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:13:17.493883 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f4a6e471d9ee4ab1af6781800903c74b Jul 20 04:13:17.493883 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006-project Jul 20 04:13:17.493883 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:13:17.493883 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:17.493883 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'c220c0a5-011c-4d57-9691-99405d5fe216'} Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:17.494740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:17.497180 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:17.497180 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:17.497180 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:17.497180 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:17.497180 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:17.497180 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:17.497180 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:17.497180 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:17.497180 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:17.497180 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:17.497180 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:17.497180 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:17.497180 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:17.497180 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:17.497180 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:17.497180 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:17.497180 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:17.497180 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:17.502763 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-930361ef-573d-447f-8b56-5841ee3a04f5 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5" status: 202 len: 0 microversion: 2.1 time: 0.173499 Jul 20 04:13:17.508683 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 627/1127] 10.222.0.17 () {58 vars in 1253 bytes} [Wed Jul 20 04:13:17 2022] DELETE /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:17.518355 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c7885fb5-3a90-449c-920b-e404f857bd23 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Calling method '.version_select at 0x7f06be0dee50>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:17.530095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d9f40052-28ca-4194-ba34-6f9b7ff116bc tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Returning 404 to user: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:17.531323 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d9f40052-28ca-4194-ba34-6f9b7ff116bc tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216" status: 404 len: 111 microversion: 2.1 time: 0.113445 Jul 20 04:13:17.540365 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 501/1128] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:17 2022] GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:17.565288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0da4c98d-4a30-4834-aae9-c37a0f9fc74e tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '.version_select at 0x7f06be1e1160>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:17.604951 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0da4c98d-4a30-4834-aae9-c37a0f9fc74e tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1546201336" status: 202 len: 0 microversion: 2.1 time: 0.058061 Jul 20 04:13:17.606042 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 502/1129] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jul 20 04:13:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1546201336 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:17.622500 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c7885fb5-3a90-449c-920b-e404f857bd23 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5" status: 200 len: 287 microversion: 2.1 time: 0.108263 Jul 20 04:13:17.623278 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 628/1130] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 04:13:17 2022] GET /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5 => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:17.785791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-16e69f43-e98c-48b0-a107-2d4f11405c8b req-6730ac9f-a52d-47bc-9f6d-492727b013a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b459a3ae-fa64-4ffa-a90f-ae87acc75273", "tag": "f98829db-28ce-43b1-91f3-0b5324542e84"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:17.811442 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-16e69f43-e98c-48b0-a107-2d4f11405c8b req-6730ac9f-a52d-47bc-9f6d-492727b013a1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:17.812209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-16e69f43-e98c-48b0-a107-2d4f11405c8b req-6730ac9f-a52d-47bc-9f6d-492727b013a1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:17.842106 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-16e69f43-e98c-48b0-a107-2d4f11405c8b req-6730ac9f-a52d-47bc-9f6d-492727b013a1 service nova] Creating event network-changed:f98829db-28ce-43b1-91f3-0b5324542e84 for instance b459a3ae-fa64-4ffa-a90f-ae87acc75273 on n-h1-826526-5 Jul 20 04:13:17.859613 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-16e69f43-e98c-48b0-a107-2d4f11405c8b req-6730ac9f-a52d-47bc-9f6d-492727b013a1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077470 Jul 20 04:13:17.871003 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 503/1131] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:13:17.884093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-160d1374-0c4f-4352-8d07-1b13fbce05f6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:17.885629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-160d1374-0c4f-4352-8d07-1b13fbce05f6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:17.907939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-160d1374-0c4f-4352-8d07-1b13fbce05f6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:17.908436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-160d1374-0c4f-4352-8d07-1b13fbce05f6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:17.909270 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-160d1374-0c4f-4352-8d07-1b13fbce05f6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:17.909709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-160d1374-0c4f-4352-8d07-1b13fbce05f6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.236515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-0c5437eb-c88e-4891-bff0-c34501b35873 req-6abb4225-49b4-4e01-a947-ccf958b013fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e26411e5-04e8-4059-8222-e0b1184dc620", "tag": "1a6dcd1e-bf04-4ab0-8b28-5bcb96655419"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:18.258466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0c5437eb-c88e-4891-bff0-c34501b35873 req-6abb4225-49b4-4e01-a947-ccf958b013fd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.259086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0c5437eb-c88e-4891-bff0-c34501b35873 req-6abb4225-49b4-4e01-a947-ccf958b013fd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.301863 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-0c5437eb-c88e-4891-bff0-c34501b35873 req-6abb4225-49b4-4e01-a947-ccf958b013fd service nova] Creating event network-changed:1a6dcd1e-bf04-4ab0-8b28-5bcb96655419 for instance e26411e5-04e8-4059-8222-e0b1184dc620 on n-h2-826526-5 Jul 20 04:13:18.326697 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-0c5437eb-c88e-4891-bff0-c34501b35873 req-6abb4225-49b4-4e01-a947-ccf958b013fd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091077 Jul 20 04:13:18.327662 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 504/1132] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:18.333031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fe37c0e7-8241-4f53-9c7f-b8c210fbafb4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:18.333798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fe37c0e7-8241-4f53-9c7f-b8c210fbafb4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:18.365029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe37c0e7-8241-4f53-9c7f-b8c210fbafb4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.365482 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe37c0e7-8241-4f53-9c7f-b8c210fbafb4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.366278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe37c0e7-8241-4f53-9c7f-b8c210fbafb4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.366730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe37c0e7-8241-4f53-9c7f-b8c210fbafb4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.553223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fe37c0e7-8241-4f53-9c7f-b8c210fbafb4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:18.561112 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fe37c0e7-8241-4f53-9c7f-b8c210fbafb4 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1265 microversion: 2.1 time: 0.231980 Jul 20 04:13:18.561713 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 505/1133] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:18 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:18.641707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3428ea40-36ea-4ada-bcc2-d0ad4886991c tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Calling method '.version_select at 0x7f06be1bc700>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:18.702835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-160d1374-0c4f-4352-8d07-1b13fbce05f6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:18.717024 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-160d1374-0c4f-4352-8d07-1b13fbce05f6 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620" status: 200 len: 1317 microversion: 2.1 time: 0.836828 Jul 20 04:13:18.717628 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 629/1134] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:17 2022] GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 => generated 1317 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:18.732800 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3428ea40-36ea-4ada-bcc2-d0ad4886991c tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5" status: 200 len: 287 microversion: 2.1 time: 0.095596 Jul 20 04:13:18.733437 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 506/1135] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 04:13:18 2022] GET /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:13:19.579375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ea9a2145-bd7e-4823-9136-9772a5b93363 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:19.580300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ea9a2145-bd7e-4823-9136-9772a5b93363 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:19.594077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea9a2145-bd7e-4823-9136-9772a5b93363 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:19.594609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea9a2145-bd7e-4823-9136-9772a5b93363 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:19.595504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea9a2145-bd7e-4823-9136-9772a5b93363 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:19.596679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea9a2145-bd7e-4823-9136-9772a5b93363 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:19.734599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fade7451-470d-4aff-ab27-cd78af1f7267 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:19.735211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fade7451-470d-4aff-ab27-cd78af1f7267 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:19.744551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fade7451-470d-4aff-ab27-cd78af1f7267 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:19.745726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fade7451-470d-4aff-ab27-cd78af1f7267 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:19.747189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fade7451-470d-4aff-ab27-cd78af1f7267 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:19.748301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fade7451-470d-4aff-ab27-cd78af1f7267 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:19.903393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ea9a2145-bd7e-4823-9136-9772a5b93363 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:19.913271 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ea9a2145-bd7e-4823-9136-9772a5b93363 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1271 microversion: 2.1 time: 0.338285 Jul 20 04:13:19.914336 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 630/1136] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:19 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1271 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:19.918943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fade7451-470d-4aff-ab27-cd78af1f7267 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:19.927640 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fade7451-470d-4aff-ab27-cd78af1f7267 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620" status: 200 len: 1317 microversion: 2.1 time: 0.197876 Jul 20 04:13:19.937054 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 507/1137] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:19 2022] GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:19.937230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-71387317-41c2-4fe6-8472-8b4416bca189 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Calling method '.version_select at 0x7f06bdeec3a0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:19.967183 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-71387317-41c2-4fe6-8472-8b4416bca189 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5" status: 200 len: 287 microversion: 2.1 time: 0.051506 Jul 20 04:13:19.968023 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 631/1138] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 04:13:19 2022] GET /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:20.634676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a1b24722-e8a3-4752-95b5-3cabc36ae3f3 tempest-ServersWithSpecificFlavorTestJSON-244217629 tempest-ServersWithSpecificFlavorTestJSON-244217629-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:20.636744 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:20.636744 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:13:20.640715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:20.641382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:20.660288 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a1b24722-e8a3-4752-95b5-3cabc36ae3f3 tempest-ServersWithSpecificFlavorTestJSON-244217629 tempest-ServersWithSpecificFlavorTestJSON-244217629-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/455043314" status: 202 len: 0 microversion: 2.1 time: 0.031045 Jul 20 04:13:20.661337 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 508/1139] 10.222.0.17 () {58 vars in 1157 bytes} [Wed Jul 20 04:13:20 2022] DELETE /compute/v2.1/flavors/455043314 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:13:20.671120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-08d521c5-feb8-47c9-993e-0a8dc528ea66 tempest-ServersWithSpecificFlavorTestJSON-244217629 tempest-ServersWithSpecificFlavorTestJSON-244217629-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:20.694818 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-08d521c5-feb8-47c9-993e-0a8dc528ea66 tempest-ServersWithSpecificFlavorTestJSON-244217629 tempest-ServersWithSpecificFlavorTestJSON-244217629-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.028368 Jul 20 04:13:20.695928 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 632/1140] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:13:20 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:20.710416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f8333d3c-c3b8-48d0-be69-dc4390967e5c tempest-ServersWithSpecificFlavorTestJSON-244217629 tempest-ServersWithSpecificFlavorTestJSON-244217629-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:20.729741 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f8333d3c-c3b8-48d0-be69-dc4390967e5c tempest-ServersWithSpecificFlavorTestJSON-244217629 tempest-ServersWithSpecificFlavorTestJSON-244217629-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1067554771" status: 202 len: 0 microversion: 2.1 time: 0.022964 Jul 20 04:13:20.734000 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 509/1141] 10.222.0.17 () {58 vars in 1160 bytes} [Wed Jul 20 04:13:20 2022] DELETE /compute/v2.1/flavors/1067554771 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:20.739425 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3177d1eb-8945-47a8-bd8a-2d0832cdb81c tempest-ServersWithSpecificFlavorTestJSON-244217629 tempest-ServersWithSpecificFlavorTestJSON-244217629-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:20.760406 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3177d1eb-8945-47a8-bd8a-2d0832cdb81c tempest-ServersWithSpecificFlavorTestJSON-244217629 tempest-ServersWithSpecificFlavorTestJSON-244217629-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025018 Jul 20 04:13:20.761062 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 633/1142] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:13:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:20.781601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d4025257-383a-4919-acfa-404b05eab18c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:20.782059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d4025257-383a-4919-acfa-404b05eab18c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:20.789444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4025257-383a-4919-acfa-404b05eab18c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.789894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4025257-383a-4919-acfa-404b05eab18c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.791363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4025257-383a-4919-acfa-404b05eab18c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.791809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4025257-383a-4919-acfa-404b05eab18c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.806376 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-d4025257-383a-4919-acfa-404b05eab18c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] HTTP exception thrown: Instance fd1e4691-aad5-45a9-818f-922c3428d53f could not be found. Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d4025257-383a-4919-acfa-404b05eab18c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Request method failure captured: Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f HTTP/1.1 Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14AsUmITjGLunCFJAhGHYjkbp9QkV_vCZQDjnVAO7F3bVMR4iyEeYcgIis97-PE8pbfw7_xX_4kXRUuAiHnBv0umVtEXI3BJw4JS8XQ9Dxb2R8CQ1jiFCvs8PfYE_-6oZ6CnXo_WvPwp-38z7vRsWXFTcYd9VpFTiGDprbW-HapLdqk Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: bc39197e171c40638322c4ca85d73305 Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:13:20.808073 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:13:20.809788 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bc39197e171c40638322c4ca85d73305"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bc39197e171c40638322c4ca85d73305"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bc39197e171c40638322c4ca85d73305", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bc39197e171c40638322c4ca85d73305"}]}] Jul 20 04:13:20.809788 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:20.809788 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: bc39197e171c40638322c4ca85d73305 Jul 20 04:13:20.809788 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:20.809788 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1700105006-project Jul 20 04:13:20.809788 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:13:20.809788 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:13:20.809788 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f4a6e471d9ee4ab1af6781800903c74b Jul 20 04:13:20.809788 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006-project Jul 20 04:13:20.809788 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:13:20.809788 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance fd1e4691-aad5-45a9-818f-922c3428d53f could not be found. Jul 20 04:13:20.809788 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'fd1e4691-aad5-45a9-818f-922c3428d53f'} Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd1e4691-aad5-45a9-818f-922c3428d53f could not be found. Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:20.810651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd1e4691-aad5-45a9-818f-922c3428d53f could not be found. Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd1e4691-aad5-45a9-818f-922c3428d53f could not be found. Jul 20 04:13:20.812145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.813651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d4025257-383a-4919-acfa-404b05eab18c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Returning 404 to user: Instance fd1e4691-aad5-45a9-818f-922c3428d53f could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:20.813651 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d4025257-383a-4919-acfa-404b05eab18c tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 404 len: 111 microversion: 2.1 time: 0.032253 Jul 20 04:13:20.813651 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 510/1143] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:20 2022] DELETE /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:20.818380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6dd09060-379b-4eb4-940b-9de8c084541f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:20.818999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6dd09060-379b-4eb4-940b-9de8c084541f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: fd1e4691-aad5-45a9-818f-922c3428d53f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:20.825832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6dd09060-379b-4eb4-940b-9de8c084541f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.826584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6dd09060-379b-4eb4-940b-9de8c084541f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.827554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6dd09060-379b-4eb4-940b-9de8c084541f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.828034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6dd09060-379b-4eb4-940b-9de8c084541f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.842399 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-6dd09060-379b-4eb4-940b-9de8c084541f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] HTTP exception thrown: Instance fd1e4691-aad5-45a9-818f-922c3428d53f could not be found. Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6dd09060-379b-4eb4-940b-9de8c084541f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Request method failure captured: Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f HTTP/1.1 Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14AsUmITjGLunCFJAhGHYjkbp9QkV_vCZQDjnVAO7F3bVMR4iyEeYcgIis97-PE8pbfw7_xX_4kXRUuAiHnBv0umVtEXI3BJw4JS8XQ9Dxb2R8CQ1jiFCvs8PfYE_-6oZ6CnXo_WvPwp-38z7vRsWXFTcYd9VpFTiGDprbW-HapLdqk Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: bc39197e171c40638322c4ca85d73305 Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:13:20.843985 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:13:20.845364 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bc39197e171c40638322c4ca85d73305"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bc39197e171c40638322c4ca85d73305"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bc39197e171c40638322c4ca85d73305", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bc39197e171c40638322c4ca85d73305"}]}] Jul 20 04:13:20.845364 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:20.845364 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: bc39197e171c40638322c4ca85d73305 Jul 20 04:13:20.845364 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:20.845364 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1700105006-project Jul 20 04:13:20.845364 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:13:20.845364 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:13:20.845364 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f4a6e471d9ee4ab1af6781800903c74b Jul 20 04:13:20.845364 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006-project Jul 20 04:13:20.845364 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:13:20.845364 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance fd1e4691-aad5-45a9-818f-922c3428d53f could not be found. Jul 20 04:13:20.845364 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'fd1e4691-aad5-45a9-818f-922c3428d53f'} Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd1e4691-aad5-45a9-818f-922c3428d53f could not be found. Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:20.846197 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:20.847607 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:20.847607 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:20.847607 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:20.847607 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:20.847607 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:20.847607 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:20.847607 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:20.847607 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd1e4691-aad5-45a9-818f-922c3428d53f could not be found. Jul 20 04:13:20.847607 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.847607 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:20.847607 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.847607 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:20.847607 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:20.847607 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:20.847607 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:20.847607 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:20.847607 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd1e4691-aad5-45a9-818f-922c3428d53f could not be found. Jul 20 04:13:20.847607 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.848766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6dd09060-379b-4eb4-940b-9de8c084541f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Returning 404 to user: Instance fd1e4691-aad5-45a9-818f-922c3428d53f could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:20.848766 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6dd09060-379b-4eb4-940b-9de8c084541f tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f" status: 404 len: 111 microversion: 2.1 time: 0.031003 Jul 20 04:13:20.848766 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 634/1144] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:20 2022] GET /compute/v2.1/servers/fd1e4691-aad5-45a9-818f-922c3428d53f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:13:20.853980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d12535b5-a47c-4090-a176-7a0ddaad1147 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:20.854480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d12535b5-a47c-4090-a176-7a0ddaad1147 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:20.862543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d12535b5-a47c-4090-a176-7a0ddaad1147 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.863252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d12535b5-a47c-4090-a176-7a0ddaad1147 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.864313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d12535b5-a47c-4090-a176-7a0ddaad1147 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.865067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d12535b5-a47c-4090-a176-7a0ddaad1147 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.880486 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-d12535b5-a47c-4090-a176-7a0ddaad1147 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] HTTP exception thrown: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d12535b5-a47c-4090-a176-7a0ddaad1147 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Request method failure captured: Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 HTTP/1.1 Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14AsUmITjGLunCFJAhGHYjkbp9QkV_vCZQDjnVAO7F3bVMR4iyEeYcgIis97-PE8pbfw7_xX_4kXRUuAiHnBv0umVtEXI3BJw4JS8XQ9Dxb2R8CQ1jiFCvs8PfYE_-6oZ6CnXo_WvPwp-38z7vRsWXFTcYd9VpFTiGDprbW-HapLdqk Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: bc39197e171c40638322c4ca85d73305 Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:13:20.882043 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:13:20.883701 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bc39197e171c40638322c4ca85d73305"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bc39197e171c40638322c4ca85d73305"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bc39197e171c40638322c4ca85d73305", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bc39197e171c40638322c4ca85d73305"}]}] Jul 20 04:13:20.883701 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:20.883701 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: bc39197e171c40638322c4ca85d73305 Jul 20 04:13:20.883701 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:20.883701 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1700105006-project Jul 20 04:13:20.883701 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:13:20.883701 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:13:20.883701 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f4a6e471d9ee4ab1af6781800903c74b Jul 20 04:13:20.883701 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006-project Jul 20 04:13:20.883701 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:13:20.883701 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:20.883701 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'c220c0a5-011c-4d57-9691-99405d5fe216'} Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:20.884704 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:20.886174 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.889003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d12535b5-a47c-4090-a176-7a0ddaad1147 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Returning 404 to user: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:20.889003 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d12535b5-a47c-4090-a176-7a0ddaad1147 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216" status: 404 len: 111 microversion: 2.1 time: 0.033285 Jul 20 04:13:20.892110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-979b86fc-5c09-4989-b91b-150ee9d158a7 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:20.892756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-979b86fc-5c09-4989-b91b-150ee9d158a7 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] [instance: c220c0a5-011c-4d57-9691-99405d5fe216] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:20.896350 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 511/1145] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:20 2022] DELETE /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:20.898908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-979b86fc-5c09-4989-b91b-150ee9d158a7 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.899362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-979b86fc-5c09-4989-b91b-150ee9d158a7 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.900206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-979b86fc-5c09-4989-b91b-150ee9d158a7 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.900690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-979b86fc-5c09-4989-b91b-150ee9d158a7 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.915142 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-979b86fc-5c09-4989-b91b-150ee9d158a7 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] HTTP exception thrown: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-979b86fc-5c09-4989-b91b-150ee9d158a7 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Request method failure captured: Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 HTTP/1.1 Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14AsUmITjGLunCFJAhGHYjkbp9QkV_vCZQDjnVAO7F3bVMR4iyEeYcgIis97-PE8pbfw7_xX_4kXRUuAiHnBv0umVtEXI3BJw4JS8XQ9Dxb2R8CQ1jiFCvs8PfYE_-6oZ6CnXo_WvPwp-38z7vRsWXFTcYd9VpFTiGDprbW-HapLdqk Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: bc39197e171c40638322c4ca85d73305 Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:13:20.917548 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:13:20.919267 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bc39197e171c40638322c4ca85d73305"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bc39197e171c40638322c4ca85d73305"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bc39197e171c40638322c4ca85d73305", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bc39197e171c40638322c4ca85d73305"}]}] Jul 20 04:13:20.919267 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:20.919267 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: bc39197e171c40638322c4ca85d73305 Jul 20 04:13:20.919267 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006 Jul 20 04:13:20.919267 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1700105006-project Jul 20 04:13:20.919267 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:13:20.919267 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:13:20.919267 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f4a6e471d9ee4ab1af6781800903c74b Jul 20 04:13:20.919267 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1700105006-project Jul 20 04:13:20.919267 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:13:20.919267 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:20.919267 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'c220c0a5-011c-4d57-9691-99405d5fe216'} Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:20.920749 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:20.922175 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:20.922175 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:20.922175 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:20.922175 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:20.922175 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:20.922175 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:20.922175 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:20.922175 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:20.922175 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.922175 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:20.922175 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.922175 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:20.922175 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:20.922175 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:20.922175 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:20.922175 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:20.922175 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. Jul 20 04:13:20.922175 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:20.923426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-979b86fc-5c09-4989-b91b-150ee9d158a7 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] Returning 404 to user: Instance c220c0a5-011c-4d57-9691-99405d5fe216 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:20.923426 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-979b86fc-5c09-4989-b91b-150ee9d158a7 tempest-ServersWithSpecificFlavorTestJSON-1700105006 tempest-ServersWithSpecificFlavorTestJSON-1700105006-project] 10.222.0.17 "GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216" status: 404 len: 111 microversion: 2.1 time: 0.030621 Jul 20 04:13:20.923426 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 635/1146] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:20 2022] GET /compute/v2.1/servers/c220c0a5-011c-4d57-9691-99405d5fe216 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:20.932010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7aa4dd78-419e-4eef-ae68-4464dd959daf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:20.932010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7aa4dd78-419e-4eef-ae68-4464dd959daf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:20.939304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7aa4dd78-419e-4eef-ae68-4464dd959daf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.939304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7aa4dd78-419e-4eef-ae68-4464dd959daf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.940131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7aa4dd78-419e-4eef-ae68-4464dd959daf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.940832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7aa4dd78-419e-4eef-ae68-4464dd959daf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.946912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d695875c-4a95-4470-a0e2-efd7ded1335c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:20.947644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d695875c-4a95-4470-a0e2-efd7ded1335c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:20.956244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d695875c-4a95-4470-a0e2-efd7ded1335c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.957672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d695875c-4a95-4470-a0e2-efd7ded1335c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.959175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d695875c-4a95-4470-a0e2-efd7ded1335c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.959723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d695875c-4a95-4470-a0e2-efd7ded1335c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:21.078665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7aa4dd78-419e-4eef-ae68-4464dd959daf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:21.090956 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7aa4dd78-419e-4eef-ae68-4464dd959daf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1271 microversion: 2.1 time: 0.163942 Jul 20 04:13:21.095833 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 512/1147] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:20 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:21.108496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5100bb9f-6c11-48e1-abe7-33d3b1bcb829 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Calling method '.version_select at 0x7f06be164ee0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:21.147013 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-5100bb9f-6c11-48e1-abe7-33d3b1bcb829 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] HTTP exception thrown: Snapshot 84eb9eaa-2591-4c3b-9416-395112f020c5 could not be found. Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5100bb9f-6c11-48e1-abe7-33d3b1bcb829 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Request method failure captured: Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5 HTTP/1.1 Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14DXgFODeatJ_oLuLmOSf_OAFvCQhxAnQ6zIJyCckAPu2cxjIm5FGXWGoruSeVklgiw02i6STIK6pIj11NrLLikJwic5Y0X2o3jkRFd7aWnWDLw0sQbQ-BlmG1Q9MG2v00vUykgMp4-l-s5VnF30IQfnRBqTnXetTwJCn1wnpCb12DY Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: b819ada6d595497a8f3704c039f5c66f Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1340303188 Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:13:21.196539 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:13:21.198307 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b819ada6d595497a8f3704c039f5c66f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b819ada6d595497a8f3704c039f5c66f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b819ada6d595497a8f3704c039f5c66f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b819ada6d595497a8f3704c039f5c66f"}]}] Jul 20 04:13:21.198307 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1340303188 Jul 20 04:13:21.198307 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: b819ada6d595497a8f3704c039f5c66f Jul 20 04:13:21.198307 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1340303188 Jul 20 04:13:21.198307 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-VolumesSnapshotsTestJSON-1340303188-project Jul 20 04:13:21.198307 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:13:21.198307 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:13:21.198307 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 8c37bebdc416440cbc02801ac0b3066a Jul 20 04:13:21.198307 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1340303188-project Jul 20 04:13:21.198307 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:13:21.198307 n-d-826526-5 devstack@n-api.service[127870]: exception: Snapshot 84eb9eaa-2591-4c3b-9416-395112f020c5 could not be found. Jul 20 04:13:21.198307 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '84eb9eaa-2591-4c3b-9416-395112f020c5'} Jul 20 04:13:21.198307 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:21.199411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:21.199411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 04:13:21.199411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 04:13:21.199411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 04:13:21.199411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 04:13:21.199411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 04:13:21.199411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 04:13:21.199411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:13:21.199411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:13:21.199411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:13:21.199411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:13:21.199411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:13:21.199411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:13:21.199411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:13:21.199411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:13:21.199411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 84eb9eaa-2591-4c3b-9416-395112f020c5 could not be found. (HTTP 404) (Request-ID: req-4bf5da25-41fa-448e-ba11-47054a0029e5) Jul 20 04:13:21.199411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:21.199411 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:13:21.201023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 84eb9eaa-2591-4c3b-9416-395112f020c5 could not be found. Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 20 04:13:21.202848 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:21.204744 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 84eb9eaa-2591-4c3b-9416-395112f020c5 could not be found. Jul 20 04:13:21.204744 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:21.204744 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:21.204744 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:21.204744 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:21.204744 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:21.204744 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:21.204744 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:21.204744 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:21.204744 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 84eb9eaa-2591-4c3b-9416-395112f020c5 could not be found. Jul 20 04:13:21.204744 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:21.204744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5100bb9f-6c11-48e1-abe7-33d3b1bcb829 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Returning 404 to user: Snapshot 84eb9eaa-2591-4c3b-9416-395112f020c5 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:21.204744 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5100bb9f-6c11-48e1-abe7-33d3b1bcb829 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5" status: 404 len: 111 microversion: 2.1 time: 0.105131 Jul 20 04:13:21.205857 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 513/1148] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 04:13:21 2022] GET /compute/v2.1/os-snapshots/84eb9eaa-2591-4c3b-9416-395112f020c5 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:21.207665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b8e41a82-1a62-495b-89eb-43aa3379d2ea tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Calling method '.version_select at 0x7f06be14a940>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:21.231639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d695875c-4a95-4470-a0e2-efd7ded1335c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:21.245684 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d695875c-4a95-4470-a0e2-efd7ded1335c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620" status: 200 len: 1317 microversion: 2.1 time: 0.304623 Jul 20 04:13:21.246356 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 636/1149] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:20 2022] GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:21.425820 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b8e41a82-1a62-495b-89eb-43aa3379d2ea tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114" status: 202 len: 0 microversion: 2.1 time: 0.222315 Jul 20 04:13:21.427655 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 514/1150] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 04:13:21 2022] DELETE /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:13:21.435130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-097c93eb-187a-4ae3-89b3-48929d09082e tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Calling method '.version_select at 0x7f06bdf74940>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:21.537502 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-097c93eb-187a-4ae3-89b3-48929d09082e tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114" status: 200 len: 345 microversion: 2.1 time: 0.106660 Jul 20 04:13:21.538146 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 637/1151] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:13:21 2022] GET /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114 => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:22.109845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-85296620-7e8e-4f15-b471-28d02ef9eedf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:22.111001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-85296620-7e8e-4f15-b471-28d02ef9eedf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:22.127437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85296620-7e8e-4f15-b471-28d02ef9eedf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.129419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85296620-7e8e-4f15-b471-28d02ef9eedf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.130407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85296620-7e8e-4f15-b471-28d02ef9eedf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.131335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85296620-7e8e-4f15-b471-28d02ef9eedf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.255997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-44856a54-1d68-4264-8e94-6faf075844fe req-ebc3bd00-b489-4011-bcde-cfd6eeb3c3bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96067d54-1e58-49cf-b7e9-7fbc5c86df79", "tag": "9f32aa7e-a422-4132-a2e3-e55d9f1c8cdb"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:22.277180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-44856a54-1d68-4264-8e94-6faf075844fe req-ebc3bd00-b489-4011-bcde-cfd6eeb3c3bc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.279481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-44856a54-1d68-4264-8e94-6faf075844fe req-ebc3bd00-b489-4011-bcde-cfd6eeb3c3bc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.298575 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-44856a54-1d68-4264-8e94-6faf075844fe req-ebc3bd00-b489-4011-bcde-cfd6eeb3c3bc service nova] Creating event network-changed:9f32aa7e-a422-4132-a2e3-e55d9f1c8cdb for instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 on n-h2-826526-5 Jul 20 04:13:22.304157 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-44856a54-1d68-4264-8e94-6faf075844fe req-ebc3bd00-b489-4011-bcde-cfd6eeb3c3bc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053114 Jul 20 04:13:22.305660 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 638/1152] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:22.313101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-faa483c9-ba2f-495c-901f-5552b4b9c8b7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:22.314065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-faa483c9-ba2f-495c-901f-5552b4b9c8b7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:22.330683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-faa483c9-ba2f-495c-901f-5552b4b9c8b7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.331416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-faa483c9-ba2f-495c-901f-5552b4b9c8b7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.332444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-faa483c9-ba2f-495c-901f-5552b4b9c8b7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.333098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-faa483c9-ba2f-495c-901f-5552b4b9c8b7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.572815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-85296620-7e8e-4f15-b471-28d02ef9eedf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:22.583967 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-85296620-7e8e-4f15-b471-28d02ef9eedf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1313 microversion: 2.1 time: 0.479155 Jul 20 04:13:22.596035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-faa483c9-ba2f-495c-901f-5552b4b9c8b7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:22.598777 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 515/1153] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:22 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:22.604363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e34cd1d3-1f2a-47dd-9c58-41dc11617820 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Calling method '.version_select at 0x7f06be153160>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:22.614004 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-faa483c9-ba2f-495c-901f-5552b4b9c8b7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620" status: 200 len: 1317 microversion: 2.1 time: 0.306750 Jul 20 04:13:22.619197 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 639/1154] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:22 2022] GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:22.667938 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e34cd1d3-1f2a-47dd-9c58-41dc11617820 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114" status: 200 len: 345 microversion: 2.1 time: 0.067697 Jul 20 04:13:22.668560 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 516/1155] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:13:22 2022] GET /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:23.615516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-069bc9e4-2d99-48dc-9dca-d6cb4c2ab475 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:23.617135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-069bc9e4-2d99-48dc-9dca-d6cb4c2ab475 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:23.636320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-23afd4d5-8373-45bd-ad1d-873786a42267 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:23.637974 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-23afd4d5-8373-45bd-ad1d-873786a42267 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:23.642992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-069bc9e4-2d99-48dc-9dca-d6cb4c2ab475 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:23.647549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-069bc9e4-2d99-48dc-9dca-d6cb4c2ab475 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:23.648840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-069bc9e4-2d99-48dc-9dca-d6cb4c2ab475 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:23.649906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-069bc9e4-2d99-48dc-9dca-d6cb4c2ab475 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:23.655778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23afd4d5-8373-45bd-ad1d-873786a42267 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:23.656821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23afd4d5-8373-45bd-ad1d-873786a42267 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:23.657965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23afd4d5-8373-45bd-ad1d-873786a42267 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:23.658645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23afd4d5-8373-45bd-ad1d-873786a42267 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:23.840580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-069bc9e4-2d99-48dc-9dca-d6cb4c2ab475 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:23.850154 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-069bc9e4-2d99-48dc-9dca-d6cb4c2ab475 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1313 microversion: 2.1 time: 0.238397 Jul 20 04:13:23.861195 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 640/1156] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:23 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:23.878018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7bd47af0-bf05-44f7-82b0-8599f951fb2d tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Calling method '.version_select at 0x7f06bdf393a0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:23.909869 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-7bd47af0-bf05-44f7-82b0-8599f951fb2d tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] HTTP exception thrown: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7bd47af0-bf05-44f7-82b0-8599f951fb2d tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Request method failure captured: Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114 HTTP/1.1 Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14DXgFODeatJ_oLuLmOSf_OAFvCQhxAnQ6zIJyCckAPu2cxjIm5FGXWGoruSeVklgiw02i6STIK6pIj11NrLLikJwic5Y0X2o3jkRFd7aWnWDLw0sQbQ-BlmG1Q9MG2v00vUykgMp4-l-s5VnF30IQfnRBqTnXetTwJCn1wnpCb12DY Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b819ada6d595497a8f3704c039f5c66f Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1340303188 Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:13:23.919211 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:13:23.920932 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b819ada6d595497a8f3704c039f5c66f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b819ada6d595497a8f3704c039f5c66f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b819ada6d595497a8f3704c039f5c66f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b819ada6d595497a8f3704c039f5c66f"}]}] Jul 20 04:13:23.920932 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1340303188 Jul 20 04:13:23.920932 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b819ada6d595497a8f3704c039f5c66f Jul 20 04:13:23.920932 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1340303188 Jul 20 04:13:23.920932 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-VolumesSnapshotsTestJSON-1340303188-project Jul 20 04:13:23.920932 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:13:23.920932 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:13:23.920932 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 8c37bebdc416440cbc02801ac0b3066a Jul 20 04:13:23.920932 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1340303188-project Jul 20 04:13:23.920932 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:13:23.920932 n-d-826526-5 devstack@n-api.service[127871]: exception: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. Jul 20 04:13:23.920932 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '1203cb06-ba8a-45aa-a6f1-dc7d848f3114'} Jul 20 04:13:23.920932 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. (HTTP 404) (Request-ID: req-bccef52a-ef55-488c-a0c8-7f78e907efbd) Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:23.921914 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:13:23.924306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 04:13:23.925741 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:23.927353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. Jul 20 04:13:23.927353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:23.927353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:23.927353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:23.927353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:23.927353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:23.927353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:23.927353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:23.927353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:23.927353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. Jul 20 04:13:23.927353 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:23.927353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7bd47af0-bf05-44f7-82b0-8599f951fb2d tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Returning 404 to user: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:23.927353 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7bd47af0-bf05-44f7-82b0-8599f951fb2d tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114" status: 404 len: 109 microversion: 2.1 time: 0.058924 Jul 20 04:13:23.931375 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 641/1157] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:13:23 2022] GET /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:23.935036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-69e92451-d095-404b-8247-954f9ea39a68 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Calling method '.version_select at 0x7f06bdf513a0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:23.980579 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-69e92451-d095-404b-8247-954f9ea39a68 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] HTTP exception thrown: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-69e92451-d095-404b-8247-954f9ea39a68 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Request method failure captured: Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114 HTTP/1.1 Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14DXgFODeatJ_oLuLmOSf_OAFvCQhxAnQ6zIJyCckAPu2cxjIm5FGXWGoruSeVklgiw02i6STIK6pIj11NrLLikJwic5Y0X2o3jkRFd7aWnWDLw0sQbQ-BlmG1Q9MG2v00vUykgMp4-l-s5VnF30IQfnRBqTnXetTwJCn1wnpCb12DY Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b819ada6d595497a8f3704c039f5c66f Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1340303188 Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:13:23.982847 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:13:23.984368 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b819ada6d595497a8f3704c039f5c66f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b819ada6d595497a8f3704c039f5c66f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b819ada6d595497a8f3704c039f5c66f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b819ada6d595497a8f3704c039f5c66f"}]}] Jul 20 04:13:23.984368 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1340303188 Jul 20 04:13:23.984368 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b819ada6d595497a8f3704c039f5c66f Jul 20 04:13:23.984368 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1340303188 Jul 20 04:13:23.984368 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-VolumesSnapshotsTestJSON-1340303188-project Jul 20 04:13:23.984368 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:13:23.984368 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:13:23.984368 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 8c37bebdc416440cbc02801ac0b3066a Jul 20 04:13:23.984368 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1340303188-project Jul 20 04:13:23.984368 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:13:23.984368 n-d-826526-5 devstack@n-api.service[127871]: exception: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. Jul 20 04:13:23.984368 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '1203cb06-ba8a-45aa-a6f1-dc7d848f3114'} Jul 20 04:13:23.984368 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. (HTTP 404) (Request-ID: req-0c376f9e-da49-4362-a77a-41de780718dd) Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:23.985276 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:13:23.986529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 04:13:23.987641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:23.988875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. Jul 20 04:13:23.988875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:23.988875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:23.988875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:23.988875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:23.988875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:23.988875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:23.988875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:23.988875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:23.988875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. Jul 20 04:13:23.988875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:23.988875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-69e92451-d095-404b-8247-954f9ea39a68 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Returning 404 to user: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:23.988875 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-69e92451-d095-404b-8247-954f9ea39a68 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114" status: 404 len: 109 microversion: 2.1 time: 0.058412 Jul 20 04:13:23.989689 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 642/1158] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 04:13:23 2022] DELETE /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:23.998396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f7d091c5-971f-46b8-b360-749941699a03 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Calling method '.version_select at 0x7f06bdf39820>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:24.031718 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-f7d091c5-971f-46b8-b360-749941699a03 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] HTTP exception thrown: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f7d091c5-971f-46b8-b360-749941699a03 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Request method failure captured: Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114 HTTP/1.1 Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14DXgFODeatJ_oLuLmOSf_OAFvCQhxAnQ6zIJyCckAPu2cxjIm5FGXWGoruSeVklgiw02i6STIK6pIj11NrLLikJwic5Y0X2o3jkRFd7aWnWDLw0sQbQ-BlmG1Q9MG2v00vUykgMp4-l-s5VnF30IQfnRBqTnXetTwJCn1wnpCb12DY Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b819ada6d595497a8f3704c039f5c66f Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1340303188 Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:13:24.033736 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:13:24.035288 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b819ada6d595497a8f3704c039f5c66f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b819ada6d595497a8f3704c039f5c66f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b819ada6d595497a8f3704c039f5c66f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b819ada6d595497a8f3704c039f5c66f"}]}] Jul 20 04:13:24.035288 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1340303188 Jul 20 04:13:24.035288 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b819ada6d595497a8f3704c039f5c66f Jul 20 04:13:24.035288 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1340303188 Jul 20 04:13:24.035288 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-VolumesSnapshotsTestJSON-1340303188-project Jul 20 04:13:24.035288 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:13:24.035288 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:13:24.035288 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 8c37bebdc416440cbc02801ac0b3066a Jul 20 04:13:24.035288 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1340303188-project Jul 20 04:13:24.035288 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:13:24.035288 n-d-826526-5 devstack@n-api.service[127871]: exception: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. Jul 20 04:13:24.035288 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '1203cb06-ba8a-45aa-a6f1-dc7d848f3114'} Jul 20 04:13:24.035288 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. (HTTP 404) (Request-ID: req-32679d52-943e-41e7-a8de-dc7c181c59e9) Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:24.036699 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:13:24.038138 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 04:13:24.039515 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:24.040922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. Jul 20 04:13:24.040922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:24.040922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:24.040922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:24.040922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:24.040922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:24.040922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:24.040922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:24.040922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:24.040922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. Jul 20 04:13:24.040922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:24.040922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f7d091c5-971f-46b8-b360-749941699a03 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] Returning 404 to user: Volume 1203cb06-ba8a-45aa-a6f1-dc7d848f3114 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:24.040922 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f7d091c5-971f-46b8-b360-749941699a03 tempest-VolumesSnapshotsTestJSON-1340303188 tempest-VolumesSnapshotsTestJSON-1340303188-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114" status: 404 len: 109 microversion: 2.1 time: 0.041027 Jul 20 04:13:24.040922 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 643/1159] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:13:23 2022] GET /compute/v2.1/os-volumes/1203cb06-ba8a-45aa-a6f1-dc7d848f3114 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:13:24.043520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-23afd4d5-8373-45bd-ad1d-873786a42267 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:24.054279 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-23afd4d5-8373-45bd-ad1d-873786a42267 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620" status: 200 len: 1317 microversion: 2.1 time: 0.422430 Jul 20 04:13:24.088309 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 517/1160] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:23 2022] GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:24.228569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-f8bfd2f8-83b2-4f55-bae9-71cface9ec13 req-7f1ef948-1cbe-4806-86a3-32f5485f95d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26411e5-04e8-4059-8222-e0b1184dc620", "name": "network-vif-plugged", "status": "completed", "tag": "1a6dcd1e-bf04-4ab0-8b28-5bcb96655419"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:24.246350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f8bfd2f8-83b2-4f55-bae9-71cface9ec13 req-7f1ef948-1cbe-4806-86a3-32f5485f95d9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:24.248839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f8bfd2f8-83b2-4f55-bae9-71cface9ec13 req-7f1ef948-1cbe-4806-86a3-32f5485f95d9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:24.272187 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-f8bfd2f8-83b2-4f55-bae9-71cface9ec13 req-7f1ef948-1cbe-4806-86a3-32f5485f95d9 service nova] Creating event network-vif-plugged:1a6dcd1e-bf04-4ab0-8b28-5bcb96655419 for instance e26411e5-04e8-4059-8222-e0b1184dc620 on n-h2-826526-5 Jul 20 04:13:24.287128 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-f8bfd2f8-83b2-4f55-bae9-71cface9ec13 req-7f1ef948-1cbe-4806-86a3-32f5485f95d9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063089 Jul 20 04:13:24.289945 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 644/1161] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:24.869669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-10841c64-7aba-46ea-a7de-bfca5b6435b1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:24.871180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-10841c64-7aba-46ea-a7de-bfca5b6435b1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:24.889677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10841c64-7aba-46ea-a7de-bfca5b6435b1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:24.896704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10841c64-7aba-46ea-a7de-bfca5b6435b1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:24.897858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10841c64-7aba-46ea-a7de-bfca5b6435b1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:24.898467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10841c64-7aba-46ea-a7de-bfca5b6435b1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:25.102972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cc01cdf9-4d9e-4ff7-aeb6-7b496a5c5c81 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:25.102972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cc01cdf9-4d9e-4ff7-aeb6-7b496a5c5c81 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:25.117793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc01cdf9-4d9e-4ff7-aeb6-7b496a5c5c81 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:25.118257 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc01cdf9-4d9e-4ff7-aeb6-7b496a5c5c81 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:25.119717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc01cdf9-4d9e-4ff7-aeb6-7b496a5c5c81 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:25.120168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc01cdf9-4d9e-4ff7-aeb6-7b496a5c5c81 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:25.583513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-10841c64-7aba-46ea-a7de-bfca5b6435b1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:25.602691 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-10841c64-7aba-46ea-a7de-bfca5b6435b1 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1313 microversion: 2.1 time: 0.737446 Jul 20 04:13:25.603314 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 518/1162] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:24 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1313 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:25.714917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cc01cdf9-4d9e-4ff7-aeb6-7b496a5c5c81 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:25.727835 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cc01cdf9-4d9e-4ff7-aeb6-7b496a5c5c81 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620" status: 200 len: 1317 microversion: 2.1 time: 0.632195 Jul 20 04:13:25.737424 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 645/1163] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:25 2022] GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 => generated 1317 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:26.620574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7ceb20e1-4717-4e35-b411-4c541f4ad888 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:26.621944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7ceb20e1-4717-4e35-b411-4c541f4ad888 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:26.631962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ceb20e1-4717-4e35-b411-4c541f4ad888 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:26.632674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ceb20e1-4717-4e35-b411-4c541f4ad888 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:26.633612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ceb20e1-4717-4e35-b411-4c541f4ad888 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:26.634040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ceb20e1-4717-4e35-b411-4c541f4ad888 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:26.745553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-68357618-d96c-4f89-bfb3-54828f087767 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:26.746162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-68357618-d96c-4f89-bfb3-54828f087767 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:26.759653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68357618-d96c-4f89-bfb3-54828f087767 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:26.760405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68357618-d96c-4f89-bfb3-54828f087767 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:26.766244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68357618-d96c-4f89-bfb3-54828f087767 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:26.767101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68357618-d96c-4f89-bfb3-54828f087767 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:26.800091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:26.956682 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7ceb20e1-4717-4e35-b411-4c541f4ad888 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:26.974841 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7ceb20e1-4717-4e35-b411-4c541f4ad888 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1313 microversion: 2.1 time: 0.359440 Jul 20 04:13:26.988164 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 519/1164] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:26 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:27.001745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-19ab0cfd-5b9f-40e5-b82e-d79b461cd61a tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:27.002754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-19ab0cfd-5b9f-40e5-b82e-d79b461cd61a tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:27.014985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19ab0cfd-5b9f-40e5-b82e-d79b461cd61a tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.015773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19ab0cfd-5b9f-40e5-b82e-d79b461cd61a tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.017953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19ab0cfd-5b9f-40e5-b82e-d79b461cd61a tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.055972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19ab0cfd-5b9f-40e5-b82e-d79b461cd61a tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.250456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-68357618-d96c-4f89-bfb3-54828f087767 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:27.259595 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-68357618-d96c-4f89-bfb3-54828f087767 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620" status: 200 len: 1467 microversion: 2.1 time: 0.518017 Jul 20 04:13:27.260180 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 646/1165] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:26 2022] GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 => generated 1467 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:27.275394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e5b7c8ed-3d00-4319-82ba-0af873700a26 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:27.276008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e5b7c8ed-3d00-4319-82ba-0af873700a26 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:27.282182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5b7c8ed-3d00-4319-82ba-0af873700a26 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.282635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5b7c8ed-3d00-4319-82ba-0af873700a26 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.283411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5b7c8ed-3d00-4319-82ba-0af873700a26 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.283852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5b7c8ed-3d00-4319-82ba-0af873700a26 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.300468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=10 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:27.426711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-19ab0cfd-5b9f-40e5-b82e-d79b461cd61a tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'services' on Instance uuid b80122a5-6106-4f62-9d72-5623e8ac0ca7 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:13:27.455271 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-19ab0cfd-5b9f-40e5-b82e-d79b461cd61a tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 2342 microversion: 2.25 time: 0.465416 Jul 20 04:13:27.469367 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 520/1166] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:26 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 2342 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:27.475981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-966c3b37-4eff-4c89-ac1f-58d5e3f151fe tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:27.477666 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:27.477666 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:13:27.479828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-966c3b37-4eff-4c89-ac1f-58d5e3f151fe tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.480514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-966c3b37-4eff-4c89-ac1f-58d5e3f151fe tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.481789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-966c3b37-4eff-4c89-ac1f-58d5e3f151fe tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.482399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-966c3b37-4eff-4c89-ac1f-58d5e3f151fe tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.499717 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e5b7c8ed-3d00-4319-82ba-0af873700a26 tempest-ServersOnMultiNodesTest-1867953388 tempest-ServersOnMultiNodesTest-1867953388-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620" status: 200 len: 1618 microversion: 2.1 time: 0.227625 Jul 20 04:13:27.500748 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 647/1167] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:27 2022] GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 => generated 1618 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:27.517886 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-524d32f6-01e0-4942-b0a1-74d077b71543 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:27.518404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-524d32f6-01e0-4942-b0a1-74d077b71543 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:27.530629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-524d32f6-01e0-4942-b0a1-74d077b71543 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.531083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-524d32f6-01e0-4942-b0a1-74d077b71543 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.531384 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-966c3b37-4eff-4c89-ac1f-58d5e3f151fe tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.060637 Jul 20 04:13:27.532106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-524d32f6-01e0-4942-b0a1-74d077b71543 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.532593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-524d32f6-01e0-4942-b0a1-74d077b71543 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.532948 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 521/1168] 10.222.0.17 () {60 vars in 1216 bytes} [Wed Jul 20 04:13:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:13:27.569029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-524d32f6-01e0-4942-b0a1-74d077b71543 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:27.573125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:27.770009 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-524d32f6-01e0-4942-b0a1-74d077b71543 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620" status: 204 len: 0 microversion: 2.1 time: 0.256166 Jul 20 04:13:27.774294 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 648/1169] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:27 2022] DELETE /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:27.779064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-de235fb9-5093-478d-b489-4fbabb470686 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:27.780618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-de235fb9-5093-478d-b489-4fbabb470686 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:27.797964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de235fb9-5093-478d-b489-4fbabb470686 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.798564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de235fb9-5093-478d-b489-4fbabb470686 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.799490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de235fb9-5093-478d-b489-4fbabb470686 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.799923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de235fb9-5093-478d-b489-4fbabb470686 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.832744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:27.993076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c6970aba-9ab5-474c-947f-24f91deb3e46 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:27.994248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c6970aba-9ab5-474c-947f-24f91deb3e46 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:28.009063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6970aba-9ab5-474c-947f-24f91deb3e46 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:28.013497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6970aba-9ab5-474c-947f-24f91deb3e46 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:28.014497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6970aba-9ab5-474c-947f-24f91deb3e46 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:28.016692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6970aba-9ab5-474c-947f-24f91deb3e46 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:28.329942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c6970aba-9ab5-474c-947f-24f91deb3e46 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:28.344127 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c6970aba-9ab5-474c-947f-24f91deb3e46 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1313 microversion: 2.1 time: 0.355468 Jul 20 04:13:28.355254 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 649/1170] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:27 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:28.465135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-944ba37b-93e7-48c8-b389-4952ac20788d req-bb2a6189-b340-49b6-ab94-d6ae8d5d8d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96067d54-1e58-49cf-b7e9-7fbc5c86df79", "name": "network-vif-plugged", "status": "completed", "tag": "9f32aa7e-a422-4132-a2e3-e55d9f1c8cdb"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:28.477692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-944ba37b-93e7-48c8-b389-4952ac20788d req-bb2a6189-b340-49b6-ab94-d6ae8d5d8d3d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:28.478847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-944ba37b-93e7-48c8-b389-4952ac20788d req-bb2a6189-b340-49b6-ab94-d6ae8d5d8d3d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:28.494027 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-944ba37b-93e7-48c8-b389-4952ac20788d req-bb2a6189-b340-49b6-ab94-d6ae8d5d8d3d service nova] Creating event network-vif-plugged:9f32aa7e-a422-4132-a2e3-e55d9f1c8cdb for instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 on n-h2-826526-5 Jul 20 04:13:28.500223 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-944ba37b-93e7-48c8-b389-4952ac20788d req-bb2a6189-b340-49b6-ab94-d6ae8d5d8d3d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039555 Jul 20 04:13:28.501586 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 650/1171] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:13:28.521608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-de235fb9-5093-478d-b489-4fbabb470686 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:28.549650 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-de235fb9-5093-478d-b489-4fbabb470686 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620" status: 200 len: 1473 microversion: 2.1 time: 0.774615 Jul 20 04:13:28.552338 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 522/1172] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:27 2022] GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 => generated 1473 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:29.365609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e5709cb8-f0e1-43fa-9795-61c13a0be5aa tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:29.369797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e5709cb8-f0e1-43fa-9795-61c13a0be5aa tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:29.397136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5709cb8-f0e1-43fa-9795-61c13a0be5aa tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.397632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5709cb8-f0e1-43fa-9795-61c13a0be5aa tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.399367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5709cb8-f0e1-43fa-9795-61c13a0be5aa tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.399818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5709cb8-f0e1-43fa-9795-61c13a0be5aa tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.482094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d4ab2b23-3494-4a74-a3e3-1b24f580d761 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a46cfb7-cd30-4b40-b074-032ca2686d13", "device": "/dev/xvdb"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:29.484399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d4ab2b23-3494-4a74-a3e3-1b24f580d761 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:29.493980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4ab2b23-3494-4a74-a3e3-1b24f580d761 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.496795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4ab2b23-3494-4a74-a3e3-1b24f580d761 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.498396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4ab2b23-3494-4a74-a3e3-1b24f580d761 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.499001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4ab2b23-3494-4a74-a3e3-1b24f580d761 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.685763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e5709cb8-f0e1-43fa-9795-61c13a0be5aa tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:29.701447 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e5709cb8-f0e1-43fa-9795-61c13a0be5aa tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1313 microversion: 2.1 time: 0.342513 Jul 20 04:13:29.702883 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 651/1173] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:29 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:29.713381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fdefaf3c-7ffd-40c3-86fe-bc39285f874a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:29.715911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fdefaf3c-7ffd-40c3-86fe-bc39285f874a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:29.734621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fdefaf3c-7ffd-40c3-86fe-bc39285f874a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.735357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fdefaf3c-7ffd-40c3-86fe-bc39285f874a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.737944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fdefaf3c-7ffd-40c3-86fe-bc39285f874a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.740151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fdefaf3c-7ffd-40c3-86fe-bc39285f874a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.920327 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d4ab2b23-3494-4a74-a3e3-1b24f580d761 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "POST /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.442574 Jul 20 04:13:29.921506 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 523/1174] 10.222.0.17 () {62 vars in 1363 bytes} [Wed Jul 20 04:13:29 2022] POST /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments => generated 194 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:13:29.995564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fdefaf3c-7ffd-40c3-86fe-bc39285f874a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:30.006125 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fdefaf3c-7ffd-40c3-86fe-bc39285f874a tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620" status: 200 len: 1473 microversion: 2.1 time: 0.302030 Jul 20 04:13:30.006952 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 652/1175] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:29 2022] GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 => generated 1473 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:30.151618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-4b27b05d-ebb8-4a6a-9dec-7d55db7b6e5b req-96176de1-276a-4921-9fab-ec9cd19b3e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26411e5-04e8-4059-8222-e0b1184dc620", "name": "network-vif-deleted", "tag": "1a6dcd1e-bf04-4ab0-8b28-5bcb96655419"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:30.194538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4b27b05d-ebb8-4a6a-9dec-7d55db7b6e5b req-96176de1-276a-4921-9fab-ec9cd19b3e7f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:30.195096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4b27b05d-ebb8-4a6a-9dec-7d55db7b6e5b req-96176de1-276a-4921-9fab-ec9cd19b3e7f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:30.255300 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-4b27b05d-ebb8-4a6a-9dec-7d55db7b6e5b req-96176de1-276a-4921-9fab-ec9cd19b3e7f service nova] Creating event network-vif-deleted:1a6dcd1e-bf04-4ab0-8b28-5bcb96655419 for instance e26411e5-04e8-4059-8222-e0b1184dc620 on n-h2-826526-5 Jul 20 04:13:30.275036 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-4b27b05d-ebb8-4a6a-9dec-7d55db7b6e5b req-96176de1-276a-4921-9fab-ec9cd19b3e7f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133348 Jul 20 04:13:30.276322 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 524/1176] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:13:30.719518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9d1e1a07-f1ea-4c60-8858-9ac13ec1813c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:30.720826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9d1e1a07-f1ea-4c60-8858-9ac13ec1813c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:30.740965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d1e1a07-f1ea-4c60-8858-9ac13ec1813c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:30.741681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d1e1a07-f1ea-4c60-8858-9ac13ec1813c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:30.751507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d1e1a07-f1ea-4c60-8858-9ac13ec1813c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:30.752878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d1e1a07-f1ea-4c60-8858-9ac13ec1813c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.030794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-58fe00e1-9472-4b92-9ad6-1efe97b84c42 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:31.032459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-58fe00e1-9472-4b92-9ad6-1efe97b84c42 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: e26411e5-04e8-4059-8222-e0b1184dc620] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:31.059251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58fe00e1-9472-4b92-9ad6-1efe97b84c42 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.062720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58fe00e1-9472-4b92-9ad6-1efe97b84c42 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.064665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58fe00e1-9472-4b92-9ad6-1efe97b84c42 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.065278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58fe00e1-9472-4b92-9ad6-1efe97b84c42 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.110528 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-58fe00e1-9472-4b92-9ad6-1efe97b84c42 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] HTTP exception thrown: Instance e26411e5-04e8-4059-8222-e0b1184dc620 could not be found. Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-58fe00e1-9472-4b92-9ad6-1efe97b84c42 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Request method failure captured: Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 HTTP/1.1 Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14BYbIK69M9QpF--D95_1lTfRhnOuUdrNuf9ZGtS89PqLQE-ZpPsyevyV1J9PJ8fPkoxBjYpBD8ByKkWxfuU1DumzfqxVkNaMTwcjvGwsZWcAcQn-nN4PcnNEry3n6H2h9IuXiyBTWbGinbzMBZy_R-YCwAPdD1fsjbZp2vLGyR86Eg Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 22bcfd2698d047dea07c643970c749eb Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:13:31.116480 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:13:31.117772 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/22bcfd2698d047dea07c643970c749eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/22bcfd2698d047dea07c643970c749eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_22bcfd2698d047dea07c643970c749eb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/22bcfd2698d047dea07c643970c749eb"}]}] Jul 20 04:13:31.117772 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:31.117772 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 22bcfd2698d047dea07c643970c749eb Jul 20 04:13:31.117772 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:31.117772 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersOnMultiNodesTest-1348686041-project Jul 20 04:13:31.117772 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:13:31.117772 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:13:31.117772 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 5e178243e1ed404092e5ea0be39d5c16 Jul 20 04:13:31.117772 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersOnMultiNodesTest-1348686041-project Jul 20 04:13:31.117772 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:13:31.117772 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance e26411e5-04e8-4059-8222-e0b1184dc620 could not be found. Jul 20 04:13:31.117772 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'e26411e5-04e8-4059-8222-e0b1184dc620'} Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e26411e5-04e8-4059-8222-e0b1184dc620 could not be found. Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:31.118504 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:31.119679 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:31.119679 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:31.119679 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:31.119679 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:31.119679 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:31.119679 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:31.119679 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:31.119679 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e26411e5-04e8-4059-8222-e0b1184dc620 could not be found. Jul 20 04:13:31.119679 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:31.119679 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:31.119679 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:31.119679 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:31.119679 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:31.119679 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:31.119679 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:31.119679 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:31.119679 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e26411e5-04e8-4059-8222-e0b1184dc620 could not be found. Jul 20 04:13:31.119679 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:31.120846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-58fe00e1-9472-4b92-9ad6-1efe97b84c42 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Returning 404 to user: Instance e26411e5-04e8-4059-8222-e0b1184dc620 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:31.120846 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-58fe00e1-9472-4b92-9ad6-1efe97b84c42 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620" status: 404 len: 111 microversion: 2.1 time: 0.097068 Jul 20 04:13:31.124381 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 525/1177] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:31 2022] GET /compute/v2.1/servers/e26411e5-04e8-4059-8222-e0b1184dc620 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:31.134586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-96e6951d-6fe1-42ff-93ba-0bcdaab2e5e5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:31.137069 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-96e6951d-6fe1-42ff-93ba-0bcdaab2e5e5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:31.155640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96e6951d-6fe1-42ff-93ba-0bcdaab2e5e5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.156092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96e6951d-6fe1-42ff-93ba-0bcdaab2e5e5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.160059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96e6951d-6fe1-42ff-93ba-0bcdaab2e5e5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.160745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96e6951d-6fe1-42ff-93ba-0bcdaab2e5e5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.253949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-96e6951d-6fe1-42ff-93ba-0bcdaab2e5e5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:31.293080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9d1e1a07-f1ea-4c60-8858-9ac13ec1813c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:31.301142 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9d1e1a07-f1ea-4c60-8858-9ac13ec1813c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1463 microversion: 2.1 time: 0.585865 Jul 20 04:13:31.317488 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 653/1178] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:30 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1463 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:31.322931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c3bd7280-280d-467c-b58f-8cc3e5804b9a tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:31.324871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c3bd7280-280d-467c-b58f-8cc3e5804b9a tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:31.342532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3bd7280-280d-467c-b58f-8cc3e5804b9a tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.347840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3bd7280-280d-467c-b58f-8cc3e5804b9a tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.352908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3bd7280-280d-467c-b58f-8cc3e5804b9a tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.353388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3bd7280-280d-467c-b58f-8cc3e5804b9a tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.420716 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-96e6951d-6fe1-42ff-93ba-0bcdaab2e5e5 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "DELETE /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a" status: 204 len: 0 microversion: 2.1 time: 0.294874 Jul 20 04:13:31.421600 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 526/1179] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:31 2022] DELETE /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:31.433580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0085e7ee-d8c5-41f0-8083-5eec9068dac2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:31.434405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0085e7ee-d8c5-41f0-8083-5eec9068dac2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:31.444985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0085e7ee-d8c5-41f0-8083-5eec9068dac2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.445730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0085e7ee-d8c5-41f0-8083-5eec9068dac2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.446664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0085e7ee-d8c5-41f0-8083-5eec9068dac2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.447259 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0085e7ee-d8c5-41f0-8083-5eec9068dac2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.687298 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c3bd7280-280d-467c-b58f-8cc3e5804b9a tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1614 microversion: 2.1 time: 0.368391 Jul 20 04:13:31.701388 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 654/1180] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:31 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1614 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:31.702211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0085e7ee-d8c5-41f0-8083-5eec9068dac2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:31.709214 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0085e7ee-d8c5-41f0-8083-5eec9068dac2 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a" status: 200 len: 1472 microversion: 2.1 time: 0.282629 Jul 20 04:13:31.713000 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 527/1181] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:31 2022] GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a => generated 1472 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:31.713324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6218cd4a-d94e-45b4-9bff-6212027bab98 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:31.713994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6218cd4a-d94e-45b4-9bff-6212027bab98 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:31.720443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:31.722576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6218cd4a-d94e-45b4-9bff-6212027bab98 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.723058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6218cd4a-d94e-45b4-9bff-6212027bab98 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.724030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6218cd4a-d94e-45b4-9bff-6212027bab98 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.724768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6218cd4a-d94e-45b4-9bff-6212027bab98 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.813759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6218cd4a-d94e-45b4-9bff-6212027bab98 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '28c19f2964444c4783b18ae6023226d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f352c241604ee79fc6830c89403173', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:31.814551 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6218cd4a-d94e-45b4-9bff-6212027bab98 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] flavor_id is None. Assuming migration. {{(pid=127871) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 04:13:31.815346 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6218cd4a-d94e-45b4-9bff-6212027bab98 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127871) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:13:32.721905 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6218cd4a-d94e-45b4-9bff-6212027bab98 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79/action" status: 202 len: 0 microversion: 2.1 time: 1.016061 Jul 20 04:13:32.733192 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 655/1182] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:13:31 2022] POST /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79/action => generated 0 bytes in 1028 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:32.745542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-824f037c-1cfd-44a0-8134-f214ab4b318c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:32.747974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-824f037c-1cfd-44a0-8134-f214ab4b318c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:32.767063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-824f037c-1cfd-44a0-8134-f214ab4b318c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:32.767512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-824f037c-1cfd-44a0-8134-f214ab4b318c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:32.768579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-824f037c-1cfd-44a0-8134-f214ab4b318c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:32.769839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-824f037c-1cfd-44a0-8134-f214ab4b318c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:33.000489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-824f037c-1cfd-44a0-8134-f214ab4b318c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:33.009359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0641e58a-5dc0-48c7-8c3b-533976a34864 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.011156 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-824f037c-1cfd-44a0-8134-f214ab4b318c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a" status: 200 len: 1472 microversion: 2.1 time: 0.275597 Jul 20 04:13:33.012036 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 656/1183] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:32 2022] GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a => generated 1472 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:33.017448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0d22bd75-429a-47b8-9973-10ef300bafa0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.018426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0d22bd75-429a-47b8-9973-10ef300bafa0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:33.028067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d22bd75-429a-47b8-9973-10ef300bafa0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:33.029433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d22bd75-429a-47b8-9973-10ef300bafa0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:33.030688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d22bd75-429a-47b8-9973-10ef300bafa0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:33.031487 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d22bd75-429a-47b8-9973-10ef300bafa0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:33.036872 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0641e58a-5dc0-48c7-8c3b-533976a34864 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.324856 Jul 20 04:13:33.049233 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 528/1184] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:13:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:13:33.055979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-17b70efe-a029-4ddc-9576-ec9629333f93 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.080481 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-17b70efe-a029-4ddc-9576-ec9629333f93 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.029626 Jul 20 04:13:33.082017 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 529/1185] 10.222.0.17 () {58 vars in 1124 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:33.095520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4bd01a1d-1ced-40ef-91e7-0d206e97eb88 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.106280 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4bd01a1d-1ced-40ef-91e7-0d206e97eb88 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014712 Jul 20 04:13:33.127950 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 530/1186] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:13:33.133645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-15d72a63-6f38-4174-912b-d97b0290d8f3 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.158291 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-15d72a63-6f38-4174-912b-d97b0290d8f3 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028473 Jul 20 04:13:33.164641 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 531/1187] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:33.182073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f33720ae-0206-4fbf-a9cd-78cf59915f2d tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.261029 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f33720ae-0206-4fbf-a9cd-78cf59915f2d tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.088448 Jul 20 04:13:33.272961 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 532/1188] 10.222.0.17 () {58 vars in 1164 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:33.280628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d1ffb766-d1ae-4844-ac3d-845d69d3f98d tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.290508 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d1ffb766-d1ae-4844-ac3d-845d69d3f98d tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014017 Jul 20 04:13:33.297560 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 533/1189] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:33.303912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d7c3db56-eb69-40de-a94f-b133701f1e27 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.369185 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d7c3db56-eb69-40de-a94f-b133701f1e27 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.070304 Jul 20 04:13:33.381956 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 534/1190] 10.222.0.17 () {58 vars in 1168 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:33.394893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3c8e3082-e32c-490a-9261-629d9364e1a6 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.432158 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3c8e3082-e32c-490a-9261-629d9364e1a6 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.047639 Jul 20 04:13:33.433730 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 535/1191] 10.222.0.17 () {58 vars in 1160 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:33.447038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e38924d6-8d1e-4c6a-b226-59389047620c tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.469915 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e38924d6-8d1e-4c6a-b226-59389047620c tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026723 Jul 20 04:13:33.474171 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 536/1192] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:33.495969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a9c20d06-ab0a-453c-95a7-3cf5313c2cdb tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.562397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:33.571786 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a9c20d06-ab0a-453c-95a7-3cf5313c2cdb tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.090283 Jul 20 04:13:33.575353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0d22bd75-429a-47b8-9973-10ef300bafa0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:33.585386 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 537/1193] 10.222.0.17 () {58 vars in 1166 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:33.587577 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0d22bd75-429a-47b8-9973-10ef300bafa0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1472 microversion: 2.1 time: 0.573316 Jul 20 04:13:33.588174 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 657/1194] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1472 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:33.594087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-182c0d66-b0fc-4d78-87dc-5cf507a05d82 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.607370 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-182c0d66-b0fc-4d78-87dc-5cf507a05d82 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020264 Jul 20 04:13:33.614153 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 538/1195] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:33.619522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-28c4929b-258d-4bb5-8385-c83000bd8b5c tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.655777 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-28c4929b-258d-4bb5-8385-c83000bd8b5c tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.040370 Jul 20 04:13:33.656799 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 658/1196] 10.222.0.17 () {58 vars in 1143 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:33.671171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-65827755-d39b-49cd-a687-df33ceb6b20f tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.681271 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-65827755-d39b-49cd-a687-df33ceb6b20f tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015771 Jul 20 04:13:33.682938 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 539/1197] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:33.693057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3139a4e5-d499-448e-a4a0-867ed9f41fc4 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.736230 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3139a4e5-d499-448e-a4a0-867ed9f41fc4 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.045184 Jul 20 04:13:33.749544 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 659/1198] 10.222.0.17 () {58 vars in 1147 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:33.755486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a860e0d3-1788-439d-9e22-f55b1776ef8d tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.786007 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a860e0d3-1788-439d-9e22-f55b1776ef8d tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.035011 Jul 20 04:13:33.786616 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 540/1199] 10.222.0.17 () {58 vars in 1139 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:33.804958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2c3bb420-ee48-4d78-8f18-3f2b8cbdf9bd tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.826349 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2c3bb420-ee48-4d78-8f18-3f2b8cbdf9bd tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026984 Jul 20 04:13:33.833953 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 660/1200] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:33.842894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6a9917d3-3725-4b50-8327-ddb2a543d037 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.887889 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6a9917d3-3725-4b50-8327-ddb2a543d037 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.051580 Jul 20 04:13:33.888574 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 541/1201] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:33.905401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d02a6a96-73b5-44c7-ae73-c3299641924a tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.951127 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d02a6a96-73b5-44c7-ae73-c3299641924a tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054447 Jul 20 04:13:33.954481 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 661/1202] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:33.968002 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ff2bec4a-7e8b-46a7-a62e-4c7a44bed141 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.982734 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ff2bec4a-7e8b-46a7-a62e-4c7a44bed141 tempest-FlavorsV2TestJSON-519438394 tempest-FlavorsV2TestJSON-519438394-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019055 Jul 20 04:13:33.983331 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 542/1203] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:34.029833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-425f4d5c-c8ed-437b-9424-4b26c34030a7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:34.030463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-425f4d5c-c8ed-437b-9424-4b26c34030a7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:34.043656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-425f4d5c-c8ed-437b-9424-4b26c34030a7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.044210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-425f4d5c-c8ed-437b-9424-4b26c34030a7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:34.045059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-425f4d5c-c8ed-437b-9424-4b26c34030a7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.048623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-425f4d5c-c8ed-437b-9424-4b26c34030a7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:34.394483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-d5173d9f-a83f-411b-ab60-80228f44836b req-d43e3d05-a78c-4ab5-833f-3061afbce8bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "089704fa-0301-45a0-a4d8-3adbc8835f2a", "name": "network-vif-deleted", "tag": "0dc711ee-fc2f-40cc-a206-2a3b853708f8"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:34.403133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-425f4d5c-c8ed-437b-9424-4b26c34030a7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:34.411319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d5173d9f-a83f-411b-ab60-80228f44836b req-d43e3d05-a78c-4ab5-833f-3061afbce8bf service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.420432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d5173d9f-a83f-411b-ab60-80228f44836b req-d43e3d05-a78c-4ab5-833f-3061afbce8bf service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:34.442971 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-d5173d9f-a83f-411b-ab60-80228f44836b req-d43e3d05-a78c-4ab5-833f-3061afbce8bf service nova] Creating event network-vif-deleted:0dc711ee-fc2f-40cc-a206-2a3b853708f8 for instance 089704fa-0301-45a0-a4d8-3adbc8835f2a on n-h1-826526-5 Jul 20 04:13:34.457965 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-d5173d9f-a83f-411b-ab60-80228f44836b req-d43e3d05-a78c-4ab5-833f-3061afbce8bf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067268 Jul 20 04:13:34.463213 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 543/1204] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:34.464790 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-425f4d5c-c8ed-437b-9424-4b26c34030a7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a" status: 200 len: 1430 microversion: 2.1 time: 0.440654 Jul 20 04:13:34.465452 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 662/1205] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:34 2022] GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a => generated 1430 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:34.605237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b04bcdf5-6663-44b6-9347-e9f010190b2d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:34.606955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b04bcdf5-6663-44b6-9347-e9f010190b2d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:34.638407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b04bcdf5-6663-44b6-9347-e9f010190b2d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.639395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b04bcdf5-6663-44b6-9347-e9f010190b2d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:34.640542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b04bcdf5-6663-44b6-9347-e9f010190b2d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.642495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b04bcdf5-6663-44b6-9347-e9f010190b2d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.007235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b04bcdf5-6663-44b6-9347-e9f010190b2d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:35.027325 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b04bcdf5-6663-44b6-9347-e9f010190b2d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1472 microversion: 2.1 time: 0.424817 Jul 20 04:13:35.030111 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 544/1206] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:34 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1472 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:35.485721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c0846db1-edf7-47ea-8a38-0a952a564066 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:35.486870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c0846db1-edf7-47ea-8a38-0a952a564066 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 089704fa-0301-45a0-a4d8-3adbc8835f2a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:35.511491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c0846db1-edf7-47ea-8a38-0a952a564066 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.515163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c0846db1-edf7-47ea-8a38-0a952a564066 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.516202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c0846db1-edf7-47ea-8a38-0a952a564066 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.517577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c0846db1-edf7-47ea-8a38-0a952a564066 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.547953 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-c0846db1-edf7-47ea-8a38-0a952a564066 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] HTTP exception thrown: Instance 089704fa-0301-45a0-a4d8-3adbc8835f2a could not be found. Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c0846db1-edf7-47ea-8a38-0a952a564066 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Request method failure captured: Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a HTTP/1.1 Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14BYbIK69M9QpF--D95_1lTfRhnOuUdrNuf9ZGtS89PqLQE-ZpPsyevyV1J9PJ8fPkoxBjYpBD8ByKkWxfuU1DumzfqxVkNaMTwcjvGwsZWcAcQn-nN4PcnNEry3n6H2h9IuXiyBTWbGinbzMBZy_R-YCwAPdD1fsjbZp2vLGyR86Eg Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 22bcfd2698d047dea07c643970c749eb Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:13:35.549692 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:13:35.551350 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/22bcfd2698d047dea07c643970c749eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/22bcfd2698d047dea07c643970c749eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_22bcfd2698d047dea07c643970c749eb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/22bcfd2698d047dea07c643970c749eb"}]}] Jul 20 04:13:35.551350 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:35.551350 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 22bcfd2698d047dea07c643970c749eb Jul 20 04:13:35.551350 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:35.551350 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersOnMultiNodesTest-1348686041-project Jul 20 04:13:35.551350 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:13:35.551350 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:13:35.551350 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 5e178243e1ed404092e5ea0be39d5c16 Jul 20 04:13:35.551350 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersOnMultiNodesTest-1348686041-project Jul 20 04:13:35.551350 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:13:35.551350 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 089704fa-0301-45a0-a4d8-3adbc8835f2a could not be found. Jul 20 04:13:35.551350 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '089704fa-0301-45a0-a4d8-3adbc8835f2a'} Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 089704fa-0301-45a0-a4d8-3adbc8835f2a could not be found. Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:35.552326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:35.554055 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:35.554055 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:35.554055 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:35.554055 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:35.554055 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:35.554055 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:35.554055 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:35.554055 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 089704fa-0301-45a0-a4d8-3adbc8835f2a could not be found. Jul 20 04:13:35.554055 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:35.554055 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:35.554055 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:35.554055 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:35.554055 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:35.554055 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:35.554055 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:35.554055 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:35.554055 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 089704fa-0301-45a0-a4d8-3adbc8835f2a could not be found. Jul 20 04:13:35.554055 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:35.556378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c0846db1-edf7-47ea-8a38-0a952a564066 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Returning 404 to user: Instance 089704fa-0301-45a0-a4d8-3adbc8835f2a could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:35.556378 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c0846db1-edf7-47ea-8a38-0a952a564066 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a" status: 404 len: 111 microversion: 2.1 time: 0.073290 Jul 20 04:13:35.559793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-61af4c53-0b81-4974-b4f3-0719b5baab19 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:35.560844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-61af4c53-0b81-4974-b4f3-0719b5baab19 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:35.567393 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 663/1207] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:35 2022] GET /compute/v2.1/servers/089704fa-0301-45a0-a4d8-3adbc8835f2a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:35.572247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61af4c53-0b81-4974-b4f3-0719b5baab19 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.572923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61af4c53-0b81-4974-b4f3-0719b5baab19 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.575955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61af4c53-0b81-4974-b4f3-0719b5baab19 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.576873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61af4c53-0b81-4974-b4f3-0719b5baab19 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.647924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-61af4c53-0b81-4974-b4f3-0719b5baab19 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:35.798012 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-61af4c53-0b81-4974-b4f3-0719b5baab19 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 204 len: 0 microversion: 2.1 time: 0.241706 Jul 20 04:13:35.798703 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 545/1208] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:35 2022] DELETE /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:13:35.806771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3cb2817e-68ba-46f9-8a1b-feabef512fe0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:35.807607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3cb2817e-68ba-46f9-8a1b-feabef512fe0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:35.814668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3cb2817e-68ba-46f9-8a1b-feabef512fe0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.816686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3cb2817e-68ba-46f9-8a1b-feabef512fe0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.821329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3cb2817e-68ba-46f9-8a1b-feabef512fe0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.821980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3cb2817e-68ba-46f9-8a1b-feabef512fe0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:36.047748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7fbeb015-9628-4257-a885-d1eec536d0ec tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:36.048671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7fbeb015-9628-4257-a885-d1eec536d0ec tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:36.064478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fbeb015-9628-4257-a885-d1eec536d0ec tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:36.066987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fbeb015-9628-4257-a885-d1eec536d0ec tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:36.067928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fbeb015-9628-4257-a885-d1eec536d0ec tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:36.069415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fbeb015-9628-4257-a885-d1eec536d0ec tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:36.105880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3cb2817e-68ba-46f9-8a1b-feabef512fe0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:36.119359 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3cb2817e-68ba-46f9-8a1b-feabef512fe0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 200 len: 1473 microversion: 2.1 time: 0.316328 Jul 20 04:13:36.135527 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 664/1209] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:35 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 1473 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:36.488055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7fbeb015-9628-4257-a885-d1eec536d0ec tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:36.496233 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7fbeb015-9628-4257-a885-d1eec536d0ec tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1472 microversion: 2.1 time: 0.452764 Jul 20 04:13:36.497216 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 546/1210] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:36 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1472 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:37.146018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9fe8ec54-558c-4dcf-adbf-0f2f54a386f1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:37.147221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9fe8ec54-558c-4dcf-adbf-0f2f54a386f1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:37.159774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fe8ec54-558c-4dcf-adbf-0f2f54a386f1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:37.162270 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fe8ec54-558c-4dcf-adbf-0f2f54a386f1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:37.164466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fe8ec54-558c-4dcf-adbf-0f2f54a386f1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:37.165189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fe8ec54-558c-4dcf-adbf-0f2f54a386f1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:37.514536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-17bc8097-d060-4ad5-a240-1b046e3df121 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:37.515120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9fe8ec54-558c-4dcf-adbf-0f2f54a386f1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:37.515258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-17bc8097-d060-4ad5-a240-1b046e3df121 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:37.524607 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9fe8ec54-558c-4dcf-adbf-0f2f54a386f1 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 200 len: 1473 microversion: 2.1 time: 0.384878 Jul 20 04:13:37.525186 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 665/1211] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:37 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 1473 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:37.536299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:37.545718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17bc8097-d060-4ad5-a240-1b046e3df121 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:37.546194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17bc8097-d060-4ad5-a240-1b046e3df121 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:37.547973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17bc8097-d060-4ad5-a240-1b046e3df121 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:37.557649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17bc8097-d060-4ad5-a240-1b046e3df121 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:37.811744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-17bc8097-d060-4ad5-a240-1b046e3df121 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:37.824670 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-17bc8097-d060-4ad5-a240-1b046e3df121 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1472 microversion: 2.1 time: 0.310714 Jul 20 04:13:37.835228 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 547/1212] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:37 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1472 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:38.490033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-300123d4-b263-46df-bd8e-af9a76b560d0 req-7fd04b5f-7479-4786-b234-1a81820da55b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ea57023-555a-427d-85a3-e83ea85f6da1", "name": "network-vif-deleted", "tag": "5f0b9cd6-bdaa-46d6-b2aa-077e8de38b53"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:38.526923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-300123d4-b263-46df-bd8e-af9a76b560d0 req-7fd04b5f-7479-4786-b234-1a81820da55b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:38.535613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-300123d4-b263-46df-bd8e-af9a76b560d0 req-7fd04b5f-7479-4786-b234-1a81820da55b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:38.542246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf333a82-2a22-4c23-a629-acd6bdff44cc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:38.543358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf333a82-2a22-4c23-a629-acd6bdff44cc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:38.559784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf333a82-2a22-4c23-a629-acd6bdff44cc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:38.561454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf333a82-2a22-4c23-a629-acd6bdff44cc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:38.564099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf333a82-2a22-4c23-a629-acd6bdff44cc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:38.564576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf333a82-2a22-4c23-a629-acd6bdff44cc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:38.576841 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-300123d4-b263-46df-bd8e-af9a76b560d0 req-7fd04b5f-7479-4786-b234-1a81820da55b service nova] Creating event network-vif-deleted:5f0b9cd6-bdaa-46d6-b2aa-077e8de38b53 for instance 6ea57023-555a-427d-85a3-e83ea85f6da1 on n-h1-826526-5 Jul 20 04:13:38.586507 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-300123d4-b263-46df-bd8e-af9a76b560d0 req-7fd04b5f-7479-4786-b234-1a81820da55b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100795 Jul 20 04:13:38.589544 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 666/1213] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:38.784809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bf333a82-2a22-4c23-a629-acd6bdff44cc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:38.804717 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf333a82-2a22-4c23-a629-acd6bdff44cc tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 200 len: 1302 microversion: 2.1 time: 0.266906 Jul 20 04:13:38.808093 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 548/1214] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:38 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 1302 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:38.842989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e886f584-3f70-4828-850c-ac7699405cad tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:38.843688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e886f584-3f70-4828-850c-ac7699405cad tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:38.876458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e886f584-3f70-4828-850c-ac7699405cad tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:38.876877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e886f584-3f70-4828-850c-ac7699405cad tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:38.889452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e886f584-3f70-4828-850c-ac7699405cad tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:38.890034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e886f584-3f70-4828-850c-ac7699405cad tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:39.323965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e886f584-3f70-4828-850c-ac7699405cad tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:39.334827 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e886f584-3f70-4828-850c-ac7699405cad tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1477 microversion: 2.1 time: 0.496429 Jul 20 04:13:39.335619 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 667/1215] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:38 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1477 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:39.824024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8dda792a-db4d-46b7-965e-a014d0384f1b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:39.824713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8dda792a-db4d-46b7-965e-a014d0384f1b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6ea57023-555a-427d-85a3-e83ea85f6da1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:39.839682 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8dda792a-db4d-46b7-965e-a014d0384f1b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:39.841870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8dda792a-db4d-46b7-965e-a014d0384f1b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:39.842883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8dda792a-db4d-46b7-965e-a014d0384f1b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:39.845388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8dda792a-db4d-46b7-965e-a014d0384f1b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:39.876283 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-8dda792a-db4d-46b7-965e-a014d0384f1b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] HTTP exception thrown: Instance 6ea57023-555a-427d-85a3-e83ea85f6da1 could not be found. Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8dda792a-db4d-46b7-965e-a014d0384f1b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Request method failure captured: Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 HTTP/1.1 Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14BYbIK69M9QpF--D95_1lTfRhnOuUdrNuf9ZGtS89PqLQE-ZpPsyevyV1J9PJ8fPkoxBjYpBD8ByKkWxfuU1DumzfqxVkNaMTwcjvGwsZWcAcQn-nN4PcnNEry3n6H2h9IuXiyBTWbGinbzMBZy_R-YCwAPdD1fsjbZp2vLGyR86Eg Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 22bcfd2698d047dea07c643970c749eb Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:13:39.879913 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:13:39.882704 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/22bcfd2698d047dea07c643970c749eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/22bcfd2698d047dea07c643970c749eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_22bcfd2698d047dea07c643970c749eb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/22bcfd2698d047dea07c643970c749eb"}]}] Jul 20 04:13:39.882704 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:39.882704 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 22bcfd2698d047dea07c643970c749eb Jul 20 04:13:39.882704 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:39.882704 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersOnMultiNodesTest-1348686041-project Jul 20 04:13:39.882704 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:13:39.882704 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:13:39.882704 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 5e178243e1ed404092e5ea0be39d5c16 Jul 20 04:13:39.882704 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersOnMultiNodesTest-1348686041-project Jul 20 04:13:39.882704 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:13:39.882704 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 6ea57023-555a-427d-85a3-e83ea85f6da1 could not be found. Jul 20 04:13:39.882704 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '6ea57023-555a-427d-85a3-e83ea85f6da1'} Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ea57023-555a-427d-85a3-e83ea85f6da1 could not be found. Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:39.883739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:39.885223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:39.885223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:39.885223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:39.885223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:39.885223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:39.885223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:39.885223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:39.885223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ea57023-555a-427d-85a3-e83ea85f6da1 could not be found. Jul 20 04:13:39.885223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:39.885223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:39.885223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:39.885223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:39.885223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:39.885223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:39.885223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:39.885223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:39.885223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ea57023-555a-427d-85a3-e83ea85f6da1 could not be found. Jul 20 04:13:39.885223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:39.896234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8dda792a-db4d-46b7-965e-a014d0384f1b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Returning 404 to user: Instance 6ea57023-555a-427d-85a3-e83ea85f6da1 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:39.899343 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8dda792a-db4d-46b7-965e-a014d0384f1b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1" status: 404 len: 111 microversion: 2.1 time: 0.077888 Jul 20 04:13:39.901794 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 549/1216] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:39 2022] GET /compute/v2.1/servers/6ea57023-555a-427d-85a3-e83ea85f6da1 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:39.909963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-10ba4382-f7e4-464b-9c6e-2ebef815f76f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:39.910441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-10ba4382-f7e4-464b-9c6e-2ebef815f76f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:39.917754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-10ba4382-f7e4-464b-9c6e-2ebef815f76f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:39.918992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-10ba4382-f7e4-464b-9c6e-2ebef815f76f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:39.921154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-10ba4382-f7e4-464b-9c6e-2ebef815f76f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:39.921608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-10ba4382-f7e4-464b-9c6e-2ebef815f76f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:39.964102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:39.971114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-10ba4382-f7e4-464b-9c6e-2ebef815f76f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:40.146783 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-10ba4382-f7e4-464b-9c6e-2ebef815f76f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2" status: 204 len: 0 microversion: 2.1 time: 0.240030 Jul 20 04:13:40.147418 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 668/1217] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:39 2022] DELETE /compute/v2.1/servers/8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:40.156203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ef19934c-90fc-426c-88c5-a5f16530bc8c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:40.156938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ef19934c-90fc-426c-88c5-a5f16530bc8c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:40.166890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef19934c-90fc-426c-88c5-a5f16530bc8c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.167794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef19934c-90fc-426c-88c5-a5f16530bc8c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.169101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef19934c-90fc-426c-88c5-a5f16530bc8c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.169910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef19934c-90fc-426c-88c5-a5f16530bc8c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.211970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ef19934c-90fc-426c-88c5-a5f16530bc8c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:40.326304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:40.356640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-54effdf7-a622-4c2d-b6fc-4bf44e8389d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:40.357421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-54effdf7-a622-4c2d-b6fc-4bf44e8389d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:40.369710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54effdf7-a622-4c2d-b6fc-4bf44e8389d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.371751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54effdf7-a622-4c2d-b6fc-4bf44e8389d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.374276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54effdf7-a622-4c2d-b6fc-4bf44e8389d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.375911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54effdf7-a622-4c2d-b6fc-4bf44e8389d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.409901 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ef19934c-90fc-426c-88c5-a5f16530bc8c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d" status: 204 len: 0 microversion: 2.1 time: 0.257587 Jul 20 04:13:40.412479 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 550/1218] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:40 2022] DELETE /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:40.432726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-28fa34ca-f1d2-47b9-8171-ab2878331714 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:40.433729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-28fa34ca-f1d2-47b9-8171-ab2878331714 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:40.451284 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28fa34ca-f1d2-47b9-8171-ab2878331714 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.454587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28fa34ca-f1d2-47b9-8171-ab2878331714 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.457165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28fa34ca-f1d2-47b9-8171-ab2878331714 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.459786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28fa34ca-f1d2-47b9-8171-ab2878331714 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.730062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-28fa34ca-f1d2-47b9-8171-ab2878331714 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:40.741566 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-28fa34ca-f1d2-47b9-8171-ab2878331714 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2" status: 200 len: 1475 microversion: 2.1 time: 0.323478 Jul 20 04:13:40.751633 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 551/1219] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:40 2022] GET /compute/v2.1/servers/8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2 => generated 1475 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:40.751767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-54effdf7-a622-4c2d-b6fc-4bf44e8389d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:40.760622 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-54effdf7-a622-4c2d-b6fc-4bf44e8389d0 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1477 microversion: 2.1 time: 0.410782 Jul 20 04:13:40.761214 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 669/1220] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:40 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1477 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:41.106178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4e97430c-a3a9-438b-b430-99661b1cd7f3 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1763192381", "id": 342816044, "os-flavor-access:is_public": "False"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:41.108662 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:41.108662 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:13:41.136458 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4e97430c-a3a9-438b-b430-99661b1cd7f3 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.392415 Jul 20 04:13:41.137736 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 552/1221] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:13:40 2022] POST /compute/v2.1/flavors => generated 436 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:41.149156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fe614886-9a0a-471e-bb7c-cfc89883cca7 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7260d9e48d5a43fc9a2e32dad18465b2"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:41.150928 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:41.150928 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:13:41.410231 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fe614886-9a0a-471e-bb7c-cfc89883cca7 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/342816044/action" status: 200 len: 96 microversion: 2.1 time: 0.264551 Jul 20 04:13:41.411779 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 670/1222] 10.222.0.17 () {60 vars in 1196 bytes} [Wed Jul 20 04:13:41 2022] POST /compute/v2.1/flavors/342816044/action => generated 96 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:13:41.421606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-002950e0-b64c-4104-922f-137ce2e7dac1 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7260d9e48d5a43fc9a2e32dad18465b2"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:41.423118 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:41.423118 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:13:41.707232 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-002950e0-b64c-4104-922f-137ce2e7dac1 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] HTTP exception thrown: Flavor access already exists for flavor 36 and project 7260d9e48d5a43fc9a2e32dad18465b2 combination. Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-002950e0-b64c-4104-922f-137ce2e7dac1 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Request method failure captured: Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/flavors/342816044/action HTTP/1.1 Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 67 Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14DzGWHUWSNOds5xi1aQyby9fKcaIFKQVqGoYl_DSmm6qju0sonI0eA_lHN33K35EwyVx5qcRS5jcIe9_on1SVnSf_P3i7-70Ysaj_ZZkFl6bL7joaZslpViqv9VIKoy1t-SXjzGOeEt3e1NbYw76egOt5Ffhv1bowDoiAgLaB2c1uU Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: b0308d3ed7e74b53befeb32105d0e28f Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1360614229 Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member,admin Jul 20 04:13:41.738030 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member,admin Jul 20 04:13:41.740097 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0308d3ed7e74b53befeb32105d0e28f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b0308d3ed7e74b53befeb32105d0e28f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b0308d3ed7e74b53befeb32105d0e28f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0308d3ed7e74b53befeb32105d0e28f"}]}] Jul 20 04:13:41.740097 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1360614229 Jul 20 04:13:41.740097 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: b0308d3ed7e74b53befeb32105d0e28f Jul 20 04:13:41.740097 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1360614229 Jul 20 04:13:41.740097 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin Jul 20 04:13:41.740097 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:13:41.740097 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:13:41.740097 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f5ceede41a244de6a798fd300da11b70 Jul 20 04:13:41.740097 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin Jul 20 04:13:41.740097 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:13:41.740097 n-d-826526-5 devstack@n-api.service[127870]: {"addTenantAccess": {"tenant": "7260d9e48d5a43fc9a2e32dad18465b2"}} Jul 20 04:13:41.740097 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:13:41.741715 n-d-826526-5 devstack@n-api.service[127870]: exception: Flavor access already exists for flavor 36 and project 7260d9e48d5a43fc9a2e32dad18465b2 combination. Jul 20 04:13:41.741715 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '342816044', 'body': {'addTenantAccess': {'tenant': '7260d9e48d5a43fc9a2e32dad18465b2'}}} Jul 20 04:13:41.741715 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:41.741715 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:41.741715 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:13:41.741715 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:13:41.741715 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:13:41.741715 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:13:41.741715 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:13:41.741715 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:13:41.741715 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:13:41.741715 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:13:41.741715 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:13:41.741715 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:13:41.741715 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:13:41.741715 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:13:41.741715 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:13:41.741715 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '36-7260d9e48d5a43fc9a2e32dad18465b2' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi session.flush() Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 04:13:41.743182 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 20 04:13:41.744922 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 04:13:41.744922 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 20 04:13:41.744922 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:13:41.744922 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:13:41.744922 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 04:13:41.744922 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 20 04:13:41.744922 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 04:13:41.744922 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 20 04:13:41.744922 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 04:13:41.744922 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 20 04:13:41.744922 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 04:13:41.744922 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 20 04:13:41.744922 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 04:13:41.744922 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 20 04:13:41.744922 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 04:13:41.744922 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 04:13:41.744922 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 04:13:41.744922 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 20 04:13:41.746822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 04:13:41.746822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 20 04:13:41.746822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 04:13:41.746822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 20 04:13:41.746822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 04:13:41.746822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 04:13:41.746822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:13:41.746822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:13:41.746822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:13:41.746822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:13:41.746822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:13:41.746822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:13:41.746822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:13:41.746822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:13:41.746822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:13:41.746822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:13:41.746822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:13:41.746822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:13:41.748822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:13:41.748822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:13:41.748822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:13:41.748822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:13:41.748822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:13:41.748822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:13:41.748822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:13:41.748822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:13:41.748822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:13:41.748822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:13:41.748822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '36-7260d9e48d5a43fc9a2e32dad18465b2' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 20 04:13:41.748822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 20 04:13:41.748822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 20, 4, 13, 41, 697745), 'updated_at': None, 'flavor_id': 36, 'project_id': '7260d9e48d5a43fc9a2e32dad18465b2'}] Jul 20 04:13:41.748822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 04:13:41.748822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:41.748822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:41.748822 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 36 and project 7260d9e48d5a43fc9a2e32dad18465b2 combination. Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:41.750785 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 36 and project 7260d9e48d5a43fc9a2e32dad18465b2 combination. Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:41.754160 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:41.756578 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 36 and project 7260d9e48d5a43fc9a2e32dad18465b2 combination. Jul 20 04:13:41.756578 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:41.757878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-002950e0-b64c-4104-922f-137ce2e7dac1 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Returning 409 to user: Flavor access already exists for flavor 36 and project 7260d9e48d5a43fc9a2e32dad18465b2 combination. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:41.761343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e20efe98-dd49-49cd-a73f-fc5fb7f313aa tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:41.761985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e20efe98-dd49-49cd-a73f-fc5fb7f313aa tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:41.762807 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-002950e0-b64c-4104-922f-137ce2e7dac1 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/342816044/action" status: 409 len: 152 microversion: 2.1 time: 0.344066 Jul 20 04:13:41.766818 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 553/1223] 10.222.0.17 () {60 vars in 1196 bytes} [Wed Jul 20 04:13:41 2022] POST /compute/v2.1/flavors/342816044/action => generated 152 bytes in 350 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:13:41.778529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aa8d3059-6cec-4ed4-8330-fb0298c55f56 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7260d9e48d5a43fc9a2e32dad18465b2"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:41.781525 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:41.781525 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:13:41.795049 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e20efe98-dd49-49cd-a73f-fc5fb7f313aa tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:41.795536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e20efe98-dd49-49cd-a73f-fc5fb7f313aa tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:41.797322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e20efe98-dd49-49cd-a73f-fc5fb7f313aa tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:41.797759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e20efe98-dd49-49cd-a73f-fc5fb7f313aa tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:42.189140 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aa8d3059-6cec-4ed4-8330-fb0298c55f56 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/342816044/action" status: 200 len: 21 microversion: 2.1 time: 0.416229 Jul 20 04:13:42.192380 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 554/1224] 10.222.0.17 () {60 vars in 1196 bytes} [Wed Jul 20 04:13:41 2022] POST /compute/v2.1/flavors/342816044/action => generated 21 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:13:42.202492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d6f4b0f1-58e2-4975-88b3-104ec2992722 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:42.204650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d6f4b0f1-58e2-4975-88b3-104ec2992722 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:42.225936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6f4b0f1-58e2-4975-88b3-104ec2992722 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:42.231694 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6f4b0f1-58e2-4975-88b3-104ec2992722 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:42.232897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6f4b0f1-58e2-4975-88b3-104ec2992722 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:42.233565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6f4b0f1-58e2-4975-88b3-104ec2992722 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:42.568860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d6f4b0f1-58e2-4975-88b3-104ec2992722 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:42.579168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e20efe98-dd49-49cd-a73f-fc5fb7f313aa tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:42.586256 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d6f4b0f1-58e2-4975-88b3-104ec2992722 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1477 microversion: 2.1 time: 0.392495 Jul 20 04:13:42.588681 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 555/1225] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:42 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1477 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:42.595613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c3fe5e59-d1d2-486d-9d0a-c40df213ed42 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:42.600871 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:42.600871 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:13:42.601126 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e20efe98-dd49-49cd-a73f-fc5fb7f313aa tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2" status: 200 len: 1475 microversion: 2.1 time: 0.844432 Jul 20 04:13:42.602634 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 671/1226] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:41 2022] GET /compute/v2.1/servers/8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2 => generated 1475 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:42.645139 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c3fe5e59-d1d2-486d-9d0a-c40df213ed42 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/342816044" status: 202 len: 0 microversion: 2.1 time: 0.054280 Jul 20 04:13:42.647262 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 556/1227] 10.222.0.17 () {58 vars in 1157 bytes} [Wed Jul 20 04:13:42 2022] DELETE /compute/v2.1/flavors/342816044 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:42.654603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e7bfa197-0cfd-493e-887b-2a14a77e3b3d tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:42.687388 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e7bfa197-0cfd-493e-887b-2a14a77e3b3d tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036785 Jul 20 04:13:42.694426 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 672/1228] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:13:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:42.713763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ae919618-8a90-499c-b02f-a15a7f4769f5 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1555167127", "id": 2037254928, "os-flavor-access:is_public": "True"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:42.715456 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:42.715456 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:13:42.748500 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ae919618-8a90-499c-b02f-a15a7f4769f5 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.033929 Jul 20 04:13:42.755328 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 557/1229] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:13:42 2022] POST /compute/v2.1/flavors => generated 438 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:42.766325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8a766905-f63c-4e9f-974f-a4c547060cf9 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:42.767365 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:42.767365 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:13:42.778069 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-8a766905-f63c-4e9f-974f-a4c547060cf9 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8a766905-f63c-4e9f-974f-a4c547060cf9 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Request method failure captured: Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/flavors/2037254928/os-flavor-access HTTP/1.1 Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14DzGWHUWSNOds5xi1aQyby9fKcaIFKQVqGoYl_DSmm6qju0sonI0eA_lHN33K35EwyVx5qcRS5jcIe9_on1SVnSf_P3i7-70Ysaj_ZZkFl6bL7joaZslpViqv9VIKoy1t-SXjzGOeEt3e1NbYw76egOt5Ffhv1bowDoiAgLaB2c1uU Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b0308d3ed7e74b53befeb32105d0e28f Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1360614229 Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:13:42.786583 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:13:42.788174 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0308d3ed7e74b53befeb32105d0e28f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b0308d3ed7e74b53befeb32105d0e28f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b0308d3ed7e74b53befeb32105d0e28f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0308d3ed7e74b53befeb32105d0e28f"}]}] Jul 20 04:13:42.788174 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1360614229 Jul 20 04:13:42.788174 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b0308d3ed7e74b53befeb32105d0e28f Jul 20 04:13:42.788174 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1360614229 Jul 20 04:13:42.788174 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin Jul 20 04:13:42.788174 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:13:42.788174 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:13:42.788174 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f5ceede41a244de6a798fd300da11b70 Jul 20 04:13:42.788174 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin Jul 20 04:13:42.788174 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:13:42.788174 n-d-826526-5 devstack@n-api.service[127871]: exception: Access list not available for public flavors. Jul 20 04:13:42.788174 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'flavor_id': '2037254928'} Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 20 04:13:42.792484 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:42.794057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8a766905-f63c-4e9f-974f-a4c547060cf9 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:42.794057 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8a766905-f63c-4e9f-974f-a4c547060cf9 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/2037254928/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.025947 Jul 20 04:13:42.794057 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 673/1230] 10.222.0.17 () {58 vars in 1208 bytes} [Wed Jul 20 04:13:42 2022] GET /compute/v2.1/flavors/2037254928/os-flavor-access => generated 91 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:13:42.797590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-709df8a1-22b0-4f44-aca9-6aa67ec16bad tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:42.862271 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-709df8a1-22b0-4f44-aca9-6aa67ec16bad tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/2037254928" status: 202 len: 0 microversion: 2.1 time: 0.067573 Jul 20 04:13:42.863456 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 558/1231] 10.222.0.17 () {58 vars in 1160 bytes} [Wed Jul 20 04:13:42 2022] DELETE /compute/v2.1/flavors/2037254928 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:13:42.877810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2ef73de4-f473-482a-a966-7214441a887e tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:42.924066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-da0738a4-67ea-4470-b551-3ce698529a90 req-c18706ec-cf42-4820-88e6-a1e982a2140f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2", "name": "network-vif-deleted", "tag": "10a828a3-bd43-49e2-a38e-dfa31069d15b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:42.947962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-da0738a4-67ea-4470-b551-3ce698529a90 req-c18706ec-cf42-4820-88e6-a1e982a2140f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:42.948823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-da0738a4-67ea-4470-b551-3ce698529a90 req-c18706ec-cf42-4820-88e6-a1e982a2140f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:42.963664 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-da0738a4-67ea-4470-b551-3ce698529a90 req-c18706ec-cf42-4820-88e6-a1e982a2140f service nova] Creating event network-vif-deleted:10a828a3-bd43-49e2-a38e-dfa31069d15b for instance 8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2 on n-h2-826526-5 Jul 20 04:13:42.966369 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2ef73de4-f473-482a-a966-7214441a887e tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.097002 Jul 20 04:13:42.968761 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 674/1232] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:13:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:42.979972 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-da0738a4-67ea-4470-b551-3ce698529a90 req-c18706ec-cf42-4820-88e6-a1e982a2140f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085986 Jul 20 04:13:42.979972 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 559/1233] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:13:42.988237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d766cca0-d705-45d9-9dbe-1ee9e2f2119d tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2135828833", "id": 901372419, "os-flavor-access:is_public": "False"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:42.989971 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:42.989971 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:13:43.023806 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d766cca0-d705-45d9-9dbe-1ee9e2f2119d tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.040526 Jul 20 04:13:43.026105 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 675/1234] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:13:42 2022] POST /compute/v2.1/flavors => generated 436 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:43.303050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-877b49df-4ba1-4252-8e40-4f24b633d062 tempest-FlavorsAccessNegativeTestJSON-1359020782 tempest-FlavorsAccessNegativeTestJSON-1359020782-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7260d9e48d5a43fc9a2e32dad18465b2"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:43.304739 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:43.304739 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:13:43.306764 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-877b49df-4ba1-4252-8e40-4f24b633d062 tempest-FlavorsAccessNegativeTestJSON-1359020782 tempest-FlavorsAccessNegativeTestJSON-1359020782-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'd4763ac519de4c5fb78c98d14d56d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7260d9e48d5a43fc9a2e32dad18465b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-877b49df-4ba1-4252-8e40-4f24b633d062 tempest-FlavorsAccessNegativeTestJSON-1359020782 tempest-FlavorsAccessNegativeTestJSON-1359020782-project] Request method failure captured: Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/flavors/901372419/action HTTP/1.1 Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 67 Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14DytaM2bW0wyl-gXYurN5oGxBGs_tOzsMovalt6BtzBeVF1rG8OUrkwUW-yT0hA1l86epzhxRbBqG2m2L6d9icJrwXo7Bb0rY6yvFzSJDxTdSOcJih6vUvVbx3VR_HhZSoiGMMO-RFgoX8obf9OXNiG1rcPsPjEOBWXTw-Lb-dGXV8 Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 7260d9e48d5a43fc9a2e32dad18465b2 Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1359020782 Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:13:43.309019 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:13:43.310562 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7260d9e48d5a43fc9a2e32dad18465b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7260d9e48d5a43fc9a2e32dad18465b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7260d9e48d5a43fc9a2e32dad18465b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7260d9e48d5a43fc9a2e32dad18465b2"}]}] Jul 20 04:13:43.310562 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1359020782 Jul 20 04:13:43.310562 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 7260d9e48d5a43fc9a2e32dad18465b2 Jul 20 04:13:43.310562 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1359020782 Jul 20 04:13:43.310562 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-FlavorsAccessNegativeTestJSON-1359020782-project Jul 20 04:13:43.310562 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:13:43.310562 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:13:43.310562 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: d4763ac519de4c5fb78c98d14d56d51f Jul 20 04:13:43.310562 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1359020782-project Jul 20 04:13:43.310562 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:13:43.310562 n-d-826526-5 devstack@n-api.service[127870]: {"addTenantAccess": {"tenant": "7260d9e48d5a43fc9a2e32dad18465b2"}} Jul 20 04:13:43.310562 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '901372419', 'body': {'addTenantAccess': {'tenant': '7260d9e48d5a43fc9a2e32dad18465b2'}}} Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:13:43.311562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 20 04:13:43.312925 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:43.328516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-877b49df-4ba1-4252-8e40-4f24b633d062 tempest-FlavorsAccessNegativeTestJSON-1359020782 tempest-FlavorsAccessNegativeTestJSON-1359020782-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:43.332524 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-877b49df-4ba1-4252-8e40-4f24b633d062 tempest-FlavorsAccessNegativeTestJSON-1359020782 tempest-FlavorsAccessNegativeTestJSON-1359020782-project] 10.222.0.17 "POST /compute/v2.1/flavors/901372419/action" status: 403 len: 130 microversion: 2.1 time: 0.298591 Jul 20 04:13:43.334691 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 560/1235] 10.222.0.17 () {60 vars in 1196 bytes} [Wed Jul 20 04:13:43 2022] POST /compute/v2.1/flavors/901372419/action => generated 130 bytes in 302 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:43.342406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d9ee2437-74b6-4293-946b-a04b11104dc1 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:43.343100 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:43.343100 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:13:43.381781 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d9ee2437-74b6-4293-946b-a04b11104dc1 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/901372419" status: 202 len: 0 microversion: 2.1 time: 0.043145 Jul 20 04:13:43.383087 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 676/1236] 10.222.0.17 () {58 vars in 1157 bytes} [Wed Jul 20 04:13:43 2022] DELETE /compute/v2.1/flavors/901372419 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:43.395629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d4ccd638-acfc-4335-b245-a8695fe1d377 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:43.452796 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d4ccd638-acfc-4335-b245-a8695fe1d377 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062450 Jul 20 04:13:43.453704 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 561/1237] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:13:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:43.470181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0f105cc6-73b0-4c84-8d3d-cd28ddc0c59f tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-55654363", "id": 1164533399, "os-flavor-access:is_public": "False"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:43.502838 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0f105cc6-73b0-4c84-8d3d-cd28ddc0c59f tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.036977 Jul 20 04:13:43.505156 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 677/1238] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:13:43 2022] POST /compute/v2.1/flavors => generated 437 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:43.517343 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0a2db20d-dde1-4cb1-843a-80b233afb8f9 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7260d9e48d5a43fc9a2e32dad18465b2"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:43.607130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1131c082-1599-4042-986b-9e4b9e8ce245 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:43.608602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1131c082-1599-4042-986b-9e4b9e8ce245 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:43.621506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1131c082-1599-4042-986b-9e4b9e8ce245 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:43.622375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1131c082-1599-4042-986b-9e4b9e8ce245 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:43.625680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1131c082-1599-4042-986b-9e4b9e8ce245 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:43.629791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1131c082-1599-4042-986b-9e4b9e8ce245 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:43.990851 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0a2db20d-dde1-4cb1-843a-80b233afb8f9 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1164533399/action" status: 200 len: 97 microversion: 2.1 time: 0.478290 Jul 20 04:13:43.994474 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 562/1239] 10.222.0.17 () {60 vars in 1199 bytes} [Wed Jul 20 04:13:43 2022] POST /compute/v2.1/flavors/1164533399/action => generated 97 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:13:44.009992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf3a7c04-df4b-4856-bb1b-8a3a4ed2fd86 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:44.010898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cf3a7c04-df4b-4856-bb1b-8a3a4ed2fd86 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:44.016068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1131c082-1599-4042-986b-9e4b9e8ce245 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:44.026293 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1131c082-1599-4042-986b-9e4b9e8ce245 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1477 microversion: 2.1 time: 0.424159 Jul 20 04:13:44.027982 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 678/1240] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:43 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1477 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:44.032006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf3a7c04-df4b-4856-bb1b-8a3a4ed2fd86 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.032488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf3a7c04-df4b-4856-bb1b-8a3a4ed2fd86 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.034060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-0a3087fb-4bb9-4f9e-bf9e-16c9c6032fc4 req-e755f5c2-bce7-4644-984a-3f983dfcb574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9cbb51-d102-4677-a14a-2837242cf16d", "name": "network-vif-deleted", "tag": "de591a0a-a73f-4cbb-b9ac-d9c499ebf844"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:44.037432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf3a7c04-df4b-4856-bb1b-8a3a4ed2fd86 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.038690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf3a7c04-df4b-4856-bb1b-8a3a4ed2fd86 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.043630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-0a3087fb-4bb9-4f9e-bf9e-16c9c6032fc4 req-e755f5c2-bce7-4644-984a-3f983dfcb574 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.044194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-0a3087fb-4bb9-4f9e-bf9e-16c9c6032fc4 req-e755f5c2-bce7-4644-984a-3f983dfcb574 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.063150 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-0a3087fb-4bb9-4f9e-bf9e-16c9c6032fc4 req-e755f5c2-bce7-4644-984a-3f983dfcb574 service nova] Creating event network-vif-deleted:de591a0a-a73f-4cbb-b9ac-d9c499ebf844 for instance 6f9cbb51-d102-4677-a14a-2837242cf16d on n-h1-826526-5 Jul 20 04:13:44.074083 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-0a3087fb-4bb9-4f9e-bf9e-16c9c6032fc4 req-e755f5c2-bce7-4644-984a-3f983dfcb574 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043700 Jul 20 04:13:44.076970 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 679/1241] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:44.087561 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-cf3a7c04-df4b-4856-bb1b-8a3a4ed2fd86 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] HTTP exception thrown: Instance 8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2 could not be found. Jul 20 04:13:44.092652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e88c7a3f-1fee-460b-b65e-d5c49b757515 tempest-FlavorsAccessNegativeTestJSON-1359020782 tempest-FlavorsAccessNegativeTestJSON-1359020782-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7260d9e48d5a43fc9a2e32dad18465b2"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:44.093991 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:44.093991 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:13:44.094842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e88c7a3f-1fee-460b-b65e-d5c49b757515 tempest-FlavorsAccessNegativeTestJSON-1359020782 tempest-FlavorsAccessNegativeTestJSON-1359020782-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'd4763ac519de4c5fb78c98d14d56d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7260d9e48d5a43fc9a2e32dad18465b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e88c7a3f-1fee-460b-b65e-d5c49b757515 tempest-FlavorsAccessNegativeTestJSON-1359020782 tempest-FlavorsAccessNegativeTestJSON-1359020782-project] Request method failure captured: Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/flavors/1164533399/action HTTP/1.1 Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 70 Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14DytaM2bW0wyl-gXYurN5oGxBGs_tOzsMovalt6BtzBeVF1rG8OUrkwUW-yT0hA1l86epzhxRbBqG2m2L6d9icJrwXo7Bb0rY6yvFzSJDxTdSOcJih6vUvVbx3VR_HhZSoiGMMO-RFgoX8obf9OXNiG1rcPsPjEOBWXTw-Lb-dGXV8 Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 7260d9e48d5a43fc9a2e32dad18465b2 Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1359020782 Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:13:44.096558 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:13:44.098209 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7260d9e48d5a43fc9a2e32dad18465b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7260d9e48d5a43fc9a2e32dad18465b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7260d9e48d5a43fc9a2e32dad18465b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7260d9e48d5a43fc9a2e32dad18465b2"}]}] Jul 20 04:13:44.098209 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1359020782 Jul 20 04:13:44.098209 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 7260d9e48d5a43fc9a2e32dad18465b2 Jul 20 04:13:44.098209 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1359020782 Jul 20 04:13:44.098209 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-FlavorsAccessNegativeTestJSON-1359020782-project Jul 20 04:13:44.098209 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:13:44.098209 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:13:44.098209 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: d4763ac519de4c5fb78c98d14d56d51f Jul 20 04:13:44.098209 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1359020782-project Jul 20 04:13:44.098209 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:13:44.098209 n-d-826526-5 devstack@n-api.service[127871]: {"removeTenantAccess": {"tenant": "7260d9e48d5a43fc9a2e32dad18465b2"}} Jul 20 04:13:44.098209 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '1164533399', 'body': {'removeTenantAccess': {'tenant': '7260d9e48d5a43fc9a2e32dad18465b2'}}} Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi context.can( Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:13:44.099157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 20 04:13:44.101143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf3a7c04-df4b-4856-bb1b-8a3a4ed2fd86 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Request method failure captured: Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2 HTTP/1.1 Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14BYbIK69M9QpF--D95_1lTfRhnOuUdrNuf9ZGtS89PqLQE-ZpPsyevyV1J9PJ8fPkoxBjYpBD8ByKkWxfuU1DumzfqxVkNaMTwcjvGwsZWcAcQn-nN4PcnNEry3n6H2h9IuXiyBTWbGinbzMBZy_R-YCwAPdD1fsjbZp2vLGyR86Eg Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 22bcfd2698d047dea07c643970c749eb Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:13:44.103988 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:13:44.106807 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/22bcfd2698d047dea07c643970c749eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/22bcfd2698d047dea07c643970c749eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_22bcfd2698d047dea07c643970c749eb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/22bcfd2698d047dea07c643970c749eb"}]}] Jul 20 04:13:44.106807 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:44.106807 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 22bcfd2698d047dea07c643970c749eb Jul 20 04:13:44.106807 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:44.106807 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersOnMultiNodesTest-1348686041-project Jul 20 04:13:44.106807 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:13:44.106807 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:13:44.106807 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 5e178243e1ed404092e5ea0be39d5c16 Jul 20 04:13:44.106807 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersOnMultiNodesTest-1348686041-project Jul 20 04:13:44.106807 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:13:44.106807 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2 could not be found. Jul 20 04:13:44.106807 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2'} Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2 could not be found. Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:44.109474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:44.112009 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:44.112009 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:44.112009 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:44.112009 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:44.112009 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:44.112009 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:44.112009 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:44.112009 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2 could not be found. Jul 20 04:13:44.112009 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:44.112009 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:44.112009 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:44.112009 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:44.112009 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:44.112009 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:44.112009 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:44.112009 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:44.112009 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2 could not be found. Jul 20 04:13:44.112009 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:44.115177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf3a7c04-df4b-4856-bb1b-8a3a4ed2fd86 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Returning 404 to user: Instance 8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:44.115177 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cf3a7c04-df4b-4856-bb1b-8a3a4ed2fd86 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2" status: 404 len: 111 microversion: 2.1 time: 0.111724 Jul 20 04:13:44.115177 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 563/1242] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:43 2022] GET /compute/v2.1/servers/8537ea21-278d-4e9c-b5d0-9a5f7f8df6b2 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:44.121851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e88c7a3f-1fee-460b-b65e-d5c49b757515 tempest-FlavorsAccessNegativeTestJSON-1359020782 tempest-FlavorsAccessNegativeTestJSON-1359020782-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:44.123814 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e88c7a3f-1fee-460b-b65e-d5c49b757515 tempest-FlavorsAccessNegativeTestJSON-1359020782 tempest-FlavorsAccessNegativeTestJSON-1359020782-project] 10.222.0.17 "POST /compute/v2.1/flavors/1164533399/action" status: 403 len: 133 microversion: 2.1 time: 0.045489 Jul 20 04:13:44.127362 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 680/1243] 10.222.0.17 () {60 vars in 1199 bytes} [Wed Jul 20 04:13:44 2022] POST /compute/v2.1/flavors/1164533399/action => generated 133 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:44.133126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1873fbf7-87c7-41fa-b1ae-846871cdf6db tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:44.134604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1873fbf7-87c7-41fa-b1ae-846871cdf6db tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:44.138659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b7f1970-e20c-4b9d-9ea2-add22d9d8594 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7260d9e48d5a43fc9a2e32dad18465b2"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:44.152042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1873fbf7-87c7-41fa-b1ae-846871cdf6db tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.154251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1873fbf7-87c7-41fa-b1ae-846871cdf6db tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.161058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1873fbf7-87c7-41fa-b1ae-846871cdf6db tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.164194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1873fbf7-87c7-41fa-b1ae-846871cdf6db tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.334732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1873fbf7-87c7-41fa-b1ae-846871cdf6db tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.341941 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1873fbf7-87c7-41fa-b1ae-846871cdf6db tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.342439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-1873fbf7-87c7-41fa-b1ae-846871cdf6db tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lazy-loading 'fault' on Instance uuid 6f9cbb51-d102-4677-a14a-2837242cf16d {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:13:44.393582 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9b7f1970-e20c-4b9d-9ea2-add22d9d8594 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1164533399/action" status: 200 len: 21 microversion: 2.1 time: 0.260011 Jul 20 04:13:44.396890 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 681/1244] 10.222.0.17 () {60 vars in 1199 bytes} [Wed Jul 20 04:13:44 2022] POST /compute/v2.1/flavors/1164533399/action => generated 21 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:13:44.414539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0cc14392-a26f-4687-aa98-9804107b6bce tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:44.416717 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:44.416717 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:13:44.482802 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0cc14392-a26f-4687-aa98-9804107b6bce tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1164533399" status: 202 len: 0 microversion: 2.1 time: 0.078624 Jul 20 04:13:44.485045 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 682/1245] 10.222.0.17 () {58 vars in 1160 bytes} [Wed Jul 20 04:13:44 2022] DELETE /compute/v2.1/flavors/1164533399 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:13:44.504386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fd3cbb90-42ff-467a-9052-2192e15d2084 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:44.551481 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fd3cbb90-42ff-467a-9052-2192e15d2084 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061561 Jul 20 04:13:44.563864 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 683/1246] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:13:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:44.568954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8cb6a2d1-c888-4ebc-9efa-ab9b196d0992 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-113397167", "id": 1296571593, "os-flavor-access:is_public": "False"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:44.572128 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:44.572128 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:13:44.580208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1873fbf7-87c7-41fa-b1ae-846871cdf6db tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:44.595022 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8cb6a2d1-c888-4ebc-9efa-ab9b196d0992 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.029632 Jul 20 04:13:44.595756 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 684/1247] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:13:44 2022] POST /compute/v2.1/flavors => generated 438 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:44.602141 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1873fbf7-87c7-41fa-b1ae-846871cdf6db tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d" status: 200 len: 1309 microversion: 2.1 time: 0.477843 Jul 20 04:13:44.609084 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 564/1248] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:44 2022] GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d => generated 1309 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:44.609438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9941acac-dd7e-47c2-9ceb-b1b0b22db262 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "119e690f40fd4763b82a9f46916db5ab"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:44.704331 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-9941acac-dd7e-47c2-9ceb-b1b0b22db262 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] HTTP exception thrown: Flavor access not found for 40 / 119e690f40fd4763b82a9f46916db5ab combination. Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9941acac-dd7e-47c2-9ceb-b1b0b22db262 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Request method failure captured: Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/flavors/1296571593/action HTTP/1.1 Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 70 Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14DzGWHUWSNOds5xi1aQyby9fKcaIFKQVqGoYl_DSmm6qju0sonI0eA_lHN33K35EwyVx5qcRS5jcIe9_on1SVnSf_P3i7-70Ysaj_ZZkFl6bL7joaZslpViqv9VIKoy1t-SXjzGOeEt3e1NbYw76egOt5Ffhv1bowDoiAgLaB2c1uU Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b0308d3ed7e74b53befeb32105d0e28f Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1360614229 Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:13:44.706519 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:13:44.707832 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0308d3ed7e74b53befeb32105d0e28f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b0308d3ed7e74b53befeb32105d0e28f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b0308d3ed7e74b53befeb32105d0e28f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b0308d3ed7e74b53befeb32105d0e28f"}]}] Jul 20 04:13:44.707832 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1360614229 Jul 20 04:13:44.707832 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b0308d3ed7e74b53befeb32105d0e28f Jul 20 04:13:44.707832 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1360614229 Jul 20 04:13:44.707832 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin Jul 20 04:13:44.707832 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:13:44.707832 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:13:44.707832 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f5ceede41a244de6a798fd300da11b70 Jul 20 04:13:44.707832 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin Jul 20 04:13:44.707832 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:13:44.707832 n-d-826526-5 devstack@n-api.service[127871]: {"removeTenantAccess": {"tenant": "119e690f40fd4763b82a9f46916db5ab"}} Jul 20 04:13:44.707832 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:13:44.708666 n-d-826526-5 devstack@n-api.service[127871]: exception: Flavor access not found for 40 / 119e690f40fd4763b82a9f46916db5ab combination. Jul 20 04:13:44.708666 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '1296571593', 'body': {'removeTenantAccess': {'tenant': '119e690f40fd4763b82a9f46916db5ab'}}} Jul 20 04:13:44.708666 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:44.708666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:44.708666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 20 04:13:44.708666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 20 04:13:44.708666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:13:44.708666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:13:44.708666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 20 04:13:44.708666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 20 04:13:44.708666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 20 04:13:44.708666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 20 04:13:44.708666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 20 04:13:44.708666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 20 04:13:44.708666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:13:44.708666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:13:44.708666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 20 04:13:44.708666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 40 / 119e690f40fd4763b82a9f46916db5ab combination. Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 40 / 119e690f40fd4763b82a9f46916db5ab combination. Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:44.709766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:44.711001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:44.711001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:44.711001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:44.711001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:44.711001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 40 / 119e690f40fd4763b82a9f46916db5ab combination. Jul 20 04:13:44.711001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:44.711001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9941acac-dd7e-47c2-9ceb-b1b0b22db262 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Returning 404 to user: Flavor access not found for 40 / 119e690f40fd4763b82a9f46916db5ab combination. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:44.711001 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9941acac-dd7e-47c2-9ceb-b1b0b22db262 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1296571593/action" status: 404 len: 124 microversion: 2.1 time: 0.104609 Jul 20 04:13:44.711001 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 685/1249] 10.222.0.17 () {60 vars in 1199 bytes} [Wed Jul 20 04:13:44 2022] POST /compute/v2.1/flavors/1296571593/action => generated 124 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:44.718500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f2bfaf2b-af09-4222-9351-0080af4ac3d6 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:44.719485 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:44.719485 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:13:44.745635 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f2bfaf2b-af09-4222-9351-0080af4ac3d6 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1296571593" status: 202 len: 0 microversion: 2.1 time: 0.031750 Jul 20 04:13:44.746965 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 565/1250] 10.222.0.17 () {58 vars in 1160 bytes} [Wed Jul 20 04:13:44 2022] DELETE /compute/v2.1/flavors/1296571593 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:44.756223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-293003a7-06c9-41eb-ae3b-9e0f3c90fb09 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:44.790904 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-293003a7-06c9-41eb-ae3b-9e0f3c90fb09 tempest-FlavorsAccessNegativeTestJSON-1360614229 tempest-FlavorsAccessNegativeTestJSON-1360614229-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039654 Jul 20 04:13:44.791726 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 686/1251] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:13:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:45.044929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-224aa32d-9e26-4942-b743-34718702d6cf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:45.046012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-224aa32d-9e26-4942-b743-34718702d6cf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:45.050488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=10 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:45.066541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-224aa32d-9e26-4942-b743-34718702d6cf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:45.067507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-224aa32d-9e26-4942-b743-34718702d6cf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:45.072254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-224aa32d-9e26-4942-b743-34718702d6cf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:45.073024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-224aa32d-9e26-4942-b743-34718702d6cf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:45.414055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-224aa32d-9e26-4942-b743-34718702d6cf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:45.426023 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-224aa32d-9e26-4942-b743-34718702d6cf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1477 microversion: 2.1 time: 0.385084 Jul 20 04:13:45.427084 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 566/1252] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:45 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1477 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:45.615588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a59d8ea7-dc66-4098-aaf8-a4819c362b2f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:45.617562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a59d8ea7-dc66-4098-aaf8-a4819c362b2f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:45.627385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a59d8ea7-dc66-4098-aaf8-a4819c362b2f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:45.627852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a59d8ea7-dc66-4098-aaf8-a4819c362b2f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:45.629403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a59d8ea7-dc66-4098-aaf8-a4819c362b2f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:45.629862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a59d8ea7-dc66-4098-aaf8-a4819c362b2f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:45.690050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a59d8ea7-dc66-4098-aaf8-a4819c362b2f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:45.690771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a59d8ea7-dc66-4098-aaf8-a4819c362b2f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:45.691388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-a59d8ea7-dc66-4098-aaf8-a4819c362b2f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lazy-loading 'fault' on Instance uuid 6f9cbb51-d102-4677-a14a-2837242cf16d {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:13:45.797460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a59d8ea7-dc66-4098-aaf8-a4819c362b2f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:45.806472 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a59d8ea7-dc66-4098-aaf8-a4819c362b2f tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d" status: 200 len: 1309 microversion: 2.1 time: 0.194915 Jul 20 04:13:45.818901 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 687/1253] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:45 2022] GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d => generated 1309 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:46.443267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f109b64a-1c00-439a-95da-9786e4d285f3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:46.443988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f109b64a-1c00-439a-95da-9786e4d285f3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:46.457115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f109b64a-1c00-439a-95da-9786e4d285f3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:46.458376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f109b64a-1c00-439a-95da-9786e4d285f3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:46.460285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f109b64a-1c00-439a-95da-9786e4d285f3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:46.462112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f109b64a-1c00-439a-95da-9786e4d285f3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:46.666497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f109b64a-1c00-439a-95da-9786e4d285f3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:46.674271 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f109b64a-1c00-439a-95da-9786e4d285f3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1477 microversion: 2.1 time: 0.235153 Jul 20 04:13:46.675442 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 567/1254] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:46 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1477 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:46.826504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fcabe545-3096-476e-9c8e-a7113b7e8eaa tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:46.827184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fcabe545-3096-476e-9c8e-a7113b7e8eaa tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 6f9cbb51-d102-4677-a14a-2837242cf16d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:46.832296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=8 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:46.849730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcabe545-3096-476e-9c8e-a7113b7e8eaa tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:46.850652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcabe545-3096-476e-9c8e-a7113b7e8eaa tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:46.854336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcabe545-3096-476e-9c8e-a7113b7e8eaa tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:46.859201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcabe545-3096-476e-9c8e-a7113b7e8eaa tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:46.908571 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-fcabe545-3096-476e-9c8e-a7113b7e8eaa tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] HTTP exception thrown: Instance 6f9cbb51-d102-4677-a14a-2837242cf16d could not be found. Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fcabe545-3096-476e-9c8e-a7113b7e8eaa tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Request method failure captured: Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d HTTP/1.1 Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14BYbIK69M9QpF--D95_1lTfRhnOuUdrNuf9ZGtS89PqLQE-ZpPsyevyV1J9PJ8fPkoxBjYpBD8ByKkWxfuU1DumzfqxVkNaMTwcjvGwsZWcAcQn-nN4PcnNEry3n6H2h9IuXiyBTWbGinbzMBZy_R-YCwAPdD1fsjbZp2vLGyR86Eg Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 22bcfd2698d047dea07c643970c749eb Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:13:46.913139 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:13:46.914599 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/22bcfd2698d047dea07c643970c749eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/22bcfd2698d047dea07c643970c749eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_22bcfd2698d047dea07c643970c749eb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/22bcfd2698d047dea07c643970c749eb"}]}] Jul 20 04:13:46.914599 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:46.914599 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 22bcfd2698d047dea07c643970c749eb Jul 20 04:13:46.914599 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:46.914599 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersOnMultiNodesTest-1348686041-project Jul 20 04:13:46.914599 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:13:46.914599 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:13:46.914599 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 5e178243e1ed404092e5ea0be39d5c16 Jul 20 04:13:46.914599 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersOnMultiNodesTest-1348686041-project Jul 20 04:13:46.914599 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:13:46.914599 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 6f9cbb51-d102-4677-a14a-2837242cf16d could not be found. Jul 20 04:13:46.914599 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '6f9cbb51-d102-4677-a14a-2837242cf16d'} Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f9cbb51-d102-4677-a14a-2837242cf16d could not be found. Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:46.915348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:46.916652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:46.916652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:46.916652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:46.916652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:46.916652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:46.916652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:46.916652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:46.916652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f9cbb51-d102-4677-a14a-2837242cf16d could not be found. Jul 20 04:13:46.916652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:46.916652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:46.916652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:46.916652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:46.916652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:46.916652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:46.916652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:46.916652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:46.916652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f9cbb51-d102-4677-a14a-2837242cf16d could not be found. Jul 20 04:13:46.916652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:13:46.917785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fcabe545-3096-476e-9c8e-a7113b7e8eaa tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Returning 404 to user: Instance 6f9cbb51-d102-4677-a14a-2837242cf16d could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:46.919687 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fcabe545-3096-476e-9c8e-a7113b7e8eaa tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d" status: 404 len: 111 microversion: 2.1 time: 0.095644 Jul 20 04:13:46.923552 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 688/1255] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:46 2022] GET /compute/v2.1/servers/6f9cbb51-d102-4677-a14a-2837242cf16d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:46.936359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6c457e65-e03a-485e-8a4f-38df91871f86 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:46.957405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ce87cb7b-8d83-4e19-947b-bbe49171d36b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:46.958815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ce87cb7b-8d83-4e19-947b-bbe49171d36b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:46.973434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce87cb7b-8d83-4e19-947b-bbe49171d36b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:46.974326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce87cb7b-8d83-4e19-947b-bbe49171d36b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:46.977553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce87cb7b-8d83-4e19-947b-bbe49171d36b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:46.978330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce87cb7b-8d83-4e19-947b-bbe49171d36b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.018667 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6c457e65-e03a-485e-8a4f-38df91871f86 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/0fbc3d46-f5df-401f-bbdf-6f1c49042fc6" status: 204 len: 0 microversion: 2.1 time: 0.093334 Jul 20 04:13:47.023289 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 568/1256] 10.222.0.17 () {58 vars in 1265 bytes} [Wed Jul 20 04:13:46 2022] DELETE /compute/v2.1/os-server-groups/0fbc3d46-f5df-401f-bbdf-6f1c49042fc6 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:47.030848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f4e203b7-2283-48e7-adc0-da0f72c2f48b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:47.031591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f4e203b7-2283-48e7-adc0-da0f72c2f48b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 3572b1fb-62bb-4279-94d0-73fefdbb8b25] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:47.045744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4e203b7-2283-48e7-adc0-da0f72c2f48b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.046459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4e203b7-2283-48e7-adc0-da0f72c2f48b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.047434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4e203b7-2283-48e7-adc0-da0f72c2f48b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.048043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4e203b7-2283-48e7-adc0-da0f72c2f48b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.081996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f4e203b7-2283-48e7-adc0-da0f72c2f48b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 3572b1fb-62bb-4279-94d0-73fefdbb8b25] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:47.266978 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f4e203b7-2283-48e7-adc0-da0f72c2f48b tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3572b1fb-62bb-4279-94d0-73fefdbb8b25" status: 204 len: 0 microversion: 2.1 time: 0.241610 Jul 20 04:13:47.267901 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 569/1257] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:47 2022] DELETE /compute/v2.1/servers/3572b1fb-62bb-4279-94d0-73fefdbb8b25 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:47.283068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b19c6af6-8478-49da-b7d2-d9af67e3b199 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:47.283998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b19c6af6-8478-49da-b7d2-d9af67e3b199 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:47.293148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b19c6af6-8478-49da-b7d2-d9af67e3b199 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.294060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b19c6af6-8478-49da-b7d2-d9af67e3b199 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.295131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b19c6af6-8478-49da-b7d2-d9af67e3b199 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.295859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b19c6af6-8478-49da-b7d2-d9af67e3b199 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.335945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b19c6af6-8478-49da-b7d2-d9af67e3b199 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:47.372836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-ce87cb7b-8d83-4e19-947b-bbe49171d36b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'services' on Instance uuid b80122a5-6106-4f62-9d72-5623e8ac0ca7 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:13:47.402548 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ce87cb7b-8d83-4e19-947b-bbe49171d36b tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 2420 microversion: 2.25 time: 0.462712 Jul 20 04:13:47.409467 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 689/1258] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:46 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 2420 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:47.421729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fcb1dab1-59e3-429c-bc43-f548045f977f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826526-5", "block_migration": "auto"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:47.423081 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fcb1dab1-59e3-429c-bc43-f548045f977f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:47.435187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcb1dab1-59e3-429c-bc43-f548045f977f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.435689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcb1dab1-59e3-429c-bc43-f548045f977f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.436514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcb1dab1-59e3-429c-bc43-f548045f977f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.437128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcb1dab1-59e3-429c-bc43-f548045f977f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.490527 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b19c6af6-8478-49da-b7d2-d9af67e3b199 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "DELETE /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6" status: 204 len: 0 microversion: 2.1 time: 0.216061 Jul 20 04:13:47.491830 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 570/1259] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:47 2022] DELETE /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:47.501156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-caca78eb-f0f2-4177-bee3-5605a5fd46c7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:47.502511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-caca78eb-f0f2-4177-bee3-5605a5fd46c7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 3572b1fb-62bb-4279-94d0-73fefdbb8b25] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:47.511461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-caca78eb-f0f2-4177-bee3-5605a5fd46c7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.512064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-fcb1dab1-59e3-429c-bc43-f548045f977f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'flavor' on Instance uuid b80122a5-6106-4f62-9d72-5623e8ac0ca7 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:13:47.512804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-caca78eb-f0f2-4177-bee3-5605a5fd46c7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.514470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-caca78eb-f0f2-4177-bee3-5605a5fd46c7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.515135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-caca78eb-f0f2-4177-bee3-5605a5fd46c7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.547291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fcb1dab1-59e3-429c-bc43-f548045f977f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Going to try to live migrate instance to n-h2-826526-5 {{(pid=127871) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:13:47.925631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-caca78eb-f0f2-4177-bee3-5605a5fd46c7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:47.939099 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-caca78eb-f0f2-4177-bee3-5605a5fd46c7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/3572b1fb-62bb-4279-94d0-73fefdbb8b25" status: 200 len: 1475 microversion: 2.1 time: 0.443171 Jul 20 04:13:47.939770 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 571/1260] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:47 2022] GET /compute/v2.1/servers/3572b1fb-62bb-4279-94d0-73fefdbb8b25 => generated 1475 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:47.963728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cb845d50-59d4-4e0b-bb4a-0374587afb12 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:47.964421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cb845d50-59d4-4e0b-bb4a-0374587afb12 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:47.982495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb845d50-59d4-4e0b-bb4a-0374587afb12 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.982970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb845d50-59d4-4e0b-bb4a-0374587afb12 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.983771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb845d50-59d4-4e0b-bb4a-0374587afb12 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.984208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb845d50-59d4-4e0b-bb4a-0374587afb12 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.351328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cb845d50-59d4-4e0b-bb4a-0374587afb12 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:48.364793 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cb845d50-59d4-4e0b-bb4a-0374587afb12 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1477 microversion: 2.1 time: 0.423911 Jul 20 04:13:48.365621 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 572/1261] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:47 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1477 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:48.958372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c5d5525f-33c1-475d-bbbb-c97f34e0ff79 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:48.958992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c5d5525f-33c1-475d-bbbb-c97f34e0ff79 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 3572b1fb-62bb-4279-94d0-73fefdbb8b25] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:48.976122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5d5525f-33c1-475d-bbbb-c97f34e0ff79 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.976602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5d5525f-33c1-475d-bbbb-c97f34e0ff79 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.977381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5d5525f-33c1-475d-bbbb-c97f34e0ff79 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.977814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5d5525f-33c1-475d-bbbb-c97f34e0ff79 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.332920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c5d5525f-33c1-475d-bbbb-c97f34e0ff79 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:49.360999 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c5d5525f-33c1-475d-bbbb-c97f34e0ff79 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/3572b1fb-62bb-4279-94d0-73fefdbb8b25" status: 200 len: 1475 microversion: 2.1 time: 0.405366 Jul 20 04:13:49.372200 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 573/1262] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:48 2022] GET /compute/v2.1/servers/3572b1fb-62bb-4279-94d0-73fefdbb8b25 => generated 1475 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:49.380751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bfe1cfca-4e5e-4073-9a17-2569e7c1dbce tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:49.382988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bfe1cfca-4e5e-4073-9a17-2569e7c1dbce tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:49.390500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bfe1cfca-4e5e-4073-9a17-2569e7c1dbce tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.391854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bfe1cfca-4e5e-4073-9a17-2569e7c1dbce tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.393437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bfe1cfca-4e5e-4073-9a17-2569e7c1dbce tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.394135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bfe1cfca-4e5e-4073-9a17-2569e7c1dbce tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.700111 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bfe1cfca-4e5e-4073-9a17-2569e7c1dbce tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1813 microversion: 2.1 time: 0.326319 Jul 20 04:13:49.700849 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 574/1263] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:49 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1813 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:49.708227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2d23c9d0-58e3-4c93-8263-1b4efe03821c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:49.708903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2d23c9d0-58e3-4c93-8263-1b4efe03821c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:49.730451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d23c9d0-58e3-4c93-8263-1b4efe03821c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.731217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d23c9d0-58e3-4c93-8263-1b4efe03821c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.734957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d23c9d0-58e3-4c93-8263-1b4efe03821c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.735558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d23c9d0-58e3-4c93-8263-1b4efe03821c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.349187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2d23c9d0-58e3-4c93-8263-1b4efe03821c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:50.354139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:50.366276 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2d23c9d0-58e3-4c93-8263-1b4efe03821c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1477 microversion: 2.1 time: 0.664346 Jul 20 04:13:50.366873 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 575/1264] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:49 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1477 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:50.371478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-943affc9-34be-4c2b-9ef9-dbd3fd791624 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:50.388924 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:50.388924 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:13:50.390954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-943affc9-34be-4c2b-9ef9-dbd3fd791624 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.397411 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-943affc9-34be-4c2b-9ef9-dbd3fd791624 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.398796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-943affc9-34be-4c2b-9ef9-dbd3fd791624 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.400646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-943affc9-34be-4c2b-9ef9-dbd3fd791624 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.441889 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-943affc9-34be-4c2b-9ef9-dbd3fd791624 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.073969 Jul 20 04:13:50.449139 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 576/1265] 10.222.0.17 () {58 vars in 1175 bytes} [Wed Jul 20 04:13:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:50.456000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b51c6340-bae4-4181-82ae-2bccbe37d407 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1955688978", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "aa8978d8-003b-4210-851c-70c785d76cf3"}, {"uuid": "8f4dcdf9-a965-4278-a8d9-886c19d878c8"}, {"uuid": "aa8978d8-003b-4210-851c-70c785d76cf3"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:50.561876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-b51c6340-bae4-4181-82ae-2bccbe37d407 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] validate_networks() for [('aa8978d8-003b-4210-851c-70c785d76cf3', None, None, None, None, None), ('8f4dcdf9-a965-4278-a8d9-886c19d878c8', None, None, None, None, None), ('aa8978d8-003b-4210-851c-70c785d76cf3', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:13:51.128530 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fcb1dab1-59e3-429c-bc43-f548045f977f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/action" status: 202 len: 0 microversion: 2.25 time: 3.710146 Jul 20 04:13:51.129244 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 690/1266] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jul 20 04:13:47 2022] POST /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/action => generated 0 bytes in 3712 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:13:51.142654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3fde472a-bc26-49b8-bafd-ed0d8f36c2d7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.142654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3fde472a-bc26-49b8-bafd-ed0d8f36c2d7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 3572b1fb-62bb-4279-94d0-73fefdbb8b25] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:51.175625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fde472a-bc26-49b8-bafd-ed0d8f36c2d7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.179447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fde472a-bc26-49b8-bafd-ed0d8f36c2d7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.186293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fde472a-bc26-49b8-bafd-ed0d8f36c2d7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.188157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fde472a-bc26-49b8-bafd-ed0d8f36c2d7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.649417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3fde472a-bc26-49b8-bafd-ed0d8f36c2d7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:51.660978 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3fde472a-bc26-49b8-bafd-ed0d8f36c2d7 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/3572b1fb-62bb-4279-94d0-73fefdbb8b25" status: 200 len: 1475 microversion: 2.1 time: 0.530654 Jul 20 04:13:51.665914 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 691/1267] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:51 2022] GET /compute/v2.1/servers/3572b1fb-62bb-4279-94d0-73fefdbb8b25 => generated 1475 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:51.678919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e0ef84c8-690a-42be-9923-413bc65ccbff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.688138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e0ef84c8-690a-42be-9923-413bc65ccbff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:51.710263 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0ef84c8-690a-42be-9923-413bc65ccbff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.710709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0ef84c8-690a-42be-9923-413bc65ccbff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.713395 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0ef84c8-690a-42be-9923-413bc65ccbff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.713869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0ef84c8-690a-42be-9923-413bc65ccbff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.461752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e0ef84c8-690a-42be-9923-413bc65ccbff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:52.474398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e0ef84c8-690a-42be-9923-413bc65ccbff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:52.485012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e0ef84c8-690a-42be-9923-413bc65ccbff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:52.496737 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e0ef84c8-690a-42be-9923-413bc65ccbff tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.824788 Jul 20 04:13:52.498916 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 692/1268] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:51 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:52.507548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-63c81e1e-24d0-4ba2-a8d8-4b8e2fff2e1c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:52.508135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-63c81e1e-24d0-4ba2-a8d8-4b8e2fff2e1c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:52.526701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63c81e1e-24d0-4ba2-a8d8-4b8e2fff2e1c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.530153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63c81e1e-24d0-4ba2-a8d8-4b8e2fff2e1c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.531323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63c81e1e-24d0-4ba2-a8d8-4b8e2fff2e1c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.533170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63c81e1e-24d0-4ba2-a8d8-4b8e2fff2e1c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.957971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-63c81e1e-24d0-4ba2-a8d8-4b8e2fff2e1c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:52.984201 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-63c81e1e-24d0-4ba2-a8d8-4b8e2fff2e1c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1477 microversion: 2.1 time: 0.481215 Jul 20 04:13:52.984963 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 693/1269] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:52 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1477 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:53.024635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a45638f3-d4c6-4e45-915c-82701dfb245c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:53.027864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a45638f3-d4c6-4e45-915c-82701dfb245c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 3572b1fb-62bb-4279-94d0-73fefdbb8b25] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:53.039163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a45638f3-d4c6-4e45-915c-82701dfb245c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:53.044661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a45638f3-d4c6-4e45-915c-82701dfb245c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:53.046743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a45638f3-d4c6-4e45-915c-82701dfb245c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:53.048995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a45638f3-d4c6-4e45-915c-82701dfb245c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:53.334403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a45638f3-d4c6-4e45-915c-82701dfb245c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:53.346868 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a45638f3-d4c6-4e45-915c-82701dfb245c tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/3572b1fb-62bb-4279-94d0-73fefdbb8b25" status: 200 len: 1475 microversion: 2.1 time: 0.344561 Jul 20 04:13:53.349330 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 694/1270] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:52 2022] GET /compute/v2.1/servers/3572b1fb-62bb-4279-94d0-73fefdbb8b25 => generated 1475 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:53.382123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-54e64b26-9e25-4da2-98fc-d166add6c27b req-f5113fd7-cd3d-462d-a2c2-8d6ba8f02102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be0a9e17-8828-4d64-ae7f-b481018a4bc6", "name": "network-vif-deleted", "tag": "9a24158e-2bd1-4825-887e-6ad9fe5b7a56"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:53.418883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-54e64b26-9e25-4da2-98fc-d166add6c27b req-f5113fd7-cd3d-462d-a2c2-8d6ba8f02102 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:53.419348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-54e64b26-9e25-4da2-98fc-d166add6c27b req-f5113fd7-cd3d-462d-a2c2-8d6ba8f02102 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:53.451906 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-54e64b26-9e25-4da2-98fc-d166add6c27b req-f5113fd7-cd3d-462d-a2c2-8d6ba8f02102 service nova] Creating event network-vif-deleted:9a24158e-2bd1-4825-887e-6ad9fe5b7a56 for instance be0a9e17-8828-4d64-ae7f-b481018a4bc6 on n-h1-826526-5 Jul 20 04:13:53.459568 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-54e64b26-9e25-4da2-98fc-d166add6c27b req-f5113fd7-cd3d-462d-a2c2-8d6ba8f02102 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108552 Jul 20 04:13:53.460534 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 695/1271] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:53.461713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-54e64b26-9e25-4da2-98fc-d166add6c27b req-f5113fd7-cd3d-462d-a2c2-8d6ba8f02102 service nova] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:53.462856 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-54e64b26-9e25-4da2-98fc-d166add6c27b req-f5113fd7-cd3d-462d-a2c2-8d6ba8f02102 service nova] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001257 Jul 20 04:13:53.482439 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 696/1272] 10.222.0.17 () {56 vars in 885 bytes} [Wed Jul 20 04:13:53 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 04:13:53.488177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0ebb5cce-e02c-4eb5-ad4f-85b95697b41a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54988f2e-b637-4389-bdf2-72552d43be28", "device": "/dev/xvdb"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:53.496255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0ebb5cce-e02c-4eb5-ad4f-85b95697b41a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:53.503808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ebb5cce-e02c-4eb5-ad4f-85b95697b41a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:53.504533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ebb5cce-e02c-4eb5-ad4f-85b95697b41a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:53.505777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ebb5cce-e02c-4eb5-ad4f-85b95697b41a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:53.506803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ebb5cce-e02c-4eb5-ad4f-85b95697b41a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:53.534533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:54.092217 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0ebb5cce-e02c-4eb5-ad4f-85b95697b41a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "POST /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.606038 Jul 20 04:13:54.096572 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 697/1273] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 04:13:53 2022] POST /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments => generated 194 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:54.131493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7c595278-dc82-4e90-8af1-65e3f74fa97e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:54.137740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7c595278-dc82-4e90-8af1-65e3f74fa97e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:54.168698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c595278-dc82-4e90-8af1-65e3f74fa97e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.169583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c595278-dc82-4e90-8af1-65e3f74fa97e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.174657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c595278-dc82-4e90-8af1-65e3f74fa97e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.175566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c595278-dc82-4e90-8af1-65e3f74fa97e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.938691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b51c6340-bae4-4181-82ae-2bccbe37d407 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:13:54.939536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b51c6340-bae4-4181-82ae-2bccbe37d407 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:13:54.940029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b51c6340-bae4-4181-82ae-2bccbe37d407 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:13:54.940510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b51c6340-bae4-4181-82ae-2bccbe37d407 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:13:54.940925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b51c6340-bae4-4181-82ae-2bccbe37d407 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:13:54.997287 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b51c6340-bae4-4181-82ae-2bccbe37d407 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.998908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b51c6340-bae4-4181-82ae-2bccbe37d407 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.004885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b51c6340-bae4-4181-82ae-2bccbe37d407 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.007410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b51c6340-bae4-4181-82ae-2bccbe37d407 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.022508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7c595278-dc82-4e90-8af1-65e3f74fa97e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:55.054828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-b51c6340-bae4-4181-82ae-2bccbe37d407 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Getting quotas for project 0c6f3b1899ec467a890b78a5db571f83. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:13:55.059522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7c595278-dc82-4e90-8af1-65e3f74fa97e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:55.067208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-b51c6340-bae4-4181-82ae-2bccbe37d407 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Getting quotas for user 5dff4ba44a4944f1b5955fb0bd9ba3bc and project 0c6f3b1899ec467a890b78a5db571f83. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:13:55.079738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7c595278-dc82-4e90-8af1-65e3f74fa97e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:55.081403 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7c595278-dc82-4e90-8af1-65e3f74fa97e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.983278 Jul 20 04:13:55.085179 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 698/1274] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:54 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:55.100067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b16ce759-fbfc-4ba9-b880-deb0dd2a7473 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:55.101463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b51c6340-bae4-4181-82ae-2bccbe37d407 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:13:55.101627 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b16ce759-fbfc-4ba9-b880-deb0dd2a7473 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:55.105513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b51c6340-bae4-4181-82ae-2bccbe37d407 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:13:55.114814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b16ce759-fbfc-4ba9-b880-deb0dd2a7473 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.116642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b16ce759-fbfc-4ba9-b880-deb0dd2a7473 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.117691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b16ce759-fbfc-4ba9-b880-deb0dd2a7473 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.118235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b16ce759-fbfc-4ba9-b880-deb0dd2a7473 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.237811 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b51c6340-bae4-4181-82ae-2bccbe37d407 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.767382 Jul 20 04:13:55.242160 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 577/1275] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:13:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 4792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:13:55.269395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c3a06c94-b6ca-498f-b99b-36275e46ab51 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:55.270223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c3a06c94-b6ca-498f-b99b-36275e46ab51 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 3572b1fb-62bb-4279-94d0-73fefdbb8b25] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:55.283211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3a06c94-b6ca-498f-b99b-36275e46ab51 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.287447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3a06c94-b6ca-498f-b99b-36275e46ab51 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.288591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3a06c94-b6ca-498f-b99b-36275e46ab51 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.291034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3a06c94-b6ca-498f-b99b-36275e46ab51 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.331014 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-c3a06c94-b6ca-498f-b99b-36275e46ab51 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] HTTP exception thrown: Instance 3572b1fb-62bb-4279-94d0-73fefdbb8b25 could not be found. Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c3a06c94-b6ca-498f-b99b-36275e46ab51 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Request method failure captured: Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/3572b1fb-62bb-4279-94d0-73fefdbb8b25 HTTP/1.1 Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14BYbIK69M9QpF--D95_1lTfRhnOuUdrNuf9ZGtS89PqLQE-ZpPsyevyV1J9PJ8fPkoxBjYpBD8ByKkWxfuU1DumzfqxVkNaMTwcjvGwsZWcAcQn-nN4PcnNEry3n6H2h9IuXiyBTWbGinbzMBZy_R-YCwAPdD1fsjbZp2vLGyR86Eg Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 22bcfd2698d047dea07c643970c749eb Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:13:55.333397 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:13:55.334959 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/22bcfd2698d047dea07c643970c749eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/22bcfd2698d047dea07c643970c749eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_22bcfd2698d047dea07c643970c749eb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/22bcfd2698d047dea07c643970c749eb"}]}] Jul 20 04:13:55.334959 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:55.334959 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 22bcfd2698d047dea07c643970c749eb Jul 20 04:13:55.334959 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:55.334959 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersOnMultiNodesTest-1348686041-project Jul 20 04:13:55.334959 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:13:55.334959 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:13:55.334959 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 5e178243e1ed404092e5ea0be39d5c16 Jul 20 04:13:55.334959 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersOnMultiNodesTest-1348686041-project Jul 20 04:13:55.334959 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:13:55.334959 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 3572b1fb-62bb-4279-94d0-73fefdbb8b25 could not be found. Jul 20 04:13:55.334959 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '3572b1fb-62bb-4279-94d0-73fefdbb8b25'} Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3572b1fb-62bb-4279-94d0-73fefdbb8b25 could not be found. Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:55.335737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:55.336976 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:55.336976 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:55.336976 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:55.336976 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:55.336976 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:55.336976 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:55.336976 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:55.336976 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3572b1fb-62bb-4279-94d0-73fefdbb8b25 could not be found. Jul 20 04:13:55.336976 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:55.336976 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:55.336976 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:55.336976 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:55.336976 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:55.336976 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:55.336976 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:55.336976 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:55.336976 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3572b1fb-62bb-4279-94d0-73fefdbb8b25 could not be found. Jul 20 04:13:55.336976 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:55.342043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c3a06c94-b6ca-498f-b99b-36275e46ab51 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Returning 404 to user: Instance 3572b1fb-62bb-4279-94d0-73fefdbb8b25 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:55.343262 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c3a06c94-b6ca-498f-b99b-36275e46ab51 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/3572b1fb-62bb-4279-94d0-73fefdbb8b25" status: 404 len: 111 microversion: 2.1 time: 0.099825 Jul 20 04:13:55.350510 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 578/1276] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:55 2022] GET /compute/v2.1/servers/3572b1fb-62bb-4279-94d0-73fefdbb8b25 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:55.355969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-db85e9d3-c221-414d-b422-52cb0641f402 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:55.361476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-db85e9d3-c221-414d-b422-52cb0641f402 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:55.563719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-db85e9d3-c221-414d-b422-52cb0641f402 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:55.576059 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-db85e9d3-c221-414d-b422-52cb0641f402 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1213 microversion: 2.1 time: 0.224045 Jul 20 04:13:55.576674 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 579/1277] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:55 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1213 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:55.589309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7810db8b-bb78-4231-b05d-0ed215a0c323 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:55.589910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7810db8b-bb78-4231-b05d-0ed215a0c323 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: be0a9e17-8828-4d64-ae7f-b481018a4bc6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:55.600222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7810db8b-bb78-4231-b05d-0ed215a0c323 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.600686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7810db8b-bb78-4231-b05d-0ed215a0c323 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.603899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7810db8b-bb78-4231-b05d-0ed215a0c323 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.606548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7810db8b-bb78-4231-b05d-0ed215a0c323 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.638796 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-7810db8b-bb78-4231-b05d-0ed215a0c323 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] HTTP exception thrown: Instance be0a9e17-8828-4d64-ae7f-b481018a4bc6 could not be found. Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7810db8b-bb78-4231-b05d-0ed215a0c323 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Request method failure captured: Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6 HTTP/1.1 Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14BYbIK69M9QpF--D95_1lTfRhnOuUdrNuf9ZGtS89PqLQE-ZpPsyevyV1J9PJ8fPkoxBjYpBD8ByKkWxfuU1DumzfqxVkNaMTwcjvGwsZWcAcQn-nN4PcnNEry3n6H2h9IuXiyBTWbGinbzMBZy_R-YCwAPdD1fsjbZp2vLGyR86Eg Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 22bcfd2698d047dea07c643970c749eb Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:13:55.641203 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:13:55.642644 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/22bcfd2698d047dea07c643970c749eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/22bcfd2698d047dea07c643970c749eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_22bcfd2698d047dea07c643970c749eb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/22bcfd2698d047dea07c643970c749eb"}]}] Jul 20 04:13:55.642644 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:55.642644 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 22bcfd2698d047dea07c643970c749eb Jul 20 04:13:55.642644 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:13:55.642644 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersOnMultiNodesTest-1348686041-project Jul 20 04:13:55.642644 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:13:55.642644 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:13:55.642644 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 5e178243e1ed404092e5ea0be39d5c16 Jul 20 04:13:55.642644 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersOnMultiNodesTest-1348686041-project Jul 20 04:13:55.642644 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:13:55.642644 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance be0a9e17-8828-4d64-ae7f-b481018a4bc6 could not be found. Jul 20 04:13:55.642644 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'be0a9e17-8828-4d64-ae7f-b481018a4bc6'} Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be0a9e17-8828-4d64-ae7f-b481018a4bc6 could not be found. Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:55.643382 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:55.644714 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:55.644714 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:55.644714 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:55.644714 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:55.644714 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:55.644714 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:55.644714 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:55.644714 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be0a9e17-8828-4d64-ae7f-b481018a4bc6 could not be found. Jul 20 04:13:55.644714 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:55.644714 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:55.644714 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:55.644714 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:55.644714 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:55.644714 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:55.644714 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:55.644714 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:55.644714 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be0a9e17-8828-4d64-ae7f-b481018a4bc6 could not be found. Jul 20 04:13:55.644714 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:13:55.647269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7810db8b-bb78-4231-b05d-0ed215a0c323 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Returning 404 to user: Instance be0a9e17-8828-4d64-ae7f-b481018a4bc6 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:55.648628 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7810db8b-bb78-4231-b05d-0ed215a0c323 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6" status: 404 len: 111 microversion: 2.1 time: 0.070791 Jul 20 04:13:55.649842 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 580/1278] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:55 2022] GET /compute/v2.1/servers/be0a9e17-8828-4d64-ae7f-b481018a4bc6 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:55.661728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-fb5cdf0f-fb73-4e00-8949-84d216d0a554 req-d18d3124-0e97-42dd-9a9b-e7e2492a3e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3572b1fb-62bb-4279-94d0-73fefdbb8b25", "name": "network-vif-deleted", "tag": "884bc047-b533-4f78-aa96-3bf5f6c73757"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:55.675757 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-fb5cdf0f-fb73-4e00-8949-84d216d0a554 req-d18d3124-0e97-42dd-9a9b-e7e2492a3e51 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.693183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-fb5cdf0f-fb73-4e00-8949-84d216d0a554 req-d18d3124-0e97-42dd-9a9b-e7e2492a3e51 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.712026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b16ce759-fbfc-4ba9-b880-deb0dd2a7473 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:55.721161 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-fb5cdf0f-fb73-4e00-8949-84d216d0a554 req-d18d3124-0e97-42dd-9a9b-e7e2492a3e51 service nova] Creating event network-vif-deleted:884bc047-b533-4f78-aa96-3bf5f6c73757 for instance 3572b1fb-62bb-4279-94d0-73fefdbb8b25 on n-h1-826526-5 Jul 20 04:13:55.725039 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b16ce759-fbfc-4ba9-b880-deb0dd2a7473 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1477 microversion: 2.1 time: 0.638170 Jul 20 04:13:55.730451 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-fb5cdf0f-fb73-4e00-8949-84d216d0a554 req-d18d3124-0e97-42dd-9a9b-e7e2492a3e51 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077766 Jul 20 04:13:55.732198 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 581/1279] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:55.735043 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 699/1280] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:55 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1477 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:55.740321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-487fd1c2-d708-4906-a51a-52b03d821d20 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:55.819315 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-487fd1c2-d708-4906-a51a-52b03d821d20 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/88729079-fa5f-46ba-b340-24992af9bb57" status: 204 len: 0 microversion: 2.1 time: 0.085063 Jul 20 04:13:55.820155 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 582/1281] 10.222.0.17 () {58 vars in 1265 bytes} [Wed Jul 20 04:13:55 2022] DELETE /compute/v2.1/os-server-groups/88729079-fa5f-46ba-b340-24992af9bb57 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:55.829832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-27af13ac-b902-4b09-ba21-598ba474ee90 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:55.830651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-27af13ac-b902-4b09-ba21-598ba474ee90 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:55.837477 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27af13ac-b902-4b09-ba21-598ba474ee90 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.841691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27af13ac-b902-4b09-ba21-598ba474ee90 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.842851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27af13ac-b902-4b09-ba21-598ba474ee90 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.843656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27af13ac-b902-4b09-ba21-598ba474ee90 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.914987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-27af13ac-b902-4b09-ba21-598ba474ee90 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:56.121774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2397b0eb-99fa-40b5-a04b-f9b51c8c3db6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:56.122583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2397b0eb-99fa-40b5-a04b-f9b51c8c3db6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:56.157842 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-27af13ac-b902-4b09-ba21-598ba474ee90 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "DELETE /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 204 len: 0 microversion: 2.1 time: 0.321584 Jul 20 04:13:56.160792 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 700/1282] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:55 2022] DELETE /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:56.164926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2397b0eb-99fa-40b5-a04b-f9b51c8c3db6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.165611 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2397b0eb-99fa-40b5-a04b-f9b51c8c3db6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.181716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2397b0eb-99fa-40b5-a04b-f9b51c8c3db6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.181716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2397b0eb-99fa-40b5-a04b-f9b51c8c3db6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.201351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7c82ff0d-25e0-47a2-96e8-addc719a5e68 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:56.205749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7c82ff0d-25e0-47a2-96e8-addc719a5e68 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:56.236572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c82ff0d-25e0-47a2-96e8-addc719a5e68 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.240238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c82ff0d-25e0-47a2-96e8-addc719a5e68 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.244372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c82ff0d-25e0-47a2-96e8-addc719a5e68 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.246058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c82ff0d-25e0-47a2-96e8-addc719a5e68 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.247538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7c82ff0d-25e0-47a2-96e8-addc719a5e68 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:57.257210 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7c82ff0d-25e0-47a2-96e8-addc719a5e68 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 200 len: 1470 microversion: 2.1 time: 1.083999 Jul 20 04:13:57.270430 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 701/1283] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:56 2022] GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 1470 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:57.275630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d5eb3f2f-0219-4928-8913-3fb5fb8bc5f9 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:57.276292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d5eb3f2f-0219-4928-8913-3fb5fb8bc5f9 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:57.302674 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5eb3f2f-0219-4928-8913-3fb5fb8bc5f9 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.313987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5eb3f2f-0219-4928-8913-3fb5fb8bc5f9 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.315285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5eb3f2f-0219-4928-8913-3fb5fb8bc5f9 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.315896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5eb3f2f-0219-4928-8913-3fb5fb8bc5f9 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.529628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d5eb3f2f-0219-4928-8913-3fb5fb8bc5f9 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:57.542495 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d5eb3f2f-0219-4928-8913-3fb5fb8bc5f9 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1273 microversion: 2.1 time: 0.270541 Jul 20 04:13:57.543807 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 702/1284] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:57 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1273 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:57.553646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-26f88cf9-61c9-4544-bf1f-96967253f789 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:57.554717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-26f88cf9-61c9-4544-bf1f-96967253f789 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:57.564717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26f88cf9-61c9-4544-bf1f-96967253f789 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.566919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26f88cf9-61c9-4544-bf1f-96967253f789 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.568227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26f88cf9-61c9-4544-bf1f-96967253f789 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.569058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26f88cf9-61c9-4544-bf1f-96967253f789 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.643339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2397b0eb-99fa-40b5-a04b-f9b51c8c3db6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:57.657789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2397b0eb-99fa-40b5-a04b-f9b51c8c3db6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:57.664053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2397b0eb-99fa-40b5-a04b-f9b51c8c3db6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:57.665700 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2397b0eb-99fa-40b5-a04b-f9b51c8c3db6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 1.560217 Jul 20 04:13:57.677298 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 583/1285] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:56 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:57.865489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-26f88cf9-61c9-4544-bf1f-96967253f789 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:57.888058 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-26f88cf9-61c9-4544-bf1f-96967253f789 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1476 microversion: 2.1 time: 0.335391 Jul 20 04:13:57.888962 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 703/1286] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:57 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1476 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:57.905620 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-12fdc2f2-bf76-434a-8123-1e2a586913bc req-962857ea-19c9-4aaa-8ad2-99328e29ce97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96067d54-1e58-49cf-b7e9-7fbc5c86df79", "name": "network-vif-unplugged", "status": "completed", "tag": "9f32aa7e-a422-4132-a2e3-e55d9f1c8cdb"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:57.917817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-12fdc2f2-bf76-434a-8123-1e2a586913bc req-962857ea-19c9-4aaa-8ad2-99328e29ce97 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.918584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-12fdc2f2-bf76-434a-8123-1e2a586913bc req-962857ea-19c9-4aaa-8ad2-99328e29ce97 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.946387 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-12fdc2f2-bf76-434a-8123-1e2a586913bc req-962857ea-19c9-4aaa-8ad2-99328e29ce97 service nova] Creating event network-vif-unplugged:9f32aa7e-a422-4132-a2e3-e55d9f1c8cdb for instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 on n-h1-826526-5 Jul 20 04:13:57.985671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [req-12fdc2f2-bf76-434a-8123-1e2a586913bc req-962857ea-19c9-4aaa-8ad2-99328e29ce97 service nova] Instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:13:58.001748 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-12fdc2f2-bf76-434a-8123-1e2a586913bc req-962857ea-19c9-4aaa-8ad2-99328e29ce97 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101670 Jul 20 04:13:58.006039 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 584/1287] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:58.283379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4e04bd8a-271b-4c53-8276-71c6e68207b0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:58.286150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4e04bd8a-271b-4c53-8276-71c6e68207b0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:58.300459 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e04bd8a-271b-4c53-8276-71c6e68207b0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.302208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e04bd8a-271b-4c53-8276-71c6e68207b0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.305122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e04bd8a-271b-4c53-8276-71c6e68207b0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.306674 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e04bd8a-271b-4c53-8276-71c6e68207b0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.562106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6fa93217-f23f-493c-8eb9-4cf149415914 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:58.563491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6fa93217-f23f-493c-8eb9-4cf149415914 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:58.583586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6fa93217-f23f-493c-8eb9-4cf149415914 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.585233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6fa93217-f23f-493c-8eb9-4cf149415914 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.587089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6fa93217-f23f-493c-8eb9-4cf149415914 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.588936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6fa93217-f23f-493c-8eb9-4cf149415914 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.598582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4e04bd8a-271b-4c53-8276-71c6e68207b0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:58.609081 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4e04bd8a-271b-4c53-8276-71c6e68207b0 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 200 len: 1470 microversion: 2.1 time: 0.330583 Jul 20 04:13:58.610870 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 704/1288] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:58 2022] GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 1470 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:58.684962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8cdd06f7-8706-4519-82ca-bddd085a44b4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:58.685935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8cdd06f7-8706-4519-82ca-bddd085a44b4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:58.698288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8cdd06f7-8706-4519-82ca-bddd085a44b4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.698927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8cdd06f7-8706-4519-82ca-bddd085a44b4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.699784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8cdd06f7-8706-4519-82ca-bddd085a44b4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.700341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8cdd06f7-8706-4519-82ca-bddd085a44b4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.874704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6fa93217-f23f-493c-8eb9-4cf149415914 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:58.885904 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6fa93217-f23f-493c-8eb9-4cf149415914 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1271 microversion: 2.1 time: 0.328637 Jul 20 04:13:58.889238 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 585/1289] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:58 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1271 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:58.906021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d4c81da-ed69-46d5-aa0a-d14921cbeea6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:58.907140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d4c81da-ed69-46d5-aa0a-d14921cbeea6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:58.919249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d4c81da-ed69-46d5-aa0a-d14921cbeea6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.919714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d4c81da-ed69-46d5-aa0a-d14921cbeea6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.923808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d4c81da-ed69-46d5-aa0a-d14921cbeea6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.924411 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d4c81da-ed69-46d5-aa0a-d14921cbeea6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.022609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8cdd06f7-8706-4519-82ca-bddd085a44b4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:59.032160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8cdd06f7-8706-4519-82ca-bddd085a44b4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:59.038430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8cdd06f7-8706-4519-82ca-bddd085a44b4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:59.041689 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8cdd06f7-8706-4519-82ca-bddd085a44b4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.360680 Jul 20 04:13:59.044603 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 705/1290] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:58 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:13:59.058570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-4442a093-3d08-43d4-a825-a284da86e3ee req-1c6c8d88-b641-4d6a-8377-8d540762d7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23481b1e-fe28-4f48-84fe-f22cae89ac46", "name": "network-vif-unplugged", "status": "completed", "tag": "c0138b21-0419-4d11-b080-80dc6be43c19"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:59.072968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4442a093-3d08-43d4-a825-a284da86e3ee req-1c6c8d88-b641-4d6a-8377-8d540762d7f2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.078348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4442a093-3d08-43d4-a825-a284da86e3ee req-1c6c8d88-b641-4d6a-8377-8d540762d7f2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.121677 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-4442a093-3d08-43d4-a825-a284da86e3ee req-1c6c8d88-b641-4d6a-8377-8d540762d7f2 service nova] Creating event network-vif-unplugged:c0138b21-0419-4d11-b080-80dc6be43c19 for instance 23481b1e-fe28-4f48-84fe-f22cae89ac46 on n-h2-826526-5 Jul 20 04:13:59.127195 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-4442a093-3d08-43d4-a825-a284da86e3ee req-1c6c8d88-b641-4d6a-8377-8d540762d7f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072985 Jul 20 04:13:59.131160 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 706/1291] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:59.359971 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d4c81da-ed69-46d5-aa0a-d14921cbeea6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:59.370603 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d4c81da-ed69-46d5-aa0a-d14921cbeea6 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1476 microversion: 2.1 time: 0.468261 Jul 20 04:13:59.371477 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 586/1292] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:58 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1476 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:59.636437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e315cdcf-4f5a-4751-b828-202824705e95 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:59.637877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e315cdcf-4f5a-4751-b828-202824705e95 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:59.648253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e315cdcf-4f5a-4751-b828-202824705e95 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.649365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e315cdcf-4f5a-4751-b828-202824705e95 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.650547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e315cdcf-4f5a-4751-b828-202824705e95 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.651410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e315cdcf-4f5a-4751-b828-202824705e95 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.732040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e315cdcf-4f5a-4751-b828-202824705e95 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e178243e1ed404092e5ea0be39d5c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bcfd2698d047dea07c643970c749eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:59.745384 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e315cdcf-4f5a-4751-b828-202824705e95 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 200 len: 1428 microversion: 2.1 time: 0.116394 Jul 20 04:13:59.745975 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 707/1293] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:59 2022] GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 1428 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:59.909940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-35563247-d219-4b5f-b759-ce490ff05b26 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:59.913140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-35563247-d219-4b5f-b759-ce490ff05b26 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:59.928021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35563247-d219-4b5f-b759-ce490ff05b26 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.928808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35563247-d219-4b5f-b759-ce490ff05b26 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.930559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35563247-d219-4b5f-b759-ce490ff05b26 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.931358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35563247-d219-4b5f-b759-ce490ff05b26 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.064314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d2fd959f-087e-4db6-8f61-ff2bc2f8ea98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:00.065329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d2fd959f-087e-4db6-8f61-ff2bc2f8ea98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:00.095911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2fd959f-087e-4db6-8f61-ff2bc2f8ea98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.098748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2fd959f-087e-4db6-8f61-ff2bc2f8ea98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.101173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2fd959f-087e-4db6-8f61-ff2bc2f8ea98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.102518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2fd959f-087e-4db6-8f61-ff2bc2f8ea98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.344975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-35563247-d219-4b5f-b759-ce490ff05b26 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:00.345462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d2fd959f-087e-4db6-8f61-ff2bc2f8ea98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:00.366582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d2fd959f-087e-4db6-8f61-ff2bc2f8ea98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:00.367350 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-35563247-d219-4b5f-b759-ce490ff05b26 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1313 microversion: 2.1 time: 0.458737 Jul 20 04:14:00.384534 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 587/1294] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:59 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:00.392365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d2fd959f-087e-4db6-8f61-ff2bc2f8ea98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:00.400338 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d2fd959f-087e-4db6-8f61-ff2bc2f8ea98 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.342339 Jul 20 04:14:00.415520 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 708/1295] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:00 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:00.429061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-844447ca-38ad-4e3d-9b4f-9b818a69360d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:00.429985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-844447ca-38ad-4e3d-9b4f-9b818a69360d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:00.432853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-ced7aef3-2a0d-4f06-a9fa-749db0837fe3 req-c8d46fbe-5110-49bc-b234-86d3708c3fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96067d54-1e58-49cf-b7e9-7fbc5c86df79", "tag": "9f32aa7e-a422-4132-a2e3-e55d9f1c8cdb"}, {"server_uuid": "23481b1e-fe28-4f48-84fe-f22cae89ac46", "name": "network-vif-deleted", "tag": "c0138b21-0419-4d11-b080-80dc6be43c19"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:00.443001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-844447ca-38ad-4e3d-9b4f-9b818a69360d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.456996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-844447ca-38ad-4e3d-9b4f-9b818a69360d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.457777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-844447ca-38ad-4e3d-9b4f-9b818a69360d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.458287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-844447ca-38ad-4e3d-9b4f-9b818a69360d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.458427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ced7aef3-2a0d-4f06-a9fa-749db0837fe3 req-c8d46fbe-5110-49bc-b234-86d3708c3fea service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.458761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ced7aef3-2a0d-4f06-a9fa-749db0837fe3 req-c8d46fbe-5110-49bc-b234-86d3708c3fea service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.507803 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-ced7aef3-2a0d-4f06-a9fa-749db0837fe3 req-c8d46fbe-5110-49bc-b234-86d3708c3fea service nova] Creating event network-changed:9f32aa7e-a422-4132-a2e3-e55d9f1c8cdb for instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 on n-h1-826526-5 Jul 20 04:14:00.508956 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-ced7aef3-2a0d-4f06-a9fa-749db0837fe3 req-c8d46fbe-5110-49bc-b234-86d3708c3fea service nova] Creating event network-vif-deleted:c0138b21-0419-4d11-b080-80dc6be43c19 for instance 23481b1e-fe28-4f48-84fe-f22cae89ac46 on n-h2-826526-5 Jul 20 04:14:00.530804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [req-ced7aef3-2a0d-4f06-a9fa-749db0837fe3 req-c8d46fbe-5110-49bc-b234-86d3708c3fea service nova] Instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:14:00.567503 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-ced7aef3-2a0d-4f06-a9fa-749db0837fe3 req-c8d46fbe-5110-49bc-b234-86d3708c3fea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.180770 Jul 20 04:14:00.568638 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 588/1296] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:00.681035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-844447ca-38ad-4e3d-9b4f-9b818a69360d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:00.692588 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-844447ca-38ad-4e3d-9b4f-9b818a69360d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1474 microversion: 2.1 time: 0.275628 Jul 20 04:14:00.701464 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 709/1297] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:00 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1474 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:00.766465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b7eb41c2-5afa-4d54-9328-85475b9cc652 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:00.767372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b7eb41c2-5afa-4d54-9328-85475b9cc652 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] [instance: 23481b1e-fe28-4f48-84fe-f22cae89ac46] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:00.784539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b7eb41c2-5afa-4d54-9328-85475b9cc652 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.786913 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b7eb41c2-5afa-4d54-9328-85475b9cc652 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.790026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b7eb41c2-5afa-4d54-9328-85475b9cc652 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.794015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b7eb41c2-5afa-4d54-9328-85475b9cc652 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.815920 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-b7eb41c2-5afa-4d54-9328-85475b9cc652 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] HTTP exception thrown: Instance 23481b1e-fe28-4f48-84fe-f22cae89ac46 could not be found. Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b7eb41c2-5afa-4d54-9328-85475b9cc652 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Request method failure captured: Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 HTTP/1.1 Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14BYbIK69M9QpF--D95_1lTfRhnOuUdrNuf9ZGtS89PqLQE-ZpPsyevyV1J9PJ8fPkoxBjYpBD8ByKkWxfuU1DumzfqxVkNaMTwcjvGwsZWcAcQn-nN4PcnNEry3n6H2h9IuXiyBTWbGinbzMBZy_R-YCwAPdD1fsjbZp2vLGyR86Eg Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 22bcfd2698d047dea07c643970c749eb Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:14:00.818914 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:14:00.820575 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/22bcfd2698d047dea07c643970c749eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/22bcfd2698d047dea07c643970c749eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_22bcfd2698d047dea07c643970c749eb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/22bcfd2698d047dea07c643970c749eb"}]}] Jul 20 04:14:00.820575 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:14:00.820575 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 22bcfd2698d047dea07c643970c749eb Jul 20 04:14:00.820575 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1348686041 Jul 20 04:14:00.820575 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersOnMultiNodesTest-1348686041-project Jul 20 04:14:00.820575 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:14:00.820575 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:14:00.820575 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 5e178243e1ed404092e5ea0be39d5c16 Jul 20 04:14:00.820575 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersOnMultiNodesTest-1348686041-project Jul 20 04:14:00.820575 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:14:00.820575 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 23481b1e-fe28-4f48-84fe-f22cae89ac46 could not be found. Jul 20 04:14:00.820575 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '23481b1e-fe28-4f48-84fe-f22cae89ac46'} Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23481b1e-fe28-4f48-84fe-f22cae89ac46 could not be found. Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:00.821449 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:00.823816 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:00.823816 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:00.823816 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:00.823816 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:00.823816 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:00.823816 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:00.823816 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:00.823816 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23481b1e-fe28-4f48-84fe-f22cae89ac46 could not be found. Jul 20 04:14:00.823816 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.823816 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:00.823816 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.823816 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.823816 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:00.823816 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:00.823816 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:00.823816 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:00.823816 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23481b1e-fe28-4f48-84fe-f22cae89ac46 could not be found. Jul 20 04:14:00.823816 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.827283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b7eb41c2-5afa-4d54-9328-85475b9cc652 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] Returning 404 to user: Instance 23481b1e-fe28-4f48-84fe-f22cae89ac46 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:00.828216 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b7eb41c2-5afa-4d54-9328-85475b9cc652 tempest-ServersOnMultiNodesTest-1348686041 tempest-ServersOnMultiNodesTest-1348686041-project] 10.222.0.17 "GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46" status: 404 len: 111 microversion: 2.1 time: 0.068533 Jul 20 04:14:00.828820 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 710/1298] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:00 2022] GET /compute/v2.1/servers/23481b1e-fe28-4f48-84fe-f22cae89ac46 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:14:00.911654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3714d357-a504-42ae-9696-05bf6e049fa2 tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Calling method '.version_select at 0x7f06be164e50>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:00.914476 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:00.914476 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:14:00.916303 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3714d357-a504-42ae-9696-05bf6e049fa2 tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.919533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3714d357-a504-42ae-9696-05bf6e049fa2 tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.952064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3714d357-a504-42ae-9696-05bf6e049fa2 tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.952795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3714d357-a504-42ae-9696-05bf6e049fa2 tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.016758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3714d357-a504-42ae-9696-05bf6e049fa2 tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.017220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3714d357-a504-42ae-9696-05bf6e049fa2 tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.038781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3714d357-a504-42ae-9696-05bf6e049fa2 tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.039823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3714d357-a504-42ae-9696-05bf6e049fa2 tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.105547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3714d357-a504-42ae-9696-05bf6e049fa2 tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.106469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3714d357-a504-42ae-9696-05bf6e049fa2 tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.124308 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3714d357-a504-42ae-9696-05bf6e049fa2 tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2546 microversion: 2.53 time: 0.387357 Jul 20 04:14:01.132575 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 589/1299] 10.222.0.17 () {60 vars in 1242 bytes} [Wed Jul 20 04:14:00 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2546 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:01.141994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b15a7e1a-5670-4dcf-a305-e981aff5b74e tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Calling method '.version_select at 0x7f06bdd141f0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:01.143899 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:01.143899 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:14:01.145124 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b15a7e1a-5670-4dcf-a305-e981aff5b74e tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.145771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b15a7e1a-5670-4dcf-a305-e981aff5b74e tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.180288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b15a7e1a-5670-4dcf-a305-e981aff5b74e tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.180740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b15a7e1a-5670-4dcf-a305-e981aff5b74e tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.258137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b15a7e1a-5670-4dcf-a305-e981aff5b74e tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.258592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b15a7e1a-5670-4dcf-a305-e981aff5b74e tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.290394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b15a7e1a-5670-4dcf-a305-e981aff5b74e tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.291078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b15a7e1a-5670-4dcf-a305-e981aff5b74e tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.317854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:01.374263 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b15a7e1a-5670-4dcf-a305-e981aff5b74e tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.380523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b15a7e1a-5670-4dcf-a305-e981aff5b74e tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.385464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-25cc3782-4c5f-48cc-90b6-837e710ba4ab tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:01.386661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-25cc3782-4c5f-48cc-90b6-837e710ba4ab tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:01.393074 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b15a7e1a-5670-4dcf-a305-e981aff5b74e tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1239 microversion: 2.53 time: 0.255458 Jul 20 04:14:01.403361 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 711/1300] 10.222.0.17 () {60 vars in 1221 bytes} [Wed Jul 20 04:14:01 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1239 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:01.407845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25cc3782-4c5f-48cc-90b6-837e710ba4ab tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.407985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2a194e47-e098-4130-b250-fb28037dd081 tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Calling method '.version_select at 0x7f06be301ca0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:01.408930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25cc3782-4c5f-48cc-90b6-837e710ba4ab tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.409321 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:01.409321 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:14:01.410661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2a194e47-e098-4130-b250-fb28037dd081 tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.411173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2a194e47-e098-4130-b250-fb28037dd081 tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.411881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25cc3782-4c5f-48cc-90b6-837e710ba4ab tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.414744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25cc3782-4c5f-48cc-90b6-837e710ba4ab tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.446798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2a194e47-e098-4130-b250-fb28037dd081 tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.449900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2a194e47-e098-4130-b250-fb28037dd081 tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.466602 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2a194e47-e098-4130-b250-fb28037dd081 tempest-HypervisorAdminV253TestBase-836727456 tempest-HypervisorAdminV253TestBase-836727456-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/c88bc321-8a49-476b-9400-f0e82cf934dc" status: 200 len: 791 microversion: 2.53 time: 0.062096 Jul 20 04:14:01.469160 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 712/1301] 10.222.0.17 () {60 vars in 1297 bytes} [Wed Jul 20 04:14:01 2022] GET /compute/v2.1/os-hypervisors/c88bc321-8a49-476b-9400-f0e82cf934dc => generated 791 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:14:01.477766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-60ac5658-341f-448b-a16e-f2786ab45b40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:01.478378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-60ac5658-341f-448b-a16e-f2786ab45b40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:01.499911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60ac5658-341f-448b-a16e-f2786ab45b40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.500798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60ac5658-341f-448b-a16e-f2786ab45b40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.504547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60ac5658-341f-448b-a16e-f2786ab45b40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.505777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60ac5658-341f-448b-a16e-f2786ab45b40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.787487 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-60ac5658-341f-448b-a16e-f2786ab45b40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:01.801196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-60ac5658-341f-448b-a16e-f2786ab45b40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:01.803207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-60ac5658-341f-448b-a16e-f2786ab45b40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:01.804632 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-60ac5658-341f-448b-a16e-f2786ab45b40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.330636 Jul 20 04:14:01.817772 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 713/1302] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:01 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:01.823467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3a9a4c98-de26-4d50-be6c-4595cdb71ae6 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:01.828002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3a9a4c98-de26-4d50-be6c-4595cdb71ae6 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:01.828922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3a9a4c98-de26-4d50-be6c-4595cdb71ae6 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Searching by: {'deleted': False, 'project_id': 'e8e6c6d2c2124397b105566e4d908026'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:14:01.834825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a9a4c98-de26-4d50-be6c-4595cdb71ae6 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.835511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a9a4c98-de26-4d50-be6c-4595cdb71ae6 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.836521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a9a4c98-de26-4d50-be6c-4595cdb71ae6 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.837114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a9a4c98-de26-4d50-be6c-4595cdb71ae6 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.992980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-3a9a4c98-de26-4d50-be6c-4595cdb71ae6 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:14:02.073085 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3a9a4c98-de26-4d50-be6c-4595cdb71ae6 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.253971 Jul 20 04:14:02.080170 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 714/1303] 10.222.0.17 () {58 vars in 1124 bytes} [Wed Jul 20 04:14:01 2022] GET /compute/v2.1/servers => generated 339 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:02.087057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-623dc758-a3b9-4baa-8298-01fbf2fd171f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:02.088100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-623dc758-a3b9-4baa-8298-01fbf2fd171f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:02.095979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-623dc758-a3b9-4baa-8298-01fbf2fd171f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.096726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-623dc758-a3b9-4baa-8298-01fbf2fd171f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.097694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-623dc758-a3b9-4baa-8298-01fbf2fd171f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.098316 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-623dc758-a3b9-4baa-8298-01fbf2fd171f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.338351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-623dc758-a3b9-4baa-8298-01fbf2fd171f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:02.363473 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-623dc758-a3b9-4baa-8298-01fbf2fd171f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1471 microversion: 2.1 time: 0.278869 Jul 20 04:14:02.367859 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 715/1304] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:02 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1471 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:02.391799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ee2f773b-e9f9-41c6-9cf0-7cac471ad657 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:02.415933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ee2f773b-e9f9-41c6-9cf0-7cac471ad657 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:02.419248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ee2f773b-e9f9-41c6-9cf0-7cac471ad657 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Searching by: {'deleted': False, 'project_id': 'e8e6c6d2c2124397b105566e4d908026'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:14:02.438122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee2f773b-e9f9-41c6-9cf0-7cac471ad657 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.440118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee2f773b-e9f9-41c6-9cf0-7cac471ad657 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.441743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee2f773b-e9f9-41c6-9cf0-7cac471ad657 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.443749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee2f773b-e9f9-41c6-9cf0-7cac471ad657 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.792382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-25cc3782-4c5f-48cc-90b6-837e710ba4ab tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:02.808566 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-25cc3782-4c5f-48cc-90b6-837e710ba4ab tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1313 microversion: 2.1 time: 1.427222 Jul 20 04:14:02.812755 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 590/1305] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:01 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1313 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:02.826739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8ec06fd0-4d7e-45e7-a3de-1f606107e670 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:02.828365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8ec06fd0-4d7e-45e7-a3de-1f606107e670 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:02.847200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8ec06fd0-4d7e-45e7-a3de-1f606107e670 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.849237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8ec06fd0-4d7e-45e7-a3de-1f606107e670 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.853314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8ec06fd0-4d7e-45e7-a3de-1f606107e670 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.867536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8ec06fd0-4d7e-45e7-a3de-1f606107e670 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.921036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-ee2f773b-e9f9-41c6-9cf0-7cac471ad657 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:14:02.993654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:03.005802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ee2f773b-e9f9-41c6-9cf0-7cac471ad657 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:03.014539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee2f773b-e9f9-41c6-9cf0-7cac471ad657 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.015257 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee2f773b-e9f9-41c6-9cf0-7cac471ad657 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.189568 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8ec06fd0-4d7e-45e7-a3de-1f606107e670 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "POST /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79/action" status: 202 len: 0 microversion: 2.1 time: 0.373664 Jul 20 04:14:03.191774 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 591/1306] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:14:02 2022] POST /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:03.213405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c6920781-2b9e-4358-8621-de234d88b72e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:03.216973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c6920781-2b9e-4358-8621-de234d88b72e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:03.242248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6920781-2b9e-4358-8621-de234d88b72e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.245732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6920781-2b9e-4358-8621-de234d88b72e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.250216 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6920781-2b9e-4358-8621-de234d88b72e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.251743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6920781-2b9e-4358-8621-de234d88b72e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.318625 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ee2f773b-e9f9-41c6-9cf0-7cac471ad657 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.948588 Jul 20 04:14:03.321605 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 716/1307] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:02 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:03.338153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b76a067-44d2-4ccd-b724-4bd4240a08cf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:03.339166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9b76a067-44d2-4ccd-b724-4bd4240a08cf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:03.352594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b76a067-44d2-4ccd-b724-4bd4240a08cf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.354045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b76a067-44d2-4ccd-b724-4bd4240a08cf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.355148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b76a067-44d2-4ccd-b724-4bd4240a08cf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.356021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b76a067-44d2-4ccd-b724-4bd4240a08cf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.694508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9b76a067-44d2-4ccd-b724-4bd4240a08cf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:03.705675 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9b76a067-44d2-4ccd-b724-4bd4240a08cf tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1470 microversion: 2.1 time: 0.382303 Jul 20 04:14:03.707591 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 717/1308] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:03 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1470 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:03.714526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f64a5c5e-5675-473a-aba1-0f805be1c5a2 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:03.728743 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f64a5c5e-5675-473a-aba1-0f805be1c5a2 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019520 Jul 20 04:14:03.730125 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 718/1309] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:14:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:03.910475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c6920781-2b9e-4358-8621-de234d88b72e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:03.932127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c6920781-2b9e-4358-8621-de234d88b72e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:03.934823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c6920781-2b9e-4358-8621-de234d88b72e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:03.936805 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c6920781-2b9e-4358-8621-de234d88b72e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.741358 Jul 20 04:14:03.950104 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 592/1310] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:03 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:03.956130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-10339398-bf0e-448c-b8b6-d73fcb727178 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:03.956993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-10339398-bf0e-448c-b8b6-d73fcb727178 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:03.964793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10339398-bf0e-448c-b8b6-d73fcb727178 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.965647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10339398-bf0e-448c-b8b6-d73fcb727178 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.967267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10339398-bf0e-448c-b8b6-d73fcb727178 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.967948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10339398-bf0e-448c-b8b6-d73fcb727178 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.066876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a72e2981-af06-4921-bf2b-7c33fa1985b2 tempest-PortsAdminExtendedAttrsTestJSON-448767536 tempest-PortsAdminExtendedAttrsTestJSON-448767536-project-admin] Calling method '.version_select at 0x7f06bdf22a60>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:04.067739 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:04.067739 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:14:04.068998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a72e2981-af06-4921-bf2b-7c33fa1985b2 tempest-PortsAdminExtendedAttrsTestJSON-448767536 tempest-PortsAdminExtendedAttrsTestJSON-448767536-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.069452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a72e2981-af06-4921-bf2b-7c33fa1985b2 tempest-PortsAdminExtendedAttrsTestJSON-448767536 tempest-PortsAdminExtendedAttrsTestJSON-448767536-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.101774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a72e2981-af06-4921-bf2b-7c33fa1985b2 tempest-PortsAdminExtendedAttrsTestJSON-448767536 tempest-PortsAdminExtendedAttrsTestJSON-448767536-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.103123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a72e2981-af06-4921-bf2b-7c33fa1985b2 tempest-PortsAdminExtendedAttrsTestJSON-448767536 tempest-PortsAdminExtendedAttrsTestJSON-448767536-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.159735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a72e2981-af06-4921-bf2b-7c33fa1985b2 tempest-PortsAdminExtendedAttrsTestJSON-448767536 tempest-PortsAdminExtendedAttrsTestJSON-448767536-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.162468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a72e2981-af06-4921-bf2b-7c33fa1985b2 tempest-PortsAdminExtendedAttrsTestJSON-448767536 tempest-PortsAdminExtendedAttrsTestJSON-448767536-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.182416 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a72e2981-af06-4921-bf2b-7c33fa1985b2 tempest-PortsAdminExtendedAttrsTestJSON-448767536 tempest-PortsAdminExtendedAttrsTestJSON-448767536-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.450967 Jul 20 04:14:04.188340 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 719/1311] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:04.209311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-70817b1c-9d09-4d9e-8913-f96aa9c1fa81 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:04.210058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-70817b1c-9d09-4d9e-8913-f96aa9c1fa81 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:04.229292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70817b1c-9d09-4d9e-8913-f96aa9c1fa81 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.230190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70817b1c-9d09-4d9e-8913-f96aa9c1fa81 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.233876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70817b1c-9d09-4d9e-8913-f96aa9c1fa81 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.237432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70817b1c-9d09-4d9e-8913-f96aa9c1fa81 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.327731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-70817b1c-9d09-4d9e-8913-f96aa9c1fa81 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:04.477373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-10339398-bf0e-448c-b8b6-d73fcb727178 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:04.486110 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-10339398-bf0e-448c-b8b6-d73fcb727178 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1334 microversion: 2.1 time: 0.534172 Jul 20 04:14:04.488163 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 593/1312] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:03 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1334 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:04.511193 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-70817b1c-9d09-4d9e-8913-f96aa9c1fa81 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 204 len: 0 microversion: 2.1 time: 0.320418 Jul 20 04:14:04.514625 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 720/1313] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:04 2022] DELETE /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:04.520603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e7acf297-e0b6-48a5-97ae-595513cc6401 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:04.521442 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e7acf297-e0b6-48a5-97ae-595513cc6401 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:04.529168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7acf297-e0b6-48a5-97ae-595513cc6401 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.542928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7acf297-e0b6-48a5-97ae-595513cc6401 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.544228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7acf297-e0b6-48a5-97ae-595513cc6401 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.546285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7acf297-e0b6-48a5-97ae-595513cc6401 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.571359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-9d8756ec-54bc-4752-a6e2-b7220378c3ab req-d88fc0b4-5b92-4ecb-9533-3f4a7dd07711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96067d54-1e58-49cf-b7e9-7fbc5c86df79", "name": "network-vif-plugged", "status": "completed", "tag": "9f32aa7e-a422-4132-a2e3-e55d9f1c8cdb"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:04.593732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9d8756ec-54bc-4752-a6e2-b7220378c3ab req-d88fc0b4-5b92-4ecb-9533-3f4a7dd07711 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.594362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9d8756ec-54bc-4752-a6e2-b7220378c3ab req-d88fc0b4-5b92-4ecb-9533-3f4a7dd07711 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.627137 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9d8756ec-54bc-4752-a6e2-b7220378c3ab req-d88fc0b4-5b92-4ecb-9533-3f4a7dd07711 service nova] Creating event network-vif-plugged:9f32aa7e-a422-4132-a2e3-e55d9f1c8cdb for instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 on n-h1-826526-5 Jul 20 04:14:04.643616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-9d8756ec-54bc-4752-a6e2-b7220378c3ab req-d88fc0b4-5b92-4ecb-9533-3f4a7dd07711 service nova] Instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:14:04.656893 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-9d8756ec-54bc-4752-a6e2-b7220378c3ab req-d88fc0b4-5b92-4ecb-9533-3f4a7dd07711 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102544 Jul 20 04:14:04.658668 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 721/1314] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:04.733448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-42cc67fe-9be4-41ed-84a0-e67ba0e2e3f3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:04.734193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-42cc67fe-9be4-41ed-84a0-e67ba0e2e3f3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:04.745385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42cc67fe-9be4-41ed-84a0-e67ba0e2e3f3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.746968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42cc67fe-9be4-41ed-84a0-e67ba0e2e3f3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.747960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42cc67fe-9be4-41ed-84a0-e67ba0e2e3f3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.748587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42cc67fe-9be4-41ed-84a0-e67ba0e2e3f3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.021028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e7acf297-e0b6-48a5-97ae-595513cc6401 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:05.033417 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e7acf297-e0b6-48a5-97ae-595513cc6401 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1712 microversion: 2.1 time: 0.516995 Jul 20 04:14:05.036330 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 594/1315] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:04 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1712 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:05.047156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a2d77b2a-9ce3-43f5-ba9d-5da10f3e37be tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:05.049636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a2d77b2a-9ce3-43f5-ba9d-5da10f3e37be tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:05.063532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:05.068826 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2d77b2a-9ce3-43f5-ba9d-5da10f3e37be tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.069608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2d77b2a-9ce3-43f5-ba9d-5da10f3e37be tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.074215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2d77b2a-9ce3-43f5-ba9d-5da10f3e37be tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.074861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2d77b2a-9ce3-43f5-ba9d-5da10f3e37be tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.105977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:05.445996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a2d77b2a-9ce3-43f5-ba9d-5da10f3e37be tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:05.457054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a2d77b2a-9ce3-43f5-ba9d-5da10f3e37be tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:05.458553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a2d77b2a-9ce3-43f5-ba9d-5da10f3e37be tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:05.459734 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a2d77b2a-9ce3-43f5-ba9d-5da10f3e37be tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.422234 Jul 20 04:14:05.470750 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 595/1316] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:05 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:05.489101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-42cc67fe-9be4-41ed-84a0-e67ba0e2e3f3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:05.501666 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-42cc67fe-9be4-41ed-84a0-e67ba0e2e3f3 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1470 microversion: 2.1 time: 0.780355 Jul 20 04:14:05.507357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7aa4eed8-0f14-4eac-b211-4a7892e84225 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:05.508408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7aa4eed8-0f14-4eac-b211-4a7892e84225 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:05.514528 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 722/1317] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:04 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1470 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:05.517582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7aa4eed8-0f14-4eac-b211-4a7892e84225 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.518312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7aa4eed8-0f14-4eac-b211-4a7892e84225 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.520430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7aa4eed8-0f14-4eac-b211-4a7892e84225 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.521187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7aa4eed8-0f14-4eac-b211-4a7892e84225 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.570652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:06.012153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7aa4eed8-0f14-4eac-b211-4a7892e84225 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:06.020643 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7aa4eed8-0f14-4eac-b211-4a7892e84225 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1334 microversion: 2.1 time: 0.517567 Jul 20 04:14:06.028115 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 596/1318] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:05 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1334 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:06.074787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-afb8cb79-d228-46fc-943f-ae54b922dae3 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:06.075971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-afb8cb79-d228-46fc-943f-ae54b922dae3 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:06.135378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afb8cb79-d228-46fc-943f-ae54b922dae3 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.138416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afb8cb79-d228-46fc-943f-ae54b922dae3 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.141211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afb8cb79-d228-46fc-943f-ae54b922dae3 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.153116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afb8cb79-d228-46fc-943f-ae54b922dae3 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.478515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-55a285da-4b0a-4d3f-a568-bfb47d3da443 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:06.479247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-55a285da-4b0a-4d3f-a568-bfb47d3da443 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:06.492031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-55a285da-4b0a-4d3f-a568-bfb47d3da443 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.493974 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-55a285da-4b0a-4d3f-a568-bfb47d3da443 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.494904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-55a285da-4b0a-4d3f-a568-bfb47d3da443 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.496972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-55a285da-4b0a-4d3f-a568-bfb47d3da443 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.935079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-55a285da-4b0a-4d3f-a568-bfb47d3da443 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:06.945859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-55a285da-4b0a-4d3f-a568-bfb47d3da443 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:06.951966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-55a285da-4b0a-4d3f-a568-bfb47d3da443 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:06.953234 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-55a285da-4b0a-4d3f-a568-bfb47d3da443 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.479255 Jul 20 04:14:06.953818 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 597/1319] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:06 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:06.967964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e72a07d5-082d-446e-9780-5bfdd171cd3d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:06.968533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e72a07d5-082d-446e-9780-5bfdd171cd3d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:06.990231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e72a07d5-082d-446e-9780-5bfdd171cd3d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.991004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e72a07d5-082d-446e-9780-5bfdd171cd3d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.992092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e72a07d5-082d-446e-9780-5bfdd171cd3d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.992715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e72a07d5-082d-446e-9780-5bfdd171cd3d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.007220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-afb8cb79-d228-46fc-943f-ae54b922dae3 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:07.034401 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-afb8cb79-d228-46fc-943f-ae54b922dae3 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1712 microversion: 2.1 time: 0.985807 Jul 20 04:14:07.044631 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 723/1320] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:06 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1712 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:07.422884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e72a07d5-082d-446e-9780-5bfdd171cd3d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:07.436775 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e72a07d5-082d-446e-9780-5bfdd171cd3d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1470 microversion: 2.1 time: 0.481864 Jul 20 04:14:07.446313 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 598/1321] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:06 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1470 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:07.446313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3939a5a2-9e49-4d2f-856d-e709c9e3322b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:07.446313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3939a5a2-9e49-4d2f-856d-e709c9e3322b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:07.462708 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3939a5a2-9e49-4d2f-856d-e709c9e3322b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.463165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3939a5a2-9e49-4d2f-856d-e709c9e3322b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.463984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3939a5a2-9e49-4d2f-856d-e709c9e3322b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.474986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3939a5a2-9e49-4d2f-856d-e709c9e3322b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.487564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-72d83cb6-713f-4bb5-9ef6-b6c059ba20b5 tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:07.488936 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:07.488936 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:14:07.490161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72d83cb6-713f-4bb5-9ef6-b6c059ba20b5 tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.490613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72d83cb6-713f-4bb5-9ef6-b6c059ba20b5 tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.491417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72d83cb6-713f-4bb5-9ef6-b6c059ba20b5 tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.491867 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72d83cb6-713f-4bb5-9ef6-b6c059ba20b5 tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.545084 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-72d83cb6-713f-4bb5-9ef6-b6c059ba20b5 tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.499289 Jul 20 04:14:07.546260 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 724/1322] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:14:07 2022] GET /compute/v2.1/os-services => generated 944 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:07.557889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-310d061c-f698-44a3-9ad4-71c09bb3240a tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:07.559235 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:07.559235 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:14:07.560969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-310d061c-f698-44a3-9ad4-71c09bb3240a tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.561585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-310d061c-f698-44a3-9ad4-71c09bb3240a tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.562723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-310d061c-f698-44a3-9ad4-71c09bb3240a tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.563501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-310d061c-f698-44a3-9ad4-71c09bb3240a tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.586814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:07.596812 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-310d061c-f698-44a3-9ad4-71c09bb3240a tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=n-d-826526-5" status: 200 len: 578 microversion: 2.1 time: 0.042808 Jul 20 04:14:07.597912 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 725/1323] 10.222.0.17 () {58 vars in 1171 bytes} [Wed Jul 20 04:14:07 2022] GET /compute/v2.1/os-services?host=n-d-826526-5 => generated 578 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:07.614205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8a2a8184-6e72-46b7-b197-afccbb6b437f tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:07.615479 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:07.615479 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:14:07.616804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a2a8184-6e72-46b7-b197-afccbb6b437f tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.617263 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a2a8184-6e72-46b7-b197-afccbb6b437f tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.618079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a2a8184-6e72-46b7-b197-afccbb6b437f tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.618536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a2a8184-6e72-46b7-b197-afccbb6b437f tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.655447 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8a2a8184-6e72-46b7-b197-afccbb6b437f tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048648 Jul 20 04:14:07.656383 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 726/1324] 10.222.0.17 () {58 vars in 1175 bytes} [Wed Jul 20 04:14:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:07.673018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7c5a2d1f-2a84-4d6b-9598-81aacdca83ba tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:07.674611 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:07.674611 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:14:07.676370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c5a2d1f-2a84-4d6b-9598-81aacdca83ba tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.677115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c5a2d1f-2a84-4d6b-9598-81aacdca83ba tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.678149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c5a2d1f-2a84-4d6b-9598-81aacdca83ba tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.679361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c5a2d1f-2a84-4d6b-9598-81aacdca83ba tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.711328 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7c5a2d1f-2a84-4d6b-9598-81aacdca83ba tempest-ServicesAdminTestJSON-1301865327 tempest-ServicesAdminTestJSON-1301865327-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.043564 Jul 20 04:14:07.712483 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 727/1325] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:14:07 2022] GET /compute/v2.1/os-services => generated 944 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:07.848555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-bc9a2ecc-c269-4a0a-b800-7d7933cb6bb3 req-4bac680c-08f4-4fde-9a61-97957d27722c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9878d79b-e774-4a05-b2f5-5a4a0c690f86", "tag": "2670d39f-bcc3-4495-a4a2-620ef21fa379"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:07.873012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bc9a2ecc-c269-4a0a-b800-7d7933cb6bb3 req-4bac680c-08f4-4fde-9a61-97957d27722c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.875217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bc9a2ecc-c269-4a0a-b800-7d7933cb6bb3 req-4bac680c-08f4-4fde-9a61-97957d27722c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.895209 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-bc9a2ecc-c269-4a0a-b800-7d7933cb6bb3 req-4bac680c-08f4-4fde-9a61-97957d27722c service nova] Creating event network-changed:2670d39f-bcc3-4495-a4a2-620ef21fa379 for instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 on n-h1-826526-5 Jul 20 04:14:07.940810 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-bc9a2ecc-c269-4a0a-b800-7d7933cb6bb3 req-4bac680c-08f4-4fde-9a61-97957d27722c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099801 Jul 20 04:14:07.946459 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 728/1326] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:07.980452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d4c4ee3c-3f08-4a86-a7d3-22a390bc66e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:07.981430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d4c4ee3c-3f08-4a86-a7d3-22a390bc66e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:08.000788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4c4ee3c-3f08-4a86-a7d3-22a390bc66e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.010630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4c4ee3c-3f08-4a86-a7d3-22a390bc66e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.013431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4c4ee3c-3f08-4a86-a7d3-22a390bc66e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.018078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4c4ee3c-3f08-4a86-a7d3-22a390bc66e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.318760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3939a5a2-9e49-4d2f-856d-e709c9e3322b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:08.348248 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3939a5a2-9e49-4d2f-856d-e709c9e3322b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1355 microversion: 2.1 time: 0.909219 Jul 20 04:14:08.349410 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 599/1327] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:07 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1355 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:08.358339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-749e54d3-427d-4e48-b84a-73fa464b39b0 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:08.364058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-749e54d3-427d-4e48-b84a-73fa464b39b0 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:08.381430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-749e54d3-427d-4e48-b84a-73fa464b39b0 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.382167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-749e54d3-427d-4e48-b84a-73fa464b39b0 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.383112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-749e54d3-427d-4e48-b84a-73fa464b39b0 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.383698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-749e54d3-427d-4e48-b84a-73fa464b39b0 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.465768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d4c4ee3c-3f08-4a86-a7d3-22a390bc66e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:08.495733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d4c4ee3c-3f08-4a86-a7d3-22a390bc66e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:08.497402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d4c4ee3c-3f08-4a86-a7d3-22a390bc66e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:08.498623 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d4c4ee3c-3f08-4a86-a7d3-22a390bc66e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.530757 Jul 20 04:14:08.503192 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 729/1328] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:07 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:08.906907 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e1860e75-819b-481b-b84d-7f3597a1734e tempest-TenantUsagesNegativeTestJSON-1355923685 tempest-TenantUsagesNegativeTestJSON-1355923685-project-admin] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-19T04%3A14%3A08.263805&end=2022-07-21T04%3A14%3A08.263805" status: 404 len: 112 microversion: - time: 0.401293 Jul 20 04:14:08.907788 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 730/1329] 10.222.0.17 () {58 vars in 1315 bytes} [Wed Jul 20 04:14:08 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-19T04%3A14%3A08.263805&end=2022-07-21T04%3A14%3A08.263805 => generated 112 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:14:08.912855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-40654360-4a56-4ac8-9c06-219eff462bb7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:08.914163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-40654360-4a56-4ac8-9c06-219eff462bb7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:08.922087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40654360-4a56-4ac8-9c06-219eff462bb7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.923039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40654360-4a56-4ac8-9c06-219eff462bb7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.924046 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40654360-4a56-4ac8-9c06-219eff462bb7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.925612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40654360-4a56-4ac8-9c06-219eff462bb7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.930789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:09.053947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-749e54d3-427d-4e48-b84a-73fa464b39b0 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6fd2fc945492d95fb2b19f80ee9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e6c6d2c2124397b105566e4d908026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:09.065080 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-749e54d3-427d-4e48-b84a-73fa464b39b0 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 200 len: 1645 microversion: 2.1 time: 0.713738 Jul 20 04:14:09.065682 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 600/1330] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:08 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 1645 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:09.080896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-a6293ffb-c5ae-4941-b2d7-a888be1d8814 req-2c3a9bbf-a865-4150-a273-24382135090a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b459a3ae-fa64-4ffa-a90f-ae87acc75273", "name": "network-vif-deleted", "tag": "f98829db-28ce-43b1-91f3-0b5324542e84"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:09.111424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-40654360-4a56-4ac8-9c06-219eff462bb7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:09.128425 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-40654360-4a56-4ac8-9c06-219eff462bb7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1470 microversion: 2.1 time: 0.215521 Jul 20 04:14:09.130114 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 731/1331] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:08 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1470 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:09.134727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a6293ffb-c5ae-4941-b2d7-a888be1d8814 req-2c3a9bbf-a865-4150-a273-24382135090a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.136528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a6293ffb-c5ae-4941-b2d7-a888be1d8814 req-2c3a9bbf-a865-4150-a273-24382135090a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.149324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-306e9844-7a9f-4a57-8b11-9b00e238900e tempest-TenantUsagesNegativeTestJSON-1355923685 tempest-TenantUsagesNegativeTestJSON-1355923685-project-admin] Calling method '.version_select at 0x7f06bdee64c0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:09.165593 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-306e9844-7a9f-4a57-8b11-9b00e238900e tempest-TenantUsagesNegativeTestJSON-1355923685 tempest-TenantUsagesNegativeTestJSON-1355923685-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 20 04:14:09.168340 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-a6293ffb-c5ae-4941-b2d7-a888be1d8814 req-2c3a9bbf-a865-4150-a273-24382135090a service nova] Creating event network-vif-deleted:f98829db-28ce-43b1-91f3-0b5324542e84 for instance b459a3ae-fa64-4ffa-a90f-ae87acc75273 on n-h1-826526-5 Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-306e9844-7a9f-4a57-8b11-9b00e238900e tempest-TenantUsagesNegativeTestJSON-1355923685 tempest-TenantUsagesNegativeTestJSON-1355923685-project-admin] Request method failure captured: Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-simple-tenant-usage/b4e512c9d84444f5b79d9463af9d0be0?start=2022-07-21T04%3A14%3A08.263805&end=2022-07-19T04%3A14%3A08.263805 HTTP/1.1 Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14EQyzqSzYSUIwiQqH4CKz_cxHJZhebG8TcfR4P8ogDjT6hSrnneGwPfvIlBjMaxgKO4mnwfSUrXJQLWeWV3YZj525A40hTC7vUTmslWNwsPoGuPhe8ySrLWStGeeIsou3Ssr4QbedY6cpiX4nNB53IDG3qL8XuJzm4DVn91aJHAmgM Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 11d4fa8a0414426a84ac6be7d61a682c Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1355923685 Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:14:09.173467 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:14:09.175274 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/11d4fa8a0414426a84ac6be7d61a682c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/11d4fa8a0414426a84ac6be7d61a682c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_11d4fa8a0414426a84ac6be7d61a682c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/11d4fa8a0414426a84ac6be7d61a682c"}]}] Jul 20 04:14:09.175274 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1355923685 Jul 20 04:14:09.175274 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 11d4fa8a0414426a84ac6be7d61a682c Jul 20 04:14:09.175274 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1355923685 Jul 20 04:14:09.175274 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TenantUsagesNegativeTestJSON-1355923685-project-admin Jul 20 04:14:09.175274 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:14:09.175274 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:14:09.175274 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 3fd59bdba7df4d5ca038648d38098ab8 Jul 20 04:14:09.175274 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1355923685-project-admin Jul 20 04:14:09.175274 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:14:09.175274 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid start time. The start time cannot occur after the end time. Jul 20 04:14:09.175274 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'b4e512c9d84444f5b79d9463af9d0be0'} Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 04:14:09.176218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 20 04:14:09.177560 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:09.177560 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:09.177560 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:09.177560 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:09.177560 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:09.177560 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:09.177560 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:09.177560 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:09.177560 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 20 04:14:09.177560 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:09.180022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-306e9844-7a9f-4a57-8b11-9b00e238900e tempest-TenantUsagesNegativeTestJSON-1355923685 tempest-TenantUsagesNegativeTestJSON-1355923685-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:09.181494 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-306e9844-7a9f-4a57-8b11-9b00e238900e tempest-TenantUsagesNegativeTestJSON-1355923685 tempest-TenantUsagesNegativeTestJSON-1355923685-project-admin] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage/b4e512c9d84444f5b79d9463af9d0be0?start=2022-07-21T04%3A14%3A08.263805&end=2022-07-19T04%3A14%3A08.263805" status: 400 len: 111 microversion: 2.1 time: 0.047698 Jul 20 04:14:09.181632 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-a6293ffb-c5ae-4941-b2d7-a888be1d8814 req-2c3a9bbf-a865-4150-a273-24382135090a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111850 Jul 20 04:14:09.182568 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 601/1332] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:09.187565 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 732/1333] 10.222.0.17 () {58 vars in 1411 bytes} [Wed Jul 20 04:14:09 2022] GET /compute/v2.1/os-simple-tenant-usage/b4e512c9d84444f5b79d9463af9d0be0?start=2022-07-21T04%3A14%3A08.263805&end=2022-07-19T04%3A14%3A08.263805 => generated 111 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:14:09.353940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-465c7660-9d39-4777-a23b-9741522fbc1b tempest-TenantUsagesNegativeTestJSON-165591779 tempest-TenantUsagesNegativeTestJSON-165591779-project] Calling method '.version_select at 0x7f06bde0a550>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:09.356495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-465c7660-9d39-4777-a23b-9741522fbc1b tempest-TenantUsagesNegativeTestJSON-165591779 tempest-TenantUsagesNegativeTestJSON-165591779-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '86ef3db62c6649ce817312d6f7a91689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e512c9d84444f5b79d9463af9d0be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-465c7660-9d39-4777-a23b-9741522fbc1b tempest-TenantUsagesNegativeTestJSON-165591779 tempest-TenantUsagesNegativeTestJSON-165591779-project] Request method failure captured: Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A14%3A08.263805&end=2022-07-21T04%3A14%3A08.263805&detailed=1 HTTP/1.1 Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14EOcACaCD4un8Y4Of-GoGAd83iOzSuGUxlQeZ7RSIwBl-PR9nrbsJYSun8jb7mSCPlHaWXwfGIQOQQEFH8XEH5Q22RX-vBCDqrmpq3bF5JZVgEQu0PMCvdJ17ZcJnz2j2aQeyVKtO2ZTOrSeph016-4m0zRwYmuwwyAP2TnGaU1Oz4 Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: b4e512c9d84444f5b79d9463af9d0be0 Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-165591779 Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:14:09.358395 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:14:09.359886 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b4e512c9d84444f5b79d9463af9d0be0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b4e512c9d84444f5b79d9463af9d0be0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b4e512c9d84444f5b79d9463af9d0be0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b4e512c9d84444f5b79d9463af9d0be0"}]}] Jul 20 04:14:09.359886 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-165591779 Jul 20 04:14:09.359886 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: b4e512c9d84444f5b79d9463af9d0be0 Jul 20 04:14:09.359886 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-165591779 Jul 20 04:14:09.359886 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TenantUsagesNegativeTestJSON-165591779-project Jul 20 04:14:09.359886 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:14:09.359886 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:14:09.359886 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 86ef3db62c6649ce817312d6f7a91689 Jul 20 04:14:09.359886 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-165591779-project Jul 20 04:14:09.359886 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:14:09.359886 n-d-826526-5 devstack@n-api.service[127870]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 20 04:14:09.359886 n-d-826526-5 devstack@n-api.service[127870]: action_args: {} Jul 20 04:14:09.359886 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:14:09.360954 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:14:09.363988 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:14:09.365536 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 20 04:14:09.365536 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:09.365536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-465c7660-9d39-4777-a23b-9741522fbc1b tempest-TenantUsagesNegativeTestJSON-165591779 tempest-TenantUsagesNegativeTestJSON-165591779-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:09.365536 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-465c7660-9d39-4777-a23b-9741522fbc1b tempest-TenantUsagesNegativeTestJSON-165591779 tempest-TenantUsagesNegativeTestJSON-165591779-project] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A14%3A08.263805&end=2022-07-21T04%3A14%3A08.263805&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.164513 Jul 20 04:14:09.369026 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 602/1334] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Jul 20 04:14:09 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A14%3A08.263805&end=2022-07-21T04%3A14%3A08.263805&detailed=1 => generated 123 bytes in 172 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:14:09.373871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2e67bad0-f0e8-4e7d-a0eb-ffc23e96100e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:09.374489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2e67bad0-f0e8-4e7d-a0eb-ffc23e96100e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:09.387433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e67bad0-f0e8-4e7d-a0eb-ffc23e96100e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.389496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e67bad0-f0e8-4e7d-a0eb-ffc23e96100e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.390957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e67bad0-f0e8-4e7d-a0eb-ffc23e96100e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.391628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e67bad0-f0e8-4e7d-a0eb-ffc23e96100e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.522993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-38d9f5c0-f671-4998-b84c-17afc015ea0c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:09.524982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-38d9f5c0-f671-4998-b84c-17afc015ea0c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:09.544780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38d9f5c0-f671-4998-b84c-17afc015ea0c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.545578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38d9f5c0-f671-4998-b84c-17afc015ea0c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.546599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38d9f5c0-f671-4998-b84c-17afc015ea0c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.547385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38d9f5c0-f671-4998-b84c-17afc015ea0c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.693514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2e67bad0-f0e8-4e7d-a0eb-ffc23e96100e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:09.705747 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2e67bad0-f0e8-4e7d-a0eb-ffc23e96100e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1355 microversion: 2.1 time: 0.335047 Jul 20 04:14:09.708199 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 733/1335] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:09 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1355 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:10.035452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-38d9f5c0-f671-4998-b84c-17afc015ea0c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:10.053852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-38d9f5c0-f671-4998-b84c-17afc015ea0c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:10.056819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-38d9f5c0-f671-4998-b84c-17afc015ea0c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:10.058901 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-38d9f5c0-f671-4998-b84c-17afc015ea0c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.543425 Jul 20 04:14:10.060043 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 603/1336] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:09 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:10.083103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b8a5ea60-5d12-4637-bea7-d5a2cebea8be tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:10.084099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b8a5ea60-5d12-4637-bea7-d5a2cebea8be tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] [instance: b459a3ae-fa64-4ffa-a90f-ae87acc75273] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:10.091328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8a5ea60-5d12-4637-bea7-d5a2cebea8be tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.092062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8a5ea60-5d12-4637-bea7-d5a2cebea8be tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.093090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8a5ea60-5d12-4637-bea7-d5a2cebea8be tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.093717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8a5ea60-5d12-4637-bea7-d5a2cebea8be tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.109085 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-b8a5ea60-5d12-4637-bea7-d5a2cebea8be tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] HTTP exception thrown: Instance b459a3ae-fa64-4ffa-a90f-ae87acc75273 could not be found. Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b8a5ea60-5d12-4637-bea7-d5a2cebea8be tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Request method failure captured: Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 HTTP/1.1 Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14C9tZZRZWAaShMSq_uwFz4uX_-4-N1BM8QwivG0fmM-gTeomnjyPetBtR8sA8iQmtC6WFjWDbxtmfiEgjHRgvV0eri2jqUdms7MI1QO7hVk4K2yk1BMvMbxGEUTqAIAhURtJ1MCKTfB1dJKYn62F_0T2YMGe6VeiU3tAXwXe31aY64 Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: e8e6c6d2c2124397b105566e4d908026 Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestManualDisk-167408014 Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:14:10.111120 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:14:10.113043 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e8e6c6d2c2124397b105566e4d908026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e8e6c6d2c2124397b105566e4d908026"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e8e6c6d2c2124397b105566e4d908026", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e8e6c6d2c2124397b105566e4d908026"}]}] Jul 20 04:14:10.113043 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestManualDisk-167408014 Jul 20 04:14:10.113043 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: e8e6c6d2c2124397b105566e4d908026 Jul 20 04:14:10.113043 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestManualDisk-167408014 Jul 20 04:14:10.113043 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestManualDisk-167408014-project Jul 20 04:14:10.113043 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:14:10.113043 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:14:10.113043 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f7b6fd2fc945492d95fb2b19f80ee9a2 Jul 20 04:14:10.113043 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestManualDisk-167408014-project Jul 20 04:14:10.113043 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:14:10.113043 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance b459a3ae-fa64-4ffa-a90f-ae87acc75273 could not be found. Jul 20 04:14:10.113043 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'b459a3ae-fa64-4ffa-a90f-ae87acc75273'} Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b459a3ae-fa64-4ffa-a90f-ae87acc75273 could not be found. Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:10.113940 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:10.115170 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:10.115170 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:10.115170 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:10.115170 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:10.115170 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:10.115170 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:10.115170 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:10.115170 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b459a3ae-fa64-4ffa-a90f-ae87acc75273 could not be found. Jul 20 04:14:10.115170 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.115170 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:10.115170 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.115170 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:10.115170 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:10.115170 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:10.115170 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:10.115170 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:10.115170 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b459a3ae-fa64-4ffa-a90f-ae87acc75273 could not be found. Jul 20 04:14:10.115170 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.117777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b8a5ea60-5d12-4637-bea7-d5a2cebea8be tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Returning 404 to user: Instance b459a3ae-fa64-4ffa-a90f-ae87acc75273 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:10.118841 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b8a5ea60-5d12-4637-bea7-d5a2cebea8be tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273" status: 404 len: 111 microversion: 2.1 time: 0.041326 Jul 20 04:14:10.120101 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 734/1337] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:10 2022] GET /compute/v2.1/servers/b459a3ae-fa64-4ffa-a90f-ae87acc75273 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:10.131089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4a610b6e-563f-4a74-9d0c-e162876533b0 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] Calling method '.version_select at 0x7f06bde23af0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:10.150821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8664f6ee-1260-4d5a-a4b2-cbdffb710c82 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:10.153099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8664f6ee-1260-4d5a-a4b2-cbdffb710c82 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:10.165926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8664f6ee-1260-4d5a-a4b2-cbdffb710c82 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.166629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8664f6ee-1260-4d5a-a4b2-cbdffb710c82 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.168031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8664f6ee-1260-4d5a-a4b2-cbdffb710c82 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.169063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8664f6ee-1260-4d5a-a4b2-cbdffb710c82 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.177029 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4a610b6e-563f-4a74-9d0c-e162876533b0 tempest-ServersTestManualDisk-167408014 tempest-ServersTestManualDisk-167408014-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-225853485" status: 202 len: 0 microversion: 2.1 time: 0.051815 Jul 20 04:14:10.179608 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 604/1338] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jul 20 04:14:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-225853485 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:10.587639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8664f6ee-1260-4d5a-a4b2-cbdffb710c82 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:10.596197 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8664f6ee-1260-4d5a-a4b2-cbdffb710c82 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1470 microversion: 2.1 time: 0.453280 Jul 20 04:14:10.602686 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 735/1339] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:10 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1470 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:10.724388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea457cab-b226-43dd-84a0-afd5e957d534 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:10.724864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ea457cab-b226-43dd-84a0-afd5e957d534 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:10.742667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea457cab-b226-43dd-84a0-afd5e957d534 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.744796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea457cab-b226-43dd-84a0-afd5e957d534 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.747830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea457cab-b226-43dd-84a0-afd5e957d534 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.748643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea457cab-b226-43dd-84a0-afd5e957d534 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.078404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-beff57a3-3a5b-4e48-9540-038ee7f80482 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:11.079221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-beff57a3-3a5b-4e48-9540-038ee7f80482 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:11.087244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-beff57a3-3a5b-4e48-9540-038ee7f80482 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.087702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-beff57a3-3a5b-4e48-9540-038ee7f80482 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.095428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-beff57a3-3a5b-4e48-9540-038ee7f80482 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.096161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-beff57a3-3a5b-4e48-9540-038ee7f80482 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.229753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ea457cab-b226-43dd-84a0-afd5e957d534 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:11.238530 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ea457cab-b226-43dd-84a0-afd5e957d534 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1355 microversion: 2.1 time: 0.518211 Jul 20 04:14:11.251503 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 605/1340] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:10 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1355 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:11.687987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-57ef7817-85b2-4af7-8a76-3d0e258e5c54 req-6296b8d9-1325-40aa-b832-f723566534f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96067d54-1e58-49cf-b7e9-7fbc5c86df79", "name": "network-vif-unplugged", "status": "completed", "tag": "9f32aa7e-a422-4132-a2e3-e55d9f1c8cdb"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:11.697507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-57ef7817-85b2-4af7-8a76-3d0e258e5c54 req-6296b8d9-1325-40aa-b832-f723566534f5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.698283 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-57ef7817-85b2-4af7-8a76-3d0e258e5c54 req-6296b8d9-1325-40aa-b832-f723566534f5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.715832 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-57ef7817-85b2-4af7-8a76-3d0e258e5c54 req-6296b8d9-1325-40aa-b832-f723566534f5 service nova] Creating event network-vif-unplugged:9f32aa7e-a422-4132-a2e3-e55d9f1c8cdb for instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 on n-h2-826526-5 Jul 20 04:14:11.723260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [req-57ef7817-85b2-4af7-8a76-3d0e258e5c54 req-6296b8d9-1325-40aa-b832-f723566534f5 service nova] Instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:14:11.750319 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-57ef7817-85b2-4af7-8a76-3d0e258e5c54 req-6296b8d9-1325-40aa-b832-f723566534f5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.382316 Jul 20 04:14:11.752213 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 606/1341] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:11.764365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b225726d-9377-44f1-9608-076979583077 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:11.765378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b225726d-9377-44f1-9608-076979583077 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:11.780730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b225726d-9377-44f1-9608-076979583077 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.781456 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b225726d-9377-44f1-9608-076979583077 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.782399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b225726d-9377-44f1-9608-076979583077 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.783122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b225726d-9377-44f1-9608-076979583077 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.865051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-beff57a3-3a5b-4e48-9540-038ee7f80482 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:11.875296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-beff57a3-3a5b-4e48-9540-038ee7f80482 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:11.876824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-beff57a3-3a5b-4e48-9540-038ee7f80482 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:11.878678 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-beff57a3-3a5b-4e48-9540-038ee7f80482 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.804796 Jul 20 04:14:11.879536 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 736/1342] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:11 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:14:12.259943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bad9984e-6c8c-4cc0-9bc8-c6290f5d1bfb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:12.260969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bad9984e-6c8c-4cc0-9bc8-c6290f5d1bfb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:12.269082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bad9984e-6c8c-4cc0-9bc8-c6290f5d1bfb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.269973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bad9984e-6c8c-4cc0-9bc8-c6290f5d1bfb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:12.270957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bad9984e-6c8c-4cc0-9bc8-c6290f5d1bfb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.271615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bad9984e-6c8c-4cc0-9bc8-c6290f5d1bfb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:12.284011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b225726d-9377-44f1-9608-076979583077 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:12.314516 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b225726d-9377-44f1-9608-076979583077 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1470 microversion: 2.1 time: 0.556053 Jul 20 04:14:12.315182 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 607/1343] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:11 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1470 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:12.737075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bad9984e-6c8c-4cc0-9bc8-c6290f5d1bfb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:12.751303 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bad9984e-6c8c-4cc0-9bc8-c6290f5d1bfb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1355 microversion: 2.1 time: 0.495802 Jul 20 04:14:12.767206 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 737/1344] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:12 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1355 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:12.899313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-330d2202-f6ac-441c-b4da-7af0db3fa0e5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:12.899933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-330d2202-f6ac-441c-b4da-7af0db3fa0e5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:12.912633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-330d2202-f6ac-441c-b4da-7af0db3fa0e5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.916171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-330d2202-f6ac-441c-b4da-7af0db3fa0e5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:12.917076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-330d2202-f6ac-441c-b4da-7af0db3fa0e5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.921115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-330d2202-f6ac-441c-b4da-7af0db3fa0e5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.333274 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a29b3bc4-27b0-422c-87d8-adcb32133d31 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:13.334660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a29b3bc4-27b0-422c-87d8-adcb32133d31 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:13.339913 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:13.351886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-330d2202-f6ac-441c-b4da-7af0db3fa0e5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:13.372841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-330d2202-f6ac-441c-b4da-7af0db3fa0e5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:13.375193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-330d2202-f6ac-441c-b4da-7af0db3fa0e5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:13.377522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a29b3bc4-27b0-422c-87d8-adcb32133d31 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:13.378047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a29b3bc4-27b0-422c-87d8-adcb32133d31 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.378674 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-330d2202-f6ac-441c-b4da-7af0db3fa0e5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.482975 Jul 20 04:14:13.378889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a29b3bc4-27b0-422c-87d8-adcb32133d31 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:13.379303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a29b3bc4-27b0-422c-87d8-adcb32133d31 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.393898 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 608/1345] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:12 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:13.774307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-336d09a0-cb56-4a71-8a89-569e8d9c7d36 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:13.774925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-336d09a0-cb56-4a71-8a89-569e8d9c7d36 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:13.792669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-336d09a0-cb56-4a71-8a89-569e8d9c7d36 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:13.794831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-336d09a0-cb56-4a71-8a89-569e8d9c7d36 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.797117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-336d09a0-cb56-4a71-8a89-569e8d9c7d36 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:13.799742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-336d09a0-cb56-4a71-8a89-569e8d9c7d36 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.464237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a29b3bc4-27b0-422c-87d8-adcb32133d31 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:14.475501 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a29b3bc4-27b0-422c-87d8-adcb32133d31 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1470 microversion: 2.1 time: 1.148171 Jul 20 04:14:14.476110 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 738/1346] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:13 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1470 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:14.490370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-336d09a0-cb56-4a71-8a89-569e8d9c7d36 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:14.499742 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-336d09a0-cb56-4a71-8a89-569e8d9c7d36 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1355 microversion: 2.1 time: 0.729399 Jul 20 04:14:14.504631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-bc9f9e4c-748a-427d-976c-f56f8a326cf5 req-a5f8bfa3-e1a9-4f15-9507-fee78a5276f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9878d79b-e774-4a05-b2f5-5a4a0c690f86", "tag": "455130e7-f24c-4265-b7d2-b727163deac0"}, {"name": "network-changed", "server_uuid": "96067d54-1e58-49cf-b7e9-7fbc5c86df79", "tag": "9f32aa7e-a422-4132-a2e3-e55d9f1c8cdb"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:14.506427 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 609/1347] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:13 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1355 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:14.524304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-22883cb7-ce09-4a62-a3ff-626dbb38daaf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:14.529425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-22883cb7-ce09-4a62-a3ff-626dbb38daaf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:14.552850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bc9f9e4c-748a-427d-976c-f56f8a326cf5 req-a5f8bfa3-e1a9-4f15-9507-fee78a5276f3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.553041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22883cb7-ce09-4a62-a3ff-626dbb38daaf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.555338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22883cb7-ce09-4a62-a3ff-626dbb38daaf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.556208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bc9f9e4c-748a-427d-976c-f56f8a326cf5 req-a5f8bfa3-e1a9-4f15-9507-fee78a5276f3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.557026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22883cb7-ce09-4a62-a3ff-626dbb38daaf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.557690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22883cb7-ce09-4a62-a3ff-626dbb38daaf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.600733 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-bc9f9e4c-748a-427d-976c-f56f8a326cf5 req-a5f8bfa3-e1a9-4f15-9507-fee78a5276f3 service nova] Creating event network-changed:455130e7-f24c-4265-b7d2-b727163deac0 for instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 on n-h1-826526-5 Jul 20 04:14:14.601309 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-bc9f9e4c-748a-427d-976c-f56f8a326cf5 req-a5f8bfa3-e1a9-4f15-9507-fee78a5276f3 service nova] Creating event network-changed:9f32aa7e-a422-4132-a2e3-e55d9f1c8cdb for instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 on n-h2-826526-5 Jul 20 04:14:14.622909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-bc9f9e4c-748a-427d-976c-f56f8a326cf5 req-a5f8bfa3-e1a9-4f15-9507-fee78a5276f3 service nova] Instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:14:14.649074 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-bc9f9e4c-748a-427d-976c-f56f8a326cf5 req-a5f8bfa3-e1a9-4f15-9507-fee78a5276f3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.166965 Jul 20 04:14:14.649990 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 739/1348] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:14.918258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-22883cb7-ce09-4a62-a3ff-626dbb38daaf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:14.939894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-22883cb7-ce09-4a62-a3ff-626dbb38daaf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:14.943547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-22883cb7-ce09-4a62-a3ff-626dbb38daaf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:14.950789 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-22883cb7-ce09-4a62-a3ff-626dbb38daaf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.440018 Jul 20 04:14:14.951435 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 610/1349] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:14 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:14.991830 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-db5d9351-e352-4c57-9952-d9e390606e1e tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] Calling method '.version_select at 0x7f06bdee6dc0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:15.038953 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-db5d9351-e352-4c57-9952-d9e390606e1e tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] HTTP exception thrown: Image not found. Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-db5d9351-e352-4c57-9952-d9e390606e1e tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] Request method failure captured: Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/images/86f1218c-1660-4765-ab6d-4cf8d29ae7f0/metadata/os_distro HTTP/1.1 Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14EWo0aoxFv52c3z8kR91jR-hqFzQKuKdVVghcfGmFY6WqITKj3nMzjBljrNAHDrxREwfIp_2bpZBge2FRNITZY-m02og6jB3nPPy9kb-qHvUuXUojTKo0bn5Uq0sdTdHQeHZnYbddfQg9AG4d33ztxHj4rbWRC_b4kY51Clc9InNGQ Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ec4096b6d37f4ebdb4e7d75883f8ca2a Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1637605664 Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:14:15.048161 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:14:15.049990 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec4096b6d37f4ebdb4e7d75883f8ca2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ec4096b6d37f4ebdb4e7d75883f8ca2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ec4096b6d37f4ebdb4e7d75883f8ca2a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec4096b6d37f4ebdb4e7d75883f8ca2a"}]}] Jul 20 04:14:15.049990 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1637605664 Jul 20 04:14:15.049990 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ec4096b6d37f4ebdb4e7d75883f8ca2a Jul 20 04:14:15.049990 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1637605664 Jul 20 04:14:15.049990 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesMetadataNegativeTestJSON-1637605664-project Jul 20 04:14:15.049990 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:14:15.049990 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:14:15.049990 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: d8519aec449a48129296ce3634e423f3 Jul 20 04:14:15.049990 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1637605664-project Jul 20 04:14:15.049990 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:14:15.049990 n-d-826526-5 devstack@n-api.service[127871]: exception: Image not found. Jul 20 04:14:15.049990 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'image_id': '86f1218c-1660-4765-ab6d-4cf8d29ae7f0', 'id': 'os_distro'} Jul 20 04:14:15.049990 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:15.051023 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.051023 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:15.051023 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:15.051023 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:15.051023 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:15.051023 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:15.051023 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:15.051023 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:15.051023 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:15.051023 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:15.051023 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:15.051023 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:15.051023 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:15.051023 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:15.051023 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:15.051023 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:15.051023 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:15.051023 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 86f1218c-1660-4765-ab6d-4cf8d29ae7f0 Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:15.053162 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 86f1218c-1660-4765-ab6d-4cf8d29ae7f0 could not be found. Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:15.054526 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:15.055844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:15.055844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:15.055844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 20 04:14:15.055844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 04:14:15.055844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:14:15.055844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:14:15.055844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:14:15.055844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.055844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.055844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.055844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.055844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:15.055844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:15.055844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:15.055844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:15.055844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:14:15.055844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.055844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-db5d9351-e352-4c57-9952-d9e390606e1e tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] Returning 404 to user: Image not found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:15.057281 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-db5d9351-e352-4c57-9952-d9e390606e1e tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] 10.222.0.17 "DELETE /compute/v2.1/images/86f1218c-1660-4765-ab6d-4cf8d29ae7f0/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.398623 Jul 20 04:14:15.057281 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 740/1350] 10.222.0.17 () {58 vars in 1292 bytes} [Wed Jul 20 04:14:14 2022] DELETE /compute/v2.1/images/86f1218c-1660-4765-ab6d-4cf8d29ae7f0/metadata/os_distro => generated 62 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:15.062694 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-20e54e3d-a9b9-4b73-a62f-b2601f0c4e93 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] Calling method '.version_select at 0x7f06bde23b80>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:15.084373 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-20e54e3d-a9b9-4b73-a62f-b2601f0c4e93 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] HTTP exception thrown: Image not found. Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-20e54e3d-a9b9-4b73-a62f-b2601f0c4e93 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] Request method failure captured: Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/images/d7c0af5a-b47d-4371-ba8e-795ce893748f/metadata/os_version HTTP/1.1 Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14EWo0aoxFv52c3z8kR91jR-hqFzQKuKdVVghcfGmFY6WqITKj3nMzjBljrNAHDrxREwfIp_2bpZBge2FRNITZY-m02og6jB3nPPy9kb-qHvUuXUojTKo0bn5Uq0sdTdHQeHZnYbddfQg9AG4d33ztxHj4rbWRC_b4kY51Clc9InNGQ Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: ec4096b6d37f4ebdb4e7d75883f8ca2a Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1637605664 Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:14:15.086791 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:14:15.088478 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec4096b6d37f4ebdb4e7d75883f8ca2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ec4096b6d37f4ebdb4e7d75883f8ca2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ec4096b6d37f4ebdb4e7d75883f8ca2a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec4096b6d37f4ebdb4e7d75883f8ca2a"}]}] Jul 20 04:14:15.088478 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1637605664 Jul 20 04:14:15.088478 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: ec4096b6d37f4ebdb4e7d75883f8ca2a Jul 20 04:14:15.088478 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1637605664 Jul 20 04:14:15.088478 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesMetadataNegativeTestJSON-1637605664-project Jul 20 04:14:15.088478 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:14:15.088478 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:14:15.088478 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: d8519aec449a48129296ce3634e423f3 Jul 20 04:14:15.088478 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1637605664-project Jul 20 04:14:15.088478 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:14:15.088478 n-d-826526-5 devstack@n-api.service[127870]: exception: Image not found. Jul 20 04:14:15.088478 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'image_id': 'd7c0af5a-b47d-4371-ba8e-795ce893748f', 'id': 'os_version'} Jul 20 04:14:15.088478 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:15.094514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.094514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:15.094514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:15.094514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:15.094514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:15.094514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:15.094514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:15.094514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:15.094514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:15.094514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:15.094514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:15.094514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:15.094514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:15.094514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:15.094514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:15.094514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:15.094514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:15.094514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d7c0af5a-b47d-4371-ba8e-795ce893748f Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:15.096689 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d7c0af5a-b47d-4371-ba8e-795ce893748f could not be found. Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:15.099364 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:15.102386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:15.102386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:15.102386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 20 04:14:15.102386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 20 04:14:15.102386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:14:15.102386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:14:15.102386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:14:15.102386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.102386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.102386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.102386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.102386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:15.102386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:15.102386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:15.102386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:15.102386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:14:15.102386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.102386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-20e54e3d-a9b9-4b73-a62f-b2601f0c4e93 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] Returning 404 to user: Image not found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:15.105014 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-20e54e3d-a9b9-4b73-a62f-b2601f0c4e93 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] 10.222.0.17 "GET /compute/v2.1/images/d7c0af5a-b47d-4371-ba8e-795ce893748f/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.029625 Jul 20 04:14:15.105014 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 611/1351] 10.222.0.17 () {58 vars in 1292 bytes} [Wed Jul 20 04:14:15 2022] GET /compute/v2.1/images/d7c0af5a-b47d-4371-ba8e-795ce893748f/metadata/os_version => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:15.105302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0617e3bc-03b7-4977-a2b9-bc4129fdbca5 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] Calling method '.version_select at 0x7f06bdfa8a60>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:15.128414 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-0617e3bc-03b7-4977-a2b9-bc4129fdbca5 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] HTTP exception thrown: Image not found. Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0617e3bc-03b7-4977-a2b9-bc4129fdbca5 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] Request method failure captured: Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/images/baf2df29-c8cb-4c72-a9d4-66b5e4bf11d6/metadata HTTP/1.1 Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14EWo0aoxFv52c3z8kR91jR-hqFzQKuKdVVghcfGmFY6WqITKj3nMzjBljrNAHDrxREwfIp_2bpZBge2FRNITZY-m02og6jB3nPPy9kb-qHvUuXUojTKo0bn5Uq0sdTdHQeHZnYbddfQg9AG4d33ztxHj4rbWRC_b4kY51Clc9InNGQ Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ec4096b6d37f4ebdb4e7d75883f8ca2a Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1637605664 Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:14:15.130458 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:14:15.131831 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec4096b6d37f4ebdb4e7d75883f8ca2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ec4096b6d37f4ebdb4e7d75883f8ca2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ec4096b6d37f4ebdb4e7d75883f8ca2a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec4096b6d37f4ebdb4e7d75883f8ca2a"}]}] Jul 20 04:14:15.131831 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1637605664 Jul 20 04:14:15.131831 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ec4096b6d37f4ebdb4e7d75883f8ca2a Jul 20 04:14:15.131831 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1637605664 Jul 20 04:14:15.131831 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesMetadataNegativeTestJSON-1637605664-project Jul 20 04:14:15.131831 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:14:15.131831 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:14:15.131831 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: d8519aec449a48129296ce3634e423f3 Jul 20 04:14:15.131831 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1637605664-project Jul 20 04:14:15.131831 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:14:15.131831 n-d-826526-5 devstack@n-api.service[127871]: exception: Image not found. Jul 20 04:14:15.131831 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'image_id': 'baf2df29-c8cb-4c72-a9d4-66b5e4bf11d6'} Jul 20 04:14:15.131831 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:15.132957 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.132957 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:15.132957 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:15.132957 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:15.132957 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:15.132957 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:15.132957 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:15.132957 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:15.132957 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:15.132957 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:15.132957 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:15.132957 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:15.132957 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:15.132957 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:15.132957 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:15.132957 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:15.132957 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:15.132957 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID baf2df29-c8cb-4c72-a9d4-66b5e4bf11d6 Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:15.134041 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image baf2df29-c8cb-4c72-a9d4-66b5e4bf11d6 could not be found. Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:15.135402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:15.138736 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:15.138736 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:15.138736 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 20 04:14:15.138736 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 20 04:14:15.138736 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:14:15.138736 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:14:15.138736 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:14:15.138736 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.138736 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.138736 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.138736 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.138736 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:15.138736 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:15.138736 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:15.138736 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:15.138736 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:14:15.138736 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.138736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0617e3bc-03b7-4977-a2b9-bc4129fdbca5 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] Returning 404 to user: Image not found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:15.142449 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0617e3bc-03b7-4977-a2b9-bc4129fdbca5 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] 10.222.0.17 "GET /compute/v2.1/images/baf2df29-c8cb-4c72-a9d4-66b5e4bf11d6/metadata" status: 404 len: 62 microversion: 2.1 time: 0.037595 Jul 20 04:14:15.142449 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 741/1352] 10.222.0.17 () {58 vars in 1259 bytes} [Wed Jul 20 04:14:15 2022] GET /compute/v2.1/images/baf2df29-c8cb-4c72-a9d4-66b5e4bf11d6/metadata => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:15.143283 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-444d50e5-405e-4c66-b465-8b5035a53165 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] Action: 'update_all', calling method: .version_select at 0x7f06bde19280>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:15.180337 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-444d50e5-405e-4c66-b465-8b5035a53165 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] HTTP exception thrown: Image not found. Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-444d50e5-405e-4c66-b465-8b5035a53165 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] Request method failure captured: Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: request: PUT /compute/v2.1/images/f293afae-1a98-46ca-be4b-68bec1e7d7bb/metadata HTTP/1.1 Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 57 Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14EWo0aoxFv52c3z8kR91jR-hqFzQKuKdVVghcfGmFY6WqITKj3nMzjBljrNAHDrxREwfIp_2bpZBge2FRNITZY-m02og6jB3nPPy9kb-qHvUuXUojTKo0bn5Uq0sdTdHQeHZnYbddfQg9AG4d33ztxHj4rbWRC_b4kY51Clc9InNGQ Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: ec4096b6d37f4ebdb4e7d75883f8ca2a Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1637605664 Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:14:15.183309 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:14:15.184996 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec4096b6d37f4ebdb4e7d75883f8ca2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ec4096b6d37f4ebdb4e7d75883f8ca2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ec4096b6d37f4ebdb4e7d75883f8ca2a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec4096b6d37f4ebdb4e7d75883f8ca2a"}]}] Jul 20 04:14:15.184996 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1637605664 Jul 20 04:14:15.184996 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: ec4096b6d37f4ebdb4e7d75883f8ca2a Jul 20 04:14:15.184996 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1637605664 Jul 20 04:14:15.184996 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesMetadataNegativeTestJSON-1637605664-project Jul 20 04:14:15.184996 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:14:15.184996 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:14:15.184996 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: d8519aec449a48129296ce3634e423f3 Jul 20 04:14:15.184996 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1637605664-project Jul 20 04:14:15.184996 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:14:15.184996 n-d-826526-5 devstack@n-api.service[127870]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 20 04:14:15.184996 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:14:15.184996 n-d-826526-5 devstack@n-api.service[127870]: exception: Image not found. Jul 20 04:14:15.184996 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'image_id': 'f293afae-1a98-46ca-be4b-68bec1e7d7bb', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 20 04:14:15.190218 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:15.190218 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.190218 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:15.190218 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:15.190218 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:15.190218 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:15.190218 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:15.190218 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:15.190218 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:15.190218 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:15.190218 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:15.190218 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:15.190218 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:15.190218 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:15.190218 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:15.190218 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:15.190218 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:15.190218 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f293afae-1a98-46ca-be4b-68bec1e7d7bb Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:15.191654 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f293afae-1a98-46ca-be4b-68bec1e7d7bb could not be found. Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:15.193043 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:14:15.194606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.196244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-444d50e5-405e-4c66-b465-8b5035a53165 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] Returning 404 to user: Image not found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:15.196244 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-444d50e5-405e-4c66-b465-8b5035a53165 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] 10.222.0.17 "PUT /compute/v2.1/images/f293afae-1a98-46ca-be4b-68bec1e7d7bb/metadata" status: 404 len: 62 microversion: 2.1 time: 0.046144 Jul 20 04:14:15.196244 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 612/1353] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:14:15 2022] PUT /compute/v2.1/images/f293afae-1a98-46ca-be4b-68bec1e7d7bb/metadata => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:15.197450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-68566ffe-3a14-44cc-969f-29e75f1bbb03 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] Action: 'update', calling method: .version_select at 0x7f06bdfa89d0>, body: {"meta": {"os_distro": "alt"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:15.216660 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-68566ffe-3a14-44cc-969f-29e75f1bbb03 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] HTTP exception thrown: Image not found. Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-68566ffe-3a14-44cc-969f-29e75f1bbb03 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] Request method failure captured: Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: request: PUT /compute/v2.1/images/f8cc7b05-78f0-4d04-86fe-e7309117a80d/metadata/os_distro HTTP/1.1 Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 30 Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14EWo0aoxFv52c3z8kR91jR-hqFzQKuKdVVghcfGmFY6WqITKj3nMzjBljrNAHDrxREwfIp_2bpZBge2FRNITZY-m02og6jB3nPPy9kb-qHvUuXUojTKo0bn5Uq0sdTdHQeHZnYbddfQg9AG4d33ztxHj4rbWRC_b4kY51Clc9InNGQ Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ec4096b6d37f4ebdb4e7d75883f8ca2a Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1637605664 Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:14:15.218666 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:14:15.220050 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec4096b6d37f4ebdb4e7d75883f8ca2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ec4096b6d37f4ebdb4e7d75883f8ca2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ec4096b6d37f4ebdb4e7d75883f8ca2a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec4096b6d37f4ebdb4e7d75883f8ca2a"}]}] Jul 20 04:14:15.220050 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1637605664 Jul 20 04:14:15.220050 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ec4096b6d37f4ebdb4e7d75883f8ca2a Jul 20 04:14:15.220050 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1637605664 Jul 20 04:14:15.220050 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesMetadataNegativeTestJSON-1637605664-project Jul 20 04:14:15.220050 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:14:15.220050 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:14:15.220050 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: d8519aec449a48129296ce3634e423f3 Jul 20 04:14:15.220050 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1637605664-project Jul 20 04:14:15.220050 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:14:15.220050 n-d-826526-5 devstack@n-api.service[127871]: {"meta": {"os_distro": "alt"}} Jul 20 04:14:15.220050 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:14:15.220050 n-d-826526-5 devstack@n-api.service[127871]: exception: Image not found. Jul 20 04:14:15.220050 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'image_id': 'f8cc7b05-78f0-4d04-86fe-e7309117a80d', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 20 04:14:15.225859 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:15.225859 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.225859 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:15.225859 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:15.225859 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:15.225859 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:15.225859 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:15.225859 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:15.225859 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:15.225859 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:15.225859 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:15.225859 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:15.225859 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:15.225859 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:15.225859 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:15.225859 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:15.225859 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:15.225859 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f8cc7b05-78f0-4d04-86fe-e7309117a80d Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:15.227188 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f8cc7b05-78f0-4d04-86fe-e7309117a80d could not be found. Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:15.229202 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:14:15.230597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.232143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-68566ffe-3a14-44cc-969f-29e75f1bbb03 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] Returning 404 to user: Image not found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:15.232143 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-68566ffe-3a14-44cc-969f-29e75f1bbb03 tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] 10.222.0.17 "PUT /compute/v2.1/images/f8cc7b05-78f0-4d04-86fe-e7309117a80d/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.029407 Jul 20 04:14:15.232143 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 742/1354] 10.222.0.17 () {60 vars in 1309 bytes} [Wed Jul 20 04:14:15 2022] PUT /compute/v2.1/images/f8cc7b05-78f0-4d04-86fe-e7309117a80d/metadata/os_distro => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:15.232434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6ccd68dd-47e7-43cf-b50e-3cfcb5c1673d tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] Action: 'create', calling method: .version_select at 0x7f06bde5fee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:15.261561 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-6ccd68dd-47e7-43cf-b50e-3cfcb5c1673d tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] HTTP exception thrown: Image not found. Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6ccd68dd-47e7-43cf-b50e-3cfcb5c1673d tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] Request method failure captured: Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/images/b6d2413a-3b97-4504-bd58-1ecc589d3de0/metadata HTTP/1.1 Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 57 Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14EWo0aoxFv52c3z8kR91jR-hqFzQKuKdVVghcfGmFY6WqITKj3nMzjBljrNAHDrxREwfIp_2bpZBge2FRNITZY-m02og6jB3nPPy9kb-qHvUuXUojTKo0bn5Uq0sdTdHQeHZnYbddfQg9AG4d33ztxHj4rbWRC_b4kY51Clc9InNGQ Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: ec4096b6d37f4ebdb4e7d75883f8ca2a Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1637605664 Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:14:15.264305 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:14:15.265710 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec4096b6d37f4ebdb4e7d75883f8ca2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ec4096b6d37f4ebdb4e7d75883f8ca2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ec4096b6d37f4ebdb4e7d75883f8ca2a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec4096b6d37f4ebdb4e7d75883f8ca2a"}]}] Jul 20 04:14:15.265710 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1637605664 Jul 20 04:14:15.265710 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: ec4096b6d37f4ebdb4e7d75883f8ca2a Jul 20 04:14:15.265710 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1637605664 Jul 20 04:14:15.265710 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesMetadataNegativeTestJSON-1637605664-project Jul 20 04:14:15.265710 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:14:15.265710 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:14:15.265710 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: d8519aec449a48129296ce3634e423f3 Jul 20 04:14:15.265710 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1637605664-project Jul 20 04:14:15.265710 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:14:15.265710 n-d-826526-5 devstack@n-api.service[127870]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 20 04:14:15.265710 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:14:15.265710 n-d-826526-5 devstack@n-api.service[127870]: exception: Image not found. Jul 20 04:14:15.265710 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'image_id': 'b6d2413a-3b97-4504-bd58-1ecc589d3de0', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 20 04:14:15.266610 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:15.266610 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.266610 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:15.266610 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:15.266610 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:15.266610 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:15.266610 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:15.266610 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:15.266610 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:15.266610 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:15.266610 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:15.266610 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:15.266610 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:15.266610 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:15.266610 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:15.266610 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:15.266610 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:15.266610 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b6d2413a-3b97-4504-bd58-1ecc589d3de0 Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:15.267739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b6d2413a-3b97-4504-bd58-1ecc589d3de0 could not be found. Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:15.269062 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:14:15.270780 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.272321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6ccd68dd-47e7-43cf-b50e-3cfcb5c1673d tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] Returning 404 to user: Image not found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:15.272321 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6ccd68dd-47e7-43cf-b50e-3cfcb5c1673d tempest-ImagesMetadataNegativeTestJSON-1637605664 tempest-ImagesMetadataNegativeTestJSON-1637605664-project] 10.222.0.17 "POST /compute/v2.1/images/b6d2413a-3b97-4504-bd58-1ecc589d3de0/metadata" status: 404 len: 62 microversion: 2.1 time: 0.039575 Jul 20 04:14:15.272321 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 613/1355] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Jul 20 04:14:15 2022] POST /compute/v2.1/images/b6d2413a-3b97-4504-bd58-1ecc589d3de0/metadata => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:15.487317 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f7bf19e2-a4a7-4ed4-a600-f48ac9250277 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:15.489292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f7bf19e2-a4a7-4ed4-a600-f48ac9250277 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:15.495630 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-12b1c186-1b9e-466c-ae5f-066ce8c2ee63 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:15.497252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-12b1c186-1b9e-466c-ae5f-066ce8c2ee63 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:15.506109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12b1c186-1b9e-466c-ae5f-066ce8c2ee63 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:15.506794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7bf19e2-a4a7-4ed4-a600-f48ac9250277 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:15.506952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12b1c186-1b9e-466c-ae5f-066ce8c2ee63 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.507256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7bf19e2-a4a7-4ed4-a600-f48ac9250277 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.507596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12b1c186-1b9e-466c-ae5f-066ce8c2ee63 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:15.508039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12b1c186-1b9e-466c-ae5f-066ce8c2ee63 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.508164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7bf19e2-a4a7-4ed4-a600-f48ac9250277 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:15.511566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7bf19e2-a4a7-4ed4-a600-f48ac9250277 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.940458 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f7bf19e2-a4a7-4ed4-a600-f48ac9250277 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1859 microversion: 2.1 time: 0.458633 Jul 20 04:14:15.941335 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 743/1356] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:15 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1859 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:16.142633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-12b1c186-1b9e-466c-ae5f-066ce8c2ee63 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:16.155171 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-12b1c186-1b9e-466c-ae5f-066ce8c2ee63 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1470 microversion: 2.1 time: 0.661675 Jul 20 04:14:16.155812 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 614/1357] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:15 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1470 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:16.165274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-431e8a77-a58e-4aa4-a11f-caf6cc795e70 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:16.172774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-431e8a77-a58e-4aa4-a11f-caf6cc795e70 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:16.190218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-431e8a77-a58e-4aa4-a11f-caf6cc795e70 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.191669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-431e8a77-a58e-4aa4-a11f-caf6cc795e70 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.196630 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-431e8a77-a58e-4aa4-a11f-caf6cc795e70 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.197896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-431e8a77-a58e-4aa4-a11f-caf6cc795e70 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.252474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-76ecb39d-f896-4215-abc2-1458387b7e1e tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:16.254551 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:16.254551 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:14:16.256501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76ecb39d-f896-4215-abc2-1458387b7e1e tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.257212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76ecb39d-f896-4215-abc2-1458387b7e1e tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.258425 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76ecb39d-f896-4215-abc2-1458387b7e1e tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.263546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76ecb39d-f896-4215-abc2-1458387b7e1e tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.296580 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-76ecb39d-f896-4215-abc2-1458387b7e1e tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.353163 Jul 20 04:14:16.297542 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 744/1358] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:14:15 2022] GET /compute/v2.1/os-services => generated 944 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:16.309855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7fca51e1-be55-4164-bcc0-775b5e347e2f tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826526-5", "block_migration": true, "disk_over_commit": false}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:16.318380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7fca51e1-be55-4164-bcc0-775b5e347e2f tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:16.328710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fca51e1-be55-4164-bcc0-775b5e347e2f tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.336748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fca51e1-be55-4164-bcc0-775b5e347e2f tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.338295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fca51e1-be55-4164-bcc0-775b5e347e2f tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.338847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fca51e1-be55-4164-bcc0-775b5e347e2f tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.369952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-7fca51e1-be55-4164-bcc0-775b5e347e2f tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lazy-loading 'flavor' on Instance uuid 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:16.386653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7fca51e1-be55-4164-bcc0-775b5e347e2f tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Going to try to live migrate instance to n-h2-826526-5 {{(pid=127871) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:14:16.810753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-431e8a77-a58e-4aa4-a11f-caf6cc795e70 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:16.819572 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-431e8a77-a58e-4aa4-a11f-caf6cc795e70 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1355 microversion: 2.1 time: 0.662649 Jul 20 04:14:16.823243 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 615/1359] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:16 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1355 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:16.830085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-65132e71-770f-4486-9f80-f02e14346c6e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:16.830709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-65132e71-770f-4486-9f80-f02e14346c6e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:16.850405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65132e71-770f-4486-9f80-f02e14346c6e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.850882 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65132e71-770f-4486-9f80-f02e14346c6e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.855032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65132e71-770f-4486-9f80-f02e14346c6e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.855516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65132e71-770f-4486-9f80-f02e14346c6e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:17.241166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-65132e71-770f-4486-9f80-f02e14346c6e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:17.254484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-65132e71-770f-4486-9f80-f02e14346c6e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:17.259922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-65132e71-770f-4486-9f80-f02e14346c6e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:17.262647 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-65132e71-770f-4486-9f80-f02e14346c6e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.438374 Jul 20 04:14:17.265550 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 616/1360] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:16 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:17.279664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-375342d6-ca5c-4380-910f-5758c79cc981 tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:17.281824 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:17.281824 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:14:17.283668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-375342d6-ca5c-4380-910f-5758c79cc981 tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:17.284375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-375342d6-ca5c-4380-910f-5758c79cc981 tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:17.285418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-375342d6-ca5c-4380-910f-5758c79cc981 tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:17.289774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-375342d6-ca5c-4380-910f-5758c79cc981 tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:17.361582 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-375342d6-ca5c-4380-910f-5758c79cc981 tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.094465 Jul 20 04:14:17.362768 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 617/1361] 10.222.0.17 () {58 vars in 1169 bytes} [Wed Jul 20 04:14:17 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:17.374374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-01f1ec62-1471-437a-a011-761555fb93dc req-ada415ab-6c38-44dd-8efd-4a6c5a1368b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9878d79b-e774-4a05-b2f5-5a4a0c690f86", "tag": "c5713650-7679-40e4-be93-d01d94d54c88"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:17.389021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-01f1ec62-1471-437a-a011-761555fb93dc req-ada415ab-6c38-44dd-8efd-4a6c5a1368b6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:17.390198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-01f1ec62-1471-437a-a011-761555fb93dc req-ada415ab-6c38-44dd-8efd-4a6c5a1368b6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:17.418362 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-01f1ec62-1471-437a-a011-761555fb93dc req-ada415ab-6c38-44dd-8efd-4a6c5a1368b6 service nova] Creating event network-changed:c5713650-7679-40e4-be93-d01d94d54c88 for instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 on n-h1-826526-5 Jul 20 04:14:17.424037 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-01f1ec62-1471-437a-a011-761555fb93dc req-ada415ab-6c38-44dd-8efd-4a6c5a1368b6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059693 Jul 20 04:14:17.425209 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 618/1362] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:17.431319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-957d87f8-0b8f-42ca-8cf8-28cb5aeb1e71 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:17.433051 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-957d87f8-0b8f-42ca-8cf8-28cb5aeb1e71 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:17.440476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-957d87f8-0b8f-42ca-8cf8-28cb5aeb1e71 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:17.441358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-957d87f8-0b8f-42ca-8cf8-28cb5aeb1e71 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:17.442461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-957d87f8-0b8f-42ca-8cf8-28cb5aeb1e71 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:17.443141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-957d87f8-0b8f-42ca-8cf8-28cb5aeb1e71 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:17.466527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:17.992418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-957d87f8-0b8f-42ca-8cf8-28cb5aeb1e71 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:18.005155 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-957d87f8-0b8f-42ca-8cf8-28cb5aeb1e71 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1463 microversion: 2.1 time: 0.578251 Jul 20 04:14:18.005765 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 619/1363] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:17 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1463 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:18.010811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c82f8cd9-b252-4be6-b097-b89ee1a566a3 tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:18.017486 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:18.017486 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:14:18.024646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c82f8cd9-b252-4be6-b097-b89ee1a566a3 tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:18.025404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c82f8cd9-b252-4be6-b097-b89ee1a566a3 tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:18.026269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c82f8cd9-b252-4be6-b097-b89ee1a566a3 tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:18.026728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c82f8cd9-b252-4be6-b097-b89ee1a566a3 tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:18.080245 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c82f8cd9-b252-4be6-b097-b89ee1a566a3 tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.073034 Jul 20 04:14:18.091313 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 620/1364] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:14:18 2022] GET /compute/v2.1/os-services => generated 944 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:18.096241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5727df1b-e62e-4a05-b3e9-670c696a0620 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:18.096882 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5727df1b-e62e-4a05-b3e9-670c696a0620 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:18.122250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5727df1b-e62e-4a05-b3e9-670c696a0620 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:18.122705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5727df1b-e62e-4a05-b3e9-670c696a0620 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:18.123492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5727df1b-e62e-4a05-b3e9-670c696a0620 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:18.123923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5727df1b-e62e-4a05-b3e9-670c696a0620 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:18.660236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5727df1b-e62e-4a05-b3e9-670c696a0620 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:18.679825 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5727df1b-e62e-4a05-b3e9-670c696a0620 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1355 microversion: 2.1 time: 0.585995 Jul 20 04:14:18.691535 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 621/1365] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:18 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1355 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:18.698922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2359c8a6-8924-4571-a222-e8e81c29da21 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:18.699796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2359c8a6-8924-4571-a222-e8e81c29da21 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:18.707310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2359c8a6-8924-4571-a222-e8e81c29da21 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:18.708122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2359c8a6-8924-4571-a222-e8e81c29da21 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:18.709810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2359c8a6-8924-4571-a222-e8e81c29da21 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:18.710490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2359c8a6-8924-4571-a222-e8e81c29da21 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.274033 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2359c8a6-8924-4571-a222-e8e81c29da21 tempest-MigrationsAdminTest-485766885 tempest-MigrationsAdminTest-485766885-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1614 microversion: 2.1 time: 0.580562 Jul 20 04:14:19.275292 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 622/1366] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:18 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1614 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:19.298516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d2cfdcf-f3d3-41b4-861f-dbedf7d22215 tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:19.300238 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:19.300238 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:14:19.301882 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d2cfdcf-f3d3-41b4-861f-dbedf7d22215 tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.302579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d2cfdcf-f3d3-41b4-861f-dbedf7d22215 tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.303654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d2cfdcf-f3d3-41b4-861f-dbedf7d22215 tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.304477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d2cfdcf-f3d3-41b4-861f-dbedf7d22215 tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.332013 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d2cfdcf-f3d3-41b4-861f-dbedf7d22215 tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=n-d-826526-5&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.044590 Jul 20 04:14:19.333073 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 623/1367] 10.222.0.17 () {58 vars in 1193 bytes} [Wed Jul 20 04:14:19 2022] GET /compute/v2.1/os-services?host=n-d-826526-5&binary=xxx => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:19.340543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-677548f1-fcd4-4822-94e9-38c70961b2e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:19.341505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-677548f1-fcd4-4822-94e9-38c70961b2e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:19.349747 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-677548f1-fcd4-4822-94e9-38c70961b2e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.351211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-677548f1-fcd4-4822-94e9-38c70961b2e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.352513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-677548f1-fcd4-4822-94e9-38c70961b2e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.353388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-677548f1-fcd4-4822-94e9-38c70961b2e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.442696 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7fca51e1-be55-4164-bcc0-775b5e347e2f tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/action" status: 202 len: 0 microversion: 2.1 time: 3.139581 Jul 20 04:14:19.444825 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 745/1368] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:14:16 2022] POST /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/action => generated 0 bytes in 3142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:19.644579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-268b962f-e458-4ae8-8915-9a943954394f req-35d2b07b-ef37-4a12-858b-763c5af02993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96067d54-1e58-49cf-b7e9-7fbc5c86df79", "name": "network-vif-plugged", "status": "completed", "tag": "9f32aa7e-a422-4132-a2e3-e55d9f1c8cdb"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:19.654490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-268b962f-e458-4ae8-8915-9a943954394f req-35d2b07b-ef37-4a12-858b-763c5af02993 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.654938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-268b962f-e458-4ae8-8915-9a943954394f req-35d2b07b-ef37-4a12-858b-763c5af02993 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.666700 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-268b962f-e458-4ae8-8915-9a943954394f req-35d2b07b-ef37-4a12-858b-763c5af02993 service nova] Creating event network-vif-plugged:9f32aa7e-a422-4132-a2e3-e55d9f1c8cdb for instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 on n-h2-826526-5 Jul 20 04:14:19.671829 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-268b962f-e458-4ae8-8915-9a943954394f req-35d2b07b-ef37-4a12-858b-763c5af02993 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225765 Jul 20 04:14:19.673364 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 746/1369] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:19.679915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-3c74b5c9-6762-490c-a795-0cb2ec038592 req-a4a906c4-f5a1-4cbc-9c7d-6a44c43ec96a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80122a5-6106-4f62-9d72-5623e8ac0ca7", "name": "network-vif-unplugged", "status": "completed", "tag": "7bc8d479-2b71-4938-aa7d-6a3906728f9d"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:19.689020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3c74b5c9-6762-490c-a795-0cb2ec038592 req-a4a906c4-f5a1-4cbc-9c7d-6a44c43ec96a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.693760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3c74b5c9-6762-490c-a795-0cb2ec038592 req-a4a906c4-f5a1-4cbc-9c7d-6a44c43ec96a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.708421 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-3c74b5c9-6762-490c-a795-0cb2ec038592 req-a4a906c4-f5a1-4cbc-9c7d-6a44c43ec96a service nova] Creating event network-vif-unplugged:7bc8d479-2b71-4938-aa7d-6a3906728f9d for instance b80122a5-6106-4f62-9d72-5623e8ac0ca7 on n-h1-826526-5 Jul 20 04:14:19.716406 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-3c74b5c9-6762-490c-a795-0cb2ec038592 req-a4a906c4-f5a1-4cbc-9c7d-6a44c43ec96a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041355 Jul 20 04:14:19.719174 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 747/1370] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:19.728435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-704df4f3-d2ff-48c3-9643-264a54717b9e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:19.729562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-704df4f3-d2ff-48c3-9643-264a54717b9e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:19.736783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-704df4f3-d2ff-48c3-9643-264a54717b9e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.737350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-704df4f3-d2ff-48c3-9643-264a54717b9e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.738325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-704df4f3-d2ff-48c3-9643-264a54717b9e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.739106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-704df4f3-d2ff-48c3-9643-264a54717b9e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.769625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-704df4f3-d2ff-48c3-9643-264a54717b9e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:19.812837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-677548f1-fcd4-4822-94e9-38c70961b2e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:19.829799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-677548f1-fcd4-4822-94e9-38c70961b2e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:19.831267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-677548f1-fcd4-4822-94e9-38c70961b2e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:19.832868 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-677548f1-fcd4-4822-94e9-38c70961b2e6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.498599 Jul 20 04:14:19.833593 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 624/1371] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:19 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:19.838106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-db053cff-0f45-4d9d-8876-d052da7dc18a tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:19.847624 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:19.847624 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:14:19.849593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db053cff-0f45-4d9d-8876-d052da7dc18a tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.850098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db053cff-0f45-4d9d-8876-d052da7dc18a tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.857643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db053cff-0f45-4d9d-8876-d052da7dc18a tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.858208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db053cff-0f45-4d9d-8876-d052da7dc18a tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.918297 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-db053cff-0f45-4d9d-8876-d052da7dc18a tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.083462 Jul 20 04:14:19.922307 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-704df4f3-d2ff-48c3-9643-264a54717b9e tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "DELETE /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 204 len: 0 microversion: 2.1 time: 0.201198 Jul 20 04:14:19.925111 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 748/1372] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:19 2022] DELETE /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:19.929622 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 625/1373] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:14:19 2022] GET /compute/v2.1/os-services => generated 944 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:19.934599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0913ecb9-be1e-49c1-aad2-0f80f30b1498 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:19.935208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0913ecb9-be1e-49c1-aad2-0f80f30b1498 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:19.938561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ef35528c-4dd0-4c34-be2f-db831d598c37 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:19.939642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ef35528c-4dd0-4c34-be2f-db831d598c37 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:19.950669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0913ecb9-be1e-49c1-aad2-0f80f30b1498 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.951142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef35528c-4dd0-4c34-be2f-db831d598c37 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.951709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0913ecb9-be1e-49c1-aad2-0f80f30b1498 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.952134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef35528c-4dd0-4c34-be2f-db831d598c37 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.952518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0913ecb9-be1e-49c1-aad2-0f80f30b1498 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.952956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0913ecb9-be1e-49c1-aad2-0f80f30b1498 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.953727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef35528c-4dd0-4c34-be2f-db831d598c37 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.954415 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef35528c-4dd0-4c34-be2f-db831d598c37 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.302214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ef35528c-4dd0-4c34-be2f-db831d598c37 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:20.314521 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ef35528c-4dd0-4c34-be2f-db831d598c37 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.387112 Jul 20 04:14:20.326206 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 749/1374] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:19 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:20.333101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b00afa46-a5e8-4093-9704-a3a0c7b341ae tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:20.335209 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:20.335209 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:14:20.337496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b00afa46-a5e8-4093-9704-a3a0c7b341ae tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.339273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b00afa46-a5e8-4093-9704-a3a0c7b341ae tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.340481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b00afa46-a5e8-4093-9704-a3a0c7b341ae tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.341182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b00afa46-a5e8-4093-9704-a3a0c7b341ae tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.378701 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b00afa46-a5e8-4093-9704-a3a0c7b341ae tempest-ServicesAdminNegativeTestJSON-1145105435 tempest-ServicesAdminNegativeTestJSON-1145105435-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.050794 Jul 20 04:14:20.379671 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 750/1375] 10.222.0.17 () {58 vars in 1197 bytes} [Wed Jul 20 04:14:20 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:20.385545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f74ed34e-2516-4ba8-a465-272fd6001f7a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:20.386517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f74ed34e-2516-4ba8-a465-272fd6001f7a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:20.387451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0913ecb9-be1e-49c1-aad2-0f80f30b1498 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:20.395046 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f74ed34e-2516-4ba8-a465-272fd6001f7a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.395686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f74ed34e-2516-4ba8-a465-272fd6001f7a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.396877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f74ed34e-2516-4ba8-a465-272fd6001f7a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.397114 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0913ecb9-be1e-49c1-aad2-0f80f30b1498 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1355 microversion: 2.1 time: 0.466371 Jul 20 04:14:20.397717 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 626/1376] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:19 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1355 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:20.397858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f74ed34e-2516-4ba8-a465-272fd6001f7a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.716933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f74ed34e-2516-4ba8-a465-272fd6001f7a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:20.721173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:20.742512 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f74ed34e-2516-4ba8-a465-272fd6001f7a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1469 microversion: 2.1 time: 0.361178 Jul 20 04:14:20.756066 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 751/1377] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:20 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1469 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:20.782467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-88160755-30e9-4495-9b5b-22b6c7c6a824 tempest-ServicesAdminNegativeTestJSON-697026539 tempest-ServicesAdminNegativeTestJSON-697026539-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:20.783509 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:20.783509 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:14:20.784686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-88160755-30e9-4495-9b5b-22b6c7c6a824 tempest-ServicesAdminNegativeTestJSON-697026539 tempest-ServicesAdminNegativeTestJSON-697026539-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'c8ecc60414614376907e3e94f56a98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4452dddef7774c41b207cc9b733c3616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-88160755-30e9-4495-9b5b-22b6c7c6a824 tempest-ServicesAdminNegativeTestJSON-697026539 tempest-ServicesAdminNegativeTestJSON-697026539-project] Request method failure captured: Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14EWfbsm-8T153mIyNMzjKJ5ohZxTKh9S5LFlmga4FgJWMTxXvre138LVgCJdGZMdxdZQ8bc0iuUXl03e9CsTsRDb_7URNuOTYmYkNz4fWk2vyDMCPcSIc6zSWzZN-JilmnQGQdTUnzbl1UFioUgPk8XuhjySliHXt4D_wUEazKqasE Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4452dddef7774c41b207cc9b733c3616 Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-697026539 Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:14:20.786514 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:14:20.788163 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4452dddef7774c41b207cc9b733c3616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4452dddef7774c41b207cc9b733c3616"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4452dddef7774c41b207cc9b733c3616", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4452dddef7774c41b207cc9b733c3616"}]}] Jul 20 04:14:20.788163 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-697026539 Jul 20 04:14:20.788163 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4452dddef7774c41b207cc9b733c3616 Jul 20 04:14:20.788163 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-697026539 Jul 20 04:14:20.788163 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServicesAdminNegativeTestJSON-697026539-project Jul 20 04:14:20.788163 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:14:20.788163 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:14:20.788163 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: c8ecc60414614376907e3e94f56a98b3 Jul 20 04:14:20.788163 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-697026539-project Jul 20 04:14:20.788163 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:14:20.788163 n-d-826526-5 devstack@n-api.service[127870]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:14:20.788163 n-d-826526-5 devstack@n-api.service[127870]: action_args: {} Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:14:20.789234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:14:20.790613 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:14:20.792193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-88160755-30e9-4495-9b5b-22b6c7c6a824 tempest-ServicesAdminNegativeTestJSON-697026539 tempest-ServicesAdminNegativeTestJSON-697026539-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:20.798333 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-88160755-30e9-4495-9b5b-22b6c7c6a824 tempest-ServicesAdminNegativeTestJSON-697026539 tempest-ServicesAdminNegativeTestJSON-697026539-project] 10.222.0.17 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.389239 Jul 20 04:14:20.798947 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 627/1378] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:14:20 2022] GET /compute/v2.1/os-services => generated 112 bytes in 401 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:20.853170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-98df2b96-6897-46a3-8aec-adebdd5fb1a4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:20.854204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-98df2b96-6897-46a3-8aec-adebdd5fb1a4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:20.892552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98df2b96-6897-46a3-8aec-adebdd5fb1a4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.895316 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98df2b96-6897-46a3-8aec-adebdd5fb1a4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.897194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98df2b96-6897-46a3-8aec-adebdd5fb1a4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.898201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98df2b96-6897-46a3-8aec-adebdd5fb1a4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:21.174402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-98df2b96-6897-46a3-8aec-adebdd5fb1a4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:21.188159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-98df2b96-6897-46a3-8aec-adebdd5fb1a4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:21.191663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-98df2b96-6897-46a3-8aec-adebdd5fb1a4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:21.193214 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-98df2b96-6897-46a3-8aec-adebdd5fb1a4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.345031 Jul 20 04:14:21.193798 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 752/1379] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:20 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:21.334213 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a9b93717-b2e4-423c-8e7f-8089b67d4b86 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:21.341440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a9b93717-b2e4-423c-8e7f-8089b67d4b86 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:21.367194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a9b93717-b2e4-423c-8e7f-8089b67d4b86 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:21.371001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a9b93717-b2e4-423c-8e7f-8089b67d4b86 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:21.372703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a9b93717-b2e4-423c-8e7f-8089b67d4b86 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:21.374377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a9b93717-b2e4-423c-8e7f-8089b67d4b86 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:21.414969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5ddb319b-3dc6-4bb7-8bd7-3bc96c001e4b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:21.415441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5ddb319b-3dc6-4bb7-8bd7-3bc96c001e4b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:21.434358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ddb319b-3dc6-4bb7-8bd7-3bc96c001e4b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:21.440159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ddb319b-3dc6-4bb7-8bd7-3bc96c001e4b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:21.441085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ddb319b-3dc6-4bb7-8bd7-3bc96c001e4b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:21.441530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ddb319b-3dc6-4bb7-8bd7-3bc96c001e4b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:22.080549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5ddb319b-3dc6-4bb7-8bd7-3bc96c001e4b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:22.091819 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5ddb319b-3dc6-4bb7-8bd7-3bc96c001e4b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1355 microversion: 2.1 time: 0.679208 Jul 20 04:14:22.092924 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 753/1380] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:21 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1355 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:22.116582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cb037d3f-d63a-4ffb-88e8-31d89ccceb0b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:22.117420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cb037d3f-d63a-4ffb-88e8-31d89ccceb0b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:22.138224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb037d3f-d63a-4ffb-88e8-31d89ccceb0b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:22.138712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb037d3f-d63a-4ffb-88e8-31d89ccceb0b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:22.139521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb037d3f-d63a-4ffb-88e8-31d89ccceb0b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:22.139944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb037d3f-d63a-4ffb-88e8-31d89ccceb0b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:22.323097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cb037d3f-d63a-4ffb-88e8-31d89ccceb0b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:22.333152 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cb037d3f-d63a-4ffb-88e8-31d89ccceb0b tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 200 len: 1298 microversion: 2.1 time: 0.238762 Jul 20 04:14:22.336931 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 754/1381] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:22 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 1298 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:22.356179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-78ab1f47-8769-48dd-904b-09b8021d52c7 req-beba1369-3297-4e20-a24d-8db2722e35d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b80122a5-6106-4f62-9d72-5623e8ac0ca7", "tag": "7bc8d479-2b71-4938-aa7d-6a3906728f9d"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:22.368436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-78ab1f47-8769-48dd-904b-09b8021d52c7 req-beba1369-3297-4e20-a24d-8db2722e35d0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:22.369098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-78ab1f47-8769-48dd-904b-09b8021d52c7 req-beba1369-3297-4e20-a24d-8db2722e35d0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:22.390164 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-78ab1f47-8769-48dd-904b-09b8021d52c7 req-beba1369-3297-4e20-a24d-8db2722e35d0 service nova] Creating event network-changed:7bc8d479-2b71-4938-aa7d-6a3906728f9d for instance b80122a5-6106-4f62-9d72-5623e8ac0ca7 on n-h1-826526-5 Jul 20 04:14:22.396610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a9b93717-b2e4-423c-8e7f-8089b67d4b86 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:22.398221 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-78ab1f47-8769-48dd-904b-09b8021d52c7 req-beba1369-3297-4e20-a24d-8db2722e35d0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059364 Jul 20 04:14:22.399392 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 755/1382] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:22.406841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c10b6c1d-d3c8-4942-ab4b-dede699cf7ba tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:22.407774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c10b6c1d-d3c8-4942-ab4b-dede699cf7ba tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:22.409213 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a9b93717-b2e4-423c-8e7f-8089b67d4b86 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 1.079913 Jul 20 04:14:22.411196 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 628/1383] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:21 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:22.438024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c10b6c1d-d3c8-4942-ab4b-dede699cf7ba tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:22.438583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c10b6c1d-d3c8-4942-ab4b-dede699cf7ba tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:22.439532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c10b6c1d-d3c8-4942-ab4b-dede699cf7ba tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:22.439865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c10b6c1d-d3c8-4942-ab4b-dede699cf7ba tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:22.968278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c10b6c1d-d3c8-4942-ab4b-dede699cf7ba tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:22.986710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c10b6c1d-d3c8-4942-ab4b-dede699cf7ba tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:22.991961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c10b6c1d-d3c8-4942-ab4b-dede699cf7ba tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:22.995168 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c10b6c1d-d3c8-4942-ab4b-dede699cf7ba tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.594469 Jul 20 04:14:23.009321 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 756/1384] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:22 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:23.110301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ddccde4a-74e4-4a28-881a-326fa407434b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:23.111117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ddccde4a-74e4-4a28-881a-326fa407434b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:23.121237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ddccde4a-74e4-4a28-881a-326fa407434b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:23.121973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ddccde4a-74e4-4a28-881a-326fa407434b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:23.123041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ddccde4a-74e4-4a28-881a-326fa407434b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:23.123642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ddccde4a-74e4-4a28-881a-326fa407434b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:23.360028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6a51f9d8-f34e-4036-911a-9695039494ce tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:23.362954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6a51f9d8-f34e-4036-911a-9695039494ce tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 96067d54-1e58-49cf-b7e9-7fbc5c86df79] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:23.375551 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a51f9d8-f34e-4036-911a-9695039494ce tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:23.377827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a51f9d8-f34e-4036-911a-9695039494ce tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:23.380182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a51f9d8-f34e-4036-911a-9695039494ce tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:23.381016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a51f9d8-f34e-4036-911a-9695039494ce tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:23.419108 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-6a51f9d8-f34e-4036-911a-9695039494ce tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] HTTP exception thrown: Instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 could not be found. Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6a51f9d8-f34e-4036-911a-9695039494ce tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Request method failure captured: Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 HTTP/1.1 Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_ogHKpISmEdjH5FROOlwz0Ev017YBccEyVz7qZ2h666LLDlH1OroF8UoG4a2PPZziZ6EcVqYpoI_rd2uiUfDqWu7yndaEjtWBPekHK4RKBObmJ0sw2wiLQae-jbq0E6cAB4rjIavvFsr8SOnQZyn__bT6-GmnjjW2C3JpkiFWamTs Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 6c73d55e6bc740d0aec2ba67f0491099 Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-MigrationsAdminTest-11980428 Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:14:23.421335 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:14:23.422803 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c73d55e6bc740d0aec2ba67f0491099"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c73d55e6bc740d0aec2ba67f0491099"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c73d55e6bc740d0aec2ba67f0491099", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c73d55e6bc740d0aec2ba67f0491099"}]}] Jul 20 04:14:23.422803 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-MigrationsAdminTest-11980428 Jul 20 04:14:23.422803 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 6c73d55e6bc740d0aec2ba67f0491099 Jul 20 04:14:23.422803 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-MigrationsAdminTest-11980428 Jul 20 04:14:23.422803 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-MigrationsAdminTest-11980428-project Jul 20 04:14:23.422803 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:14:23.422803 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:14:23.422803 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: b4f8b49fd45944a384836a1459e4e7e9 Jul 20 04:14:23.422803 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-MigrationsAdminTest-11980428-project Jul 20 04:14:23.422803 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:14:23.422803 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 could not be found. Jul 20 04:14:23.422803 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '96067d54-1e58-49cf-b7e9-7fbc5c86df79'} Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 could not be found. Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:23.423830 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:23.425326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:23.425326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:23.425326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:23.425326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:23.425326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:23.425326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:23.425326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:23.425326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 could not be found. Jul 20 04:14:23.425326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:23.425326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:23.425326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:23.425326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:23.425326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:23.425326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:23.425326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:23.425326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:23.425326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 could not be found. Jul 20 04:14:23.425326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:23.431186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6a51f9d8-f34e-4036-911a-9695039494ce tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Returning 404 to user: Instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:23.433556 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6a51f9d8-f34e-4036-911a-9695039494ce tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79" status: 404 len: 111 microversion: 2.1 time: 0.081285 Jul 20 04:14:23.434697 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 757/1385] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:23 2022] GET /compute/v2.1/servers/96067d54-1e58-49cf-b7e9-7fbc5c86df79 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:23.440932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e9c6224b-3c12-4043-82d6-740e489aa947 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:23.441834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e9c6224b-3c12-4043-82d6-740e489aa947 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:23.451565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9c6224b-3c12-4043-82d6-740e489aa947 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:23.452310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9c6224b-3c12-4043-82d6-740e489aa947 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:23.453345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9c6224b-3c12-4043-82d6-740e489aa947 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:23.453940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9c6224b-3c12-4043-82d6-740e489aa947 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:23.471450 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ddccde4a-74e4-4a28-881a-326fa407434b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:23.479546 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ddccde4a-74e4-4a28-881a-326fa407434b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1355 microversion: 2.1 time: 0.374067 Jul 20 04:14:23.490760 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 629/1386] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:23 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1355 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:23.497346 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bfe36416-0f8e-4443-8fc8-1d753bb234d7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:23.497847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bfe36416-0f8e-4443-8fc8-1d753bb234d7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:23.504814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bfe36416-0f8e-4443-8fc8-1d753bb234d7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:23.505526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bfe36416-0f8e-4443-8fc8-1d753bb234d7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:23.506494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bfe36416-0f8e-4443-8fc8-1d753bb234d7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:23.507089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bfe36416-0f8e-4443-8fc8-1d753bb234d7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:23.549572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bfe36416-0f8e-4443-8fc8-1d753bb234d7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:23.651750 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bfe36416-0f8e-4443-8fc8-1d753bb234d7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "DELETE /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 204 len: 0 microversion: 2.1 time: 0.158388 Jul 20 04:14:23.653545 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 630/1387] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:23 2022] DELETE /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:23.665234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d3d454c4-2979-4d09-b5b7-feb0509ffde9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:23.667982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d3d454c4-2979-4d09-b5b7-feb0509ffde9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:23.676593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d3d454c4-2979-4d09-b5b7-feb0509ffde9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:23.677534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d3d454c4-2979-4d09-b5b7-feb0509ffde9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:23.678610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d3d454c4-2979-4d09-b5b7-feb0509ffde9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:23.679770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d3d454c4-2979-4d09-b5b7-feb0509ffde9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.080593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d3d454c4-2979-4d09-b5b7-feb0509ffde9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:24.101002 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d3d454c4-2979-4d09-b5b7-feb0509ffde9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1535 microversion: 2.1 time: 0.436604 Jul 20 04:14:24.101858 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 631/1388] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:23 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1535 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:24.116605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cbf80737-ce17-4c5a-b654-c601aaa774a3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:24.120854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cbf80737-ce17-4c5a-b654-c601aaa774a3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:24.129397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cbf80737-ce17-4c5a-b654-c601aaa774a3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.130189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cbf80737-ce17-4c5a-b654-c601aaa774a3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.131355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cbf80737-ce17-4c5a-b654-c601aaa774a3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.132478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cbf80737-ce17-4c5a-b654-c601aaa774a3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.291832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e9c6224b-3c12-4043-82d6-740e489aa947 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:24.314373 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e9c6224b-3c12-4043-82d6-740e489aa947 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.878354 Jul 20 04:14:24.314967 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 758/1389] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:23 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:24.449454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-bc702eac-f7a5-40d0-aa88-c371abea73b2 req-8f4fe9b2-5961-49cc-8155-912ee0a6b5fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96067d54-1e58-49cf-b7e9-7fbc5c86df79", "name": "network-vif-deleted", "tag": "9f32aa7e-a422-4132-a2e3-e55d9f1c8cdb"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:24.472626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bc702eac-f7a5-40d0-aa88-c371abea73b2 req-8f4fe9b2-5961-49cc-8155-912ee0a6b5fb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.473460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bc702eac-f7a5-40d0-aa88-c371abea73b2 req-8f4fe9b2-5961-49cc-8155-912ee0a6b5fb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.494083 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-bc702eac-f7a5-40d0-aa88-c371abea73b2 req-8f4fe9b2-5961-49cc-8155-912ee0a6b5fb service nova] Creating event network-vif-deleted:9f32aa7e-a422-4132-a2e3-e55d9f1c8cdb for instance 96067d54-1e58-49cf-b7e9-7fbc5c86df79 on n-h2-826526-5 Jul 20 04:14:24.501085 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-bc702eac-f7a5-40d0-aa88-c371abea73b2 req-8f4fe9b2-5961-49cc-8155-912ee0a6b5fb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058092 Jul 20 04:14:24.502261 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 759/1390] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:24.511924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0a372971-31f9-4d27-afaa-4438c4117881 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:24.514473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0a372971-31f9-4d27-afaa-4438c4117881 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:24.523671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a372971-31f9-4d27-afaa-4438c4117881 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.524429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a372971-31f9-4d27-afaa-4438c4117881 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.525728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a372971-31f9-4d27-afaa-4438c4117881 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.526499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a372971-31f9-4d27-afaa-4438c4117881 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.557780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cbf80737-ce17-4c5a-b654-c601aaa774a3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:24.579908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cbf80737-ce17-4c5a-b654-c601aaa774a3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:24.581913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cbf80737-ce17-4c5a-b654-c601aaa774a3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:24.583751 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cbf80737-ce17-4c5a-b654-c601aaa774a3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.479635 Jul 20 04:14:24.585072 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 632/1391] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:24 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:24.928239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0a372971-31f9-4d27-afaa-4438c4117881 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:24.942859 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0a372971-31f9-4d27-afaa-4438c4117881 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1355 microversion: 2.1 time: 0.438342 Jul 20 04:14:24.946118 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 760/1392] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:24 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1355 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:25.120910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-076a1ff8-925d-4dbd-9e93-67de8c22706d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:25.121842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-076a1ff8-925d-4dbd-9e93-67de8c22706d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:25.142871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-076a1ff8-925d-4dbd-9e93-67de8c22706d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:25.143325 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-076a1ff8-925d-4dbd-9e93-67de8c22706d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:25.144122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-076a1ff8-925d-4dbd-9e93-67de8c22706d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:25.152055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-076a1ff8-925d-4dbd-9e93-67de8c22706d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:25.333463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8502e98c-5a6c-47e6-af04-b20448e3e09d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:25.334086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8502e98c-5a6c-47e6-af04-b20448e3e09d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:25.343429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8502e98c-5a6c-47e6-af04-b20448e3e09d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:25.343885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8502e98c-5a6c-47e6-af04-b20448e3e09d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:25.347060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8502e98c-5a6c-47e6-af04-b20448e3e09d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:25.350004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8502e98c-5a6c-47e6-af04-b20448e3e09d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:25.473626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-076a1ff8-925d-4dbd-9e93-67de8c22706d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:25.482095 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-076a1ff8-925d-4dbd-9e93-67de8c22706d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1535 microversion: 2.1 time: 0.366687 Jul 20 04:14:25.485446 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 633/1393] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:25 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1535 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:25.602804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-44c44b9c-3b53-4a6a-9892-6dfdcfc76d82 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:25.604452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-44c44b9c-3b53-4a6a-9892-6dfdcfc76d82 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:25.616414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44c44b9c-3b53-4a6a-9892-6dfdcfc76d82 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:25.617261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44c44b9c-3b53-4a6a-9892-6dfdcfc76d82 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:25.618281 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44c44b9c-3b53-4a6a-9892-6dfdcfc76d82 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:25.621377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44c44b9c-3b53-4a6a-9892-6dfdcfc76d82 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:25.874533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8502e98c-5a6c-47e6-af04-b20448e3e09d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:25.886172 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8502e98c-5a6c-47e6-af04-b20448e3e09d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.558015 Jul 20 04:14:25.889287 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 761/1394] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:25 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:25.964062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4ed90301-badd-4307-b804-6fb8ab326689 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:25.964808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4ed90301-badd-4307-b804-6fb8ab326689 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:25.975909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ed90301-badd-4307-b804-6fb8ab326689 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:25.976390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ed90301-badd-4307-b804-6fb8ab326689 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:25.977366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ed90301-badd-4307-b804-6fb8ab326689 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:25.983670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ed90301-badd-4307-b804-6fb8ab326689 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:26.364958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4ed90301-badd-4307-b804-6fb8ab326689 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:26.375207 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4ed90301-badd-4307-b804-6fb8ab326689 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1355 microversion: 2.1 time: 0.415988 Jul 20 04:14:26.375806 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 762/1395] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:25 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1355 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:26.503462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c63fbfa-827f-47d3-86f9-4b43c4df9606 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:26.504243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0c63fbfa-827f-47d3-86f9-4b43c4df9606 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:26.515947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c63fbfa-827f-47d3-86f9-4b43c4df9606 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:26.516541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c63fbfa-827f-47d3-86f9-4b43c4df9606 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:26.517189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c63fbfa-827f-47d3-86f9-4b43c4df9606 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:26.517755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c63fbfa-827f-47d3-86f9-4b43c4df9606 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:26.600372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-44c44b9c-3b53-4a6a-9892-6dfdcfc76d82 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:26.609445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-44c44b9c-3b53-4a6a-9892-6dfdcfc76d82 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:26.610907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-44c44b9c-3b53-4a6a-9892-6dfdcfc76d82 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:26.612087 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-44c44b9c-3b53-4a6a-9892-6dfdcfc76d82 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 1.013710 Jul 20 04:14:26.626440 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 634/1396] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:25 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:14:26.903090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-62376f30-bd77-46c5-9137-cac2517aefbb tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:26.903938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62376f30-bd77-46c5-9137-cac2517aefbb tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:26.910673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62376f30-bd77-46c5-9137-cac2517aefbb tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:26.911121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62376f30-bd77-46c5-9137-cac2517aefbb tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:26.911884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62376f30-bd77-46c5-9137-cac2517aefbb tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:26.918356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62376f30-bd77-46c5-9137-cac2517aefbb tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:27.179018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0c63fbfa-827f-47d3-86f9-4b43c4df9606 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:27.188788 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0c63fbfa-827f-47d3-86f9-4b43c4df9606 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 200 len: 1493 microversion: 2.1 time: 0.690487 Jul 20 04:14:27.201264 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 763/1397] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:26 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 1493 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:27.207662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-63def1e3-528e-415e-81c3-df80139456e2 req-9b137bce-b777-41f5-9435-f87bdced53fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944a56a8-87ef-4988-9f97-106c08046fe9", "name": "network-vif-deleted", "tag": "63a5fa97-49af-495f-b6c4-80e7f5925cac"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:27.217578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-63def1e3-528e-415e-81c3-df80139456e2 req-9b137bce-b777-41f5-9435-f87bdced53fb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:27.218024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-63def1e3-528e-415e-81c3-df80139456e2 req-9b137bce-b777-41f5-9435-f87bdced53fb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:27.234228 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-63def1e3-528e-415e-81c3-df80139456e2 req-9b137bce-b777-41f5-9435-f87bdced53fb service nova] Creating event network-vif-deleted:63a5fa97-49af-495f-b6c4-80e7f5925cac for instance 944a56a8-87ef-4988-9f97-106c08046fe9 on n-h2-826526-5 Jul 20 04:14:27.241114 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-63def1e3-528e-415e-81c3-df80139456e2 req-9b137bce-b777-41f5-9435-f87bdced53fb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037959 Jul 20 04:14:27.241960 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 764/1398] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:27.381032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-fb644825-8910-4de0-824c-5db867357aa7 req-43851870-fdd4-4d48-b7e9-f37c5682f8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9878d79b-e774-4a05-b2f5-5a4a0c690f86", "name": "network-vif-plugged", "status": "completed", "tag": "455130e7-f24c-4265-b7d2-b727163deac0"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:27.391510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-fb644825-8910-4de0-824c-5db867357aa7 req-43851870-fdd4-4d48-b7e9-f37c5682f8a9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:27.391954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-fb644825-8910-4de0-824c-5db867357aa7 req-43851870-fdd4-4d48-b7e9-f37c5682f8a9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:27.423529 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-fb644825-8910-4de0-824c-5db867357aa7 req-43851870-fdd4-4d48-b7e9-f37c5682f8a9 service nova] Creating event network-vif-plugged:455130e7-f24c-4265-b7d2-b727163deac0 for instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 on n-h1-826526-5 Jul 20 04:14:27.442065 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-fb644825-8910-4de0-824c-5db867357aa7 req-43851870-fdd4-4d48-b7e9-f37c5682f8a9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065512 Jul 20 04:14:27.443364 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 765/1399] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:27.449357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9c5e4985-0fd4-4e79-a13e-bc3b44451f54 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:27.450319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9c5e4985-0fd4-4e79-a13e-bc3b44451f54 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:27.469778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c5e4985-0fd4-4e79-a13e-bc3b44451f54 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:27.470516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c5e4985-0fd4-4e79-a13e-bc3b44451f54 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:27.471464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c5e4985-0fd4-4e79-a13e-bc3b44451f54 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:27.472240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c5e4985-0fd4-4e79-a13e-bc3b44451f54 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:27.561318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-62376f30-bd77-46c5-9137-cac2517aefbb tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:27.594621 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-62376f30-bd77-46c5-9137-cac2517aefbb tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.677748 Jul 20 04:14:27.607690 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 635/1400] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:26 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:27.651261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-10256f34-61ae-4998-8e40-41ff956083b3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:27.653282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-10256f34-61ae-4998-8e40-41ff956083b3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:27.685915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10256f34-61ae-4998-8e40-41ff956083b3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:27.691440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10256f34-61ae-4998-8e40-41ff956083b3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:27.697814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10256f34-61ae-4998-8e40-41ff956083b3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:27.699510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10256f34-61ae-4998-8e40-41ff956083b3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:27.813277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9c5e4985-0fd4-4e79-a13e-bc3b44451f54 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:27.829130 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9c5e4985-0fd4-4e79-a13e-bc3b44451f54 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1355 microversion: 2.1 time: 0.382545 Jul 20 04:14:27.830380 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 766/1401] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:27 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1355 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:28.207860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d140afd5-b494-4ff7-8f77-a001c141f4c2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:28.208564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d140afd5-b494-4ff7-8f77-a001c141f4c2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 944a56a8-87ef-4988-9f97-106c08046fe9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:28.224008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d140afd5-b494-4ff7-8f77-a001c141f4c2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:28.224480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d140afd5-b494-4ff7-8f77-a001c141f4c2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:28.225356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d140afd5-b494-4ff7-8f77-a001c141f4c2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:28.225959 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d140afd5-b494-4ff7-8f77-a001c141f4c2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:28.254077 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-d140afd5-b494-4ff7-8f77-a001c141f4c2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] HTTP exception thrown: Instance 944a56a8-87ef-4988-9f97-106c08046fe9 could not be found. Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d140afd5-b494-4ff7-8f77-a001c141f4c2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Request method failure captured: Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 HTTP/1.1 Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_ogHKpISmEdjH5FROOlwz0Ev017YBccEyVz7qZ2h666LLDlH1OroF8UoG4a2PPZziZ6EcVqYpoI_rd2uiUfDqWu7yndaEjtWBPekHK4RKBObmJ0sw2wiLQae-jbq0E6cAB4rjIavvFsr8SOnQZyn__bT6-GmnjjW2C3JpkiFWamTs Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 6c73d55e6bc740d0aec2ba67f0491099 Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-MigrationsAdminTest-11980428 Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:14:28.256815 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:14:28.258339 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c73d55e6bc740d0aec2ba67f0491099"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c73d55e6bc740d0aec2ba67f0491099"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c73d55e6bc740d0aec2ba67f0491099", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c73d55e6bc740d0aec2ba67f0491099"}]}] Jul 20 04:14:28.258339 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-MigrationsAdminTest-11980428 Jul 20 04:14:28.258339 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 6c73d55e6bc740d0aec2ba67f0491099 Jul 20 04:14:28.258339 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-MigrationsAdminTest-11980428 Jul 20 04:14:28.258339 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-MigrationsAdminTest-11980428-project Jul 20 04:14:28.258339 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:14:28.258339 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:14:28.258339 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: b4f8b49fd45944a384836a1459e4e7e9 Jul 20 04:14:28.258339 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-MigrationsAdminTest-11980428-project Jul 20 04:14:28.258339 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:14:28.258339 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 944a56a8-87ef-4988-9f97-106c08046fe9 could not be found. Jul 20 04:14:28.258339 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '944a56a8-87ef-4988-9f97-106c08046fe9'} Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 944a56a8-87ef-4988-9f97-106c08046fe9 could not be found. Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:28.259097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:28.260533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:28.260533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:28.260533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:28.260533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:28.260533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:28.260533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:28.260533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:28.260533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 944a56a8-87ef-4988-9f97-106c08046fe9 could not be found. Jul 20 04:14:28.260533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.260533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:28.260533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.260533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:28.260533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:28.260533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:28.260533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:28.260533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:28.260533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 944a56a8-87ef-4988-9f97-106c08046fe9 could not be found. Jul 20 04:14:28.260533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.263221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d140afd5-b494-4ff7-8f77-a001c141f4c2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Returning 404 to user: Instance 944a56a8-87ef-4988-9f97-106c08046fe9 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:28.264467 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d140afd5-b494-4ff7-8f77-a001c141f4c2 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9" status: 404 len: 111 microversion: 2.1 time: 0.060680 Jul 20 04:14:28.270132 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 767/1402] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:28 2022] GET /compute/v2.1/servers/944a56a8-87ef-4988-9f97-106c08046fe9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:28.276219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f6d49fb6-f6e0-445b-812b-0d1fef6b8a7c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '.version_select at 0x7f06bdf75160>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:28.286657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-10256f34-61ae-4998-8e40-41ff956083b3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:28.300311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-10256f34-61ae-4998-8e40-41ff956083b3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:28.305603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-10256f34-61ae-4998-8e40-41ff956083b3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:28.310638 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-10256f34-61ae-4998-8e40-41ff956083b3 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.667329 Jul 20 04:14:28.311443 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f6d49fb6-f6e0-445b-812b-0d1fef6b8a7c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-882049605" status: 202 len: 0 microversion: 2.1 time: 0.039610 Jul 20 04:14:28.312190 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 768/1403] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jul 20 04:14:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-882049605 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:28.325608 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 636/1404] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:27 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:28.625939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-39b0ff9a-4f66-4621-8029-2729158e8599 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:28.626587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-39b0ff9a-4f66-4621-8029-2729158e8599 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:28.643844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39b0ff9a-4f66-4621-8029-2729158e8599 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:28.644666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39b0ff9a-4f66-4621-8029-2729158e8599 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:28.648307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39b0ff9a-4f66-4621-8029-2729158e8599 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:28.648836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39b0ff9a-4f66-4621-8029-2729158e8599 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:28.847016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0f862c7c-4f25-4dc5-86d1-b56ffe7d022e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:28.848291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0f862c7c-4f25-4dc5-86d1-b56ffe7d022e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:28.859416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:28.864819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f862c7c-4f25-4dc5-86d1-b56ffe7d022e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:28.865553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f862c7c-4f25-4dc5-86d1-b56ffe7d022e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:28.866458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f862c7c-4f25-4dc5-86d1-b56ffe7d022e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:28.867122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f862c7c-4f25-4dc5-86d1-b56ffe7d022e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:28.937800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:28.979949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-39b0ff9a-4f66-4621-8029-2729158e8599 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:28.996227 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-39b0ff9a-4f66-4621-8029-2729158e8599 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.373816 Jul 20 04:14:29.021689 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 769/1405] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:28 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:29.335919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fe16a0ae-82a6-4af3-b9e6-36aefcf7fc03 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:29.337484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fe16a0ae-82a6-4af3-b9e6-36aefcf7fc03 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:29.353005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe16a0ae-82a6-4af3-b9e6-36aefcf7fc03 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:29.353544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe16a0ae-82a6-4af3-b9e6-36aefcf7fc03 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:29.354364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe16a0ae-82a6-4af3-b9e6-36aefcf7fc03 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:29.354810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe16a0ae-82a6-4af3-b9e6-36aefcf7fc03 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:29.557091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0f862c7c-4f25-4dc5-86d1-b56ffe7d022e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:29.576722 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0f862c7c-4f25-4dc5-86d1-b56ffe7d022e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1355 microversion: 2.1 time: 0.729591 Jul 20 04:14:29.578008 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 637/1406] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:28 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1355 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:29.613419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-4bbf5510-bed7-47f2-bea0-8aaff7f925f5 req-9ab672e0-3f53-4eae-845a-85c246b47acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9878d79b-e774-4a05-b2f5-5a4a0c690f86", "name": "network-vif-plugged", "status": "completed", "tag": "2670d39f-bcc3-4495-a4a2-620ef21fa379"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:29.634564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4bbf5510-bed7-47f2-bea0-8aaff7f925f5 req-9ab672e0-3f53-4eae-845a-85c246b47acb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:29.635386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4bbf5510-bed7-47f2-bea0-8aaff7f925f5 req-9ab672e0-3f53-4eae-845a-85c246b47acb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:29.658585 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-4bbf5510-bed7-47f2-bea0-8aaff7f925f5 req-9ab672e0-3f53-4eae-845a-85c246b47acb service nova] Creating event network-vif-plugged:2670d39f-bcc3-4495-a4a2-620ef21fa379 for instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 on n-h1-826526-5 Jul 20 04:14:29.671036 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-4bbf5510-bed7-47f2-bea0-8aaff7f925f5 req-9ab672e0-3f53-4eae-845a-85c246b47acb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064379 Jul 20 04:14:29.673046 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 638/1407] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:29.717009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4c350d87-cbdb-4153-a05e-af91ed8d47c8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:29.719212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4c350d87-cbdb-4153-a05e-af91ed8d47c8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:29.738415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c350d87-cbdb-4153-a05e-af91ed8d47c8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:29.739133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c350d87-cbdb-4153-a05e-af91ed8d47c8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:29.741118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c350d87-cbdb-4153-a05e-af91ed8d47c8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:29.742042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c350d87-cbdb-4153-a05e-af91ed8d47c8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:29.781379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4c350d87-cbdb-4153-a05e-af91ed8d47c8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:29.867539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fe16a0ae-82a6-4af3-b9e6-36aefcf7fc03 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:29.881511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:29.886506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fe16a0ae-82a6-4af3-b9e6-36aefcf7fc03 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:29.888016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fe16a0ae-82a6-4af3-b9e6-36aefcf7fc03 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:29.889504 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fe16a0ae-82a6-4af3-b9e6-36aefcf7fc03 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.561074 Jul 20 04:14:29.890075 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 770/1408] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:29 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:14:29.988705 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4c350d87-cbdb-4153-a05e-af91ed8d47c8 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "DELETE /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 204 len: 0 microversion: 2.1 time: 0.298328 Jul 20 04:14:29.992901 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 639/1409] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:29 2022] DELETE /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:29.997489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-30561efd-7b67-4ca6-a207-2282080fe160 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:29.998531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-30561efd-7b67-4ca6-a207-2282080fe160 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:30.008395 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:30.017364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30561efd-7b67-4ca6-a207-2282080fe160 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:30.019433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30561efd-7b67-4ca6-a207-2282080fe160 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:30.022627 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30561efd-7b67-4ca6-a207-2282080fe160 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:30.024697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30561efd-7b67-4ca6-a207-2282080fe160 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:30.026425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7f00e565-83aa-4737-b848-535da6fcdb88 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:30.027365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7f00e565-83aa-4737-b848-535da6fcdb88 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:30.034886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f00e565-83aa-4737-b848-535da6fcdb88 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:30.035654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f00e565-83aa-4737-b848-535da6fcdb88 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:30.036144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f00e565-83aa-4737-b848-535da6fcdb88 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:30.036621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f00e565-83aa-4737-b848-535da6fcdb88 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:30.359786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=16 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:30.509444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-30561efd-7b67-4ca6-a207-2282080fe160 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:30.517956 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-30561efd-7b67-4ca6-a207-2282080fe160 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1469 microversion: 2.1 time: 0.524315 Jul 20 04:14:30.533926 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 771/1410] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:29 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1469 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:30.539632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-70bb1173-c770-45e6-a7b5-1027417d2b21 req-fd279929-4580-4da3-b7dd-27670dc4b1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80122a5-6106-4f62-9d72-5623e8ac0ca7", "name": "network-vif-unplugged", "status": "completed", "tag": "7bc8d479-2b71-4938-aa7d-6a3906728f9d"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:30.557897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-70bb1173-c770-45e6-a7b5-1027417d2b21 req-fd279929-4580-4da3-b7dd-27670dc4b1c1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:30.558880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-70bb1173-c770-45e6-a7b5-1027417d2b21 req-fd279929-4580-4da3-b7dd-27670dc4b1c1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:30.582727 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-70bb1173-c770-45e6-a7b5-1027417d2b21 req-fd279929-4580-4da3-b7dd-27670dc4b1c1 service nova] Creating event network-vif-unplugged:7bc8d479-2b71-4938-aa7d-6a3906728f9d for instance b80122a5-6106-4f62-9d72-5623e8ac0ca7 on n-h1-826526-5 Jul 20 04:14:30.592001 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-70bb1173-c770-45e6-a7b5-1027417d2b21 req-fd279929-4580-4da3-b7dd-27670dc4b1c1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056088 Jul 20 04:14:30.593490 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 772/1411] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:30.601921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6e3b0224-7791-4530-ba93-6dee394454e8 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:30.603023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6e3b0224-7791-4530-ba93-6dee394454e8 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:30.617840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e3b0224-7791-4530-ba93-6dee394454e8 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:30.618356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e3b0224-7791-4530-ba93-6dee394454e8 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:30.619230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e3b0224-7791-4530-ba93-6dee394454e8 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:30.619674 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e3b0224-7791-4530-ba93-6dee394454e8 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:31.013082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6e3b0224-7791-4530-ba93-6dee394454e8 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:31.051316 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6e3b0224-7791-4530-ba93-6dee394454e8 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1355 microversion: 2.1 time: 0.447114 Jul 20 04:14:31.054869 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 773/1412] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:30 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1355 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:31.063373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4fd4b8c4-f91f-4acb-b93d-06c5f68fc389 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:31.069614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4fd4b8c4-f91f-4acb-b93d-06c5f68fc389 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:31.093547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4fd4b8c4-f91f-4acb-b93d-06c5f68fc389 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:31.093996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4fd4b8c4-f91f-4acb-b93d-06c5f68fc389 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:31.094912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7f00e565-83aa-4737-b848-535da6fcdb88 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:31.100472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4fd4b8c4-f91f-4acb-b93d-06c5f68fc389 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:31.101163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4fd4b8c4-f91f-4acb-b93d-06c5f68fc389 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:31.104060 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7f00e565-83aa-4737-b848-535da6fcdb88 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 1.086143 Jul 20 04:14:31.108039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:31.111865 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 640/1413] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:30 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:31.484529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4fd4b8c4-f91f-4acb-b93d-06c5f68fc389 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:31.509218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4fd4b8c4-f91f-4acb-b93d-06c5f68fc389 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:31.513520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4fd4b8c4-f91f-4acb-b93d-06c5f68fc389 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:31.516717 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4fd4b8c4-f91f-4acb-b93d-06c5f68fc389 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.456739 Jul 20 04:14:31.517621 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 774/1414] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:31 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:31.541556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4700597d-0e8a-4485-ba74-57b9c229bdf9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:31.542309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4700597d-0e8a-4485-ba74-57b9c229bdf9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:31.558438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4700597d-0e8a-4485-ba74-57b9c229bdf9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:31.558992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4700597d-0e8a-4485-ba74-57b9c229bdf9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:31.560746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4700597d-0e8a-4485-ba74-57b9c229bdf9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:31.562002 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4700597d-0e8a-4485-ba74-57b9c229bdf9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:31.765208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-3202a98a-3510-4fd9-8667-7bd8bf82db7e req-7296753c-4ceb-444e-b766-796232ac3bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9878d79b-e774-4a05-b2f5-5a4a0c690f86", "name": "network-vif-plugged", "status": "completed", "tag": "c5713650-7679-40e4-be93-d01d94d54c88"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:31.786778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3202a98a-3510-4fd9-8667-7bd8bf82db7e req-7296753c-4ceb-444e-b766-796232ac3bfd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:31.787501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3202a98a-3510-4fd9-8667-7bd8bf82db7e req-7296753c-4ceb-444e-b766-796232ac3bfd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:31.804121 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-3202a98a-3510-4fd9-8667-7bd8bf82db7e req-7296753c-4ceb-444e-b766-796232ac3bfd service nova] Creating event network-vif-plugged:c5713650-7679-40e4-be93-d01d94d54c88 for instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 on n-h1-826526-5 Jul 20 04:14:31.821592 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-3202a98a-3510-4fd9-8667-7bd8bf82db7e req-7296753c-4ceb-444e-b766-796232ac3bfd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058519 Jul 20 04:14:31.825733 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 775/1415] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:32.077604 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d91831b1-ddb5-4651-9d65-013538765fab tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:32.078319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d91831b1-ddb5-4651-9d65-013538765fab tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:32.100603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d91831b1-ddb5-4651-9d65-013538765fab tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:32.101409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d91831b1-ddb5-4651-9d65-013538765fab tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:32.102563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d91831b1-ddb5-4651-9d65-013538765fab tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:32.103113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d91831b1-ddb5-4651-9d65-013538765fab tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:32.162676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4700597d-0e8a-4485-ba74-57b9c229bdf9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:32.178357 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4700597d-0e8a-4485-ba74-57b9c229bdf9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1469 microversion: 2.1 time: 0.642998 Jul 20 04:14:32.180205 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 641/1416] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:31 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1469 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:32.189732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-74d4651e-de74-4d4f-857f-661cb79fb864 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:32.191781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-74d4651e-de74-4d4f-857f-661cb79fb864 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:32.210565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74d4651e-de74-4d4f-857f-661cb79fb864 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:32.211764 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74d4651e-de74-4d4f-857f-661cb79fb864 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:32.218977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74d4651e-de74-4d4f-857f-661cb79fb864 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:32.220440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74d4651e-de74-4d4f-857f-661cb79fb864 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:32.824658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-74d4651e-de74-4d4f-857f-661cb79fb864 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:32.837184 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-74d4651e-de74-4d4f-857f-661cb79fb864 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.655595 Jul 20 04:14:32.838222 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 642/1417] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:32 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:32.844053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d3c979a-42e3-43b3-81d2-c639f1e543d5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:32.850359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d3c979a-42e3-43b3-81d2-c639f1e543d5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:32.874349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d3c979a-42e3-43b3-81d2-c639f1e543d5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:32.874796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d3c979a-42e3-43b3-81d2-c639f1e543d5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:32.875833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d3c979a-42e3-43b3-81d2-c639f1e543d5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:32.876548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d3c979a-42e3-43b3-81d2-c639f1e543d5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:33.111467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d91831b1-ddb5-4651-9d65-013538765fab tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:33.135282 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d91831b1-ddb5-4651-9d65-013538765fab tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1355 microversion: 2.1 time: 1.066647 Jul 20 04:14:33.137377 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 776/1418] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:32 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1355 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:33.197149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bd87ebbb-003c-46bb-97be-8738f9fc39d9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:33.197821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bd87ebbb-003c-46bb-97be-8738f9fc39d9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:33.209449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd87ebbb-003c-46bb-97be-8738f9fc39d9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:33.221652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd87ebbb-003c-46bb-97be-8738f9fc39d9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:33.224179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd87ebbb-003c-46bb-97be-8738f9fc39d9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:33.225897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd87ebbb-003c-46bb-97be-8738f9fc39d9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:33.640520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d3c979a-42e3-43b3-81d2-c639f1e543d5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:33.651379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d3c979a-42e3-43b3-81d2-c639f1e543d5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:33.660076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d3c979a-42e3-43b3-81d2-c639f1e543d5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:33.665122 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d3c979a-42e3-43b3-81d2-c639f1e543d5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.824875 Jul 20 04:14:33.670079 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 643/1419] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:32 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:33.862069 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-02489567-35cc-4e00-94ea-da1043ab9fc0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:33.863239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-02489567-35cc-4e00-94ea-da1043ab9fc0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:33.874938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02489567-35cc-4e00-94ea-da1043ab9fc0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:33.881229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02489567-35cc-4e00-94ea-da1043ab9fc0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:33.882401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02489567-35cc-4e00-94ea-da1043ab9fc0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:33.887600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02489567-35cc-4e00-94ea-da1043ab9fc0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:34.411731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bd87ebbb-003c-46bb-97be-8738f9fc39d9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:34.413592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-02489567-35cc-4e00-94ea-da1043ab9fc0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:34.428629 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bd87ebbb-003c-46bb-97be-8738f9fc39d9 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 200 len: 1469 microversion: 2.1 time: 1.232781 Jul 20 04:14:34.432486 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 777/1420] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:33 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 1469 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:34.442342 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-02489567-35cc-4e00-94ea-da1043ab9fc0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.585063 Jul 20 04:14:34.443463 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 644/1421] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:33 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:34.446581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-3ef10b14-5f18-4989-88cd-8ba0c0dac327 req-4b9c7965-e4aa-47d9-9fe4-727889d9180b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367d7c6a-04c7-4d70-9afd-bbc8d97c9247", "name": "network-vif-deleted", "tag": "10cee44f-babb-4437-935e-ea2811233f2e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:34.459956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3ef10b14-5f18-4989-88cd-8ba0c0dac327 req-4b9c7965-e4aa-47d9-9fe4-727889d9180b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:34.461203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0683a75b-ee68-4036-b085-8f275ff1ab17 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:34.461998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3ef10b14-5f18-4989-88cd-8ba0c0dac327 req-4b9c7965-e4aa-47d9-9fe4-727889d9180b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:34.462123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0683a75b-ee68-4036-b085-8f275ff1ab17 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:34.495995 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0683a75b-ee68-4036-b085-8f275ff1ab17 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:34.497285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0683a75b-ee68-4036-b085-8f275ff1ab17 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:34.498364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0683a75b-ee68-4036-b085-8f275ff1ab17 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:34.500137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0683a75b-ee68-4036-b085-8f275ff1ab17 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:34.500709 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-3ef10b14-5f18-4989-88cd-8ba0c0dac327 req-4b9c7965-e4aa-47d9-9fe4-727889d9180b service nova] Creating event network-vif-deleted:10cee44f-babb-4437-935e-ea2811233f2e for instance 367d7c6a-04c7-4d70-9afd-bbc8d97c9247 on n-h1-826526-5 Jul 20 04:14:34.515465 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-3ef10b14-5f18-4989-88cd-8ba0c0dac327 req-4b9c7965-e4aa-47d9-9fe4-727889d9180b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081649 Jul 20 04:14:34.522065 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 778/1422] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:34.692519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6f760da8-12ef-4f93-affc-6d47f598c5f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:34.693347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6f760da8-12ef-4f93-affc-6d47f598c5f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:34.701555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f760da8-12ef-4f93-affc-6d47f598c5f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:34.701994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f760da8-12ef-4f93-affc-6d47f598c5f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:34.705547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f760da8-12ef-4f93-affc-6d47f598c5f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:34.705999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f760da8-12ef-4f93-affc-6d47f598c5f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:34.800171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0683a75b-ee68-4036-b085-8f275ff1ab17 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:34.809910 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0683a75b-ee68-4036-b085-8f275ff1ab17 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1805 microversion: 2.1 time: 0.365014 Jul 20 04:14:34.810529 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 645/1423] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:34 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1805 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:35.022999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0fca1c46-df4b-491f-918f-5600b2f976f9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-408057235", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "4a34548b-e35a-44a0-ab83-c5f87d932d5b"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:35.120375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-0fca1c46-df4b-491f-918f-5600b2f976f9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] validate_networks() for [('4a34548b-e35a-44a0-ab83-c5f87d932d5b', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:14:35.456715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6f760da8-12ef-4f93-affc-6d47f598c5f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:35.471297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6f760da8-12ef-4f93-affc-6d47f598c5f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:35.473484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6f760da8-12ef-4f93-affc-6d47f598c5f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:35.475028 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6f760da8-12ef-4f93-affc-6d47f598c5f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1811 microversion: 2.25 time: 0.791207 Jul 20 04:14:35.476220 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 779/1424] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:34 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1811 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:14:35.492652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b310cff-fad3-42a1-af47-e9707df010e3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:35.493889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9b310cff-fad3-42a1-af47-e9707df010e3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:35.503396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b310cff-fad3-42a1-af47-e9707df010e3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.504356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b310cff-fad3-42a1-af47-e9707df010e3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.505414 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b310cff-fad3-42a1-af47-e9707df010e3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.506061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b310cff-fad3-42a1-af47-e9707df010e3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.557333 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9b310cff-fad3-42a1-af47-e9707df010e3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86/ips" status: 200 len: 218 microversion: 2.1 time: 0.079681 Jul 20 04:14:35.562956 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 780/1425] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 04:14:35 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86/ips => generated 218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:35.573695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-20f5263e-a986-4253-b9f7-9c6c534c1259 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:35.574750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-20f5263e-a986-4253-b9f7-9c6c534c1259 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 367d7c6a-04c7-4d70-9afd-bbc8d97c9247] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:35.585732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20f5263e-a986-4253-b9f7-9c6c534c1259 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.586661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20f5263e-a986-4253-b9f7-9c6c534c1259 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.587863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20f5263e-a986-4253-b9f7-9c6c534c1259 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.589230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20f5263e-a986-4253-b9f7-9c6c534c1259 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.606679 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-20f5263e-a986-4253-b9f7-9c6c534c1259 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] HTTP exception thrown: Instance 367d7c6a-04c7-4d70-9afd-bbc8d97c9247 could not be found. Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-20f5263e-a986-4253-b9f7-9c6c534c1259 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Request method failure captured: Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 HTTP/1.1 Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_ogHKpISmEdjH5FROOlwz0Ev017YBccEyVz7qZ2h666LLDlH1OroF8UoG4a2PPZziZ6EcVqYpoI_rd2uiUfDqWu7yndaEjtWBPekHK4RKBObmJ0sw2wiLQae-jbq0E6cAB4rjIavvFsr8SOnQZyn__bT6-GmnjjW2C3JpkiFWamTs Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 6c73d55e6bc740d0aec2ba67f0491099 Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-MigrationsAdminTest-11980428 Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:14:35.608554 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:14:35.609987 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c73d55e6bc740d0aec2ba67f0491099"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c73d55e6bc740d0aec2ba67f0491099"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c73d55e6bc740d0aec2ba67f0491099", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c73d55e6bc740d0aec2ba67f0491099"}]}] Jul 20 04:14:35.609987 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-MigrationsAdminTest-11980428 Jul 20 04:14:35.609987 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 6c73d55e6bc740d0aec2ba67f0491099 Jul 20 04:14:35.609987 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-MigrationsAdminTest-11980428 Jul 20 04:14:35.609987 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-MigrationsAdminTest-11980428-project Jul 20 04:14:35.609987 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:14:35.609987 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:14:35.609987 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: b4f8b49fd45944a384836a1459e4e7e9 Jul 20 04:14:35.609987 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-MigrationsAdminTest-11980428-project Jul 20 04:14:35.609987 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:14:35.609987 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 367d7c6a-04c7-4d70-9afd-bbc8d97c9247 could not be found. Jul 20 04:14:35.609987 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '367d7c6a-04c7-4d70-9afd-bbc8d97c9247'} Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 367d7c6a-04c7-4d70-9afd-bbc8d97c9247 could not be found. Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:35.610794 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:35.612591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:35.612591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:35.612591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:35.612591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:35.612591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:35.612591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:35.612591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:35.612591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 367d7c6a-04c7-4d70-9afd-bbc8d97c9247 could not be found. Jul 20 04:14:35.612591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:35.612591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:35.612591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:35.612591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:35.612591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:35.612591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:35.612591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:35.612591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:35.612591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 367d7c6a-04c7-4d70-9afd-bbc8d97c9247 could not be found. Jul 20 04:14:35.612591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:35.615091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-20f5263e-a986-4253-b9f7-9c6c534c1259 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Returning 404 to user: Instance 367d7c6a-04c7-4d70-9afd-bbc8d97c9247 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:35.615091 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-20f5263e-a986-4253-b9f7-9c6c534c1259 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247" status: 404 len: 111 microversion: 2.1 time: 0.045692 Jul 20 04:14:35.615091 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 781/1426] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:35 2022] GET /compute/v2.1/servers/367d7c6a-04c7-4d70-9afd-bbc8d97c9247 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:35.615527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-15466717-9693-4a51-893e-14168db858c7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:35.615991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-15466717-9693-4a51-893e-14168db858c7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:35.623142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-15466717-9693-4a51-893e-14168db858c7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.623631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-15466717-9693-4a51-893e-14168db858c7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.624467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-15466717-9693-4a51-893e-14168db858c7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.624915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-15466717-9693-4a51-893e-14168db858c7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.831414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0fca1c46-df4b-491f-918f-5600b2f976f9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:14:35.831992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0fca1c46-df4b-491f-918f-5600b2f976f9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:14:35.832309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0fca1c46-df4b-491f-918f-5600b2f976f9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:14:35.832726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0fca1c46-df4b-491f-918f-5600b2f976f9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:14:35.833143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0fca1c46-df4b-491f-918f-5600b2f976f9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:14:35.844235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0fca1c46-df4b-491f-918f-5600b2f976f9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.845718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0fca1c46-df4b-491f-918f-5600b2f976f9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.847231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0fca1c46-df4b-491f-918f-5600b2f976f9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.847836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0fca1c46-df4b-491f-918f-5600b2f976f9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.870190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-0fca1c46-df4b-491f-918f-5600b2f976f9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Getting quotas for project 2c925e4a93c3401fa5f4d51e7380b7ad. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:35.876446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-0fca1c46-df4b-491f-918f-5600b2f976f9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Getting quotas for user feb531c9e5dd4afd99f2974848a6a75b and project 2c925e4a93c3401fa5f4d51e7380b7ad. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:35.899836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0fca1c46-df4b-491f-918f-5600b2f976f9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:14:35.902765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0fca1c46-df4b-491f-918f-5600b2f976f9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:14:35.954027 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0fca1c46-df4b-491f-918f-5600b2f976f9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.130211 Jul 20 04:14:35.955051 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 646/1427] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:14:35.960029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9a0123f6-f54a-4146-be37-c6317feb568e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:35.960851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9a0123f6-f54a-4146-be37-c6317feb568e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:35.968539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a0123f6-f54a-4146-be37-c6317feb568e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.969332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a0123f6-f54a-4146-be37-c6317feb568e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.970312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a0123f6-f54a-4146-be37-c6317feb568e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.970951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a0123f6-f54a-4146-be37-c6317feb568e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.005084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9a0123f6-f54a-4146-be37-c6317feb568e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:36.142918 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9a0123f6-f54a-4146-be37-c6317feb568e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 204 len: 0 microversion: 2.1 time: 0.186025 Jul 20 04:14:36.152907 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 647/1428] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:35 2022] DELETE /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:36.164798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-73bee915-4e6d-417b-808d-481c772b9c8d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:36.168616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-73bee915-4e6d-417b-808d-481c772b9c8d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:36.178931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73bee915-4e6d-417b-808d-481c772b9c8d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.179656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73bee915-4e6d-417b-808d-481c772b9c8d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.180737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73bee915-4e6d-417b-808d-481c772b9c8d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.181744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73bee915-4e6d-417b-808d-481c772b9c8d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.236386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-73bee915-4e6d-417b-808d-481c772b9c8d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:36.388973 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-73bee915-4e6d-417b-808d-481c772b9c8d tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 204 len: 0 microversion: 2.1 time: 0.236413 Jul 20 04:14:36.390362 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 648/1429] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:36 2022] DELETE /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:36.404961 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0c88cbcd-16b8-44af-9010-5c217b5b4232 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:36.405987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0c88cbcd-16b8-44af-9010-5c217b5b4232 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:36.486027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0c88cbcd-16b8-44af-9010-5c217b5b4232 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:36.497494 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0c88cbcd-16b8-44af-9010-5c217b5b4232 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15" status: 200 len: 1207 microversion: 2.1 time: 0.101962 Jul 20 04:14:36.498385 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 649/1430] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:36 2022] GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 => generated 1207 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:36.498385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bc3c2a87-f74c-4bbd-a85e-adad5942abf6 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:36.498385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bc3c2a87-f74c-4bbd-a85e-adad5942abf6 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:36.534055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc3c2a87-f74c-4bbd-a85e-adad5942abf6 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.534727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc3c2a87-f74c-4bbd-a85e-adad5942abf6 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.535534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc3c2a87-f74c-4bbd-a85e-adad5942abf6 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.535982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc3c2a87-f74c-4bbd-a85e-adad5942abf6 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.664029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-15466717-9693-4a51-893e-14168db858c7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:36.682849 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-15466717-9693-4a51-893e-14168db858c7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 1.070860 Jul 20 04:14:36.683290 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 782/1431] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:35 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:36.698112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bd3ca445-d362-48c6-acee-8f3c5e37d17f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:36.700110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bd3ca445-d362-48c6-acee-8f3c5e37d17f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:36.714208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd3ca445-d362-48c6-acee-8f3c5e37d17f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.716872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd3ca445-d362-48c6-acee-8f3c5e37d17f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.718471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd3ca445-d362-48c6-acee-8f3c5e37d17f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.719840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd3ca445-d362-48c6-acee-8f3c5e37d17f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.832155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bc3c2a87-f74c-4bbd-a85e-adad5942abf6 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:36.844828 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bc3c2a87-f74c-4bbd-a85e-adad5942abf6 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1811 microversion: 2.1 time: 0.344578 Jul 20 04:14:36.860379 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 650/1432] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:36 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1811 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:36.870338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b37a4e3e-e98e-4c88-b2fc-a3d517ceec62 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:36.870946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b37a4e3e-e98e-4c88-b2fc-a3d517ceec62 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:36.893293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b37a4e3e-e98e-4c88-b2fc-a3d517ceec62 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.895328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b37a4e3e-e98e-4c88-b2fc-a3d517ceec62 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.896312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b37a4e3e-e98e-4c88-b2fc-a3d517ceec62 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.896843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b37a4e3e-e98e-4c88-b2fc-a3d517ceec62 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.937430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:37.096309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b37a4e3e-e98e-4c88-b2fc-a3d517ceec62 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:37.106015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b37a4e3e-e98e-4c88-b2fc-a3d517ceec62 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:37.107891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b37a4e3e-e98e-4c88-b2fc-a3d517ceec62 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:37.109373 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b37a4e3e-e98e-4c88-b2fc-a3d517ceec62 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1801 microversion: 2.25 time: 0.247904 Jul 20 04:14:37.110754 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 651/1433] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:36 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1801 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:37.127697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-45ab6921-0cd9-4876-8e89-dbca570d1264 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '.version_select at 0x7f06bde57430>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:37.130355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45ab6921-0cd9-4876-8e89-dbca570d1264 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.131644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45ab6921-0cd9-4876-8e89-dbca570d1264 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.145351 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-45ab6921-0cd9-4876-8e89-dbca570d1264 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 3450 microversion: 2.25 time: 0.022014 Jul 20 04:14:37.146064 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 652/1434] 10.222.0.17 () {60 vars in 1183 bytes} [Wed Jul 20 04:14:37 2022] GET /compute/v2.1/os-migrations => generated 3450 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:14:37.158942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c06a317a-75df-41e6-b8dd-d3f2ff02d78f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:37.159685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c06a317a-75df-41e6-b8dd-d3f2ff02d78f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:37.165926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c06a317a-75df-41e6-b8dd-d3f2ff02d78f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.166494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c06a317a-75df-41e6-b8dd-d3f2ff02d78f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.167326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c06a317a-75df-41e6-b8dd-d3f2ff02d78f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.167930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c06a317a-75df-41e6-b8dd-d3f2ff02d78f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.319586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-c06a317a-75df-41e6-b8dd-d3f2ff02d78f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'services' on Instance uuid b80122a5-6106-4f62-9d72-5623e8ac0ca7 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:37.375316 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c06a317a-75df-41e6-b8dd-d3f2ff02d78f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 2420 microversion: 2.25 time: 0.220250 Jul 20 04:14:37.378092 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 653/1435] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:37 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 2420 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:37.398273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8ab14909-fecd-4a8e-8b5d-1a9a7e36d8e6 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:37.399575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8ab14909-fecd-4a8e-8b5d-1a9a7e36d8e6 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:37.417578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8ab14909-fecd-4a8e-8b5d-1a9a7e36d8e6 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.418590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8ab14909-fecd-4a8e-8b5d-1a9a7e36d8e6 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.419669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8ab14909-fecd-4a8e-8b5d-1a9a7e36d8e6 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.420512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8ab14909-fecd-4a8e-8b5d-1a9a7e36d8e6 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.540229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bd3ca445-d362-48c6-acee-8f3c5e37d17f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:37.557665 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bd3ca445-d362-48c6-acee-8f3c5e37d17f tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1466 microversion: 2.1 time: 0.871630 Jul 20 04:14:37.561113 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 783/1436] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:36 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1466 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:37.578931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-784e511b-3cf1-45f2-afdf-e37520ef2d10 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:37.580099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-784e511b-3cf1-45f2-afdf-e37520ef2d10 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:37.626749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-784e511b-3cf1-45f2-afdf-e37520ef2d10 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.627119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-784e511b-3cf1-45f2-afdf-e37520ef2d10 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.636228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-784e511b-3cf1-45f2-afdf-e37520ef2d10 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.638897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-784e511b-3cf1-45f2-afdf-e37520ef2d10 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.873903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-8ab14909-fecd-4a8e-8b5d-1a9a7e36d8e6 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'services' on Instance uuid b80122a5-6106-4f62-9d72-5623e8ac0ca7 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:37.894890 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8ab14909-fecd-4a8e-8b5d-1a9a7e36d8e6 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 2420 microversion: 2.25 time: 0.504395 Jul 20 04:14:37.910404 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 654/1437] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:37 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 2420 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:37.917626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-419d61a6-fac9-4df5-ba0b-37b612e4878f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:37.918354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-419d61a6-fac9-4df5-ba0b-37b612e4878f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:37.927651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-419d61a6-fac9-4df5-ba0b-37b612e4878f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.928569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-419d61a6-fac9-4df5-ba0b-37b612e4878f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.928975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-784e511b-3cf1-45f2-afdf-e37520ef2d10 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:37.931474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-419d61a6-fac9-4df5-ba0b-37b612e4878f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.932187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-419d61a6-fac9-4df5-ba0b-37b612e4878f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.942445 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-784e511b-3cf1-45f2-afdf-e37520ef2d10 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15" status: 200 len: 1203 microversion: 2.1 time: 0.376766 Jul 20 04:14:37.943925 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 784/1438] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:37 2022] GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 => generated 1203 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:37.959094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-83d22912-56d8-4ad2-ba22-bec1d5a6c5ad tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:37.966112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-83d22912-56d8-4ad2-ba22-bec1d5a6c5ad tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:37.974071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83d22912-56d8-4ad2-ba22-bec1d5a6c5ad tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.977418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83d22912-56d8-4ad2-ba22-bec1d5a6c5ad tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.981600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83d22912-56d8-4ad2-ba22-bec1d5a6c5ad tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.983368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83d22912-56d8-4ad2-ba22-bec1d5a6c5ad tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:38.545897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-419d61a6-fac9-4df5-ba0b-37b612e4878f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:38.554605 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-419d61a6-fac9-4df5-ba0b-37b612e4878f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.642702 Jul 20 04:14:38.555949 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 655/1439] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:37 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:38.560896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-711781da-5fdb-4691-8e70-a7533844fdaa tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:38.561546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-711781da-5fdb-4691-8e70-a7533844fdaa tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:38.578560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-711781da-5fdb-4691-8e70-a7533844fdaa tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.579549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-711781da-5fdb-4691-8e70-a7533844fdaa tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:38.581316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-711781da-5fdb-4691-8e70-a7533844fdaa tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.583420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-711781da-5fdb-4691-8e70-a7533844fdaa tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:38.634405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-83d22912-56d8-4ad2-ba22-bec1d5a6c5ad tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:38.650653 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-83d22912-56d8-4ad2-ba22-bec1d5a6c5ad tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1811 microversion: 2.1 time: 0.701077 Jul 20 04:14:38.669889 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 785/1440] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:37 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1811 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:38.682133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6f814ef1-52fa-4ba6-a009-268c96d65b3c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:38.689617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6f814ef1-52fa-4ba6-a009-268c96d65b3c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:38.699108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f814ef1-52fa-4ba6-a009-268c96d65b3c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.700614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f814ef1-52fa-4ba6-a009-268c96d65b3c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:38.701676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f814ef1-52fa-4ba6-a009-268c96d65b3c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.707822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f814ef1-52fa-4ba6-a009-268c96d65b3c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:38.865814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-711781da-5fdb-4691-8e70-a7533844fdaa tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lazy-loading 'services' on Instance uuid b80122a5-6106-4f62-9d72-5623e8ac0ca7 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:39.367047 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-711781da-5fdb-4691-8e70-a7533844fdaa tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments/1a46cfb7-cd30-4b40-b074-032ca2686d13" status: 202 len: 0 microversion: 2.25 time: 0.809258 Jul 20 04:14:39.371209 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 656/1441] 10.222.0.17 () {60 vars in 1456 bytes} [Wed Jul 20 04:14:38 2022] DELETE /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments/1a46cfb7-cd30-4b40-b074-032ca2686d13 => generated 0 bytes in 811 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:39.409163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-22e6c8b2-61e0-4ca1-8193-325e7f2ee733 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.410449 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-22e6c8b2-61e0-4ca1-8193-325e7f2ee733 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:39.440008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22e6c8b2-61e0-4ca1-8193-325e7f2ee733 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:39.441654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22e6c8b2-61e0-4ca1-8193-325e7f2ee733 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:39.443030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22e6c8b2-61e0-4ca1-8193-325e7f2ee733 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:39.446468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22e6c8b2-61e0-4ca1-8193-325e7f2ee733 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:39.621049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-22e6c8b2-61e0-4ca1-8193-325e7f2ee733 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:39.634548 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-22e6c8b2-61e0-4ca1-8193-325e7f2ee733 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15" status: 200 len: 1265 microversion: 2.1 time: 0.265023 Jul 20 04:14:39.635379 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 657/1442] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:39 2022] GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:39.640306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-74d3c4eb-1b6b-423a-a53b-c1ad0b31fe7a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.641529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-74d3c4eb-1b6b-423a-a53b-c1ad0b31fe7a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:39.648174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74d3c4eb-1b6b-423a-a53b-c1ad0b31fe7a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:39.649260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74d3c4eb-1b6b-423a-a53b-c1ad0b31fe7a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:39.650311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74d3c4eb-1b6b-423a-a53b-c1ad0b31fe7a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:39.650957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74d3c4eb-1b6b-423a-a53b-c1ad0b31fe7a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:39.707124 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-74d3c4eb-1b6b-423a-a53b-c1ad0b31fe7a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.070494 Jul 20 04:14:39.708103 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 658/1443] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:14:39 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:14:39.719663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cae69df7-ada8-42d9-b15c-7c9b0d58f11c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.720819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cae69df7-ada8-42d9-b15c-7c9b0d58f11c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:39.729209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cae69df7-ada8-42d9-b15c-7c9b0d58f11c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:39.730191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cae69df7-ada8-42d9-b15c-7c9b0d58f11c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:39.731432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cae69df7-ada8-42d9-b15c-7c9b0d58f11c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:39.732198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cae69df7-ada8-42d9-b15c-7c9b0d58f11c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:39.862015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6f814ef1-52fa-4ba6-a009-268c96d65b3c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:39.868446 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6f814ef1-52fa-4ba6-a009-268c96d65b3c tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1466 microversion: 2.1 time: 1.197158 Jul 20 04:14:39.869086 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 786/1444] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:38 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1466 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:39.878642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d163be51-eb13-4900-8845-4778684c2ee7 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.884488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d163be51-eb13-4900-8845-4778684c2ee7 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:39.891586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d163be51-eb13-4900-8845-4778684c2ee7 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:39.893990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d163be51-eb13-4900-8845-4778684c2ee7 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:39.895025 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d163be51-eb13-4900-8845-4778684c2ee7 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:39.895721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d163be51-eb13-4900-8845-4778684c2ee7 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.586450 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cae69df7-ada8-42d9-b15c-7c9b0d58f11c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:40.601603 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cae69df7-ada8-42d9-b15c-7c9b0d58f11c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.891987 Jul 20 04:14:40.611286 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 659/1445] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:39 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:40.623545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-1e7147d0-827c-43da-bbc4-e43041ac41fd req-f1fda4d4-6e5a-4907-abd0-00010f64ce06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9878d79b-e774-4a05-b2f5-5a4a0c690f86", "name": "network-vif-deleted", "tag": "455130e7-f24c-4265-b7d2-b727163deac0"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:40.658296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-1e7147d0-827c-43da-bbc4-e43041ac41fd req-f1fda4d4-6e5a-4907-abd0-00010f64ce06 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.666863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-1e7147d0-827c-43da-bbc4-e43041ac41fd req-f1fda4d4-6e5a-4907-abd0-00010f64ce06 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.698365 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-1e7147d0-827c-43da-bbc4-e43041ac41fd req-f1fda4d4-6e5a-4907-abd0-00010f64ce06 service nova] Creating event network-vif-deleted:455130e7-f24c-4265-b7d2-b727163deac0 for instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 on n-h1-826526-5 Jul 20 04:14:40.724543 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-1e7147d0-827c-43da-bbc4-e43041ac41fd req-f1fda4d4-6e5a-4907-abd0-00010f64ce06 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111595 Jul 20 04:14:40.734735 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 660/1446] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:40.747883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-8386f8b9-2e5a-4a13-aaa0-cd714e61ce54 req-f8237568-6531-4e13-aaff-32a684f95b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9878d79b-e774-4a05-b2f5-5a4a0c690f86", "name": "network-vif-unplugged", "status": "completed", "tag": "2670d39f-bcc3-4495-a4a2-620ef21fa379"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:40.770905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8386f8b9-2e5a-4a13-aaa0-cd714e61ce54 req-f8237568-6531-4e13-aaff-32a684f95b7a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.781994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8386f8b9-2e5a-4a13-aaa0-cd714e61ce54 req-f8237568-6531-4e13-aaff-32a684f95b7a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.798004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d163be51-eb13-4900-8845-4778684c2ee7 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:40.813570 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-8386f8b9-2e5a-4a13-aaa0-cd714e61ce54 req-f8237568-6531-4e13-aaff-32a684f95b7a service nova] Creating event network-vif-unplugged:2670d39f-bcc3-4495-a4a2-620ef21fa379 for instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 on n-h1-826526-5 Jul 20 04:14:40.821533 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-8386f8b9-2e5a-4a13-aaa0-cd714e61ce54 req-f8237568-6531-4e13-aaff-32a684f95b7a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083182 Jul 20 04:14:40.821861 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d163be51-eb13-4900-8845-4778684c2ee7 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1790 microversion: 2.1 time: 0.947645 Jul 20 04:14:40.822731 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 787/1447] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:39 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1790 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:40.824126 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 661/1448] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:40.830126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a5e26109-da42-4d6e-bcf7-8086bddbf766 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:40.831500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a5e26109-da42-4d6e-bcf7-8086bddbf766 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:40.842272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5e26109-da42-4d6e-bcf7-8086bddbf766 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.843022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5e26109-da42-4d6e-bcf7-8086bddbf766 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.843162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2b9cf1de-af59-4ff0-8383-e3d6ec99d307 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:40.843822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2b9cf1de-af59-4ff0-8383-e3d6ec99d307 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:40.844475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5e26109-da42-4d6e-bcf7-8086bddbf766 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.845299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5e26109-da42-4d6e-bcf7-8086bddbf766 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.865900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b9cf1de-af59-4ff0-8383-e3d6ec99d307 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.866696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b9cf1de-af59-4ff0-8383-e3d6ec99d307 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.869649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b9cf1de-af59-4ff0-8383-e3d6ec99d307 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.870261 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b9cf1de-af59-4ff0-8383-e3d6ec99d307 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.891627 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a5e26109-da42-4d6e-bcf7-8086bddbf766 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.065520 Jul 20 04:14:40.896070 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 662/1449] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:14:40 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:14:40.901932 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-03b9aef3-fa81-4c31-b3bf-01cb0f7eeb4a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:40.902986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-03b9aef3-fa81-4c31-b3bf-01cb0f7eeb4a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:40.913336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03b9aef3-fa81-4c31-b3bf-01cb0f7eeb4a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.914120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03b9aef3-fa81-4c31-b3bf-01cb0f7eeb4a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.915201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03b9aef3-fa81-4c31-b3bf-01cb0f7eeb4a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.915991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03b9aef3-fa81-4c31-b3bf-01cb0f7eeb4a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.959150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03b9aef3-fa81-4c31-b3bf-01cb0f7eeb4a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.959951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03b9aef3-fa81-4c31-b3bf-01cb0f7eeb4a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.960773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-03b9aef3-fa81-4c31-b3bf-01cb0f7eeb4a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lazy-loading 'fault' on Instance uuid 0cb300df-ffbd-4b36-88f0-cb0e17340221 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:41.075639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-03b9aef3-fa81-4c31-b3bf-01cb0f7eeb4a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f8b49fd45944a384836a1459e4e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c73d55e6bc740d0aec2ba67f0491099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:41.097137 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-03b9aef3-fa81-4c31-b3bf-01cb0f7eeb4a tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 200 len: 1301 microversion: 2.1 time: 0.197666 Jul 20 04:14:41.099993 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 663/1450] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:40 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 1301 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:41.242415 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2b9cf1de-af59-4ff0-8383-e3d6ec99d307 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:41.253315 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2b9cf1de-af59-4ff0-8383-e3d6ec99d307 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15" status: 200 len: 1265 microversion: 2.1 time: 0.429331 Jul 20 04:14:41.253917 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 788/1451] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:40 2022] GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 => generated 1265 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:41.630814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d2f38fc-ba57-4a3c-8dd7-83b472f3e191 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.632443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d2f38fc-ba57-4a3c-8dd7-83b472f3e191 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:41.656443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d2f38fc-ba57-4a3c-8dd7-83b472f3e191 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.657785 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d2f38fc-ba57-4a3c-8dd7-83b472f3e191 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.658881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d2f38fc-ba57-4a3c-8dd7-83b472f3e191 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.660595 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d2f38fc-ba57-4a3c-8dd7-83b472f3e191 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.840144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-282a8497-2e91-4f63-ac28-df84a1f1b70d tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.841082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-282a8497-2e91-4f63-ac28-df84a1f1b70d tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:41.858899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-282a8497-2e91-4f63-ac28-df84a1f1b70d tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.865472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-282a8497-2e91-4f63-ac28-df84a1f1b70d tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.873637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-282a8497-2e91-4f63-ac28-df84a1f1b70d tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.874967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-282a8497-2e91-4f63-ac28-df84a1f1b70d tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.441568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-282a8497-2e91-4f63-ac28-df84a1f1b70d tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:42.459201 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-282a8497-2e91-4f63-ac28-df84a1f1b70d tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1610 microversion: 2.1 time: 0.623512 Jul 20 04:14:42.463065 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 789/1452] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:41 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1610 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:42.490387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5d9c1913-a291-49a3-bfe3-bbf8e3c6e0f8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:42.499604 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5d9c1913-a291-49a3-bfe3-bbf8e3c6e0f8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:42.520456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d9c1913-a291-49a3-bfe3-bbf8e3c6e0f8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.521010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d9c1913-a291-49a3-bfe3-bbf8e3c6e0f8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.521853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d9c1913-a291-49a3-bfe3-bbf8e3c6e0f8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.522299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d9c1913-a291-49a3-bfe3-bbf8e3c6e0f8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.648965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d2f38fc-ba57-4a3c-8dd7-83b472f3e191 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:42.652059 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5d9c1913-a291-49a3-bfe3-bbf8e3c6e0f8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.187616 Jul 20 04:14:42.656195 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 790/1453] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:14:42 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:14:42.666834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ade3d021-7077-4317-96be-e6e7884c4db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:42.667117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ade3d021-7077-4317-96be-e6e7884c4db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] [instance: 0cb300df-ffbd-4b36-88f0-cb0e17340221] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:42.682224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ade3d021-7077-4317-96be-e6e7884c4db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.686600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ade3d021-7077-4317-96be-e6e7884c4db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.687423 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d2f38fc-ba57-4a3c-8dd7-83b472f3e191 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 1.059163 Jul 20 04:14:42.688510 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 664/1454] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:41 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:42.697397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ade3d021-7077-4317-96be-e6e7884c4db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.698045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ade3d021-7077-4317-96be-e6e7884c4db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.729766 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-ade3d021-7077-4317-96be-e6e7884c4db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] HTTP exception thrown: Instance 0cb300df-ffbd-4b36-88f0-cb0e17340221 could not be found. Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ade3d021-7077-4317-96be-e6e7884c4db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Request method failure captured: Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 HTTP/1.1 Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi13_ogHKpISmEdjH5FROOlwz0Ev017YBccEyVz7qZ2h666LLDlH1OroF8UoG4a2PPZziZ6EcVqYpoI_rd2uiUfDqWu7yndaEjtWBPekHK4RKBObmJ0sw2wiLQae-jbq0E6cAB4rjIavvFsr8SOnQZyn__bT6-GmnjjW2C3JpkiFWamTs Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 6c73d55e6bc740d0aec2ba67f0491099 Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-MigrationsAdminTest-11980428 Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:14:42.731357 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:14:42.732884 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c73d55e6bc740d0aec2ba67f0491099"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c73d55e6bc740d0aec2ba67f0491099"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c73d55e6bc740d0aec2ba67f0491099", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c73d55e6bc740d0aec2ba67f0491099"}]}] Jul 20 04:14:42.732884 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-MigrationsAdminTest-11980428 Jul 20 04:14:42.732884 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 6c73d55e6bc740d0aec2ba67f0491099 Jul 20 04:14:42.732884 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-MigrationsAdminTest-11980428 Jul 20 04:14:42.732884 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-MigrationsAdminTest-11980428-project Jul 20 04:14:42.732884 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:14:42.732884 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:14:42.732884 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: b4f8b49fd45944a384836a1459e4e7e9 Jul 20 04:14:42.732884 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-MigrationsAdminTest-11980428-project Jul 20 04:14:42.732884 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:14:42.732884 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 0cb300df-ffbd-4b36-88f0-cb0e17340221 could not be found. Jul 20 04:14:42.732884 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '0cb300df-ffbd-4b36-88f0-cb0e17340221'} Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cb300df-ffbd-4b36-88f0-cb0e17340221 could not be found. Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:42.733725 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:42.735081 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:42.735081 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:42.735081 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:42.735081 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:42.735081 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:42.735081 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:42.735081 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:42.735081 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cb300df-ffbd-4b36-88f0-cb0e17340221 could not be found. Jul 20 04:14:42.735081 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.735081 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:42.735081 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.735081 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.735081 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:42.735081 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:42.735081 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:42.735081 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:42.735081 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cb300df-ffbd-4b36-88f0-cb0e17340221 could not be found. Jul 20 04:14:42.735081 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.737120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ade3d021-7077-4317-96be-e6e7884c4db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] Returning 404 to user: Instance 0cb300df-ffbd-4b36-88f0-cb0e17340221 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:42.737120 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ade3d021-7077-4317-96be-e6e7884c4db7 tempest-MigrationsAdminTest-11980428 tempest-MigrationsAdminTest-11980428-project] 10.222.0.17 "GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221" status: 404 len: 111 microversion: 2.1 time: 0.079783 Jul 20 04:14:42.738004 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 791/1455] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:42 2022] GET /compute/v2.1/servers/0cb300df-ffbd-4b36-88f0-cb0e17340221 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:42.746526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fd1cc105-9f5b-4e10-b1f7-7e4655cb669b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:42.751379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fd1cc105-9f5b-4e10-b1f7-7e4655cb669b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:42.766566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd1cc105-9f5b-4e10-b1f7-7e4655cb669b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.767324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd1cc105-9f5b-4e10-b1f7-7e4655cb669b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.768362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd1cc105-9f5b-4e10-b1f7-7e4655cb669b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.769882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd1cc105-9f5b-4e10-b1f7-7e4655cb669b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:43.076074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fd1cc105-9f5b-4e10-b1f7-7e4655cb669b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:43.088938 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fd1cc105-9f5b-4e10-b1f7-7e4655cb669b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15" status: 200 len: 1307 microversion: 2.1 time: 0.346209 Jul 20 04:14:43.090457 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 792/1456] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:42 2022] GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 => generated 1307 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:43.298555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-dabe7acd-cf7d-4fa9-baac-6c20a5b907b4 req-3081fdb5-11de-46c7-b085-c90a2dac6651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb300df-ffbd-4b36-88f0-cb0e17340221", "name": "network-vif-deleted", "tag": "40ec11f2-83c0-4550-8566-1e9b3ffdcae2"}, {"server_uuid": "9878d79b-e774-4a05-b2f5-5a4a0c690f86", "name": "network-vif-deleted", "tag": "c5713650-7679-40e4-be93-d01d94d54c88"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:43.315218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-dabe7acd-cf7d-4fa9-baac-6c20a5b907b4 req-3081fdb5-11de-46c7-b085-c90a2dac6651 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:43.315776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-dabe7acd-cf7d-4fa9-baac-6c20a5b907b4 req-3081fdb5-11de-46c7-b085-c90a2dac6651 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:43.344432 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-dabe7acd-cf7d-4fa9-baac-6c20a5b907b4 req-3081fdb5-11de-46c7-b085-c90a2dac6651 service nova] Creating event network-vif-deleted:40ec11f2-83c0-4550-8566-1e9b3ffdcae2 for instance 0cb300df-ffbd-4b36-88f0-cb0e17340221 on n-h2-826526-5 Jul 20 04:14:43.345070 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-dabe7acd-cf7d-4fa9-baac-6c20a5b907b4 req-3081fdb5-11de-46c7-b085-c90a2dac6651 service nova] Creating event network-vif-deleted:c5713650-7679-40e4-be93-d01d94d54c88 for instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 on n-h1-826526-5 Jul 20 04:14:43.347449 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-db026017-14c7-4ff5-9b4a-f93278a38eab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1941549525", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "05347d26-3624-497b-9d9a-fcd9da53546d"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:43.371594 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-dabe7acd-cf7d-4fa9-baac-6c20a5b907b4 req-3081fdb5-11de-46c7-b085-c90a2dac6651 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076816 Jul 20 04:14:43.375107 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 793/1457] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:43.465856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-db026017-14c7-4ff5-9b4a-f93278a38eab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] validate_networks() for [('05347d26-3624-497b-9d9a-fcd9da53546d', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:14:43.480804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f342ec92-7a93-47d0-ad91-d41d0e7ebe8c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:43.481701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f342ec92-7a93-47d0-ad91-d41d0e7ebe8c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:43.495242 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f342ec92-7a93-47d0-ad91-d41d0e7ebe8c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:43.495947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f342ec92-7a93-47d0-ad91-d41d0e7ebe8c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:43.497422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f342ec92-7a93-47d0-ad91-d41d0e7ebe8c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:43.498095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f342ec92-7a93-47d0-ad91-d41d0e7ebe8c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:43.537587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:43.771075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f342ec92-7a93-47d0-ad91-d41d0e7ebe8c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:43.784631 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f342ec92-7a93-47d0-ad91-d41d0e7ebe8c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1495 microversion: 2.1 time: 0.307981 Jul 20 04:14:43.795321 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 794/1458] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:43 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1495 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:43.821979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c30e3b9-4253-4644-b3c8-b27fb28f215a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:43.826727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0c30e3b9-4253-4644-b3c8-b27fb28f215a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:43.837014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c30e3b9-4253-4644-b3c8-b27fb28f215a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:43.838986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c30e3b9-4253-4644-b3c8-b27fb28f215a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:43.844881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c30e3b9-4253-4644-b3c8-b27fb28f215a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:43.848923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c30e3b9-4253-4644-b3c8-b27fb28f215a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:43.934501 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0c30e3b9-4253-4644-b3c8-b27fb28f215a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.137725 Jul 20 04:14:43.941957 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 795/1459] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:14:43 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:14:43.952405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5b654807-4e44-486f-b354-9c1322068285 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:43.953381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5b654807-4e44-486f-b354-9c1322068285 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:43.962039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b654807-4e44-486f-b354-9c1322068285 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:43.963538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b654807-4e44-486f-b354-9c1322068285 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:43.965536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b654807-4e44-486f-b354-9c1322068285 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:43.966603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b654807-4e44-486f-b354-9c1322068285 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:44.354735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5b654807-4e44-486f-b354-9c1322068285 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:44.370701 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5b654807-4e44-486f-b354-9c1322068285 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.424348 Jul 20 04:14:44.374202 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 796/1460] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:43 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:44.390077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b466add1-989e-4215-8935-ee9b64ccd560 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:44.391741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b466add1-989e-4215-8935-ee9b64ccd560 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:44.414103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b466add1-989e-4215-8935-ee9b64ccd560 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:44.416209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b466add1-989e-4215-8935-ee9b64ccd560 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:44.439917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b466add1-989e-4215-8935-ee9b64ccd560 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:44.444041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b466add1-989e-4215-8935-ee9b64ccd560 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:44.912043 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b466add1-989e-4215-8935-ee9b64ccd560 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:44.929866 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b466add1-989e-4215-8935-ee9b64ccd560 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15" status: 200 len: 1307 microversion: 2.1 time: 0.551689 Jul 20 04:14:44.931383 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 797/1461] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:44 2022] GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 => generated 1307 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:44.939033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-48b84aed-73c5-485d-bfc3-f56637ab4b97 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:44.939889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-48b84aed-73c5-485d-bfc3-f56637ab4b97 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:44.957638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48b84aed-73c5-485d-bfc3-f56637ab4b97 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:44.958820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48b84aed-73c5-485d-bfc3-f56637ab4b97 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:44.959764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48b84aed-73c5-485d-bfc3-f56637ab4b97 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:44.960705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48b84aed-73c5-485d-bfc3-f56637ab4b97 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:45.321896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-48b84aed-73c5-485d-bfc3-f56637ab4b97 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:45.334745 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-48b84aed-73c5-485d-bfc3-f56637ab4b97 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1495 microversion: 2.1 time: 0.401619 Jul 20 04:14:45.337312 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 798/1462] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:44 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1495 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:45.362101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-396b36bd-95a3-45ef-b72d-2d44ef1d20d6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:45.363379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-396b36bd-95a3-45ef-b72d-2d44ef1d20d6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:45.381574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-396b36bd-95a3-45ef-b72d-2d44ef1d20d6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:45.382708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-396b36bd-95a3-45ef-b72d-2d44ef1d20d6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:45.383762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-396b36bd-95a3-45ef-b72d-2d44ef1d20d6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:45.384943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-396b36bd-95a3-45ef-b72d-2d44ef1d20d6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:45.483992 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-396b36bd-95a3-45ef-b72d-2d44ef1d20d6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.141201 Jul 20 04:14:45.485303 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 799/1463] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:14:45 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:14:45.492813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9db35a81-ccea-4692-8473-3d80b3abf4f8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:45.493933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9db35a81-ccea-4692-8473-3d80b3abf4f8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:45.513364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9db35a81-ccea-4692-8473-3d80b3abf4f8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:45.518952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9db35a81-ccea-4692-8473-3d80b3abf4f8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:45.523585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9db35a81-ccea-4692-8473-3d80b3abf4f8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:45.524471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9db35a81-ccea-4692-8473-3d80b3abf4f8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:45.793814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9db35a81-ccea-4692-8473-3d80b3abf4f8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:45.805148 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9db35a81-ccea-4692-8473-3d80b3abf4f8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.318237 Jul 20 04:14:45.811188 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 800/1464] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:45 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:45.859464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:45.958314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e35df8ad-25bd-47e1-b280-856ee96c0650 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:45.958942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e35df8ad-25bd-47e1-b280-856ee96c0650 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:45.972648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e35df8ad-25bd-47e1-b280-856ee96c0650 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:45.973715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e35df8ad-25bd-47e1-b280-856ee96c0650 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:45.974697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e35df8ad-25bd-47e1-b280-856ee96c0650 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:45.980110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e35df8ad-25bd-47e1-b280-856ee96c0650 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:46.254352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e35df8ad-25bd-47e1-b280-856ee96c0650 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:46.270531 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e35df8ad-25bd-47e1-b280-856ee96c0650 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15" status: 200 len: 1307 microversion: 2.1 time: 0.327056 Jul 20 04:14:46.271637 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 801/1465] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:45 2022] GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 => generated 1307 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:46.358645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a1407de9-2db2-4e03-9b4b-a445e023c64b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:46.359624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a1407de9-2db2-4e03-9b4b-a445e023c64b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:46.366985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1407de9-2db2-4e03-9b4b-a445e023c64b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:46.368189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1407de9-2db2-4e03-9b4b-a445e023c64b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:46.369274 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1407de9-2db2-4e03-9b4b-a445e023c64b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:46.369921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1407de9-2db2-4e03-9b4b-a445e023c64b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:46.494217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:46.702137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a1407de9-2db2-4e03-9b4b-a445e023c64b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:46.710687 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a1407de9-2db2-4e03-9b4b-a445e023c64b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1495 microversion: 2.1 time: 0.358711 Jul 20 04:14:46.717822 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 802/1466] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:46 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1495 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:46.735637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-431bfb8c-d6c2-4ead-8351-7ee018342edf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:46.738202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-431bfb8c-d6c2-4ead-8351-7ee018342edf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:46.756420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-431bfb8c-d6c2-4ead-8351-7ee018342edf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:46.756883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-431bfb8c-d6c2-4ead-8351-7ee018342edf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:46.760128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-431bfb8c-d6c2-4ead-8351-7ee018342edf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:46.761471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-431bfb8c-d6c2-4ead-8351-7ee018342edf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:46.876127 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-431bfb8c-d6c2-4ead-8351-7ee018342edf tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.156909 Jul 20 04:14:46.886020 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 803/1467] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:14:46 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:14:46.891840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5b29dd24-ba8f-400f-ba34-826b441670e5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:46.894592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5b29dd24-ba8f-400f-ba34-826b441670e5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:46.913165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b29dd24-ba8f-400f-ba34-826b441670e5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:46.913833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b29dd24-ba8f-400f-ba34-826b441670e5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:46.915371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b29dd24-ba8f-400f-ba34-826b441670e5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:46.916441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b29dd24-ba8f-400f-ba34-826b441670e5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.147003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-db026017-14c7-4ff5-9b4a-f93278a38eab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:14:47.147492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-db026017-14c7-4ff5-9b4a-f93278a38eab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:14:47.147887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-db026017-14c7-4ff5-9b4a-f93278a38eab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:14:47.148325 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-db026017-14c7-4ff5-9b4a-f93278a38eab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:14:47.148744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-db026017-14c7-4ff5-9b4a-f93278a38eab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:14:47.165215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db026017-14c7-4ff5-9b4a-f93278a38eab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.165996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db026017-14c7-4ff5-9b4a-f93278a38eab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.167263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db026017-14c7-4ff5-9b4a-f93278a38eab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.167966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db026017-14c7-4ff5-9b4a-f93278a38eab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.193797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-db026017-14c7-4ff5-9b4a-f93278a38eab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Getting quotas for project 3c01e02dff54478d891dafa488ab4753. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:47.200464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-db026017-14c7-4ff5-9b4a-f93278a38eab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Getting quotas for user 3d3e518f087b49a0bedfd9a7df8b4af8 and project 3c01e02dff54478d891dafa488ab4753. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:47.218242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:47.220356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-db026017-14c7-4ff5-9b4a-f93278a38eab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Going to run 2 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:14:47.223667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-db026017-14c7-4ff5-9b4a-f93278a38eab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: af59fb24-63c1-4529-8bb5-2cf7efb75250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:14:47.294617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-db026017-14c7-4ff5-9b4a-f93278a38eab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=af59fb24-63c1-4529-8bb5-2cf7efb75250,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:14:47.359447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5b29dd24-ba8f-400f-ba34-826b441670e5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:47.374892 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5b29dd24-ba8f-400f-ba34-826b441670e5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.487622 Jul 20 04:14:47.376206 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 804/1468] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:46 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:47.402025 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-69e87b3c-293b-441c-8f8d-b42d54bece8d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:47.403109 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-69e87b3c-293b-441c-8f8d-b42d54bece8d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:47.423720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69e87b3c-293b-441c-8f8d-b42d54bece8d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.425232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69e87b3c-293b-441c-8f8d-b42d54bece8d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.427306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69e87b3c-293b-441c-8f8d-b42d54bece8d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.427739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69e87b3c-293b-441c-8f8d-b42d54bece8d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.467697 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-db026017-14c7-4ff5-9b4a-f93278a38eab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.775010 Jul 20 04:14:47.473310 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 665/1469] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 4784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:14:47.487393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-118107c5-0d44-41f9-a538-5e99c7060442 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:47.514251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-118107c5-0d44-41f9-a538-5e99c7060442 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:47.515578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-118107c5-0d44-41f9-a538-5e99c7060442 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Searching by: {'deleted': False, 'project_id': '3c01e02dff54478d891dafa488ab4753'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:14:47.591531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-118107c5-0d44-41f9-a538-5e99c7060442 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.609132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-118107c5-0d44-41f9-a538-5e99c7060442 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.610861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-118107c5-0d44-41f9-a538-5e99c7060442 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.618987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-118107c5-0d44-41f9-a538-5e99c7060442 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.730461 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-118107c5-0d44-41f9-a538-5e99c7060442 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.243444 Jul 20 04:14:47.735007 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 666/1470] 10.222.0.17 () {58 vars in 1124 bytes} [Wed Jul 20 04:14:47 2022] GET /compute/v2.1/servers => generated 677 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:47.749980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-73ab0e8d-47ab-4a27-a63c-e9fc1db09b53 req-eaf209a5-b0d6-493b-a6e5-86ed171e476b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9878d79b-e774-4a05-b2f5-5a4a0c690f86", "name": "network-vif-deleted", "tag": "2670d39f-bcc3-4495-a4a2-620ef21fa379"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:47.772395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-73ab0e8d-47ab-4a27-a63c-e9fc1db09b53 req-eaf209a5-b0d6-493b-a6e5-86ed171e476b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.773997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-73ab0e8d-47ab-4a27-a63c-e9fc1db09b53 req-eaf209a5-b0d6-493b-a6e5-86ed171e476b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.804834 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-73ab0e8d-47ab-4a27-a63c-e9fc1db09b53 req-eaf209a5-b0d6-493b-a6e5-86ed171e476b service nova] Creating event network-vif-deleted:2670d39f-bcc3-4495-a4a2-620ef21fa379 for instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 on n-h1-826526-5 Jul 20 04:14:47.823018 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-73ab0e8d-47ab-4a27-a63c-e9fc1db09b53 req-eaf209a5-b0d6-493b-a6e5-86ed171e476b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086094 Jul 20 04:14:47.824222 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 667/1471] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:47.831608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f4950d58-c1d6-45ce-8a5a-f4bd4bc194a5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:47.833046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f4950d58-c1d6-45ce-8a5a-f4bd4bc194a5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:47.841562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4950d58-c1d6-45ce-8a5a-f4bd4bc194a5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.843098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4950d58-c1d6-45ce-8a5a-f4bd4bc194a5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.846491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4950d58-c1d6-45ce-8a5a-f4bd4bc194a5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.848715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4950d58-c1d6-45ce-8a5a-f4bd4bc194a5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.991203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4950d58-c1d6-45ce-8a5a-f4bd4bc194a5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.997516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4950d58-c1d6-45ce-8a5a-f4bd4bc194a5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.998136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-f4950d58-c1d6-45ce-8a5a-f4bd4bc194a5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lazy-loading 'fault' on Instance uuid 9878d79b-e774-4a05-b2f5-5a4a0c690f86 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:48.249240 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f4950d58-c1d6-45ce-8a5a-f4bd4bc194a5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:48.261648 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f4950d58-c1d6-45ce-8a5a-f4bd4bc194a5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 200 len: 1303 microversion: 2.1 time: 0.435341 Jul 20 04:14:48.265173 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 668/1472] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:47 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 1303 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:48.280688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fc59d11f-00ad-4eee-a2c6-98231da251f9 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:48.285087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fc59d11f-00ad-4eee-a2c6-98231da251f9 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:48.397894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-69e87b3c-293b-441c-8f8d-b42d54bece8d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:48.413724 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-69e87b3c-293b-441c-8f8d-b42d54bece8d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15" status: 200 len: 1307 microversion: 2.1 time: 1.022554 Jul 20 04:14:48.414967 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 805/1473] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:47 2022] GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 => generated 1307 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:48.440551 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c7d3310c-2b0f-436b-a3b3-59145b70b250 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:48.443739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c7d3310c-2b0f-436b-a3b3-59145b70b250 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:48.458656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7d3310c-2b0f-436b-a3b3-59145b70b250 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:48.460580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7d3310c-2b0f-436b-a3b3-59145b70b250 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:48.464162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7d3310c-2b0f-436b-a3b3-59145b70b250 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:48.465286 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7d3310c-2b0f-436b-a3b3-59145b70b250 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:48.562659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fc59d11f-00ad-4eee-a2c6-98231da251f9 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:48.571554 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fc59d11f-00ad-4eee-a2c6-98231da251f9 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511" status: 200 len: 1220 microversion: 2.1 time: 0.304245 Jul 20 04:14:48.572143 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 669/1474] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:48 2022] GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511 => generated 1220 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:48.581862 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c7d3310c-2b0f-436b-a3b3-59145b70b250 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.150744 Jul 20 04:14:48.583054 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 806/1475] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:14:48 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:14:48.599138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-679dba5b-d2db-443b-9416-951429f369f8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:48.602204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-679dba5b-d2db-443b-9416-951429f369f8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:48.621100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-679dba5b-d2db-443b-9416-951429f369f8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:48.627419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-679dba5b-d2db-443b-9416-951429f369f8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:48.629493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-679dba5b-d2db-443b-9416-951429f369f8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:48.632913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-679dba5b-d2db-443b-9416-951429f369f8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.290679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c8342ee-03ce-4fe0-8f5b-c45fc8afb199 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:49.292015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0c8342ee-03ce-4fe0-8f5b-c45fc8afb199 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:49.315278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c8342ee-03ce-4fe0-8f5b-c45fc8afb199 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.317470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c8342ee-03ce-4fe0-8f5b-c45fc8afb199 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.320230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c8342ee-03ce-4fe0-8f5b-c45fc8afb199 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.321000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c8342ee-03ce-4fe0-8f5b-c45fc8afb199 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.369490 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-0c8342ee-03ce-4fe0-8f5b-c45fc8afb199 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] HTTP exception thrown: Instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 could not be found. Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c8342ee-03ce-4fe0-8f5b-c45fc8afb199 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Request method failure captured: Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 HTTP/1.1 Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14D6E-QhrjgtOW87yCf7R-_R3mQSPJQf-VvmnlT2zUedB2ynysqxBhsiWbMlm1qhE5_CEpDG1ZR2sI_o2GOLUURYZVf9kt7XZNjc_iTHaEPLLQvlAhw8_I4qXi1jP3CB5KvKMxQYX4cO5Vmge1nCHMjfIdBuvwPDvgkNdYmF0052k1Q Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 0c6f3b1899ec467a890b78a5db571f83 Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestMultiNic-1985676234 Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:14:49.373293 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:14:49.374810 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c6f3b1899ec467a890b78a5db571f83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0c6f3b1899ec467a890b78a5db571f83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0c6f3b1899ec467a890b78a5db571f83", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c6f3b1899ec467a890b78a5db571f83"}]}] Jul 20 04:14:49.374810 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestMultiNic-1985676234 Jul 20 04:14:49.374810 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 0c6f3b1899ec467a890b78a5db571f83 Jul 20 04:14:49.374810 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestMultiNic-1985676234 Jul 20 04:14:49.374810 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestMultiNic-1985676234-project Jul 20 04:14:49.374810 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:14:49.374810 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:14:49.374810 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 5dff4ba44a4944f1b5955fb0bd9ba3bc Jul 20 04:14:49.374810 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestMultiNic-1985676234-project Jul 20 04:14:49.374810 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:14:49.374810 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 could not be found. Jul 20 04:14:49.374810 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '9878d79b-e774-4a05-b2f5-5a4a0c690f86'} Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 could not be found. Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:49.375652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:49.377380 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:49.377380 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:49.377380 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:49.377380 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:49.377380 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:49.377380 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:49.377380 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:49.377380 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 could not be found. Jul 20 04:14:49.377380 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:49.377380 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:49.377380 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:49.377380 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:49.377380 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:49.377380 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:49.377380 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:49.377380 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:49.377380 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 could not be found. Jul 20 04:14:49.377380 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:14:49.382493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c8342ee-03ce-4fe0-8f5b-c45fc8afb199 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Returning 404 to user: Instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:49.385271 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0c8342ee-03ce-4fe0-8f5b-c45fc8afb199 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 404 len: 111 microversion: 2.1 time: 0.107257 Jul 20 04:14:49.386755 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 807/1476] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:49 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:49.443417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2be8917e-d182-4368-aa74-6cf794cbb171 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:49.448521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2be8917e-d182-4368-aa74-6cf794cbb171 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:49.471261 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2be8917e-d182-4368-aa74-6cf794cbb171 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.474738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2be8917e-d182-4368-aa74-6cf794cbb171 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.478359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2be8917e-d182-4368-aa74-6cf794cbb171 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.480111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2be8917e-d182-4368-aa74-6cf794cbb171 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.809455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-679dba5b-d2db-443b-9416-951429f369f8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:49.825915 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-679dba5b-d2db-443b-9416-951429f369f8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 1.242576 Jul 20 04:14:49.836654 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 670/1477] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:48 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:49.842215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-902fd663-268c-46ca-931f-894f2e2cfc53 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:49.843230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-902fd663-268c-46ca-931f-894f2e2cfc53 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:49.852819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-902fd663-268c-46ca-931f-894f2e2cfc53 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.856084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-902fd663-268c-46ca-931f-894f2e2cfc53 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.857920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-902fd663-268c-46ca-931f-894f2e2cfc53 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.858636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-902fd663-268c-46ca-931f-894f2e2cfc53 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.875195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:50.044580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-902fd663-268c-46ca-931f-894f2e2cfc53 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:50.055103 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-902fd663-268c-46ca-931f-894f2e2cfc53 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511" status: 200 len: 1272 microversion: 2.1 time: 0.216418 Jul 20 04:14:50.079844 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 671/1478] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:49 2022] GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511 => generated 1272 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:50.091717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-014bfabf-2d81-4dd8-8be6-f3f744b59fa9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:50.097743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-014bfabf-2d81-4dd8-8be6-f3f744b59fa9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:50.118322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-014bfabf-2d81-4dd8-8be6-f3f744b59fa9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:50.121110 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-014bfabf-2d81-4dd8-8be6-f3f744b59fa9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:50.123469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-014bfabf-2d81-4dd8-8be6-f3f744b59fa9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:50.123796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-014bfabf-2d81-4dd8-8be6-f3f744b59fa9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:50.204093 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-014bfabf-2d81-4dd8-8be6-f3f744b59fa9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.121123 Jul 20 04:14:50.209466 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 672/1479] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:14:50 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:14:50.228899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-12abda05-20fd-4784-a345-6ff88255abf4 req-b4c2e079-72d9-4864-a239-f30e0a22e484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15", "tag": "8ea4b8f0-2e09-4c78-bfdc-b37c6369a077"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:50.256364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-12abda05-20fd-4784-a345-6ff88255abf4 req-b4c2e079-72d9-4864-a239-f30e0a22e484 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:50.257343 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-12abda05-20fd-4784-a345-6ff88255abf4 req-b4c2e079-72d9-4864-a239-f30e0a22e484 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:50.273248 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-12abda05-20fd-4784-a345-6ff88255abf4 req-b4c2e079-72d9-4864-a239-f30e0a22e484 service nova] Creating event network-changed:8ea4b8f0-2e09-4c78-bfdc-b37c6369a077 for instance b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 on n-h2-826526-5 Jul 20 04:14:50.279115 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-12abda05-20fd-4784-a345-6ff88255abf4 req-b4c2e079-72d9-4864-a239-f30e0a22e484 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068298 Jul 20 04:14:50.280113 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 673/1480] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:50.537812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-210360ae-7258-4175-adae-94eedcf523e8 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Action: 'update', calling method: .version_select at 0x7f06be062310>, body: {"quota_set": {"ram": "5120"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:50.573114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2be8917e-d182-4368-aa74-6cf794cbb171 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:50.583814 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2be8917e-d182-4368-aa74-6cf794cbb171 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15" status: 200 len: 1307 microversion: 2.1 time: 1.156683 Jul 20 04:14:50.590090 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 808/1481] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:49 2022] GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 => generated 1307 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:50.661244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-210360ae-7258-4175-adae-94eedcf523e8 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:50.661699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-210360ae-7258-4175-adae-94eedcf523e8 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:50.662545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-210360ae-7258-4175-adae-94eedcf523e8 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:50.662991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-210360ae-7258-4175-adae-94eedcf523e8 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:50.773171 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-210360ae-7258-4175-adae-94eedcf523e8 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/4e0c3006c8784f66af68369c174289a7" status: 200 len: 240 microversion: 2.36 time: 0.491659 Jul 20 04:14:50.773966 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 674/1482] 10.222.0.17 () {62 vars in 1302 bytes} [Wed Jul 20 04:14:50 2022] PUT /compute/v2.1/os-quota-sets/4e0c3006c8784f66af68369c174289a7 => generated 240 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:14:50.785113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4f8ed19a-a0c7-4283-b214-fc2fb0172f90 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Calling method '.version_select at 0x7f06bdeec4c0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:50.844102 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1afc1f9a-c210-4d44-8ba0-3988d0e6f511 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:50.845065 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1afc1f9a-c210-4d44-8ba0-3988d0e6f511 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:50.859696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1afc1f9a-c210-4d44-8ba0-3988d0e6f511 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:50.860547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1afc1f9a-c210-4d44-8ba0-3988d0e6f511 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:50.861587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1afc1f9a-c210-4d44-8ba0-3988d0e6f511 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:50.862674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1afc1f9a-c210-4d44-8ba0-3988d0e6f511 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:50.923246 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f8ed19a-a0c7-4283-b214-fc2fb0172f90 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:50.923697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f8ed19a-a0c7-4283-b214-fc2fb0172f90 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:50.924542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f8ed19a-a0c7-4283-b214-fc2fb0172f90 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:50.924988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f8ed19a-a0c7-4283-b214-fc2fb0172f90 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:50.987366 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4f8ed19a-a0c7-4283-b214-fc2fb0172f90 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/4e0c3006c8784f66af68369c174289a7/detail" status: 200 len: 672 microversion: 2.36 time: 0.206141 Jul 20 04:14:50.989851 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 809/1483] 10.222.0.17 () {60 vars in 1303 bytes} [Wed Jul 20 04:14:50 2022] GET /compute/v2.1/os-quota-sets/4e0c3006c8784f66af68369c174289a7/detail => generated 672 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:14:51.087193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-107f1d2c-0a41-424a-8d9b-59873f931d79 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:51.088083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-107f1d2c-0a41-424a-8d9b-59873f931d79 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:51.096686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-107f1d2c-0a41-424a-8d9b-59873f931d79 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.099091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-107f1d2c-0a41-424a-8d9b-59873f931d79 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.099933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-107f1d2c-0a41-424a-8d9b-59873f931d79 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.100411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-107f1d2c-0a41-424a-8d9b-59873f931d79 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.268224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-107f1d2c-0a41-424a-8d9b-59873f931d79 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:51.285962 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-107f1d2c-0a41-424a-8d9b-59873f931d79 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511" status: 200 len: 1278 microversion: 2.1 time: 0.203347 Jul 20 04:14:51.286865 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 810/1484] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:51 2022] GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511 => generated 1278 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:51.302567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d0fa99b-b21b-48a0-b72c-d5d1e305a27e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:51.307725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4d0fa99b-b21b-48a0-b72c-d5d1e305a27e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:51.335856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d0fa99b-b21b-48a0-b72c-d5d1e305a27e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.337808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d0fa99b-b21b-48a0-b72c-d5d1e305a27e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.338823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d0fa99b-b21b-48a0-b72c-d5d1e305a27e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.341956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d0fa99b-b21b-48a0-b72c-d5d1e305a27e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.431655 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4d0fa99b-b21b-48a0-b72c-d5d1e305a27e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.133551 Jul 20 04:14:51.437573 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 811/1485] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:14:51 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7/os-volume_attachments => generated 25 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:51.443377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b480812d-6b34-4ba8-92ed-bdc14b3de811 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Action: 'update', calling method: .version_select at 0x7f06bdeb9c10>, body: {"quota_set": {"ram": "2048"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:51.521948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1afc1f9a-c210-4d44-8ba0-3988d0e6f511 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:51.535272 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1afc1f9a-c210-4d44-8ba0-3988d0e6f511 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.695501 Jul 20 04:14:51.540342 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 675/1486] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:50 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:51.607294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fd8fe7e3-3140-4f88-9e91-f0c64d3b63d8 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:51.611313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fd8fe7e3-3140-4f88-9e91-f0c64d3b63d8 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:51.615995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b480812d-6b34-4ba8-92ed-bdc14b3de811 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.617126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b480812d-6b34-4ba8-92ed-bdc14b3de811 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.618284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b480812d-6b34-4ba8-92ed-bdc14b3de811 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.618901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b480812d-6b34-4ba8-92ed-bdc14b3de811 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.630721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd8fe7e3-3140-4f88-9e91-f0c64d3b63d8 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.633502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd8fe7e3-3140-4f88-9e91-f0c64d3b63d8 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.634546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd8fe7e3-3140-4f88-9e91-f0c64d3b63d8 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.635007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd8fe7e3-3140-4f88-9e91-f0c64d3b63d8 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.670338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b480812d-6b34-4ba8-92ed-bdc14b3de811 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.671371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b480812d-6b34-4ba8-92ed-bdc14b3de811 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.672562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b480812d-6b34-4ba8-92ed-bdc14b3de811 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.673223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b480812d-6b34-4ba8-92ed-bdc14b3de811 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.682595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:51.757033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:51.853351 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b480812d-6b34-4ba8-92ed-bdc14b3de811 tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/4e0c3006c8784f66af68369c174289a7?user_id=69a59da5ca5f450b9e2d3037470fc4fb" status: 200 len: 240 microversion: 2.36 time: 0.414409 Jul 20 04:14:51.857394 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 812/1487] 10.222.0.17 () {62 vars in 1383 bytes} [Wed Jul 20 04:14:51 2022] PUT /compute/v2.1/os-quota-sets/4e0c3006c8784f66af68369c174289a7?user_id=69a59da5ca5f450b9e2d3037470fc4fb => generated 240 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:14:51.873438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d8e59134-d97a-454a-86d6-338acd556fbb tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] Calling method '.version_select at 0x7f06bdee64c0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:52.024594 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d8e59134-d97a-454a-86d6-338acd556fbb tempest-QuotasAdminTestV236-195729309 tempest-QuotasAdminTestV236-195729309-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/4e0c3006c8784f66af68369c174289a7?user_id=69a59da5ca5f450b9e2d3037470fc4fb" status: 200 len: 282 microversion: 2.36 time: 0.162824 Jul 20 04:14:52.025633 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 813/1488] 10.222.0.17 () {60 vars in 1363 bytes} [Wed Jul 20 04:14:51 2022] GET /compute/v2.1/os-quota-sets/4e0c3006c8784f66af68369c174289a7?user_id=69a59da5ca5f450b9e2d3037470fc4fb => generated 282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:14:52.157871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-344ebcc8-a57f-46b6-b369-bf8a3212ed3a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2099033691", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "02803c14-35b7-4d41-afe7-2c5b8fd340b9"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:52.362293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-344ebcc8-a57f-46b6-b369-bf8a3212ed3a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] validate_networks() for [('02803c14-35b7-4d41-afe7-2c5b8fd340b9', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:14:54.574324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fd8fe7e3-3140-4f88-9e91-f0c64d3b63d8 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:54.598899 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fd8fe7e3-3140-4f88-9e91-f0c64d3b63d8 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15" status: 200 len: 1307 microversion: 2.1 time: 2.995278 Jul 20 04:14:54.602881 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 676/1489] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:51 2022] GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 => generated 1307 bytes in 3000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:54.641624 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-10e0eaea-e6f0-4410-a6e3-3ff522e6484c tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:54.649913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-10e0eaea-e6f0-4410-a6e3-3ff522e6484c tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:54.663784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10e0eaea-e6f0-4410-a6e3-3ff522e6484c tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:54.675364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10e0eaea-e6f0-4410-a6e3-3ff522e6484c tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:54.676896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10e0eaea-e6f0-4410-a6e3-3ff522e6484c tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:54.677452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10e0eaea-e6f0-4410-a6e3-3ff522e6484c tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:55.097116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-10e0eaea-e6f0-4410-a6e3-3ff522e6484c tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:55.109026 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-10e0eaea-e6f0-4410-a6e3-3ff522e6484c tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511" status: 200 len: 1278 microversion: 2.1 time: 0.504823 Jul 20 04:14:55.124251 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 677/1490] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:54 2022] GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511 => generated 1278 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:55.138855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-547aa274-ab98-4f51-b284-ec987b11c587 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:55.146517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-547aa274-ab98-4f51-b284-ec987b11c587 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:55.162610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-547aa274-ab98-4f51-b284-ec987b11c587 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:55.177179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-547aa274-ab98-4f51-b284-ec987b11c587 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:55.179077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-547aa274-ab98-4f51-b284-ec987b11c587 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:55.179724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-547aa274-ab98-4f51-b284-ec987b11c587 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:56.014492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-344ebcc8-a57f-46b6-b369-bf8a3212ed3a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:14:56.015069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-344ebcc8-a57f-46b6-b369-bf8a3212ed3a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:14:56.015541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-344ebcc8-a57f-46b6-b369-bf8a3212ed3a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:14:56.016041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-344ebcc8-a57f-46b6-b369-bf8a3212ed3a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:14:56.016557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-344ebcc8-a57f-46b6-b369-bf8a3212ed3a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:14:56.042171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-344ebcc8-a57f-46b6-b369-bf8a3212ed3a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:56.047828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-344ebcc8-a57f-46b6-b369-bf8a3212ed3a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:56.060010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-344ebcc8-a57f-46b6-b369-bf8a3212ed3a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:56.060866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-344ebcc8-a57f-46b6-b369-bf8a3212ed3a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:56.110394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-547aa274-ab98-4f51-b284-ec987b11c587 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:56.129145 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-547aa274-ab98-4f51-b284-ec987b11c587 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.998429 Jul 20 04:14:56.137315 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 678/1491] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:55 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:56.138159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-344ebcc8-a57f-46b6-b369-bf8a3212ed3a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Getting quotas for project aabdfe1e44014cb9b940e5f7c7fc9938. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:56.153832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-344ebcc8-a57f-46b6-b369-bf8a3212ed3a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Getting quotas for user b8a99f17308e4a21be83507470946b76 and project aabdfe1e44014cb9b940e5f7c7fc9938. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:56.156767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5859d69d-df38-4142-9d1a-40d0d90a913c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:56.157784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5859d69d-df38-4142-9d1a-40d0d90a913c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:56.192155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5859d69d-df38-4142-9d1a-40d0d90a913c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:56.196950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-344ebcc8-a57f-46b6-b369-bf8a3212ed3a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:14:56.199933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5859d69d-df38-4142-9d1a-40d0d90a913c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:56.202239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-344ebcc8-a57f-46b6-b369-bf8a3212ed3a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:14:56.203724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5859d69d-df38-4142-9d1a-40d0d90a913c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:56.204578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5859d69d-df38-4142-9d1a-40d0d90a913c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:56.349211 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-344ebcc8-a57f-46b6-b369-bf8a3212ed3a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.318011 Jul 20 04:14:56.360208 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 814/1492] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 4334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:14:56.371975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7861306b-adb8-4155-add2-8006f4800108 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:56.372953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7861306b-adb8-4155-add2-8006f4800108 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:56.381582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7861306b-adb8-4155-add2-8006f4800108 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:56.382235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7861306b-adb8-4155-add2-8006f4800108 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:56.383203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7861306b-adb8-4155-add2-8006f4800108 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:56.383935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7861306b-adb8-4155-add2-8006f4800108 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:56.556033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7861306b-adb8-4155-add2-8006f4800108 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:56.574304 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7861306b-adb8-4155-add2-8006f4800108 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511" status: 200 len: 1278 microversion: 2.1 time: 0.210787 Jul 20 04:14:56.575355 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 815/1493] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:56 2022] GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511 => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:56.593232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3e3714b3-5b72-4753-baab-d28367b87a68 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:56.594851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3e3714b3-5b72-4753-baab-d28367b87a68 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:56.934174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3e3714b3-5b72-4753-baab-d28367b87a68 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:56.942378 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3e3714b3-5b72-4753-baab-d28367b87a68 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 200 len: 1224 microversion: 2.1 time: 0.365755 Jul 20 04:14:56.947169 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 816/1494] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:56 2022] GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 1224 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:57.154011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-30fb30b7-ded8-4365-a034-9955b936673d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:57.155437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-30fb30b7-ded8-4365-a034-9955b936673d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:57.162921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30fb30b7-ded8-4365-a034-9955b936673d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:57.174911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30fb30b7-ded8-4365-a034-9955b936673d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:57.176541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30fb30b7-ded8-4365-a034-9955b936673d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:57.183688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30fb30b7-ded8-4365-a034-9955b936673d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:58.019125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5859d69d-df38-4142-9d1a-40d0d90a913c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:58.033230 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5859d69d-df38-4142-9d1a-40d0d90a913c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15" status: 200 len: 1307 microversion: 2.1 time: 1.893493 Jul 20 04:14:58.033843 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 679/1495] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:56 2022] GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 => generated 1307 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:58.038447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f40af0c9-d0e3-488d-afd3-c19701919dca req-4fa09dc2-83e5-43dc-9561-7a6b50ff9b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15", "name": "network-vif-plugged", "status": "completed", "tag": "8ea4b8f0-2e09-4c78-bfdc-b37c6369a077"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:58.074776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f40af0c9-d0e3-488d-afd3-c19701919dca req-4fa09dc2-83e5-43dc-9561-7a6b50ff9b49 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:58.075234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f40af0c9-d0e3-488d-afd3-c19701919dca req-4fa09dc2-83e5-43dc-9561-7a6b50ff9b49 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:58.105135 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f40af0c9-d0e3-488d-afd3-c19701919dca req-4fa09dc2-83e5-43dc-9561-7a6b50ff9b49 service nova] Creating event network-vif-plugged:8ea4b8f0-2e09-4c78-bfdc-b37c6369a077 for instance b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 on n-h2-826526-5 Jul 20 04:14:58.118334 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f40af0c9-d0e3-488d-afd3-c19701919dca req-4fa09dc2-83e5-43dc-9561-7a6b50ff9b49 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082788 Jul 20 04:14:58.124375 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 680/1496] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:58.135336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b3811709-f712-4b6a-adb0-9343c9d62a41 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:58.137299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b3811709-f712-4b6a-adb0-9343c9d62a41 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:58.152651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b3811709-f712-4b6a-adb0-9343c9d62a41 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:58.154756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b3811709-f712-4b6a-adb0-9343c9d62a41 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:58.155758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b3811709-f712-4b6a-adb0-9343c9d62a41 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:58.165231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b3811709-f712-4b6a-adb0-9343c9d62a41 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:58.319353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-30fb30b7-ded8-4365-a034-9955b936673d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:58.348850 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-30fb30b7-ded8-4365-a034-9955b936673d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 1.198260 Jul 20 04:14:58.359750 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 817/1497] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:57 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:58.394790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dedbb6ff-fa39-4cb6-ac8b-890c74defe30 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:58.396167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dedbb6ff-fa39-4cb6-ac8b-890c74defe30 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:58.416302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dedbb6ff-fa39-4cb6-ac8b-890c74defe30 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:58.418814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dedbb6ff-fa39-4cb6-ac8b-890c74defe30 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:58.423242 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dedbb6ff-fa39-4cb6-ac8b-890c74defe30 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:58.423992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dedbb6ff-fa39-4cb6-ac8b-890c74defe30 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:58.696995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dedbb6ff-fa39-4cb6-ac8b-890c74defe30 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:58.723180 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dedbb6ff-fa39-4cb6-ac8b-890c74defe30 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 200 len: 1276 microversion: 2.1 time: 0.370277 Jul 20 04:14:58.728362 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 818/1498] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:58 2022] GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 1276 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:59.051067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a45b592e-b496-4beb-9bdb-2f0a2e20585d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:59.051609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a45b592e-b496-4beb-9bdb-2f0a2e20585d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:59.058949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a45b592e-b496-4beb-9bdb-2f0a2e20585d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.059405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a45b592e-b496-4beb-9bdb-2f0a2e20585d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.060181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a45b592e-b496-4beb-9bdb-2f0a2e20585d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.060648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a45b592e-b496-4beb-9bdb-2f0a2e20585d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.195301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b3811709-f712-4b6a-adb0-9343c9d62a41 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:59.209697 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b3811709-f712-4b6a-adb0-9343c9d62a41 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511" status: 200 len: 1320 microversion: 2.1 time: 1.083739 Jul 20 04:14:59.216033 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 681/1499] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:58 2022] GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511 => generated 1320 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:59.367728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-489ee53b-62fb-449f-a7cc-00a161e52485 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:59.368920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-489ee53b-62fb-449f-a7cc-00a161e52485 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:59.391451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-489ee53b-62fb-449f-a7cc-00a161e52485 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.396954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-489ee53b-62fb-449f-a7cc-00a161e52485 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.401745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-489ee53b-62fb-449f-a7cc-00a161e52485 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.404874 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-489ee53b-62fb-449f-a7cc-00a161e52485 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.097789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-489ee53b-62fb-449f-a7cc-00a161e52485 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:00.113913 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-489ee53b-62fb-449f-a7cc-00a161e52485 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.750682 Jul 20 04:15:00.123814 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 682/1500] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:59 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:00.123814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1cb8e477-5814-4748-8e6a-953ba7c3378a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:00.128844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1cb8e477-5814-4748-8e6a-953ba7c3378a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:00.137089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cb8e477-5814-4748-8e6a-953ba7c3378a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.137553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cb8e477-5814-4748-8e6a-953ba7c3378a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.138507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cb8e477-5814-4748-8e6a-953ba7c3378a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.138902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cb8e477-5814-4748-8e6a-953ba7c3378a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.320366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1cb8e477-5814-4748-8e6a-953ba7c3378a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:00.345485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a45b592e-b496-4beb-9bdb-2f0a2e20585d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:00.346845 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1cb8e477-5814-4748-8e6a-953ba7c3378a tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 200 len: 1282 microversion: 2.1 time: 0.229742 Jul 20 04:15:00.347668 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 683/1501] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:00 2022] GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 1282 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:00.354319 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a45b592e-b496-4beb-9bdb-2f0a2e20585d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15" status: 200 len: 1307 microversion: 2.1 time: 1.307106 Jul 20 04:15:00.357462 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 819/1502] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:59 2022] GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 => generated 1307 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:00.361003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e97ac422-8cab-4b4d-9e21-366331aea054 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:00.361676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e97ac422-8cab-4b4d-9e21-366331aea054 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:00.393562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e97ac422-8cab-4b4d-9e21-366331aea054 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.394314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e97ac422-8cab-4b4d-9e21-366331aea054 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.397003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e97ac422-8cab-4b4d-9e21-366331aea054 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.397538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e97ac422-8cab-4b4d-9e21-366331aea054 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.670317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:00.758558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=16 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:00.800233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-d9889de8-7e8c-446f-aeb8-d433c63a1981 req-714df56e-047d-45e6-ab98-88df7ff7e6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af59fb24-63c1-4529-8bb5-2cf7efb75250", "tag": "697044e8-782c-4b3a-8905-0c74decaf371"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:00.822286 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d9889de8-7e8c-446f-aeb8-d433c63a1981 req-714df56e-047d-45e6-ab98-88df7ff7e6c0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.822845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d9889de8-7e8c-446f-aeb8-d433c63a1981 req-714df56e-047d-45e6-ab98-88df7ff7e6c0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.850284 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-d9889de8-7e8c-446f-aeb8-d433c63a1981 req-714df56e-047d-45e6-ab98-88df7ff7e6c0 service nova] Creating event network-changed:697044e8-782c-4b3a-8905-0c74decaf371 for instance af59fb24-63c1-4529-8bb5-2cf7efb75250 on n-h1-826526-5 Jul 20 04:15:00.861508 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-d9889de8-7e8c-446f-aeb8-d433c63a1981 req-714df56e-047d-45e6-ab98-88df7ff7e6c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067546 Jul 20 04:15:00.866848 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 820/1503] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:00.974502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-7d2f9ee4-2196-41c4-bd69-b3b34f56c199 req-e1a958d4-4ea1-4d6b-816c-63e711296205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4440f926-b6ca-47fe-a531-de10d5d97511", "tag": "f59d2bc8-8cd3-44d1-89b5-cdc7417c9ae2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:00.995477 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7d2f9ee4-2196-41c4-bd69-b3b34f56c199 req-e1a958d4-4ea1-4d6b-816c-63e711296205 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:01.008722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7d2f9ee4-2196-41c4-bd69-b3b34f56c199 req-e1a958d4-4ea1-4d6b-816c-63e711296205 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:01.054934 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-7d2f9ee4-2196-41c4-bd69-b3b34f56c199 req-e1a958d4-4ea1-4d6b-816c-63e711296205 service nova] Creating event network-changed:f59d2bc8-8cd3-44d1-89b5-cdc7417c9ae2 for instance 4440f926-b6ca-47fe-a531-de10d5d97511 on n-h1-826526-5 Jul 20 04:15:01.068484 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-7d2f9ee4-2196-41c4-bd69-b3b34f56c199 req-e1a958d4-4ea1-4d6b-816c-63e711296205 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094863 Jul 20 04:15:01.071572 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 821/1504] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:01.111055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e97ac422-8cab-4b4d-9e21-366331aea054 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:01.121298 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e97ac422-8cab-4b4d-9e21-366331aea054 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511" status: 200 len: 1320 microversion: 2.1 time: 0.770705 Jul 20 04:15:01.123312 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 684/1505] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:00 2022] GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511 => generated 1320 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:01.139180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d2463941-73e2-4cd0-92b9-a2dd7266a8ce tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:01.139893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d2463941-73e2-4cd0-92b9-a2dd7266a8ce tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:01.159953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2463941-73e2-4cd0-92b9-a2dd7266a8ce tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:01.161149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2463941-73e2-4cd0-92b9-a2dd7266a8ce tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:01.172778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2463941-73e2-4cd0-92b9-a2dd7266a8ce tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:01.173285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2463941-73e2-4cd0-92b9-a2dd7266a8ce tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:01.370134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e1f58867-98cd-49ed-84b3-c0bff3437f65 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:01.372038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e1f58867-98cd-49ed-84b3-c0bff3437f65 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:01.381405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e1f58867-98cd-49ed-84b3-c0bff3437f65 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:01.382481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e1f58867-98cd-49ed-84b3-c0bff3437f65 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:01.383805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e1f58867-98cd-49ed-84b3-c0bff3437f65 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:01.384745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e1f58867-98cd-49ed-84b3-c0bff3437f65 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:01.634288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d2463941-73e2-4cd0-92b9-a2dd7266a8ce tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:01.649701 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d2463941-73e2-4cd0-92b9-a2dd7266a8ce tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.514214 Jul 20 04:15:01.663014 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 822/1506] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:01 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:01.670246 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-718f10d0-db00-492d-8851-c110760e9565 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:01.671204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-718f10d0-db00-492d-8851-c110760e9565 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:01.681974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-718f10d0-db00-492d-8851-c110760e9565 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:01.705675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e1f58867-98cd-49ed-84b3-c0bff3437f65 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:01.717916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-718f10d0-db00-492d-8851-c110760e9565 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:01.719696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-718f10d0-db00-492d-8851-c110760e9565 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:01.720787 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e1f58867-98cd-49ed-84b3-c0bff3437f65 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 200 len: 1282 microversion: 2.1 time: 0.360260 Jul 20 04:15:01.721926 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 685/1507] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:01 2022] GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 1282 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:01.722629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-718f10d0-db00-492d-8851-c110760e9565 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:02.141090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-63b2d51c-39d4-417f-a068-03e379316f34 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:02.142253 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-63b2d51c-39d4-417f-a068-03e379316f34 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:02.156557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63b2d51c-39d4-417f-a068-03e379316f34 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.157470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63b2d51c-39d4-417f-a068-03e379316f34 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:02.159013 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63b2d51c-39d4-417f-a068-03e379316f34 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.159685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63b2d51c-39d4-417f-a068-03e379316f34 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:02.600028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-718f10d0-db00-492d-8851-c110760e9565 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:02.615281 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-718f10d0-db00-492d-8851-c110760e9565 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15" status: 200 len: 1487 microversion: 2.1 time: 0.950375 Jul 20 04:15:02.616723 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 823/1508] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:01 2022] GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 => generated 1487 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:02.636385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8c36a7f7-e5a4-4033-b8b4-33d566d69581 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:02.638435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8c36a7f7-e5a4-4033-b8b4-33d566d69581 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:02.659258 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c36a7f7-e5a4-4033-b8b4-33d566d69581 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.659714 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c36a7f7-e5a4-4033-b8b4-33d566d69581 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:02.660537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c36a7f7-e5a4-4033-b8b4-33d566d69581 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.661769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c36a7f7-e5a4-4033-b8b4-33d566d69581 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:02.761611 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8c36a7f7-e5a4-4033-b8b4-33d566d69581 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "POST /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15/action" status: 202 len: 0 microversion: 2.1 time: 0.130449 Jul 20 04:15:02.762690 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 824/1509] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:15:02 2022] POST /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:02.768627 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e4158430-147d-4f1c-84b3-3b166aed9630 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:02.770685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e4158430-147d-4f1c-84b3-3b166aed9630 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:02.777961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4158430-147d-4f1c-84b3-3b166aed9630 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.778419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4158430-147d-4f1c-84b3-3b166aed9630 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:02.779743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4158430-147d-4f1c-84b3-3b166aed9630 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.780413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4158430-147d-4f1c-84b3-3b166aed9630 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:03.011262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-63b2d51c-39d4-417f-a068-03e379316f34 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:03.024659 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-63b2d51c-39d4-417f-a068-03e379316f34 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511" status: 200 len: 1320 microversion: 2.1 time: 0.887193 Jul 20 04:15:03.026582 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 686/1510] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:02 2022] GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511 => generated 1320 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:03.039815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-931c5c3a-ecc2-437c-97a6-7afbaf2a2733 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:03.040673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-931c5c3a-ecc2-437c-97a6-7afbaf2a2733 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:03.062528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-931c5c3a-ecc2-437c-97a6-7afbaf2a2733 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:03.062990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-931c5c3a-ecc2-437c-97a6-7afbaf2a2733 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:03.063779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-931c5c3a-ecc2-437c-97a6-7afbaf2a2733 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:03.064287 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-931c5c3a-ecc2-437c-97a6-7afbaf2a2733 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:03.336816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e4158430-147d-4f1c-84b3-3b166aed9630 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:03.352073 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e4158430-147d-4f1c-84b3-3b166aed9630 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.587274 Jul 20 04:15:03.364548 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 825/1511] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:02 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:03.379209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-55b352aa-105f-41f3-9d15-8aa60c2d5054 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:03.380032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-55b352aa-105f-41f3-9d15-8aa60c2d5054 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:03.396926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55b352aa-105f-41f3-9d15-8aa60c2d5054 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:03.397617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55b352aa-105f-41f3-9d15-8aa60c2d5054 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:03.398462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55b352aa-105f-41f3-9d15-8aa60c2d5054 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:03.398972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55b352aa-105f-41f3-9d15-8aa60c2d5054 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:03.772890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-931c5c3a-ecc2-437c-97a6-7afbaf2a2733 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:03.798895 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-931c5c3a-ecc2-437c-97a6-7afbaf2a2733 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 200 len: 1324 microversion: 2.1 time: 0.764751 Jul 20 04:15:03.810051 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 687/1512] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:03 2022] GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 1324 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:03.952145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-55b352aa-105f-41f3-9d15-8aa60c2d5054 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:03.974292 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-55b352aa-105f-41f3-9d15-8aa60c2d5054 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15" status: 200 len: 1472 microversion: 2.1 time: 0.603523 Jul 20 04:15:03.981746 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 826/1513] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:03 2022] GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 => generated 1472 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:03.994717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-266b8126-7362-4274-aa8f-cffb8444c420 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1814718367"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:03.996324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-266b8126-7362-4274-aa8f-cffb8444c420 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:04.011354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-266b8126-7362-4274-aa8f-cffb8444c420 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.013068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-266b8126-7362-4274-aa8f-cffb8444c420 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.016645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-266b8126-7362-4274-aa8f-cffb8444c420 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.017381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-266b8126-7362-4274-aa8f-cffb8444c420 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.044038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2127a919-8ef1-4bf5-9039-c6cef645199f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:04.046654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2127a919-8ef1-4bf5-9039-c6cef645199f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:04.059649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2127a919-8ef1-4bf5-9039-c6cef645199f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.060113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2127a919-8ef1-4bf5-9039-c6cef645199f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.060931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2127a919-8ef1-4bf5-9039-c6cef645199f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.061417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2127a919-8ef1-4bf5-9039-c6cef645199f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.524412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2127a919-8ef1-4bf5-9039-c6cef645199f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:04.537852 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2127a919-8ef1-4bf5-9039-c6cef645199f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511" status: 200 len: 1320 microversion: 2.1 time: 0.498845 Jul 20 04:15:04.555615 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 827/1514] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:04 2022] GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511 => generated 1320 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:04.565795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-f2644e7c-73f7-47d5-a63d-315e7f982c16 req-6c9f58ef-a7ea-454a-a018-bea49d46c51d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e27a49d1-11a9-47e6-b680-bb5d5e5e38ee", "tag": "963beecd-90f4-4da3-9538-8b41d8af8789"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:04.588852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f2644e7c-73f7-47d5-a63d-315e7f982c16 req-6c9f58ef-a7ea-454a-a018-bea49d46c51d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.589956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f2644e7c-73f7-47d5-a63d-315e7f982c16 req-6c9f58ef-a7ea-454a-a018-bea49d46c51d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.630543 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-f2644e7c-73f7-47d5-a63d-315e7f982c16 req-6c9f58ef-a7ea-454a-a018-bea49d46c51d service nova] Creating event network-changed:963beecd-90f4-4da3-9538-8b41d8af8789 for instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee on n-h2-826526-5 Jul 20 04:15:04.644781 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-f2644e7c-73f7-47d5-a63d-315e7f982c16 req-6c9f58ef-a7ea-454a-a018-bea49d46c51d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087166 Jul 20 04:15:04.645469 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 828/1515] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:04.657082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-85c04a33-dd45-4525-99d9-aaa4e3a26a6a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:04.659319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-85c04a33-dd45-4525-99d9-aaa4e3a26a6a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:04.673653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85c04a33-dd45-4525-99d9-aaa4e3a26a6a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.674111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85c04a33-dd45-4525-99d9-aaa4e3a26a6a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.678072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85c04a33-dd45-4525-99d9-aaa4e3a26a6a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.678576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85c04a33-dd45-4525-99d9-aaa4e3a26a6a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.715108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:04.794541 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-266b8126-7362-4274-aa8f-cffb8444c420 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "POST /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15/action" status: 202 len: 0 microversion: 2.1 time: 0.801821 Jul 20 04:15:04.796009 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 688/1516] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:15:03 2022] POST /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15/action => generated 0 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:15:04.831218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-237f876d-4773-4742-9f55-823ed2289d0d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be062310>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:04.935381 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-237f876d-4773-4742-9f55-823ed2289d0d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 200 len: 1412 microversion: 2.1 time: 0.117789 Jul 20 04:15:04.941085 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 689/1517] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:04 2022] GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 1412 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:04.949345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3aae12c0-7204-4904-8583-3071a1340a08 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:04.950486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3aae12c0-7204-4904-8583-3071a1340a08 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:04.968514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3aae12c0-7204-4904-8583-3071a1340a08 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.969011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3aae12c0-7204-4904-8583-3071a1340a08 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.971415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3aae12c0-7204-4904-8583-3071a1340a08 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.972218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3aae12c0-7204-4904-8583-3071a1340a08 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:05.216099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-85c04a33-dd45-4525-99d9-aaa4e3a26a6a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:05.227554 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-85c04a33-dd45-4525-99d9-aaa4e3a26a6a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.580743 Jul 20 04:15:05.230228 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 829/1518] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:04 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:05.566482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c9af680-9008-4a14-bd7d-8018b743c115 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:05.567285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0c9af680-9008-4a14-bd7d-8018b743c115 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:05.598814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c9af680-9008-4a14-bd7d-8018b743c115 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:05.599586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c9af680-9008-4a14-bd7d-8018b743c115 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:05.600944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c9af680-9008-4a14-bd7d-8018b743c115 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:05.605957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3aae12c0-7204-4904-8583-3071a1340a08 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:05.618925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c9af680-9008-4a14-bd7d-8018b743c115 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:05.622824 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3aae12c0-7204-4904-8583-3071a1340a08 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 200 len: 1324 microversion: 2.1 time: 0.685242 Jul 20 04:15:05.625904 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 690/1519] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:04 2022] GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 1324 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:05.950739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-638193c4-3760-4ffa-833b-03b04767aaaf tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be1649d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:06.033878 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-638193c4-3760-4ffa-833b-03b04767aaaf tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 200 len: 1412 microversion: 2.1 time: 0.087930 Jul 20 04:15:06.035660 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 691/1520] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:05 2022] GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:06.098469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=9 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:06.245964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8649b4a9-43b9-4bd1-92a5-ade0e5ef53ec tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:06.246672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8649b4a9-43b9-4bd1-92a5-ade0e5ef53ec tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:06.262958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8649b4a9-43b9-4bd1-92a5-ade0e5ef53ec tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:06.263617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8649b4a9-43b9-4bd1-92a5-ade0e5ef53ec tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:06.267569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8649b4a9-43b9-4bd1-92a5-ade0e5ef53ec tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:06.268446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8649b4a9-43b9-4bd1-92a5-ade0e5ef53ec tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:06.941909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=26 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:07.155340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0c9af680-9008-4a14-bd7d-8018b743c115 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:07.168964 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0c9af680-9008-4a14-bd7d-8018b743c115 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511" status: 200 len: 1320 microversion: 2.1 time: 1.613582 Jul 20 04:15:07.172840 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 830/1521] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:05 2022] GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511 => generated 1320 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:07.202382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a1f15e16-97aa-4573-96e1-3bb3ebcfcfc2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:07.203065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a1f15e16-97aa-4573-96e1-3bb3ebcfcfc2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:07.212928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1f15e16-97aa-4573-96e1-3bb3ebcfcfc2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:07.213708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1f15e16-97aa-4573-96e1-3bb3ebcfcfc2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:07.214730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1f15e16-97aa-4573-96e1-3bb3ebcfcfc2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:07.215343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1f15e16-97aa-4573-96e1-3bb3ebcfcfc2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:07.301412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8649b4a9-43b9-4bd1-92a5-ade0e5ef53ec tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:07.333697 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8649b4a9-43b9-4bd1-92a5-ade0e5ef53ec tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 1.092250 Jul 20 04:15:07.337898 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 692/1522] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:06 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:07.343770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8f997a05-e299-4755-b95a-552689111eb8 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be0e50d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:07.428042 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8f997a05-e299-4755-b95a-552689111eb8 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 200 len: 1412 microversion: 2.1 time: 0.088665 Jul 20 04:15:07.430028 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 693/1523] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:07 2022] GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:07.441873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5867af4a-d27b-40c7-a25a-40ce78c56e39 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1231659737", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "bf96e009-f5db-47ac-90e9-d53b72246f03"}, {"uuid": "85e16aab-7eac-409c-b150-3aa997af80b8"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:07.574023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-5867af4a-d27b-40c7-a25a-40ce78c56e39 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] validate_networks() for [('bf96e009-f5db-47ac-90e9-d53b72246f03', None, None, None, None, None), ('85e16aab-7eac-409c-b150-3aa997af80b8', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:08.024223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a1f15e16-97aa-4573-96e1-3bb3ebcfcfc2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:08.048100 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a1f15e16-97aa-4573-96e1-3bb3ebcfcfc2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 200 len: 1324 microversion: 2.1 time: 0.861975 Jul 20 04:15:08.048100 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 831/1524] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:07 2022] GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 1324 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:08.062497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-3b4c5b20-d37a-4bce-8475-c802f56ca904 req-2558a8f0-e0c8-44d0-addc-e7e952190fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52df8cf7-6be8-4f22-a0b4-4a5e0b31be04", "name": "network-vif-unplugged", "status": "completed", "tag": "295ab3b5-0949-4953-b868-df3a92dd92e7"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:08.085936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3b4c5b20-d37a-4bce-8475-c802f56ca904 req-2558a8f0-e0c8-44d0-addc-e7e952190fee service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.088939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3b4c5b20-d37a-4bce-8475-c802f56ca904 req-2558a8f0-e0c8-44d0-addc-e7e952190fee service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:08.105726 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-3b4c5b20-d37a-4bce-8475-c802f56ca904 req-2558a8f0-e0c8-44d0-addc-e7e952190fee service nova] Creating event network-vif-unplugged:295ab3b5-0949-4953-b868-df3a92dd92e7 for instance 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 on n-h1-826526-5 Jul 20 04:15:08.113283 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-3b4c5b20-d37a-4bce-8475-c802f56ca904 req-2558a8f0-e0c8-44d0-addc-e7e952190fee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064403 Jul 20 04:15:08.114288 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 832/1525] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:08.189917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6409129b-9803-452e-aee0-e19ba55a92eb tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:08.190789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6409129b-9803-452e-aee0-e19ba55a92eb tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:08.202264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6409129b-9803-452e-aee0-e19ba55a92eb tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.207518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6409129b-9803-452e-aee0-e19ba55a92eb tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:08.209317 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6409129b-9803-452e-aee0-e19ba55a92eb tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.210166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6409129b-9803-452e-aee0-e19ba55a92eb tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:08.290627 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:08.769571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6409129b-9803-452e-aee0-e19ba55a92eb tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:08.782879 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6409129b-9803-452e-aee0-e19ba55a92eb tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511" status: 200 len: 1320 microversion: 2.1 time: 0.597477 Jul 20 04:15:08.784983 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 833/1526] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:08 2022] GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511 => generated 1320 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:08.790629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5eb2c720-79a2-436e-a00e-110df30a1a56 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:08.791251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5eb2c720-79a2-436e-a00e-110df30a1a56 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:08.800632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eb2c720-79a2-436e-a00e-110df30a1a56 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.801087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eb2c720-79a2-436e-a00e-110df30a1a56 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:08.801885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eb2c720-79a2-436e-a00e-110df30a1a56 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.802461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eb2c720-79a2-436e-a00e-110df30a1a56 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.251466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5eb2c720-79a2-436e-a00e-110df30a1a56 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:09.270509 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5eb2c720-79a2-436e-a00e-110df30a1a56 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.483053 Jul 20 04:15:09.272127 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 834/1527] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:08 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:09.290220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5db6ba79-80ef-4167-9a16-2a2c069de7b2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be3eb3a0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:09.593010 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5db6ba79-80ef-4167-9a16-2a2c069de7b2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 200 len: 1412 microversion: 2.1 time: 0.315780 Jul 20 04:15:09.593610 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 835/1528] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:09 2022] GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 1412 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:09.618922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b6c5ec35-0400-4fdd-b9c1-fd748c6b5ab2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:09.619651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b6c5ec35-0400-4fdd-b9c1-fd748c6b5ab2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:09.633380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b6c5ec35-0400-4fdd-b9c1-fd748c6b5ab2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.636250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b6c5ec35-0400-4fdd-b9c1-fd748c6b5ab2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.639192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b6c5ec35-0400-4fdd-b9c1-fd748c6b5ab2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.639740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b6c5ec35-0400-4fdd-b9c1-fd748c6b5ab2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.326578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b6c5ec35-0400-4fdd-b9c1-fd748c6b5ab2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:10.346150 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b6c5ec35-0400-4fdd-b9c1-fd748c6b5ab2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 200 len: 1324 microversion: 2.1 time: 0.751349 Jul 20 04:15:10.348132 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 836/1529] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:09 2022] GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 1324 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:10.368194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fe199ecf-3f8d-4735-b1c5-283a5034bbf3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:10.368854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fe199ecf-3f8d-4735-b1c5-283a5034bbf3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:10.399922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe199ecf-3f8d-4735-b1c5-283a5034bbf3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.402825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe199ecf-3f8d-4735-b1c5-283a5034bbf3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.407890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe199ecf-3f8d-4735-b1c5-283a5034bbf3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.408436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe199ecf-3f8d-4735-b1c5-283a5034bbf3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.506242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5867af4a-d27b-40c7-a25a-40ce78c56e39 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:15:10.507405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5867af4a-d27b-40c7-a25a-40ce78c56e39 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:15:10.508078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5867af4a-d27b-40c7-a25a-40ce78c56e39 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:15:10.509255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5867af4a-d27b-40c7-a25a-40ce78c56e39 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:15:10.509928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5867af4a-d27b-40c7-a25a-40ce78c56e39 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:15:10.534618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5867af4a-d27b-40c7-a25a-40ce78c56e39 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.537238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5867af4a-d27b-40c7-a25a-40ce78c56e39 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.539893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5867af4a-d27b-40c7-a25a-40ce78c56e39 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.540819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5867af4a-d27b-40c7-a25a-40ce78c56e39 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.645956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-5867af4a-d27b-40c7-a25a-40ce78c56e39 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Getting quotas for project 0c6f3b1899ec467a890b78a5db571f83. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:10.666324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-5867af4a-d27b-40c7-a25a-40ce78c56e39 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Getting quotas for user 5dff4ba44a4944f1b5955fb0bd9ba3bc and project 0c6f3b1899ec467a890b78a5db571f83. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:10.726473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5867af4a-d27b-40c7-a25a-40ce78c56e39 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:15:10.730683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5867af4a-d27b-40c7-a25a-40ce78c56e39 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:10.909848 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5867af4a-d27b-40c7-a25a-40ce78c56e39 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.475605 Jul 20 04:15:10.911633 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 694/1530] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 3480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:15:10.923283 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-b8cb885b-aeba-4d10-80fd-b3f75dc0b54a req-e7f6fc16-bc18-495f-9ddf-9d6784cdf46e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52df8cf7-6be8-4f22-a0b4-4a5e0b31be04", "tag": "295ab3b5-0949-4953-b868-df3a92dd92e7"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:10.946146 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b8cb885b-aeba-4d10-80fd-b3f75dc0b54a req-e7f6fc16-bc18-495f-9ddf-9d6784cdf46e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.947081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b8cb885b-aeba-4d10-80fd-b3f75dc0b54a req-e7f6fc16-bc18-495f-9ddf-9d6784cdf46e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.994315 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-b8cb885b-aeba-4d10-80fd-b3f75dc0b54a req-e7f6fc16-bc18-495f-9ddf-9d6784cdf46e service nova] Creating event network-changed:295ab3b5-0949-4953-b868-df3a92dd92e7 for instance 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 on n-h1-826526-5 Jul 20 04:15:11.031384 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-b8cb885b-aeba-4d10-80fd-b3f75dc0b54a req-e7f6fc16-bc18-495f-9ddf-9d6784cdf46e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117941 Jul 20 04:15:11.059591 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 695/1531] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:11.081239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b0930db7-2724-4e71-81fb-f1513fcd8ce3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:11.081956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b0930db7-2724-4e71-81fb-f1513fcd8ce3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:11.117482 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0930db7-2724-4e71-81fb-f1513fcd8ce3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:11.118215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0930db7-2724-4e71-81fb-f1513fcd8ce3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:11.119176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0930db7-2724-4e71-81fb-f1513fcd8ce3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:11.119632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0930db7-2724-4e71-81fb-f1513fcd8ce3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:11.577036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fe199ecf-3f8d-4735-b1c5-283a5034bbf3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:11.586388 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fe199ecf-3f8d-4735-b1c5-283a5034bbf3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511" status: 200 len: 1320 microversion: 2.1 time: 1.235964 Jul 20 04:15:11.602047 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 837/1532] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:10 2022] GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511 => generated 1320 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:11.624782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4ea2b906-8641-44ae-bfe2-c4c85a8dcc26 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be4aa160>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:11.680336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b0930db7-2724-4e71-81fb-f1513fcd8ce3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:11.701917 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b0930db7-2724-4e71-81fb-f1513fcd8ce3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.640357 Jul 20 04:15:11.702525 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 696/1533] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:11 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:11.732276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-d99878c0-54f5-4a39-9f6f-08464c4be782 req-354daa36-7872-4a45-b237-3817da620d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af59fb24-63c1-4529-8bb5-2cf7efb75250", "name": "network-vif-plugged", "status": "completed", "tag": "697044e8-782c-4b3a-8905-0c74decaf371"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:11.761937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d99878c0-54f5-4a39-9f6f-08464c4be782 req-354daa36-7872-4a45-b237-3817da620d44 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:11.764044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d99878c0-54f5-4a39-9f6f-08464c4be782 req-354daa36-7872-4a45-b237-3817da620d44 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:11.793394 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-d99878c0-54f5-4a39-9f6f-08464c4be782 req-354daa36-7872-4a45-b237-3817da620d44 service nova] Creating event network-vif-plugged:697044e8-782c-4b3a-8905-0c74decaf371 for instance af59fb24-63c1-4529-8bb5-2cf7efb75250 on n-h1-826526-5 Jul 20 04:15:11.813837 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-d99878c0-54f5-4a39-9f6f-08464c4be782 req-354daa36-7872-4a45-b237-3817da620d44 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095057 Jul 20 04:15:11.815692 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 697/1534] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:11.825720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-221a582d-cf84-4b09-aa61-f4d19ac06411 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:11.826851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-221a582d-cf84-4b09-aa61-f4d19ac06411 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:11.873408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:12.200549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-221a582d-cf84-4b09-aa61-f4d19ac06411 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:12.217997 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-221a582d-cf84-4b09-aa61-f4d19ac06411 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1213 microversion: 2.1 time: 0.398128 Jul 20 04:15:12.236179 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 698/1535] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:11 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1213 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:12.254766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6c1edb5a-620f-417a-aa0a-83ca8285bc1d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:12.263360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6c1edb5a-620f-417a-aa0a-83ca8285bc1d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:12.284876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c1edb5a-620f-417a-aa0a-83ca8285bc1d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.301233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c1edb5a-620f-417a-aa0a-83ca8285bc1d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.302189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c1edb5a-620f-417a-aa0a-83ca8285bc1d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.303593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c1edb5a-620f-417a-aa0a-83ca8285bc1d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.704775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6c1edb5a-620f-417a-aa0a-83ca8285bc1d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:12.721765 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6c1edb5a-620f-417a-aa0a-83ca8285bc1d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 200 len: 1324 microversion: 2.1 time: 0.482125 Jul 20 04:15:12.740555 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 699/1536] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:12 2022] GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 1324 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:12.761719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4431d3ba-74da-42e5-aaaa-063dfc17f358 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:12.765406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4431d3ba-74da-42e5-aaaa-063dfc17f358 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:12.788232 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4431d3ba-74da-42e5-aaaa-063dfc17f358 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.793921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4431d3ba-74da-42e5-aaaa-063dfc17f358 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.796984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4431d3ba-74da-42e5-aaaa-063dfc17f358 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.802072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4431d3ba-74da-42e5-aaaa-063dfc17f358 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.352879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4431d3ba-74da-42e5-aaaa-063dfc17f358 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:13.371574 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4431d3ba-74da-42e5-aaaa-063dfc17f358 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511" status: 200 len: 1320 microversion: 2.1 time: 0.629916 Jul 20 04:15:13.395034 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 700/1537] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:12 2022] GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511 => generated 1320 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:13.403772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3327e2be-35ec-4433-8ffc-6aac959ccfed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:13.412291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3327e2be-35ec-4433-8ffc-6aac959ccfed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:13.437397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3327e2be-35ec-4433-8ffc-6aac959ccfed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.438346 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3327e2be-35ec-4433-8ffc-6aac959ccfed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.439545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3327e2be-35ec-4433-8ffc-6aac959ccfed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.444337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3327e2be-35ec-4433-8ffc-6aac959ccfed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.387907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3327e2be-35ec-4433-8ffc-6aac959ccfed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:14.425027 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3327e2be-35ec-4433-8ffc-6aac959ccfed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 1.026654 Jul 20 04:15:14.425963 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 701/1538] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:13 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:14.454351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ce424411-7719-4664-bd63-032970a09db5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:14.459277 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ce424411-7719-4664-bd63-032970a09db5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:14.485716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce424411-7719-4664-bd63-032970a09db5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.486891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce424411-7719-4664-bd63-032970a09db5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.492748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce424411-7719-4664-bd63-032970a09db5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.493497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce424411-7719-4664-bd63-032970a09db5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.679650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ce424411-7719-4664-bd63-032970a09db5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:14.699521 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ce424411-7719-4664-bd63-032970a09db5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1271 microversion: 2.1 time: 0.252124 Jul 20 04:15:14.711996 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 702/1539] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:14 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1271 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:14.724744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-90de3a56-29dc-4864-a5ad-35ebc20c4cd2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:14.730704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-90de3a56-29dc-4864-a5ad-35ebc20c4cd2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:14.753893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90de3a56-29dc-4864-a5ad-35ebc20c4cd2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.754366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90de3a56-29dc-4864-a5ad-35ebc20c4cd2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.770689 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90de3a56-29dc-4864-a5ad-35ebc20c4cd2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.771179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90de3a56-29dc-4864-a5ad-35ebc20c4cd2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.128029 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4ea2b906-8641-44ae-bfe2-c4c85a8dcc26 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 200 len: 1412 microversion: 2.1 time: 3.524286 Jul 20 04:15:15.128650 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 838/1540] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:11 2022] GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 1412 bytes in 3526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:15.160090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-3cb6542b-d8d1-4aa8-a980-f0e0573d7086 req-94018389-e652-43cd-8207-153d58803422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15", "name": "network-vif-plugged", "status": "completed", "tag": "8ea4b8f0-2e09-4c78-bfdc-b37c6369a077"}, {"server_uuid": "4440f926-b6ca-47fe-a531-de10d5d97511", "name": "network-vif-plugged", "status": "completed", "tag": "f59d2bc8-8cd3-44d1-89b5-cdc7417c9ae2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:15.194833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3cb6542b-d8d1-4aa8-a980-f0e0573d7086 req-94018389-e652-43cd-8207-153d58803422 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.198811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3cb6542b-d8d1-4aa8-a980-f0e0573d7086 req-94018389-e652-43cd-8207-153d58803422 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.245868 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-3cb6542b-d8d1-4aa8-a980-f0e0573d7086 req-94018389-e652-43cd-8207-153d58803422 service nova] Creating event network-vif-plugged:8ea4b8f0-2e09-4c78-bfdc-b37c6369a077 for instance b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 on n-h2-826526-5 Jul 20 04:15:15.246433 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-3cb6542b-d8d1-4aa8-a980-f0e0573d7086 req-94018389-e652-43cd-8207-153d58803422 service nova] Creating event network-vif-plugged:f59d2bc8-8cd3-44d1-89b5-cdc7417c9ae2 for instance 4440f926-b6ca-47fe-a531-de10d5d97511 on n-h1-826526-5 Jul 20 04:15:15.272894 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-3cb6542b-d8d1-4aa8-a980-f0e0573d7086 req-94018389-e652-43cd-8207-153d58803422 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.134502 Jul 20 04:15:15.275902 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 839/1541] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:15.292195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c82f3aaf-2644-4600-aec2-00c68742f0a3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:15.293085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c82f3aaf-2644-4600-aec2-00c68742f0a3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:15.310619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c82f3aaf-2644-4600-aec2-00c68742f0a3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.311314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c82f3aaf-2644-4600-aec2-00c68742f0a3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.314520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c82f3aaf-2644-4600-aec2-00c68742f0a3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.315672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c82f3aaf-2644-4600-aec2-00c68742f0a3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.838769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c82f3aaf-2644-4600-aec2-00c68742f0a3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:15.847681 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c82f3aaf-2644-4600-aec2-00c68742f0a3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511" status: 200 len: 1320 microversion: 2.1 time: 0.570185 Jul 20 04:15:15.872510 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 840/1542] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:15 2022] GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511 => generated 1320 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:15.894601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d72c3702-7bcc-4cd1-9f46-4d94f5a81c6c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:15.904341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d72c3702-7bcc-4cd1-9f46-4d94f5a81c6c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:15.931520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d72c3702-7bcc-4cd1-9f46-4d94f5a81c6c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.932591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d72c3702-7bcc-4cd1-9f46-4d94f5a81c6c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.933850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d72c3702-7bcc-4cd1-9f46-4d94f5a81c6c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.937722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d72c3702-7bcc-4cd1-9f46-4d94f5a81c6c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.254029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-90de3a56-29dc-4864-a5ad-35ebc20c4cd2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:16.263583 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-90de3a56-29dc-4864-a5ad-35ebc20c4cd2 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 200 len: 1324 microversion: 2.1 time: 1.550147 Jul 20 04:15:16.276990 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 703/1543] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:14 2022] GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 1324 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:16.290967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f155ed68-ac1c-4422-81ae-9bf0d6a00aa3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:16.299078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f155ed68-ac1c-4422-81ae-9bf0d6a00aa3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:16.332587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f155ed68-ac1c-4422-81ae-9bf0d6a00aa3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.333366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f155ed68-ac1c-4422-81ae-9bf0d6a00aa3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.334362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f155ed68-ac1c-4422-81ae-9bf0d6a00aa3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.337999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f155ed68-ac1c-4422-81ae-9bf0d6a00aa3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.351451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d72c3702-7bcc-4cd1-9f46-4d94f5a81c6c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:16.368571 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d72c3702-7bcc-4cd1-9f46-4d94f5a81c6c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.493888 Jul 20 04:15:16.372644 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 841/1544] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:15 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:16.389011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-277d3c3d-450a-4e7d-a32f-9e4523b7efa2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bdf22ca0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:16.495130 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-277d3c3d-450a-4e7d-a32f-9e4523b7efa2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 200 len: 1412 microversion: 2.1 time: 0.118585 Jul 20 04:15:16.495736 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 842/1545] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:16 2022] GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 1412 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:16.573977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f155ed68-ac1c-4422-81ae-9bf0d6a00aa3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:16.587324 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f155ed68-ac1c-4422-81ae-9bf0d6a00aa3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1271 microversion: 2.1 time: 0.305075 Jul 20 04:15:16.590107 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 704/1546] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:16 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1271 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:16.883295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9d62c3de-fa6d-402f-9949-28f404ec560f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:16.884386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9d62c3de-fa6d-402f-9949-28f404ec560f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:16.897967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d62c3de-fa6d-402f-9949-28f404ec560f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.899375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d62c3de-fa6d-402f-9949-28f404ec560f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.900444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d62c3de-fa6d-402f-9949-28f404ec560f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.901042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d62c3de-fa6d-402f-9949-28f404ec560f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.291411 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a95faefe-28b9-44a7-9bd2-08afebf842e0 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:17.292303 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a95faefe-28b9-44a7-9bd2-08afebf842e0 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:17.331931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a95faefe-28b9-44a7-9bd2-08afebf842e0 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.332901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a95faefe-28b9-44a7-9bd2-08afebf842e0 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.335008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a95faefe-28b9-44a7-9bd2-08afebf842e0 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.337027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a95faefe-28b9-44a7-9bd2-08afebf842e0 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.630240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9d62c3de-fa6d-402f-9949-28f404ec560f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:17.643310 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9d62c3de-fa6d-402f-9949-28f404ec560f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511" status: 200 len: 1320 microversion: 2.1 time: 0.763800 Jul 20 04:15:17.649334 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 843/1547] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:16 2022] GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511 => generated 1320 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:17.654758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-250cfd1b-28f6-4303-a4a1-71abe51aec04 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:17.659201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-250cfd1b-28f6-4303-a4a1-71abe51aec04 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:17.676643 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-250cfd1b-28f6-4303-a4a1-71abe51aec04 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.677442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-250cfd1b-28f6-4303-a4a1-71abe51aec04 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.678657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-250cfd1b-28f6-4303-a4a1-71abe51aec04 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.679536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-250cfd1b-28f6-4303-a4a1-71abe51aec04 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.860952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a95faefe-28b9-44a7-9bd2-08afebf842e0 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:17.874908 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a95faefe-28b9-44a7-9bd2-08afebf842e0 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 200 len: 1324 microversion: 2.1 time: 0.588711 Jul 20 04:15:17.879518 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 705/1548] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:17 2022] GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 1324 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:17.889523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4a44ebd9-4af4-46ab-b210-7d098a3ea1dc tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bde40a60>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:18.030654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-250cfd1b-28f6-4303-a4a1-71abe51aec04 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:18.058858 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-250cfd1b-28f6-4303-a4a1-71abe51aec04 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.393272 Jul 20 04:15:18.061549 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 844/1549] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:17 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:18.068321 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4a44ebd9-4af4-46ab-b210-7d098a3ea1dc tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 200 len: 1412 microversion: 2.1 time: 0.187215 Jul 20 04:15:18.069202 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 706/1550] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:17 2022] GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 1412 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:18.079312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9bd0d441-fa09-4d00-966a-5b7065a231df tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:18.079943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9bd0d441-fa09-4d00-966a-5b7065a231df tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:18.109506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9bd0d441-fa09-4d00-966a-5b7065a231df tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.111662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9bd0d441-fa09-4d00-966a-5b7065a231df tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.113592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9bd0d441-fa09-4d00-966a-5b7065a231df tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.114194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9bd0d441-fa09-4d00-966a-5b7065a231df tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.446636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-77426c16-aea1-4c6c-bf50-3062a96771d0 req-dfbacaac-51a0-445d-aa6f-3b2fe5dafddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52df8cf7-6be8-4f22-a0b4-4a5e0b31be04", "name": "network-vif-unplugged", "status": "completed", "tag": "295ab3b5-0949-4953-b868-df3a92dd92e7"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:18.465113 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-77426c16-aea1-4c6c-bf50-3062a96771d0 req-dfbacaac-51a0-445d-aa6f-3b2fe5dafddd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.471312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-77426c16-aea1-4c6c-bf50-3062a96771d0 req-dfbacaac-51a0-445d-aa6f-3b2fe5dafddd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.515605 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-77426c16-aea1-4c6c-bf50-3062a96771d0 req-dfbacaac-51a0-445d-aa6f-3b2fe5dafddd service nova] Creating event network-vif-unplugged:295ab3b5-0949-4953-b868-df3a92dd92e7 for instance 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 on n-h1-826526-5 Jul 20 04:15:18.537258 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-77426c16-aea1-4c6c-bf50-3062a96771d0 req-dfbacaac-51a0-445d-aa6f-3b2fe5dafddd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094466 Jul 20 04:15:18.538647 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 707/1551] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:18.669386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6dd42c0a-fdfb-4cad-8593-c08d24b05f4d tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:18.670518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6dd42c0a-fdfb-4cad-8593-c08d24b05f4d tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:18.696238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6dd42c0a-fdfb-4cad-8593-c08d24b05f4d tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.697555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6dd42c0a-fdfb-4cad-8593-c08d24b05f4d tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.698640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6dd42c0a-fdfb-4cad-8593-c08d24b05f4d tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.705031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6dd42c0a-fdfb-4cad-8593-c08d24b05f4d tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:19.300680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9bd0d441-fa09-4d00-966a-5b7065a231df tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:19.312572 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9bd0d441-fa09-4d00-966a-5b7065a231df tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1313 microversion: 2.1 time: 1.249340 Jul 20 04:15:19.318721 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 845/1552] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:18 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1313 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:19.328162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dbe76fdd-d028-4bc3-9278-fd9e3483d537 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:19.344236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dbe76fdd-d028-4bc3-9278-fd9e3483d537 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:19.366501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbe76fdd-d028-4bc3-9278-fd9e3483d537 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:19.367305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbe76fdd-d028-4bc3-9278-fd9e3483d537 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:19.368318 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbe76fdd-d028-4bc3-9278-fd9e3483d537 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:19.368961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbe76fdd-d028-4bc3-9278-fd9e3483d537 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:20.582585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:20.784154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dbe76fdd-d028-4bc3-9278-fd9e3483d537 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:20.794975 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dbe76fdd-d028-4bc3-9278-fd9e3483d537 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 200 len: 1324 microversion: 2.1 time: 1.473010 Jul 20 04:15:20.802690 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 846/1553] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:19 2022] GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 1324 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:20.815945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6dd42c0a-fdfb-4cad-8593-c08d24b05f4d tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:20.827640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d2eadbbd-b5b9-4054-b84a-00dc15775a9f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:20.834458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d2eadbbd-b5b9-4054-b84a-00dc15775a9f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:20.834917 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6dd42c0a-fdfb-4cad-8593-c08d24b05f4d tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511" status: 200 len: 1508 microversion: 2.1 time: 2.171879 Jul 20 04:15:20.850627 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 708/1554] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:18 2022] GET /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511 => generated 1508 bytes in 2190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:20.868184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fb34782b-09c8-423c-a0eb-8b5e6e4a622e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bdddd3a0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:20.869329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2eadbbd-b5b9-4054-b84a-00dc15775a9f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:20.871998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2eadbbd-b5b9-4054-b84a-00dc15775a9f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:20.874476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2eadbbd-b5b9-4054-b84a-00dc15775a9f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:20.878410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2eadbbd-b5b9-4054-b84a-00dc15775a9f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:20.995529 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fb34782b-09c8-423c-a0eb-8b5e6e4a622e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 200 len: 1412 microversion: 2.1 time: 0.140749 Jul 20 04:15:20.997345 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 709/1555] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:20 2022] GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 1412 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:21.005880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2bf88892-4e32-4e7f-a1bf-0b3075b13707 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:21.009910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2bf88892-4e32-4e7f-a1bf-0b3075b13707 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:21.019825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bf88892-4e32-4e7f-a1bf-0b3075b13707 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:21.020653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bf88892-4e32-4e7f-a1bf-0b3075b13707 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:21.021728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bf88892-4e32-4e7f-a1bf-0b3075b13707 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:21.023662 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bf88892-4e32-4e7f-a1bf-0b3075b13707 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:21.410765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2bf88892-4e32-4e7f-a1bf-0b3075b13707 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:21.422816 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2bf88892-4e32-4e7f-a1bf-0b3075b13707 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1334 microversion: 2.1 time: 0.424021 Jul 20 04:15:21.427091 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 710/1556] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:20 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1334 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:21.446232 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-edd899f8-ce20-444d-a96f-80a196011f27 req-cb4d687a-9bac-49bc-a83a-505cce08248f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e27a49d1-11a9-47e6-b680-bb5d5e5e38ee", "name": "network-vif-plugged", "status": "completed", "tag": "963beecd-90f4-4da3-9538-8b41d8af8789"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:21.473151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-edd899f8-ce20-444d-a96f-80a196011f27 req-cb4d687a-9bac-49bc-a83a-505cce08248f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:21.477431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-edd899f8-ce20-444d-a96f-80a196011f27 req-cb4d687a-9bac-49bc-a83a-505cce08248f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:21.511463 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-edd899f8-ce20-444d-a96f-80a196011f27 req-cb4d687a-9bac-49bc-a83a-505cce08248f service nova] Creating event network-vif-plugged:963beecd-90f4-4da3-9538-8b41d8af8789 for instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee on n-h2-826526-5 Jul 20 04:15:21.527879 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-edd899f8-ce20-444d-a96f-80a196011f27 req-cb4d687a-9bac-49bc-a83a-505cce08248f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099042 Jul 20 04:15:21.529319 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 711/1557] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:21.540689 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-511ea4e1-914a-4b84-9fce-d4b502798547 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:21.547565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-511ea4e1-914a-4b84-9fce-d4b502798547 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: af59fb24-63c1-4529-8bb5-2cf7efb75250] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:21.588114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-511ea4e1-914a-4b84-9fce-d4b502798547 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:21.595469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-511ea4e1-914a-4b84-9fce-d4b502798547 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:21.602327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-511ea4e1-914a-4b84-9fce-d4b502798547 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:21.603479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-511ea4e1-914a-4b84-9fce-d4b502798547 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.205556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:22.272199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-511ea4e1-914a-4b84-9fce-d4b502798547 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:22.281497 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-511ea4e1-914a-4b84-9fce-d4b502798547 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/af59fb24-63c1-4529-8bb5-2cf7efb75250" status: 200 len: 1508 microversion: 2.1 time: 0.750446 Jul 20 04:15:22.289016 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 712/1558] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:21 2022] GET /compute/v2.1/servers/af59fb24-63c1-4529-8bb5-2cf7efb75250 => generated 1508 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:22.294705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-44a0b752-263c-4dd3-b359-441556e4b3b5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:22.297864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-44a0b752-263c-4dd3-b359-441556e4b3b5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:22.315308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44a0b752-263c-4dd3-b359-441556e4b3b5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.315929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44a0b752-263c-4dd3-b359-441556e4b3b5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.317393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44a0b752-263c-4dd3-b359-441556e4b3b5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.318570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44a0b752-263c-4dd3-b359-441556e4b3b5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.425657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d2eadbbd-b5b9-4054-b84a-00dc15775a9f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:22.440382 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d2eadbbd-b5b9-4054-b84a-00dc15775a9f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 1.636424 Jul 20 04:15:22.451673 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 847/1559] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:20 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:22.456783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5865f422-7c94-4110-a4e9-595f56bb1fa0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be0f33a0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:22.561395 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5865f422-7c94-4110-a4e9-595f56bb1fa0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 200 len: 1412 microversion: 2.1 time: 0.108243 Jul 20 04:15:22.562554 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 848/1560] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:22 2022] GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 1412 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:22.571912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5db688c5-ec3c-46ce-bf4c-da79b62880d3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:22.576890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5db688c5-ec3c-46ce-bf4c-da79b62880d3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: af59fb24-63c1-4529-8bb5-2cf7efb75250] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:22.579345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=88 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:22.598930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5db688c5-ec3c-46ce-bf4c-da79b62880d3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.600539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5db688c5-ec3c-46ce-bf4c-da79b62880d3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.609672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5db688c5-ec3c-46ce-bf4c-da79b62880d3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.610734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5db688c5-ec3c-46ce-bf4c-da79b62880d3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.704980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5db688c5-ec3c-46ce-bf4c-da79b62880d3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: af59fb24-63c1-4529-8bb5-2cf7efb75250] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:15:22.971588 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5db688c5-ec3c-46ce-bf4c-da79b62880d3 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "DELETE /compute/v2.1/servers/af59fb24-63c1-4529-8bb5-2cf7efb75250" status: 204 len: 0 microversion: 2.1 time: 0.407271 Jul 20 04:15:22.976680 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 849/1561] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:15:22 2022] DELETE /compute/v2.1/servers/af59fb24-63c1-4529-8bb5-2cf7efb75250 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:15:22.994125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7d92aab9-4788-44b3-80b6-174a4e5e9e49 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:22.994953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7d92aab9-4788-44b3-80b6-174a4e5e9e49 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:23.012244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d92aab9-4788-44b3-80b6-174a4e5e9e49 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:23.012725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d92aab9-4788-44b3-80b6-174a4e5e9e49 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:23.013531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d92aab9-4788-44b3-80b6-174a4e5e9e49 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:23.013974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d92aab9-4788-44b3-80b6-174a4e5e9e49 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:23.349027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-44a0b752-263c-4dd3-b359-441556e4b3b5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:23.362492 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-44a0b752-263c-4dd3-b359-441556e4b3b5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 200 len: 1324 microversion: 2.1 time: 1.072039 Jul 20 04:15:23.364909 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 713/1562] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:22 2022] GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 1324 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:23.378653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0e15c669-88c0-4928-984e-9979a788de2d tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:23.379419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0e15c669-88c0-4928-984e-9979a788de2d tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:23.397279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e15c669-88c0-4928-984e-9979a788de2d tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:23.401377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e15c669-88c0-4928-984e-9979a788de2d tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:23.402567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e15c669-88c0-4928-984e-9979a788de2d tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:23.406045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e15c669-88c0-4928-984e-9979a788de2d tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:23.458821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:23.464637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0e15c669-88c0-4928-984e-9979a788de2d tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 4440f926-b6ca-47fe-a531-de10d5d97511] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:15:23.607190 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0e15c669-88c0-4928-984e-9979a788de2d tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511" status: 204 len: 0 microversion: 2.1 time: 0.240470 Jul 20 04:15:23.608500 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 714/1563] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:15:23 2022] DELETE /compute/v2.1/servers/4440f926-b6ca-47fe-a531-de10d5d97511 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:15:23.640967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e8f225cb-cae2-4c3b-895b-606830636eca tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:23.643574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e8f225cb-cae2-4c3b-895b-606830636eca tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:23.666513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7d92aab9-4788-44b3-80b6-174a4e5e9e49 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:23.674475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8f225cb-cae2-4c3b-895b-606830636eca tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:23.680461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8f225cb-cae2-4c3b-895b-606830636eca tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:23.681234 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7d92aab9-4788-44b3-80b6-174a4e5e9e49 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1334 microversion: 2.1 time: 0.699501 Jul 20 04:15:23.682227 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 850/1564] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:22 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1334 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:23.688564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8f225cb-cae2-4c3b-895b-606830636eca tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:23.692554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8f225cb-cae2-4c3b-895b-606830636eca tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:23.702068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e55ec7a0-652e-44ac-bed2-b2fbf804c617 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be0e9ee0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:23.830830 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e55ec7a0-652e-44ac-bed2-b2fbf804c617 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 200 len: 1412 microversion: 2.1 time: 0.138990 Jul 20 04:15:23.831716 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 851/1565] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:23 2022] GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 1412 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:23.908101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-29276838-4fe2-4ec7-a435-58f28d0a9eed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-498089672", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "05347d26-3624-497b-9d9a-fcd9da53546d"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:24.042762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-29276838-4fe2-4ec7-a435-58f28d0a9eed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] validate_networks() for [('05347d26-3624-497b-9d9a-fcd9da53546d', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:24.506464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e8f225cb-cae2-4c3b-895b-606830636eca tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:24.533670 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e8f225cb-cae2-4c3b-895b-606830636eca tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 0.922290 Jul 20 04:15:24.536674 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 715/1566] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:23 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:24.554914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0a1a7f7d-3361-44d4-be5e-3167565c60b0 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:24.557594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0a1a7f7d-3361-44d4-be5e-3167565c60b0 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:24.579085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0a1a7f7d-3361-44d4-be5e-3167565c60b0 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.579538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0a1a7f7d-3361-44d4-be5e-3167565c60b0 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.583019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0a1a7f7d-3361-44d4-be5e-3167565c60b0 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.585514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0a1a7f7d-3361-44d4-be5e-3167565c60b0 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:25.780345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0a1a7f7d-3361-44d4-be5e-3167565c60b0 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:25.801216 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0a1a7f7d-3361-44d4-be5e-3167565c60b0 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 200 len: 1520 microversion: 2.1 time: 1.262620 Jul 20 04:15:25.804590 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 716/1567] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:24 2022] GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 1520 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:25.813992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7eb4d8b9-1b64-4712-95f1-e18ef9cbf7a1 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:25.825210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7eb4d8b9-1b64-4712-95f1-e18ef9cbf7a1 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:25.832180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7eb4d8b9-1b64-4712-95f1-e18ef9cbf7a1 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.832810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7eb4d8b9-1b64-4712-95f1-e18ef9cbf7a1 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:25.833723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7eb4d8b9-1b64-4712-95f1-e18ef9cbf7a1 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.834304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7eb4d8b9-1b64-4712-95f1-e18ef9cbf7a1 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.287526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7eb4d8b9-1b64-4712-95f1-e18ef9cbf7a1 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:26.296771 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7eb4d8b9-1b64-4712-95f1-e18ef9cbf7a1 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1334 microversion: 2.1 time: 0.490661 Jul 20 04:15:26.309088 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 717/1568] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:25 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1334 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:26.314343 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6587cd91-b359-4db8-9051-5cffbee30f41 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be1439d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:26.383103 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6587cd91-b359-4db8-9051-5cffbee30f41 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 200 len: 1412 microversion: 2.1 time: 0.072472 Jul 20 04:15:26.389711 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 718/1569] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:26 2022] GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 1412 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:26.398973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-40c06e3d-907b-48aa-8fa0-e38c1d154dec tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:26.403628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-40c06e3d-907b-48aa-8fa0-e38c1d154dec tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:26.419682 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40c06e3d-907b-48aa-8fa0-e38c1d154dec tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.420594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40c06e3d-907b-48aa-8fa0-e38c1d154dec tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.421628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40c06e3d-907b-48aa-8fa0-e38c1d154dec tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.422293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40c06e3d-907b-48aa-8fa0-e38c1d154dec tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.872956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-40c06e3d-907b-48aa-8fa0-e38c1d154dec tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:27.900689 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-40c06e3d-907b-48aa-8fa0-e38c1d154dec tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1718 microversion: 2.1 time: 1.509174 Jul 20 04:15:27.909308 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 719/1570] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:26 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1718 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:27.918229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a3b94b98-54af-4b49-b3ff-134ba56f80f8 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Action: 'create', calling method: .version_select at 0x7f06be1438b0>, body: {"pool": null} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:28.270726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-29276838-4fe2-4ec7-a435-58f28d0a9eed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:15:28.271357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-29276838-4fe2-4ec7-a435-58f28d0a9eed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:15:28.271613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-29276838-4fe2-4ec7-a435-58f28d0a9eed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:15:28.272462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-29276838-4fe2-4ec7-a435-58f28d0a9eed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:15:28.273165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-29276838-4fe2-4ec7-a435-58f28d0a9eed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:15:28.288306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29276838-4fe2-4ec7-a435-58f28d0a9eed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.291411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29276838-4fe2-4ec7-a435-58f28d0a9eed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.293810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29276838-4fe2-4ec7-a435-58f28d0a9eed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.294638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29276838-4fe2-4ec7-a435-58f28d0a9eed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.349576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-29276838-4fe2-4ec7-a435-58f28d0a9eed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Getting quotas for project 3c01e02dff54478d891dafa488ab4753. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:28.364388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-29276838-4fe2-4ec7-a435-58f28d0a9eed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Getting quotas for user 3d3e518f087b49a0bedfd9a7df8b4af8 and project 3c01e02dff54478d891dafa488ab4753. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:28.409650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-29276838-4fe2-4ec7-a435-58f28d0a9eed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Going to run 2 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:15:28.419169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-29276838-4fe2-4ec7-a435-58f28d0a9eed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 7662c91d-2965-4c2d-ade7-ec500f555d38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:28.504194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-29276838-4fe2-4ec7-a435-58f28d0a9eed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: de6fb41c-e1f2-4001-b7cf-f058963d6b29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=7662c91d-2965-4c2d-ade7-ec500f555d38,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:28.669332 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-29276838-4fe2-4ec7-a435-58f28d0a9eed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 4.765340 Jul 20 04:15:28.673585 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 852/1571] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:23 2022] POST /compute/v2.1/servers => generated 32 bytes in 4771 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:15:28.688599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-b22b276e-5994-45d2-9519-572e0bf85768 req-4381220f-23df-44bc-8f0c-e4e007538413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a56f06-9dcb-4146-b21c-ffd422f03c83", "tag": "978c8640-62a1-4db3-b6be-4939f52018ea"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:28.733454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-b22b276e-5994-45d2-9519-572e0bf85768 req-4381220f-23df-44bc-8f0c-e4e007538413 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.738411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-b22b276e-5994-45d2-9519-572e0bf85768 req-4381220f-23df-44bc-8f0c-e4e007538413 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.846448 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-b22b276e-5994-45d2-9519-572e0bf85768 req-4381220f-23df-44bc-8f0c-e4e007538413 service nova] Creating event network-changed:978c8640-62a1-4db3-b6be-4939f52018ea for instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 on n-h1-826526-5 Jul 20 04:15:28.863394 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-b22b276e-5994-45d2-9519-572e0bf85768 req-4381220f-23df-44bc-8f0c-e4e007538413 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188263 Jul 20 04:15:28.868593 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 853/1572] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:28.883369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c4b09785-2624-40b6-95aa-63baccf20b50 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:28.885825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c4b09785-2624-40b6-95aa-63baccf20b50 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:28.903954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4b09785-2624-40b6-95aa-63baccf20b50 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.907643 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4b09785-2624-40b6-95aa-63baccf20b50 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.908785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4b09785-2624-40b6-95aa-63baccf20b50 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.909451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4b09785-2624-40b6-95aa-63baccf20b50 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:30.197638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c4b09785-2624-40b6-95aa-63baccf20b50 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:30.219984 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c4b09785-2624-40b6-95aa-63baccf20b50 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1334 microversion: 2.1 time: 1.347058 Jul 20 04:15:30.220740 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 854/1573] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:28 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1334 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:30.237649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-217ff939-8d9b-47e8-b965-5d97c881cc62 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be0e9a60>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:30.429518 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-217ff939-8d9b-47e8-b965-5d97c881cc62 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 200 len: 1412 microversion: 2.1 time: 0.207030 Jul 20 04:15:30.435352 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 855/1574] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:30 2022] GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 1412 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:30.444653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-450a6f74-38c6-439d-8d9f-0702f3900f0e tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:30.499572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-450a6f74-38c6-439d-8d9f-0702f3900f0e tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:30.517506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-450a6f74-38c6-439d-8d9f-0702f3900f0e tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Searching by: {'deleted': False, 'project_id': '3c01e02dff54478d891dafa488ab4753'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:15:30.593074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-450a6f74-38c6-439d-8d9f-0702f3900f0e tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:30.593526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-450a6f74-38c6-439d-8d9f-0702f3900f0e tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:30.594332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-450a6f74-38c6-439d-8d9f-0702f3900f0e tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:30.594766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-450a6f74-38c6-439d-8d9f-0702f3900f0e tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:30.810261 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-450a6f74-38c6-439d-8d9f-0702f3900f0e tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:15:30.940506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:30.943639 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-450a6f74-38c6-439d-8d9f-0702f3900f0e tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.506531 Jul 20 04:15:30.962851 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 856/1575] 10.222.0.17 () {58 vars in 1124 bytes} [Wed Jul 20 04:15:30 2022] GET /compute/v2.1/servers => generated 1335 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:30.977300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-c52ca1ad-63d7-48bf-99d3-e74e4f4cd38c req-340a9fe7-571f-404e-95b7-df6677da7678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4440f926-b6ca-47fe-a531-de10d5d97511", "name": "network-vif-unplugged", "status": "completed", "tag": "f59d2bc8-8cd3-44d1-89b5-cdc7417c9ae2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:31.015558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c52ca1ad-63d7-48bf-99d3-e74e4f4cd38c req-340a9fe7-571f-404e-95b7-df6677da7678 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:31.017278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c52ca1ad-63d7-48bf-99d3-e74e4f4cd38c req-340a9fe7-571f-404e-95b7-df6677da7678 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:31.067377 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-c52ca1ad-63d7-48bf-99d3-e74e4f4cd38c req-340a9fe7-571f-404e-95b7-df6677da7678 service nova] Creating event network-vif-unplugged:f59d2bc8-8cd3-44d1-89b5-cdc7417c9ae2 for instance 4440f926-b6ca-47fe-a531-de10d5d97511 on n-h1-826526-5 Jul 20 04:15:31.091594 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-c52ca1ad-63d7-48bf-99d3-e74e4f4cd38c req-340a9fe7-571f-404e-95b7-df6677da7678 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124118 Jul 20 04:15:31.097844 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 857/1576] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:31.105232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-805f6322-0c16-4ef4-8c1d-306ee4e64e1c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:31.119553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-805f6322-0c16-4ef4-8c1d-306ee4e64e1c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:31.141483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-805f6322-0c16-4ef4-8c1d-306ee4e64e1c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:31.147506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-805f6322-0c16-4ef4-8c1d-306ee4e64e1c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:31.148815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-805f6322-0c16-4ef4-8c1d-306ee4e64e1c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:31.149477 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-805f6322-0c16-4ef4-8c1d-306ee4e64e1c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:31.965680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-805f6322-0c16-4ef4-8c1d-306ee4e64e1c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:31.979375 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-805f6322-0c16-4ef4-8c1d-306ee4e64e1c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1708 microversion: 2.1 time: 0.879803 Jul 20 04:15:32.010608 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 858/1577] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:31 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1708 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:32.018729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-369667a3-ca3a-4551-ba22-4c2cff8a8a06 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:32.023209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-369667a3-ca3a-4551-ba22-4c2cff8a8a06 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 7662c91d-2965-4c2d-ade7-ec500f555d38] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:32.037873 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-369667a3-ca3a-4551-ba22-4c2cff8a8a06 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:32.038870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-369667a3-ca3a-4551-ba22-4c2cff8a8a06 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:32.042824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-369667a3-ca3a-4551-ba22-4c2cff8a8a06 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:32.044040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-369667a3-ca3a-4551-ba22-4c2cff8a8a06 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:32.196449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-369667a3-ca3a-4551-ba22-4c2cff8a8a06 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:32.205340 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-369667a3-ca3a-4551-ba22-4c2cff8a8a06 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38" status: 200 len: 1277 microversion: 2.1 time: 0.193503 Jul 20 04:15:32.230423 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 859/1578] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:32 2022] GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38 => generated 1277 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:32.235409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dca1eed2-0796-4da3-a990-843a4ccd4935 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:32.236031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dca1eed2-0796-4da3-a990-843a4ccd4935 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:32.262416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dca1eed2-0796-4da3-a990-843a4ccd4935 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:32.262780 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dca1eed2-0796-4da3-a990-843a4ccd4935 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:32.266778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dca1eed2-0796-4da3-a990-843a4ccd4935 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:32.269984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dca1eed2-0796-4da3-a990-843a4ccd4935 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:32.945207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dca1eed2-0796-4da3-a990-843a4ccd4935 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:32.961511 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dca1eed2-0796-4da3-a990-843a4ccd4935 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1334 microversion: 2.1 time: 0.725675 Jul 20 04:15:32.964484 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 860/1579] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:32 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1334 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:32.983993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-9df8ea2d-17c8-4e5f-b3fa-8bce3efff85f req-794c1686-802a-4306-906c-97b87da04b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af59fb24-63c1-4529-8bb5-2cf7efb75250", "name": "network-vif-deleted", "tag": "697044e8-782c-4b3a-8905-0c74decaf371"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:33.024825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9df8ea2d-17c8-4e5f-b3fa-8bce3efff85f req-794c1686-802a-4306-906c-97b87da04b3e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:33.025542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9df8ea2d-17c8-4e5f-b3fa-8bce3efff85f req-794c1686-802a-4306-906c-97b87da04b3e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:33.105890 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9df8ea2d-17c8-4e5f-b3fa-8bce3efff85f req-794c1686-802a-4306-906c-97b87da04b3e service nova] Creating event network-vif-deleted:697044e8-782c-4b3a-8905-0c74decaf371 for instance af59fb24-63c1-4529-8bb5-2cf7efb75250 on n-h1-826526-5 Jul 20 04:15:33.122666 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-9df8ea2d-17c8-4e5f-b3fa-8bce3efff85f req-794c1686-802a-4306-906c-97b87da04b3e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154443 Jul 20 04:15:33.127517 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 861/1580] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:33.144152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fa08c8c0-5b70-4831-8a09-5d0bb4f2fde4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be3375e0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:33.245573 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fa08c8c0-5b70-4831-8a09-5d0bb4f2fde4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 200 len: 1412 microversion: 2.1 time: 0.116439 Jul 20 04:15:33.246185 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 862/1581] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:33 2022] GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:33.266546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-744331da-792f-499e-8b84-67df141defeb req-21b46d24-381f-414e-bca3-13cdadf21663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4440f926-b6ca-47fe-a531-de10d5d97511", "name": "network-vif-deleted", "tag": "f59d2bc8-8cd3-44d1-89b5-cdc7417c9ae2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:33.302264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-744331da-792f-499e-8b84-67df141defeb req-21b46d24-381f-414e-bca3-13cdadf21663 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:33.305375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-744331da-792f-499e-8b84-67df141defeb req-21b46d24-381f-414e-bca3-13cdadf21663 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:33.339135 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-744331da-792f-499e-8b84-67df141defeb req-21b46d24-381f-414e-bca3-13cdadf21663 service nova] Creating event network-vif-deleted:f59d2bc8-8cd3-44d1-89b5-cdc7417c9ae2 for instance 4440f926-b6ca-47fe-a531-de10d5d97511 on n-h1-826526-5 Jul 20 04:15:33.358764 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-744331da-792f-499e-8b84-67df141defeb req-21b46d24-381f-414e-bca3-13cdadf21663 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095884 Jul 20 04:15:33.361466 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 863/1582] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:33.379271 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5e3a6efa-d247-4d3e-802e-c7daf66805fe tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '.version_select at 0x7f06be47ddc0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:33.387031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e3a6efa-d247-4d3e-802e-c7daf66805fe tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:33.394026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e3a6efa-d247-4d3e-802e-c7daf66805fe tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:33.424097 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5e3a6efa-d247-4d3e-802e-c7daf66805fe tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 2321 microversion: 2.1 time: 0.060675 Jul 20 04:15:33.427182 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 864/1583] 10.222.0.17 () {58 vars in 1142 bytes} [Wed Jul 20 04:15:33 2022] GET /compute/v2.1/os-migrations => generated 2321 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:33.440876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0aad2262-ed4e-43cd-87bb-ab72e276dfa6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1579964193", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "08ef3e3e-6870-4bac-a7ee-1dba3bc5da77"}], "block_device_mapping_v2": [{"uuid": "4663d2cd-5b77-4685-bd70-edbaa5baa3d3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:33.686845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-0aad2262-ed4e-43cd-87bb-ab72e276dfa6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] validate_networks() for [('08ef3e3e-6870-4bac-a7ee-1dba3bc5da77', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:34.792689 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a3b94b98-54af-4b49-b3ff-134ba56f80f8 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.881330 Jul 20 04:15:34.793264 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 720/1584] 10.222.0.17 () {60 vars in 1169 bytes} [Wed Jul 20 04:15:27 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:34.822204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-0c0f3d9d-7ff6-4a48-ae71-aca87bf606aa req-9ca56df7-a45b-4400-bc08-2a89a67d28f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af59fb24-63c1-4529-8bb5-2cf7efb75250", "name": "network-vif-unplugged", "status": "completed", "tag": "697044e8-782c-4b3a-8905-0c74decaf371"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:34.854903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0c0f3d9d-7ff6-4a48-ae71-aca87bf606aa req-9ca56df7-a45b-4400-bc08-2a89a67d28f6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:34.856828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0c0f3d9d-7ff6-4a48-ae71-aca87bf606aa req-9ca56df7-a45b-4400-bc08-2a89a67d28f6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:34.889781 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-0c0f3d9d-7ff6-4a48-ae71-aca87bf606aa req-9ca56df7-a45b-4400-bc08-2a89a67d28f6 service nova] Creating event network-vif-unplugged:697044e8-782c-4b3a-8905-0c74decaf371 for instance af59fb24-63c1-4529-8bb5-2cf7efb75250 on n-h1-826526-5 Jul 20 04:15:34.913721 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-0c0f3d9d-7ff6-4a48-ae71-aca87bf606aa req-9ca56df7-a45b-4400-bc08-2a89a67d28f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109559 Jul 20 04:15:34.914806 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 721/1585] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:34.938740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e13a68d9-7ed6-4131-aae7-fa55b2ac580e tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:34.941366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e13a68d9-7ed6-4131-aae7-fa55b2ac580e tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 7662c91d-2965-4c2d-ade7-ec500f555d38] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:34.969004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e13a68d9-7ed6-4131-aae7-fa55b2ac580e tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:34.974425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e13a68d9-7ed6-4131-aae7-fa55b2ac580e tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:34.981763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e13a68d9-7ed6-4131-aae7-fa55b2ac580e tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:34.981763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e13a68d9-7ed6-4131-aae7-fa55b2ac580e tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.451261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e13a68d9-7ed6-4131-aae7-fa55b2ac580e tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:35.463960 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e13a68d9-7ed6-4131-aae7-fa55b2ac580e tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38" status: 200 len: 1275 microversion: 2.1 time: 0.547059 Jul 20 04:15:35.469101 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 722/1586] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:34 2022] GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38 => generated 1275 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:35.485538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-af92e264-a6bc-427a-9923-3cadc1afd145 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:35.489246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-af92e264-a6bc-427a-9923-3cadc1afd145 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:35.493951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0aad2262-ed4e-43cd-87bb-ab72e276dfa6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:15:35.494536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0aad2262-ed4e-43cd-87bb-ab72e276dfa6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:15:35.498460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0aad2262-ed4e-43cd-87bb-ab72e276dfa6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:15:35.498971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0aad2262-ed4e-43cd-87bb-ab72e276dfa6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:15:35.499469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0aad2262-ed4e-43cd-87bb-ab72e276dfa6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:15:35.537240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0aad2262-ed4e-43cd-87bb-ab72e276dfa6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.538410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af92e264-a6bc-427a-9923-3cadc1afd145 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.539060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0aad2262-ed4e-43cd-87bb-ab72e276dfa6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.540489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af92e264-a6bc-427a-9923-3cadc1afd145 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.541057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0aad2262-ed4e-43cd-87bb-ab72e276dfa6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.542112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0aad2262-ed4e-43cd-87bb-ab72e276dfa6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.546934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af92e264-a6bc-427a-9923-3cadc1afd145 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.547564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af92e264-a6bc-427a-9923-3cadc1afd145 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.641882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-0aad2262-ed4e-43cd-87bb-ab72e276dfa6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Getting quotas for project 8d4037629b9e4e6fa92e2a8d89cf0311. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:35.656828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-0aad2262-ed4e-43cd-87bb-ab72e276dfa6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Getting quotas for user 45a9bfefde81473d88610b03e0de9bf4 and project 8d4037629b9e4e6fa92e2a8d89cf0311. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:35.798680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0aad2262-ed4e-43cd-87bb-ab72e276dfa6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:15:35.800899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0aad2262-ed4e-43cd-87bb-ab72e276dfa6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4663d2cd-5b77-4685-bd70-edbaa5baa3d3',volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:36.217522 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0aad2262-ed4e-43cd-87bb-ab72e276dfa6 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.784198 Jul 20 04:15:36.218714 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 865/1587] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 04:15:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2791 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:15:36.227514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-56d0c36c-bf61-4102-ad1a-8d251ec529f5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:36.233085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-56d0c36c-bf61-4102-ad1a-8d251ec529f5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:36.250618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56d0c36c-bf61-4102-ad1a-8d251ec529f5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.261156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56d0c36c-bf61-4102-ad1a-8d251ec529f5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.263011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56d0c36c-bf61-4102-ad1a-8d251ec529f5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.263650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56d0c36c-bf61-4102-ad1a-8d251ec529f5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.375471 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-af92e264-a6bc-427a-9923-3cadc1afd145 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1859 microversion: 2.1 time: 0.902291 Jul 20 04:15:36.387914 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 723/1588] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:35 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1859 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:36.405808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c78902f8-451a-4cbf-8eae-b6908e337aeb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be1bc5e0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:36.515428 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c78902f8-451a-4cbf-8eae-b6908e337aeb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 200 len: 1412 microversion: 2.1 time: 0.125316 Jul 20 04:15:36.516244 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 724/1589] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:36 2022] GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:36.543123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-10615493-9774-4495-b7dc-392590a94b2b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2085351864", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "02803c14-35b7-4d41-afe7-2c5b8fd340b9"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:36.712443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-10615493-9774-4495-b7dc-392590a94b2b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] validate_networks() for [('02803c14-35b7-4d41-afe7-2c5b8fd340b9', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:37.294835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-56d0c36c-bf61-4102-ad1a-8d251ec529f5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:37.323078 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-56d0c36c-bf61-4102-ad1a-8d251ec529f5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1334 microversion: 2.1 time: 1.095921 Jul 20 04:15:37.324078 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 866/1590] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:36 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1334 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:37.332608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-4df8dec3-68fb-460b-beea-c3ec099d9edc req-673e6c33-078d-4626-a16f-5c9e5db74fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a56f06-9dcb-4146-b21c-ffd422f03c83", "tag": "2c9a10c4-0894-44e5-97cf-4807bf1031a2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:37.377142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4df8dec3-68fb-460b-beea-c3ec099d9edc req-673e6c33-078d-4626-a16f-5c9e5db74fa2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.378952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4df8dec3-68fb-460b-beea-c3ec099d9edc req-673e6c33-078d-4626-a16f-5c9e5db74fa2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.431956 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-4df8dec3-68fb-460b-beea-c3ec099d9edc req-673e6c33-078d-4626-a16f-5c9e5db74fa2 service nova] Creating event network-changed:2c9a10c4-0894-44e5-97cf-4807bf1031a2 for instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 on n-h1-826526-5 Jul 20 04:15:37.438535 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-4df8dec3-68fb-460b-beea-c3ec099d9edc req-673e6c33-078d-4626-a16f-5c9e5db74fa2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110590 Jul 20 04:15:37.454291 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 867/1591] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:37.475945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-88fcd3c7-a01e-4229-82b5-d858668d9b05 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:37.477360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-88fcd3c7-a01e-4229-82b5-d858668d9b05 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:37.493522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88fcd3c7-a01e-4229-82b5-d858668d9b05 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.497268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88fcd3c7-a01e-4229-82b5-d858668d9b05 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.499289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88fcd3c7-a01e-4229-82b5-d858668d9b05 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.505753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88fcd3c7-a01e-4229-82b5-d858668d9b05 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.916168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-88fcd3c7-a01e-4229-82b5-d858668d9b05 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:37.941765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-88fcd3c7-a01e-4229-82b5-d858668d9b05 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:37.944635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-88fcd3c7-a01e-4229-82b5-d858668d9b05 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:37.947057 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-88fcd3c7-a01e-4229-82b5-d858668d9b05 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1185 microversion: 2.25 time: 0.490988 Jul 20 04:15:37.960324 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 868/1592] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:37 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1185 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:37.966846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-93814f57-221d-4e4e-adcf-90db174afb67 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:37.967771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-93814f57-221d-4e4e-adcf-90db174afb67 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:37.979983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93814f57-221d-4e4e-adcf-90db174afb67 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.983819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93814f57-221d-4e4e-adcf-90db174afb67 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.987190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93814f57-221d-4e4e-adcf-90db174afb67 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.988352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93814f57-221d-4e4e-adcf-90db174afb67 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:38.577410 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-93814f57-221d-4e4e-adcf-90db174afb67 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1859 microversion: 2.1 time: 0.615555 Jul 20 04:15:38.583579 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 869/1593] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:37 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1859 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:38.593554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e35205c3-e7ca-40d5-8778-acc5848dfaca tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:38.608242 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e35205c3-e7ca-40d5-8778-acc5848dfaca tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 7662c91d-2965-4c2d-ade7-ec500f555d38] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:38.660765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e35205c3-e7ca-40d5-8778-acc5848dfaca tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:38.667822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e35205c3-e7ca-40d5-8778-acc5848dfaca tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:38.672736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e35205c3-e7ca-40d5-8778-acc5848dfaca tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:38.677058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e35205c3-e7ca-40d5-8778-acc5848dfaca tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:38.726967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-10615493-9774-4495-b7dc-392590a94b2b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:15:38.727531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-10615493-9774-4495-b7dc-392590a94b2b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:15:38.728731 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-10615493-9774-4495-b7dc-392590a94b2b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:15:38.729234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-10615493-9774-4495-b7dc-392590a94b2b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:15:38.729731 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-10615493-9774-4495-b7dc-392590a94b2b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:15:38.768088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10615493-9774-4495-b7dc-392590a94b2b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:38.773555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10615493-9774-4495-b7dc-392590a94b2b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:38.777665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10615493-9774-4495-b7dc-392590a94b2b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:38.785361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10615493-9774-4495-b7dc-392590a94b2b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:38.854053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-10615493-9774-4495-b7dc-392590a94b2b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Getting quotas for project aabdfe1e44014cb9b940e5f7c7fc9938. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:38.862037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-10615493-9774-4495-b7dc-392590a94b2b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Getting quotas for user b8a99f17308e4a21be83507470946b76 and project aabdfe1e44014cb9b940e5f7c7fc9938. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:38.896867 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-10615493-9774-4495-b7dc-392590a94b2b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:15:38.899549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-10615493-9774-4495-b7dc-392590a94b2b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:39.056092 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-10615493-9774-4495-b7dc-392590a94b2b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.538510 Jul 20 04:15:39.062835 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 725/1594] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:15:39.071333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-49654a08-8e47-49f1-88d5-d60a05cb9456 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be143670>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:39.164453 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-49654a08-8e47-49f1-88d5-d60a05cb9456 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 200 len: 1412 microversion: 2.1 time: 0.100134 Jul 20 04:15:39.165057 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 726/1595] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:39 2022] GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:39.175588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fea5c2e0-5bb7-45b6-9c1d-e4af8eea1879 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:39.179436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fea5c2e0-5bb7-45b6-9c1d-e4af8eea1879 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:39.197559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fea5c2e0-5bb7-45b6-9c1d-e4af8eea1879 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:39.198220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fea5c2e0-5bb7-45b6-9c1d-e4af8eea1879 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:39.198974 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fea5c2e0-5bb7-45b6-9c1d-e4af8eea1879 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:39.207945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fea5c2e0-5bb7-45b6-9c1d-e4af8eea1879 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:39.808852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fea5c2e0-5bb7-45b6-9c1d-e4af8eea1879 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:39.826059 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fea5c2e0-5bb7-45b6-9c1d-e4af8eea1879 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1334 microversion: 2.1 time: 0.659059 Jul 20 04:15:39.827293 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 727/1596] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:39 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1334 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:39.855541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8c629a6a-b3c5-4663-a2b7-206ff22237d7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:39.856781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8c629a6a-b3c5-4663-a2b7-206ff22237d7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:39.870587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c629a6a-b3c5-4663-a2b7-206ff22237d7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:39.874259 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c629a6a-b3c5-4663-a2b7-206ff22237d7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:39.877539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c629a6a-b3c5-4663-a2b7-206ff22237d7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:39.880069 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c629a6a-b3c5-4663-a2b7-206ff22237d7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.005379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e35205c3-e7ca-40d5-8778-acc5848dfaca tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:40.041723 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e35205c3-e7ca-40d5-8778-acc5848dfaca tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38" status: 200 len: 1317 microversion: 2.1 time: 1.456522 Jul 20 04:15:40.068074 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 870/1597] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:38 2022] GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38 => generated 1317 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:40.080857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c11b34cd-574b-4653-a294-f014379f3a22 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:40.098234 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c11b34cd-574b-4653-a294-f014379f3a22 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:40.118346 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c11b34cd-574b-4653-a294-f014379f3a22 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.128618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c11b34cd-574b-4653-a294-f014379f3a22 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.135109 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c11b34cd-574b-4653-a294-f014379f3a22 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.135745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c11b34cd-574b-4653-a294-f014379f3a22 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.263523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-8c629a6a-b3c5-4663-a2b7-206ff22237d7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lazy-loading 'services' on Instance uuid 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:15:40.479616 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8c629a6a-b3c5-4663-a2b7-206ff22237d7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "DELETE /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments/54988f2e-b637-4389-bdf2-72552d43be28" status: 202 len: 0 microversion: 2.1 time: 0.649597 Jul 20 04:15:40.482771 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 728/1598] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 04:15:39 2022] DELETE /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments/54988f2e-b637-4389-bdf2-72552d43be28 => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:40.500057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6abeabe7-ffce-4b1c-b314-b4043441a0df tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:40.501754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6abeabe7-ffce-4b1c-b314-b4043441a0df tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:40.511308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6abeabe7-ffce-4b1c-b314-b4043441a0df tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.512031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6abeabe7-ffce-4b1c-b314-b4043441a0df tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.513074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6abeabe7-ffce-4b1c-b314-b4043441a0df tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.514031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6abeabe7-ffce-4b1c-b314-b4043441a0df tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.583158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c11b34cd-574b-4653-a294-f014379f3a22 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:40.600879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c11b34cd-574b-4653-a294-f014379f3a22 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:40.632994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c11b34cd-574b-4653-a294-f014379f3a22 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:40.642304 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c11b34cd-574b-4653-a294-f014379f3a22 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1251 microversion: 2.25 time: 0.565046 Jul 20 04:15:40.643404 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 871/1599] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:40 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1251 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:40.650996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2c2851bb-0705-4b25-9efc-7f8f1850704e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bdd34af0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:40.708806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6abeabe7-ffce-4b1c-b314-b4043441a0df tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:40.732319 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6abeabe7-ffce-4b1c-b314-b4043441a0df tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f" status: 200 len: 1276 microversion: 2.1 time: 0.243528 Jul 20 04:15:40.733004 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 729/1600] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:40 2022] GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f => generated 1276 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:40.746517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-31ae9317-e12f-41e1-ba84-9f026b6bc5d7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:40.747570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-31ae9317-e12f-41e1-ba84-9f026b6bc5d7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:40.764574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31ae9317-e12f-41e1-ba84-9f026b6bc5d7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.778856 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2c2851bb-0705-4b25-9efc-7f8f1850704e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 200 len: 1412 microversion: 2.1 time: 0.134035 Jul 20 04:15:40.781479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31ae9317-e12f-41e1-ba84-9f026b6bc5d7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.782413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31ae9317-e12f-41e1-ba84-9f026b6bc5d7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.782662 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 872/1601] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:40 2022] GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 1412 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:40.782810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31ae9317-e12f-41e1-ba84-9f026b6bc5d7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.845406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-19f9ef32-4470-4701-9705-556860f168c3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:40.846438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-19f9ef32-4470-4701-9705-556860f168c3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:40.863109 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19f9ef32-4470-4701-9705-556860f168c3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.863922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19f9ef32-4470-4701-9705-556860f168c3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.865114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19f9ef32-4470-4701-9705-556860f168c3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.869132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19f9ef32-4470-4701-9705-556860f168c3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.919126 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-31ae9317-e12f-41e1-ba84-9f026b6bc5d7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183637 Jul 20 04:15:40.920344 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 730/1602] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:15:40 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:41.064911 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7c03b92c-45a8-42ba-8da0-7e97d94a3322 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:41.065610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7c03b92c-45a8-42ba-8da0-7e97d94a3322 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 7662c91d-2965-4c2d-ade7-ec500f555d38] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:41.079016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c03b92c-45a8-42ba-8da0-7e97d94a3322 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.080833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c03b92c-45a8-42ba-8da0-7e97d94a3322 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.083438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c03b92c-45a8-42ba-8da0-7e97d94a3322 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.085577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c03b92c-45a8-42ba-8da0-7e97d94a3322 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.540563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-19f9ef32-4470-4701-9705-556860f168c3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:41.554819 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-19f9ef32-4470-4701-9705-556860f168c3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1334 microversion: 2.1 time: 0.714863 Jul 20 04:15:41.563833 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 873/1603] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:40 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1334 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:41.662066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f8913b2e-d3fd-4523-adfc-66e41c29aa5c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:41.664510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f8913b2e-d3fd-4523-adfc-66e41c29aa5c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:41.680774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8913b2e-d3fd-4523-adfc-66e41c29aa5c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.689239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8913b2e-d3fd-4523-adfc-66e41c29aa5c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.693178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8913b2e-d3fd-4523-adfc-66e41c29aa5c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.699716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8913b2e-d3fd-4523-adfc-66e41c29aa5c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.863379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7c03b92c-45a8-42ba-8da0-7e97d94a3322 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:41.871551 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7c03b92c-45a8-42ba-8da0-7e97d94a3322 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38" status: 200 len: 1317 microversion: 2.1 time: 0.812202 Jul 20 04:15:41.872886 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 731/1604] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:41 2022] GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38 => generated 1317 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:41.878830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a6308cb0-d8aa-4972-89de-3e77efa809d1 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:41.879676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a6308cb0-d8aa-4972-89de-3e77efa809d1 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:41.886170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6308cb0-d8aa-4972-89de-3e77efa809d1 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.886853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6308cb0-d8aa-4972-89de-3e77efa809d1 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.888564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6308cb0-d8aa-4972-89de-3e77efa809d1 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.889181 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6308cb0-d8aa-4972-89de-3e77efa809d1 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.006376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a6308cb0-d8aa-4972-89de-3e77efa809d1 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:42.020386 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a6308cb0-d8aa-4972-89de-3e77efa809d1 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f" status: 200 len: 1282 microversion: 2.1 time: 0.146120 Jul 20 04:15:42.030195 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 732/1605] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:41 2022] GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f => generated 1282 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:42.035516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aea93d13-5f48-4c3f-a870-2bf853a3cbb4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bde40700>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:42.115019 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aea93d13-5f48-4c3f-a870-2bf853a3cbb4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 200 len: 1421 microversion: 2.1 time: 0.083574 Jul 20 04:15:42.116053 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 733/1606] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:42 2022] GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:42.137195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1ed8675b-257b-4660-a9e1-0bf55ddefd5c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:42.138254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1ed8675b-257b-4660-a9e1-0bf55ddefd5c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:42.141082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:42.174094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ed8675b-257b-4660-a9e1-0bf55ddefd5c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:42.174738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ed8675b-257b-4660-a9e1-0bf55ddefd5c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.175726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ed8675b-257b-4660-a9e1-0bf55ddefd5c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:42.176048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ed8675b-257b-4660-a9e1-0bf55ddefd5c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.249805 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1ed8675b-257b-4660-a9e1-0bf55ddefd5c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132626 Jul 20 04:15:42.251842 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 734/1607] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:15:42 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:42.257869 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-40a03b1d-1377-4b73-a486-7cd714b44332 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bde40b80>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:42.336356 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-40a03b1d-1377-4b73-a486-7cd714b44332 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 200 len: 1421 microversion: 2.1 time: 0.082969 Jul 20 04:15:42.337647 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 735/1608] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:42 2022] GET /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:42.352307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-762a41eb-f898-4ee4-8f52-dda902cf687e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be1e73a0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:42.675620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f8913b2e-d3fd-4523-adfc-66e41c29aa5c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:42.701031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f8913b2e-d3fd-4523-adfc-66e41c29aa5c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:42.709644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f8913b2e-d3fd-4523-adfc-66e41c29aa5c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:42.713153 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f8913b2e-d3fd-4523-adfc-66e41c29aa5c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1251 microversion: 2.25 time: 1.055184 Jul 20 04:15:42.716830 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 874/1609] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:41 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1251 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:15:42.744088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-862e7cc3-bb65-4bd1-b42f-8a75b80a9abe tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:42.745975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-862e7cc3-bb65-4bd1-b42f-8a75b80a9abe tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:42.762768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-862e7cc3-bb65-4bd1-b42f-8a75b80a9abe tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:42.763403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-862e7cc3-bb65-4bd1-b42f-8a75b80a9abe tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.764869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-862e7cc3-bb65-4bd1-b42f-8a75b80a9abe tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:42.776697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-862e7cc3-bb65-4bd1-b42f-8a75b80a9abe tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:43.474820 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-762a41eb-f898-4ee4-8f52-dda902cf687e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "DELETE /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 204 len: 0 microversion: 2.1 time: 1.128202 Jul 20 04:15:43.475586 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 736/1610] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:42 2022] DELETE /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 0 bytes in 1131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:15:43.482153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dd56fafb-9539-4be7-b31e-64ce900a8cfc tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:43.482779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dd56fafb-9539-4be7-b31e-64ce900a8cfc tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 7662c91d-2965-4c2d-ade7-ec500f555d38] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:43.497405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd56fafb-9539-4be7-b31e-64ce900a8cfc tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:43.498206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd56fafb-9539-4be7-b31e-64ce900a8cfc tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:43.499868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd56fafb-9539-4be7-b31e-64ce900a8cfc tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:43.500345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd56fafb-9539-4be7-b31e-64ce900a8cfc tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:43.511027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:43.922424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-862e7cc3-bb65-4bd1-b42f-8a75b80a9abe tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:43.942753 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-862e7cc3-bb65-4bd1-b42f-8a75b80a9abe tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1334 microversion: 2.1 time: 1.209816 Jul 20 04:15:43.943820 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 875/1611] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:42 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1334 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:43.959512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1c27833f-f5e5-4aab-9008-e0f6a2b37a86 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:43.960472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1c27833f-f5e5-4aab-9008-e0f6a2b37a86 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:43.969090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c27833f-f5e5-4aab-9008-e0f6a2b37a86 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:43.974336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c27833f-f5e5-4aab-9008-e0f6a2b37a86 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:43.975666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c27833f-f5e5-4aab-9008-e0f6a2b37a86 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:43.976592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c27833f-f5e5-4aab-9008-e0f6a2b37a86 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.285536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1c27833f-f5e5-4aab-9008-e0f6a2b37a86 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:44.299959 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1c27833f-f5e5-4aab-9008-e0f6a2b37a86 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f" status: 200 len: 1282 microversion: 2.1 time: 0.346511 Jul 20 04:15:44.310046 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 876/1612] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:43 2022] GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f => generated 1282 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:44.318733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6a0e0d2e-003c-410c-92d6-34ff87cb1440 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:44.321697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6a0e0d2e-003c-410c-92d6-34ff87cb1440 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:44.330874 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dd56fafb-9539-4be7-b31e-64ce900a8cfc tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:44.342787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a0e0d2e-003c-410c-92d6-34ff87cb1440 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.343239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a0e0d2e-003c-410c-92d6-34ff87cb1440 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.347223 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dd56fafb-9539-4be7-b31e-64ce900a8cfc tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38" status: 200 len: 1317 microversion: 2.1 time: 0.869828 Jul 20 04:15:44.349817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a0e0d2e-003c-410c-92d6-34ff87cb1440 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.351197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a0e0d2e-003c-410c-92d6-34ff87cb1440 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.354510 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 737/1613] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:43 2022] GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38 => generated 1317 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:44.376892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-776a25ea-a2bc-4f53-af52-ec66f9b7a86a req-f8df47ff-c16a-4ecb-b53f-40fc5638f8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a56f06-9dcb-4146-b21c-ffd422f03c83", "name": "network-vif-plugged", "status": "completed", "tag": "978c8640-62a1-4db3-b6be-4939f52018ea"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:44.401549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-776a25ea-a2bc-4f53-af52-ec66f9b7a86a req-f8df47ff-c16a-4ecb-b53f-40fc5638f8b5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.407312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-776a25ea-a2bc-4f53-af52-ec66f9b7a86a req-f8df47ff-c16a-4ecb-b53f-40fc5638f8b5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.438085 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-776a25ea-a2bc-4f53-af52-ec66f9b7a86a req-f8df47ff-c16a-4ecb-b53f-40fc5638f8b5 service nova] Creating event network-vif-plugged:978c8640-62a1-4db3-b6be-4939f52018ea for instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 on n-h1-826526-5 Jul 20 04:15:44.454357 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-776a25ea-a2bc-4f53-af52-ec66f9b7a86a req-f8df47ff-c16a-4ecb-b53f-40fc5638f8b5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088138 Jul 20 04:15:44.455699 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 738/1614] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:44.461412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4934e37e-f470-4aa0-9ac5-155c8ae66915 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:44.466060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4934e37e-f470-4aa0-9ac5-155c8ae66915 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:44.473460 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6a0e0d2e-003c-410c-92d6-34ff87cb1440 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168867 Jul 20 04:15:44.476039 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 877/1615] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:15:44 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:44.481875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4934e37e-f470-4aa0-9ac5-155c8ae66915 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.482913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4934e37e-f470-4aa0-9ac5-155c8ae66915 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.494133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4934e37e-f470-4aa0-9ac5-155c8ae66915 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.494881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4934e37e-f470-4aa0-9ac5-155c8ae66915 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.495349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-bde572a6-0c09-4052-b1a0-5e36161382a8 req-19406452-a8d2-470f-a1c4-bbbff85f5e1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7662c91d-2965-4c2d-ade7-ec500f555d38", "tag": "bc073d80-646b-4c5f-a802-2eb8d71b2add"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:44.521198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bde572a6-0c09-4052-b1a0-5e36161382a8 req-19406452-a8d2-470f-a1c4-bbbff85f5e1e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.522172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bde572a6-0c09-4052-b1a0-5e36161382a8 req-19406452-a8d2-470f-a1c4-bbbff85f5e1e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.558465 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-bde572a6-0c09-4052-b1a0-5e36161382a8 req-19406452-a8d2-470f-a1c4-bbbff85f5e1e service nova] Creating event network-changed:bc073d80-646b-4c5f-a802-2eb8d71b2add for instance 7662c91d-2965-4c2d-ade7-ec500f555d38 on n-h1-826526-5 Jul 20 04:15:44.563699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4934e37e-f470-4aa0-9ac5-155c8ae66915 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:15:44.584923 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-bde572a6-0c09-4052-b1a0-5e36161382a8 req-19406452-a8d2-470f-a1c4-bbbff85f5e1e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099674 Jul 20 04:15:44.586862 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 878/1616] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:44.603379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-82079e2e-0243-494d-abf2-86023fcfe8c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:44.607710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-82079e2e-0243-494d-abf2-86023fcfe8c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:44.650492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82079e2e-0243-494d-abf2-86023fcfe8c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.654287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82079e2e-0243-494d-abf2-86023fcfe8c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.655749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82079e2e-0243-494d-abf2-86023fcfe8c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.656389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82079e2e-0243-494d-abf2-86023fcfe8c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.720800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:44.763193 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4934e37e-f470-4aa0-9ac5-155c8ae66915 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15" status: 204 len: 0 microversion: 2.1 time: 0.305683 Jul 20 04:15:44.764493 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 739/1617] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:15:44 2022] DELETE /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:15:44.962975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-47f0ca5d-ccb3-4021-af4a-a55034f61d05 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:44.965458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-47f0ca5d-ccb3-4021-af4a-a55034f61d05 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:44.980012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-47f0ca5d-ccb3-4021-af4a-a55034f61d05 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.980998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-47f0ca5d-ccb3-4021-af4a-a55034f61d05 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.983417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-47f0ca5d-ccb3-4021-af4a-a55034f61d05 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.986696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-47f0ca5d-ccb3-4021-af4a-a55034f61d05 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:45.595344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:45.684425 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=12 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:45.849514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-47f0ca5d-ccb3-4021-af4a-a55034f61d05 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:45.892203 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-47f0ca5d-ccb3-4021-af4a-a55034f61d05 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1334 microversion: 2.1 time: 0.933197 Jul 20 04:15:45.911551 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 740/1618] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:44 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1334 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:45.933529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4e741cd1-6854-47aa-9117-94672420046e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1573487175", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "4a34548b-e35a-44a0-ab83-c5f87d932d5b"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:46.093739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-4e741cd1-6854-47aa-9117-94672420046e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] validate_networks() for [('4a34548b-e35a-44a0-ab83-c5f87d932d5b', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:46.559201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-82079e2e-0243-494d-abf2-86023fcfe8c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:46.580417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-82079e2e-0243-494d-abf2-86023fcfe8c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:46.591825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-82079e2e-0243-494d-abf2-86023fcfe8c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:46.593308 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-82079e2e-0243-494d-abf2-86023fcfe8c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1293 microversion: 2.25 time: 2.004428 Jul 20 04:15:46.594545 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 879/1619] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:44 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1293 bytes in 2007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:46.599743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ead145f0-d672-4780-8845-92b909fa7940 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:46.600472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ead145f0-d672-4780-8845-92b909fa7940 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:46.619521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ead145f0-d672-4780-8845-92b909fa7940 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:46.623541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ead145f0-d672-4780-8845-92b909fa7940 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:46.626882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ead145f0-d672-4780-8845-92b909fa7940 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:46.629587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ead145f0-d672-4780-8845-92b909fa7940 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:46.895375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ead145f0-d672-4780-8845-92b909fa7940 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:46.910244 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ead145f0-d672-4780-8845-92b909fa7940 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f" status: 200 len: 1282 microversion: 2.1 time: 0.314406 Jul 20 04:15:46.910862 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 880/1620] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:46 2022] GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f => generated 1282 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:46.937044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-43564640-b4d3-42fb-ac69-0d8813cd929b tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:46.937669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-43564640-b4d3-42fb-ac69-0d8813cd929b tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 7662c91d-2965-4c2d-ade7-ec500f555d38] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:46.951485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43564640-b4d3-42fb-ac69-0d8813cd929b tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:46.952528 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43564640-b4d3-42fb-ac69-0d8813cd929b tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:46.953321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43564640-b4d3-42fb-ac69-0d8813cd929b tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:46.953755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43564640-b4d3-42fb-ac69-0d8813cd929b tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:47.789194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-43564640-b4d3-42fb-ac69-0d8813cd929b tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:47.798353 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-43564640-b4d3-42fb-ac69-0d8813cd929b tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38" status: 200 len: 1317 microversion: 2.1 time: 0.865862 Jul 20 04:15:47.798959 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 881/1621] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:46 2022] GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38 => generated 1317 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:47.816159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7fd387cc-6035-4f1a-a44d-371cb654228b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:47.817769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7fd387cc-6035-4f1a-a44d-371cb654228b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:47.825012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fd387cc-6035-4f1a-a44d-371cb654228b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:47.825741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fd387cc-6035-4f1a-a44d-371cb654228b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:47.826691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fd387cc-6035-4f1a-a44d-371cb654228b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:47.827305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fd387cc-6035-4f1a-a44d-371cb654228b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:47.864013 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7fd387cc-6035-4f1a-a44d-371cb654228b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052439 Jul 20 04:15:47.869163 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 882/1622] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:15:47 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:47.876878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-8841888d-f099-4dab-bb76-9432c167914f req-50d61905-909b-45b2-a1ed-6ed714b911c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c4bdc1-7bb8-47c0-b73f-317ba18949df", "tag": "7c532b32-d9c8-43cb-aa4c-635e4487021e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:47.886526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8841888d-f099-4dab-bb76-9432c167914f req-50d61905-909b-45b2-a1ed-6ed714b911c0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:47.887222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8841888d-f099-4dab-bb76-9432c167914f req-50d61905-909b-45b2-a1ed-6ed714b911c0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:47.899912 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-8841888d-f099-4dab-bb76-9432c167914f req-50d61905-909b-45b2-a1ed-6ed714b911c0 service nova] Creating event network-changed:7c532b32-d9c8-43cb-aa4c-635e4487021e for instance 32c4bdc1-7bb8-47c0-b73f-317ba18949df on n-h1-826526-5 Jul 20 04:15:47.905813 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-8841888d-f099-4dab-bb76-9432c167914f req-50d61905-909b-45b2-a1ed-6ed714b911c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034925 Jul 20 04:15:47.906495 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 883/1623] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:47.915032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-f6649ae9-652b-4c65-85fb-51f4e8f6f18e req-2292b0c6-e50b-4e98-94b2-c5f70c30f6dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a56f06-9dcb-4146-b21c-ffd422f03c83", "name": "network-vif-plugged", "status": "completed", "tag": "2c9a10c4-0894-44e5-97cf-4807bf1031a2"}, {"server_uuid": "b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15", "name": "network-vif-unplugged", "status": "completed", "tag": "8ea4b8f0-2e09-4c78-bfdc-b37c6369a077"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:47.930100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f6649ae9-652b-4c65-85fb-51f4e8f6f18e req-2292b0c6-e50b-4e98-94b2-c5f70c30f6dd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:47.931895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f6649ae9-652b-4c65-85fb-51f4e8f6f18e req-2292b0c6-e50b-4e98-94b2-c5f70c30f6dd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:47.967570 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-f6649ae9-652b-4c65-85fb-51f4e8f6f18e req-2292b0c6-e50b-4e98-94b2-c5f70c30f6dd service nova] Creating event network-vif-plugged:2c9a10c4-0894-44e5-97cf-4807bf1031a2 for instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 on n-h1-826526-5 Jul 20 04:15:47.969206 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-f6649ae9-652b-4c65-85fb-51f4e8f6f18e req-2292b0c6-e50b-4e98-94b2-c5f70c30f6dd service nova] Creating event network-vif-unplugged:8ea4b8f0-2e09-4c78-bfdc-b37c6369a077 for instance b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 on n-h2-826526-5 Jul 20 04:15:47.996537 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-f6649ae9-652b-4c65-85fb-51f4e8f6f18e req-2292b0c6-e50b-4e98-94b2-c5f70c30f6dd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.088107 Jul 20 04:15:47.999311 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 884/1624] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:48.013721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-65669c51-f184-4315-9313-196d10530f93 req-46b5d4ce-bb61-4282-991d-c24a7de6347c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6fb41c-e1f2-4001-b7cf-f058963d6b29", "tag": "0572c0e0-dc0b-4e7e-95f5-e156f2810ae6"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:48.038349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-4e741cd1-6854-47aa-9117-94672420046e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:15:48.039393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-4e741cd1-6854-47aa-9117-94672420046e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:15:48.040642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-4e741cd1-6854-47aa-9117-94672420046e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:15:48.041167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-4e741cd1-6854-47aa-9117-94672420046e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:15:48.041691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-4e741cd1-6854-47aa-9117-94672420046e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:15:48.056626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:48.070046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e741cd1-6854-47aa-9117-94672420046e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.071810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e741cd1-6854-47aa-9117-94672420046e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.072929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e741cd1-6854-47aa-9117-94672420046e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.074726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e741cd1-6854-47aa-9117-94672420046e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.077657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-65669c51-f184-4315-9313-196d10530f93 req-46b5d4ce-bb61-4282-991d-c24a7de6347c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.079299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-65669c51-f184-4315-9313-196d10530f93 req-46b5d4ce-bb61-4282-991d-c24a7de6347c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.106665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-4e741cd1-6854-47aa-9117-94672420046e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Getting quotas for project 2c925e4a93c3401fa5f4d51e7380b7ad. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:48.106938 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-65669c51-f184-4315-9313-196d10530f93 req-46b5d4ce-bb61-4282-991d-c24a7de6347c service nova] Creating event network-changed:0572c0e0-dc0b-4e7e-95f5-e156f2810ae6 for instance de6fb41c-e1f2-4001-b7cf-f058963d6b29 on n-h1-826526-5 Jul 20 04:15:48.118689 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-4e741cd1-6854-47aa-9117-94672420046e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Getting quotas for user feb531c9e5dd4afd99f2974848a6a75b and project 2c925e4a93c3401fa5f4d51e7380b7ad. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:48.119610 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-65669c51-f184-4315-9313-196d10530f93 req-46b5d4ce-bb61-4282-991d-c24a7de6347c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116292 Jul 20 04:15:48.127935 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 885/1625] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:48.134670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0a147bb3-b908-4e6d-b40a-fae21332832a tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:48.135378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0a147bb3-b908-4e6d-b40a-fae21332832a tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:48.143856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4e741cd1-6854-47aa-9117-94672420046e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:15:48.148087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4e741cd1-6854-47aa-9117-94672420046e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:48.151883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a147bb3-b908-4e6d-b40a-fae21332832a tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.164919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a147bb3-b908-4e6d-b40a-fae21332832a tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.166976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a147bb3-b908-4e6d-b40a-fae21332832a tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.167666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a147bb3-b908-4e6d-b40a-fae21332832a tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.250518 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4e741cd1-6854-47aa-9117-94672420046e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.336825 Jul 20 04:15:48.256970 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 741/1626] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:15:48.262679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a7cc3a81-9dd8-414b-85a0-6d79e1673d0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:48.263299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a7cc3a81-9dd8-414b-85a0-6d79e1673d0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:48.282811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7cc3a81-9dd8-414b-85a0-6d79e1673d0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.283262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7cc3a81-9dd8-414b-85a0-6d79e1673d0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.284064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7cc3a81-9dd8-414b-85a0-6d79e1673d0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.286518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7cc3a81-9dd8-414b-85a0-6d79e1673d0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.903472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a7cc3a81-9dd8-414b-85a0-6d79e1673d0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:48.921137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a7cc3a81-9dd8-414b-85a0-6d79e1673d0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:48.923914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a7cc3a81-9dd8-414b-85a0-6d79e1673d0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:48.925457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0a147bb3-b908-4e6d-b40a-fae21332832a tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:48.931381 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a7cc3a81-9dd8-414b-85a0-6d79e1673d0d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1293 microversion: 2.25 time: 0.673017 Jul 20 04:15:48.932668 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 742/1627] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:48 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1293 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:48.940038 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0a147bb3-b908-4e6d-b40a-fae21332832a tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1334 microversion: 2.1 time: 0.810451 Jul 20 04:15:48.943797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-43fb8fa4-95f4-41e6-b6f5-79776b73d687 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:48.944170 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 886/1628] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:48 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1334 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:48.944483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-43fb8fa4-95f4-41e6-b6f5-79776b73d687 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:48.960974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ba7f56dc-7366-4cdd-b102-94e32d0cd0cc tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:48.961931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ba7f56dc-7366-4cdd-b102-94e32d0cd0cc tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:48.988212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43fb8fa4-95f4-41e6-b6f5-79776b73d687 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.989026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43fb8fa4-95f4-41e6-b6f5-79776b73d687 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.990613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43fb8fa4-95f4-41e6-b6f5-79776b73d687 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.991158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43fb8fa4-95f4-41e6-b6f5-79776b73d687 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:49.118837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ba7f56dc-7366-4cdd-b102-94e32d0cd0cc tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:49.128828 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ba7f56dc-7366-4cdd-b102-94e32d0cd0cc tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1208 microversion: 2.1 time: 0.182766 Jul 20 04:15:49.129768 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 887/1629] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:48 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1208 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:49.161812 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e3a1a722-dd74-4c75-8e24-385ca7198517 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:49.168815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e3a1a722-dd74-4c75-8e24-385ca7198517 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 7662c91d-2965-4c2d-ade7-ec500f555d38] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:49.199680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3a1a722-dd74-4c75-8e24-385ca7198517 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:49.200417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3a1a722-dd74-4c75-8e24-385ca7198517 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:49.211813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3a1a722-dd74-4c75-8e24-385ca7198517 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:49.212789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3a1a722-dd74-4c75-8e24-385ca7198517 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:49.677835 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-43fb8fa4-95f4-41e6-b6f5-79776b73d687 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:49.693201 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-43fb8fa4-95f4-41e6-b6f5-79776b73d687 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f" status: 200 len: 1324 microversion: 2.1 time: 0.759363 Jul 20 04:15:49.694062 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 743/1630] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:48 2022] GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f => generated 1324 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:49.710238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1c90b340-ceb0-41d7-88e0-0abb3fdb32e7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:49.711417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1c90b340-ceb0-41d7-88e0-0abb3fdb32e7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:49.723251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c90b340-ceb0-41d7-88e0-0abb3fdb32e7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:49.729420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c90b340-ceb0-41d7-88e0-0abb3fdb32e7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:49.730737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c90b340-ceb0-41d7-88e0-0abb3fdb32e7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:49.731377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c90b340-ceb0-41d7-88e0-0abb3fdb32e7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:49.821914 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1c90b340-ceb0-41d7-88e0-0abb3fdb32e7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121804 Jul 20 04:15:49.834235 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 744/1631] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:15:49 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:49.917409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e3a1a722-dd74-4c75-8e24-385ca7198517 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:49.934314 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e3a1a722-dd74-4c75-8e24-385ca7198517 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38" status: 200 len: 1317 microversion: 2.1 time: 0.783730 Jul 20 04:15:49.939285 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 888/1632] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:49 2022] GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38 => generated 1317 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:49.954946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c339a1ce-c8cc-4ce0-b3a8-2ad1eb59b3d4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:49.955931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c339a1ce-c8cc-4ce0-b3a8-2ad1eb59b3d4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:49.966763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-668e8fff-b373-4701-82d9-734072979a3b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:49.980113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-668e8fff-b373-4701-82d9-734072979a3b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:49.983688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c339a1ce-c8cc-4ce0-b3a8-2ad1eb59b3d4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:49.986071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c339a1ce-c8cc-4ce0-b3a8-2ad1eb59b3d4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:49.990299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c339a1ce-c8cc-4ce0-b3a8-2ad1eb59b3d4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:49.997311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c339a1ce-c8cc-4ce0-b3a8-2ad1eb59b3d4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.003921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-668e8fff-b373-4701-82d9-734072979a3b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:50.005937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-668e8fff-b373-4701-82d9-734072979a3b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.006956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-668e8fff-b373-4701-82d9-734072979a3b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:50.007407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-668e8fff-b373-4701-82d9-734072979a3b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.551477 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-668e8fff-b373-4701-82d9-734072979a3b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:50.586826 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-668e8fff-b373-4701-82d9-734072979a3b tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1334 microversion: 2.1 time: 0.625365 Jul 20 04:15:50.596886 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 889/1633] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:49 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1334 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:50.600641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d35ddfe7-7ae2-4f7c-956b-06fecd6f5e11 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:50.601768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d35ddfe7-7ae2-4f7c-956b-06fecd6f5e11 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:50.649266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d35ddfe7-7ae2-4f7c-956b-06fecd6f5e11 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:50.662912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d35ddfe7-7ae2-4f7c-956b-06fecd6f5e11 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.666189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d35ddfe7-7ae2-4f7c-956b-06fecd6f5e11 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:50.666676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d35ddfe7-7ae2-4f7c-956b-06fecd6f5e11 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.967097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d35ddfe7-7ae2-4f7c-956b-06fecd6f5e11 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:50.977749 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d35ddfe7-7ae2-4f7c-956b-06fecd6f5e11 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1268 microversion: 2.1 time: 0.385900 Jul 20 04:15:50.989589 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 890/1634] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:50 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1268 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:50.996135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9269b510-bb2e-400a-84b7-fcac599c55da tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:50.997807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9269b510-bb2e-400a-84b7-fcac599c55da tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:51.006634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9269b510-bb2e-400a-84b7-fcac599c55da tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.007559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9269b510-bb2e-400a-84b7-fcac599c55da tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.008767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9269b510-bb2e-400a-84b7-fcac599c55da tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.009624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9269b510-bb2e-400a-84b7-fcac599c55da tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.072143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c339a1ce-c8cc-4ce0-b3a8-2ad1eb59b3d4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:51.103113 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c339a1ce-c8cc-4ce0-b3a8-2ad1eb59b3d4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:51.110234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c339a1ce-c8cc-4ce0-b3a8-2ad1eb59b3d4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:51.112467 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c339a1ce-c8cc-4ce0-b3a8-2ad1eb59b3d4 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1293 microversion: 2.25 time: 1.164158 Jul 20 04:15:51.127392 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 745/1635] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:49 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1293 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:51.147490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-03c00ce3-9d23-48ec-a22a-4885dd50a1f0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:51.151225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-03c00ce3-9d23-48ec-a22a-4885dd50a1f0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:51.165448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03c00ce3-9d23-48ec-a22a-4885dd50a1f0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.166466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03c00ce3-9d23-48ec-a22a-4885dd50a1f0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.169076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03c00ce3-9d23-48ec-a22a-4885dd50a1f0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.170452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03c00ce3-9d23-48ec-a22a-4885dd50a1f0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.269286 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-03c00ce3-9d23-48ec-a22a-4885dd50a1f0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140572 Jul 20 04:15:51.270167 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 746/1636] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:15:51 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:51.287083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-3c0d5223-6db6-4de5-848b-7a9971972587 req-6833a644-5efe-4d49-889f-f1478bfb6649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15", "name": "network-vif-deleted", "tag": "8ea4b8f0-2e09-4c78-bfdc-b37c6369a077"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:51.308947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-3c0d5223-6db6-4de5-848b-7a9971972587 req-6833a644-5efe-4d49-889f-f1478bfb6649 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.309447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-3c0d5223-6db6-4de5-848b-7a9971972587 req-6833a644-5efe-4d49-889f-f1478bfb6649 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.332156 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-3c0d5223-6db6-4de5-848b-7a9971972587 req-6833a644-5efe-4d49-889f-f1478bfb6649 service nova] Creating event network-vif-deleted:8ea4b8f0-2e09-4c78-bfdc-b37c6369a077 for instance b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 on n-h2-826526-5 Jul 20 04:15:51.347502 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-3c0d5223-6db6-4de5-848b-7a9971972587 req-6833a644-5efe-4d49-889f-f1478bfb6649 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076200 Jul 20 04:15:51.348566 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 747/1637] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:51.356598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b025d29f-5c4d-40ec-809c-08026ff93053 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:51.357336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b025d29f-5c4d-40ec-809c-08026ff93053 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 7662c91d-2965-4c2d-ade7-ec500f555d38] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:51.364310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b025d29f-5c4d-40ec-809c-08026ff93053 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.365144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b025d29f-5c4d-40ec-809c-08026ff93053 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.366244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b025d29f-5c4d-40ec-809c-08026ff93053 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.366921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b025d29f-5c4d-40ec-809c-08026ff93053 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.943239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b025d29f-5c4d-40ec-809c-08026ff93053 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:51.956317 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b025d29f-5c4d-40ec-809c-08026ff93053 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38" status: 200 len: 1317 microversion: 2.1 time: 0.604956 Jul 20 04:15:51.957314 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 748/1638] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:51 2022] GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38 => generated 1317 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:51.967535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c5b99cc8-e448-408c-bb25-b79364f3fda1 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:51.970833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c5b99cc8-e448-408c-bb25-b79364f3fda1 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:51.987153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5b99cc8-e448-408c-bb25-b79364f3fda1 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.987564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5b99cc8-e448-408c-bb25-b79364f3fda1 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.988401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5b99cc8-e448-408c-bb25-b79364f3fda1 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.988841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5b99cc8-e448-408c-bb25-b79364f3fda1 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.414891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c5b99cc8-e448-408c-bb25-b79364f3fda1 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:52.428546 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c5b99cc8-e448-408c-bb25-b79364f3fda1 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1669 microversion: 2.1 time: 0.469742 Jul 20 04:15:52.429154 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 749/1639] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:51 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1669 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:52.441234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7d0c0402-a10f-421e-8a1d-bab66882d419 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:52.441861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7d0c0402-a10f-421e-8a1d-bab66882d419 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:52.458032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d0c0402-a10f-421e-8a1d-bab66882d419 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.458516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d0c0402-a10f-421e-8a1d-bab66882d419 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.459356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d0c0402-a10f-421e-8a1d-bab66882d419 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.459797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d0c0402-a10f-421e-8a1d-bab66882d419 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.654108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9269b510-bb2e-400a-84b7-fcac599c55da tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:52.655495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7d0c0402-a10f-421e-8a1d-bab66882d419 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:52.663823 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9269b510-bb2e-400a-84b7-fcac599c55da tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f" status: 200 len: 1324 microversion: 2.1 time: 1.672530 Jul 20 04:15:52.664440 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7d0c0402-a10f-421e-8a1d-bab66882d419 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1266 microversion: 2.1 time: 0.234178 Jul 20 04:15:52.665621 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 750/1640] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:52 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:52.672330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-26e7c854-0f68-4970-947a-6eeedde72d99 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:52.673253 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-26e7c854-0f68-4970-947a-6eeedde72d99 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:52.685623 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 891/1641] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:50 2022] GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f => generated 1324 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:52.685623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-1d1a7439-7146-4305-9821-1a86949864f5 req-2b0bc1f0-e3d4-44d0-8a07-ac21fe3c4460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7662c91d-2965-4c2d-ade7-ec500f555d38", "name": "network-vif-plugged", "status": "completed", "tag": "bc073d80-646b-4c5f-a802-2eb8d71b2add"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:52.690931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26e7c854-0f68-4970-947a-6eeedde72d99 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.691706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26e7c854-0f68-4970-947a-6eeedde72d99 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.693407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26e7c854-0f68-4970-947a-6eeedde72d99 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.694125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26e7c854-0f68-4970-947a-6eeedde72d99 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.720472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1d1a7439-7146-4305-9821-1a86949864f5 req-2b0bc1f0-e3d4-44d0-8a07-ac21fe3c4460 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.721217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1d1a7439-7146-4305-9821-1a86949864f5 req-2b0bc1f0-e3d4-44d0-8a07-ac21fe3c4460 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.744978 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-1d1a7439-7146-4305-9821-1a86949864f5 req-2b0bc1f0-e3d4-44d0-8a07-ac21fe3c4460 service nova] Creating event network-vif-plugged:bc073d80-646b-4c5f-a802-2eb8d71b2add for instance 7662c91d-2965-4c2d-ade7-ec500f555d38 on n-h1-826526-5 Jul 20 04:15:52.751256 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-1d1a7439-7146-4305-9821-1a86949864f5 req-2b0bc1f0-e3d4-44d0-8a07-ac21fe3c4460 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072175 Jul 20 04:15:52.752498 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 892/1642] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:52.758644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c004fd63-7006-4cce-8b26-af46ee121ed0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:52.762827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c004fd63-7006-4cce-8b26-af46ee121ed0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:52.777993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c004fd63-7006-4cce-8b26-af46ee121ed0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.778748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c004fd63-7006-4cce-8b26-af46ee121ed0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.786023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c004fd63-7006-4cce-8b26-af46ee121ed0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.786914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c004fd63-7006-4cce-8b26-af46ee121ed0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.871514 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c004fd63-7006-4cce-8b26-af46ee121ed0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117531 Jul 20 04:15:52.872508 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 893/1643] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:15:52 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:52.888373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4fd83a04-551a-4c03-9e98-eb7b6f4f45b3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:52.888881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4fd83a04-551a-4c03-9e98-eb7b6f4f45b3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:52.895950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4fd83a04-551a-4c03-9e98-eb7b6f4f45b3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.896455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4fd83a04-551a-4c03-9e98-eb7b6f4f45b3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.897360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4fd83a04-551a-4c03-9e98-eb7b6f4f45b3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.897807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4fd83a04-551a-4c03-9e98-eb7b6f4f45b3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.951694 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4fd83a04-551a-4c03-9e98-eb7b6f4f45b3 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83/ips" status: 200 len: 179 microversion: 2.1 time: 0.078425 Jul 20 04:15:52.957873 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 894/1644] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 04:15:52 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83/ips => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:52.969925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-8558fc67-97f2-4dd2-8ee5-34666e1fced2 req-c26cd5ea-327c-40d6-b23f-7d412b2ca061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ae9a8d-371f-4e62-899c-54d3840aa87f", "tag": "d788b629-ae4b-43be-9ccc-1503bc9e05eb"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:53.001276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8558fc67-97f2-4dd2-8ee5-34666e1fced2 req-c26cd5ea-327c-40d6-b23f-7d412b2ca061 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.001767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8558fc67-97f2-4dd2-8ee5-34666e1fced2 req-c26cd5ea-327c-40d6-b23f-7d412b2ca061 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.033267 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-8558fc67-97f2-4dd2-8ee5-34666e1fced2 req-c26cd5ea-327c-40d6-b23f-7d412b2ca061 service nova] Creating event network-changed:d788b629-ae4b-43be-9ccc-1503bc9e05eb for instance b5ae9a8d-371f-4e62-899c-54d3840aa87f on n-h2-826526-5 Jul 20 04:15:53.048715 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-8558fc67-97f2-4dd2-8ee5-34666e1fced2 req-c26cd5ea-327c-40d6-b23f-7d412b2ca061 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087433 Jul 20 04:15:53.050784 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 895/1645] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:53.067401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-abece1f6-d689-41dc-97c6-8d79a8f37a8e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:53.070092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-abece1f6-d689-41dc-97c6-8d79a8f37a8e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:53.088035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abece1f6-d689-41dc-97c6-8d79a8f37a8e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.088644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abece1f6-d689-41dc-97c6-8d79a8f37a8e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.089535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abece1f6-d689-41dc-97c6-8d79a8f37a8e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.090073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abece1f6-d689-41dc-97c6-8d79a8f37a8e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.186874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-abece1f6-d689-41dc-97c6-8d79a8f37a8e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:15:53.333915 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-abece1f6-d689-41dc-97c6-8d79a8f37a8e tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "DELETE /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 204 len: 0 microversion: 2.1 time: 0.279783 Jul 20 04:15:53.335288 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 896/1646] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:15:53 2022] DELETE /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:15:53.350018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3036052d-3bad-425b-b8d4-49c0f94c86ab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:53.352574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3036052d-3bad-425b-b8d4-49c0f94c86ab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 7662c91d-2965-4c2d-ade7-ec500f555d38] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:53.367549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3036052d-3bad-425b-b8d4-49c0f94c86ab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.368336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3036052d-3bad-425b-b8d4-49c0f94c86ab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.370800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3036052d-3bad-425b-b8d4-49c0f94c86ab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.373271 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3036052d-3bad-425b-b8d4-49c0f94c86ab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.517773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-26e7c854-0f68-4970-947a-6eeedde72d99 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:53.539065 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-26e7c854-0f68-4970-947a-6eeedde72d99 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:53.542156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-26e7c854-0f68-4970-947a-6eeedde72d99 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:53.543788 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-26e7c854-0f68-4970-947a-6eeedde72d99 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1293 microversion: 2.25 time: 0.875722 Jul 20 04:15:53.544793 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 751/1647] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:52 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1293 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:53.557399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8406d89d-49e7-4e72-b71f-828f4faf2dd5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:53.558262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8406d89d-49e7-4e72-b71f-828f4faf2dd5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:53.564970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8406d89d-49e7-4e72-b71f-828f4faf2dd5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.565795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8406d89d-49e7-4e72-b71f-828f4faf2dd5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.566842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8406d89d-49e7-4e72-b71f-828f4faf2dd5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.567782 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8406d89d-49e7-4e72-b71f-828f4faf2dd5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.766469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3036052d-3bad-425b-b8d4-49c0f94c86ab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:53.785629 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3036052d-3bad-425b-b8d4-49c0f94c86ab tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38" status: 200 len: 1317 microversion: 2.1 time: 0.446017 Jul 20 04:15:53.786512 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 897/1648] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:53 2022] GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38 => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:53.827325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-404edc42-68fc-4ed7-a61f-55cd6cd1a89a tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:53.829128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-404edc42-68fc-4ed7-a61f-55cd6cd1a89a tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:53.846129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-404edc42-68fc-4ed7-a61f-55cd6cd1a89a tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.846591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-404edc42-68fc-4ed7-a61f-55cd6cd1a89a tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.847510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-404edc42-68fc-4ed7-a61f-55cd6cd1a89a tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.847962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-404edc42-68fc-4ed7-a61f-55cd6cd1a89a tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:54.014244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-404edc42-68fc-4ed7-a61f-55cd6cd1a89a tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:54.027735 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-404edc42-68fc-4ed7-a61f-55cd6cd1a89a tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1266 microversion: 2.1 time: 0.220543 Jul 20 04:15:54.028697 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 898/1649] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:53 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:54.042537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d8e7f256-5c0f-4016-a940-c702760f4fab tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:54.043158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d8e7f256-5c0f-4016-a940-c702760f4fab tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:54.059877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8e7f256-5c0f-4016-a940-c702760f4fab tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:54.060157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8e7f256-5c0f-4016-a940-c702760f4fab tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:54.066859 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8e7f256-5c0f-4016-a940-c702760f4fab tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:54.067688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8e7f256-5c0f-4016-a940-c702760f4fab tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:54.084868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:54.243418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8406d89d-49e7-4e72-b71f-828f4faf2dd5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:54.256608 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8406d89d-49e7-4e72-b71f-828f4faf2dd5 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1675 microversion: 2.1 time: 0.710181 Jul 20 04:15:54.257284 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 752/1650] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:53 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1675 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:54.268560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1a919e0f-eddb-4150-b4da-c224b6119cce tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:54.273736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1a919e0f-eddb-4150-b4da-c224b6119cce tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:54.282772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1a919e0f-eddb-4150-b4da-c224b6119cce tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:54.283337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1a919e0f-eddb-4150-b4da-c224b6119cce tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:54.284538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1a919e0f-eddb-4150-b4da-c224b6119cce tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:54.285047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1a919e0f-eddb-4150-b4da-c224b6119cce tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:54.384161 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1a919e0f-eddb-4150-b4da-c224b6119cce tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.125128 Jul 20 04:15:54.385808 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 753/1651] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:15:54 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:15:54.563169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-85546e0b-e5f8-4269-a68e-67d0b7d4b9e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:54.563854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-85546e0b-e5f8-4269-a68e-67d0b7d4b9e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:54.586493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85546e0b-e5f8-4269-a68e-67d0b7d4b9e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:54.590224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85546e0b-e5f8-4269-a68e-67d0b7d4b9e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:54.591297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85546e0b-e5f8-4269-a68e-67d0b7d4b9e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:54.596388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85546e0b-e5f8-4269-a68e-67d0b7d4b9e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:54.644815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:55.058079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d8e7f256-5c0f-4016-a940-c702760f4fab tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:55.078011 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d8e7f256-5c0f-4016-a940-c702760f4fab tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f" status: 200 len: 1324 microversion: 2.1 time: 1.048186 Jul 20 04:15:55.088658 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 899/1652] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:54 2022] GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f => generated 1324 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:55.095308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-24999d2a-0ef4-42b3-a094-28cfff8ce5f5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:55.096180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-24999d2a-0ef4-42b3-a094-28cfff8ce5f5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 7662c91d-2965-4c2d-ade7-ec500f555d38] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:55.122762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24999d2a-0ef4-42b3-a094-28cfff8ce5f5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.123424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24999d2a-0ef4-42b3-a094-28cfff8ce5f5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.124414 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24999d2a-0ef4-42b3-a094-28cfff8ce5f5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.125015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24999d2a-0ef4-42b3-a094-28cfff8ce5f5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.260291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-85546e0b-e5f8-4269-a68e-67d0b7d4b9e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:55.269754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-85546e0b-e5f8-4269-a68e-67d0b7d4b9e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:55.271261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-85546e0b-e5f8-4269-a68e-67d0b7d4b9e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:55.282521 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-85546e0b-e5f8-4269-a68e-67d0b7d4b9e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1293 microversion: 2.25 time: 0.723804 Jul 20 04:15:55.286443 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 754/1653] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:54 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1293 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:55.298038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-13e0b238-292a-42cd-b888-04f9dafb30bd tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:55.302084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-13e0b238-292a-42cd-b888-04f9dafb30bd tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:55.326570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13e0b238-292a-42cd-b888-04f9dafb30bd tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.333893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13e0b238-292a-42cd-b888-04f9dafb30bd tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.334982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13e0b238-292a-42cd-b888-04f9dafb30bd tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.337631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13e0b238-292a-42cd-b888-04f9dafb30bd tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.814183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-13e0b238-292a-42cd-b888-04f9dafb30bd tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:55.828233 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-13e0b238-292a-42cd-b888-04f9dafb30bd tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1308 microversion: 2.1 time: 0.540064 Jul 20 04:15:55.831741 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 755/1654] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:55 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1308 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:55.841482 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b75e05c7-89d6-4ab0-98b5-06d378efe12c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:55.841482 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b75e05c7-89d6-4ab0-98b5-06d378efe12c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:55.860124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b75e05c7-89d6-4ab0-98b5-06d378efe12c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.860599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b75e05c7-89d6-4ab0-98b5-06d378efe12c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.861382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b75e05c7-89d6-4ab0-98b5-06d378efe12c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.861817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b75e05c7-89d6-4ab0-98b5-06d378efe12c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.965044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-24999d2a-0ef4-42b3-a094-28cfff8ce5f5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:55.983383 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-24999d2a-0ef4-42b3-a094-28cfff8ce5f5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38" status: 200 len: 1317 microversion: 2.1 time: 0.893401 Jul 20 04:15:55.986360 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 900/1655] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:55 2022] GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38 => generated 1317 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:56.096924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6ac097f9-379e-4f4a-8ced-262d865d71b9 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:56.097833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6ac097f9-379e-4f4a-8ced-262d865d71b9 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:56.118717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ac097f9-379e-4f4a-8ced-262d865d71b9 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:56.121666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ac097f9-379e-4f4a-8ced-262d865d71b9 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:56.124511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ac097f9-379e-4f4a-8ced-262d865d71b9 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:56.125236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ac097f9-379e-4f4a-8ced-262d865d71b9 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:56.332946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b75e05c7-89d6-4ab0-98b5-06d378efe12c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:56.346975 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b75e05c7-89d6-4ab0-98b5-06d378efe12c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1675 microversion: 2.1 time: 0.513764 Jul 20 04:15:56.352585 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 756/1656] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:55 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1675 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:56.362878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f55234da-1604-45bc-b336-bed1ee6e3b2f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:56.364072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f55234da-1604-45bc-b336-bed1ee6e3b2f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:56.378465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f55234da-1604-45bc-b336-bed1ee6e3b2f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:56.378923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f55234da-1604-45bc-b336-bed1ee6e3b2f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:56.383776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f55234da-1604-45bc-b336-bed1ee6e3b2f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:56.384762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f55234da-1604-45bc-b336-bed1ee6e3b2f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:57.249277 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f55234da-1604-45bc-b336-bed1ee6e3b2f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:57.298414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f55234da-1604-45bc-b336-bed1ee6e3b2f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:57.304833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f55234da-1604-45bc-b336-bed1ee6e3b2f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:57.306776 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f55234da-1604-45bc-b336-bed1ee6e3b2f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1293 microversion: 2.25 time: 0.952756 Jul 20 04:15:57.308683 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 757/1657] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:56 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1293 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:57.316086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d60e191a-7d53-494f-b67f-0c19c56642ac tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:57.317255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d60e191a-7d53-494f-b67f-0c19c56642ac tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:57.327245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d60e191a-7d53-494f-b67f-0c19c56642ac tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:57.328135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d60e191a-7d53-494f-b67f-0c19c56642ac tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:57.329379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d60e191a-7d53-494f-b67f-0c19c56642ac tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:57.330222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d60e191a-7d53-494f-b67f-0c19c56642ac tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:57.848954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6ac097f9-379e-4f4a-8ced-262d865d71b9 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:57.864996 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6ac097f9-379e-4f4a-8ced-262d865d71b9 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f" status: 200 len: 1324 microversion: 2.1 time: 1.772384 Jul 20 04:15:57.866040 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 901/1658] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:56 2022] GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f => generated 1324 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:57.876487 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-848682d7-adcb-48fc-9fe5-3cc94c6dd035 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:57.877084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-848682d7-adcb-48fc-9fe5-3cc94c6dd035 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 7662c91d-2965-4c2d-ade7-ec500f555d38] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:57.904523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-848682d7-adcb-48fc-9fe5-3cc94c6dd035 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:57.904978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-848682d7-adcb-48fc-9fe5-3cc94c6dd035 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:57.910935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-848682d7-adcb-48fc-9fe5-3cc94c6dd035 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:57.911402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-848682d7-adcb-48fc-9fe5-3cc94c6dd035 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:57.979652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d60e191a-7d53-494f-b67f-0c19c56642ac tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:57.997129 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d60e191a-7d53-494f-b67f-0c19c56642ac tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1308 microversion: 2.1 time: 0.687012 Jul 20 04:15:57.997754 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 758/1659] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:57 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1308 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:58.003254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ff6a0851-428c-491b-8fbe-39d289be6b4d tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:58.003471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ff6a0851-428c-491b-8fbe-39d289be6b4d tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:58.053141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff6a0851-428c-491b-8fbe-39d289be6b4d tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:58.053657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff6a0851-428c-491b-8fbe-39d289be6b4d tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:58.054509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff6a0851-428c-491b-8fbe-39d289be6b4d tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:58.061414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff6a0851-428c-491b-8fbe-39d289be6b4d tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:58.095245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:58.133100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=12 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:58.925667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ff6a0851-428c-491b-8fbe-39d289be6b4d tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:58.947631 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ff6a0851-428c-491b-8fbe-39d289be6b4d tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1654 microversion: 2.1 time: 0.942553 Jul 20 04:15:58.949244 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 759/1660] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:57 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1654 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:58.954749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-4039fcdd-f1a8-4e24-8f0f-da58737951ea req-fb2898ee-a154-4916-8175-7c214bf77f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a56f06-9dcb-4146-b21c-ffd422f03c83", "name": "network-vif-deleted", "tag": "2c9a10c4-0894-44e5-97cf-4807bf1031a2"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:58.984535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4039fcdd-f1a8-4e24-8f0f-da58737951ea req-fb2898ee-a154-4916-8175-7c214bf77f21 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:58.985172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4039fcdd-f1a8-4e24-8f0f-da58737951ea req-fb2898ee-a154-4916-8175-7c214bf77f21 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.024699 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-4039fcdd-f1a8-4e24-8f0f-da58737951ea req-fb2898ee-a154-4916-8175-7c214bf77f21 service nova] Creating event network-vif-deleted:2c9a10c4-0894-44e5-97cf-4807bf1031a2 for instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 on n-h1-826526-5 Jul 20 04:15:59.038097 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-4039fcdd-f1a8-4e24-8f0f-da58737951ea req-fb2898ee-a154-4916-8175-7c214bf77f21 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087175 Jul 20 04:15:59.039169 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 760/1661] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:59.057860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-0b8d4fa8-d391-4c43-9995-370d93425768 req-3e8a3b42-e253-47fe-bbfc-350ea5fb4df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2976722a-674d-49e5-b4e3-3aebf11d51c5", "tag": "a90d62a0-b1f9-47e0-a6cd-97d4474f8e74"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:59.078813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0b8d4fa8-d391-4c43-9995-370d93425768 req-3e8a3b42-e253-47fe-bbfc-350ea5fb4df4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.079472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0b8d4fa8-d391-4c43-9995-370d93425768 req-3e8a3b42-e253-47fe-bbfc-350ea5fb4df4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.108806 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-0b8d4fa8-d391-4c43-9995-370d93425768 req-3e8a3b42-e253-47fe-bbfc-350ea5fb4df4 service nova] Creating event network-changed:a90d62a0-b1f9-47e0-a6cd-97d4474f8e74 for instance 2976722a-674d-49e5-b4e3-3aebf11d51c5 on n-h1-826526-5 Jul 20 04:15:59.111001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-848682d7-adcb-48fc-9fe5-3cc94c6dd035 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:59.122353 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-0b8d4fa8-d391-4c43-9995-370d93425768 req-3e8a3b42-e253-47fe-bbfc-350ea5fb4df4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080767 Jul 20 04:15:59.122995 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 761/1662] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:59.130922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:59.139147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-cbc89ba5-32bf-4b0a-9302-9ce42764dcd8 req-2993144b-50dc-4d11-85b8-1aebd646769c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6fb41c-e1f2-4001-b7cf-f058963d6b29", "name": "network-vif-plugged", "status": "completed", "tag": "0572c0e0-dc0b-4e7e-95f5-e156f2810ae6"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:59.149109 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-848682d7-adcb-48fc-9fe5-3cc94c6dd035 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38" status: 200 len: 1506 microversion: 2.1 time: 1.281424 Jul 20 04:15:59.151901 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 902/1663] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:57 2022] GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38 => generated 1506 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:59.159115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dbec6db8-8af8-4896-ab32-07bd41dc082e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:59.160066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dbec6db8-8af8-4896-ab32-07bd41dc082e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:59.203598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-cbc89ba5-32bf-4b0a-9302-9ce42764dcd8 req-2993144b-50dc-4d11-85b8-1aebd646769c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.213653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbec6db8-8af8-4896-ab32-07bd41dc082e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.214650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-cbc89ba5-32bf-4b0a-9302-9ce42764dcd8 req-2993144b-50dc-4d11-85b8-1aebd646769c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.216963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbec6db8-8af8-4896-ab32-07bd41dc082e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.220897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbec6db8-8af8-4896-ab32-07bd41dc082e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.223581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbec6db8-8af8-4896-ab32-07bd41dc082e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.278848 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-cbc89ba5-32bf-4b0a-9302-9ce42764dcd8 req-2993144b-50dc-4d11-85b8-1aebd646769c service nova] Creating event network-vif-plugged:0572c0e0-dc0b-4e7e-95f5-e156f2810ae6 for instance de6fb41c-e1f2-4001-b7cf-f058963d6b29 on n-h1-826526-5 Jul 20 04:15:59.296023 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-cbc89ba5-32bf-4b0a-9302-9ce42764dcd8 req-2993144b-50dc-4d11-85b8-1aebd646769c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170465 Jul 20 04:15:59.300537 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 762/1664] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:59.316421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2bbc1bb4-037a-4897-b7d2-86638346db04 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:59.318221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2bbc1bb4-037a-4897-b7d2-86638346db04 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:59.342937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bbc1bb4-037a-4897-b7d2-86638346db04 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.350344 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bbc1bb4-037a-4897-b7d2-86638346db04 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.358191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bbc1bb4-037a-4897-b7d2-86638346db04 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.360447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bbc1bb4-037a-4897-b7d2-86638346db04 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.842039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dbec6db8-8af8-4896-ab32-07bd41dc082e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:59.863667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dbec6db8-8af8-4896-ab32-07bd41dc082e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:59.866738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dbec6db8-8af8-4896-ab32-07bd41dc082e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:59.888159 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dbec6db8-8af8-4896-ab32-07bd41dc082e tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1281 microversion: 2.25 time: 0.734501 Jul 20 04:15:59.891012 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 903/1665] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:59 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1281 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:59.900706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-652dccef-1cd3-4603-94ff-9811edd65345 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:59.902343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-652dccef-1cd3-4603-94ff-9811edd65345 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:59.918673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-652dccef-1cd3-4603-94ff-9811edd65345 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.920223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-652dccef-1cd3-4603-94ff-9811edd65345 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.922276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2bbc1bb4-037a-4897-b7d2-86638346db04 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:59.923661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-652dccef-1cd3-4603-94ff-9811edd65345 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.924757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-652dccef-1cd3-4603-94ff-9811edd65345 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.933227 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2bbc1bb4-037a-4897-b7d2-86638346db04 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f" status: 200 len: 1324 microversion: 2.1 time: 0.630891 Jul 20 04:15:59.945804 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 763/1666] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:59 2022] GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f => generated 1324 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:59.951386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b433b2ac-a79f-454c-bb71-1b9ef1700667 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:59.952435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b433b2ac-a79f-454c-bb71-1b9ef1700667 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: de6fb41c-e1f2-4001-b7cf-f058963d6b29] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:59.959332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b433b2ac-a79f-454c-bb71-1b9ef1700667 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.961698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b433b2ac-a79f-454c-bb71-1b9ef1700667 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.962534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b433b2ac-a79f-454c-bb71-1b9ef1700667 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.963063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b433b2ac-a79f-454c-bb71-1b9ef1700667 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.308179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b433b2ac-a79f-454c-bb71-1b9ef1700667 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:00.322993 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b433b2ac-a79f-454c-bb71-1b9ef1700667 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/de6fb41c-e1f2-4001-b7cf-f058963d6b29" status: 200 len: 1317 microversion: 2.1 time: 0.375380 Jul 20 04:16:00.323913 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 764/1667] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:59 2022] GET /compute/v2.1/servers/de6fb41c-e1f2-4001-b7cf-f058963d6b29 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:00.332474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-032d9174-9f3b-400d-8302-e74cbfc6f4db tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:00.334989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-032d9174-9f3b-400d-8302-e74cbfc6f4db tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:00.349229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-032d9174-9f3b-400d-8302-e74cbfc6f4db tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.352099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-032d9174-9f3b-400d-8302-e74cbfc6f4db tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.353285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-032d9174-9f3b-400d-8302-e74cbfc6f4db tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.357857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-032d9174-9f3b-400d-8302-e74cbfc6f4db tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.474824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-652dccef-1cd3-4603-94ff-9811edd65345 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:00.484970 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-652dccef-1cd3-4603-94ff-9811edd65345 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1308 microversion: 2.1 time: 0.591130 Jul 20 04:16:00.501187 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 904/1668] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:59 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1308 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:00.545249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-032d9174-9f3b-400d-8302-e74cbfc6f4db tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dff4ba44a4944f1b5955fb0bd9ba3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f3b1899ec467a890b78a5db571f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:00.559670 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-032d9174-9f3b-400d-8302-e74cbfc6f4db tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 200 len: 1454 microversion: 2.1 time: 0.234451 Jul 20 04:16:00.560911 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 765/1669] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:00 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 1454 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:00.918452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-25f7ec85-4321-4903-a2dc-6f772472f97b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:00.919213 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-25f7ec85-4321-4903-a2dc-6f772472f97b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:00.941477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25f7ec85-4321-4903-a2dc-6f772472f97b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.942096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25f7ec85-4321-4903-a2dc-6f772472f97b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.942955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25f7ec85-4321-4903-a2dc-6f772472f97b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.953920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25f7ec85-4321-4903-a2dc-6f772472f97b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.038991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-51f85a5d-6404-44f5-85bd-9c3f016e6964 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Action: 'create', calling method: .version_select at 0x7f06bdd92ca0>, body: {"keypair": {"name": "tempest-keypair-95203804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmrVctphz/FsMYF7S1OaOVfv6F6wWy5c6HJid6p1lP01hy2WZzCkPWBL8gOLP5ZGZlYeKX3VMqZnbGbm/DHoS4roylHi/hp6jWHP6B+Cz7V0ncr10HPCvND22b9Xg2Cgg=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:01.096665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-51f85a5d-6404-44f5-85bd-9c3f016e6964 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Getting quotas for project 5ac9884530484da7acd3b52a3e9567d5. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:01.108580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-51f85a5d-6404-44f5-85bd-9c3f016e6964 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Getting quotas for user 317e1c9f0eda4534aab1e18a72e7540a and project 5ac9884530484da7acd3b52a3e9567d5. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:01.185491 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-51f85a5d-6404-44f5-85bd-9c3f016e6964 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.503186 Jul 20 04:16:01.186762 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 905/1670] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:16:00 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:16:01.197071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a76091b8-beb4-438f-b3d6-49bbc4b73339 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:01.199195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a76091b8-beb4-438f-b3d6-49bbc4b73339 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:01.214846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a76091b8-beb4-438f-b3d6-49bbc4b73339 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.216306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a76091b8-beb4-438f-b3d6-49bbc4b73339 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.219730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a76091b8-beb4-438f-b3d6-49bbc4b73339 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.220468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a76091b8-beb4-438f-b3d6-49bbc4b73339 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.476120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a76091b8-beb4-438f-b3d6-49bbc4b73339 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:01.490425 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a76091b8-beb4-438f-b3d6-49bbc4b73339 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f" status: 200 len: 1324 microversion: 2.1 time: 0.302251 Jul 20 04:16:01.491025 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 906/1671] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:01 2022] GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f => generated 1324 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:01.499480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-edccd09b-86e0-4eb1-823b-b39ea43c7ef5 req-a82a8047-bc02-48e0-84a2-346755ba6c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a56f06-9dcb-4146-b21c-ffd422f03c83", "name": "network-vif-deleted", "tag": "978c8640-62a1-4db3-b6be-4939f52018ea"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:01.528521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-edccd09b-86e0-4eb1-823b-b39ea43c7ef5 req-a82a8047-bc02-48e0-84a2-346755ba6c8a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.529017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-edccd09b-86e0-4eb1-823b-b39ea43c7ef5 req-a82a8047-bc02-48e0-84a2-346755ba6c8a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.569248 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-edccd09b-86e0-4eb1-823b-b39ea43c7ef5 req-a82a8047-bc02-48e0-84a2-346755ba6c8a service nova] Creating event network-vif-deleted:978c8640-62a1-4db3-b6be-4939f52018ea for instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 on n-h1-826526-5 Jul 20 04:16:01.605510 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-edccd09b-86e0-4eb1-823b-b39ea43c7ef5 req-a82a8047-bc02-48e0-84a2-346755ba6c8a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112006 Jul 20 04:16:01.611000 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 907/1672] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:01.647016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-05fc00e6-dab7-4528-a038-504592002f2f req-371c2b39-0d52-4b5c-bc78-de0b7ea2ea8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a56f06-9dcb-4146-b21c-ffd422f03c83", "name": "network-vif-unplugged", "status": "completed", "tag": "978c8640-62a1-4db3-b6be-4939f52018ea"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:01.681081 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-05fc00e6-dab7-4528-a038-504592002f2f req-371c2b39-0d52-4b5c-bc78-de0b7ea2ea8b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.683906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-05fc00e6-dab7-4528-a038-504592002f2f req-371c2b39-0d52-4b5c-bc78-de0b7ea2ea8b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.779608 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-05fc00e6-dab7-4528-a038-504592002f2f req-371c2b39-0d52-4b5c-bc78-de0b7ea2ea8b service nova] Creating event network-vif-unplugged:978c8640-62a1-4db3-b6be-4939f52018ea for instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 on n-h1-826526-5 Jul 20 04:16:01.820722 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-05fc00e6-dab7-4528-a038-504592002f2f req-371c2b39-0d52-4b5c-bc78-de0b7ea2ea8b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.204818 Jul 20 04:16:01.827877 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 908/1673] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:01.849926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e3ca185a-abb6-4746-bc92-0fd0f8bb98ee tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:01.854625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e3ca185a-abb6-4746-bc92-0fd0f8bb98ee tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: de6fb41c-e1f2-4001-b7cf-f058963d6b29] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:01.873241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3ca185a-abb6-4746-bc92-0fd0f8bb98ee tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.877396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3ca185a-abb6-4746-bc92-0fd0f8bb98ee tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.878662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3ca185a-abb6-4746-bc92-0fd0f8bb98ee tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.879124 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3ca185a-abb6-4746-bc92-0fd0f8bb98ee tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.934962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-25f7ec85-4321-4903-a2dc-6f772472f97b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:01.948481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-25f7ec85-4321-4903-a2dc-6f772472f97b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:01.954994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-25f7ec85-4321-4903-a2dc-6f772472f97b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:01.959985 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-25f7ec85-4321-4903-a2dc-6f772472f97b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1281 microversion: 2.25 time: 1.051679 Jul 20 04:16:01.975748 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 766/1674] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:00 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1281 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:16:01.983506 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-256ab807-7674-4e96-8e0e-dd9ef86037d2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:01.990685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-256ab807-7674-4e96-8e0e-dd9ef86037d2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:02.002384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-256ab807-7674-4e96-8e0e-dd9ef86037d2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.005115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-256ab807-7674-4e96-8e0e-dd9ef86037d2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.008181 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-256ab807-7674-4e96-8e0e-dd9ef86037d2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.012823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-256ab807-7674-4e96-8e0e-dd9ef86037d2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.310046 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e3ca185a-abb6-4746-bc92-0fd0f8bb98ee tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:02.323788 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e3ca185a-abb6-4746-bc92-0fd0f8bb98ee tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/de6fb41c-e1f2-4001-b7cf-f058963d6b29" status: 200 len: 1317 microversion: 2.1 time: 0.490312 Jul 20 04:16:02.328155 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 909/1675] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:01 2022] GET /compute/v2.1/servers/de6fb41c-e1f2-4001-b7cf-f058963d6b29 => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:02.334378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c9486b7-11e8-4ee0-ab36-33ba4e4b3e42 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:02.335869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0c9486b7-11e8-4ee0-ab36-33ba4e4b3e42 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:02.346736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c9486b7-11e8-4ee0-ab36-33ba4e4b3e42 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.348030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c9486b7-11e8-4ee0-ab36-33ba4e4b3e42 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.349836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c9486b7-11e8-4ee0-ab36-33ba4e4b3e42 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.350925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c9486b7-11e8-4ee0-ab36-33ba4e4b3e42 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.379497 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-0c9486b7-11e8-4ee0-ab36-33ba4e4b3e42 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] HTTP exception thrown: Instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 could not be found. Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c9486b7-11e8-4ee0-ab36-33ba4e4b3e42 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Request method failure captured: Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 HTTP/1.1 Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14D6E-QhrjgtOW87yCf7R-_R3mQSPJQf-VvmnlT2zUedB2ynysqxBhsiWbMlm1qhE5_CEpDG1ZR2sI_o2GOLUURYZVf9kt7XZNjc_iTHaEPLLQvlAhw8_I4qXi1jP3CB5KvKMxQYX4cO5Vmge1nCHMjfIdBuvwPDvgkNdYmF0052k1Q Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 0c6f3b1899ec467a890b78a5db571f83 Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestMultiNic-1985676234 Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:16:02.383566 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:16:02.386448 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c6f3b1899ec467a890b78a5db571f83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0c6f3b1899ec467a890b78a5db571f83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0c6f3b1899ec467a890b78a5db571f83", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c6f3b1899ec467a890b78a5db571f83"}]}] Jul 20 04:16:02.386448 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestMultiNic-1985676234 Jul 20 04:16:02.386448 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 0c6f3b1899ec467a890b78a5db571f83 Jul 20 04:16:02.386448 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestMultiNic-1985676234 Jul 20 04:16:02.386448 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestMultiNic-1985676234-project Jul 20 04:16:02.386448 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:16:02.386448 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:16:02.386448 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 5dff4ba44a4944f1b5955fb0bd9ba3bc Jul 20 04:16:02.386448 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestMultiNic-1985676234-project Jul 20 04:16:02.386448 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:16:02.386448 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 could not be found. Jul 20 04:16:02.386448 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '05a56f06-9dcb-4146-b21c-ffd422f03c83'} Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 could not be found. Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:02.387569 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:02.390744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:02.390744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:16:02.390744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:16:02.390744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:02.390744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:02.390744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:02.390744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:02.390744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 could not be found. Jul 20 04:16:02.390744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:02.390744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:02.390744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:02.390744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:02.390744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:02.390744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:02.390744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:02.390744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:02.390744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 could not be found. Jul 20 04:16:02.390744 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:02.399067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c9486b7-11e8-4ee0-ab36-33ba4e4b3e42 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Returning 404 to user: Instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:02.399869 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0c9486b7-11e8-4ee0-ab36-33ba4e4b3e42 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 404 len: 111 microversion: 2.1 time: 0.069958 Jul 20 04:16:02.404999 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 910/1676] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:02 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:02.514209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-07c30437-c0cd-4c92-90bd-9ad58bec0d0d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:02.517761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-07c30437-c0cd-4c92-90bd-9ad58bec0d0d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:02.538590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07c30437-c0cd-4c92-90bd-9ad58bec0d0d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.539252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07c30437-c0cd-4c92-90bd-9ad58bec0d0d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.551058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07c30437-c0cd-4c92-90bd-9ad58bec0d0d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.551720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07c30437-c0cd-4c92-90bd-9ad58bec0d0d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.908412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-256ab807-7674-4e96-8e0e-dd9ef86037d2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:02.951516 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-256ab807-7674-4e96-8e0e-dd9ef86037d2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1308 microversion: 2.1 time: 0.960357 Jul 20 04:16:02.954637 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 767/1677] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:01 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1308 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:02.984870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a5e82bfd-66ab-42e8-964c-64052a45e25a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:02.985804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a5e82bfd-66ab-42e8-964c-64052a45e25a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:03.004303 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5e82bfd-66ab-42e8-964c-64052a45e25a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:03.005261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5e82bfd-66ab-42e8-964c-64052a45e25a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:03.006380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5e82bfd-66ab-42e8-964c-64052a45e25a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:03.007009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5e82bfd-66ab-42e8-964c-64052a45e25a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:03.045096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-07c30437-c0cd-4c92-90bd-9ad58bec0d0d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:03.079515 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-07c30437-c0cd-4c92-90bd-9ad58bec0d0d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f" status: 200 len: 1324 microversion: 2.1 time: 0.574348 Jul 20 04:16:03.086020 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 911/1678] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:02 2022] GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f => generated 1324 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:03.351731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ec468525-80bf-4376-8a6f-758f3fdd0bf1 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:03.353408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ec468525-80bf-4376-8a6f-758f3fdd0bf1 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: de6fb41c-e1f2-4001-b7cf-f058963d6b29] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:03.373271 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec468525-80bf-4376-8a6f-758f3fdd0bf1 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:03.376237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec468525-80bf-4376-8a6f-758f3fdd0bf1 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:03.379353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec468525-80bf-4376-8a6f-758f3fdd0bf1 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:03.380752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec468525-80bf-4376-8a6f-758f3fdd0bf1 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:03.557843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a5e82bfd-66ab-42e8-964c-64052a45e25a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:03.574963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a5e82bfd-66ab-42e8-964c-64052a45e25a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:03.583132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a5e82bfd-66ab-42e8-964c-64052a45e25a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:03.584672 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a5e82bfd-66ab-42e8-964c-64052a45e25a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1281 microversion: 2.25 time: 0.604761 Jul 20 04:16:03.590223 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 768/1679] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:02 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1281 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:03.841268 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-045ac5ff-9a2a-4218-ac50-0d64d6fdc8bc req-a2a5db26-a2ed-4640-a99b-87b70b6f0470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ae9a8d-371f-4e62-899c-54d3840aa87f", "name": "network-vif-plugged", "status": "completed", "tag": "d788b629-ae4b-43be-9ccc-1503bc9e05eb"}, {"server_uuid": "2976722a-674d-49e5-b4e3-3aebf11d51c5", "name": "network-vif-plugged", "status": "completed", "tag": "a90d62a0-b1f9-47e0-a6cd-97d4474f8e74"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:03.861648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-045ac5ff-9a2a-4218-ac50-0d64d6fdc8bc req-a2a5db26-a2ed-4640-a99b-87b70b6f0470 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:03.866709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-045ac5ff-9a2a-4218-ac50-0d64d6fdc8bc req-a2a5db26-a2ed-4640-a99b-87b70b6f0470 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:03.893212 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-045ac5ff-9a2a-4218-ac50-0d64d6fdc8bc req-a2a5db26-a2ed-4640-a99b-87b70b6f0470 service nova] Creating event network-vif-plugged:d788b629-ae4b-43be-9ccc-1503bc9e05eb for instance b5ae9a8d-371f-4e62-899c-54d3840aa87f on n-h2-826526-5 Jul 20 04:16:03.895934 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-045ac5ff-9a2a-4218-ac50-0d64d6fdc8bc req-a2a5db26-a2ed-4640-a99b-87b70b6f0470 service nova] Creating event network-vif-plugged:a90d62a0-b1f9-47e0-a6cd-97d4474f8e74 for instance 2976722a-674d-49e5-b4e3-3aebf11d51c5 on n-h1-826526-5 Jul 20 04:16:03.940446 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-045ac5ff-9a2a-4218-ac50-0d64d6fdc8bc req-a2a5db26-a2ed-4640-a99b-87b70b6f0470 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.104861 Jul 20 04:16:03.953493 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 769/1680] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:03.972980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a64bb32b-e74e-475d-bbf9-214d9f1a7cf5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:03.974736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a64bb32b-e74e-475d-bbf9-214d9f1a7cf5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:04.004556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a64bb32b-e74e-475d-bbf9-214d9f1a7cf5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.005022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a64bb32b-e74e-475d-bbf9-214d9f1a7cf5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.005997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a64bb32b-e74e-475d-bbf9-214d9f1a7cf5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.007644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a64bb32b-e74e-475d-bbf9-214d9f1a7cf5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.226779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ec468525-80bf-4376-8a6f-758f3fdd0bf1 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:04.257756 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ec468525-80bf-4376-8a6f-758f3fdd0bf1 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/de6fb41c-e1f2-4001-b7cf-f058963d6b29" status: 200 len: 1505 microversion: 2.1 time: 0.910383 Jul 20 04:16:04.260930 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 912/1681] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:03 2022] GET /compute/v2.1/servers/de6fb41c-e1f2-4001-b7cf-f058963d6b29 => generated 1505 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:04.283641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d8dfd697-6640-46bf-97b8-3b1e3e023044 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:04.285922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d8dfd697-6640-46bf-97b8-3b1e3e023044 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:04.335499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8dfd697-6640-46bf-97b8-3b1e3e023044 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.338197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8dfd697-6640-46bf-97b8-3b1e3e023044 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.340232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8dfd697-6640-46bf-97b8-3b1e3e023044 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.342793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8dfd697-6640-46bf-97b8-3b1e3e023044 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.720134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a64bb32b-e74e-475d-bbf9-214d9f1a7cf5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:04.734124 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a64bb32b-e74e-475d-bbf9-214d9f1a7cf5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1308 microversion: 2.1 time: 0.766546 Jul 20 04:16:04.736798 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 770/1682] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:03 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1308 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:04.751542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94a8ce1a-d57d-4ca6-b55d-7631e5cad4a8 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:04.752349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-94a8ce1a-d57d-4ca6-b55d-7631e5cad4a8 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: de6fb41c-e1f2-4001-b7cf-f058963d6b29] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:04.767700 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94a8ce1a-d57d-4ca6-b55d-7631e5cad4a8 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.781563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94a8ce1a-d57d-4ca6-b55d-7631e5cad4a8 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.782441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94a8ce1a-d57d-4ca6-b55d-7631e5cad4a8 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.782885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94a8ce1a-d57d-4ca6-b55d-7631e5cad4a8 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.861020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-94a8ce1a-d57d-4ca6-b55d-7631e5cad4a8 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: de6fb41c-e1f2-4001-b7cf-f058963d6b29] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:04.982584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:05.051070 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-94a8ce1a-d57d-4ca6-b55d-7631e5cad4a8 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "DELETE /compute/v2.1/servers/de6fb41c-e1f2-4001-b7cf-f058963d6b29" status: 204 len: 0 microversion: 2.1 time: 0.312614 Jul 20 04:16:05.067793 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 771/1683] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:04 2022] DELETE /compute/v2.1/servers/de6fb41c-e1f2-4001-b7cf-f058963d6b29 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:05.073844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-89b59ecd-10cc-4c0e-adf7-0e1210b581bc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:05.077457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-89b59ecd-10cc-4c0e-adf7-0e1210b581bc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:05.091036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89b59ecd-10cc-4c0e-adf7-0e1210b581bc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.101143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89b59ecd-10cc-4c0e-adf7-0e1210b581bc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.102291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89b59ecd-10cc-4c0e-adf7-0e1210b581bc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.102898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89b59ecd-10cc-4c0e-adf7-0e1210b581bc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.324013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d8dfd697-6640-46bf-97b8-3b1e3e023044 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:05.354116 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d8dfd697-6640-46bf-97b8-3b1e3e023044 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f" status: 200 len: 1324 microversion: 2.1 time: 1.087567 Jul 20 04:16:05.355687 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 913/1684] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:04 2022] GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f => generated 1324 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:05.373199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8cd0b54f-1d29-45e3-a491-eab189334cd7 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:05.373968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8cd0b54f-1d29-45e3-a491-eab189334cd7 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 7662c91d-2965-4c2d-ade7-ec500f555d38] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:05.394964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8cd0b54f-1d29-45e3-a491-eab189334cd7 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.395762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8cd0b54f-1d29-45e3-a491-eab189334cd7 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.401187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8cd0b54f-1d29-45e3-a491-eab189334cd7 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.402653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8cd0b54f-1d29-45e3-a491-eab189334cd7 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.479712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8cd0b54f-1d29-45e3-a491-eab189334cd7 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 7662c91d-2965-4c2d-ade7-ec500f555d38] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:05.485535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-89b59ecd-10cc-4c0e-adf7-0e1210b581bc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:05.514570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-89b59ecd-10cc-4c0e-adf7-0e1210b581bc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:05.517214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-89b59ecd-10cc-4c0e-adf7-0e1210b581bc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:05.518595 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-89b59ecd-10cc-4c0e-adf7-0e1210b581bc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1281 microversion: 2.25 time: 0.449291 Jul 20 04:16:05.530710 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 772/1685] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:05 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1281 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:05.714032 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8cd0b54f-1d29-45e3-a491-eab189334cd7 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38" status: 204 len: 0 microversion: 2.1 time: 0.356208 Jul 20 04:16:05.715155 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 914/1686] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:05 2022] DELETE /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:05.729194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8b8addcb-0b32-4c61-9493-655fc02daa9f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:05.730462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8b8addcb-0b32-4c61-9493-655fc02daa9f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: de6fb41c-e1f2-4001-b7cf-f058963d6b29] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:05.736445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:05.754724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e291500a-a341-4a5e-9af2-e62e0f959cc3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:05.756005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e291500a-a341-4a5e-9af2-e62e0f959cc3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:05.768343 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b8addcb-0b32-4c61-9493-655fc02daa9f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.768588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e291500a-a341-4a5e-9af2-e62e0f959cc3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.769204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b8addcb-0b32-4c61-9493-655fc02daa9f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.769338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e291500a-a341-4a5e-9af2-e62e0f959cc3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.770284 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b8addcb-0b32-4c61-9493-655fc02daa9f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.772729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e291500a-a341-4a5e-9af2-e62e0f959cc3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.773323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b8addcb-0b32-4c61-9493-655fc02daa9f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.773739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e291500a-a341-4a5e-9af2-e62e0f959cc3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.159442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e291500a-a341-4a5e-9af2-e62e0f959cc3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:06.173100 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e291500a-a341-4a5e-9af2-e62e0f959cc3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1308 microversion: 2.1 time: 0.422947 Jul 20 04:16:06.181556 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 915/1687] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:05 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1308 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:06.249463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8b8addcb-0b32-4c61-9493-655fc02daa9f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:06.259342 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8b8addcb-0b32-4c61-9493-655fc02daa9f tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/de6fb41c-e1f2-4001-b7cf-f058963d6b29" status: 200 len: 1511 microversion: 2.1 time: 0.540049 Jul 20 04:16:06.259967 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 773/1688] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:05 2022] GET /compute/v2.1/servers/de6fb41c-e1f2-4001-b7cf-f058963d6b29 => generated 1511 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:06.374393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-28b77cc6-6229-4e87-95d5-69f17652e6c8 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:06.375775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-28b77cc6-6229-4e87-95d5-69f17652e6c8 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:06.389669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28b77cc6-6229-4e87-95d5-69f17652e6c8 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.390547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28b77cc6-6229-4e87-95d5-69f17652e6c8 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.392216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28b77cc6-6229-4e87-95d5-69f17652e6c8 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.393261 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28b77cc6-6229-4e87-95d5-69f17652e6c8 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.546938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cd3c2251-bd00-446f-8d97-ef5d9b56ee58 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:06.547666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cd3c2251-bd00-446f-8d97-ef5d9b56ee58 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:06.583095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd3c2251-bd00-446f-8d97-ef5d9b56ee58 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.585387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd3c2251-bd00-446f-8d97-ef5d9b56ee58 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.586580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd3c2251-bd00-446f-8d97-ef5d9b56ee58 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.589226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd3c2251-bd00-446f-8d97-ef5d9b56ee58 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.709077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-28b77cc6-6229-4e87-95d5-69f17652e6c8 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:06.722130 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-28b77cc6-6229-4e87-95d5-69f17652e6c8 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f" status: 200 len: 1519 microversion: 2.1 time: 0.347161 Jul 20 04:16:06.723572 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 916/1689] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:06 2022] GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f => generated 1519 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:06.742306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8a171454-ac26-47ef-b315-97902da25c5e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Action: 'action', calling method: .version_select at 0x7f06c4de1d30>, body: {"addFloatingIp": {"address": "172.25.2.35"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:06.744033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8a171454-ac26-47ef-b315-97902da25c5e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:06.754746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a171454-ac26-47ef-b315-97902da25c5e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.755248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a171454-ac26-47ef-b315-97902da25c5e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.756578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a171454-ac26-47ef-b315-97902da25c5e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.757253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a171454-ac26-47ef-b315-97902da25c5e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.794745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:06.846793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a171454-ac26-47ef-b315-97902da25c5e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Acquired lock "refresh_cache-e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" {{(pid=127871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:16:06.995273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cd3c2251-bd00-446f-8d97-ef5d9b56ee58 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:07.019351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cd3c2251-bd00-446f-8d97-ef5d9b56ee58 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:07.021002 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cd3c2251-bd00-446f-8d97-ef5d9b56ee58 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:07.024498 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cd3c2251-bd00-446f-8d97-ef5d9b56ee58 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1281 microversion: 2.25 time: 0.491432 Jul 20 04:16:07.025087 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 774/1690] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:06 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1281 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:16:07.060054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c9ff5000-0c5f-4753-9342-17ef4d54d0d5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1184542434", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "874598db-a331-4a76-938b-6804bd901bc8"}], "security_groups": [{"name": "tempest-securitygroup--1587897560"}], "key_name": "tempest-keypair-95203804", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:07.336400 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-c9ff5000-0c5f-4753-9342-17ef4d54d0d5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] validate_networks() for [('874598db-a331-4a76-938b-6804bd901bc8', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:09.134440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-8a171454-ac26-47ef-b315-97902da25c5e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Building network info cache for instance {{(pid=127871) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:16:09.603493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-c9ff5000-0c5f-4753-9342-17ef4d54d0d5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:09.603493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-c9ff5000-0c5f-4753-9342-17ef4d54d0d5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:09.604122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-c9ff5000-0c5f-4753-9342-17ef4d54d0d5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:09.604228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-c9ff5000-0c5f-4753-9342-17ef4d54d0d5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:09.605367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-c9ff5000-0c5f-4753-9342-17ef4d54d0d5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:09.632916 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9ff5000-0c5f-4753-9342-17ef4d54d0d5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.633699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9ff5000-0c5f-4753-9342-17ef4d54d0d5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.641261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9ff5000-0c5f-4753-9342-17ef4d54d0d5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.644848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9ff5000-0c5f-4753-9342-17ef4d54d0d5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.678319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-c9ff5000-0c5f-4753-9342-17ef4d54d0d5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Getting quotas for project 5ac9884530484da7acd3b52a3e9567d5. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:09.685159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-c9ff5000-0c5f-4753-9342-17ef4d54d0d5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Getting quotas for user 317e1c9f0eda4534aab1e18a72e7540a and project 5ac9884530484da7acd3b52a3e9567d5. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:09.699615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c9ff5000-0c5f-4753-9342-17ef4d54d0d5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:09.702260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c9ff5000-0c5f-4753-9342-17ef4d54d0d5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:09.776520 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c9ff5000-0c5f-4753-9342-17ef4d54d0d5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.720709 Jul 20 04:16:09.783829 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 775/1691] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 2730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:16:09.794065 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea6048dc-7952-4daf-9ceb-678065572c51 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:09.796654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ea6048dc-7952-4daf-9ceb-678065572c51 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:09.809334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea6048dc-7952-4daf-9ceb-678065572c51 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.813848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea6048dc-7952-4daf-9ceb-678065572c51 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.814989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea6048dc-7952-4daf-9ceb-678065572c51 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.817901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea6048dc-7952-4daf-9ceb-678065572c51 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.001044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-8a171454-ac26-47ef-b315-97902da25c5e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Updating instance_info_cache with network_info: [{"id": "963beecd-90f4-4da3-9538-8b41d8af8789", "address": "fa:16:3e:a7:09:fb", "network": {"id": "02803c14-35b7-4d41-afe7-2c5b8fd340b9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-727897289-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aabdfe1e44014cb9b940e5f7c7fc9938", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap963beecd-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127871) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:16:10.033429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a171454-ac26-47ef-b315-97902da25c5e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Releasing lock "refresh_cache-e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" {{(pid=127871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:16:10.034877 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8a171454-ac26-47ef-b315-97902da25c5e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "POST /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee/action" status: 202 len: 0 microversion: 2.1 time: 3.298581 Jul 20 04:16:10.035907 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 917/1692] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:06 2022] POST /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee/action => generated 0 bytes in 3300 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 20 04:16:10.045925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bc2615e8-4930-49af-b83f-6b3d40f96ee8 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:10.048344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bc2615e8-4930-49af-b83f-6b3d40f96ee8 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: de6fb41c-e1f2-4001-b7cf-f058963d6b29] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:10.063239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc2615e8-4930-49af-b83f-6b3d40f96ee8 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.063679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc2615e8-4930-49af-b83f-6b3d40f96ee8 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.064528 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc2615e8-4930-49af-b83f-6b3d40f96ee8 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.065809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc2615e8-4930-49af-b83f-6b3d40f96ee8 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.301391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bc2615e8-4930-49af-b83f-6b3d40f96ee8 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:10.316790 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bc2615e8-4930-49af-b83f-6b3d40f96ee8 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/de6fb41c-e1f2-4001-b7cf-f058963d6b29" status: 200 len: 1469 microversion: 2.1 time: 0.276340 Jul 20 04:16:10.323143 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 918/1693] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:10 2022] GET /compute/v2.1/servers/de6fb41c-e1f2-4001-b7cf-f058963d6b29 => generated 1469 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:10.334515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-c0b11b4b-d1ef-4e0c-835e-4927f683f83e req-46f1a801-6ae2-48c1-9eb1-83337232a639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c4bdc1-7bb8-47c0-b73f-317ba18949df", "name": "network-vif-plugged", "status": "completed", "tag": "7c532b32-d9c8-43cb-aa4c-635e4487021e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:10.352857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c0b11b4b-d1ef-4e0c-835e-4927f683f83e req-46f1a801-6ae2-48c1-9eb1-83337232a639 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.353309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c0b11b4b-d1ef-4e0c-835e-4927f683f83e req-46f1a801-6ae2-48c1-9eb1-83337232a639 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.398789 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-c0b11b4b-d1ef-4e0c-835e-4927f683f83e req-46f1a801-6ae2-48c1-9eb1-83337232a639 service nova] Creating event network-vif-plugged:7c532b32-d9c8-43cb-aa4c-635e4487021e for instance 32c4bdc1-7bb8-47c0-b73f-317ba18949df on n-h1-826526-5 Jul 20 04:16:10.430760 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-c0b11b4b-d1ef-4e0c-835e-4927f683f83e req-46f1a801-6ae2-48c1-9eb1-83337232a639 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105497 Jul 20 04:16:10.432170 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 919/1694] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:10.451228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ea6048dc-7952-4daf-9ceb-678065572c51 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:10.456702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-91cc92de-9055-415f-ad83-9330bc2f0ba2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:10.457968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-91cc92de-9055-415f-ad83-9330bc2f0ba2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:10.469992 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ea6048dc-7952-4daf-9ceb-678065572c51 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1488 microversion: 2.1 time: 0.684675 Jul 20 04:16:10.474860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91cc92de-9055-415f-ad83-9330bc2f0ba2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.475537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91cc92de-9055-415f-ad83-9330bc2f0ba2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.476702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91cc92de-9055-415f-ad83-9330bc2f0ba2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.477320 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91cc92de-9055-415f-ad83-9330bc2f0ba2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.488550 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 776/1695] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:09 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1488 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:10.489393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-d567769d-9ce8-45b7-a6b7-9dcffc5674cb req-bf076a62-d01c-4c1f-b0eb-e3215d58bf5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e27a49d1-11a9-47e6-b680-bb5d5e5e38ee", "tag": "963beecd-90f4-4da3-9538-8b41d8af8789"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:10.512551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d567769d-9ce8-45b7-a6b7-9dcffc5674cb req-bf076a62-d01c-4c1f-b0eb-e3215d58bf5d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.513010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d567769d-9ce8-45b7-a6b7-9dcffc5674cb req-bf076a62-d01c-4c1f-b0eb-e3215d58bf5d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.571022 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-d567769d-9ce8-45b7-a6b7-9dcffc5674cb req-bf076a62-d01c-4c1f-b0eb-e3215d58bf5d service nova] Creating event network-changed:963beecd-90f4-4da3-9538-8b41d8af8789 for instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee on n-h2-826526-5 Jul 20 04:16:10.597912 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-d567769d-9ce8-45b7-a6b7-9dcffc5674cb req-bf076a62-d01c-4c1f-b0eb-e3215d58bf5d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118247 Jul 20 04:16:10.599544 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 777/1696] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:10.607121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-54826332-9ef6-4f33-b82e-960d39da5b48 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:10.615371 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-54826332-9ef6-4f33-b82e-960d39da5b48 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:10.635439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54826332-9ef6-4f33-b82e-960d39da5b48 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.636190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54826332-9ef6-4f33-b82e-960d39da5b48 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.637480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54826332-9ef6-4f33-b82e-960d39da5b48 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.638151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54826332-9ef6-4f33-b82e-960d39da5b48 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.815285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-54826332-9ef6-4f33-b82e-960d39da5b48 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:10.834414 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-54826332-9ef6-4f33-b82e-960d39da5b48 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3" status: 200 len: 1244 microversion: 2.1 time: 0.225492 Jul 20 04:16:10.837099 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 778/1697] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:10 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3 => generated 1244 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:10.848667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-37dc6935-59fc-4c4c-9671-c2de83f9df8e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Action: 'action', calling method: .version_select at 0x7f06c4dd7940>, body: {"addFloatingIp": {"address": "172.25.2.35"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:10.854158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-37dc6935-59fc-4c4c-9671-c2de83f9df8e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:10.880599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37dc6935-59fc-4c4c-9671-c2de83f9df8e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.881660 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37dc6935-59fc-4c4c-9671-c2de83f9df8e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.882658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37dc6935-59fc-4c4c-9671-c2de83f9df8e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.883273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37dc6935-59fc-4c4c-9671-c2de83f9df8e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.968364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37dc6935-59fc-4c4c-9671-c2de83f9df8e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Acquired lock "refresh_cache-b5ae9a8d-371f-4e62-899c-54d3840aa87f" {{(pid=127870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:16:11.134716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-91cc92de-9055-415f-ad83-9330bc2f0ba2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:11.146276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:11.150388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-91cc92de-9055-415f-ad83-9330bc2f0ba2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:11.152187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-91cc92de-9055-415f-ad83-9330bc2f0ba2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:11.156933 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-91cc92de-9055-415f-ad83-9330bc2f0ba2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1281 microversion: 2.25 time: 0.723303 Jul 20 04:16:11.160189 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 920/1698] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:10 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1281 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:11.165309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c4f55b0a-b25d-41f7-ab0c-a541aae19d5c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:11.166031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c4f55b0a-b25d-41f7-ab0c-a541aae19d5c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:11.173742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4f55b0a-b25d-41f7-ab0c-a541aae19d5c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.174737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4f55b0a-b25d-41f7-ab0c-a541aae19d5c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.176016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4f55b0a-b25d-41f7-ab0c-a541aae19d5c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.176674 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4f55b0a-b25d-41f7-ab0c-a541aae19d5c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.194376 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-c4f55b0a-b25d-41f7-ab0c-a541aae19d5c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] HTTP exception thrown: Instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 could not be found. Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c4f55b0a-b25d-41f7-ab0c-a541aae19d5c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Request method failure captured: Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 HTTP/1.1 Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14D6E-QhrjgtOW87yCf7R-_R3mQSPJQf-VvmnlT2zUedB2ynysqxBhsiWbMlm1qhE5_CEpDG1ZR2sI_o2GOLUURYZVf9kt7XZNjc_iTHaEPLLQvlAhw8_I4qXi1jP3CB5KvKMxQYX4cO5Vmge1nCHMjfIdBuvwPDvgkNdYmF0052k1Q Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 0c6f3b1899ec467a890b78a5db571f83 Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestMultiNic-1985676234 Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:16:11.196720 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:16:11.198608 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c6f3b1899ec467a890b78a5db571f83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0c6f3b1899ec467a890b78a5db571f83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0c6f3b1899ec467a890b78a5db571f83", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c6f3b1899ec467a890b78a5db571f83"}]}] Jul 20 04:16:11.198608 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestMultiNic-1985676234 Jul 20 04:16:11.198608 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 0c6f3b1899ec467a890b78a5db571f83 Jul 20 04:16:11.198608 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestMultiNic-1985676234 Jul 20 04:16:11.198608 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestMultiNic-1985676234-project Jul 20 04:16:11.198608 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:16:11.198608 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:16:11.198608 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 5dff4ba44a4944f1b5955fb0bd9ba3bc Jul 20 04:16:11.198608 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestMultiNic-1985676234-project Jul 20 04:16:11.198608 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:16:11.198608 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 could not be found. Jul 20 04:16:11.198608 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '05a56f06-9dcb-4146-b21c-ffd422f03c83'} Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 could not be found. Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:11.199593 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 could not be found. Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 could not be found. Jul 20 04:16:11.201198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:11.203991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c4f55b0a-b25d-41f7-ab0c-a541aae19d5c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Returning 404 to user: Instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:11.205145 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c4f55b0a-b25d-41f7-ab0c-a541aae19d5c tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "DELETE /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 404 len: 111 microversion: 2.1 time: 0.043743 Jul 20 04:16:11.209189 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 921/1699] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:11 2022] DELETE /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:11.217500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8df719a6-3abd-4157-9dc2-2f5c89b0d0ff tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:11.225110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8df719a6-3abd-4157-9dc2-2f5c89b0d0ff tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.225917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8df719a6-3abd-4157-9dc2-2f5c89b0d0ff tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.378139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8df719a6-3abd-4157-9dc2-2f5c89b0d0ff tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Going to try to stop instance {{(pid=127871) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:16:11.502952 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8df719a6-3abd-4157-9dc2-2f5c89b0d0ff tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "POST /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5/action" status: 202 len: 0 microversion: 2.1 time: 0.283280 Jul 20 04:16:11.503815 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 922/1700] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:11 2022] POST /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:11.517659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-383f1922-b23c-487f-8b8c-247359a51c7e req-132e482a-4021-4946-8705-1fe82667831f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6fb41c-e1f2-4001-b7cf-f058963d6b29", "name": "network-vif-deleted", "tag": "0572c0e0-dc0b-4e7e-95f5-e156f2810ae6"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:11.527607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:11.530552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-383f1922-b23c-487f-8b8c-247359a51c7e req-132e482a-4021-4946-8705-1fe82667831f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.532609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-383f1922-b23c-487f-8b8c-247359a51c7e req-132e482a-4021-4946-8705-1fe82667831f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.572161 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-383f1922-b23c-487f-8b8c-247359a51c7e req-132e482a-4021-4946-8705-1fe82667831f service nova] Creating event network-vif-deleted:0572c0e0-dc0b-4e7e-95f5-e156f2810ae6 for instance de6fb41c-e1f2-4001-b7cf-f058963d6b29 on n-h1-826526-5 Jul 20 04:16:11.592910 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-383f1922-b23c-487f-8b8c-247359a51c7e req-132e482a-4021-4946-8705-1fe82667831f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079161 Jul 20 04:16:11.595128 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 923/1701] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:11.611303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1c73a20f-5252-412a-8243-c08a0fef73bb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:11.615071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1c73a20f-5252-412a-8243-c08a0fef73bb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 05a56f06-9dcb-4146-b21c-ffd422f03c83] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:11.640800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c73a20f-5252-412a-8243-c08a0fef73bb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.641653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c73a20f-5252-412a-8243-c08a0fef73bb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.642696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c73a20f-5252-412a-8243-c08a0fef73bb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.643353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c73a20f-5252-412a-8243-c08a0fef73bb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.678353 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-1c73a20f-5252-412a-8243-c08a0fef73bb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] HTTP exception thrown: Instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 could not be found. Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1c73a20f-5252-412a-8243-c08a0fef73bb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Request method failure captured: Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 HTTP/1.1 Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14D6E-QhrjgtOW87yCf7R-_R3mQSPJQf-VvmnlT2zUedB2ynysqxBhsiWbMlm1qhE5_CEpDG1ZR2sI_o2GOLUURYZVf9kt7XZNjc_iTHaEPLLQvlAhw8_I4qXi1jP3CB5KvKMxQYX4cO5Vmge1nCHMjfIdBuvwPDvgkNdYmF0052k1Q Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 0c6f3b1899ec467a890b78a5db571f83 Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestMultiNic-1985676234 Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:16:11.684240 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:16:11.685856 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c6f3b1899ec467a890b78a5db571f83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0c6f3b1899ec467a890b78a5db571f83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0c6f3b1899ec467a890b78a5db571f83", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c6f3b1899ec467a890b78a5db571f83"}]}] Jul 20 04:16:11.685856 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestMultiNic-1985676234 Jul 20 04:16:11.685856 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 0c6f3b1899ec467a890b78a5db571f83 Jul 20 04:16:11.685856 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestMultiNic-1985676234 Jul 20 04:16:11.685856 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestMultiNic-1985676234-project Jul 20 04:16:11.685856 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:16:11.685856 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:16:11.685856 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 5dff4ba44a4944f1b5955fb0bd9ba3bc Jul 20 04:16:11.685856 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestMultiNic-1985676234-project Jul 20 04:16:11.685856 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:16:11.685856 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 could not be found. Jul 20 04:16:11.685856 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '05a56f06-9dcb-4146-b21c-ffd422f03c83'} Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 could not be found. Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:11.687066 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:11.693160 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:11.693160 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:16:11.693160 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:16:11.693160 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:11.693160 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:11.693160 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:11.693160 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:11.693160 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 could not be found. Jul 20 04:16:11.693160 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:11.693160 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:11.693160 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:11.693160 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:11.693160 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:11.693160 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:11.693160 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:11.693160 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:11.693160 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 could not be found. Jul 20 04:16:11.693160 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:11.695751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1c73a20f-5252-412a-8243-c08a0fef73bb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Returning 404 to user: Instance 05a56f06-9dcb-4146-b21c-ffd422f03c83 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:11.695751 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1c73a20f-5252-412a-8243-c08a0fef73bb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83" status: 404 len: 111 microversion: 2.1 time: 0.085187 Jul 20 04:16:11.695751 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 924/1702] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:11 2022] GET /compute/v2.1/servers/05a56f06-9dcb-4146-b21c-ffd422f03c83 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:11.703518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-96bb373f-508d-4e67-85b9-4aba9adec4ac tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:11.705612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-96bb373f-508d-4e67-85b9-4aba9adec4ac tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: de6fb41c-e1f2-4001-b7cf-f058963d6b29] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:11.719758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96bb373f-508d-4e67-85b9-4aba9adec4ac tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.720210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96bb373f-508d-4e67-85b9-4aba9adec4ac tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.724630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96bb373f-508d-4e67-85b9-4aba9adec4ac tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.725793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96bb373f-508d-4e67-85b9-4aba9adec4ac tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.767230 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-96bb373f-508d-4e67-85b9-4aba9adec4ac tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] HTTP exception thrown: Instance de6fb41c-e1f2-4001-b7cf-f058963d6b29 could not be found. Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-96bb373f-508d-4e67-85b9-4aba9adec4ac tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Request method failure captured: Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/de6fb41c-e1f2-4001-b7cf-f058963d6b29 HTTP/1.1 Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Ex6yxXGShR2UE1fhYd7eADFyl7GoQLdE7AydUI4Dd_d8sO9SHJ2Wr8v5tDrMc8urO7GN44fKMtXX8cTWFksERBE3xgjjU-u_El0EtVyOIdqq787h_LvSSqnjrjgssb4xxXUAIu92jMqwLXAobzGgVK00ODusUD5Ai_1JMCMnAq7f8 Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 3c01e02dff54478d891dafa488ab4753 Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-MultipleCreateTestJSON-1217345292 Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:16:11.769611 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:16:11.771430 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3c01e02dff54478d891dafa488ab4753"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3c01e02dff54478d891dafa488ab4753"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3c01e02dff54478d891dafa488ab4753", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3c01e02dff54478d891dafa488ab4753"}]}] Jul 20 04:16:11.771430 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-MultipleCreateTestJSON-1217345292 Jul 20 04:16:11.771430 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 3c01e02dff54478d891dafa488ab4753 Jul 20 04:16:11.771430 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1217345292 Jul 20 04:16:11.771430 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-MultipleCreateTestJSON-1217345292-project Jul 20 04:16:11.771430 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:16:11.771430 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:16:11.771430 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 3d3e518f087b49a0bedfd9a7df8b4af8 Jul 20 04:16:11.771430 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-MultipleCreateTestJSON-1217345292-project Jul 20 04:16:11.771430 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:16:11.771430 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance de6fb41c-e1f2-4001-b7cf-f058963d6b29 could not be found. Jul 20 04:16:11.771430 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'de6fb41c-e1f2-4001-b7cf-f058963d6b29'} Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de6fb41c-e1f2-4001-b7cf-f058963d6b29 could not be found. Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:11.772737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:11.774359 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:11.774359 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:16:11.774359 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:16:11.774359 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:11.774359 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:11.774359 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:11.774359 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:11.774359 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de6fb41c-e1f2-4001-b7cf-f058963d6b29 could not be found. Jul 20 04:16:11.774359 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:11.774359 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:11.774359 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:11.774359 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:11.774359 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:11.774359 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:11.774359 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:11.774359 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:11.774359 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de6fb41c-e1f2-4001-b7cf-f058963d6b29 could not be found. Jul 20 04:16:11.774359 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:11.775826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-96bb373f-508d-4e67-85b9-4aba9adec4ac tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Returning 404 to user: Instance de6fb41c-e1f2-4001-b7cf-f058963d6b29 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:11.777200 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-96bb373f-508d-4e67-85b9-4aba9adec4ac tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/de6fb41c-e1f2-4001-b7cf-f058963d6b29" status: 404 len: 111 microversion: 2.1 time: 0.087892 Jul 20 04:16:11.777878 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 925/1703] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:11 2022] GET /compute/v2.1/servers/de6fb41c-e1f2-4001-b7cf-f058963d6b29 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:11.784428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8fa41d18-0851-4da7-b359-3c0a0ba7a5c0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:11.785451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8fa41d18-0851-4da7-b359-3c0a0ba7a5c0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:11.800839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fa41d18-0851-4da7-b359-3c0a0ba7a5c0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.802447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fa41d18-0851-4da7-b359-3c0a0ba7a5c0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.804813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fa41d18-0851-4da7-b359-3c0a0ba7a5c0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.806170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fa41d18-0851-4da7-b359-3c0a0ba7a5c0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.154637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8fa41d18-0851-4da7-b359-3c0a0ba7a5c0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:12.179106 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8fa41d18-0851-4da7-b359-3c0a0ba7a5c0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1498 microversion: 2.1 time: 0.397267 Jul 20 04:16:12.181174 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 926/1704] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:11 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1498 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:12.187172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3bb4585b-97e4-4293-8bea-ad0ae118a9eb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:12.187338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3bb4585b-97e4-4293-8bea-ad0ae118a9eb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:12.214744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3bb4585b-97e4-4293-8bea-ad0ae118a9eb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.217712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3bb4585b-97e4-4293-8bea-ad0ae118a9eb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.219424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3bb4585b-97e4-4293-8bea-ad0ae118a9eb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.220082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3bb4585b-97e4-4293-8bea-ad0ae118a9eb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.243056 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-3bb4585b-97e4-4293-8bea-ad0ae118a9eb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] HTTP exception thrown: Instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 could not be found. Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3bb4585b-97e4-4293-8bea-ad0ae118a9eb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Request method failure captured: Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 HTTP/1.1 Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14D6E-QhrjgtOW87yCf7R-_R3mQSPJQf-VvmnlT2zUedB2ynysqxBhsiWbMlm1qhE5_CEpDG1ZR2sI_o2GOLUURYZVf9kt7XZNjc_iTHaEPLLQvlAhw8_I4qXi1jP3CB5KvKMxQYX4cO5Vmge1nCHMjfIdBuvwPDvgkNdYmF0052k1Q Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 0c6f3b1899ec467a890b78a5db571f83 Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestMultiNic-1985676234 Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:16:12.245113 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:16:12.246706 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c6f3b1899ec467a890b78a5db571f83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0c6f3b1899ec467a890b78a5db571f83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0c6f3b1899ec467a890b78a5db571f83", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c6f3b1899ec467a890b78a5db571f83"}]}] Jul 20 04:16:12.246706 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestMultiNic-1985676234 Jul 20 04:16:12.246706 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 0c6f3b1899ec467a890b78a5db571f83 Jul 20 04:16:12.246706 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestMultiNic-1985676234 Jul 20 04:16:12.246706 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestMultiNic-1985676234-project Jul 20 04:16:12.246706 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:16:12.246706 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:16:12.246706 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 5dff4ba44a4944f1b5955fb0bd9ba3bc Jul 20 04:16:12.246706 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestMultiNic-1985676234-project Jul 20 04:16:12.246706 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:16:12.246706 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 could not be found. Jul 20 04:16:12.246706 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '9878d79b-e774-4a05-b2f5-5a4a0c690f86'} Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 could not be found. Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:12.247572 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 could not be found. Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 could not be found. Jul 20 04:16:12.249088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:12.252819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3bb4585b-97e4-4293-8bea-ad0ae118a9eb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Returning 404 to user: Instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:12.253806 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3bb4585b-97e4-4293-8bea-ad0ae118a9eb tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 404 len: 111 microversion: 2.1 time: 0.071379 Jul 20 04:16:12.254652 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 927/1705] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:12 2022] DELETE /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:12.260445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-90de0f20-ec42-4020-97b0-2fbffbbe08c5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:12.261159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-90de0f20-ec42-4020-97b0-2fbffbbe08c5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 7662c91d-2965-4c2d-ade7-ec500f555d38] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:12.268896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-90de0f20-ec42-4020-97b0-2fbffbbe08c5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.270123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-90de0f20-ec42-4020-97b0-2fbffbbe08c5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.272584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-90de0f20-ec42-4020-97b0-2fbffbbe08c5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.273267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-90de0f20-ec42-4020-97b0-2fbffbbe08c5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.324012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-90de0f20-ec42-4020-97b0-2fbffbbe08c5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.324513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-90de0f20-ec42-4020-97b0-2fbffbbe08c5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.324979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-90de0f20-ec42-4020-97b0-2fbffbbe08c5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lazy-loading 'fault' on Instance uuid 7662c91d-2965-4c2d-ade7-ec500f555d38 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:12.380066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-90de0f20-ec42-4020-97b0-2fbffbbe08c5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3e518f087b49a0bedfd9a7df8b4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c01e02dff54478d891dafa488ab4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:12.388512 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-90de0f20-ec42-4020-97b0-2fbffbbe08c5 tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38" status: 200 len: 1307 microversion: 2.1 time: 0.132507 Jul 20 04:16:12.389164 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 928/1706] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:12 2022] GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38 => generated 1307 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:12.395292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0b816397-a839-4d97-b15a-ad5af779f3b8 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:12.396549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0b816397-a839-4d97-b15a-ad5af779f3b8 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:12.405298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b816397-a839-4d97-b15a-ad5af779f3b8 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.406062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b816397-a839-4d97-b15a-ad5af779f3b8 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.407005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b816397-a839-4d97-b15a-ad5af779f3b8 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.407509 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b816397-a839-4d97-b15a-ad5af779f3b8 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.514168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0b816397-a839-4d97-b15a-ad5af779f3b8 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:12.524019 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0b816397-a839-4d97-b15a-ad5af779f3b8 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3" status: 200 len: 1298 microversion: 2.1 time: 0.133301 Jul 20 04:16:12.528478 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 929/1707] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:12 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3 => generated 1298 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:12.537673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-71074758-3872-46ef-a263-3d3daf2ce4d9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:12.538525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-71074758-3872-46ef-a263-3d3daf2ce4d9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:12.546431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71074758-3872-46ef-a263-3d3daf2ce4d9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.546775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71074758-3872-46ef-a263-3d3daf2ce4d9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.547897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71074758-3872-46ef-a263-3d3daf2ce4d9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.548581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71074758-3872-46ef-a263-3d3daf2ce4d9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.748683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-71074758-3872-46ef-a263-3d3daf2ce4d9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:12.759507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-71074758-3872-46ef-a263-3d3daf2ce4d9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:12.761398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-71074758-3872-46ef-a263-3d3daf2ce4d9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:12.765957 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-71074758-3872-46ef-a263-3d3daf2ce4d9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1478 microversion: 2.25 time: 0.236190 Jul 20 04:16:12.778479 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 930/1708] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:12 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1478 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:12.778479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-52bfd615-e0fd-4baa-90a9-af72074cf0f2 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:12.778479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-52bfd615-e0fd-4baa-90a9-af72074cf0f2 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] [instance: 9878d79b-e774-4a05-b2f5-5a4a0c690f86] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:12.783031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52bfd615-e0fd-4baa-90a9-af72074cf0f2 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.784295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52bfd615-e0fd-4baa-90a9-af72074cf0f2 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.785340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52bfd615-e0fd-4baa-90a9-af72074cf0f2 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.785848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52bfd615-e0fd-4baa-90a9-af72074cf0f2 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.809732 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-52bfd615-e0fd-4baa-90a9-af72074cf0f2 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] HTTP exception thrown: Instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 could not be found. Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-52bfd615-e0fd-4baa-90a9-af72074cf0f2 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Request method failure captured: Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 HTTP/1.1 Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14D6E-QhrjgtOW87yCf7R-_R3mQSPJQf-VvmnlT2zUedB2ynysqxBhsiWbMlm1qhE5_CEpDG1ZR2sI_o2GOLUURYZVf9kt7XZNjc_iTHaEPLLQvlAhw8_I4qXi1jP3CB5KvKMxQYX4cO5Vmge1nCHMjfIdBuvwPDvgkNdYmF0052k1Q Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 0c6f3b1899ec467a890b78a5db571f83 Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestMultiNic-1985676234 Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:16:12.812170 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:16:12.814402 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c6f3b1899ec467a890b78a5db571f83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0c6f3b1899ec467a890b78a5db571f83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0c6f3b1899ec467a890b78a5db571f83", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c6f3b1899ec467a890b78a5db571f83"}]}] Jul 20 04:16:12.814402 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestMultiNic-1985676234 Jul 20 04:16:12.814402 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 0c6f3b1899ec467a890b78a5db571f83 Jul 20 04:16:12.814402 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestMultiNic-1985676234 Jul 20 04:16:12.814402 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestMultiNic-1985676234-project Jul 20 04:16:12.814402 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:16:12.814402 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:16:12.814402 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 5dff4ba44a4944f1b5955fb0bd9ba3bc Jul 20 04:16:12.814402 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestMultiNic-1985676234-project Jul 20 04:16:12.814402 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:16:12.814402 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 could not be found. Jul 20 04:16:12.814402 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '9878d79b-e774-4a05-b2f5-5a4a0c690f86'} Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 could not be found. Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:12.815643 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:12.818551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:12.818551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:16:12.818551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:16:12.818551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:12.818551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:12.818551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:12.818551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:12.818551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 could not be found. Jul 20 04:16:12.818551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:12.818551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:12.818551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:12.818551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:12.818551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:12.818551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:12.818551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:12.818551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:12.818551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 could not be found. Jul 20 04:16:12.818551 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:12.821238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-52bfd615-e0fd-4baa-90a9-af72074cf0f2 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] Returning 404 to user: Instance 9878d79b-e774-4a05-b2f5-5a4a0c690f86 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:12.821238 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-52bfd615-e0fd-4baa-90a9-af72074cf0f2 tempest-ServersTestMultiNic-1985676234 tempest-ServersTestMultiNic-1985676234-project] 10.222.0.17 "GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86" status: 404 len: 111 microversion: 2.1 time: 0.046393 Jul 20 04:16:12.821238 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 931/1709] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:12 2022] GET /compute/v2.1/servers/9878d79b-e774-4a05-b2f5-5a4a0c690f86 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:13.009916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-62c87fdf-7747-4c1d-a9e2-846def9f7fc9 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:13.010488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-62c87fdf-7747-4c1d-a9e2-846def9f7fc9 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:13.019035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62c87fdf-7747-4c1d-a9e2-846def9f7fc9 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:13.019606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62c87fdf-7747-4c1d-a9e2-846def9f7fc9 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:13.021358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62c87fdf-7747-4c1d-a9e2-846def9f7fc9 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:13.022254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62c87fdf-7747-4c1d-a9e2-846def9f7fc9 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:13.264734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-62c87fdf-7747-4c1d-a9e2-846def9f7fc9 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'services' on Instance uuid 32c4bdc1-7bb8-47c0-b73f-317ba18949df {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:13.307175 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-62c87fdf-7747-4c1d-a9e2-846def9f7fc9 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1971 microversion: 2.25 time: 0.486501 Jul 20 04:16:13.315342 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 932/1710] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:12 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1971 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:13.331185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cc31c562-25ba-4cae-9aa4-c03c9a462051 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:13.332448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cc31c562-25ba-4cae-9aa4-c03c9a462051 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:13.344703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc31c562-25ba-4cae-9aa4-c03c9a462051 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:13.345283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc31c562-25ba-4cae-9aa4-c03c9a462051 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:13.346823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc31c562-25ba-4cae-9aa4-c03c9a462051 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:13.347663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc31c562-25ba-4cae-9aa4-c03c9a462051 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:13.815021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cc31c562-25ba-4cae-9aa4-c03c9a462051 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:13.825488 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cc31c562-25ba-4cae-9aa4-c03c9a462051 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1498 microversion: 2.1 time: 0.507630 Jul 20 04:16:13.826082 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 933/1711] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:13 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1498 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:13.833618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9f215d88-941c-433b-8518-9323da568db9 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:13.849472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9f215d88-941c-433b-8518-9323da568db9 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:13.868937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f215d88-941c-433b-8518-9323da568db9 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:13.874080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f215d88-941c-433b-8518-9323da568db9 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:13.875097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f215d88-941c-433b-8518-9323da568db9 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:13.875955 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f215d88-941c-433b-8518-9323da568db9 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:14.514567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-9f215d88-941c-433b-8518-9323da568db9 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'services' on Instance uuid 32c4bdc1-7bb8-47c0-b73f-317ba18949df {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:14.533452 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9f215d88-941c-433b-8518-9323da568db9 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1971 microversion: 2.25 time: 0.703962 Jul 20 04:16:14.534999 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 934/1712] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:13 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1971 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:14.541065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-da88f750-a628-43e1-933a-8b55ee51eeed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:14.542066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-da88f750-a628-43e1-933a-8b55ee51eeed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] [instance: 7662c91d-2965-4c2d-ade7-ec500f555d38] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:14.558390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da88f750-a628-43e1-933a-8b55ee51eeed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:14.559365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da88f750-a628-43e1-933a-8b55ee51eeed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:14.560534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da88f750-a628-43e1-933a-8b55ee51eeed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:14.561453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da88f750-a628-43e1-933a-8b55ee51eeed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:14.589782 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-da88f750-a628-43e1-933a-8b55ee51eeed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] HTTP exception thrown: Instance 7662c91d-2965-4c2d-ade7-ec500f555d38 could not be found. Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-da88f750-a628-43e1-933a-8b55ee51eeed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Request method failure captured: Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38 HTTP/1.1 Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Ex6yxXGShR2UE1fhYd7eADFyl7GoQLdE7AydUI4Dd_d8sO9SHJ2Wr8v5tDrMc8urO7GN44fKMtXX8cTWFksERBE3xgjjU-u_El0EtVyOIdqq787h_LvSSqnjrjgssb4xxXUAIu92jMqwLXAobzGgVK00ODusUD5Ai_1JMCMnAq7f8 Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 3c01e02dff54478d891dafa488ab4753 Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-MultipleCreateTestJSON-1217345292 Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:16:14.594171 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:16:14.596550 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3c01e02dff54478d891dafa488ab4753"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3c01e02dff54478d891dafa488ab4753"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3c01e02dff54478d891dafa488ab4753", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3c01e02dff54478d891dafa488ab4753"}]}] Jul 20 04:16:14.596550 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-MultipleCreateTestJSON-1217345292 Jul 20 04:16:14.596550 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 3c01e02dff54478d891dafa488ab4753 Jul 20 04:16:14.596550 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1217345292 Jul 20 04:16:14.596550 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-MultipleCreateTestJSON-1217345292-project Jul 20 04:16:14.596550 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:16:14.596550 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:16:14.596550 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 3d3e518f087b49a0bedfd9a7df8b4af8 Jul 20 04:16:14.596550 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-MultipleCreateTestJSON-1217345292-project Jul 20 04:16:14.596550 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:16:14.596550 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 7662c91d-2965-4c2d-ade7-ec500f555d38 could not be found. Jul 20 04:16:14.596550 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '7662c91d-2965-4c2d-ade7-ec500f555d38'} Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7662c91d-2965-4c2d-ade7-ec500f555d38 could not be found. Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:14.597476 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:14.598965 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:14.598965 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:16:14.598965 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:16:14.598965 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:14.598965 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:14.598965 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:14.598965 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:14.598965 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7662c91d-2965-4c2d-ade7-ec500f555d38 could not be found. Jul 20 04:16:14.598965 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:14.598965 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:14.598965 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:14.598965 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:14.598965 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:14.598965 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:14.598965 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:14.598965 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:14.598965 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7662c91d-2965-4c2d-ade7-ec500f555d38 could not be found. Jul 20 04:16:14.598965 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:14.602028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-da88f750-a628-43e1-933a-8b55ee51eeed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] Returning 404 to user: Instance 7662c91d-2965-4c2d-ade7-ec500f555d38 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:14.603069 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-da88f750-a628-43e1-933a-8b55ee51eeed tempest-MultipleCreateTestJSON-1217345292 tempest-MultipleCreateTestJSON-1217345292-project] 10.222.0.17 "GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38" status: 404 len: 111 microversion: 2.1 time: 0.066892 Jul 20 04:16:14.603821 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 935/1713] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:14 2022] GET /compute/v2.1/servers/7662c91d-2965-4c2d-ade7-ec500f555d38 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:14.622305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d2941484-1aaa-443c-836d-f2cad35b3449 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:14.623509 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d2941484-1aaa-443c-836d-f2cad35b3449 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:14.633625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2941484-1aaa-443c-836d-f2cad35b3449 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:14.637276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2941484-1aaa-443c-836d-f2cad35b3449 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:14.638482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2941484-1aaa-443c-836d-f2cad35b3449 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:14.639166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2941484-1aaa-443c-836d-f2cad35b3449 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:14.682319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:15.043146 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d2941484-1aaa-443c-836d-f2cad35b3449 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:15.063268 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d2941484-1aaa-443c-836d-f2cad35b3449 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3" status: 200 len: 1366 microversion: 2.1 time: 0.456698 Jul 20 04:16:15.065007 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 936/1714] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:14 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3 => generated 1366 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:15.083704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-89a01abd-6a3e-429c-8750-36aed0ce2bf8 req-1f88f47e-a1a9-4bf8-a2dd-cdb9eb48869d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7662c91d-2965-4c2d-ade7-ec500f555d38", "name": "network-vif-deleted", "tag": "bc073d80-646b-4c5f-a802-2eb8d71b2add"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:15.098617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-89a01abd-6a3e-429c-8750-36aed0ce2bf8 req-1f88f47e-a1a9-4bf8-a2dd-cdb9eb48869d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:15.099090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-89a01abd-6a3e-429c-8750-36aed0ce2bf8 req-1f88f47e-a1a9-4bf8-a2dd-cdb9eb48869d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:15.111436 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-89a01abd-6a3e-429c-8750-36aed0ce2bf8 req-1f88f47e-a1a9-4bf8-a2dd-cdb9eb48869d service nova] Creating event network-vif-deleted:bc073d80-646b-4c5f-a802-2eb8d71b2add for instance 7662c91d-2965-4c2d-ade7-ec500f555d38 on n-h1-826526-5 Jul 20 04:16:15.116736 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-89a01abd-6a3e-429c-8750-36aed0ce2bf8 req-1f88f47e-a1a9-4bf8-a2dd-cdb9eb48869d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049915 Jul 20 04:16:15.119337 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 937/1715] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:15.124151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9fc08615-88d8-4267-b633-e1791c7feebf tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:15.124942 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:16:15.124942 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:16:15.126838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fc08615-88d8-4267-b633-e1791c7feebf tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:15.127370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fc08615-88d8-4267-b633-e1791c7feebf tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:15.128290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fc08615-88d8-4267-b633-e1791c7feebf tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:15.129265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fc08615-88d8-4267-b633-e1791c7feebf tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:15.181573 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9fc08615-88d8-4267-b633-e1791c7feebf tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.062348 Jul 20 04:16:15.182876 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 938/1716] 10.222.0.17 () {60 vars in 1216 bytes} [Wed Jul 20 04:16:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:16:15.188092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4221bd3d-faa1-47dc-92e4-1d20f7153a88 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:15.189098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4221bd3d-faa1-47dc-92e4-1d20f7153a88 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:15.196172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4221bd3d-faa1-47dc-92e4-1d20f7153a88 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:15.196944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4221bd3d-faa1-47dc-92e4-1d20f7153a88 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:15.198121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4221bd3d-faa1-47dc-92e4-1d20f7153a88 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:15.198745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4221bd3d-faa1-47dc-92e4-1d20f7153a88 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:15.642181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4221bd3d-faa1-47dc-92e4-1d20f7153a88 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:15.657824 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4221bd3d-faa1-47dc-92e4-1d20f7153a88 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1498 microversion: 2.1 time: 0.472974 Jul 20 04:16:15.659104 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 939/1717] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:15 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1498 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:15.673171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-60b417a1-8da9-4976-9f81-8ad54edf9c15 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826526-5", "block_migration": "auto"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:15.678062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-60b417a1-8da9-4976-9f81-8ad54edf9c15 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:15.715504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60b417a1-8da9-4976-9f81-8ad54edf9c15 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:15.715958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60b417a1-8da9-4976-9f81-8ad54edf9c15 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:15.716778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60b417a1-8da9-4976-9f81-8ad54edf9c15 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:15.717216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60b417a1-8da9-4976-9f81-8ad54edf9c15 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:15.792653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-60b417a1-8da9-4976-9f81-8ad54edf9c15 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'flavor' on Instance uuid 32c4bdc1-7bb8-47c0-b73f-317ba18949df {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:15.835747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-60b417a1-8da9-4976-9f81-8ad54edf9c15 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Going to try to live migrate instance to n-h2-826526-5 {{(pid=127871) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:16:18.260105 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.network.neutron [None req-37dc6935-59fc-4c4c-9671-c2de83f9df8e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] re-assign floating IP 172.25.2.35 from instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee Jul 20 04:16:18.364557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-37dc6935-59fc-4c4c-9671-c2de83f9df8e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Building network info cache for instance {{(pid=127870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:16:18.809803 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-60b417a1-8da9-4976-9f81-8ad54edf9c15 tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df/action" status: 202 len: 0 microversion: 2.25 time: 3.149256 Jul 20 04:16:18.810603 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 940/1718] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jul 20 04:16:15 2022] POST /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df/action => generated 0 bytes in 3151 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:18.820737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-af5ddc5e-b4bc-471c-adc2-1fa157731710 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:18.821703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-af5ddc5e-b4bc-471c-adc2-1fa157731710 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:18.835115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af5ddc5e-b4bc-471c-adc2-1fa157731710 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.840966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af5ddc5e-b4bc-471c-adc2-1fa157731710 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.843502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af5ddc5e-b4bc-471c-adc2-1fa157731710 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.848299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af5ddc5e-b4bc-471c-adc2-1fa157731710 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:19.667678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:19.693805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:19.946691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-37dc6935-59fc-4c4c-9671-c2de83f9df8e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Updating instance_info_cache with network_info: [{"id": "963beecd-90f4-4da3-9538-8b41d8af8789", "address": "fa:16:3e:a7:09:fb", "network": {"id": "02803c14-35b7-4d41-afe7-2c5b8fd340b9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-727897289-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aabdfe1e44014cb9b940e5f7c7fc9938", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap963beecd-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:16:19.971675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-37dc6935-59fc-4c4c-9671-c2de83f9df8e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Building network info cache for instance {{(pid=127870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:16:20.222039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-af5ddc5e-b4bc-471c-adc2-1fa157731710 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:20.249785 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-af5ddc5e-b4bc-471c-adc2-1fa157731710 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3" status: 200 len: 1366 microversion: 2.1 time: 1.437797 Jul 20 04:16:20.250727 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 941/1719] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:18 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3 => generated 1366 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:20.260333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-59fb8c4e-f8a3-4175-8e2e-e8888d5ea4d5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:20.260971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-59fb8c4e-f8a3-4175-8e2e-e8888d5ea4d5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:20.270181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59fb8c4e-f8a3-4175-8e2e-e8888d5ea4d5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.271195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59fb8c4e-f8a3-4175-8e2e-e8888d5ea4d5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.272693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59fb8c4e-f8a3-4175-8e2e-e8888d5ea4d5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.273623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59fb8c4e-f8a3-4175-8e2e-e8888d5ea4d5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.681013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-59fb8c4e-f8a3-4175-8e2e-e8888d5ea4d5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:20.701303 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-59fb8c4e-f8a3-4175-8e2e-e8888d5ea4d5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1498 microversion: 2.1 time: 0.449452 Jul 20 04:16:20.712906 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 942/1720] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:20 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1498 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:20.719745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-5301a02c-4e52-4658-a381-290950d61bec req-b21d94e6-e4dc-4cb5-b827-59538614085b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e27a49d1-11a9-47e6-b680-bb5d5e5e38ee", "tag": "963beecd-90f4-4da3-9538-8b41d8af8789"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:20.729734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5301a02c-4e52-4658-a381-290950d61bec req-b21d94e6-e4dc-4cb5-b827-59538614085b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.730692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5301a02c-4e52-4658-a381-290950d61bec req-b21d94e6-e4dc-4cb5-b827-59538614085b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.746901 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-5301a02c-4e52-4658-a381-290950d61bec req-b21d94e6-e4dc-4cb5-b827-59538614085b service nova] Creating event network-changed:963beecd-90f4-4da3-9538-8b41d8af8789 for instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee on n-h2-826526-5 Jul 20 04:16:20.754603 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-5301a02c-4e52-4658-a381-290950d61bec req-b21d94e6-e4dc-4cb5-b827-59538614085b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038320 Jul 20 04:16:20.755864 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 943/1721] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:20.764689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5efab5d0-4dda-4fb3-8493-545f3f115e4f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:20.765802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5efab5d0-4dda-4fb3-8493-545f3f115e4f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:20.776199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5efab5d0-4dda-4fb3-8493-545f3f115e4f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.777088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5efab5d0-4dda-4fb3-8493-545f3f115e4f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.778155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5efab5d0-4dda-4fb3-8493-545f3f115e4f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.778862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5efab5d0-4dda-4fb3-8493-545f3f115e4f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.866964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:21.038912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5efab5d0-4dda-4fb3-8493-545f3f115e4f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:21.054337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5efab5d0-4dda-4fb3-8493-545f3f115e4f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:21.056657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5efab5d0-4dda-4fb3-8493-545f3f115e4f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:21.058261 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5efab5d0-4dda-4fb3-8493-545f3f115e4f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1488 microversion: 2.25 time: 0.300987 Jul 20 04:16:21.059323 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 944/1722] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:20 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1488 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:21.268843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-647957a9-2ba2-4f81-867a-eb2ce8f7367e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:21.269559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-647957a9-2ba2-4f81-867a-eb2ce8f7367e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:21.282560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-647957a9-2ba2-4f81-867a-eb2ce8f7367e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:21.283021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-647957a9-2ba2-4f81-867a-eb2ce8f7367e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:21.284348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-647957a9-2ba2-4f81-867a-eb2ce8f7367e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:21.284813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-647957a9-2ba2-4f81-867a-eb2ce8f7367e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:21.979057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-647957a9-2ba2-4f81-867a-eb2ce8f7367e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:21.991231 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-647957a9-2ba2-4f81-867a-eb2ce8f7367e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3" status: 200 len: 1366 microversion: 2.1 time: 0.726218 Jul 20 04:16:21.992157 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 945/1723] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:21 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3 => generated 1366 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:21.999039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3edfdb4e-e95e-4324-befc-b2f0519ab65f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:21.999714 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3edfdb4e-e95e-4324-befc-b2f0519ab65f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:22.015836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3edfdb4e-e95e-4324-befc-b2f0519ab65f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.019244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3edfdb4e-e95e-4324-befc-b2f0519ab65f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.020094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3edfdb4e-e95e-4324-befc-b2f0519ab65f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.021344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3edfdb4e-e95e-4324-befc-b2f0519ab65f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.257395 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3edfdb4e-e95e-4324-befc-b2f0519ab65f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:22.281492 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3edfdb4e-e95e-4324-befc-b2f0519ab65f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1498 microversion: 2.1 time: 0.287804 Jul 20 04:16:22.288208 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 946/1724] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:21 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1498 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:22.310213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-13c3f41a-6a6c-4cc9-80b0-9dd13e99e5d8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:22.314245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-13c3f41a-6a6c-4cc9-80b0-9dd13e99e5d8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:22.343255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13c3f41a-6a6c-4cc9-80b0-9dd13e99e5d8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.348200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13c3f41a-6a6c-4cc9-80b0-9dd13e99e5d8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.371727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13c3f41a-6a6c-4cc9-80b0-9dd13e99e5d8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.376622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13c3f41a-6a6c-4cc9-80b0-9dd13e99e5d8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.614618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-13c3f41a-6a6c-4cc9-80b0-9dd13e99e5d8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:22.628641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-13c3f41a-6a6c-4cc9-80b0-9dd13e99e5d8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:22.631720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-13c3f41a-6a6c-4cc9-80b0-9dd13e99e5d8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:22.634393 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-13c3f41a-6a6c-4cc9-80b0-9dd13e99e5d8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1488 microversion: 2.25 time: 0.338254 Jul 20 04:16:22.635628 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 947/1725] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:22 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1488 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:23.010267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a1410569-530b-4759-b3de-f463c97b3f26 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:23.010986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a1410569-530b-4759-b3de-f463c97b3f26 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:23.032064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1410569-530b-4759-b3de-f463c97b3f26 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.032640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1410569-530b-4759-b3de-f463c97b3f26 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.036118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1410569-530b-4759-b3de-f463c97b3f26 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.036755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1410569-530b-4759-b3de-f463c97b3f26 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.400584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a1410569-530b-4759-b3de-f463c97b3f26 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:23.421436 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a1410569-530b-4759-b3de-f463c97b3f26 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3" status: 200 len: 1366 microversion: 2.1 time: 0.415604 Jul 20 04:16:23.433585 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 948/1726] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:23 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3 => generated 1366 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:23.443434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-a99ab5b6-bc0b-4d72-811d-5c27150252a4 req-3ea73013-a258-4e19-ae65-2f51da1d42f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee9170bb-33df-43d7-b35f-1d846da620d3", "tag": "08cf3082-9efd-4024-be41-ac9e072b2995"}, {"name": "network-changed", "server_uuid": "b5ae9a8d-371f-4e62-899c-54d3840aa87f", "tag": "d788b629-ae4b-43be-9ccc-1503bc9e05eb"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:23.468795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a99ab5b6-bc0b-4d72-811d-5c27150252a4 req-3ea73013-a258-4e19-ae65-2f51da1d42f8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.469633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a99ab5b6-bc0b-4d72-811d-5c27150252a4 req-3ea73013-a258-4e19-ae65-2f51da1d42f8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.498318 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-a99ab5b6-bc0b-4d72-811d-5c27150252a4 req-3ea73013-a258-4e19-ae65-2f51da1d42f8 service nova] Creating event network-changed:08cf3082-9efd-4024-be41-ac9e072b2995 for instance ee9170bb-33df-43d7-b35f-1d846da620d3 on n-h2-826526-5 Jul 20 04:16:23.498977 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-a99ab5b6-bc0b-4d72-811d-5c27150252a4 req-3ea73013-a258-4e19-ae65-2f51da1d42f8 service nova] Creating event network-changed:d788b629-ae4b-43be-9ccc-1503bc9e05eb for instance b5ae9a8d-371f-4e62-899c-54d3840aa87f on n-h2-826526-5 Jul 20 04:16:23.507500 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-a99ab5b6-bc0b-4d72-811d-5c27150252a4 req-3ea73013-a258-4e19-ae65-2f51da1d42f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.070875 Jul 20 04:16:23.508513 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 949/1727] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:23.535106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a2eb4b0b-878a-44a0-8c5d-c111b719994f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:23.537465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a2eb4b0b-878a-44a0-8c5d-c111b719994f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:23.552574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2eb4b0b-878a-44a0-8c5d-c111b719994f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.556987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2eb4b0b-878a-44a0-8c5d-c111b719994f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.558127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2eb4b0b-878a-44a0-8c5d-c111b719994f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.558985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2eb4b0b-878a-44a0-8c5d-c111b719994f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.176347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-37dc6935-59fc-4c4c-9671-c2de83f9df8e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Updating instance_info_cache with network_info: [{"id": "d788b629-ae4b-43be-9ccc-1503bc9e05eb", "address": "fa:16:3e:23:da:a0", "network": {"id": "02803c14-35b7-4d41-afe7-2c5b8fd340b9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-727897289-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aabdfe1e44014cb9b940e5f7c7fc9938", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd788b629-ae", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:16:24.191925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37dc6935-59fc-4c4c-9671-c2de83f9df8e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Releasing lock "refresh_cache-b5ae9a8d-371f-4e62-899c-54d3840aa87f" {{(pid=127870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:16:24.192908 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-37dc6935-59fc-4c4c-9671-c2de83f9df8e tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "POST /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f/action" status: 202 len: 0 microversion: 2.1 time: 13.354592 Jul 20 04:16:24.193679 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 779/1728] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:10 2022] POST /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f/action => generated 0 bytes in 13356 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:16:24.219715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1943b263-8f74-4f19-8dc2-34af433ea16c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:24.220391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1943b263-8f74-4f19-8dc2-34af433ea16c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:24.238418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1943b263-8f74-4f19-8dc2-34af433ea16c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.241573 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1943b263-8f74-4f19-8dc2-34af433ea16c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.244143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1943b263-8f74-4f19-8dc2-34af433ea16c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.251208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1943b263-8f74-4f19-8dc2-34af433ea16c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.496469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a2eb4b0b-878a-44a0-8c5d-c111b719994f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:24.514263 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a2eb4b0b-878a-44a0-8c5d-c111b719994f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1498 microversion: 2.1 time: 1.002399 Jul 20 04:16:24.515814 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 950/1729] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:23 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1498 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:24.530356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-22c0bc97-877f-4fb8-a1c0-f4382cbec637 req-ce0cfa62-71f4-43eb-a87b-95787ac2c289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9170bb-33df-43d7-b35f-1d846da620d3", "name": "network-vif-plugged", "status": "completed", "tag": "08cf3082-9efd-4024-be41-ac9e072b2995"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:24.556376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-22c0bc97-877f-4fb8-a1c0-f4382cbec637 req-ce0cfa62-71f4-43eb-a87b-95787ac2c289 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.559566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-22c0bc97-877f-4fb8-a1c0-f4382cbec637 req-ce0cfa62-71f4-43eb-a87b-95787ac2c289 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.601612 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-22c0bc97-877f-4fb8-a1c0-f4382cbec637 req-ce0cfa62-71f4-43eb-a87b-95787ac2c289 service nova] Creating event network-vif-plugged:08cf3082-9efd-4024-be41-ac9e072b2995 for instance ee9170bb-33df-43d7-b35f-1d846da620d3 on n-h2-826526-5 Jul 20 04:16:24.636087 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-22c0bc97-877f-4fb8-a1c0-f4382cbec637 req-ce0cfa62-71f4-43eb-a87b-95787ac2c289 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115125 Jul 20 04:16:24.639661 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 951/1730] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:24.678061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ac3abce6-da85-4232-aaee-4cf12ae0f9f4 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Action: 'action', calling method: .version_select at 0x7f06c4de1dc0>, body: {"removeFloatingIp": {"address": "172.25.2.35"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:24.705173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1943b263-8f74-4f19-8dc2-34af433ea16c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:24.731218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1943b263-8f74-4f19-8dc2-34af433ea16c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:24.735583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1943b263-8f74-4f19-8dc2-34af433ea16c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:24.747964 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1943b263-8f74-4f19-8dc2-34af433ea16c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1488 microversion: 2.25 time: 0.545920 Jul 20 04:16:24.759712 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 780/1731] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:24 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1488 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:24.759712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7adb2ac5-0156-47be-bc6e-0201c4ba8969 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:24.759712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7adb2ac5-0156-47be-bc6e-0201c4ba8969 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:24.769711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7adb2ac5-0156-47be-bc6e-0201c4ba8969 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.770171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7adb2ac5-0156-47be-bc6e-0201c4ba8969 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.771562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7adb2ac5-0156-47be-bc6e-0201c4ba8969 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.772072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7adb2ac5-0156-47be-bc6e-0201c4ba8969 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.137974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:25.233342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ac3abce6-da85-4232-aaee-4cf12ae0f9f4 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:25.241897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac3abce6-da85-4232-aaee-4cf12ae0f9f4 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.242347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac3abce6-da85-4232-aaee-4cf12ae0f9f4 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.245059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac3abce6-da85-4232-aaee-4cf12ae0f9f4 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.246981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac3abce6-da85-4232-aaee-4cf12ae0f9f4 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.753767 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-ac3abce6-da85-4232-aaee-4cf12ae0f9f4 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] HTTP exception thrown: Floating IP 172.25.2.35 is not associated with instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee. Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ac3abce6-da85-4232-aaee-4cf12ae0f9f4 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Request method failure captured: Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee/action HTTP/1.1 Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 48 Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14E78gf6en3SFEOeLm1R4lD_j3nbKIbxJoN6xj6b01OhhyV0rnZh_D5mQg0dwVm3OvUzEOFz4Ob9E7jqyYI0kzVZfkKwUrdzPfl7cc2OLc1W_7BQuZQI_x2yB76pR0c5i69-xavS_qxLeSnnvCDLQtKzhQ_DalXPGpax6KJZvmB-PAI Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: aabdfe1e44014cb9b940e5f7c7fc9938 Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-116001615 Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:16:25.759536 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:16:25.761534 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aabdfe1e44014cb9b940e5f7c7fc9938"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aabdfe1e44014cb9b940e5f7c7fc9938"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aabdfe1e44014cb9b940e5f7c7fc9938", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aabdfe1e44014cb9b940e5f7c7fc9938"}]}] Jul 20 04:16:25.761534 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-116001615 Jul 20 04:16:25.761534 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: aabdfe1e44014cb9b940e5f7c7fc9938 Jul 20 04:16:25.761534 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-116001615 Jul 20 04:16:25.761534 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-FloatingIPsAssociationTestJSON-116001615-project Jul 20 04:16:25.761534 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:16:25.761534 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:16:25.761534 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: b8a99f17308e4a21be83507470946b76 Jul 20 04:16:25.761534 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-116001615-project Jul 20 04:16:25.761534 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:16:25.761534 n-d-826526-5 devstack@n-api.service[127871]: {"removeFloatingIp": {"address": "172.25.2.35"}} Jul 20 04:16:25.761534 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:16:25.761534 n-d-826526-5 devstack@n-api.service[127871]: exception: Floating IP 172.25.2.35 is not associated with instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee. Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'e27a49d1-11a9-47e6-b680-bb5d5e5e38ee', 'body': {'removeFloatingIp': {'address': '172.25.2.35'}}} Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.35 is not associated with instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee. Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:25.762511 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:25.764108 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:25.764108 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:25.764108 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:25.764108 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:25.764108 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.35 is not associated with instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee. Jul 20 04:16:25.764108 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:25.774663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ac3abce6-da85-4232-aaee-4cf12ae0f9f4 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Returning 409 to user: Floating IP 172.25.2.35 is not associated with instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:25.779372 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ac3abce6-da85-4232-aaee-4cf12ae0f9f4 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "POST /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee/action" status: 409 len: 145 microversion: 2.1 time: 1.131652 Jul 20 04:16:25.788490 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 952/1732] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:24 2022] POST /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee/action => generated 145 bytes in 1148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:16:25.807225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ef1b8de8-c4b9-42dd-a66b-7df866465ceb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:25.808996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ef1b8de8-c4b9-42dd-a66b-7df866465ceb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:25.841531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef1b8de8-c4b9-42dd-a66b-7df866465ceb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.842353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef1b8de8-c4b9-42dd-a66b-7df866465ceb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.843498 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef1b8de8-c4b9-42dd-a66b-7df866465ceb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.850152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef1b8de8-c4b9-42dd-a66b-7df866465ceb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.905951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7adb2ac5-0156-47be-bc6e-0201c4ba8969 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:25.915615 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7adb2ac5-0156-47be-bc6e-0201c4ba8969 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3" status: 200 len: 1366 microversion: 2.1 time: 1.163896 Jul 20 04:16:25.917370 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 781/1733] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:24 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3 => generated 1366 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:25.941456 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-46b47308-ea70-4da6-9605-465fba77912d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:25.942519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-46b47308-ea70-4da6-9605-465fba77912d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:25.960615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46b47308-ea70-4da6-9605-465fba77912d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.962784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46b47308-ea70-4da6-9605-465fba77912d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.964125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46b47308-ea70-4da6-9605-465fba77912d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.965168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46b47308-ea70-4da6-9605-465fba77912d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:26.208899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ef1b8de8-c4b9-42dd-a66b-7df866465ceb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:26.222554 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ef1b8de8-c4b9-42dd-a66b-7df866465ceb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1498 microversion: 2.1 time: 0.430874 Jul 20 04:16:26.223847 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 953/1734] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:25 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1498 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:26.231254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-66495a4a-b5bf-475d-b97d-3247aa50a7ac tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.35"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:26.547369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-66495a4a-b5bf-475d-b97d-3247aa50a7ac tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:26.558196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66495a4a-b5bf-475d-b97d-3247aa50a7ac tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:26.558919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66495a4a-b5bf-475d-b97d-3247aa50a7ac tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:26.562842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66495a4a-b5bf-475d-b97d-3247aa50a7ac tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:26.563649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66495a4a-b5bf-475d-b97d-3247aa50a7ac tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:26.782881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-46b47308-ea70-4da6-9605-465fba77912d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:26.798009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-46b47308-ea70-4da6-9605-465fba77912d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:26.803866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-46b47308-ea70-4da6-9605-465fba77912d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:26.808179 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-46b47308-ea70-4da6-9605-465fba77912d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1488 microversion: 2.25 time: 0.889424 Jul 20 04:16:26.813308 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 782/1735] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:25 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1488 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:26.932556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3411c57d-9dbd-4519-8d4e-2dc7ca2b048f tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:26.935332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3411c57d-9dbd-4519-8d4e-2dc7ca2b048f tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:26.950156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3411c57d-9dbd-4519-8d4e-2dc7ca2b048f tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:26.952813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3411c57d-9dbd-4519-8d4e-2dc7ca2b048f tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:26.960201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3411c57d-9dbd-4519-8d4e-2dc7ca2b048f tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:26.960705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3411c57d-9dbd-4519-8d4e-2dc7ca2b048f tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:27.279199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66495a4a-b5bf-475d-b97d-3247aa50a7ac tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Acquired lock "refresh_cache-b5ae9a8d-371f-4e62-899c-54d3840aa87f" {{(pid=127871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:16:27.799521 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3411c57d-9dbd-4519-8d4e-2dc7ca2b048f tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:27.835183 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3411c57d-9dbd-4519-8d4e-2dc7ca2b048f tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3" status: 200 len: 1366 microversion: 2.1 time: 0.905930 Jul 20 04:16:27.848999 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 783/1736] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:26 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3 => generated 1366 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:27.863616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-48b853ce-46f2-44af-abd0-2829e0103f0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1903418819", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d596c209-8ad5-47de-87f3-e30c0a431c35"}], "block_device_mapping_v2": [{"uuid": "d44c34f9-447b-4339-89f6-814f983856fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:27.978632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-48b853ce-46f2-44af-abd0-2829e0103f0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] validate_networks() for [('d596c209-8ad5-47de-87f3-e30c0a431c35', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:29.052827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-66495a4a-b5bf-475d-b97d-3247aa50a7ac tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Building network info cache for instance {{(pid=127871) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:16:29.055575 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:29.836329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-48b853ce-46f2-44af-abd0-2829e0103f0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:29.836831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-48b853ce-46f2-44af-abd0-2829e0103f0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:29.837265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-48b853ce-46f2-44af-abd0-2829e0103f0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:29.837979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-48b853ce-46f2-44af-abd0-2829e0103f0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:29.838415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-48b853ce-46f2-44af-abd0-2829e0103f0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:29.853652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b853ce-46f2-44af-abd0-2829e0103f0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.856748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b853ce-46f2-44af-abd0-2829e0103f0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.858021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b853ce-46f2-44af-abd0-2829e0103f0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.862172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b853ce-46f2-44af-abd0-2829e0103f0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.905480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-48b853ce-46f2-44af-abd0-2829e0103f0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Getting quotas for project 6295769a840d437c9deed641966fd143. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:29.921404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-48b853ce-46f2-44af-abd0-2829e0103f0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Getting quotas for user 106afc4bcfc04122b9afb3cc2b17cc03 and project 6295769a840d437c9deed641966fd143. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:30.057808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-48b853ce-46f2-44af-abd0-2829e0103f0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:30.060349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-48b853ce-46f2-44af-abd0-2829e0103f0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d44c34f9-447b-4339-89f6-814f983856fa',volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:30.167971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-66495a4a-b5bf-475d-b97d-3247aa50a7ac tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Updating instance_info_cache with network_info: [{"id": "d788b629-ae4b-43be-9ccc-1503bc9e05eb", "address": "fa:16:3e:23:da:a0", "network": {"id": "02803c14-35b7-4d41-afe7-2c5b8fd340b9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-727897289-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aabdfe1e44014cb9b940e5f7c7fc9938", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd788b629-ae", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127871) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:16:30.190738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66495a4a-b5bf-475d-b97d-3247aa50a7ac tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Releasing lock "refresh_cache-b5ae9a8d-371f-4e62-899c-54d3840aa87f" {{(pid=127871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:16:30.191765 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-66495a4a-b5bf-475d-b97d-3247aa50a7ac tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "POST /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f/action" status: 202 len: 0 microversion: 2.1 time: 3.966651 Jul 20 04:16:30.193006 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 954/1737] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:26 2022] POST /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f/action => generated 0 bytes in 3968 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:16:30.198454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8201621c-4baa-4ad6-a01e-023620df3fb3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:30.199750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8201621c-4baa-4ad6-a01e-023620df3fb3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:30.212650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8201621c-4baa-4ad6-a01e-023620df3fb3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.213413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8201621c-4baa-4ad6-a01e-023620df3fb3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.215287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8201621c-4baa-4ad6-a01e-023620df3fb3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.216553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8201621c-4baa-4ad6-a01e-023620df3fb3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.411291 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-48b853ce-46f2-44af-abd0-2829e0103f0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.560372 Jul 20 04:16:30.426917 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 784/1738] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:30.450290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6d51abf1-a356-4eed-8ec0-37ace84d76e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:30.451163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6d51abf1-a356-4eed-8ec0-37ace84d76e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:30.462692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d51abf1-a356-4eed-8ec0-37ace84d76e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.465931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d51abf1-a356-4eed-8ec0-37ace84d76e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.466781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d51abf1-a356-4eed-8ec0-37ace84d76e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.468114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d51abf1-a356-4eed-8ec0-37ace84d76e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.717482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8201621c-4baa-4ad6-a01e-023620df3fb3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:30.730764 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8201621c-4baa-4ad6-a01e-023620df3fb3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1498 microversion: 2.1 time: 0.536316 Jul 20 04:16:30.731376 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 955/1739] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:30 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1498 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:30.746623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0a404169-1f36-4bf2-9957-210e421613b5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:30.747249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0a404169-1f36-4bf2-9957-210e421613b5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:30.763697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a404169-1f36-4bf2-9957-210e421613b5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.764151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a404169-1f36-4bf2-9957-210e421613b5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.765422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a404169-1f36-4bf2-9957-210e421613b5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.766020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a404169-1f36-4bf2-9957-210e421613b5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.858876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6d51abf1-a356-4eed-8ec0-37ace84d76e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:30.873133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6d51abf1-a356-4eed-8ec0-37ace84d76e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:30.876870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6d51abf1-a356-4eed-8ec0-37ace84d76e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:30.878163 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6d51abf1-a356-4eed-8ec0-37ace84d76e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1488 microversion: 2.25 time: 0.448928 Jul 20 04:16:30.879883 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 785/1740] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:30 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1488 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:31.059388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0a404169-1f36-4bf2-9957-210e421613b5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:31.068846 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0a404169-1f36-4bf2-9957-210e421613b5 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3" status: 200 len: 1555 microversion: 2.1 time: 0.336358 Jul 20 04:16:31.069433 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 956/1741] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:30 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3 => generated 1555 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:31.164076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-9aa643a5-82ba-4de6-9980-98b05f09fdc5 req-e8c3a7cc-5ae6-4638-b9f2-917db08d4269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ae9a8d-371f-4e62-899c-54d3840aa87f", "tag": "d788b629-ae4b-43be-9ccc-1503bc9e05eb"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:31.182569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-9aa643a5-82ba-4de6-9980-98b05f09fdc5 req-e8c3a7cc-5ae6-4638-b9f2-917db08d4269 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.183051 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-9aa643a5-82ba-4de6-9980-98b05f09fdc5 req-e8c3a7cc-5ae6-4638-b9f2-917db08d4269 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.216356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ee544f20-a233-4e4a-a1fe-23ad60ab32a5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-17507363", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": "none"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:31.227350 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-9aa643a5-82ba-4de6-9980-98b05f09fdc5 req-e8c3a7cc-5ae6-4638-b9f2-917db08d4269 service nova] Creating event network-changed:d788b629-ae4b-43be-9ccc-1503bc9e05eb for instance b5ae9a8d-371f-4e62-899c-54d3840aa87f on n-h2-826526-5 Jul 20 04:16:31.252694 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-9aa643a5-82ba-4de6-9980-98b05f09fdc5 req-e8c3a7cc-5ae6-4638-b9f2-917db08d4269 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.370902 Jul 20 04:16:31.261335 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 786/1742] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:31.273592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8abc8e4e-afe5-4d26-9378-c7d34fc9657d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:31.274920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8abc8e4e-afe5-4d26-9378-c7d34fc9657d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:31.295193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8abc8e4e-afe5-4d26-9378-c7d34fc9657d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.298450 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8abc8e4e-afe5-4d26-9378-c7d34fc9657d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.299669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8abc8e4e-afe5-4d26-9378-c7d34fc9657d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.301904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8abc8e4e-afe5-4d26-9378-c7d34fc9657d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.336578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ee544f20-a233-4e4a-a1fe-23ad60ab32a5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:31.337498 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ee544f20-a233-4e4a-a1fe-23ad60ab32a5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:31.338991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ee544f20-a233-4e4a-a1fe-23ad60ab32a5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:31.342089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ee544f20-a233-4e4a-a1fe-23ad60ab32a5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:31.344231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ee544f20-a233-4e4a-a1fe-23ad60ab32a5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:31.368902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee544f20-a233-4e4a-a1fe-23ad60ab32a5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.369724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee544f20-a233-4e4a-a1fe-23ad60ab32a5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.371745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee544f20-a233-4e4a-a1fe-23ad60ab32a5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.373408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee544f20-a233-4e4a-a1fe-23ad60ab32a5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.389988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8abc8e4e-afe5-4d26-9378-c7d34fc9657d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:31.404517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-ee544f20-a233-4e4a-a1fe-23ad60ab32a5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Getting quotas for project 62bf47cd6f584d1aab1e39328866d8ec. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:31.421556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-ee544f20-a233-4e4a-a1fe-23ad60ab32a5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Getting quotas for user 605993a99d88480baf3444a9b6dd7735 and project 62bf47cd6f584d1aab1e39328866d8ec. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:31.460505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ee544f20-a233-4e4a-a1fe-23ad60ab32a5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:31.465797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ee544f20-a233-4e4a-a1fe-23ad60ab32a5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] [instance: b85c0220-3e18-416c-9e67-d8850e6dd2bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:31.471632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:31.592021 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ee544f20-a233-4e4a-a1fe-23ad60ab32a5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.515507 Jul 20 04:16:31.600301 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 957/1743] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 04:16:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:16:31.638663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-769d0c88-71a9-4ae2-baa5-9ac2f2ebcd17 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:31.639495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-769d0c88-71a9-4ae2-baa5-9ac2f2ebcd17 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:31.645546 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8abc8e4e-afe5-4d26-9378-c7d34fc9657d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f" status: 204 len: 0 microversion: 2.1 time: 0.380059 Jul 20 04:16:31.646189 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 787/1744] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:31 2022] DELETE /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:31.664512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-769d0c88-71a9-4ae2-baa5-9ac2f2ebcd17 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.666775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-769d0c88-71a9-4ae2-baa5-9ac2f2ebcd17 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.671221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-769d0c88-71a9-4ae2-baa5-9ac2f2ebcd17 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.674066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-769d0c88-71a9-4ae2-baa5-9ac2f2ebcd17 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.686855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-244b5689-2f15-4dc5-bc39-d2547b95cd0d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:31.687574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-244b5689-2f15-4dc5-bc39-d2547b95cd0d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:31.713783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-244b5689-2f15-4dc5-bc39-d2547b95cd0d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.714274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-244b5689-2f15-4dc5-bc39-d2547b95cd0d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.717984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-244b5689-2f15-4dc5-bc39-d2547b95cd0d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.721233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-244b5689-2f15-4dc5-bc39-d2547b95cd0d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.803716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-769d0c88-71a9-4ae2-baa5-9ac2f2ebcd17 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:31.814018 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-769d0c88-71a9-4ae2-baa5-9ac2f2ebcd17 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1095 microversion: 2.1 time: 0.206150 Jul 20 04:16:31.814956 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 958/1745] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:31 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1095 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:31.827570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cef5ff4a-5c31-4c5b-885f-234831e73af2 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:31.833719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cef5ff4a-5c31-4c5b-885f-234831e73af2 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] [instance: b85c0220-3e18-416c-9e67-d8850e6dd2bf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:31.903778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cef5ff4a-5c31-4c5b-885f-234831e73af2 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605993a99d88480baf3444a9b6dd7735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf47cd6f584d1aab1e39328866d8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:31.913342 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-244b5689-2f15-4dc5-bc39-d2547b95cd0d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.248574 Jul 20 04:16:31.914283 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 788/1746] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:16:31 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-interface => generated 284 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:31.920310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cef5ff4a-5c31-4c5b-885f-234831e73af2 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '605993a99d88480baf3444a9b6dd7735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf47cd6f584d1aab1e39328866d8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:31.921010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-87464fbf-9d35-4a88-97a2-ecb4e580f52b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.35"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:31.923704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-87464fbf-9d35-4a88-97a2-ecb4e580f52b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:31.925828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cef5ff4a-5c31-4c5b-885f-234831e73af2 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '605993a99d88480baf3444a9b6dd7735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf47cd6f584d1aab1e39328866d8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:31.927264 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cef5ff4a-5c31-4c5b-885f-234831e73af2 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] 10.222.0.17 "GET /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf" status: 200 len: 1279 microversion: 2.47 time: 0.111113 Jul 20 04:16:31.928629 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 959/1747] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:31 2022] GET /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf => generated 1279 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:31.942131 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2020ad8c-d5f4-4ecc-a15d-fcfa0c2c9e5d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:31.942807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2020ad8c-d5f4-4ecc-a15d-fcfa0c2c9e5d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:31.945811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87464fbf-9d35-4a88-97a2-ecb4e580f52b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.946280 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87464fbf-9d35-4a88-97a2-ecb4e580f52b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.949100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87464fbf-9d35-4a88-97a2-ecb4e580f52b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.950444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87464fbf-9d35-4a88-97a2-ecb4e580f52b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.957174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2020ad8c-d5f4-4ecc-a15d-fcfa0c2c9e5d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.957701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2020ad8c-d5f4-4ecc-a15d-fcfa0c2c9e5d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.958566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2020ad8c-d5f4-4ecc-a15d-fcfa0c2c9e5d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.961709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2020ad8c-d5f4-4ecc-a15d-fcfa0c2c9e5d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:32.033688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87464fbf-9d35-4a88-97a2-ecb4e580f52b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Acquired lock "refresh_cache-e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" {{(pid=127870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:16:32.463577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2020ad8c-d5f4-4ecc-a15d-fcfa0c2c9e5d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:32.476072 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2020ad8c-d5f4-4ecc-a15d-fcfa0c2c9e5d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1498 microversion: 2.1 time: 0.546269 Jul 20 04:16:32.477466 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 960/1748] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:31 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1498 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:32.491254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6c722130-2c62-4845-a400-c0c417d4c3f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:32.492041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6c722130-2c62-4845-a400-c0c417d4c3f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:32.513189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c722130-2c62-4845-a400-c0c417d4c3f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:32.514856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c722130-2c62-4845-a400-c0c417d4c3f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:32.518374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c722130-2c62-4845-a400-c0c417d4c3f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:32.519161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c722130-2c62-4845-a400-c0c417d4c3f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:32.992655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6c722130-2c62-4845-a400-c0c417d4c3f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:33.013293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6c722130-2c62-4845-a400-c0c417d4c3f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:33.024372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6c722130-2c62-4845-a400-c0c417d4c3f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:33.027690 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6c722130-2c62-4845-a400-c0c417d4c3f9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1488 microversion: 2.25 time: 0.547026 Jul 20 04:16:33.028917 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 961/1749] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:32 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1488 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:33.040189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bde997be-575c-429f-a4b0-6e5383eb404f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:33.041379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bde997be-575c-429f-a4b0-6e5383eb404f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:33.064218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:33.067576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bde997be-575c-429f-a4b0-6e5383eb404f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.068562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bde997be-575c-429f-a4b0-6e5383eb404f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.069552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bde997be-575c-429f-a4b0-6e5383eb404f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.070155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bde997be-575c-429f-a4b0-6e5383eb404f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.612726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bde997be-575c-429f-a4b0-6e5383eb404f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:33.629274 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bde997be-575c-429f-a4b0-6e5383eb404f tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1169 microversion: 2.1 time: 0.599059 Jul 20 04:16:33.630906 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 962/1750] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:33 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1169 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:33.642476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4f7444ca-186e-4443-b453-a4f6719e398d tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:33.643085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4f7444ca-186e-4443-b453-a4f6719e398d tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] [instance: b85c0220-3e18-416c-9e67-d8850e6dd2bf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:33.653044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f7444ca-186e-4443-b453-a4f6719e398d tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.655236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f7444ca-186e-4443-b453-a4f6719e398d tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.656254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f7444ca-186e-4443-b453-a4f6719e398d tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.657536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f7444ca-186e-4443-b453-a4f6719e398d tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.870128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4f7444ca-186e-4443-b453-a4f6719e398d tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605993a99d88480baf3444a9b6dd7735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf47cd6f584d1aab1e39328866d8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:33.894158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4f7444ca-186e-4443-b453-a4f6719e398d tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '605993a99d88480baf3444a9b6dd7735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf47cd6f584d1aab1e39328866d8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:33.900194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4f7444ca-186e-4443-b453-a4f6719e398d tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '605993a99d88480baf3444a9b6dd7735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf47cd6f584d1aab1e39328866d8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:33.902806 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4f7444ca-186e-4443-b453-a4f6719e398d tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] 10.222.0.17 "GET /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf" status: 200 len: 1337 microversion: 2.47 time: 0.270214 Jul 20 04:16:33.907222 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 963/1751] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:33 2022] GET /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf => generated 1337 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:33.912325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6f485aea-7c73-414b-86b2-5bee2e141f3d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:33.929971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6f485aea-7c73-414b-86b2-5bee2e141f3d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:33.945160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f485aea-7c73-414b-86b2-5bee2e141f3d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.948174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f485aea-7c73-414b-86b2-5bee2e141f3d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.949341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f485aea-7c73-414b-86b2-5bee2e141f3d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.951697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f485aea-7c73-414b-86b2-5bee2e141f3d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.249504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6f485aea-7c73-414b-86b2-5bee2e141f3d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:34.263603 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6f485aea-7c73-414b-86b2-5bee2e141f3d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1498 microversion: 2.1 time: 0.355225 Jul 20 04:16:34.270890 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 964/1752] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:33 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1498 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:34.294153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dcce4e65-c6fe-4264-b8dc-aba66940f4e1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:34.302031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dcce4e65-c6fe-4264-b8dc-aba66940f4e1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:34.321212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcce4e65-c6fe-4264-b8dc-aba66940f4e1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.321823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcce4e65-c6fe-4264-b8dc-aba66940f4e1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.322619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcce4e65-c6fe-4264-b8dc-aba66940f4e1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.323053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcce4e65-c6fe-4264-b8dc-aba66940f4e1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.682678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dcce4e65-c6fe-4264-b8dc-aba66940f4e1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:34.702662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dcce4e65-c6fe-4264-b8dc-aba66940f4e1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:34.704163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dcce4e65-c6fe-4264-b8dc-aba66940f4e1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:34.728806 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dcce4e65-c6fe-4264-b8dc-aba66940f4e1 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1488 microversion: 2.25 time: 0.432046 Jul 20 04:16:34.732507 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 965/1753] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:34 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1488 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:34.744776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-055450ba-1a04-491e-8368-bea4c1f0877c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:34.745466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-055450ba-1a04-491e-8368-bea4c1f0877c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:34.754719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-055450ba-1a04-491e-8368-bea4c1f0877c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.764902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-055450ba-1a04-491e-8368-bea4c1f0877c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.765796 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-055450ba-1a04-491e-8368-bea4c1f0877c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.766239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-055450ba-1a04-491e-8368-bea4c1f0877c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.931410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-055450ba-1a04-491e-8368-bea4c1f0877c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:34.940639 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-055450ba-1a04-491e-8368-bea4c1f0877c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1169 microversion: 2.1 time: 0.206584 Jul 20 04:16:34.941570 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 966/1754] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:34 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1169 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:34.956398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ffd2c30b-0f7e-4d9e-b979-a1a5e92da9be tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:34.957904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ffd2c30b-0f7e-4d9e-b979-a1a5e92da9be tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] [instance: b85c0220-3e18-416c-9e67-d8850e6dd2bf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:34.976736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffd2c30b-0f7e-4d9e-b979-a1a5e92da9be tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.977615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffd2c30b-0f7e-4d9e-b979-a1a5e92da9be tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.983407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffd2c30b-0f7e-4d9e-b979-a1a5e92da9be tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.984283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffd2c30b-0f7e-4d9e-b979-a1a5e92da9be tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.795330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ffd2c30b-0f7e-4d9e-b979-a1a5e92da9be tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605993a99d88480baf3444a9b6dd7735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf47cd6f584d1aab1e39328866d8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:35.811831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ffd2c30b-0f7e-4d9e-b979-a1a5e92da9be tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '605993a99d88480baf3444a9b6dd7735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf47cd6f584d1aab1e39328866d8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:35.817454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ffd2c30b-0f7e-4d9e-b979-a1a5e92da9be tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '605993a99d88480baf3444a9b6dd7735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf47cd6f584d1aab1e39328866d8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:35.818903 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ffd2c30b-0f7e-4d9e-b979-a1a5e92da9be tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] 10.222.0.17 "GET /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf" status: 200 len: 1337 microversion: 2.47 time: 0.876155 Jul 20 04:16:35.819641 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 967/1755] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:34 2022] GET /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf => generated 1337 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:35.839454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e615b9a4-04cc-44ef-b3cd-8796ed4ad2d3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:35.840640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e615b9a4-04cc-44ef-b3cd-8796ed4ad2d3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:35.849145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e615b9a4-04cc-44ef-b3cd-8796ed4ad2d3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.849878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e615b9a4-04cc-44ef-b3cd-8796ed4ad2d3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.851110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e615b9a4-04cc-44ef-b3cd-8796ed4ad2d3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.852116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e615b9a4-04cc-44ef-b3cd-8796ed4ad2d3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.139846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e615b9a4-04cc-44ef-b3cd-8796ed4ad2d3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:36.155618 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e615b9a4-04cc-44ef-b3cd-8796ed4ad2d3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1498 microversion: 2.1 time: 0.319447 Jul 20 04:16:36.156671 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 968/1756] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:35 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1498 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:36.176757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-687218bd-cc81-4c6e-8d4c-1b10e2833700 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:36.201221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-687218bd-cc81-4c6e-8d4c-1b10e2833700 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:36.223624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-687218bd-cc81-4c6e-8d4c-1b10e2833700 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.227081 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-687218bd-cc81-4c6e-8d4c-1b10e2833700 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.234327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-687218bd-cc81-4c6e-8d4c-1b10e2833700 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.236034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-687218bd-cc81-4c6e-8d4c-1b10e2833700 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.585259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-687218bd-cc81-4c6e-8d4c-1b10e2833700 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:36.595500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-687218bd-cc81-4c6e-8d4c-1b10e2833700 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:36.602493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-687218bd-cc81-4c6e-8d4c-1b10e2833700 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:36.603731 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-687218bd-cc81-4c6e-8d4c-1b10e2833700 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1488 microversion: 2.25 time: 0.445089 Jul 20 04:16:36.610132 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 969/1757] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:36 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1488 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:36.621680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-6f3bb3db-d8d8-4235-b39f-5a71e6cbf03d req-5d78714b-62df-42e7-baee-bf376d17dcec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee9170bb-33df-43d7-b35f-1d846da620d3", "tag": "08cf3082-9efd-4024-be41-ac9e072b2995"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:36.646803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-6f3bb3db-d8d8-4235-b39f-5a71e6cbf03d req-5d78714b-62df-42e7-baee-bf376d17dcec service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.648385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-6f3bb3db-d8d8-4235-b39f-5a71e6cbf03d req-5d78714b-62df-42e7-baee-bf376d17dcec service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.690121 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-6f3bb3db-d8d8-4235-b39f-5a71e6cbf03d req-5d78714b-62df-42e7-baee-bf376d17dcec service nova] Creating event network-changed:08cf3082-9efd-4024-be41-ac9e072b2995 for instance ee9170bb-33df-43d7-b35f-1d846da620d3 on n-h2-826526-5 Jul 20 04:16:36.699928 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-6f3bb3db-d8d8-4235-b39f-5a71e6cbf03d req-5d78714b-62df-42e7-baee-bf376d17dcec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087784 Jul 20 04:16:36.703890 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 970/1758] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:36.710721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-84dd5dae-526b-4ec3-b308-a3ffb583082d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:36.715291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-84dd5dae-526b-4ec3-b308-a3ffb583082d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:36.725209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84dd5dae-526b-4ec3-b308-a3ffb583082d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.726004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84dd5dae-526b-4ec3-b308-a3ffb583082d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.727054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84dd5dae-526b-4ec3-b308-a3ffb583082d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.727826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84dd5dae-526b-4ec3-b308-a3ffb583082d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.885746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-84dd5dae-526b-4ec3-b308-a3ffb583082d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:36.900192 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-84dd5dae-526b-4ec3-b308-a3ffb583082d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1169 microversion: 2.1 time: 0.194040 Jul 20 04:16:36.912394 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 971/1759] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:36 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1169 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:36.922732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-af8b2bdd-e66e-4555-9676-b4f7adb97d0d req-8d0b96f8-b80a-4593-a130-d16afb5a072f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ae9a8d-371f-4e62-899c-54d3840aa87f", "name": "network-vif-deleted", "tag": "d788b629-ae4b-43be-9ccc-1503bc9e05eb"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:36.934181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-af8b2bdd-e66e-4555-9676-b4f7adb97d0d req-8d0b96f8-b80a-4593-a130-d16afb5a072f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.934817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-af8b2bdd-e66e-4555-9676-b4f7adb97d0d req-8d0b96f8-b80a-4593-a130-d16afb5a072f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.966677 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-af8b2bdd-e66e-4555-9676-b4f7adb97d0d req-8d0b96f8-b80a-4593-a130-d16afb5a072f service nova] Creating event network-vif-deleted:d788b629-ae4b-43be-9ccc-1503bc9e05eb for instance b5ae9a8d-371f-4e62-899c-54d3840aa87f on n-h2-826526-5 Jul 20 04:16:36.975520 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-af8b2bdd-e66e-4555-9676-b4f7adb97d0d req-8d0b96f8-b80a-4593-a130-d16afb5a072f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061107 Jul 20 04:16:36.979728 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 972/1760] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:36.988776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fa170418-6334-4411-9ca4-a86a51083c72 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:36.990940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fa170418-6334-4411-9ca4-a86a51083c72 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] [instance: b85c0220-3e18-416c-9e67-d8850e6dd2bf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:37.006427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa170418-6334-4411-9ca4-a86a51083c72 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.006896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa170418-6334-4411-9ca4-a86a51083c72 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.012306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa170418-6334-4411-9ca4-a86a51083c72 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.012770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa170418-6334-4411-9ca4-a86a51083c72 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.038597 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:37.125675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fa170418-6334-4411-9ca4-a86a51083c72 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605993a99d88480baf3444a9b6dd7735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf47cd6f584d1aab1e39328866d8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:37.139643 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fa170418-6334-4411-9ca4-a86a51083c72 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '605993a99d88480baf3444a9b6dd7735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf47cd6f584d1aab1e39328866d8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:37.142144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fa170418-6334-4411-9ca4-a86a51083c72 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '605993a99d88480baf3444a9b6dd7735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf47cd6f584d1aab1e39328866d8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:37.144210 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fa170418-6334-4411-9ca4-a86a51083c72 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] 10.222.0.17 "GET /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf" status: 200 len: 1358 microversion: 2.47 time: 0.163277 Jul 20 04:16:37.145464 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 973/1761] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:36 2022] GET /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:37.166252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-665c0d20-3173-4094-b67d-237ce960133e tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1196482172"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:37.167850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-665c0d20-3173-4094-b67d-237ce960133e tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] [instance: b85c0220-3e18-416c-9e67-d8850e6dd2bf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:37.192309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-665c0d20-3173-4094-b67d-237ce960133e tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.192770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-665c0d20-3173-4094-b67d-237ce960133e tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.196676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-665c0d20-3173-4094-b67d-237ce960133e tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.198379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-665c0d20-3173-4094-b67d-237ce960133e tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.828347 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-665c0d20-3173-4094-b67d-237ce960133e tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] 10.222.0.17 "POST /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf/action" status: 202 len: 52 microversion: 2.47 time: 0.664551 Jul 20 04:16:37.830015 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 974/1762] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jul 20 04:16:37 2022] POST /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf/action => generated 52 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Jul 20 04:16:37.847148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3a1b47c1-539d-40bf-8d60-359a82ad4564 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:37.849724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3a1b47c1-539d-40bf-8d60-359a82ad4564 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:37.858969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a1b47c1-539d-40bf-8d60-359a82ad4564 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.859979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a1b47c1-539d-40bf-8d60-359a82ad4564 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.861123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a1b47c1-539d-40bf-8d60-359a82ad4564 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.861803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a1b47c1-539d-40bf-8d60-359a82ad4564 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:38.096581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3a1b47c1-539d-40bf-8d60-359a82ad4564 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:38.107023 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3a1b47c1-539d-40bf-8d60-359a82ad4564 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1498 microversion: 2.1 time: 0.266614 Jul 20 04:16:38.107614 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 975/1763] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:37 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1498 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:38.114270 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1d2e677d-59d6-4acc-bb1c-37707c2b650f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:38.114883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1d2e677d-59d6-4acc-bb1c-37707c2b650f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:38.121327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d2e677d-59d6-4acc-bb1c-37707c2b650f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:38.121806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d2e677d-59d6-4acc-bb1c-37707c2b650f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:38.122609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d2e677d-59d6-4acc-bb1c-37707c2b650f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:38.123061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d2e677d-59d6-4acc-bb1c-37707c2b650f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:38.302185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-87464fbf-9d35-4a88-97a2-ecb4e580f52b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Building network info cache for instance {{(pid=127870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:16:38.325251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1d2e677d-59d6-4acc-bb1c-37707c2b650f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:38.338356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1d2e677d-59d6-4acc-bb1c-37707c2b650f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:38.342252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1d2e677d-59d6-4acc-bb1c-37707c2b650f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:38.343569 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1d2e677d-59d6-4acc-bb1c-37707c2b650f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1488 microversion: 2.25 time: 0.234728 Jul 20 04:16:38.353059 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 976/1764] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:38 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1488 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:38.358132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-084aeb0a-1087-4614-9710-1607f05b3bc6 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:38.358640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-084aeb0a-1087-4614-9710-1607f05b3bc6 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] [instance: b85c0220-3e18-416c-9e67-d8850e6dd2bf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:38.378147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-084aeb0a-1087-4614-9710-1607f05b3bc6 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:38.378617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-084aeb0a-1087-4614-9710-1607f05b3bc6 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:38.384132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-084aeb0a-1087-4614-9710-1607f05b3bc6 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:38.385615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-084aeb0a-1087-4614-9710-1607f05b3bc6 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:38.435724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-084aeb0a-1087-4614-9710-1607f05b3bc6 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] [instance: b85c0220-3e18-416c-9e67-d8850e6dd2bf] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:38.695649 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-084aeb0a-1087-4614-9710-1607f05b3bc6 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf" status: 204 len: 0 microversion: 2.47 time: 0.340909 Jul 20 04:16:38.702070 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 977/1765] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:16:38 2022] DELETE /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:16:38.719069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f067e963-bf14-4358-95c5-adbfa4c44ae6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:38.723688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f067e963-bf14-4358-95c5-adbfa4c44ae6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:38.734801 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f067e963-bf14-4358-95c5-adbfa4c44ae6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:38.735870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f067e963-bf14-4358-95c5-adbfa4c44ae6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:38.737950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f067e963-bf14-4358-95c5-adbfa4c44ae6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:38.739005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f067e963-bf14-4358-95c5-adbfa4c44ae6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.055352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f067e963-bf14-4358-95c5-adbfa4c44ae6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:39.063559 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f067e963-bf14-4358-95c5-adbfa4c44ae6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1211 microversion: 2.1 time: 0.359592 Jul 20 04:16:39.068496 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 978/1766] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:38 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1211 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:39.074040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e08dfd5d-86a8-4057-89c3-a79d0fa1eda5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:39.077872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e08dfd5d-86a8-4057-89c3-a79d0fa1eda5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] [instance: b85c0220-3e18-416c-9e67-d8850e6dd2bf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:39.095826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e08dfd5d-86a8-4057-89c3-a79d0fa1eda5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.096565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e08dfd5d-86a8-4057-89c3-a79d0fa1eda5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.097580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e08dfd5d-86a8-4057-89c3-a79d0fa1eda5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.101065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e08dfd5d-86a8-4057-89c3-a79d0fa1eda5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.202658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e08dfd5d-86a8-4057-89c3-a79d0fa1eda5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605993a99d88480baf3444a9b6dd7735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf47cd6f584d1aab1e39328866d8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:39.216803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e08dfd5d-86a8-4057-89c3-a79d0fa1eda5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '605993a99d88480baf3444a9b6dd7735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf47cd6f584d1aab1e39328866d8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:39.218405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e08dfd5d-86a8-4057-89c3-a79d0fa1eda5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '605993a99d88480baf3444a9b6dd7735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf47cd6f584d1aab1e39328866d8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:39.223169 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e08dfd5d-86a8-4057-89c3-a79d0fa1eda5 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] 10.222.0.17 "GET /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf" status: 200 len: 1364 microversion: 2.47 time: 0.153120 Jul 20 04:16:39.226175 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 979/1767] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:39 2022] GET /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:39.246396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-97c0bd94-22b1-4a4c-8c27-f3421ae75a5d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:39.247873 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-97c0bd94-22b1-4a4c-8c27-f3421ae75a5d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:39.272561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97c0bd94-22b1-4a4c-8c27-f3421ae75a5d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.273275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97c0bd94-22b1-4a4c-8c27-f3421ae75a5d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.274287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97c0bd94-22b1-4a4c-8c27-f3421ae75a5d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.274909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97c0bd94-22b1-4a4c-8c27-f3421ae75a5d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.510485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-97c0bd94-22b1-4a4c-8c27-f3421ae75a5d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:39.527053 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-97c0bd94-22b1-4a4c-8c27-f3421ae75a5d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1498 microversion: 2.1 time: 0.297956 Jul 20 04:16:39.527887 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 980/1768] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:39 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1498 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:39.534976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-1d4f1d2b-c6d0-4d52-b01c-33317b4946ea req-eee7b6ad-62d9-488a-9dbc-0a99f92521c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e27a49d1-11a9-47e6-b680-bb5d5e5e38ee", "tag": "963beecd-90f4-4da3-9538-8b41d8af8789"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:39.562416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1d4f1d2b-c6d0-4d52-b01c-33317b4946ea req-eee7b6ad-62d9-488a-9dbc-0a99f92521c1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.564107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1d4f1d2b-c6d0-4d52-b01c-33317b4946ea req-eee7b6ad-62d9-488a-9dbc-0a99f92521c1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.584821 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-1d4f1d2b-c6d0-4d52-b01c-33317b4946ea req-eee7b6ad-62d9-488a-9dbc-0a99f92521c1 service nova] Creating event network-changed:963beecd-90f4-4da3-9538-8b41d8af8789 for instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee on n-h2-826526-5 Jul 20 04:16:39.591814 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-1d4f1d2b-c6d0-4d52-b01c-33317b4946ea req-eee7b6ad-62d9-488a-9dbc-0a99f92521c1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062119 Jul 20 04:16:39.594003 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 981/1769] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:39.614633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4e040928-7b93-409f-835e-525ab61a3a9f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:39.615707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4e040928-7b93-409f-835e-525ab61a3a9f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:39.624287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e040928-7b93-409f-835e-525ab61a3a9f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.625556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e040928-7b93-409f-835e-525ab61a3a9f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.626614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e040928-7b93-409f-835e-525ab61a3a9f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.627345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e040928-7b93-409f-835e-525ab61a3a9f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.882695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:39.938004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:39.945064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4e040928-7b93-409f-835e-525ab61a3a9f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:39.960329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4e040928-7b93-409f-835e-525ab61a3a9f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:39.966588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4e040928-7b93-409f-835e-525ab61a3a9f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:39.967921 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4e040928-7b93-409f-835e-525ab61a3a9f tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1488 microversion: 2.25 time: 0.372534 Jul 20 04:16:39.971111 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 982/1770] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:39 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1488 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:40.082322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2bd93e0b-b992-4896-bef7-50f24bb36cb1 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:40.083828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2bd93e0b-b992-4896-bef7-50f24bb36cb1 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:40.097452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bd93e0b-b992-4896-bef7-50f24bb36cb1 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.098854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bd93e0b-b992-4896-bef7-50f24bb36cb1 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:40.103138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bd93e0b-b992-4896-bef7-50f24bb36cb1 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.103915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bd93e0b-b992-4896-bef7-50f24bb36cb1 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:40.947575 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2bd93e0b-b992-4896-bef7-50f24bb36cb1 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:40.962043 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2bd93e0b-b992-4896-bef7-50f24bb36cb1 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1211 microversion: 2.1 time: 0.883430 Jul 20 04:16:40.962854 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 983/1771] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:40 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1211 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:40.970363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8f21a063-fb47-44a2-8b3e-ca6903d1d1f7 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:40.971240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8f21a063-fb47-44a2-8b3e-ca6903d1d1f7 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] [instance: b85c0220-3e18-416c-9e67-d8850e6dd2bf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:40.977851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f21a063-fb47-44a2-8b3e-ca6903d1d1f7 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.979363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f21a063-fb47-44a2-8b3e-ca6903d1d1f7 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:40.980453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f21a063-fb47-44a2-8b3e-ca6903d1d1f7 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.981118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f21a063-fb47-44a2-8b3e-ca6903d1d1f7 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.118241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8f21a063-fb47-44a2-8b3e-ca6903d1d1f7 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605993a99d88480baf3444a9b6dd7735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf47cd6f584d1aab1e39328866d8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:41.131816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8f21a063-fb47-44a2-8b3e-ca6903d1d1f7 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '605993a99d88480baf3444a9b6dd7735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf47cd6f584d1aab1e39328866d8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:41.133807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8f21a063-fb47-44a2-8b3e-ca6903d1d1f7 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '605993a99d88480baf3444a9b6dd7735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf47cd6f584d1aab1e39328866d8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:41.135282 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8f21a063-fb47-44a2-8b3e-ca6903d1d1f7 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] 10.222.0.17 "GET /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf" status: 200 len: 1364 microversion: 2.47 time: 0.169956 Jul 20 04:16:41.149129 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 984/1772] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:40 2022] GET /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:41.154197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-032c1b99-b529-4be6-baff-2991fc3f26d9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:41.155083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-032c1b99-b529-4be6-baff-2991fc3f26d9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:41.161517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-032c1b99-b529-4be6-baff-2991fc3f26d9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.162271 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-032c1b99-b529-4be6-baff-2991fc3f26d9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.163254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-032c1b99-b529-4be6-baff-2991fc3f26d9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.163903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-032c1b99-b529-4be6-baff-2991fc3f26d9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.391221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:41.909330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=8 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:41.933175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:42.046565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-032c1b99-b529-4be6-baff-2991fc3f26d9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:42.054610 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-032c1b99-b529-4be6-baff-2991fc3f26d9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1498 microversion: 2.1 time: 0.904093 Jul 20 04:16:42.068165 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 985/1773] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:41 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1498 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:42.079058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6bc650f9-8eb7-432f-b29e-1352d9ad2e8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:42.079659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6bc650f9-8eb7-432f-b29e-1352d9ad2e8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:42.092404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6bc650f9-8eb7-432f-b29e-1352d9ad2e8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.092909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6bc650f9-8eb7-432f-b29e-1352d9ad2e8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.093950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6bc650f9-8eb7-432f-b29e-1352d9ad2e8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.094389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6bc650f9-8eb7-432f-b29e-1352d9ad2e8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.289233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-87464fbf-9d35-4a88-97a2-ecb4e580f52b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Updating instance_info_cache with network_info: [{"id": "963beecd-90f4-4da3-9538-8b41d8af8789", "address": "fa:16:3e:a7:09:fb", "network": {"id": "02803c14-35b7-4d41-afe7-2c5b8fd340b9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-727897289-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aabdfe1e44014cb9b940e5f7c7fc9938", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap963beecd-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:16:42.298784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87464fbf-9d35-4a88-97a2-ecb4e580f52b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Releasing lock "refresh_cache-e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" {{(pid=127870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:16:42.305285 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-87464fbf-9d35-4a88-97a2-ecb4e580f52b tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "POST /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee/action" status: 202 len: 0 microversion: 2.1 time: 10.389264 Jul 20 04:16:42.306061 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 789/1774] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:31 2022] POST /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee/action => generated 0 bytes in 10391 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:16:42.313536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-27749c0d-1796-4c28-94c8-f5d7336bb422 req-bd04786d-14cf-4276-bdea-fc80dc1db394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c4bdc1-7bb8-47c0-b73f-317ba18949df", "name": "network-vif-unplugged", "status": "completed", "tag": "7c532b32-d9c8-43cb-aa4c-635e4487021e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:42.325057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-27749c0d-1796-4c28-94c8-f5d7336bb422 req-bd04786d-14cf-4276-bdea-fc80dc1db394 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.326257 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-27749c0d-1796-4c28-94c8-f5d7336bb422 req-bd04786d-14cf-4276-bdea-fc80dc1db394 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.342940 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-27749c0d-1796-4c28-94c8-f5d7336bb422 req-bd04786d-14cf-4276-bdea-fc80dc1db394 service nova] Creating event network-vif-unplugged:7c532b32-d9c8-43cb-aa4c-635e4487021e for instance 32c4bdc1-7bb8-47c0-b73f-317ba18949df on n-h1-826526-5 Jul 20 04:16:42.349613 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-27749c0d-1796-4c28-94c8-f5d7336bb422 req-bd04786d-14cf-4276-bdea-fc80dc1db394 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041937 Jul 20 04:16:42.351122 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 790/1775] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:42.358126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bee6ffcc-fd85-4237-9158-c764cfc90d3c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:42.359251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bee6ffcc-fd85-4237-9158-c764cfc90d3c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:42.367964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bee6ffcc-fd85-4237-9158-c764cfc90d3c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.368930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bee6ffcc-fd85-4237-9158-c764cfc90d3c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.369970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bee6ffcc-fd85-4237-9158-c764cfc90d3c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.370695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bee6ffcc-fd85-4237-9158-c764cfc90d3c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.534583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6bc650f9-8eb7-432f-b29e-1352d9ad2e8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:42.559030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6bc650f9-8eb7-432f-b29e-1352d9ad2e8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:42.560742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6bc650f9-8eb7-432f-b29e-1352d9ad2e8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:42.562031 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6bc650f9-8eb7-432f-b29e-1352d9ad2e8d tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1488 microversion: 2.25 time: 0.492629 Jul 20 04:16:42.562614 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 986/1776] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:42 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1488 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:42.582035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-97b3ac6c-9d48-4e26-935f-b93de8e9f014 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:42.582615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-97b3ac6c-9d48-4e26-935f-b93de8e9f014 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] [instance: b85c0220-3e18-416c-9e67-d8850e6dd2bf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:42.590290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97b3ac6c-9d48-4e26-935f-b93de8e9f014 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.591420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97b3ac6c-9d48-4e26-935f-b93de8e9f014 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.597236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97b3ac6c-9d48-4e26-935f-b93de8e9f014 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.598798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97b3ac6c-9d48-4e26-935f-b93de8e9f014 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.622180 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-97b3ac6c-9d48-4e26-935f-b93de8e9f014 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] HTTP exception thrown: Instance b85c0220-3e18-416c-9e67-d8850e6dd2bf could not be found. Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-97b3ac6c-9d48-4e26-935f-b93de8e9f014 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Request method failure captured: Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf HTTP/1.1 Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14GdAan01XsfF6MnbZFzskWJXWsbDgRyQT5AWF23duz2x3nT7grL1ZmQAmdyNsNTWw95pjnpakozpA9wBPyAuQ8afeVob33uFn0fxDlrvf9JE2DJ6xqzxDVwpT7Q35ZFPIADNdXM3-HVEIYvBSxaZ3rpWSKhh04ufQGfzDxvU_JZYjs Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: X-Openstack-Nova-Api-Version: 2.47 Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 62bf47cd6f584d1aab1e39328866d8ec Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersAaction247Test-863901877 Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:16:42.624330 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:16:42.626239 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/62bf47cd6f584d1aab1e39328866d8ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/62bf47cd6f584d1aab1e39328866d8ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_62bf47cd6f584d1aab1e39328866d8ec", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/62bf47cd6f584d1aab1e39328866d8ec"}]}] Jul 20 04:16:42.626239 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersAaction247Test-863901877 Jul 20 04:16:42.626239 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 62bf47cd6f584d1aab1e39328866d8ec Jul 20 04:16:42.626239 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersAaction247Test-863901877 Jul 20 04:16:42.626239 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersAaction247Test-863901877-project Jul 20 04:16:42.626239 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:16:42.626239 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:16:42.626239 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 605993a99d88480baf3444a9b6dd7735 Jul 20 04:16:42.626239 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersAaction247Test-863901877-project Jul 20 04:16:42.626239 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:16:42.626239 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance b85c0220-3e18-416c-9e67-d8850e6dd2bf could not be found. Jul 20 04:16:42.626239 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'b85c0220-3e18-416c-9e67-d8850e6dd2bf'} Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b85c0220-3e18-416c-9e67-d8850e6dd2bf could not be found. Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:42.627137 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:42.631082 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:42.631082 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:16:42.631082 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:16:42.631082 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:42.631082 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:42.631082 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:42.631082 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:42.631082 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b85c0220-3e18-416c-9e67-d8850e6dd2bf could not be found. Jul 20 04:16:42.631082 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:42.631082 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:42.631082 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:42.631082 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:42.631082 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:42.631082 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:42.631082 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:42.631082 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:42.631082 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b85c0220-3e18-416c-9e67-d8850e6dd2bf could not be found. Jul 20 04:16:42.631082 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:16:42.637170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-97b3ac6c-9d48-4e26-935f-b93de8e9f014 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] Returning 404 to user: Instance b85c0220-3e18-416c-9e67-d8850e6dd2bf could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:42.638321 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-97b3ac6c-9d48-4e26-935f-b93de8e9f014 tempest-ServersAaction247Test-863901877 tempest-ServersAaction247Test-863901877-project] 10.222.0.17 "GET /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf" status: 404 len: 111 microversion: 2.47 time: 0.069109 Jul 20 04:16:42.639473 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 987/1777] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:42 2022] GET /compute/v2.1/servers/b85c0220-3e18-416c-9e67-d8850e6dd2bf => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:16:42.648567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-484d233a-cd11-4661-afbe-35868110b331 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '.version_select at 0x7f06bda67310>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:42.815458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bee6ffcc-fd85-4237-9158-c764cfc90d3c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:42.845556 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bee6ffcc-fd85-4237-9158-c764cfc90d3c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1199 microversion: 2.1 time: 0.492469 Jul 20 04:16:42.846978 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 791/1778] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:42 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1199 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:43.071096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-45e10d55-8e44-4a97-85a7-a68529e3f963 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:43.072558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-45e10d55-8e44-4a97-85a7-a68529e3f963 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:43.088029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45e10d55-8e44-4a97-85a7-a68529e3f963 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.089954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45e10d55-8e44-4a97-85a7-a68529e3f963 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.098420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45e10d55-8e44-4a97-85a7-a68529e3f963 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.099458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45e10d55-8e44-4a97-85a7-a68529e3f963 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.252495 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-484d233a-cd11-4661-afbe-35868110b331 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/fd67e9f2-8509-42c5-8d76-0ebbf9399364" status: 200 len: 184 microversion: 2.1 time: 0.611464 Jul 20 04:16:43.253115 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 988/1779] 10.222.0.17 () {58 vars in 1259 bytes} [Wed Jul 20 04:16:42 2022] GET /compute/v2.1/os-floating-ips/fd67e9f2-8509-42c5-8d76-0ebbf9399364 => generated 184 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:43.264914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9d516e3e-9213-4408-a342-2505a0b2256d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.35"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:43.491974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9d516e3e-9213-4408-a342-2505a0b2256d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:43.501448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d516e3e-9213-4408-a342-2505a0b2256d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.502445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d516e3e-9213-4408-a342-2505a0b2256d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.503536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d516e3e-9213-4408-a342-2505a0b2256d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.504149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d516e3e-9213-4408-a342-2505a0b2256d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.525670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:43.760490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d516e3e-9213-4408-a342-2505a0b2256d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Acquired lock "refresh_cache-e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" {{(pid=127871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:16:44.154410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-45e10d55-8e44-4a97-85a7-a68529e3f963 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:44.163671 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-45e10d55-8e44-4a97-85a7-a68529e3f963 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 200 len: 1475 microversion: 2.1 time: 1.096419 Jul 20 04:16:44.164417 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 792/1780] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:43 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 1475 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:44.170203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c9edd4c3-459a-4177-944f-d48b54185cac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:44.170953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c9edd4c3-459a-4177-944f-d48b54185cac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:44.177360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9edd4c3-459a-4177-944f-d48b54185cac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.177913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9edd4c3-459a-4177-944f-d48b54185cac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.179047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9edd4c3-459a-4177-944f-d48b54185cac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.179546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9edd4c3-459a-4177-944f-d48b54185cac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.758201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c9edd4c3-459a-4177-944f-d48b54185cac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:44.774436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c9edd4c3-459a-4177-944f-d48b54185cac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:44.781573 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c9edd4c3-459a-4177-944f-d48b54185cac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:44.783482 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c9edd4c3-459a-4177-944f-d48b54185cac tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1488 microversion: 2.25 time: 0.617733 Jul 20 04:16:44.786642 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 793/1781] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:44 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1488 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:44.797493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-14d92cff-a9bd-403c-8532-5730e0c020b8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:44.798274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-14d92cff-a9bd-403c-8532-5730e0c020b8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:44.805739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14d92cff-a9bd-403c-8532-5730e0c020b8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.806703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14d92cff-a9bd-403c-8532-5730e0c020b8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.807815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14d92cff-a9bd-403c-8532-5730e0c020b8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.808514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14d92cff-a9bd-403c-8532-5730e0c020b8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.099693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-9d516e3e-9213-4408-a342-2505a0b2256d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Building network info cache for instance {{(pid=127871) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:16:45.351758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-14d92cff-a9bd-403c-8532-5730e0c020b8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:45.369819 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-14d92cff-a9bd-403c-8532-5730e0c020b8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1199 microversion: 2.1 time: 0.578557 Jul 20 04:16:45.372207 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 794/1782] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:44 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1199 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:45.385725 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-30f3a75b-62ff-4d1b-aa5d-201cb74189eb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-123430286"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:45.389729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-30f3a75b-62ff-4d1b-aa5d-201cb74189eb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:45.402731 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30f3a75b-62ff-4d1b-aa5d-201cb74189eb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.403638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30f3a75b-62ff-4d1b-aa5d-201cb74189eb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.404820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30f3a75b-62ff-4d1b-aa5d-201cb74189eb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.405573 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30f3a75b-62ff-4d1b-aa5d-201cb74189eb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.995639 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-30f3a75b-62ff-4d1b-aa5d-201cb74189eb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "POST /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5/action" status: 202 len: 0 microversion: 2.1 time: 0.621520 Jul 20 04:16:45.996715 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 795/1783] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:45 2022] POST /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:16:46.005663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-a056fdfc-6bcd-43b0-95a6-abf330a53045 req-3444b0ad-123b-4e58-b420-ccfe68221cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c4bdc1-7bb8-47c0-b73f-317ba18949df", "tag": "7c532b32-d9c8-43cb-aa4c-635e4487021e"}, {"name": "network-changed", "server_uuid": "7b62c758-d90d-48b5-903f-7553734f4cfe", "tag": "be0fb241-a959-4d10-85fb-6ddb8e17edb2"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:46.026713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a056fdfc-6bcd-43b0-95a6-abf330a53045 req-3444b0ad-123b-4e58-b420-ccfe68221cfd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.027465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a056fdfc-6bcd-43b0-95a6-abf330a53045 req-3444b0ad-123b-4e58-b420-ccfe68221cfd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.045707 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-a056fdfc-6bcd-43b0-95a6-abf330a53045 req-3444b0ad-123b-4e58-b420-ccfe68221cfd service nova] Creating event network-changed:7c532b32-d9c8-43cb-aa4c-635e4487021e for instance 32c4bdc1-7bb8-47c0-b73f-317ba18949df on n-h1-826526-5 Jul 20 04:16:46.046741 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-a056fdfc-6bcd-43b0-95a6-abf330a53045 req-3444b0ad-123b-4e58-b420-ccfe68221cfd service nova] Creating event network-changed:be0fb241-a959-4d10-85fb-6ddb8e17edb2 for instance 7b62c758-d90d-48b5-903f-7553734f4cfe on n-h1-826526-5 Jul 20 04:16:46.060833 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-a056fdfc-6bcd-43b0-95a6-abf330a53045 req-3444b0ad-123b-4e58-b420-ccfe68221cfd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.061744 Jul 20 04:16:46.062239 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 796/1784] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:46.070342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-c9e67ed6-3f0e-4f4b-8f1f-5b1beaa4f99c req-54678263-7e75-4e37-bc61-b7240be2387a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e27a49d1-11a9-47e6-b680-bb5d5e5e38ee", "tag": "963beecd-90f4-4da3-9538-8b41d8af8789"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:46.085457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c9e67ed6-3f0e-4f4b-8f1f-5b1beaa4f99c req-54678263-7e75-4e37-bc61-b7240be2387a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.086526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c9e67ed6-3f0e-4f4b-8f1f-5b1beaa4f99c req-54678263-7e75-4e37-bc61-b7240be2387a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.105630 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-c9e67ed6-3f0e-4f4b-8f1f-5b1beaa4f99c req-54678263-7e75-4e37-bc61-b7240be2387a service nova] Creating event network-changed:963beecd-90f4-4da3-9538-8b41d8af8789 for instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee on n-h2-826526-5 Jul 20 04:16:46.112390 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-c9e67ed6-3f0e-4f4b-8f1f-5b1beaa4f99c req-54678263-7e75-4e37-bc61-b7240be2387a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048321 Jul 20 04:16:46.113958 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 797/1785] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:46.121305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-43a761ae-31d3-4abc-9ffe-464ca0bcb3db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:46.122433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-43a761ae-31d3-4abc-9ffe-464ca0bcb3db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:46.133766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43a761ae-31d3-4abc-9ffe-464ca0bcb3db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.134927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43a761ae-31d3-4abc-9ffe-464ca0bcb3db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.136522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43a761ae-31d3-4abc-9ffe-464ca0bcb3db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.137398 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43a761ae-31d3-4abc-9ffe-464ca0bcb3db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.990143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-9d516e3e-9213-4408-a342-2505a0b2256d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Updating instance_info_cache with network_info: [{"id": "963beecd-90f4-4da3-9538-8b41d8af8789", "address": "fa:16:3e:a7:09:fb", "network": {"id": "02803c14-35b7-4d41-afe7-2c5b8fd340b9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-727897289-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aabdfe1e44014cb9b940e5f7c7fc9938", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap963beecd-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127871) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:16:47.018409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d516e3e-9213-4408-a342-2505a0b2256d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Releasing lock "refresh_cache-e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" {{(pid=127871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:16:47.019988 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9d516e3e-9213-4408-a342-2505a0b2256d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "POST /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee/action" status: 202 len: 0 microversion: 2.1 time: 3.758664 Jul 20 04:16:47.024750 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 989/1786] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:43 2022] POST /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee/action => generated 0 bytes in 3763 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 20 04:16:47.036897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9df89f81-16b7-4fb9-83fe-8a9c6c4af218 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c74208b0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.148695 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9df89f81-16b7-4fb9-83fe-8a9c6c4af218 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.122255 Jul 20 04:16:47.149561 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 990/1787] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:47 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:47.154237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6d1be829-b0b2-4929-8648-661401421e2a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.154861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6d1be829-b0b2-4929-8648-661401421e2a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:47.171812 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d1be829-b0b2-4929-8648-661401421e2a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.172312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d1be829-b0b2-4929-8648-661401421e2a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.183426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d1be829-b0b2-4929-8648-661401421e2a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.184247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d1be829-b0b2-4929-8648-661401421e2a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.410626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-43a761ae-31d3-4abc-9ffe-464ca0bcb3db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:47.423915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-43a761ae-31d3-4abc-9ffe-464ca0bcb3db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:47.431144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-43a761ae-31d3-4abc-9ffe-464ca0bcb3db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:47.434809 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-43a761ae-31d3-4abc-9ffe-464ca0bcb3db tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1488 microversion: 2.25 time: 1.319280 Jul 20 04:16:47.436360 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 798/1788] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:46 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1488 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:47.451273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3f9b2f37-9e44-4498-882c-d9a0931b9a22 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.452195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3f9b2f37-9e44-4498-882c-d9a0931b9a22 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:47.464634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f9b2f37-9e44-4498-882c-d9a0931b9a22 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.466224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f9b2f37-9e44-4498-882c-d9a0931b9a22 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.468641 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f9b2f37-9e44-4498-882c-d9a0931b9a22 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.470342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f9b2f37-9e44-4498-882c-d9a0931b9a22 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.509057 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-3f9b2f37-9e44-4498-882c-d9a0931b9a22 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] HTTP exception thrown: Instance b5ae9a8d-371f-4e62-899c-54d3840aa87f could not be found. Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3f9b2f37-9e44-4498-882c-d9a0931b9a22 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Request method failure captured: Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f HTTP/1.1 Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14E78gf6en3SFEOeLm1R4lD_j3nbKIbxJoN6xj6b01OhhyV0rnZh_D5mQg0dwVm3OvUzEOFz4Ob9E7jqyYI0kzVZfkKwUrdzPfl7cc2OLc1W_7BQuZQI_x2yB76pR0c5i69-xavS_qxLeSnnvCDLQtKzhQ_DalXPGpax6KJZvmB-PAI Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: aabdfe1e44014cb9b940e5f7c7fc9938 Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-116001615 Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:16:47.513966 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:16:47.516144 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aabdfe1e44014cb9b940e5f7c7fc9938"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aabdfe1e44014cb9b940e5f7c7fc9938"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aabdfe1e44014cb9b940e5f7c7fc9938", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aabdfe1e44014cb9b940e5f7c7fc9938"}]}] Jul 20 04:16:47.516144 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-116001615 Jul 20 04:16:47.516144 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: aabdfe1e44014cb9b940e5f7c7fc9938 Jul 20 04:16:47.516144 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-116001615 Jul 20 04:16:47.516144 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-FloatingIPsAssociationTestJSON-116001615-project Jul 20 04:16:47.516144 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:16:47.516144 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:16:47.516144 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: b8a99f17308e4a21be83507470946b76 Jul 20 04:16:47.516144 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-116001615-project Jul 20 04:16:47.516144 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:16:47.516144 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance b5ae9a8d-371f-4e62-899c-54d3840aa87f could not be found. Jul 20 04:16:47.516144 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'b5ae9a8d-371f-4e62-899c-54d3840aa87f'} Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5ae9a8d-371f-4e62-899c-54d3840aa87f could not be found. Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:47.517273 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5ae9a8d-371f-4e62-899c-54d3840aa87f could not be found. Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5ae9a8d-371f-4e62-899c-54d3840aa87f could not be found. Jul 20 04:16:47.519136 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:16:47.522028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3f9b2f37-9e44-4498-882c-d9a0931b9a22 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Returning 404 to user: Instance b5ae9a8d-371f-4e62-899c-54d3840aa87f could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:47.525352 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3f9b2f37-9e44-4498-882c-d9a0931b9a22 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f" status: 404 len: 111 microversion: 2.1 time: 0.087955 Jul 20 04:16:47.528138 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 799/1789] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:47 2022] DELETE /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:47.530533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3f9b2f37-9e44-4498-882c-d9a0931b9a22 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.535047 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3f9b2f37-9e44-4498-882c-d9a0931b9a22 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002999 Jul 20 04:16:47.537633 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 800/1790] 10.222.0.17 () {56 vars in 885 bytes} [Wed Jul 20 04:16:47 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 04:16:47.552170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-54fdba99-0382-47ef-bd03-3cb358200be7 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.554276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-54fdba99-0382-47ef-bd03-3cb358200be7 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: b5ae9a8d-371f-4e62-899c-54d3840aa87f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:47.571148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54fdba99-0382-47ef-bd03-3cb358200be7 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.574632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54fdba99-0382-47ef-bd03-3cb358200be7 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.579839 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54fdba99-0382-47ef-bd03-3cb358200be7 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.580658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54fdba99-0382-47ef-bd03-3cb358200be7 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.639955 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6d1be829-b0b2-4929-8648-661401421e2a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:47.657174 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6d1be829-b0b2-4929-8648-661401421e2a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1199 microversion: 2.1 time: 0.498315 Jul 20 04:16:47.667156 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 991/1791] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:47 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1199 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-54fdba99-0382-47ef-bd03-3cb358200be7 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] HTTP exception thrown: Instance b5ae9a8d-371f-4e62-899c-54d3840aa87f could not be found. Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-54fdba99-0382-47ef-bd03-3cb358200be7 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Request method failure captured: Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f HTTP/1.1 Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14E78gf6en3SFEOeLm1R4lD_j3nbKIbxJoN6xj6b01OhhyV0rnZh_D5mQg0dwVm3OvUzEOFz4Ob9E7jqyYI0kzVZfkKwUrdzPfl7cc2OLc1W_7BQuZQI_x2yB76pR0c5i69-xavS_qxLeSnnvCDLQtKzhQ_DalXPGpax6KJZvmB-PAI Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: aabdfe1e44014cb9b940e5f7c7fc9938 Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-116001615 Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:16:47.667420 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:16:47.669810 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aabdfe1e44014cb9b940e5f7c7fc9938"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aabdfe1e44014cb9b940e5f7c7fc9938"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aabdfe1e44014cb9b940e5f7c7fc9938", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aabdfe1e44014cb9b940e5f7c7fc9938"}]}] Jul 20 04:16:47.669810 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-116001615 Jul 20 04:16:47.669810 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: aabdfe1e44014cb9b940e5f7c7fc9938 Jul 20 04:16:47.669810 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-116001615 Jul 20 04:16:47.669810 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-FloatingIPsAssociationTestJSON-116001615-project Jul 20 04:16:47.669810 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:16:47.669810 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:16:47.669810 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: b8a99f17308e4a21be83507470946b76 Jul 20 04:16:47.669810 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-116001615-project Jul 20 04:16:47.669810 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:16:47.669810 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance b5ae9a8d-371f-4e62-899c-54d3840aa87f could not be found. Jul 20 04:16:47.669810 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'b5ae9a8d-371f-4e62-899c-54d3840aa87f'} Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5ae9a8d-371f-4e62-899c-54d3840aa87f could not be found. Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:47.670644 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:47.673131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:47.673131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:16:47.673131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:16:47.673131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:47.673131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:47.673131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:47.673131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:47.673131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5ae9a8d-371f-4e62-899c-54d3840aa87f could not be found. Jul 20 04:16:47.673131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:16:47.673131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:47.673131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:16:47.673131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:47.673131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:47.673131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:47.673131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:47.673131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:47.673131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5ae9a8d-371f-4e62-899c-54d3840aa87f could not be found. Jul 20 04:16:47.673131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:16:47.676698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-54fdba99-0382-47ef-bd03-3cb358200be7 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Returning 404 to user: Instance b5ae9a8d-371f-4e62-899c-54d3840aa87f could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:47.676698 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-54fdba99-0382-47ef-bd03-3cb358200be7 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f" status: 404 len: 111 microversion: 2.1 time: 0.126571 Jul 20 04:16:47.676698 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 801/1792] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:47 2022] GET /compute/v2.1/servers/b5ae9a8d-371f-4e62-899c-54d3840aa87f => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:47.678060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0afdf638-5953-461f-bb12-34dda0e3fdc5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '.version_select at 0x7f06bdda6310>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:48.162386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c350eec4-ecf7-4498-b216-b72ed1f6806d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be871e50>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:48.248146 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c350eec4-ecf7-4498-b216-b72ed1f6806d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.089818 Jul 20 04:16:48.249007 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 802/1793] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:48 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:48.459579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-432b1e2f-1ccd-4707-a37b-89dc68364969 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:48.460922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-432b1e2f-1ccd-4707-a37b-89dc68364969 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:48.487977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-432b1e2f-1ccd-4707-a37b-89dc68364969 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.489888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-432b1e2f-1ccd-4707-a37b-89dc68364969 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.495054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-432b1e2f-1ccd-4707-a37b-89dc68364969 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.496089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-432b1e2f-1ccd-4707-a37b-89dc68364969 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.555722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-432b1e2f-1ccd-4707-a37b-89dc68364969 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:49.575132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-432b1e2f-1ccd-4707-a37b-89dc68364969 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:49.581241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-432b1e2f-1ccd-4707-a37b-89dc68364969 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:49.582590 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-432b1e2f-1ccd-4707-a37b-89dc68364969 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1488 microversion: 2.25 time: 1.128605 Jul 20 04:16:49.589064 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 803/1794] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:48 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1488 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:49.595718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8d27835c-3eb7-49f8-88e2-cc170d7b1f42 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:49.600321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8d27835c-3eb7-49f8-88e2-cc170d7b1f42 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:49.612003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d27835c-3eb7-49f8-88e2-cc170d7b1f42 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.614334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d27835c-3eb7-49f8-88e2-cc170d7b1f42 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.615201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d27835c-3eb7-49f8-88e2-cc170d7b1f42 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.615645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d27835c-3eb7-49f8-88e2-cc170d7b1f42 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.120844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8d27835c-3eb7-49f8-88e2-cc170d7b1f42 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:50.138869 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8d27835c-3eb7-49f8-88e2-cc170d7b1f42 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1199 microversion: 2.1 time: 0.545931 Jul 20 04:16:50.154195 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 804/1795] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:49 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1199 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:50.247657 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0afdf638-5953-461f-bb12-34dda0e3fdc5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/fd67e9f2-8509-42c5-8d76-0ebbf9399364" status: 202 len: 0 microversion: 2.1 time: 2.573965 Jul 20 04:16:50.249319 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 992/1796] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:16:47 2022] DELETE /compute/v2.1/os-floating-ips/fd67e9f2-8509-42c5-8d76-0ebbf9399364 => generated 0 bytes in 2576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:50.255695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-44701bf1-461f-4e2a-874a-026126cd817c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c7495820>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:50.375710 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-44701bf1-461f-4e2a-874a-026126cd817c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.124514 Jul 20 04:16:50.377118 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 993/1797] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:50 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:50.389853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-4639a54c-8a96-4f13-9bb7-21dc16ef7a6c req-2fba7f12-ad40-4c52-bc98-612706571da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c4bdc1-7bb8-47c0-b73f-317ba18949df", "name": "network-vif-unplugged", "status": "completed", "tag": "7c532b32-d9c8-43cb-aa4c-635e4487021e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:50.417560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4639a54c-8a96-4f13-9bb7-21dc16ef7a6c req-2fba7f12-ad40-4c52-bc98-612706571da5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.420402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4639a54c-8a96-4f13-9bb7-21dc16ef7a6c req-2fba7f12-ad40-4c52-bc98-612706571da5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.455186 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-4639a54c-8a96-4f13-9bb7-21dc16ef7a6c req-2fba7f12-ad40-4c52-bc98-612706571da5 service nova] Creating event network-vif-unplugged:7c532b32-d9c8-43cb-aa4c-635e4487021e for instance 32c4bdc1-7bb8-47c0-b73f-317ba18949df on n-h1-826526-5 Jul 20 04:16:50.479724 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-4639a54c-8a96-4f13-9bb7-21dc16ef7a6c req-2fba7f12-ad40-4c52-bc98-612706571da5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099706 Jul 20 04:16:50.481699 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 994/1798] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:50.506743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5d4d6ef2-fd15-479f-9a97-a3bb3fd76cc5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:50.508180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5d4d6ef2-fd15-479f-9a97-a3bb3fd76cc5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:50.537796 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d4d6ef2-fd15-479f-9a97-a3bb3fd76cc5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.538431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d4d6ef2-fd15-479f-9a97-a3bb3fd76cc5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.543340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d4d6ef2-fd15-479f-9a97-a3bb3fd76cc5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.546059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d4d6ef2-fd15-479f-9a97-a3bb3fd76cc5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.644309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5d4d6ef2-fd15-479f-9a97-a3bb3fd76cc5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:50.983524 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5d4d6ef2-fd15-479f-9a97-a3bb3fd76cc5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 204 len: 0 microversion: 2.1 time: 0.498452 Jul 20 04:16:50.984179 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 995/1799] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:50 2022] DELETE /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:50.996394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dc9920e8-7a71-4d27-a367-85895af41c67 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:50.998716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dc9920e8-7a71-4d27-a367-85895af41c67 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:51.008909 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eb8cedf3-4281-4faa-8ed8-25965e45297d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1501389309", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "ecc907e0-adff-45c2-95dc-044e6d8bcd7d"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:51.035112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc9920e8-7a71-4d27-a367-85895af41c67 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.035610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc9920e8-7a71-4d27-a367-85895af41c67 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.039167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc9920e8-7a71-4d27-a367-85895af41c67 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.039688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc9920e8-7a71-4d27-a367-85895af41c67 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.140181 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-eb8cedf3-4281-4faa-8ed8-25965e45297d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] validate_networks() for [('ecc907e0-adff-45c2-95dc-044e6d8bcd7d', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:51.569154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dc9920e8-7a71-4d27-a367-85895af41c67 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:51.577971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dc9920e8-7a71-4d27-a367-85895af41c67 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:51.583363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dc9920e8-7a71-4d27-a367-85895af41c67 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:51.590774 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dc9920e8-7a71-4d27-a367-85895af41c67 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1488 microversion: 2.25 time: 0.605021 Jul 20 04:16:51.591729 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 996/1800] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:50 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1488 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:51.618549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3c8bc531-d769-4495-8b16-0db605090a9d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:51.619555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3c8bc531-d769-4495-8b16-0db605090a9d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:51.649517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c8bc531-d769-4495-8b16-0db605090a9d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.662612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c8bc531-d769-4495-8b16-0db605090a9d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.663665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c8bc531-d769-4495-8b16-0db605090a9d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.665949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c8bc531-d769-4495-8b16-0db605090a9d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.090762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-eb8cedf3-4281-4faa-8ed8-25965e45297d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:52.091893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-eb8cedf3-4281-4faa-8ed8-25965e45297d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:52.092746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-eb8cedf3-4281-4faa-8ed8-25965e45297d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:52.093720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-eb8cedf3-4281-4faa-8ed8-25965e45297d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:52.094710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-eb8cedf3-4281-4faa-8ed8-25965e45297d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:52.119035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb8cedf3-4281-4faa-8ed8-25965e45297d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.129166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb8cedf3-4281-4faa-8ed8-25965e45297d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.130486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb8cedf3-4281-4faa-8ed8-25965e45297d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.132920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb8cedf3-4281-4faa-8ed8-25965e45297d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.180090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-eb8cedf3-4281-4faa-8ed8-25965e45297d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Getting quotas for project 5a7fc5df24c0437b9a21746466ca9bc2. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:52.193184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-eb8cedf3-4281-4faa-8ed8-25965e45297d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Getting quotas for user 5b06b12e39f947a2acfb1574e53b910c and project 5a7fc5df24c0437b9a21746466ca9bc2. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:52.247550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eb8cedf3-4281-4faa-8ed8-25965e45297d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:52.262425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eb8cedf3-4281-4faa-8ed8-25965e45297d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:52.400839 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eb8cedf3-4281-4faa-8ed8-25965e45297d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.242969 Jul 20 04:16:52.409528 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 805/1801] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:52.417023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d7b7eba5-9418-4bde-b43d-b5123fb7a032 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:52.420683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d7b7eba5-9418-4bde-b43d-b5123fb7a032 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:52.448058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7b7eba5-9418-4bde-b43d-b5123fb7a032 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.450913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7b7eba5-9418-4bde-b43d-b5123fb7a032 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.454220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7b7eba5-9418-4bde-b43d-b5123fb7a032 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.454897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7b7eba5-9418-4bde-b43d-b5123fb7a032 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.463176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3c8bc531-d769-4495-8b16-0db605090a9d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:52.477696 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3c8bc531-d769-4495-8b16-0db605090a9d tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 200 len: 1526 microversion: 2.1 time: 0.884581 Jul 20 04:16:52.484055 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 997/1802] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:51 2022] GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 1526 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:52.495943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-266652ce-9d47-4ecf-b3df-dd21267aeeff tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bdda6310>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:52.583818 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-266652ce-9d47-4ecf-b3df-dd21267aeeff tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.098019 Jul 20 04:16:52.594758 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 998/1803] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:52 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:52.913247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d7b7eba5-9418-4bde-b43d-b5123fb7a032 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:52.922336 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d7b7eba5-9418-4bde-b43d-b5123fb7a032 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1199 microversion: 2.1 time: 0.511112 Jul 20 04:16:52.931175 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 806/1804] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:52 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1199 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:52.942641 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f75f4bd3-c0b7-4083-90a7-d89069e078da tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:52.954907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f75f4bd3-c0b7-4083-90a7-d89069e078da tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:53.002112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a63aa021-736a-4f53-96d7-7bbccc0d6577 tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] Action: 'create', calling method: .version_select at 0x7f06c7428b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2016889266", "metadata": {"Type": "work"}}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:53.263352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f75f4bd3-c0b7-4083-90a7-d89069e078da tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b06b12e39f947a2acfb1574e53b910c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7fc5df24c0437b9a21746466ca9bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:53.271449 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f75f4bd3-c0b7-4083-90a7-d89069e078da tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 200 len: 1217 microversion: 2.1 time: 0.337496 Jul 20 04:16:53.284670 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 807/1805] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:52 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 1217 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:53.297454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4128d111-a184-4cfa-94ba-834cf7917139 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:53.301151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4128d111-a184-4cfa-94ba-834cf7917139 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:53.358455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4128d111-a184-4cfa-94ba-834cf7917139 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.359791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4128d111-a184-4cfa-94ba-834cf7917139 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.360982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4128d111-a184-4cfa-94ba-834cf7917139 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.362663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4128d111-a184-4cfa-94ba-834cf7917139 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.895990 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a63aa021-736a-4f53-96d7-7bbccc0d6577 tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.299881 Jul 20 04:16:53.897902 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 999/1806] 10.222.0.17 () {60 vars in 1155 bytes} [Wed Jul 20 04:16:52 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1303 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 04:16:53.910029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-da35db71-3464-4a80-be4a-2a43b56894ed req-62f3d982-b4ff-4e63-abf4-40a7af8f478c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2976722a-674d-49e5-b4e3-3aebf11d51c5", "name": "network-vif-plugged", "status": "completed", "tag": "a90d62a0-b1f9-47e0-a6cd-97d4474f8e74"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:53.967026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-da35db71-3464-4a80-be4a-2a43b56894ed req-62f3d982-b4ff-4e63-abf4-40a7af8f478c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.971720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-da35db71-3464-4a80-be4a-2a43b56894ed req-62f3d982-b4ff-4e63-abf4-40a7af8f478c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.081166 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-da35db71-3464-4a80-be4a-2a43b56894ed req-62f3d982-b4ff-4e63-abf4-40a7af8f478c service nova] Creating event network-vif-plugged:a90d62a0-b1f9-47e0-a6cd-97d4474f8e74 for instance 2976722a-674d-49e5-b4e3-3aebf11d51c5 on n-h1-826526-5 Jul 20 04:16:54.132146 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-da35db71-3464-4a80-be4a-2a43b56894ed req-62f3d982-b4ff-4e63-abf4-40a7af8f478c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226300 Jul 20 04:16:54.153750 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1000/1807] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:54.185445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-623a8ecb-bf97-40eb-8b3b-6e7bb2f45d50 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.188779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-623a8ecb-bf97-40eb-8b3b-6e7bb2f45d50 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:54.221507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-623a8ecb-bf97-40eb-8b3b-6e7bb2f45d50 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.221958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-623a8ecb-bf97-40eb-8b3b-6e7bb2f45d50 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.241262 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-623a8ecb-bf97-40eb-8b3b-6e7bb2f45d50 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.241850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-623a8ecb-bf97-40eb-8b3b-6e7bb2f45d50 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.442934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4128d111-a184-4cfa-94ba-834cf7917139 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:54.487205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4128d111-a184-4cfa-94ba-834cf7917139 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:54.493640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4128d111-a184-4cfa-94ba-834cf7917139 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:54.495486 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4128d111-a184-4cfa-94ba-834cf7917139 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1488 microversion: 2.25 time: 1.208710 Jul 20 04:16:54.506391 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 808/1808] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:53 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1488 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:54.520915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9d708888-98af-4bd0-8b3d-b4c575cf2d46 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be2dbd30>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.655250 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9d708888-98af-4bd0-8b3d-b4c575cf2d46 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.144426 Jul 20 04:16:54.655822 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 809/1809] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:54.676079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2fb5908b-4a46-4501-8451-b3deb950e163 tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] Calling method '.version_select at 0x7f06be86baf0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.709506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-623a8ecb-bf97-40eb-8b3b-6e7bb2f45d50 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:54.719110 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-623a8ecb-bf97-40eb-8b3b-6e7bb2f45d50 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 200 len: 1484 microversion: 2.1 time: 0.563779 Jul 20 04:16:54.719709 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1001/1810] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 1484 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:54.750275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-66a86a4f-9f29-460f-8fd0-a8066d656455 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.758365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-66a86a4f-9f29-460f-8fd0-a8066d656455 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:54.813024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66a86a4f-9f29-460f-8fd0-a8066d656455 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.813656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66a86a4f-9f29-460f-8fd0-a8066d656455 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.844635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66a86a4f-9f29-460f-8fd0-a8066d656455 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.844635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66a86a4f-9f29-460f-8fd0-a8066d656455 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.898630 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2fb5908b-4a46-4501-8451-b3deb950e163 tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8" status: 200 len: 353 microversion: 2.1 time: 0.241481 Jul 20 04:16:54.899789 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 810/1811] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8 => generated 353 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:54.909485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d2b159b-b184-41ee-8bdd-ebe564c83e99 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.910458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d2b159b-b184-41ee-8bdd-ebe564c83e99 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:54.941292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d2b159b-b184-41ee-8bdd-ebe564c83e99 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.942289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d2b159b-b184-41ee-8bdd-ebe564c83e99 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.944126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d2b159b-b184-41ee-8bdd-ebe564c83e99 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.949565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d2b159b-b184-41ee-8bdd-ebe564c83e99 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.966555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:55.258510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d2b159b-b184-41ee-8bdd-ebe564c83e99 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b06b12e39f947a2acfb1574e53b910c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7fc5df24c0437b9a21746466ca9bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:55.269359 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d2b159b-b184-41ee-8bdd-ebe564c83e99 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 200 len: 1269 microversion: 2.1 time: 0.366585 Jul 20 04:16:55.290170 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 811/1812] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 1269 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:55.299389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-502b4e71-73e5-4e50-b625-e145a60872f4 req-6859a29c-451f-42fb-b0e0-6ee1218a5215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e27a49d1-11a9-47e6-b680-bb5d5e5e38ee", "name": "network-vif-deleted", "tag": "963beecd-90f4-4da3-9538-8b41d8af8789"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:55.308883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-502b4e71-73e5-4e50-b625-e145a60872f4 req-6859a29c-451f-42fb-b0e0-6ee1218a5215 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.309745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-502b4e71-73e5-4e50-b625-e145a60872f4 req-6859a29c-451f-42fb-b0e0-6ee1218a5215 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.323792 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-502b4e71-73e5-4e50-b625-e145a60872f4 req-6859a29c-451f-42fb-b0e0-6ee1218a5215 service nova] Creating event network-vif-deleted:963beecd-90f4-4da3-9538-8b41d8af8789 for instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee on n-h2-826526-5 Jul 20 04:16:55.331057 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-502b4e71-73e5-4e50-b625-e145a60872f4 req-6859a29c-451f-42fb-b0e0-6ee1218a5215 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039197 Jul 20 04:16:55.332475 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 812/1813] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:55.539257 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-16f54764-3a68-4ba0-8646-3e692a2df7ca tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:55.540024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-16f54764-3a68-4ba0-8646-3e692a2df7ca tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:55.579023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16f54764-3a68-4ba0-8646-3e692a2df7ca tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.581671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16f54764-3a68-4ba0-8646-3e692a2df7ca tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.596289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16f54764-3a68-4ba0-8646-3e692a2df7ca tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.597138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16f54764-3a68-4ba0-8646-3e692a2df7ca tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.755314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-66a86a4f-9f29-460f-8fd0-a8066d656455 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:55.768770 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-66a86a4f-9f29-460f-8fd0-a8066d656455 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1199 microversion: 2.1 time: 1.041474 Jul 20 04:16:55.771676 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1002/1814] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1199 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:55.794917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-286c5934-def0-475e-893c-2794270199b0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be6b70d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:55.900930 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-286c5934-def0-475e-893c-2794270199b0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.127959 Jul 20 04:16:55.901855 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1003/1815] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:55 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:55.920958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-287baa37-eff9-4cfd-8d3d-1d104036830c tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:55.921688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-287baa37-eff9-4cfd-8d3d-1d104036830c tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:55.943628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-287baa37-eff9-4cfd-8d3d-1d104036830c tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.944771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-287baa37-eff9-4cfd-8d3d-1d104036830c tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.952542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-287baa37-eff9-4cfd-8d3d-1d104036830c tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.959999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-287baa37-eff9-4cfd-8d3d-1d104036830c tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.072806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-287baa37-eff9-4cfd-8d3d-1d104036830c tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.074990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-287baa37-eff9-4cfd-8d3d-1d104036830c tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.077496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-287baa37-eff9-4cfd-8d3d-1d104036830c tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lazy-loading 'fault' on Instance uuid e27a49d1-11a9-47e6-b680-bb5d5e5e38ee {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:56.279237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-16f54764-3a68-4ba0-8646-3e692a2df7ca tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:56.295144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-16f54764-3a68-4ba0-8646-3e692a2df7ca tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:56.300566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-16f54764-3a68-4ba0-8646-3e692a2df7ca tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:56.301853 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-16f54764-3a68-4ba0-8646-3e692a2df7ca tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1488 microversion: 2.25 time: 0.780221 Jul 20 04:16:56.304677 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 813/1816] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:55 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1488 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:56.318104 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-61649e4e-6985-4d81-8e81-4719d8b7b3c9 tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] Calling method '.version_select at 0x7f06be7a2700>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:56.502972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-287baa37-eff9-4cfd-8d3d-1d104036830c tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a99f17308e4a21be83507470946b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdfe1e44014cb9b940e5f7c7fc9938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:56.516056 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-287baa37-eff9-4cfd-8d3d-1d104036830c tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 200 len: 1314 microversion: 2.1 time: 0.612710 Jul 20 04:16:56.517226 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1004/1817] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:55 2022] GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:56.528093 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-61649e4e-6985-4d81-8e81-4719d8b7b3c9 tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8" status: 200 len: 353 microversion: 2.1 time: 0.222252 Jul 20 04:16:56.533083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-11be4909-97fb-4b4c-b654-88d60912d9e1 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:56.533482 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 814/1818] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:16:56 2022] GET /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8 => generated 353 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:56.534247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-11be4909-97fb-4b4c-b654-88d60912d9e1 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:56.580142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11be4909-97fb-4b4c-b654-88d60912d9e1 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.581079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11be4909-97fb-4b4c-b654-88d60912d9e1 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.582173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11be4909-97fb-4b4c-b654-88d60912d9e1 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.585205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11be4909-97fb-4b4c-b654-88d60912d9e1 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.790004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-565572d2-92dd-4b47-b99c-318509782df8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:56.790644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-565572d2-92dd-4b47-b99c-318509782df8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:56.808827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-11be4909-97fb-4b4c-b654-88d60912d9e1 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b06b12e39f947a2acfb1574e53b910c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7fc5df24c0437b9a21746466ca9bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:56.818196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-565572d2-92dd-4b47-b99c-318509782df8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.818660 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-565572d2-92dd-4b47-b99c-318509782df8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.819570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-565572d2-92dd-4b47-b99c-318509782df8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.819795 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-11be4909-97fb-4b4c-b654-88d60912d9e1 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 200 len: 1275 microversion: 2.1 time: 0.298290 Jul 20 04:16:56.819939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-565572d2-92dd-4b47-b99c-318509782df8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.829585 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1005/1819] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:56 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 1275 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:56.915809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-62e951cd-75ee-439e-9c6b-71449d8ee021 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bd9dba60>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:56.996773 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-62e951cd-75ee-439e-9c6b-71449d8ee021 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.081115 Jul 20 04:16:56.998418 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1006/1820] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:56 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:57.232050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-565572d2-92dd-4b47-b99c-318509782df8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:57.241033 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-565572d2-92dd-4b47-b99c-318509782df8 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1199 microversion: 2.1 time: 0.456290 Jul 20 04:16:57.242262 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 815/1821] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:56 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1199 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:57.324630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-30f06e17-1278-499f-ad46-d7f1b083af40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:57.325317 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-30f06e17-1278-499f-ad46-d7f1b083af40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:57.346407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30f06e17-1278-499f-ad46-d7f1b083af40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.347092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30f06e17-1278-499f-ad46-d7f1b083af40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.348063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30f06e17-1278-499f-ad46-d7f1b083af40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.348690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30f06e17-1278-499f-ad46-d7f1b083af40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.536093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-285816c2-dfec-457a-a6d2-54f7b76774e5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:57.536993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-285816c2-dfec-457a-a6d2-54f7b76774e5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] [instance: e27a49d1-11a9-47e6-b680-bb5d5e5e38ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:57.555186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-285816c2-dfec-457a-a6d2-54f7b76774e5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.556677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-285816c2-dfec-457a-a6d2-54f7b76774e5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.557938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-285816c2-dfec-457a-a6d2-54f7b76774e5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.560967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-285816c2-dfec-457a-a6d2-54f7b76774e5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.591903 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-285816c2-dfec-457a-a6d2-54f7b76774e5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] HTTP exception thrown: Instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee could not be found. Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-285816c2-dfec-457a-a6d2-54f7b76774e5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Request method failure captured: Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee HTTP/1.1 Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14E78gf6en3SFEOeLm1R4lD_j3nbKIbxJoN6xj6b01OhhyV0rnZh_D5mQg0dwVm3OvUzEOFz4Ob9E7jqyYI0kzVZfkKwUrdzPfl7cc2OLc1W_7BQuZQI_x2yB76pR0c5i69-xavS_qxLeSnnvCDLQtKzhQ_DalXPGpax6KJZvmB-PAI Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: aabdfe1e44014cb9b940e5f7c7fc9938 Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-116001615 Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:16:57.598624 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:16:57.600687 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aabdfe1e44014cb9b940e5f7c7fc9938"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aabdfe1e44014cb9b940e5f7c7fc9938"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aabdfe1e44014cb9b940e5f7c7fc9938", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aabdfe1e44014cb9b940e5f7c7fc9938"}]}] Jul 20 04:16:57.600687 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-116001615 Jul 20 04:16:57.600687 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: aabdfe1e44014cb9b940e5f7c7fc9938 Jul 20 04:16:57.600687 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-116001615 Jul 20 04:16:57.600687 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-FloatingIPsAssociationTestJSON-116001615-project Jul 20 04:16:57.600687 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:16:57.600687 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:16:57.600687 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: b8a99f17308e4a21be83507470946b76 Jul 20 04:16:57.600687 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-116001615-project Jul 20 04:16:57.600687 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:16:57.600687 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee could not be found. Jul 20 04:16:57.600687 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'e27a49d1-11a9-47e6-b680-bb5d5e5e38ee'} Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee could not be found. Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:57.601699 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:57.603417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:57.603417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:16:57.603417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:16:57.603417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:57.603417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:57.603417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:57.603417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:57.603417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee could not be found. Jul 20 04:16:57.603417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:16:57.603417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:57.603417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:16:57.603417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:57.603417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:57.603417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:57.603417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:57.603417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:57.603417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee could not be found. Jul 20 04:16:57.603417 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:16:57.607177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-285816c2-dfec-457a-a6d2-54f7b76774e5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] Returning 404 to user: Instance e27a49d1-11a9-47e6-b680-bb5d5e5e38ee could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:57.608243 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-285816c2-dfec-457a-a6d2-54f7b76774e5 tempest-FloatingIPsAssociationTestJSON-116001615 tempest-FloatingIPsAssociationTestJSON-116001615-project] 10.222.0.17 "GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee" status: 404 len: 111 microversion: 2.1 time: 0.077397 Jul 20 04:16:57.629939 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 816/1822] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:57 2022] GET /compute/v2.1/servers/e27a49d1-11a9-47e6-b680-bb5d5e5e38ee => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:57.636908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-56d07d8a-cb5e-4197-be41-6eb0906df3ab tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] Calling method '.version_select at 0x7f06be062ca0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:57.744722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-30f06e17-1278-499f-ad46-d7f1b083af40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:57.755828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-30f06e17-1278-499f-ad46-d7f1b083af40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:57.767469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-30f06e17-1278-499f-ad46-d7f1b083af40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:57.772340 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-30f06e17-1278-499f-ad46-d7f1b083af40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1478 microversion: 2.25 time: 0.449786 Jul 20 04:16:57.773523 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1007/1823] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:57 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1478 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:57.790375 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-56d07d8a-cb5e-4197-be41-6eb0906df3ab tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8" status: 200 len: 354 microversion: 2.1 time: 0.159068 Jul 20 04:16:57.791455 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 817/1824] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:16:57 2022] GET /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8 => generated 354 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:57.819103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-99719640-1c29-4ea6-a825-79e9fc4f043f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '.version_select at 0x7f06be2c6160>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:57.822266 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5060eb4e-3ac1-4807-ba99-871975578e18 tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] Calling method '.version_select at 0x7f06bedb4700>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:57.825203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-99719640-1c29-4ea6-a825-79e9fc4f043f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.829890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-99719640-1c29-4ea6-a825-79e9fc4f043f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.889032 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-99719640-1c29-4ea6-a825-79e9fc4f043f tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 3204 microversion: 2.25 time: 0.088640 Jul 20 04:16:57.903058 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1008/1825] 10.222.0.17 () {60 vars in 1183 bytes} [Wed Jul 20 04:16:57 2022] GET /compute/v2.1/os-migrations => generated 3204 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:57.908201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-92aa6a6e-90a6-4e72-91f8-96f5945aef6d req-bde3c6a9-319d-4218-9093-a1e1fb6a4cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b62c758-d90d-48b5-903f-7553734f4cfe", "name": "network-vif-plugged", "status": "completed", "tag": "be0fb241-a959-4d10-85fb-6ddb8e17edb2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:57.947729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-92aa6a6e-90a6-4e72-91f8-96f5945aef6d req-bde3c6a9-319d-4218-9093-a1e1fb6a4cc3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.950869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-92aa6a6e-90a6-4e72-91f8-96f5945aef6d req-bde3c6a9-319d-4218-9093-a1e1fb6a4cc3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.984945 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5060eb4e-3ac1-4807-ba99-871975578e18 tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8" status: 200 len: 354 microversion: 2.1 time: 0.181862 Jul 20 04:16:57.986964 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 818/1826] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:16:57 2022] GET /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8 => generated 354 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:57.991987 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-92aa6a6e-90a6-4e72-91f8-96f5945aef6d req-bde3c6a9-319d-4218-9093-a1e1fb6a4cc3 service nova] Creating event network-vif-plugged:be0fb241-a959-4d10-85fb-6ddb8e17edb2 for instance 7b62c758-d90d-48b5-903f-7553734f4cfe on n-h1-826526-5 Jul 20 04:16:57.995793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-246d40d2-8803-4fd8-8643-1961918cfb8a tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:58.007363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-246d40d2-8803-4fd8-8643-1961918cfb8a tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:58.030980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-246d40d2-8803-4fd8-8643-1961918cfb8a tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.032663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-246d40d2-8803-4fd8-8643-1961918cfb8a tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.034297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-246d40d2-8803-4fd8-8643-1961918cfb8a tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.035603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-246d40d2-8803-4fd8-8643-1961918cfb8a tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.047960 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-92aa6a6e-90a6-4e72-91f8-96f5945aef6d req-bde3c6a9-319d-4218-9093-a1e1fb6a4cc3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141643 Jul 20 04:16:58.048695 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1009/1827] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:58.061632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-35671683-bc69-4c5f-9a41-7bea34f2fbcf tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:58.062416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35671683-bc69-4c5f-9a41-7bea34f2fbcf tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:58.102587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35671683-bc69-4c5f-9a41-7bea34f2fbcf tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.103090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35671683-bc69-4c5f-9a41-7bea34f2fbcf tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.103948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35671683-bc69-4c5f-9a41-7bea34f2fbcf tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.104580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35671683-bc69-4c5f-9a41-7bea34f2fbcf tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.741999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-246d40d2-8803-4fd8-8643-1961918cfb8a tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b06b12e39f947a2acfb1574e53b910c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7fc5df24c0437b9a21746466ca9bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:58.791816 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-246d40d2-8803-4fd8-8643-1961918cfb8a tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 200 len: 1317 microversion: 2.1 time: 0.802816 Jul 20 04:16:58.795272 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 819/1828] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:57 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 1317 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:58.808161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-af712183-bdcd-4fb7-ad25-d58d43239aea tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] Calling method '.version_select at 0x7f06be0e59d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:58.928801 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-af712183-bdcd-4fb7-ad25-d58d43239aea tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8" status: 202 len: 0 microversion: 2.1 time: 0.129812 Jul 20 04:16:58.929707 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 820/1829] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 04:16:58 2022] DELETE /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:58.937924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b4f31c1d-57be-4f85-841b-fd5d49337357 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be6bb1f0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.006158 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b4f31c1d-57be-4f85-841b-fd5d49337357 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.075112 Jul 20 04:16:59.007846 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 821/1830] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:58 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:59.015871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c6a11435-b731-4249-82d9-53f089b3a992 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.017047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c6a11435-b731-4249-82d9-53f089b3a992 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.027716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6a11435-b731-4249-82d9-53f089b3a992 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.030977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6a11435-b731-4249-82d9-53f089b3a992 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.033480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6a11435-b731-4249-82d9-53f089b3a992 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.034195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6a11435-b731-4249-82d9-53f089b3a992 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.281805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-35671683-bc69-4c5f-9a41-7bea34f2fbcf tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] Lazy-loading 'services' on Instance uuid 32c4bdc1-7bb8-47c0-b73f-317ba18949df {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:59.314559 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-35671683-bc69-4c5f-9a41-7bea34f2fbcf tempest-LiveAutoBlockMigrationV225Test-1041912202 tempest-LiveAutoBlockMigrationV225Test-1041912202-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1971 microversion: 2.25 time: 1.263210 Jul 20 04:16:59.319997 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1010/1831] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:58 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1971 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:59.330929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2293526d-38f1-4093-adc0-d39c39bb1ada tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] Calling method '.version_select at 0x7f06be2c6dc0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.466871 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2293526d-38f1-4093-adc0-d39c39bb1ada tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8" status: 200 len: 353 microversion: 2.1 time: 0.145286 Jul 20 04:16:59.469344 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1011/1832] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8 => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:59.486187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bf7a5fe1-7934-49bd-bc1b-ea015851d3b8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.486691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bf7a5fe1-7934-49bd-bc1b-ea015851d3b8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.507015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf7a5fe1-7934-49bd-bc1b-ea015851d3b8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.507450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf7a5fe1-7934-49bd-bc1b-ea015851d3b8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.508378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf7a5fe1-7934-49bd-bc1b-ea015851d3b8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.508874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf7a5fe1-7934-49bd-bc1b-ea015851d3b8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.533074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c6a11435-b731-4249-82d9-53f089b3a992 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:59.545346 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c6a11435-b731-4249-82d9-53f089b3a992 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1199 microversion: 2.1 time: 0.535441 Jul 20 04:16:59.546987 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 822/1833] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1199 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:59.593495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bf7a5fe1-7934-49bd-bc1b-ea015851d3b8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:59.660695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:59.710080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:59.718240 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bf7a5fe1-7934-49bd-bc1b-ea015851d3b8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "DELETE /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 204 len: 0 microversion: 2.25 time: 0.246896 Jul 20 04:16:59.722018 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1012/1834] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:16:59 2022] DELETE /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:16:59.733113 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5a6a816f-6912-4fe1-af63-b809229abbb9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.734286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5a6a816f-6912-4fe1-af63-b809229abbb9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.742367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a6a816f-6912-4fe1-af63-b809229abbb9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.743182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a6a816f-6912-4fe1-af63-b809229abbb9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.744293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a6a816f-6912-4fe1-af63-b809229abbb9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.744955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a6a816f-6912-4fe1-af63-b809229abbb9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.813360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e297d89b-fad2-4976-afdf-9792db16e903 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.814146 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e297d89b-fad2-4976-afdf-9792db16e903 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.830096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e297d89b-fad2-4976-afdf-9792db16e903 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.830581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e297d89b-fad2-4976-afdf-9792db16e903 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.832061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e297d89b-fad2-4976-afdf-9792db16e903 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.833034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e297d89b-fad2-4976-afdf-9792db16e903 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.133441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5a6a816f-6912-4fe1-af63-b809229abbb9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:00.151137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5a6a816f-6912-4fe1-af63-b809229abbb9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:00.159701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5a6a816f-6912-4fe1-af63-b809229abbb9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:00.162108 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5a6a816f-6912-4fe1-af63-b809229abbb9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1484 microversion: 2.25 time: 0.437687 Jul 20 04:17:00.173627 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 823/1835] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1484 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:00.185678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7171a97b-5a97-4f46-9cc5-a5d19a039601 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be9970d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:00.311990 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7171a97b-5a97-4f46-9cc5-a5d19a039601 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.136815 Jul 20 04:17:00.314757 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 824/1836] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:00 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:00.373995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e297d89b-fad2-4976-afdf-9792db16e903 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b06b12e39f947a2acfb1574e53b910c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7fc5df24c0437b9a21746466ca9bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:00.391984 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e297d89b-fad2-4976-afdf-9792db16e903 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 200 len: 1317 microversion: 2.1 time: 0.583363 Jul 20 04:17:00.409661 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1013/1837] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 1317 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:00.483684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6fea3a25-8241-4560-9c20-8c08e28066c7 tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] Calling method '.version_select at 0x7f06be86b9d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:00.564314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-188c982c-1b51-455c-9730-34052716cf51 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:00.565243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-188c982c-1b51-455c-9730-34052716cf51 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:00.580441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-188c982c-1b51-455c-9730-34052716cf51 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.583800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-188c982c-1b51-455c-9730-34052716cf51 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.586537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-188c982c-1b51-455c-9730-34052716cf51 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.586992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-188c982c-1b51-455c-9730-34052716cf51 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.666553 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6fea3a25-8241-4560-9c20-8c08e28066c7 tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8" status: 200 len: 353 microversion: 2.1 time: 0.188749 Jul 20 04:17:00.667154 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 825/1838] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:17:00 2022] GET /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8 => generated 353 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:00.808011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-2dda9043-2fe4-4108-889e-730798b5ac02 req-4c08a6db-94a7-4284-8ea1-47f6192506c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f11b376-b57d-4e26-85c1-8c8b958f4ada", "tag": "0de5ee82-0107-4d78-be4c-57f52a2e5945"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:00.835017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2dda9043-2fe4-4108-889e-730798b5ac02 req-4c08a6db-94a7-4284-8ea1-47f6192506c9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.837582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2dda9043-2fe4-4108-889e-730798b5ac02 req-4c08a6db-94a7-4284-8ea1-47f6192506c9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.891017 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-2dda9043-2fe4-4108-889e-730798b5ac02 req-4c08a6db-94a7-4284-8ea1-47f6192506c9 service nova] Creating event network-changed:0de5ee82-0107-4d78-be4c-57f52a2e5945 for instance 1f11b376-b57d-4e26-85c1-8c8b958f4ada on n-h2-826526-5 Jul 20 04:17:00.915276 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-2dda9043-2fe4-4108-889e-730798b5ac02 req-4c08a6db-94a7-4284-8ea1-47f6192506c9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109140 Jul 20 04:17:00.920137 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 826/1839] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:01.059026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-188c982c-1b51-455c-9730-34052716cf51 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:01.093459 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-188c982c-1b51-455c-9730-34052716cf51 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1383 microversion: 2.1 time: 0.526708 Jul 20 04:17:01.095018 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1014/1840] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:00 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1383 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:01.181848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-07ef5aec-ec55-4df0-80af-cf9284cff1c2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:01.182613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-07ef5aec-ec55-4df0-80af-cf9284cff1c2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:01.205930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07ef5aec-ec55-4df0-80af-cf9284cff1c2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.212704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07ef5aec-ec55-4df0-80af-cf9284cff1c2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.215635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07ef5aec-ec55-4df0-80af-cf9284cff1c2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.217148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07ef5aec-ec55-4df0-80af-cf9284cff1c2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.614933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-600b6705-2448-4c04-8d48-d66f41563330 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:01.615792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-600b6705-2448-4c04-8d48-d66f41563330 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:01.637513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-600b6705-2448-4c04-8d48-d66f41563330 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.637969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-600b6705-2448-4c04-8d48-d66f41563330 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.651800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-600b6705-2448-4c04-8d48-d66f41563330 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.653515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-600b6705-2448-4c04-8d48-d66f41563330 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.741218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-07ef5aec-ec55-4df0-80af-cf9284cff1c2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:01.754652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-07ef5aec-ec55-4df0-80af-cf9284cff1c2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:01.756167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-07ef5aec-ec55-4df0-80af-cf9284cff1c2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:01.757415 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-07ef5aec-ec55-4df0-80af-cf9284cff1c2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1484 microversion: 2.25 time: 0.580084 Jul 20 04:17:01.760130 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1015/1841] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:01 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1484 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:01.768328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b31763a7-7b35-4cac-a9f8-40e5d080ec09 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be6c6d30>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:01.832990 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b31763a7-7b35-4cac-a9f8-40e5d080ec09 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.071442 Jul 20 04:17:01.840273 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1016/1842] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:01 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:01.851068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-633b4de5-af3b-40b5-af4c-ec6ccbc82081 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:01.855772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-633b4de5-af3b-40b5-af4c-ec6ccbc82081 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:01.866077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-633b4de5-af3b-40b5-af4c-ec6ccbc82081 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.866835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-633b4de5-af3b-40b5-af4c-ec6ccbc82081 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.868075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-633b4de5-af3b-40b5-af4c-ec6ccbc82081 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.868747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-633b4de5-af3b-40b5-af4c-ec6ccbc82081 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.159196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:02.395556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-633b4de5-af3b-40b5-af4c-ec6ccbc82081 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b06b12e39f947a2acfb1574e53b910c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7fc5df24c0437b9a21746466ca9bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:02.412946 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-633b4de5-af3b-40b5-af4c-ec6ccbc82081 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 200 len: 1317 microversion: 2.1 time: 0.562147 Jul 20 04:17:02.414253 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1017/1843] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:01 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:02.419495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ad2a073f-437c-4a1a-9a7f-f0ad508fbe7d tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] Calling method '.version_select at 0x7f06bdda6b80>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:02.528990 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ad2a073f-437c-4a1a-9a7f-f0ad508fbe7d tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8" status: 200 len: 353 microversion: 2.1 time: 0.113267 Jul 20 04:17:02.530697 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1018/1844] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:17:02 2022] GET /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8 => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:02.660327 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-600b6705-2448-4c04-8d48-d66f41563330 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1534 microversion: 2.1 time: 1.551654 Jul 20 04:17:02.661869 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 827/1845] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:01 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1534 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:02.676953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1d4f3dc5-e335-47a9-84a9-637f397287a1 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:02.677715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1d4f3dc5-e335-47a9-84a9-637f397287a1 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:02.688216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d4f3dc5-e335-47a9-84a9-637f397287a1 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.690302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d4f3dc5-e335-47a9-84a9-637f397287a1 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.692782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d4f3dc5-e335-47a9-84a9-637f397287a1 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.695231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d4f3dc5-e335-47a9-84a9-637f397287a1 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.775282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f3db548e-445e-474a-b05e-bc99ce4795fc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:02.776170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f3db548e-445e-474a-b05e-bc99ce4795fc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:02.791566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3db548e-445e-474a-b05e-bc99ce4795fc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.793487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3db548e-445e-474a-b05e-bc99ce4795fc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.801379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3db548e-445e-474a-b05e-bc99ce4795fc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.802158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3db548e-445e-474a-b05e-bc99ce4795fc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.268500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f3db548e-445e-474a-b05e-bc99ce4795fc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:03.283966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:03.302546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f3db548e-445e-474a-b05e-bc99ce4795fc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:03.308439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f3db548e-445e-474a-b05e-bc99ce4795fc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:03.316220 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f3db548e-445e-474a-b05e-bc99ce4795fc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1484 microversion: 2.25 time: 0.539032 Jul 20 04:17:03.317396 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 828/1846] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:02 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1484 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:03.344739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-68cf0f51-90a8-4dbb-a3f8-baa18c81cf6b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be6d7700>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:03.433207 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-68cf0f51-90a8-4dbb-a3f8-baa18c81cf6b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.110690 Jul 20 04:17:03.441006 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 829/1847] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:03 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:03.457122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-428d9625-596d-493b-a785-48abba96796e tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:03.458500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-428d9625-596d-493b-a785-48abba96796e tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:03.473899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-428d9625-596d-493b-a785-48abba96796e tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.481203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-428d9625-596d-493b-a785-48abba96796e tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.482195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-428d9625-596d-493b-a785-48abba96796e tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.482770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-428d9625-596d-493b-a785-48abba96796e tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.648497 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1d4f3dc5-e335-47a9-84a9-637f397287a1 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1534 microversion: 2.1 time: 0.967374 Jul 20 04:17:03.649356 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1019/1848] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:02 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1534 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:03.680616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-7120d582-a794-4c2c-9412-8c624a6c2f35 req-49b79f98-478b-46c1-a57a-34785cb18193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c4bdc1-7bb8-47c0-b73f-317ba18949df", "name": "network-vif-deleted", "tag": "7c532b32-d9c8-43cb-aa4c-635e4487021e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:03.707164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7120d582-a794-4c2c-9412-8c624a6c2f35 req-49b79f98-478b-46c1-a57a-34785cb18193 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.707606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7120d582-a794-4c2c-9412-8c624a6c2f35 req-49b79f98-478b-46c1-a57a-34785cb18193 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.733902 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-7120d582-a794-4c2c-9412-8c624a6c2f35 req-49b79f98-478b-46c1-a57a-34785cb18193 service nova] Creating event network-vif-deleted:7c532b32-d9c8-43cb-aa4c-635e4487021e for instance 32c4bdc1-7bb8-47c0-b73f-317ba18949df on n-h2-826526-5 Jul 20 04:17:03.741166 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-7120d582-a794-4c2c-9412-8c624a6c2f35 req-49b79f98-478b-46c1-a57a-34785cb18193 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063908 Jul 20 04:17:03.750328 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1020/1849] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:03.759227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9f4c22ff-6587-4e31-977f-9851980007c9 tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] Calling method '.version_select at 0x7f06c748b670>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:03.858222 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-9f4c22ff-6587-4e31-977f-9851980007c9 tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] HTTP exception thrown: Volume ec86be4d-64e5-4310-8898-eac84e7e90b8 could not be found. Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9f4c22ff-6587-4e31-977f-9851980007c9 tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] Request method failure captured: Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8 HTTP/1.1 Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14GzUQs-mlLWgroHxl_ga-nWuE3awABjcRlEkrlDuUaEzVR3CQ9J4k6gERz8DWOJTVQuHiY2NwHGmKyEc3JC1GALetM-Z3byMl7EozH5goNsfgzLd7HNTATYZjSQJ2E1B_O-s2WWOb0Ph9qJ1bcBQO924zipJ3fpHAFKwJ7SoNJuyRk Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 968563963803459cbe527a0fc1339405 Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-VolumesGetTestJSON-1184694150 Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:17:03.861459 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:17:03.863147 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/968563963803459cbe527a0fc1339405"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/968563963803459cbe527a0fc1339405"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_968563963803459cbe527a0fc1339405", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/968563963803459cbe527a0fc1339405"}]}] Jul 20 04:17:03.863147 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-VolumesGetTestJSON-1184694150 Jul 20 04:17:03.863147 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 968563963803459cbe527a0fc1339405 Jul 20 04:17:03.863147 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-VolumesGetTestJSON-1184694150 Jul 20 04:17:03.863147 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-VolumesGetTestJSON-1184694150-project Jul 20 04:17:03.863147 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:17:03.863147 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:17:03.863147 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: b9c729eb94fe449f99380b2157c12c35 Jul 20 04:17:03.863147 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-VolumesGetTestJSON-1184694150-project Jul 20 04:17:03.863147 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:17:03.863147 n-d-826526-5 devstack@n-api.service[127871]: exception: Volume ec86be4d-64e5-4310-8898-eac84e7e90b8 could not be found. Jul 20 04:17:03.863147 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'ec86be4d-64e5-4310-8898-eac84e7e90b8'} Jul 20 04:17:03.863147 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ec86be4d-64e5-4310-8898-eac84e7e90b8 could not be found. (HTTP 404) (Request-ID: req-263a1ac3-af84-45ec-888c-0db594ac893b) Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:03.864110 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:17:03.866445 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ec86be4d-64e5-4310-8898-eac84e7e90b8 could not be found. Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 04:17:03.868921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:03.871455 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ec86be4d-64e5-4310-8898-eac84e7e90b8 could not be found. Jul 20 04:17:03.871455 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:03.871455 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:03.871455 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:03.871455 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:03.871455 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:03.871455 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:03.871455 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:03.871455 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:03.871455 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ec86be4d-64e5-4310-8898-eac84e7e90b8 could not be found. Jul 20 04:17:03.871455 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:03.871455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9f4c22ff-6587-4e31-977f-9851980007c9 tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] Returning 404 to user: Volume ec86be4d-64e5-4310-8898-eac84e7e90b8 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:03.871455 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9f4c22ff-6587-4e31-977f-9851980007c9 tempest-VolumesGetTestJSON-1184694150 tempest-VolumesGetTestJSON-1184694150-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8" status: 404 len: 109 microversion: 2.1 time: 0.111232 Jul 20 04:17:03.879076 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1021/1850] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:17:03 2022] GET /compute/v2.1/os-volumes/ec86be4d-64e5-4310-8898-eac84e7e90b8 => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:03.906413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c70d33e-6832-4f6a-a80d-d9a944e7fa90 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:03.927776 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:17:03.927776 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:17:03.951961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c70d33e-6832-4f6a-a80d-d9a944e7fa90 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.954343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c70d33e-6832-4f6a-a80d-d9a944e7fa90 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.955594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c70d33e-6832-4f6a-a80d-d9a944e7fa90 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.958942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c70d33e-6832-4f6a-a80d-d9a944e7fa90 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.044318 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0c70d33e-6832-4f6a-a80d-d9a944e7fa90 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.163080 Jul 20 04:17:04.054854 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1022/1851] 10.222.0.17 () {58 vars in 1175 bytes} [Wed Jul 20 04:17:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:04.061492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d381001-0db2-4eb6-bdad-7823ff31f701 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826526-5", "block_migration": false, "disk_over_commit": false}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:04.064118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4d381001-0db2-4eb6-bdad-7823ff31f701 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:04.078768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d381001-0db2-4eb6-bdad-7823ff31f701 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.084177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d381001-0db2-4eb6-bdad-7823ff31f701 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.095816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d381001-0db2-4eb6-bdad-7823ff31f701 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.098194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d381001-0db2-4eb6-bdad-7823ff31f701 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.176986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-4d381001-0db2-4eb6-bdad-7823ff31f701 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lazy-loading 'flavor' on Instance uuid 7b62c758-d90d-48b5-903f-7553734f4cfe {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:04.184137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-428d9625-596d-493b-a785-48abba96796e tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b06b12e39f947a2acfb1574e53b910c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7fc5df24c0437b9a21746466ca9bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:04.201857 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-428d9625-596d-493b-a785-48abba96796e tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 200 len: 1317 microversion: 2.1 time: 0.759470 Jul 20 04:17:04.211282 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 830/1852] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:03 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 1317 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:04.256821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4d381001-0db2-4eb6-bdad-7823ff31f701 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Going to try to live migrate instance to n-h2-826526-5 {{(pid=127871) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:17:04.346005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dc36c466-1949-4a7a-a303-ff6378e6f038 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:04.351929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dc36c466-1949-4a7a-a303-ff6378e6f038 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:04.410298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc36c466-1949-4a7a-a303-ff6378e6f038 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.411610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc36c466-1949-4a7a-a303-ff6378e6f038 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.421000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc36c466-1949-4a7a-a303-ff6378e6f038 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.425814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc36c466-1949-4a7a-a303-ff6378e6f038 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.655767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dc36c466-1949-4a7a-a303-ff6378e6f038 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:04.669044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dc36c466-1949-4a7a-a303-ff6378e6f038 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:04.682236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dc36c466-1949-4a7a-a303-ff6378e6f038 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:04.686566 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dc36c466-1949-4a7a-a303-ff6378e6f038 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1266 microversion: 2.25 time: 0.352363 Jul 20 04:17:04.688981 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 831/1853] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:04 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1266 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:04.696205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4c091c7f-7f98-4f13-a9d9-0981781ba26a tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bdeafe50>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:04.817731 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4c091c7f-7f98-4f13-a9d9-0981781ba26a tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.125096 Jul 20 04:17:04.822888 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 832/1854] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:04 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:05.223682 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7b505919-bbed-4a1e-9c19-6f496fe30d58 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:05.224444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7b505919-bbed-4a1e-9c19-6f496fe30d58 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:05.245448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b505919-bbed-4a1e-9c19-6f496fe30d58 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.245927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b505919-bbed-4a1e-9c19-6f496fe30d58 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.264356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b505919-bbed-4a1e-9c19-6f496fe30d58 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.265007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b505919-bbed-4a1e-9c19-6f496fe30d58 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:06.144579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7b505919-bbed-4a1e-9c19-6f496fe30d58 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b06b12e39f947a2acfb1574e53b910c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7fc5df24c0437b9a21746466ca9bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:06.157111 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7b505919-bbed-4a1e-9c19-6f496fe30d58 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 200 len: 1317 microversion: 2.1 time: 0.937917 Jul 20 04:17:06.160789 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 833/1855] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:05 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 1317 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:06.172892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8933290f-6697-4eb3-a718-cd4450656133 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:06.177055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8933290f-6697-4eb3-a718-cd4450656133 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:06.195178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8933290f-6697-4eb3-a718-cd4450656133 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:06.199472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8933290f-6697-4eb3-a718-cd4450656133 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:06.201968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8933290f-6697-4eb3-a718-cd4450656133 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:06.202820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8933290f-6697-4eb3-a718-cd4450656133 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:06.703472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8933290f-6697-4eb3-a718-cd4450656133 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:06.732794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8933290f-6697-4eb3-a718-cd4450656133 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:06.743215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8933290f-6697-4eb3-a718-cd4450656133 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:06.749639 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8933290f-6697-4eb3-a718-cd4450656133 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1266 microversion: 2.25 time: 0.585581 Jul 20 04:17:06.755046 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 834/1856] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:06 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1266 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:06.768079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f04ef440-f272-46c8-90ac-be24c8a152f6 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be86bf70>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:06.944254 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f04ef440-f272-46c8-90ac-be24c8a152f6 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.185028 Jul 20 04:17:06.945277 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 835/1857] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:06 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:07.194008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-09ad7bcb-cb71-457c-aa01-6e49fa9b7293 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:07.195165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-09ad7bcb-cb71-457c-aa01-6e49fa9b7293 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:07.251231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09ad7bcb-cb71-457c-aa01-6e49fa9b7293 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.258575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09ad7bcb-cb71-457c-aa01-6e49fa9b7293 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.261286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09ad7bcb-cb71-457c-aa01-6e49fa9b7293 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.263589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09ad7bcb-cb71-457c-aa01-6e49fa9b7293 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.991149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-09ad7bcb-cb71-457c-aa01-6e49fa9b7293 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b06b12e39f947a2acfb1574e53b910c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7fc5df24c0437b9a21746466ca9bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:08.010173 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-09ad7bcb-cb71-457c-aa01-6e49fa9b7293 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 200 len: 1317 microversion: 2.1 time: 0.823945 Jul 20 04:17:08.010786 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 836/1858] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:07 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 1317 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:08.030019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-11e463e5-f9c0-4d73-8a6e-4178d8ed1cef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:08.030676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-11e463e5-f9c0-4d73-8a6e-4178d8ed1cef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:08.048085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11e463e5-f9c0-4d73-8a6e-4178d8ed1cef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.048571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11e463e5-f9c0-4d73-8a6e-4178d8ed1cef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.049370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11e463e5-f9c0-4d73-8a6e-4178d8ed1cef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.049851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11e463e5-f9c0-4d73-8a6e-4178d8ed1cef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.346113 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-11e463e5-f9c0-4d73-8a6e-4178d8ed1cef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:08.367192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-11e463e5-f9c0-4d73-8a6e-4178d8ed1cef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:08.377853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-11e463e5-f9c0-4d73-8a6e-4178d8ed1cef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:08.379202 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-11e463e5-f9c0-4d73-8a6e-4178d8ed1cef tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1266 microversion: 2.25 time: 0.367360 Jul 20 04:17:08.400696 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 837/1859] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:08 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1266 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:08.405755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e51a2ce8-9489-4f1b-b8ee-3cb9a2515576 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be7b4790>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:08.504687 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e51a2ce8-9489-4f1b-b8ee-3cb9a2515576 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.102693 Jul 20 04:17:08.508468 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 838/1860] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:08 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:08.521338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-84edecd7-ef88-4d3b-bc34-e2f9a5f23331 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e612e86-6b2a-47de-b41b-00e713b9e6bb"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:08.529963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-84edecd7-ef88-4d3b-bc34-e2f9a5f23331 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:08.564617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84edecd7-ef88-4d3b-bc34-e2f9a5f23331 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.565404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84edecd7-ef88-4d3b-bc34-e2f9a5f23331 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.571705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84edecd7-ef88-4d3b-bc34-e2f9a5f23331 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.572431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84edecd7-ef88-4d3b-bc34-e2f9a5f23331 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.724424 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4d381001-0db2-4eb6-bdad-7823ff31f701 tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe/action" status: 202 len: 0 microversion: 2.1 time: 4.667939 Jul 20 04:17:08.728736 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1023/1861] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:04 2022] POST /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe/action => generated 0 bytes in 4673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:08.737508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5b41bca2-9c61-4625-a4d2-5713fd281aad tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:08.741035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5b41bca2-9c61-4625-a4d2-5713fd281aad tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:08.779105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b41bca2-9c61-4625-a4d2-5713fd281aad tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.779594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b41bca2-9c61-4625-a4d2-5713fd281aad tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.780501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b41bca2-9c61-4625-a4d2-5713fd281aad tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.780976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b41bca2-9c61-4625-a4d2-5713fd281aad tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:09.245633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5b41bca2-9c61-4625-a4d2-5713fd281aad tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:09.258076 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5b41bca2-9c61-4625-a4d2-5713fd281aad tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.527515 Jul 20 04:17:09.259046 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1024/1862] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:08 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:09.289012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-73ede160-e534-42a2-a6bf-c4fc4257ce9b req-45fb3624-d380-4587-ad35-f73779aaf1dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f11b376-b57d-4e26-85c1-8c8b958f4ada", "name": "network-vif-plugged", "status": "completed", "tag": "0de5ee82-0107-4d78-be4c-57f52a2e5945"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:09.297900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:09.324793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-73ede160-e534-42a2-a6bf-c4fc4257ce9b req-45fb3624-d380-4587-ad35-f73779aaf1dc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:09.325936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-73ede160-e534-42a2-a6bf-c4fc4257ce9b req-45fb3624-d380-4587-ad35-f73779aaf1dc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:09.356901 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-84edecd7-ef88-4d3b-bc34-e2f9a5f23331 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "POST /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.841163 Jul 20 04:17:09.364918 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 839/1863] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 04:17:08 2022] POST /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments => generated 194 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:09.379775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3a58eb56-23a9-49ba-b4a0-cd677c631b74 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:09.383710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3a58eb56-23a9-49ba-b4a0-cd677c631b74 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:09.400180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a58eb56-23a9-49ba-b4a0-cd677c631b74 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:09.402120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a58eb56-23a9-49ba-b4a0-cd677c631b74 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:09.403480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a58eb56-23a9-49ba-b4a0-cd677c631b74 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:09.404106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a58eb56-23a9-49ba-b4a0-cd677c631b74 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:09.405054 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-73ede160-e534-42a2-a6bf-c4fc4257ce9b req-45fb3624-d380-4587-ad35-f73779aaf1dc service nova] Creating event network-vif-plugged:0de5ee82-0107-4d78-be4c-57f52a2e5945 for instance 1f11b376-b57d-4e26-85c1-8c8b958f4ada on n-h2-826526-5 Jul 20 04:17:09.439526 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-73ede160-e534-42a2-a6bf-c4fc4257ce9b req-45fb3624-d380-4587-ad35-f73779aaf1dc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161605 Jul 20 04:17:09.442575 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1025/1864] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:09.485647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-81bf8f23-7d02-45ef-a86e-d8ec1a669e3b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:09.486447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-81bf8f23-7d02-45ef-a86e-d8ec1a669e3b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:09.508421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81bf8f23-7d02-45ef-a86e-d8ec1a669e3b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:09.515179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81bf8f23-7d02-45ef-a86e-d8ec1a669e3b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:09.518448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81bf8f23-7d02-45ef-a86e-d8ec1a669e3b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:09.521685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81bf8f23-7d02-45ef-a86e-d8ec1a669e3b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:09.685878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-81bf8f23-7d02-45ef-a86e-d8ec1a669e3b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:09.714709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-81bf8f23-7d02-45ef-a86e-d8ec1a669e3b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:09.719345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-81bf8f23-7d02-45ef-a86e-d8ec1a669e3b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:09.723451 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-81bf8f23-7d02-45ef-a86e-d8ec1a669e3b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1266 microversion: 2.25 time: 0.278165 Jul 20 04:17:09.741473 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1026/1865] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:09 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:09.748127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bc9fdafc-ca50-4014-80f0-dc95c9e5b366 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c73e31f0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:09.871776 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bc9fdafc-ca50-4014-80f0-dc95c9e5b366 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.127721 Jul 20 04:17:09.878288 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1027/1866] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:09 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:10.208235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-92226ac1-b53f-4776-8109-f0d48c093bfc tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] Action: 'create', calling method: .version_select at 0x7f06c748dd30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1473506901", "metadata": {"Type": "work"}}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-92226ac1-b53f-4776-8109-f0d48c093bfc tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] Request method failure captured: Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 122 Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14HFM0fYaZvd2fXVJfHLO_kAViM5mMQWFQeXGHy4_N0md_qiZGrGtssnJg9Iblk6rp12lw1gLPVLZHUU3M5riaZvw0gBTE0T9IFM8wQ_DBMHLxM7a4ZZZN_uJ4Qt6LEViSQ15jShF-CcNNSjg-7HmDJoGBcAb4w_b_w4Cl4WVoM4dDo Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: f16f31a682ec46389d445c4c5832a879 Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-VolumesNegativeTest-1123101644 Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:17:10.210985 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:17:10.212650 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f16f31a682ec46389d445c4c5832a879"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f16f31a682ec46389d445c4c5832a879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f16f31a682ec46389d445c4c5832a879", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f16f31a682ec46389d445c4c5832a879"}]}] Jul 20 04:17:10.212650 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-VolumesNegativeTest-1123101644 Jul 20 04:17:10.212650 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: f16f31a682ec46389d445c4c5832a879 Jul 20 04:17:10.212650 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-VolumesNegativeTest-1123101644 Jul 20 04:17:10.212650 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-VolumesNegativeTest-1123101644-project Jul 20 04:17:10.212650 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:17:10.212650 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:17:10.212650 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a24b369a764d4073bb8bcae8c6e577c5 Jul 20 04:17:10.212650 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-VolumesNegativeTest-1123101644-project Jul 20 04:17:10.212650 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:17:10.212650 n-d-826526-5 devstack@n-api.service[127871]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1473506901", "metadata": {"Type": "work"}}} Jul 20 04:17:10.212650 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:17:10.212650 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1473506901', 'metadata': {'Type': 'work'}}}} Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi '#$%' Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:10.213630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:17:10.222265 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:17:10.225060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 04:17:10.225060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.225060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-92226ac1-b53f-4776-8109-f0d48c093bfc tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:10.225060 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-92226ac1-b53f-4776-8109-f0d48c093bfc tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.245412 Jul 20 04:17:10.225060 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1028/1867] 10.222.0.17 () {60 vars in 1155 bytes} [Wed Jul 20 04:17:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 248 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:17:10.234260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2516cf22-bb03-4b57-bf79-407854eff394 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] Action: 'create', calling method: .version_select at 0x7f06c7428160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1787200353", "metadata": {"Type": "work"}}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2516cf22-bb03-4b57-bf79-407854eff394 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] Request method failure captured: Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 120 Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14HFM0fYaZvd2fXVJfHLO_kAViM5mMQWFQeXGHy4_N0md_qiZGrGtssnJg9Iblk6rp12lw1gLPVLZHUU3M5riaZvw0gBTE0T9IFM8wQ_DBMHLxM7a4ZZZN_uJ4Qt6LEViSQ15jShF-CcNNSjg-7HmDJoGBcAb4w_b_w4Cl4WVoM4dDo Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: f16f31a682ec46389d445c4c5832a879 Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-VolumesNegativeTest-1123101644 Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:17:10.242053 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:17:10.243694 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f16f31a682ec46389d445c4c5832a879"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f16f31a682ec46389d445c4c5832a879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f16f31a682ec46389d445c4c5832a879", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f16f31a682ec46389d445c4c5832a879"}]}] Jul 20 04:17:10.243694 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-VolumesNegativeTest-1123101644 Jul 20 04:17:10.243694 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: f16f31a682ec46389d445c4c5832a879 Jul 20 04:17:10.243694 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-VolumesNegativeTest-1123101644 Jul 20 04:17:10.243694 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-VolumesNegativeTest-1123101644-project Jul 20 04:17:10.243694 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:17:10.243694 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:17:10.243694 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a24b369a764d4073bb8bcae8c6e577c5 Jul 20 04:17:10.243694 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-VolumesNegativeTest-1123101644-project Jul 20 04:17:10.243694 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:17:10.243694 n-d-826526-5 devstack@n-api.service[127871]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1787200353", "metadata": {"Type": "work"}}} Jul 20 04:17:10.243694 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:17:10.243694 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1787200353', 'metadata': {'Type': 'work'}}}} Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi '0' Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:10.244629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:17:10.246169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:17:10.247527 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 04:17:10.247527 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.250202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2516cf22-bb03-4b57-bf79-407854eff394 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:10.254202 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2516cf22-bb03-4b57-bf79-407854eff394 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.029191 Jul 20 04:17:10.255922 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1029/1868] 10.222.0.17 () {60 vars in 1155 bytes} [Wed Jul 20 04:17:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:17:10.268809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-27ae4a52-f924-4063-b7da-f3356d35f363 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] Action: 'create', calling method: .version_select at 0x7f06c748df70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-975786833", "metadata": {"Type": "work"}}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-27ae4a52-f924-4063-b7da-f3356d35f363 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] Request method failure captured: Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 118 Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14HFM0fYaZvd2fXVJfHLO_kAViM5mMQWFQeXGHy4_N0md_qiZGrGtssnJg9Iblk6rp12lw1gLPVLZHUU3M5riaZvw0gBTE0T9IFM8wQ_DBMHLxM7a4ZZZN_uJ4Qt6LEViSQ15jShF-CcNNSjg-7HmDJoGBcAb4w_b_w4Cl4WVoM4dDo Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: f16f31a682ec46389d445c4c5832a879 Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-VolumesNegativeTest-1123101644 Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:17:10.279212 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:17:10.281687 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f16f31a682ec46389d445c4c5832a879"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f16f31a682ec46389d445c4c5832a879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f16f31a682ec46389d445c4c5832a879", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f16f31a682ec46389d445c4c5832a879"}]}] Jul 20 04:17:10.281687 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-VolumesNegativeTest-1123101644 Jul 20 04:17:10.281687 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: f16f31a682ec46389d445c4c5832a879 Jul 20 04:17:10.281687 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-VolumesNegativeTest-1123101644 Jul 20 04:17:10.281687 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-VolumesNegativeTest-1123101644-project Jul 20 04:17:10.281687 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:17:10.281687 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:17:10.281687 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a24b369a764d4073bb8bcae8c6e577c5 Jul 20 04:17:10.281687 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-VolumesNegativeTest-1123101644-project Jul 20 04:17:10.281687 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:17:10.281687 n-d-826526-5 devstack@n-api.service[127871]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-975786833", "metadata": {"Type": "work"}}} Jul 20 04:17:10.281687 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:17:10.281687 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-975786833', 'metadata': {'Type': 'work'}}}} Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi '' Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:10.282586 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:17:10.284209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:17:10.286578 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 04:17:10.286578 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:10.301967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-27ae4a52-f924-4063-b7da-f3356d35f363 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:10.303366 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-27ae4a52-f924-4063-b7da-f3356d35f363 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.041440 Jul 20 04:17:10.313722 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1030/1869] 10.222.0.17 () {60 vars in 1155 bytes} [Wed Jul 20 04:17:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:17:10.319774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7f7d0473-6442-415f-bae9-687b0b39e320 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:10.321117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7f7d0473-6442-415f-bae9-687b0b39e320 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:10.331552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f7d0473-6442-415f-bae9-687b0b39e320 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:10.332404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f7d0473-6442-415f-bae9-687b0b39e320 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:10.333407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f7d0473-6442-415f-bae9-687b0b39e320 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:10.334115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f7d0473-6442-415f-bae9-687b0b39e320 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:10.428448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3a58eb56-23a9-49ba-b4a0-cd677c631b74 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b06b12e39f947a2acfb1574e53b910c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7fc5df24c0437b9a21746466ca9bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:10.443787 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3a58eb56-23a9-49ba-b4a0-cd677c631b74 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 200 len: 1317 microversion: 2.1 time: 1.073435 Jul 20 04:17:10.447150 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 840/1870] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:09 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 1317 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:10.459516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6ed702e6-5782-4173-bdb6-5c921d4de6b4 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] Calling method '.version_select at 0x7f06be6f85e0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:10.816676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7f7d0473-6442-415f-bae9-687b0b39e320 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:10.835522 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7f7d0473-6442-415f-bae9-687b0b39e320 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.515936 Jul 20 04:17:10.843042 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1031/1871] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:10 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:10.867632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-08783e91-d1e6-47b8-8a74-aec26eb04765 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:10.873684 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-08783e91-d1e6-47b8-8a74-aec26eb04765 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:10.907444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08783e91-d1e6-47b8-8a74-aec26eb04765 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:10.912174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08783e91-d1e6-47b8-8a74-aec26eb04765 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:10.916871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08783e91-d1e6-47b8-8a74-aec26eb04765 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:10.919037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08783e91-d1e6-47b8-8a74-aec26eb04765 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.165359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-08783e91-d1e6-47b8-8a74-aec26eb04765 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.184082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-08783e91-d1e6-47b8-8a74-aec26eb04765 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.186861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-08783e91-d1e6-47b8-8a74-aec26eb04765 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.189388 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-08783e91-d1e6-47b8-8a74-aec26eb04765 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1266 microversion: 2.25 time: 0.343099 Jul 20 04:17:11.191062 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1032/1872] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:10 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1266 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:11.199606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c58f582-30a7-4c7d-9258-37cca3780d2d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c7430b80>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:11.310499 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0c58f582-30a7-4c7d-9258-37cca3780d2d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.115751 Jul 20 04:17:11.312552 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1033/1873] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:11 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:11.472475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-88a9f27c-9d5b-4b3a-801d-5c2157e13ddb tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:11.474413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-88a9f27c-9d5b-4b3a-801d-5c2157e13ddb tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:11.491599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88a9f27c-9d5b-4b3a-801d-5c2157e13ddb tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.493154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88a9f27c-9d5b-4b3a-801d-5c2157e13ddb tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.497181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88a9f27c-9d5b-4b3a-801d-5c2157e13ddb tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.498565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88a9f27c-9d5b-4b3a-801d-5c2157e13ddb tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.969597 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-88a9f27c-9d5b-4b3a-801d-5c2157e13ddb tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b06b12e39f947a2acfb1574e53b910c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7fc5df24c0437b9a21746466ca9bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.979129 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-88a9f27c-9d5b-4b3a-801d-5c2157e13ddb tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 200 len: 1317 microversion: 2.1 time: 0.520203 Jul 20 04:17:11.982104 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1034/1874] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:11 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 1317 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:11.994261 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-31baaacd-b771-4ad2-9c9b-577bceeb984c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:11.995885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-31baaacd-b771-4ad2-9c9b-577bceeb984c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:12.008982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31baaacd-b771-4ad2-9c9b-577bceeb984c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.011633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31baaacd-b771-4ad2-9c9b-577bceeb984c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.012688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31baaacd-b771-4ad2-9c9b-577bceeb984c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.014811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31baaacd-b771-4ad2-9c9b-577bceeb984c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.304338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-31baaacd-b771-4ad2-9c9b-577bceeb984c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.316596 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-31baaacd-b771-4ad2-9c9b-577bceeb984c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.333050 Jul 20 04:17:12.317378 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1035/1875] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:11 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:12.327721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9c6d8c12-64cc-4bcd-a8e6-08cd7adc132c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.329370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9c6d8c12-64cc-4bcd-a8e6-08cd7adc132c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:12.351831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c6d8c12-64cc-4bcd-a8e6-08cd7adc132c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.352749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c6d8c12-64cc-4bcd-a8e6-08cd7adc132c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.354741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c6d8c12-64cc-4bcd-a8e6-08cd7adc132c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.355131 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c6d8c12-64cc-4bcd-a8e6-08cd7adc132c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.500235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9c6d8c12-64cc-4bcd-a8e6-08cd7adc132c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.503054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:12.518765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9c6d8c12-64cc-4bcd-a8e6-08cd7adc132c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.520583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9c6d8c12-64cc-4bcd-a8e6-08cd7adc132c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.523895 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9c6d8c12-64cc-4bcd-a8e6-08cd7adc132c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1266 microversion: 2.25 time: 0.205171 Jul 20 04:17:12.524527 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1036/1876] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:12 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:12.539380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5a13f1ba-9dc9-429a-b8ae-00c2053cb393 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c7430550>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.659335 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5a13f1ba-9dc9-429a-b8ae-00c2053cb393 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.128212 Jul 20 04:17:12.659928 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1037/1877] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:12 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:13.002616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-46153f5c-e311-4d51-96e4-b7e2d746a022 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:13.003336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-46153f5c-e311-4d51-96e4-b7e2d746a022 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:13.021691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46153f5c-e311-4d51-96e4-b7e2d746a022 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.029761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46153f5c-e311-4d51-96e4-b7e2d746a022 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.031965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46153f5c-e311-4d51-96e4-b7e2d746a022 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.033838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46153f5c-e311-4d51-96e4-b7e2d746a022 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.356042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-46153f5c-e311-4d51-96e4-b7e2d746a022 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b06b12e39f947a2acfb1574e53b910c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7fc5df24c0437b9a21746466ca9bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:13.367634 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-46153f5c-e311-4d51-96e4-b7e2d746a022 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 200 len: 1505 microversion: 2.1 time: 0.369527 Jul 20 04:17:13.380301 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1038/1878] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:12 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 1505 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:13.380301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-774d647b-49e8-497b-bc82-e5f9b8110ec4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:13.381072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-774d647b-49e8-497b-bc82-e5f9b8110ec4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:13.388610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-774d647b-49e8-497b-bc82-e5f9b8110ec4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.389061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-774d647b-49e8-497b-bc82-e5f9b8110ec4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.389852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-774d647b-49e8-497b-bc82-e5f9b8110ec4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.390349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-774d647b-49e8-497b-bc82-e5f9b8110ec4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.599294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-774d647b-49e8-497b-bc82-e5f9b8110ec4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:13.610518 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-774d647b-49e8-497b-bc82-e5f9b8110ec4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.240672 Jul 20 04:17:13.620158 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1039/1879] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:13 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:13.620488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5386e225-10bf-40b4-855f-944ff9b4d7e9 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:13.621208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5386e225-10bf-40b4-855f-944ff9b4d7e9 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:13.629980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5386e225-10bf-40b4-855f-944ff9b4d7e9 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.629980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5386e225-10bf-40b4-855f-944ff9b4d7e9 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.630433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5386e225-10bf-40b4-855f-944ff9b4d7e9 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.630870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5386e225-10bf-40b4-855f-944ff9b4d7e9 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.675021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5386e225-10bf-40b4-855f-944ff9b4d7e9 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '5b06b12e39f947a2acfb1574e53b910c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7fc5df24c0437b9a21746466ca9bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:13.675827 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5386e225-10bf-40b4-855f-944ff9b4d7e9 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada/os-instance-actions/req-eb8cedf3-4281-4faa-8ed8-25965e45297d" status: 200 len: 313 microversion: 2.1 time: 0.063111 Jul 20 04:17:13.683736 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1040/1880] 10.222.0.17 () {58 vars in 1418 bytes} [Wed Jul 20 04:17:13 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada/os-instance-actions/req-eb8cedf3-4281-4faa-8ed8-25965e45297d => generated 313 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:13.683736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-64085ca8-6dcd-4716-8804-76d7050ebc5a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:13.683736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-64085ca8-6dcd-4716-8804-76d7050ebc5a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:13.690061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64085ca8-6dcd-4716-8804-76d7050ebc5a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.690840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64085ca8-6dcd-4716-8804-76d7050ebc5a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.692015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64085ca8-6dcd-4716-8804-76d7050ebc5a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.692511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64085ca8-6dcd-4716-8804-76d7050ebc5a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.805627 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-64085ca8-6dcd-4716-8804-76d7050ebc5a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:13.814628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-64085ca8-6dcd-4716-8804-76d7050ebc5a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:13.817160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-64085ca8-6dcd-4716-8804-76d7050ebc5a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:13.818347 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-64085ca8-6dcd-4716-8804-76d7050ebc5a tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1266 microversion: 2.25 time: 0.140567 Jul 20 04:17:13.819485 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1041/1881] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:13 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:13.824230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1faef2b4-ea4d-4fe6-8e87-ffd0549d661b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c748bc10>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:13.897274 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1faef2b4-ea4d-4fe6-8e87-ffd0549d661b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.076610 Jul 20 04:17:13.897870 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1042/1882] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:13 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:13.907565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0cff17f4-e163-40f6-8c24-d148d6199ad9 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:13.909776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0cff17f4-e163-40f6-8c24-d148d6199ad9 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:13.925030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0cff17f4-e163-40f6-8c24-d148d6199ad9 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.925502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0cff17f4-e163-40f6-8c24-d148d6199ad9 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.926288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0cff17f4-e163-40f6-8c24-d148d6199ad9 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.926725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0cff17f4-e163-40f6-8c24-d148d6199ad9 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.991009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:14.055580 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0cff17f4-e163-40f6-8c24-d148d6199ad9 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "POST /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada/action" status: 202 len: 0 microversion: 2.1 time: 0.156481 Jul 20 04:17:14.060311 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1043/1883] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:13 2022] POST /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:14.069984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-de68adc6-5744-4973-afc5-14c4a107ec6e tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:14.070706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-de68adc6-5744-4973-afc5-14c4a107ec6e tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:14.079000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de68adc6-5744-4973-afc5-14c4a107ec6e tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.079000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de68adc6-5744-4973-afc5-14c4a107ec6e tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.079925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de68adc6-5744-4973-afc5-14c4a107ec6e tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.080882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de68adc6-5744-4973-afc5-14c4a107ec6e tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.708984 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-6ed702e6-5782-4173-bdb6-5c921d4de6b4 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] HTTP exception thrown: Volume tempest-invalid-1917838679 could not be found. Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6ed702e6-5782-4173-bdb6-5c921d4de6b4 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] Request method failure captured: Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1917838679 HTTP/1.1 Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14HFM0fYaZvd2fXVJfHLO_kAViM5mMQWFQeXGHy4_N0md_qiZGrGtssnJg9Iblk6rp12lw1gLPVLZHUU3M5riaZvw0gBTE0T9IFM8wQ_DBMHLxM7a4ZZZN_uJ4Qt6LEViSQ15jShF-CcNNSjg-7HmDJoGBcAb4w_b_w4Cl4WVoM4dDo Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: f16f31a682ec46389d445c4c5832a879 Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-VolumesNegativeTest-1123101644 Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:17:14.712300 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:17:14.714094 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f16f31a682ec46389d445c4c5832a879"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f16f31a682ec46389d445c4c5832a879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f16f31a682ec46389d445c4c5832a879", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f16f31a682ec46389d445c4c5832a879"}]}] Jul 20 04:17:14.714094 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-VolumesNegativeTest-1123101644 Jul 20 04:17:14.714094 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: f16f31a682ec46389d445c4c5832a879 Jul 20 04:17:14.714094 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-VolumesNegativeTest-1123101644 Jul 20 04:17:14.714094 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-VolumesNegativeTest-1123101644-project Jul 20 04:17:14.714094 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:17:14.714094 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:17:14.714094 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a24b369a764d4073bb8bcae8c6e577c5 Jul 20 04:17:14.714094 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-VolumesNegativeTest-1123101644-project Jul 20 04:17:14.714094 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:17:14.714094 n-d-826526-5 devstack@n-api.service[127870]: exception: Volume tempest-invalid-1917838679 could not be found. Jul 20 04:17:14.714094 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'tempest-invalid-1917838679'} Jul 20 04:17:14.714094 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1917838679 could not be found. (HTTP 404) (Request-ID: req-15ee35b5-8186-445c-bac6-8a8670ecf49b) Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:14.715158 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:17:14.716737 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1917838679 could not be found. Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:14.718235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1917838679 could not be found. Jul 20 04:17:14.719827 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:14.719827 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:14.719827 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:14.719827 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:14.719827 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:14.719827 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:14.719827 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:14.719827 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:14.719827 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1917838679 could not be found. Jul 20 04:17:14.719827 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:14.722087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6ed702e6-5782-4173-bdb6-5c921d4de6b4 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] Returning 404 to user: Volume tempest-invalid-1917838679 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:14.723168 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6ed702e6-5782-4173-bdb6-5c921d4de6b4 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1917838679" status: 404 len: 99 microversion: 2.1 time: 4.274729 Jul 20 04:17:14.724241 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 841/1884] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jul 20 04:17:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1917838679 => generated 99 bytes in 4276 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:17:14.733113 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea47df84-3a0c-4d56-8ef0-2a57784cc89d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:14.735813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ea47df84-3a0c-4d56-8ef0-2a57784cc89d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:14.759612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:14.765767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea47df84-3a0c-4d56-8ef0-2a57784cc89d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.766523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea47df84-3a0c-4d56-8ef0-2a57784cc89d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.767582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea47df84-3a0c-4d56-8ef0-2a57784cc89d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.768255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea47df84-3a0c-4d56-8ef0-2a57784cc89d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.825371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-de68adc6-5744-4973-afc5-14c4a107ec6e tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b06b12e39f947a2acfb1574e53b910c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7fc5df24c0437b9a21746466ca9bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:14.835642 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-de68adc6-5744-4973-afc5-14c4a107ec6e tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 200 len: 1507 microversion: 2.1 time: 0.770841 Jul 20 04:17:14.842655 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1044/1885] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:14 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 1507 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:14.864044 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8e7a839b-9d73-429c-8ee4-1db94e168888 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.020052 Jul 20 04:17:14.866291 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1045/1886] 10.222.0.17 () {58 vars in 1139 bytes} [Wed Jul 20 04:17:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:17:14.881240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b0e8e629-4bb9-40fb-ba60-4a19df5ace8b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:14.885561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b0e8e629-4bb9-40fb-ba60-4a19df5ace8b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:14.898466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b0e8e629-4bb9-40fb-ba60-4a19df5ace8b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.905932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b0e8e629-4bb9-40fb-ba60-4a19df5ace8b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.910782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b0e8e629-4bb9-40fb-ba60-4a19df5ace8b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.911509 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b0e8e629-4bb9-40fb-ba60-4a19df5ace8b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:15.127746 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:17:15.128234 n-d-826526-5 devstack@n-api.service[127870]: Wed Jul 20 04:17:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe (ip 10.222.0.17) !!! Jul 20 04:17:15.226591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b0e8e629-4bb9-40fb-ba60-4a19df5ace8b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.240637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b0e8e629-4bb9-40fb-ba60-4a19df5ace8b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.247036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b0e8e629-4bb9-40fb-ba60-4a19df5ace8b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.261387 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b0e8e629-4bb9-40fb-ba60-4a19df5ace8b tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 200 len: 1266 microversion: 2.25 time: 0.381605 Jul 20 04:17:15.263918 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1046/1887] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:14 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 1266 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:15.271607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ea47df84-3a0c-4d56-8ef0-2a57784cc89d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.281773 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ea47df84-3a0c-4d56-8ef0-2a57784cc89d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.556107 Jul 20 04:17:15.286434 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b2c06d3a-05d4-4f8a-aeb2-8c4198f13edb tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.019956 Jul 20 04:17:15.291432 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 842/1888] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:14 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:15.295051 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1047/1889] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:17:15 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:17:15.298169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e009c123-6d8c-4b7c-a6a2-f9948dfc9313 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be2f81f0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:15.314761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-24bd6326-92aa-4ea5-8848-5a1fc221c7e5 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] Calling method '.version_select at 0x7f06c748d280>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:15.404202 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e009c123-6d8c-4b7c-a6a2-f9948dfc9313 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.111240 Jul 20 04:17:15.406251 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 843/1890] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:15 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:15.861895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9b472c5d-3441-4baf-83c4-213f67d19c99 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:15.862910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9b472c5d-3441-4baf-83c4-213f67d19c99 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:15.876665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9b472c5d-3441-4baf-83c4-213f67d19c99 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:15.877124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9b472c5d-3441-4baf-83c4-213f67d19c99 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:15.878011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9b472c5d-3441-4baf-83c4-213f67d19c99 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:15.878451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9b472c5d-3441-4baf-83c4-213f67d19c99 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.403943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9b472c5d-3441-4baf-83c4-213f67d19c99 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b06b12e39f947a2acfb1574e53b910c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7fc5df24c0437b9a21746466ca9bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:16.424436 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9b472c5d-3441-4baf-83c4-213f67d19c99 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 200 len: 1507 microversion: 2.1 time: 0.558826 Jul 20 04:17:16.425707 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 844/1891] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:15 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 1507 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:16.430905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-48b4bb01-b8f7-455b-b8ca-e966356628da tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:16.431924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-48b4bb01-b8f7-455b-b8ca-e966356628da tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 32c4bdc1-7bb8-47c0-b73f-317ba18949df] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:16.447250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b4bb01-b8f7-455b-b8ca-e966356628da tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.450118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b4bb01-b8f7-455b-b8ca-e966356628da tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.451322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b4bb01-b8f7-455b-b8ca-e966356628da tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.457009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b4bb01-b8f7-455b-b8ca-e966356628da tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.491192 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-48b4bb01-b8f7-455b-b8ca-e966356628da tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] HTTP exception thrown: Instance 32c4bdc1-7bb8-47c0-b73f-317ba18949df could not be found. Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-48b4bb01-b8f7-455b-b8ca-e966356628da tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Request method failure captured: Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df HTTP/1.1 Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14ALEpS8cLFwrWGrP2QWc6ENbBeQxhTSZrCMB4J-aiWbIB1DcF5qsJhQO_fS3PT3NzooKQpZlA-XJW7ILwnbQGTJCAxxmlsPvEnem5bZawLFEGTJVax5f9UvzTQ2J2dI4LC2UBTpQtVDHBHmByN6irkSPk6c_cmOrMQPvRZJYv9WSV0 Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 8d4037629b9e4e6fa92e2a8d89cf0311 Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1255805509 Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:17:16.493238 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:17:16.494965 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d4037629b9e4e6fa92e2a8d89cf0311"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8d4037629b9e4e6fa92e2a8d89cf0311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8d4037629b9e4e6fa92e2a8d89cf0311", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d4037629b9e4e6fa92e2a8d89cf0311"}]}] Jul 20 04:17:16.494965 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1255805509 Jul 20 04:17:16.494965 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 8d4037629b9e4e6fa92e2a8d89cf0311 Jul 20 04:17:16.494965 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1255805509 Jul 20 04:17:16.494965 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-LiveAutoBlockMigrationV225Test-1255805509-project Jul 20 04:17:16.494965 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:17:16.494965 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:17:16.494965 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 45a9bfefde81473d88610b03e0de9bf4 Jul 20 04:17:16.494965 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1255805509-project Jul 20 04:17:16.494965 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:17:16.494965 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 32c4bdc1-7bb8-47c0-b73f-317ba18949df could not be found. Jul 20 04:17:16.494965 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '32c4bdc1-7bb8-47c0-b73f-317ba18949df'} Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c4bdc1-7bb8-47c0-b73f-317ba18949df could not be found. Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:16.495978 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:16.497535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:16.497535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:16.497535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:16.497535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:16.497535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:16.497535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:16.497535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:16.497535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c4bdc1-7bb8-47c0-b73f-317ba18949df could not be found. Jul 20 04:17:16.497535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:16.497535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:16.497535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:16.497535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:16.497535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:16.497535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:16.497535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:16.497535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:16.497535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c4bdc1-7bb8-47c0-b73f-317ba18949df could not be found. Jul 20 04:17:16.497535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:16.503620 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-48b4bb01-b8f7-455b-b8ca-e966356628da tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Returning 404 to user: Instance 32c4bdc1-7bb8-47c0-b73f-317ba18949df could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:16.509561 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-48b4bb01-b8f7-455b-b8ca-e966356628da tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df" status: 404 len: 111 microversion: 2.25 time: 0.082510 Jul 20 04:17:16.515089 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 845/1892] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:16 2022] GET /compute/v2.1/servers/32c4bdc1-7bb8-47c0-b73f-317ba18949df => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:17:16.525571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-06a6ac1c-3cf4-446a-a603-a2cc66aab9b0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:16.530325 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-06a6ac1c-3cf4-446a-a603-a2cc66aab9b0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:16.544388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06a6ac1c-3cf4-446a-a603-a2cc66aab9b0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.545267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06a6ac1c-3cf4-446a-a603-a2cc66aab9b0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.547392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06a6ac1c-3cf4-446a-a603-a2cc66aab9b0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.548680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06a6ac1c-3cf4-446a-a603-a2cc66aab9b0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.199187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-06a6ac1c-3cf4-446a-a603-a2cc66aab9b0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:17.212820 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-06a6ac1c-3cf4-446a-a603-a2cc66aab9b0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.696189 Jul 20 04:17:17.214868 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 846/1893] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:16 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:17.221518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-85d3d5bd-317e-4492-92a1-29316b88bd4a tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be2dfdc0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:17.320950 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-85d3d5bd-317e-4492-92a1-29316b88bd4a tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.104504 Jul 20 04:17:17.322858 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 847/1894] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:17 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:17.445810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-98eddae7-d13f-4f88-888d-548f83eefb94 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:17.447087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-98eddae7-d13f-4f88-888d-548f83eefb94 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:17.464085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98eddae7-d13f-4f88-888d-548f83eefb94 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.464962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98eddae7-d13f-4f88-888d-548f83eefb94 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.466116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98eddae7-d13f-4f88-888d-548f83eefb94 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.466748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98eddae7-d13f-4f88-888d-548f83eefb94 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.275315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-98eddae7-d13f-4f88-888d-548f83eefb94 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b06b12e39f947a2acfb1574e53b910c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7fc5df24c0437b9a21746466ca9bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:18.288705 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-98eddae7-d13f-4f88-888d-548f83eefb94 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 200 len: 1505 microversion: 2.1 time: 0.846926 Jul 20 04:17:18.289736 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 848/1895] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:17 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 1505 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:18.298787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f1ca577e-3316-487c-8688-a71f474f2cb5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:18.305023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f1ca577e-3316-487c-8688-a71f474f2cb5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:18.322473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1ca577e-3316-487c-8688-a71f474f2cb5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.325217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1ca577e-3316-487c-8688-a71f474f2cb5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.329852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1ca577e-3316-487c-8688-a71f474f2cb5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.330800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1ca577e-3316-487c-8688-a71f474f2cb5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.025219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f1ca577e-3316-487c-8688-a71f474f2cb5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:19.038104 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f1ca577e-3316-487c-8688-a71f474f2cb5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.744080 Jul 20 04:17:19.039127 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 849/1896] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:18 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:19.047775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-70abaa0a-37ab-4303-a0a8-1092e03b8b3d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '.version_select at 0x7f06be2ec160>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:19.055664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-70abaa0a-37ab-4303-a0a8-1092e03b8b3d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:19.069879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70abaa0a-37ab-4303-a0a8-1092e03b8b3d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.071579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70abaa0a-37ab-4303-a0a8-1092e03b8b3d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.074168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70abaa0a-37ab-4303-a0a8-1092e03b8b3d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.074839 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70abaa0a-37ab-4303-a0a8-1092e03b8b3d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.148492 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-70abaa0a-37ab-4303-a0a8-1092e03b8b3d tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.107733 Jul 20 04:17:19.149414 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 850/1897] 10.222.0.17 () {58 vars in 1295 bytes} [Wed Jul 20 04:17:19 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada/os-instance-actions => generated 611 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:19.154746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-331141e3-0b08-4f30-bb77-5471f57bfc56 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be6f83a0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:19.246495 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-331141e3-0b08-4f30-bb77-5471f57bfc56 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1411 microversion: 2.1 time: 0.095631 Jul 20 04:17:19.247120 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 851/1898] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:19 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:19.258794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-695814ab-c3f0-4004-9bcd-1549aa954ea2 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:19.259985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-695814ab-c3f0-4004-9bcd-1549aa954ea2 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:19.277650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-695814ab-c3f0-4004-9bcd-1549aa954ea2 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.278478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-695814ab-c3f0-4004-9bcd-1549aa954ea2 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.279109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-695814ab-c3f0-4004-9bcd-1549aa954ea2 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.279569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-695814ab-c3f0-4004-9bcd-1549aa954ea2 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.351740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-695814ab-c3f0-4004-9bcd-1549aa954ea2 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:19.525716 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-695814ab-c3f0-4004-9bcd-1549aa954ea2 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 204 len: 0 microversion: 2.1 time: 0.276475 Jul 20 04:17:19.529571 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 852/1899] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:19 2022] DELETE /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:19.560738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-18b9df32-a752-45cf-92de-7454c2cae299 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:19.562987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-18b9df32-a752-45cf-92de-7454c2cae299 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:19.575776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18b9df32-a752-45cf-92de-7454c2cae299 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.578341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18b9df32-a752-45cf-92de-7454c2cae299 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.580920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18b9df32-a752-45cf-92de-7454c2cae299 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.582293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18b9df32-a752-45cf-92de-7454c2cae299 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.920090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-18b9df32-a752-45cf-92de-7454c2cae299 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b06b12e39f947a2acfb1574e53b910c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7fc5df24c0437b9a21746466ca9bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:19.968734 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-18b9df32-a752-45cf-92de-7454c2cae299 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 200 len: 1511 microversion: 2.1 time: 0.424059 Jul 20 04:17:19.971136 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 853/1900] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:19 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 1511 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:20.069059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1697b186-f180-4aa1-b8d4-32cbbf2e9c0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:20.071382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1697b186-f180-4aa1-b8d4-32cbbf2e9c0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:20.096932 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1697b186-f180-4aa1-b8d4-32cbbf2e9c0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.098238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1697b186-f180-4aa1-b8d4-32cbbf2e9c0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.100034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1697b186-f180-4aa1-b8d4-32cbbf2e9c0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.100533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1697b186-f180-4aa1-b8d4-32cbbf2e9c0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.685638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1697b186-f180-4aa1-b8d4-32cbbf2e9c0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:20.708735 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1697b186-f180-4aa1-b8d4-32cbbf2e9c0a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.648188 Jul 20 04:17:20.712830 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 854/1901] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:20 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:20.719627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-de5efd8f-d9c7-4ef8-9b86-34ba6ea0d5b3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be6999d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:20.812815 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-de5efd8f-d9c7-4ef8-9b86-34ba6ea0d5b3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1420 microversion: 2.1 time: 0.098482 Jul 20 04:17:20.813416 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 855/1902] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:20 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:20.827335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e7a3d8ce-b31f-43d3-bd1a-0d10e13a393c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be6f8430>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:20.916730 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e7a3d8ce-b31f-43d3-bd1a-0d10e13a393c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 200 len: 1420 microversion: 2.1 time: 0.094865 Jul 20 04:17:20.917605 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 856/1903] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:20 2022] GET /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:20.933066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-af26fb06-6b5b-4864-9fef-7940b5bc51e6 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be699d30>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:22.034940 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-af26fb06-6b5b-4864-9fef-7940b5bc51e6 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "DELETE /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 204 len: 0 microversion: 2.1 time: 1.106166 Jul 20 04:17:22.036030 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 857/1904] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:20 2022] DELETE /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 0 bytes in 1108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:22.043337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9fb927b0-0645-4fa1-bb4c-63a54595e180 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:22.047816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9fb927b0-0645-4fa1-bb4c-63a54595e180 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:22.069842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9fb927b0-0645-4fa1-bb4c-63a54595e180 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.071705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9fb927b0-0645-4fa1-bb4c-63a54595e180 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.075301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9fb927b0-0645-4fa1-bb4c-63a54595e180 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.076785 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9fb927b0-0645-4fa1-bb4c-63a54595e180 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.798707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9fb927b0-0645-4fa1-bb4c-63a54595e180 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b06b12e39f947a2acfb1574e53b910c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7fc5df24c0437b9a21746466ca9bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:22.816927 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9fb927b0-0645-4fa1-bb4c-63a54595e180 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 200 len: 1511 microversion: 2.1 time: 0.777699 Jul 20 04:17:22.818242 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 858/1905] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:22 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 1511 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:22.867302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a0130f91-4983-48e7-96b3-b22650289ee4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:22.877841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a0130f91-4983-48e7-96b3-b22650289ee4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:22.902708 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0130f91-4983-48e7-96b3-b22650289ee4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.909521 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0130f91-4983-48e7-96b3-b22650289ee4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.911567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0130f91-4983-48e7-96b3-b22650289ee4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.914093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0130f91-4983-48e7-96b3-b22650289ee4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.782676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a0130f91-4983-48e7-96b3-b22650289ee4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.796991 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a0130f91-4983-48e7-96b3-b22650289ee4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.956967 Jul 20 04:17:23.798579 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 859/1906] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:22 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:23.810608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b48675b0-0241-43fa-9a6c-ae9186865d9c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:23.811492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b48675b0-0241-43fa-9a6c-ae9186865d9c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:23.828391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b48675b0-0241-43fa-9a6c-ae9186865d9c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.834759 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b48675b0-0241-43fa-9a6c-ae9186865d9c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.837011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b48675b0-0241-43fa-9a6c-ae9186865d9c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.838186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b48675b0-0241-43fa-9a6c-ae9186865d9c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.909433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b48675b0-0241-43fa-9a6c-ae9186865d9c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:24.016849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:24.097385 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b48675b0-0241-43fa-9a6c-ae9186865d9c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 204 len: 0 microversion: 2.1 time: 0.293676 Jul 20 04:17:24.099119 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 860/1907] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:23 2022] DELETE /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:24.126412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e4fa52dc-c554-433e-80fe-b54158ca8eb2 req-b019fd18-a763-4d5f-913a-86e33c6cc534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f11b376-b57d-4e26-85c1-8c8b958f4ada", "name": "network-vif-deleted", "tag": "0de5ee82-0107-4d78-be4c-57f52a2e5945"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:24.143686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e4fa52dc-c554-433e-80fe-b54158ca8eb2 req-b019fd18-a763-4d5f-913a-86e33c6cc534 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.144569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e4fa52dc-c554-433e-80fe-b54158ca8eb2 req-b019fd18-a763-4d5f-913a-86e33c6cc534 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.161165 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e4fa52dc-c554-433e-80fe-b54158ca8eb2 req-b019fd18-a763-4d5f-913a-86e33c6cc534 service nova] Creating event network-vif-deleted:0de5ee82-0107-4d78-be4c-57f52a2e5945 for instance 1f11b376-b57d-4e26-85c1-8c8b958f4ada on n-h2-826526-5 Jul 20 04:17:24.168069 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e4fa52dc-c554-433e-80fe-b54158ca8eb2 req-b019fd18-a763-4d5f-913a-86e33c6cc534 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065907 Jul 20 04:17:24.169157 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 861/1908] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:24.189924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aee78d29-93d3-4026-afe4-b78f2efa4712 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:24.192988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aee78d29-93d3-4026-afe4-b78f2efa4712 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] [instance: 1f11b376-b57d-4e26-85c1-8c8b958f4ada] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:24.207441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aee78d29-93d3-4026-afe4-b78f2efa4712 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.208535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aee78d29-93d3-4026-afe4-b78f2efa4712 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.210311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aee78d29-93d3-4026-afe4-b78f2efa4712 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.210829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aee78d29-93d3-4026-afe4-b78f2efa4712 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.260629 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-aee78d29-93d3-4026-afe4-b78f2efa4712 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] HTTP exception thrown: Instance 1f11b376-b57d-4e26-85c1-8c8b958f4ada could not be found. Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aee78d29-93d3-4026-afe4-b78f2efa4712 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Request method failure captured: Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada HTTP/1.1 Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14Gw3PLagXAOMr9mv3zWSfvkqyrmDK5sLW7trE6NPSBH6PUb90AHMGkMHWGoG0GHIB80naNhZdNQqNspL6BLG7uP2BHhlBH5TBXCZJXtDuwAHDKmeNOokSceJU3tjRK2kA4X_JoPhXuD2t1exnpmV66ct6e_JH20ch2ptvl1kZsh-M4 Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 5a7fc5df24c0437b9a21746466ca9bc2 Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-InstanceActionsTestJSON-2000975205 Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:17:24.263002 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:17:24.264769 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5a7fc5df24c0437b9a21746466ca9bc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5a7fc5df24c0437b9a21746466ca9bc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5a7fc5df24c0437b9a21746466ca9bc2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5a7fc5df24c0437b9a21746466ca9bc2"}]}] Jul 20 04:17:24.264769 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-InstanceActionsTestJSON-2000975205 Jul 20 04:17:24.264769 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 5a7fc5df24c0437b9a21746466ca9bc2 Jul 20 04:17:24.264769 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-InstanceActionsTestJSON-2000975205 Jul 20 04:17:24.264769 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-InstanceActionsTestJSON-2000975205-project Jul 20 04:17:24.264769 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:17:24.264769 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:17:24.264769 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 5b06b12e39f947a2acfb1574e53b910c Jul 20 04:17:24.264769 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-InstanceActionsTestJSON-2000975205-project Jul 20 04:17:24.264769 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:17:24.264769 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 1f11b376-b57d-4e26-85c1-8c8b958f4ada could not be found. Jul 20 04:17:24.264769 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '1f11b376-b57d-4e26-85c1-8c8b958f4ada'} Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f11b376-b57d-4e26-85c1-8c8b958f4ada could not be found. Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:24.265841 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:24.267437 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:24.267437 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:24.267437 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:24.267437 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:24.267437 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:24.267437 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:24.267437 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:24.267437 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f11b376-b57d-4e26-85c1-8c8b958f4ada could not be found. Jul 20 04:17:24.267437 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:24.267437 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:24.267437 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:24.267437 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:24.267437 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:24.267437 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:24.267437 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:24.267437 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:24.267437 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f11b376-b57d-4e26-85c1-8c8b958f4ada could not be found. Jul 20 04:17:24.267437 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:24.272674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aee78d29-93d3-4026-afe4-b78f2efa4712 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] Returning 404 to user: Instance 1f11b376-b57d-4e26-85c1-8c8b958f4ada could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:24.273963 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aee78d29-93d3-4026-afe4-b78f2efa4712 tempest-InstanceActionsTestJSON-2000975205 tempest-InstanceActionsTestJSON-2000975205-project] 10.222.0.17 "GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada" status: 404 len: 111 microversion: 2.1 time: 0.097543 Jul 20 04:17:24.275902 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 862/1909] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:24 2022] GET /compute/v2.1/servers/1f11b376-b57d-4e26-85c1-8c8b958f4ada => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:24.307115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-0e0c507e-2b68-474e-b279-dd308aec5767 req-03df878d-e881-4c6e-a3ea-82646629aed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2976722a-674d-49e5-b4e3-3aebf11d51c5", "name": "network-vif-unplugged", "status": "completed", "tag": "a90d62a0-b1f9-47e0-a6cd-97d4474f8e74"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:24.332876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0e0c507e-2b68-474e-b279-dd308aec5767 req-03df878d-e881-4c6e-a3ea-82646629aed3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.334037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0e0c507e-2b68-474e-b279-dd308aec5767 req-03df878d-e881-4c6e-a3ea-82646629aed3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.351541 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-0e0c507e-2b68-474e-b279-dd308aec5767 req-03df878d-e881-4c6e-a3ea-82646629aed3 service nova] Creating event network-vif-unplugged:a90d62a0-b1f9-47e0-a6cd-97d4474f8e74 for instance 2976722a-674d-49e5-b4e3-3aebf11d51c5 on n-h1-826526-5 Jul 20 04:17:24.364530 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-0e0c507e-2b68-474e-b279-dd308aec5767 req-03df878d-e881-4c6e-a3ea-82646629aed3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061095 Jul 20 04:17:24.365962 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 863/1910] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:24.373565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a19b1548-b6b3-4474-9706-a40bd44d6202 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-3516932", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "4a34548b-e35a-44a0-ab83-c5f87d932d5b"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:24.466347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-a19b1548-b6b3-4474-9706-a40bd44d6202 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] validate_networks() for [('4a34548b-e35a-44a0-ab83-c5f87d932d5b', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:17:24.893922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=51 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:25.232670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:25.482474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a19b1548-b6b3-4474-9706-a40bd44d6202 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:25.483478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a19b1548-b6b3-4474-9706-a40bd44d6202 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:25.484125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a19b1548-b6b3-4474-9706-a40bd44d6202 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:25.485622 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a19b1548-b6b3-4474-9706-a40bd44d6202 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:25.486297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a19b1548-b6b3-4474-9706-a40bd44d6202 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:25.507309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a19b1548-b6b3-4474-9706-a40bd44d6202 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.508748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a19b1548-b6b3-4474-9706-a40bd44d6202 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.509962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a19b1548-b6b3-4474-9706-a40bd44d6202 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.510619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a19b1548-b6b3-4474-9706-a40bd44d6202 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.592752 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-a19b1548-b6b3-4474-9706-a40bd44d6202 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Getting quotas for project 2c925e4a93c3401fa5f4d51e7380b7ad. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:25.601467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-a19b1548-b6b3-4474-9706-a40bd44d6202 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Getting quotas for user feb531c9e5dd4afd99f2974848a6a75b and project 2c925e4a93c3401fa5f4d51e7380b7ad. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:25.635673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a19b1548-b6b3-4474-9706-a40bd44d6202 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:25.645543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a19b1548-b6b3-4474-9706-a40bd44d6202 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:25.747678 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a19b1548-b6b3-4474-9706-a40bd44d6202 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.375104 Jul 20 04:17:25.751073 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 864/1911] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:17:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:17:25.773816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-09f113de-f3bd-489b-a776-46cae8a6186c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:25.778807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-09f113de-f3bd-489b-a776-46cae8a6186c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:25.799815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09f113de-f3bd-489b-a776-46cae8a6186c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.800576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09f113de-f3bd-489b-a776-46cae8a6186c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.801572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09f113de-f3bd-489b-a776-46cae8a6186c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.804428 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09f113de-f3bd-489b-a776-46cae8a6186c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:26.426369 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-09f113de-f3bd-489b-a776-46cae8a6186c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:26.437068 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-09f113de-f3bd-489b-a776-46cae8a6186c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.684464 Jul 20 04:17:26.442578 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 865/1912] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:25 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:26.471116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cfd0e7a3-8240-42b1-a756-5f62e8c0d9f7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:26.477070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cfd0e7a3-8240-42b1-a756-5f62e8c0d9f7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:26.625874 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cfd0e7a3-8240-42b1-a756-5f62e8c0d9f7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:26.641520 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cfd0e7a3-8240-42b1-a756-5f62e8c0d9f7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 200 len: 1205 microversion: 2.1 time: 0.196122 Jul 20 04:17:26.644850 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 866/1913] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:26 2022] GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 1205 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:27.461846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1027c99a-6481-49be-9950-3eed29686615 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:27.462734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1027c99a-6481-49be-9950-3eed29686615 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:27.475869 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1027c99a-6481-49be-9950-3eed29686615 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:27.480980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1027c99a-6481-49be-9950-3eed29686615 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:27.482115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1027c99a-6481-49be-9950-3eed29686615 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:27.483314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1027c99a-6481-49be-9950-3eed29686615 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.139242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1027c99a-6481-49be-9950-3eed29686615 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:28.166548 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1027c99a-6481-49be-9950-3eed29686615 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.710184 Jul 20 04:17:28.170692 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 867/1914] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:27 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:28.203978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-62dd8841-873a-40f8-bc43-8a6d80f69ef9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:28.208297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62dd8841-873a-40f8-bc43-8a6d80f69ef9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:28.230435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62dd8841-873a-40f8-bc43-8a6d80f69ef9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.230891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62dd8841-873a-40f8-bc43-8a6d80f69ef9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.231684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62dd8841-873a-40f8-bc43-8a6d80f69ef9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.232116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62dd8841-873a-40f8-bc43-8a6d80f69ef9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.686288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-62dd8841-873a-40f8-bc43-8a6d80f69ef9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:28.707863 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-62dd8841-873a-40f8-bc43-8a6d80f69ef9 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 200 len: 1263 microversion: 2.1 time: 0.515469 Jul 20 04:17:28.711242 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 868/1915] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:28 2022] GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 1263 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:28.734145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f0a6efa8-21fa-4d30-b47d-638db0699f85 req-9a9a19b8-5736-4622-b595-2b977c12ea12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2976722a-674d-49e5-b4e3-3aebf11d51c5", "name": "network-vif-deleted", "tag": "a90d62a0-b1f9-47e0-a6cd-97d4474f8e74"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:28.812514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f0a6efa8-21fa-4d30-b47d-638db0699f85 req-9a9a19b8-5736-4622-b595-2b977c12ea12 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.813815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f0a6efa8-21fa-4d30-b47d-638db0699f85 req-9a9a19b8-5736-4622-b595-2b977c12ea12 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.814744 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-24bd6326-92aa-4ea5-8848-5a1fc221c7e5 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] HTTP exception thrown: Volume 37227e78-fd41-4020-ae74-7ce82d1f43b6 could not be found. Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-24bd6326-92aa-4ea5-8848-5a1fc221c7e5 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] Request method failure captured: Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/os-volumes/37227e78-fd41-4020-ae74-7ce82d1f43b6 HTTP/1.1 Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14HFM0fYaZvd2fXVJfHLO_kAViM5mMQWFQeXGHy4_N0md_qiZGrGtssnJg9Iblk6rp12lw1gLPVLZHUU3M5riaZvw0gBTE0T9IFM8wQ_DBMHLxM7a4ZZZN_uJ4Qt6LEViSQ15jShF-CcNNSjg-7HmDJoGBcAb4w_b_w4Cl4WVoM4dDo Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: f16f31a682ec46389d445c4c5832a879 Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-VolumesNegativeTest-1123101644 Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:17:28.817474 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:17:28.819020 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f16f31a682ec46389d445c4c5832a879"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f16f31a682ec46389d445c4c5832a879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f16f31a682ec46389d445c4c5832a879", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f16f31a682ec46389d445c4c5832a879"}]}] Jul 20 04:17:28.819020 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-VolumesNegativeTest-1123101644 Jul 20 04:17:28.819020 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: f16f31a682ec46389d445c4c5832a879 Jul 20 04:17:28.819020 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-VolumesNegativeTest-1123101644 Jul 20 04:17:28.819020 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-VolumesNegativeTest-1123101644-project Jul 20 04:17:28.819020 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:17:28.819020 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:17:28.819020 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a24b369a764d4073bb8bcae8c6e577c5 Jul 20 04:17:28.819020 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-VolumesNegativeTest-1123101644-project Jul 20 04:17:28.819020 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:17:28.819020 n-d-826526-5 devstack@n-api.service[127871]: exception: Volume 37227e78-fd41-4020-ae74-7ce82d1f43b6 could not be found. Jul 20 04:17:28.819020 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '37227e78-fd41-4020-ae74-7ce82d1f43b6'} Jul 20 04:17:28.819020 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 37227e78-fd41-4020-ae74-7ce82d1f43b6 could not be found. (HTTP 404) (Request-ID: req-76a9f596-1b03-4471-9120-d037dc527eb0) Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:28.821306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:17:28.823629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 37227e78-fd41-4020-ae74-7ce82d1f43b6 could not be found. Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 04:17:28.827912 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:28.831901 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 37227e78-fd41-4020-ae74-7ce82d1f43b6 could not be found. Jul 20 04:17:28.831901 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:28.831901 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:28.831901 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:28.831901 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:28.831901 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:28.831901 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:28.831901 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:28.831901 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:28.831901 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 37227e78-fd41-4020-ae74-7ce82d1f43b6 could not be found. Jul 20 04:17:28.831901 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:28.831901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-24bd6326-92aa-4ea5-8848-5a1fc221c7e5 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] Returning 404 to user: Volume 37227e78-fd41-4020-ae74-7ce82d1f43b6 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:28.831901 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-24bd6326-92aa-4ea5-8848-5a1fc221c7e5 tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/37227e78-fd41-4020-ae74-7ce82d1f43b6" status: 404 len: 109 microversion: 2.1 time: 13.518734 Jul 20 04:17:28.831901 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1048/1916] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 04:17:15 2022] DELETE /compute/v2.1/os-volumes/37227e78-fd41-4020-ae74-7ce82d1f43b6 => generated 109 bytes in 13520 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:28.837858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-58d6d210-b6fb-4364-a517-0544700deb1c tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] Calling method '.version_select at 0x7f06c7495310>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:28.891879 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f0a6efa8-21fa-4d30-b47d-638db0699f85 req-9a9a19b8-5736-4622-b595-2b977c12ea12 service nova] Creating event network-vif-deleted:a90d62a0-b1f9-47e0-a6cd-97d4474f8e74 for instance 2976722a-674d-49e5-b4e3-3aebf11d51c5 on n-h1-826526-5 Jul 20 04:17:28.909070 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f0a6efa8-21fa-4d30-b47d-638db0699f85 req-9a9a19b8-5736-4622-b595-2b977c12ea12 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195835 Jul 20 04:17:28.909710 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 869/1917] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:29.092338 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-58d6d210-b6fb-4364-a517-0544700deb1c tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] HTTP exception thrown: Volume 48e4a3e6-0211-4fb5-a4c3-09e2e3839cd8 could not be found. Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-58d6d210-b6fb-4364-a517-0544700deb1c tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] Request method failure captured: Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-volumes/48e4a3e6-0211-4fb5-a4c3-09e2e3839cd8 HTTP/1.1 Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14HFM0fYaZvd2fXVJfHLO_kAViM5mMQWFQeXGHy4_N0md_qiZGrGtssnJg9Iblk6rp12lw1gLPVLZHUU3M5riaZvw0gBTE0T9IFM8wQ_DBMHLxM7a4ZZZN_uJ4Qt6LEViSQ15jShF-CcNNSjg-7HmDJoGBcAb4w_b_w4Cl4WVoM4dDo Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: f16f31a682ec46389d445c4c5832a879 Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-VolumesNegativeTest-1123101644 Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:17:29.094281 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:17:29.096124 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f16f31a682ec46389d445c4c5832a879"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f16f31a682ec46389d445c4c5832a879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f16f31a682ec46389d445c4c5832a879", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f16f31a682ec46389d445c4c5832a879"}]}] Jul 20 04:17:29.096124 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-VolumesNegativeTest-1123101644 Jul 20 04:17:29.096124 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: f16f31a682ec46389d445c4c5832a879 Jul 20 04:17:29.096124 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-VolumesNegativeTest-1123101644 Jul 20 04:17:29.096124 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-VolumesNegativeTest-1123101644-project Jul 20 04:17:29.096124 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:17:29.096124 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:17:29.096124 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a24b369a764d4073bb8bcae8c6e577c5 Jul 20 04:17:29.096124 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-VolumesNegativeTest-1123101644-project Jul 20 04:17:29.096124 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:17:29.096124 n-d-826526-5 devstack@n-api.service[127871]: exception: Volume 48e4a3e6-0211-4fb5-a4c3-09e2e3839cd8 could not be found. Jul 20 04:17:29.096124 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '48e4a3e6-0211-4fb5-a4c3-09e2e3839cd8'} Jul 20 04:17:29.096124 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 48e4a3e6-0211-4fb5-a4c3-09e2e3839cd8 could not be found. (HTTP 404) (Request-ID: req-27aef7ae-5425-4738-a513-a535d9952c78) Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:29.097772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:17:29.100151 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 48e4a3e6-0211-4fb5-a4c3-09e2e3839cd8 could not be found. Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 04:17:29.101839 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:29.103662 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 48e4a3e6-0211-4fb5-a4c3-09e2e3839cd8 could not be found. Jul 20 04:17:29.103662 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:29.103662 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:29.103662 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:29.103662 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:29.103662 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:29.103662 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:29.103662 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:29.103662 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:29.103662 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 48e4a3e6-0211-4fb5-a4c3-09e2e3839cd8 could not be found. Jul 20 04:17:29.103662 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:29.103662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-58d6d210-b6fb-4364-a517-0544700deb1c tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] Returning 404 to user: Volume 48e4a3e6-0211-4fb5-a4c3-09e2e3839cd8 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:29.103662 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-58d6d210-b6fb-4364-a517-0544700deb1c tempest-VolumesNegativeTest-1123101644 tempest-VolumesNegativeTest-1123101644-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/48e4a3e6-0211-4fb5-a4c3-09e2e3839cd8" status: 404 len: 109 microversion: 2.1 time: 0.268898 Jul 20 04:17:29.103662 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1049/1918] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:17:28 2022] GET /compute/v2.1/os-volumes/48e4a3e6-0211-4fb5-a4c3-09e2e3839cd8 => generated 109 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:29.191845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-593d2405-7823-41f4-91a1-7c83ee91e786 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:29.193746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-593d2405-7823-41f4-91a1-7c83ee91e786 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:29.215312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-593d2405-7823-41f4-91a1-7c83ee91e786 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.221031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-593d2405-7823-41f4-91a1-7c83ee91e786 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.223377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-593d2405-7823-41f4-91a1-7c83ee91e786 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.225965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-593d2405-7823-41f4-91a1-7c83ee91e786 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.728215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1cb73e37-1805-44e9-893e-c3632852c5b7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:29.728857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1cb73e37-1805-44e9-893e-c3632852c5b7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:29.741611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1cb73e37-1805-44e9-893e-c3632852c5b7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.749811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1cb73e37-1805-44e9-893e-c3632852c5b7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.753583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1cb73e37-1805-44e9-893e-c3632852c5b7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.758031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1cb73e37-1805-44e9-893e-c3632852c5b7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.785387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-593d2405-7823-41f4-91a1-7c83ee91e786 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:29.795503 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-593d2405-7823-41f4-91a1-7c83ee91e786 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.609294 Jul 20 04:17:29.800745 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 870/1919] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:29 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:30.254178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1cb73e37-1805-44e9-893e-c3632852c5b7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:30.264779 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1cb73e37-1805-44e9-893e-c3632852c5b7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 200 len: 1263 microversion: 2.1 time: 0.541430 Jul 20 04:17:30.269151 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1050/1920] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:29 2022] GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 1263 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:30.483580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-677f4acd-b590-471d-92d1-5b16e8a0abbe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-148578154", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "80c07577-b101-4f4f-b656-c3a34d626764"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:30.591212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-677f4acd-b590-471d-92d1-5b16e8a0abbe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] validate_networks() for [('80c07577-b101-4f4f-b656-c3a34d626764', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:17:30.821128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-255687eb-0eee-4635-9352-a6aaae5532c3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:30.822115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-255687eb-0eee-4635-9352-a6aaae5532c3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:30.836323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-255687eb-0eee-4635-9352-a6aaae5532c3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.838381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-255687eb-0eee-4635-9352-a6aaae5532c3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.843402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-255687eb-0eee-4635-9352-a6aaae5532c3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.846028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-255687eb-0eee-4635-9352-a6aaae5532c3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.712647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-677f4acd-b590-471d-92d1-5b16e8a0abbe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:31.713270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-677f4acd-b590-471d-92d1-5b16e8a0abbe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:31.713687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-677f4acd-b590-471d-92d1-5b16e8a0abbe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:31.714307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-677f4acd-b590-471d-92d1-5b16e8a0abbe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:31.714771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-677f4acd-b590-471d-92d1-5b16e8a0abbe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:31.734838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-677f4acd-b590-471d-92d1-5b16e8a0abbe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.737485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-677f4acd-b590-471d-92d1-5b16e8a0abbe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.741387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-677f4acd-b590-471d-92d1-5b16e8a0abbe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.741853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-677f4acd-b590-471d-92d1-5b16e8a0abbe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.800037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-677f4acd-b590-471d-92d1-5b16e8a0abbe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Getting quotas for project 023236fb56b14d0a9e5ae4dd6120162a. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:31.821790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-677f4acd-b590-471d-92d1-5b16e8a0abbe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Getting quotas for user 20801c8e312044b38e1a758387877528 and project 023236fb56b14d0a9e5ae4dd6120162a. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:31.861832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-677f4acd-b590-471d-92d1-5b16e8a0abbe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:31.870085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-677f4acd-b590-471d-92d1-5b16e8a0abbe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:32.027733 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-677f4acd-b590-471d-92d1-5b16e8a0abbe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.908045 Jul 20 04:17:32.036870 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 871/1921] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:17:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:17:32.053053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-97544f0b-59b5-42bf-af89-68132abf28a0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:32.061642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-97544f0b-59b5-42bf-af89-68132abf28a0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:32.084831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97544f0b-59b5-42bf-af89-68132abf28a0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.085426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97544f0b-59b5-42bf-af89-68132abf28a0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.089936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97544f0b-59b5-42bf-af89-68132abf28a0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.095208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97544f0b-59b5-42bf-af89-68132abf28a0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.163109 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-255687eb-0eee-4635-9352-a6aaae5532c3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:32.173752 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-255687eb-0eee-4635-9352-a6aaae5532c3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 1.356632 Jul 20 04:17:32.185226 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1051/1922] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:30 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:32.205613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-85415561-ec60-4265-9bbc-53461e764a6a tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:32.206251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-85415561-ec60-4265-9bbc-53461e764a6a tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:32.488402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-85415561-ec60-4265-9bbc-53461e764a6a tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20801c8e312044b38e1a758387877528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '023236fb56b14d0a9e5ae4dd6120162a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:32.502547 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-85415561-ec60-4265-9bbc-53461e764a6a tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" status: 200 len: 1231 microversion: 2.1 time: 0.315903 Jul 20 04:17:32.504615 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1052/1923] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:32 2022] GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f => generated 1231 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:33.193144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-65d9207e-bcc3-4bd3-879c-10cf1910495c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:33.193775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-65d9207e-bcc3-4bd3-879c-10cf1910495c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:33.243157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-97544f0b-59b5-42bf-af89-68132abf28a0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:33.258989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65d9207e-bcc3-4bd3-879c-10cf1910495c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.260343 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-97544f0b-59b5-42bf-af89-68132abf28a0 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 200 len: 1305 microversion: 2.1 time: 1.214535 Jul 20 04:17:33.262463 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 872/1924] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:32 2022] GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 1305 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:33.270328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65d9207e-bcc3-4bd3-879c-10cf1910495c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.272416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65d9207e-bcc3-4bd3-879c-10cf1910495c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.274209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65d9207e-bcc3-4bd3-879c-10cf1910495c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.520287 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cecde8a5-0263-4ab9-a220-c8831a192796 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:33.521183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cecde8a5-0263-4ab9-a220-c8831a192796 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:33.528954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cecde8a5-0263-4ab9-a220-c8831a192796 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.541992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cecde8a5-0263-4ab9-a220-c8831a192796 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.543233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cecde8a5-0263-4ab9-a220-c8831a192796 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.543867 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cecde8a5-0263-4ab9-a220-c8831a192796 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.935429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cecde8a5-0263-4ab9-a220-c8831a192796 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20801c8e312044b38e1a758387877528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '023236fb56b14d0a9e5ae4dd6120162a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:33.945132 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cecde8a5-0263-4ab9-a220-c8831a192796 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" status: 200 len: 1227 microversion: 2.1 time: 0.428922 Jul 20 04:17:33.952713 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 873/1925] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:33 2022] GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f => generated 1227 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:34.098115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-65d9207e-bcc3-4bd3-879c-10cf1910495c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:34.114782 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-65d9207e-bcc3-4bd3-879c-10cf1910495c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.927534 Jul 20 04:17:34.115408 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1053/1926] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:33 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:34.278382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-161ac297-166f-4714-afea-8d22c6bd6406 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:34.279168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-161ac297-166f-4714-afea-8d22c6bd6406 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:34.286949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-161ac297-166f-4714-afea-8d22c6bd6406 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.290737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-161ac297-166f-4714-afea-8d22c6bd6406 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.292329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-161ac297-166f-4714-afea-8d22c6bd6406 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.296496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-161ac297-166f-4714-afea-8d22c6bd6406 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.257599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3f4d5b0d-8d53-4d09-bfce-332a6a27da73 tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b4bfb058-2c6a-41bf-91d4-31bb8a20e4b3"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:35.258650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3f4d5b0d-8d53-4d09-bfce-332a6a27da73 tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.277524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f4d5b0d-8d53-4d09-bfce-332a6a27da73 tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.278168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f4d5b0d-8d53-4d09-bfce-332a6a27da73 tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.281759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f4d5b0d-8d53-4d09-bfce-332a6a27da73 tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.283956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f4d5b0d-8d53-4d09-bfce-332a6a27da73 tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.488534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-161ac297-166f-4714-afea-8d22c6bd6406 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:35.508694 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-161ac297-166f-4714-afea-8d22c6bd6406 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 200 len: 1305 microversion: 2.1 time: 1.232251 Jul 20 04:17:35.518742 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 874/1927] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:34 2022] GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 1305 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:35.523079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-629cf29b-b89f-43a4-92dc-7870bab9055b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.524906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-629cf29b-b89f-43a4-92dc-7870bab9055b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.543945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-629cf29b-b89f-43a4-92dc-7870bab9055b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.551509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-629cf29b-b89f-43a4-92dc-7870bab9055b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.555112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-629cf29b-b89f-43a4-92dc-7870bab9055b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.558182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-629cf29b-b89f-43a4-92dc-7870bab9055b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.576973 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-3f4d5b0d-8d53-4d09-bfce-332a6a27da73 tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] HTTP exception thrown: Volume b4bfb058-2c6a-41bf-91d4-31bb8a20e4b3 could not be found. Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3f4d5b0d-8d53-4d09-bfce-332a6a27da73 tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] Request method failure captured: Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: request: PUT /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments/4e612e86-6b2a-47de-b41b-00e713b9e6bb HTTP/1.1 Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 74 Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14GAufyNS9JNTcio_BIyTV3aydBIM92jOEmFb3np1bwu9f4lkJDkXe1T4PXvU4z3O_jtWFRAfXwTvlO1-jzKe3MnyB9FrBCsmkO1maGDy2p8MV2KBmITlHLMR-HuHcz1badlKeNE3IXbNE3mYt6vKWzyi1ZK7aszBU4spV_gnFxjkKY Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 02b439f74bf04bc6bb23f1cde4d3d8c8 Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-VolumesAdminNegativeTest-530099437 Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:17:35.581395 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:17:35.582979 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/02b439f74bf04bc6bb23f1cde4d3d8c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/02b439f74bf04bc6bb23f1cde4d3d8c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_02b439f74bf04bc6bb23f1cde4d3d8c8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/02b439f74bf04bc6bb23f1cde4d3d8c8"}]}] Jul 20 04:17:35.582979 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-VolumesAdminNegativeTest-530099437 Jul 20 04:17:35.582979 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 02b439f74bf04bc6bb23f1cde4d3d8c8 Jul 20 04:17:35.582979 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-530099437 Jul 20 04:17:35.582979 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-VolumesAdminNegativeTest-530099437-project-admin Jul 20 04:17:35.582979 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:17:35.582979 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:17:35.582979 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c44504c9ae454e3292314fd8891697d0 Jul 20 04:17:35.582979 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-VolumesAdminNegativeTest-530099437-project-admin Jul 20 04:17:35.582979 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:17:35.582979 n-d-826526-5 devstack@n-api.service[127871]: {"volumeAttachment": {"volumeId": "b4bfb058-2c6a-41bf-91d4-31bb8a20e4b3"}} Jul 20 04:17:35.582979 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:17:35.582979 n-d-826526-5 devstack@n-api.service[127871]: exception: Volume b4bfb058-2c6a-41bf-91d4-31bb8a20e4b3 could not be found. Jul 20 04:17:35.584088 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'server_id': 'ee9170bb-33df-43d7-b35f-1d846da620d3', 'id': '4e612e86-6b2a-47de-b41b-00e713b9e6bb', 'body': {'volumeAttachment': {'volumeId': 'b4bfb058-2c6a-41bf-91d4-31bb8a20e4b3'}}} Jul 20 04:17:35.584088 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:35.584088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:35.584088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:17:35.584088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:17:35.584088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:17:35.584088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:17:35.584088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:17:35.584088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:17:35.584088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:17:35.584088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:17:35.584088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:17:35.584088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:17:35.584088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:17:35.584088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:17:35.584088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:17:35.584088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4bfb058-2c6a-41bf-91d4-31bb8a20e4b3 could not be found. (HTTP 404) (Request-ID: req-c64d4b83-7850-4163-8d03-8b3e85c1a458) Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:17:35.585306 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4bfb058-2c6a-41bf-91d4-31bb8a20e4b3 could not be found. Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:35.586591 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume b4bfb058-2c6a-41bf-91d4-31bb8a20e4b3 could not be found. Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4bfb058-2c6a-41bf-91d4-31bb8a20e4b3 could not be found. Jul 20 04:17:35.587872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:17:35.593378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3f4d5b0d-8d53-4d09-bfce-332a6a27da73 tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] Returning 400 to user: Volume b4bfb058-2c6a-41bf-91d4-31bb8a20e4b3 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:35.593378 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3f4d5b0d-8d53-4d09-bfce-332a6a27da73 tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] 10.222.0.17 "PUT /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments/4e612e86-6b2a-47de-b41b-00e713b9e6bb" status: 400 len: 107 microversion: 2.1 time: 0.832218 Jul 20 04:17:35.593378 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1054/1928] 10.222.0.17 () {60 vars in 1432 bytes} [Wed Jul 20 04:17:34 2022] PUT /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments/4e612e86-6b2a-47de-b41b-00e713b9e6bb => generated 107 bytes in 834 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:17:35.602117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4636bbe4-9e9d-4b0f-9a89-7f6ebd996b47 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.602762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4636bbe4-9e9d-4b0f-9a89-7f6ebd996b47 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.633698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4636bbe4-9e9d-4b0f-9a89-7f6ebd996b47 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.636840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4636bbe4-9e9d-4b0f-9a89-7f6ebd996b47 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.652364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4636bbe4-9e9d-4b0f-9a89-7f6ebd996b47 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.652855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4636bbe4-9e9d-4b0f-9a89-7f6ebd996b47 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.964813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-629cf29b-b89f-43a4-92dc-7870bab9055b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20801c8e312044b38e1a758387877528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '023236fb56b14d0a9e5ae4dd6120162a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:35.978835 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-629cf29b-b89f-43a4-92dc-7870bab9055b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" status: 200 len: 1289 microversion: 2.1 time: 0.464489 Jul 20 04:17:35.979921 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 875/1929] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:35 2022] GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f => generated 1289 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:35.990886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2319d914-d19e-4193-8d14-3acc4494b8a6 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.992794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2319d914-d19e-4193-8d14-3acc4494b8a6 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:36.004353 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2319d914-d19e-4193-8d14-3acc4494b8a6 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.004813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2319d914-d19e-4193-8d14-3acc4494b8a6 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.005612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2319d914-d19e-4193-8d14-3acc4494b8a6 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.006055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2319d914-d19e-4193-8d14-3acc4494b8a6 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.225000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-2319d914-d19e-4193-8d14-3acc4494b8a6 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lazy-loading 'services' on Instance uuid ee9170bb-33df-43d7-b35f-1d846da620d3 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:36.370086 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2319d914-d19e-4193-8d14-3acc4494b8a6 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments/4e612e86-6b2a-47de-b41b-00e713b9e6bb" status: 202 len: 0 microversion: 2.1 time: 0.388342 Jul 20 04:17:36.370709 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 876/1930] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 04:17:35 2022] DELETE /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments/4e612e86-6b2a-47de-b41b-00e713b9e6bb => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:36.380568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1fbe31e2-8792-480b-a200-a62b006824f1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:36.381680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1fbe31e2-8792-480b-a200-a62b006824f1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:36.388360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:36.402362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1fbe31e2-8792-480b-a200-a62b006824f1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.407843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1fbe31e2-8792-480b-a200-a62b006824f1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.408926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1fbe31e2-8792-480b-a200-a62b006824f1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.409514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1fbe31e2-8792-480b-a200-a62b006824f1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.545284 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1fbe31e2-8792-480b-a200-a62b006824f1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161734 Jul 20 04:17:36.548033 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 877/1931] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:17:36 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:36.553139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ca921b2a-e513-4bd0-bf5c-3d6016f57676 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:36.563135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ca921b2a-e513-4bd0-bf5c-3d6016f57676 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:36.572724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4636bbe4-9e9d-4b0f-9a89-7f6ebd996b47 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:36.574285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca921b2a-e513-4bd0-bf5c-3d6016f57676 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.574968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca921b2a-e513-4bd0-bf5c-3d6016f57676 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.576734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca921b2a-e513-4bd0-bf5c-3d6016f57676 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.577381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca921b2a-e513-4bd0-bf5c-3d6016f57676 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.591434 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4636bbe4-9e9d-4b0f-9a89-7f6ebd996b47 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 1.000667 Jul 20 04:17:36.592062 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1055/1932] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:35 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:37.002892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bc0ae5e3-1463-472f-94a7-01008f30cf11 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:37.003849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bc0ae5e3-1463-472f-94a7-01008f30cf11 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:37.020975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc0ae5e3-1463-472f-94a7-01008f30cf11 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.033284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc0ae5e3-1463-472f-94a7-01008f30cf11 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.039294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc0ae5e3-1463-472f-94a7-01008f30cf11 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.044856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc0ae5e3-1463-472f-94a7-01008f30cf11 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.507116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ca921b2a-e513-4bd0-bf5c-3d6016f57676 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:37.517637 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ca921b2a-e513-4bd0-bf5c-3d6016f57676 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 200 len: 1305 microversion: 2.1 time: 0.968202 Jul 20 04:17:37.518319 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 878/1933] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:36 2022] GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 1305 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:37.545590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-60830645-5a7e-4156-98d6-24544f779fd1 req-6020f3b6-f35d-410f-8cfd-d0d9af12f7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a02cfafe-ca57-4211-bd4e-287672a73ea9", "tag": "e80289a8-2b86-4831-85b3-4562ecf108c7"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:37.581859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-60830645-5a7e-4156-98d6-24544f779fd1 req-6020f3b6-f35d-410f-8cfd-d0d9af12f7d3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.587459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-60830645-5a7e-4156-98d6-24544f779fd1 req-6020f3b6-f35d-410f-8cfd-d0d9af12f7d3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.639901 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-60830645-5a7e-4156-98d6-24544f779fd1 req-6020f3b6-f35d-410f-8cfd-d0d9af12f7d3 service nova] Creating event network-changed:e80289a8-2b86-4831-85b3-4562ecf108c7 for instance a02cfafe-ca57-4211-bd4e-287672a73ea9 on n-h2-826526-5 Jul 20 04:17:37.656983 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-60830645-5a7e-4156-98d6-24544f779fd1 req-6020f3b6-f35d-410f-8cfd-d0d9af12f7d3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124702 Jul 20 04:17:37.657692 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 879/1934] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:37.673459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1e6f101d-6298-40ef-926a-b45244adaed7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:37.674572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1e6f101d-6298-40ef-926a-b45244adaed7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:37.687080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1e6f101d-6298-40ef-926a-b45244adaed7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.687862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1e6f101d-6298-40ef-926a-b45244adaed7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.688880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1e6f101d-6298-40ef-926a-b45244adaed7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.689912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1e6f101d-6298-40ef-926a-b45244adaed7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.768825 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1e6f101d-6298-40ef-926a-b45244adaed7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101495 Jul 20 04:17:37.769935 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 880/1935] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:17:37 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:37.776146 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a7b9209f-6740-4c4c-aa15-4b665640a181 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:37.778094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a7b9209f-6740-4c4c-aa15-4b665640a181 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:37.791673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7b9209f-6740-4c4c-aa15-4b665640a181 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.793317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7b9209f-6740-4c4c-aa15-4b665640a181 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.794668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7b9209f-6740-4c4c-aa15-4b665640a181 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.795285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7b9209f-6740-4c4c-aa15-4b665640a181 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.988299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bc0ae5e3-1463-472f-94a7-01008f30cf11 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20801c8e312044b38e1a758387877528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '023236fb56b14d0a9e5ae4dd6120162a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:38.002378 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bc0ae5e3-1463-472f-94a7-01008f30cf11 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" status: 200 len: 1331 microversion: 2.1 time: 1.007178 Jul 20 04:17:38.013995 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1056/1936] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:36 2022] GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f => generated 1331 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:38.240741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a7b9209f-6740-4c4c-aa15-4b665640a181 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:38.251712 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a7b9209f-6740-4c4c-aa15-4b665640a181 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.480059 Jul 20 04:17:38.253573 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 881/1937] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:37 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:38.535749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9c4d27ea-c8c5-47ed-af7e-091781272cb8 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:38.539952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9c4d27ea-c8c5-47ed-af7e-091781272cb8 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:38.559629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c4d27ea-c8c5-47ed-af7e-091781272cb8 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.560874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c4d27ea-c8c5-47ed-af7e-091781272cb8 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.562943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c4d27ea-c8c5-47ed-af7e-091781272cb8 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.563793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c4d27ea-c8c5-47ed-af7e-091781272cb8 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.781285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f60fe92c-accc-499b-89f2-00bd4fbac2f0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:38.782224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f60fe92c-accc-499b-89f2-00bd4fbac2f0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:38.795810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f60fe92c-accc-499b-89f2-00bd4fbac2f0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.796360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f60fe92c-accc-499b-89f2-00bd4fbac2f0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.797179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f60fe92c-accc-499b-89f2-00bd4fbac2f0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.797635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f60fe92c-accc-499b-89f2-00bd4fbac2f0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.813402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:38.879847 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f60fe92c-accc-499b-89f2-00bd4fbac2f0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102731 Jul 20 04:17:38.886734 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 882/1938] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:17:38 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:39.021803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bcc14197-5e62-4fae-b637-c2b78531cd46 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:39.022905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bcc14197-5e62-4fae-b637-c2b78531cd46 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:39.029991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcc14197-5e62-4fae-b637-c2b78531cd46 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.043478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcc14197-5e62-4fae-b637-c2b78531cd46 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.047492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcc14197-5e62-4fae-b637-c2b78531cd46 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.048298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcc14197-5e62-4fae-b637-c2b78531cd46 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.606161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9c4d27ea-c8c5-47ed-af7e-091781272cb8 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:39.624572 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9c4d27ea-c8c5-47ed-af7e-091781272cb8 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 200 len: 1305 microversion: 2.1 time: 1.089099 Jul 20 04:17:39.625415 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1057/1939] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:38 2022] GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 1305 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:39.639560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7ae56302-f2f1-49c0-a062-51f8ee1a5f38 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:39.647153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7ae56302-f2f1-49c0-a062-51f8ee1a5f38 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:39.668888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ae56302-f2f1-49c0-a062-51f8ee1a5f38 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.669419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ae56302-f2f1-49c0-a062-51f8ee1a5f38 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.670255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ae56302-f2f1-49c0-a062-51f8ee1a5f38 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.670694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ae56302-f2f1-49c0-a062-51f8ee1a5f38 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.945886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bcc14197-5e62-4fae-b637-c2b78531cd46 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20801c8e312044b38e1a758387877528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '023236fb56b14d0a9e5ae4dd6120162a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:39.956006 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bcc14197-5e62-4fae-b637-c2b78531cd46 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" status: 200 len: 1331 microversion: 2.1 time: 0.938031 Jul 20 04:17:39.957646 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 883/1940] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:39 2022] GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f => generated 1331 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:39.963488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9f1ef427-76f2-4195-80f7-c948b8661d7d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:39.965112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9f1ef427-76f2-4195-80f7-c948b8661d7d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:39.975155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f1ef427-76f2-4195-80f7-c948b8661d7d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.975931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f1ef427-76f2-4195-80f7-c948b8661d7d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.977281 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f1ef427-76f2-4195-80f7-c948b8661d7d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.978056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f1ef427-76f2-4195-80f7-c948b8661d7d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.061528 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7ae56302-f2f1-49c0-a062-51f8ee1a5f38 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:40.066541 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9f1ef427-76f2-4195-80f7-c948b8661d7d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106600 Jul 20 04:17:40.068654 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 884/1941] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:17:39 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:40.080400 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7ae56302-f2f1-49c0-a062-51f8ee1a5f38 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.453381 Jul 20 04:17:40.081109 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1058/1942] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:39 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:40.596553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ce7708d3-9456-4fbe-9c1c-f33dfe4297d2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:40.597354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ce7708d3-9456-4fbe-9c1c-f33dfe4297d2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:40.609384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce7708d3-9456-4fbe-9c1c-f33dfe4297d2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.609911 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce7708d3-9456-4fbe-9c1c-f33dfe4297d2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.614899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce7708d3-9456-4fbe-9c1c-f33dfe4297d2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.615382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce7708d3-9456-4fbe-9c1c-f33dfe4297d2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.642005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8b805e55-b1bc-4b8d-8e15-a18d479ce2f3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:40.642803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8b805e55-b1bc-4b8d-8e15-a18d479ce2f3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:40.650529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b805e55-b1bc-4b8d-8e15-a18d479ce2f3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.656498 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b805e55-b1bc-4b8d-8e15-a18d479ce2f3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.657412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b805e55-b1bc-4b8d-8e15-a18d479ce2f3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.657968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b805e55-b1bc-4b8d-8e15-a18d479ce2f3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.678379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ce7708d3-9456-4fbe-9c1c-f33dfe4297d2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:40.790059 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ce7708d3-9456-4fbe-9c1c-f33dfe4297d2 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 204 len: 0 microversion: 2.25 time: 0.197677 Jul 20 04:17:40.794663 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 885/1943] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:17:40 2022] DELETE /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:17:40.812957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a11f7307-a0a8-429f-ba8f-5c296aec213c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:40.813771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a11f7307-a0a8-429f-ba8f-5c296aec213c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:40.822530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a11f7307-a0a8-429f-ba8f-5c296aec213c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.822993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a11f7307-a0a8-429f-ba8f-5c296aec213c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.824017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a11f7307-a0a8-429f-ba8f-5c296aec213c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.824567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a11f7307-a0a8-429f-ba8f-5c296aec213c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.990858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8b805e55-b1bc-4b8d-8e15-a18d479ce2f3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:41.006370 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8b805e55-b1bc-4b8d-8e15-a18d479ce2f3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 200 len: 1305 microversion: 2.1 time: 0.365626 Jul 20 04:17:41.007026 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1059/1944] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:40 2022] GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 1305 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:41.022005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-9801da11-4aa5-4b24-80be-263a2c6569a1 req-62c23eba-f78f-4aba-8288-4d388ec17751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f", "tag": "5fe4d090-78b8-44a5-99b6-9391f731a824"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:41.032861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9801da11-4aa5-4b24-80be-263a2c6569a1 req-62c23eba-f78f-4aba-8288-4d388ec17751 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.035283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9801da11-4aa5-4b24-80be-263a2c6569a1 req-62c23eba-f78f-4aba-8288-4d388ec17751 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.079707 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9801da11-4aa5-4b24-80be-263a2c6569a1 req-62c23eba-f78f-4aba-8288-4d388ec17751 service nova] Creating event network-changed:5fe4d090-78b8-44a5-99b6-9391f731a824 for instance 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f on n-h1-826526-5 Jul 20 04:17:41.092513 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-9801da11-4aa5-4b24-80be-263a2c6569a1 req-62c23eba-f78f-4aba-8288-4d388ec17751 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077064 Jul 20 04:17:41.098216 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1060/1945] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:41.105255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6640a594-015b-45c3-a7e4-51be99a63024 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:41.105965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6640a594-015b-45c3-a7e4-51be99a63024 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:41.114462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6640a594-015b-45c3-a7e4-51be99a63024 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.115200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6640a594-015b-45c3-a7e4-51be99a63024 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.122703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6640a594-015b-45c3-a7e4-51be99a63024 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.123205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6640a594-015b-45c3-a7e4-51be99a63024 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.369961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6640a594-015b-45c3-a7e4-51be99a63024 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20801c8e312044b38e1a758387877528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '023236fb56b14d0a9e5ae4dd6120162a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:41.390819 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6640a594-015b-45c3-a7e4-51be99a63024 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" status: 200 len: 1331 microversion: 2.1 time: 0.291117 Jul 20 04:17:41.403022 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1061/1946] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:41 2022] GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f => generated 1331 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:41.409759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f5855e35-95bc-4d6e-874d-894b065ea817 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:41.411229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f5855e35-95bc-4d6e-874d-894b065ea817 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:41.421381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f5855e35-95bc-4d6e-874d-894b065ea817 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.422229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f5855e35-95bc-4d6e-874d-894b065ea817 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.424783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f5855e35-95bc-4d6e-874d-894b065ea817 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.425361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f5855e35-95bc-4d6e-874d-894b065ea817 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.469835 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f5855e35-95bc-4d6e-874d-894b065ea817 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065308 Jul 20 04:17:41.471107 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1062/1947] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:17:41 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:41.476898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bcb63229-ac08-4a8c-aa06-a3edf5392eb3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:41.477805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bcb63229-ac08-4a8c-aa06-a3edf5392eb3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:41.486310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bcb63229-ac08-4a8c-aa06-a3edf5392eb3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.487039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bcb63229-ac08-4a8c-aa06-a3edf5392eb3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.488176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bcb63229-ac08-4a8c-aa06-a3edf5392eb3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.488764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bcb63229-ac08-4a8c-aa06-a3edf5392eb3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.776309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:41.844538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=14 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:41.908920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bcb63229-ac08-4a8c-aa06-a3edf5392eb3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:41.919089 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bcb63229-ac08-4a8c-aa06-a3edf5392eb3 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.446709 Jul 20 04:17:41.921569 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1063/1948] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:41 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:42.012384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a11f7307-a0a8-429f-ba8f-5c296aec213c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.025073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a9bb062c-aaa3-4180-a1cb-904490a01cd1 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:42.025728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a9bb062c-aaa3-4180-a1cb-904490a01cd1 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:42.030001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a11f7307-a0a8-429f-ba8f-5c296aec213c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.031543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a11f7307-a0a8-429f-ba8f-5c296aec213c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.032944 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a11f7307-a0a8-429f-ba8f-5c296aec213c tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1729 microversion: 2.25 time: 1.236923 Jul 20 04:17:42.033580 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 886/1949] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:40 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1729 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:42.038372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9bb062c-aaa3-4180-a1cb-904490a01cd1 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.041247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9bb062c-aaa3-4180-a1cb-904490a01cd1 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.043840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9bb062c-aaa3-4180-a1cb-904490a01cd1 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.045179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9bb062c-aaa3-4180-a1cb-904490a01cd1 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.412845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a80531ef-79ef-4ab4-b3cb-a5aefffe7edc tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:42.414345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a80531ef-79ef-4ab4-b3cb-a5aefffe7edc tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:42.431763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a80531ef-79ef-4ab4-b3cb-a5aefffe7edc tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.433391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a80531ef-79ef-4ab4-b3cb-a5aefffe7edc tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.437362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a80531ef-79ef-4ab4-b3cb-a5aefffe7edc tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.443786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a80531ef-79ef-4ab4-b3cb-a5aefffe7edc tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.502803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:42.551284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a9bb062c-aaa3-4180-a1cb-904490a01cd1 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.565819 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a9bb062c-aaa3-4180-a1cb-904490a01cd1 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 200 len: 1305 microversion: 2.1 time: 0.543907 Jul 20 04:17:42.568660 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1064/1950] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:42 2022] GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 1305 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:42.581738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2c51ce6a-edea-422e-be5d-3e23b070030c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:42.584746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2c51ce6a-edea-422e-be5d-3e23b070030c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:42.599085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c51ce6a-edea-422e-be5d-3e23b070030c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.600592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c51ce6a-edea-422e-be5d-3e23b070030c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.602227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c51ce6a-edea-422e-be5d-3e23b070030c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.602779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c51ce6a-edea-422e-be5d-3e23b070030c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.645225 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2c51ce6a-edea-422e-be5d-3e23b070030c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073365 Jul 20 04:17:42.646500 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1065/1951] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:17:42 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:42.856926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-29b0ea90-f8f2-47ab-bcd3-4891cbd440d0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-2026128347", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": "none"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:42.957250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-29b0ea90-f8f2-47ab-bcd3-4891cbd440d0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:42.957887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-29b0ea90-f8f2-47ab-bcd3-4891cbd440d0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:42.958488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-29b0ea90-f8f2-47ab-bcd3-4891cbd440d0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:42.959001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-29b0ea90-f8f2-47ab-bcd3-4891cbd440d0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:42.959624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-29b0ea90-f8f2-47ab-bcd3-4891cbd440d0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:42.980107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29b0ea90-f8f2-47ab-bcd3-4891cbd440d0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.980743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29b0ea90-f8f2-47ab-bcd3-4891cbd440d0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.981866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29b0ea90-f8f2-47ab-bcd3-4891cbd440d0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.982576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29b0ea90-f8f2-47ab-bcd3-4891cbd440d0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.012389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-29b0ea90-f8f2-47ab-bcd3-4891cbd440d0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Getting quotas for project 67c4fe6a168c430ca5555c138fc46197. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:43.041817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-29b0ea90-f8f2-47ab-bcd3-4891cbd440d0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Getting quotas for user 01bf3d6f011940bdbc816c82b60c2a18 and project 67c4fe6a168c430ca5555c138fc46197. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:43.074480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-29b0ea90-f8f2-47ab-bcd3-4891cbd440d0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:43.078700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-29b0ea90-f8f2-47ab-bcd3-4891cbd440d0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:43.194988 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-29b0ea90-f8f2-47ab-bcd3-4891cbd440d0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.545250 Jul 20 04:17:43.196474 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1066/1952] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 04:17:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:17:43.201936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-162304ab-cb62-42ca-a5e4-1c093acae792 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:43.203003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-162304ab-cb62-42ca-a5e4-1c093acae792 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:43.213203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-162304ab-cb62-42ca-a5e4-1c093acae792 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.213923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-162304ab-cb62-42ca-a5e4-1c093acae792 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.215165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-162304ab-cb62-42ca-a5e4-1c093acae792 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.215954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-162304ab-cb62-42ca-a5e4-1c093acae792 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.861041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-162304ab-cb62-42ca-a5e4-1c093acae792 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:43.871647 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-162304ab-cb62-42ca-a5e4-1c093acae792 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.673761 Jul 20 04:17:43.872275 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1067/1953] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:43 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:43.899735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7125c0db-b9a5-4af0-9c17-2027be67b3e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:43.911505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7125c0db-b9a5-4af0-9c17-2027be67b3e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:43.942496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7125c0db-b9a5-4af0-9c17-2027be67b3e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.943288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7125c0db-b9a5-4af0-9c17-2027be67b3e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.944480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7125c0db-b9a5-4af0-9c17-2027be67b3e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.945062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7125c0db-b9a5-4af0-9c17-2027be67b3e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.063268 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a80531ef-79ef-4ab4-b3cb-a5aefffe7edc tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20801c8e312044b38e1a758387877528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '023236fb56b14d0a9e5ae4dd6120162a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.078594 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a80531ef-79ef-4ab4-b3cb-a5aefffe7edc tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" status: 200 len: 1331 microversion: 2.1 time: 1.671334 Jul 20 04:17:44.080834 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 887/1954] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:42 2022] GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f => generated 1331 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:44.093117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-593523ab-5273-48e7-bf8e-4cccb7a8eb5c tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:44.094533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-593523ab-5273-48e7-bf8e-4cccb7a8eb5c tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:44.204484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-593523ab-5273-48e7-bf8e-4cccb7a8eb5c tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.219661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-593523ab-5273-48e7-bf8e-4cccb7a8eb5c tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.221594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-593523ab-5273-48e7-bf8e-4cccb7a8eb5c tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.227950 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-593523ab-5273-48e7-bf8e-4cccb7a8eb5c tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1278 microversion: 2.57 time: 0.145093 Jul 20 04:17:44.229818 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 888/1955] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:44 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1278 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:44.244777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-4cebf1a6-5894-45d6-b771-9739134d2583 req-c2a4ff0b-a676-42d7-ade2-b14a9b08f17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b62c758-d90d-48b5-903f-7553734f4cfe", "name": "network-vif-unplugged", "status": "completed", "tag": "be0fb241-a959-4d10-85fb-6ddb8e17edb2"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:44.266070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4cebf1a6-5894-45d6-b771-9739134d2583 req-c2a4ff0b-a676-42d7-ade2-b14a9b08f17b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.266849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4cebf1a6-5894-45d6-b771-9739134d2583 req-c2a4ff0b-a676-42d7-ade2-b14a9b08f17b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.296574 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-4cebf1a6-5894-45d6-b771-9739134d2583 req-c2a4ff0b-a676-42d7-ade2-b14a9b08f17b service nova] Creating event network-vif-unplugged:be0fb241-a959-4d10-85fb-6ddb8e17edb2 for instance 7b62c758-d90d-48b5-903f-7553734f4cfe on n-h1-826526-5 Jul 20 04:17:44.310040 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-4cebf1a6-5894-45d6-b771-9739134d2583 req-c2a4ff0b-a676-42d7-ade2-b14a9b08f17b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077854 Jul 20 04:17:44.314629 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 889/1956] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:44.326051 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-03a10e75-bf15-497c-8eeb-788883376df7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:44.326778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-03a10e75-bf15-497c-8eeb-788883376df7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:44.347256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03a10e75-bf15-497c-8eeb-788883376df7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.351471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03a10e75-bf15-497c-8eeb-788883376df7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.352555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03a10e75-bf15-497c-8eeb-788883376df7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.352856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03a10e75-bf15-497c-8eeb-788883376df7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.354422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7125c0db-b9a5-4af0-9c17-2027be67b3e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.367393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7125c0db-b9a5-4af0-9c17-2027be67b3e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.372158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7125c0db-b9a5-4af0-9c17-2027be67b3e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.376040 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7125c0db-b9a5-4af0-9c17-2027be67b3e0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 200 len: 1664 microversion: 2.25 time: 0.492937 Jul 20 04:17:44.378866 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1068/1957] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:43 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 1664 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:44.393472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-714d51af-fd98-40c6-810c-c75bc779aa68 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:44.394854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-714d51af-fd98-40c6-810c-c75bc779aa68 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:44.412182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-714d51af-fd98-40c6-810c-c75bc779aa68 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.413952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-714d51af-fd98-40c6-810c-c75bc779aa68 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.416939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-714d51af-fd98-40c6-810c-c75bc779aa68 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.418095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-714d51af-fd98-40c6-810c-c75bc779aa68 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.481775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:44.500936 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-714d51af-fd98-40c6-810c-c75bc779aa68 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120408 Jul 20 04:17:44.502061 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1069/1958] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:17:44 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:44.523634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-40c5058c-09b1-4204-af48-5b573b518b75 req-5bf8bdd1-0003-4223-93c1-0791ca919066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80122a5-6106-4f62-9d72-5623e8ac0ca7", "name": "network-vif-deleted", "tag": "7bc8d479-2b71-4938-aa7d-6a3906728f9d"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:44.552294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-40c5058c-09b1-4204-af48-5b573b518b75 req-5bf8bdd1-0003-4223-93c1-0791ca919066 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.553061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-40c5058c-09b1-4204-af48-5b573b518b75 req-5bf8bdd1-0003-4223-93c1-0791ca919066 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.581351 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-40c5058c-09b1-4204-af48-5b573b518b75 req-5bf8bdd1-0003-4223-93c1-0791ca919066 service nova] Creating event network-vif-deleted:7bc8d479-2b71-4938-aa7d-6a3906728f9d for instance b80122a5-6106-4f62-9d72-5623e8ac0ca7 on n-h2-826526-5 Jul 20 04:17:44.595033 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-40c5058c-09b1-4204-af48-5b573b518b75 req-5bf8bdd1-0003-4223-93c1-0791ca919066 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091521 Jul 20 04:17:44.598669 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1070/1959] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:44.709010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-03a10e75-bf15-497c-8eeb-788883376df7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.724033 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-03a10e75-bf15-497c-8eeb-788883376df7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 200 len: 1305 microversion: 2.1 time: 0.404780 Jul 20 04:17:44.724900 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 890/1960] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:44 2022] GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 1305 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:44.904297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8d6da99b-9a19-4c24-9a14-edda49791768 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:44.906006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8d6da99b-9a19-4c24-9a14-edda49791768 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:44.925146 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d6da99b-9a19-4c24-9a14-edda49791768 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.927312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d6da99b-9a19-4c24-9a14-edda49791768 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.929546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d6da99b-9a19-4c24-9a14-edda49791768 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.930583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d6da99b-9a19-4c24-9a14-edda49791768 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.101090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-700e3160-713e-4619-99ea-42ba01c35187 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:45.101821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-700e3160-713e-4619-99ea-42ba01c35187 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:45.118012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-700e3160-713e-4619-99ea-42ba01c35187 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.118483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-700e3160-713e-4619-99ea-42ba01c35187 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.125270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-700e3160-713e-4619-99ea-42ba01c35187 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.127439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-700e3160-713e-4619-99ea-42ba01c35187 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.521806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8d6da99b-9a19-4c24-9a14-edda49791768 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.537788 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8d6da99b-9a19-4c24-9a14-edda49791768 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.646694 Jul 20 04:17:45.547959 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1071/1961] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:44 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:45.557725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-10cb9332-0468-499e-b9f4-48aa5dce2eec tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:45.561137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-10cb9332-0468-499e-b9f4-48aa5dce2eec tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:45.591191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-10cb9332-0468-499e-b9f4-48aa5dce2eec tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.591813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-10cb9332-0468-499e-b9f4-48aa5dce2eec tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.593328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-10cb9332-0468-499e-b9f4-48aa5dce2eec tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.593845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-10cb9332-0468-499e-b9f4-48aa5dce2eec tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.724597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-700e3160-713e-4619-99ea-42ba01c35187 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20801c8e312044b38e1a758387877528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '023236fb56b14d0a9e5ae4dd6120162a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.740934 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-700e3160-713e-4619-99ea-42ba01c35187 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" status: 200 len: 1331 microversion: 2.1 time: 0.644198 Jul 20 04:17:45.742071 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 891/1962] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:45 2022] GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f => generated 1331 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:45.756015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-484f6379-d757-4ea3-a1a2-1eac4f97c7b7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:45.757656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-484f6379-d757-4ea3-a1a2-1eac4f97c7b7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: b80122a5-6106-4f62-9d72-5623e8ac0ca7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:45.765019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-10cb9332-0468-499e-b9f4-48aa5dce2eec tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.771970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-484f6379-d757-4ea3-a1a2-1eac4f97c7b7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.773939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-484f6379-d757-4ea3-a1a2-1eac4f97c7b7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.775818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-484f6379-d757-4ea3-a1a2-1eac4f97c7b7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.778696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-10cb9332-0468-499e-b9f4-48aa5dce2eec tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.779569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-484f6379-d757-4ea3-a1a2-1eac4f97c7b7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.783724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-10cb9332-0468-499e-b9f4-48aa5dce2eec tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.786694 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-10cb9332-0468-499e-b9f4-48aa5dce2eec tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1330 microversion: 2.57 time: 0.236537 Jul 20 04:17:45.788662 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1072/1963] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:45 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1330 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:45.814525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a09fd969-d832-481e-ace4-88d6fdd2edd7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:45.815767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a09fd969-d832-481e-ace4-88d6fdd2edd7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:45.822550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a09fd969-d832-481e-ace4-88d6fdd2edd7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.823176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a09fd969-d832-481e-ace4-88d6fdd2edd7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.829269 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-484f6379-d757-4ea3-a1a2-1eac4f97c7b7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] HTTP exception thrown: Instance b80122a5-6106-4f62-9d72-5623e8ac0ca7 could not be found. Jul 20 04:17:45.830929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a09fd969-d832-481e-ace4-88d6fdd2edd7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.833711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a09fd969-d832-481e-ace4-88d6fdd2edd7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-484f6379-d757-4ea3-a1a2-1eac4f97c7b7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Request method failure captured: Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 HTTP/1.1 Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14ALEpS8cLFwrWGrP2QWc6ENbBeQxhTSZrCMB4J-aiWbIB1DcF5qsJhQO_fS3PT3NzooKQpZlA-XJW7ILwnbQGTJCAxxmlsPvEnem5bZawLFEGTJVax5f9UvzTQ2J2dI4LC2UBTpQtVDHBHmByN6irkSPk6c_cmOrMQPvRZJYv9WSV0 Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 8d4037629b9e4e6fa92e2a8d89cf0311 Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1255805509 Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:17:45.850880 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:17:45.852381 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d4037629b9e4e6fa92e2a8d89cf0311"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8d4037629b9e4e6fa92e2a8d89cf0311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8d4037629b9e4e6fa92e2a8d89cf0311", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d4037629b9e4e6fa92e2a8d89cf0311"}]}] Jul 20 04:17:45.852381 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1255805509 Jul 20 04:17:45.852381 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 8d4037629b9e4e6fa92e2a8d89cf0311 Jul 20 04:17:45.852381 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1255805509 Jul 20 04:17:45.852381 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-LiveAutoBlockMigrationV225Test-1255805509-project Jul 20 04:17:45.852381 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:17:45.852381 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:17:45.852381 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 45a9bfefde81473d88610b03e0de9bf4 Jul 20 04:17:45.852381 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1255805509-project Jul 20 04:17:45.852381 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:17:45.852381 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance b80122a5-6106-4f62-9d72-5623e8ac0ca7 could not be found. Jul 20 04:17:45.852381 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'b80122a5-6106-4f62-9d72-5623e8ac0ca7'} Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b80122a5-6106-4f62-9d72-5623e8ac0ca7 could not be found. Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:45.853161 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:45.854345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:45.854345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:45.854345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:45.854345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:45.854345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:45.854345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:45.854345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:45.854345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b80122a5-6106-4f62-9d72-5623e8ac0ca7 could not be found. Jul 20 04:17:45.854345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:45.854345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:45.854345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:45.854345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:45.854345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:45.854345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:45.854345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:45.854345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:45.854345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b80122a5-6106-4f62-9d72-5623e8ac0ca7 could not be found. Jul 20 04:17:45.854345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:45.855370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-484f6379-d757-4ea3-a1a2-1eac4f97c7b7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Returning 404 to user: Instance b80122a5-6106-4f62-9d72-5623e8ac0ca7 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:45.855370 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-484f6379-d757-4ea3-a1a2-1eac4f97c7b7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7" status: 404 len: 111 microversion: 2.25 time: 0.111554 Jul 20 04:17:45.863095 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 892/1964] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:45 2022] GET /compute/v2.1/servers/b80122a5-6106-4f62-9d72-5623e8ac0ca7 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:17:45.876710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6b45f700-b505-454a-9f49-3ad0cd758e99 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:45.878317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6b45f700-b505-454a-9f49-3ad0cd758e99 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:45.891227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b45f700-b505-454a-9f49-3ad0cd758e99 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.897517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b45f700-b505-454a-9f49-3ad0cd758e99 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.898909 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b45f700-b505-454a-9f49-3ad0cd758e99 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.899364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b45f700-b505-454a-9f49-3ad0cd758e99 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.908940 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a09fd969-d832-481e-ace4-88d6fdd2edd7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.117061 Jul 20 04:17:45.917985 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1073/1965] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:17:45 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:17:45.925735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-340638cc-5c74-4cb7-aca0-0a10c60c7a40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '.version_select at 0x7f06c73f28b0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:45.975998 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-340638cc-5c74-4cb7-aca0-0a10c60c7a40 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1934932113" status: 204 len: 0 microversion: 2.25 time: 0.057090 Jul 20 04:17:45.976835 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1074/1966] 10.222.0.17 () {60 vars in 1261 bytes} [Wed Jul 20 04:17:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1934932113 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:17:46.266319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-12de80db-a951-4790-bc41-c56c6b4dabe1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1216747092", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "874598db-a331-4a76-938b-6804bd901bc8"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:46.341736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6b45f700-b505-454a-9f49-3ad0cd758e99 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:46.349997 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6b45f700-b505-454a-9f49-3ad0cd758e99 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 200 len: 1305 microversion: 2.1 time: 0.483678 Jul 20 04:17:46.350579 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 893/1967] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:45 2022] GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 1305 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:46.352532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-12de80db-a951-4790-bc41-c56c6b4dabe1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] validate_networks() for [('874598db-a331-4a76-938b-6804bd901bc8', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:17:46.367047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-fd169a28-9205-4bf6-bc94-0bc852442dea req-faaee145-7124-4dfe-afe1-c98c36fd6e43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b62c758-d90d-48b5-903f-7553734f4cfe", "tag": "be0fb241-a959-4d10-85fb-6ddb8e17edb2"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:46.394063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-fd169a28-9205-4bf6-bc94-0bc852442dea req-faaee145-7124-4dfe-afe1-c98c36fd6e43 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.394736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-fd169a28-9205-4bf6-bc94-0bc852442dea req-faaee145-7124-4dfe-afe1-c98c36fd6e43 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:46.416556 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-fd169a28-9205-4bf6-bc94-0bc852442dea req-faaee145-7124-4dfe-afe1-c98c36fd6e43 service nova] Creating event network-changed:be0fb241-a959-4d10-85fb-6ddb8e17edb2 for instance 7b62c758-d90d-48b5-903f-7553734f4cfe on n-h1-826526-5 Jul 20 04:17:46.427034 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-fd169a28-9205-4bf6-bc94-0bc852442dea req-faaee145-7124-4dfe-afe1-c98c36fd6e43 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063245 Jul 20 04:17:46.431357 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 894/1968] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:46.555982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-52e5ff9c-33b4-4976-8b38-0a1746a1ed71 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:46.557121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-52e5ff9c-33b4-4976-8b38-0a1746a1ed71 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:46.570898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52e5ff9c-33b4-4976-8b38-0a1746a1ed71 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.583079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52e5ff9c-33b4-4976-8b38-0a1746a1ed71 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:46.586462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52e5ff9c-33b4-4976-8b38-0a1746a1ed71 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.586998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52e5ff9c-33b4-4976-8b38-0a1746a1ed71 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:46.994558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-52e5ff9c-33b4-4976-8b38-0a1746a1ed71 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:47.004940 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-52e5ff9c-33b4-4976-8b38-0a1746a1ed71 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.453496 Jul 20 04:17:47.008759 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 895/1969] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:46 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:47.032451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2ce189d7-4cd8-4ec0-8391-5640e4e3c7f9 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:47.035255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2ce189d7-4cd8-4ec0-8391-5640e4e3c7f9 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:47.048912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ce189d7-4cd8-4ec0-8391-5640e4e3c7f9 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.049608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ce189d7-4cd8-4ec0-8391-5640e4e3c7f9 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.050556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ce189d7-4cd8-4ec0-8391-5640e4e3c7f9 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.051144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ce189d7-4cd8-4ec0-8391-5640e4e3c7f9 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.510786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-12de80db-a951-4790-bc41-c56c6b4dabe1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:47.511827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-12de80db-a951-4790-bc41-c56c6b4dabe1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:47.512397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-12de80db-a951-4790-bc41-c56c6b4dabe1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:47.512802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-12de80db-a951-4790-bc41-c56c6b4dabe1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:47.514013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-12de80db-a951-4790-bc41-c56c6b4dabe1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:47.525028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-12de80db-a951-4790-bc41-c56c6b4dabe1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.525941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-12de80db-a951-4790-bc41-c56c6b4dabe1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.527048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-12de80db-a951-4790-bc41-c56c6b4dabe1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.527681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-12de80db-a951-4790-bc41-c56c6b4dabe1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.554870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-12de80db-a951-4790-bc41-c56c6b4dabe1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Getting quotas for project 5ac9884530484da7acd3b52a3e9567d5. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:47.561259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-12de80db-a951-4790-bc41-c56c6b4dabe1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Getting quotas for user 317e1c9f0eda4534aab1e18a72e7540a and project 5ac9884530484da7acd3b52a3e9567d5. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:47.584985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-12de80db-a951-4790-bc41-c56c6b4dabe1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:47.587670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-12de80db-a951-4790-bc41-c56c6b4dabe1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:47.610809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2ce189d7-4cd8-4ec0-8391-5640e4e3c7f9 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20801c8e312044b38e1a758387877528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '023236fb56b14d0a9e5ae4dd6120162a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:47.622418 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2ce189d7-4cd8-4ec0-8391-5640e4e3c7f9 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" status: 200 len: 1331 microversion: 2.1 time: 0.611361 Jul 20 04:17:47.635428 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 896/1970] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:47 2022] GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f => generated 1331 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:47.641126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-880478db-0640-4a29-a5c5-43c0a2d337a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:47.641759 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-880478db-0640-4a29-a5c5-43c0a2d337a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:47.667663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-880478db-0640-4a29-a5c5-43c0a2d337a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.668143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-880478db-0640-4a29-a5c5-43c0a2d337a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.669040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-880478db-0640-4a29-a5c5-43c0a2d337a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.670297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-880478db-0640-4a29-a5c5-43c0a2d337a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.691197 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-12de80db-a951-4790-bc41-c56c6b4dabe1 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.430139 Jul 20 04:17:47.696930 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1075/1971] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:17:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:17:47.737787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-dc0f41c3-0329-4a43-b54a-617f5da793d4 req-d3eb2ae3-996a-4678-be5f-08bdbf7fa81b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a02cfafe-ca57-4211-bd4e-287672a73ea9", "name": "network-vif-plugged", "status": "completed", "tag": "e80289a8-2b86-4831-85b3-4562ecf108c7"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:47.767240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-dc0f41c3-0329-4a43-b54a-617f5da793d4 req-d3eb2ae3-996a-4678-be5f-08bdbf7fa81b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.768509 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-dc0f41c3-0329-4a43-b54a-617f5da793d4 req-d3eb2ae3-996a-4678-be5f-08bdbf7fa81b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.804083 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-dc0f41c3-0329-4a43-b54a-617f5da793d4 req-d3eb2ae3-996a-4678-be5f-08bdbf7fa81b service nova] Creating event network-vif-plugged:e80289a8-2b86-4831-85b3-4562ecf108c7 for instance a02cfafe-ca57-4211-bd4e-287672a73ea9 on n-h2-826526-5 Jul 20 04:17:47.817491 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-dc0f41c3-0329-4a43-b54a-617f5da793d4 req-d3eb2ae3-996a-4678-be5f-08bdbf7fa81b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119076 Jul 20 04:17:47.821252 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1076/1972] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:47.839896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-63ed3c85-3a0c-4cf3-ab93-9b794c048cce tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:47.844975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-63ed3c85-3a0c-4cf3-ab93-9b794c048cce tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:47.865015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63ed3c85-3a0c-4cf3-ab93-9b794c048cce tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.865479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63ed3c85-3a0c-4cf3-ab93-9b794c048cce tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.868378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63ed3c85-3a0c-4cf3-ab93-9b794c048cce tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.868863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63ed3c85-3a0c-4cf3-ab93-9b794c048cce tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.070038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-880478db-0640-4a29-a5c5-43c0a2d337a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.086099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-880478db-0640-4a29-a5c5-43c0a2d337a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.088890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-880478db-0640-4a29-a5c5-43c0a2d337a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.090642 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-880478db-0640-4a29-a5c5-43c0a2d337a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1336 microversion: 2.57 time: 0.453713 Jul 20 04:17:48.091567 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 897/1973] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:47 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1336 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:48.097073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2098c357-f1b4-4924-beda-ec329f082c58 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:48.098546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2098c357-f1b4-4924-beda-ec329f082c58 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:48.222874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-63ed3c85-3a0c-4cf3-ab93-9b794c048cce tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.232563 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-63ed3c85-3a0c-4cf3-ab93-9b794c048cce tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 200 len: 1305 microversion: 2.1 time: 0.405662 Jul 20 04:17:48.233457 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1077/1974] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:47 2022] GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 1305 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:48.239953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-91e61b40-93c4-42a0-8f51-5987f7cba6bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:48.240797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-91e61b40-93c4-42a0-8f51-5987f7cba6bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:48.249064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91e61b40-93c4-42a0-8f51-5987f7cba6bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.250361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91e61b40-93c4-42a0-8f51-5987f7cba6bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.251509 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91e61b40-93c4-42a0-8f51-5987f7cba6bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.252382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91e61b40-93c4-42a0-8f51-5987f7cba6bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.261439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2098c357-f1b4-4924-beda-ec329f082c58 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.277395 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2098c357-f1b4-4924-beda-ec329f082c58 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 200 len: 1218 microversion: 2.1 time: 0.183625 Jul 20 04:17:48.278479 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 898/1975] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:48 2022] GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:48.283876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf35dab7-c627-4d97-9cb1-e11d25a7e802 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:48.284588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf35dab7-c627-4d97-9cb1-e11d25a7e802 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:48.297404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf35dab7-c627-4d97-9cb1-e11d25a7e802 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.302018 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf35dab7-c627-4d97-9cb1-e11d25a7e802 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.303303 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf35dab7-c627-4d97-9cb1-e11d25a7e802 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.303926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf35dab7-c627-4d97-9cb1-e11d25a7e802 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.351365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf35dab7-c627-4d97-9cb1-e11d25a7e802 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:48.441235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:48.536806 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf35dab7-c627-4d97-9cb1-e11d25a7e802 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 204 len: 0 microversion: 2.25 time: 0.256719 Jul 20 04:17:48.537367 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 899/1976] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:17:48 2022] DELETE /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:17:48.547310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c9c38291-46f8-46c3-a73a-2b69df2adea8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:48.552075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c9c38291-46f8-46c3-a73a-2b69df2adea8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:48.568875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9c38291-46f8-46c3-a73a-2b69df2adea8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.569584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9c38291-46f8-46c3-a73a-2b69df2adea8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.570666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9c38291-46f8-46c3-a73a-2b69df2adea8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.571313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9c38291-46f8-46c3-a73a-2b69df2adea8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.691739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-91e61b40-93c4-42a0-8f51-5987f7cba6bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.701739 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-91e61b40-93c4-42a0-8f51-5987f7cba6bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.466536 Jul 20 04:17:48.702317 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1078/1977] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:48 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:48.715794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d1d78fd1-cc54-4a7b-b5b7-238f0ea0802c tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:48.716383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d1d78fd1-cc54-4a7b-b5b7-238f0ea0802c tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:48.730356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d1d78fd1-cc54-4a7b-b5b7-238f0ea0802c tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.737421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d1d78fd1-cc54-4a7b-b5b7-238f0ea0802c tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.738610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d1d78fd1-cc54-4a7b-b5b7-238f0ea0802c tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.739190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d1d78fd1-cc54-4a7b-b5b7-238f0ea0802c tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.926558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c9c38291-46f8-46c3-a73a-2b69df2adea8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.937880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c9c38291-46f8-46c3-a73a-2b69df2adea8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.939743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c9c38291-46f8-46c3-a73a-2b69df2adea8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.941530 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c9c38291-46f8-46c3-a73a-2b69df2adea8 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1549 microversion: 2.25 time: 0.399768 Jul 20 04:17:48.942486 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 900/1978] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:48 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1549 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:49.014941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d1d78fd1-cc54-4a7b-b5b7-238f0ea0802c tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20801c8e312044b38e1a758387877528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '023236fb56b14d0a9e5ae4dd6120162a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.022700 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d1d78fd1-cc54-4a7b-b5b7-238f0ea0802c tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" status: 200 len: 1331 microversion: 2.1 time: 0.319366 Jul 20 04:17:49.028072 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1079/1979] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:48 2022] GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f => generated 1331 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:49.111679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6889b133-087c-4a19-95a2-650dd9eb4748 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:49.112809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6889b133-087c-4a19-95a2-650dd9eb4748 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:49.133976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6889b133-087c-4a19-95a2-650dd9eb4748 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.139693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6889b133-087c-4a19-95a2-650dd9eb4748 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.143532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6889b133-087c-4a19-95a2-650dd9eb4748 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.144252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6889b133-087c-4a19-95a2-650dd9eb4748 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.251011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-71946185-5379-43a3-933b-de686e1986c3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:49.251637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-71946185-5379-43a3-933b-de686e1986c3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:49.276048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71946185-5379-43a3-933b-de686e1986c3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.282874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71946185-5379-43a3-933b-de686e1986c3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.284285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71946185-5379-43a3-933b-de686e1986c3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.289735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71946185-5379-43a3-933b-de686e1986c3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.332384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6889b133-087c-4a19-95a2-650dd9eb4748 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.348108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6889b133-087c-4a19-95a2-650dd9eb4748 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.350507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6889b133-087c-4a19-95a2-650dd9eb4748 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.352004 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6889b133-087c-4a19-95a2-650dd9eb4748 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1357 microversion: 2.57 time: 0.245538 Jul 20 04:17:49.353270 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 901/1980] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:49 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1357 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:49.368890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d601baf9-2608-48c8-b9a1-00a7dd6c6099 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:49.369875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d601baf9-2608-48c8-b9a1-00a7dd6c6099 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:49.386034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d601baf9-2608-48c8-b9a1-00a7dd6c6099 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.386592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d601baf9-2608-48c8-b9a1-00a7dd6c6099 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.387454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d601baf9-2608-48c8-b9a1-00a7dd6c6099 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.388073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d601baf9-2608-48c8-b9a1-00a7dd6c6099 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.521594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d601baf9-2608-48c8-b9a1-00a7dd6c6099 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.530987 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d601baf9-2608-48c8-b9a1-00a7dd6c6099 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 200 len: 1270 microversion: 2.1 time: 0.176430 Jul 20 04:17:49.535265 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 902/1981] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:49 2022] GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 1270 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:49.563768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-63c38d54-e4db-42a4-896e-3b97c26d29d4 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:49.567481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-71946185-5379-43a3-933b-de686e1986c3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.570820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-63c38d54-e4db-42a4-896e-3b97c26d29d4 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:49.578774 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-71946185-5379-43a3-933b-de686e1986c3 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 200 len: 1305 microversion: 2.1 time: 0.333310 Jul 20 04:17:49.579852 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1080/1982] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:49 2022] GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 1305 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:49.583866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63c38d54-e4db-42a4-896e-3b97c26d29d4 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.584560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63c38d54-e4db-42a4-896e-3b97c26d29d4 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.585499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63c38d54-e4db-42a4-896e-3b97c26d29d4 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.586083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63c38d54-e4db-42a4-896e-3b97c26d29d4 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.700749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-63c38d54-e4db-42a4-896e-3b97c26d29d4 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:49.701099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-63c38d54-e4db-42a4-896e-3b97c26d29d4 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:49.701637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-63c38d54-e4db-42a4-896e-3b97c26d29d4 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:49.702058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-63c38d54-e4db-42a4-896e-3b97c26d29d4 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:49.702508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-63c38d54-e4db-42a4-896e-3b97c26d29d4 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:49.722032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-20ce47aa-c28f-447a-9328-6ef345ef3b47 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:49.723855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-20ce47aa-c28f-447a-9328-6ef345ef3b47 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:49.737510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20ce47aa-c28f-447a-9328-6ef345ef3b47 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.738257 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20ce47aa-c28f-447a-9328-6ef345ef3b47 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.741749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20ce47aa-c28f-447a-9328-6ef345ef3b47 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.743837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20ce47aa-c28f-447a-9328-6ef345ef3b47 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.868671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-63c38d54-e4db-42a4-896e-3b97c26d29d4 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:49.879689 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63c38d54-e4db-42a4-896e-3b97c26d29d4 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.880620 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63c38d54-e4db-42a4-896e-3b97c26d29d4 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.882277 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63c38d54-e4db-42a4-896e-3b97c26d29d4 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.882870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63c38d54-e4db-42a4-896e-3b97c26d29d4 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.978969 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-63c38d54-e4db-42a4-896e-3b97c26d29d4 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "POST /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f/action" status: 202 len: 1138 microversion: 2.57 time: 0.424769 Jul 20 04:17:49.981044 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 903/1983] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Jul 20 04:17:49 2022] POST /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f/action => generated 1138 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 04:17:49.995921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-6d50efaf-1876-4baa-9585-d0b94b776349 req-96bbc487-b3b6-42a4-9cf9-4471a0f7a064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f", "name": "network-vif-plugged", "status": "completed", "tag": "5fe4d090-78b8-44a5-99b6-9391f731a824"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:50.007478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6d50efaf-1876-4baa-9585-d0b94b776349 req-96bbc487-b3b6-42a4-9cf9-4471a0f7a064 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.008433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6d50efaf-1876-4baa-9585-d0b94b776349 req-96bbc487-b3b6-42a4-9cf9-4471a0f7a064 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.026435 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-6d50efaf-1876-4baa-9585-d0b94b776349 req-96bbc487-b3b6-42a4-9cf9-4471a0f7a064 service nova] Creating event network-vif-plugged:5fe4d090-78b8-44a5-99b6-9391f731a824 for instance 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f on n-h1-826526-5 Jul 20 04:17:50.060751 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-6d50efaf-1876-4baa-9585-d0b94b776349 req-96bbc487-b3b6-42a4-9cf9-4471a0f7a064 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077992 Jul 20 04:17:50.063452 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 904/1984] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:50.096080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1caf177e-d60d-42f2-bf82-ae1bd04389b0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:50.096824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1caf177e-d60d-42f2-bf82-ae1bd04389b0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:50.132224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1caf177e-d60d-42f2-bf82-ae1bd04389b0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.133156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1caf177e-d60d-42f2-bf82-ae1bd04389b0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.134309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1caf177e-d60d-42f2-bf82-ae1bd04389b0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.136419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1caf177e-d60d-42f2-bf82-ae1bd04389b0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.391898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-20ce47aa-c28f-447a-9328-6ef345ef3b47 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.406702 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-20ce47aa-c28f-447a-9328-6ef345ef3b47 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.689239 Jul 20 04:17:50.408530 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1081/1985] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:49 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:50.421679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e879cbfe-7cca-4a5f-bcde-cbd545d7fd6f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:50.425327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e879cbfe-7cca-4a5f-bcde-cbd545d7fd6f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:50.442742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e879cbfe-7cca-4a5f-bcde-cbd545d7fd6f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.446665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e879cbfe-7cca-4a5f-bcde-cbd545d7fd6f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.449491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e879cbfe-7cca-4a5f-bcde-cbd545d7fd6f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.450217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e879cbfe-7cca-4a5f-bcde-cbd545d7fd6f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.650556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e879cbfe-7cca-4a5f-bcde-cbd545d7fd6f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.667357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e879cbfe-7cca-4a5f-bcde-cbd545d7fd6f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.675191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e879cbfe-7cca-4a5f-bcde-cbd545d7fd6f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.678940 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e879cbfe-7cca-4a5f-bcde-cbd545d7fd6f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.268544 Jul 20 04:17:50.681310 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1082/1986] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:50 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:50.686817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-291a0d2b-1826-4388-a41c-62fa6f95d6fe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:50.687604 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-291a0d2b-1826-4388-a41c-62fa6f95d6fe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:50.690930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:50.696149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-291a0d2b-1826-4388-a41c-62fa6f95d6fe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.696940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-291a0d2b-1826-4388-a41c-62fa6f95d6fe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.697945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-291a0d2b-1826-4388-a41c-62fa6f95d6fe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.698944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-291a0d2b-1826-4388-a41c-62fa6f95d6fe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.980211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-291a0d2b-1826-4388-a41c-62fa6f95d6fe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20801c8e312044b38e1a758387877528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '023236fb56b14d0a9e5ae4dd6120162a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.987936 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-291a0d2b-1826-4388-a41c-62fa6f95d6fe tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" status: 200 len: 1331 microversion: 2.1 time: 0.305141 Jul 20 04:17:50.996355 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1083/1987] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:50 2022] GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f => generated 1331 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:51.010651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-76a82b64-f664-48bb-acca-0a9f33f99bdf tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:51.011197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-76a82b64-f664-48bb-acca-0a9f33f99bdf tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:51.017484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76a82b64-f664-48bb-acca-0a9f33f99bdf tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.017968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76a82b64-f664-48bb-acca-0a9f33f99bdf tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.018742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76a82b64-f664-48bb-acca-0a9f33f99bdf tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.019172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76a82b64-f664-48bb-acca-0a9f33f99bdf tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.073859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1caf177e-d60d-42f2-bf82-ae1bd04389b0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.086115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1caf177e-d60d-42f2-bf82-ae1bd04389b0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.090574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1caf177e-d60d-42f2-bf82-ae1bd04389b0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.101782 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1caf177e-d60d-42f2-bf82-ae1bd04389b0 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1549 microversion: 2.25 time: 1.033050 Jul 20 04:17:51.102793 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 905/1988] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:50 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1549 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:51.116993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3fe2365b-a07a-4265-9fc9-104b6255fc3c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:51.117940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3fe2365b-a07a-4265-9fc9-104b6255fc3c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:51.126364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3fe2365b-a07a-4265-9fc9-104b6255fc3c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.130230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3fe2365b-a07a-4265-9fc9-104b6255fc3c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.131609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3fe2365b-a07a-4265-9fc9-104b6255fc3c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.132278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3fe2365b-a07a-4265-9fc9-104b6255fc3c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.174685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-76a82b64-f664-48bb-acca-0a9f33f99bdf tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.184307 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-76a82b64-f664-48bb-acca-0a9f33f99bdf tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 200 len: 1276 microversion: 2.1 time: 0.191866 Jul 20 04:17:51.187246 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1084/1989] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:50 2022] GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:51.426335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-55425fa8-c1a4-49dd-b7cb-bbbfdc15f530 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:51.426946 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-55425fa8-c1a4-49dd-b7cb-bbbfdc15f530 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:51.437471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55425fa8-c1a4-49dd-b7cb-bbbfdc15f530 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.437933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55425fa8-c1a4-49dd-b7cb-bbbfdc15f530 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.438715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55425fa8-c1a4-49dd-b7cb-bbbfdc15f530 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.445538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55425fa8-c1a4-49dd-b7cb-bbbfdc15f530 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.832163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3fe2365b-a07a-4265-9fc9-104b6255fc3c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.859287 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3fe2365b-a07a-4265-9fc9-104b6255fc3c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 200 len: 1485 microversion: 2.1 time: 0.755171 Jul 20 04:17:51.862010 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 906/1990] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:51 2022] GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 1485 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:51.880252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-2e6a042d-cc0e-4436-a1c0-b5b6a02f8cef req-c1d0e41a-554b-4431-8f99-5a57f37b9c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69", "name": "network-vif-deleted", "tag": "ab1206c5-d9dd-462c-a1bb-fc0ceafad15f"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:51.909293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2e6a042d-cc0e-4436-a1c0-b5b6a02f8cef req-c1d0e41a-554b-4431-8f99-5a57f37b9c9b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.910366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2e6a042d-cc0e-4436-a1c0-b5b6a02f8cef req-c1d0e41a-554b-4431-8f99-5a57f37b9c9b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.968287 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-2e6a042d-cc0e-4436-a1c0-b5b6a02f8cef req-c1d0e41a-554b-4431-8f99-5a57f37b9c9b service nova] Creating event network-vif-deleted:ab1206c5-d9dd-462c-a1bb-fc0ceafad15f for instance 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 on n-h2-826526-5 Jul 20 04:17:51.983472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-55425fa8-c1a4-49dd-b7cb-bbbfdc15f530 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.983982 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-2e6a042d-cc0e-4436-a1c0-b5b6a02f8cef req-c1d0e41a-554b-4431-8f99-5a57f37b9c9b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116928 Jul 20 04:17:51.987116 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 907/1991] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:51.996000 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-55425fa8-c1a4-49dd-b7cb-bbbfdc15f530 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.571229 Jul 20 04:17:51.998690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6f0f9f00-f17c-4c26-93f6-92299ba1ac09 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:52.000027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6f0f9f00-f17c-4c26-93f6-92299ba1ac09 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:52.008417 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1085/1992] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:51 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:52.011625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f0f9f00-f17c-4c26-93f6-92299ba1ac09 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.018687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f0f9f00-f17c-4c26-93f6-92299ba1ac09 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.019976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f0f9f00-f17c-4c26-93f6-92299ba1ac09 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.021337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f0f9f00-f17c-4c26-93f6-92299ba1ac09 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.021778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5e5ab4a0-b4d3-4f73-95f4-61f8cda0770f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:52.023252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5e5ab4a0-b4d3-4f73-95f4-61f8cda0770f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:52.040200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e5ab4a0-b4d3-4f73-95f4-61f8cda0770f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.042369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e5ab4a0-b4d3-4f73-95f4-61f8cda0770f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.043195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e5ab4a0-b4d3-4f73-95f4-61f8cda0770f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.044715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e5ab4a0-b4d3-4f73-95f4-61f8cda0770f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.098805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-5e5ab4a0-b4d3-4f73-95f4-61f8cda0770f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lazy-loading 'flavor' on Instance uuid a02cfafe-ca57-4211-bd4e-287672a73ea9 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:52.236976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6f0f9f00-f17c-4c26-93f6-92299ba1ac09 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:52.254029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6f0f9f00-f17c-4c26-93f6-92299ba1ac09 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:52.281374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6f0f9f00-f17c-4c26-93f6-92299ba1ac09 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:52.283785 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6f0f9f00-f17c-4c26-93f6-92299ba1ac09 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.295362 Jul 20 04:17:52.286316 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 908/1993] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:51 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:52.300008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bcb9008c-c3e5-417a-8d72-566b2e5ca284 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:52.306833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bcb9008c-c3e5-417a-8d72-566b2e5ca284 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:52.313267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcb9008c-c3e5-417a-8d72-566b2e5ca284 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.314052 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcb9008c-c3e5-417a-8d72-566b2e5ca284 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.315126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcb9008c-c3e5-417a-8d72-566b2e5ca284 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.319772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcb9008c-c3e5-417a-8d72-566b2e5ca284 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.412112 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5e5ab4a0-b4d3-4f73-95f4-61f8cda0770f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "POST /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9/action" status: 202 len: 0 microversion: 2.1 time: 0.395881 Jul 20 04:17:52.415078 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1086/1994] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:52 2022] POST /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:52.423713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0f0efb03-93f5-47ff-972c-f9623cc6dce5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:52.425127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0f0efb03-93f5-47ff-972c-f9623cc6dce5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:52.433502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f0efb03-93f5-47ff-972c-f9623cc6dce5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.434213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f0efb03-93f5-47ff-972c-f9623cc6dce5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.435572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f0efb03-93f5-47ff-972c-f9623cc6dce5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.436370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f0efb03-93f5-47ff-972c-f9623cc6dce5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.442661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:52.492361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f0efb03-93f5-47ff-972c-f9623cc6dce5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.494419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f0efb03-93f5-47ff-972c-f9623cc6dce5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.495401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-0f0efb03-93f5-47ff-972c-f9623cc6dce5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lazy-loading 'fault' on Instance uuid 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:52.582314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0f0efb03-93f5-47ff-972c-f9623cc6dce5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:52.593212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0f0efb03-93f5-47ff-972c-f9623cc6dce5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:52.595509 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0f0efb03-93f5-47ff-972c-f9623cc6dce5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:52.597395 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0f0efb03-93f5-47ff-972c-f9623cc6dce5 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 200 len: 1352 microversion: 2.25 time: 0.179195 Jul 20 04:17:52.598583 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1087/1995] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:52 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 1352 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:52.604782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e94f118b-9dcb-4884-972b-18b5d3ddbdb7 req-148bda1d-ce98-4d7d-a2fe-33de9213055b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b62c758-d90d-48b5-903f-7553734f4cfe", "name": "network-vif-unplugged", "status": "completed", "tag": "be0fb241-a959-4d10-85fb-6ddb8e17edb2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:52.625087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e94f118b-9dcb-4884-972b-18b5d3ddbdb7 req-148bda1d-ce98-4d7d-a2fe-33de9213055b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.625797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e94f118b-9dcb-4884-972b-18b5d3ddbdb7 req-148bda1d-ce98-4d7d-a2fe-33de9213055b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.645989 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e94f118b-9dcb-4884-972b-18b5d3ddbdb7 req-148bda1d-ce98-4d7d-a2fe-33de9213055b service nova] Creating event network-vif-unplugged:be0fb241-a959-4d10-85fb-6ddb8e17edb2 for instance 7b62c758-d90d-48b5-903f-7553734f4cfe on n-h1-826526-5 Jul 20 04:17:52.663137 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e94f118b-9dcb-4884-972b-18b5d3ddbdb7 req-148bda1d-ce98-4d7d-a2fe-33de9213055b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063033 Jul 20 04:17:52.664107 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1088/1996] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:52.670855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-472dff49-f49e-4b5d-b0e5-a52f4cfe1db6 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:52.672416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-472dff49-f49e-4b5d-b0e5-a52f4cfe1db6 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:52.682802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-472dff49-f49e-4b5d-b0e5-a52f4cfe1db6 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.683715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-472dff49-f49e-4b5d-b0e5-a52f4cfe1db6 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.684712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-472dff49-f49e-4b5d-b0e5-a52f4cfe1db6 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.685153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-472dff49-f49e-4b5d-b0e5-a52f4cfe1db6 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.752203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bcb9008c-c3e5-417a-8d72-566b2e5ca284 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20801c8e312044b38e1a758387877528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '023236fb56b14d0a9e5ae4dd6120162a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:52.776796 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bcb9008c-c3e5-417a-8d72-566b2e5ca284 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" status: 200 len: 1535 microversion: 2.1 time: 0.485846 Jul 20 04:17:52.780601 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 909/1997] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:52 2022] GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f => generated 1535 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:52.803792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a4fe17d9-179b-4832-a59e-cb355de2cf89 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:52.806047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a4fe17d9-179b-4832-a59e-cb355de2cf89 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:52.840635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4fe17d9-179b-4832-a59e-cb355de2cf89 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.841471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4fe17d9-179b-4832-a59e-cb355de2cf89 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.842326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4fe17d9-179b-4832-a59e-cb355de2cf89 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.844628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4fe17d9-179b-4832-a59e-cb355de2cf89 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.072671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-472dff49-f49e-4b5d-b0e5-a52f4cfe1db6 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.089699 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-472dff49-f49e-4b5d-b0e5-a52f4cfe1db6 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 200 len: 1318 microversion: 2.1 time: 0.418131 Jul 20 04:17:53.095001 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1089/1998] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:52 2022] GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:53.117959 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1f816788-c3d5-40c8-bbe5-2df1a3f88848 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Action: 'create', calling method: .version_select at 0x7f06c7459d30>, body: {"pool": "802b4524-5322-4d85-a63f-cab8cf79b0d6"} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:53.947733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a4fe17d9-179b-4832-a59e-cb355de2cf89 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.961511 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a4fe17d9-179b-4832-a59e-cb355de2cf89 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 200 len: 1493 microversion: 2.1 time: 1.179158 Jul 20 04:17:53.963451 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 910/1999] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:52 2022] GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 1493 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:53.974444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-631d23ab-3938-4213-8cbf-cad883462001 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:53.976722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-631d23ab-3938-4213-8cbf-cad883462001 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:53.991413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-631d23ab-3938-4213-8cbf-cad883462001 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.992089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-631d23ab-3938-4213-8cbf-cad883462001 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.993537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-631d23ab-3938-4213-8cbf-cad883462001 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.994299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-631d23ab-3938-4213-8cbf-cad883462001 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.436190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-631d23ab-3938-4213-8cbf-cad883462001 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.452754 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-631d23ab-3938-4213-8cbf-cad883462001 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1393 microversion: 2.1 time: 0.480671 Jul 20 04:17:54.453584 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 911/2000] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:53 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1393 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:54.458962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3474261e-fd06-47f2-a0d9-b80ae864421d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:54.461708 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3474261e-fd06-47f2-a0d9-b80ae864421d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:54.477448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3474261e-fd06-47f2-a0d9-b80ae864421d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.478177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3474261e-fd06-47f2-a0d9-b80ae864421d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.479118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3474261e-fd06-47f2-a0d9-b80ae864421d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.479705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3474261e-fd06-47f2-a0d9-b80ae864421d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.694247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3474261e-fd06-47f2-a0d9-b80ae864421d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.707755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3474261e-fd06-47f2-a0d9-b80ae864421d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.715622 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3474261e-fd06-47f2-a0d9-b80ae864421d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.717183 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3474261e-fd06-47f2-a0d9-b80ae864421d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.262282 Jul 20 04:17:54.719726 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 912/2001] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:54 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:54.734545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-62eea273-3e22-4cd2-9920-ea57703ab3cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:54.735585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62eea273-3e22-4cd2-9920-ea57703ab3cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:54.753823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62eea273-3e22-4cd2-9920-ea57703ab3cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.754277 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62eea273-3e22-4cd2-9920-ea57703ab3cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.755068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62eea273-3e22-4cd2-9920-ea57703ab3cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.755506 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62eea273-3e22-4cd2-9920-ea57703ab3cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.775914 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-62eea273-3e22-4cd2-9920-ea57703ab3cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] HTTP exception thrown: Instance 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 could not be found. Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-62eea273-3e22-4cd2-9920-ea57703ab3cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Request method failure captured: Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 HTTP/1.1 Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14ALEpS8cLFwrWGrP2QWc6ENbBeQxhTSZrCMB4J-aiWbIB1DcF5qsJhQO_fS3PT3NzooKQpZlA-XJW7ILwnbQGTJCAxxmlsPvEnem5bZawLFEGTJVax5f9UvzTQ2J2dI4LC2UBTpQtVDHBHmByN6irkSPk6c_cmOrMQPvRZJYv9WSV0 Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 8d4037629b9e4e6fa92e2a8d89cf0311 Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1255805509 Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:17:54.777630 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:17:54.778976 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d4037629b9e4e6fa92e2a8d89cf0311"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8d4037629b9e4e6fa92e2a8d89cf0311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8d4037629b9e4e6fa92e2a8d89cf0311", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d4037629b9e4e6fa92e2a8d89cf0311"}]}] Jul 20 04:17:54.778976 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1255805509 Jul 20 04:17:54.778976 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 8d4037629b9e4e6fa92e2a8d89cf0311 Jul 20 04:17:54.778976 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1255805509 Jul 20 04:17:54.778976 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-LiveAutoBlockMigrationV225Test-1255805509-project Jul 20 04:17:54.778976 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:17:54.778976 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:17:54.778976 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 45a9bfefde81473d88610b03e0de9bf4 Jul 20 04:17:54.778976 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1255805509-project Jul 20 04:17:54.778976 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:17:54.778976 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 could not be found. Jul 20 04:17:54.778976 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69'} Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 could not be found. Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:54.779739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:54.780757 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:54.780757 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:54.780757 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:54.780757 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:54.780757 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:54.780757 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:54.780757 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:54.780757 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 could not be found. Jul 20 04:17:54.780757 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.780757 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:54.780757 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.780757 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:54.780757 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:54.780757 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:54.780757 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:54.780757 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:54.780757 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 could not be found. Jul 20 04:17:54.780757 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.782132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-62eea273-3e22-4cd2-9920-ea57703ab3cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Returning 404 to user: Instance 0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:54.782132 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-62eea273-3e22-4cd2-9920-ea57703ab3cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69" status: 404 len: 111 microversion: 2.25 time: 0.058071 Jul 20 04:17:54.782132 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 913/2002] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:54 2022] GET /compute/v2.1/servers/0acbffd8-7b5d-4c65-938c-9dcc7c8fcb69 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:17:54.792985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-430a6101-a458-4795-a9ac-fd902144b524 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:54.793998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-430a6101-a458-4795-a9ac-fd902144b524 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:54.801127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-430a6101-a458-4795-a9ac-fd902144b524 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.801931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-430a6101-a458-4795-a9ac-fd902144b524 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.802935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-430a6101-a458-4795-a9ac-fd902144b524 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.803811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-430a6101-a458-4795-a9ac-fd902144b524 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.169606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-430a6101-a458-4795-a9ac-fd902144b524 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:55.192571 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-430a6101-a458-4795-a9ac-fd902144b524 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 200 len: 1318 microversion: 2.1 time: 0.411883 Jul 20 04:17:55.193177 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 914/2003] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:54 2022] GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:55.198164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a6c419b1-2b91-4f3b-a8cb-b00beab314cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:55.199443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a6c419b1-2b91-4f3b-a8cb-b00beab314cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:55.206088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6c419b1-2b91-4f3b-a8cb-b00beab314cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:55.206716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6c419b1-2b91-4f3b-a8cb-b00beab314cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.207651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6c419b1-2b91-4f3b-a8cb-b00beab314cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:55.208222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6c419b1-2b91-4f3b-a8cb-b00beab314cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.244681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a6c419b1-2b91-4f3b-a8cb-b00beab314cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:55.268903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:55.381058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:55.386232 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a6c419b1-2b91-4f3b-a8cb-b00beab314cc tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 204 len: 0 microversion: 2.25 time: 0.191597 Jul 20 04:17:55.387664 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 915/2004] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:17:55 2022] DELETE /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:17:55.398073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-25e4e226-99cc-430c-b690-c571b49835ee tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:55.399633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-25e4e226-99cc-430c-b690-c571b49835ee tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:55.409299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25e4e226-99cc-430c-b690-c571b49835ee tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:55.410064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25e4e226-99cc-430c-b690-c571b49835ee tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.411097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25e4e226-99cc-430c-b690-c571b49835ee tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:55.411873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25e4e226-99cc-430c-b690-c571b49835ee tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.847170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-25e4e226-99cc-430c-b690-c571b49835ee tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:55.860273 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-25e4e226-99cc-430c-b690-c571b49835ee tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 200 len: 1476 microversion: 2.1 time: 0.469274 Jul 20 04:17:55.861057 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 916/2005] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:55 2022] GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 1476 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:55.884485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea4e8a25-3bca-477b-a772-847cf11fb2c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:55.886882 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ea4e8a25-3bca-477b-a772-847cf11fb2c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:55.900144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea4e8a25-3bca-477b-a772-847cf11fb2c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:55.901717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea4e8a25-3bca-477b-a772-847cf11fb2c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.902811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea4e8a25-3bca-477b-a772-847cf11fb2c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:55.903888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea4e8a25-3bca-477b-a772-847cf11fb2c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.430950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ea4e8a25-3bca-477b-a772-847cf11fb2c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:56.449396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ea4e8a25-3bca-477b-a772-847cf11fb2c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:56.450899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ea4e8a25-3bca-477b-a772-847cf11fb2c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:56.452077 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ea4e8a25-3bca-477b-a772-847cf11fb2c7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1564 microversion: 2.25 time: 0.582892 Jul 20 04:17:56.452680 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 917/2006] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:55 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1564 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:56.457561 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-83c68db6-a7f0-48f8-bb9d-d7c66f9fc0bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:56.458176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-83c68db6-a7f0-48f8-bb9d-d7c66f9fc0bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:56.471766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83c68db6-a7f0-48f8-bb9d-d7c66f9fc0bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.472211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83c68db6-a7f0-48f8-bb9d-d7c66f9fc0bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.473029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83c68db6-a7f0-48f8-bb9d-d7c66f9fc0bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.473463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83c68db6-a7f0-48f8-bb9d-d7c66f9fc0bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.940057 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1f816788-c3d5-40c8-bbe5-2df1a3f88848 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.843763 Jul 20 04:17:56.940782 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1090/2007] 10.222.0.17 () {60 vars in 1169 bytes} [Wed Jul 20 04:17:53 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:56.952295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-723be231-3186-41bc-bf5a-91499f830881 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:56.953261 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-723be231-3186-41bc-bf5a-91499f830881 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:56.961359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-723be231-3186-41bc-bf5a-91499f830881 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.961919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-723be231-3186-41bc-bf5a-91499f830881 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.962790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-723be231-3186-41bc-bf5a-91499f830881 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.963339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-723be231-3186-41bc-bf5a-91499f830881 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.061836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-723be231-3186-41bc-bf5a-91499f830881 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.072851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-723be231-3186-41bc-bf5a-91499f830881 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.075339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-723be231-3186-41bc-bf5a-91499f830881 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.077057 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-723be231-3186-41bc-bf5a-91499f830881 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.134885 Jul 20 04:17:57.078682 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1091/2008] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:56 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:57.086273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e038a85d-d462-4617-81f1-9d1bd15b7d63 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2128928906"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:57.088028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e038a85d-d462-4617-81f1-9d1bd15b7d63 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:57.096563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e038a85d-d462-4617-81f1-9d1bd15b7d63 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.096985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e038a85d-d462-4617-81f1-9d1bd15b7d63 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.097963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e038a85d-d462-4617-81f1-9d1bd15b7d63 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.098413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e038a85d-d462-4617-81f1-9d1bd15b7d63 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.136362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-83c68db6-a7f0-48f8-bb9d-d7c66f9fc0bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.146766 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-83c68db6-a7f0-48f8-bb9d-d7c66f9fc0bf tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1383 microversion: 2.1 time: 0.692489 Jul 20 04:17:57.146885 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 918/2009] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:56 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1383 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:57.165187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-a47fca92-1df0-4a93-99b9-e46964f48c30 req-83d091a9-655f-432b-a900-1d115de305e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1320f3fe-788f-4ebe-ad01-67e9201ac630", "tag": "a075a139-e1e3-4aba-a6b3-d51472d32eaa"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:57.175818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a47fca92-1df0-4a93-99b9-e46964f48c30 req-83d091a9-655f-432b-a900-1d115de305e9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.176575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a47fca92-1df0-4a93-99b9-e46964f48c30 req-83d091a9-655f-432b-a900-1d115de305e9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.190705 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-a47fca92-1df0-4a93-99b9-e46964f48c30 req-83d091a9-655f-432b-a900-1d115de305e9 service nova] Creating event network-changed:a075a139-e1e3-4aba-a6b3-d51472d32eaa for instance 1320f3fe-788f-4ebe-ad01-67e9201ac630 on n-h2-826526-5 Jul 20 04:17:57.196758 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-a47fca92-1df0-4a93-99b9-e46964f48c30 req-83d091a9-655f-432b-a900-1d115de305e9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036842 Jul 20 04:17:57.198101 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 919/2010] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:57.204784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-292117b3-4dd9-48ae-957f-086646dd132c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:57.206185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-292117b3-4dd9-48ae-957f-086646dd132c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:57.228836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-292117b3-4dd9-48ae-957f-086646dd132c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.229655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-292117b3-4dd9-48ae-957f-086646dd132c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.231191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-292117b3-4dd9-48ae-957f-086646dd132c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.232219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-292117b3-4dd9-48ae-957f-086646dd132c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.466299 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e038a85d-d462-4617-81f1-9d1bd15b7d63 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "POST /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9/action" status: 202 len: 0 microversion: 2.1 time: 0.385103 Jul 20 04:17:57.466974 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1092/2011] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:57 2022] POST /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:17:57.473190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3f48abc8-df08-4568-8542-c59c4bc13787 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.85"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:57.474721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3f48abc8-df08-4568-8542-c59c4bc13787 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:57.482212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f48abc8-df08-4568-8542-c59c4bc13787 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.482769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f48abc8-df08-4568-8542-c59c4bc13787 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.483777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f48abc8-df08-4568-8542-c59c4bc13787 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.484220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f48abc8-df08-4568-8542-c59c4bc13787 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.511127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f48abc8-df08-4568-8542-c59c4bc13787 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Acquired lock "refresh_cache-2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" {{(pid=127871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:17:57.537952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-292117b3-4dd9-48ae-957f-086646dd132c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.542273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:57.551923 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-292117b3-4dd9-48ae-957f-086646dd132c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 200 len: 1318 microversion: 2.1 time: 0.352330 Jul 20 04:17:57.552844 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 920/2012] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:57 2022] GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:57.558053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8b990123-c43b-42bc-98bf-1e43309e7e4a tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '.version_select at 0x7f06bde0a1f0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:57.561124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b990123-c43b-42bc-98bf-1e43309e7e4a tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.561674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b990123-c43b-42bc-98bf-1e43309e7e4a tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.571156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=12 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:57.571809 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8b990123-c43b-42bc-98bf-1e43309e7e4a tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 1938 microversion: 2.1 time: 0.017597 Jul 20 04:17:57.572720 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 921/2013] 10.222.0.17 () {58 vars in 1142 bytes} [Wed Jul 20 04:17:57 2022] GET /compute/v2.1/os-migrations => generated 1938 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:57.577541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fa7a6a5c-4e6f-49ca-9ae9-3e758a95e6e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:57.578144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fa7a6a5c-4e6f-49ca-9ae9-3e758a95e6e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:57.585159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fa7a6a5c-4e6f-49ca-9ae9-3e758a95e6e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.585635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fa7a6a5c-4e6f-49ca-9ae9-3e758a95e6e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.586575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fa7a6a5c-4e6f-49ca-9ae9-3e758a95e6e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.587001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fa7a6a5c-4e6f-49ca-9ae9-3e758a95e6e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.667876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fa7a6a5c-4e6f-49ca-9ae9-3e758a95e6e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.685007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fa7a6a5c-4e6f-49ca-9ae9-3e758a95e6e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.687095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fa7a6a5c-4e6f-49ca-9ae9-3e758a95e6e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.688360 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fa7a6a5c-4e6f-49ca-9ae9-3e758a95e6e9 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1522 microversion: 2.25 time: 0.114527 Jul 20 04:17:57.692619 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 922/2014] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:57 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1522 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:57.706804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-58e941e1-13c5-492e-9dca-541a8fb3174d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be8b2dc0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:57.764870 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-58e941e1-13c5-492e-9dca-541a8fb3174d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.071160 Jul 20 04:17:57.770553 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 923/2015] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:57 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:57.770733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a31d250b-5cee-42e7-97cd-dff60715333b tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:57.771393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a31d250b-5cee-42e7-97cd-dff60715333b tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:57.779613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a31d250b-5cee-42e7-97cd-dff60715333b tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.780064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a31d250b-5cee-42e7-97cd-dff60715333b tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.781042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a31d250b-5cee-42e7-97cd-dff60715333b tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.781484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a31d250b-5cee-42e7-97cd-dff60715333b tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.997892 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a31d250b-5cee-42e7-97cd-dff60715333b tempest-LiveMigrationTest-1951582164 tempest-LiveMigrationTest-1951582164-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1534 microversion: 2.1 time: 0.230689 Jul 20 04:17:57.998486 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 924/2016] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:57 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1534 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:58.024996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-92f56f9d-3b39-4588-ac36-58fa208c5170 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:58.025511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-92f56f9d-3b39-4588-ac36-58fa208c5170 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:58.048506 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92f56f9d-3b39-4588-ac36-58fa208c5170 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.049322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92f56f9d-3b39-4588-ac36-58fa208c5170 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.051088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92f56f9d-3b39-4588-ac36-58fa208c5170 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.057000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92f56f9d-3b39-4588-ac36-58fa208c5170 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.107547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-92f56f9d-3b39-4588-ac36-58fa208c5170 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:58.269953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:58.286406 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-92f56f9d-3b39-4588-ac36-58fa208c5170 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 204 len: 0 microversion: 2.1 time: 0.264332 Jul 20 04:17:58.288798 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 925/2017] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:58 2022] DELETE /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:58.298686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2970b3c9-4c61-4ce0-9358-f91b1cf3b952 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:58.299745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2970b3c9-4c61-4ce0-9358-f91b1cf3b952 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:58.310751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2970b3c9-4c61-4ce0-9358-f91b1cf3b952 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.311363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2970b3c9-4c61-4ce0-9358-f91b1cf3b952 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.312364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2970b3c9-4c61-4ce0-9358-f91b1cf3b952 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.312895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2970b3c9-4c61-4ce0-9358-f91b1cf3b952 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.419335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2970b3c9-4c61-4ce0-9358-f91b1cf3b952 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:58.428065 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2970b3c9-4c61-4ce0-9358-f91b1cf3b952 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:58.429761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2970b3c9-4c61-4ce0-9358-f91b1cf3b952 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:58.431041 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2970b3c9-4c61-4ce0-9358-f91b1cf3b952 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.140836 Jul 20 04:17:58.431717 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 926/2018] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:58 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:58.436606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-25dc7a08-eab0-491e-815f-b5e9330a212a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:58.437515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-25dc7a08-eab0-491e-815f-b5e9330a212a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:58.445227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25dc7a08-eab0-491e-815f-b5e9330a212a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.445839 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25dc7a08-eab0-491e-815f-b5e9330a212a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.446717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25dc7a08-eab0-491e-815f-b5e9330a212a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.447259 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25dc7a08-eab0-491e-815f-b5e9330a212a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.614937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-25dc7a08-eab0-491e-815f-b5e9330a212a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:58.625107 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-25dc7a08-eab0-491e-815f-b5e9330a212a tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1389 microversion: 2.1 time: 0.191576 Jul 20 04:17:58.626086 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 927/2019] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:58 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1389 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:58.633957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b1f901ad-599f-41de-aead-47fb6462c19f tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:58.635028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b1f901ad-599f-41de-aead-47fb6462c19f tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:58.641497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1f901ad-599f-41de-aead-47fb6462c19f tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.641984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1f901ad-599f-41de-aead-47fb6462c19f tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.643125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1f901ad-599f-41de-aead-47fb6462c19f tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.643772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1f901ad-599f-41de-aead-47fb6462c19f tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.833903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b1f901ad-599f-41de-aead-47fb6462c19f tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:58.843564 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b1f901ad-599f-41de-aead-47fb6462c19f tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 200 len: 1318 microversion: 2.1 time: 0.215944 Jul 20 04:17:58.845012 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 928/2020] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:58 2022] GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:58.869517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7fbe2ba6-8660-4d34-a3cd-757ed6ed5b77 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:58.870148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7fbe2ba6-8660-4d34-a3cd-757ed6ed5b77 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:58.889300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fbe2ba6-8660-4d34-a3cd-757ed6ed5b77 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.891325 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fbe2ba6-8660-4d34-a3cd-757ed6ed5b77 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.896223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fbe2ba6-8660-4d34-a3cd-757ed6ed5b77 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.896223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fbe2ba6-8660-4d34-a3cd-757ed6ed5b77 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.961770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fbe2ba6-8660-4d34-a3cd-757ed6ed5b77 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.962163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fbe2ba6-8660-4d34-a3cd-757ed6ed5b77 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.962620 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-7fbe2ba6-8660-4d34-a3cd-757ed6ed5b77 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lazy-loading 'fault' on Instance uuid ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:59.007771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7fbe2ba6-8660-4d34-a3cd-757ed6ed5b77 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.015893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7fbe2ba6-8660-4d34-a3cd-757ed6ed5b77 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.017707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7fbe2ba6-8660-4d34-a3cd-757ed6ed5b77 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45a9bfefde81473d88610b03e0de9bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4037629b9e4e6fa92e2a8d89cf0311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.018961 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7fbe2ba6-8660-4d34-a3cd-757ed6ed5b77 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 200 len: 1351 microversion: 2.25 time: 0.159413 Jul 20 04:17:59.029629 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 929/2021] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:58 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 1351 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:59.034393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f7a8ccd7-4b3b-4684-85d6-a03d1b6b5b67 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bde0bee0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:59.079941 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f7a8ccd7-4b3b-4684-85d6-a03d1b6b5b67 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.058975 Jul 20 04:17:59.081429 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 930/2022] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:59 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:59.244998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-1efb7ef9-de70-4e5e-9e7f-964eb8e12930 req-4c25a5d7-b36a-4e1b-bca6-c230b3481f18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a", "name": "network-vif-deleted", "tag": "ac5fffab-5b76-4774-b5dc-86edfb73fa2e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:59.282646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-1efb7ef9-de70-4e5e-9e7f-964eb8e12930 req-4c25a5d7-b36a-4e1b-bca6-c230b3481f18 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.284757 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-1efb7ef9-de70-4e5e-9e7f-964eb8e12930 req-4c25a5d7-b36a-4e1b-bca6-c230b3481f18 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.309936 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-1efb7ef9-de70-4e5e-9e7f-964eb8e12930 req-4c25a5d7-b36a-4e1b-bca6-c230b3481f18 service nova] Creating event network-vif-deleted:ac5fffab-5b76-4774-b5dc-86edfb73fa2e for instance ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a on n-h2-826526-5 Jul 20 04:17:59.316107 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-1efb7ef9-de70-4e5e-9e7f-964eb8e12930 req-4c25a5d7-b36a-4e1b-bca6-c230b3481f18 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093305 Jul 20 04:17:59.319204 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 931/2023] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:59.451127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7da20ff9-2aba-47ea-91c6-98fe957e3c43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:59.452077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7da20ff9-2aba-47ea-91c6-98fe957e3c43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:59.459681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7da20ff9-2aba-47ea-91c6-98fe957e3c43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.460119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7da20ff9-2aba-47ea-91c6-98fe957e3c43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.461117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7da20ff9-2aba-47ea-91c6-98fe957e3c43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.461544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7da20ff9-2aba-47ea-91c6-98fe957e3c43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.549464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7da20ff9-2aba-47ea-91c6-98fe957e3c43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.564636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7da20ff9-2aba-47ea-91c6-98fe957e3c43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.566430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7da20ff9-2aba-47ea-91c6-98fe957e3c43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.567628 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7da20ff9-2aba-47ea-91c6-98fe957e3c43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.121379 Jul 20 04:17:59.568207 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 932/2024] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:59 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:59.642601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b28377e9-4f6b-47b8-ae3b-c418d45b651d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:59.643467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b28377e9-4f6b-47b8-ae3b-c418d45b651d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:59.650151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b28377e9-4f6b-47b8-ae3b-c418d45b651d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.650682 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b28377e9-4f6b-47b8-ae3b-c418d45b651d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.651669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b28377e9-4f6b-47b8-ae3b-c418d45b651d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.652305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b28377e9-4f6b-47b8-ae3b-c418d45b651d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.655355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:59.823784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b28377e9-4f6b-47b8-ae3b-c418d45b651d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.834462 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b28377e9-4f6b-47b8-ae3b-c418d45b651d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1389 microversion: 2.1 time: 0.195279 Jul 20 04:17:59.849439 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 933/2025] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:59 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1389 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:59.863570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-576d16b4-0af7-4e16-bafb-5ec5637c20d3 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:59.864331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-576d16b4-0af7-4e16-bafb-5ec5637c20d3 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:59.871640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-576d16b4-0af7-4e16-bafb-5ec5637c20d3 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.872297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-576d16b4-0af7-4e16-bafb-5ec5637c20d3 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.873539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-576d16b4-0af7-4e16-bafb-5ec5637c20d3 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.873780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-576d16b4-0af7-4e16-bafb-5ec5637c20d3 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.202168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-576d16b4-0af7-4e16-bafb-5ec5637c20d3 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.212493 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-576d16b4-0af7-4e16-bafb-5ec5637c20d3 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 200 len: 1318 microversion: 2.1 time: 0.353700 Jul 20 04:18:00.226206 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 934/2026] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:59 2022] GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:00.239211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-37c4abd5-16c2-43cb-857a-cafbe0897fa7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:00.240591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-37c4abd5-16c2-43cb-857a-cafbe0897fa7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] [instance: ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:00.258403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37c4abd5-16c2-43cb-857a-cafbe0897fa7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.258772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37c4abd5-16c2-43cb-857a-cafbe0897fa7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.259556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37c4abd5-16c2-43cb-857a-cafbe0897fa7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.259990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37c4abd5-16c2-43cb-857a-cafbe0897fa7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.303014 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-37c4abd5-16c2-43cb-857a-cafbe0897fa7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] HTTP exception thrown: Instance ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a could not be found. Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-37c4abd5-16c2-43cb-857a-cafbe0897fa7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Request method failure captured: Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a HTTP/1.1 Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14ALEpS8cLFwrWGrP2QWc6ENbBeQxhTSZrCMB4J-aiWbIB1DcF5qsJhQO_fS3PT3NzooKQpZlA-XJW7ILwnbQGTJCAxxmlsPvEnem5bZawLFEGTJVax5f9UvzTQ2J2dI4LC2UBTpQtVDHBHmByN6irkSPk6c_cmOrMQPvRZJYv9WSV0 Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 8d4037629b9e4e6fa92e2a8d89cf0311 Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1255805509 Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:18:00.305154 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:18:00.306585 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d4037629b9e4e6fa92e2a8d89cf0311"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8d4037629b9e4e6fa92e2a8d89cf0311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8d4037629b9e4e6fa92e2a8d89cf0311", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d4037629b9e4e6fa92e2a8d89cf0311"}]}] Jul 20 04:18:00.306585 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1255805509 Jul 20 04:18:00.306585 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 8d4037629b9e4e6fa92e2a8d89cf0311 Jul 20 04:18:00.306585 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1255805509 Jul 20 04:18:00.306585 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-LiveAutoBlockMigrationV225Test-1255805509-project Jul 20 04:18:00.306585 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:18:00.306585 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:18:00.306585 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 45a9bfefde81473d88610b03e0de9bf4 Jul 20 04:18:00.306585 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1255805509-project Jul 20 04:18:00.306585 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:18:00.306585 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a could not be found. Jul 20 04:18:00.306585 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a'} Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a could not be found. Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:00.307393 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:00.308646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:00.308646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:00.308646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:00.308646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:00.308646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:00.308646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:00.308646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:00.308646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a could not be found. Jul 20 04:18:00.308646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:00.308646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:00.308646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:00.308646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:00.308646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:00.308646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:00.308646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:00.308646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:00.308646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a could not be found. Jul 20 04:18:00.308646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:00.310697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-37c4abd5-16c2-43cb-857a-cafbe0897fa7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] Returning 404 to user: Instance ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:00.311710 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-37c4abd5-16c2-43cb-857a-cafbe0897fa7 tempest-LiveAutoBlockMigrationV225Test-1255805509 tempest-LiveAutoBlockMigrationV225Test-1255805509-project] 10.222.0.17 "GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a" status: 404 len: 111 microversion: 2.25 time: 0.084551 Jul 20 04:18:00.312748 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 935/2027] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:00 2022] GET /compute/v2.1/servers/ad85c63c-6e7d-47cd-bc59-bfbe8be25a5a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:18:00.321201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f8a960f2-084c-4b18-8d6f-370837e7eb6e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bdde91f0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:00.328250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-3f48abc8-df08-4568-8542-c59c4bc13787 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Building network info cache for instance {{(pid=127871) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:18:00.392770 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f8a960f2-084c-4b18-8d6f-370837e7eb6e tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.078703 Jul 20 04:18:00.393843 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 936/2028] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:00 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:00.404794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-196cf5ad-bab6-45d7-8f33-32db433c8651 req-c1ccc510-8127-43a1-aaf8-037a0f9f6b49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f", "tag": "5fe4d090-78b8-44a5-99b6-9391f731a824"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:00.422455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-196cf5ad-bab6-45d7-8f33-32db433c8651 req-c1ccc510-8127-43a1-aaf8-037a0f9f6b49 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.425501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-196cf5ad-bab6-45d7-8f33-32db433c8651 req-c1ccc510-8127-43a1-aaf8-037a0f9f6b49 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.453441 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-196cf5ad-bab6-45d7-8f33-32db433c8651 req-c1ccc510-8127-43a1-aaf8-037a0f9f6b49 service nova] Creating event network-changed:5fe4d090-78b8-44a5-99b6-9391f731a824 for instance 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f on n-h1-826526-5 Jul 20 04:18:00.463201 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-196cf5ad-bab6-45d7-8f33-32db433c8651 req-c1ccc510-8127-43a1-aaf8-037a0f9f6b49 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068234 Jul 20 04:18:00.467496 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 937/2029] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:00.592427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-39842530-1bde-4335-8213-d8a15d4267cd tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:00.593510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-39842530-1bde-4335-8213-d8a15d4267cd tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:00.601928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39842530-1bde-4335-8213-d8a15d4267cd tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.603435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39842530-1bde-4335-8213-d8a15d4267cd tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.604561 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39842530-1bde-4335-8213-d8a15d4267cd tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.605398 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39842530-1bde-4335-8213-d8a15d4267cd tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.736223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-39842530-1bde-4335-8213-d8a15d4267cd tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.757936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-39842530-1bde-4335-8213-d8a15d4267cd tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.764390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-39842530-1bde-4335-8213-d8a15d4267cd tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.765681 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-39842530-1bde-4335-8213-d8a15d4267cd tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.178572 Jul 20 04:18:00.776806 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 938/2030] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:00 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:00.855489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-93b042d2-5411-402f-a05b-28b5925e0bd4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:00.856170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-93b042d2-5411-402f-a05b-28b5925e0bd4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:00.865861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93b042d2-5411-402f-a05b-28b5925e0bd4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.866319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93b042d2-5411-402f-a05b-28b5925e0bd4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.867120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93b042d2-5411-402f-a05b-28b5925e0bd4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.867579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93b042d2-5411-402f-a05b-28b5925e0bd4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.164809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-93b042d2-5411-402f-a05b-28b5925e0bd4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:01.179554 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-93b042d2-5411-402f-a05b-28b5925e0bd4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1184 microversion: 2.1 time: 0.328166 Jul 20 04:18:01.182703 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 939/2031] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:00 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1184 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:01.229693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-50facd5c-44e3-44b6-b0ea-4800ea1d28ef tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:01.230467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-50facd5c-44e3-44b6-b0ea-4800ea1d28ef tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:01.246269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50facd5c-44e3-44b6-b0ea-4800ea1d28ef tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.247773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50facd5c-44e3-44b6-b0ea-4800ea1d28ef tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.252080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50facd5c-44e3-44b6-b0ea-4800ea1d28ef tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.253560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50facd5c-44e3-44b6-b0ea-4800ea1d28ef tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.878573 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-50facd5c-44e3-44b6-b0ea-4800ea1d28ef tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:01.887480 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-50facd5c-44e3-44b6-b0ea-4800ea1d28ef tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 200 len: 1318 microversion: 2.1 time: 0.661903 Jul 20 04:18:01.910740 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 940/2032] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:01 2022] GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 1318 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:01.931275 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9ffc2738-174c-483a-b658-3eb03e26a810 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bde0b3a0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:02.059921 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9ffc2738-174c-483a-b658-3eb03e26a810 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.147260 Jul 20 04:18:02.073412 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 941/2033] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:01 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:02.109633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-80ce65c0-a412-461c-b2e6-c5e371d005df tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:02.109633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-80ce65c0-a412-461c-b2e6-c5e371d005df tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:02.153247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80ce65c0-a412-461c-b2e6-c5e371d005df tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.153757 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80ce65c0-a412-461c-b2e6-c5e371d005df tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.156357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80ce65c0-a412-461c-b2e6-c5e371d005df tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.158502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80ce65c0-a412-461c-b2e6-c5e371d005df tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.361068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-80ce65c0-a412-461c-b2e6-c5e371d005df tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:02.383816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-80ce65c0-a412-461c-b2e6-c5e371d005df tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:02.387285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-80ce65c0-a412-461c-b2e6-c5e371d005df tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:02.389600 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-80ce65c0-a412-461c-b2e6-c5e371d005df tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.314914 Jul 20 04:18:02.393316 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 942/2034] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:02 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:02.413270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e608fe96-e5f3-4b4e-8fbc-3510b466537b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:02.418448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e608fe96-e5f3-4b4e-8fbc-3510b466537b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:02.431042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e608fe96-e5f3-4b4e-8fbc-3510b466537b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.434461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e608fe96-e5f3-4b4e-8fbc-3510b466537b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.437639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e608fe96-e5f3-4b4e-8fbc-3510b466537b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.438281 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e608fe96-e5f3-4b4e-8fbc-3510b466537b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.609374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e608fe96-e5f3-4b4e-8fbc-3510b466537b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:02.622136 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e608fe96-e5f3-4b4e-8fbc-3510b466537b tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1184 microversion: 2.1 time: 0.212780 Jul 20 04:18:02.622741 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 943/2035] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:02 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1184 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:02.906289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0f8234ed-e9f1-4e49-9b9c-60121d53d221 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:02.907745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0f8234ed-e9f1-4e49-9b9c-60121d53d221 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:02.922582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f8234ed-e9f1-4e49-9b9c-60121d53d221 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.928221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f8234ed-e9f1-4e49-9b9c-60121d53d221 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.932530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f8234ed-e9f1-4e49-9b9c-60121d53d221 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.933798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f8234ed-e9f1-4e49-9b9c-60121d53d221 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.532691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0f8234ed-e9f1-4e49-9b9c-60121d53d221 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.541983 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0f8234ed-e9f1-4e49-9b9c-60121d53d221 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 200 len: 1318 microversion: 2.1 time: 0.640078 Jul 20 04:18:03.545369 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 944/2036] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:02 2022] GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:03.558018 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fccfe681-af03-4911-bb21-8c8ccef91abd tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bdde5c10>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:03.688320 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fccfe681-af03-4911-bb21-8c8ccef91abd tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.141264 Jul 20 04:18:03.694351 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 945/2037] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:03 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:03.702552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-c8633816-0398-4b66-bda4-e57d9d990d5c req-f32d9fa2-e5e1-4e67-8d94-1b5acb5c00e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b62c758-d90d-48b5-903f-7553734f4cfe", "name": "network-vif-deleted", "tag": "be0fb241-a959-4d10-85fb-6ddb8e17edb2"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:03.742686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c8633816-0398-4b66-bda4-e57d9d990d5c req-f32d9fa2-e5e1-4e67-8d94-1b5acb5c00e1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.743778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c8633816-0398-4b66-bda4-e57d9d990d5c req-f32d9fa2-e5e1-4e67-8d94-1b5acb5c00e1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.773054 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-c8633816-0398-4b66-bda4-e57d9d990d5c req-f32d9fa2-e5e1-4e67-8d94-1b5acb5c00e1 service nova] Creating event network-vif-deleted:be0fb241-a959-4d10-85fb-6ddb8e17edb2 for instance 7b62c758-d90d-48b5-903f-7553734f4cfe on n-h2-826526-5 Jul 20 04:18:03.788045 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-c8633816-0398-4b66-bda4-e57d9d990d5c req-f32d9fa2-e5e1-4e67-8d94-1b5acb5c00e1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088933 Jul 20 04:18:03.788899 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 946/2038] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:03.809020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-df0a1416-bf0c-471f-a8c5-bca08f8151ef tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:03.811040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-df0a1416-bf0c-471f-a8c5-bca08f8151ef tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:03.834644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df0a1416-bf0c-471f-a8c5-bca08f8151ef tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.835267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df0a1416-bf0c-471f-a8c5-bca08f8151ef tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.841673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df0a1416-bf0c-471f-a8c5-bca08f8151ef tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.843068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df0a1416-bf0c-471f-a8c5-bca08f8151ef tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.052604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-df0a1416-bf0c-471f-a8c5-bca08f8151ef tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.062217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-df0a1416-bf0c-471f-a8c5-bca08f8151ef tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.067657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-df0a1416-bf0c-471f-a8c5-bca08f8151ef tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.071076 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-df0a1416-bf0c-471f-a8c5-bca08f8151ef tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.277839 Jul 20 04:18:04.071076 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 947/2039] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:03 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:04.094372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-053b41e6-1032-4378-acb9-5dcb7fde45f6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:04.095008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-053b41e6-1032-4378-acb9-5dcb7fde45f6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:04.108201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-053b41e6-1032-4378-acb9-5dcb7fde45f6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.120612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-053b41e6-1032-4378-acb9-5dcb7fde45f6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.121591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-053b41e6-1032-4378-acb9-5dcb7fde45f6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.122054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-053b41e6-1032-4378-acb9-5dcb7fde45f6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.249035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-053b41e6-1032-4378-acb9-5dcb7fde45f6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.258242 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-053b41e6-1032-4378-acb9-5dcb7fde45f6 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1184 microversion: 2.1 time: 0.169450 Jul 20 04:18:04.259050 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 948/2040] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:04 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1184 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:04.561729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-504d45fc-8dd6-4f8e-b739-f47212692fb2 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:04.562340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-504d45fc-8dd6-4f8e-b739-f47212692fb2 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:04.582709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-504d45fc-8dd6-4f8e-b739-f47212692fb2 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.583266 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-504d45fc-8dd6-4f8e-b739-f47212692fb2 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.584183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-504d45fc-8dd6-4f8e-b739-f47212692fb2 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.584744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-504d45fc-8dd6-4f8e-b739-f47212692fb2 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.863259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-3f48abc8-df08-4568-8542-c59c4bc13787 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Updating instance_info_cache with network_info: [{"id": "5fe4d090-78b8-44a5-99b6-9391f731a824", "address": "fa:16:3e:a7:31:41", "network": {"id": "80c07577-b101-4f4f-b656-c3a34d626764", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-806748749-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "023236fb56b14d0a9e5ae4dd6120162a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5fe4d090-78", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127871) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:18:04.872909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f48abc8-df08-4568-8542-c59c4bc13787 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Releasing lock "refresh_cache-2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" {{(pid=127871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:18:04.873775 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3f48abc8-df08-4568-8542-c59c4bc13787 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "POST /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f/action" status: 202 len: 0 microversion: 2.1 time: 7.405217 Jul 20 04:18:04.891053 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1093/2041] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:57 2022] POST /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f/action => generated 0 bytes in 7423 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:18:04.899275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5e82c916-f666-4bec-a6dd-3eb5b6a24c44 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c73b9c10>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:05.061829 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5e82c916-f666-4bec-a6dd-3eb5b6a24c44 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.169603 Jul 20 04:18:05.062549 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1094/2042] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:04 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:05.075667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-89692ad1-71f2-48a1-ac8b-98cd337473ab tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Action: 'create', calling method: .version_select at 0x7f06c7430c10>, body: {"pool": "802b4524-5322-4d85-a63f-cab8cf79b0d6"} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:05.226812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-504d45fc-8dd6-4f8e-b739-f47212692fb2 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:05.240253 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-504d45fc-8dd6-4f8e-b739-f47212692fb2 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 200 len: 1318 microversion: 2.1 time: 0.681154 Jul 20 04:18:05.248947 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 949/2043] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:04 2022] GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 1318 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:05.260783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-87b4705a-534d-4f2f-a4f1-ff0b9d730b5d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:05.261567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-87b4705a-534d-4f2f-a4f1-ff0b9d730b5d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:05.279564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87b4705a-534d-4f2f-a4f1-ff0b9d730b5d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.280908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87b4705a-534d-4f2f-a4f1-ff0b9d730b5d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.285389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87b4705a-534d-4f2f-a4f1-ff0b9d730b5d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.286127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87b4705a-534d-4f2f-a4f1-ff0b9d730b5d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.455198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-87b4705a-534d-4f2f-a4f1-ff0b9d730b5d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:05.470026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-87b4705a-534d-4f2f-a4f1-ff0b9d730b5d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:05.477679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-87b4705a-534d-4f2f-a4f1-ff0b9d730b5d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:05.484999 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-87b4705a-534d-4f2f-a4f1-ff0b9d730b5d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.233995 Jul 20 04:18:05.486101 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 950/2044] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:05 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:05.491049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4e3b509e-3545-4c37-9be0-bcf7889929ed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:05.491930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4e3b509e-3545-4c37-9be0-bcf7889929ed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:05.502092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e3b509e-3545-4c37-9be0-bcf7889929ed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.502985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e3b509e-3545-4c37-9be0-bcf7889929ed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.504044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e3b509e-3545-4c37-9be0-bcf7889929ed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.505179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e3b509e-3545-4c37-9be0-bcf7889929ed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.684074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4e3b509e-3545-4c37-9be0-bcf7889929ed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:05.698598 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4e3b509e-3545-4c37-9be0-bcf7889929ed tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1184 microversion: 2.1 time: 0.211190 Jul 20 04:18:05.714026 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 951/2045] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:05 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1184 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:05.768103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-15282bb0-bb95-4843-9961-ab3c5d74904d req-4a908fc3-bbe8-4c6c-bafd-76db53838d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1320f3fe-788f-4ebe-ad01-67e9201ac630", "name": "network-vif-plugged", "status": "completed", "tag": "a075a139-e1e3-4aba-a6b3-d51472d32eaa"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:05.801977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-15282bb0-bb95-4843-9961-ab3c5d74904d req-4a908fc3-bbe8-4c6c-bafd-76db53838d46 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.804730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-15282bb0-bb95-4843-9961-ab3c5d74904d req-4a908fc3-bbe8-4c6c-bafd-76db53838d46 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.864843 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-15282bb0-bb95-4843-9961-ab3c5d74904d req-4a908fc3-bbe8-4c6c-bafd-76db53838d46 service nova] Creating event network-vif-plugged:a075a139-e1e3-4aba-a6b3-d51472d32eaa for instance 1320f3fe-788f-4ebe-ad01-67e9201ac630 on n-h2-826526-5 Jul 20 04:18:05.883428 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-15282bb0-bb95-4843-9961-ab3c5d74904d req-4a908fc3-bbe8-4c6c-bafd-76db53838d46 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133247 Jul 20 04:18:05.884705 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 952/2046] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:06.076210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a8173d31-ce57-4bde-8f30-23509736acd6 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bdb91af0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:06.154936 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a8173d31-ce57-4bde-8f30-23509736acd6 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.083411 Jul 20 04:18:06.155569 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 953/2047] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:06 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:06.269445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d7b81c5b-c07f-4527-a31f-5b6e91966a3c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:06.270975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d7b81c5b-c07f-4527-a31f-5b6e91966a3c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:06.288322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7b81c5b-c07f-4527-a31f-5b6e91966a3c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.291732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7b81c5b-c07f-4527-a31f-5b6e91966a3c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.298361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7b81c5b-c07f-4527-a31f-5b6e91966a3c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.303121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7b81c5b-c07f-4527-a31f-5b6e91966a3c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.728096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d7b81c5b-c07f-4527-a31f-5b6e91966a3c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:06.777888 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d7b81c5b-c07f-4527-a31f-5b6e91966a3c tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 200 len: 1318 microversion: 2.1 time: 0.502554 Jul 20 04:18:06.780008 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 954/2048] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:06 2022] GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 1318 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:06.800008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d49539a7-8e6e-46c1-be2f-acdd59078b1f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:06.804370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d49539a7-8e6e-46c1-be2f-acdd59078b1f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:06.820115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d49539a7-8e6e-46c1-be2f-acdd59078b1f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.824600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d49539a7-8e6e-46c1-be2f-acdd59078b1f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.828368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d49539a7-8e6e-46c1-be2f-acdd59078b1f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.829084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d49539a7-8e6e-46c1-be2f-acdd59078b1f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.097644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d49539a7-8e6e-46c1-be2f-acdd59078b1f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.125652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d49539a7-8e6e-46c1-be2f-acdd59078b1f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.132982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d49539a7-8e6e-46c1-be2f-acdd59078b1f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.136686 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d49539a7-8e6e-46c1-be2f-acdd59078b1f tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.355290 Jul 20 04:18:07.137636 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 955/2049] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:06 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:07.157364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cfe0deac-ff13-465e-ac9c-2c4534bfa5d0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:07.158060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cfe0deac-ff13-465e-ac9c-2c4534bfa5d0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:07.172773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cfe0deac-ff13-465e-ac9c-2c4534bfa5d0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.173249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cfe0deac-ff13-465e-ac9c-2c4534bfa5d0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.174059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cfe0deac-ff13-465e-ac9c-2c4534bfa5d0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.177950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cfe0deac-ff13-465e-ac9c-2c4534bfa5d0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.209466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:07.297221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cfe0deac-ff13-465e-ac9c-2c4534bfa5d0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.308802 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cfe0deac-ff13-465e-ac9c-2c4534bfa5d0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1184 microversion: 2.1 time: 0.162517 Jul 20 04:18:07.309643 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 956/2050] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:07 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1184 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:07.331117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-068098d0-6e02-48f4-b2d2-8942bc1b5eab tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bdbab700>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:07.410041 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-068098d0-6e02-48f4-b2d2-8942bc1b5eab tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.087419 Jul 20 04:18:07.416151 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 957/2051] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:07 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:07.479425 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=20 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:07.799262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-95ff51db-847a-414e-b9fb-2854634ee5da tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:07.799965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-95ff51db-847a-414e-b9fb-2854634ee5da tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:07.825500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95ff51db-847a-414e-b9fb-2854634ee5da tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.825947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95ff51db-847a-414e-b9fb-2854634ee5da tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.826735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95ff51db-847a-414e-b9fb-2854634ee5da tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.827167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95ff51db-847a-414e-b9fb-2854634ee5da tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.343191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-95ff51db-847a-414e-b9fb-2854634ee5da tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.367163 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-95ff51db-847a-414e-b9fb-2854634ee5da tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 200 len: 1318 microversion: 2.1 time: 0.573828 Jul 20 04:18:08.369705 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 958/2052] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:07 2022] GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 1318 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:08.385070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-61b9f988-58c8-4167-a007-6c537107af62 req-cf9f1ba9-b8ef-493f-8aef-fa825e821344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a02cfafe-ca57-4211-bd4e-287672a73ea9", "name": "network-vif-plugged", "status": "completed", "tag": "e80289a8-2b86-4831-85b3-4562ecf108c7"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:08.423454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-61b9f988-58c8-4167-a007-6c537107af62 req-cf9f1ba9-b8ef-493f-8aef-fa825e821344 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.423908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-61b9f988-58c8-4167-a007-6c537107af62 req-cf9f1ba9-b8ef-493f-8aef-fa825e821344 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.468400 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-61b9f988-58c8-4167-a007-6c537107af62 req-cf9f1ba9-b8ef-493f-8aef-fa825e821344 service nova] Creating event network-vif-plugged:e80289a8-2b86-4831-85b3-4562ecf108c7 for instance a02cfafe-ca57-4211-bd4e-287672a73ea9 on n-h2-826526-5 Jul 20 04:18:08.480412 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-61b9f988-58c8-4167-a007-6c537107af62 req-cf9f1ba9-b8ef-493f-8aef-fa825e821344 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109143 Jul 20 04:18:08.486198 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 959/2053] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:08.506828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f158696e-bbfa-439c-a283-547206f2e8cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:08.510921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f158696e-bbfa-439c-a283-547206f2e8cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:08.536883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f158696e-bbfa-439c-a283-547206f2e8cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.539274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f158696e-bbfa-439c-a283-547206f2e8cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.555115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f158696e-bbfa-439c-a283-547206f2e8cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.556422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f158696e-bbfa-439c-a283-547206f2e8cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.772219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f158696e-bbfa-439c-a283-547206f2e8cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.799619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f158696e-bbfa-439c-a283-547206f2e8cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.813440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f158696e-bbfa-439c-a283-547206f2e8cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.820437 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f158696e-bbfa-439c-a283-547206f2e8cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.332286 Jul 20 04:18:08.822110 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 960/2054] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:08 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:08.835672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2c50a57a-7dc8-4e33-8473-13ca5786fcbe tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:08.836795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2c50a57a-7dc8-4e33-8473-13ca5786fcbe tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:08.852351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c50a57a-7dc8-4e33-8473-13ca5786fcbe tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.852351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c50a57a-7dc8-4e33-8473-13ca5786fcbe tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.853151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c50a57a-7dc8-4e33-8473-13ca5786fcbe tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.853572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c50a57a-7dc8-4e33-8473-13ca5786fcbe tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.195812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2c50a57a-7dc8-4e33-8473-13ca5786fcbe tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.208306 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2c50a57a-7dc8-4e33-8473-13ca5786fcbe tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1184 microversion: 2.1 time: 0.383937 Jul 20 04:18:09.224170 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 961/2055] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:08 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1184 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:09.245403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-11f7b64e-99a3-4542-8647-5ac901530dac tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bdbb73a0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:09.351791 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-11f7b64e-99a3-4542-8647-5ac901530dac tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.125459 Jul 20 04:18:09.353382 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 962/2056] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:09 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:09.388024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f1eb863e-6202-475e-86b9-b629da18133d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:09.389543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f1eb863e-6202-475e-86b9-b629da18133d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:09.420559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1eb863e-6202-475e-86b9-b629da18133d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.421778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1eb863e-6202-475e-86b9-b629da18133d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.422647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1eb863e-6202-475e-86b9-b629da18133d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.426414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1eb863e-6202-475e-86b9-b629da18133d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.218341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f1eb863e-6202-475e-86b9-b629da18133d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.227985 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f1eb863e-6202-475e-86b9-b629da18133d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 200 len: 1508 microversion: 2.1 time: 0.846664 Jul 20 04:18:10.228601 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 963/2057] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:09 2022] GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 1508 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:10.236674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b5bd5ea4-4d2e-4cbf-abe9-b1b05593f20b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:10.257032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b5bd5ea4-4d2e-4cbf-abe9-b1b05593f20b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:10.276466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b5bd5ea4-4d2e-4cbf-abe9-b1b05593f20b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.281409 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b5bd5ea4-4d2e-4cbf-abe9-b1b05593f20b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.285388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b5bd5ea4-4d2e-4cbf-abe9-b1b05593f20b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.287540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b5bd5ea4-4d2e-4cbf-abe9-b1b05593f20b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.433069 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-89692ad1-71f2-48a1-ac8b-98cd337473ab tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.369237 Jul 20 04:18:10.433684 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1095/2058] 10.222.0.17 () {60 vars in 1169 bytes} [Wed Jul 20 04:18:05 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:10.445943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-888dbcd5-2a87-49c3-8cc4-b524de2e5d46 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:10.446561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-888dbcd5-2a87-49c3-8cc4-b524de2e5d46 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:10.481193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-888dbcd5-2a87-49c3-8cc4-b524de2e5d46 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.481766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-888dbcd5-2a87-49c3-8cc4-b524de2e5d46 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.485825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-888dbcd5-2a87-49c3-8cc4-b524de2e5d46 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.486276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-888dbcd5-2a87-49c3-8cc4-b524de2e5d46 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.508987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b5bd5ea4-4d2e-4cbf-abe9-b1b05593f20b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.527418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b5bd5ea4-4d2e-4cbf-abe9-b1b05593f20b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.537134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b5bd5ea4-4d2e-4cbf-abe9-b1b05593f20b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.543322 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b5bd5ea4-4d2e-4cbf-abe9-b1b05593f20b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.306213 Jul 20 04:18:10.544983 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 964/2059] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:10 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:10.566726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-13e08db5-0591-4d28-93df-46f34b6a8024 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bdbab790>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:10.733523 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-13e08db5-0591-4d28-93df-46f34b6a8024 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.186643 Jul 20 04:18:10.740692 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 965/2060] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:10 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:10.763139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e66cbe52-f20e-4ff7-abe3-ce6a25d0a45b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.58"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:10.765933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e66cbe52-f20e-4ff7-abe3-ce6a25d0a45b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:10.775959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e66cbe52-f20e-4ff7-abe3-ce6a25d0a45b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.776627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e66cbe52-f20e-4ff7-abe3-ce6a25d0a45b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.777887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e66cbe52-f20e-4ff7-abe3-ce6a25d0a45b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.778502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e66cbe52-f20e-4ff7-abe3-ce6a25d0a45b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.894023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e66cbe52-f20e-4ff7-abe3-ce6a25d0a45b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Acquired lock "refresh_cache-2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" {{(pid=127870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:18:10.973380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-888dbcd5-2a87-49c3-8cc4-b524de2e5d46 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.990070 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-888dbcd5-2a87-49c3-8cc4-b524de2e5d46 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 200 len: 1184 microversion: 2.1 time: 0.549130 Jul 20 04:18:10.995480 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1096/2061] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:10 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 1184 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:11.570377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e9c0ada0-3b67-46b6-94fc-cbb75caf116d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:11.571050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e9c0ada0-3b67-46b6-94fc-cbb75caf116d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:11.593478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9c0ada0-3b67-46b6-94fc-cbb75caf116d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.599727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9c0ada0-3b67-46b6-94fc-cbb75caf116d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.604583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9c0ada0-3b67-46b6-94fc-cbb75caf116d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.605131 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9c0ada0-3b67-46b6-94fc-cbb75caf116d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.016254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e9c0ada0-3b67-46b6-94fc-cbb75caf116d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:12.081019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e9c0ada0-3b67-46b6-94fc-cbb75caf116d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:12.098722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e9c0ada0-3b67-46b6-94fc-cbb75caf116d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:12.100013 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e9c0ada0-3b67-46b6-94fc-cbb75caf116d tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.537770 Jul 20 04:18:12.100640 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1097/2062] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:11 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:12.110380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0cd7589b-692e-4c49-9418-f317ab9ab8ad tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c7327c10>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:12.242090 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0cd7589b-692e-4c49-9418-f317ab9ab8ad tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.138220 Jul 20 04:18:12.247848 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1098/2063] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:12 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:12.247848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b00af505-7df3-44c3-ad7c-bc2dc8a69b19 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:12.261067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b00af505-7df3-44c3-ad7c-bc2dc8a69b19 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 7b62c758-d90d-48b5-903f-7553734f4cfe] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:12.292930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b00af505-7df3-44c3-ad7c-bc2dc8a69b19 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.293613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b00af505-7df3-44c3-ad7c-bc2dc8a69b19 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.294551 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b00af505-7df3-44c3-ad7c-bc2dc8a69b19 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.295123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b00af505-7df3-44c3-ad7c-bc2dc8a69b19 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.320904 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-b00af505-7df3-44c3-ad7c-bc2dc8a69b19 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] HTTP exception thrown: Instance 7b62c758-d90d-48b5-903f-7553734f4cfe could not be found. Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b00af505-7df3-44c3-ad7c-bc2dc8a69b19 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Request method failure captured: Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe HTTP/1.1 Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14A4ikgrSQW1K5pUSo73dThwRYzu2k9_sjeIqs5ovqlB9_4Zy1V7mYGO_GAlHyzvWmfmnH6ciVgRFLkV9P-fgNmw14JRJJYYnkiLDNPhuDFTllBCcQ7IG9-ZMcY0uyxCGjO5TRMUrrjM17zCBUYSr2zwdJAF7qrFHwfrKEoAiftIqEk Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 6295769a840d437c9deed641966fd143 Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-LiveMigrationTest-684935058 Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:18:12.324058 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:18:12.325415 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6295769a840d437c9deed641966fd143"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6295769a840d437c9deed641966fd143"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6295769a840d437c9deed641966fd143", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6295769a840d437c9deed641966fd143"}]}] Jul 20 04:18:12.325415 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-LiveMigrationTest-684935058 Jul 20 04:18:12.325415 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 6295769a840d437c9deed641966fd143 Jul 20 04:18:12.325415 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-LiveMigrationTest-684935058 Jul 20 04:18:12.325415 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-LiveMigrationTest-684935058-project Jul 20 04:18:12.325415 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:18:12.325415 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:18:12.325415 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 106afc4bcfc04122b9afb3cc2b17cc03 Jul 20 04:18:12.325415 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-LiveMigrationTest-684935058-project Jul 20 04:18:12.325415 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:18:12.325415 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 7b62c758-d90d-48b5-903f-7553734f4cfe could not be found. Jul 20 04:18:12.325415 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '7b62c758-d90d-48b5-903f-7553734f4cfe'} Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b62c758-d90d-48b5-903f-7553734f4cfe could not be found. Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:12.326161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:12.327398 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:12.327398 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:12.327398 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:12.327398 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:12.327398 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:12.327398 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:12.327398 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:12.327398 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b62c758-d90d-48b5-903f-7553734f4cfe could not be found. Jul 20 04:18:12.327398 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:12.327398 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:12.327398 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:12.327398 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:12.327398 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:12.327398 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:12.327398 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:12.327398 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:12.327398 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b62c758-d90d-48b5-903f-7553734f4cfe could not be found. Jul 20 04:18:12.327398 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:12.330472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b00af505-7df3-44c3-ad7c-bc2dc8a69b19 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Returning 404 to user: Instance 7b62c758-d90d-48b5-903f-7553734f4cfe could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:12.332703 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b00af505-7df3-44c3-ad7c-bc2dc8a69b19 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe" status: 404 len: 111 microversion: 2.1 time: 0.087965 Jul 20 04:18:12.333489 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1099/2064] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:12 2022] GET /compute/v2.1/servers/7b62c758-d90d-48b5-903f-7553734f4cfe => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:13.121405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1993f53d-784a-4314-892f-72abee4197a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:13.122160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1993f53d-784a-4314-892f-72abee4197a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:13.131605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1993f53d-784a-4314-892f-72abee4197a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.132059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1993f53d-784a-4314-892f-72abee4197a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.133021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1993f53d-784a-4314-892f-72abee4197a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.133460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1993f53d-784a-4314-892f-72abee4197a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.673468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1993f53d-784a-4314-892f-72abee4197a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.688821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1993f53d-784a-4314-892f-72abee4197a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.696637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1993f53d-784a-4314-892f-72abee4197a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.697872 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1993f53d-784a-4314-892f-72abee4197a8 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.580635 Jul 20 04:18:13.701399 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1100/2065] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:13 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:13.712926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b7fc7266-50c8-4b4b-914b-f7e386a8c8c2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c74155e0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:13.808313 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b7fc7266-50c8-4b4b-914b-f7e386a8c8c2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.105190 Jul 20 04:18:13.808961 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1101/2066] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:13 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:14.470289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0b6557a4-060a-4413-b0d1-3b1f2b84584e tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "52ffdcfc-ba23-41c5-add4-bc65e06b293d"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:14.473413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0b6557a4-060a-4413-b0d1-3b1f2b84584e tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:14.490632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b6557a4-060a-4413-b0d1-3b1f2b84584e tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.491765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b6557a4-060a-4413-b0d1-3b1f2b84584e tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.495876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b6557a4-060a-4413-b0d1-3b1f2b84584e tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.496595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b6557a4-060a-4413-b0d1-3b1f2b84584e tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.559391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG neutronclient.v2_0.client [None req-e66cbe52-f20e-4ff7-abe3-ce6a25d0a45b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.58 (a9eb27db-3535-418d-97b5-00fcd5082092) with port 5fe4d090-78b8-44a5-99b6-9391f731a824 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 802b4524-5322-4d85-a63f-cab8cf79b0d6.", "detail": ""}} {{(pid=127870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:18:14.560193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e66cbe52-f20e-4ff7-abe3-ce6a25d0a45b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Releasing lock "refresh_cache-2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" {{(pid=127870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:18:14.560683 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-e66cbe52-f20e-4ff7-abe3-ce6a25d0a45b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.58 (a9eb27db-3535-418d-97b5-00fcd5082092) with port 5fe4d090-78b8-44a5-99b6-9391f731a824 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 802b4524-5322-4d85-a63f-cab8cf79b0d6. Jul 20 04:18:14.560683 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-da2d5751-ae65-4aa9-af0f-7c2973a27c23'] Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e66cbe52-f20e-4ff7-abe3-ce6a25d0a45b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Request method failure captured: Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f/action HTTP/1.1 Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 45 Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14HZ1izt9DFIckUkHMOv3p3ULpa4J0MQbGcqLd1LTSgPcDU4v5FF7fy7VcRe5LpHx6wq46V4OUbFtqfIBSTXo-nrD8XQ1C0bC-F6M_CDonFH1HvKGQ6LC0TOeYvg0PHgPIORiv-3uxsMhQtoJmDPSGUhZ71lgziK53pGMnLpCItR13w Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 023236fb56b14d0a9e5ae4dd6120162a Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:18:14.563176 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:18:14.564385 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/023236fb56b14d0a9e5ae4dd6120162a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/023236fb56b14d0a9e5ae4dd6120162a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_023236fb56b14d0a9e5ae4dd6120162a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/023236fb56b14d0a9e5ae4dd6120162a"}]}] Jul 20 04:18:14.564385 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 Jul 20 04:18:14.564385 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 023236fb56b14d0a9e5ae4dd6120162a Jul 20 04:18:14.564385 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 Jul 20 04:18:14.564385 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project Jul 20 04:18:14.564385 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:18:14.564385 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:18:14.564385 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 20801c8e312044b38e1a758387877528 Jul 20 04:18:14.564385 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project Jul 20 04:18:14.564385 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:18:14.564385 n-d-826526-5 devstack@n-api.service[127870]: {"addFloatingIp": {"address": "172.25.2.58"}} Jul 20 04:18:14.564385 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:18:14.565129 n-d-826526-5 devstack@n-api.service[127870]: exception: Cannot associate floating IP 172.25.2.58 (a9eb27db-3535-418d-97b5-00fcd5082092) with port 5fe4d090-78b8-44a5-99b6-9391f731a824 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 802b4524-5322-4d85-a63f-cab8cf79b0d6. Jul 20 04:18:14.565129 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-da2d5751-ae65-4aa9-af0f-7c2973a27c23'] Jul 20 04:18:14.565129 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f', 'body': {'addFloatingIp': {'address': '172.25.2.58'}}} Jul 20 04:18:14.565129 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:14.565129 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:14.565129 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 20 04:18:14.565129 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 20 04:18:14.565129 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:14.565129 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:14.565129 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 20 04:18:14.565129 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 20 04:18:14.565129 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:14.565129 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:14.565129 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 20 04:18:14.565129 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 20 04:18:14.565129 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:14.565129 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:14.568990 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 20 04:18:14.568990 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 20 04:18:14.568990 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:14.568990 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:14.568990 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:18:14.568990 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:18:14.568990 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:14.568990 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:14.568990 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:18:14.568990 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:18:14.568990 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:14.568990 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:14.568990 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:18:14.568990 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:18:14.568990 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:18:14.568990 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:18:14.569918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.58 (a9eb27db-3535-418d-97b5-00fcd5082092) with port 5fe4d090-78b8-44a5-99b6-9391f731a824 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 802b4524-5322-4d85-a63f-cab8cf79b0d6. Jul 20 04:18:14.569918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da2d5751-ae65-4aa9-af0f-7c2973a27c23'] Jul 20 04:18:14.569918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.569918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:14.569918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.569918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:14.569918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 20 04:18:14.569918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 20 04:18:14.569918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 20 04:18:14.569918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 20 04:18:14.569918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 20 04:18:14.569918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 20 04:18:14.569918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.58 (a9eb27db-3535-418d-97b5-00fcd5082092) with port 5fe4d090-78b8-44a5-99b6-9391f731a824 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 802b4524-5322-4d85-a63f-cab8cf79b0d6. Jul 20 04:18:14.569918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da2d5751-ae65-4aa9-af0f-7c2973a27c23'] Jul 20 04:18:14.569918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.569918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:14.570748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.570748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:14.570748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:14.570748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:14.570748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:14.570748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:14.570748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:18:14.570748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:18:14.570748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:14.570748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:14.570748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:18:14.570748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:18:14.570748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 20 04:18:14.570748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:18:14.570748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.58 (a9eb27db-3535-418d-97b5-00fcd5082092) with port 5fe4d090-78b8-44a5-99b6-9391f731a824 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 802b4524-5322-4d85-a63f-cab8cf79b0d6. Jul 20 04:18:14.570748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da2d5751-ae65-4aa9-af0f-7c2973a27c23'] Jul 20 04:18:14.570748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.570748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:14.571661 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.571661 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:14.571661 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:14.571661 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:14.571661 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:14.571661 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:14.571661 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.58 (a9eb27db-3535-418d-97b5-00fcd5082092) with port 5fe4d090-78b8-44a5-99b6-9391f731a824 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 802b4524-5322-4d85-a63f-cab8cf79b0d6. Jul 20 04:18:14.571661 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da2d5751-ae65-4aa9-af0f-7c2973a27c23'] Jul 20 04:18:14.571661 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.571661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e66cbe52-f20e-4ff7-abe3-ce6a25d0a45b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Returning 400 to user: Cannot associate floating IP 172.25.2.58 (a9eb27db-3535-418d-97b5-00fcd5082092) with port 5fe4d090-78b8-44a5-99b6-9391f731a824 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 802b4524-5322-4d85-a63f-cab8cf79b0d6. Jul 20 04:18:14.571661 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-da2d5751-ae65-4aa9-af0f-7c2973a27c23'] {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:14.572314 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e66cbe52-f20e-4ff7-abe3-ce6a25d0a45b tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "POST /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f/action" status: 400 len: 381 microversion: 2.1 time: 3.822697 Jul 20 04:18:14.572314 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 966/2067] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:18:10 2022] POST /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f/action => generated 381 bytes in 3824 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:18:14.584375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e85a6d76-f4e9-4f81-9163-a47a2c1caf6d tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '.version_select at 0x7f06bec1f700>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:14.639008 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-0b6557a4-060a-4413-b0d1-3b1f2b84584e tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] HTTP exception thrown: Volume ad1c808c-ae8a-4e53-90e2-3bc85a3c3b78 could not be found. Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0b6557a4-060a-4413-b0d1-3b1f2b84584e tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] Request method failure captured: Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: request: PUT /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630/os-volume_attachments/ad1c808c-ae8a-4e53-90e2-3bc85a3c3b78 HTTP/1.1 Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 74 Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14GAufyNS9JNTcio_BIyTV3aydBIM92jOEmFb3np1bwu9f4lkJDkXe1T4PXvU4z3O_jtWFRAfXwTvlO1-jzKe3MnyB9FrBCsmkO1maGDy2p8MV2KBmITlHLMR-HuHcz1badlKeNE3IXbNE3mYt6vKWzyi1ZK7aszBU4spV_gnFxjkKY Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 02b439f74bf04bc6bb23f1cde4d3d8c8 Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-VolumesAdminNegativeTest-530099437 Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:18:14.641170 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:18:14.642300 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/02b439f74bf04bc6bb23f1cde4d3d8c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/02b439f74bf04bc6bb23f1cde4d3d8c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_02b439f74bf04bc6bb23f1cde4d3d8c8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/02b439f74bf04bc6bb23f1cde4d3d8c8"}]}] Jul 20 04:18:14.642300 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-VolumesAdminNegativeTest-530099437 Jul 20 04:18:14.642300 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 02b439f74bf04bc6bb23f1cde4d3d8c8 Jul 20 04:18:14.642300 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-530099437 Jul 20 04:18:14.642300 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-VolumesAdminNegativeTest-530099437-project-admin Jul 20 04:18:14.642300 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:18:14.642300 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:18:14.642300 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c44504c9ae454e3292314fd8891697d0 Jul 20 04:18:14.642300 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-VolumesAdminNegativeTest-530099437-project-admin Jul 20 04:18:14.642300 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:18:14.642300 n-d-826526-5 devstack@n-api.service[127871]: {"volumeAttachment": {"volumeId": "52ffdcfc-ba23-41c5-add4-bc65e06b293d"}} Jul 20 04:18:14.642300 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:18:14.642300 n-d-826526-5 devstack@n-api.service[127871]: exception: Volume ad1c808c-ae8a-4e53-90e2-3bc85a3c3b78 could not be found. Jul 20 04:18:14.642986 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'server_id': '1320f3fe-788f-4ebe-ad01-67e9201ac630', 'id': 'ad1c808c-ae8a-4e53-90e2-3bc85a3c3b78', 'body': {'volumeAttachment': {'volumeId': '52ffdcfc-ba23-41c5-add4-bc65e06b293d'}}} Jul 20 04:18:14.642986 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:14.642986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:14.642986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:18:14.642986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:18:14.642986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:18:14.642986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:18:14.642986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:18:14.642986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:18:14.642986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:18:14.642986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:18:14.642986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:18:14.642986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:18:14.642986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:18:14.642986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:18:14.642986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:18:14.642986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad1c808c-ae8a-4e53-90e2-3bc85a3c3b78 could not be found. (HTTP 404) (Request-ID: req-3f6e2b49-c6c0-44f6-ae24-75451e086498) Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:18:14.643982 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad1c808c-ae8a-4e53-90e2-3bc85a3c3b78 could not be found. Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:14.645077 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad1c808c-ae8a-4e53-90e2-3bc85a3c3b78 could not be found. Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad1c808c-ae8a-4e53-90e2-3bc85a3c3b78 could not be found. Jul 20 04:18:14.645986 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.646939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0b6557a4-060a-4413-b0d1-3b1f2b84584e tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] Returning 404 to user: Volume ad1c808c-ae8a-4e53-90e2-3bc85a3c3b78 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:14.646939 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0b6557a4-060a-4413-b0d1-3b1f2b84584e tempest-VolumesAdminNegativeTest-530099437 tempest-VolumesAdminNegativeTest-530099437-project-admin] 10.222.0.17 "PUT /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630/os-volume_attachments/ad1c808c-ae8a-4e53-90e2-3bc85a3c3b78" status: 404 len: 109 microversion: 2.1 time: 0.176961 Jul 20 04:18:14.646939 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1102/2068] 10.222.0.17 () {60 vars in 1432 bytes} [Wed Jul 20 04:18:14 2022] PUT /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630/os-volume_attachments/ad1c808c-ae8a-4e53-90e2-3bc85a3c3b78 => generated 109 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:14.717303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a4bd6508-a677-4e77-8478-b18adcebde20 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:14.718502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a4bd6508-a677-4e77-8478-b18adcebde20 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:14.733158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a4bd6508-a677-4e77-8478-b18adcebde20 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.733619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a4bd6508-a677-4e77-8478-b18adcebde20 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.734495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a4bd6508-a677-4e77-8478-b18adcebde20 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.734981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a4bd6508-a677-4e77-8478-b18adcebde20 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.001723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a4bd6508-a677-4e77-8478-b18adcebde20 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.012958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a4bd6508-a677-4e77-8478-b18adcebde20 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.024474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a4bd6508-a677-4e77-8478-b18adcebde20 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.025885 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a4bd6508-a677-4e77-8478-b18adcebde20 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.312530 Jul 20 04:18:15.027127 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1103/2069] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:14 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:15.049676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8aefc2c0-ef93-4fcc-a807-58e30eda4a9d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c7415940>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:15.254111 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8aefc2c0-ef93-4fcc-a807-58e30eda4a9d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.225322 Jul 20 04:18:15.256098 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1104/2070] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:15 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:16.048076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6dedfa2f-4001-4b6b-a4f3-6fd11312cee2 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:16.049421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6dedfa2f-4001-4b6b-a4f3-6fd11312cee2 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:16.090469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6dedfa2f-4001-4b6b-a4f3-6fd11312cee2 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.090941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6dedfa2f-4001-4b6b-a4f3-6fd11312cee2 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.101875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6dedfa2f-4001-4b6b-a4f3-6fd11312cee2 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.102373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6dedfa2f-4001-4b6b-a4f3-6fd11312cee2 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.418994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6dedfa2f-4001-4b6b-a4f3-6fd11312cee2 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:16.452512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6dedfa2f-4001-4b6b-a4f3-6fd11312cee2 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:16.462070 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6dedfa2f-4001-4b6b-a4f3-6fd11312cee2 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:16.466352 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6dedfa2f-4001-4b6b-a4f3-6fd11312cee2 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.424487 Jul 20 04:18:16.468329 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1105/2071] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:16 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:16.489942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-03f0fbad-2816-4554-a2f9-3a1ba2ab9ee4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c7357c10>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:16.607481 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-03f0fbad-2816-4554-a2f9-3a1ba2ab9ee4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.133717 Jul 20 04:18:16.609087 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1106/2072] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:16 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:17.487522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-44f1cacc-8aab-4518-934e-5ac7983b2b2b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:17.489671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-44f1cacc-8aab-4518-934e-5ac7983b2b2b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:17.504652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44f1cacc-8aab-4518-934e-5ac7983b2b2b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.505417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44f1cacc-8aab-4518-934e-5ac7983b2b2b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.506400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44f1cacc-8aab-4518-934e-5ac7983b2b2b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.506982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44f1cacc-8aab-4518-934e-5ac7983b2b2b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.803480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-44f1cacc-8aab-4518-934e-5ac7983b2b2b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:17.818580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-44f1cacc-8aab-4518-934e-5ac7983b2b2b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:17.820533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-44f1cacc-8aab-4518-934e-5ac7983b2b2b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:17.824699 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-44f1cacc-8aab-4518-934e-5ac7983b2b2b tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.342395 Jul 20 04:18:17.829115 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1107/2073] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:17 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:17.850463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b554e3d6-2560-4a42-9f62-eb588a858567 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c73e39d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:17.984878 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b554e3d6-2560-4a42-9f62-eb588a858567 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.154308 Jul 20 04:18:17.985474 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1108/2074] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:17 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:18.301264 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e85a6d76-f4e9-4f81-9163-a47a2c1caf6d tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/a9eb27db-3535-418d-97b5-00fcd5082092" status: 202 len: 0 microversion: 2.1 time: 3.731073 Jul 20 04:18:18.302216 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 967/2075] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:18:14 2022] DELETE /compute/v2.1/os-floating-ips/a9eb27db-3535-418d-97b5-00fcd5082092 => generated 0 bytes in 3733 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:18:18.313408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a697d817-4e3a-48d6-a5c4-eb1cb51a14c3 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.85"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:18.778586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a697d817-4e3a-48d6-a5c4-eb1cb51a14c3 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:18.786079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a697d817-4e3a-48d6-a5c4-eb1cb51a14c3 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.786522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a697d817-4e3a-48d6-a5c4-eb1cb51a14c3 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.787502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a697d817-4e3a-48d6-a5c4-eb1cb51a14c3 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.799645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a697d817-4e3a-48d6-a5c4-eb1cb51a14c3 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.866954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b831e400-eaa8-48ac-a9ab-9e815e1671a0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:18.867726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b831e400-eaa8-48ac-a9ab-9e815e1671a0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:18.883753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b831e400-eaa8-48ac-a9ab-9e815e1671a0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.884661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b831e400-eaa8-48ac-a9ab-9e815e1671a0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.887751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b831e400-eaa8-48ac-a9ab-9e815e1671a0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.888816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b831e400-eaa8-48ac-a9ab-9e815e1671a0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.052365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b831e400-eaa8-48ac-a9ab-9e815e1671a0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:19.066562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b831e400-eaa8-48ac-a9ab-9e815e1671a0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:19.069157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b831e400-eaa8-48ac-a9ab-9e815e1671a0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:19.070753 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b831e400-eaa8-48ac-a9ab-9e815e1671a0 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.209077 Jul 20 04:18:19.084817 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 968/2076] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:18 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:19.098501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2de93c0f-6fe5-4ca6-8c3f-cecfaab1e0de tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bdb74280>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:19.227382 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2de93c0f-6fe5-4ca6-8c3f-cecfaab1e0de tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.141269 Jul 20 04:18:19.228547 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 969/2077] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:19 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:19.764253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a697d817-4e3a-48d6-a5c4-eb1cb51a14c3 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Acquired lock "refresh_cache-2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" {{(pid=127871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:18:20.092098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a5f52dff-bfec-4250-a879-9c66729ffa74 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:20.092820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a5f52dff-bfec-4250-a879-9c66729ffa74 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:20.104998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5f52dff-bfec-4250-a879-9c66729ffa74 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.114732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5f52dff-bfec-4250-a879-9c66729ffa74 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.121575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5f52dff-bfec-4250-a879-9c66729ffa74 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.126437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5f52dff-bfec-4250-a879-9c66729ffa74 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.324904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a5f52dff-bfec-4250-a879-9c66729ffa74 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.338301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a5f52dff-bfec-4250-a879-9c66729ffa74 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.340593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a5f52dff-bfec-4250-a879-9c66729ffa74 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.350842 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a5f52dff-bfec-4250-a879-9c66729ffa74 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.264044 Jul 20 04:18:20.351839 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 970/2078] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:20 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:20.383290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-71a768b5-31b4-4655-ad94-45f4311afdbe tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bdb74af0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:20.492696 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-71a768b5-31b4-4655-ad94-45f4311afdbe tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.136735 Jul 20 04:18:20.505097 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 971/2079] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:20 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:20.656024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bfc4b264-b6b2-4ca0-834b-a75f859d43a0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:20.664489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bfc4b264-b6b2-4ca0-834b-a75f859d43a0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:20.699018 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bfc4b264-b6b2-4ca0-834b-a75f859d43a0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.699774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bfc4b264-b6b2-4ca0-834b-a75f859d43a0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.715692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bfc4b264-b6b2-4ca0-834b-a75f859d43a0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.715692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bfc4b264-b6b2-4ca0-834b-a75f859d43a0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.830329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bfc4b264-b6b2-4ca0-834b-a75f859d43a0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:20.986175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:21.037694 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bfc4b264-b6b2-4ca0-834b-a75f859d43a0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 204 len: 0 microversion: 2.1 time: 0.389036 Jul 20 04:18:21.038823 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 972/2080] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:20 2022] DELETE /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:18:21.047249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a6054699-3c3e-492c-8fc0-5be2d2adadc0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:21.048184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a6054699-3c3e-492c-8fc0-5be2d2adadc0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:21.066576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6054699-3c3e-492c-8fc0-5be2d2adadc0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.067263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6054699-3c3e-492c-8fc0-5be2d2adadc0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:21.068497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6054699-3c3e-492c-8fc0-5be2d2adadc0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.069252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6054699-3c3e-492c-8fc0-5be2d2adadc0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:21.885891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a6054699-3c3e-492c-8fc0-5be2d2adadc0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:21.894741 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a6054699-3c3e-492c-8fc0-5be2d2adadc0 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 200 len: 1514 microversion: 2.1 time: 0.851616 Jul 20 04:18:21.897937 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 973/2081] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:21 2022] GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 1514 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:21.918723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ddc6a242-a1b9-4053-b231-8a0ead0361cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:21.919888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ddc6a242-a1b9-4053-b231-8a0ead0361cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:21.935272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ddc6a242-a1b9-4053-b231-8a0ead0361cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.936138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ddc6a242-a1b9-4053-b231-8a0ead0361cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:21.940326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ddc6a242-a1b9-4053-b231-8a0ead0361cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.941153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ddc6a242-a1b9-4053-b231-8a0ead0361cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.061907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ddc6a242-a1b9-4053-b231-8a0ead0361cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:22.074760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ddc6a242-a1b9-4053-b231-8a0ead0361cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:22.082080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ddc6a242-a1b9-4053-b231-8a0ead0361cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:22.083926 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ddc6a242-a1b9-4053-b231-8a0ead0361cb tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1366 microversion: 2.57 time: 0.172666 Jul 20 04:18:22.096201 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 974/2082] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:21 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:22.101667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4c4bc203-4132-4508-a8e7-f0de2f88df7c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c7459280>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:22.164043 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4c4bc203-4132-4508-a8e7-f0de2f88df7c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.066255 Jul 20 04:18:22.165636 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 975/2083] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:22 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:22.172327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b9abf32c-ccd1-452f-8cd4-0ef1ac009d03 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:22.173125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b9abf32c-ccd1-452f-8cd4-0ef1ac009d03 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:22.182540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9abf32c-ccd1-452f-8cd4-0ef1ac009d03 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.183334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9abf32c-ccd1-452f-8cd4-0ef1ac009d03 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.184375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9abf32c-ccd1-452f-8cd4-0ef1ac009d03 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.185021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9abf32c-ccd1-452f-8cd4-0ef1ac009d03 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.224720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b9abf32c-ccd1-452f-8cd4-0ef1ac009d03 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:22.468867 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b9abf32c-ccd1-452f-8cd4-0ef1ac009d03 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "DELETE /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 204 len: 0 microversion: 2.1 time: 0.299556 Jul 20 04:18:22.472187 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 976/2084] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:22 2022] DELETE /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:18:22.494003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7bfca2fc-4a1f-4156-a0fb-af1078178a4d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:22.494837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7bfca2fc-4a1f-4156-a0fb-af1078178a4d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:22.514501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7bfca2fc-4a1f-4156-a0fb-af1078178a4d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.514955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7bfca2fc-4a1f-4156-a0fb-af1078178a4d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.517990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7bfca2fc-4a1f-4156-a0fb-af1078178a4d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.518544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7bfca2fc-4a1f-4156-a0fb-af1078178a4d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.261319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7bfca2fc-4a1f-4156-a0fb-af1078178a4d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.265697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:23.276164 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7bfca2fc-4a1f-4156-a0fb-af1078178a4d tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1668 microversion: 2.1 time: 0.798985 Jul 20 04:18:23.291891 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 977/2085] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:22 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1668 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:23.302466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-61a15178-6fbc-4fcb-9095-6cb3b21e97f8 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:23.303095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-61a15178-6fbc-4fcb-9095-6cb3b21e97f8 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:23.314531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61a15178-6fbc-4fcb-9095-6cb3b21e97f8 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.314975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61a15178-6fbc-4fcb-9095-6cb3b21e97f8 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.315868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61a15178-6fbc-4fcb-9095-6cb3b21e97f8 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.316319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61a15178-6fbc-4fcb-9095-6cb3b21e97f8 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.823917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-61a15178-6fbc-4fcb-9095-6cb3b21e97f8 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.832662 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-61a15178-6fbc-4fcb-9095-6cb3b21e97f8 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 200 len: 1514 microversion: 2.1 time: 0.539423 Jul 20 04:18:23.845614 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 978/2086] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:23 2022] GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 1514 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:23.857551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6d78d317-c97f-430d-aa4d-dc6850ad6328 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:23.860707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6d78d317-c97f-430d-aa4d-dc6850ad6328 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:23.877434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d78d317-c97f-430d-aa4d-dc6850ad6328 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.878067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d78d317-c97f-430d-aa4d-dc6850ad6328 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.878927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d78d317-c97f-430d-aa4d-dc6850ad6328 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.879436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d78d317-c97f-430d-aa4d-dc6850ad6328 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.016232 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6d78d317-c97f-430d-aa4d-dc6850ad6328 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.029332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6d78d317-c97f-430d-aa4d-dc6850ad6328 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.034153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6d78d317-c97f-430d-aa4d-dc6850ad6328 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.035505 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6d78d317-c97f-430d-aa4d-dc6850ad6328 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1372 microversion: 2.57 time: 0.188653 Jul 20 04:18:24.036129 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 979/2087] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:23 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:24.061652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-25867d31-2015-44f7-8a4f-878d335d5d85 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c746af70>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:24.142090 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-25867d31-2015-44f7-8a4f-878d335d5d85 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.089511 Jul 20 04:18:24.142914 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 980/2088] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:24 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:24.299861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c6399d77-815b-43d5-86b1-c0d44f3a6a85 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:24.300593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c6399d77-815b-43d5-86b1-c0d44f3a6a85 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:24.319854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6399d77-815b-43d5-86b1-c0d44f3a6a85 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.331190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6399d77-815b-43d5-86b1-c0d44f3a6a85 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.332196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6399d77-815b-43d5-86b1-c0d44f3a6a85 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.334766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6399d77-815b-43d5-86b1-c0d44f3a6a85 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.362980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-a697d817-4e3a-48d6-a5c4-eb1cb51a14c3 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Building network info cache for instance {{(pid=127871) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:18:25.365641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:25.718115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c6399d77-815b-43d5-86b1-c0d44f3a6a85 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:25.747092 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c6399d77-815b-43d5-86b1-c0d44f3a6a85 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1668 microversion: 2.1 time: 1.451352 Jul 20 04:18:25.764252 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 981/2089] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:24 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1668 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:25.776548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-78cf0b49-f453-4192-b176-35734c86ec0d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:25.777999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-78cf0b49-f453-4192-b176-35734c86ec0d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:25.795050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78cf0b49-f453-4192-b176-35734c86ec0d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.795828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78cf0b49-f453-4192-b176-35734c86ec0d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.796848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78cf0b49-f453-4192-b176-35734c86ec0d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.801273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78cf0b49-f453-4192-b176-35734c86ec0d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.894130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78cf0b49-f453-4192-b176-35734c86ec0d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.895020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78cf0b49-f453-4192-b176-35734c86ec0d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.895677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-78cf0b49-f453-4192-b176-35734c86ec0d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lazy-loading 'fault' on Instance uuid 1320f3fe-788f-4ebe-ad01-67e9201ac630 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:26.270922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-78cf0b49-f453-4192-b176-35734c86ec0d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.324898 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-78cf0b49-f453-4192-b176-35734c86ec0d tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 200 len: 1308 microversion: 2.1 time: 0.559105 Jul 20 04:18:26.329292 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 982/2090] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:25 2022] GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 1308 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:26.347706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d54b4ef3-6932-4edd-bd4a-f75a17c72cea tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:26.350392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d54b4ef3-6932-4edd-bd4a-f75a17c72cea tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:26.372756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d54b4ef3-6932-4edd-bd4a-f75a17c72cea tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.378435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d54b4ef3-6932-4edd-bd4a-f75a17c72cea tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.380023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d54b4ef3-6932-4edd-bd4a-f75a17c72cea tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.381719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d54b4ef3-6932-4edd-bd4a-f75a17c72cea tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.650345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d54b4ef3-6932-4edd-bd4a-f75a17c72cea tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.700499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d54b4ef3-6932-4edd-bd4a-f75a17c72cea tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.709604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d54b4ef3-6932-4edd-bd4a-f75a17c72cea tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.714982 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d54b4ef3-6932-4edd-bd4a-f75a17c72cea tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1357 microversion: 2.57 time: 0.382142 Jul 20 04:18:26.716090 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 983/2091] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:26 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1357 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:26.745640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3958dd14-1e10-4134-b1aa-5625a633fa08 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c7487670>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:26.887207 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3958dd14-1e10-4134-b1aa-5625a633fa08 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.168623 Jul 20 04:18:26.888509 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 984/2092] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:26 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:26.938965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-5cd4c07f-4eb4-49f9-a7b2-ba195660213d req-765e2477-f0d1-4234-9966-e67e371486b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1320f3fe-788f-4ebe-ad01-67e9201ac630", "name": "network-vif-deleted", "tag": "a075a139-e1e3-4aba-a6b3-d51472d32eaa"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:27.000596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5cd4c07f-4eb4-49f9-a7b2-ba195660213d req-765e2477-f0d1-4234-9966-e67e371486b1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.014012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5cd4c07f-4eb4-49f9-a7b2-ba195660213d req-765e2477-f0d1-4234-9966-e67e371486b1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.067082 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-5cd4c07f-4eb4-49f9-a7b2-ba195660213d req-765e2477-f0d1-4234-9966-e67e371486b1 service nova] Creating event network-vif-deleted:a075a139-e1e3-4aba-a6b3-d51472d32eaa for instance 1320f3fe-788f-4ebe-ad01-67e9201ac630 on n-h2-826526-5 Jul 20 04:18:27.081098 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-5cd4c07f-4eb4-49f9-a7b2-ba195660213d req-765e2477-f0d1-4234-9966-e67e371486b1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189471 Jul 20 04:18:27.083774 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 985/2093] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:27.098499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c49c0374-4f87-4beb-96e4-1cf7c4a5217c tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:27.099890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c49c0374-4f87-4beb-96e4-1cf7c4a5217c tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:27.114883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c49c0374-4f87-4beb-96e4-1cf7c4a5217c tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.116220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c49c0374-4f87-4beb-96e4-1cf7c4a5217c tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.118178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c49c0374-4f87-4beb-96e4-1cf7c4a5217c tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.119312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c49c0374-4f87-4beb-96e4-1cf7c4a5217c tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.181574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c49c0374-4f87-4beb-96e4-1cf7c4a5217c tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:27.374319 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c49c0374-4f87-4beb-96e4-1cf7c4a5217c tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 204 len: 0 microversion: 2.57 time: 0.280715 Jul 20 04:18:27.375643 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 986/2094] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:18:27 2022] DELETE /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:18:27.388250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f60d491e-2a57-4e44-95fd-782422a6a4b0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:27.394077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f60d491e-2a57-4e44-95fd-782422a6a4b0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:27.406698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f60d491e-2a57-4e44-95fd-782422a6a4b0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.409853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f60d491e-2a57-4e44-95fd-782422a6a4b0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.410761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f60d491e-2a57-4e44-95fd-782422a6a4b0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.411205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f60d491e-2a57-4e44-95fd-782422a6a4b0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.686802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f60d491e-2a57-4e44-95fd-782422a6a4b0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.703101 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f60d491e-2a57-4e44-95fd-782422a6a4b0 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1601 microversion: 2.1 time: 0.325232 Jul 20 04:18:27.703726 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 987/2095] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:27 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1601 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:27.723029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6e2125a1-a0d8-497f-9832-a36eeef34a1e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:27.733519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6e2125a1-a0d8-497f-9832-a36eeef34a1e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: 1320f3fe-788f-4ebe-ad01-67e9201ac630] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:27.744588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e2125a1-a0d8-497f-9832-a36eeef34a1e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.749741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e2125a1-a0d8-497f-9832-a36eeef34a1e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.751270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e2125a1-a0d8-497f-9832-a36eeef34a1e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.751871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e2125a1-a0d8-497f-9832-a36eeef34a1e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.813450 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-6e2125a1-a0d8-497f-9832-a36eeef34a1e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] HTTP exception thrown: Instance 1320f3fe-788f-4ebe-ad01-67e9201ac630 could not be found. Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6e2125a1-a0d8-497f-9832-a36eeef34a1e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Request method failure captured: Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 HTTP/1.1 Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14FlJ4L4ihsp-U77OpV_ADJJFwzj9ywn0Pj1Ia0HXq5HxxZQyN74rOTcj4Vb5-MPHfEYty8Cr6XyUgzc1yltv5yodChXAZMWfDVH9MIwSgu2X6-jMF---yNypfQXv5pxPL8N26TieJJUjGbPp3bs2vFFt6jJiHyJmxS3FR7x6NA_Sg0 Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 5ac9884530484da7acd3b52a3e9567d5 Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-VolumesAdminNegativeTest-3052417 Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:18:27.817168 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:18:27.818376 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ac9884530484da7acd3b52a3e9567d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5ac9884530484da7acd3b52a3e9567d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5ac9884530484da7acd3b52a3e9567d5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ac9884530484da7acd3b52a3e9567d5"}]}] Jul 20 04:18:27.818376 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-VolumesAdminNegativeTest-3052417 Jul 20 04:18:27.818376 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 5ac9884530484da7acd3b52a3e9567d5 Jul 20 04:18:27.818376 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-3052417 Jul 20 04:18:27.818376 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-VolumesAdminNegativeTest-3052417-project Jul 20 04:18:27.818376 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:18:27.818376 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:18:27.818376 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 317e1c9f0eda4534aab1e18a72e7540a Jul 20 04:18:27.818376 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-VolumesAdminNegativeTest-3052417-project Jul 20 04:18:27.818376 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:18:27.818376 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 1320f3fe-788f-4ebe-ad01-67e9201ac630 could not be found. Jul 20 04:18:27.818376 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '1320f3fe-788f-4ebe-ad01-67e9201ac630'} Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1320f3fe-788f-4ebe-ad01-67e9201ac630 could not be found. Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:27.819023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:27.820064 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:27.820064 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:27.820064 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:27.820064 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:27.820064 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:27.820064 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:27.820064 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:27.820064 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1320f3fe-788f-4ebe-ad01-67e9201ac630 could not be found. Jul 20 04:18:27.820064 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:27.820064 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:27.820064 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:27.820064 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:27.820064 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:27.820064 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:27.820064 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:27.820064 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:27.820064 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1320f3fe-788f-4ebe-ad01-67e9201ac630 could not be found. Jul 20 04:18:27.820064 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:27.821326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6e2125a1-a0d8-497f-9832-a36eeef34a1e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Returning 404 to user: Instance 1320f3fe-788f-4ebe-ad01-67e9201ac630 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:27.821326 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6e2125a1-a0d8-497f-9832-a36eeef34a1e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630" status: 404 len: 111 microversion: 2.1 time: 0.115572 Jul 20 04:18:27.824219 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 988/2096] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:27 2022] GET /compute/v2.1/servers/1320f3fe-788f-4ebe-ad01-67e9201ac630 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:27.876545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-47bb6615-d1b2-4e40-817b-dd8158a9e315 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:27.881397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-47bb6615-d1b2-4e40-817b-dd8158a9e315 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:27.896611 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-47bb6615-d1b2-4e40-817b-dd8158a9e315 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.898192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-47bb6615-d1b2-4e40-817b-dd8158a9e315 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.901125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-47bb6615-d1b2-4e40-817b-dd8158a9e315 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.901826 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-47bb6615-d1b2-4e40-817b-dd8158a9e315 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.161827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-a697d817-4e3a-48d6-a5c4-eb1cb51a14c3 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Updating instance_info_cache with network_info: [{"id": "5fe4d090-78b8-44a5-99b6-9391f731a824", "address": "fa:16:3e:a7:31:41", "network": {"id": "80c07577-b101-4f4f-b656-c3a34d626764", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-806748749-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "023236fb56b14d0a9e5ae4dd6120162a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5fe4d090-78", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127871) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:18:28.204546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a697d817-4e3a-48d6-a5c4-eb1cb51a14c3 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Releasing lock "refresh_cache-2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" {{(pid=127871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:18:28.222438 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a697d817-4e3a-48d6-a5c4-eb1cb51a14c3 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "POST /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f/action" status: 202 len: 0 microversion: 2.1 time: 9.897787 Jul 20 04:18:28.223196 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1109/2097] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:18:18 2022] POST /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f/action => generated 0 bytes in 9917 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:18:28.258973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c3c279c-5d58-464d-9a70-16fd6a989d43 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c7350940>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:28.366089 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0c3c279c-5d58-464d-9a70-16fd6a989d43 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.120024 Jul 20 04:18:28.366708 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1110/2098] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:28 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:28.403212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-84fe9591-e178-455f-8f1c-e4a988d6dec0 req-880c592b-583d-4198-be45-01e4e7117929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52df8cf7-6be8-4f22-a0b4-4a5e0b31be04", "name": "network-vif-deleted", "tag": "295ab3b5-0949-4953-b868-df3a92dd92e7"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:28.417484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-47bb6615-d1b2-4e40-817b-dd8158a9e315 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.436702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-47bb6615-d1b2-4e40-817b-dd8158a9e315 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.447948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-47bb6615-d1b2-4e40-817b-dd8158a9e315 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.452207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-84fe9591-e178-455f-8f1c-e4a988d6dec0 req-880c592b-583d-4198-be45-01e4e7117929 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.453285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-84fe9591-e178-455f-8f1c-e4a988d6dec0 req-880c592b-583d-4198-be45-01e4e7117929 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.453521 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-47bb6615-d1b2-4e40-817b-dd8158a9e315 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1363 microversion: 2.57 time: 0.624047 Jul 20 04:18:28.454198 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 989/2099] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:27 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1363 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:28.470632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-92ab1e8d-f91b-4466-8f32-368e4392b208 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '.version_select at 0x7f06be620d30>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:28.521685 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-84fe9591-e178-455f-8f1c-e4a988d6dec0 req-880c592b-583d-4198-be45-01e4e7117929 service nova] Creating event network-vif-deleted:295ab3b5-0949-4953-b868-df3a92dd92e7 for instance 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 on n-h2-826526-5 Jul 20 04:18:28.558221 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-84fe9591-e178-455f-8f1c-e4a988d6dec0 req-880c592b-583d-4198-be45-01e4e7117929 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190214 Jul 20 04:18:28.561912 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1111/2100] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:28.728969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e1bb22ad-ec91-47a6-830b-474cfd0e1f18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:28.730566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e1bb22ad-ec91-47a6-830b-474cfd0e1f18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:28.755371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1bb22ad-ec91-47a6-830b-474cfd0e1f18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.757311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1bb22ad-ec91-47a6-830b-474cfd0e1f18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.763515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1bb22ad-ec91-47a6-830b-474cfd0e1f18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.766626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1bb22ad-ec91-47a6-830b-474cfd0e1f18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.937622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1bb22ad-ec91-47a6-830b-474cfd0e1f18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.942028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1bb22ad-ec91-47a6-830b-474cfd0e1f18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.945887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-e1bb22ad-ec91-47a6-830b-474cfd0e1f18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lazy-loading 'fault' on Instance uuid 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:29.837199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e1bb22ad-ec91-47a6-830b-474cfd0e1f18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:29.844887 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e1bb22ad-ec91-47a6-830b-474cfd0e1f18 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 200 len: 1324 microversion: 2.1 time: 1.121468 Jul 20 04:18:29.858976 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1112/2101] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:28 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 1324 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:29.867652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c164e16-0160-48d7-8b4f-f7855266759a tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c72f1af0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:30.129527 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0c164e16-0160-48d7-8b4f-f7855266759a tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.269273 Jul 20 04:18:30.130476 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1113/2102] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:29 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:30.153115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-066b5729-fb6d-4538-8a85-36c7beaa2de9 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:30.154484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-066b5729-fb6d-4538-8a85-36c7beaa2de9 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:30.176684 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-066b5729-fb6d-4538-8a85-36c7beaa2de9 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.177136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-066b5729-fb6d-4538-8a85-36c7beaa2de9 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.177923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-066b5729-fb6d-4538-8a85-36c7beaa2de9 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.183103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-066b5729-fb6d-4538-8a85-36c7beaa2de9 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.335022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-066b5729-fb6d-4538-8a85-36c7beaa2de9 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.335699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-066b5729-fb6d-4538-8a85-36c7beaa2de9 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.335914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-066b5729-fb6d-4538-8a85-36c7beaa2de9 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lazy-loading 'fault' on Instance uuid 6c24bd48-ab49-4b20-9b06-b3fedc3e278f {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:30.434665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-066b5729-fb6d-4538-8a85-36c7beaa2de9 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.449661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-066b5729-fb6d-4538-8a85-36c7beaa2de9 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.451928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-066b5729-fb6d-4538-8a85-36c7beaa2de9 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01bf3d6f011940bdbc816c82b60c2a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c4fe6a168c430ca5555c138fc46197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.453371 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-066b5729-fb6d-4538-8a85-36c7beaa2de9 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 200 len: 1368 microversion: 2.57 time: 0.321961 Jul 20 04:18:30.454092 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1114/2103] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:30 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 1368 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:30.463960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-cb4ef771-83b5-41ff-884c-4bee4acbb7d0 req-9f894071-9497-417c-8e0e-a1120bb6811b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f", "tag": "5fe4d090-78b8-44a5-99b6-9391f731a824"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:30.479378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-cb4ef771-83b5-41ff-884c-4bee4acbb7d0 req-9f894071-9497-417c-8e0e-a1120bb6811b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.482084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-cb4ef771-83b5-41ff-884c-4bee4acbb7d0 req-9f894071-9497-417c-8e0e-a1120bb6811b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.497759 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-cb4ef771-83b5-41ff-884c-4bee4acbb7d0 req-9f894071-9497-417c-8e0e-a1120bb6811b service nova] Creating event network-changed:5fe4d090-78b8-44a5-99b6-9391f731a824 for instance 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f on n-h1-826526-5 Jul 20 04:18:30.508328 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-cb4ef771-83b5-41ff-884c-4bee4acbb7d0 req-9f894071-9497-417c-8e0e-a1120bb6811b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049187 Jul 20 04:18:30.510397 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1115/2104] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:30.862781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-44f8b427-0f48-4abe-b551-c7578b234c4e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:30.864220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-44f8b427-0f48-4abe-b551-c7578b234c4e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:30.884349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44f8b427-0f48-4abe-b551-c7578b234c4e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.884745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44f8b427-0f48-4abe-b551-c7578b234c4e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.893653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44f8b427-0f48-4abe-b551-c7578b234c4e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.894092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44f8b427-0f48-4abe-b551-c7578b234c4e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:31.555490 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-44f8b427-0f48-4abe-b551-c7578b234c4e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] HTTP exception thrown: Instance 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 could not be found. Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-44f8b427-0f48-4abe-b551-c7578b234c4e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Request method failure captured: Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 HTTP/1.1 Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14A4ikgrSQW1K5pUSo73dThwRYzu2k9_sjeIqs5ovqlB9_4Zy1V7mYGO_GAlHyzvWmfmnH6ciVgRFLkV9P-fgNmw14JRJJYYnkiLDNPhuDFTllBCcQ7IG9-ZMcY0uyxCGjO5TRMUrrjM17zCBUYSr2zwdJAF7qrFHwfrKEoAiftIqEk Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 6295769a840d437c9deed641966fd143 Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-LiveMigrationTest-684935058 Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:18:31.557819 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:18:31.559265 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6295769a840d437c9deed641966fd143"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6295769a840d437c9deed641966fd143"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6295769a840d437c9deed641966fd143", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6295769a840d437c9deed641966fd143"}]}] Jul 20 04:18:31.559265 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-LiveMigrationTest-684935058 Jul 20 04:18:31.559265 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 6295769a840d437c9deed641966fd143 Jul 20 04:18:31.559265 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-LiveMigrationTest-684935058 Jul 20 04:18:31.559265 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-LiveMigrationTest-684935058-project Jul 20 04:18:31.559265 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:18:31.559265 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:18:31.559265 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 106afc4bcfc04122b9afb3cc2b17cc03 Jul 20 04:18:31.559265 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-LiveMigrationTest-684935058-project Jul 20 04:18:31.559265 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:18:31.559265 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 could not be found. Jul 20 04:18:31.559265 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '52df8cf7-6be8-4f22-a0b4-4a5e0b31be04'} Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 could not be found. Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:31.559917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:31.561284 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:31.561284 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:31.561284 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:31.561284 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:31.561284 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:31.561284 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:31.561284 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:31.561284 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 could not be found. Jul 20 04:18:31.561284 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:31.561284 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:31.561284 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:31.561284 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:31.561284 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:31.561284 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:31.561284 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:31.561284 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:31.561284 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 could not be found. Jul 20 04:18:31.561284 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:31.563630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-44f8b427-0f48-4abe-b551-c7578b234c4e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Returning 404 to user: Instance 52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:31.564884 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-44f8b427-0f48-4abe-b551-c7578b234c4e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04" status: 404 len: 111 microversion: 2.1 time: 0.706240 Jul 20 04:18:31.566061 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1116/2105] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:30 2022] GET /compute/v2.1/servers/52df8cf7-6be8-4f22-a0b4-4a5e0b31be04 => generated 111 bytes in 708 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:18:31.571156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c0e48122-2a26-420c-b9d3-2215f12481ef tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c7415ee0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:31.690468 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c0e48122-2a26-420c-b9d3-2215f12481ef tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.123103 Jul 20 04:18:31.691330 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1117/2106] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:31 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:31.699654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-270dbf67-a94e-46e3-aef3-1042444b9b43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:31.701565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-270dbf67-a94e-46e3-aef3-1042444b9b43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] [instance: 6c24bd48-ab49-4b20-9b06-b3fedc3e278f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:31.716357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-270dbf67-a94e-46e3-aef3-1042444b9b43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:31.717011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-270dbf67-a94e-46e3-aef3-1042444b9b43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:31.718024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-270dbf67-a94e-46e3-aef3-1042444b9b43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:31.718845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-270dbf67-a94e-46e3-aef3-1042444b9b43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:31.747467 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-270dbf67-a94e-46e3-aef3-1042444b9b43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] HTTP exception thrown: Instance 6c24bd48-ab49-4b20-9b06-b3fedc3e278f could not be found. Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-270dbf67-a94e-46e3-aef3-1042444b9b43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Request method failure captured: Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f HTTP/1.1 Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Hm_yfXtHQvI-MQrQ6CaBcU5vIntV5A8m6T87Eyld82-HPeAADoPRzvYh4-h6MR1w8h_NK9d_WM3wbXasKD1zWZqdWcn8CTFMDiUx67FMs0qG9fsam5ZmeJblbJA4WVlkMxcuzc4QkzGxb4nDwZ2zkFP0gRP8PzDwsHcaXvGl1KKBk Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: X-Openstack-Nova-Api-Version: 2.57 Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 67c4fe6a168c430ca5555c138fc46197 Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerShowV257Test-1432959350 Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:18:31.751054 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:18:31.752650 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/67c4fe6a168c430ca5555c138fc46197"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/67c4fe6a168c430ca5555c138fc46197"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_67c4fe6a168c430ca5555c138fc46197", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/67c4fe6a168c430ca5555c138fc46197"}]}] Jul 20 04:18:31.752650 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerShowV257Test-1432959350 Jul 20 04:18:31.752650 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 67c4fe6a168c430ca5555c138fc46197 Jul 20 04:18:31.752650 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerShowV257Test-1432959350 Jul 20 04:18:31.752650 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerShowV257Test-1432959350-project Jul 20 04:18:31.752650 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:18:31.752650 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:18:31.752650 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 01bf3d6f011940bdbc816c82b60c2a18 Jul 20 04:18:31.752650 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerShowV257Test-1432959350-project Jul 20 04:18:31.752650 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:18:31.752650 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 6c24bd48-ab49-4b20-9b06-b3fedc3e278f could not be found. Jul 20 04:18:31.752650 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '6c24bd48-ab49-4b20-9b06-b3fedc3e278f'} Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c24bd48-ab49-4b20-9b06-b3fedc3e278f could not be found. Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:31.753374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:31.754392 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:31.754392 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:31.754392 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:31.754392 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:31.754392 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:31.754392 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:31.754392 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:31.754392 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c24bd48-ab49-4b20-9b06-b3fedc3e278f could not be found. Jul 20 04:18:31.754392 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:31.754392 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:31.754392 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:31.754392 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:31.754392 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:31.754392 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:31.754392 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:31.754392 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:31.754392 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c24bd48-ab49-4b20-9b06-b3fedc3e278f could not be found. Jul 20 04:18:31.754392 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:31.759174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-270dbf67-a94e-46e3-aef3-1042444b9b43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] Returning 404 to user: Instance 6c24bd48-ab49-4b20-9b06-b3fedc3e278f could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:31.761068 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-270dbf67-a94e-46e3-aef3-1042444b9b43 tempest-ServerShowV257Test-1432959350 tempest-ServerShowV257Test-1432959350-project] 10.222.0.17 "GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f" status: 404 len: 111 microversion: 2.57 time: 0.067118 Jul 20 04:18:31.765143 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1118/2107] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:31 2022] GET /compute/v2.1/servers/6c24bd48-ab49-4b20-9b06-b3fedc3e278f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:18:31.783901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ec0bfd80-ccad-4319-aab3-50d4749271db tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '.version_select at 0x7f06c739c8b0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:31.854505 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ec0bfd80-ccad-4319-aab3-50d4749271db tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964298915" status: 202 len: 0 microversion: 2.1 time: 0.085948 Jul 20 04:18:31.861764 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1119/2108] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jul 20 04:18:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964298915 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:18:32.670742 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-92ab1e8d-f91b-4466-8f32-368e4392b208 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/53259a8c-4385-4449-b11d-2d3c00f09aaf" status: 202 len: 0 microversion: 2.1 time: 4.215286 Jul 20 04:18:32.671307 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 990/2109] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:18:28 2022] DELETE /compute/v2.1/os-floating-ips/53259a8c-4385-4449-b11d-2d3c00f09aaf => generated 0 bytes in 4217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:18:32.683113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dcd6b9ae-0d12-4c65-8814-50985a09fc2d tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:32.710707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c422b4ac-21be-43ed-b4c8-205cc15c3553 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bde0a1f0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dcd6b9ae-0d12-4c65-8814-50985a09fc2d tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Request method failure captured: Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f/action HTTP/1.1 Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 34 Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14HZ1izt9DFIckUkHMOv3p3ULpa4J0MQbGcqLd1LTSgPcDU4v5FF7fy7VcRe5LpHx6wq46V4OUbFtqfIBSTXo-nrD8XQ1C0bC-F6M_CDonFH1HvKGQ6LC0TOeYvg0PHgPIORiv-3uxsMhQtoJmDPSGUhZ71lgziK53pGMnLpCItR13w Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 023236fb56b14d0a9e5ae4dd6120162a Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:18:32.718706 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:18:32.720025 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/023236fb56b14d0a9e5ae4dd6120162a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/023236fb56b14d0a9e5ae4dd6120162a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_023236fb56b14d0a9e5ae4dd6120162a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/023236fb56b14d0a9e5ae4dd6120162a"}]}] Jul 20 04:18:32.720025 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 Jul 20 04:18:32.720025 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 023236fb56b14d0a9e5ae4dd6120162a Jul 20 04:18:32.720025 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 Jul 20 04:18:32.720025 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project Jul 20 04:18:32.720025 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:18:32.720025 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:18:32.720025 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 20801c8e312044b38e1a758387877528 Jul 20 04:18:32.720025 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project Jul 20 04:18:32.720025 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:18:32.720025 n-d-826526-5 devstack@n-api.service[127871]: {"addFloatingIp": {"address": ""}} Jul 20 04:18:32.720025 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:18:32.720025 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f', 'body': {'addFloatingIp': {'address': ''}}} Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi '' Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:32.720853 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:18:32.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:18:32.724466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 20 04:18:32.724466 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:32.727932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dcd6b9ae-0d12-4c65-8814-50985a09fc2d tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:32.730911 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dcd6b9ae-0d12-4c65-8814-50985a09fc2d tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "POST /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f/action" status: 400 len: 142 microversion: 2.1 time: 0.053720 Jul 20 04:18:32.737352 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1120/2110] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:18:32 2022] POST /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f/action => generated 142 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:18:32.757088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-76066bcd-2ac6-4c07-92a2-1a024e79ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:32.758180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-76066bcd-2ac6-4c07-92a2-1a024e79ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:32.801528 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76066bcd-2ac6-4c07-92a2-1a024e79ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.803526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76066bcd-2ac6-4c07-92a2-1a024e79ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.804792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76066bcd-2ac6-4c07-92a2-1a024e79ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.807321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76066bcd-2ac6-4c07-92a2-1a024e79ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.846963 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c422b4ac-21be-43ed-b4c8-205cc15c3553 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.141871 Jul 20 04:18:32.856161 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 991/2111] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:32 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:32.940203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76066bcd-2ac6-4c07-92a2-1a024e79ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Acquired lock "refresh_cache-2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" {{(pid=127871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:18:33.452045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76066bcd-2ac6-4c07-92a2-1a024e79ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Releasing lock "refresh_cache-2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" {{(pid=127871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:18:33.452910 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-76066bcd-2ac6-4c07-92a2-1a024e79ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] HTTP exception thrown: floating IP not found Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-76066bcd-2ac6-4c07-92a2-1a024e79ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Request method failure captured: Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f/action HTTP/1.1 Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 41 Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14HZ1izt9DFIckUkHMOv3p3ULpa4J0MQbGcqLd1LTSgPcDU4v5FF7fy7VcRe5LpHx6wq46V4OUbFtqfIBSTXo-nrD8XQ1C0bC-F6M_CDonFH1HvKGQ6LC0TOeYvg0PHgPIORiv-3uxsMhQtoJmDPSGUhZ71lgziK53pGMnLpCItR13w Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 023236fb56b14d0a9e5ae4dd6120162a Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:18:33.455131 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:18:33.456847 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/023236fb56b14d0a9e5ae4dd6120162a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/023236fb56b14d0a9e5ae4dd6120162a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_023236fb56b14d0a9e5ae4dd6120162a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/023236fb56b14d0a9e5ae4dd6120162a"}]}] Jul 20 04:18:33.456847 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 Jul 20 04:18:33.456847 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 023236fb56b14d0a9e5ae4dd6120162a Jul 20 04:18:33.456847 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 Jul 20 04:18:33.456847 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project Jul 20 04:18:33.456847 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:18:33.456847 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:18:33.456847 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 20801c8e312044b38e1a758387877528 Jul 20 04:18:33.456847 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project Jul 20 04:18:33.456847 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:18:33.456847 n-d-826526-5 devstack@n-api.service[127871]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 20 04:18:33.456847 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:18:33.456847 n-d-826526-5 devstack@n-api.service[127871]: exception: floating IP not found Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:33.457731 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 20 04:18:33.458842 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:33.465976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-76066bcd-2ac6-4c07-92a2-1a024e79ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Returning 404 to user: floating IP not found {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:33.465976 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-76066bcd-2ac6-4c07-92a2-1a024e79ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "POST /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f/action" status: 404 len: 67 microversion: 2.1 time: 0.713681 Jul 20 04:18:33.465976 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1121/2112] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:18:32 2022] POST /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f/action => generated 67 bytes in 715 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:18:33.477033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-30419650-733c-468e-960d-9e0020ec481d tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Action: 'action', calling method: .version_select at 0x7f06c4dd7e50>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:33.661454 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-30419650-733c-468e-960d-9e0020ec481d tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-30419650-733c-468e-960d-9e0020ec481d tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Request method failure captured: Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f/action HTTP/1.1 Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 44 Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14HZ1izt9DFIckUkHMOv3p3ULpa4J0MQbGcqLd1LTSgPcDU4v5FF7fy7VcRe5LpHx6wq46V4OUbFtqfIBSTXo-nrD8XQ1C0bC-F6M_CDonFH1HvKGQ6LC0TOeYvg0PHgPIORiv-3uxsMhQtoJmDPSGUhZ71lgziK53pGMnLpCItR13w Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 023236fb56b14d0a9e5ae4dd6120162a Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:18:33.663160 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:18:33.664322 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/023236fb56b14d0a9e5ae4dd6120162a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/023236fb56b14d0a9e5ae4dd6120162a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_023236fb56b14d0a9e5ae4dd6120162a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/023236fb56b14d0a9e5ae4dd6120162a"}]}] Jul 20 04:18:33.664322 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 Jul 20 04:18:33.664322 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 023236fb56b14d0a9e5ae4dd6120162a Jul 20 04:18:33.664322 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 Jul 20 04:18:33.664322 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project Jul 20 04:18:33.664322 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:18:33.664322 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:18:33.664322 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 20801c8e312044b38e1a758387877528 Jul 20 04:18:33.664322 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project Jul 20 04:18:33.664322 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:18:33.664322 n-d-826526-5 devstack@n-api.service[127870]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 20 04:18:33.664322 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:18:33.664322 n-d-826526-5 devstack@n-api.service[127870]: exception: Floating IP not found for address 0.0.0.0. Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:33.665031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 20 04:18:33.666026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:33.667123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-30419650-733c-468e-960d-9e0020ec481d tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:33.667123 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-30419650-733c-468e-960d-9e0020ec481d tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "POST /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f/action" status: 404 len: 88 microversion: 2.1 time: 0.199278 Jul 20 04:18:33.667123 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 992/2113] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:18:33 2022] POST /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f/action => generated 88 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:18:33.677176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8263b065-e39f-4a5f-9579-f776b7398347 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:33.677683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8263b065-e39f-4a5f-9579-f776b7398347 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:33.701047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8263b065-e39f-4a5f-9579-f776b7398347 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.701724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8263b065-e39f-4a5f-9579-f776b7398347 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.714539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8263b065-e39f-4a5f-9579-f776b7398347 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.715170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8263b065-e39f-4a5f-9579-f776b7398347 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.827331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8263b065-e39f-4a5f-9579-f776b7398347 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:33.888287 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fd906eae-3b9e-43b2-a256-78ed0f7281ad tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bde23700>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:33.984167 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fd906eae-3b9e-43b2-a256-78ed0f7281ad tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1438 microversion: 2.1 time: 0.127006 Jul 20 04:18:33.986894 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 993/2114] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:33 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1438 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:34.218870 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8263b065-e39f-4a5f-9579-f776b7398347 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" status: 204 len: 0 microversion: 2.1 time: 0.546795 Jul 20 04:18:34.230668 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1122/2115] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:33 2022] DELETE /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:18:34.239063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b9f46bf8-54f4-4118-a036-f9745e1477b8 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:34.239849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b9f46bf8-54f4-4118-a036-f9745e1477b8 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:34.253527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9f46bf8-54f4-4118-a036-f9745e1477b8 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.258003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9f46bf8-54f4-4118-a036-f9745e1477b8 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.261525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9f46bf8-54f4-4118-a036-f9745e1477b8 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.262119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9f46bf8-54f4-4118-a036-f9745e1477b8 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.318773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3d7564cf-54da-4b72-9b8c-e0f350eb9fee tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:34.319406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3d7564cf-54da-4b72-9b8c-e0f350eb9fee tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:34.339386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3d7564cf-54da-4b72-9b8c-e0f350eb9fee tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.341209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3d7564cf-54da-4b72-9b8c-e0f350eb9fee tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.342598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3d7564cf-54da-4b72-9b8c-e0f350eb9fee tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.346591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3d7564cf-54da-4b72-9b8c-e0f350eb9fee tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.419723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3d7564cf-54da-4b72-9b8c-e0f350eb9fee tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:34.591602 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3d7564cf-54da-4b72-9b8c-e0f350eb9fee tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 204 len: 0 microversion: 2.1 time: 0.277832 Jul 20 04:18:34.595032 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1123/2116] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:34 2022] DELETE /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:18:34.629157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-edc4d519-172d-4e5f-8dec-6a2351591da7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:34.632713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-edc4d519-172d-4e5f-8dec-6a2351591da7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:34.651348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edc4d519-172d-4e5f-8dec-6a2351591da7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.651809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edc4d519-172d-4e5f-8dec-6a2351591da7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.652671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edc4d519-172d-4e5f-8dec-6a2351591da7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.654439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edc4d519-172d-4e5f-8dec-6a2351591da7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.885858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b9f46bf8-54f4-4118-a036-f9745e1477b8 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20801c8e312044b38e1a758387877528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '023236fb56b14d0a9e5ae4dd6120162a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:34.898529 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b9f46bf8-54f4-4118-a036-f9745e1477b8 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" status: 200 len: 1541 microversion: 2.1 time: 0.661489 Jul 20 04:18:34.910300 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 994/2117] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:34 2022] GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f => generated 1541 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:34.917463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dd6cffc7-3649-4e66-9d86-5d5f21e26976 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:34.923087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dd6cffc7-3649-4e66-9d86-5d5f21e26976 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:34.941022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd6cffc7-3649-4e66-9d86-5d5f21e26976 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.941702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd6cffc7-3649-4e66-9d86-5d5f21e26976 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.943306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd6cffc7-3649-4e66-9d86-5d5f21e26976 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.943903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd6cffc7-3649-4e66-9d86-5d5f21e26976 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.007746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dd6cffc7-3649-4e66-9d86-5d5f21e26976 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:35.053825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-edc4d519-172d-4e5f-8dec-6a2351591da7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.066761 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-edc4d519-172d-4e5f-8dec-6a2351591da7 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1485 microversion: 2.1 time: 0.463299 Jul 20 04:18:35.079003 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1124/2118] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:34 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1485 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:35.089243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ad28f1be-16e2-4639-9b37-d124161ba957 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c73e3310>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:35.186763 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ad28f1be-16e2-4639-9b37-d124161ba957 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1447 microversion: 2.1 time: 0.101502 Jul 20 04:18:35.187366 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1125/2119] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:35 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1447 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:35.203878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-94856592-424f-41f8-85a3-dc61596ef68c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c73e3820>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:35.273528 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dd6cffc7-3649-4e66-9d86-5d5f21e26976 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3" status: 204 len: 0 microversion: 2.1 time: 0.369684 Jul 20 04:18:35.274489 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 995/2120] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:34 2022] DELETE /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:18:35.300441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-860caae3-81e1-4d38-a87b-aada9ec7aa20 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:35.301333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-860caae3-81e1-4d38-a87b-aada9ec7aa20 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:35.305338 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-94856592-424f-41f8-85a3-dc61596ef68c tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 200 len: 1447 microversion: 2.1 time: 0.105675 Jul 20 04:18:35.309375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-860caae3-81e1-4d38-a87b-aada9ec7aa20 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.310255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-860caae3-81e1-4d38-a87b-aada9ec7aa20 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.311202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-860caae3-81e1-4d38-a87b-aada9ec7aa20 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.311768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-860caae3-81e1-4d38-a87b-aada9ec7aa20 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.313199 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1126/2121] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:35 2022] GET /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 1447 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:35.321942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cfdc4891-02d2-48f9-87bc-1574ccda9605 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be2c6160>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:35.642774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-860caae3-81e1-4d38-a87b-aada9ec7aa20 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.655395 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-860caae3-81e1-4d38-a87b-aada9ec7aa20 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3" status: 200 len: 1679 microversion: 2.1 time: 0.375646 Jul 20 04:18:35.660433 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 996/2122] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:35 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3 => generated 1679 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:35.918749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7fcb9ea8-c4fb-4eff-a285-ed42cd198fdc tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:35.919379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7fcb9ea8-c4fb-4eff-a285-ed42cd198fdc tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:35.931125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fcb9ea8-c4fb-4eff-a285-ed42cd198fdc tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.931229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fcb9ea8-c4fb-4eff-a285-ed42cd198fdc tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.932123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fcb9ea8-c4fb-4eff-a285-ed42cd198fdc tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.940699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fcb9ea8-c4fb-4eff-a285-ed42cd198fdc tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.216969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7fcb9ea8-c4fb-4eff-a285-ed42cd198fdc tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20801c8e312044b38e1a758387877528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '023236fb56b14d0a9e5ae4dd6120162a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:36.235617 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7fcb9ea8-c4fb-4eff-a285-ed42cd198fdc tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" status: 200 len: 1541 microversion: 2.1 time: 0.321457 Jul 20 04:18:36.237716 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 997/2123] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:35 2022] GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f => generated 1541 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:36.264877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-05a1d290-4a60-4208-9b0d-ad92499a18f5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:36.267441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-05a1d290-4a60-4208-9b0d-ad92499a18f5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:36.341134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-05a1d290-4a60-4208-9b0d-ad92499a18f5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.342176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-05a1d290-4a60-4208-9b0d-ad92499a18f5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.344989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-05a1d290-4a60-4208-9b0d-ad92499a18f5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.347038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-05a1d290-4a60-4208-9b0d-ad92499a18f5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.391332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:36.636853 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cfdc4891-02d2-48f9-87bc-1574ccda9605 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "DELETE /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 204 len: 0 microversion: 2.1 time: 1.321997 Jul 20 04:18:36.637435 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1127/2124] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:35 2022] DELETE /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 0 bytes in 1324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:18:37.075497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fcc8e247-6d1d-4629-abed-0866f9790a9f tempest-ExtensionsTest-730401204 tempest-ExtensionsTest-730401204-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:37.077247 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fcc8e247-6d1d-4629-abed-0866f9790a9f tempest-ExtensionsTest-730401204 tempest-ExtensionsTest-730401204-project] 10.222.0.17 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.438657 Jul 20 04:18:37.077810 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1128/2125] 10.222.0.17 () {58 vars in 1169 bytes} [Wed Jul 20 04:18:36 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:37.083865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-855575f9-b9b9-4b4b-b703-b5f69076b69b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:37.084396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-855575f9-b9b9-4b4b-b703-b5f69076b69b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:37.096159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-855575f9-b9b9-4b4b-b703-b5f69076b69b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.096159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-855575f9-b9b9-4b4b-b703-b5f69076b69b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.096159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-855575f9-b9b9-4b4b-b703-b5f69076b69b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.096159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-855575f9-b9b9-4b4b-b703-b5f69076b69b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.124356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-855575f9-b9b9-4b4b-b703-b5f69076b69b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:37.169754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-05a1d290-4a60-4208-9b0d-ad92499a18f5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:37.182672 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-05a1d290-4a60-4208-9b0d-ad92499a18f5 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1485 microversion: 2.1 time: 0.943261 Jul 20 04:18:37.189750 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 998/2126] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:36 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1485 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:37.195914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7f49b310-e9fa-4ea1-a7be-562a88be1f86 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:37.200099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7f49b310-e9fa-4ea1-a7be-562a88be1f86 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:37.217377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f49b310-e9fa-4ea1-a7be-562a88be1f86 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.218101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f49b310-e9fa-4ea1-a7be-562a88be1f86 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.219145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f49b310-e9fa-4ea1-a7be-562a88be1f86 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.219861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f49b310-e9fa-4ea1-a7be-562a88be1f86 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.278015 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-855575f9-b9b9-4b4b-b703-b5f69076b69b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 204 len: 0 microversion: 2.1 time: 0.198677 Jul 20 04:18:37.279534 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1129/2127] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:37 2022] DELETE /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:18:37.288718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-943376b7-90f0-434c-8a1e-1a6b4c07abf3 tempest-ExtensionsTest-730401204 tempest-ExtensionsTest-730401204-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:37.297725 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-943376b7-90f0-434c-8a1e-1a6b4c07abf3 tempest-ExtensionsTest-730401204 tempest-ExtensionsTest-730401204-project] 10.222.0.17 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.013722 Jul 20 04:18:37.299109 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1130/2128] 10.222.0.17 () {58 vars in 1133 bytes} [Wed Jul 20 04:18:37 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:18:37.305599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cb7868c9-6e3a-4fc6-bdae-21d7b72b3d81 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:37.306759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cb7868c9-6e3a-4fc6-bdae-21d7b72b3d81 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:37.315885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb7868c9-6e3a-4fc6-bdae-21d7b72b3d81 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.316739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb7868c9-6e3a-4fc6-bdae-21d7b72b3d81 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.317837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb7868c9-6e3a-4fc6-bdae-21d7b72b3d81 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.318616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb7868c9-6e3a-4fc6-bdae-21d7b72b3d81 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.513416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7f49b310-e9fa-4ea1-a7be-562a88be1f86 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:37.528533 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7f49b310-e9fa-4ea1-a7be-562a88be1f86 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3" status: 200 len: 1679 microversion: 2.1 time: 0.337363 Jul 20 04:18:37.539519 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 999/2129] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:37 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3 => generated 1679 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:37.547137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf2e0e40-8480-47bc-9a44-edd1e8ee2cd7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1319005863", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "4a34548b-e35a-44a0-ab83-c5f87d932d5b"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:37.592129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cb7868c9-6e3a-4fc6-bdae-21d7b72b3d81 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20801c8e312044b38e1a758387877528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '023236fb56b14d0a9e5ae4dd6120162a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:37.604464 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cb7868c9-6e3a-4fc6-bdae-21d7b72b3d81 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" status: 200 len: 1499 microversion: 2.1 time: 0.302206 Jul 20 04:18:37.618440 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1131/2130] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:37 2022] GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f => generated 1499 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:37.647535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-cf2e0e40-8480-47bc-9a44-edd1e8ee2cd7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] validate_networks() for [('4a34548b-e35a-44a0-ab83-c5f87d932d5b', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:18:37.739335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-60583616-778a-4189-80e0-4a70e6d42c2f req-7742a81f-2ac8-416e-9b39-db1a0a45cce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f", "name": "network-vif-deleted", "tag": "5fe4d090-78b8-44a5-99b6-9391f731a824"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:37.745193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:37.759883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-60583616-778a-4189-80e0-4a70e6d42c2f req-7742a81f-2ac8-416e-9b39-db1a0a45cce8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.761625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-60583616-778a-4189-80e0-4a70e6d42c2f req-7742a81f-2ac8-416e-9b39-db1a0a45cce8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.796284 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-60583616-778a-4189-80e0-4a70e6d42c2f req-7742a81f-2ac8-416e-9b39-db1a0a45cce8 service nova] Creating event network-vif-deleted:5fe4d090-78b8-44a5-99b6-9391f731a824 for instance 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f on n-h1-826526-5 Jul 20 04:18:37.810280 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-60583616-778a-4189-80e0-4a70e6d42c2f req-7742a81f-2ac8-416e-9b39-db1a0a45cce8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078114 Jul 20 04:18:37.811827 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1132/2131] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:18:38.209814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b157e94-be40-4004-9ab2-4466d5bf8e8e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:38.210669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9b157e94-be40-4004-9ab2-4466d5bf8e8e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:38.228489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b157e94-be40-4004-9ab2-4466d5bf8e8e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.229233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b157e94-be40-4004-9ab2-4466d5bf8e8e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.230176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b157e94-be40-4004-9ab2-4466d5bf8e8e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.230736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b157e94-be40-4004-9ab2-4466d5bf8e8e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.289339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:38.512973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9b157e94-be40-4004-9ab2-4466d5bf8e8e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:38.533018 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9b157e94-be40-4004-9ab2-4466d5bf8e8e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 200 len: 1443 microversion: 2.1 time: 0.320469 Jul 20 04:18:38.533713 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1133/2132] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:38 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 1443 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:38.543107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-1f76002f-f119-4ade-9be2-55a299b7a179 req-d6a6af5e-bb61-40bd-a544-2e641e8aa6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a04f4bb0-5809-44b5-bb51-63bd97076afc", "name": "network-vif-deleted", "tag": "754db640-ac88-45b2-8510-52b75fd6b650"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:38.568443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1f76002f-f119-4ade-9be2-55a299b7a179 req-d6a6af5e-bb61-40bd-a544-2e641e8aa6d8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.568895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1f76002f-f119-4ade-9be2-55a299b7a179 req-d6a6af5e-bb61-40bd-a544-2e641e8aa6d8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.586469 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-1f76002f-f119-4ade-9be2-55a299b7a179 req-d6a6af5e-bb61-40bd-a544-2e641e8aa6d8 service nova] Creating event network-vif-deleted:754db640-ac88-45b2-8510-52b75fd6b650 for instance a04f4bb0-5809-44b5-bb51-63bd97076afc on n-h2-826526-5 Jul 20 04:18:38.607194 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-1f76002f-f119-4ade-9be2-55a299b7a179 req-d6a6af5e-bb61-40bd-a544-2e641e8aa6d8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072040 Jul 20 04:18:38.607899 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1134/2133] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:38.619379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-43d35e42-b589-40ec-9b1a-a80a6c3ae9b7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:38.620114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-43d35e42-b589-40ec-9b1a-a80a6c3ae9b7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:38.640148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43d35e42-b589-40ec-9b1a-a80a6c3ae9b7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.640636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43d35e42-b589-40ec-9b1a-a80a6c3ae9b7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.641437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43d35e42-b589-40ec-9b1a-a80a6c3ae9b7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.645640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43d35e42-b589-40ec-9b1a-a80a6c3ae9b7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.087225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-43d35e42-b589-40ec-9b1a-a80a6c3ae9b7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:39.098014 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-43d35e42-b589-40ec-9b1a-a80a6c3ae9b7 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3" status: 200 len: 1679 microversion: 2.1 time: 0.488863 Jul 20 04:18:39.100824 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1135/2134] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:38 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3 => generated 1679 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:39.114079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c58cce15-64dd-452d-9e93-41afe16bd5f2 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:39.115040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c58cce15-64dd-452d-9e93-41afe16bd5f2 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] [instance: 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:39.130208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c58cce15-64dd-452d-9e93-41afe16bd5f2 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.133865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c58cce15-64dd-452d-9e93-41afe16bd5f2 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.135186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c58cce15-64dd-452d-9e93-41afe16bd5f2 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.135660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c58cce15-64dd-452d-9e93-41afe16bd5f2 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.172739 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-c58cce15-64dd-452d-9e93-41afe16bd5f2 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] HTTP exception thrown: Instance 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f could not be found. Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c58cce15-64dd-452d-9e93-41afe16bd5f2 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Request method failure captured: Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f HTTP/1.1 Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14HZ1izt9DFIckUkHMOv3p3ULpa4J0MQbGcqLd1LTSgPcDU4v5FF7fy7VcRe5LpHx6wq46V4OUbFtqfIBSTXo-nrD8XQ1C0bC-F6M_CDonFH1HvKGQ6LC0TOeYvg0PHgPIORiv-3uxsMhQtoJmDPSGUhZ71lgziK53pGMnLpCItR13w Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 023236fb56b14d0a9e5ae4dd6120162a Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:18:39.176974 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:18:39.178517 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/023236fb56b14d0a9e5ae4dd6120162a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/023236fb56b14d0a9e5ae4dd6120162a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_023236fb56b14d0a9e5ae4dd6120162a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/023236fb56b14d0a9e5ae4dd6120162a"}]}] Jul 20 04:18:39.178517 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 Jul 20 04:18:39.178517 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 023236fb56b14d0a9e5ae4dd6120162a Jul 20 04:18:39.178517 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 Jul 20 04:18:39.178517 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project Jul 20 04:18:39.178517 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:18:39.178517 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:18:39.178517 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 20801c8e312044b38e1a758387877528 Jul 20 04:18:39.178517 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project Jul 20 04:18:39.178517 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:18:39.178517 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f could not be found. Jul 20 04:18:39.178517 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f'} Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f could not be found. Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:39.179348 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:39.180588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:39.180588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:39.180588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:39.180588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:39.180588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:39.180588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:39.180588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:39.180588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f could not be found. Jul 20 04:18:39.180588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:39.180588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:39.180588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:39.180588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:39.180588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:39.180588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:39.180588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:39.180588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:39.180588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f could not be found. Jul 20 04:18:39.180588 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:39.181697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c58cce15-64dd-452d-9e93-41afe16bd5f2 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] Returning 404 to user: Instance 2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:39.181697 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c58cce15-64dd-452d-9e93-41afe16bd5f2 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008 tempest-FloatingIPsAssociationNegativeTestJSON-2044837008-project] 10.222.0.17 "GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f" status: 404 len: 111 microversion: 2.1 time: 0.076359 Jul 20 04:18:39.185813 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1136/2135] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:39 2022] GET /compute/v2.1/servers/2ab0ccd0-e842-486c-a2c5-d727d7ca8c9f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:39.532411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-d776d098-f0cb-4625-b971-051833f7ed64 req-03c81158-aa8d-49b1-a435-ecf9c0231aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9170bb-33df-43d7-b35f-1d846da620d3", "name": "network-vif-unplugged", "status": "completed", "tag": "08cf3082-9efd-4024-be41-ac9e072b2995"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:39.559696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d776d098-f0cb-4625-b971-051833f7ed64 req-03c81158-aa8d-49b1-a435-ecf9c0231aa1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.560301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d776d098-f0cb-4625-b971-051833f7ed64 req-03c81158-aa8d-49b1-a435-ecf9c0231aa1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.587797 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-d776d098-f0cb-4625-b971-051833f7ed64 req-03c81158-aa8d-49b1-a435-ecf9c0231aa1 service nova] Creating event network-vif-unplugged:08cf3082-9efd-4024-be41-ac9e072b2995 for instance ee9170bb-33df-43d7-b35f-1d846da620d3 on n-h2-826526-5 Jul 20 04:18:39.592066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-cf2e0e40-8480-47bc-9a44-edd1e8ee2cd7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:39.593945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-cf2e0e40-8480-47bc-9a44-edd1e8ee2cd7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:39.595107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-cf2e0e40-8480-47bc-9a44-edd1e8ee2cd7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:39.595715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-cf2e0e40-8480-47bc-9a44-edd1e8ee2cd7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:39.596400 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-cf2e0e40-8480-47bc-9a44-edd1e8ee2cd7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:39.599468 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-d776d098-f0cb-4625-b971-051833f7ed64 req-03c81158-aa8d-49b1-a435-ecf9c0231aa1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069526 Jul 20 04:18:39.604002 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1137/2136] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:39.622569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-882b4c52-391e-4382-bb09-39e36c7756a4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:39.623530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-882b4c52-391e-4382-bb09-39e36c7756a4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: a04f4bb0-5809-44b5-bb51-63bd97076afc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:39.625874 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf2e0e40-8480-47bc-9a44-edd1e8ee2cd7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.626325 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf2e0e40-8480-47bc-9a44-edd1e8ee2cd7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.627473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf2e0e40-8480-47bc-9a44-edd1e8ee2cd7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.634282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-882b4c52-391e-4382-bb09-39e36c7756a4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.634864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-882b4c52-391e-4382-bb09-39e36c7756a4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.635743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-882b4c52-391e-4382-bb09-39e36c7756a4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.636286 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-882b4c52-391e-4382-bb09-39e36c7756a4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.647881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf2e0e40-8480-47bc-9a44-edd1e8ee2cd7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.654596 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-882b4c52-391e-4382-bb09-39e36c7756a4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] HTTP exception thrown: Instance a04f4bb0-5809-44b5-bb51-63bd97076afc could not be found. Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-882b4c52-391e-4382-bb09-39e36c7756a4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Request method failure captured: Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc HTTP/1.1 Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14A4ikgrSQW1K5pUSo73dThwRYzu2k9_sjeIqs5ovqlB9_4Zy1V7mYGO_GAlHyzvWmfmnH6ciVgRFLkV9P-fgNmw14JRJJYYnkiLDNPhuDFTllBCcQ7IG9-ZMcY0uyxCGjO5TRMUrrjM17zCBUYSr2zwdJAF7qrFHwfrKEoAiftIqEk Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 6295769a840d437c9deed641966fd143 Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-LiveMigrationTest-684935058 Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:18:39.656706 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:18:39.657954 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6295769a840d437c9deed641966fd143"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6295769a840d437c9deed641966fd143"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6295769a840d437c9deed641966fd143", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6295769a840d437c9deed641966fd143"}]}] Jul 20 04:18:39.657954 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-LiveMigrationTest-684935058 Jul 20 04:18:39.657954 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 6295769a840d437c9deed641966fd143 Jul 20 04:18:39.657954 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-LiveMigrationTest-684935058 Jul 20 04:18:39.657954 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-LiveMigrationTest-684935058-project Jul 20 04:18:39.657954 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:18:39.657954 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:18:39.657954 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 106afc4bcfc04122b9afb3cc2b17cc03 Jul 20 04:18:39.657954 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-LiveMigrationTest-684935058-project Jul 20 04:18:39.657954 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:18:39.657954 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance a04f4bb0-5809-44b5-bb51-63bd97076afc could not be found. Jul 20 04:18:39.657954 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'a04f4bb0-5809-44b5-bb51-63bd97076afc'} Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a04f4bb0-5809-44b5-bb51-63bd97076afc could not be found. Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:39.658681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:39.659821 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:39.659821 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:39.659821 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:39.659821 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:39.659821 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:39.659821 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:39.659821 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:39.659821 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a04f4bb0-5809-44b5-bb51-63bd97076afc could not be found. Jul 20 04:18:39.659821 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:39.659821 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:39.659821 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:39.659821 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:39.659821 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:39.659821 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:39.659821 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:39.659821 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:39.659821 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a04f4bb0-5809-44b5-bb51-63bd97076afc could not be found. Jul 20 04:18:39.659821 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:39.664554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-882b4c52-391e-4382-bb09-39e36c7756a4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Returning 404 to user: Instance a04f4bb0-5809-44b5-bb51-63bd97076afc could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:39.665874 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-882b4c52-391e-4382-bb09-39e36c7756a4 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc" status: 404 len: 111 microversion: 2.1 time: 0.059804 Jul 20 04:18:39.666992 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1138/2137] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:39 2022] GET /compute/v2.1/servers/a04f4bb0-5809-44b5-bb51-63bd97076afc => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:39.686473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9acd684d-947b-41f7-b66a-d3edd399e122 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:39.686883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9acd684d-947b-41f7-b66a-d3edd399e122 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:39.694349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9acd684d-947b-41f7-b66a-d3edd399e122 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.701022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9acd684d-947b-41f7-b66a-d3edd399e122 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.702142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9acd684d-947b-41f7-b66a-d3edd399e122 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.702887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9acd684d-947b-41f7-b66a-d3edd399e122 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.706195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-cf2e0e40-8480-47bc-9a44-edd1e8ee2cd7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Getting quotas for project 2c925e4a93c3401fa5f4d51e7380b7ad. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:39.720901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-cf2e0e40-8480-47bc-9a44-edd1e8ee2cd7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Getting quotas for user feb531c9e5dd4afd99f2974848a6a75b and project 2c925e4a93c3401fa5f4d51e7380b7ad. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:39.755781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9acd684d-947b-41f7-b66a-d3edd399e122 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:39.793692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cf2e0e40-8480-47bc-9a44-edd1e8ee2cd7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:39.799571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cf2e0e40-8480-47bc-9a44-edd1e8ee2cd7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:39.945775 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9acd684d-947b-41f7-b66a-d3edd399e122 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 204 len: 0 microversion: 2.1 time: 0.273889 Jul 20 04:18:39.947489 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1139/2138] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:39 2022] DELETE /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:18:39.955988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-22855e13-38c8-4a9f-8c1a-e6f47a7ded4e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:39.960312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-22855e13-38c8-4a9f-8c1a-e6f47a7ded4e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:39.975945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22855e13-38c8-4a9f-8c1a-e6f47a7ded4e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.976739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22855e13-38c8-4a9f-8c1a-e6f47a7ded4e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.985468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22855e13-38c8-4a9f-8c1a-e6f47a7ded4e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.986260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22855e13-38c8-4a9f-8c1a-e6f47a7ded4e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.019385 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cf2e0e40-8480-47bc-9a44-edd1e8ee2cd7 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.473871 Jul 20 04:18:40.020089 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1000/2139] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:18:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:18:40.042726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6ac8bffe-a748-4e2c-b538-9734a9a29f41 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:40.049863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6ac8bffe-a748-4e2c-b538-9734a9a29f41 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:40.366783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6ac8bffe-a748-4e2c-b538-9734a9a29f41 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.385716 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6ac8bffe-a748-4e2c-b538-9734a9a29f41 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 200 len: 1208 microversion: 2.1 time: 0.355486 Jul 20 04:18:40.393632 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1001/2140] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:40 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 1208 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:40.401235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-22855e13-38c8-4a9f-8c1a-e6f47a7ded4e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.411652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0299787e-e18b-41ff-8da4-3beeefff298e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:40.412322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0299787e-e18b-41ff-8da4-3beeefff298e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:40.419495 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-22855e13-38c8-4a9f-8c1a-e6f47a7ded4e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1499 microversion: 2.1 time: 0.467799 Jul 20 04:18:40.432216 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1140/2141] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:39 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1499 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:40.442315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0299787e-e18b-41ff-8da4-3beeefff298e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.444210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0299787e-e18b-41ff-8da4-3beeefff298e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.446628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0299787e-e18b-41ff-8da4-3beeefff298e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.447250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0299787e-e18b-41ff-8da4-3beeefff298e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.667502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0299787e-e18b-41ff-8da4-3beeefff298e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317e1c9f0eda4534aab1e18a72e7540a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9884530484da7acd3b52a3e9567d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.691348 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0299787e-e18b-41ff-8da4-3beeefff298e tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3" status: 200 len: 1611 microversion: 2.1 time: 0.296315 Jul 20 04:18:40.697110 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1002/2142] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:40 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3 => generated 1611 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:40.803620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-f74e7217-5ae7-43cb-b8da-0217e546bfcc req-7fea1031-1f77-427a-a448-1744cba8a411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9170bb-33df-43d7-b35f-1d846da620d3", "name": "network-vif-deleted", "tag": "08cf3082-9efd-4024-be41-ac9e072b2995"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:40.844917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f74e7217-5ae7-43cb-b8da-0217e546bfcc req-7fea1031-1f77-427a-a448-1744cba8a411 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.845362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f74e7217-5ae7-43cb-b8da-0217e546bfcc req-7fea1031-1f77-427a-a448-1744cba8a411 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.906968 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-f74e7217-5ae7-43cb-b8da-0217e546bfcc req-7fea1031-1f77-427a-a448-1744cba8a411 service nova] Creating event network-vif-deleted:08cf3082-9efd-4024-be41-ac9e072b2995 for instance ee9170bb-33df-43d7-b35f-1d846da620d3 on n-h2-826526-5 Jul 20 04:18:40.924424 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-f74e7217-5ae7-43cb-b8da-0217e546bfcc req-7fea1031-1f77-427a-a448-1744cba8a411 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131299 Jul 20 04:18:40.928028 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1141/2143] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:41.413982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-60b2a014-8d95-4dfc-a7d4-61cb02a93fa2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:41.414901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-60b2a014-8d95-4dfc-a7d4-61cb02a93fa2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:41.431982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-60b2a014-8d95-4dfc-a7d4-61cb02a93fa2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.432817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-60b2a014-8d95-4dfc-a7d4-61cb02a93fa2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.436365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-60b2a014-8d95-4dfc-a7d4-61cb02a93fa2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.438233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-60b2a014-8d95-4dfc-a7d4-61cb02a93fa2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.438362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-600ad542-bbb0-4ce5-b8fb-1e761f2ec73e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:41.439090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-600ad542-bbb0-4ce5-b8fb-1e761f2ec73e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:41.452428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-600ad542-bbb0-4ce5-b8fb-1e761f2ec73e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.453067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-600ad542-bbb0-4ce5-b8fb-1e761f2ec73e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.455695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-600ad542-bbb0-4ce5-b8fb-1e761f2ec73e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.464241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-600ad542-bbb0-4ce5-b8fb-1e761f2ec73e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.765670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-600ad542-bbb0-4ce5-b8fb-1e761f2ec73e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:41.789595 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-600ad542-bbb0-4ce5-b8fb-1e761f2ec73e tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1499 microversion: 2.1 time: 0.356184 Jul 20 04:18:41.791182 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1142/2144] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:41 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1499 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:41.798107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-ceaf10b3-8c35-489c-a512-257f010c1993 req-2263d879-95b8-4f6a-add3-7e992e6a541d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a02cfafe-ca57-4211-bd4e-287672a73ea9", "name": "network-vif-unplugged", "status": "completed", "tag": "e80289a8-2b86-4831-85b3-4562ecf108c7"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:41.810296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ceaf10b3-8c35-489c-a512-257f010c1993 req-2263d879-95b8-4f6a-add3-7e992e6a541d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.811178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ceaf10b3-8c35-489c-a512-257f010c1993 req-2263d879-95b8-4f6a-add3-7e992e6a541d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.828786 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-ceaf10b3-8c35-489c-a512-257f010c1993 req-2263d879-95b8-4f6a-add3-7e992e6a541d service nova] Creating event network-vif-unplugged:e80289a8-2b86-4831-85b3-4562ecf108c7 for instance a02cfafe-ca57-4211-bd4e-287672a73ea9 on n-h2-826526-5 Jul 20 04:18:41.834273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-60b2a014-8d95-4dfc-a7d4-61cb02a93fa2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:41.834981 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-ceaf10b3-8c35-489c-a512-257f010c1993 req-2263d879-95b8-4f6a-add3-7e992e6a541d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042310 Jul 20 04:18:41.835836 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1143/2145] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:41.843275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-36777a17-5fa1-4a4a-a151-6c33f6cb3b48 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:41.844184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-36777a17-5fa1-4a4a-a151-6c33f6cb3b48 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] [instance: ee9170bb-33df-43d7-b35f-1d846da620d3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:41.855085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36777a17-5fa1-4a4a-a151-6c33f6cb3b48 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.856020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36777a17-5fa1-4a4a-a151-6c33f6cb3b48 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.859254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36777a17-5fa1-4a4a-a151-6c33f6cb3b48 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.860017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36777a17-5fa1-4a4a-a151-6c33f6cb3b48 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.860971 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-60b2a014-8d95-4dfc-a7d4-61cb02a93fa2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 200 len: 1260 microversion: 2.1 time: 0.452853 Jul 20 04:18:41.863478 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1003/2146] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:41 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 1260 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:41.891252 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-36777a17-5fa1-4a4a-a151-6c33f6cb3b48 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] HTTP exception thrown: Instance ee9170bb-33df-43d7-b35f-1d846da620d3 could not be found. Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-36777a17-5fa1-4a4a-a151-6c33f6cb3b48 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Request method failure captured: Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3 HTTP/1.1 Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14FlJ4L4ihsp-U77OpV_ADJJFwzj9ywn0Pj1Ia0HXq5HxxZQyN74rOTcj4Vb5-MPHfEYty8Cr6XyUgzc1yltv5yodChXAZMWfDVH9MIwSgu2X6-jMF---yNypfQXv5pxPL8N26TieJJUjGbPp3bs2vFFt6jJiHyJmxS3FR7x6NA_Sg0 Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 5ac9884530484da7acd3b52a3e9567d5 Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-VolumesAdminNegativeTest-3052417 Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:18:41.895303 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:18:41.897252 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ac9884530484da7acd3b52a3e9567d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5ac9884530484da7acd3b52a3e9567d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5ac9884530484da7acd3b52a3e9567d5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ac9884530484da7acd3b52a3e9567d5"}]}] Jul 20 04:18:41.897252 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-VolumesAdminNegativeTest-3052417 Jul 20 04:18:41.897252 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 5ac9884530484da7acd3b52a3e9567d5 Jul 20 04:18:41.897252 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-3052417 Jul 20 04:18:41.897252 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-VolumesAdminNegativeTest-3052417-project Jul 20 04:18:41.897252 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:18:41.897252 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:18:41.897252 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 317e1c9f0eda4534aab1e18a72e7540a Jul 20 04:18:41.897252 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-VolumesAdminNegativeTest-3052417-project Jul 20 04:18:41.897252 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:18:41.897252 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance ee9170bb-33df-43d7-b35f-1d846da620d3 could not be found. Jul 20 04:18:41.897252 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'ee9170bb-33df-43d7-b35f-1d846da620d3'} Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee9170bb-33df-43d7-b35f-1d846da620d3 could not be found. Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:41.897903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:41.898952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:41.898952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:41.898952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:41.898952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:41.898952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:41.898952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:41.898952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:41.898952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee9170bb-33df-43d7-b35f-1d846da620d3 could not be found. Jul 20 04:18:41.898952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:41.898952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:41.898952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:41.898952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:41.898952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:41.898952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:41.898952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:41.898952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:41.898952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee9170bb-33df-43d7-b35f-1d846da620d3 could not be found. Jul 20 04:18:41.898952 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:18:41.900491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-36777a17-5fa1-4a4a-a151-6c33f6cb3b48 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Returning 404 to user: Instance ee9170bb-33df-43d7-b35f-1d846da620d3 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:41.902623 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-36777a17-5fa1-4a4a-a151-6c33f6cb3b48 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3" status: 404 len: 111 microversion: 2.1 time: 0.065497 Jul 20 04:18:41.906748 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1144/2147] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:41 2022] GET /compute/v2.1/servers/ee9170bb-33df-43d7-b35f-1d846da620d3 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:41.914028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1f95a162-15bc-4d2a-8338-15e3cf21db13 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] Calling method '.version_select at 0x7f06bdde9790>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:41.950304 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1f95a162-15bc-4d2a-8338-15e3cf21db13 tempest-VolumesAdminNegativeTest-3052417 tempest-VolumesAdminNegativeTest-3052417-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-95203804" status: 202 len: 0 microversion: 2.1 time: 0.040791 Jul 20 04:18:41.950973 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1004/2148] 10.222.0.17 () {58 vars in 1214 bytes} [Wed Jul 20 04:18:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-95203804 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:18:42.564090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7c125ab6-ba8a-48da-8712-c18b8b793649 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-174879468", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": "none"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:42.612321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-160bbabb-182f-448a-939e-82d874bf17ee req-59dda999-6546-48e5-a213-2abc1ca2d77d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a02cfafe-ca57-4211-bd4e-287672a73ea9", "name": "network-vif-deleted", "tag": "e80289a8-2b86-4831-85b3-4562ecf108c7"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:42.650073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-160bbabb-182f-448a-939e-82d874bf17ee req-59dda999-6546-48e5-a213-2abc1ca2d77d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.651803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-160bbabb-182f-448a-939e-82d874bf17ee req-59dda999-6546-48e5-a213-2abc1ca2d77d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.691853 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-160bbabb-182f-448a-939e-82d874bf17ee req-59dda999-6546-48e5-a213-2abc1ca2d77d service nova] Creating event network-vif-deleted:e80289a8-2b86-4831-85b3-4562ecf108c7 for instance a02cfafe-ca57-4211-bd4e-287672a73ea9 on n-h2-826526-5 Jul 20 04:18:42.698728 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-160bbabb-182f-448a-939e-82d874bf17ee req-59dda999-6546-48e5-a213-2abc1ca2d77d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111842 Jul 20 04:18:42.708030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-7c125ab6-ba8a-48da-8712-c18b8b793649 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:42.708798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-7c125ab6-ba8a-48da-8712-c18b8b793649 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:42.709785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-7c125ab6-ba8a-48da-8712-c18b8b793649 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:42.710445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-7c125ab6-ba8a-48da-8712-c18b8b793649 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:42.711852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-7c125ab6-ba8a-48da-8712-c18b8b793649 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:42.712552 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1005/2149] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:18:42.722384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c125ab6-ba8a-48da-8712-c18b8b793649 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.723056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c125ab6-ba8a-48da-8712-c18b8b793649 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.724330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c125ab6-ba8a-48da-8712-c18b8b793649 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.725387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c125ab6-ba8a-48da-8712-c18b8b793649 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.768756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-7c125ab6-ba8a-48da-8712-c18b8b793649 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Getting quotas for project becf6f1f28854a64817a7e7d80c6e8ac. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:42.776678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-7c125ab6-ba8a-48da-8712-c18b8b793649 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Getting quotas for user 93b1b595bde24757beec1c8c572491ab and project becf6f1f28854a64817a7e7d80c6e8ac. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:42.798324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7c125ab6-ba8a-48da-8712-c18b8b793649 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:42.815092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bc599448-9971-4b8d-b555-3d1885618a8c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:42.815924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bc599448-9971-4b8d-b555-3d1885618a8c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:42.821690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7c125ab6-ba8a-48da-8712-c18b8b793649 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:42.830719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc599448-9971-4b8d-b555-3d1885618a8c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.831174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc599448-9971-4b8d-b555-3d1885618a8c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.833149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc599448-9971-4b8d-b555-3d1885618a8c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.833593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc599448-9971-4b8d-b555-3d1885618a8c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.990592 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7c125ab6-ba8a-48da-8712-c18b8b793649 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.913328 Jul 20 04:18:42.991147 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1145/2150] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 04:18:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:18:43.031042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dfe84867-e292-46b7-8f26-0d1b56376b4f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:43.031679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dfe84867-e292-46b7-8f26-0d1b56376b4f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:43.060252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dfe84867-e292-46b7-8f26-0d1b56376b4f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.060748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dfe84867-e292-46b7-8f26-0d1b56376b4f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.061574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dfe84867-e292-46b7-8f26-0d1b56376b4f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.062021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dfe84867-e292-46b7-8f26-0d1b56376b4f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.219325 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bc599448-9971-4b8d-b555-3d1885618a8c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106afc4bcfc04122b9afb3cc2b17cc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6295769a840d437c9deed641966fd143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.256655 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bc599448-9971-4b8d-b555-3d1885618a8c tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 200 len: 1457 microversion: 2.1 time: 0.446275 Jul 20 04:18:43.261530 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1006/2151] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:42 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 1457 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:43.282193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0003661f-49c9-458e-ad12-f5d4f0c84eb5 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:43.285762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0003661f-49c9-458e-ad12-f5d4f0c84eb5 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:43.330576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:43.339941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dfe84867-e292-46b7-8f26-0d1b56376b4f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.348595 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dfe84867-e292-46b7-8f26-0d1b56376b4f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 200 len: 1266 microversion: 2.1 time: 0.345901 Jul 20 04:18:43.359338 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1146/2152] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:42 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 1266 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:43.669954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0003661f-49c9-458e-ad12-f5d4f0c84eb5 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.683668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0003661f-49c9-458e-ad12-f5d4f0c84eb5 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.685902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0003661f-49c9-458e-ad12-f5d4f0c84eb5 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.701978 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0003661f-49c9-458e-ad12-f5d4f0c84eb5 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "PUT /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1358 microversion: 2.75 time: 0.438752 Jul 20 04:18:43.702874 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1007/2153] 10.222.0.17 () {62 vars in 1296 bytes} [Wed Jul 20 04:18:43 2022] PUT /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1358 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:43.727908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f7da7f48-9594-48cb-836b-d8700e21a1db tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:43.729525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f7da7f48-9594-48cb-836b-d8700e21a1db tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:43.919754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f7da7f48-9594-48cb-836b-d8700e21a1db tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.929866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f7da7f48-9594-48cb-836b-d8700e21a1db tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.936238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f7da7f48-9594-48cb-836b-d8700e21a1db tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.946474 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f7da7f48-9594-48cb-836b-d8700e21a1db tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1358 microversion: 2.75 time: 0.228840 Jul 20 04:18:43.947811 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1147/2154] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:43 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:44.280023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-93ffbc44-bf91-47bc-8796-8c36eaa23493 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:44.281498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-93ffbc44-bf91-47bc-8796-8c36eaa23493 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] [instance: c1a020af-3235-4739-bf57-bea531fa53ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:44.288946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93ffbc44-bf91-47bc-8796-8c36eaa23493 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.290075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93ffbc44-bf91-47bc-8796-8c36eaa23493 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.291069 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93ffbc44-bf91-47bc-8796-8c36eaa23493 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.291739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93ffbc44-bf91-47bc-8796-8c36eaa23493 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.327256 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-93ffbc44-bf91-47bc-8796-8c36eaa23493 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] HTTP exception thrown: Instance c1a020af-3235-4739-bf57-bea531fa53ca could not be found. Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-93ffbc44-bf91-47bc-8796-8c36eaa23493 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Request method failure captured: Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca HTTP/1.1 Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14A4ikgrSQW1K5pUSo73dThwRYzu2k9_sjeIqs5ovqlB9_4Zy1V7mYGO_GAlHyzvWmfmnH6ciVgRFLkV9P-fgNmw14JRJJYYnkiLDNPhuDFTllBCcQ7IG9-ZMcY0uyxCGjO5TRMUrrjM17zCBUYSr2zwdJAF7qrFHwfrKEoAiftIqEk Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 6295769a840d437c9deed641966fd143 Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-LiveMigrationTest-684935058 Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:18:44.332154 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:18:44.333655 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6295769a840d437c9deed641966fd143"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6295769a840d437c9deed641966fd143"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6295769a840d437c9deed641966fd143", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6295769a840d437c9deed641966fd143"}]}] Jul 20 04:18:44.333655 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-LiveMigrationTest-684935058 Jul 20 04:18:44.333655 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 6295769a840d437c9deed641966fd143 Jul 20 04:18:44.333655 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-LiveMigrationTest-684935058 Jul 20 04:18:44.333655 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-LiveMigrationTest-684935058-project Jul 20 04:18:44.333655 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:18:44.333655 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:18:44.333655 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 106afc4bcfc04122b9afb3cc2b17cc03 Jul 20 04:18:44.333655 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-LiveMigrationTest-684935058-project Jul 20 04:18:44.333655 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:18:44.333655 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance c1a020af-3235-4739-bf57-bea531fa53ca could not be found. Jul 20 04:18:44.333655 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'c1a020af-3235-4739-bf57-bea531fa53ca'} Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1a020af-3235-4739-bf57-bea531fa53ca could not be found. Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:44.334589 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:44.335763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:44.335763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:44.335763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:44.335763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:44.335763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:44.335763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:44.335763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:44.335763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1a020af-3235-4739-bf57-bea531fa53ca could not be found. Jul 20 04:18:44.335763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:44.335763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:44.335763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:44.335763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:44.335763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:44.335763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:44.335763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:44.335763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:44.335763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1a020af-3235-4739-bf57-bea531fa53ca could not be found. Jul 20 04:18:44.335763 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:18:44.336717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-93ffbc44-bf91-47bc-8796-8c36eaa23493 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] Returning 404 to user: Instance c1a020af-3235-4739-bf57-bea531fa53ca could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:44.337277 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-93ffbc44-bf91-47bc-8796-8c36eaa23493 tempest-LiveMigrationTest-684935058 tempest-LiveMigrationTest-684935058-project] 10.222.0.17 "GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca" status: 404 len: 111 microversion: 2.1 time: 0.062246 Jul 20 04:18:44.341464 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1008/2155] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:44 2022] GET /compute/v2.1/servers/c1a020af-3235-4739-bf57-bea531fa53ca => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:44.369045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-826e67d4-3a32-4b3f-bf14-577221710292 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:44.369286 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-826e67d4-3a32-4b3f-bf14-577221710292 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:44.397499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-826e67d4-3a32-4b3f-bf14-577221710292 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.405511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-826e67d4-3a32-4b3f-bf14-577221710292 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.412462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-826e67d4-3a32-4b3f-bf14-577221710292 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.412922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-826e67d4-3a32-4b3f-bf14-577221710292 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.652868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-826e67d4-3a32-4b3f-bf14-577221710292 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.667146 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-826e67d4-3a32-4b3f-bf14-577221710292 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 200 len: 1266 microversion: 2.1 time: 0.303948 Jul 20 04:18:44.671110 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1148/2156] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:44 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:44.820147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-a58276ce-3615-430a-8ed2-64522721fb21 req-4e7bf11f-ec83-49b3-a496-aa2ba51a69a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a020af-3235-4739-bf57-bea531fa53ca", "name": "network-vif-deleted", "tag": "eedf651b-ee24-4854-9080-987fdef37537"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:44.841155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a58276ce-3615-430a-8ed2-64522721fb21 req-4e7bf11f-ec83-49b3-a496-aa2ba51a69a4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.841800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a58276ce-3615-430a-8ed2-64522721fb21 req-4e7bf11f-ec83-49b3-a496-aa2ba51a69a4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.859345 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-a58276ce-3615-430a-8ed2-64522721fb21 req-4e7bf11f-ec83-49b3-a496-aa2ba51a69a4 service nova] Creating event network-vif-deleted:eedf651b-ee24-4854-9080-987fdef37537 for instance c1a020af-3235-4739-bf57-bea531fa53ca on n-h2-826526-5 Jul 20 04:18:44.877296 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-a58276ce-3615-430a-8ed2-64522721fb21 req-4e7bf11f-ec83-49b3-a496-aa2ba51a69a4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060951 Jul 20 04:18:44.878906 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1009/2157] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:44.966268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cc99d4b5-e3da-4654-ad21-328fda5b75db tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:44.967474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cc99d4b5-e3da-4654-ad21-328fda5b75db tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:44.978212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc99d4b5-e3da-4654-ad21-328fda5b75db tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.985074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc99d4b5-e3da-4654-ad21-328fda5b75db tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.986334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc99d4b5-e3da-4654-ad21-328fda5b75db tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.986932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc99d4b5-e3da-4654-ad21-328fda5b75db tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.405706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cc99d4b5-e3da-4654-ad21-328fda5b75db tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:45.419366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cc99d4b5-e3da-4654-ad21-328fda5b75db tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:45.421334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cc99d4b5-e3da-4654-ad21-328fda5b75db tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:45.429143 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cc99d4b5-e3da-4654-ad21-328fda5b75db tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1418 microversion: 2.75 time: 0.466648 Jul 20 04:18:45.440463 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1149/2158] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:44 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1418 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:45.688576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9275acd1-e298-47cb-8d59-3a7aa69b7a99 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:45.689795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9275acd1-e298-47cb-8d59-3a7aa69b7a99 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:45.701119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9275acd1-e298-47cb-8d59-3a7aa69b7a99 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.703173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9275acd1-e298-47cb-8d59-3a7aa69b7a99 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.705977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9275acd1-e298-47cb-8d59-3a7aa69b7a99 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.709087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9275acd1-e298-47cb-8d59-3a7aa69b7a99 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.350177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9275acd1-e298-47cb-8d59-3a7aa69b7a99 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.371465 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9275acd1-e298-47cb-8d59-3a7aa69b7a99 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 200 len: 1308 microversion: 2.1 time: 0.683819 Jul 20 04:18:46.378281 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1010/2159] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:45 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 1308 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:46.451706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cc158fab-9e06-41a4-b727-f87488df4b8c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:46.455290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cc158fab-9e06-41a4-b727-f87488df4b8c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:46.485020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc158fab-9e06-41a4-b727-f87488df4b8c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.485692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc158fab-9e06-41a4-b727-f87488df4b8c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.486730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc158fab-9e06-41a4-b727-f87488df4b8c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.487162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc158fab-9e06-41a4-b727-f87488df4b8c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.921219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cc158fab-9e06-41a4-b727-f87488df4b8c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.939540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cc158fab-9e06-41a4-b727-f87488df4b8c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.944443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cc158fab-9e06-41a4-b727-f87488df4b8c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.961236 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cc158fab-9e06-41a4-b727-f87488df4b8c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1416 microversion: 2.75 time: 0.514387 Jul 20 04:18:46.962267 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1150/2160] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:46 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1416 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:47.391958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-38a5a4db-acd6-4bba-8093-9d2cc5f1c4c6 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.393483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-38a5a4db-acd6-4bba-8093-9d2cc5f1c4c6 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:47.412690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38a5a4db-acd6-4bba-8093-9d2cc5f1c4c6 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.413220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38a5a4db-acd6-4bba-8093-9d2cc5f1c4c6 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.415195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38a5a4db-acd6-4bba-8093-9d2cc5f1c4c6 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.415640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38a5a4db-acd6-4bba-8093-9d2cc5f1c4c6 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.983989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ff446fab-f8b0-432e-af44-9f1b1f4f61b0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.986507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ff446fab-f8b0-432e-af44-9f1b1f4f61b0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.002160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff446fab-f8b0-432e-af44-9f1b1f4f61b0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.002977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff446fab-f8b0-432e-af44-9f1b1f4f61b0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.006473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff446fab-f8b0-432e-af44-9f1b1f4f61b0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.007174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff446fab-f8b0-432e-af44-9f1b1f4f61b0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.248481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-38a5a4db-acd6-4bba-8093-9d2cc5f1c4c6 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.262121 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-38a5a4db-acd6-4bba-8093-9d2cc5f1c4c6 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 200 len: 1308 microversion: 2.1 time: 0.874746 Jul 20 04:18:48.263262 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1011/2161] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:47 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 1308 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:48.265175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ff446fab-f8b0-432e-af44-9f1b1f4f61b0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.274680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ff446fab-f8b0-432e-af44-9f1b1f4f61b0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.279740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ff446fab-f8b0-432e-af44-9f1b1f4f61b0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.290795 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ff446fab-f8b0-432e-af44-9f1b1f4f61b0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1437 microversion: 2.75 time: 0.311724 Jul 20 04:18:48.292149 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1151/2162] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:47 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1437 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:48.310594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:48.312409 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.319116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.319789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.320755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.321338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.435526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:48.436151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:48.436600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:48.439443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:48.439675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:48.527964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.535122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.535579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.536926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.537388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.792772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.806829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.819218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.829348 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0e7f749a-ca7e-44c1-9c69-b931ad6660c6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "POST /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60/action" status: 202 len: 1494 microversion: 2.75 time: 0.522688 Jul 20 04:18:48.850351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-784c1a6e-e0b3-4399-8a5e-8e6d2627d130 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:48.850974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-784c1a6e-e0b3-4399-8a5e-8e6d2627d130 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.857607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-784c1a6e-e0b3-4399-8a5e-8e6d2627d130 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.858062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-784c1a6e-e0b3-4399-8a5e-8e6d2627d130 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.858855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-784c1a6e-e0b3-4399-8a5e-8e6d2627d130 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.859294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-784c1a6e-e0b3-4399-8a5e-8e6d2627d130 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.860367 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1012/2163] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jul 20 04:18:48 2022] POST /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60/action => generated 1494 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 04:18:49.279285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c3e4ca56-33cf-42ff-a00e-8b89420aaaeb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:49.279910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c3e4ca56-33cf-42ff-a00e-8b89420aaaeb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:49.292513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3e4ca56-33cf-42ff-a00e-8b89420aaaeb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.292963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3e4ca56-33cf-42ff-a00e-8b89420aaaeb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.293759 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3e4ca56-33cf-42ff-a00e-8b89420aaaeb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.294195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3e4ca56-33cf-42ff-a00e-8b89420aaaeb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.440216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-784c1a6e-e0b3-4399-8a5e-8e6d2627d130 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:49.449070 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-784c1a6e-e0b3-4399-8a5e-8e6d2627d130 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:49.450620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-784c1a6e-e0b3-4399-8a5e-8e6d2627d130 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:49.467274 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-784c1a6e-e0b3-4399-8a5e-8e6d2627d130 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 0.620944 Jul 20 04:18:49.479639 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1152/2164] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:48 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:49.671089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:50.132449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-8bfa3d01-4a1b-4663-adee-e885636b7efd req-3108b77c-9fd1-46d9-95a4-1b172d54eade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d91e537-1321-48d1-b48c-30fe2537df3c", "tag": "89f9237c-b54d-48b3-8ad3-31664a5a3cdd"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:50.159942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8bfa3d01-4a1b-4663-adee-e885636b7efd req-3108b77c-9fd1-46d9-95a4-1b172d54eade service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.161129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8bfa3d01-4a1b-4663-adee-e885636b7efd req-3108b77c-9fd1-46d9-95a4-1b172d54eade service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.179386 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-8bfa3d01-4a1b-4663-adee-e885636b7efd req-3108b77c-9fd1-46d9-95a4-1b172d54eade service nova] Creating event network-changed:89f9237c-b54d-48b3-8ad3-31664a5a3cdd for instance 0d91e537-1321-48d1-b48c-30fe2537df3c on n-h1-826526-5 Jul 20 04:18:50.188915 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-8bfa3d01-4a1b-4663-adee-e885636b7efd req-3108b77c-9fd1-46d9-95a4-1b172d54eade service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060356 Jul 20 04:18:50.189949 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1153/2165] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:18:50.213771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c3e4ca56-33cf-42ff-a00e-8b89420aaaeb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:50.229676 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c3e4ca56-33cf-42ff-a00e-8b89420aaaeb tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 200 len: 1308 microversion: 2.1 time: 0.954208 Jul 20 04:18:50.231323 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1013/2166] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:49 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 1308 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:50.487507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5fd4fb8a-522e-4542-bb4c-cf2e270ac84a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:50.488347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5fd4fb8a-522e-4542-bb4c-cf2e270ac84a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:50.502491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5fd4fb8a-522e-4542-bb4c-cf2e270ac84a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.503103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5fd4fb8a-522e-4542-bb4c-cf2e270ac84a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.504539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5fd4fb8a-522e-4542-bb4c-cf2e270ac84a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.505140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5fd4fb8a-522e-4542-bb4c-cf2e270ac84a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.829753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5fd4fb8a-522e-4542-bb4c-cf2e270ac84a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:50.847682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5fd4fb8a-522e-4542-bb4c-cf2e270ac84a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:50.849361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5fd4fb8a-522e-4542-bb4c-cf2e270ac84a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:50.877678 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5fd4fb8a-522e-4542-bb4c-cf2e270ac84a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 0.393818 Jul 20 04:18:50.889001 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1154/2167] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:50 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:51.251676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4240e627-0627-42a3-875e-7c6dcf03f618 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:51.254117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4240e627-0627-42a3-875e-7c6dcf03f618 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:51.268684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4240e627-0627-42a3-875e-7c6dcf03f618 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.272508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4240e627-0627-42a3-875e-7c6dcf03f618 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.278451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4240e627-0627-42a3-875e-7c6dcf03f618 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.279271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4240e627-0627-42a3-875e-7c6dcf03f618 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.676179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4240e627-0627-42a3-875e-7c6dcf03f618 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:51.703261 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4240e627-0627-42a3-875e-7c6dcf03f618 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 200 len: 1308 microversion: 2.1 time: 0.456095 Jul 20 04:18:51.704309 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1014/2168] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:51 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 1308 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:51.899164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-46d9a835-de76-4c2d-b700-ff9214aba0f0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:51.899817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-46d9a835-de76-4c2d-b700-ff9214aba0f0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:51.917611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46d9a835-de76-4c2d-b700-ff9214aba0f0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.922053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46d9a835-de76-4c2d-b700-ff9214aba0f0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.922053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46d9a835-de76-4c2d-b700-ff9214aba0f0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.922791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46d9a835-de76-4c2d-b700-ff9214aba0f0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.971490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:52.069322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-46d9a835-de76-4c2d-b700-ff9214aba0f0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:52.084783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-46d9a835-de76-4c2d-b700-ff9214aba0f0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:52.087951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-46d9a835-de76-4c2d-b700-ff9214aba0f0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:52.105149 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-46d9a835-de76-4c2d-b700-ff9214aba0f0 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 0.210031 Jul 20 04:18:52.118681 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1155/2169] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:51 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:52.723435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a0854319-2799-4e92-967d-b944db83259d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:52.724008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a0854319-2799-4e92-967d-b944db83259d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:52.745211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0854319-2799-4e92-967d-b944db83259d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.754102 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0854319-2799-4e92-967d-b944db83259d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.759426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0854319-2799-4e92-967d-b944db83259d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.761106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0854319-2799-4e92-967d-b944db83259d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.133370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0ae38b7a-caa3-4ecb-9602-285d9e414e19 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:53.134586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0ae38b7a-caa3-4ecb-9602-285d9e414e19 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:53.139095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:53.150882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ae38b7a-caa3-4ecb-9602-285d9e414e19 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.151561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ae38b7a-caa3-4ecb-9602-285d9e414e19 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.152860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ae38b7a-caa3-4ecb-9602-285d9e414e19 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.153699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ae38b7a-caa3-4ecb-9602-285d9e414e19 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.248577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a0854319-2799-4e92-967d-b944db83259d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:53.258833 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a0854319-2799-4e92-967d-b944db83259d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 200 len: 1308 microversion: 2.1 time: 0.541814 Jul 20 04:18:53.259437 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1015/2170] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:52 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 1308 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:53.766095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0ae38b7a-caa3-4ecb-9602-285d9e414e19 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:53.775052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0ae38b7a-caa3-4ecb-9602-285d9e414e19 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:53.776582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0ae38b7a-caa3-4ecb-9602-285d9e414e19 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:53.797471 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0ae38b7a-caa3-4ecb-9602-285d9e414e19 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 0.676737 Jul 20 04:18:53.798072 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1156/2171] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:53 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:54.276185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-441e9d18-fa7a-4fc6-91bd-60fd08e07cd1 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:54.278262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-441e9d18-fa7a-4fc6-91bd-60fd08e07cd1 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:54.280692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=10 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:54.291745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-441e9d18-fa7a-4fc6-91bd-60fd08e07cd1 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.298729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-441e9d18-fa7a-4fc6-91bd-60fd08e07cd1 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.300021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-441e9d18-fa7a-4fc6-91bd-60fd08e07cd1 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.300753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-441e9d18-fa7a-4fc6-91bd-60fd08e07cd1 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.779043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-441e9d18-fa7a-4fc6-91bd-60fd08e07cd1 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:54.788609 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-441e9d18-fa7a-4fc6-91bd-60fd08e07cd1 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 200 len: 1308 microversion: 2.1 time: 0.515635 Jul 20 04:18:54.790921 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1016/2172] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:54 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 1308 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:54.820778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-09d1ceaa-416a-4299-a4fe-ce457a159a45 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:54.822126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-09d1ceaa-416a-4299-a4fe-ce457a159a45 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:54.824151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=8 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:54.837502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09d1ceaa-416a-4299-a4fe-ce457a159a45 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.838935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09d1ceaa-416a-4299-a4fe-ce457a159a45 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.839759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09d1ceaa-416a-4299-a4fe-ce457a159a45 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.840196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09d1ceaa-416a-4299-a4fe-ce457a159a45 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.111770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-09d1ceaa-416a-4299-a4fe-ce457a159a45 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:55.127827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-09d1ceaa-416a-4299-a4fe-ce457a159a45 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:55.131429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-09d1ceaa-416a-4299-a4fe-ce457a159a45 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:55.153300 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-09d1ceaa-416a-4299-a4fe-ce457a159a45 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 0.336188 Jul 20 04:18:55.166022 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1157/2173] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:54 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:55.809231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-760cfa9f-fa8b-47b0-b83e-58f1f87b9d54 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:55.809851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-760cfa9f-fa8b-47b0-b83e-58f1f87b9d54 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:55.833134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-760cfa9f-fa8b-47b0-b83e-58f1f87b9d54 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.836126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-760cfa9f-fa8b-47b0-b83e-58f1f87b9d54 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.839534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-760cfa9f-fa8b-47b0-b83e-58f1f87b9d54 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.844024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-760cfa9f-fa8b-47b0-b83e-58f1f87b9d54 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.175495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-007eeb69-f913-4e25-95c3-acef7c4c9cc4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:56.176358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-007eeb69-f913-4e25-95c3-acef7c4c9cc4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:56.194367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-007eeb69-f913-4e25-95c3-acef7c4c9cc4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.195893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-007eeb69-f913-4e25-95c3-acef7c4c9cc4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.197701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-007eeb69-f913-4e25-95c3-acef7c4c9cc4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.199277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-007eeb69-f913-4e25-95c3-acef7c4c9cc4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.317861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-007eeb69-f913-4e25-95c3-acef7c4c9cc4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:56.333342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-007eeb69-f913-4e25-95c3-acef7c4c9cc4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:56.337182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-007eeb69-f913-4e25-95c3-acef7c4c9cc4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:56.351670 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-007eeb69-f913-4e25-95c3-acef7c4c9cc4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 0.181895 Jul 20 04:18:56.363975 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1158/2174] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:56 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:56.692034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-760cfa9f-fa8b-47b0-b83e-58f1f87b9d54 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:56.702103 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-760cfa9f-fa8b-47b0-b83e-58f1f87b9d54 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 200 len: 1308 microversion: 2.1 time: 0.899691 Jul 20 04:18:56.706582 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1017/2175] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:55 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 1308 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:56.814222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-a68efa27-a43c-4d30-8b77-f737e78aaf1a req-67a857b7-f3ac-4514-aaf9-8347950fd154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d91e537-1321-48d1-b48c-30fe2537df3c", "name": "network-vif-plugged", "status": "completed", "tag": "89f9237c-b54d-48b3-8ad3-31664a5a3cdd"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:56.840724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a68efa27-a43c-4d30-8b77-f737e78aaf1a req-67a857b7-f3ac-4514-aaf9-8347950fd154 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.842942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a68efa27-a43c-4d30-8b77-f737e78aaf1a req-67a857b7-f3ac-4514-aaf9-8347950fd154 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.890390 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-a68efa27-a43c-4d30-8b77-f737e78aaf1a req-67a857b7-f3ac-4514-aaf9-8347950fd154 service nova] Creating event network-vif-plugged:89f9237c-b54d-48b3-8ad3-31664a5a3cdd for instance 0d91e537-1321-48d1-b48c-30fe2537df3c on n-h1-826526-5 Jul 20 04:18:56.906234 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-a68efa27-a43c-4d30-8b77-f737e78aaf1a req-67a857b7-f3ac-4514-aaf9-8347950fd154 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098167 Jul 20 04:18:56.909474 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1159/2176] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:57.373338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6a1d2ae7-bb2a-4675-87fd-a0e20d69dda6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:57.373801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6a1d2ae7-bb2a-4675-87fd-a0e20d69dda6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:57.384923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a1d2ae7-bb2a-4675-87fd-a0e20d69dda6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.385386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a1d2ae7-bb2a-4675-87fd-a0e20d69dda6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.386192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a1d2ae7-bb2a-4675-87fd-a0e20d69dda6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.386630 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a1d2ae7-bb2a-4675-87fd-a0e20d69dda6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.420163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:57.725392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ebc1e2ec-1fac-4027-924a-da6bd6b7a8ce tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:57.725392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ebc1e2ec-1fac-4027-924a-da6bd6b7a8ce tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:57.735871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebc1e2ec-1fac-4027-924a-da6bd6b7a8ce tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.738692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebc1e2ec-1fac-4027-924a-da6bd6b7a8ce tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.740782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebc1e2ec-1fac-4027-924a-da6bd6b7a8ce tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.741365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebc1e2ec-1fac-4027-924a-da6bd6b7a8ce tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:58.654447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6a1d2ae7-bb2a-4675-87fd-a0e20d69dda6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:58.665425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6a1d2ae7-bb2a-4675-87fd-a0e20d69dda6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:58.671353 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6a1d2ae7-bb2a-4675-87fd-a0e20d69dda6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:58.687434 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6a1d2ae7-bb2a-4675-87fd-a0e20d69dda6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 1.318027 Jul 20 04:18:58.688052 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1018/2177] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:57 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:58.760906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ebc1e2ec-1fac-4027-924a-da6bd6b7a8ce tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:58.778833 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ebc1e2ec-1fac-4027-924a-da6bd6b7a8ce tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 200 len: 1308 microversion: 2.1 time: 1.061076 Jul 20 04:18:58.780124 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1160/2178] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:57 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 1308 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:59.707231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c60a4496-955b-4ba1-af87-17fd6e62e136 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:59.708672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c60a4496-955b-4ba1-af87-17fd6e62e136 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:59.717816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c60a4496-955b-4ba1-af87-17fd6e62e136 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.719559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c60a4496-955b-4ba1-af87-17fd6e62e136 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.724915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c60a4496-955b-4ba1-af87-17fd6e62e136 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.725671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c60a4496-955b-4ba1-af87-17fd6e62e136 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.799626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-41d5977d-5213-42ea-83b0-42ea7868323b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:59.800474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-41d5977d-5213-42ea-83b0-42ea7868323b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:59.814778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:59.833345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41d5977d-5213-42ea-83b0-42ea7868323b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.834378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41d5977d-5213-42ea-83b0-42ea7868323b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.836331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41d5977d-5213-42ea-83b0-42ea7868323b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.837089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41d5977d-5213-42ea-83b0-42ea7868323b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.031032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c60a4496-955b-4ba1-af87-17fd6e62e136 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:00.041471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c60a4496-955b-4ba1-af87-17fd6e62e136 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:00.043054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c60a4496-955b-4ba1-af87-17fd6e62e136 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:00.058937 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c60a4496-955b-4ba1-af87-17fd6e62e136 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 0.355736 Jul 20 04:19:00.060428 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1019/2179] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:59 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:00.234876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-41d5977d-5213-42ea-83b0-42ea7868323b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:00.250275 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-41d5977d-5213-42ea-83b0-42ea7868323b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 200 len: 1489 microversion: 2.1 time: 0.454630 Jul 20 04:19:00.253625 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1161/2180] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:59 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 1489 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:00.274426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-694469b7-bf34-4920-88f2-d14234eade8f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2066012541"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:00.282393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-694469b7-bf34-4920-88f2-d14234eade8f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:00.296939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-694469b7-bf34-4920-88f2-d14234eade8f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.297413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-694469b7-bf34-4920-88f2-d14234eade8f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.301112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-694469b7-bf34-4920-88f2-d14234eade8f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.301572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-694469b7-bf34-4920-88f2-d14234eade8f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.080418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b5a971c1-1085-453a-ae50-1d19ea3a4609 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:01.081009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b5a971c1-1085-453a-ae50-1d19ea3a4609 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:01.097757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5a971c1-1085-453a-ae50-1d19ea3a4609 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.103860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5a971c1-1085-453a-ae50-1d19ea3a4609 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.106237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5a971c1-1085-453a-ae50-1d19ea3a4609 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.109333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5a971c1-1085-453a-ae50-1d19ea3a4609 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.266353 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-694469b7-bf34-4920-88f2-d14234eade8f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "POST /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c/action" status: 202 len: 0 microversion: 2.1 time: 0.995887 Jul 20 04:19:01.270228 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1020/2181] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:19:00 2022] POST /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c/action => generated 0 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:19:01.292686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b5a971c1-1085-453a-ae50-1d19ea3a4609 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:01.295063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c3d44477-8974-4a37-8219-5e08ebea4330 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bdbab700>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:01.306949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b5a971c1-1085-453a-ae50-1d19ea3a4609 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:01.309618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b5a971c1-1085-453a-ae50-1d19ea3a4609 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:01.342912 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b5a971c1-1085-453a-ae50-1d19ea3a4609 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 0.254433 Jul 20 04:19:01.348053 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1162/2182] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:01 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:01.391622 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c3d44477-8974-4a37-8219-5e08ebea4330 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/6489b8b6-c2af-4d54-a507-4805d5c55761" status: 200 len: 1412 microversion: 2.1 time: 0.114361 Jul 20 04:19:01.393054 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1021/2183] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:01 2022] GET /compute/v2.1/images/6489b8b6-c2af-4d54-a507-4805d5c55761 => generated 1412 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:01.405146 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e947cd49-73b9-4b86-88ec-2a5ce9f38c44 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bda673a0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:01.482956 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e947cd49-73b9-4b86-88ec-2a5ce9f38c44 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/6489b8b6-c2af-4d54-a507-4805d5c55761" status: 200 len: 1412 microversion: 2.1 time: 0.082420 Jul 20 04:19:01.484039 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1163/2184] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:01 2022] GET /compute/v2.1/images/6489b8b6-c2af-4d54-a507-4805d5c55761 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:01.497190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf9a4e00-9f02-474a-8b54-ecde3d20e961 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bdbabdc0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:01.791897 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf9a4e00-9f02-474a-8b54-ecde3d20e961 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "DELETE /compute/v2.1/images/6489b8b6-c2af-4d54-a507-4805d5c55761" status: 204 len: 0 microversion: 2.1 time: 0.292697 Jul 20 04:19:01.791897 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1022/2185] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:01 2022] DELETE /compute/v2.1/images/6489b8b6-c2af-4d54-a507-4805d5c55761 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:01.802891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c21df2fa-13af-438f-b76c-c7ad9baae47f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bdf40940>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:01.838569 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-c21df2fa-13af-438f-b76c-c7ad9baae47f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] HTTP exception thrown: Image not found. Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c21df2fa-13af-438f-b76c-c7ad9baae47f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Request method failure captured: Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/images/6489b8b6-c2af-4d54-a507-4805d5c55761 HTTP/1.1 Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Eq_1lZm5MsAlJHN4mVyj8OHpedCS1Ai-JyS-u1ScAtFEoC4FDbe4h67tyj15DylExMLdWM_4eRliTuMx2BTmGKfnssND71cCcirfxarg9budDuC9M1jMhxKQN0e8YHEfQCSo417X0mbx4PYx_wzdWo213PhdTEnuqt0g1caL3wypk Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:19:01.841085 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:19:01.842408 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2c925e4a93c3401fa5f4d51e7380b7ad", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}] Jul 20 04:19:01.842408 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesTestJSON-320895897 Jul 20 04:19:01.842408 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:01.842408 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:01.842408 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:01.842408 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:19:01.842408 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:19:01.842408 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: feb531c9e5dd4afd99f2974848a6a75b Jul 20 04:19:01.842408 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:01.842408 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:19:01.842408 n-d-826526-5 devstack@n-api.service[127871]: exception: Image not found. Jul 20 04:19:01.842408 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '6489b8b6-c2af-4d54-a507-4805d5c55761'} Jul 20 04:19:01.842408 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:01.842408 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:01.843190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:19:01.843190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:19:01.843190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:19:01.843190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:19:01.843190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:19:01.843190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:19:01.843190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:19:01.843190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:19:01.843190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:19:01.843190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:19:01.843190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:19:01.843190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:19:01.843190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:19:01.843190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:19:01.843190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:19:01.843190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:19:01.843190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6489b8b6-c2af-4d54-a507-4805d5c55761 Jul 20 04:19:01.843190 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:19:01.844201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6489b8b6-c2af-4d54-a507-4805d5c55761 could not be found. Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:19:01.847157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:19:01.848608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:01.848608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:01.848608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 04:19:01.848608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:19:01.848608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:19:01.848608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:01.848608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:01.848608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:01.848608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:01.848608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:01.848608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:01.848608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:01.848608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:01.848608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:19:01.848608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:01.848608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c21df2fa-13af-438f-b76c-c7ad9baae47f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Returning 404 to user: Image not found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:01.848608 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c21df2fa-13af-438f-b76c-c7ad9baae47f tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/images/6489b8b6-c2af-4d54-a507-4805d5c55761" status: 404 len: 62 microversion: 2.1 time: 0.049860 Jul 20 04:19:01.849824 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1164/2186] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:01 2022] GET /compute/v2.1/images/6489b8b6-c2af-4d54-a507-4805d5c55761 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:19:01.853751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-192e9cfa-6772-4d14-a750-4f74e929c648 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:01.854825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-192e9cfa-6772-4d14-a750-4f74e929c648 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:01.861848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-192e9cfa-6772-4d14-a750-4f74e929c648 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.862322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-192e9cfa-6772-4d14-a750-4f74e929c648 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.863218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-192e9cfa-6772-4d14-a750-4f74e929c648 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.863657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-192e9cfa-6772-4d14-a750-4f74e929c648 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.376073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4e7ce64b-e358-4035-a7e7-5afc7ea7b3b1 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:02.379496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4e7ce64b-e358-4035-a7e7-5afc7ea7b3b1 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:02.396363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e7ce64b-e358-4035-a7e7-5afc7ea7b3b1 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.396838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e7ce64b-e358-4035-a7e7-5afc7ea7b3b1 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.397725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e7ce64b-e358-4035-a7e7-5afc7ea7b3b1 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.398169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e7ce64b-e358-4035-a7e7-5afc7ea7b3b1 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.579486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4e7ce64b-e358-4035-a7e7-5afc7ea7b3b1 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:02.592594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4e7ce64b-e358-4035-a7e7-5afc7ea7b3b1 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:02.595846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4e7ce64b-e358-4035-a7e7-5afc7ea7b3b1 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:02.603082 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4e7ce64b-e358-4035-a7e7-5afc7ea7b3b1 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 0.238976 Jul 20 04:19:02.605869 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1165/2187] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:02 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:19:02.819285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-192e9cfa-6772-4d14-a750-4f74e929c648 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:02.829610 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-192e9cfa-6772-4d14-a750-4f74e929c648 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 200 len: 1501 microversion: 2.1 time: 0.980370 Jul 20 04:19:02.834935 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1023/2188] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:01 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 1501 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:03.628926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-33ed05c0-25a3-410c-92ce-547e9c457f82 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:03.629551 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-33ed05c0-25a3-410c-92ce-547e9c457f82 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:03.639394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33ed05c0-25a3-410c-92ce-547e9c457f82 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.639854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33ed05c0-25a3-410c-92ce-547e9c457f82 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.648208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33ed05c0-25a3-410c-92ce-547e9c457f82 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.648715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33ed05c0-25a3-410c-92ce-547e9c457f82 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.807948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-33ed05c0-25a3-410c-92ce-547e9c457f82 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:03.817578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-33ed05c0-25a3-410c-92ce-547e9c457f82 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:03.819096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-33ed05c0-25a3-410c-92ce-547e9c457f82 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:03.836952 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-33ed05c0-25a3-410c-92ce-547e9c457f82 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 0.212782 Jul 20 04:19:03.837561 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1166/2189] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:03 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:03.856790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1614c544-6bdb-4014-982f-61c4b8f83344 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:03.857852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1614c544-6bdb-4014-982f-61c4b8f83344 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:03.871208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1614c544-6bdb-4014-982f-61c4b8f83344 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.871661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1614c544-6bdb-4014-982f-61c4b8f83344 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.872491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1614c544-6bdb-4014-982f-61c4b8f83344 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.872928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1614c544-6bdb-4014-982f-61c4b8f83344 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.327212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1614c544-6bdb-4014-982f-61c4b8f83344 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:04.342965 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1614c544-6bdb-4014-982f-61c4b8f83344 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 200 len: 1507 microversion: 2.1 time: 0.491934 Jul 20 04:19:04.351932 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1024/2190] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:03 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 1507 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:04.860510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-88048036-680c-480e-b831-c1197eeb8481 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:04.861182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-88048036-680c-480e-b831-c1197eeb8481 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:04.880399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88048036-680c-480e-b831-c1197eeb8481 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.885239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88048036-680c-480e-b831-c1197eeb8481 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.886292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88048036-680c-480e-b831-c1197eeb8481 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.889843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88048036-680c-480e-b831-c1197eeb8481 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:05.213162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-88048036-680c-480e-b831-c1197eeb8481 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:05.233809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-88048036-680c-480e-b831-c1197eeb8481 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:05.237983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-88048036-680c-480e-b831-c1197eeb8481 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:05.247359 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-88048036-680c-480e-b831-c1197eeb8481 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 0.392635 Jul 20 04:19:05.248986 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1167/2191] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:04 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:05.369920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6642b1f5-147e-4ddc-be79-a9e743b975b2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:05.370980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6642b1f5-147e-4ddc-be79-a9e743b975b2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:05.397036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6642b1f5-147e-4ddc-be79-a9e743b975b2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:05.400061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6642b1f5-147e-4ddc-be79-a9e743b975b2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:05.401104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6642b1f5-147e-4ddc-be79-a9e743b975b2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:05.401703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6642b1f5-147e-4ddc-be79-a9e743b975b2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:05.532722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8a51c6c3-1c05-43e2-8cac-bb8e6d0a46a5 tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] Action: 'create', calling method: .version_select at 0x7f06bdbab820>, body: {"pool": null} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:05.981430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6642b1f5-147e-4ddc-be79-a9e743b975b2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:05.999385 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6642b1f5-147e-4ddc-be79-a9e743b975b2 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 200 len: 1489 microversion: 2.1 time: 0.634100 Jul 20 04:19:06.000945 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1168/2192] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:05 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 1489 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:06.025792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5f3241d0-11a3-4bfc-bec2-c55bcb907f20 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:06.028910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5f3241d0-11a3-4bfc-bec2-c55bcb907f20 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:06.044008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f3241d0-11a3-4bfc-bec2-c55bcb907f20 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.044933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f3241d0-11a3-4bfc-bec2-c55bcb907f20 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.045883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f3241d0-11a3-4bfc-bec2-c55bcb907f20 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.047528 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f3241d0-11a3-4bfc-bec2-c55bcb907f20 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.149515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5f3241d0-11a3-4bfc-bec2-c55bcb907f20 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:06.343303 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5f3241d0-11a3-4bfc-bec2-c55bcb907f20 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 204 len: 0 microversion: 2.1 time: 0.328435 Jul 20 04:19:06.344215 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1169/2193] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:06 2022] DELETE /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:06.355920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-db59db27-9800-40b1-90cc-c54d6d0f6d87 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:06.357220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-db59db27-9800-40b1-90cc-c54d6d0f6d87 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:06.374490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db59db27-9800-40b1-90cc-c54d6d0f6d87 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.374947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db59db27-9800-40b1-90cc-c54d6d0f6d87 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.381921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db59db27-9800-40b1-90cc-c54d6d0f6d87 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.382538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db59db27-9800-40b1-90cc-c54d6d0f6d87 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.637399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-db59db27-9800-40b1-90cc-c54d6d0f6d87 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:06.653424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-db59db27-9800-40b1-90cc-c54d6d0f6d87 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:06.655177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-db59db27-9800-40b1-90cc-c54d6d0f6d87 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:06.671213 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-db59db27-9800-40b1-90cc-c54d6d0f6d87 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 0.325378 Jul 20 04:19:06.683326 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1170/2194] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:06 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:06.683326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-83ba026c-e189-4604-ae8d-7fa51bf09f64 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06be2c6ee0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:06.730164 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-83ba026c-e189-4604-ae8d-7fa51bf09f64 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] HTTP exception thrown: Image not found. Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-83ba026c-e189-4604-ae8d-7fa51bf09f64 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Request method failure captured: Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/images/6489b8b6-c2af-4d54-a507-4805d5c55761 HTTP/1.1 Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Eq_1lZm5MsAlJHN4mVyj8OHpedCS1Ai-JyS-u1ScAtFEoC4FDbe4h67tyj15DylExMLdWM_4eRliTuMx2BTmGKfnssND71cCcirfxarg9budDuC9M1jMhxKQN0e8YHEfQCSo417X0mbx4PYx_wzdWo213PhdTEnuqt0g1caL3wypk Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:19:06.733605 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:19:06.735173 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2c925e4a93c3401fa5f4d51e7380b7ad", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}] Jul 20 04:19:06.735173 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesTestJSON-320895897 Jul 20 04:19:06.735173 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:06.735173 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:06.735173 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:06.735173 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:19:06.735173 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:19:06.735173 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: feb531c9e5dd4afd99f2974848a6a75b Jul 20 04:19:06.735173 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:06.735173 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:19:06.735173 n-d-826526-5 devstack@n-api.service[127871]: exception: Image not found. Jul 20 04:19:06.735173 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '6489b8b6-c2af-4d54-a507-4805d5c55761'} Jul 20 04:19:06.735173 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:06.735173 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6489b8b6-c2af-4d54-a507-4805d5c55761 to delete Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:06.739494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6489b8b6-c2af-4d54-a507-4805d5c55761 could not be found. Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:06.740781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:19:06.742400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:19:06.742400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:19:06.742400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:06.742400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:06.742400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:06.742400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:06.742400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:06.742400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:06.742400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:06.742400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:06.742400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:19:06.742400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:06.742400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-83ba026c-e189-4604-ae8d-7fa51bf09f64 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Returning 404 to user: Image not found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:06.742400 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-83ba026c-e189-4604-ae8d-7fa51bf09f64 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "DELETE /compute/v2.1/images/6489b8b6-c2af-4d54-a507-4805d5c55761" status: 404 len: 62 microversion: 2.1 time: 0.061899 Jul 20 04:19:06.742400 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1171/2195] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:06 2022] DELETE /compute/v2.1/images/6489b8b6-c2af-4d54-a507-4805d5c55761 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:19:06.744476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c5d950e8-bdba-41fa-bd55-c3500d519dfa tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:06.744785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c5d950e8-bdba-41fa-bd55-c3500d519dfa tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:06.766398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5d950e8-bdba-41fa-bd55-c3500d519dfa tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.766863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5d950e8-bdba-41fa-bd55-c3500d519dfa tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.772754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5d950e8-bdba-41fa-bd55-c3500d519dfa tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.773231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5d950e8-bdba-41fa-bd55-c3500d519dfa tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.828055 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c5d950e8-bdba-41fa-bd55-c3500d519dfa tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:06.929298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:06.949432 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.compute.api [None req-c5d950e8-bdba-41fa-bd55-c3500d519dfa tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Instance is already in deleting state, ignoring this request Jul 20 04:19:06.950303 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c5d950e8-bdba-41fa-bd55-c3500d519dfa tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 204 len: 0 microversion: 2.1 time: 0.210098 Jul 20 04:19:06.951471 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1172/2196] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:06 2022] DELETE /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:19:06.960485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e1261672-b236-41bf-b601-da44d524831b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:06.961070 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e1261672-b236-41bf-b601-da44d524831b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:06.978898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1261672-b236-41bf-b601-da44d524831b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.979365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1261672-b236-41bf-b601-da44d524831b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.980199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1261672-b236-41bf-b601-da44d524831b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.980809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1261672-b236-41bf-b601-da44d524831b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.275766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e1261672-b236-41bf-b601-da44d524831b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:08.290435 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e1261672-b236-41bf-b601-da44d524831b tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 200 len: 1495 microversion: 2.1 time: 1.333572 Jul 20 04:19:08.291314 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1173/2197] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:06 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 1495 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:08.303847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-76dee761-4cd2-4784-a20e-ddcf7e075073 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:08.304814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-76dee761-4cd2-4784-a20e-ddcf7e075073 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:08.312574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76dee761-4cd2-4784-a20e-ddcf7e075073 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:08.314113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76dee761-4cd2-4784-a20e-ddcf7e075073 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.315468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76dee761-4cd2-4784-a20e-ddcf7e075073 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:08.316447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76dee761-4cd2-4784-a20e-ddcf7e075073 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.530496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-76dee761-4cd2-4784-a20e-ddcf7e075073 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:08.557695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-76dee761-4cd2-4784-a20e-ddcf7e075073 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:08.560412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-76dee761-4cd2-4784-a20e-ddcf7e075073 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:08.581651 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-76dee761-4cd2-4784-a20e-ddcf7e075073 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 0.280418 Jul 20 04:19:08.588433 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1174/2198] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:08 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:08.843275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-217e01f2-021f-4de6-b0f9-40834fbea3ec req-026112ca-dd80-4288-8d26-8bab5ff0a283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d91e537-1321-48d1-b48c-30fe2537df3c", "name": "network-vif-plugged", "status": "completed", "tag": "89f9237c-b54d-48b3-8ad3-31664a5a3cdd"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:08.865155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-217e01f2-021f-4de6-b0f9-40834fbea3ec req-026112ca-dd80-4288-8d26-8bab5ff0a283 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:08.866445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-217e01f2-021f-4de6-b0f9-40834fbea3ec req-026112ca-dd80-4288-8d26-8bab5ff0a283 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.915565 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-217e01f2-021f-4de6-b0f9-40834fbea3ec req-026112ca-dd80-4288-8d26-8bab5ff0a283 service nova] Creating event network-vif-plugged:89f9237c-b54d-48b3-8ad3-31664a5a3cdd for instance 0d91e537-1321-48d1-b48c-30fe2537df3c on n-h1-826526-5 Jul 20 04:19:08.928240 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-217e01f2-021f-4de6-b0f9-40834fbea3ec req-026112ca-dd80-4288-8d26-8bab5ff0a283 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089726 Jul 20 04:19:08.928878 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1175/2199] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:09.309724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-344a6d3a-4b0c-4b63-9eb0-c761f4aefc3d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:09.311691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-344a6d3a-4b0c-4b63-9eb0-c761f4aefc3d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:09.318478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-344a6d3a-4b0c-4b63-9eb0-c761f4aefc3d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.320393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-344a6d3a-4b0c-4b63-9eb0-c761f4aefc3d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.321524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-344a6d3a-4b0c-4b63-9eb0-c761f4aefc3d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.322114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-344a6d3a-4b0c-4b63-9eb0-c761f4aefc3d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.847351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-344a6d3a-4b0c-4b63-9eb0-c761f4aefc3d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb531c9e5dd4afd99f2974848a6a75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c925e4a93c3401fa5f4d51e7380b7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:09.862712 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-344a6d3a-4b0c-4b63-9eb0-c761f4aefc3d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 200 len: 1495 microversion: 2.1 time: 0.557522 Jul 20 04:19:09.887056 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1176/2200] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:09 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 1495 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:09.892483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cd8e5dfe-7c3c-4393-aa19-74b0ac57767b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:09.894971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cd8e5dfe-7c3c-4393-aa19-74b0ac57767b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:09.910449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd8e5dfe-7c3c-4393-aa19-74b0ac57767b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.911053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd8e5dfe-7c3c-4393-aa19-74b0ac57767b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.912030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd8e5dfe-7c3c-4393-aa19-74b0ac57767b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.912585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd8e5dfe-7c3c-4393-aa19-74b0ac57767b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.085304 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cd8e5dfe-7c3c-4393-aa19-74b0ac57767b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:10.104584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cd8e5dfe-7c3c-4393-aa19-74b0ac57767b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:10.107266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cd8e5dfe-7c3c-4393-aa19-74b0ac57767b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:10.130410 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cd8e5dfe-7c3c-4393-aa19-74b0ac57767b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 0.246588 Jul 20 04:19:10.146046 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1177/2201] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:09 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:10.344352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-aef8b44b-3687-4f91-aa86-f70055c27ba0 req-0bf35d68-cd53-4dae-88ef-90d306c81b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d91e537-1321-48d1-b48c-30fe2537df3c", "name": "network-vif-deleted", "tag": "89f9237c-b54d-48b3-8ad3-31664a5a3cdd"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:10.390679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-aef8b44b-3687-4f91-aa86-f70055c27ba0 req-0bf35d68-cd53-4dae-88ef-90d306c81b66 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.397841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-aef8b44b-3687-4f91-aa86-f70055c27ba0 req-0bf35d68-cd53-4dae-88ef-90d306c81b66 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.439632 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-aef8b44b-3687-4f91-aa86-f70055c27ba0 req-0bf35d68-cd53-4dae-88ef-90d306c81b66 service nova] Creating event network-vif-deleted:89f9237c-b54d-48b3-8ad3-31664a5a3cdd for instance 0d91e537-1321-48d1-b48c-30fe2537df3c on n-h1-826526-5 Jul 20 04:19:10.448392 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-aef8b44b-3687-4f91-aa86-f70055c27ba0 req-0bf35d68-cd53-4dae-88ef-90d306c81b66 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120784 Jul 20 04:19:10.451141 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1178/2202] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:10.895957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f95be98f-3f30-4644-a2e3-92604990ec33 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:10.896931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f95be98f-3f30-4644-a2e3-92604990ec33 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 0d91e537-1321-48d1-b48c-30fe2537df3c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:10.907767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f95be98f-3f30-4644-a2e3-92604990ec33 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.908324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f95be98f-3f30-4644-a2e3-92604990ec33 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.909304 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f95be98f-3f30-4644-a2e3-92604990ec33 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.909968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f95be98f-3f30-4644-a2e3-92604990ec33 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.916311 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8a51c6c3-1c05-43e2-8cac-bb8e6d0a46a5 tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.744354 Jul 20 04:19:10.917823 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1025/2203] 10.222.0.17 () {60 vars in 1169 bytes} [Wed Jul 20 04:19:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:19:10.928301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7251c196-6758-46b0-a5ef-f345141699dd tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] Action: 'create', calling method: .version_select at 0x7f06be95e670>, body: {"pool": null} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:10.955083 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-f95be98f-3f30-4644-a2e3-92604990ec33 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] HTTP exception thrown: Instance 0d91e537-1321-48d1-b48c-30fe2537df3c could not be found. Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f95be98f-3f30-4644-a2e3-92604990ec33 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Request method failure captured: Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c HTTP/1.1 Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Eq_1lZm5MsAlJHN4mVyj8OHpedCS1Ai-JyS-u1ScAtFEoC4FDbe4h67tyj15DylExMLdWM_4eRliTuMx2BTmGKfnssND71cCcirfxarg9budDuC9M1jMhxKQN0e8YHEfQCSo417X0mbx4PYx_wzdWo213PhdTEnuqt0g1caL3wypk Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:19:10.959402 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:19:10.961275 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2c925e4a93c3401fa5f4d51e7380b7ad", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}] Jul 20 04:19:10.961275 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesTestJSON-320895897 Jul 20 04:19:10.961275 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:10.961275 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:10.961275 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:10.961275 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:19:10.961275 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:19:10.961275 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: feb531c9e5dd4afd99f2974848a6a75b Jul 20 04:19:10.961275 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:10.961275 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:19:10.961275 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 0d91e537-1321-48d1-b48c-30fe2537df3c could not be found. Jul 20 04:19:10.961275 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '0d91e537-1321-48d1-b48c-30fe2537df3c'} Jul 20 04:19:10.961275 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d91e537-1321-48d1-b48c-30fe2537df3c could not be found. Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:10.962204 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:10.963555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:10.963555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:10.963555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:10.963555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:10.963555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:10.963555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:10.963555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d91e537-1321-48d1-b48c-30fe2537df3c could not be found. Jul 20 04:19:10.963555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.963555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:10.963555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.963555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.963555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:10.963555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:10.963555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:10.963555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:10.963555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d91e537-1321-48d1-b48c-30fe2537df3c could not be found. Jul 20 04:19:10.963555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.964711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f95be98f-3f30-4644-a2e3-92604990ec33 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Returning 404 to user: Instance 0d91e537-1321-48d1-b48c-30fe2537df3c could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:10.964711 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f95be98f-3f30-4644-a2e3-92604990ec33 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c" status: 404 len: 111 microversion: 2.1 time: 0.070136 Jul 20 04:19:10.964711 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1179/2204] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:10 2022] GET /compute/v2.1/servers/0d91e537-1321-48d1-b48c-30fe2537df3c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:19:10.974182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-08025ed7-1815-44ea-b860-a69376162b47 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bda674c0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:11.020835 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-08025ed7-1815-44ea-b860-a69376162b47 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] HTTP exception thrown: Image not found. Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-08025ed7-1815-44ea-b860-a69376162b47 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Request method failure captured: Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 HTTP/1.1 Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Eq_1lZm5MsAlJHN4mVyj8OHpedCS1Ai-JyS-u1ScAtFEoC4FDbe4h67tyj15DylExMLdWM_4eRliTuMx2BTmGKfnssND71cCcirfxarg9budDuC9M1jMhxKQN0e8YHEfQCSo417X0mbx4PYx_wzdWo213PhdTEnuqt0g1caL3wypk Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:19:11.022802 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:19:11.024072 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2c925e4a93c3401fa5f4d51e7380b7ad", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}] Jul 20 04:19:11.024072 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.024072 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:11.024072 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.024072 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:11.024072 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:19:11.024072 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:19:11.024072 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: feb531c9e5dd4afd99f2974848a6a75b Jul 20 04:19:11.024072 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:11.024072 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:19:11.024072 n-d-826526-5 devstack@n-api.service[127871]: exception: Image not found. Jul 20 04:19:11.024072 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '8874f3af-5014-4528-b630-8f588f50b857'} Jul 20 04:19:11.024072 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:11.024072 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8874f3af-5014-4528-b630-8f588f50b857 to delete Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.024867 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8874f3af-5014-4528-b630-8f588f50b857 could not be found. Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:11.026097 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:19:11.027442 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:19:11.027442 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:19:11.027442 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.027442 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.027442 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.027442 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.027442 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:11.027442 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:11.027442 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:11.027442 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:11.027442 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:19:11.027442 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.029559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-08025ed7-1815-44ea-b860-a69376162b47 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Returning 404 to user: Image not found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:11.030579 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-08025ed7-1815-44ea-b860-a69376162b47 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "DELETE /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857" status: 404 len: 62 microversion: 2.1 time: 0.062835 Jul 20 04:19:11.031612 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1180/2205] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:10 2022] DELETE /compute/v2.1/images/8874f3af-5014-4528-b630-8f588f50b857 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:19:11.044610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1e022cf5-0e80-43c1-b64e-987c3f48b0f4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:11.045461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1e022cf5-0e80-43c1-b64e-987c3f48b0f4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:11.067845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e022cf5-0e80-43c1-b64e-987c3f48b0f4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.068683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e022cf5-0e80-43c1-b64e-987c3f48b0f4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.069545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e022cf5-0e80-43c1-b64e-987c3f48b0f4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.069963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e022cf5-0e80-43c1-b64e-987c3f48b0f4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.090491 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-1e022cf5-0e80-43c1-b64e-987c3f48b0f4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] HTTP exception thrown: Instance a02cfafe-ca57-4211-bd4e-287672a73ea9 could not be found. Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1e022cf5-0e80-43c1-b64e-987c3f48b0f4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Request method failure captured: Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 HTTP/1.1 Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Eq_1lZm5MsAlJHN4mVyj8OHpedCS1Ai-JyS-u1ScAtFEoC4FDbe4h67tyj15DylExMLdWM_4eRliTuMx2BTmGKfnssND71cCcirfxarg9budDuC9M1jMhxKQN0e8YHEfQCSo417X0mbx4PYx_wzdWo213PhdTEnuqt0g1caL3wypk Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:19:11.092142 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:19:11.093678 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2c925e4a93c3401fa5f4d51e7380b7ad", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}] Jul 20 04:19:11.093678 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.093678 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:11.093678 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.093678 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:11.093678 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:19:11.093678 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:19:11.093678 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: feb531c9e5dd4afd99f2974848a6a75b Jul 20 04:19:11.093678 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:11.093678 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:19:11.093678 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance a02cfafe-ca57-4211-bd4e-287672a73ea9 could not be found. Jul 20 04:19:11.093678 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'a02cfafe-ca57-4211-bd4e-287672a73ea9'} Jul 20 04:19:11.093678 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a02cfafe-ca57-4211-bd4e-287672a73ea9 could not be found. Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:11.094580 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a02cfafe-ca57-4211-bd4e-287672a73ea9 could not be found. Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a02cfafe-ca57-4211-bd4e-287672a73ea9 could not be found. Jul 20 04:19:11.096123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.097624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1e022cf5-0e80-43c1-b64e-987c3f48b0f4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Returning 404 to user: Instance a02cfafe-ca57-4211-bd4e-287672a73ea9 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:11.097624 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1e022cf5-0e80-43c1-b64e-987c3f48b0f4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 404 len: 111 microversion: 2.1 time: 0.057474 Jul 20 04:19:11.097624 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1181/2206] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:11 2022] DELETE /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:19:11.108619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-635fa523-e112-4308-bd51-4f323095f51d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:11.109371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-635fa523-e112-4308-bd51-4f323095f51d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: a02cfafe-ca57-4211-bd4e-287672a73ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:11.117225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-635fa523-e112-4308-bd51-4f323095f51d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.117827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-635fa523-e112-4308-bd51-4f323095f51d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.118756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-635fa523-e112-4308-bd51-4f323095f51d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.119335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-635fa523-e112-4308-bd51-4f323095f51d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.135887 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-635fa523-e112-4308-bd51-4f323095f51d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] HTTP exception thrown: Instance a02cfafe-ca57-4211-bd4e-287672a73ea9 could not be found. Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-635fa523-e112-4308-bd51-4f323095f51d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Request method failure captured: Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 HTTP/1.1 Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Eq_1lZm5MsAlJHN4mVyj8OHpedCS1Ai-JyS-u1ScAtFEoC4FDbe4h67tyj15DylExMLdWM_4eRliTuMx2BTmGKfnssND71cCcirfxarg9budDuC9M1jMhxKQN0e8YHEfQCSo417X0mbx4PYx_wzdWo213PhdTEnuqt0g1caL3wypk Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:19:11.137759 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:19:11.139189 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2c925e4a93c3401fa5f4d51e7380b7ad", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}] Jul 20 04:19:11.139189 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.139189 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:11.139189 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.139189 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:11.139189 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:19:11.139189 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:19:11.139189 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: feb531c9e5dd4afd99f2974848a6a75b Jul 20 04:19:11.139189 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:11.139189 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:19:11.139189 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance a02cfafe-ca57-4211-bd4e-287672a73ea9 could not be found. Jul 20 04:19:11.139189 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'a02cfafe-ca57-4211-bd4e-287672a73ea9'} Jul 20 04:19:11.139189 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a02cfafe-ca57-4211-bd4e-287672a73ea9 could not be found. Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:11.140056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:11.141533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:11.141533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:11.141533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:11.141533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:11.141533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:11.141533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:11.141533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a02cfafe-ca57-4211-bd4e-287672a73ea9 could not be found. Jul 20 04:19:11.141533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.141533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.141533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.141533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.141533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:11.141533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:11.141533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:11.141533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:11.141533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a02cfafe-ca57-4211-bd4e-287672a73ea9 could not be found. Jul 20 04:19:11.141533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.148472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-635fa523-e112-4308-bd51-4f323095f51d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Returning 404 to user: Instance a02cfafe-ca57-4211-bd4e-287672a73ea9 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:11.149505 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-635fa523-e112-4308-bd51-4f323095f51d tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9" status: 404 len: 111 microversion: 2.1 time: 0.050862 Jul 20 04:19:11.153638 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1182/2207] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:11 2022] GET /compute/v2.1/servers/a02cfafe-ca57-4211-bd4e-287672a73ea9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:11.156993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-643f571f-a779-4ab3-9448-c2ba8a38ac4c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:11.157756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-643f571f-a779-4ab3-9448-c2ba8a38ac4c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:11.165255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-643f571f-a779-4ab3-9448-c2ba8a38ac4c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.165869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-643f571f-a779-4ab3-9448-c2ba8a38ac4c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.167146 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-643f571f-a779-4ab3-9448-c2ba8a38ac4c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.167790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-643f571f-a779-4ab3-9448-c2ba8a38ac4c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.371085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-643f571f-a779-4ab3-9448-c2ba8a38ac4c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:11.387569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-643f571f-a779-4ab3-9448-c2ba8a38ac4c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:11.391147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-643f571f-a779-4ab3-9448-c2ba8a38ac4c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:11.414400 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-643f571f-a779-4ab3-9448-c2ba8a38ac4c tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 0.262209 Jul 20 04:19:11.416072 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1183/2208] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:11 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:11.423385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0df6ff3b-6184-4916-812b-2ce5b9fa8135 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06c739c3a0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:11.465066 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-0df6ff3b-6184-4916-812b-2ce5b9fa8135 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] HTTP exception thrown: Image not found. Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0df6ff3b-6184-4916-812b-2ce5b9fa8135 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Request method failure captured: Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 HTTP/1.1 Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Eq_1lZm5MsAlJHN4mVyj8OHpedCS1Ai-JyS-u1ScAtFEoC4FDbe4h67tyj15DylExMLdWM_4eRliTuMx2BTmGKfnssND71cCcirfxarg9budDuC9M1jMhxKQN0e8YHEfQCSo417X0mbx4PYx_wzdWo213PhdTEnuqt0g1caL3wypk Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:19:11.467690 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:19:11.469104 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2c925e4a93c3401fa5f4d51e7380b7ad", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}] Jul 20 04:19:11.469104 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.469104 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:11.469104 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.469104 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:11.469104 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:19:11.469104 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:19:11.469104 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: feb531c9e5dd4afd99f2974848a6a75b Jul 20 04:19:11.469104 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:11.469104 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:19:11.469104 n-d-826526-5 devstack@n-api.service[127871]: exception: Image not found. Jul 20 04:19:11.469104 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913'} Jul 20 04:19:11.469104 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:11.469104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 to delete Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.470059 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 could not be found. Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:11.471529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:19:11.473403 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:19:11.473403 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:19:11.473403 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.473403 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.473403 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.473403 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.473403 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:11.473403 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:11.473403 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:11.473403 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:11.473403 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:19:11.473403 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.476544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0df6ff3b-6184-4916-812b-2ce5b9fa8135 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Returning 404 to user: Image not found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:11.488562 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0df6ff3b-6184-4916-812b-2ce5b9fa8135 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "DELETE /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913" status: 404 len: 62 microversion: 2.1 time: 0.061073 Jul 20 04:19:11.496138 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1184/2209] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:11 2022] DELETE /compute/v2.1/images/36ebcc7e-93a4-4bf1-b8c5-61fdf4aad913 => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:19:11.502042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ac79bdb5-fbda-44a2-ae28-4019a0d6f033 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:11.503171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ac79bdb5-fbda-44a2-ae28-4019a0d6f033 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:11.525754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac79bdb5-fbda-44a2-ae28-4019a0d6f033 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.526994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac79bdb5-fbda-44a2-ae28-4019a0d6f033 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.528013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac79bdb5-fbda-44a2-ae28-4019a0d6f033 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.528731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac79bdb5-fbda-44a2-ae28-4019a0d6f033 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.544821 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-ac79bdb5-fbda-44a2-ae28-4019a0d6f033 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] HTTP exception thrown: Instance 2976722a-674d-49e5-b4e3-3aebf11d51c5 could not be found. Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ac79bdb5-fbda-44a2-ae28-4019a0d6f033 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Request method failure captured: Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 HTTP/1.1 Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Eq_1lZm5MsAlJHN4mVyj8OHpedCS1Ai-JyS-u1ScAtFEoC4FDbe4h67tyj15DylExMLdWM_4eRliTuMx2BTmGKfnssND71cCcirfxarg9budDuC9M1jMhxKQN0e8YHEfQCSo417X0mbx4PYx_wzdWo213PhdTEnuqt0g1caL3wypk Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:19:11.547703 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:19:11.548941 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2c925e4a93c3401fa5f4d51e7380b7ad", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}] Jul 20 04:19:11.548941 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.548941 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:11.548941 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.548941 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:11.548941 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:19:11.548941 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:19:11.548941 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: feb531c9e5dd4afd99f2974848a6a75b Jul 20 04:19:11.548941 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:11.548941 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:19:11.548941 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 2976722a-674d-49e5-b4e3-3aebf11d51c5 could not be found. Jul 20 04:19:11.548941 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '2976722a-674d-49e5-b4e3-3aebf11d51c5'} Jul 20 04:19:11.548941 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2976722a-674d-49e5-b4e3-3aebf11d51c5 could not be found. Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:11.549656 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2976722a-674d-49e5-b4e3-3aebf11d51c5 could not be found. Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2976722a-674d-49e5-b4e3-3aebf11d51c5 could not be found. Jul 20 04:19:11.550783 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.554955 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ac79bdb5-fbda-44a2-ae28-4019a0d6f033 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Returning 404 to user: Instance 2976722a-674d-49e5-b4e3-3aebf11d51c5 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:11.557397 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ac79bdb5-fbda-44a2-ae28-4019a0d6f033 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 404 len: 111 microversion: 2.1 time: 0.059637 Jul 20 04:19:11.558575 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1185/2210] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:11 2022] DELETE /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:11.581857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0b410e55-0b5c-43c2-909f-129982857bc4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:11.583135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0b410e55-0b5c-43c2-909f-129982857bc4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: 2976722a-674d-49e5-b4e3-3aebf11d51c5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:11.602731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b410e55-0b5c-43c2-909f-129982857bc4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.604569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b410e55-0b5c-43c2-909f-129982857bc4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.606701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b410e55-0b5c-43c2-909f-129982857bc4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.607478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b410e55-0b5c-43c2-909f-129982857bc4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.640946 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-0b410e55-0b5c-43c2-909f-129982857bc4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] HTTP exception thrown: Instance 2976722a-674d-49e5-b4e3-3aebf11d51c5 could not be found. Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0b410e55-0b5c-43c2-909f-129982857bc4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Request method failure captured: Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 HTTP/1.1 Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Eq_1lZm5MsAlJHN4mVyj8OHpedCS1Ai-JyS-u1ScAtFEoC4FDbe4h67tyj15DylExMLdWM_4eRliTuMx2BTmGKfnssND71cCcirfxarg9budDuC9M1jMhxKQN0e8YHEfQCSo417X0mbx4PYx_wzdWo213PhdTEnuqt0g1caL3wypk Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:19:11.654216 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:19:11.655552 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2c925e4a93c3401fa5f4d51e7380b7ad", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}] Jul 20 04:19:11.655552 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.655552 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:11.655552 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.655552 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:11.655552 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:19:11.655552 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:19:11.655552 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: feb531c9e5dd4afd99f2974848a6a75b Jul 20 04:19:11.655552 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:11.655552 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:19:11.655552 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 2976722a-674d-49e5-b4e3-3aebf11d51c5 could not be found. Jul 20 04:19:11.655552 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '2976722a-674d-49e5-b4e3-3aebf11d51c5'} Jul 20 04:19:11.655552 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2976722a-674d-49e5-b4e3-3aebf11d51c5 could not be found. Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:11.656283 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:11.657477 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:11.657477 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:11.657477 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:11.657477 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:11.657477 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:11.657477 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:11.657477 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2976722a-674d-49e5-b4e3-3aebf11d51c5 could not be found. Jul 20 04:19:11.657477 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.657477 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.657477 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.657477 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.657477 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:11.657477 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:11.657477 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:11.657477 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:11.657477 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2976722a-674d-49e5-b4e3-3aebf11d51c5 could not be found. Jul 20 04:19:11.657477 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.659673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0b410e55-0b5c-43c2-909f-129982857bc4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Returning 404 to user: Instance 2976722a-674d-49e5-b4e3-3aebf11d51c5 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:11.660748 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0b410e55-0b5c-43c2-909f-129982857bc4 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5" status: 404 len: 111 microversion: 2.1 time: 0.095133 Jul 20 04:19:11.661862 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1186/2211] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:11 2022] GET /compute/v2.1/servers/2976722a-674d-49e5-b4e3-3aebf11d51c5 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:11.694618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e30ab8cc-ab36-4c17-8c38-08d37c1d8508 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '.version_select at 0x7f06bda67f70>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:11.728582 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-e30ab8cc-ab36-4c17-8c38-08d37c1d8508 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] HTTP exception thrown: Image not found. Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e30ab8cc-ab36-4c17-8c38-08d37c1d8508 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Request method failure captured: Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 HTTP/1.1 Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Eq_1lZm5MsAlJHN4mVyj8OHpedCS1Ai-JyS-u1ScAtFEoC4FDbe4h67tyj15DylExMLdWM_4eRliTuMx2BTmGKfnssND71cCcirfxarg9budDuC9M1jMhxKQN0e8YHEfQCSo417X0mbx4PYx_wzdWo213PhdTEnuqt0g1caL3wypk Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:19:11.730361 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:19:11.731766 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2c925e4a93c3401fa5f4d51e7380b7ad", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}] Jul 20 04:19:11.731766 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.731766 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:11.731766 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.731766 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:11.731766 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:19:11.731766 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:19:11.731766 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: feb531c9e5dd4afd99f2974848a6a75b Jul 20 04:19:11.731766 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:11.731766 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:19:11.731766 n-d-826526-5 devstack@n-api.service[127871]: exception: Image not found. Jul 20 04:19:11.731766 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '31461d61-6926-4baf-b19b-c84e75325901'} Jul 20 04:19:11.731766 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:11.731766 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 31461d61-6926-4baf-b19b-c84e75325901 to delete Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.735616 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 31461d61-6926-4baf-b19b-c84e75325901 could not be found. Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:11.736833 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:19:11.737932 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:19:11.737932 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:19:11.737932 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.737932 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.737932 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.737932 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.737932 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:11.737932 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:11.737932 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:11.737932 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:11.737932 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:19:11.737932 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.737932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e30ab8cc-ab36-4c17-8c38-08d37c1d8508 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Returning 404 to user: Image not found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:11.737932 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e30ab8cc-ab36-4c17-8c38-08d37c1d8508 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "DELETE /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901" status: 404 len: 62 microversion: 2.1 time: 0.064587 Jul 20 04:19:11.737932 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1187/2212] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:11 2022] DELETE /compute/v2.1/images/31461d61-6926-4baf-b19b-c84e75325901 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:19:11.740413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4f2d6bb6-78f6-48b6-9c4f-677193e17919 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:11.740914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4f2d6bb6-78f6-48b6-9c4f-677193e17919 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:11.765718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f2d6bb6-78f6-48b6-9c4f-677193e17919 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.767738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f2d6bb6-78f6-48b6-9c4f-677193e17919 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.771456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f2d6bb6-78f6-48b6-9c4f-677193e17919 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.772015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f2d6bb6-78f6-48b6-9c4f-677193e17919 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.797014 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-4f2d6bb6-78f6-48b6-9c4f-677193e17919 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] HTTP exception thrown: Instance b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 could not be found. Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4f2d6bb6-78f6-48b6-9c4f-677193e17919 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Request method failure captured: Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 HTTP/1.1 Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Eq_1lZm5MsAlJHN4mVyj8OHpedCS1Ai-JyS-u1ScAtFEoC4FDbe4h67tyj15DylExMLdWM_4eRliTuMx2BTmGKfnssND71cCcirfxarg9budDuC9M1jMhxKQN0e8YHEfQCSo417X0mbx4PYx_wzdWo213PhdTEnuqt0g1caL3wypk Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:19:11.800856 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:19:11.802025 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2c925e4a93c3401fa5f4d51e7380b7ad", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}] Jul 20 04:19:11.802025 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.802025 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:11.802025 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.802025 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:11.802025 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:19:11.802025 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:19:11.802025 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: feb531c9e5dd4afd99f2974848a6a75b Jul 20 04:19:11.802025 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:11.802025 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:19:11.802025 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 could not be found. Jul 20 04:19:11.802025 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15'} Jul 20 04:19:11.802025 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 could not be found. Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:11.802716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 could not be found. Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 could not be found. Jul 20 04:19:11.806828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.807947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4f2d6bb6-78f6-48b6-9c4f-677193e17919 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Returning 404 to user: Instance b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:11.807947 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4f2d6bb6-78f6-48b6-9c4f-677193e17919 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15" status: 404 len: 111 microversion: 2.1 time: 0.066151 Jul 20 04:19:11.807947 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1188/2213] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:11 2022] DELETE /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:11.819002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-eb93fc9d-e74c-40f8-9eb2-287aa3ea75c5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:11.819639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-eb93fc9d-e74c-40f8-9eb2-287aa3ea75c5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] [instance: b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:11.832993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb93fc9d-e74c-40f8-9eb2-287aa3ea75c5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.833445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb93fc9d-e74c-40f8-9eb2-287aa3ea75c5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.839522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb93fc9d-e74c-40f8-9eb2-287aa3ea75c5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.841200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb93fc9d-e74c-40f8-9eb2-287aa3ea75c5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.879289 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-eb93fc9d-e74c-40f8-9eb2-287aa3ea75c5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] HTTP exception thrown: Instance b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 could not be found. Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-eb93fc9d-e74c-40f8-9eb2-287aa3ea75c5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Request method failure captured: Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 HTTP/1.1 Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Eq_1lZm5MsAlJHN4mVyj8OHpedCS1Ai-JyS-u1ScAtFEoC4FDbe4h67tyj15DylExMLdWM_4eRliTuMx2BTmGKfnssND71cCcirfxarg9budDuC9M1jMhxKQN0e8YHEfQCSo417X0mbx4PYx_wzdWo213PhdTEnuqt0g1caL3wypk Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:19:11.883218 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:19:11.884642 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2c925e4a93c3401fa5f4d51e7380b7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2c925e4a93c3401fa5f4d51e7380b7ad", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2c925e4a93c3401fa5f4d51e7380b7ad"}]}] Jul 20 04:19:11.884642 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.884642 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 2c925e4a93c3401fa5f4d51e7380b7ad Jul 20 04:19:11.884642 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesTestJSON-320895897 Jul 20 04:19:11.884642 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:11.884642 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:19:11.884642 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:19:11.884642 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: feb531c9e5dd4afd99f2974848a6a75b Jul 20 04:19:11.884642 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesTestJSON-320895897-project Jul 20 04:19:11.884642 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:19:11.884642 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 could not be found. Jul 20 04:19:11.884642 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15'} Jul 20 04:19:11.884642 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 could not be found. Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:11.885473 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:11.886728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:11.886728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:11.886728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:11.886728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:11.886728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:11.886728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:11.886728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 could not be found. Jul 20 04:19:11.886728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.886728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:11.886728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.886728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:11.886728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:11.886728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:11.886728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:11.886728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:11.886728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 could not be found. Jul 20 04:19:11.886728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:19:11.889621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-eb93fc9d-e74c-40f8-9eb2-287aa3ea75c5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] Returning 404 to user: Instance b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:11.890658 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-eb93fc9d-e74c-40f8-9eb2-287aa3ea75c5 tempest-ImagesTestJSON-320895897 tempest-ImagesTestJSON-320895897-project] 10.222.0.17 "GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15" status: 404 len: 111 microversion: 2.1 time: 0.083788 Jul 20 04:19:11.891835 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1189/2214] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:11 2022] GET /compute/v2.1/servers/b5c5f711-a3dd-4b7b-b63c-bf2028ca3a15 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:12.440563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a7e176e6-87b1-4210-9edf-c575c8508466 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:12.441357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a7e176e6-87b1-4210-9edf-c575c8508466 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:12.455921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7e176e6-87b1-4210-9edf-c575c8508466 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.457624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7e176e6-87b1-4210-9edf-c575c8508466 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:12.459104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7e176e6-87b1-4210-9edf-c575c8508466 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.459796 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7e176e6-87b1-4210-9edf-c575c8508466 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:12.716339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a7e176e6-87b1-4210-9edf-c575c8508466 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:12.735690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a7e176e6-87b1-4210-9edf-c575c8508466 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:12.738956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a7e176e6-87b1-4210-9edf-c575c8508466 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:12.756827 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a7e176e6-87b1-4210-9edf-c575c8508466 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 0.321249 Jul 20 04:19:12.772679 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1190/2215] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:12 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:13.776311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bfc47a33-3804-48b8-8393-05b2afea8423 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:13.777080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bfc47a33-3804-48b8-8393-05b2afea8423 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:13.793342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bfc47a33-3804-48b8-8393-05b2afea8423 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:13.794002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bfc47a33-3804-48b8-8393-05b2afea8423 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:13.795833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bfc47a33-3804-48b8-8393-05b2afea8423 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:13.797050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bfc47a33-3804-48b8-8393-05b2afea8423 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:13.866214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=47 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:13.947704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bfc47a33-3804-48b8-8393-05b2afea8423 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:13.967447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bfc47a33-3804-48b8-8393-05b2afea8423 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:13.970502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bfc47a33-3804-48b8-8393-05b2afea8423 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:13.991199 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bfc47a33-3804-48b8-8393-05b2afea8423 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 0.216061 Jul 20 04:19:13.994876 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1191/2216] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:13 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:19:14.336293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:15.021308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ad12eccd-e6cc-4f01-9ab0-7a5cc3acb2b4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:15.022548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ad12eccd-e6cc-4f01-9ab0-7a5cc3acb2b4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:15.041465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad12eccd-e6cc-4f01-9ab0-7a5cc3acb2b4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.042309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad12eccd-e6cc-4f01-9ab0-7a5cc3acb2b4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.047610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad12eccd-e6cc-4f01-9ab0-7a5cc3acb2b4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.047610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad12eccd-e6cc-4f01-9ab0-7a5cc3acb2b4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.481444 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7251c196-6758-46b0-a5ef-f345141699dd tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.556984 Jul 20 04:19:15.484670 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1026/2217] 10.222.0.17 () {60 vars in 1169 bytes} [Wed Jul 20 04:19:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:15.512416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7a19b286-54a2-4fa0-8304-83336a302ec3 tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] Action: 'create', calling method: .version_select at 0x7f06bea71d30>, body: {"pool": null} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:15.601806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ad12eccd-e6cc-4f01-9ab0-7a5cc3acb2b4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:15.615306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ad12eccd-e6cc-4f01-9ab0-7a5cc3acb2b4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:15.618867 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ad12eccd-e6cc-4f01-9ab0-7a5cc3acb2b4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:15.633023 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ad12eccd-e6cc-4f01-9ab0-7a5cc3acb2b4 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1446 microversion: 2.75 time: 0.622297 Jul 20 04:19:15.637187 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1192/2218] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:15 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1446 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:16.664801 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9ab6983c-6afd-4744-8b5a-29bba0a37964 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:16.666534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9ab6983c-6afd-4744-8b5a-29bba0a37964 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:16.678539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ab6983c-6afd-4744-8b5a-29bba0a37964 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:16.679089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ab6983c-6afd-4744-8b5a-29bba0a37964 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:16.680049 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ab6983c-6afd-4744-8b5a-29bba0a37964 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:16.680764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ab6983c-6afd-4744-8b5a-29bba0a37964 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:16.841334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9ab6983c-6afd-4744-8b5a-29bba0a37964 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:16.862136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9ab6983c-6afd-4744-8b5a-29bba0a37964 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:16.863788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9ab6983c-6afd-4744-8b5a-29bba0a37964 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:16.869527 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9ab6983c-6afd-4744-8b5a-29bba0a37964 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1452 microversion: 2.75 time: 0.210893 Jul 20 04:19:16.882126 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1193/2219] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:16 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1452 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:17.890895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c3884ce0-edbf-400a-8bcb-4861b66b901b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:17.896125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c3884ce0-edbf-400a-8bcb-4861b66b901b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:17.914874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3884ce0-edbf-400a-8bcb-4861b66b901b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:17.916764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3884ce0-edbf-400a-8bcb-4861b66b901b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:17.918797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3884ce0-edbf-400a-8bcb-4861b66b901b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:17.921365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3884ce0-edbf-400a-8bcb-4861b66b901b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:18.123827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c3884ce0-edbf-400a-8bcb-4861b66b901b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:18.141018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c3884ce0-edbf-400a-8bcb-4861b66b901b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:18.152569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c3884ce0-edbf-400a-8bcb-4861b66b901b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:18.172451 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c3884ce0-edbf-400a-8bcb-4861b66b901b tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1452 microversion: 2.75 time: 0.284117 Jul 20 04:19:18.175202 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1194/2220] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:17 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1452 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:19:19.196797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c2c406e-af25-4843-9f87-f3eda198cb53 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:19.198513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0c2c406e-af25-4843-9f87-f3eda198cb53 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:19.215118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c2c406e-af25-4843-9f87-f3eda198cb53 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:19.215932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c2c406e-af25-4843-9f87-f3eda198cb53 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:19.218164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c2c406e-af25-4843-9f87-f3eda198cb53 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:19.219083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c2c406e-af25-4843-9f87-f3eda198cb53 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:19.879060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0c2c406e-af25-4843-9f87-f3eda198cb53 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:19.890738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0c2c406e-af25-4843-9f87-f3eda198cb53 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:19.893098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0c2c406e-af25-4843-9f87-f3eda198cb53 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:19.900371 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0c2c406e-af25-4843-9f87-f3eda198cb53 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1437 microversion: 2.75 time: 0.710528 Jul 20 04:19:19.901291 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1195/2221] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:19 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1437 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:19:20.194135 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7a19b286-54a2-4fa0-8304-83336a302ec3 tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.702490 Jul 20 04:19:20.196327 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1027/2222] 10.222.0.17 () {60 vars in 1169 bytes} [Wed Jul 20 04:19:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:20.206224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fae276f4-78bf-4c0a-a981-09c7c4d0f30f tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] Action: 'create', calling method: .version_select at 0x7f06be6e01f0>, body: {"pool": null} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:20.342270 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d94fb00c-562a-4626-8461-a2e23d0c2205 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:20.345915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d94fb00c-562a-4626-8461-a2e23d0c2205 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:20.371711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d94fb00c-562a-4626-8461-a2e23d0c2205 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.372111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d94fb00c-562a-4626-8461-a2e23d0c2205 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.373152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d94fb00c-562a-4626-8461-a2e23d0c2205 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.373591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d94fb00c-562a-4626-8461-a2e23d0c2205 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.562594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-d94fb00c-562a-4626-8461-a2e23d0c2205 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:20.563354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-d94fb00c-562a-4626-8461-a2e23d0c2205 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:20.565077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-d94fb00c-562a-4626-8461-a2e23d0c2205 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:20.565744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-d94fb00c-562a-4626-8461-a2e23d0c2205 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:20.567553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-d94fb00c-562a-4626-8461-a2e23d0c2205 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:20.714698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d94fb00c-562a-4626-8461-a2e23d0c2205 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:20.723818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d94fb00c-562a-4626-8461-a2e23d0c2205 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.734686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d94fb00c-562a-4626-8461-a2e23d0c2205 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.735767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d94fb00c-562a-4626-8461-a2e23d0c2205 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.737370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d94fb00c-562a-4626-8461-a2e23d0c2205 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.782798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:20.941876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-d94fb00c-562a-4626-8461-a2e23d0c2205 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:21.029210 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d94fb00c-562a-4626-8461-a2e23d0c2205 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60/action" status: 202 len: 1940 microversion: 2.75 time: 1.109443 Jul 20 04:19:21.030647 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1196/2223] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jul 20 04:19:19 2022] POST /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60/action => generated 1940 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 20 04:19:21.063057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-71f1a9c2-0140-4a27-8ea1-8148f3c5f03a tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:21.064082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-71f1a9c2-0140-4a27-8ea1-8148f3c5f03a tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:21.066590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:21.085037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71f1a9c2-0140-4a27-8ea1-8148f3c5f03a tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:21.085769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71f1a9c2-0140-4a27-8ea1-8148f3c5f03a tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.094769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71f1a9c2-0140-4a27-8ea1-8148f3c5f03a tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:21.096872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71f1a9c2-0140-4a27-8ea1-8148f3c5f03a tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.380703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-71f1a9c2-0140-4a27-8ea1-8148f3c5f03a tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:21.405573 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-71f1a9c2-0140-4a27-8ea1-8148f3c5f03a tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1927 microversion: 2.75 time: 0.359786 Jul 20 04:19:21.406824 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1197/2224] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:21 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1927 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:22.426338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9191ffa0-a58b-4e36-b33a-85cc7ebd4354 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:22.426995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9191ffa0-a58b-4e36-b33a-85cc7ebd4354 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:22.444972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9191ffa0-a58b-4e36-b33a-85cc7ebd4354 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:22.445424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9191ffa0-a58b-4e36-b33a-85cc7ebd4354 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:22.446202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9191ffa0-a58b-4e36-b33a-85cc7ebd4354 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:22.451235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9191ffa0-a58b-4e36-b33a-85cc7ebd4354 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:22.557800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-9191ffa0-a58b-4e36-b33a-85cc7ebd4354 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:22.634155 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9191ffa0-a58b-4e36-b33a-85cc7ebd4354 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1927 microversion: 2.75 time: 0.211550 Jul 20 04:19:22.635794 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1198/2225] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:22 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1927 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:19:23.657251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1413b1a1-7d0b-4ea7-b74f-93273a6f1d58 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:23.659063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1413b1a1-7d0b-4ea7-b74f-93273a6f1d58 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:23.684478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1413b1a1-7d0b-4ea7-b74f-93273a6f1d58 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:23.685462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1413b1a1-7d0b-4ea7-b74f-93273a6f1d58 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:23.690379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1413b1a1-7d0b-4ea7-b74f-93273a6f1d58 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:23.692355 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1413b1a1-7d0b-4ea7-b74f-93273a6f1d58 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:23.860484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-1413b1a1-7d0b-4ea7-b74f-93273a6f1d58 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:23.906148 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1413b1a1-7d0b-4ea7-b74f-93273a6f1d58 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1927 microversion: 2.75 time: 0.254007 Jul 20 04:19:23.907713 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1199/2226] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:23 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1927 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:24.632661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1cb977a2-ca64-42a1-9561-ed9786b87ab2 tempest-SecurityGroupsTestAdminJSON-1457679970 tempest-SecurityGroupsTestAdminJSON-1457679970-project] Action: 'create', calling method: .version_select at 0x7f06be91d550>, body: {"security_group": {"name": "tempest-securitygroup-2044600528", "description": "tempest-description-1281058550"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:25.078336 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fae276f4-78bf-4c0a-a981-09c7c4d0f30f tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.876124 Jul 20 04:19:25.079957 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1028/2227] 10.222.0.17 () {60 vars in 1169 bytes} [Wed Jul 20 04:19:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:25.090135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-89476b4c-3aaf-4ebf-8263-a43a3d46b665 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:25.090661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-89476b4c-3aaf-4ebf-8263-a43a3d46b665 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:25.110639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89476b4c-3aaf-4ebf-8263-a43a3d46b665 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:25.117501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89476b4c-3aaf-4ebf-8263-a43a3d46b665 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:25.119374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89476b4c-3aaf-4ebf-8263-a43a3d46b665 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:25.124945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89476b4c-3aaf-4ebf-8263-a43a3d46b665 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:25.296826 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1cb977a2-ca64-42a1-9561-ed9786b87ab2 tempest-SecurityGroupsTestAdminJSON-1457679970 tempest-SecurityGroupsTestAdminJSON-1457679970-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.249566 Jul 20 04:19:25.298426 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1200/2228] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:19:24 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:25.304208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f7cd7fc8-a23d-4901-972a-681cf07a8fb4 tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] Calling method '.version_select at 0x7f06bddbbf70>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:25.432583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-89476b4c-3aaf-4ebf-8263-a43a3d46b665 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:25.483911 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-89476b4c-3aaf-4ebf-8263-a43a3d46b665 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1927 microversion: 2.75 time: 0.389797 Jul 20 04:19:25.484708 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1029/2229] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:25 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1927 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:25.490824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cd20e145-9462-4fe1-9c83-342a73f1e201 tempest-SecurityGroupsTestAdminJSON-1457679970 tempest-SecurityGroupsTestAdminJSON-1457679970-project] Action: 'create', calling method: .version_select at 0x7f06be6d78b0>, body: {"security_group": {"name": "tempest-securitygroup-1729198448", "description": "tempest-description-305754674"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:25.771179 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f7cd7fc8-a23d-4901-972a-681cf07a8fb4 tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/858140ee-9cc9-433a-af16-94b1af1b32c1" status: 200 len: 142 microversion: 2.1 time: 0.471269 Jul 20 04:19:25.777331 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1201/2230] 10.222.0.17 () {58 vars in 1259 bytes} [Wed Jul 20 04:19:25 2022] GET /compute/v2.1/os-floating-ips/858140ee-9cc9-433a-af16-94b1af1b32c1 => generated 142 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:25.782337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-361e7586-e7a2-4341-84f9-00b222d9dddd tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] Calling method '.version_select at 0x7f06bdd5b040>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:26.356168 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cd20e145-9462-4fe1-9c83-342a73f1e201 tempest-SecurityGroupsTestAdminJSON-1457679970 tempest-SecurityGroupsTestAdminJSON-1457679970-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.868869 Jul 20 04:19:26.365691 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1030/2231] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:19:25 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:26.860647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-82c4a96e-9fad-4e0f-80ab-6461b926df90 tempest-SecurityGroupsTestAdminJSON-799159239 tempest-SecurityGroupsTestAdminJSON-799159239-project-admin] Action: 'create', calling method: .version_select at 0x7f06bdb8b940>, body: {"security_group": {"name": "tempest-securitygroup-1505287472", "description": "tempest-description-715743723"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:27.394564 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-361e7586-e7a2-4341-84f9-00b222d9dddd tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/858140ee-9cc9-433a-af16-94b1af1b32c1" status: 202 len: 0 microversion: 2.1 time: 1.615798 Jul 20 04:19:27.399621 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1202/2232] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:19:25 2022] DELETE /compute/v2.1/os-floating-ips/858140ee-9cc9-433a-af16-94b1af1b32c1 => generated 0 bytes in 1622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:19:27.417281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1b854ae6-6f88-44a1-b2d0-732a50d17e4e tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:27.418431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1b854ae6-6f88-44a1-b2d0-732a50d17e4e tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:27.426921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1b854ae6-6f88-44a1-b2d0-732a50d17e4e tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:27.427847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1b854ae6-6f88-44a1-b2d0-732a50d17e4e tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:27.428683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1b854ae6-6f88-44a1-b2d0-732a50d17e4e tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:27.429136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1b854ae6-6f88-44a1-b2d0-732a50d17e4e tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:27.549823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-1b854ae6-6f88-44a1-b2d0-732a50d17e4e tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:27.573839 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1b854ae6-6f88-44a1-b2d0-732a50d17e4e tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1927 microversion: 2.75 time: 0.168913 Jul 20 04:19:27.575836 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1203/2233] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:27 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1927 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:27.583061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fc8c092d-4066-4857-b341-fefd605452fb tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] Calling method '.version_select at 0x7f06bda67280>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:27.769165 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fc8c092d-4066-4857-b341-fefd605452fb tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.191748 Jul 20 04:19:27.778726 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1204/2234] 10.222.0.17 () {58 vars in 1163 bytes} [Wed Jul 20 04:19:27 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:19:27.797590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-892ce840-914d-455b-8c8c-fe8423f76ad5 tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] Calling method '.version_select at 0x7f06bda67ca0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:28.235417 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-892ce840-914d-455b-8c8c-fe8423f76ad5 tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.448337 Jul 20 04:19:28.245777 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1205/2235] 10.222.0.17 () {58 vars in 1148 bytes} [Wed Jul 20 04:19:27 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:19:28.252381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0e09d971-14b5-476e-bfd9-4ec6c34a5348 tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] Calling method '.version_select at 0x7f06c739c310>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:29.201060 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-82c4a96e-9fad-4e0f-80ab-6461b926df90 tempest-SecurityGroupsTestAdminJSON-799159239 tempest-SecurityGroupsTestAdminJSON-799159239-project-admin] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.832534 Jul 20 04:19:29.207528 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1031/2236] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:19:26 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:29.215267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-380ba255-cec7-46b9-ad49-0a5c6e248a2f tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:29.215902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-380ba255-cec7-46b9-ad49-0a5c6e248a2f tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:29.241640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-380ba255-cec7-46b9-ad49-0a5c6e248a2f tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:29.242117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-380ba255-cec7-46b9-ad49-0a5c6e248a2f tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.242931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-380ba255-cec7-46b9-ad49-0a5c6e248a2f tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:29.243382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-380ba255-cec7-46b9-ad49-0a5c6e248a2f tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.448911 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-380ba255-cec7-46b9-ad49-0a5c6e248a2f tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:29.486440 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-380ba255-cec7-46b9-ad49-0a5c6e248a2f tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1927 microversion: 2.75 time: 0.277990 Jul 20 04:19:29.488020 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1032/2237] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:29 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1927 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:29.502199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4a734963-db8e-4615-bb93-671ade3ca2f1 tempest-SecurityGroupsTestAdminJSON-799159239 tempest-SecurityGroupsTestAdminJSON-799159239-project-admin] Action: 'create', calling method: .version_select at 0x7f06bdb8bc10>, body: {"security_group": {"name": "tempest-securitygroup-1506638710", "description": "tempest-description-1444267999"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:30.323985 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4a734963-db8e-4615-bb93-671ade3ca2f1 tempest-SecurityGroupsTestAdminJSON-799159239 tempest-SecurityGroupsTestAdminJSON-799159239-project-admin] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.834443 Jul 20 04:19:30.335015 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1033/2238] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:19:29 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:30.340787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-29066d1f-1afc-4afa-89ab-e7fc141a1777 tempest-SecurityGroupsTestAdminJSON-799159239 tempest-SecurityGroupsTestAdminJSON-799159239-project-admin] Calling method '.version_select at 0x7f06bdbabca0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:30.907884 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0e09d971-14b5-476e-bfd9-4ec6c34a5348 tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/7bdbae18-208b-4d7c-be6d-6cf36b286022" status: 202 len: 0 microversion: 2.1 time: 2.660487 Jul 20 04:19:30.908869 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1206/2239] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:19:28 2022] DELETE /compute/v2.1/os-floating-ips/7bdbae18-208b-4d7c-be6d-6cf36b286022 => generated 0 bytes in 2662 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:19:30.914202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d6b20f5e-09c6-4447-b015-bf2a9211c79d tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:30.914834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d6b20f5e-09c6-4447-b015-bf2a9211c79d tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:30.942277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6b20f5e-09c6-4447-b015-bf2a9211c79d tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:30.942702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6b20f5e-09c6-4447-b015-bf2a9211c79d tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:30.943523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6b20f5e-09c6-4447-b015-bf2a9211c79d tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:30.943966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6b20f5e-09c6-4447-b015-bf2a9211c79d tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:31.123151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-d6b20f5e-09c6-4447-b015-bf2a9211c79d tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:31.178703 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d6b20f5e-09c6-4447-b015-bf2a9211c79d tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1927 microversion: 2.75 time: 0.268540 Jul 20 04:19:31.179326 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1207/2240] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:30 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1927 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:31.183828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-756f0f05-25ac-4461-996c-164565b7fb0d tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] Calling method '.version_select at 0x7f06bda67af0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:32.883499 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-756f0f05-25ac-4461-996c-164565b7fb0d tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/6f375a00-3269-4b50-abde-39f2580016da" status: 202 len: 0 microversion: 2.1 time: 1.702880 Jul 20 04:19:32.885091 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1208/2241] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:19:31 2022] DELETE /compute/v2.1/os-floating-ips/6f375a00-3269-4b50-abde-39f2580016da => generated 0 bytes in 1705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:19:32.891078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e076e505-4ffe-4c91-909f-60fb874e7110 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:32.892013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e076e505-4ffe-4c91-909f-60fb874e7110 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:32.909253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e076e505-4ffe-4c91-909f-60fb874e7110 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:32.910867 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e076e505-4ffe-4c91-909f-60fb874e7110 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:32.918867 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e076e505-4ffe-4c91-909f-60fb874e7110 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:32.919809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e076e505-4ffe-4c91-909f-60fb874e7110 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.342818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-e076e505-4ffe-4c91-909f-60fb874e7110 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:33.388175 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e076e505-4ffe-4c91-909f-60fb874e7110 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1927 microversion: 2.75 time: 0.501754 Jul 20 04:19:33.389040 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1209/2242] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:32 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1927 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:33.399203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e2fcc25c-8dd2-428c-908d-eb444125cf9e tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] Calling method '.version_select at 0x7f06c74158b0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:34.894214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG neutronclient.v2_0.client [None req-29066d1f-1afc-4afa-89ab-e7fc141a1777 tempest-SecurityGroupsTestAdminJSON-799159239 tempest-SecurityGroupsTestAdminJSON-799159239-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6c64e8eb-9596-422e-9a92-fddbcf3151a4 does not exist", "detail": ""}} {{(pid=127870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:19:34.895942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.security_group_api [None req-29066d1f-1afc-4afa-89ab-e7fc141a1777 tempest-SecurityGroupsTestAdminJSON-799159239 tempest-SecurityGroupsTestAdminJSON-799159239-project-admin] Neutron security group 6c64e8eb-9596-422e-9a92-fddbcf3151a4 not found {{(pid=127870) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:19:34.897194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.compute.security_groups [None req-29066d1f-1afc-4afa-89ab-e7fc141a1777 tempest-SecurityGroupsTestAdminJSON-799159239 tempest-SecurityGroupsTestAdminJSON-799159239-project-admin] Security Group ID 6c64e8eb-9596-422e-9a92-fddbcf3151a4 does not exist {{(pid=127870) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 20 04:19:35.030560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG neutronclient.v2_0.client [None req-29066d1f-1afc-4afa-89ab-e7fc141a1777 tempest-SecurityGroupsTestAdminJSON-799159239 tempest-SecurityGroupsTestAdminJSON-799159239-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6c64e8eb-9596-422e-9a92-fddbcf3151a4 does not exist", "detail": ""}} {{(pid=127870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:19:35.031344 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.security_group_api [None req-29066d1f-1afc-4afa-89ab-e7fc141a1777 tempest-SecurityGroupsTestAdminJSON-799159239 tempest-SecurityGroupsTestAdminJSON-799159239-project-admin] Neutron security group 6c64e8eb-9596-422e-9a92-fddbcf3151a4 not found {{(pid=127870) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:19:35.031959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.compute.security_groups [None req-29066d1f-1afc-4afa-89ab-e7fc141a1777 tempest-SecurityGroupsTestAdminJSON-799159239 tempest-SecurityGroupsTestAdminJSON-799159239-project-admin] Security Group ID 6c64e8eb-9596-422e-9a92-fddbcf3151a4 does not exist {{(pid=127870) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 20 04:19:36.482966 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e2fcc25c-8dd2-428c-908d-eb444125cf9e tempest-FloatingIPDetailsTestJSON-2136935898 tempest-FloatingIPDetailsTestJSON-2136935898-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/dd7580d6-e72a-421a-abab-736bae4bd2fe" status: 202 len: 0 microversion: 2.1 time: 3.092627 Jul 20 04:19:36.486817 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1210/2243] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:19:33 2022] DELETE /compute/v2.1/os-floating-ips/dd7580d6-e72a-421a-abab-736bae4bd2fe => generated 0 bytes in 3094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:19:36.488650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-222982a0-9721-4f21-a6e1-00da60811d48 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:36.489269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-222982a0-9721-4f21-a6e1-00da60811d48 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:36.504946 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-222982a0-9721-4f21-a6e1-00da60811d48 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.505303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-222982a0-9721-4f21-a6e1-00da60811d48 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.506114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-222982a0-9721-4f21-a6e1-00da60811d48 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.506548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-222982a0-9721-4f21-a6e1-00da60811d48 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.951368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-222982a0-9721-4f21-a6e1-00da60811d48 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:36.992737 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-222982a0-9721-4f21-a6e1-00da60811d48 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1927 microversion: 2.75 time: 0.507699 Jul 20 04:19:36.993336 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1211/2244] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:36 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1927 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:38.013697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9592e921-2d68-46f3-b0d7-4f064825a183 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:38.015503 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9592e921-2d68-46f3-b0d7-4f064825a183 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:38.026697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9592e921-2d68-46f3-b0d7-4f064825a183 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.027830 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9592e921-2d68-46f3-b0d7-4f064825a183 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.029228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9592e921-2d68-46f3-b0d7-4f064825a183 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.030371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9592e921-2d68-46f3-b0d7-4f064825a183 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.173267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-9592e921-2d68-46f3-b0d7-4f064825a183 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:38.209091 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9592e921-2d68-46f3-b0d7-4f064825a183 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1927 microversion: 2.75 time: 0.199461 Jul 20 04:19:38.222916 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1212/2245] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:38 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1927 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:19:39.122796 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-29066d1f-1afc-4afa-89ab-e7fc141a1777 tempest-SecurityGroupsTestAdminJSON-799159239 tempest-SecurityGroupsTestAdminJSON-799159239-project-admin] 10.222.0.17 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8362 microversion: 2.1 time: 8.785500 Jul 20 04:19:39.140379 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1034/2246] 10.222.0.17 () {58 vars in 1190 bytes} [Wed Jul 20 04:19:30 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8362 bytes in 8804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:39.147389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b7410362-5f79-47f0-8a59-0d801005fa02 tempest-SecurityGroupsTestAdminJSON-1457679970 tempest-SecurityGroupsTestAdminJSON-1457679970-project] Calling method '.version_select at 0x7f06bdf744c0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:39.236677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-50d062af-0f82-4a8e-8aa7-705e9fe1cf95 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:39.238144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-50d062af-0f82-4a8e-8aa7-705e9fe1cf95 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:39.287574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50d062af-0f82-4a8e-8aa7-705e9fe1cf95 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.291380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50d062af-0f82-4a8e-8aa7-705e9fe1cf95 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.293632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50d062af-0f82-4a8e-8aa7-705e9fe1cf95 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.296048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50d062af-0f82-4a8e-8aa7-705e9fe1cf95 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.647299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-50d062af-0f82-4a8e-8aa7-705e9fe1cf95 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:39.683367 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-50d062af-0f82-4a8e-8aa7-705e9fe1cf95 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1927 microversion: 2.75 time: 0.455662 Jul 20 04:19:39.707322 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1035/2247] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:39 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1927 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:19:40.671008 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b7410362-5f79-47f0-8a59-0d801005fa02 tempest-SecurityGroupsTestAdminJSON-1457679970 tempest-SecurityGroupsTestAdminJSON-1457679970-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 1.529351 Jul 20 04:19:40.672342 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1213/2248] 10.222.0.17 () {58 vars in 1190 bytes} [Wed Jul 20 04:19:39 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:40.684235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e26dbbee-4c88-404e-85d4-51d18b43c49f tempest-SecurityGroupsTestAdminJSON-799159239 tempest-SecurityGroupsTestAdminJSON-799159239-project-admin] Calling method '.version_select at 0x7f06c746a4c0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:40.705117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-36a7c6bc-ed6f-44d4-9524-f69ef33949a4 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:40.706140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-36a7c6bc-ed6f-44d4-9524-f69ef33949a4 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:40.718508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36a7c6bc-ed6f-44d4-9524-f69ef33949a4 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.725017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36a7c6bc-ed6f-44d4-9524-f69ef33949a4 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.726248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36a7c6bc-ed6f-44d4-9524-f69ef33949a4 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.727089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36a7c6bc-ed6f-44d4-9524-f69ef33949a4 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:41.018605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-36a7c6bc-ed6f-44d4-9524-f69ef33949a4 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:41.050091 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-36a7c6bc-ed6f-44d4-9524-f69ef33949a4 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1927 microversion: 2.75 time: 0.349226 Jul 20 04:19:41.064075 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1214/2249] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:40 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1927 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:19:41.599033 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e26dbbee-4c88-404e-85d4-51d18b43c49f tempest-SecurityGroupsTestAdminJSON-799159239 tempest-SecurityGroupsTestAdminJSON-799159239-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/64184365-b2c5-4b48-b0d2-604a78c74747" status: 202 len: 0 microversion: 2.1 time: 0.918716 Jul 20 04:19:41.599959 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1036/2250] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:19:40 2022] DELETE /compute/v2.1/os-security-groups/64184365-b2c5-4b48-b0d2-604a78c74747 => generated 0 bytes in 920 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:19:41.607811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-31ee2a8f-b748-412e-b86e-216359f2db7c tempest-SecurityGroupsTestAdminJSON-799159239 tempest-SecurityGroupsTestAdminJSON-799159239-project-admin] Calling method '.version_select at 0x7f06be72f8b0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.075212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2ed880a7-4579-4068-a043-85839af5cf2a tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.075838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2ed880a7-4579-4068-a043-85839af5cf2a tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:42.092712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ed880a7-4579-4068-a043-85839af5cf2a tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.093163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ed880a7-4579-4068-a043-85839af5cf2a tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.093950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ed880a7-4579-4068-a043-85839af5cf2a tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.094392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ed880a7-4579-4068-a043-85839af5cf2a tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.335024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-2ed880a7-4579-4068-a043-85839af5cf2a tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:42.359382 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2ed880a7-4579-4068-a043-85839af5cf2a tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1927 microversion: 2.75 time: 0.287231 Jul 20 04:19:42.373125 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1037/2251] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:42 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1927 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:43.073034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e368414b-6ab6-416c-ace6-796834c3b384 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1682937361", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "9f2e15c5-cd04-41fb-8ad2-3e5402de35e5"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:43.149229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-e368414b-6ab6-416c-ace6-796834c3b384 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] validate_networks() for [('9f2e15c5-cd04-41fb-8ad2-3e5402de35e5', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:43.426484 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-31ee2a8f-b748-412e-b86e-216359f2db7c tempest-SecurityGroupsTestAdminJSON-799159239 tempest-SecurityGroupsTestAdminJSON-799159239-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/0b10e01c-d81c-43e9-844d-b37a4fd90bd8" status: 202 len: 0 microversion: 2.1 time: 1.814219 Jul 20 04:19:43.426484 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1215/2252] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:19:41 2022] DELETE /compute/v2.1/os-security-groups/0b10e01c-d81c-43e9-844d-b37a4fd90bd8 => generated 0 bytes in 1820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:19:43.432426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2795b6b9-3dc7-4b96-a348-fc9a3eb614e5 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:43.434387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2795b6b9-3dc7-4b96-a348-fc9a3eb614e5 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:43.453476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2795b6b9-3dc7-4b96-a348-fc9a3eb614e5 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.454327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2795b6b9-3dc7-4b96-a348-fc9a3eb614e5 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.456933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2795b6b9-3dc7-4b96-a348-fc9a3eb614e5 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.457587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2795b6b9-3dc7-4b96-a348-fc9a3eb614e5 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.934041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-2795b6b9-3dc7-4b96-a348-fc9a3eb614e5 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:43.983066 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2795b6b9-3dc7-4b96-a348-fc9a3eb614e5 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1927 microversion: 2.75 time: 0.557966 Jul 20 04:19:43.997125 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1216/2253] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:43 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1927 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:44.011226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cd1e3154-59cf-4459-9b04-aa68af33f4ec tempest-SecurityGroupsTestAdminJSON-1457679970 tempest-SecurityGroupsTestAdminJSON-1457679970-project] Calling method '.version_select at 0x7f06be2c6430>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:44.421940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e368414b-6ab6-416c-ace6-796834c3b384 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:44.423112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e368414b-6ab6-416c-ace6-796834c3b384 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:44.423763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e368414b-6ab6-416c-ace6-796834c3b384 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:44.424367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e368414b-6ab6-416c-ace6-796834c3b384 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:44.425022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e368414b-6ab6-416c-ace6-796834c3b384 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:44.451377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e368414b-6ab6-416c-ace6-796834c3b384 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:44.455542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e368414b-6ab6-416c-ace6-796834c3b384 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:44.456861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e368414b-6ab6-416c-ace6-796834c3b384 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:44.459704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e368414b-6ab6-416c-ace6-796834c3b384 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:44.515540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-e368414b-6ab6-416c-ace6-796834c3b384 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Getting quotas for project e2651ab9d1654a3fabd35e634f82558b. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:44.533724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-e368414b-6ab6-416c-ace6-796834c3b384 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Getting quotas for user 508eee71ee6b4a918feec4dff7ae0f58 and project e2651ab9d1654a3fabd35e634f82558b. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:44.571699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e368414b-6ab6-416c-ace6-796834c3b384 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:44.577460 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e368414b-6ab6-416c-ace6-796834c3b384 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:44.684151 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e368414b-6ab6-416c-ace6-796834c3b384 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.803404 Jul 20 04:19:44.689986 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1038/2254] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:44.870642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cfdeb0b1-daac-4de6-9d11-1a8d66303a6e tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Action: 'create', calling method: .version_select at 0x7f06bec1f670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1117743674", "description": "tempest-description-717633004"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:46.172016 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cd1e3154-59cf-4459-9b04-aa68af33f4ec tempest-SecurityGroupsTestAdminJSON-1457679970 tempest-SecurityGroupsTestAdminJSON-1457679970-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/2b53b4b0-2d7f-4bf9-b77b-d4b0ada5767d" status: 202 len: 0 microversion: 2.1 time: 2.173042 Jul 20 04:19:46.177959 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1217/2255] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:19:43 2022] DELETE /compute/v2.1/os-security-groups/2b53b4b0-2d7f-4bf9-b77b-d4b0ada5767d => generated 0 bytes in 2180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:19:46.184590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9e533037-0a78-4ee1-951b-73711123b0b4 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:46.187530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9e533037-0a78-4ee1-951b-73711123b0b4 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:46.219326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e533037-0a78-4ee1-951b-73711123b0b4 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.219845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e533037-0a78-4ee1-951b-73711123b0b4 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.220606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e533037-0a78-4ee1-951b-73711123b0b4 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.224907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e533037-0a78-4ee1-951b-73711123b0b4 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.499014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9e533037-0a78-4ee1-951b-73711123b0b4 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508eee71ee6b4a918feec4dff7ae0f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2651ab9d1654a3fabd35e634f82558b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:46.519228 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9e533037-0a78-4ee1-951b-73711123b0b4 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd" status: 200 len: 1229 microversion: 2.1 time: 0.335305 Jul 20 04:19:46.535352 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1218/2256] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:46 2022] GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd => generated 1229 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:46.540716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-279124e0-2b64-4190-9d12-f85340c91128 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:46.548335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-279124e0-2b64-4190-9d12-f85340c91128 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:46.571194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-279124e0-2b64-4190-9d12-f85340c91128 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.571736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-279124e0-2b64-4190-9d12-f85340c91128 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.576948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-279124e0-2b64-4190-9d12-f85340c91128 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.578481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-279124e0-2b64-4190-9d12-f85340c91128 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.720717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-279124e0-2b64-4190-9d12-f85340c91128 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:46.729347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:46.768383 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cfdeb0b1-daac-4de6-9d11-1a8d66303a6e tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.077044 Jul 20 04:19:46.770982 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1039/2257] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:19:44 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:46.780872 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-279124e0-2b64-4190-9d12-f85340c91128 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1927 microversion: 2.75 time: 0.243864 Jul 20 04:19:46.782257 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1219/2258] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:46 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1927 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:46.792160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-647066cb-ff66-4f99-b02d-e243e07e8a83 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Action: 'create', calling method: .version_select at 0x7f06bdf74ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1403057986", "description": "tempest-description-135120908"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:46.795478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f8da9c83-dcc0-42f7-8089-cd0113b4eed9 tempest-SecurityGroupsTestAdminJSON-1457679970 tempest-SecurityGroupsTestAdminJSON-1457679970-project] Calling method '.version_select at 0x7f06c741ac10>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:47.760441 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-647066cb-ff66-4f99-b02d-e243e07e8a83 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.976809 Jul 20 04:19:47.762073 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1220/2259] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:19:46 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:47.766855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-39df0afe-d01f-4b98-ad9b-a6b28f881bd3 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:47.767462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-39df0afe-d01f-4b98-ad9b-a6b28f881bd3 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:47.802162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39df0afe-d01f-4b98-ad9b-a6b28f881bd3 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:47.803093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39df0afe-d01f-4b98-ad9b-a6b28f881bd3 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:47.805345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39df0afe-d01f-4b98-ad9b-a6b28f881bd3 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:47.807265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39df0afe-d01f-4b98-ad9b-a6b28f881bd3 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.071998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-39df0afe-d01f-4b98-ad9b-a6b28f881bd3 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508eee71ee6b4a918feec4dff7ae0f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2651ab9d1654a3fabd35e634f82558b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:48.082513 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-39df0afe-d01f-4b98-ad9b-a6b28f881bd3 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd" status: 200 len: 1283 microversion: 2.1 time: 0.319157 Jul 20 04:19:48.085160 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1221/2260] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:47 2022] GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd => generated 1283 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:48.090450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-185746f3-2e08-470e-87ab-68d84e63f643 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:48.091299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-185746f3-2e08-470e-87ab-68d84e63f643 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:48.131847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-185746f3-2e08-470e-87ab-68d84e63f643 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.138620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-185746f3-2e08-470e-87ab-68d84e63f643 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.147422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-185746f3-2e08-470e-87ab-68d84e63f643 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.152248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-185746f3-2e08-470e-87ab-68d84e63f643 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.353291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-185746f3-2e08-470e-87ab-68d84e63f643 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:48.412897 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-185746f3-2e08-470e-87ab-68d84e63f643 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1933 microversion: 2.75 time: 0.326227 Jul 20 04:19:48.425036 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1222/2261] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:48 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1933 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:48.431655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f895719c-707a-44e0-8ee2-d9b9b355999f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1422713508", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "46925f95-2af7-4d2b-9091-d109b13c5d2e"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:48.563846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-f895719c-707a-44e0-8ee2-d9b9b355999f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] validate_networks() for [('46925f95-2af7-4d2b-9091-d109b13c5d2e', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:48.693283 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f8da9c83-dcc0-42f7-8089-cd0113b4eed9 tempest-SecurityGroupsTestAdminJSON-1457679970 tempest-SecurityGroupsTestAdminJSON-1457679970-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/dd9ccf97-f77b-42e2-a053-ba4c6b394f43" status: 202 len: 0 microversion: 2.1 time: 1.920503 Jul 20 04:19:48.694069 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1040/2262] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:19:46 2022] DELETE /compute/v2.1/os-security-groups/dd9ccf97-f77b-42e2-a053-ba4c6b394f43 => generated 0 bytes in 1922 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:19:49.101905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a4110755-7134-4f51-9ec6-577817a65eeb tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:49.103839 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a4110755-7134-4f51-9ec6-577817a65eeb tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:49.129407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4110755-7134-4f51-9ec6-577817a65eeb tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:49.131046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4110755-7134-4f51-9ec6-577817a65eeb tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:49.131944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4110755-7134-4f51-9ec6-577817a65eeb tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:49.132428 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4110755-7134-4f51-9ec6-577817a65eeb tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:49.308576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a4110755-7134-4f51-9ec6-577817a65eeb tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508eee71ee6b4a918feec4dff7ae0f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2651ab9d1654a3fabd35e634f82558b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:49.323480 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a4110755-7134-4f51-9ec6-577817a65eeb tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd" status: 200 len: 1283 microversion: 2.1 time: 0.225666 Jul 20 04:19:49.327125 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1041/2263] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:49 2022] GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd => generated 1283 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:49.433280 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3f07b8b1-8774-4b4d-bbd3-36988a3a0661 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:49.433905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3f07b8b1-8774-4b4d-bbd3-36988a3a0661 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:49.442669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f07b8b1-8774-4b4d-bbd3-36988a3a0661 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:49.443443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f07b8b1-8774-4b4d-bbd3-36988a3a0661 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:49.444462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f07b8b1-8774-4b4d-bbd3-36988a3a0661 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:49.445086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f07b8b1-8774-4b4d-bbd3-36988a3a0661 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:49.748197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-3f07b8b1-8774-4b4d-bbd3-36988a3a0661 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:49.799762 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3f07b8b1-8774-4b4d-bbd3-36988a3a0661 tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1933 microversion: 2.75 time: 0.369730 Jul 20 04:19:49.823533 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1042/2264] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:49 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1933 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:19:50.341886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1084cb4f-a540-4b51-aba7-caf7ce037f6f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:50.342939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1084cb4f-a540-4b51-aba7-caf7ce037f6f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:50.355244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1084cb4f-a540-4b51-aba7-caf7ce037f6f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.359841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1084cb4f-a540-4b51-aba7-caf7ce037f6f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.362023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1084cb4f-a540-4b51-aba7-caf7ce037f6f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.364509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1084cb4f-a540-4b51-aba7-caf7ce037f6f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.509945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1084cb4f-a540-4b51-aba7-caf7ce037f6f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508eee71ee6b4a918feec4dff7ae0f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2651ab9d1654a3fabd35e634f82558b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:50.525519 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1084cb4f-a540-4b51-aba7-caf7ce037f6f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd" status: 200 len: 1283 microversion: 2.1 time: 0.186251 Jul 20 04:19:50.543730 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1043/2265] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:50 2022] GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd => generated 1283 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:50.821741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-23fabbfd-c5cd-4a22-ab4e-37d90dfd0e8c tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:50.822342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-23fabbfd-c5cd-4a22-ab4e-37d90dfd0e8c tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:50.831496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23fabbfd-c5cd-4a22-ab4e-37d90dfd0e8c tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.831941 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23fabbfd-c5cd-4a22-ab4e-37d90dfd0e8c tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.832796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23fabbfd-c5cd-4a22-ab4e-37d90dfd0e8c tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.833389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23fabbfd-c5cd-4a22-ab4e-37d90dfd0e8c tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.933809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-23fabbfd-c5cd-4a22-ab4e-37d90dfd0e8c tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] Lazy-loading 'services' on Instance uuid 67d9a8e8-29eb-47a6-8538-75bee0757a60 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:50.963721 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-23fabbfd-c5cd-4a22-ab4e-37d90dfd0e8c tempest-ServersAdmin275Test-1436392800 tempest-ServersAdmin275Test-1436392800-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1918 microversion: 2.75 time: 0.145681 Jul 20 04:19:50.964341 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1044/2266] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:50 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1918 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:19:50.992058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-169a0826-f97b-47ce-b5ad-1399d289ae95 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:50.992609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-169a0826-f97b-47ce-b5ad-1399d289ae95 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:51.000101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-169a0826-f97b-47ce-b5ad-1399d289ae95 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.000578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-169a0826-f97b-47ce-b5ad-1399d289ae95 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.001558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-169a0826-f97b-47ce-b5ad-1399d289ae95 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.002194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-169a0826-f97b-47ce-b5ad-1399d289ae95 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.041255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-169a0826-f97b-47ce-b5ad-1399d289ae95 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:51.183425 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-169a0826-f97b-47ce-b5ad-1399d289ae95 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "DELETE /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 204 len: 0 microversion: 2.75 time: 0.197728 Jul 20 04:19:51.184424 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1045/2267] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:19:50 2022] DELETE /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:19:51.193090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3e116fdf-3b8a-4beb-8a44-76e9741a797a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:51.193793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3e116fdf-3b8a-4beb-8a44-76e9741a797a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:51.214949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e116fdf-3b8a-4beb-8a44-76e9741a797a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.217686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e116fdf-3b8a-4beb-8a44-76e9741a797a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.219479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e116fdf-3b8a-4beb-8a44-76e9741a797a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.223809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e116fdf-3b8a-4beb-8a44-76e9741a797a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.358540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3e116fdf-3b8a-4beb-8a44-76e9741a797a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:51.369574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3e116fdf-3b8a-4beb-8a44-76e9741a797a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:51.377169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3e116fdf-3b8a-4beb-8a44-76e9741a797a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:51.385742 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3e116fdf-3b8a-4beb-8a44-76e9741a797a tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1443 microversion: 2.75 time: 0.196459 Jul 20 04:19:51.393008 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1046/2268] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:51 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1443 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:19:51.549559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d964bad-0ad0-4664-999c-aebfdfd7e939 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:51.550194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d964bad-0ad0-4664-999c-aebfdfd7e939 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:51.583324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d964bad-0ad0-4664-999c-aebfdfd7e939 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.583783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d964bad-0ad0-4664-999c-aebfdfd7e939 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.589875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d964bad-0ad0-4664-999c-aebfdfd7e939 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.590720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d964bad-0ad0-4664-999c-aebfdfd7e939 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.597902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f895719c-707a-44e0-8ee2-d9b9b355999f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:51.599594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f895719c-707a-44e0-8ee2-d9b9b355999f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:51.600322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f895719c-707a-44e0-8ee2-d9b9b355999f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:51.601662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f895719c-707a-44e0-8ee2-d9b9b355999f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:51.602270 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f895719c-707a-44e0-8ee2-d9b9b355999f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:51.608130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=54 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:51.621158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f895719c-707a-44e0-8ee2-d9b9b355999f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.621944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f895719c-707a-44e0-8ee2-d9b9b355999f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.622954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f895719c-707a-44e0-8ee2-d9b9b355999f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.623576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f895719c-707a-44e0-8ee2-d9b9b355999f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.652760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-f895719c-707a-44e0-8ee2-d9b9b355999f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Getting quotas for project 373f9f5b2b9f44fdba67acfc147b7d84. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:51.660236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-f895719c-707a-44e0-8ee2-d9b9b355999f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Getting quotas for user 539cb225b4b0422c9f19e0eb18c8983e and project 373f9f5b2b9f44fdba67acfc147b7d84. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:51.676721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f895719c-707a-44e0-8ee2-d9b9b355999f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:51.680866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f895719c-707a-44e0-8ee2-d9b9b355999f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:51.743455 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f895719c-707a-44e0-8ee2-d9b9b355999f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.327819 Jul 20 04:19:51.750205 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1223/2269] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:51.756318 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-73711a4e-7257-404e-ac0f-9f0ec841c889 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:51.757221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-73711a4e-7257-404e-ac0f-9f0ec841c889 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:51.945927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-73711a4e-7257-404e-ac0f-9f0ec841c889 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:51.954254 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-73711a4e-7257-404e-ac0f-9f0ec841c889 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 200 len: 1216 microversion: 2.1 time: 0.202466 Jul 20 04:19:51.955936 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1224/2270] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:51 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 1216 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:52.291457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d964bad-0ad0-4664-999c-aebfdfd7e939 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508eee71ee6b4a918feec4dff7ae0f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2651ab9d1654a3fabd35e634f82558b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.306388 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d964bad-0ad0-4664-999c-aebfdfd7e939 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd" status: 200 len: 1325 microversion: 2.1 time: 0.761297 Jul 20 04:19:52.307703 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1047/2271] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:51 2022] GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd => generated 1325 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:52.413104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-46436fab-ef36-4fd9-aa3c-e250f163ad12 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:52.413771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-46436fab-ef36-4fd9-aa3c-e250f163ad12 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:52.427102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46436fab-ef36-4fd9-aa3c-e250f163ad12 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.433481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46436fab-ef36-4fd9-aa3c-e250f163ad12 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.434799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46436fab-ef36-4fd9-aa3c-e250f163ad12 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.435555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46436fab-ef36-4fd9-aa3c-e250f163ad12 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.897755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-46436fab-ef36-4fd9-aa3c-e250f163ad12 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.919623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-46436fab-ef36-4fd9-aa3c-e250f163ad12 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.922085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-46436fab-ef36-4fd9-aa3c-e250f163ad12 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.931554 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-46436fab-ef36-4fd9-aa3c-e250f163ad12 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1443 microversion: 2.75 time: 0.524238 Jul 20 04:19:52.935045 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1225/2272] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:52 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1443 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:52.972717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9d4b3f93-b404-4c99-aec2-db604aaad607 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:52.973704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9d4b3f93-b404-4c99-aec2-db604aaad607 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:52.981412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d4b3f93-b404-4c99-aec2-db604aaad607 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.982117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d4b3f93-b404-4c99-aec2-db604aaad607 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.983095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d4b3f93-b404-4c99-aec2-db604aaad607 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.983692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d4b3f93-b404-4c99-aec2-db604aaad607 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:53.077057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9d4b3f93-b404-4c99-aec2-db604aaad607 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:53.088426 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9d4b3f93-b404-4c99-aec2-db604aaad607 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 200 len: 1268 microversion: 2.1 time: 0.120280 Jul 20 04:19:53.098469 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1048/2273] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:52 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 1268 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:53.325482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-30f7487c-b805-4e73-8222-aa2883e7142a tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:53.326283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-30f7487c-b805-4e73-8222-aa2883e7142a tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:53.333131 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30f7487c-b805-4e73-8222-aa2883e7142a tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:53.339250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30f7487c-b805-4e73-8222-aa2883e7142a tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:53.339971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30f7487c-b805-4e73-8222-aa2883e7142a tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:53.341121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30f7487c-b805-4e73-8222-aa2883e7142a tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:53.964440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c4114fa9-5c9b-4215-8ad4-2b7151eb4364 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:53.965182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c4114fa9-5c9b-4215-8ad4-2b7151eb4364 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:53.967275 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:53.989262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4114fa9-5c9b-4215-8ad4-2b7151eb4364 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:53.989754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4114fa9-5c9b-4215-8ad4-2b7151eb4364 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:53.990574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4114fa9-5c9b-4215-8ad4-2b7151eb4364 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:53.992462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4114fa9-5c9b-4215-8ad4-2b7151eb4364 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.039189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:54.077606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-30f7487c-b805-4e73-8222-aa2883e7142a tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508eee71ee6b4a918feec4dff7ae0f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2651ab9d1654a3fabd35e634f82558b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:54.094526 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-30f7487c-b805-4e73-8222-aa2883e7142a tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd" status: 200 len: 1325 microversion: 2.1 time: 0.773095 Jul 20 04:19:54.097175 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1226/2274] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:53 2022] GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd => generated 1325 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:54.109243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a0a30cf9-6e5a-4f1e-a3e5-ad939e0ccbd1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:54.110987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a0a30cf9-6e5a-4f1e-a3e5-ad939e0ccbd1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:54.122922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0a30cf9-6e5a-4f1e-a3e5-ad939e0ccbd1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.124811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0a30cf9-6e5a-4f1e-a3e5-ad939e0ccbd1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.130232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0a30cf9-6e5a-4f1e-a3e5-ad939e0ccbd1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.137032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0a30cf9-6e5a-4f1e-a3e5-ad939e0ccbd1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.362910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c4114fa9-5c9b-4215-8ad4-2b7151eb4364 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:54.385943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c4114fa9-5c9b-4215-8ad4-2b7151eb4364 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:54.392651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c4114fa9-5c9b-4215-8ad4-2b7151eb4364 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93b1b595bde24757beec1c8c572491ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becf6f1f28854a64817a7e7d80c6e8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:54.428525 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c4114fa9-5c9b-4215-8ad4-2b7151eb4364 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 200 len: 1443 microversion: 2.75 time: 0.463583 Jul 20 04:19:54.428525 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1049/2275] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:53 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 1443 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:54.680718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a0a30cf9-6e5a-4f1e-a3e5-ad939e0ccbd1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:54.694823 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a0a30cf9-6e5a-4f1e-a3e5-ad939e0ccbd1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 200 len: 1274 microversion: 2.1 time: 0.592567 Jul 20 04:19:54.709915 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1227/2276] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:54 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 1274 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:55.114586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-30aa5602-acf0-4a2f-b3c8-66ebe40bc1d8 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:55.115198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-30aa5602-acf0-4a2f-b3c8-66ebe40bc1d8 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:55.128016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:55.129420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:55.161173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30aa5602-acf0-4a2f-b3c8-66ebe40bc1d8 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.163935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30aa5602-acf0-4a2f-b3c8-66ebe40bc1d8 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.165606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30aa5602-acf0-4a2f-b3c8-66ebe40bc1d8 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.171942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30aa5602-acf0-4a2f-b3c8-66ebe40bc1d8 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.690484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-30aa5602-acf0-4a2f-b3c8-66ebe40bc1d8 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508eee71ee6b4a918feec4dff7ae0f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2651ab9d1654a3fabd35e634f82558b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:55.699306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-35c23957-8a9f-44fe-b673-bf65e6d9b0b1 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1472976444", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:55.710887 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-30aa5602-acf0-4a2f-b3c8-66ebe40bc1d8 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd" status: 200 len: 1325 microversion: 2.1 time: 0.600716 Jul 20 04:19:55.726354 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1050/2277] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:55 2022] GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd => generated 1325 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:55.748183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-020e54f5-9a8d-4716-b7c9-8cd6bcaecdc6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:55.755082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-020e54f5-9a8d-4716-b7c9-8cd6bcaecdc6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] [instance: 67d9a8e8-29eb-47a6-8538-75bee0757a60] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:55.775535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-020e54f5-9a8d-4716-b7c9-8cd6bcaecdc6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.776152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-020e54f5-9a8d-4716-b7c9-8cd6bcaecdc6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.777066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-020e54f5-9a8d-4716-b7c9-8cd6bcaecdc6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.777587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-020e54f5-9a8d-4716-b7c9-8cd6bcaecdc6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.801924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-35c23957-8a9f-44fe-b673-bf65e6d9b0b1 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:55.841219 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-020e54f5-9a8d-4716-b7c9-8cd6bcaecdc6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] HTTP exception thrown: Instance 67d9a8e8-29eb-47a6-8538-75bee0757a60 could not be found. Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-020e54f5-9a8d-4716-b7c9-8cd6bcaecdc6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Request method failure captured: Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 HTTP/1.1 Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14IfP8zJ1zbtBa_93MOE_P11V2Le_zpznbAQpyvCt1RkY9G8LyUeDqSw871mUd21h57wPcbyHVbJpsTeHQcI61bUvYgW-X_9xi-vl1gnpNc6KqqRxt-VcnI17J0-8J_NyzoFey-UgSweNY5Ww5g1dk_2pdjNRxaoKIh6qxlPrrLUJ8w Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.75 Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: becf6f1f28854a64817a7e7d80c6e8ac Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersAdmin275Test-2125658140 Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:19:55.845196 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:19:55.847281 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/becf6f1f28854a64817a7e7d80c6e8ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/becf6f1f28854a64817a7e7d80c6e8ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_becf6f1f28854a64817a7e7d80c6e8ac", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/becf6f1f28854a64817a7e7d80c6e8ac"}]}] Jul 20 04:19:55.847281 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersAdmin275Test-2125658140 Jul 20 04:19:55.847281 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: becf6f1f28854a64817a7e7d80c6e8ac Jul 20 04:19:55.847281 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersAdmin275Test-2125658140 Jul 20 04:19:55.847281 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersAdmin275Test-2125658140-project Jul 20 04:19:55.847281 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:19:55.847281 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:19:55.847281 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 93b1b595bde24757beec1c8c572491ab Jul 20 04:19:55.847281 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersAdmin275Test-2125658140-project Jul 20 04:19:55.847281 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:19:55.847281 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 67d9a8e8-29eb-47a6-8538-75bee0757a60 could not be found. Jul 20 04:19:55.847281 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '67d9a8e8-29eb-47a6-8538-75bee0757a60'} Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67d9a8e8-29eb-47a6-8538-75bee0757a60 could not be found. Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:55.848150 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:55.849409 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:55.849409 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:55.849409 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:55.849409 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:55.849409 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:55.849409 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:55.849409 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:55.849409 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67d9a8e8-29eb-47a6-8538-75bee0757a60 could not be found. Jul 20 04:19:55.849409 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:19:55.849409 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:55.849409 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:19:55.849409 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:55.849409 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:55.849409 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:55.849409 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:55.849409 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:55.849409 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67d9a8e8-29eb-47a6-8538-75bee0757a60 could not be found. Jul 20 04:19:55.849409 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:19:55.851222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-020e54f5-9a8d-4716-b7c9-8cd6bcaecdc6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] Returning 404 to user: Instance 67d9a8e8-29eb-47a6-8538-75bee0757a60 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:55.852218 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-020e54f5-9a8d-4716-b7c9-8cd6bcaecdc6 tempest-ServersAdmin275Test-2125658140 tempest-ServersAdmin275Test-2125658140-project] 10.222.0.17 "GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60" status: 404 len: 111 microversion: 2.75 time: 0.119313 Jul 20 04:19:55.856233 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1051/2278] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:55 2022] GET /compute/v2.1/servers/67d9a8e8-29eb-47a6-8538-75bee0757a60 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:19:55.866644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a67c9551-2fbf-4bac-b294-27bf31907ab0 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:55.869103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a67c9551-2fbf-4bac-b294-27bf31907ab0 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:55.888687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a67c9551-2fbf-4bac-b294-27bf31907ab0 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.889439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a67c9551-2fbf-4bac-b294-27bf31907ab0 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.890444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a67c9551-2fbf-4bac-b294-27bf31907ab0 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.891088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a67c9551-2fbf-4bac-b294-27bf31907ab0 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.406290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a67c9551-2fbf-4bac-b294-27bf31907ab0 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:56.422029 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a67c9551-2fbf-4bac-b294-27bf31907ab0 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 200 len: 1274 microversion: 2.1 time: 0.564205 Jul 20 04:19:56.422677 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1052/2279] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:55 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 1274 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:56.869526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-35c23957-8a9f-44fe-b673-bf65e6d9b0b1 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:56.870051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-35c23957-8a9f-44fe-b673-bf65e6d9b0b1 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:56.870638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-35c23957-8a9f-44fe-b673-bf65e6d9b0b1 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:56.871153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-35c23957-8a9f-44fe-b673-bf65e6d9b0b1 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:56.871667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-35c23957-8a9f-44fe-b673-bf65e6d9b0b1 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:56.888507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35c23957-8a9f-44fe-b673-bf65e6d9b0b1 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.889371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35c23957-8a9f-44fe-b673-bf65e6d9b0b1 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.894125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8041e9f9-9863-4911-a02c-58ef93232f97 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1069270584", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:56.895693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35c23957-8a9f-44fe-b673-bf65e6d9b0b1 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.896202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35c23957-8a9f-44fe-b673-bf65e6d9b0b1 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.934845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-35c23957-8a9f-44fe-b673-bf65e6d9b0b1 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Getting quotas for project d883ef732fba496db095a9ba2202a304. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:56.961884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-35c23957-8a9f-44fe-b673-bf65e6d9b0b1 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Getting quotas for user b3d729a66b42428cb90920e80d8a06ce and project d883ef732fba496db095a9ba2202a304. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:56.992862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35c23957-8a9f-44fe-b673-bf65e6d9b0b1 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:56.994976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35c23957-8a9f-44fe-b673-bf65e6d9b0b1 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:57.022444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-8041e9f9-9863-4911-a02c-58ef93232f97 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] validate_networks() for None {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:57.101357 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-35c23957-8a9f-44fe-b673-bf65e6d9b0b1 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.960595 Jul 20 04:19:57.109586 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1228/2280] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:57.116686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-464bab1f-85ce-4e34-a1c0-8ee9eb629f2d tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:57.116686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-464bab1f-85ce-4e34-a1c0-8ee9eb629f2d tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:57.123169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-464bab1f-85ce-4e34-a1c0-8ee9eb629f2d tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.123621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-464bab1f-85ce-4e34-a1c0-8ee9eb629f2d tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.125409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-464bab1f-85ce-4e34-a1c0-8ee9eb629f2d tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.125851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-464bab1f-85ce-4e34-a1c0-8ee9eb629f2d tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.863566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-464bab1f-85ce-4e34-a1c0-8ee9eb629f2d tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508eee71ee6b4a918feec4dff7ae0f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2651ab9d1654a3fabd35e634f82558b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:57.888475 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-464bab1f-85ce-4e34-a1c0-8ee9eb629f2d tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd" status: 200 len: 1325 microversion: 2.1 time: 0.773284 Jul 20 04:19:57.890468 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1229/2281] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:57 2022] GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd => generated 1325 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:57.909805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-638b4292-d63b-48cc-9a59-e2c46365a0c3 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:57.911328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-638b4292-d63b-48cc-9a59-e2c46365a0c3 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:57.932761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-638b4292-d63b-48cc-9a59-e2c46365a0c3 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.933740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-638b4292-d63b-48cc-9a59-e2c46365a0c3 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.935760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-638b4292-d63b-48cc-9a59-e2c46365a0c3 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.936704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-638b4292-d63b-48cc-9a59-e2c46365a0c3 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.142807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-638b4292-d63b-48cc-9a59-e2c46365a0c3 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:58.158364 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-638b4292-d63b-48cc-9a59-e2c46365a0c3 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1221 microversion: 2.1 time: 0.266190 Jul 20 04:19:58.159343 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1230/2282] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:57 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1221 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:58.172381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9af13459-1b14-4a4c-bac4-988b56c055ce tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.173254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9af13459-1b14-4a4c-bac4-988b56c055ce tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:58.181143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9af13459-1b14-4a4c-bac4-988b56c055ce tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.181817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9af13459-1b14-4a4c-bac4-988b56c055ce tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.182836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9af13459-1b14-4a4c-bac4-988b56c055ce tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.183520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9af13459-1b14-4a4c-bac4-988b56c055ce tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.467317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8041e9f9-9863-4911-a02c-58ef93232f97 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:58.473599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8041e9f9-9863-4911-a02c-58ef93232f97 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:58.477461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8041e9f9-9863-4911-a02c-58ef93232f97 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:58.481961 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8041e9f9-9863-4911-a02c-58ef93232f97 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:58.483771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8041e9f9-9863-4911-a02c-58ef93232f97 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:58.509328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8041e9f9-9863-4911-a02c-58ef93232f97 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.510191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8041e9f9-9863-4911-a02c-58ef93232f97 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.511495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8041e9f9-9863-4911-a02c-58ef93232f97 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.512133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8041e9f9-9863-4911-a02c-58ef93232f97 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.706932 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8041e9f9-9863-4911-a02c-58ef93232f97 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Getting quotas for project a12dc3cd573c47e89a2aac47a6d5fd78. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:58.728483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8041e9f9-9863-4911-a02c-58ef93232f97 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Getting quotas for user a4c22d39ea834080adb14e4133bb458a and project a12dc3cd573c47e89a2aac47a6d5fd78. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:58.761940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9af13459-1b14-4a4c-bac4-988b56c055ce tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:58.776440 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9af13459-1b14-4a4c-bac4-988b56c055ce tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 200 len: 1316 microversion: 2.1 time: 0.615695 Jul 20 04:19:58.785738 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1231/2283] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:58 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 1316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:58.800284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-a135cf14-4928-4d3c-a5e5-c5c1e7c36dfa req-73370194-aada-4c9d-a675-12134404ef30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d563dace-705c-492a-a1c6-5bb2254b32bd", "tag": "b08a34e6-0f48-4a56-984a-1682540bbf2e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:58.801356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8041e9f9-9863-4911-a02c-58ef93232f97 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:58.810994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8041e9f9-9863-4911-a02c-58ef93232f97 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:58.836978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a135cf14-4928-4d3c-a5e5-c5c1e7c36dfa req-73370194-aada-4c9d-a675-12134404ef30 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.837419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a135cf14-4928-4d3c-a5e5-c5c1e7c36dfa req-73370194-aada-4c9d-a675-12134404ef30 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.874051 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-a135cf14-4928-4d3c-a5e5-c5c1e7c36dfa req-73370194-aada-4c9d-a675-12134404ef30 service nova] Creating event network-changed:b08a34e6-0f48-4a56-984a-1682540bbf2e for instance d563dace-705c-492a-a1c6-5bb2254b32bd on n-h1-826526-5 Jul 20 04:19:58.884371 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-a135cf14-4928-4d3c-a5e5-c5c1e7c36dfa req-73370194-aada-4c9d-a675-12134404ef30 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097142 Jul 20 04:19:58.886185 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1232/2284] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:58.907653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b4d753b-8751-4dcc-8aac-1d260bf6e935 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.908400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9b4d753b-8751-4dcc-8aac-1d260bf6e935 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:58.936433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b4d753b-8751-4dcc-8aac-1d260bf6e935 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.936900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b4d753b-8751-4dcc-8aac-1d260bf6e935 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.937751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b4d753b-8751-4dcc-8aac-1d260bf6e935 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.938380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b4d753b-8751-4dcc-8aac-1d260bf6e935 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.966149 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8041e9f9-9863-4911-a02c-58ef93232f97 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.537071 Jul 20 04:19:58.971562 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1053/2285] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:58.982688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8c8235f8-048a-44b5-a5aa-58a303f6fcb3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.997309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8c8235f8-048a-44b5-a5aa-58a303f6fcb3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:59.476050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8c8235f8-048a-44b5-a5aa-58a303f6fcb3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c22d39ea834080adb14e4133bb458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dc3cd573c47e89a2aac47a6d5fd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:59.503418 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8c8235f8-048a-44b5-a5aa-58a303f6fcb3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0" status: 200 len: 1223 microversion: 2.1 time: 0.521772 Jul 20 04:19:59.509324 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1054/2286] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:58 2022] GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 => generated 1223 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:59.536991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-de54b695-0a02-4744-9180-e4fd93778f8d tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:59.544027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-de54b695-0a02-4744-9180-e4fd93778f8d tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:59.562038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de54b695-0a02-4744-9180-e4fd93778f8d tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.569346 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de54b695-0a02-4744-9180-e4fd93778f8d tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.573987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de54b695-0a02-4744-9180-e4fd93778f8d tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.577386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de54b695-0a02-4744-9180-e4fd93778f8d tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.710578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9b4d753b-8751-4dcc-8aac-1d260bf6e935 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508eee71ee6b4a918feec4dff7ae0f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2651ab9d1654a3fabd35e634f82558b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:59.725690 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9b4d753b-8751-4dcc-8aac-1d260bf6e935 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd" status: 200 len: 1325 microversion: 2.1 time: 0.821400 Jul 20 04:19:59.727179 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1233/2287] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:58 2022] GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd => generated 1325 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:59.795779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-622d9937-0f1f-4407-9e5e-84a532bfc3e4 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:59.796458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-622d9937-0f1f-4407-9e5e-84a532bfc3e4 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:59.809849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-622d9937-0f1f-4407-9e5e-84a532bfc3e4 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.810557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-622d9937-0f1f-4407-9e5e-84a532bfc3e4 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.811599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-622d9937-0f1f-4407-9e5e-84a532bfc3e4 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.812618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-622d9937-0f1f-4407-9e5e-84a532bfc3e4 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.148020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-de54b695-0a02-4744-9180-e4fd93778f8d tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:00.163957 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-de54b695-0a02-4744-9180-e4fd93778f8d tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1275 microversion: 2.1 time: 0.638385 Jul 20 04:20:00.177597 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1055/2288] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:59 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1275 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:00.190180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-622d9937-0f1f-4407-9e5e-84a532bfc3e4 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:00.204463 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-622d9937-0f1f-4407-9e5e-84a532bfc3e4 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 200 len: 1316 microversion: 2.1 time: 0.413641 Jul 20 04:20:00.205095 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1234/2289] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:59 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:00.557915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-90e682f3-194b-4e3a-8e78-626515281aeb tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:00.564889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-90e682f3-194b-4e3a-8e78-626515281aeb tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:00.614931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90e682f3-194b-4e3a-8e78-626515281aeb tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.623306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90e682f3-194b-4e3a-8e78-626515281aeb tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.632654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90e682f3-194b-4e3a-8e78-626515281aeb tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.635112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90e682f3-194b-4e3a-8e78-626515281aeb tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.743565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-392c1850-1ac9-4ac6-adfc-22577daaf378 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:00.744426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-392c1850-1ac9-4ac6-adfc-22577daaf378 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:00.756657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-392c1850-1ac9-4ac6-adfc-22577daaf378 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.757106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-392c1850-1ac9-4ac6-adfc-22577daaf378 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.758251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-392c1850-1ac9-4ac6-adfc-22577daaf378 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.758464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-392c1850-1ac9-4ac6-adfc-22577daaf378 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.401446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-90e682f3-194b-4e3a-8e78-626515281aeb tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c22d39ea834080adb14e4133bb458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dc3cd573c47e89a2aac47a6d5fd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:01.414561 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-90e682f3-194b-4e3a-8e78-626515281aeb tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0" status: 200 len: 1275 microversion: 2.1 time: 0.889485 Jul 20 04:20:01.417723 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1056/2290] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:00 2022] GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 => generated 1275 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:01.426996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a0e2e422-2771-41e8-a540-b5ba90adbb72 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:01.428009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a0e2e422-2771-41e8-a540-b5ba90adbb72 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:01.436511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0e2e422-2771-41e8-a540-b5ba90adbb72 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.437264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0e2e422-2771-41e8-a540-b5ba90adbb72 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.438225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0e2e422-2771-41e8-a540-b5ba90adbb72 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.439331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0e2e422-2771-41e8-a540-b5ba90adbb72 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.642336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a0e2e422-2771-41e8-a540-b5ba90adbb72 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:01.655297 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a0e2e422-2771-41e8-a540-b5ba90adbb72 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1275 microversion: 2.1 time: 0.234695 Jul 20 04:20:01.664738 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1057/2291] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:01 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1275 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:01.664738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-513d280e-a5ec-471f-af7b-2f86ad6def92 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:01.665198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-513d280e-a5ec-471f-af7b-2f86ad6def92 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:01.677494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-513d280e-a5ec-471f-af7b-2f86ad6def92 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.678275 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-513d280e-a5ec-471f-af7b-2f86ad6def92 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.679414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-513d280e-a5ec-471f-af7b-2f86ad6def92 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.680232 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-513d280e-a5ec-471f-af7b-2f86ad6def92 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.080618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-392c1850-1ac9-4ac6-adfc-22577daaf378 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508eee71ee6b4a918feec4dff7ae0f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2651ab9d1654a3fabd35e634f82558b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:02.090642 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-392c1850-1ac9-4ac6-adfc-22577daaf378 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd" status: 200 len: 1325 microversion: 2.1 time: 1.350636 Jul 20 04:20:02.091732 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1235/2292] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:00 2022] GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd => generated 1325 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:02.382884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-513d280e-a5ec-471f-af7b-2f86ad6def92 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:02.392223 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-513d280e-a5ec-471f-af7b-2f86ad6def92 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 200 len: 1316 microversion: 2.1 time: 0.734569 Jul 20 04:20:02.395912 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1058/2293] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:01 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 1316 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:02.433300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-24266112-3d6e-4ab2-a931-a18179c19992 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:02.433933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-24266112-3d6e-4ab2-a931-a18179c19992 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:02.443722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24266112-3d6e-4ab2-a931-a18179c19992 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.444468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24266112-3d6e-4ab2-a931-a18179c19992 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.445096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24266112-3d6e-4ab2-a931-a18179c19992 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.450239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24266112-3d6e-4ab2-a931-a18179c19992 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.516119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e3618233-bfe4-4609-815e-a90030ef47e0 req-a6e36f0e-28e3-4743-86cb-978b02ada4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd", "tag": "d17d33e4-2f92-4b69-a966-8ecf67ac6a66"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:02.529371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e3618233-bfe4-4609-815e-a90030ef47e0 req-a6e36f0e-28e3-4743-86cb-978b02ada4e2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.530109 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e3618233-bfe4-4609-815e-a90030ef47e0 req-a6e36f0e-28e3-4743-86cb-978b02ada4e2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.543763 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e3618233-bfe4-4609-815e-a90030ef47e0 req-a6e36f0e-28e3-4743-86cb-978b02ada4e2 service nova] Creating event network-changed:d17d33e4-2f92-4b69-a966-8ecf67ac6a66 for instance bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd on n-h1-826526-5 Jul 20 04:20:02.551047 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e3618233-bfe4-4609-815e-a90030ef47e0 req-a6e36f0e-28e3-4743-86cb-978b02ada4e2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.402164 Jul 20 04:20:02.553132 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1236/2294] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:02.668417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-24266112-3d6e-4ab2-a931-a18179c19992 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c22d39ea834080adb14e4133bb458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dc3cd573c47e89a2aac47a6d5fd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:02.674952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9dca0afe-46b4-4e0e-9089-a977122e6cbd tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:02.675661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9dca0afe-46b4-4e0e-9089-a977122e6cbd tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:02.687584 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-24266112-3d6e-4ab2-a931-a18179c19992 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0" status: 200 len: 1281 microversion: 2.1 time: 0.258046 Jul 20 04:20:02.694923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9dca0afe-46b4-4e0e-9089-a977122e6cbd tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.698119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9dca0afe-46b4-4e0e-9089-a977122e6cbd tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.699396 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1059/2295] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:02 2022] GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 => generated 1281 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:02.699532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9dca0afe-46b4-4e0e-9089-a977122e6cbd tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.700203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9dca0afe-46b4-4e0e-9089-a977122e6cbd tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.886443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9dca0afe-46b4-4e0e-9089-a977122e6cbd tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:02.918473 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9dca0afe-46b4-4e0e-9089-a977122e6cbd tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1275 microversion: 2.1 time: 0.249857 Jul 20 04:20:02.929731 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1237/2296] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:02 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1275 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:03.108892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d4f8808d-8c8e-4382-b763-957896a9fd9f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:03.110099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d4f8808d-8c8e-4382-b763-957896a9fd9f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:03.120530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4f8808d-8c8e-4382-b763-957896a9fd9f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.121875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4f8808d-8c8e-4382-b763-957896a9fd9f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.123525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4f8808d-8c8e-4382-b763-957896a9fd9f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.124191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4f8808d-8c8e-4382-b763-957896a9fd9f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.412121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-638c3ade-2385-42de-b9ff-d4666b012524 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:03.412774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-638c3ade-2385-42de-b9ff-d4666b012524 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:03.432240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-638c3ade-2385-42de-b9ff-d4666b012524 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.432992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-638c3ade-2385-42de-b9ff-d4666b012524 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.433979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-638c3ade-2385-42de-b9ff-d4666b012524 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.434598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-638c3ade-2385-42de-b9ff-d4666b012524 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.731252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-638c3ade-2385-42de-b9ff-d4666b012524 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:03.754929 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-638c3ade-2385-42de-b9ff-d4666b012524 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 200 len: 1316 microversion: 2.1 time: 0.341673 Jul 20 04:20:03.754929 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1238/2297] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:03 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:03.756605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-019c4f97-8933-47c0-ae3f-386fd899af32 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:03.757232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-019c4f97-8933-47c0-ae3f-386fd899af32 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:03.776853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-019c4f97-8933-47c0-ae3f-386fd899af32 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.777475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-019c4f97-8933-47c0-ae3f-386fd899af32 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.778626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-019c4f97-8933-47c0-ae3f-386fd899af32 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.779084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-019c4f97-8933-47c0-ae3f-386fd899af32 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.883083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-019c4f97-8933-47c0-ae3f-386fd899af32 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c22d39ea834080adb14e4133bb458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dc3cd573c47e89a2aac47a6d5fd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:03.892673 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-019c4f97-8933-47c0-ae3f-386fd899af32 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0" status: 200 len: 1281 microversion: 2.1 time: 0.140912 Jul 20 04:20:03.893144 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1239/2298] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:03 2022] GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 => generated 1281 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:03.943115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-71749caf-2912-485f-971d-46556bf8f501 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:03.944978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-71749caf-2912-485f-971d-46556bf8f501 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:03.956300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71749caf-2912-485f-971d-46556bf8f501 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.957095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71749caf-2912-485f-971d-46556bf8f501 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.958678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71749caf-2912-485f-971d-46556bf8f501 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.959578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71749caf-2912-485f-971d-46556bf8f501 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:04.124040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-71749caf-2912-485f-971d-46556bf8f501 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:04.148292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:04.156356 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-71749caf-2912-485f-971d-46556bf8f501 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1275 microversion: 2.1 time: 0.222338 Jul 20 04:20:04.158325 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1240/2299] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:03 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1275 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:04.379899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d4f8808d-8c8e-4382-b763-957896a9fd9f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508eee71ee6b4a918feec4dff7ae0f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2651ab9d1654a3fabd35e634f82558b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:04.388911 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d4f8808d-8c8e-4382-b763-957896a9fd9f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd" status: 200 len: 1325 microversion: 2.1 time: 1.284571 Jul 20 04:20:04.402819 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1060/2300] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:03 2022] GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd => generated 1325 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:04.769288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c48a2735-35c7-456e-afda-36e823553d33 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:04.770715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c48a2735-35c7-456e-afda-36e823553d33 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:04.800788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c48a2735-35c7-456e-afda-36e823553d33 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:04.804147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c48a2735-35c7-456e-afda-36e823553d33 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:04.814741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c48a2735-35c7-456e-afda-36e823553d33 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:04.816090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c48a2735-35c7-456e-afda-36e823553d33 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:04.911169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f0ea6adf-2bca-44ea-812f-dd8e835c877c tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:04.911799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f0ea6adf-2bca-44ea-812f-dd8e835c877c tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:04.924423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f0ea6adf-2bca-44ea-812f-dd8e835c877c tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:04.925169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f0ea6adf-2bca-44ea-812f-dd8e835c877c tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:04.938418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f0ea6adf-2bca-44ea-812f-dd8e835c877c tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:04.943979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f0ea6adf-2bca-44ea-812f-dd8e835c877c tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.385880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f0ea6adf-2bca-44ea-812f-dd8e835c877c tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c22d39ea834080adb14e4133bb458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dc3cd573c47e89a2aac47a6d5fd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:05.399271 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f0ea6adf-2bca-44ea-812f-dd8e835c877c tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0" status: 200 len: 1281 microversion: 2.1 time: 0.492656 Jul 20 04:20:05.400892 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1061/2301] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:04 2022] GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 => generated 1281 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:05.531198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c48a2735-35c7-456e-afda-36e823553d33 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:05.544420 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c48a2735-35c7-456e-afda-36e823553d33 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 200 len: 1316 microversion: 2.1 time: 0.780873 Jul 20 04:20:05.551208 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1241/2302] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:04 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 1316 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:05.563441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9ce607b4-431c-4365-8fea-71edc587605a tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:05.574219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9ce607b4-431c-4365-8fea-71edc587605a tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:05.582591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ce607b4-431c-4365-8fea-71edc587605a tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.584229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ce607b4-431c-4365-8fea-71edc587605a tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.585398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ce607b4-431c-4365-8fea-71edc587605a tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.589065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ce607b4-431c-4365-8fea-71edc587605a tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.687695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-29b42342-a76f-47bc-991a-a5ed447204ba req-1b1dd9ad-5810-4d86-8928-35bfcdbf6064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d563dace-705c-492a-a1c6-5bb2254b32bd", "name": "network-vif-plugged", "status": "completed", "tag": "b08a34e6-0f48-4a56-984a-1682540bbf2e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:05.699514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-29b42342-a76f-47bc-991a-a5ed447204ba req-1b1dd9ad-5810-4d86-8928-35bfcdbf6064 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.700250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-29b42342-a76f-47bc-991a-a5ed447204ba req-1b1dd9ad-5810-4d86-8928-35bfcdbf6064 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.727660 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-29b42342-a76f-47bc-991a-a5ed447204ba req-1b1dd9ad-5810-4d86-8928-35bfcdbf6064 service nova] Creating event network-vif-plugged:b08a34e6-0f48-4a56-984a-1682540bbf2e for instance d563dace-705c-492a-a1c6-5bb2254b32bd on n-h1-826526-5 Jul 20 04:20:05.734789 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-29b42342-a76f-47bc-991a-a5ed447204ba req-1b1dd9ad-5810-4d86-8928-35bfcdbf6064 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.331967 Jul 20 04:20:05.737006 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1062/2303] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:05.746420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2bc49f65-9b3d-42e7-9d28-95991510d3b0 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:05.747476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2bc49f65-9b3d-42e7-9d28-95991510d3b0 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:05.769024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bc49f65-9b3d-42e7-9d28-95991510d3b0 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.775282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bc49f65-9b3d-42e7-9d28-95991510d3b0 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.777605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bc49f65-9b3d-42e7-9d28-95991510d3b0 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.778230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bc49f65-9b3d-42e7-9d28-95991510d3b0 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.351674 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9ce607b4-431c-4365-8fea-71edc587605a tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:06.380911 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9ce607b4-431c-4365-8fea-71edc587605a tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1317 microversion: 2.1 time: 0.823279 Jul 20 04:20:06.384217 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1242/2304] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:05 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1317 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:06.417916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-945f4161-33f6-49a5-b5ab-277cf1363828 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:06.419547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-945f4161-33f6-49a5-b5ab-277cf1363828 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:06.431524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-945f4161-33f6-49a5-b5ab-277cf1363828 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.431978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-945f4161-33f6-49a5-b5ab-277cf1363828 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.432820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-945f4161-33f6-49a5-b5ab-277cf1363828 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.433265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-945f4161-33f6-49a5-b5ab-277cf1363828 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.693753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-945f4161-33f6-49a5-b5ab-277cf1363828 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c22d39ea834080adb14e4133bb458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dc3cd573c47e89a2aac47a6d5fd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:06.713041 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-945f4161-33f6-49a5-b5ab-277cf1363828 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0" status: 200 len: 1281 microversion: 2.1 time: 0.298972 Jul 20 04:20:06.713633 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1243/2305] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:06 2022] GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 => generated 1281 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:06.719424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8e7d3e06-0a00-47eb-a96f-09779b27f3b1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:06.720301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8e7d3e06-0a00-47eb-a96f-09779b27f3b1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:06.742233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8e7d3e06-0a00-47eb-a96f-09779b27f3b1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.742902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8e7d3e06-0a00-47eb-a96f-09779b27f3b1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.743713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8e7d3e06-0a00-47eb-a96f-09779b27f3b1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.744156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8e7d3e06-0a00-47eb-a96f-09779b27f3b1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.918360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:06.984233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=14 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:07.038275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8e7d3e06-0a00-47eb-a96f-09779b27f3b1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:07.050197 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8e7d3e06-0a00-47eb-a96f-09779b27f3b1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 200 len: 1316 microversion: 2.1 time: 0.334382 Jul 20 04:20:07.050821 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1244/2306] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:06 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:07.188544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2bc49f65-9b3d-42e7-9d28-95991510d3b0 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508eee71ee6b4a918feec4dff7ae0f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2651ab9d1654a3fabd35e634f82558b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:07.201696 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2bc49f65-9b3d-42e7-9d28-95991510d3b0 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd" status: 200 len: 1325 microversion: 2.1 time: 1.462979 Jul 20 04:20:07.213247 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1063/2307] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:05 2022] GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd => generated 1325 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:07.405531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1d05d4cb-e7a6-4bb3-8841-c29c428826b0 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:07.407363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1d05d4cb-e7a6-4bb3-8841-c29c428826b0 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:07.421921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d05d4cb-e7a6-4bb3-8841-c29c428826b0 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.428119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d05d4cb-e7a6-4bb3-8841-c29c428826b0 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.429804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d05d4cb-e7a6-4bb3-8841-c29c428826b0 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.431062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d05d4cb-e7a6-4bb3-8841-c29c428826b0 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.740166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5b37d90e-2a6f-4535-9b57-382011685ef2 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:07.741526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5b37d90e-2a6f-4535-9b57-382011685ef2 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:07.757078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b37d90e-2a6f-4535-9b57-382011685ef2 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.757958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b37d90e-2a6f-4535-9b57-382011685ef2 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.759021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b37d90e-2a6f-4535-9b57-382011685ef2 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.769745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b37d90e-2a6f-4535-9b57-382011685ef2 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.801699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1d05d4cb-e7a6-4bb3-8841-c29c428826b0 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:07.821927 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1d05d4cb-e7a6-4bb3-8841-c29c428826b0 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1317 microversion: 2.1 time: 0.424941 Jul 20 04:20:07.822549 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1245/2308] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:07 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:08.067322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5169021d-67f1-4e70-ba0f-8a5ef113745d tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:08.067963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5169021d-67f1-4e70-ba0f-8a5ef113745d tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:08.080076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5169021d-67f1-4e70-ba0f-8a5ef113745d tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.080585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5169021d-67f1-4e70-ba0f-8a5ef113745d tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.081409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5169021d-67f1-4e70-ba0f-8a5ef113745d tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.081857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5169021d-67f1-4e70-ba0f-8a5ef113745d tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.545907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5169021d-67f1-4e70-ba0f-8a5ef113745d tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:08.563068 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5169021d-67f1-4e70-ba0f-8a5ef113745d tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 200 len: 1316 microversion: 2.1 time: 0.499625 Jul 20 04:20:08.565659 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1246/2309] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:08 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 1316 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:08.576977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c898dbf4-14e1-44c8-8701-331600a1a831 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:08.578362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c898dbf4-14e1-44c8-8701-331600a1a831 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:08.600709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c898dbf4-14e1-44c8-8701-331600a1a831 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.601164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c898dbf4-14e1-44c8-8701-331600a1a831 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.602642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c898dbf4-14e1-44c8-8701-331600a1a831 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.602642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c898dbf4-14e1-44c8-8701-331600a1a831 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.619119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:08.960742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c898dbf4-14e1-44c8-8701-331600a1a831 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508eee71ee6b4a918feec4dff7ae0f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2651ab9d1654a3fabd35e634f82558b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:08.977319 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c898dbf4-14e1-44c8-8701-331600a1a831 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd" status: 200 len: 1522 microversion: 2.1 time: 0.409682 Jul 20 04:20:08.977930 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1247/2310] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:08 2022] GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:09.000223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-63ff41ba-d5f2-44af-9f41-c94b86320a94 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:09.001128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-63ff41ba-d5f2-44af-9f41-c94b86320a94 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:09.010794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63ff41ba-d5f2-44af-9f41-c94b86320a94 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.011927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63ff41ba-d5f2-44af-9f41-c94b86320a94 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.012919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63ff41ba-d5f2-44af-9f41-c94b86320a94 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.013509 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63ff41ba-d5f2-44af-9f41-c94b86320a94 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.106653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5b37d90e-2a6f-4535-9b57-382011685ef2 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c22d39ea834080adb14e4133bb458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dc3cd573c47e89a2aac47a6d5fd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:09.118519 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5b37d90e-2a6f-4535-9b57-382011685ef2 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0" status: 200 len: 1323 microversion: 2.1 time: 1.391014 Jul 20 04:20:09.134493 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1064/2311] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:07 2022] GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 => generated 1323 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:09.142491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf6e0028-8015-41df-9c26-e42a27535867 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:09.143441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cf6e0028-8015-41df-9c26-e42a27535867 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:09.153331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf6e0028-8015-41df-9c26-e42a27535867 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.154837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf6e0028-8015-41df-9c26-e42a27535867 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.155808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf6e0028-8015-41df-9c26-e42a27535867 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.156407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf6e0028-8015-41df-9c26-e42a27535867 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.217118 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-cf6e0028-8015-41df-9c26-e42a27535867 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] HTTP exception thrown: Action 999 not found Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf6e0028-8015-41df-9c26-e42a27535867 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Request method failure captured: Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd/os-instance-actions/999 HTTP/1.1 Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14JeG8GLMyIpl3vAiGik2DKaUa8f-V3fxtcWySAJhTEhW4DF36jllJDY0Fg42MUiBMABZeMzBk3A-MfX0VUXDehV5APgcVBvUIuQfaNRhcztl2GqHCJfpqzqBa1Z131H8pb86YEjvutdpCIHQAE41y7zd2WC1GB7n0g4hP-5DqPqRIs Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: e2651ab9d1654a3fabd35e634f82558b Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1197339694 Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:20:09.224530 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:20:09.226047 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e2651ab9d1654a3fabd35e634f82558b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e2651ab9d1654a3fabd35e634f82558b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e2651ab9d1654a3fabd35e634f82558b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e2651ab9d1654a3fabd35e634f82558b"}]}] Jul 20 04:20:09.226047 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1197339694 Jul 20 04:20:09.226047 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: e2651ab9d1654a3fabd35e634f82558b Jul 20 04:20:09.226047 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1197339694 Jul 20 04:20:09.226047 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-InstanceActionsNegativeTestJSON-1197339694-project Jul 20 04:20:09.226047 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:20:09.226047 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:20:09.226047 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 508eee71ee6b4a918feec4dff7ae0f58 Jul 20 04:20:09.226047 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1197339694-project Jul 20 04:20:09.226047 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:20:09.226047 n-d-826526-5 devstack@n-api.service[127870]: exception: Action 999 not found Jul 20 04:20:09.226047 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'server_id': 'd563dace-705c-492a-a1c6-5bb2254b32bd', 'id': '999'} Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 20 04:20:09.226934 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:09.229226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf6e0028-8015-41df-9c26-e42a27535867 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Returning 404 to user: Action 999 not found {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:09.230118 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cf6e0028-8015-41df-9c26-e42a27535867 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.094191 Jul 20 04:20:09.238490 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1065/2312] 10.222.0.17 () {58 vars in 1307 bytes} [Wed Jul 20 04:20:09 2022] GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd/os-instance-actions/999 => generated 66 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:20:09.246192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3c6f482a-650c-41f7-a595-ead875adc705 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '.version_select at 0x7f06be505af0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:09.246787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3c6f482a-650c-41f7-a595-ead875adc705 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: 42743639-f88a-45bc-bb31-083bf18fb14a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:09.255799 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-3c6f482a-650c-41f7-a595-ead875adc705 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] HTTP exception thrown: Instance 42743639-f88a-45bc-bb31-083bf18fb14a could not be found. Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3c6f482a-650c-41f7-a595-ead875adc705 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Request method failure captured: Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/42743639-f88a-45bc-bb31-083bf18fb14a/os-instance-actions HTTP/1.1 Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14JeG8GLMyIpl3vAiGik2DKaUa8f-V3fxtcWySAJhTEhW4DF36jllJDY0Fg42MUiBMABZeMzBk3A-MfX0VUXDehV5APgcVBvUIuQfaNRhcztl2GqHCJfpqzqBa1Z131H8pb86YEjvutdpCIHQAE41y7zd2WC1GB7n0g4hP-5DqPqRIs Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: e2651ab9d1654a3fabd35e634f82558b Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1197339694 Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:20:09.257730 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:20:09.259241 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e2651ab9d1654a3fabd35e634f82558b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e2651ab9d1654a3fabd35e634f82558b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e2651ab9d1654a3fabd35e634f82558b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e2651ab9d1654a3fabd35e634f82558b"}]}] Jul 20 04:20:09.259241 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1197339694 Jul 20 04:20:09.259241 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: e2651ab9d1654a3fabd35e634f82558b Jul 20 04:20:09.259241 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1197339694 Jul 20 04:20:09.259241 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-InstanceActionsNegativeTestJSON-1197339694-project Jul 20 04:20:09.259241 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:20:09.259241 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:20:09.259241 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 508eee71ee6b4a918feec4dff7ae0f58 Jul 20 04:20:09.259241 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1197339694-project Jul 20 04:20:09.259241 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:20:09.259241 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 42743639-f88a-45bc-bb31-083bf18fb14a could not be found. Jul 20 04:20:09.259241 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'server_id': '42743639-f88a-45bc-bb31-083bf18fb14a'} Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42743639-f88a-45bc-bb31-083bf18fb14a could not be found. Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:09.260042 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42743639-f88a-45bc-bb31-083bf18fb14a could not be found. Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42743639-f88a-45bc-bb31-083bf18fb14a could not be found. Jul 20 04:20:09.261439 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:09.265453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3c6f482a-650c-41f7-a595-ead875adc705 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Returning 404 to user: Instance 42743639-f88a-45bc-bb31-083bf18fb14a could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:09.266493 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3c6f482a-650c-41f7-a595-ead875adc705 tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "GET /compute/v2.1/servers/42743639-f88a-45bc-bb31-083bf18fb14a/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.025102 Jul 20 04:20:09.267587 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1066/2313] 10.222.0.17 () {58 vars in 1295 bytes} [Wed Jul 20 04:20:09 2022] GET /compute/v2.1/servers/42743639-f88a-45bc-bb31-083bf18fb14a/os-instance-actions => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:20:09.289133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-619ede16-6353-4d76-b7e3-12031a51a45f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:09.290584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-619ede16-6353-4d76-b7e3-12031a51a45f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:09.313015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-619ede16-6353-4d76-b7e3-12031a51a45f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.313664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-619ede16-6353-4d76-b7e3-12031a51a45f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.314709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-619ede16-6353-4d76-b7e3-12031a51a45f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.315318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-619ede16-6353-4d76-b7e3-12031a51a45f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.481379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-619ede16-6353-4d76-b7e3-12031a51a45f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:09.502336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:09.725252 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-619ede16-6353-4d76-b7e3-12031a51a45f tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd" status: 204 len: 0 microversion: 2.1 time: 0.447594 Jul 20 04:20:09.726734 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1067/2314] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:09 2022] DELETE /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:09.747166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c60fa2f3-07cd-4488-8dda-1b7e024a3a85 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:09.748391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c60fa2f3-07cd-4488-8dda-1b7e024a3a85 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:09.776417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c60fa2f3-07cd-4488-8dda-1b7e024a3a85 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.777545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c60fa2f3-07cd-4488-8dda-1b7e024a3a85 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.779690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c60fa2f3-07cd-4488-8dda-1b7e024a3a85 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.787623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c60fa2f3-07cd-4488-8dda-1b7e024a3a85 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.912596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:10.368505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-63ff41ba-d5f2-44af-9f41-c94b86320a94 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:10.392960 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-63ff41ba-d5f2-44af-9f41-c94b86320a94 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1317 microversion: 2.1 time: 1.413900 Jul 20 04:20:10.396938 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1248/2315] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:08 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1317 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:10.415807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f74a49b6-aabf-484a-ba99-d397dd385e7d tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:10.416740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f74a49b6-aabf-484a-ba99-d397dd385e7d tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:10.439304 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f74a49b6-aabf-484a-ba99-d397dd385e7d tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.452327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f74a49b6-aabf-484a-ba99-d397dd385e7d tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.453476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f74a49b6-aabf-484a-ba99-d397dd385e7d tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.454100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f74a49b6-aabf-484a-ba99-d397dd385e7d tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.591753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c60fa2f3-07cd-4488-8dda-1b7e024a3a85 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:10.609128 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c60fa2f3-07cd-4488-8dda-1b7e024a3a85 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 200 len: 1316 microversion: 2.1 time: 0.875711 Jul 20 04:20:10.619694 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1068/2316] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:09 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 1316 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:10.626498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-dc685d68-8ece-446c-8eff-c9874a90c635 req-65fe5b1e-9fc4-4149-ba3c-d8ca216b46f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd", "name": "network-vif-plugged", "status": "completed", "tag": "d17d33e4-2f92-4b69-a966-8ecf67ac6a66"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:10.662184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-dc685d68-8ece-446c-8eff-c9874a90c635 req-65fe5b1e-9fc4-4149-ba3c-d8ca216b46f7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.662629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-dc685d68-8ece-446c-8eff-c9874a90c635 req-65fe5b1e-9fc4-4149-ba3c-d8ca216b46f7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.706440 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-dc685d68-8ece-446c-8eff-c9874a90c635 req-65fe5b1e-9fc4-4149-ba3c-d8ca216b46f7 service nova] Creating event network-vif-plugged:d17d33e4-2f92-4b69-a966-8ecf67ac6a66 for instance bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd on n-h1-826526-5 Jul 20 04:20:10.732911 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-dc685d68-8ece-446c-8eff-c9874a90c635 req-65fe5b1e-9fc4-4149-ba3c-d8ca216b46f7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108670 Jul 20 04:20:10.736684 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1069/2317] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:10.764897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d802486e-2370-429d-8bdf-68c4033342d8 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:10.768015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d802486e-2370-429d-8bdf-68c4033342d8 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:10.778400 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d802486e-2370-429d-8bdf-68c4033342d8 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.779312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d802486e-2370-429d-8bdf-68c4033342d8 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.780345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d802486e-2370-429d-8bdf-68c4033342d8 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.781159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d802486e-2370-429d-8bdf-68c4033342d8 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.505725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f74a49b6-aabf-484a-ba99-d397dd385e7d tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508eee71ee6b4a918feec4dff7ae0f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2651ab9d1654a3fabd35e634f82558b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:11.521552 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f74a49b6-aabf-484a-ba99-d397dd385e7d tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd" status: 200 len: 1528 microversion: 2.1 time: 1.109648 Jul 20 04:20:11.522545 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1249/2318] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:10 2022] GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd => generated 1528 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:11.529407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-2a46b2f1-d6a2-4f38-af4a-a2e8eb68f27d req-ce0aaded-3de0-4d7f-96eb-1498113fbb80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff1be9b8-b9ff-40ea-a63a-d01d38a96102", "tag": "f6cbea3d-636a-48f6-a62e-de1624ae8f8b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:11.557213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-2a46b2f1-d6a2-4f38-af4a-a2e8eb68f27d req-ce0aaded-3de0-4d7f-96eb-1498113fbb80 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.558210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-2a46b2f1-d6a2-4f38-af4a-a2e8eb68f27d req-ce0aaded-3de0-4d7f-96eb-1498113fbb80 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.580001 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-2a46b2f1-d6a2-4f38-af4a-a2e8eb68f27d req-ce0aaded-3de0-4d7f-96eb-1498113fbb80 service nova] Creating event network-changed:f6cbea3d-636a-48f6-a62e-de1624ae8f8b for instance ff1be9b8-b9ff-40ea-a63a-d01d38a96102 on n-h2-826526-5 Jul 20 04:20:11.654333 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-2a46b2f1-d6a2-4f38-af4a-a2e8eb68f27d req-ce0aaded-3de0-4d7f-96eb-1498113fbb80 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125804 Jul 20 04:20:11.659601 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1250/2319] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:11.681265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d9afe437-8f48-4aab-a49d-48f70f55bfb0 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:11.681995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d9afe437-8f48-4aab-a49d-48f70f55bfb0 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:11.701765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d9afe437-8f48-4aab-a49d-48f70f55bfb0 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.702228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d9afe437-8f48-4aab-a49d-48f70f55bfb0 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.703071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d9afe437-8f48-4aab-a49d-48f70f55bfb0 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.703552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d9afe437-8f48-4aab-a49d-48f70f55bfb0 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.044024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d802486e-2370-429d-8bdf-68c4033342d8 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c22d39ea834080adb14e4133bb458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dc3cd573c47e89a2aac47a6d5fd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:12.061488 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d802486e-2370-429d-8bdf-68c4033342d8 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0" status: 200 len: 1323 microversion: 2.1 time: 1.323207 Jul 20 04:20:12.074035 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1070/2320] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:10 2022] GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 => generated 1323 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:12.080046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dd83bc91-baba-4a99-8b5f-476d422d7c8f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:12.081948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dd83bc91-baba-4a99-8b5f-476d422d7c8f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:12.090444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd83bc91-baba-4a99-8b5f-476d422d7c8f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.091250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd83bc91-baba-4a99-8b5f-476d422d7c8f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.092242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd83bc91-baba-4a99-8b5f-476d422d7c8f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.092851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd83bc91-baba-4a99-8b5f-476d422d7c8f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.296444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d9afe437-8f48-4aab-a49d-48f70f55bfb0 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:12.308683 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d9afe437-8f48-4aab-a49d-48f70f55bfb0 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1317 microversion: 2.1 time: 0.646285 Jul 20 04:20:12.309343 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1251/2321] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:11 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1317 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:12.541667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-70a0925f-488e-42af-b59a-b521d6cee3ab tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:12.543454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-70a0925f-488e-42af-b59a-b521d6cee3ab tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:12.565783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70a0925f-488e-42af-b59a-b521d6cee3ab tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.566493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70a0925f-488e-42af-b59a-b521d6cee3ab tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.567910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70a0925f-488e-42af-b59a-b521d6cee3ab tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.569047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70a0925f-488e-42af-b59a-b521d6cee3ab tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.697100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dd83bc91-baba-4a99-8b5f-476d422d7c8f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:12.721905 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dd83bc91-baba-4a99-8b5f-476d422d7c8f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 200 len: 1316 microversion: 2.1 time: 0.643843 Jul 20 04:20:12.723837 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1071/2322] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:12 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 1316 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:13.046079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e17e6cf7-abf1-4f30-a0bf-43b8274b6646 req-8d7b533e-5934-4d7a-ac41-353c51aa80bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d563dace-705c-492a-a1c6-5bb2254b32bd", "name": "network-vif-deleted", "tag": "b08a34e6-0f48-4a56-984a-1682540bbf2e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:13.078543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-70a0925f-488e-42af-b59a-b521d6cee3ab tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508eee71ee6b4a918feec4dff7ae0f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2651ab9d1654a3fabd35e634f82558b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:13.095268 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-70a0925f-488e-42af-b59a-b521d6cee3ab tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd" status: 200 len: 1528 microversion: 2.1 time: 0.557948 Jul 20 04:20:13.097981 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1252/2323] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:12 2022] GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd => generated 1528 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:13.109194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d8f141be-ab71-4659-824e-f9d84e5ef908 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:13.111467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d8f141be-ab71-4659-824e-f9d84e5ef908 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:13.129312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8f141be-ab71-4659-824e-f9d84e5ef908 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.130850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8f141be-ab71-4659-824e-f9d84e5ef908 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.133136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8f141be-ab71-4659-824e-f9d84e5ef908 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.136950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8f141be-ab71-4659-824e-f9d84e5ef908 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.140311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e17e6cf7-abf1-4f30-a0bf-43b8274b6646 req-8d7b533e-5934-4d7a-ac41-353c51aa80bd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.141075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e17e6cf7-abf1-4f30-a0bf-43b8274b6646 req-8d7b533e-5934-4d7a-ac41-353c51aa80bd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.196459 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e17e6cf7-abf1-4f30-a0bf-43b8274b6646 req-8d7b533e-5934-4d7a-ac41-353c51aa80bd service nova] Creating event network-vif-deleted:b08a34e6-0f48-4a56-984a-1682540bbf2e for instance d563dace-705c-492a-a1c6-5bb2254b32bd on n-h1-826526-5 Jul 20 04:20:13.214543 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e17e6cf7-abf1-4f30-a0bf-43b8274b6646 req-8d7b533e-5934-4d7a-ac41-353c51aa80bd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176769 Jul 20 04:20:13.220003 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1072/2324] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:13.331377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a29b26f3-c880-4473-93b5-180eea6b0716 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:13.338651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a29b26f3-c880-4473-93b5-180eea6b0716 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:13.398389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a29b26f3-c880-4473-93b5-180eea6b0716 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.399574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a29b26f3-c880-4473-93b5-180eea6b0716 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.418418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a29b26f3-c880-4473-93b5-180eea6b0716 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.429460 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a29b26f3-c880-4473-93b5-180eea6b0716 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.724878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d8f141be-ab71-4659-824e-f9d84e5ef908 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c22d39ea834080adb14e4133bb458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dc3cd573c47e89a2aac47a6d5fd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:13.744567 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d8f141be-ab71-4659-824e-f9d84e5ef908 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0" status: 200 len: 1323 microversion: 2.1 time: 0.642503 Jul 20 04:20:13.745240 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1253/2325] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:13 2022] GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 => generated 1323 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:13.765865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7c7e34f0-f604-4d65-9a7f-c56c45e171d3 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:13.773301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7c7e34f0-f604-4d65-9a7f-c56c45e171d3 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:13.801572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c7e34f0-f604-4d65-9a7f-c56c45e171d3 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.806468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c7e34f0-f604-4d65-9a7f-c56c45e171d3 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.807574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c7e34f0-f604-4d65-9a7f-c56c45e171d3 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.808026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c7e34f0-f604-4d65-9a7f-c56c45e171d3 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.401951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7c7e34f0-f604-4d65-9a7f-c56c45e171d3 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:14.410503 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7c7e34f0-f604-4d65-9a7f-c56c45e171d3 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 200 len: 1504 microversion: 2.1 time: 0.664123 Jul 20 04:20:14.411117 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1254/2326] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:13 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 1504 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:14.421737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e30ac0a5-91bf-4360-9302-f726a919a3ef req-4af365df-0630-474e-81a8-11826223ab25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90092a0d-bb08-4eb7-88d8-5789a1941ed0", "tag": "5a2e332a-1fdd-451a-9677-e9aa6c4b5e77"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:14.446288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e30ac0a5-91bf-4360-9302-f726a919a3ef req-4af365df-0630-474e-81a8-11826223ab25 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.446872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e30ac0a5-91bf-4360-9302-f726a919a3ef req-4af365df-0630-474e-81a8-11826223ab25 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.472647 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e30ac0a5-91bf-4360-9302-f726a919a3ef req-4af365df-0630-474e-81a8-11826223ab25 service nova] Creating event network-changed:5a2e332a-1fdd-451a-9677-e9aa6c4b5e77 for instance 90092a0d-bb08-4eb7-88d8-5789a1941ed0 on n-h2-826526-5 Jul 20 04:20:14.491298 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e30ac0a5-91bf-4360-9302-f726a919a3ef req-4af365df-0630-474e-81a8-11826223ab25 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078348 Jul 20 04:20:14.493370 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1255/2327] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:14.499156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dd2c0c09-c8d8-4a58-984e-0d557d9f89eb tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:14.499875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dd2c0c09-c8d8-4a58-984e-0d557d9f89eb tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] [instance: d563dace-705c-492a-a1c6-5bb2254b32bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:14.517722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd2c0c09-c8d8-4a58-984e-0d557d9f89eb tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.518184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd2c0c09-c8d8-4a58-984e-0d557d9f89eb tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.518986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd2c0c09-c8d8-4a58-984e-0d557d9f89eb tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.519428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd2c0c09-c8d8-4a58-984e-0d557d9f89eb tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.558218 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-dd2c0c09-c8d8-4a58-984e-0d557d9f89eb tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] HTTP exception thrown: Instance d563dace-705c-492a-a1c6-5bb2254b32bd could not be found. Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dd2c0c09-c8d8-4a58-984e-0d557d9f89eb tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Request method failure captured: Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd HTTP/1.1 Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14JeG8GLMyIpl3vAiGik2DKaUa8f-V3fxtcWySAJhTEhW4DF36jllJDY0Fg42MUiBMABZeMzBk3A-MfX0VUXDehV5APgcVBvUIuQfaNRhcztl2GqHCJfpqzqBa1Z131H8pb86YEjvutdpCIHQAE41y7zd2WC1GB7n0g4hP-5DqPqRIs Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: e2651ab9d1654a3fabd35e634f82558b Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1197339694 Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:20:14.560033 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:20:14.562750 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e2651ab9d1654a3fabd35e634f82558b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e2651ab9d1654a3fabd35e634f82558b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e2651ab9d1654a3fabd35e634f82558b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e2651ab9d1654a3fabd35e634f82558b"}]}] Jul 20 04:20:14.562750 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1197339694 Jul 20 04:20:14.562750 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: e2651ab9d1654a3fabd35e634f82558b Jul 20 04:20:14.562750 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1197339694 Jul 20 04:20:14.562750 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-InstanceActionsNegativeTestJSON-1197339694-project Jul 20 04:20:14.562750 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:20:14.562750 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:20:14.562750 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 508eee71ee6b4a918feec4dff7ae0f58 Jul 20 04:20:14.562750 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1197339694-project Jul 20 04:20:14.562750 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:20:14.562750 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance d563dace-705c-492a-a1c6-5bb2254b32bd could not be found. Jul 20 04:20:14.562750 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'd563dace-705c-492a-a1c6-5bb2254b32bd'} Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d563dace-705c-492a-a1c6-5bb2254b32bd could not be found. Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:14.564377 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:14.566786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:14.566786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:14.566786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:14.566786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:14.566786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:14.566786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:14.566786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:14.566786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d563dace-705c-492a-a1c6-5bb2254b32bd could not be found. Jul 20 04:20:14.566786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:14.566786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:14.566786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:14.566786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:14.566786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:14.566786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:14.566786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:14.566786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:14.566786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d563dace-705c-492a-a1c6-5bb2254b32bd could not be found. Jul 20 04:20:14.566786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:14.569293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dd2c0c09-c8d8-4a58-984e-0d557d9f89eb tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] Returning 404 to user: Instance d563dace-705c-492a-a1c6-5bb2254b32bd could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:14.569293 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dd2c0c09-c8d8-4a58-984e-0d557d9f89eb tempest-InstanceActionsNegativeTestJSON-1197339694 tempest-InstanceActionsNegativeTestJSON-1197339694-project] 10.222.0.17 "GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd" status: 404 len: 111 microversion: 2.1 time: 0.066658 Jul 20 04:20:14.569293 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1256/2328] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:14 2022] GET /compute/v2.1/servers/d563dace-705c-492a-a1c6-5bb2254b32bd => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:14.569293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-13b21fde-7d5c-43e8-a119-c854c191f310 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1117743674"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:14.569293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-13b21fde-7d5c-43e8-a119-c854c191f310 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:14.590621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13b21fde-7d5c-43e8-a119-c854c191f310 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.591105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13b21fde-7d5c-43e8-a119-c854c191f310 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.591916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13b21fde-7d5c-43e8-a119-c854c191f310 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.592394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13b21fde-7d5c-43e8-a119-c854c191f310 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.914805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a29b26f3-c880-4473-93b5-180eea6b0716 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:14.952390 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a29b26f3-c880-4473-93b5-180eea6b0716 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1317 microversion: 2.1 time: 1.629975 Jul 20 04:20:14.955072 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1073/2329] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:13 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1317 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:14.963050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4f6920df-2618-450d-bccb-2dcc4d906ccc tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:14.966596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4f6920df-2618-450d-bccb-2dcc4d906ccc tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:14.973929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f6920df-2618-450d-bccb-2dcc4d906ccc tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.974952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f6920df-2618-450d-bccb-2dcc4d906ccc tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.975905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f6920df-2618-450d-bccb-2dcc4d906ccc tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.976743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f6920df-2618-450d-bccb-2dcc4d906ccc tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.057565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4f6920df-2618-450d-bccb-2dcc4d906ccc tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c22d39ea834080adb14e4133bb458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dc3cd573c47e89a2aac47a6d5fd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:16.074709 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4f6920df-2618-450d-bccb-2dcc4d906ccc tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0" status: 200 len: 1323 microversion: 2.1 time: 1.117361 Jul 20 04:20:16.075933 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1074/2330] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:14 2022] GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 => generated 1323 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:16.096691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c0e6881a-6a94-4900-bc52-07135121295c tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:16.097335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c0e6881a-6a94-4900-bc52-07135121295c tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:16.104892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0e6881a-6a94-4900-bc52-07135121295c tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.105544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0e6881a-6a94-4900-bc52-07135121295c tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.107751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0e6881a-6a94-4900-bc52-07135121295c tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.108496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0e6881a-6a94-4900-bc52-07135121295c tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.199634 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.network.security_group_api [None req-13b21fde-7d5c-43e8-a119-c854c191f310 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Adding security group 5f622391-c5a2-44d8-9064-7bae04f5f735 to port d17d33e4-2f92-4b69-a966-8ecf67ac6a66 Jul 20 04:20:17.088335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c0e6881a-6a94-4900-bc52-07135121295c tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:17.099236 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c0e6881a-6a94-4900-bc52-07135121295c tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1317 microversion: 2.1 time: 1.019767 Jul 20 04:20:17.102894 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1075/2331] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:16 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1317 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:17.108108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-86d6e5a1-c9da-4343-9238-b5cb85fca297 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:17.113605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-86d6e5a1-c9da-4343-9238-b5cb85fca297 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:17.132910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86d6e5a1-c9da-4343-9238-b5cb85fca297 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:17.133369 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86d6e5a1-c9da-4343-9238-b5cb85fca297 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:17.134165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86d6e5a1-c9da-4343-9238-b5cb85fca297 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:17.134608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86d6e5a1-c9da-4343-9238-b5cb85fca297 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:17.535143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-86d6e5a1-c9da-4343-9238-b5cb85fca297 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c22d39ea834080adb14e4133bb458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dc3cd573c47e89a2aac47a6d5fd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:17.550853 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-86d6e5a1-c9da-4343-9238-b5cb85fca297 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0" status: 200 len: 1323 microversion: 2.1 time: 0.441750 Jul 20 04:20:17.553260 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1076/2332] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:17 2022] GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 => generated 1323 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:17.812342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-6180cc36-cdf7-46ea-b5bd-b3d996bf49d5 req-66edd291-c6e7-4ccd-b3cf-df35401e8ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1be9b8-b9ff-40ea-a63a-d01d38a96102", "name": "network-vif-plugged", "status": "completed", "tag": "f6cbea3d-636a-48f6-a62e-de1624ae8f8b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:17.821865 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-13b21fde-7d5c-43e8-a119-c854c191f310 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "POST /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd/action" status: 202 len: 0 microversion: 2.1 time: 3.258799 Jul 20 04:20:17.823577 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1257/2333] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:20:14 2022] POST /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd/action => generated 0 bytes in 3261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:20:17.829496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6180cc36-cdf7-46ea-b5bd-b3d996bf49d5 req-66edd291-c6e7-4ccd-b3cf-df35401e8ce0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:17.834478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6180cc36-cdf7-46ea-b5bd-b3d996bf49d5 req-66edd291-c6e7-4ccd-b3cf-df35401e8ce0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:17.841168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-f1aab8ff-ec5a-46a0-ac2f-92f5cf7424fe req-08a5bb30-5aad-419f-95ec-75ee73e7fe52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd", "tag": "d17d33e4-2f92-4b69-a966-8ecf67ac6a66"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:17.860039 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-6180cc36-cdf7-46ea-b5bd-b3d996bf49d5 req-66edd291-c6e7-4ccd-b3cf-df35401e8ce0 service nova] Creating event network-vif-plugged:f6cbea3d-636a-48f6-a62e-de1624ae8f8b for instance ff1be9b8-b9ff-40ea-a63a-d01d38a96102 on n-h2-826526-5 Jul 20 04:20:17.862227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:17.867364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f1aab8ff-ec5a-46a0-ac2f-92f5cf7424fe req-08a5bb30-5aad-419f-95ec-75ee73e7fe52 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:17.868153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f1aab8ff-ec5a-46a0-ac2f-92f5cf7424fe req-08a5bb30-5aad-419f-95ec-75ee73e7fe52 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:17.876071 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-6180cc36-cdf7-46ea-b5bd-b3d996bf49d5 req-66edd291-c6e7-4ccd-b3cf-df35401e8ce0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069067 Jul 20 04:20:17.881418 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1077/2334] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:17.892700 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-da41d7e1-41b1-4896-a35b-395ec0469bd0 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1403057986"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:17.894019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-da41d7e1-41b1-4896-a35b-395ec0469bd0 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:17.899302 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-f1aab8ff-ec5a-46a0-ac2f-92f5cf7424fe req-08a5bb30-5aad-419f-95ec-75ee73e7fe52 service nova] Creating event network-changed:d17d33e4-2f92-4b69-a966-8ecf67ac6a66 for instance bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd on n-h1-826526-5 Jul 20 04:20:17.908323 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-f1aab8ff-ec5a-46a0-ac2f-92f5cf7424fe req-08a5bb30-5aad-419f-95ec-75ee73e7fe52 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072481 Jul 20 04:20:17.909491 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1258/2335] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:17.928706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da41d7e1-41b1-4896-a35b-395ec0469bd0 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:17.930152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da41d7e1-41b1-4896-a35b-395ec0469bd0 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:17.931379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da41d7e1-41b1-4896-a35b-395ec0469bd0 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:17.932149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da41d7e1-41b1-4896-a35b-395ec0469bd0 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.117720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c7afb1ec-3711-4e7d-b8ff-9eb3a14a0eb6 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:18.118828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c7afb1ec-3711-4e7d-b8ff-9eb3a14a0eb6 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:18.133279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7afb1ec-3711-4e7d-b8ff-9eb3a14a0eb6 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:18.135669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7afb1ec-3711-4e7d-b8ff-9eb3a14a0eb6 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.136808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7afb1ec-3711-4e7d-b8ff-9eb3a14a0eb6 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:18.145212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7afb1ec-3711-4e7d-b8ff-9eb3a14a0eb6 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.592964 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.network.security_group_api [None req-da41d7e1-41b1-4896-a35b-395ec0469bd0 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Adding security group a6211e57-3a34-4c5c-8fa9-ce5da2735bfa to port d17d33e4-2f92-4b69-a966-8ecf67ac6a66 Jul 20 04:20:18.986903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c7afb1ec-3711-4e7d-b8ff-9eb3a14a0eb6 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:18.999986 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c7afb1ec-3711-4e7d-b8ff-9eb3a14a0eb6 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1317 microversion: 2.1 time: 0.886352 Jul 20 04:20:19.000658 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1259/2336] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:18 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1317 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:19.010252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-82c3e9f8-9fa5-4556-a368-043b9d22906d tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:19.010872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-82c3e9f8-9fa5-4556-a368-043b9d22906d tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:19.029386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82c3e9f8-9fa5-4556-a368-043b9d22906d tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:19.032820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82c3e9f8-9fa5-4556-a368-043b9d22906d tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:19.033845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82c3e9f8-9fa5-4556-a368-043b9d22906d tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:19.037447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82c3e9f8-9fa5-4556-a368-043b9d22906d tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:19.086821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:19.442332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-82c3e9f8-9fa5-4556-a368-043b9d22906d tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c22d39ea834080adb14e4133bb458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dc3cd573c47e89a2aac47a6d5fd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:19.455584 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-82c3e9f8-9fa5-4556-a368-043b9d22906d tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0" status: 200 len: 1323 microversion: 2.1 time: 0.453222 Jul 20 04:20:19.456713 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1260/2337] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:19 2022] GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 => generated 1323 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:20.023890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-86e222c1-0e08-4b0e-8f7a-6659cda20e7a tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:20.028581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-86e222c1-0e08-4b0e-8f7a-6659cda20e7a tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:20.043938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86e222c1-0e08-4b0e-8f7a-6659cda20e7a tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:20.045631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86e222c1-0e08-4b0e-8f7a-6659cda20e7a tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:20.047036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86e222c1-0e08-4b0e-8f7a-6659cda20e7a tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:20.047844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86e222c1-0e08-4b0e-8f7a-6659cda20e7a tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:20.407915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-86e222c1-0e08-4b0e-8f7a-6659cda20e7a tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:20.425902 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-86e222c1-0e08-4b0e-8f7a-6659cda20e7a tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1466 microversion: 2.1 time: 0.411852 Jul 20 04:20:20.427601 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1261/2338] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:20 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1466 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:20.448085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-eb25be20-e666-456a-a950-8fa812c8a2a4 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-605628821", "metadata": {"image_type": "test"}}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:20.449230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-eb25be20-e666-456a-a950-8fa812c8a2a4 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:20.459557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb25be20-e666-456a-a950-8fa812c8a2a4 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:20.460014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb25be20-e666-456a-a950-8fa812c8a2a4 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:20.460841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb25be20-e666-456a-a950-8fa812c8a2a4 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:20.461470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb25be20-e666-456a-a950-8fa812c8a2a4 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:20.539178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-eb25be20-e666-456a-a950-8fa812c8a2a4 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Getting quotas for project d883ef732fba496db095a9ba2202a304. Resources: dict_keys(['metadata_items']) {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:20.548824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-eb25be20-e666-456a-a950-8fa812c8a2a4 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Getting quotas for user b3d729a66b42428cb90920e80d8a06ce and project d883ef732fba496db095a9ba2202a304. Resources: dict_keys(['metadata_items']) {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:20.901798 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-da41d7e1-41b1-4896-a35b-395ec0469bd0 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "POST /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd/action" status: 202 len: 0 microversion: 2.1 time: 3.018984 Jul 20 04:20:20.907581 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1078/2339] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:20:17 2022] POST /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd/action => generated 0 bytes in 3023 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:20:20.909434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-435ef874-1942-4873-972f-ef918f2bf6b3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:20.910324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-435ef874-1942-4873-972f-ef918f2bf6b3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:20.924137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-435ef874-1942-4873-972f-ef918f2bf6b3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:20.927928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-435ef874-1942-4873-972f-ef918f2bf6b3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:20.935587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-435ef874-1942-4873-972f-ef918f2bf6b3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:20.936494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-435ef874-1942-4873-972f-ef918f2bf6b3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:20.961979 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-eb25be20-e666-456a-a950-8fa812c8a2a4 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "POST /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102/action" status: 202 len: 0 microversion: 2.1 time: 0.522341 Jul 20 04:20:20.970722 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1262/2340] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:20:20 2022] POST /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 20 04:20:20.976952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4bccd7d5-47aa-4f53-938a-be2e333dc411 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:20.980327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4bccd7d5-47aa-4f53-938a-be2e333dc411 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:21.004430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4bccd7d5-47aa-4f53-938a-be2e333dc411 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:21.005604 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4bccd7d5-47aa-4f53-938a-be2e333dc411 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:21.006673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4bccd7d5-47aa-4f53-938a-be2e333dc411 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:21.007322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4bccd7d5-47aa-4f53-938a-be2e333dc411 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:21.472666 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4bccd7d5-47aa-4f53-938a-be2e333dc411 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.500206 Jul 20 04:20:21.473882 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1263/2341] 10.222.0.17 () {58 vars in 1292 bytes} [Wed Jul 20 04:20:20 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd/os-security-groups => generated 1157 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:21.488388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3e4514d7-ef92-44a1-b257-0590d804cc78 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06bdf30670>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:21.555105 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3e4514d7-ef92-44a1-b257-0590d804cc78 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1421 microversion: 2.1 time: 0.080027 Jul 20 04:20:21.562433 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1264/2342] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:21 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1421 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:21.573690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-aa7809cb-cd00-4af2-84b0-f70774cc307d req-56a5d3fb-021c-42da-b3e4-99fb0212b1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd", "tag": "d17d33e4-2f92-4b69-a966-8ecf67ac6a66"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:21.597368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-aa7809cb-cd00-4af2-84b0-f70774cc307d req-56a5d3fb-021c-42da-b3e4-99fb0212b1c6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:21.598224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-aa7809cb-cd00-4af2-84b0-f70774cc307d req-56a5d3fb-021c-42da-b3e4-99fb0212b1c6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:21.612620 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-aa7809cb-cd00-4af2-84b0-f70774cc307d req-56a5d3fb-021c-42da-b3e4-99fb0212b1c6 service nova] Creating event network-changed:d17d33e4-2f92-4b69-a966-8ecf67ac6a66 for instance bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd on n-h1-826526-5 Jul 20 04:20:21.626580 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-aa7809cb-cd00-4af2-84b0-f70774cc307d req-56a5d3fb-021c-42da-b3e4-99fb0212b1c6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059897 Jul 20 04:20:21.641208 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1265/2343] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:21.923556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9a1da5db-c34e-4739-a6db-8dfc68e5c220 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] Action: 'create', calling method: .version_select at 0x7f06be0ded30>, body: {"pool": null} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:22.216894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-435ef874-1942-4873-972f-ef918f2bf6b3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c22d39ea834080adb14e4133bb458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dc3cd573c47e89a2aac47a6d5fd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:22.225798 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-435ef874-1942-4873-972f-ef918f2bf6b3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0" status: 200 len: 1323 microversion: 2.1 time: 1.320039 Jul 20 04:20:22.226509 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1079/2344] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:20 2022] GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 => generated 1323 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:22.244563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-53b6ea7c-f3fc-4bc8-91d1-1deaeb6dc1d9 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Action: 'create', calling method: .version_select at 0x7f06beb59670>, body: {"security_group": {"name": " tempest-securitygroup -2090711921 ", "description": "tempest-description-1040400150"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:23.560094 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-53b6ea7c-f3fc-4bc8-91d1-1deaeb6dc1d9 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 1.324594 Jul 20 04:20:23.561143 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1080/2345] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:20:22 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:23.566569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c6ef30f7-817d-41bd-9cf6-d2a70db53b35 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be2cc9d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:23.655388 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c6ef30f7-817d-41bd-9cf6-d2a70db53b35 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1421 microversion: 2.1 time: 0.092822 Jul 20 04:20:23.656094 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1081/2346] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:23 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1421 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:23.672571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-2c8ede81-6c18-4a4a-ad23-a4c40e15daba req-9872521e-c1e7-4435-bb51-0ee36aa6aa1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90092a0d-bb08-4eb7-88d8-5789a1941ed0", "name": "network-vif-plugged", "status": "completed", "tag": "5a2e332a-1fdd-451a-9677-e9aa6c4b5e77"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:23.689000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2c8ede81-6c18-4a4a-ad23-a4c40e15daba req-9872521e-c1e7-4435-bb51-0ee36aa6aa1f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:23.689226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2c8ede81-6c18-4a4a-ad23-a4c40e15daba req-9872521e-c1e7-4435-bb51-0ee36aa6aa1f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:23.721311 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-2c8ede81-6c18-4a4a-ad23-a4c40e15daba req-9872521e-c1e7-4435-bb51-0ee36aa6aa1f service nova] Creating event network-vif-plugged:5a2e332a-1fdd-451a-9677-e9aa6c4b5e77 for instance 90092a0d-bb08-4eb7-88d8-5789a1941ed0 on n-h2-826526-5 Jul 20 04:20:23.730555 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-2c8ede81-6c18-4a4a-ad23-a4c40e15daba req-9872521e-c1e7-4435-bb51-0ee36aa6aa1f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066898 Jul 20 04:20:23.735003 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1082/2347] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:23.747987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-96df7e8a-92a7-4f70-b8d8-a9e6402397b0 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:23.759397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-96df7e8a-92a7-4f70-b8d8-a9e6402397b0 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:23.767179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96df7e8a-92a7-4f70-b8d8-a9e6402397b0 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:23.767826 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96df7e8a-92a7-4f70-b8d8-a9e6402397b0 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:23.768812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96df7e8a-92a7-4f70-b8d8-a9e6402397b0 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:23.769444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96df7e8a-92a7-4f70-b8d8-a9e6402397b0 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:24.295900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-96df7e8a-92a7-4f70-b8d8-a9e6402397b0 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c22d39ea834080adb14e4133bb458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dc3cd573c47e89a2aac47a6d5fd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:24.305762 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-96df7e8a-92a7-4f70-b8d8-a9e6402397b0 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0" status: 200 len: 1323 microversion: 2.1 time: 0.569060 Jul 20 04:20:24.307206 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1083/2348] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:23 2022] GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 => generated 1323 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:24.328432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-211a54ba-178f-402c-92ed-43fde9375995 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06be8ebf70>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:24.548507 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-211a54ba-178f-402c-92ed-43fde9375995 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/5cf754ec-491d-4b7a-930a-fa97df4e0dbd" status: 200 len: 224 microversion: 2.1 time: 0.226753 Jul 20 04:20:24.549103 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1084/2349] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 04:20:24 2022] GET /compute/v2.1/os-security-groups/5cf754ec-491d-4b7a-930a-fa97df4e0dbd => generated 224 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:24.562137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6d141b3c-b191-4c7f-acd5-e663b7defb1c tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06bdbabe50>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:25.473759 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6d141b3c-b191-4c7f-acd5-e663b7defb1c tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/5cf754ec-491d-4b7a-930a-fa97df4e0dbd" status: 202 len: 0 microversion: 2.1 time: 0.917396 Jul 20 04:20:25.474731 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1085/2350] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:20:24 2022] DELETE /compute/v2.1/os-security-groups/5cf754ec-491d-4b7a-930a-fa97df4e0dbd => generated 0 bytes in 919 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:20:25.479654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b0319f18-1621-454d-b1a7-8d3d90c7c9c7 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be2cc430>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:25.572379 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b0319f18-1621-454d-b1a7-8d3d90c7c9c7 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1421 microversion: 2.1 time: 0.096345 Jul 20 04:20:25.581612 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1086/2351] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:25 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1421 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:25.596446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b1f3aed6-a8f7-4410-8c4c-98faf5a5cad3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:25.597107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b1f3aed6-a8f7-4410-8c4c-98faf5a5cad3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:25.603686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:25.636758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1f3aed6-a8f7-4410-8c4c-98faf5a5cad3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.645840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1f3aed6-a8f7-4410-8c4c-98faf5a5cad3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.648685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1f3aed6-a8f7-4410-8c4c-98faf5a5cad3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.650337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1f3aed6-a8f7-4410-8c4c-98faf5a5cad3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.907880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b1f3aed6-a8f7-4410-8c4c-98faf5a5cad3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c22d39ea834080adb14e4133bb458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dc3cd573c47e89a2aac47a6d5fd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:25.916604 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b1f3aed6-a8f7-4410-8c4c-98faf5a5cad3 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0" status: 200 len: 1473 microversion: 2.1 time: 0.333228 Jul 20 04:20:25.921919 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1087/2352] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:25 2022] GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 => generated 1473 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:25.931104 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-64ae72dc-d318-4632-b8c8-b28fefbd0ac1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06be871040>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:25.973943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG neutronclient.v2_0.client [None req-64ae72dc-d318-4632-b8c8-b28fefbd0ac1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5cf754ec-491d-4b7a-930a-fa97df4e0dbd does not exist", "detail": ""}} {{(pid=127870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:20:25.974760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.security_group_api [None req-64ae72dc-d318-4632-b8c8-b28fefbd0ac1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Neutron security group 5cf754ec-491d-4b7a-930a-fa97df4e0dbd not found {{(pid=127870) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:20:25.975476 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-64ae72dc-d318-4632-b8c8-b28fefbd0ac1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] HTTP exception thrown: Security group 5cf754ec-491d-4b7a-930a-fa97df4e0dbd does not exist Jul 20 04:20:25.975476 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-667995b4-6d06-44f2-a20e-9381169816d0'] Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-64ae72dc-d318-4632-b8c8-b28fefbd0ac1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Request method failure captured: Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/os-security-groups/5cf754ec-491d-4b7a-930a-fa97df4e0dbd HTTP/1.1 Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14JfAGKjPuA6ODJ-Qtd1em2O9yA3rahErotNYmVH9cKLqXeleHpCho0NIxaqZH7I3kILCGiDqMrjK0vy8DvdBt2Jb59H_-WliyaefNEp44gjG3S0TsxNI_vZzHSAfQzFRseRskmabnqYG7qLPbXQPBbvdUJJYh9qJrSBMBDZ9FAEz1w Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:20:25.977786 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:20:25.979122 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373f9f5b2b9f44fdba67acfc147b7d84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}] Jul 20 04:20:25.979122 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:20:25.979122 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:20:25.979122 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:20:25.979122 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:20:25.979122 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:20:25.979122 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:20:25.979122 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 539cb225b4b0422c9f19e0eb18c8983e Jul 20 04:20:25.979122 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:20:25.979122 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:20:25.979122 n-d-826526-5 devstack@n-api.service[127870]: exception: Security group 5cf754ec-491d-4b7a-930a-fa97df4e0dbd does not exist Jul 20 04:20:25.979122 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-667995b4-6d06-44f2-a20e-9381169816d0'] Jul 20 04:20:25.979122 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '5cf754ec-491d-4b7a-930a-fa97df4e0dbd'} Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:25.979970 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:20:25.981224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:20:25.981224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:25.981224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:25.981224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:20:25.981224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:20:25.981224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:20:25.981224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:20:25.981224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5cf754ec-491d-4b7a-930a-fa97df4e0dbd does not exist Jul 20 04:20:25.981224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-667995b4-6d06-44f2-a20e-9381169816d0'] Jul 20 04:20:25.981224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:25.981224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:25.981224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:25.981224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:25.981224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:20:25.981224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:20:25.981224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:20:25.981224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:20:25.981224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5cf754ec-491d-4b7a-930a-fa97df4e0dbd does not exist Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-667995b4-6d06-44f2-a20e-9381169816d0'] Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5cf754ec-491d-4b7a-930a-fa97df4e0dbd does not exist Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-667995b4-6d06-44f2-a20e-9381169816d0'] Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:25.982461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:25.983933 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:25.983933 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:25.983933 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:25.983933 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:25.983933 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5cf754ec-491d-4b7a-930a-fa97df4e0dbd does not exist Jul 20 04:20:25.983933 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-667995b4-6d06-44f2-a20e-9381169816d0'] Jul 20 04:20:25.983933 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:25.985373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-64ae72dc-d318-4632-b8c8-b28fefbd0ac1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Returning 404 to user: Security group 5cf754ec-491d-4b7a-930a-fa97df4e0dbd does not exist Jul 20 04:20:25.985373 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-667995b4-6d06-44f2-a20e-9381169816d0'] {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:25.986511 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-64ae72dc-d318-4632-b8c8-b28fefbd0ac1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/5cf754ec-491d-4b7a-930a-fa97df4e0dbd" status: 404 len: 194 microversion: 2.1 time: 0.063384 Jul 20 04:20:25.993592 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1088/2353] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 04:20:25 2022] GET /compute/v2.1/os-security-groups/5cf754ec-491d-4b7a-930a-fa97df4e0dbd => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:25.997405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dc5600ae-e61f-4f12-bea7-3fb84fe62005 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:25.998740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dc5600ae-e61f-4f12-bea7-3fb84fe62005 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:26.008096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc5600ae-e61f-4f12-bea7-3fb84fe62005 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.008928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc5600ae-e61f-4f12-bea7-3fb84fe62005 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.009955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc5600ae-e61f-4f12-bea7-3fb84fe62005 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.010629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc5600ae-e61f-4f12-bea7-3fb84fe62005 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.042697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dc5600ae-e61f-4f12-bea7-3fb84fe62005 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'a4c22d39ea834080adb14e4133bb458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dc3cd573c47e89a2aac47a6d5fd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dc5600ae-e61f-4f12-bea7-3fb84fe62005 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Request method failure captured: Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0/diagnostics HTTP/1.1 Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14JqHwtovicCc9MiDZIQLO3sB9CGtmrh7X82ujpJi8tm-heMH4oBgB6RfHnMNRzbVf3CyJ3qSJGYBigMY2Gw3T1v1nxYYmkZ4k_0EgQYqdC3W0kEUXlgUdk9ItfaxzAuJraFrOhBI42hrLffB0RadU3rEy825ilZsUDRFQ4zq6C98x8 Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: a12dc3cd573c47e89a2aac47a6d5fd78 Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1724478785 Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:20:26.050855 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:20:26.052300 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a12dc3cd573c47e89a2aac47a6d5fd78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a12dc3cd573c47e89a2aac47a6d5fd78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a12dc3cd573c47e89a2aac47a6d5fd78", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a12dc3cd573c47e89a2aac47a6d5fd78"}]}] Jul 20 04:20:26.052300 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1724478785 Jul 20 04:20:26.052300 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: a12dc3cd573c47e89a2aac47a6d5fd78 Jul 20 04:20:26.052300 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1724478785 Jul 20 04:20:26.052300 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerDiagnosticsNegativeTest-1724478785-project Jul 20 04:20:26.052300 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:20:26.052300 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:20:26.052300 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a4c22d39ea834080adb14e4133bb458a Jul 20 04:20:26.052300 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1724478785-project Jul 20 04:20:26.052300 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:20:26.052300 n-d-826526-5 devstack@n-api.service[127870]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'server_id': '90092a0d-bb08-4eb7-88d8-5789a1941ed0'} Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:20:26.052971 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:20:26.054128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:20:26.054128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:20:26.054128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:20:26.054128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:20:26.054128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:20:26.054128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 20 04:20:26.054128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:26.054128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:26.054128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:26.054128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:26.054128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:26.054128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:26.054128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:20:26.054128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:20:26.054128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 20 04:20:26.054128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:26.059653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dc5600ae-e61f-4f12-bea7-3fb84fe62005 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:26.060954 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dc5600ae-e61f-4f12-bea7-3fb84fe62005 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.071453 Jul 20 04:20:26.062331 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1089/2354] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:20:25 2022] GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0/diagnostics => generated 117 bytes in 73 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:26.080162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0cc22766-864b-4a59-b161-15055d7ce7d4 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Action: 'create', calling method: .version_select at 0x7f06be871700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-411433801", "description": "tempest-description-1266590984"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:26.413515 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0cc22766-864b-4a59-b161-15055d7ce7d4 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.347845 Jul 20 04:20:26.414009 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1090/2355] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:20:26 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:26.419371 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d10ac5fb-5827-4089-8ad5-71fda160ca07 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:26.420067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d10ac5fb-5827-4089-8ad5-71fda160ca07 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:26.438220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d10ac5fb-5827-4089-8ad5-71fda160ca07 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.440589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d10ac5fb-5827-4089-8ad5-71fda160ca07 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.441616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d10ac5fb-5827-4089-8ad5-71fda160ca07 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.444804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d10ac5fb-5827-4089-8ad5-71fda160ca07 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.516736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d10ac5fb-5827-4089-8ad5-71fda160ca07 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:26.847586 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d10ac5fb-5827-4089-8ad5-71fda160ca07 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "DELETE /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0" status: 204 len: 0 microversion: 2.1 time: 0.424747 Jul 20 04:20:26.854000 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1091/2356] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:26 2022] DELETE /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:26.875844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-6ad2485b-17f8-4559-841d-d4578e824730 req-289c0bf4-2e50-4ede-aafa-209b32306169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1be9b8-b9ff-40ea-a63a-d01d38a96102", "name": "network-vif-plugged", "status": "completed", "tag": "f6cbea3d-636a-48f6-a62e-de1624ae8f8b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:26.940808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6ad2485b-17f8-4559-841d-d4578e824730 req-289c0bf4-2e50-4ede-aafa-209b32306169 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.941579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6ad2485b-17f8-4559-841d-d4578e824730 req-289c0bf4-2e50-4ede-aafa-209b32306169 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.972815 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-6ad2485b-17f8-4559-841d-d4578e824730 req-289c0bf4-2e50-4ede-aafa-209b32306169 service nova] Creating event network-vif-plugged:f6cbea3d-636a-48f6-a62e-de1624ae8f8b for instance ff1be9b8-b9ff-40ea-a63a-d01d38a96102 on n-h2-826526-5 Jul 20 04:20:26.978428 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-6ad2485b-17f8-4559-841d-d4578e824730 req-289c0bf4-2e50-4ede-aafa-209b32306169 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124088 Jul 20 04:20:26.979050 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1092/2357] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:26.986037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8e155aa2-2212-427a-984d-3818a202e878 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Action: 'create', calling method: .version_select at 0x7f06be871040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1094897553", "description": "tempest-description-1070090756"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:27.802457 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8e155aa2-2212-427a-984d-3818a202e878 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.821090 Jul 20 04:20:27.803687 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1093/2358] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:20:26 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:27.808794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0fc16f3c-d661-45b0-bcd6-1fe11183e65f tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be62e280>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:27.905516 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0fc16f3c-d661-45b0-bcd6-1fe11183e65f tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1421 microversion: 2.1 time: 0.100070 Jul 20 04:20:27.908426 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1094/2359] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:27 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1421 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:27.935516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b0480f51-bb08-438b-9fce-cdbd339a76d1 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:27.936488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b0480f51-bb08-438b-9fce-cdbd339a76d1 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:27.954654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0480f51-bb08-438b-9fce-cdbd339a76d1 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.955183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0480f51-bb08-438b-9fce-cdbd339a76d1 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.969796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0480f51-bb08-438b-9fce-cdbd339a76d1 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.969796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0480f51-bb08-438b-9fce-cdbd339a76d1 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.652572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b0480f51-bb08-438b-9fce-cdbd339a76d1 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c22d39ea834080adb14e4133bb458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dc3cd573c47e89a2aac47a6d5fd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:28.664643 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b0480f51-bb08-438b-9fce-cdbd339a76d1 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0" status: 200 len: 1479 microversion: 2.1 time: 0.754254 Jul 20 04:20:28.666972 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1095/2360] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:27 2022] GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 => generated 1479 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:28.683707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bc3d08c3-3107-4dde-a311-5a9e6bfe0d64 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Action: 'create', calling method: .version_select at 0x7f06bdb8b700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-423493912", "description": "tempest-description-902442425"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:29.142497 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bc3d08c3-3107-4dde-a311-5a9e6bfe0d64 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.472634 Jul 20 04:20:29.143663 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1096/2361] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:20:28 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:29.149067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-247a2493-eb27-49dc-8340-920c8e649d20 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be620b80>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:29.224749 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-247a2493-eb27-49dc-8340-920c8e649d20 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1421 microversion: 2.1 time: 0.079299 Jul 20 04:20:29.225656 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1097/2362] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:29 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1421 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:29.233010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-959aaf20-0919-48b8-ac36-487b17f7e00d tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06be981670>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:31.255429 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-959aaf20-0919-48b8-ac36-487b17f7e00d tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 2.027386 Jul 20 04:20:31.256522 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1098/2363] 10.222.0.17 () {58 vars in 1157 bytes} [Wed Jul 20 04:20:29 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 2030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:31.285593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4c70b5de-5f54-48e0-b055-50e059dbb1e5 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:31.287626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4c70b5de-5f54-48e0-b055-50e059dbb1e5 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] [instance: 90092a0d-bb08-4eb7-88d8-5789a1941ed0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:31.345069 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c70b5de-5f54-48e0-b055-50e059dbb1e5 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:31.345917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c70b5de-5f54-48e0-b055-50e059dbb1e5 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:31.350343 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c70b5de-5f54-48e0-b055-50e059dbb1e5 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:31.354151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c70b5de-5f54-48e0-b055-50e059dbb1e5 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:31.454116 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-4c70b5de-5f54-48e0-b055-50e059dbb1e5 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] HTTP exception thrown: Instance 90092a0d-bb08-4eb7-88d8-5789a1941ed0 could not be found. Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4c70b5de-5f54-48e0-b055-50e059dbb1e5 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Request method failure captured: Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 HTTP/1.1 Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14JqHwtovicCc9MiDZIQLO3sB9CGtmrh7X82ujpJi8tm-heMH4oBgB6RfHnMNRzbVf3CyJ3qSJGYBigMY2Gw3T1v1nxYYmkZ4k_0EgQYqdC3W0kEUXlgUdk9ItfaxzAuJraFrOhBI42hrLffB0RadU3rEy825ilZsUDRFQ4zq6C98x8 Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: a12dc3cd573c47e89a2aac47a6d5fd78 Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1724478785 Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:20:31.464360 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:20:31.465912 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a12dc3cd573c47e89a2aac47a6d5fd78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a12dc3cd573c47e89a2aac47a6d5fd78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a12dc3cd573c47e89a2aac47a6d5fd78", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a12dc3cd573c47e89a2aac47a6d5fd78"}]}] Jul 20 04:20:31.465912 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1724478785 Jul 20 04:20:31.465912 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: a12dc3cd573c47e89a2aac47a6d5fd78 Jul 20 04:20:31.465912 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1724478785 Jul 20 04:20:31.465912 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerDiagnosticsNegativeTest-1724478785-project Jul 20 04:20:31.465912 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:20:31.465912 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:20:31.465912 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a4c22d39ea834080adb14e4133bb458a Jul 20 04:20:31.465912 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1724478785-project Jul 20 04:20:31.465912 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:20:31.465912 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 90092a0d-bb08-4eb7-88d8-5789a1941ed0 could not be found. Jul 20 04:20:31.465912 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '90092a0d-bb08-4eb7-88d8-5789a1941ed0'} Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90092a0d-bb08-4eb7-88d8-5789a1941ed0 could not be found. Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:31.466779 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:31.468217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:31.468217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:31.468217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:31.468217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:31.468217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:31.468217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:31.468217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:31.468217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90092a0d-bb08-4eb7-88d8-5789a1941ed0 could not be found. Jul 20 04:20:31.468217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:31.468217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:31.468217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:31.468217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:31.468217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:31.468217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:31.468217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:31.468217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:31.468217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90092a0d-bb08-4eb7-88d8-5789a1941ed0 could not be found. Jul 20 04:20:31.468217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:20:31.476235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4c70b5de-5f54-48e0-b055-50e059dbb1e5 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] Returning 404 to user: Instance 90092a0d-bb08-4eb7-88d8-5789a1941ed0 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:31.479960 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4c70b5de-5f54-48e0-b055-50e059dbb1e5 tempest-ServerDiagnosticsNegativeTest-1724478785 tempest-ServerDiagnosticsNegativeTest-1724478785-project] 10.222.0.17 "GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0" status: 404 len: 111 microversion: 2.1 time: 0.202990 Jul 20 04:20:31.488870 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1099/2364] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:31 2022] GET /compute/v2.1/servers/90092a0d-bb08-4eb7-88d8-5789a1941ed0 => generated 111 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:31.494558 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9a1da5db-c34e-4739-a6db-8dfc68e5c220 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.838228 Jul 20 04:20:31.497957 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1266/2365] 10.222.0.17 () {60 vars in 1169 bytes} [Wed Jul 20 04:20:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:31.512207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-d22c23b5-a747-41e9-a583-a844baa059d0 req-8fb25e3f-9791-40f7-a5dd-879591f87577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90092a0d-bb08-4eb7-88d8-5789a1941ed0", "name": "network-vif-deleted", "tag": "5a2e332a-1fdd-451a-9677-e9aa6c4b5e77"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:31.527179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-194e65f9-286d-458f-8e66-642cf877e0ef tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be5a7e50>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:31.543872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d22c23b5-a747-41e9-a583-a844baa059d0 req-8fb25e3f-9791-40f7-a5dd-879591f87577 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:31.563748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d22c23b5-a747-41e9-a583-a844baa059d0 req-8fb25e3f-9791-40f7-a5dd-879591f87577 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:31.568602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:31.598379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=21 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:31.611442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:31.636087 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-194e65f9-286d-458f-8e66-642cf877e0ef tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1421 microversion: 2.1 time: 0.136787 Jul 20 04:20:31.644719 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-d22c23b5-a747-41e9-a583-a844baa059d0 req-8fb25e3f-9791-40f7-a5dd-879591f87577 service nova] Creating event network-vif-deleted:5a2e332a-1fdd-451a-9677-e9aa6c4b5e77 for instance 90092a0d-bb08-4eb7-88d8-5789a1941ed0 on n-h2-826526-5 Jul 20 04:20:31.645251 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1267/2366] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:31 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1421 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:31.651333 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-d22c23b5-a747-41e9-a583-a844baa059d0 req-8fb25e3f-9791-40f7-a5dd-879591f87577 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160933 Jul 20 04:20:31.654199 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1100/2367] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:31.660739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6117d124-2e15-47a9-9b42-c0798773b06a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06be0b1e50>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:31.671455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-86ecaf3d-c352-4a22-a54c-da6c9cf32422 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] Calling method '.version_select at 0x7f06be86b3a0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:32.330969 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-86ecaf3d-c352-4a22-a54c-da6c9cf32422 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/e84c6ec2-24ac-4548-968a-7464ccb8b0cf" status: 200 len: 142 microversion: 2.1 time: 0.675288 Jul 20 04:20:32.339831 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1101/2368] 10.222.0.17 () {58 vars in 1259 bytes} [Wed Jul 20 04:20:31 2022] GET /compute/v2.1/os-floating-ips/e84c6ec2-24ac-4548-968a-7464ccb8b0cf => generated 142 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:32.390222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f8dc694e-ffb9-439b-b95b-e42867118651 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] Calling method '.version_select at 0x7f06be505940>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:33.029399 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6117d124-2e15-47a9-9b42-c0798773b06a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/0083f176-eb56-470f-a14f-9dcf331a9a3a" status: 202 len: 0 microversion: 2.1 time: 1.382610 Jul 20 04:20:33.030433 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1268/2369] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:20:31 2022] DELETE /compute/v2.1/os-security-groups/0083f176-eb56-470f-a14f-9dcf331a9a3a => generated 0 bytes in 1384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:20:33.037373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b1290403-1406-4eb5-b8b8-9ac0a262cbd1 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be07f3a0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:33.147072 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b1290403-1406-4eb5-b8b8-9ac0a262cbd1 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1421 microversion: 2.1 time: 0.115030 Jul 20 04:20:33.149399 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1269/2370] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:33 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1421 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:33.158068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2592950a-29e0-4346-88f4-0c607f6ccb1d tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06c72f9af0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:33.262537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG neutronclient.v2_0.client [None req-2592950a-29e0-4346-88f4-0c607f6ccb1d tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0083f176-eb56-470f-a14f-9dcf331a9a3a does not exist", "detail": ""}} {{(pid=127871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:20:33.263167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.security_group_api [None req-2592950a-29e0-4346-88f4-0c607f6ccb1d tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Neutron security group 0083f176-eb56-470f-a14f-9dcf331a9a3a not found {{(pid=127871) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:20:33.264736 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-2592950a-29e0-4346-88f4-0c607f6ccb1d tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] HTTP exception thrown: Security group 0083f176-eb56-470f-a14f-9dcf331a9a3a does not exist Jul 20 04:20:33.264736 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-94955e9b-10cc-468c-a022-8d9034666598'] Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2592950a-29e0-4346-88f4-0c607f6ccb1d tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Request method failure captured: Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-security-groups/0083f176-eb56-470f-a14f-9dcf331a9a3a HTTP/1.1 Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14JfAGKjPuA6ODJ-Qtd1em2O9yA3rahErotNYmVH9cKLqXeleHpCho0NIxaqZH7I3kILCGiDqMrjK0vy8DvdBt2Jb59H_-WliyaefNEp44gjG3S0TsxNI_vZzHSAfQzFRseRskmabnqYG7qLPbXQPBbvdUJJYh9qJrSBMBDZ9FAEz1w Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:20:33.266828 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:20:33.269176 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373f9f5b2b9f44fdba67acfc147b7d84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}] Jul 20 04:20:33.269176 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:20:33.269176 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:20:33.269176 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:20:33.269176 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:20:33.269176 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:20:33.269176 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:20:33.269176 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 539cb225b4b0422c9f19e0eb18c8983e Jul 20 04:20:33.269176 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:20:33.269176 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:20:33.269176 n-d-826526-5 devstack@n-api.service[127871]: exception: Security group 0083f176-eb56-470f-a14f-9dcf331a9a3a does not exist Jul 20 04:20:33.269176 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-94955e9b-10cc-468c-a022-8d9034666598'] Jul 20 04:20:33.269176 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '0083f176-eb56-470f-a14f-9dcf331a9a3a'} Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:33.270056 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:20:33.271176 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:20:33.271176 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:33.271176 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:33.271176 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:20:33.271176 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:20:33.271176 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:20:33.271176 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:20:33.271176 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0083f176-eb56-470f-a14f-9dcf331a9a3a does not exist Jul 20 04:20:33.271176 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94955e9b-10cc-468c-a022-8d9034666598'] Jul 20 04:20:33.271176 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:33.271176 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:33.271176 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:33.271176 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:33.271176 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:20:33.271176 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:20:33.271176 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:20:33.271176 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:20:33.271176 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0083f176-eb56-470f-a14f-9dcf331a9a3a does not exist Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94955e9b-10cc-468c-a022-8d9034666598'] Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0083f176-eb56-470f-a14f-9dcf331a9a3a does not exist Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94955e9b-10cc-468c-a022-8d9034666598'] Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:33.272278 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:33.273582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:33.273582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:33.273582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:33.273582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:33.273582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0083f176-eb56-470f-a14f-9dcf331a9a3a does not exist Jul 20 04:20:33.273582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94955e9b-10cc-468c-a022-8d9034666598'] Jul 20 04:20:33.273582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:33.273582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2592950a-29e0-4346-88f4-0c607f6ccb1d tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Returning 404 to user: Security group 0083f176-eb56-470f-a14f-9dcf331a9a3a does not exist Jul 20 04:20:33.273582 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-94955e9b-10cc-468c-a022-8d9034666598'] {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:33.273582 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2592950a-29e0-4346-88f4-0c607f6ccb1d tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/0083f176-eb56-470f-a14f-9dcf331a9a3a" status: 404 len: 194 microversion: 2.1 time: 0.117574 Jul 20 04:20:33.274582 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f8dc694e-ffb9-439b-b95b-e42867118651 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.927036 Jul 20 04:20:33.274666 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1270/2371] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 04:20:33 2022] GET /compute/v2.1/os-security-groups/0083f176-eb56-470f-a14f-9dcf331a9a3a => generated 194 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:33.275838 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1102/2372] 10.222.0.17 () {58 vars in 1148 bytes} [Wed Jul 20 04:20:32 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:33.279094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b81f62ca-01f2-457b-a8af-aaceca566534 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06be0f0700>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:33.281396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b707bd97-ad2b-4871-bfa9-c09502fcba2d tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] Calling method '.version_select at 0x7f06be505ee0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:34.124735 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b81f62ca-01f2-457b-a8af-aaceca566534 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/e7c148e1-e2a3-4839-8dc7-95e8a3244bea" status: 202 len: 0 microversion: 2.1 time: 0.849550 Jul 20 04:20:34.127537 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1271/2373] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:20:33 2022] DELETE /compute/v2.1/os-security-groups/e7c148e1-e2a3-4839-8dc7-95e8a3244bea => generated 0 bytes in 853 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:20:34.140698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f6090144-3723-4101-8586-886bbad4d963 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06be09ad30>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:34.289944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG neutronclient.v2_0.client [None req-f6090144-3723-4101-8586-886bbad4d963 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e7c148e1-e2a3-4839-8dc7-95e8a3244bea does not exist", "detail": ""}} {{(pid=127871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:20:34.290664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.security_group_api [None req-f6090144-3723-4101-8586-886bbad4d963 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Neutron security group e7c148e1-e2a3-4839-8dc7-95e8a3244bea not found {{(pid=127871) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:20:34.291180 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-f6090144-3723-4101-8586-886bbad4d963 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] HTTP exception thrown: Security group e7c148e1-e2a3-4839-8dc7-95e8a3244bea does not exist Jul 20 04:20:34.291180 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-2be5d814-7aec-47a6-add1-6621c8c16c90'] Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f6090144-3723-4101-8586-886bbad4d963 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Request method failure captured: Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-security-groups/e7c148e1-e2a3-4839-8dc7-95e8a3244bea HTTP/1.1 Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14JfAGKjPuA6ODJ-Qtd1em2O9yA3rahErotNYmVH9cKLqXeleHpCho0NIxaqZH7I3kILCGiDqMrjK0vy8DvdBt2Jb59H_-WliyaefNEp44gjG3S0TsxNI_vZzHSAfQzFRseRskmabnqYG7qLPbXQPBbvdUJJYh9qJrSBMBDZ9FAEz1w Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:20:34.294239 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:20:34.295866 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373f9f5b2b9f44fdba67acfc147b7d84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}] Jul 20 04:20:34.295866 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:20:34.295866 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:20:34.295866 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:20:34.295866 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:20:34.295866 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:20:34.295866 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:20:34.295866 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 539cb225b4b0422c9f19e0eb18c8983e Jul 20 04:20:34.295866 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:20:34.295866 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:20:34.295866 n-d-826526-5 devstack@n-api.service[127871]: exception: Security group e7c148e1-e2a3-4839-8dc7-95e8a3244bea does not exist Jul 20 04:20:34.295866 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-2be5d814-7aec-47a6-add1-6621c8c16c90'] Jul 20 04:20:34.295866 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'e7c148e1-e2a3-4839-8dc7-95e8a3244bea'} Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:34.296903 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:20:34.298297 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:20:34.298297 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:34.298297 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:34.298297 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:20:34.298297 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:20:34.298297 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:20:34.298297 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:20:34.298297 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e7c148e1-e2a3-4839-8dc7-95e8a3244bea does not exist Jul 20 04:20:34.298297 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2be5d814-7aec-47a6-add1-6621c8c16c90'] Jul 20 04:20:34.298297 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:34.298297 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:34.298297 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:34.298297 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:34.298297 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:20:34.298297 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:20:34.298297 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:20:34.298297 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:20:34.298297 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e7c148e1-e2a3-4839-8dc7-95e8a3244bea does not exist Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2be5d814-7aec-47a6-add1-6621c8c16c90'] Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e7c148e1-e2a3-4839-8dc7-95e8a3244bea does not exist Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2be5d814-7aec-47a6-add1-6621c8c16c90'] Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:34.299622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:34.302155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:34.302155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:34.302155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:34.302155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:34.302155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e7c148e1-e2a3-4839-8dc7-95e8a3244bea does not exist Jul 20 04:20:34.302155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2be5d814-7aec-47a6-add1-6621c8c16c90'] Jul 20 04:20:34.302155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:34.302155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f6090144-3723-4101-8586-886bbad4d963 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Returning 404 to user: Security group e7c148e1-e2a3-4839-8dc7-95e8a3244bea does not exist Jul 20 04:20:34.302155 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-2be5d814-7aec-47a6-add1-6621c8c16c90'] {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:34.302155 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f6090144-3723-4101-8586-886bbad4d963 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/e7c148e1-e2a3-4839-8dc7-95e8a3244bea" status: 404 len: 194 microversion: 2.1 time: 0.163763 Jul 20 04:20:34.302155 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1272/2374] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 04:20:34 2022] GET /compute/v2.1/os-security-groups/e7c148e1-e2a3-4839-8dc7-95e8a3244bea => generated 194 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:34.318766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ae57b94f-f675-4a03-88dc-808639635ac5 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be0f30d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:34.412646 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ae57b94f-f675-4a03-88dc-808639635ac5 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1421 microversion: 2.1 time: 0.113374 Jul 20 04:20:34.421029 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1273/2375] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:34 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1421 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:34.434944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3734a5c4-f597-4c48-b3de-7cc836468168 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06be09a670>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:35.754577 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3734a5c4-f597-4c48-b3de-7cc836468168 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/117560a7-ed15-4df9-b4cf-455fe34cac80" status: 202 len: 0 microversion: 2.1 time: 1.337303 Jul 20 04:20:35.755228 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1274/2376] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:20:34 2022] DELETE /compute/v2.1/os-security-groups/117560a7-ed15-4df9-b4cf-455fe34cac80 => generated 0 bytes in 1341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:20:35.761858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cc9c995a-e60c-4940-a0f9-680e29a66964 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06bdf75ca0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:35.829690 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cc9c995a-e60c-4940-a0f9-680e29a66964 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1421 microversion: 2.1 time: 0.072685 Jul 20 04:20:35.830573 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1275/2377] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:35 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1421 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:35.839131 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2d1017b2-1b90-41ed-afdd-ddf7a8488975 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06bda675e0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:35.981464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG neutronclient.v2_0.client [None req-2d1017b2-1b90-41ed-afdd-ddf7a8488975 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 117560a7-ed15-4df9-b4cf-455fe34cac80 does not exist", "detail": ""}} {{(pid=127871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:20:35.982333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.security_group_api [None req-2d1017b2-1b90-41ed-afdd-ddf7a8488975 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Neutron security group 117560a7-ed15-4df9-b4cf-455fe34cac80 not found {{(pid=127871) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:20:35.983029 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-2d1017b2-1b90-41ed-afdd-ddf7a8488975 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] HTTP exception thrown: Security group 117560a7-ed15-4df9-b4cf-455fe34cac80 does not exist Jul 20 04:20:35.983029 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-a4db0f56-eddf-4b79-b884-96ad33aef081'] Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2d1017b2-1b90-41ed-afdd-ddf7a8488975 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Request method failure captured: Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-security-groups/117560a7-ed15-4df9-b4cf-455fe34cac80 HTTP/1.1 Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14JfAGKjPuA6ODJ-Qtd1em2O9yA3rahErotNYmVH9cKLqXeleHpCho0NIxaqZH7I3kILCGiDqMrjK0vy8DvdBt2Jb59H_-WliyaefNEp44gjG3S0TsxNI_vZzHSAfQzFRseRskmabnqYG7qLPbXQPBbvdUJJYh9qJrSBMBDZ9FAEz1w Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:20:35.985212 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:20:35.986655 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373f9f5b2b9f44fdba67acfc147b7d84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}] Jul 20 04:20:35.986655 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:20:35.986655 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:20:35.986655 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:20:35.986655 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:20:35.986655 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:20:35.986655 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:20:35.986655 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 539cb225b4b0422c9f19e0eb18c8983e Jul 20 04:20:35.986655 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:20:35.986655 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:20:35.986655 n-d-826526-5 devstack@n-api.service[127871]: exception: Security group 117560a7-ed15-4df9-b4cf-455fe34cac80 does not exist Jul 20 04:20:35.986655 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-a4db0f56-eddf-4b79-b884-96ad33aef081'] Jul 20 04:20:35.986655 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '117560a7-ed15-4df9-b4cf-455fe34cac80'} Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:35.987568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:20:35.988896 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:20:35.988896 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:35.988896 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:35.988896 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:20:35.988896 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:20:35.988896 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:20:35.988896 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:20:35.988896 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 117560a7-ed15-4df9-b4cf-455fe34cac80 does not exist Jul 20 04:20:35.988896 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4db0f56-eddf-4b79-b884-96ad33aef081'] Jul 20 04:20:35.988896 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:35.988896 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:35.988896 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:35.988896 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:35.988896 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:20:35.988896 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:20:35.988896 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:20:35.988896 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:20:35.988896 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 117560a7-ed15-4df9-b4cf-455fe34cac80 does not exist Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4db0f56-eddf-4b79-b884-96ad33aef081'] Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 117560a7-ed15-4df9-b4cf-455fe34cac80 does not exist Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4db0f56-eddf-4b79-b884-96ad33aef081'] Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:35.989930 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:35.991309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:35.991309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:35.991309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:35.991309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:35.991309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 117560a7-ed15-4df9-b4cf-455fe34cac80 does not exist Jul 20 04:20:35.991309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4db0f56-eddf-4b79-b884-96ad33aef081'] Jul 20 04:20:35.991309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:35.993336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2d1017b2-1b90-41ed-afdd-ddf7a8488975 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Returning 404 to user: Security group 117560a7-ed15-4df9-b4cf-455fe34cac80 does not exist Jul 20 04:20:35.993336 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-a4db0f56-eddf-4b79-b884-96ad33aef081'] {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:35.994529 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2d1017b2-1b90-41ed-afdd-ddf7a8488975 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/117560a7-ed15-4df9-b4cf-455fe34cac80" status: 404 len: 194 microversion: 2.1 time: 0.162789 Jul 20 04:20:35.995656 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1276/2378] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 04:20:35 2022] GET /compute/v2.1/os-security-groups/117560a7-ed15-4df9-b4cf-455fe34cac80 => generated 194 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:36.008761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e26ef3f5-c836-4f64-8fd8-728f76e973e8 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06bda67ca0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:37.169419 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b707bd97-ad2b-4871-bfa9-c09502fcba2d tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/e84c6ec2-24ac-4548-968a-7464ccb8b0cf" status: 202 len: 0 microversion: 2.1 time: 3.892190 Jul 20 04:20:37.174878 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1103/2379] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:20:33 2022] DELETE /compute/v2.1/os-floating-ips/e84c6ec2-24ac-4548-968a-7464ccb8b0cf => generated 0 bytes in 3898 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:20:37.180367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf111a41-412d-42c8-91cd-62fd66996545 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be7a01f0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:37.252502 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cf111a41-412d-42c8-91cd-62fd66996545 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1421 microversion: 2.1 time: 0.074153 Jul 20 04:20:37.253776 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1104/2380] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:37 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1421 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:37.264112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1ccf20fe-8a61-403c-9bcb-8f0dd39f7e9d tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] Action: 'create', calling method: .version_select at 0x7f06be895f70>, body: {"pool": null} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:37.562476 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e26ef3f5-c836-4f64-8fd8-728f76e973e8 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.558917 Jul 20 04:20:37.568138 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1277/2381] 10.222.0.17 () {58 vars in 1157 bytes} [Wed Jul 20 04:20:35 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:37.589460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a3514641-b517-4cc3-ab7f-b82bdcf20508 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Action: 'create', calling method: .version_select at 0x7f06bdf30670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1882606480", "description": "tempest-description-182624623"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:38.864052 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a3514641-b517-4cc3-ab7f-b82bdcf20508 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.280872 Jul 20 04:20:38.865396 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1278/2382] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:20:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:38.870542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-84c72d9c-ec6c-4f49-a9b1-3edfbe8d4667 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06bddbbf70>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:38.958020 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-84c72d9c-ec6c-4f49-a9b1-3edfbe8d4667 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1421 microversion: 2.1 time: 0.090867 Jul 20 04:20:38.965588 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1279/2383] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:38 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1421 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:38.972656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1cdac9bb-33d7-4426-9884-e153f835d62a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Action: 'create', calling method: .version_select at 0x7f06be6b7700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2083928718", "description": "tempest-description-767933714"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:39.521603 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1cdac9bb-33d7-4426-9884-e153f835d62a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.553391 Jul 20 04:20:39.522773 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1280/2384] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:20:38 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:39.683830 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c7f09feb-284a-45cd-8854-8ef1fb16a3a5 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1047496332", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "46925f95-2af7-4d2b-9091-d109b13c5d2e"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:39.817339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-c7f09feb-284a-45cd-8854-8ef1fb16a3a5 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] validate_networks() for [('46925f95-2af7-4d2b-9091-d109b13c5d2e', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:20:41.063956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c7f09feb-284a-45cd-8854-8ef1fb16a3a5 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:20:41.065197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c7f09feb-284a-45cd-8854-8ef1fb16a3a5 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:20:41.066240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c7f09feb-284a-45cd-8854-8ef1fb16a3a5 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:20:41.067302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c7f09feb-284a-45cd-8854-8ef1fb16a3a5 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:20:41.068068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c7f09feb-284a-45cd-8854-8ef1fb16a3a5 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:20:41.114605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7f09feb-284a-45cd-8854-8ef1fb16a3a5 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:41.116241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7f09feb-284a-45cd-8854-8ef1fb16a3a5 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:41.121393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7f09feb-284a-45cd-8854-8ef1fb16a3a5 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:41.122411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7f09feb-284a-45cd-8854-8ef1fb16a3a5 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:41.218047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c7f09feb-284a-45cd-8854-8ef1fb16a3a5 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Getting quotas for project 373f9f5b2b9f44fdba67acfc147b7d84. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:41.245442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c7f09feb-284a-45cd-8854-8ef1fb16a3a5 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Getting quotas for user 539cb225b4b0422c9f19e0eb18c8983e and project 373f9f5b2b9f44fdba67acfc147b7d84. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:41.278772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c7f09feb-284a-45cd-8854-8ef1fb16a3a5 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:20:41.281647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c7f09feb-284a-45cd-8854-8ef1fb16a3a5 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:20:41.450470 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c7f09feb-284a-45cd-8854-8ef1fb16a3a5 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.772556 Jul 20 04:20:41.463131 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1281/2385] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:20:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:20:41.469024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c9a3cab9-45f6-40e7-8a29-621ca043650c tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be0f3b80>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:41.518715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:41.564869 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c9a3cab9-45f6-40e7-8a29-621ca043650c tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1421 microversion: 2.1 time: 0.095637 Jul 20 04:20:41.566073 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1282/2386] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:41 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1421 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:41.571983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8c7ef0fc-abb5-44ec-9393-52db21f53908 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:41.572922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8c7ef0fc-abb5-44ec-9393-52db21f53908 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:41.660279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8c7ef0fc-abb5-44ec-9393-52db21f53908 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:41.672118 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8c7ef0fc-abb5-44ec-9393-52db21f53908 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 200 len: 1216 microversion: 2.1 time: 0.103642 Jul 20 04:20:41.691566 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1283/2387] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:41 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 1216 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:42.170162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0d645cb1-1089-4828-b265-dc346bdddda1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1175556017", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:42.310169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-0d645cb1-1089-4828-b265-dc346bdddda1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:20:43.271297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0d645cb1-1089-4828-b265-dc346bdddda1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:20:43.272704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0d645cb1-1089-4828-b265-dc346bdddda1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:20:43.273527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0d645cb1-1089-4828-b265-dc346bdddda1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:20:43.274149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0d645cb1-1089-4828-b265-dc346bdddda1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:20:43.275095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0d645cb1-1089-4828-b265-dc346bdddda1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:20:43.332210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d645cb1-1089-4828-b265-dc346bdddda1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:43.335178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d645cb1-1089-4828-b265-dc346bdddda1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:43.340023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d645cb1-1089-4828-b265-dc346bdddda1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:43.343106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d645cb1-1089-4828-b265-dc346bdddda1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:43.426967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-0d645cb1-1089-4828-b265-dc346bdddda1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Getting quotas for project e780b879f5f943468e72977a75ee807d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:43.445468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-0d645cb1-1089-4828-b265-dc346bdddda1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Getting quotas for user cace98c409cd464a93e2d98ff7d1a989 and project e780b879f5f943468e72977a75ee807d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:43.495647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0d645cb1-1089-4828-b265-dc346bdddda1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:20:43.509212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0d645cb1-1089-4828-b265-dc346bdddda1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:20:43.631522 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0d645cb1-1089-4828-b265-dc346bdddda1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.949045 Jul 20 04:20:43.633583 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1284/2388] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:20:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:20:43.656894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7ebc70cf-72e7-41d8-a1f2-bd0aeb700d15 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be2c6940>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:43.828702 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7ebc70cf-72e7-41d8-a1f2-bd0aeb700d15 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1421 microversion: 2.1 time: 0.192636 Jul 20 04:20:43.850855 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1285/2389] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:43 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1421 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:43.883620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fc4c899a-dc15-4c6b-84fc-b02f379f01d9 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:43.889643 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fc4c899a-dc15-4c6b-84fc-b02f379f01d9 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:43.917360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fc4c899a-dc15-4c6b-84fc-b02f379f01d9 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:43.918214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fc4c899a-dc15-4c6b-84fc-b02f379f01d9 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:43.924309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fc4c899a-dc15-4c6b-84fc-b02f379f01d9 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:43.927833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fc4c899a-dc15-4c6b-84fc-b02f379f01d9 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:44.385769 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1ccf20fe-8a61-403c-9bcb-8f0dd39f7e9d tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.130419 Jul 20 04:20:44.387055 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1105/2390] 10.222.0.17 () {60 vars in 1169 bytes} [Wed Jul 20 04:20:37 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:44.397397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-543e0359-8806-4a6a-89f7-5494eacc8586 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1313134951", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:44.525962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-543e0359-8806-4a6a-89f7-5494eacc8586 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] validate_networks() for None {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:20:44.803822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fc4c899a-dc15-4c6b-84fc-b02f379f01d9 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:44.820275 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fc4c899a-dc15-4c6b-84fc-b02f379f01d9 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 200 len: 1286 microversion: 2.1 time: 0.951214 Jul 20 04:20:44.820969 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1286/2391] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:43 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 1286 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:44.833291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-09a91883-3a5b-43fc-a6b0-b64e934d5f17 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] Calling method '.version_select at 0x7f06be07f820>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:46.281639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-543e0359-8806-4a6a-89f7-5494eacc8586 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:20:46.282840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-543e0359-8806-4a6a-89f7-5494eacc8586 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:20:46.283555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-543e0359-8806-4a6a-89f7-5494eacc8586 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:20:46.284178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-543e0359-8806-4a6a-89f7-5494eacc8586 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:20:46.284852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-543e0359-8806-4a6a-89f7-5494eacc8586 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:20:46.301366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-543e0359-8806-4a6a-89f7-5494eacc8586 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:46.302214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-543e0359-8806-4a6a-89f7-5494eacc8586 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:46.303427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-543e0359-8806-4a6a-89f7-5494eacc8586 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:46.304109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-543e0359-8806-4a6a-89f7-5494eacc8586 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:46.338519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-543e0359-8806-4a6a-89f7-5494eacc8586 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Getting quotas for project e780b879f5f943468e72977a75ee807d. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:46.345812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-543e0359-8806-4a6a-89f7-5494eacc8586 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Getting quotas for user cace98c409cd464a93e2d98ff7d1a989 and project e780b879f5f943468e72977a75ee807d. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:46.375920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-543e0359-8806-4a6a-89f7-5494eacc8586 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:20:46.389519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-543e0359-8806-4a6a-89f7-5494eacc8586 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:20:46.492911 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-543e0359-8806-4a6a-89f7-5494eacc8586 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.104650 Jul 20 04:20:46.493560 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1106/2392] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:20:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:20:46.505162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-818ffed5-4ad0-4b1a-aa95-0d82ee09bdce tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be997790>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:46.611812 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-818ffed5-4ad0-4b1a-aa95-0d82ee09bdce tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1421 microversion: 2.1 time: 0.116313 Jul 20 04:20:46.612753 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1107/2393] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:46 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1421 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:46.636841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c0431129-053c-4c55-9cbf-f47b85a6b032 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:46.638666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c0431129-053c-4c55-9cbf-f47b85a6b032 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:46.679820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0431129-053c-4c55-9cbf-f47b85a6b032 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:46.680404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0431129-053c-4c55-9cbf-f47b85a6b032 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:46.681299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0431129-053c-4c55-9cbf-f47b85a6b032 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:46.681755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0431129-053c-4c55-9cbf-f47b85a6b032 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:47.006893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c0431129-053c-4c55-9cbf-f47b85a6b032 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:47.026770 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c0431129-053c-4c55-9cbf-f47b85a6b032 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 200 len: 1274 microversion: 2.1 time: 0.406325 Jul 20 04:20:47.031339 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1108/2394] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:46 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 1274 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:47.041235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b3455478-4013-42e4-84b7-14937e75466b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:47.044896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b3455478-4013-42e4-84b7-14937e75466b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:47.454635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b3455478-4013-42e4-84b7-14937e75466b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:47.465824 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b3455478-4013-42e4-84b7-14937e75466b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1214 microversion: 2.1 time: 0.432672 Jul 20 04:20:47.469801 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1109/2395] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:47 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1214 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:47.626456 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-868a40d6-22b8-48a9-a645-8b33e191975d tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be86bc10>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:47.706860 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-868a40d6-22b8-48a9-a645-8b33e191975d tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1421 microversion: 2.1 time: 0.084615 Jul 20 04:20:47.714741 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1110/2396] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:47 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1421 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:48.050613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eb726656-1b34-4592-a2b0-126905b65bdb tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:48.050716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eb726656-1b34-4592-a2b0-126905b65bdb tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:48.071555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb726656-1b34-4592-a2b0-126905b65bdb tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:48.072142 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb726656-1b34-4592-a2b0-126905b65bdb tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:48.073262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb726656-1b34-4592-a2b0-126905b65bdb tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:48.079305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb726656-1b34-4592-a2b0-126905b65bdb tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:48.593651 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-09a91883-3a5b-43fc-a6b0-b64e934d5f17 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/9ff47ebf-00c3-4d41-871a-90ae72097b02" status: 202 len: 0 microversion: 2.1 time: 3.767797 Jul 20 04:20:48.598513 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1287/2397] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:20:44 2022] DELETE /compute/v2.1/os-floating-ips/9ff47ebf-00c3-4d41-871a-90ae72097b02 => generated 0 bytes in 3770 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:20:48.610211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e649c49e-29d9-4c10-a598-9a194073787c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:48.610925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e649c49e-29d9-4c10-a598-9a194073787c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:48.631545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e649c49e-29d9-4c10-a598-9a194073787c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:48.632289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e649c49e-29d9-4c10-a598-9a194073787c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:48.633981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e649c49e-29d9-4c10-a598-9a194073787c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:48.635831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e649c49e-29d9-4c10-a598-9a194073787c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:48.912240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e649c49e-29d9-4c10-a598-9a194073787c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:48.927959 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e649c49e-29d9-4c10-a598-9a194073787c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1284 microversion: 2.1 time: 0.331728 Jul 20 04:20:48.936159 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1288/2398] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:48 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1284 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:48.942742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-45bc7ab5-773c-4898-8928-09757d4d9658 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] Calling method '.version_select at 0x7f06bdee6dc0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:49.037490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG neutronclient.v2_0.client [None req-45bc7ab5-773c-4898-8928-09757d4d9658 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9ff47ebf-00c3-4d41-871a-90ae72097b02 could not be found", "detail": ""}} {{(pid=127871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:20:49.038537 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-45bc7ab5-773c-4898-8928-09757d4d9658 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] HTTP exception thrown: Floating IP not found for ID 9ff47ebf-00c3-4d41-871a-90ae72097b02 Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-45bc7ab5-773c-4898-8928-09757d4d9658 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] Request method failure captured: Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/os-floating-ips/9ff47ebf-00c3-4d41-871a-90ae72097b02 HTTP/1.1 Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14KFcwUzDz8B9vrACL9kBRNPOopQp0EZBEg0km7eLpC3MZhLD2t3KJAoqED8xL35BZm4u-BwLERV_5D7B9p9bfTxRDGe2qZiM_sB6Jo-ZftCDmndNOC1VvvnKlrPu6pj-meGD_cncH7A96h-Qxokyt9VeuICPtvU-BN4TkY0fBUz2xY Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: e179cd6680e741949c54944453ff691a Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-FloatingIPsTestJSON-138054350 Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:20:49.041701 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:20:49.042974 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e179cd6680e741949c54944453ff691a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e179cd6680e741949c54944453ff691a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e179cd6680e741949c54944453ff691a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e179cd6680e741949c54944453ff691a"}]}] Jul 20 04:20:49.042974 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-FloatingIPsTestJSON-138054350 Jul 20 04:20:49.042974 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: e179cd6680e741949c54944453ff691a Jul 20 04:20:49.042974 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-FloatingIPsTestJSON-138054350 Jul 20 04:20:49.042974 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-FloatingIPsTestJSON-138054350-project Jul 20 04:20:49.042974 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:20:49.042974 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:20:49.042974 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c72b2eae00a3494186d463503441a3b1 Jul 20 04:20:49.042974 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-FloatingIPsTestJSON-138054350-project Jul 20 04:20:49.042974 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:20:49.042974 n-d-826526-5 devstack@n-api.service[127871]: exception: Floating IP not found for ID 9ff47ebf-00c3-4d41-871a-90ae72097b02 Jul 20 04:20:49.042974 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '9ff47ebf-00c3-4d41-871a-90ae72097b02'} Jul 20 04:20:49.042974 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:20:49.043776 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9ff47ebf-00c3-4d41-871a-90ae72097b02 could not be found Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ae90b24-92d3-4914-9fb8-a03091eacb60'] Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9ff47ebf-00c3-4d41-871a-90ae72097b02. Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.045062 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9ff47ebf-00c3-4d41-871a-90ae72097b02 Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:49.046217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:49.047346 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9ff47ebf-00c3-4d41-871a-90ae72097b02 Jul 20 04:20:49.047346 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.049241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-45bc7ab5-773c-4898-8928-09757d4d9658 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] Returning 404 to user: Floating IP not found for ID 9ff47ebf-00c3-4d41-871a-90ae72097b02 {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:49.050359 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-45bc7ab5-773c-4898-8928-09757d4d9658 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/9ff47ebf-00c3-4d41-871a-90ae72097b02" status: 404 len: 111 microversion: 2.1 time: 0.112788 Jul 20 04:20:49.051471 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1289/2399] 10.222.0.17 () {58 vars in 1259 bytes} [Wed Jul 20 04:20:48 2022] GET /compute/v2.1/os-floating-ips/9ff47ebf-00c3-4d41-871a-90ae72097b02 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:49.056306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f6ba82d0-6bc1-491f-9ffc-3004a64dea03 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06bdf22e50>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:49.149552 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f6ba82d0-6bc1-491f-9ffc-3004a64dea03 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1421 microversion: 2.1 time: 0.096771 Jul 20 04:20:49.150316 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1290/2400] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:49 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1421 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:49.173746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b744c2a2-d33d-4163-b857-8df9511c0b67 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] Calling method '.version_select at 0x7f06be071160>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:49.310644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eb726656-1b34-4592-a2b0-126905b65bdb tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:49.320504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG neutronclient.v2_0.client [None req-b744c2a2-d33d-4163-b857-8df9511c0b67 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9ff47ebf-00c3-4d41-871a-90ae72097b02 could not be found", "detail": ""}} {{(pid=127871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:20:49.321206 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-b744c2a2-d33d-4163-b857-8df9511c0b67 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] HTTP exception thrown: Floating IP not found for ID 9ff47ebf-00c3-4d41-871a-90ae72097b02 Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b744c2a2-d33d-4163-b857-8df9511c0b67 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] Request method failure captured: Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/os-floating-ips/9ff47ebf-00c3-4d41-871a-90ae72097b02 HTTP/1.1 Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14KFcwUzDz8B9vrACL9kBRNPOopQp0EZBEg0km7eLpC3MZhLD2t3KJAoqED8xL35BZm4u-BwLERV_5D7B9p9bfTxRDGe2qZiM_sB6Jo-ZftCDmndNOC1VvvnKlrPu6pj-meGD_cncH7A96h-Qxokyt9VeuICPtvU-BN4TkY0fBUz2xY Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: e179cd6680e741949c54944453ff691a Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-FloatingIPsTestJSON-138054350 Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:20:49.324205 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:20:49.325613 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e179cd6680e741949c54944453ff691a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e179cd6680e741949c54944453ff691a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e179cd6680e741949c54944453ff691a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e179cd6680e741949c54944453ff691a"}]}] Jul 20 04:20:49.325613 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-FloatingIPsTestJSON-138054350 Jul 20 04:20:49.325613 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: e179cd6680e741949c54944453ff691a Jul 20 04:20:49.325613 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-FloatingIPsTestJSON-138054350 Jul 20 04:20:49.325613 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-FloatingIPsTestJSON-138054350-project Jul 20 04:20:49.325613 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:20:49.325613 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:20:49.325613 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c72b2eae00a3494186d463503441a3b1 Jul 20 04:20:49.325613 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-FloatingIPsTestJSON-138054350-project Jul 20 04:20:49.325613 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:20:49.325613 n-d-826526-5 devstack@n-api.service[127871]: exception: Floating IP not found for ID 9ff47ebf-00c3-4d41-871a-90ae72097b02 Jul 20 04:20:49.325613 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '9ff47ebf-00c3-4d41-871a-90ae72097b02'} Jul 20 04:20:49.325613 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:20:49.326400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9ff47ebf-00c3-4d41-871a-90ae72097b02 could not be found Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b80c4cc5-d5a2-4f3b-9681-f05c9dc0781a'] Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9ff47ebf-00c3-4d41-871a-90ae72097b02. Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.327478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9ff47ebf-00c3-4d41-871a-90ae72097b02 Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:49.328709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:49.330548 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9ff47ebf-00c3-4d41-871a-90ae72097b02 Jul 20 04:20:49.330548 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.330548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b744c2a2-d33d-4163-b857-8df9511c0b67 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] Returning 404 to user: Floating IP not found for ID 9ff47ebf-00c3-4d41-871a-90ae72097b02 {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:49.330548 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b744c2a2-d33d-4163-b857-8df9511c0b67 tempest-FloatingIPsTestJSON-138054350 tempest-FloatingIPsTestJSON-138054350-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/9ff47ebf-00c3-4d41-871a-90ae72097b02" status: 404 len: 111 microversion: 2.1 time: 0.174028 Jul 20 04:20:49.330548 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1291/2401] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:20:49 2022] DELETE /compute/v2.1/os-floating-ips/9ff47ebf-00c3-4d41-871a-90ae72097b02 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:49.334955 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eb726656-1b34-4592-a2b0-126905b65bdb tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 200 len: 1316 microversion: 2.1 time: 1.291690 Jul 20 04:20:49.335922 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1111/2402] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:48 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 1316 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:49.951844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7c816afc-2cb1-4609-a9f7-76611eed4778 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:49.952608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7c816afc-2cb1-4609-a9f7-76611eed4778 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:49.964990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c816afc-2cb1-4609-a9f7-76611eed4778 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.967949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c816afc-2cb1-4609-a9f7-76611eed4778 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.968960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c816afc-2cb1-4609-a9f7-76611eed4778 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.970710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c816afc-2cb1-4609-a9f7-76611eed4778 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:50.088947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7c816afc-2cb1-4609-a9f7-76611eed4778 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:50.100110 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7c816afc-2cb1-4609-a9f7-76611eed4778 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1272 microversion: 2.1 time: 0.152884 Jul 20 04:20:50.112121 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1292/2403] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:49 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:50.176801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8360f08f-b3fd-42e9-8b39-5a96db096bd5 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be2df160>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:50.268117 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8360f08f-b3fd-42e9-8b39-5a96db096bd5 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1421 microversion: 2.1 time: 0.097620 Jul 20 04:20:50.276243 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1112/2404] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:50 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1421 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:50.353406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e83e6550-5525-4bc1-9978-111b128e8a9a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:50.354435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e83e6550-5525-4bc1-9978-111b128e8a9a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:50.368796 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e83e6550-5525-4bc1-9978-111b128e8a9a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:50.369550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e83e6550-5525-4bc1-9978-111b128e8a9a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:50.370573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e83e6550-5525-4bc1-9978-111b128e8a9a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:50.371210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e83e6550-5525-4bc1-9978-111b128e8a9a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:50.795891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e83e6550-5525-4bc1-9978-111b128e8a9a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:50.804993 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e83e6550-5525-4bc1-9978-111b128e8a9a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 200 len: 1316 microversion: 2.1 time: 0.456223 Jul 20 04:20:50.811639 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1293/2405] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:50 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 1316 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:51.118434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6aea3e97-f0b6-405b-8858-51e4ac326e88 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:51.119636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6aea3e97-f0b6-405b-8858-51e4ac326e88 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:51.133377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6aea3e97-f0b6-405b-8858-51e4ac326e88 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.134099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6aea3e97-f0b6-405b-8858-51e4ac326e88 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.137892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6aea3e97-f0b6-405b-8858-51e4ac326e88 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.138659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6aea3e97-f0b6-405b-8858-51e4ac326e88 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.229473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-4250476f-10b8-4de8-8829-6ccec5ec1ea8 req-782d74e5-e515-4420-9301-9354bc3b3b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c0981d-36c0-4e76-ab07-6e9e52a20635", "tag": "45c00b5a-4dbc-45f6-b538-6c0cd7abaa0e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:51.264106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4250476f-10b8-4de8-8829-6ccec5ec1ea8 req-782d74e5-e515-4420-9301-9354bc3b3b86 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.267693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4250476f-10b8-4de8-8829-6ccec5ec1ea8 req-782d74e5-e515-4420-9301-9354bc3b3b86 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.300161 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-4250476f-10b8-4de8-8829-6ccec5ec1ea8 req-782d74e5-e515-4420-9301-9354bc3b3b86 service nova] Creating event network-changed:45c00b5a-4dbc-45f6-b538-6c0cd7abaa0e for instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 on n-h1-826526-5 Jul 20 04:20:51.310999 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-4250476f-10b8-4de8-8829-6ccec5ec1ea8 req-782d74e5-e515-4420-9301-9354bc3b3b86 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084236 Jul 20 04:20:51.312725 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1294/2406] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:20:51.329551 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-509cc841-0ad8-473a-8fb9-5706cb21413e tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be4aa670>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:51.412526 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-509cc841-0ad8-473a-8fb9-5706cb21413e tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1421 microversion: 2.1 time: 0.098102 Jul 20 04:20:51.415260 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1295/2407] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:51 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1421 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:51.816018 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6aea3e97-f0b6-405b-8858-51e4ac326e88 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:51.828250 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6aea3e97-f0b6-405b-8858-51e4ac326e88 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1272 microversion: 2.1 time: 0.711432 Jul 20 04:20:51.829841 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1113/2408] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:51 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1272 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:51.847097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1378ad9a-ef48-4f95-a01f-b63ac7a8ea9f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:51.847909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1378ad9a-ef48-4f95-a01f-b63ac7a8ea9f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:51.860693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1378ad9a-ef48-4f95-a01f-b63ac7a8ea9f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.861154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1378ad9a-ef48-4f95-a01f-b63ac7a8ea9f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.862925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1378ad9a-ef48-4f95-a01f-b63ac7a8ea9f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.863376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1378ad9a-ef48-4f95-a01f-b63ac7a8ea9f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:52.395924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1378ad9a-ef48-4f95-a01f-b63ac7a8ea9f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:52.405388 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1378ad9a-ef48-4f95-a01f-b63ac7a8ea9f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 200 len: 1316 microversion: 2.1 time: 0.577915 Jul 20 04:20:52.415832 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1296/2409] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:51 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 1316 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:52.427749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c38fda97-5712-43e3-ac77-4f0c5d7cbe3e tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be2df4c0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:52.511528 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c38fda97-5712-43e3-ac77-4f0c5d7cbe3e tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1430 microversion: 2.1 time: 0.088136 Jul 20 04:20:52.511848 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1114/2410] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:52 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1430 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:52.523671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-014c4f02-e157-49bb-a366-9f8faf274333 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06c742fca0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:52.621102 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-014c4f02-e157-49bb-a366-9f8faf274333 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 200 len: 1430 microversion: 2.1 time: 0.101573 Jul 20 04:20:52.623835 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1297/2411] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:52 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 1430 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:52.640770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1c7ec709-3ee1-4506-9574-e847774e2bfa tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:52.641397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1c7ec709-3ee1-4506-9574-e847774e2bfa tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:52.666178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c7ec709-3ee1-4506-9574-e847774e2bfa tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:52.666639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c7ec709-3ee1-4506-9574-e847774e2bfa tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:52.671071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c7ec709-3ee1-4506-9574-e847774e2bfa tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:52.671594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c7ec709-3ee1-4506-9574-e847774e2bfa tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:52.846480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-28cd46cc-828f-44ac-8b87-1f1707a9e54c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:52.849894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-28cd46cc-828f-44ac-8b87-1f1707a9e54c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:52.856869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28cd46cc-828f-44ac-8b87-1f1707a9e54c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:52.857465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28cd46cc-828f-44ac-8b87-1f1707a9e54c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:52.858364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28cd46cc-828f-44ac-8b87-1f1707a9e54c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:52.859042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28cd46cc-828f-44ac-8b87-1f1707a9e54c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:53.047948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-28cd46cc-828f-44ac-8b87-1f1707a9e54c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:53.063121 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-28cd46cc-828f-44ac-8b87-1f1707a9e54c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1272 microversion: 2.1 time: 0.220352 Jul 20 04:20:53.065246 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1298/2412] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:52 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:53.422939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d6fa0095-92e1-438c-b459-257ee5bcd613 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:53.423578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d6fa0095-92e1-438c-b459-257ee5bcd613 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:53.435991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:53.438053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6fa0095-92e1-438c-b459-257ee5bcd613 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:53.438645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6fa0095-92e1-438c-b459-257ee5bcd613 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:53.441890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6fa0095-92e1-438c-b459-257ee5bcd613 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:53.442500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6fa0095-92e1-438c-b459-257ee5bcd613 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:53.494815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=14 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:54.639591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d6fa0095-92e1-438c-b459-257ee5bcd613 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:54.647750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1c7ec709-3ee1-4506-9574-e847774e2bfa tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:54.659878 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1c7ec709-3ee1-4506-9574-e847774e2bfa tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1466 microversion: 2.1 time: 2.028741 Jul 20 04:20:54.663021 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d6fa0095-92e1-438c-b459-257ee5bcd613 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 200 len: 1316 microversion: 2.1 time: 1.243978 Jul 20 04:20:54.673244 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1115/2413] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:52 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1466 bytes in 2043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:54.677198 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1299/2414] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:53 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 1316 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:54.683337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-87b9bd05-5674-40d4-8038-e40f4a4bbc56 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:54.684246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-87b9bd05-5674-40d4-8038-e40f4a4bbc56 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:54.691758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7fe7723c-d592-4a6e-a103-97763661f6d6 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06bdcda820>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:54.697228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87b9bd05-5674-40d4-8038-e40f4a4bbc56 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:54.700143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87b9bd05-5674-40d4-8038-e40f4a4bbc56 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:54.705584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87b9bd05-5674-40d4-8038-e40f4a4bbc56 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:54.706264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87b9bd05-5674-40d4-8038-e40f4a4bbc56 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:54.785107 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7fe7723c-d592-4a6e-a103-97763661f6d6 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/dd295612-2ec2-458d-9fdf-8704437a5c0b" status: 200 len: 784 microversion: 2.1 time: 0.104522 Jul 20 04:20:54.795507 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1300/2415] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:54 2022] GET /compute/v2.1/images/dd295612-2ec2-458d-9fdf-8704437a5c0b => generated 784 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:54.822188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3ed3ce55-f205-4236-b996-8c26547771f2 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:54.833913 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3ed3ce55-f205-4236-b996-8c26547771f2 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035886 Jul 20 04:20:54.840876 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1301/2416] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:20:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:54.846253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-94847b64-a029-4b66-bb47-625c7506f2c7 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be09ac10>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:55.308704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-87b9bd05-5674-40d4-8038-e40f4a4bbc56 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:55.325797 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-87b9bd05-5674-40d4-8038-e40f4a4bbc56 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1272 microversion: 2.1 time: 0.651020 Jul 20 04:20:55.326422 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1116/2417] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:54 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1272 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:55.685243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e43ff742-ace4-48e7-84de-eebc7d65613f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:55.686984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e43ff742-ace4-48e7-84de-eebc7d65613f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:55.707934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e43ff742-ace4-48e7-84de-eebc7d65613f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:55.708872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e43ff742-ace4-48e7-84de-eebc7d65613f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:55.711251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e43ff742-ace4-48e7-84de-eebc7d65613f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:55.714159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e43ff742-ace4-48e7-84de-eebc7d65613f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:55.921459 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-94847b64-a029-4b66-bb47-625c7506f2c7 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "DELETE /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 204 len: 0 microversion: 2.1 time: 1.079268 Jul 20 04:20:55.922798 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1302/2418] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:54 2022] DELETE /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 0 bytes in 1081 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:55.933342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0aef8333-d15e-4f06-a850-5d3766d121e2 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be5a7700>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:55.983858 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-0aef8333-d15e-4f06-a850-5d3766d121e2 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] HTTP exception thrown: Image not found. Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0aef8333-d15e-4f06-a850-5d3766d121e2 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Request method failure captured: Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 HTTP/1.1 Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Jqjep9Tgv-ixep_e_5DOyJvgMJbqB_43o0Bd8u6QwZsUO1pLaUEiHDKiUnVmcNkmDg6mNc9alRhXiKXDcort_2eibP9JXV1s1RK-CRS7h1JXU22kp-U5zyBWlb68nOKoDRBRHNl0sD819nHDvufMrlmhobsuymfH-2QNcVU-qHaNk Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: d883ef732fba496db095a9ba2202a304 Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesOneServerTestJSON-939634403 Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:20:55.986259 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:20:55.987851 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d883ef732fba496db095a9ba2202a304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d883ef732fba496db095a9ba2202a304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d883ef732fba496db095a9ba2202a304", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d883ef732fba496db095a9ba2202a304"}]}] Jul 20 04:20:55.987851 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesOneServerTestJSON-939634403 Jul 20 04:20:55.987851 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: d883ef732fba496db095a9ba2202a304 Jul 20 04:20:55.987851 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-939634403 Jul 20 04:20:55.987851 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesOneServerTestJSON-939634403-project Jul 20 04:20:55.987851 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:20:55.987851 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:20:55.987851 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: b3d729a66b42428cb90920e80d8a06ce Jul 20 04:20:55.987851 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesOneServerTestJSON-939634403-project Jul 20 04:20:55.987851 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:20:55.987851 n-d-826526-5 devstack@n-api.service[127871]: exception: Image not found. Jul 20 04:20:55.987851 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '31ffe742-de5b-47cc-bb36-266dbe2929b3'} Jul 20 04:20:55.987851 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:55.987851 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:55.989012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:20:55.989012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:20:55.989012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:20:55.989012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:20:55.989012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:20:55.989012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:20:55.989012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:20:55.989012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:20:55.989012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:20:55.989012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:20:55.989012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:20:55.989012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:20:55.989012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:20:55.989012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:20:55.989012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:20:55.989012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:20:55.989012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 31ffe742-de5b-47cc-bb36-266dbe2929b3 Jul 20 04:20:55.989012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:20:55.990269 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 31ffe742-de5b-47cc-bb36-266dbe2929b3 could not be found. Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:55.991645 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:55.993128 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:55.993128 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:55.993128 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 04:20:55.993128 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:20:55.993128 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:20:55.993128 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:55.993128 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:55.993128 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:55.993128 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:55.993128 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:55.993128 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:55.993128 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:55.993128 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:55.993128 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:20:55.993128 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:20:55.997688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0aef8333-d15e-4f06-a850-5d3766d121e2 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Returning 404 to user: Image not found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:56.000145 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0aef8333-d15e-4f06-a850-5d3766d121e2 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 404 len: 62 microversion: 2.1 time: 0.072013 Jul 20 04:20:56.010597 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1303/2419] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:55 2022] GET /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:20:56.024538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-26e82263-9234-4a84-b2bd-0880dcd80c1c tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-240803570"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:56.025999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-26e82263-9234-4a84-b2bd-0880dcd80c1c tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:56.037054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26e82263-9234-4a84-b2bd-0880dcd80c1c tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:56.037755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26e82263-9234-4a84-b2bd-0880dcd80c1c tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:56.038748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26e82263-9234-4a84-b2bd-0880dcd80c1c tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:56.039341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26e82263-9234-4a84-b2bd-0880dcd80c1c tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:56.314490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:56.413211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e43ff742-ace4-48e7-84de-eebc7d65613f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:56.434776 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e43ff742-ace4-48e7-84de-eebc7d65613f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 200 len: 1316 microversion: 2.1 time: 0.753122 Jul 20 04:20:56.450336 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1117/2420] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:55 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 1316 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:56.463983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-3aace9cf-31df-4a9d-bd73-23ab4d5c3e9c req-3be0fe61-910f-4844-84e5-f33712de339b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1be9b8-b9ff-40ea-a63a-d01d38a96102", "name": "network-vif-unplugged", "status": "completed", "tag": "f6cbea3d-636a-48f6-a62e-de1624ae8f8b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:56.474024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-3aace9cf-31df-4a9d-bd73-23ab4d5c3e9c req-3be0fe61-910f-4844-84e5-f33712de339b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:56.474765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-3aace9cf-31df-4a9d-bd73-23ab4d5c3e9c req-3be0fe61-910f-4844-84e5-f33712de339b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:56.489890 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-3aace9cf-31df-4a9d-bd73-23ab4d5c3e9c req-3be0fe61-910f-4844-84e5-f33712de339b service nova] Creating event network-vif-unplugged:f6cbea3d-636a-48f6-a62e-de1624ae8f8b for instance ff1be9b8-b9ff-40ea-a63a-d01d38a96102 on n-h2-826526-5 Jul 20 04:20:56.498348 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-3aace9cf-31df-4a9d-bd73-23ab4d5c3e9c req-3be0fe61-910f-4844-84e5-f33712de339b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044754 Jul 20 04:20:56.499844 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1118/2421] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:56.510447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b13aa0ff-137c-4530-94f8-d4fd38a8165d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:56.511579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b13aa0ff-137c-4530-94f8-d4fd38a8165d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:56.518583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b13aa0ff-137c-4530-94f8-d4fd38a8165d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:56.519316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b13aa0ff-137c-4530-94f8-d4fd38a8165d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:56.520609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b13aa0ff-137c-4530-94f8-d4fd38a8165d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:56.521675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b13aa0ff-137c-4530-94f8-d4fd38a8165d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:56.666099 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-26e82263-9234-4a84-b2bd-0880dcd80c1c tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "POST /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102/action" status: 202 len: 0 microversion: 2.1 time: 0.645340 Jul 20 04:20:56.667348 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1304/2422] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:20:56 2022] POST /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102/action => generated 0 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:20:56.707093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ce51f875-d18b-4e57-9025-211a56f0c6bf tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be5aaca0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:56.833583 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ce51f875-d18b-4e57-9025-211a56f0c6bf tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.137411 Jul 20 04:20:56.834440 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1305/2423] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:56 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:57.462409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0ff7248b-21fc-4455-be03-3453e90afa5e tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:57.464710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:57.472533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0ff7248b-21fc-4455-be03-3453e90afa5e tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:57.490650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ff7248b-21fc-4455-be03-3453e90afa5e tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:57.496841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ff7248b-21fc-4455-be03-3453e90afa5e tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:57.497914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ff7248b-21fc-4455-be03-3453e90afa5e tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:57.498380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ff7248b-21fc-4455-be03-3453e90afa5e tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:57.958864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0ff7248b-21fc-4455-be03-3453e90afa5e tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:57.972023 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0ff7248b-21fc-4455-be03-3453e90afa5e tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 200 len: 1316 microversion: 2.1 time: 0.515879 Jul 20 04:20:57.973217 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1306/2424] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:57 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 1316 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:57.986939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-93065545-27c1-46d2-83bc-206031d02c82 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06bda67430>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:58.075426 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-93065545-27c1-46d2-83bc-206031d02c82 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.100879 Jul 20 04:20:58.078436 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1307/2425] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:57 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:58.218978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7a07cd91-a947-4205-819c-8fc4b0eca777 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Action: 'create', calling method: .version_select at 0x7f06be2c6940>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-211104576", "policies": ["affinity"]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:58.252514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-7a07cd91-a947-4205-819c-8fc4b0eca777 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:58.274883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-7a07cd91-a947-4205-819c-8fc4b0eca777 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for user f13c4ff6d8814e0b86c6e5be78d80300 and project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:58.399121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-7a07cd91-a947-4205-819c-8fc4b0eca777 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:58.424997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-7a07cd91-a947-4205-819c-8fc4b0eca777 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for user f13c4ff6d8814e0b86c6e5be78d80300 and project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:58.463721 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7a07cd91-a947-4205-819c-8fc4b0eca777 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.344801 Jul 20 04:20:58.470274 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1308/2426] 10.222.0.17 () {60 vars in 1173 bytes} [Wed Jul 20 04:20:58 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:20:58.486241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-493f2742-82fb-4184-b7f4-499d83fbb077 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Action: 'create', calling method: .version_select at 0x7f06be337940>, body: {"server_group": {"name": "tempest-server-group-380369180", "policies": ["affinity"]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:58.522729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-493f2742-82fb-4184-b7f4-499d83fbb077 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:58.528486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-493f2742-82fb-4184-b7f4-499d83fbb077 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for user f13c4ff6d8814e0b86c6e5be78d80300 and project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:58.568731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:58.592937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-493f2742-82fb-4184-b7f4-499d83fbb077 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:58.602451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-493f2742-82fb-4184-b7f4-499d83fbb077 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for user f13c4ff6d8814e0b86c6e5be78d80300 and project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:58.622561 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-493f2742-82fb-4184-b7f4-499d83fbb077 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.150889 Jul 20 04:20:58.632855 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1309/2427] 10.222.0.17 () {60 vars in 1172 bytes} [Wed Jul 20 04:20:58 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:58.638231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cb0c1a98-1569-4d20-8793-67dc316e5142 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Action: 'create', calling method: .version_select at 0x7f06be09a8b0>, body: {"server_group": {"name": "tempest-server-group-380369180", "policies": ["affinity"]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:58.685136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-cb0c1a98-1569-4d20-8793-67dc316e5142 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:58.701335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-cb0c1a98-1569-4d20-8793-67dc316e5142 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for user f13c4ff6d8814e0b86c6e5be78d80300 and project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:58.794725 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b13aa0ff-137c-4530-94f8-d4fd38a8165d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:58.820898 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b13aa0ff-137c-4530-94f8-d4fd38a8165d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1314 microversion: 2.1 time: 2.318784 Jul 20 04:20:58.825629 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1119/2428] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:56 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1314 bytes in 2325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:58.846613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-cb0c1a98-1569-4d20-8793-67dc316e5142 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:58.866075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-cb0c1a98-1569-4d20-8793-67dc316e5142 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for user f13c4ff6d8814e0b86c6e5be78d80300 and project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:58.904923 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cb0c1a98-1569-4d20-8793-67dc316e5142 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.270601 Jul 20 04:20:58.911097 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1310/2429] 10.222.0.17 () {60 vars in 1172 bytes} [Wed Jul 20 04:20:58 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:58.922768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-09b3d03b-6bc6-4574-af0b-46fae46d6712 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:58.972108 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-09b3d03b-6bc6-4574-af0b-46fae46d6712 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/143b51c9-0eb7-4616-9443-b38ba7fab9cf" status: 204 len: 0 microversion: 2.1 time: 0.054400 Jul 20 04:20:58.973654 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1120/2430] 10.222.0.17 () {58 vars in 1265 bytes} [Wed Jul 20 04:20:58 2022] DELETE /compute/v2.1/os-server-groups/143b51c9-0eb7-4616-9443-b38ba7fab9cf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:58.982825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c9490b2c-bc4b-44fb-aa14-4f9f13336be9 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:59.002436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-76c6a36a-1c42-4761-80ae-fccceded4f95 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:59.003671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-76c6a36a-1c42-4761-80ae-fccceded4f95 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:59.012545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76c6a36a-1c42-4761-80ae-fccceded4f95 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:59.013453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76c6a36a-1c42-4761-80ae-fccceded4f95 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:59.016316 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c9490b2c-bc4b-44fb-aa14-4f9f13336be9 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.037403 Jul 20 04:20:59.016605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76c6a36a-1c42-4761-80ae-fccceded4f95 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:59.017291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76c6a36a-1c42-4761-80ae-fccceded4f95 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:59.032088 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1311/2431] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:20:58 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:20:59.039434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d1590387-eab8-4ccd-a40b-ee460ac8c788 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:59.109654 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d1590387-eab8-4ccd-a40b-ee460ac8c788 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/6b61f769-d267-4854-83f5-a17288edbd6e" status: 204 len: 0 microversion: 2.1 time: 0.074214 Jul 20 04:20:59.110628 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1312/2432] 10.222.0.17 () {58 vars in 1265 bytes} [Wed Jul 20 04:20:59 2022] DELETE /compute/v2.1/os-server-groups/6b61f769-d267-4854-83f5-a17288edbd6e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:20:59.119115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-76ea9650-69d5-439e-96ac-200ed9a1fc75 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06bdee6280>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:59.198527 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-76ea9650-69d5-439e-96ac-200ed9a1fc75 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.083584 Jul 20 04:20:59.202137 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1313/2433] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:59 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:59.211862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-87cedca1-7438-4def-a7a0-3b185fc95545 req-336a39eb-dfe9-49f4-8802-7b89dd3e2e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c0981d-36c0-4e76-ab07-6e9e52a20635", "name": "network-vif-plugged", "status": "completed", "tag": "45c00b5a-4dbc-45f6-b538-6c0cd7abaa0e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:59.232514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-87cedca1-7438-4def-a7a0-3b185fc95545 req-336a39eb-dfe9-49f4-8802-7b89dd3e2e1f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:59.232514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-87cedca1-7438-4def-a7a0-3b185fc95545 req-336a39eb-dfe9-49f4-8802-7b89dd3e2e1f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:59.267757 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-87cedca1-7438-4def-a7a0-3b185fc95545 req-336a39eb-dfe9-49f4-8802-7b89dd3e2e1f service nova] Creating event network-vif-plugged:45c00b5a-4dbc-45f6-b538-6c0cd7abaa0e for instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 on n-h1-826526-5 Jul 20 04:20:59.279043 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-87cedca1-7438-4def-a7a0-3b185fc95545 req-336a39eb-dfe9-49f4-8802-7b89dd3e2e1f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074835 Jul 20 04:20:59.279716 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1314/2434] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:59.288908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-221c572e-9d25-4a52-af36-451a2a8e4626 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:59.315470 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-221c572e-9d25-4a52-af36-451a2a8e4626 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.028915 Jul 20 04:20:59.316325 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1315/2435] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:20:59 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:59.330287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-32cb5448-c039-4f9c-b1c8-91f2b7e6d02e tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Action: 'create', calling method: .version_select at 0x7f06bdee6940>, body: {"server_group": {"name": "tempest-server-group-919359170", "policies": ["affinity"]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:59.378096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-32cb5448-c039-4f9c-b1c8-91f2b7e6d02e tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:59.395379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-32cb5448-c039-4f9c-b1c8-91f2b7e6d02e tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for user f13c4ff6d8814e0b86c6e5be78d80300 and project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:59.519629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-32cb5448-c039-4f9c-b1c8-91f2b7e6d02e tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:59.531003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-32cb5448-c039-4f9c-b1c8-91f2b7e6d02e tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for user f13c4ff6d8814e0b86c6e5be78d80300 and project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:59.562894 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-32cb5448-c039-4f9c-b1c8-91f2b7e6d02e tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.239419 Jul 20 04:20:59.563943 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1316/2436] 10.222.0.17 () {60 vars in 1172 bytes} [Wed Jul 20 04:20:59 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:59.577427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4e200dc4-c4a8-4f35-91df-ae3a8bd2aad5 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:59.621606 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4e200dc4-c4a8-4f35-91df-ae3a8bd2aad5 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/12c3d0da-38eb-4df1-8e47-bc48d403be68" status: 204 len: 0 microversion: 2.1 time: 0.049970 Jul 20 04:20:59.625672 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1317/2437] 10.222.0.17 () {58 vars in 1265 bytes} [Wed Jul 20 04:20:59 2022] DELETE /compute/v2.1/os-server-groups/12c3d0da-38eb-4df1-8e47-bc48d403be68 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:59.637756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2b3af13c-016b-4344-9f70-187f063d9796 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:59.665663 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2b3af13c-016b-4344-9f70-187f063d9796 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.038612 Jul 20 04:20:59.672344 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1318/2438] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:20:59 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:59.679141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5a1a154c-0c2b-4ab6-a7e2-b4c6c09a154d tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Action: 'create', calling method: .version_select at 0x7f06be6db940>, body: {"server_group": {"name": "tempest-server-group-1263002343", "policies": ["anti-affinity"]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:59.710149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-5a1a154c-0c2b-4ab6-a7e2-b4c6c09a154d tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:59.718259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-5a1a154c-0c2b-4ab6-a7e2-b4c6c09a154d tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for user f13c4ff6d8814e0b86c6e5be78d80300 and project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:59.734420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:59.776599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-5a1a154c-0c2b-4ab6-a7e2-b4c6c09a154d tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:59.803495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-5a1a154c-0c2b-4ab6-a7e2-b4c6c09a154d tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for user f13c4ff6d8814e0b86c6e5be78d80300 and project f8e6196788984b23be749aa5dd384673. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:59.838758 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5a1a154c-0c2b-4ab6-a7e2-b4c6c09a154d tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.164913 Jul 20 04:20:59.848209 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1319/2439] 10.222.0.17 () {60 vars in 1172 bytes} [Wed Jul 20 04:20:59 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:59.864428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-733e3252-9515-464f-9713-22d1c18f85f5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:59.865208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-733e3252-9515-464f-9713-22d1c18f85f5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:59.879353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-733e3252-9515-464f-9713-22d1c18f85f5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:59.880180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-733e3252-9515-464f-9713-22d1c18f85f5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:59.881495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-733e3252-9515-464f-9713-22d1c18f85f5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:59.882087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-733e3252-9515-464f-9713-22d1c18f85f5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:00.249095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-733e3252-9515-464f-9713-22d1c18f85f5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:00.262813 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-733e3252-9515-464f-9713-22d1c18f85f5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1314 microversion: 2.1 time: 0.409508 Jul 20 04:21:00.272573 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1320/2440] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:59 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:00.283725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-09ad28d2-fca7-4c0a-9f6b-2c27fa54212a tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:00.350312 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-09ad28d2-fca7-4c0a-9f6b-2c27fa54212a tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/381b2f0b-7f53-420e-8d62-1b54fe129f94" status: 204 len: 0 microversion: 2.1 time: 0.072638 Jul 20 04:21:00.351381 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1321/2441] 10.222.0.17 () {58 vars in 1265 bytes} [Wed Jul 20 04:21:00 2022] DELETE /compute/v2.1/os-server-groups/381b2f0b-7f53-420e-8d62-1b54fe129f94 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:21:00.361285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d5d90f4e-1891-47c2-9367-8b9096963e05 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06bdf92430>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:00.513451 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d5d90f4e-1891-47c2-9367-8b9096963e05 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.159374 Jul 20 04:21:00.514615 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1322/2442] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:00 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:00.522561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a33ee581-b1b4-4262-ac71-acf08bf94166 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:00.549788 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a33ee581-b1b4-4262-ac71-acf08bf94166 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.032391 Jul 20 04:21:00.550384 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1323/2443] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:21:00 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:00.718072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1683702883", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "9d8e0db5-e986-47e5-9bc9-b337f7ca146e"}]}, "os:scheduler_hints": {"group": "b0b195da-a2a2-4a34-be15-76e508e84229"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:00.875359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] validate_networks() for [('9d8e0db5-e986-47e5-9bc9-b337f7ca146e', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:21:02.205570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-76c6a36a-1c42-4761-80ae-fccceded4f95 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:02.217361 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-76c6a36a-1c42-4761-80ae-fccceded4f95 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 200 len: 1316 microversion: 2.1 time: 3.225572 Jul 20 04:21:02.221429 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1121/2444] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:58 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 1316 bytes in 3229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:02.231776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ba0c5868-2af0-4144-af2e-e6f80939e412 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:02.232766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ba0c5868-2af0-4144-af2e-e6f80939e412 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:02.241860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba0c5868-2af0-4144-af2e-e6f80939e412 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:02.242667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba0c5868-2af0-4144-af2e-e6f80939e412 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:02.243674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba0c5868-2af0-4144-af2e-e6f80939e412 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:02.244481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba0c5868-2af0-4144-af2e-e6f80939e412 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:02.551738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:02.552943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:02.553665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:02.554236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:02.554995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:02.623031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:02.625716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:02.641104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:02.641772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:02.666275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:02.708435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for project f8e6196788984b23be749aa5dd384673. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:02.720747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for user f13c4ff6d8814e0b86c6e5be78d80300 and project f8e6196788984b23be749aa5dd384673. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:02.743095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:21:02.745999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:02.853457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for project f8e6196788984b23be749aa5dd384673. Resources: {'server_group_members'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:02.860676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for user f13c4ff6d8814e0b86c6e5be78d80300 and project f8e6196788984b23be749aa5dd384673. Resources: {'server_group_members'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:02.913253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for project f8e6196788984b23be749aa5dd384673. Resources: {'server_group_members'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:02.920438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Getting quotas for user f13c4ff6d8814e0b86c6e5be78d80300 and project f8e6196788984b23be749aa5dd384673. Resources: {'server_group_members'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:02.958074 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c4acb14e-74d9-4420-b136-4d34a00d7a98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.252455 Jul 20 04:21:02.964582 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1324/2445] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:21:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:21:02.978344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b6251fce-99bc-4949-9c28-60c21a0d7028 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be09ad30>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:03.115436 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b6251fce-99bc-4949-9c28-60c21a0d7028 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.146447 Jul 20 04:21:03.116239 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1325/2446] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:02 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:03.145439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-557a3223-7975-4405-aeed-b86804aa87ad req-f956e5f5-9334-4f31-82aa-0278fae9d968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1be9b8-b9ff-40ea-a63a-d01d38a96102", "name": "network-vif-plugged", "status": "completed", "tag": "f6cbea3d-636a-48f6-a62e-de1624ae8f8b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:03.174667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-557a3223-7975-4405-aeed-b86804aa87ad req-f956e5f5-9334-4f31-82aa-0278fae9d968 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:03.175115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-557a3223-7975-4405-aeed-b86804aa87ad req-f956e5f5-9334-4f31-82aa-0278fae9d968 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:03.213292 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-557a3223-7975-4405-aeed-b86804aa87ad req-f956e5f5-9334-4f31-82aa-0278fae9d968 service nova] Creating event network-vif-plugged:f6cbea3d-636a-48f6-a62e-de1624ae8f8b for instance ff1be9b8-b9ff-40ea-a63a-d01d38a96102 on n-h2-826526-5 Jul 20 04:21:03.227144 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-557a3223-7975-4405-aeed-b86804aa87ad req-f956e5f5-9334-4f31-82aa-0278fae9d968 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091949 Jul 20 04:21:03.229861 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1326/2447] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:03.241795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e10c89e3-7ecf-4a7b-a235-7e0ec5bbb7ea tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:03.242521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e10c89e3-7ecf-4a7b-a235-7e0ec5bbb7ea tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:03.352605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e10c89e3-7ecf-4a7b-a235-7e0ec5bbb7ea tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:03.359569 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e10c89e3-7ecf-4a7b-a235-7e0ec5bbb7ea tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1213 microversion: 2.1 time: 0.128006 Jul 20 04:21:03.362198 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1327/2448] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:03 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1213 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:03.396411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-78fbbc08-d5b7-4cb1-8b9e-94b4f9a7cac9 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:03.397072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-78fbbc08-d5b7-4cb1-8b9e-94b4f9a7cac9 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:03.404880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78fbbc08-d5b7-4cb1-8b9e-94b4f9a7cac9 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:03.405272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78fbbc08-d5b7-4cb1-8b9e-94b4f9a7cac9 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:03.406544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78fbbc08-d5b7-4cb1-8b9e-94b4f9a7cac9 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:03.407321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78fbbc08-d5b7-4cb1-8b9e-94b4f9a7cac9 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:03.662848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ba0c5868-2af0-4144-af2e-e6f80939e412 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:03.682079 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ba0c5868-2af0-4144-af2e-e6f80939e412 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1314 microversion: 2.1 time: 1.458239 Jul 20 04:21:03.685900 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1122/2449] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:02 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1314 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:03.708815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-78fbbc08-d5b7-4cb1-8b9e-94b4f9a7cac9 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:03.719770 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-78fbbc08-d5b7-4cb1-8b9e-94b4f9a7cac9 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 200 len: 1504 microversion: 2.1 time: 0.346409 Jul 20 04:21:03.721251 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1328/2450] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:03 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:03.739131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-52292b3a-726f-4916-9d3f-89ed61936b31 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1882606480"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:03.739831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-52292b3a-726f-4916-9d3f-89ed61936b31 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:03.766732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52292b3a-726f-4916-9d3f-89ed61936b31 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:03.767216 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52292b3a-726f-4916-9d3f-89ed61936b31 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:03.768320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52292b3a-726f-4916-9d3f-89ed61936b31 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:03.768812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52292b3a-726f-4916-9d3f-89ed61936b31 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.129320 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7bb129bf-d516-411c-ade8-8a27e989aa4a tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be09a790>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:04.216662 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7bb129bf-d516-411c-ade8-8a27e989aa4a tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.091231 Jul 20 04:21:04.222282 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1329/2451] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:04 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:04.379674 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c93c189c-fb99-487f-8235-46b2282c7b98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:04.380396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c93c189c-fb99-487f-8235-46b2282c7b98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:04.416987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c93c189c-fb99-487f-8235-46b2282c7b98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.417722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c93c189c-fb99-487f-8235-46b2282c7b98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.419797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c93c189c-fb99-487f-8235-46b2282c7b98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.420438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c93c189c-fb99-487f-8235-46b2282c7b98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.528229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c93c189c-fb99-487f-8235-46b2282c7b98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:04.542301 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c93c189c-fb99-487f-8235-46b2282c7b98 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1265 microversion: 2.1 time: 0.167218 Jul 20 04:21:04.548548 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1330/2452] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:04 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:04.702687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5f89fc90-dcef-4bbd-878e-ba5eaa6e6f9a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:04.703404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5f89fc90-dcef-4bbd-878e-ba5eaa6e6f9a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:04.722652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f89fc90-dcef-4bbd-878e-ba5eaa6e6f9a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.729894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f89fc90-dcef-4bbd-878e-ba5eaa6e6f9a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.732702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f89fc90-dcef-4bbd-878e-ba5eaa6e6f9a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.733632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f89fc90-dcef-4bbd-878e-ba5eaa6e6f9a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:05.087704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5f89fc90-dcef-4bbd-878e-ba5eaa6e6f9a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:05.097110 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5f89fc90-dcef-4bbd-878e-ba5eaa6e6f9a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1314 microversion: 2.1 time: 0.398352 Jul 20 04:21:05.098586 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1331/2453] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:04 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:05.147504 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.network.security_group_api [None req-52292b3a-726f-4916-9d3f-89ed61936b31 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Adding security group d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 to port 45c00b5a-4dbc-45f6-b538-6c0cd7abaa0e Jul 20 04:21:05.229871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-25642fcb-e116-4e04-99df-f52d3249a8ae tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06bdd5b790>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:05.320156 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-25642fcb-e116-4e04-99df-f52d3249a8ae tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.094247 Jul 20 04:21:05.323405 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1332/2454] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:05 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:05.434104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-2ec65c21-a857-42c8-b73e-78762da91bb4 req-6ddee746-1ba2-4b3b-b90a-9e9b3838185a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b80cc2-a403-42e3-a623-aa5896d360e9", "tag": "8266a16e-2ac7-4af1-a58a-e921890fc926"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:05.472910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-2ec65c21-a857-42c8-b73e-78762da91bb4 req-6ddee746-1ba2-4b3b-b90a-9e9b3838185a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:05.479496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-2ec65c21-a857-42c8-b73e-78762da91bb4 req-6ddee746-1ba2-4b3b-b90a-9e9b3838185a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:05.499191 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-2ec65c21-a857-42c8-b73e-78762da91bb4 req-6ddee746-1ba2-4b3b-b90a-9e9b3838185a service nova] Creating event network-changed:8266a16e-2ac7-4af1-a58a-e921890fc926 for instance 62b80cc2-a403-42e3-a623-aa5896d360e9 on n-h2-826526-5 Jul 20 04:21:05.522321 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-2ec65c21-a857-42c8-b73e-78762da91bb4 req-6ddee746-1ba2-4b3b-b90a-9e9b3838185a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091555 Jul 20 04:21:05.525944 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1333/2455] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:05.564127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2e42b489-cf8c-4efc-99b1-9ebe2967d1d9 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:05.565067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2e42b489-cf8c-4efc-99b1-9ebe2967d1d9 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:05.572577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e42b489-cf8c-4efc-99b1-9ebe2967d1d9 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:05.579444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e42b489-cf8c-4efc-99b1-9ebe2967d1d9 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:05.580554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e42b489-cf8c-4efc-99b1-9ebe2967d1d9 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:05.585695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e42b489-cf8c-4efc-99b1-9ebe2967d1d9 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:05.770319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2e42b489-cf8c-4efc-99b1-9ebe2967d1d9 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:05.783839 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2e42b489-cf8c-4efc-99b1-9ebe2967d1d9 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1271 microversion: 2.1 time: 0.223881 Jul 20 04:21:05.796104 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1334/2456] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:05 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1271 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:06.115521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d2c5e0ba-7e4d-46ac-b996-8b58b73135ab tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:06.116172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d2c5e0ba-7e4d-46ac-b996-8b58b73135ab tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:06.124649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2c5e0ba-7e4d-46ac-b996-8b58b73135ab tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.136617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2c5e0ba-7e4d-46ac-b996-8b58b73135ab tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.137730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2c5e0ba-7e4d-46ac-b996-8b58b73135ab tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.139259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2c5e0ba-7e4d-46ac-b996-8b58b73135ab tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.480417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d2c5e0ba-7e4d-46ac-b996-8b58b73135ab tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:06.490087 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d2c5e0ba-7e4d-46ac-b996-8b58b73135ab tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1314 microversion: 2.1 time: 0.378842 Jul 20 04:21:06.501100 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1335/2457] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:06 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:06.506800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-95b6587b-55f0-4549-acae-21e7f3dfa34e tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06bdf92e50>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:06.654674 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-95b6587b-55f0-4549-acae-21e7f3dfa34e tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.151786 Jul 20 04:21:06.660497 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1336/2458] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:06 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:06.802267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1a1eff70-b001-4d79-bd85-0d4d1de77458 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:06.802922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1a1eff70-b001-4d79-bd85-0d4d1de77458 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:06.817753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1a1eff70-b001-4d79-bd85-0d4d1de77458 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.818215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1a1eff70-b001-4d79-bd85-0d4d1de77458 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.819011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1a1eff70-b001-4d79-bd85-0d4d1de77458 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.819450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1a1eff70-b001-4d79-bd85-0d4d1de77458 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.983638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1a1eff70-b001-4d79-bd85-0d4d1de77458 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:06.995923 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1a1eff70-b001-4d79-bd85-0d4d1de77458 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1271 microversion: 2.1 time: 0.196921 Jul 20 04:21:07.001551 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1337/2459] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:06 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1271 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:07.507606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-573f5cda-79d1-4cc2-9008-e8d7241145d5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:07.509756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-573f5cda-79d1-4cc2-9008-e8d7241145d5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:07.521227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-573f5cda-79d1-4cc2-9008-e8d7241145d5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.524473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-573f5cda-79d1-4cc2-9008-e8d7241145d5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:07.529412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-573f5cda-79d1-4cc2-9008-e8d7241145d5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.530081 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-573f5cda-79d1-4cc2-9008-e8d7241145d5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:07.857349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-573f5cda-79d1-4cc2-9008-e8d7241145d5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:07.875560 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-573f5cda-79d1-4cc2-9008-e8d7241145d5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1314 microversion: 2.1 time: 0.370164 Jul 20 04:21:07.877510 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1338/2460] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:07 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:07.884826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0008f3f6-100d-4a39-8300-fec37a5fcdb0 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06bdcda940>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:07.975935 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0008f3f6-100d-4a39-8300-fec37a5fcdb0 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.096271 Jul 20 04:21:07.976913 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1339/2461] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:07 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:07.988441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-a27efe28-1406-4d35-844f-6789b3897cc0 req-b7365f3a-eb52-442a-9abb-0b619335a598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e657e9b-7218-4037-a681-e00c4b71023b", "tag": "73a2f40f-aa9f-4110-8c81-c1c7afbe4bcc"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:07.998047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a27efe28-1406-4d35-844f-6789b3897cc0 req-b7365f3a-eb52-442a-9abb-0b619335a598 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.998791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a27efe28-1406-4d35-844f-6789b3897cc0 req-b7365f3a-eb52-442a-9abb-0b619335a598 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:08.021570 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-a27efe28-1406-4d35-844f-6789b3897cc0 req-b7365f3a-eb52-442a-9abb-0b619335a598 service nova] Creating event network-changed:73a2f40f-aa9f-4110-8c81-c1c7afbe4bcc for instance 0e657e9b-7218-4037-a681-e00c4b71023b on n-h1-826526-5 Jul 20 04:21:08.027435 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-a27efe28-1406-4d35-844f-6789b3897cc0 req-b7365f3a-eb52-442a-9abb-0b619335a598 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043355 Jul 20 04:21:08.028712 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1340/2462] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:08.035004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-47bf5726-5cfe-4875-8381-e339b27495dc tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:08.036032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-47bf5726-5cfe-4875-8381-e339b27495dc tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:08.043156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47bf5726-5cfe-4875-8381-e339b27495dc tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:08.044140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47bf5726-5cfe-4875-8381-e339b27495dc tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:08.045122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47bf5726-5cfe-4875-8381-e339b27495dc tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:08.045554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47bf5726-5cfe-4875-8381-e339b27495dc tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:08.222504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-47bf5726-5cfe-4875-8381-e339b27495dc tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:08.237259 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-47bf5726-5cfe-4875-8381-e339b27495dc tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1271 microversion: 2.1 time: 0.206879 Jul 20 04:21:08.248234 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1341/2463] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:08 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1271 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:08.895999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-33502b02-6900-4d3b-809b-52b9adff80a3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:08.897391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-33502b02-6900-4d3b-809b-52b9adff80a3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:08.911668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33502b02-6900-4d3b-809b-52b9adff80a3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:08.912859 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33502b02-6900-4d3b-809b-52b9adff80a3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:08.916485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33502b02-6900-4d3b-809b-52b9adff80a3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:08.920085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33502b02-6900-4d3b-809b-52b9adff80a3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:09.690477 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-52292b3a-726f-4916-9d3f-89ed61936b31 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "POST /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635/action" status: 202 len: 0 microversion: 2.1 time: 5.956846 Jul 20 04:21:09.691406 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1123/2464] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:03 2022] POST /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635/action => generated 0 bytes in 5958 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:09.708733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-91b03ff2-657a-4178-9bbb-b9cc48e83719 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06bebb84c0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:09.816212 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-91b03ff2-657a-4178-9bbb-b9cc48e83719 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.123266 Jul 20 04:21:09.816967 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1124/2465] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:09 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:09.834330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b12dfe65-b0ae-416d-8fc5-1b8fc6015cb8 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:09.834982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b12dfe65-b0ae-416d-8fc5-1b8fc6015cb8 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:09.869835 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b12dfe65-b0ae-416d-8fc5-1b8fc6015cb8 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:09.870320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b12dfe65-b0ae-416d-8fc5-1b8fc6015cb8 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:09.875694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-33502b02-6900-4d3b-809b-52b9adff80a3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:09.881824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b12dfe65-b0ae-416d-8fc5-1b8fc6015cb8 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:09.895697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b12dfe65-b0ae-416d-8fc5-1b8fc6015cb8 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:09.897471 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-33502b02-6900-4d3b-809b-52b9adff80a3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1314 microversion: 2.1 time: 0.996540 Jul 20 04:21:09.902782 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1342/2466] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:08 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1314 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:09.926402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cb3e2a1d-b247-41e7-a784-97544646f6ae tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06be0b1d30>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:10.435089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG neutronclient.v2_0.client [None req-cb3e2a1d-b247-41e7-a784-97544646f6ae tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 in use.", "detail": ""}} {{(pid=127871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:21:10.437110 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-cb3e2a1d-b247-41e7-a784-97544646f6ae tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] HTTP exception thrown: Security Group d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 in use. Jul 20 04:21:10.437110 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-1b7bef14-b658-4e57-a977-e3199f267055'] Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cb3e2a1d-b247-41e7-a784-97544646f6ae tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Request method failure captured: Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/os-security-groups/d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 HTTP/1.1 Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14JfAGKjPuA6ODJ-Qtd1em2O9yA3rahErotNYmVH9cKLqXeleHpCho0NIxaqZH7I3kILCGiDqMrjK0vy8DvdBt2Jb59H_-WliyaefNEp44gjG3S0TsxNI_vZzHSAfQzFRseRskmabnqYG7qLPbXQPBbvdUJJYh9qJrSBMBDZ9FAEz1w Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:21:10.445002 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:21:10.446408 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373f9f5b2b9f44fdba67acfc147b7d84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}] Jul 20 04:21:10.446408 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:10.446408 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:10.446408 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:10.446408 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:10.446408 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:21:10.446408 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:21:10.446408 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 539cb225b4b0422c9f19e0eb18c8983e Jul 20 04:21:10.446408 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:10.446408 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:21:10.446408 n-d-826526-5 devstack@n-api.service[127871]: exception: Security Group d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 in use. Jul 20 04:21:10.446408 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-1b7bef14-b658-4e57-a977-e3199f267055'] Jul 20 04:21:10.446408 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'd4e319b7-e21f-4cd5-ac95-02dd6eb13fa0'} Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:10.447199 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 in use. Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b7bef14-b658-4e57-a977-e3199f267055'] Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 in use. Jul 20 04:21:10.449201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b7bef14-b658-4e57-a977-e3199f267055'] Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 in use. Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b7bef14-b658-4e57-a977-e3199f267055'] Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:10.452012 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:10.455715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:10.455715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:10.455715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:10.455715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 in use. Jul 20 04:21:10.455715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b7bef14-b658-4e57-a977-e3199f267055'] Jul 20 04:21:10.455715 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:10.455715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cb3e2a1d-b247-41e7-a784-97544646f6ae tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Returning 400 to user: Security Group d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 in use. Jul 20 04:21:10.455715 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-1b7bef14-b658-4e57-a977-e3199f267055'] {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:10.455715 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cb3e2a1d-b247-41e7-a784-97544646f6ae tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0" status: 400 len: 185 microversion: 2.1 time: 0.545524 Jul 20 04:21:10.464340 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1343/2467] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:21:09 2022] DELETE /compute/v2.1/os-security-groups/d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 => generated 185 bytes in 559 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:21:10.471667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-9dad3eae-11de-444c-bfe1-97e44f9bff4d req-3c9f7404-233c-4256-b30d-9aae509c0022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c0981d-36c0-4e76-ab07-6e9e52a20635", "tag": "45c00b5a-4dbc-45f6-b538-6c0cd7abaa0e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:10.502296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:10.513350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9dad3eae-11de-444c-bfe1-97e44f9bff4d req-3c9f7404-233c-4256-b30d-9aae509c0022 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.513941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9dad3eae-11de-444c-bfe1-97e44f9bff4d req-3c9f7404-233c-4256-b30d-9aae509c0022 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:10.550900 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9dad3eae-11de-444c-bfe1-97e44f9bff4d req-3c9f7404-233c-4256-b30d-9aae509c0022 service nova] Creating event network-changed:45c00b5a-4dbc-45f6-b538-6c0cd7abaa0e for instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 on n-h1-826526-5 Jul 20 04:21:10.559500 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-9dad3eae-11de-444c-bfe1-97e44f9bff4d req-3c9f7404-233c-4256-b30d-9aae509c0022 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093715 Jul 20 04:21:10.564158 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1344/2468] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:10.575208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0f18186d-cdf4-43a2-931b-a6a2d0de4183 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:10.585284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0f18186d-cdf4-43a2-931b-a6a2d0de4183 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:10.610091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f18186d-cdf4-43a2-931b-a6a2d0de4183 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.610889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f18186d-cdf4-43a2-931b-a6a2d0de4183 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:10.611689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f18186d-cdf4-43a2-931b-a6a2d0de4183 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.612179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f18186d-cdf4-43a2-931b-a6a2d0de4183 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:10.804214 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0f18186d-cdf4-43a2-931b-a6a2d0de4183 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "POST /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635/action" status: 202 len: 0 microversion: 2.1 time: 0.234480 Jul 20 04:21:10.808036 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1345/2469] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:10 2022] POST /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:10.818422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-539a29b8-bcb1-424f-9838-46667ed16059 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:10.820841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-539a29b8-bcb1-424f-9838-46667ed16059 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:10.840664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-539a29b8-bcb1-424f-9838-46667ed16059 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.841562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-539a29b8-bcb1-424f-9838-46667ed16059 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:10.844773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-539a29b8-bcb1-424f-9838-46667ed16059 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.845439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-539a29b8-bcb1-424f-9838-46667ed16059 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:11.268765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b12dfe65-b0ae-416d-8fc5-1b8fc6015cb8 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:11.282317 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b12dfe65-b0ae-416d-8fc5-1b8fc6015cb8 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1313 microversion: 2.1 time: 1.461884 Jul 20 04:21:11.283344 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1125/2470] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:09 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1313 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:11.297547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-558f5aab-da42-49dd-afee-e0264962cc34 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be2dbca0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:11.385065 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-558f5aab-da42-49dd-afee-e0264962cc34 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.095580 Jul 20 04:21:11.386645 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1126/2471] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:11 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:11.405038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-323c841b-466f-4b6c-8981-a93eca1d4f68 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:11.409549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-323c841b-466f-4b6c-8981-a93eca1d4f68 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:11.427751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-323c841b-466f-4b6c-8981-a93eca1d4f68 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:11.433091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-323c841b-466f-4b6c-8981-a93eca1d4f68 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:11.435086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-323c841b-466f-4b6c-8981-a93eca1d4f68 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:11.435763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-323c841b-466f-4b6c-8981-a93eca1d4f68 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.183113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-539a29b8-bcb1-424f-9838-46667ed16059 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:12.200051 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-539a29b8-bcb1-424f-9838-46667ed16059 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 200 len: 1575 microversion: 2.1 time: 1.389947 Jul 20 04:21:12.203479 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1346/2472] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:10 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 1575 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:12.302895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b040a28e-1552-4aab-b91c-d60a05f05a58 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:12.303779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b040a28e-1552-4aab-b91c-d60a05f05a58 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:12.319954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b040a28e-1552-4aab-b91c-d60a05f05a58 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.320722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b040a28e-1552-4aab-b91c-d60a05f05a58 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.322410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b040a28e-1552-4aab-b91c-d60a05f05a58 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.324994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b040a28e-1552-4aab-b91c-d60a05f05a58 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.666869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:13.359833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=56 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:13.443949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-323c841b-466f-4b6c-8981-a93eca1d4f68 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:13.446896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=73 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:13.466143 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-323c841b-466f-4b6c-8981-a93eca1d4f68 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1314 microversion: 2.1 time: 2.072702 Jul 20 04:21:13.481910 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1127/2473] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:11 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1314 bytes in 2089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:13.488518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2dc53e9c-5693-46fc-a454-5e00b54a0d31 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be8eb700>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:13.527819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b040a28e-1552-4aab-b91c-d60a05f05a58 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:13.541913 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b040a28e-1552-4aab-b91c-d60a05f05a58 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1313 microversion: 2.1 time: 1.242488 Jul 20 04:21:13.551480 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1347/2474] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:12 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1313 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:13.556141 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2dc53e9c-5693-46fc-a454-5e00b54a0d31 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.072394 Jul 20 04:21:13.557052 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1128/2475] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:13 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:13.562156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1b60c2e4-f7ce-48ff-8670-0a0bad57feea tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:13.562156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1b60c2e4-f7ce-48ff-8670-0a0bad57feea tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:13.583509 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1b60c2e4-f7ce-48ff-8670-0a0bad57feea tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:13.584059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1b60c2e4-f7ce-48ff-8670-0a0bad57feea tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:13.585447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1b60c2e4-f7ce-48ff-8670-0a0bad57feea tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:13.586275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1b60c2e4-f7ce-48ff-8670-0a0bad57feea tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.040061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1b60c2e4-f7ce-48ff-8670-0a0bad57feea tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:14.054539 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1b60c2e4-f7ce-48ff-8670-0a0bad57feea tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 200 len: 1575 microversion: 2.1 time: 0.507994 Jul 20 04:21:14.056074 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1348/2476] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:13 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 1575 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:14.486526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ba31cbde-594a-43f5-b734-ecaf4d37f122 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:14.487143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ba31cbde-594a-43f5-b734-ecaf4d37f122 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:14.497580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:14.509557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba31cbde-594a-43f5-b734-ecaf4d37f122 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.512217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba31cbde-594a-43f5-b734-ecaf4d37f122 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.514931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba31cbde-594a-43f5-b734-ecaf4d37f122 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.515863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba31cbde-594a-43f5-b734-ecaf4d37f122 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.559448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-444d3d45-7c53-426f-a6ef-43162dd5f5c0 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:14.560658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-444d3d45-7c53-426f-a6ef-43162dd5f5c0 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:14.578411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-444d3d45-7c53-426f-a6ef-43162dd5f5c0 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.584536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-444d3d45-7c53-426f-a6ef-43162dd5f5c0 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.586906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-444d3d45-7c53-426f-a6ef-43162dd5f5c0 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.591382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-444d3d45-7c53-426f-a6ef-43162dd5f5c0 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:15.688469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-444d3d45-7c53-426f-a6ef-43162dd5f5c0 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:15.698811 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-444d3d45-7c53-426f-a6ef-43162dd5f5c0 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1313 microversion: 2.1 time: 1.143542 Jul 20 04:21:15.724779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ba31cbde-594a-43f5-b734-ecaf4d37f122 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:15.731847 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1349/2477] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:14 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1313 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:15.732133 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ba31cbde-594a-43f5-b734-ecaf4d37f122 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1314 microversion: 2.1 time: 1.241185 Jul 20 04:21:15.732391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-371a8338-c067-41d3-8686-9531ff360efc tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be0f3790>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:15.739440 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1129/2478] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:14 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1314 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:15.745906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f6ce9f32-1ad4-4264-9817-7715265eb4e1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:15.746555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f6ce9f32-1ad4-4264-9817-7715265eb4e1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:15.754902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6ce9f32-1ad4-4264-9817-7715265eb4e1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:15.755524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6ce9f32-1ad4-4264-9817-7715265eb4e1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:15.756828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6ce9f32-1ad4-4264-9817-7715265eb4e1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:15.757439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6ce9f32-1ad4-4264-9817-7715265eb4e1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:15.863190 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-371a8338-c067-41d3-8686-9531ff360efc tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.148989 Jul 20 04:21:15.865030 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1350/2479] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:15 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:15.900671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-83ac42cb-60b5-4991-ab91-db84a9fb783f req-61c6c3a4-9049-4f0a-af5e-a31a282ea2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e657e9b-7218-4037-a681-e00c4b71023b", "name": "network-vif-plugged", "status": "completed", "tag": "73a2f40f-aa9f-4110-8c81-c1c7afbe4bcc"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:15.918605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-83ac42cb-60b5-4991-ab91-db84a9fb783f req-61c6c3a4-9049-4f0a-af5e-a31a282ea2a1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:15.923754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-83ac42cb-60b5-4991-ab91-db84a9fb783f req-61c6c3a4-9049-4f0a-af5e-a31a282ea2a1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:15.939831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:15.942840 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-83ac42cb-60b5-4991-ab91-db84a9fb783f req-61c6c3a4-9049-4f0a-af5e-a31a282ea2a1 service nova] Creating event network-vif-plugged:73a2f40f-aa9f-4110-8c81-c1c7afbe4bcc for instance 0e657e9b-7218-4037-a681-e00c4b71023b on n-h1-826526-5 Jul 20 04:21:15.951383 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-83ac42cb-60b5-4991-ab91-db84a9fb783f req-61c6c3a4-9049-4f0a-af5e-a31a282ea2a1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068602 Jul 20 04:21:15.952986 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1351/2480] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:16.608117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-c473b94f-cd0a-4ff6-a4c1-ee5bc9ca04a0 req-0eab7872-5a10-4fa3-ada7-48ea1fe6fe27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "122d7f8a-8307-4b34-b5b5-0b98a961c340", "tag": "a43a640d-ba5f-4937-b46e-36f7af65c087"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:16.642424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c473b94f-cd0a-4ff6-a4c1-ee5bc9ca04a0 req-0eab7872-5a10-4fa3-ada7-48ea1fe6fe27 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.643394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c473b94f-cd0a-4ff6-a4c1-ee5bc9ca04a0 req-0eab7872-5a10-4fa3-ada7-48ea1fe6fe27 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.662497 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-c473b94f-cd0a-4ff6-a4c1-ee5bc9ca04a0 req-0eab7872-5a10-4fa3-ada7-48ea1fe6fe27 service nova] Creating event network-changed:a43a640d-ba5f-4937-b46e-36f7af65c087 for instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 on n-h2-826526-5 Jul 20 04:21:16.669699 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-c473b94f-cd0a-4ff6-a4c1-ee5bc9ca04a0 req-0eab7872-5a10-4fa3-ada7-48ea1fe6fe27 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079043 Jul 20 04:21:16.670932 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1352/2481] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:21:16.742871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-87725d8f-1a13-412a-9204-0d16065d623f tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:16.744727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-87725d8f-1a13-412a-9204-0d16065d623f tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:16.763151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-87725d8f-1a13-412a-9204-0d16065d623f tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.765411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-87725d8f-1a13-412a-9204-0d16065d623f tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.766932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-87725d8f-1a13-412a-9204-0d16065d623f tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.768518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-87725d8f-1a13-412a-9204-0d16065d623f tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.002311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f6ce9f32-1ad4-4264-9817-7715265eb4e1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:17.014753 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f6ce9f32-1ad4-4264-9817-7715265eb4e1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 200 len: 1575 microversion: 2.1 time: 1.273944 Jul 20 04:21:17.015354 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1130/2482] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:15 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 1575 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:17.057085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-13889f53-2aab-4546-860c-a967b9b0c920 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:17.059008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-13889f53-2aab-4546-860c-a967b9b0c920 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:17.075045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13889f53-2aab-4546-860c-a967b9b0c920 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.077958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13889f53-2aab-4546-860c-a967b9b0c920 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.080465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13889f53-2aab-4546-860c-a967b9b0c920 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.082343 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13889f53-2aab-4546-860c-a967b9b0c920 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.671593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-87725d8f-1a13-412a-9204-0d16065d623f tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:17.680553 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-87725d8f-1a13-412a-9204-0d16065d623f tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1313 microversion: 2.1 time: 0.944184 Jul 20 04:21:17.685240 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1353/2483] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:16 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1313 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:17.701070 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0f83dac6-cb2a-4600-bcd3-e09d311ac657 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06c7459430>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:17.788542 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0f83dac6-cb2a-4600-bcd3-e09d311ac657 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.091980 Jul 20 04:21:17.796344 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1354/2484] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:17 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:17.994800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-915efa27-0e9a-4fde-9e55-e0a66c69d886 req-cf50de84-24cc-4a61-a8f7-08e10e4deb40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b80cc2-a403-42e3-a623-aa5896d360e9", "name": "network-vif-plugged", "status": "completed", "tag": "8266a16e-2ac7-4af1-a58a-e921890fc926"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:18.028045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-915efa27-0e9a-4fde-9e55-e0a66c69d886 req-cf50de84-24cc-4a61-a8f7-08e10e4deb40 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.028497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-915efa27-0e9a-4fde-9e55-e0a66c69d886 req-cf50de84-24cc-4a61-a8f7-08e10e4deb40 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.045564 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-915efa27-0e9a-4fde-9e55-e0a66c69d886 req-cf50de84-24cc-4a61-a8f7-08e10e4deb40 service nova] Creating event network-vif-plugged:8266a16e-2ac7-4af1-a58a-e921890fc926 for instance 62b80cc2-a403-42e3-a623-aa5896d360e9 on n-h2-826526-5 Jul 20 04:21:18.051551 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-915efa27-0e9a-4fde-9e55-e0a66c69d886 req-cf50de84-24cc-4a61-a8f7-08e10e4deb40 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060330 Jul 20 04:21:18.056769 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1355/2485] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:21:18.064761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5ea315b7-0c61-4c71-8f27-2198a0943326 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:18.066172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5ea315b7-0c61-4c71-8f27-2198a0943326 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:18.097466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ea315b7-0c61-4c71-8f27-2198a0943326 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.099438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ea315b7-0c61-4c71-8f27-2198a0943326 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.101395 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ea315b7-0c61-4c71-8f27-2198a0943326 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.104551 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ea315b7-0c61-4c71-8f27-2198a0943326 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.142607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-13889f53-2aab-4546-860c-a967b9b0c920 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:18.156410 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-13889f53-2aab-4546-860c-a967b9b0c920 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1314 microversion: 2.1 time: 1.122662 Jul 20 04:21:18.157015 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1131/2486] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:17 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1314 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:18.496026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5ea315b7-0c61-4c71-8f27-2198a0943326 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:18.504708 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5ea315b7-0c61-4c71-8f27-2198a0943326 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 200 len: 1573 microversion: 2.1 time: 0.446213 Jul 20 04:21:18.509013 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1356/2487] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:18 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 1573 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:18.526510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-176c792a-b2b9-4b3d-b86b-7a0349ac6ccf tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2083928718"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:18.527153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-176c792a-b2b9-4b3d-b86b-7a0349ac6ccf tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:18.535160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-176c792a-b2b9-4b3d-b86b-7a0349ac6ccf tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.536119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-176c792a-b2b9-4b3d-b86b-7a0349ac6ccf tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.537243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-176c792a-b2b9-4b3d-b86b-7a0349ac6ccf tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.537892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-176c792a-b2b9-4b3d-b86b-7a0349ac6ccf tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.702085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7606844f-dc8d-4710-99d5-1f73003e9c61 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:18.702854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7606844f-dc8d-4710-99d5-1f73003e9c61 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:18.718333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7606844f-dc8d-4710-99d5-1f73003e9c61 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.718895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7606844f-dc8d-4710-99d5-1f73003e9c61 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.719837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7606844f-dc8d-4710-99d5-1f73003e9c61 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.720410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7606844f-dc8d-4710-99d5-1f73003e9c61 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.056104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7606844f-dc8d-4710-99d5-1f73003e9c61 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:19.089538 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7606844f-dc8d-4710-99d5-1f73003e9c61 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1313 microversion: 2.1 time: 0.374911 Jul 20 04:21:19.090972 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1357/2488] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:18 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1313 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:19.105479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bb668ad4-67e9-45a1-9aeb-67b64fc47a7d tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be77a160>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:19.187439 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bb668ad4-67e9-45a1-9aeb-67b64fc47a7d tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.091484 Jul 20 04:21:19.195183 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1358/2489] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:19 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:19.219710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a0339b6f-c0af-428b-8da4-42edeb7ef4bc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:19.227722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a0339b6f-c0af-428b-8da4-42edeb7ef4bc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:19.259780 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0339b6f-c0af-428b-8da4-42edeb7ef4bc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.264308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0339b6f-c0af-428b-8da4-42edeb7ef4bc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.281713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0339b6f-c0af-428b-8da4-42edeb7ef4bc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.284838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0339b6f-c0af-428b-8da4-42edeb7ef4bc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.651573 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.network.security_group_api [None req-176c792a-b2b9-4b3d-b86b-7a0349ac6ccf tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Adding security group 5529f1b8-a4ed-4179-b435-1371d16fd836 to port 45c00b5a-4dbc-45f6-b538-6c0cd7abaa0e Jul 20 04:21:19.875226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a0339b6f-c0af-428b-8da4-42edeb7ef4bc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:19.889398 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a0339b6f-c0af-428b-8da4-42edeb7ef4bc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1463 microversion: 2.1 time: 0.692797 Jul 20 04:21:19.903857 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1359/2490] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:19 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1463 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:19.915954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2430a94c-59fd-42a1-91a5-2ecad501743d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:19.919629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2430a94c-59fd-42a1-91a5-2ecad501743d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:19.934605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2430a94c-59fd-42a1-91a5-2ecad501743d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.935783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2430a94c-59fd-42a1-91a5-2ecad501743d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.937775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2430a94c-59fd-42a1-91a5-2ecad501743d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.939685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2430a94c-59fd-42a1-91a5-2ecad501743d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:20.793764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2430a94c-59fd-42a1-91a5-2ecad501743d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:20.803617 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2430a94c-59fd-42a1-91a5-2ecad501743d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1314 microversion: 2.1 time: 0.896894 Jul 20 04:21:20.814956 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1360/2491] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:19 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1314 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:20.820882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3acbc0f9-73b2-4400-9cc4-836c930a768b tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:20.829124 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3acbc0f9-73b2-4400-9cc4-836c930a768b tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:20.840160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3acbc0f9-73b2-4400-9cc4-836c930a768b tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:20.840899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3acbc0f9-73b2-4400-9cc4-836c930a768b tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:20.841919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3acbc0f9-73b2-4400-9cc4-836c930a768b tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:20.844950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3acbc0f9-73b2-4400-9cc4-836c930a768b tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.359111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3acbc0f9-73b2-4400-9cc4-836c930a768b tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:21.367672 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3acbc0f9-73b2-4400-9cc4-836c930a768b tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1313 microversion: 2.1 time: 0.551117 Jul 20 04:21:21.376688 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1361/2492] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:20 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:21.382919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-485a66ae-028d-4603-8a7d-867c67202c8b tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06bdcda820>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:21.450618 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-176c792a-b2b9-4b3d-b86b-7a0349ac6ccf tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "POST /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635/action" status: 202 len: 0 microversion: 2.1 time: 2.928528 Jul 20 04:21:21.451409 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1132/2493] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:18 2022] POST /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635/action => generated 0 bytes in 2931 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:21.467668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-01da0146-0a4a-4d78-b4a6-09bbd8914d89 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06be8b2ee0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:21.523787 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-485a66ae-028d-4603-8a7d-867c67202c8b tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.145329 Jul 20 04:21:21.524865 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1362/2494] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:21 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:21.544980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-9433b88b-8407-4f6c-ba6b-57c9029a48de req-2061aa2e-2943-4149-ab65-ecb8532319cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c0981d-36c0-4e76-ab07-6e9e52a20635", "tag": "45c00b5a-4dbc-45f6-b538-6c0cd7abaa0e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:21.575086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9433b88b-8407-4f6c-ba6b-57c9029a48de req-2061aa2e-2943-4149-ab65-ecb8532319cc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.575790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9433b88b-8407-4f6c-ba6b-57c9029a48de req-2061aa2e-2943-4149-ab65-ecb8532319cc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.596895 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9433b88b-8407-4f6c-ba6b-57c9029a48de req-2061aa2e-2943-4149-ab65-ecb8532319cc service nova] Creating event network-changed:45c00b5a-4dbc-45f6-b538-6c0cd7abaa0e for instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 on n-h1-826526-5 Jul 20 04:21:21.607191 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-9433b88b-8407-4f6c-ba6b-57c9029a48de req-2061aa2e-2943-4149-ab65-ecb8532319cc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080604 Jul 20 04:21:21.608108 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1363/2495] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:21.832717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-73390a12-616d-4b78-9089-f6008a95803d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:21.834312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-73390a12-616d-4b78-9089-f6008a95803d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:21.851222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73390a12-616d-4b78-9089-f6008a95803d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.851933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73390a12-616d-4b78-9089-f6008a95803d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.852907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73390a12-616d-4b78-9089-f6008a95803d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.853501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73390a12-616d-4b78-9089-f6008a95803d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:22.632132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-73390a12-616d-4b78-9089-f6008a95803d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:22.644348 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-73390a12-616d-4b78-9089-f6008a95803d tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1464 microversion: 2.1 time: 0.816762 Jul 20 04:21:22.648887 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1364/2496] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:21 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1464 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:22.660039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fc6867ad-a5f9-4c20-aed1-53ad84747f12 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:22.661035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fc6867ad-a5f9-4c20-aed1-53ad84747f12 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:22.697611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fc6867ad-a5f9-4c20-aed1-53ad84747f12 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:22.698544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fc6867ad-a5f9-4c20-aed1-53ad84747f12 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:22.701670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fc6867ad-a5f9-4c20-aed1-53ad84747f12 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:22.702719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fc6867ad-a5f9-4c20-aed1-53ad84747f12 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.020169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG neutronclient.v2_0.client [None req-01da0146-0a4a-4d78-b4a6-09bbd8914d89 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 5529f1b8-a4ed-4179-b435-1371d16fd836 in use.", "detail": ""}} {{(pid=127870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:21:23.022359 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-01da0146-0a4a-4d78-b4a6-09bbd8914d89 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] HTTP exception thrown: Security Group 5529f1b8-a4ed-4179-b435-1371d16fd836 in use. Jul 20 04:21:23.022359 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-3bc87faf-ef71-4359-a880-b7ea88a5e504'] Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-01da0146-0a4a-4d78-b4a6-09bbd8914d89 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Request method failure captured: Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/os-security-groups/5529f1b8-a4ed-4179-b435-1371d16fd836 HTTP/1.1 Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14JfAGKjPuA6ODJ-Qtd1em2O9yA3rahErotNYmVH9cKLqXeleHpCho0NIxaqZH7I3kILCGiDqMrjK0vy8DvdBt2Jb59H_-WliyaefNEp44gjG3S0TsxNI_vZzHSAfQzFRseRskmabnqYG7qLPbXQPBbvdUJJYh9qJrSBMBDZ9FAEz1w Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:21:23.026315 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:21:23.027644 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373f9f5b2b9f44fdba67acfc147b7d84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}] Jul 20 04:21:23.027644 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:23.027644 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:23.027644 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:23.027644 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:23.027644 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:21:23.027644 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:21:23.027644 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 539cb225b4b0422c9f19e0eb18c8983e Jul 20 04:21:23.027644 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:23.027644 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:21:23.027644 n-d-826526-5 devstack@n-api.service[127870]: exception: Security Group 5529f1b8-a4ed-4179-b435-1371d16fd836 in use. Jul 20 04:21:23.027644 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-3bc87faf-ef71-4359-a880-b7ea88a5e504'] Jul 20 04:21:23.027644 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '5529f1b8-a4ed-4179-b435-1371d16fd836'} Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:23.028451 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 5529f1b8-a4ed-4179-b435-1371d16fd836 in use. Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bc87faf-ef71-4359-a880-b7ea88a5e504'] Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 5529f1b8-a4ed-4179-b435-1371d16fd836 in use. Jul 20 04:21:23.029602 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bc87faf-ef71-4359-a880-b7ea88a5e504'] Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 5529f1b8-a4ed-4179-b435-1371d16fd836 in use. Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bc87faf-ef71-4359-a880-b7ea88a5e504'] Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.030724 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:23.032037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:23.032037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:23.032037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:23.032037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 5529f1b8-a4ed-4179-b435-1371d16fd836 in use. Jul 20 04:21:23.032037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bc87faf-ef71-4359-a880-b7ea88a5e504'] Jul 20 04:21:23.032037 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.036731 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-01da0146-0a4a-4d78-b4a6-09bbd8914d89 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Returning 400 to user: Security Group 5529f1b8-a4ed-4179-b435-1371d16fd836 in use. Jul 20 04:21:23.036731 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-3bc87faf-ef71-4359-a880-b7ea88a5e504'] {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:23.038013 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-01da0146-0a4a-4d78-b4a6-09bbd8914d89 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/5529f1b8-a4ed-4179-b435-1371d16fd836" status: 400 len: 185 microversion: 2.1 time: 1.581196 Jul 20 04:21:23.039139 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1133/2497] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:21:21 2022] DELETE /compute/v2.1/os-security-groups/5529f1b8-a4ed-4179-b435-1371d16fd836 => generated 185 bytes in 1583 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:21:23.054822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1021fb8e-afc2-4cde-94bc-25e411c66e7f tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be8954c0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:23.139891 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1021fb8e-afc2-4cde-94bc-25e411c66e7f tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.099394 Jul 20 04:21:23.140761 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1134/2498] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:23 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:23.158782 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2582713f-0433-4dba-ae86-afcd2ccbaae6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1363921640", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "62b80cc2-a403-42e3-a623-aa5896d360e9"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:23.281902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fc6867ad-a5f9-4c20-aed1-53ad84747f12 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:23.290593 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fc6867ad-a5f9-4c20-aed1-53ad84747f12 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1313 microversion: 2.1 time: 0.639855 Jul 20 04:21:23.292359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-2582713f-0433-4dba-ae86-afcd2ccbaae6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] validate_networks() for None {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:21:23.298081 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1365/2499] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:22 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1313 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:23.310299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-03a66ee7-5fb4-4d6c-b8a4-6ffe52fa2610 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:23.310808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-03a66ee7-5fb4-4d6c-b8a4-6ffe52fa2610 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:23.341633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03a66ee7-5fb4-4d6c-b8a4-6ffe52fa2610 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.342095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03a66ee7-5fb4-4d6c-b8a4-6ffe52fa2610 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.353928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03a66ee7-5fb4-4d6c-b8a4-6ffe52fa2610 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.354515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03a66ee7-5fb4-4d6c-b8a4-6ffe52fa2610 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.439417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-03a66ee7-5fb4-4d6c-b8a4-6ffe52fa2610 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:21:23.703274 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-03a66ee7-5fb4-4d6c-b8a4-6ffe52fa2610 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 204 len: 0 microversion: 2.1 time: 0.403840 Jul 20 04:21:23.707208 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1366/2500] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:23 2022] DELETE /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:21:23.724173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8d555442-9906-444c-896b-abc40c15b5ce tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:23.728774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8d555442-9906-444c-896b-abc40c15b5ce tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:23.745705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d555442-9906-444c-896b-abc40c15b5ce tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.749324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d555442-9906-444c-896b-abc40c15b5ce tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.750266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d555442-9906-444c-896b-abc40c15b5ce tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.750717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d555442-9906-444c-896b-abc40c15b5ce tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.566286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-2582713f-0433-4dba-ae86-afcd2ccbaae6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:24.567509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-2582713f-0433-4dba-ae86-afcd2ccbaae6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:24.568460 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-2582713f-0433-4dba-ae86-afcd2ccbaae6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:24.569123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-2582713f-0433-4dba-ae86-afcd2ccbaae6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:24.569726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-2582713f-0433-4dba-ae86-afcd2ccbaae6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:24.593237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2582713f-0433-4dba-ae86-afcd2ccbaae6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.594166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2582713f-0433-4dba-ae86-afcd2ccbaae6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.597535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2582713f-0433-4dba-ae86-afcd2ccbaae6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.600488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2582713f-0433-4dba-ae86-afcd2ccbaae6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.665537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8d555442-9906-444c-896b-abc40c15b5ce tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:24.674971 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8d555442-9906-444c-896b-abc40c15b5ce tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 200 len: 1648 microversion: 2.1 time: 0.963666 Jul 20 04:21:24.686279 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1367/2501] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:23 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 1648 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:24.701163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-2582713f-0433-4dba-ae86-afcd2ccbaae6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Getting quotas for project e780b879f5f943468e72977a75ee807d. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:24.704353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-509460e2-fa4b-4849-84ec-7860f4c9b504 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be3ee280>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:24.716050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-2582713f-0433-4dba-ae86-afcd2ccbaae6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Getting quotas for user cace98c409cd464a93e2d98ff7d1a989 and project e780b879f5f943468e72977a75ee807d. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:24.768130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2582713f-0433-4dba-ae86-afcd2ccbaae6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:21:24.783378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2582713f-0433-4dba-ae86-afcd2ccbaae6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:24.830651 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-509460e2-fa4b-4849-84ec-7860f4c9b504 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.142600 Jul 20 04:21:24.832011 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1368/2502] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:24 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:24.847996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-efa1d647-e09c-4bc4-bf4a-a7de978b19f1 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:24.848979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-efa1d647-e09c-4bc4-bf4a-a7de978b19f1 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:24.862774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-efa1d647-e09c-4bc4-bf4a-a7de978b19f1 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.866519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-efa1d647-e09c-4bc4-bf4a-a7de978b19f1 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.869313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-efa1d647-e09c-4bc4-bf4a-a7de978b19f1 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.875686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-efa1d647-e09c-4bc4-bf4a-a7de978b19f1 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.924008 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2582713f-0433-4dba-ae86-afcd2ccbaae6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.781783 Jul 20 04:21:24.935993 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1135/2503] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:21:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:21:24.973671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-27bca1b2-ebda-4fb5-9399-d365cfbc08e3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:24.975108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-27bca1b2-ebda-4fb5-9399-d365cfbc08e3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:25.305126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-27bca1b2-ebda-4fb5-9399-d365cfbc08e3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:25.322462 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-27bca1b2-ebda-4fb5-9399-d365cfbc08e3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c" status: 200 len: 1214 microversion: 2.1 time: 0.384356 Jul 20 04:21:25.324052 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1136/2504] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:24 2022] GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c => generated 1214 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:25.699120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b02b2555-23ca-4a3c-8544-0640f6a95e45 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:25.700200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b02b2555-23ca-4a3c-8544-0640f6a95e45 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:25.726604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b02b2555-23ca-4a3c-8544-0640f6a95e45 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:25.729493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b02b2555-23ca-4a3c-8544-0640f6a95e45 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:25.730388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b02b2555-23ca-4a3c-8544-0640f6a95e45 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:25.738294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b02b2555-23ca-4a3c-8544-0640f6a95e45 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:25.874414 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-efa1d647-e09c-4bc4-bf4a-a7de978b19f1 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:25.884391 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-efa1d647-e09c-4bc4-bf4a-a7de978b19f1 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1313 microversion: 2.1 time: 1.048393 Jul 20 04:21:25.888545 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1369/2505] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:24 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1313 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:25.895832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d2a50fd4-85ca-46b7-9266-e618f27b06bb tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06bddbb820>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:25.971510 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d2a50fd4-85ca-46b7-9266-e618f27b06bb tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1426 microversion: 2.1 time: 0.081395 Jul 20 04:21:25.977428 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1370/2506] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:25 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1426 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:26.339387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5e9bc9c5-594a-415e-9632-144ffbb9c50e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:26.340348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5e9bc9c5-594a-415e-9632-144ffbb9c50e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:26.358212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e9bc9c5-594a-415e-9632-144ffbb9c50e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:26.358770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e9bc9c5-594a-415e-9632-144ffbb9c50e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:26.361119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e9bc9c5-594a-415e-9632-144ffbb9c50e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:26.361770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e9bc9c5-594a-415e-9632-144ffbb9c50e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:26.737508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5e9bc9c5-594a-415e-9632-144ffbb9c50e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:26.751660 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5e9bc9c5-594a-415e-9632-144ffbb9c50e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c" status: 200 len: 1266 microversion: 2.1 time: 0.416520 Jul 20 04:21:26.752341 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1371/2507] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:26 2022] GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c => generated 1266 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:26.904633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f9eabdf8-e280-456b-bee2-8cf692512675 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:26.906720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f9eabdf8-e280-456b-bee2-8cf692512675 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:26.925969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9eabdf8-e280-456b-bee2-8cf692512675 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:26.928072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9eabdf8-e280-456b-bee2-8cf692512675 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:26.933011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9eabdf8-e280-456b-bee2-8cf692512675 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:26.933475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9eabdf8-e280-456b-bee2-8cf692512675 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.452668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f9eabdf8-e280-456b-bee2-8cf692512675 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:27.469834 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f9eabdf8-e280-456b-bee2-8cf692512675 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1313 microversion: 2.1 time: 0.569561 Jul 20 04:21:27.487401 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1372/2508] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:26 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1313 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:27.498639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f6f4c14d-b131-4fa8-b47e-4a3b784f062d tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06bdfaeaf0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:27.563081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b02b2555-23ca-4a3c-8544-0640f6a95e45 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:27.580089 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b02b2555-23ca-4a3c-8544-0640f6a95e45 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 200 len: 1648 microversion: 2.1 time: 1.883472 Jul 20 04:21:27.581023 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1137/2509] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:25 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 1648 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:27.619019 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f6f4c14d-b131-4fa8-b47e-4a3b784f062d tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1435 microversion: 2.1 time: 0.121648 Jul 20 04:21:27.619699 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1373/2510] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:27 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1435 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:27.649705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-06234d20-c9ad-49a3-a177-c157d187040b tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be9b33a0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:27.745689 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-06234d20-c9ad-49a3-a177-c157d187040b tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 200 len: 1435 microversion: 2.1 time: 0.113782 Jul 20 04:21:27.748584 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1138/2511] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:27 2022] GET /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 1435 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:27.771555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-06ebb9a4-d604-47e3-adee-13a52f45ec3b tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:27.776014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-06ebb9a4-d604-47e3-adee-13a52f45ec3b tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:27.783479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a2a71f18-850b-4c89-8d80-d9e6b1f1e2a1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:27.786261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a2a71f18-850b-4c89-8d80-d9e6b1f1e2a1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:27.790661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06ebb9a4-d604-47e3-adee-13a52f45ec3b tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.794077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06ebb9a4-d604-47e3-adee-13a52f45ec3b tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.795616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06ebb9a4-d604-47e3-adee-13a52f45ec3b tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.798297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06ebb9a4-d604-47e3-adee-13a52f45ec3b tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.811117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2a71f18-850b-4c89-8d80-d9e6b1f1e2a1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.814241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2a71f18-850b-4c89-8d80-d9e6b1f1e2a1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.816407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2a71f18-850b-4c89-8d80-d9e6b1f1e2a1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.817312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2a71f18-850b-4c89-8d80-d9e6b1f1e2a1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:28.018008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a2a71f18-850b-4c89-8d80-d9e6b1f1e2a1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:28.059401 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a2a71f18-850b-4c89-8d80-d9e6b1f1e2a1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c" status: 200 len: 1272 microversion: 2.1 time: 0.288768 Jul 20 04:21:28.070384 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1139/2512] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:27 2022] GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c => generated 1272 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:28.093679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-a15bb4d0-b822-4b50-8d8d-6647bc890996 req-fb20da57-dc75-4edf-a050-9961d03826da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122d7f8a-8307-4b34-b5b5-0b98a961c340", "name": "network-vif-plugged", "status": "completed", "tag": "a43a640d-ba5f-4937-b46e-36f7af65c087"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:28.122996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a15bb4d0-b822-4b50-8d8d-6647bc890996 req-fb20da57-dc75-4edf-a050-9961d03826da service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:28.126201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a15bb4d0-b822-4b50-8d8d-6647bc890996 req-fb20da57-dc75-4edf-a050-9961d03826da service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:28.185202 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-a15bb4d0-b822-4b50-8d8d-6647bc890996 req-fb20da57-dc75-4edf-a050-9961d03826da service nova] Creating event network-vif-plugged:a43a640d-ba5f-4937-b46e-36f7af65c087 for instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 on n-h2-826526-5 Jul 20 04:21:28.232706 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-a15bb4d0-b822-4b50-8d8d-6647bc890996 req-fb20da57-dc75-4edf-a050-9961d03826da service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155466 Jul 20 04:21:28.239015 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1140/2513] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:28.387244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e7a8d389-d8af-4cb2-90a5-245ca1a7ab7f req-aabb9b66-81f1-438d-8b7c-b7f4a3a5303f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c0981d-36c0-4e76-ab07-6e9e52a20635", "name": "network-vif-deleted", "tag": "45c00b5a-4dbc-45f6-b538-6c0cd7abaa0e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:28.409044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e7a8d389-d8af-4cb2-90a5-245ca1a7ab7f req-aabb9b66-81f1-438d-8b7c-b7f4a3a5303f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:28.409462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e7a8d389-d8af-4cb2-90a5-245ca1a7ab7f req-aabb9b66-81f1-438d-8b7c-b7f4a3a5303f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:28.438906 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e7a8d389-d8af-4cb2-90a5-245ca1a7ab7f req-aabb9b66-81f1-438d-8b7c-b7f4a3a5303f service nova] Creating event network-vif-deleted:45c00b5a-4dbc-45f6-b538-6c0cd7abaa0e for instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 on n-h1-826526-5 Jul 20 04:21:28.454869 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e7a8d389-d8af-4cb2-90a5-245ca1a7ab7f req-aabb9b66-81f1-438d-8b7c-b7f4a3a5303f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073419 Jul 20 04:21:28.456591 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1141/2514] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:28.503970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-718f8a6c-9f75-41f2-86d7-771ccb25af11 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:28.511731 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-718f8a6c-9f75-41f2-86d7-771ccb25af11 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:28.529150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-718f8a6c-9f75-41f2-86d7-771ccb25af11 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:28.530120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-718f8a6c-9f75-41f2-86d7-771ccb25af11 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:28.532158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-718f8a6c-9f75-41f2-86d7-771ccb25af11 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:28.532983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-718f8a6c-9f75-41f2-86d7-771ccb25af11 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:28.852703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-06ebb9a4-d604-47e3-adee-13a52f45ec3b tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:28.870107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:28.878056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-718f8a6c-9f75-41f2-86d7-771ccb25af11 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:28.887796 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-06ebb9a4-d604-47e3-adee-13a52f45ec3b tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1466 microversion: 2.1 time: 1.127473 Jul 20 04:21:28.888859 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1374/2515] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:27 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1466 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:28.893755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-38505778-5b93-4e80-a9be-e9d4d8195e34 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:28.894374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-38505778-5b93-4e80-a9be-e9d4d8195e34 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:28.910026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38505778-5b93-4e80-a9be-e9d4d8195e34 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:28.910266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38505778-5b93-4e80-a9be-e9d4d8195e34 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:28.911262 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38505778-5b93-4e80-a9be-e9d4d8195e34 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:28.911847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38505778-5b93-4e80-a9be-e9d4d8195e34 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:28.915393 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-718f8a6c-9f75-41f2-86d7-771ccb25af11 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1313 microversion: 2.1 time: 0.423034 Jul 20 04:21:28.919067 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1142/2516] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:28 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:28.931767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-873f222c-32db-42ef-a241-80c6c9ccde39 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06c7459b80>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:29.068426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38505778-5b93-4e80-a9be-e9d4d8195e34 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:29.070465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38505778-5b93-4e80-a9be-e9d4d8195e34 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:29.071612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-38505778-5b93-4e80-a9be-e9d4d8195e34 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lazy-loading 'fault' on Instance uuid 51c0981d-36c0-4e76-ab07-6e9e52a20635 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:21:29.162725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-38505778-5b93-4e80-a9be-e9d4d8195e34 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:29.173779 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-38505778-5b93-4e80-a9be-e9d4d8195e34 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 200 len: 1306 microversion: 2.1 time: 0.282643 Jul 20 04:21:29.177520 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1375/2517] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:28 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 1306 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:29.191024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-165e23b8-34e1-43ce-9942-eb2bab77f6e5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:29.193293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-165e23b8-34e1-43ce-9942-eb2bab77f6e5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:29.209092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-165e23b8-34e1-43ce-9942-eb2bab77f6e5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:29.210711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-165e23b8-34e1-43ce-9942-eb2bab77f6e5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:29.213164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-165e23b8-34e1-43ce-9942-eb2bab77f6e5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:29.218132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-165e23b8-34e1-43ce-9942-eb2bab77f6e5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:29.364367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-165e23b8-34e1-43ce-9942-eb2bab77f6e5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:29.375732 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-165e23b8-34e1-43ce-9942-eb2bab77f6e5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c" status: 200 len: 1272 microversion: 2.1 time: 0.195876 Jul 20 04:21:29.385795 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1376/2518] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:29 2022] GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:29.937944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d858a8f8-57fb-44e3-b66e-b010609da6ff tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:29.940017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d858a8f8-57fb-44e3-b66e-b010609da6ff tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:29.960981 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-873f222c-32db-42ef-a241-80c6c9ccde39 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "DELETE /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461" status: 204 len: 0 microversion: 2.1 time: 1.039512 Jul 20 04:21:29.962903 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1143/2519] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:28 2022] DELETE /compute/v2.1/images/f56b7e30-4ab4-4c9f-abb8-7ed8fbff3461 => generated 0 bytes in 1043 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:21:29.963447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d858a8f8-57fb-44e3-b66e-b010609da6ff tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:29.963447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d858a8f8-57fb-44e3-b66e-b010609da6ff tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:29.963892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d858a8f8-57fb-44e3-b66e-b010609da6ff tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:29.964255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d858a8f8-57fb-44e3-b66e-b010609da6ff tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:29.974197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b41b1474-9018-471b-905f-c9ace48e9ff3 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '.version_select at 0x7f06be8713a0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:30.016312 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-b41b1474-9018-471b-905f-c9ace48e9ff3 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] HTTP exception thrown: Image not found. Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b41b1474-9018-471b-905f-c9ace48e9ff3 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Request method failure captured: Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 HTTP/1.1 Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14Jqjep9Tgv-ixep_e_5DOyJvgMJbqB_43o0Bd8u6QwZsUO1pLaUEiHDKiUnVmcNkmDg6mNc9alRhXiKXDcort_2eibP9JXV1s1RK-CRS7h1JXU22kp-U5zyBWlb68nOKoDRBRHNl0sD819nHDvufMrlmhobsuymfH-2QNcVU-qHaNk Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: d883ef732fba496db095a9ba2202a304 Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesOneServerTestJSON-939634403 Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:21:30.027671 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:21:30.029329 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d883ef732fba496db095a9ba2202a304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d883ef732fba496db095a9ba2202a304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d883ef732fba496db095a9ba2202a304", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d883ef732fba496db095a9ba2202a304"}]}] Jul 20 04:21:30.029329 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesOneServerTestJSON-939634403 Jul 20 04:21:30.029329 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: d883ef732fba496db095a9ba2202a304 Jul 20 04:21:30.029329 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-939634403 Jul 20 04:21:30.029329 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesOneServerTestJSON-939634403-project Jul 20 04:21:30.029329 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:21:30.029329 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:21:30.029329 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: b3d729a66b42428cb90920e80d8a06ce Jul 20 04:21:30.029329 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesOneServerTestJSON-939634403-project Jul 20 04:21:30.029329 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:21:30.029329 n-d-826526-5 devstack@n-api.service[127870]: exception: Image not found. Jul 20 04:21:30.029329 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '31ffe742-de5b-47cc-bb36-266dbe2929b3'} Jul 20 04:21:30.029329 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:30.029329 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 31ffe742-de5b-47cc-bb36-266dbe2929b3 to delete Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:30.030202 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 31ffe742-de5b-47cc-bb36-266dbe2929b3 could not be found. Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:30.031463 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:21:30.032749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:21:30.032749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:21:30.032749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:30.032749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:30.032749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:30.032749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:30.032749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:30.032749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:30.032749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:30.032749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:30.032749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:21:30.032749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:30.032749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b41b1474-9018-471b-905f-c9ace48e9ff3 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Returning 404 to user: Image not found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:30.032749 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b41b1474-9018-471b-905f-c9ace48e9ff3 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "DELETE /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3" status: 404 len: 62 microversion: 2.1 time: 0.064275 Jul 20 04:21:30.039385 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1144/2520] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:29 2022] DELETE /compute/v2.1/images/31ffe742-de5b-47cc-bb36-266dbe2929b3 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:21:30.048030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-701ba7d2-b611-4e96-b69a-15d08a507c8e tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:30.048619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-701ba7d2-b611-4e96-b69a-15d08a507c8e tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:30.057480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-701ba7d2-b611-4e96-b69a-15d08a507c8e tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:30.058059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-701ba7d2-b611-4e96-b69a-15d08a507c8e tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:30.059510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-701ba7d2-b611-4e96-b69a-15d08a507c8e tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:30.060067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-701ba7d2-b611-4e96-b69a-15d08a507c8e tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:30.106545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-701ba7d2-b611-4e96-b69a-15d08a507c8e tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:21:30.257140 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-701ba7d2-b611-4e96-b69a-15d08a507c8e tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 204 len: 0 microversion: 2.1 time: 0.214822 Jul 20 04:21:30.267038 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1145/2521] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:30 2022] DELETE /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:21:30.277463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-591a012a-9871-41c7-8364-0ef6d9fb4830 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:30.278576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-591a012a-9871-41c7-8364-0ef6d9fb4830 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:30.285222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-591a012a-9871-41c7-8364-0ef6d9fb4830 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:30.286225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-591a012a-9871-41c7-8364-0ef6d9fb4830 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:30.287375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-591a012a-9871-41c7-8364-0ef6d9fb4830 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:30.288182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-591a012a-9871-41c7-8364-0ef6d9fb4830 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:30.324635 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-591a012a-9871-41c7-8364-0ef6d9fb4830 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] HTTP exception thrown: Instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 could not be found. Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-591a012a-9871-41c7-8364-0ef6d9fb4830 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Request method failure captured: Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 HTTP/1.1 Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14JfAGKjPuA6ODJ-Qtd1em2O9yA3rahErotNYmVH9cKLqXeleHpCho0NIxaqZH7I3kILCGiDqMrjK0vy8DvdBt2Jb59H_-WliyaefNEp44gjG3S0TsxNI_vZzHSAfQzFRseRskmabnqYG7qLPbXQPBbvdUJJYh9qJrSBMBDZ9FAEz1w Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:21:30.326858 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:21:30.328426 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373f9f5b2b9f44fdba67acfc147b7d84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}] Jul 20 04:21:30.328426 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:30.328426 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:30.328426 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:30.328426 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:30.328426 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:21:30.328426 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:21:30.328426 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 539cb225b4b0422c9f19e0eb18c8983e Jul 20 04:21:30.328426 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:30.328426 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:21:30.328426 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 could not be found. Jul 20 04:21:30.328426 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '51c0981d-36c0-4e76-ab07-6e9e52a20635'} Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 could not be found. Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:30.329365 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:30.330535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:30.330535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:30.330535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:30.330535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:30.330535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:30.330535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:30.330535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:30.330535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 could not be found. Jul 20 04:21:30.330535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:30.330535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:30.330535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:30.330535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:30.330535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:30.330535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:30.330535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:30.330535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:30.330535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 could not be found. Jul 20 04:21:30.330535 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:30.331589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-591a012a-9871-41c7-8364-0ef6d9fb4830 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Returning 404 to user: Instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:30.331589 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-591a012a-9871-41c7-8364-0ef6d9fb4830 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 404 len: 111 microversion: 2.1 time: 0.058083 Jul 20 04:21:30.332372 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1146/2522] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:30 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:30.347528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a91da31f-d51c-40de-9ff4-00f10c1435a9 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:30.349030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a91da31f-d51c-40de-9ff4-00f10c1435a9 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:30.363521 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a91da31f-d51c-40de-9ff4-00f10c1435a9 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:30.365147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a91da31f-d51c-40de-9ff4-00f10c1435a9 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:30.366149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a91da31f-d51c-40de-9ff4-00f10c1435a9 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:30.366821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a91da31f-d51c-40de-9ff4-00f10c1435a9 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:30.495942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d858a8f8-57fb-44e3-b66e-b010609da6ff tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:30.509388 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d858a8f8-57fb-44e3-b66e-b010609da6ff tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1499 microversion: 2.1 time: 0.579638 Jul 20 04:21:30.514286 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1377/2523] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:29 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1499 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:30.522564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d24c5143-dcf6-4fdd-8a30-547ba7632f55 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06be0e9160>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:31.280135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a91da31f-d51c-40de-9ff4-00f10c1435a9 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:31.298484 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a91da31f-d51c-40de-9ff4-00f10c1435a9 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1472 microversion: 2.1 time: 0.961725 Jul 20 04:21:31.309834 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1147/2524] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:30 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1472 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:31.316394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6d342e0c-0ea8-425b-be6d-f956f0648dcc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:31.317337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6d342e0c-0ea8-425b-be6d-f956f0648dcc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:31.324958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d342e0c-0ea8-425b-be6d-f956f0648dcc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.325946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d342e0c-0ea8-425b-be6d-f956f0648dcc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.327221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d342e0c-0ea8-425b-be6d-f956f0648dcc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.327777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d342e0c-0ea8-425b-be6d-f956f0648dcc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.346162 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d24c5143-dcf6-4fdd-8a30-547ba7632f55 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0" status: 202 len: 0 microversion: 2.1 time: 0.830428 Jul 20 04:21:31.347390 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1378/2525] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:21:30 2022] DELETE /compute/v2.1/os-security-groups/d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 => generated 0 bytes in 833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:31.353497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3c7b95e9-9a9d-46be-8c6d-368a98546e97 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:31.386384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.compute.server_groups [None req-3c7b95e9-9a9d-46be-8c6d-368a98546e97 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Querying cell fbf41b76-8148-4f7f-88f5-d6fd988c2859(cell1) for 1 instances {{(pid=127871) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:21:31.390440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c7b95e9-9a9d-46be-8c6d-368a98546e97 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.392074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c7b95e9-9a9d-46be-8c6d-368a98546e97 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.441962 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3c7b95e9-9a9d-46be-8c6d-368a98546e97 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/b0b195da-a2a2-4a34-be15-76e508e84229" status: 200 len: 221 microversion: 2.1 time: 0.092835 Jul 20 04:21:31.443229 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1379/2526] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:21:31 2022] GET /compute/v2.1/os-server-groups/b0b195da-a2a2-4a34-be15-76e508e84229 => generated 221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:31.457235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-210f1c37-22ef-42e5-8b16-1e532dfb6cd1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06be1c5790>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:31.752001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6d342e0c-0ea8-425b-be6d-f956f0648dcc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:31.763447 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6d342e0c-0ea8-425b-be6d-f956f0648dcc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c" status: 200 len: 1314 microversion: 2.1 time: 0.451451 Jul 20 04:21:31.776100 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1148/2527] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:31 2022] GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:31.781348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a710cc10-5ee2-4a07-9a0a-78716360485e tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:31.781873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a710cc10-5ee2-4a07-9a0a-78716360485e tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:31.790033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a710cc10-5ee2-4a07-9a0a-78716360485e tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.790465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a710cc10-5ee2-4a07-9a0a-78716360485e tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.791259 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a710cc10-5ee2-4a07-9a0a-78716360485e tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.791708 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a710cc10-5ee2-4a07-9a0a-78716360485e tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.838867 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a710cc10-5ee2-4a07-9a0a-78716360485e tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:21:31.996799 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a710cc10-5ee2-4a07-9a0a-78716360485e tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "DELETE /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 204 len: 0 microversion: 2.1 time: 0.218430 Jul 20 04:21:31.997548 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1149/2528] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:31 2022] DELETE /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:21:32.015099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-14281e83-77d3-4484-a6af-480bf8f2df9a tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:32.017473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-14281e83-77d3-4484-a6af-480bf8f2df9a tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:32.027996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14281e83-77d3-4484-a6af-480bf8f2df9a tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:32.029593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14281e83-77d3-4484-a6af-480bf8f2df9a tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:32.030613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14281e83-77d3-4484-a6af-480bf8f2df9a tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:32.031432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14281e83-77d3-4484-a6af-480bf8f2df9a tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:32.385433 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-210f1c37-22ef-42e5-8b16-1e532dfb6cd1 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/5529f1b8-a4ed-4179-b435-1371d16fd836" status: 202 len: 0 microversion: 2.1 time: 0.933249 Jul 20 04:21:32.386165 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1380/2529] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:21:31 2022] DELETE /compute/v2.1/os-security-groups/5529f1b8-a4ed-4179-b435-1371d16fd836 => generated 0 bytes in 935 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:32.398583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7ecd7aac-0762-4e20-8278-5ab4a0649687 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:32.402874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7ecd7aac-0762-4e20-8278-5ab4a0649687 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:32.416349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ecd7aac-0762-4e20-8278-5ab4a0649687 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:32.417769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ecd7aac-0762-4e20-8278-5ab4a0649687 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:32.420636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ecd7aac-0762-4e20-8278-5ab4a0649687 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:32.421747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ecd7aac-0762-4e20-8278-5ab4a0649687 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:32.558994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-14281e83-77d3-4484-a6af-480bf8f2df9a tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:32.571699 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-14281e83-77d3-4484-a6af-480bf8f2df9a tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1505 microversion: 2.1 time: 0.568406 Jul 20 04:21:32.586882 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1150/2530] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:32 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1505 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:32.600806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-01e069e8-89bf-47bd-9dd4-ce0b06707846 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Action: 'create', calling method: .version_select at 0x7f06be9b3700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-716424065", "description": "tempest-description-172865044"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:32.900970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7ecd7aac-0762-4e20-8278-5ab4a0649687 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:32.923720 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7ecd7aac-0762-4e20-8278-5ab4a0649687 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1472 microversion: 2.1 time: 0.536011 Jul 20 04:21:32.932869 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1381/2531] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:32 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1472 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:32.933360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-a11c1fc4-b20c-459a-a692-25588b9eee30 req-91e79a3d-f6f5-4099-b475-1d3a86984eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1be9b8-b9ff-40ea-a63a-d01d38a96102", "name": "network-vif-unplugged", "status": "completed", "tag": "f6cbea3d-636a-48f6-a62e-de1624ae8f8b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:33.033902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a11c1fc4-b20c-459a-a692-25588b9eee30 req-91e79a3d-f6f5-4099-b475-1d3a86984eeb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:33.035800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a11c1fc4-b20c-459a-a692-25588b9eee30 req-91e79a3d-f6f5-4099-b475-1d3a86984eeb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:33.065347 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-a11c1fc4-b20c-459a-a692-25588b9eee30 req-91e79a3d-f6f5-4099-b475-1d3a86984eeb service nova] Creating event network-vif-unplugged:f6cbea3d-636a-48f6-a62e-de1624ae8f8b for instance ff1be9b8-b9ff-40ea-a63a-d01d38a96102 on n-h2-826526-5 Jul 20 04:21:33.073264 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-a11c1fc4-b20c-459a-a692-25588b9eee30 req-91e79a3d-f6f5-4099-b475-1d3a86984eeb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.147082 Jul 20 04:21:33.074177 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1382/2532] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:33.088414 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-37d7bc7f-d946-44a6-a3d1-024f374b72e7 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:33.091928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-37d7bc7f-d946-44a6-a3d1-024f374b72e7 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:33.104201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37d7bc7f-d946-44a6-a3d1-024f374b72e7 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:33.106265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37d7bc7f-d946-44a6-a3d1-024f374b72e7 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:33.107662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37d7bc7f-d946-44a6-a3d1-024f374b72e7 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:33.109235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37d7bc7f-d946-44a6-a3d1-024f374b72e7 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:33.565821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-37d7bc7f-d946-44a6-a3d1-024f374b72e7 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:33.575240 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-37d7bc7f-d946-44a6-a3d1-024f374b72e7 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c" status: 200 len: 1314 microversion: 2.1 time: 0.498253 Jul 20 04:21:33.587256 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1383/2533] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:33 2022] GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:33.592795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-444c98f0-901b-440f-a74b-d21f1231ad19 req-9f3ba3ec-cc4b-48c3-8858-addd4c444b91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98b1f0db-8edc-44e8-a1ea-7c5efff1534c", "tag": "ffb541a6-bf04-450c-9d5f-88a72fda1a31"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:33.615364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-444c98f0-901b-440f-a74b-d21f1231ad19 req-9f3ba3ec-cc4b-48c3-8858-addd4c444b91 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:33.616103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-444c98f0-901b-440f-a74b-d21f1231ad19 req-9f3ba3ec-cc4b-48c3-8858-addd4c444b91 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:33.649394 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-444c98f0-901b-440f-a74b-d21f1231ad19 req-9f3ba3ec-cc4b-48c3-8858-addd4c444b91 service nova] Creating event network-changed:ffb541a6-bf04-450c-9d5f-88a72fda1a31 for instance 98b1f0db-8edc-44e8-a1ea-7c5efff1534c on n-h2-826526-5 Jul 20 04:21:33.653018 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-01e069e8-89bf-47bd-9dd4-ce0b06707846 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.065541 Jul 20 04:21:33.654509 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1151/2534] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:21:32 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:33.661395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-215953ce-a4ca-4d22-961a-6c7dc5a6e144 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:33.663120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-215953ce-a4ca-4d22-961a-6c7dc5a6e144 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:33.686395 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-444c98f0-901b-440f-a74b-d21f1231ad19 req-9f3ba3ec-cc4b-48c3-8858-addd4c444b91 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096125 Jul 20 04:21:33.687725 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1384/2535] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:33.689755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-215953ce-a4ca-4d22-961a-6c7dc5a6e144 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:33.692651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-215953ce-a4ca-4d22-961a-6c7dc5a6e144 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:33.697279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-215953ce-a4ca-4d22-961a-6c7dc5a6e144 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:33.698026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-215953ce-a4ca-4d22-961a-6c7dc5a6e144 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:33.708648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-70b0e0f2-b155-4016-8a07-14edd163e9ab tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Action: 'update', calling method: .version_select at 0x7f06bdeecc10>, body: {"security_group": {"name": "tempest-sg-hth-749882069", "description": "tempest-description-hth-100473916"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:33.727613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:34.652792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:35.238301 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-70b0e0f2-b155-4016-8a07-14edd163e9ab tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "PUT /compute/v2.1/os-security-groups/24383ce4-e743-4447-9851-a845e487c8ff" status: 200 len: 216 microversion: 2.1 time: 1.546835 Jul 20 04:21:35.239073 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1385/2536] 10.222.0.17 () {60 vars in 1289 bytes} [Wed Jul 20 04:21:33 2022] PUT /compute/v2.1/os-security-groups/24383ce4-e743-4447-9851-a845e487c8ff => generated 216 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:35.244926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d7b9b7c3-6f0e-4509-9afb-03b178ac8e57 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:35.246146 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d7b9b7c3-6f0e-4509-9afb-03b178ac8e57 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:35.269057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7b9b7c3-6f0e-4509-9afb-03b178ac8e57 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:35.269763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7b9b7c3-6f0e-4509-9afb-03b178ac8e57 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:35.271235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7b9b7c3-6f0e-4509-9afb-03b178ac8e57 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:35.276929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7b9b7c3-6f0e-4509-9afb-03b178ac8e57 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:35.310824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:35.551402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-215953ce-a4ca-4d22-961a-6c7dc5a6e144 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:35.569072 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-215953ce-a4ca-4d22-961a-6c7dc5a6e144 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1505 microversion: 2.1 time: 1.913267 Jul 20 04:21:35.576315 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1152/2537] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:33 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1505 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:35.591078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-28bb929a-2e77-42a0-8ee2-f42dc8f8c9ae tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:35.593048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-28bb929a-2e77-42a0-8ee2-f42dc8f8c9ae tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:35.605453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28bb929a-2e77-42a0-8ee2-f42dc8f8c9ae tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:35.609555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28bb929a-2e77-42a0-8ee2-f42dc8f8c9ae tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:35.610647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28bb929a-2e77-42a0-8ee2-f42dc8f8c9ae tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:35.619655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28bb929a-2e77-42a0-8ee2-f42dc8f8c9ae tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:35.942231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d7b9b7c3-6f0e-4509-9afb-03b178ac8e57 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:35.951407 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d7b9b7c3-6f0e-4509-9afb-03b178ac8e57 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1472 microversion: 2.1 time: 0.711003 Jul 20 04:21:35.966366 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1386/2538] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:35 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1472 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:35.973290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fa1a282b-2051-4a68-8bac-332054033591 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06bdd3ae50>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:36.505357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-28bb929a-2e77-42a0-8ee2-f42dc8f8c9ae tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:36.531498 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-28bb929a-2e77-42a0-8ee2-f42dc8f8c9ae tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c" status: 200 len: 1314 microversion: 2.1 time: 0.944132 Jul 20 04:21:36.552602 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1153/2539] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:35 2022] GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c => generated 1314 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:36.600451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d483cafd-d597-47bf-a559-35469ebb2ebd tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:36.604126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d483cafd-d597-47bf-a559-35469ebb2ebd tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:36.653241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d483cafd-d597-47bf-a559-35469ebb2ebd tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:36.653703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d483cafd-d597-47bf-a559-35469ebb2ebd tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:36.654505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d483cafd-d597-47bf-a559-35469ebb2ebd tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:36.654948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d483cafd-d597-47bf-a559-35469ebb2ebd tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:36.777141 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fa1a282b-2051-4a68-8bac-332054033591 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/24383ce4-e743-4447-9851-a845e487c8ff" status: 200 len: 216 microversion: 2.1 time: 0.816305 Jul 20 04:21:36.777942 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1387/2540] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 04:21:35 2022] GET /compute/v2.1/os-security-groups/24383ce4-e743-4447-9851-a845e487c8ff => generated 216 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:36.796017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2b17874c-a108-4a76-a8c8-1c823fe651e7 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06bdeb8160>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:37.301357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d483cafd-d597-47bf-a559-35469ebb2ebd tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13c4ff6d8814e0b86c6e5be78d80300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e6196788984b23be749aa5dd384673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:37.314794 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d483cafd-d597-47bf-a559-35469ebb2ebd tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 200 len: 1463 microversion: 2.1 time: 0.724911 Jul 20 04:21:37.316322 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1154/2541] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:36 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 1463 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:37.334137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c13b44d4-c453-4d2f-9965-d4bb14841d17 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:37.334978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c13b44d4-c453-4d2f-9965-d4bb14841d17 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:37.353657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c13b44d4-c453-4d2f-9965-d4bb14841d17 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:37.354134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c13b44d4-c453-4d2f-9965-d4bb14841d17 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:37.354957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c13b44d4-c453-4d2f-9965-d4bb14841d17 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:37.355411 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c13b44d4-c453-4d2f-9965-d4bb14841d17 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:37.774831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c13b44d4-c453-4d2f-9965-d4bb14841d17 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d729a66b42428cb90920e80d8a06ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd883ef732fba496db095a9ba2202a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:37.786311 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c13b44d4-c453-4d2f-9965-d4bb14841d17 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 200 len: 1430 microversion: 2.1 time: 0.467999 Jul 20 04:21:37.787468 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1155/2542] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:37 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 1430 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:37.802011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a5a347cd-2c55-43d0-bf02-297f4a109962 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:37.802690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a5a347cd-2c55-43d0-bf02-297f4a109962 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:37.822819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5a347cd-2c55-43d0-bf02-297f4a109962 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:37.823612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5a347cd-2c55-43d0-bf02-297f4a109962 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:37.825017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5a347cd-2c55-43d0-bf02-297f4a109962 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:37.825636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5a347cd-2c55-43d0-bf02-297f4a109962 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:38.681461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a5a347cd-2c55-43d0-bf02-297f4a109962 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:38.693189 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a5a347cd-2c55-43d0-bf02-297f4a109962 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c" status: 200 len: 1314 microversion: 2.1 time: 0.904244 Jul 20 04:21:38.693915 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1156/2543] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:37 2022] GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c => generated 1314 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:38.716661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-5618d8e6-7543-4285-bf86-aa75832a8b10 req-51bd5519-324c-43a6-a2f3-8b7aaa6adf07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1be9b8-b9ff-40ea-a63a-d01d38a96102", "name": "network-vif-deleted", "tag": "f6cbea3d-636a-48f6-a62e-de1624ae8f8b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:38.758815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5618d8e6-7543-4285-bf86-aa75832a8b10 req-51bd5519-324c-43a6-a2f3-8b7aaa6adf07 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:38.759262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5618d8e6-7543-4285-bf86-aa75832a8b10 req-51bd5519-324c-43a6-a2f3-8b7aaa6adf07 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:38.794992 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-5618d8e6-7543-4285-bf86-aa75832a8b10 req-51bd5519-324c-43a6-a2f3-8b7aaa6adf07 service nova] Creating event network-vif-deleted:f6cbea3d-636a-48f6-a62e-de1624ae8f8b for instance ff1be9b8-b9ff-40ea-a63a-d01d38a96102 on n-h2-826526-5 Jul 20 04:21:38.817509 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-5618d8e6-7543-4285-bf86-aa75832a8b10 req-51bd5519-324c-43a6-a2f3-8b7aaa6adf07 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112221 Jul 20 04:21:38.819366 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1157/2544] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:39.092196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-8c91fa70-9797-4a76-ac27-3a15b551d0a6 req-9cb209c6-77ea-4b26-9cf0-5bd823a67cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122d7f8a-8307-4b34-b5b5-0b98a961c340", "name": "network-vif-deleted", "tag": "a43a640d-ba5f-4937-b46e-36f7af65c087"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:39.110204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8c91fa70-9797-4a76-ac27-3a15b551d0a6 req-9cb209c6-77ea-4b26-9cf0-5bd823a67cf5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.125124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8c91fa70-9797-4a76-ac27-3a15b551d0a6 req-9cb209c6-77ea-4b26-9cf0-5bd823a67cf5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.141501 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-8c91fa70-9797-4a76-ac27-3a15b551d0a6 req-9cb209c6-77ea-4b26-9cf0-5bd823a67cf5 service nova] Creating event network-vif-deleted:a43a640d-ba5f-4937-b46e-36f7af65c087 for instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 on n-h2-826526-5 Jul 20 04:21:39.147415 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-8c91fa70-9797-4a76-ac27-3a15b551d0a6 req-9cb209c6-77ea-4b26-9cf0-5bd823a67cf5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.326206 Jul 20 04:21:39.148748 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1158/2545] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:39.173493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-90e74b51-cbc5-49fb-b63e-1aca0fc9ad70 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:39.174600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-90e74b51-cbc5-49fb-b63e-1aca0fc9ad70 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:39.183125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90e74b51-cbc5-49fb-b63e-1aca0fc9ad70 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.183947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90e74b51-cbc5-49fb-b63e-1aca0fc9ad70 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.185434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90e74b51-cbc5-49fb-b63e-1aca0fc9ad70 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.186183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90e74b51-cbc5-49fb-b63e-1aca0fc9ad70 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.186607 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2b17874c-a108-4a76-a8c8-1c823fe651e7 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/24383ce4-e743-4447-9851-a845e487c8ff" status: 202 len: 0 microversion: 2.1 time: 2.396905 Jul 20 04:21:39.195883 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1388/2546] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:21:36 2022] DELETE /compute/v2.1/os-security-groups/24383ce4-e743-4447-9851-a845e487c8ff => generated 0 bytes in 2407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:39.202954 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-90e74b51-cbc5-49fb-b63e-1aca0fc9ad70 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] HTTP exception thrown: Instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 could not be found. Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-90e74b51-cbc5-49fb-b63e-1aca0fc9ad70 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Request method failure captured: Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 HTTP/1.1 Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14KpKuPo_5WCP4zZqpoY6YlBFsMbw4VwzEWKntfNQ5LkrtLQw_iDg-Dle-JK4ZWHpQ5WiBXC1PFIs7GY4eBvEV8VldihxdshcbEHRKfzCgiDKUFALy3xn_iMNzCOdPbmKUwJ2VwPbzPQRlyn3aEBtzyxpcNOAtX7_XEXgTAfihHOZi8 Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: f8e6196788984b23be749aa5dd384673 Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:21:39.207460 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:21:39.209465 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f8e6196788984b23be749aa5dd384673"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f8e6196788984b23be749aa5dd384673"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f8e6196788984b23be749aa5dd384673", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f8e6196788984b23be749aa5dd384673"}]}] Jul 20 04:21:39.209465 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:39.209465 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: f8e6196788984b23be749aa5dd384673 Jul 20 04:21:39.209465 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:39.209465 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerGroupTestJSON-859584202-project Jul 20 04:21:39.209465 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:21:39.209465 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:21:39.209465 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f13c4ff6d8814e0b86c6e5be78d80300 Jul 20 04:21:39.209465 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerGroupTestJSON-859584202-project Jul 20 04:21:39.209465 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:21:39.209465 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 could not be found. Jul 20 04:21:39.209465 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '122d7f8a-8307-4b34-b5b5-0b98a961c340'} Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 could not be found. Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:39.210231 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:39.211498 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:39.211498 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:39.211498 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:39.211498 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:39.211498 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:39.211498 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:39.211498 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:39.211498 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 could not be found. Jul 20 04:21:39.211498 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.211498 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:39.211498 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.211498 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.211498 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:39.211498 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:39.211498 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:39.211498 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:39.211498 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 could not be found. Jul 20 04:21:39.211498 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.214654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-95aa7330-0dda-4af5-9de7-bc73e9ce9281 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:39.214654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-95aa7330-0dda-4af5-9de7-bc73e9ce9281 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] [instance: ff1be9b8-b9ff-40ea-a63a-d01d38a96102] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:39.221457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-90e74b51-cbc5-49fb-b63e-1aca0fc9ad70 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Returning 404 to user: Instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:39.222847 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-90e74b51-cbc5-49fb-b63e-1aca0fc9ad70 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 404 len: 111 microversion: 2.1 time: 0.072599 Jul 20 04:21:39.226487 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1159/2547] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:39 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:39.233044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-95aa7330-0dda-4af5-9de7-bc73e9ce9281 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.236669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-95aa7330-0dda-4af5-9de7-bc73e9ce9281 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.239807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-23de889a-6608-4b75-afe9-32376f03d36a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:39.240580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-95aa7330-0dda-4af5-9de7-bc73e9ce9281 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.241045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-95aa7330-0dda-4af5-9de7-bc73e9ce9281 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.248507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-23de889a-6608-4b75-afe9-32376f03d36a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:39.263113 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23de889a-6608-4b75-afe9-32376f03d36a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.263835 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23de889a-6608-4b75-afe9-32376f03d36a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.265028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23de889a-6608-4b75-afe9-32376f03d36a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.265738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23de889a-6608-4b75-afe9-32376f03d36a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.272883 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-95aa7330-0dda-4af5-9de7-bc73e9ce9281 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] HTTP exception thrown: Instance ff1be9b8-b9ff-40ea-a63a-d01d38a96102 could not be found. Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-95aa7330-0dda-4af5-9de7-bc73e9ce9281 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Request method failure captured: Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 HTTP/1.1 Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Jqjep9Tgv-ixep_e_5DOyJvgMJbqB_43o0Bd8u6QwZsUO1pLaUEiHDKiUnVmcNkmDg6mNc9alRhXiKXDcort_2eibP9JXV1s1RK-CRS7h1JXU22kp-U5zyBWlb68nOKoDRBRHNl0sD819nHDvufMrlmhobsuymfH-2QNcVU-qHaNk Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: d883ef732fba496db095a9ba2202a304 Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesOneServerTestJSON-939634403 Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:21:39.284201 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:21:39.286737 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d883ef732fba496db095a9ba2202a304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d883ef732fba496db095a9ba2202a304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d883ef732fba496db095a9ba2202a304", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d883ef732fba496db095a9ba2202a304"}]}] Jul 20 04:21:39.286737 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesOneServerTestJSON-939634403 Jul 20 04:21:39.286737 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: d883ef732fba496db095a9ba2202a304 Jul 20 04:21:39.286737 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-939634403 Jul 20 04:21:39.286737 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesOneServerTestJSON-939634403-project Jul 20 04:21:39.286737 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:21:39.286737 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:21:39.286737 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: b3d729a66b42428cb90920e80d8a06ce Jul 20 04:21:39.286737 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesOneServerTestJSON-939634403-project Jul 20 04:21:39.286737 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:21:39.286737 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance ff1be9b8-b9ff-40ea-a63a-d01d38a96102 could not be found. Jul 20 04:21:39.286737 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'ff1be9b8-b9ff-40ea-a63a-d01d38a96102'} Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff1be9b8-b9ff-40ea-a63a-d01d38a96102 could not be found. Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:39.292443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:39.313799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:39.313799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:39.313799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:39.313799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:39.313799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:39.313799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:39.313799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:39.313799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff1be9b8-b9ff-40ea-a63a-d01d38a96102 could not be found. Jul 20 04:21:39.313799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.313799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:39.313799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.313799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.313799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:39.313799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:39.313799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:39.313799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:39.313799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff1be9b8-b9ff-40ea-a63a-d01d38a96102 could not be found. Jul 20 04:21:39.313799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-23de889a-6608-4b75-afe9-32376f03d36a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] HTTP exception thrown: Instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 could not be found. Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-23de889a-6608-4b75-afe9-32376f03d36a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Request method failure captured: Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 HTTP/1.1 Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14JfAGKjPuA6ODJ-Qtd1em2O9yA3rahErotNYmVH9cKLqXeleHpCho0NIxaqZH7I3kILCGiDqMrjK0vy8DvdBt2Jb59H_-WliyaefNEp44gjG3S0TsxNI_vZzHSAfQzFRseRskmabnqYG7qLPbXQPBbvdUJJYh9qJrSBMBDZ9FAEz1w Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:21:39.318425 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:21:39.324686 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373f9f5b2b9f44fdba67acfc147b7d84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}] Jul 20 04:21:39.324686 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:39.324686 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:39.324686 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:39.324686 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:39.324686 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:21:39.324686 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:21:39.324686 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 539cb225b4b0422c9f19e0eb18c8983e Jul 20 04:21:39.324686 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:39.324686 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:21:39.324686 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 could not be found. Jul 20 04:21:39.324686 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '51c0981d-36c0-4e76-ab07-6e9e52a20635'} Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 could not be found. Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:39.327586 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 could not be found. Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 could not be found. Jul 20 04:21:39.340453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.352790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-23de889a-6608-4b75-afe9-32376f03d36a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Returning 404 to user: Instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:39.352790 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-23de889a-6608-4b75-afe9-32376f03d36a tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 404 len: 111 microversion: 2.1 time: 0.086440 Jul 20 04:21:39.352790 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1160/2548] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:39 2022] DELETE /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:39.358189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-95aa7330-0dda-4af5-9de7-bc73e9ce9281 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] Returning 404 to user: Instance ff1be9b8-b9ff-40ea-a63a-d01d38a96102 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:39.358189 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-95aa7330-0dda-4af5-9de7-bc73e9ce9281 tempest-ImagesOneServerTestJSON-939634403 tempest-ImagesOneServerTestJSON-939634403-project] 10.222.0.17 "GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102" status: 404 len: 111 microversion: 2.1 time: 0.134292 Jul 20 04:21:39.358884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-abf665c2-03ec-4e5a-9938-007693c8b40c tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:39.359150 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1389/2549] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:39 2022] GET /compute/v2.1/servers/ff1be9b8-b9ff-40ea-a63a-d01d38a96102 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:39.377097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-33a5cedd-1290-4b06-9875-3999fb15cf07 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:39.380960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-33a5cedd-1290-4b06-9875-3999fb15cf07 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: 51c0981d-36c0-4e76-ab07-6e9e52a20635] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:39.395647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.compute.server_groups [None req-abf665c2-03ec-4e5a-9938-007693c8b40c tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Querying cell fbf41b76-8148-4f7f-88f5-d6fd988c2859(cell1) for 1 instances {{(pid=127870) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:21:39.396509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-abf665c2-03ec-4e5a-9938-007693c8b40c tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.402086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-abf665c2-03ec-4e5a-9938-007693c8b40c tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.411542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33a5cedd-1290-4b06-9875-3999fb15cf07 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.413432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33a5cedd-1290-4b06-9875-3999fb15cf07 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.416084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33a5cedd-1290-4b06-9875-3999fb15cf07 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.418112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33a5cedd-1290-4b06-9875-3999fb15cf07 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.424774 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-abf665c2-03ec-4e5a-9938-007693c8b40c tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.103356 Jul 20 04:21:39.428851 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1161/2550] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:21:39 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:39.437072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-46cc9540-665b-4fb0-aaeb-f43ad18a1b2d tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:39.474247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.compute.server_groups [None req-46cc9540-665b-4fb0-aaeb-f43ad18a1b2d tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Querying cell fbf41b76-8148-4f7f-88f5-d6fd988c2859(cell1) for 1 instances {{(pid=127870) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:21:39.475629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46cc9540-665b-4fb0-aaeb-f43ad18a1b2d tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.476376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46cc9540-665b-4fb0-aaeb-f43ad18a1b2d tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.490031 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-33a5cedd-1290-4b06-9875-3999fb15cf07 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] HTTP exception thrown: Instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 could not be found. Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-33a5cedd-1290-4b06-9875-3999fb15cf07 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Request method failure captured: Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 HTTP/1.1 Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14JfAGKjPuA6ODJ-Qtd1em2O9yA3rahErotNYmVH9cKLqXeleHpCho0NIxaqZH7I3kILCGiDqMrjK0vy8DvdBt2Jb59H_-WliyaefNEp44gjG3S0TsxNI_vZzHSAfQzFRseRskmabnqYG7qLPbXQPBbvdUJJYh9qJrSBMBDZ9FAEz1w Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:21:39.500621 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:21:39.503418 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373f9f5b2b9f44fdba67acfc147b7d84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}] Jul 20 04:21:39.503418 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:39.503418 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:39.503418 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:39.503418 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:39.503418 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:21:39.503418 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:21:39.503418 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 539cb225b4b0422c9f19e0eb18c8983e Jul 20 04:21:39.503418 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:39.503418 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:21:39.503418 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 could not be found. Jul 20 04:21:39.503418 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '51c0981d-36c0-4e76-ab07-6e9e52a20635'} Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 could not be found. Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:39.505002 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:39.509191 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:39.509191 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:39.509191 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:39.509191 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:39.509191 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:39.509191 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:39.509191 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:39.509191 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 could not be found. Jul 20 04:21:39.509191 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.509191 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:39.509191 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.509191 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.509191 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:39.509191 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:39.509191 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:39.509191 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:39.509191 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 could not be found. Jul 20 04:21:39.509191 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.519538 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-46cc9540-665b-4fb0-aaeb-f43ad18a1b2d tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/b0b195da-a2a2-4a34-be15-76e508e84229" status: 200 len: 183 microversion: 2.1 time: 0.083196 Jul 20 04:21:39.520572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-33a5cedd-1290-4b06-9875-3999fb15cf07 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Returning 404 to user: Instance 51c0981d-36c0-4e76-ab07-6e9e52a20635 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:39.520572 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-33a5cedd-1290-4b06-9875-3999fb15cf07 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635" status: 404 len: 111 microversion: 2.1 time: 0.175758 Jul 20 04:21:39.521330 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1162/2551] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:21:39 2022] GET /compute/v2.1/os-server-groups/b0b195da-a2a2-4a34-be15-76e508e84229 => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:39.525458 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1390/2552] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:39 2022] GET /compute/v2.1/servers/51c0981d-36c0-4e76-ab07-6e9e52a20635 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:39.529318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fd5c1d4a-5847-435a-a41d-6a43a4ba0a9c tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06c74591f0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:39.534963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-043e0745-223a-41b4-b1ac-6ed77f48f44f tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:39.538719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-043e0745-223a-41b4-b1ac-6ed77f48f44f tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:39.555186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-043e0745-223a-41b4-b1ac-6ed77f48f44f tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.555822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-043e0745-223a-41b4-b1ac-6ed77f48f44f tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.556660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-043e0745-223a-41b4-b1ac-6ed77f48f44f tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.557102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-043e0745-223a-41b4-b1ac-6ed77f48f44f tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.587158 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-043e0745-223a-41b4-b1ac-6ed77f48f44f tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] HTTP exception thrown: Instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 could not be found. Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-043e0745-223a-41b4-b1ac-6ed77f48f44f tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Request method failure captured: Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 HTTP/1.1 Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14KpKuPo_5WCP4zZqpoY6YlBFsMbw4VwzEWKntfNQ5LkrtLQw_iDg-Dle-JK4ZWHpQ5WiBXC1PFIs7GY4eBvEV8VldihxdshcbEHRKfzCgiDKUFALy3xn_iMNzCOdPbmKUwJ2VwPbzPQRlyn3aEBtzyxpcNOAtX7_XEXgTAfihHOZi8 Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: f8e6196788984b23be749aa5dd384673 Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:21:39.593327 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:21:39.595706 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f8e6196788984b23be749aa5dd384673"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f8e6196788984b23be749aa5dd384673"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f8e6196788984b23be749aa5dd384673", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f8e6196788984b23be749aa5dd384673"}]}] Jul 20 04:21:39.595706 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:39.595706 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: f8e6196788984b23be749aa5dd384673 Jul 20 04:21:39.595706 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:39.595706 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerGroupTestJSON-859584202-project Jul 20 04:21:39.595706 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:21:39.595706 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:21:39.595706 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f13c4ff6d8814e0b86c6e5be78d80300 Jul 20 04:21:39.595706 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerGroupTestJSON-859584202-project Jul 20 04:21:39.595706 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:21:39.595706 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 could not be found. Jul 20 04:21:39.595706 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '122d7f8a-8307-4b34-b5b5-0b98a961c340'} Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 could not be found. Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:39.601119 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 could not be found. Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 could not be found. Jul 20 04:21:39.605926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.612460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-043e0745-223a-41b4-b1ac-6ed77f48f44f tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Returning 404 to user: Instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:39.612460 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-043e0745-223a-41b4-b1ac-6ed77f48f44f tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "DELETE /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 404 len: 111 microversion: 2.1 time: 0.068493 Jul 20 04:21:39.612460 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1391/2553] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:39 2022] DELETE /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:39.618369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a5781b67-e410-46a6-b16e-326cdc8e5356 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:39.619065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a5781b67-e410-46a6-b16e-326cdc8e5356 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] [instance: 122d7f8a-8307-4b34-b5b5-0b98a961c340] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:39.641586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5781b67-e410-46a6-b16e-326cdc8e5356 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.642041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5781b67-e410-46a6-b16e-326cdc8e5356 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.642825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5781b67-e410-46a6-b16e-326cdc8e5356 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.644897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5781b67-e410-46a6-b16e-326cdc8e5356 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.679635 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-a5781b67-e410-46a6-b16e-326cdc8e5356 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] HTTP exception thrown: Instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 could not be found. Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a5781b67-e410-46a6-b16e-326cdc8e5356 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Request method failure captured: Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 HTTP/1.1 Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14KpKuPo_5WCP4zZqpoY6YlBFsMbw4VwzEWKntfNQ5LkrtLQw_iDg-Dle-JK4ZWHpQ5WiBXC1PFIs7GY4eBvEV8VldihxdshcbEHRKfzCgiDKUFALy3xn_iMNzCOdPbmKUwJ2VwPbzPQRlyn3aEBtzyxpcNOAtX7_XEXgTAfihHOZi8 Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: f8e6196788984b23be749aa5dd384673 Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:21:39.690370 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:21:39.693127 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f8e6196788984b23be749aa5dd384673"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f8e6196788984b23be749aa5dd384673"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f8e6196788984b23be749aa5dd384673", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f8e6196788984b23be749aa5dd384673"}]}] Jul 20 04:21:39.693127 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:39.693127 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: f8e6196788984b23be749aa5dd384673 Jul 20 04:21:39.693127 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:39.693127 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerGroupTestJSON-859584202-project Jul 20 04:21:39.693127 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:21:39.693127 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:21:39.693127 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f13c4ff6d8814e0b86c6e5be78d80300 Jul 20 04:21:39.693127 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerGroupTestJSON-859584202-project Jul 20 04:21:39.693127 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:21:39.693127 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 could not be found. Jul 20 04:21:39.693127 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '122d7f8a-8307-4b34-b5b5-0b98a961c340'} Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 could not be found. Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:39.695198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:39.698093 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:39.698093 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:39.698093 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:39.698093 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:39.698093 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:39.698093 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:39.698093 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:39.698093 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 could not be found. Jul 20 04:21:39.698093 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.698093 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:39.698093 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.698093 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.698093 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:39.698093 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:39.698093 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:39.698093 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:39.698093 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 could not be found. Jul 20 04:21:39.698093 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.700479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a5781b67-e410-46a6-b16e-326cdc8e5356 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Returning 404 to user: Instance 122d7f8a-8307-4b34-b5b5-0b98a961c340 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:39.700479 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a5781b67-e410-46a6-b16e-326cdc8e5356 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340" status: 404 len: 111 microversion: 2.1 time: 0.091661 Jul 20 04:21:39.700479 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1392/2554] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:39 2022] GET /compute/v2.1/servers/122d7f8a-8307-4b34-b5b5-0b98a961c340 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:39.702279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a6d0778f-e8c1-454a-92eb-8be8ed4535e5 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:39.719427 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-a6d0778f-e8c1-454a-92eb-8be8ed4535e5 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] HTTP exception thrown: Instance group 381b2f0b-7f53-420e-8d62-1b54fe129f94 could not be found. Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a6d0778f-e8c1-454a-92eb-8be8ed4535e5 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Request method failure captured: Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/os-server-groups/381b2f0b-7f53-420e-8d62-1b54fe129f94 HTTP/1.1 Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14KpKuPo_5WCP4zZqpoY6YlBFsMbw4VwzEWKntfNQ5LkrtLQw_iDg-Dle-JK4ZWHpQ5WiBXC1PFIs7GY4eBvEV8VldihxdshcbEHRKfzCgiDKUFALy3xn_iMNzCOdPbmKUwJ2VwPbzPQRlyn3aEBtzyxpcNOAtX7_XEXgTAfihHOZi8 Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: f8e6196788984b23be749aa5dd384673 Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:21:39.727540 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:21:39.730042 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f8e6196788984b23be749aa5dd384673"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f8e6196788984b23be749aa5dd384673"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f8e6196788984b23be749aa5dd384673", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f8e6196788984b23be749aa5dd384673"}]}] Jul 20 04:21:39.730042 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:39.730042 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: f8e6196788984b23be749aa5dd384673 Jul 20 04:21:39.730042 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:39.730042 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerGroupTestJSON-859584202-project Jul 20 04:21:39.730042 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:21:39.730042 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:21:39.730042 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f13c4ff6d8814e0b86c6e5be78d80300 Jul 20 04:21:39.730042 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerGroupTestJSON-859584202-project Jul 20 04:21:39.730042 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:21:39.730042 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance group 381b2f0b-7f53-420e-8d62-1b54fe129f94 could not be found. Jul 20 04:21:39.730042 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '381b2f0b-7f53-420e-8d62-1b54fe129f94'} Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 381b2f0b-7f53-420e-8d62-1b54fe129f94 could not be found. Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:39.734371 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:39.737025 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:39.737025 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:39.737025 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:39.737025 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:39.737025 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:21:39.737025 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:39.737025 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 381b2f0b-7f53-420e-8d62-1b54fe129f94 could not be found. Jul 20 04:21:39.737025 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.737025 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:39.737025 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.737025 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.737025 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:39.737025 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:39.737025 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:39.737025 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:39.737025 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 381b2f0b-7f53-420e-8d62-1b54fe129f94 could not be found. Jul 20 04:21:39.737025 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.739345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a6d0778f-e8c1-454a-92eb-8be8ed4535e5 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Returning 404 to user: Instance group 381b2f0b-7f53-420e-8d62-1b54fe129f94 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:39.739345 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a6d0778f-e8c1-454a-92eb-8be8ed4535e5 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/381b2f0b-7f53-420e-8d62-1b54fe129f94" status: 404 len: 117 microversion: 2.1 time: 0.030660 Jul 20 04:21:39.739345 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1393/2555] 10.222.0.17 () {58 vars in 1265 bytes} [Wed Jul 20 04:21:39 2022] DELETE /compute/v2.1/os-server-groups/381b2f0b-7f53-420e-8d62-1b54fe129f94 => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:21:39.762108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-adb5c86f-a04b-40a5-a5da-efc07729afa0 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:39.762739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-adb5c86f-a04b-40a5-a5da-efc07729afa0 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:39.782888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adb5c86f-a04b-40a5-a5da-efc07729afa0 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.785344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adb5c86f-a04b-40a5-a5da-efc07729afa0 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.788364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adb5c86f-a04b-40a5-a5da-efc07729afa0 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.789028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adb5c86f-a04b-40a5-a5da-efc07729afa0 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:40.230452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG neutronclient.v2_0.client [None req-fd5c1d4a-5847-435a-a41d-6a43a4ba0a9c tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5529f1b8-a4ed-4179-b435-1371d16fd836 does not exist", "detail": ""}} {{(pid=127870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:21:40.231419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.security_group_api [None req-fd5c1d4a-5847-435a-a41d-6a43a4ba0a9c tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Neutron security group 5529f1b8-a4ed-4179-b435-1371d16fd836 not found {{(pid=127870) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:21:40.232155 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-fd5c1d4a-5847-435a-a41d-6a43a4ba0a9c tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] HTTP exception thrown: Security group 5529f1b8-a4ed-4179-b435-1371d16fd836 does not exist Jul 20 04:21:40.232155 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-cedc23c5-8b63-4857-85a9-874aa356c551'] Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fd5c1d4a-5847-435a-a41d-6a43a4ba0a9c tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Request method failure captured: Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/os-security-groups/5529f1b8-a4ed-4179-b435-1371d16fd836 HTTP/1.1 Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14JfAGKjPuA6ODJ-Qtd1em2O9yA3rahErotNYmVH9cKLqXeleHpCho0NIxaqZH7I3kILCGiDqMrjK0vy8DvdBt2Jb59H_-WliyaefNEp44gjG3S0TsxNI_vZzHSAfQzFRseRskmabnqYG7qLPbXQPBbvdUJJYh9qJrSBMBDZ9FAEz1w Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:21:40.235211 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:21:40.236908 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373f9f5b2b9f44fdba67acfc147b7d84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}] Jul 20 04:21:40.236908 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:40.236908 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:40.236908 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:40.236908 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:40.236908 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:21:40.236908 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:21:40.236908 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 539cb225b4b0422c9f19e0eb18c8983e Jul 20 04:21:40.236908 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:40.236908 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:21:40.236908 n-d-826526-5 devstack@n-api.service[127870]: exception: Security group 5529f1b8-a4ed-4179-b435-1371d16fd836 does not exist Jul 20 04:21:40.236908 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-cedc23c5-8b63-4857-85a9-874aa356c551'] Jul 20 04:21:40.236908 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '5529f1b8-a4ed-4179-b435-1371d16fd836'} Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.237958 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:21:40.239514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:21:40.239514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.239514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.239514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:21:40.239514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:21:40.239514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:21:40.239514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:21:40.239514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5529f1b8-a4ed-4179-b435-1371d16fd836 does not exist Jul 20 04:21:40.239514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cedc23c5-8b63-4857-85a9-874aa356c551'] Jul 20 04:21:40.239514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.239514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.239514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.239514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.239514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:21:40.239514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:21:40.239514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:21:40.239514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:21:40.239514 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5529f1b8-a4ed-4179-b435-1371d16fd836 does not exist Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cedc23c5-8b63-4857-85a9-874aa356c551'] Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5529f1b8-a4ed-4179-b435-1371d16fd836 does not exist Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cedc23c5-8b63-4857-85a9-874aa356c551'] Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.243098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.246318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:40.246318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:40.246318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:40.246318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:40.246318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5529f1b8-a4ed-4179-b435-1371d16fd836 does not exist Jul 20 04:21:40.246318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cedc23c5-8b63-4857-85a9-874aa356c551'] Jul 20 04:21:40.246318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.252587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fd5c1d4a-5847-435a-a41d-6a43a4ba0a9c tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Returning 404 to user: Security group 5529f1b8-a4ed-4179-b435-1371d16fd836 does not exist Jul 20 04:21:40.252587 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-cedc23c5-8b63-4857-85a9-874aa356c551'] {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:40.254751 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fd5c1d4a-5847-435a-a41d-6a43a4ba0a9c tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/5529f1b8-a4ed-4179-b435-1371d16fd836" status: 404 len: 194 microversion: 2.1 time: 0.730251 Jul 20 04:21:40.261810 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1163/2556] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:21:39 2022] DELETE /compute/v2.1/os-security-groups/5529f1b8-a4ed-4179-b435-1371d16fd836 => generated 194 bytes in 738 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:21:40.269298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b8560b5a-3f0e-446a-bd77-72b25ca11db6 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:40.277853 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-b8560b5a-3f0e-446a-bd77-72b25ca11db6 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] HTTP exception thrown: Instance group 12c3d0da-38eb-4df1-8e47-bc48d403be68 could not be found. Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b8560b5a-3f0e-446a-bd77-72b25ca11db6 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Request method failure captured: Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/os-server-groups/12c3d0da-38eb-4df1-8e47-bc48d403be68 HTTP/1.1 Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14KpKuPo_5WCP4zZqpoY6YlBFsMbw4VwzEWKntfNQ5LkrtLQw_iDg-Dle-JK4ZWHpQ5WiBXC1PFIs7GY4eBvEV8VldihxdshcbEHRKfzCgiDKUFALy3xn_iMNzCOdPbmKUwJ2VwPbzPQRlyn3aEBtzyxpcNOAtX7_XEXgTAfihHOZi8 Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: f8e6196788984b23be749aa5dd384673 Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:21:40.283350 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:21:40.286057 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f8e6196788984b23be749aa5dd384673"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f8e6196788984b23be749aa5dd384673"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f8e6196788984b23be749aa5dd384673", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f8e6196788984b23be749aa5dd384673"}]}] Jul 20 04:21:40.286057 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:40.286057 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: f8e6196788984b23be749aa5dd384673 Jul 20 04:21:40.286057 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:40.286057 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerGroupTestJSON-859584202-project Jul 20 04:21:40.286057 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:21:40.286057 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:21:40.286057 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f13c4ff6d8814e0b86c6e5be78d80300 Jul 20 04:21:40.286057 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerGroupTestJSON-859584202-project Jul 20 04:21:40.286057 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:21:40.286057 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance group 12c3d0da-38eb-4df1-8e47-bc48d403be68 could not be found. Jul 20 04:21:40.286057 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '12c3d0da-38eb-4df1-8e47-bc48d403be68'} Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 12c3d0da-38eb-4df1-8e47-bc48d403be68 could not be found. Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:40.290249 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:40.294863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:40.294863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:40.294863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:40.294863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:40.294863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:21:40.294863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:40.294863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 12c3d0da-38eb-4df1-8e47-bc48d403be68 could not be found. Jul 20 04:21:40.294863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.294863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.294863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.294863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.294863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:40.294863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:40.294863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:40.294863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:40.294863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 12c3d0da-38eb-4df1-8e47-bc48d403be68 could not be found. Jul 20 04:21:40.294863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.304911 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b8560b5a-3f0e-446a-bd77-72b25ca11db6 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Returning 404 to user: Instance group 12c3d0da-38eb-4df1-8e47-bc48d403be68 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:40.304911 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b8560b5a-3f0e-446a-bd77-72b25ca11db6 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/12c3d0da-38eb-4df1-8e47-bc48d403be68" status: 404 len: 117 microversion: 2.1 time: 0.039116 Jul 20 04:21:40.306331 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1164/2557] 10.222.0.17 () {58 vars in 1265 bytes} [Wed Jul 20 04:21:40 2022] DELETE /compute/v2.1/os-server-groups/12c3d0da-38eb-4df1-8e47-bc48d403be68 => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:40.313926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-939559da-4055-459c-a557-b48660f6ba3b tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06be9b3700>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:40.518994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG neutronclient.v2_0.client [None req-939559da-4055-459c-a557-b48660f6ba3b tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 does not exist", "detail": ""}} {{(pid=127870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:21:40.520601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.security_group_api [None req-939559da-4055-459c-a557-b48660f6ba3b tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Neutron security group d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 not found {{(pid=127870) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:21:40.521798 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-939559da-4055-459c-a557-b48660f6ba3b tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] HTTP exception thrown: Security group d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 does not exist Jul 20 04:21:40.521798 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-e05c67d9-c0bc-4738-bfc5-b6133cf3bdff'] Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-939559da-4055-459c-a557-b48660f6ba3b tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Request method failure captured: Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/os-security-groups/d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 HTTP/1.1 Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14JfAGKjPuA6ODJ-Qtd1em2O9yA3rahErotNYmVH9cKLqXeleHpCho0NIxaqZH7I3kILCGiDqMrjK0vy8DvdBt2Jb59H_-WliyaefNEp44gjG3S0TsxNI_vZzHSAfQzFRseRskmabnqYG7qLPbXQPBbvdUJJYh9qJrSBMBDZ9FAEz1w Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:21:40.527988 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:21:40.530262 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373f9f5b2b9f44fdba67acfc147b7d84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}] Jul 20 04:21:40.530262 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:40.530262 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:40.530262 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:40.530262 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:40.530262 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:21:40.530262 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:21:40.530262 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 539cb225b4b0422c9f19e0eb18c8983e Jul 20 04:21:40.530262 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:40.530262 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:21:40.530262 n-d-826526-5 devstack@n-api.service[127870]: exception: Security group d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 does not exist Jul 20 04:21:40.530262 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-e05c67d9-c0bc-4738-bfc5-b6133cf3bdff'] Jul 20 04:21:40.530262 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'd4e319b7-e21f-4cd5-ac95-02dd6eb13fa0'} Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.531606 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:21:40.532781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:21:40.532781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.532781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.532781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:21:40.532781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:21:40.532781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:21:40.532781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:21:40.532781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 does not exist Jul 20 04:21:40.532781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e05c67d9-c0bc-4738-bfc5-b6133cf3bdff'] Jul 20 04:21:40.532781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.532781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.532781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.532781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.532781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:21:40.532781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:21:40.532781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:21:40.532781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:21:40.532781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 does not exist Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e05c67d9-c0bc-4738-bfc5-b6133cf3bdff'] Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 does not exist Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e05c67d9-c0bc-4738-bfc5-b6133cf3bdff'] Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.537223 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.541876 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:40.541876 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:40.541876 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:40.541876 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:40.541876 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 does not exist Jul 20 04:21:40.541876 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e05c67d9-c0bc-4738-bfc5-b6133cf3bdff'] Jul 20 04:21:40.541876 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.549708 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-939559da-4055-459c-a557-b48660f6ba3b tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Returning 404 to user: Security group d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 does not exist Jul 20 04:21:40.549708 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-e05c67d9-c0bc-4738-bfc5-b6133cf3bdff'] {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:40.549708 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-939559da-4055-459c-a557-b48660f6ba3b tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0" status: 404 len: 194 microversion: 2.1 time: 0.238061 Jul 20 04:21:40.550596 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1165/2558] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:21:40 2022] DELETE /compute/v2.1/os-security-groups/d4e319b7-e21f-4cd5-ac95-02dd6eb13fa0 => generated 194 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:40.557958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2289df59-be1f-494f-990c-30e4302e32b6 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:40.567868 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-2289df59-be1f-494f-990c-30e4302e32b6 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] HTTP exception thrown: Instance group 6b61f769-d267-4854-83f5-a17288edbd6e could not be found. Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2289df59-be1f-494f-990c-30e4302e32b6 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Request method failure captured: Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/os-server-groups/6b61f769-d267-4854-83f5-a17288edbd6e HTTP/1.1 Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14KpKuPo_5WCP4zZqpoY6YlBFsMbw4VwzEWKntfNQ5LkrtLQw_iDg-Dle-JK4ZWHpQ5WiBXC1PFIs7GY4eBvEV8VldihxdshcbEHRKfzCgiDKUFALy3xn_iMNzCOdPbmKUwJ2VwPbzPQRlyn3aEBtzyxpcNOAtX7_XEXgTAfihHOZi8 Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: f8e6196788984b23be749aa5dd384673 Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:21:40.570359 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:21:40.571723 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f8e6196788984b23be749aa5dd384673"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f8e6196788984b23be749aa5dd384673"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f8e6196788984b23be749aa5dd384673", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f8e6196788984b23be749aa5dd384673"}]}] Jul 20 04:21:40.571723 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:40.571723 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: f8e6196788984b23be749aa5dd384673 Jul 20 04:21:40.571723 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:40.571723 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerGroupTestJSON-859584202-project Jul 20 04:21:40.571723 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:21:40.571723 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:21:40.571723 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f13c4ff6d8814e0b86c6e5be78d80300 Jul 20 04:21:40.571723 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerGroupTestJSON-859584202-project Jul 20 04:21:40.571723 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:21:40.571723 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance group 6b61f769-d267-4854-83f5-a17288edbd6e could not be found. Jul 20 04:21:40.571723 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '6b61f769-d267-4854-83f5-a17288edbd6e'} Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6b61f769-d267-4854-83f5-a17288edbd6e could not be found. Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:40.572461 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:40.573642 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:40.573642 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:40.573642 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:40.573642 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:40.573642 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:21:40.573642 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:40.573642 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6b61f769-d267-4854-83f5-a17288edbd6e could not be found. Jul 20 04:21:40.573642 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.573642 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.573642 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.573642 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.573642 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:40.573642 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:40.573642 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:40.573642 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:40.573642 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6b61f769-d267-4854-83f5-a17288edbd6e could not be found. Jul 20 04:21:40.573642 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.583253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-adb5c86f-a04b-40a5-a5da-efc07729afa0 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:40.597557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2289df59-be1f-494f-990c-30e4302e32b6 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Returning 404 to user: Instance group 6b61f769-d267-4854-83f5-a17288edbd6e could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:40.599554 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2289df59-be1f-494f-990c-30e4302e32b6 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/6b61f769-d267-4854-83f5-a17288edbd6e" status: 404 len: 117 microversion: 2.1 time: 0.047573 Jul 20 04:21:40.601129 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1166/2559] 10.222.0.17 () {58 vars in 1265 bytes} [Wed Jul 20 04:21:40 2022] DELETE /compute/v2.1/os-server-groups/6b61f769-d267-4854-83f5-a17288edbd6e => generated 117 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:40.602067 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-adb5c86f-a04b-40a5-a5da-efc07729afa0 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c" status: 200 len: 1314 microversion: 2.1 time: 0.856108 Jul 20 04:21:40.608924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ac0f269f-4721-47a8-a663-7f3919912bfa tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06be9b3d30>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:40.618392 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1394/2560] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:39 2022] GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c => generated 1314 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:40.623887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b15b7e8-9758-40f9-81a5-fc3323daa51b tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:40.626749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:40.636747 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-9b15b7e8-9758-40f9-81a5-fc3323daa51b tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] HTTP exception thrown: Instance group 143b51c9-0eb7-4616-9443-b38ba7fab9cf could not be found. Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b15b7e8-9758-40f9-81a5-fc3323daa51b tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Request method failure captured: Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/os-server-groups/143b51c9-0eb7-4616-9443-b38ba7fab9cf HTTP/1.1 Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14KpKuPo_5WCP4zZqpoY6YlBFsMbw4VwzEWKntfNQ5LkrtLQw_iDg-Dle-JK4ZWHpQ5WiBXC1PFIs7GY4eBvEV8VldihxdshcbEHRKfzCgiDKUFALy3xn_iMNzCOdPbmKUwJ2VwPbzPQRlyn3aEBtzyxpcNOAtX7_XEXgTAfihHOZi8 Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: f8e6196788984b23be749aa5dd384673 Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:21:40.639520 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:21:40.641545 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f8e6196788984b23be749aa5dd384673"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f8e6196788984b23be749aa5dd384673"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f8e6196788984b23be749aa5dd384673", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f8e6196788984b23be749aa5dd384673"}]}] Jul 20 04:21:40.641545 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:40.641545 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: f8e6196788984b23be749aa5dd384673 Jul 20 04:21:40.641545 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerGroupTestJSON-859584202 Jul 20 04:21:40.641545 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerGroupTestJSON-859584202-project Jul 20 04:21:40.641545 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:21:40.641545 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:21:40.641545 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f13c4ff6d8814e0b86c6e5be78d80300 Jul 20 04:21:40.641545 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerGroupTestJSON-859584202-project Jul 20 04:21:40.641545 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:21:40.641545 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance group 143b51c9-0eb7-4616-9443-b38ba7fab9cf could not be found. Jul 20 04:21:40.641545 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '143b51c9-0eb7-4616-9443-b38ba7fab9cf'} Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 143b51c9-0eb7-4616-9443-b38ba7fab9cf could not be found. Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:40.642615 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:40.645667 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:40.645667 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:40.645667 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:40.645667 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:40.645667 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:21:40.645667 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:40.645667 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 143b51c9-0eb7-4616-9443-b38ba7fab9cf could not be found. Jul 20 04:21:40.645667 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.645667 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.645667 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.645667 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.645667 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:40.645667 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:40.645667 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:40.645667 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:40.645667 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 143b51c9-0eb7-4616-9443-b38ba7fab9cf could not be found. Jul 20 04:21:40.645667 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.647912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b15b7e8-9758-40f9-81a5-fc3323daa51b tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Returning 404 to user: Instance group 143b51c9-0eb7-4616-9443-b38ba7fab9cf could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:40.649331 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9b15b7e8-9758-40f9-81a5-fc3323daa51b tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/143b51c9-0eb7-4616-9443-b38ba7fab9cf" status: 404 len: 117 microversion: 2.1 time: 0.029701 Jul 20 04:21:40.654106 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1395/2561] 10.222.0.17 () {58 vars in 1265 bytes} [Wed Jul 20 04:21:40 2022] DELETE /compute/v2.1/os-server-groups/143b51c9-0eb7-4616-9443-b38ba7fab9cf => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:40.662071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2656bbb3-2ff3-4e6e-8638-d767b8490c78 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:40.677182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG neutronclient.v2_0.client [None req-ac0f269f-4721-47a8-a663-7f3919912bfa tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 117560a7-ed15-4df9-b4cf-455fe34cac80 does not exist", "detail": ""}} {{(pid=127870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:21:40.678221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.security_group_api [None req-ac0f269f-4721-47a8-a663-7f3919912bfa tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Neutron security group 117560a7-ed15-4df9-b4cf-455fe34cac80 not found {{(pid=127870) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:21:40.678870 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-ac0f269f-4721-47a8-a663-7f3919912bfa tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] HTTP exception thrown: Security group 117560a7-ed15-4df9-b4cf-455fe34cac80 does not exist Jul 20 04:21:40.678870 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-fb15a709-5ea3-4a63-b2d0-7304fa6f0ca7'] Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ac0f269f-4721-47a8-a663-7f3919912bfa tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Request method failure captured: Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/os-security-groups/117560a7-ed15-4df9-b4cf-455fe34cac80 HTTP/1.1 Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14JfAGKjPuA6ODJ-Qtd1em2O9yA3rahErotNYmVH9cKLqXeleHpCho0NIxaqZH7I3kILCGiDqMrjK0vy8DvdBt2Jb59H_-WliyaefNEp44gjG3S0TsxNI_vZzHSAfQzFRseRskmabnqYG7qLPbXQPBbvdUJJYh9qJrSBMBDZ9FAEz1w Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:21:40.684334 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:21:40.687604 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373f9f5b2b9f44fdba67acfc147b7d84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}] Jul 20 04:21:40.687604 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:40.687604 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:40.687604 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:40.687604 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:40.687604 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:21:40.687604 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:21:40.687604 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 539cb225b4b0422c9f19e0eb18c8983e Jul 20 04:21:40.687604 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:40.687604 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:21:40.687604 n-d-826526-5 devstack@n-api.service[127870]: exception: Security group 117560a7-ed15-4df9-b4cf-455fe34cac80 does not exist Jul 20 04:21:40.687604 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-fb15a709-5ea3-4a63-b2d0-7304fa6f0ca7'] Jul 20 04:21:40.687604 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '117560a7-ed15-4df9-b4cf-455fe34cac80'} Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.689121 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:21:40.692069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:21:40.692069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.692069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.692069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:21:40.692069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:21:40.692069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:21:40.692069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:21:40.692069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 117560a7-ed15-4df9-b4cf-455fe34cac80 does not exist Jul 20 04:21:40.692069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb15a709-5ea3-4a63-b2d0-7304fa6f0ca7'] Jul 20 04:21:40.692069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.692069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.692069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.692069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.692069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:21:40.692069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:21:40.692069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:21:40.692069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:21:40.692069 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 117560a7-ed15-4df9-b4cf-455fe34cac80 does not exist Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb15a709-5ea3-4a63-b2d0-7304fa6f0ca7'] Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 117560a7-ed15-4df9-b4cf-455fe34cac80 does not exist Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb15a709-5ea3-4a63-b2d0-7304fa6f0ca7'] Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.695255 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.700376 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:40.700376 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:40.700376 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:40.700376 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:40.700376 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 117560a7-ed15-4df9-b4cf-455fe34cac80 does not exist Jul 20 04:21:40.700376 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb15a709-5ea3-4a63-b2d0-7304fa6f0ca7'] Jul 20 04:21:40.700376 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.706196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ac0f269f-4721-47a8-a663-7f3919912bfa tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Returning 404 to user: Security group 117560a7-ed15-4df9-b4cf-455fe34cac80 does not exist Jul 20 04:21:40.706196 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-fb15a709-5ea3-4a63-b2d0-7304fa6f0ca7'] {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:40.707990 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ac0f269f-4721-47a8-a663-7f3919912bfa tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/117560a7-ed15-4df9-b4cf-455fe34cac80" status: 404 len: 194 microversion: 2.1 time: 0.105284 Jul 20 04:21:40.711074 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1167/2562] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:21:40 2022] DELETE /compute/v2.1/os-security-groups/117560a7-ed15-4df9-b4cf-455fe34cac80 => generated 194 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:40.711610 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2656bbb3-2ff3-4e6e-8638-d767b8490c78 tempest-ServerGroupTestJSON-859584202 tempest-ServerGroupTestJSON-859584202-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/b0b195da-a2a2-4a34-be15-76e508e84229" status: 204 len: 0 microversion: 2.1 time: 0.055783 Jul 20 04:21:40.714775 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1396/2563] 10.222.0.17 () {58 vars in 1265 bytes} [Wed Jul 20 04:21:40 2022] DELETE /compute/v2.1/os-server-groups/b0b195da-a2a2-4a34-be15-76e508e84229 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:21:40.725625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9e12ec51-c843-45b4-902b-29087f59ad17 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06be2db940>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:40.806613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG neutronclient.v2_0.client [None req-9e12ec51-c843-45b4-902b-29087f59ad17 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e7c148e1-e2a3-4839-8dc7-95e8a3244bea does not exist", "detail": ""}} {{(pid=127870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:21:40.807684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.security_group_api [None req-9e12ec51-c843-45b4-902b-29087f59ad17 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Neutron security group e7c148e1-e2a3-4839-8dc7-95e8a3244bea not found {{(pid=127870) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:21:40.808568 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-9e12ec51-c843-45b4-902b-29087f59ad17 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] HTTP exception thrown: Security group e7c148e1-e2a3-4839-8dc7-95e8a3244bea does not exist Jul 20 04:21:40.808568 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-885c033b-5467-4b5a-8d15-67588e7fbd1f'] Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9e12ec51-c843-45b4-902b-29087f59ad17 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Request method failure captured: Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/os-security-groups/e7c148e1-e2a3-4839-8dc7-95e8a3244bea HTTP/1.1 Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14JfAGKjPuA6ODJ-Qtd1em2O9yA3rahErotNYmVH9cKLqXeleHpCho0NIxaqZH7I3kILCGiDqMrjK0vy8DvdBt2Jb59H_-WliyaefNEp44gjG3S0TsxNI_vZzHSAfQzFRseRskmabnqYG7qLPbXQPBbvdUJJYh9qJrSBMBDZ9FAEz1w Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:21:40.812335 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:21:40.814210 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373f9f5b2b9f44fdba67acfc147b7d84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}] Jul 20 04:21:40.814210 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:40.814210 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:40.814210 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:40.814210 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:40.814210 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:21:40.814210 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:21:40.814210 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 539cb225b4b0422c9f19e0eb18c8983e Jul 20 04:21:40.814210 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:40.814210 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:21:40.814210 n-d-826526-5 devstack@n-api.service[127870]: exception: Security group e7c148e1-e2a3-4839-8dc7-95e8a3244bea does not exist Jul 20 04:21:40.814210 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-885c033b-5467-4b5a-8d15-67588e7fbd1f'] Jul 20 04:21:40.814210 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'e7c148e1-e2a3-4839-8dc7-95e8a3244bea'} Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.815091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:21:40.817125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:21:40.817125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.817125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.817125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:21:40.817125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:21:40.817125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:21:40.817125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:21:40.817125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e7c148e1-e2a3-4839-8dc7-95e8a3244bea does not exist Jul 20 04:21:40.817125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-885c033b-5467-4b5a-8d15-67588e7fbd1f'] Jul 20 04:21:40.817125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.817125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.817125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.817125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.817125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:21:40.817125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:21:40.817125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:21:40.817125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:21:40.817125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e7c148e1-e2a3-4839-8dc7-95e8a3244bea does not exist Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-885c033b-5467-4b5a-8d15-67588e7fbd1f'] Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e7c148e1-e2a3-4839-8dc7-95e8a3244bea does not exist Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-885c033b-5467-4b5a-8d15-67588e7fbd1f'] Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.819571 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.822802 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:40.822802 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:40.822802 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:40.822802 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:40.822802 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e7c148e1-e2a3-4839-8dc7-95e8a3244bea does not exist Jul 20 04:21:40.822802 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-885c033b-5467-4b5a-8d15-67588e7fbd1f'] Jul 20 04:21:40.822802 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.825328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9e12ec51-c843-45b4-902b-29087f59ad17 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Returning 404 to user: Security group e7c148e1-e2a3-4839-8dc7-95e8a3244bea does not exist Jul 20 04:21:40.825328 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-885c033b-5467-4b5a-8d15-67588e7fbd1f'] {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:40.826229 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9e12ec51-c843-45b4-902b-29087f59ad17 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/e7c148e1-e2a3-4839-8dc7-95e8a3244bea" status: 404 len: 194 microversion: 2.1 time: 0.110272 Jul 20 04:21:40.827043 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1168/2564] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:21:40 2022] DELETE /compute/v2.1/os-security-groups/e7c148e1-e2a3-4839-8dc7-95e8a3244bea => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:40.836957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6f857b73-77f1-465a-bb05-93eb4db04b38 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06bdeec5e0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:40.977241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG neutronclient.v2_0.client [None req-6f857b73-77f1-465a-bb05-93eb4db04b38 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0083f176-eb56-470f-a14f-9dcf331a9a3a does not exist", "detail": ""}} {{(pid=127871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:21:40.978135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.security_group_api [None req-6f857b73-77f1-465a-bb05-93eb4db04b38 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Neutron security group 0083f176-eb56-470f-a14f-9dcf331a9a3a not found {{(pid=127871) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:21:40.978676 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-6f857b73-77f1-465a-bb05-93eb4db04b38 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] HTTP exception thrown: Security group 0083f176-eb56-470f-a14f-9dcf331a9a3a does not exist Jul 20 04:21:40.978676 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-f295da0a-ac3f-431c-868f-c0c1bc4a909c'] Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6f857b73-77f1-465a-bb05-93eb4db04b38 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Request method failure captured: Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/os-security-groups/0083f176-eb56-470f-a14f-9dcf331a9a3a HTTP/1.1 Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14JfAGKjPuA6ODJ-Qtd1em2O9yA3rahErotNYmVH9cKLqXeleHpCho0NIxaqZH7I3kILCGiDqMrjK0vy8DvdBt2Jb59H_-WliyaefNEp44gjG3S0TsxNI_vZzHSAfQzFRseRskmabnqYG7qLPbXQPBbvdUJJYh9qJrSBMBDZ9FAEz1w Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:21:40.980622 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:21:40.981966 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373f9f5b2b9f44fdba67acfc147b7d84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}] Jul 20 04:21:40.981966 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:40.981966 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:40.981966 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:40.981966 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:40.981966 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:21:40.981966 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:21:40.981966 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 539cb225b4b0422c9f19e0eb18c8983e Jul 20 04:21:40.981966 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:40.981966 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:21:40.981966 n-d-826526-5 devstack@n-api.service[127871]: exception: Security group 0083f176-eb56-470f-a14f-9dcf331a9a3a does not exist Jul 20 04:21:40.981966 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-f295da0a-ac3f-431c-868f-c0c1bc4a909c'] Jul 20 04:21:40.981966 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '0083f176-eb56-470f-a14f-9dcf331a9a3a'} Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.982769 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:21:40.984716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:21:40.984716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:40.984716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:40.984716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:21:40.984716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:21:40.984716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:21:40.984716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:21:40.984716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0083f176-eb56-470f-a14f-9dcf331a9a3a does not exist Jul 20 04:21:40.984716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f295da0a-ac3f-431c-868f-c0c1bc4a909c'] Jul 20 04:21:40.984716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.984716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.984716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.984716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.984716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:21:40.984716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:21:40.984716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:21:40.984716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:21:40.984716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0083f176-eb56-470f-a14f-9dcf331a9a3a does not exist Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f295da0a-ac3f-431c-868f-c0c1bc4a909c'] Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0083f176-eb56-470f-a14f-9dcf331a9a3a does not exist Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f295da0a-ac3f-431c-868f-c0c1bc4a909c'] Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.985825 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:40.989091 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:40.989091 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:40.989091 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:40.989091 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:40.989091 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0083f176-eb56-470f-a14f-9dcf331a9a3a does not exist Jul 20 04:21:40.989091 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f295da0a-ac3f-431c-868f-c0c1bc4a909c'] Jul 20 04:21:40.989091 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:40.989091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6f857b73-77f1-465a-bb05-93eb4db04b38 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Returning 404 to user: Security group 0083f176-eb56-470f-a14f-9dcf331a9a3a does not exist Jul 20 04:21:40.989091 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-f295da0a-ac3f-431c-868f-c0c1bc4a909c'] {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:40.989091 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6f857b73-77f1-465a-bb05-93eb4db04b38 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/0083f176-eb56-470f-a14f-9dcf331a9a3a" status: 404 len: 194 microversion: 2.1 time: 0.151706 Jul 20 04:21:40.989091 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1397/2565] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:21:40 2022] DELETE /compute/v2.1/os-security-groups/0083f176-eb56-470f-a14f-9dcf331a9a3a => generated 194 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:40.999626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ed1a52d7-62df-453e-9137-688138be5194 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06c73b9ee0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:41.168823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8b8226b0-bd7a-4bad-abc9-44abf80fe540 tempest-FloatingIPDetailsNegativeTestJSON-1741868653 tempest-FloatingIPDetailsNegativeTestJSON-1741868653-project] Calling method '.version_select at 0x7f06be2db4c0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:41.193276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG neutronclient.v2_0.client [None req-ed1a52d7-62df-453e-9137-688138be5194 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5cf754ec-491d-4b7a-930a-fa97df4e0dbd does not exist", "detail": ""}} {{(pid=127871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:21:41.194855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.security_group_api [None req-ed1a52d7-62df-453e-9137-688138be5194 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Neutron security group 5cf754ec-491d-4b7a-930a-fa97df4e0dbd not found {{(pid=127871) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:21:41.195987 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-ed1a52d7-62df-453e-9137-688138be5194 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] HTTP exception thrown: Security group 5cf754ec-491d-4b7a-930a-fa97df4e0dbd does not exist Jul 20 04:21:41.195987 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-f048f920-886a-491a-b473-0e5ce26a1ef4'] Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ed1a52d7-62df-453e-9137-688138be5194 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Request method failure captured: Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/os-security-groups/5cf754ec-491d-4b7a-930a-fa97df4e0dbd HTTP/1.1 Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14JfAGKjPuA6ODJ-Qtd1em2O9yA3rahErotNYmVH9cKLqXeleHpCho0NIxaqZH7I3kILCGiDqMrjK0vy8DvdBt2Jb59H_-WliyaefNEp44gjG3S0TsxNI_vZzHSAfQzFRseRskmabnqYG7qLPbXQPBbvdUJJYh9qJrSBMBDZ9FAEz1w Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:21:41.200187 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:21:41.201743 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373f9f5b2b9f44fdba67acfc147b7d84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}] Jul 20 04:21:41.201743 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:41.201743 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:41.201743 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:41.201743 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:41.201743 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:21:41.201743 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:21:41.201743 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 539cb225b4b0422c9f19e0eb18c8983e Jul 20 04:21:41.201743 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:41.201743 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:21:41.201743 n-d-826526-5 devstack@n-api.service[127871]: exception: Security group 5cf754ec-491d-4b7a-930a-fa97df4e0dbd does not exist Jul 20 04:21:41.201743 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-f048f920-886a-491a-b473-0e5ce26a1ef4'] Jul 20 04:21:41.201743 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '5cf754ec-491d-4b7a-930a-fa97df4e0dbd'} Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:41.202533 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:21:41.203659 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:21:41.203659 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:41.203659 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:41.203659 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:21:41.203659 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:21:41.203659 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:21:41.203659 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:21:41.203659 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5cf754ec-491d-4b7a-930a-fa97df4e0dbd does not exist Jul 20 04:21:41.203659 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f048f920-886a-491a-b473-0e5ce26a1ef4'] Jul 20 04:21:41.203659 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:41.203659 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:41.203659 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:41.203659 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:41.203659 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:21:41.203659 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:21:41.203659 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:21:41.203659 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:21:41.203659 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5cf754ec-491d-4b7a-930a-fa97df4e0dbd does not exist Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f048f920-886a-491a-b473-0e5ce26a1ef4'] Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5cf754ec-491d-4b7a-930a-fa97df4e0dbd does not exist Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f048f920-886a-491a-b473-0e5ce26a1ef4'] Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:41.206894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:41.209868 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:41.209868 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:41.209868 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:41.209868 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:41.209868 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5cf754ec-491d-4b7a-930a-fa97df4e0dbd does not exist Jul 20 04:21:41.209868 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f048f920-886a-491a-b473-0e5ce26a1ef4'] Jul 20 04:21:41.209868 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:41.213004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ed1a52d7-62df-453e-9137-688138be5194 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Returning 404 to user: Security group 5cf754ec-491d-4b7a-930a-fa97df4e0dbd does not exist Jul 20 04:21:41.213004 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-f048f920-886a-491a-b473-0e5ce26a1ef4'] {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:41.214688 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ed1a52d7-62df-453e-9137-688138be5194 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/5cf754ec-491d-4b7a-930a-fa97df4e0dbd" status: 404 len: 194 microversion: 2.1 time: 0.226281 Jul 20 04:21:41.215849 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1398/2566] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:21:40 2022] DELETE /compute/v2.1/os-security-groups/5cf754ec-491d-4b7a-930a-fa97df4e0dbd => generated 194 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:41.225409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-72c6d5d7-fc9c-4892-a9bf-135cc2552f87 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:41.226167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-72c6d5d7-fc9c-4892-a9bf-135cc2552f87 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:41.237585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG neutronclient.v2_0.client [None req-8b8226b0-bd7a-4bad-abc9-44abf80fe540 tempest-FloatingIPDetailsNegativeTestJSON-1741868653 tempest-FloatingIPDetailsNegativeTestJSON-1741868653-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 50befbc5-f266-4e05-b405-25cebe92436c could not be found", "detail": ""}} {{(pid=127870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:21:41.238968 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-8b8226b0-bd7a-4bad-abc9-44abf80fe540 tempest-FloatingIPDetailsNegativeTestJSON-1741868653 tempest-FloatingIPDetailsNegativeTestJSON-1741868653-project] HTTP exception thrown: Floating IP not found for ID 50befbc5-f266-4e05-b405-25cebe92436c Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8b8226b0-bd7a-4bad-abc9-44abf80fe540 tempest-FloatingIPDetailsNegativeTestJSON-1741868653 tempest-FloatingIPDetailsNegativeTestJSON-1741868653-project] Request method failure captured: Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/os-floating-ips/50befbc5-f266-4e05-b405-25cebe92436c HTTP/1.1 Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14LUWQtiLrr2Z1r5Driign5sMjbyjeuzI6YSsvXM4drYa-OkpFTZLRFUy8A_nCgpUIaDS_o7wtPd-6MTTh5Kvs8d7Q1s-IqKF9sgkbv2bD0Y_SKOA_flrpfII4gMOqxaaz0oGnCe_HkoFca1YECd4kjzdy30rgynpXUe6ygPGre3XVo Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 1be05747a30c46238ba8a7dc4e2d97d3 Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1741868653 Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:21:41.242705 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:21:41.244183 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1be05747a30c46238ba8a7dc4e2d97d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1be05747a30c46238ba8a7dc4e2d97d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1be05747a30c46238ba8a7dc4e2d97d3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1be05747a30c46238ba8a7dc4e2d97d3"}]}] Jul 20 04:21:41.244183 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1741868653 Jul 20 04:21:41.244183 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 1be05747a30c46238ba8a7dc4e2d97d3 Jul 20 04:21:41.244183 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1741868653 Jul 20 04:21:41.244183 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1741868653-project Jul 20 04:21:41.244183 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:21:41.244183 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:21:41.244183 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 979100df67ec46409794344fbf515eae Jul 20 04:21:41.244183 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1741868653-project Jul 20 04:21:41.244183 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:21:41.244183 n-d-826526-5 devstack@n-api.service[127870]: exception: Floating IP not found for ID 50befbc5-f266-4e05-b405-25cebe92436c Jul 20 04:21:41.244183 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '50befbc5-f266-4e05-b405-25cebe92436c'} Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:41.245152 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 50befbc5-f266-4e05-b405-25cebe92436c could not be found Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b280953-54fe-4a5f-afc6-979e16932e6d'] Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 50befbc5-f266-4e05-b405-25cebe92436c. Jul 20 04:21:41.246278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 50befbc5-f266-4e05-b405-25cebe92436c Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:41.247462 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:41.248766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:41.248766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 50befbc5-f266-4e05-b405-25cebe92436c Jul 20 04:21:41.248766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:21:41.248766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8b8226b0-bd7a-4bad-abc9-44abf80fe540 tempest-FloatingIPDetailsNegativeTestJSON-1741868653 tempest-FloatingIPDetailsNegativeTestJSON-1741868653-project] Returning 404 to user: Floating IP not found for ID 50befbc5-f266-4e05-b405-25cebe92436c {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:41.248766 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8b8226b0-bd7a-4bad-abc9-44abf80fe540 tempest-FloatingIPDetailsNegativeTestJSON-1741868653 tempest-FloatingIPDetailsNegativeTestJSON-1741868653-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/50befbc5-f266-4e05-b405-25cebe92436c" status: 404 len: 111 microversion: 2.1 time: 0.336337 Jul 20 04:21:41.248766 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1169/2567] 10.222.0.17 () {58 vars in 1259 bytes} [Wed Jul 20 04:21:40 2022] GET /compute/v2.1/os-floating-ips/50befbc5-f266-4e05-b405-25cebe92436c => generated 111 bytes in 338 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:41.249160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72c6d5d7-fc9c-4892-a9bf-135cc2552f87 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:41.249160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72c6d5d7-fc9c-4892-a9bf-135cc2552f87 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.249160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72c6d5d7-fc9c-4892-a9bf-135cc2552f87 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:41.249160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72c6d5d7-fc9c-4892-a9bf-135cc2552f87 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.285538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-72c6d5d7-fc9c-4892-a9bf-135cc2552f87 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:21:41.471618 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-72c6d5d7-fc9c-4892-a9bf-135cc2552f87 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 204 len: 0 microversion: 2.1 time: 0.249453 Jul 20 04:21:41.473897 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1399/2568] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:41 2022] DELETE /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:21:41.487601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5aec64ff-289f-41b4-bde8-818bdf6afe0f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:41.488561 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5aec64ff-289f-41b4-bde8-818bdf6afe0f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:41.505965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5aec64ff-289f-41b4-bde8-818bdf6afe0f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:41.508689 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5aec64ff-289f-41b4-bde8-818bdf6afe0f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.509530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5aec64ff-289f-41b4-bde8-818bdf6afe0f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:41.509974 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5aec64ff-289f-41b4-bde8-818bdf6afe0f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.627370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-32f3ef96-7b9e-4306-8c49-d8d706e8df91 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:41.631875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-32f3ef96-7b9e-4306-8c49-d8d706e8df91 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:41.658024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32f3ef96-7b9e-4306-8c49-d8d706e8df91 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:41.658441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32f3ef96-7b9e-4306-8c49-d8d706e8df91 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.659478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32f3ef96-7b9e-4306-8c49-d8d706e8df91 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:41.659691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32f3ef96-7b9e-4306-8c49-d8d706e8df91 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:42.434311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5aec64ff-289f-41b4-bde8-818bdf6afe0f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:42.453057 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5aec64ff-289f-41b4-bde8-818bdf6afe0f tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 200 len: 1648 microversion: 2.1 time: 0.974473 Jul 20 04:21:42.456747 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1170/2569] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:41 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 1648 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:42.770849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-66fc8938-907c-4d1d-afc9-20de361e1ee9 req-19f53e88-742c-4a31-a016-987e158482ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b1f0db-8edc-44e8-a1ea-7c5efff1534c", "name": "network-vif-plugged", "status": "completed", "tag": "ffb541a6-bf04-450c-9d5f-88a72fda1a31"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:42.792047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-66fc8938-907c-4d1d-afc9-20de361e1ee9 req-19f53e88-742c-4a31-a016-987e158482ef service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:42.796820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-66fc8938-907c-4d1d-afc9-20de361e1ee9 req-19f53e88-742c-4a31-a016-987e158482ef service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:42.839751 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-66fc8938-907c-4d1d-afc9-20de361e1ee9 req-19f53e88-742c-4a31-a016-987e158482ef service nova] Creating event network-vif-plugged:ffb541a6-bf04-450c-9d5f-88a72fda1a31 for instance 98b1f0db-8edc-44e8-a1ea-7c5efff1534c on n-h2-826526-5 Jul 20 04:21:42.853175 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-66fc8938-907c-4d1d-afc9-20de361e1ee9 req-19f53e88-742c-4a31-a016-987e158482ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085121 Jul 20 04:21:42.866835 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1171/2570] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:21:43.201954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-32f3ef96-7b9e-4306-8c49-d8d706e8df91 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:43.224132 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-32f3ef96-7b9e-4306-8c49-d8d706e8df91 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c" status: 200 len: 1314 microversion: 2.1 time: 1.603608 Jul 20 04:21:43.234035 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1400/2571] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:41 2022] GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c => generated 1314 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:43.476553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-15d8f0f0-58ef-48f0-ac55-5e4610883dd8 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:43.477975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-15d8f0f0-58ef-48f0-ac55-5e4610883dd8 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:43.485989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-15d8f0f0-58ef-48f0-ac55-5e4610883dd8 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:43.486807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-15d8f0f0-58ef-48f0-ac55-5e4610883dd8 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:43.487889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-15d8f0f0-58ef-48f0-ac55-5e4610883dd8 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:43.488947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-15d8f0f0-58ef-48f0-ac55-5e4610883dd8 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:43.939695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-15d8f0f0-58ef-48f0-ac55-5e4610883dd8 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:43.953762 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-15d8f0f0-58ef-48f0-ac55-5e4610883dd8 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 200 len: 1648 microversion: 2.1 time: 0.482165 Jul 20 04:21:43.954631 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1172/2572] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:43 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 1648 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:44.243432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-83282c20-05ee-4c84-9dc9-3b301b46622a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:44.244727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-83282c20-05ee-4c84-9dc9-3b301b46622a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:44.258861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83282c20-05ee-4c84-9dc9-3b301b46622a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:44.275741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83282c20-05ee-4c84-9dc9-3b301b46622a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:44.276682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83282c20-05ee-4c84-9dc9-3b301b46622a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:44.277148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83282c20-05ee-4c84-9dc9-3b301b46622a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:44.989403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ad28788b-86b5-47d8-876e-eedb2b4638fe tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:44.991448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ad28788b-86b5-47d8-876e-eedb2b4638fe tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:45.003092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:45.010570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad28788b-86b5-47d8-876e-eedb2b4638fe tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:45.012388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad28788b-86b5-47d8-876e-eedb2b4638fe tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:45.014082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad28788b-86b5-47d8-876e-eedb2b4638fe tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:45.019864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-83282c20-05ee-4c84-9dc9-3b301b46622a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:45.033843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad28788b-86b5-47d8-876e-eedb2b4638fe tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:45.043506 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-83282c20-05ee-4c84-9dc9-3b301b46622a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c" status: 200 len: 1314 microversion: 2.1 time: 0.805198 Jul 20 04:21:45.048066 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1401/2573] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:44 2022] GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c => generated 1314 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:45.316811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ad28788b-86b5-47d8-876e-eedb2b4638fe tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539cb225b4b0422c9f19e0eb18c8983e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373f9f5b2b9f44fdba67acfc147b7d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:45.333608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-5b72460a-eae5-47e1-82ba-a6f37f472896 req-bf4931c6-07c5-44f4-92ec-ab14fd66ced5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd", "name": "network-vif-deleted", "tag": "d17d33e4-2f92-4b69-a966-8ecf67ac6a66"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:45.346730 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ad28788b-86b5-47d8-876e-eedb2b4638fe tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 200 len: 1468 microversion: 2.1 time: 0.358683 Jul 20 04:21:45.348190 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1173/2574] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:44 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 1468 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:45.353895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5b72460a-eae5-47e1-82ba-a6f37f472896 req-bf4931c6-07c5-44f4-92ec-ab14fd66ced5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:45.354489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5b72460a-eae5-47e1-82ba-a6f37f472896 req-bf4931c6-07c5-44f4-92ec-ab14fd66ced5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:45.381925 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-5b72460a-eae5-47e1-82ba-a6f37f472896 req-bf4931c6-07c5-44f4-92ec-ab14fd66ced5 service nova] Creating event network-vif-deleted:d17d33e4-2f92-4b69-a966-8ecf67ac6a66 for instance bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd on n-h1-826526-5 Jul 20 04:21:45.405513 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-5b72460a-eae5-47e1-82ba-a6f37f472896 req-bf4931c6-07c5-44f4-92ec-ab14fd66ced5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076024 Jul 20 04:21:45.406439 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1402/2575] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:46.066562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2594fe55-da53-4465-9ae9-c8997109575b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:46.067888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2594fe55-da53-4465-9ae9-c8997109575b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:46.083307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2594fe55-da53-4465-9ae9-c8997109575b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:46.085258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2594fe55-da53-4465-9ae9-c8997109575b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:46.087310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2594fe55-da53-4465-9ae9-c8997109575b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:46.089097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2594fe55-da53-4465-9ae9-c8997109575b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:46.381269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-336c78fb-5165-4e31-b44e-7c3c3fd55e92 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:46.384530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-336c78fb-5165-4e31-b44e-7c3c3fd55e92 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] [instance: bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:46.413390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-336c78fb-5165-4e31-b44e-7c3c3fd55e92 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:46.414339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-336c78fb-5165-4e31-b44e-7c3c3fd55e92 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:46.415407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-336c78fb-5165-4e31-b44e-7c3c3fd55e92 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:46.416095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-336c78fb-5165-4e31-b44e-7c3c3fd55e92 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:46.457750 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-336c78fb-5165-4e31-b44e-7c3c3fd55e92 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] HTTP exception thrown: Instance bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd could not be found. Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-336c78fb-5165-4e31-b44e-7c3c3fd55e92 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Request method failure captured: Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd HTTP/1.1 Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14JfAGKjPuA6ODJ-Qtd1em2O9yA3rahErotNYmVH9cKLqXeleHpCho0NIxaqZH7I3kILCGiDqMrjK0vy8DvdBt2Jb59H_-WliyaefNEp44gjG3S0TsxNI_vZzHSAfQzFRseRskmabnqYG7qLPbXQPBbvdUJJYh9qJrSBMBDZ9FAEz1w Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:21:46.459783 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:21:46.461325 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373f9f5b2b9f44fdba67acfc147b7d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373f9f5b2b9f44fdba67acfc147b7d84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373f9f5b2b9f44fdba67acfc147b7d84"}]}] Jul 20 04:21:46.461325 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:46.461325 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 373f9f5b2b9f44fdba67acfc147b7d84 Jul 20 04:21:46.461325 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2081207763 Jul 20 04:21:46.461325 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:46.461325 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:21:46.461325 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:21:46.461325 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 539cb225b4b0422c9f19e0eb18c8983e Jul 20 04:21:46.461325 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-SecurityGroupsTestJSON-2081207763-project Jul 20 04:21:46.461325 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:21:46.461325 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd could not be found. Jul 20 04:21:46.461325 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd'} Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd could not be found. Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:46.462196 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:46.463647 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:46.463647 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:46.463647 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:46.463647 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:46.463647 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:46.463647 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:46.463647 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:46.463647 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd could not be found. Jul 20 04:21:46.463647 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:46.463647 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:46.463647 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:46.463647 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:46.463647 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:46.463647 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:46.463647 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:46.463647 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:46.463647 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd could not be found. Jul 20 04:21:46.463647 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:21:46.466179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-336c78fb-5165-4e31-b44e-7c3c3fd55e92 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Returning 404 to user: Instance bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:46.467205 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-336c78fb-5165-4e31-b44e-7c3c3fd55e92 tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd" status: 404 len: 111 microversion: 2.1 time: 0.097917 Jul 20 04:21:46.468237 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1403/2576] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:46 2022] GET /compute/v2.1/servers/bf1b6e20-1f8f-4be5-883c-1ecb47b4c5bd => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:46.478833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-72b2e964-8a70-4a1c-8ed1-8242b9d2fbbf tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06bdd79790>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:46.975372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2594fe55-da53-4465-9ae9-c8997109575b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:46.995723 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2594fe55-da53-4465-9ae9-c8997109575b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c" status: 200 len: 1464 microversion: 2.1 time: 0.931048 Jul 20 04:21:47.009481 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1174/2577] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:46 2022] GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c => generated 1464 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:47.319210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0468792d-3151-4a05-92c4-941000b540c2 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:47.326829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0468792d-3151-4a05-92c4-941000b540c2 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Searching by: {'deleted': False, 'project_id': '47be263fa20b4e9ab5a2345de5c3109f'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:21:47.340432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0468792d-3151-4a05-92c4-941000b540c2 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:47.341139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0468792d-3151-4a05-92c4-941000b540c2 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:47.342130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0468792d-3151-4a05-92c4-941000b540c2 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:47.342715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0468792d-3151-4a05-92c4-941000b540c2 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:47.506416 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0468792d-3151-4a05-92c4-941000b540c2 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.485804 Jul 20 04:21:47.520902 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1175/2578] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:21:47 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:21:47.526679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-21f47aa7-337a-49cf-a33c-c644444aa8f3 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:47.539055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-21f47aa7-337a-49cf-a33c-c644444aa8f3 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Searching by: {'deleted': False} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:21:47.546519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21f47aa7-337a-49cf-a33c-c644444aa8f3 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:47.547368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21f47aa7-337a-49cf-a33c-c644444aa8f3 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:47.548454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21f47aa7-337a-49cf-a33c-c644444aa8f3 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:47.549118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21f47aa7-337a-49cf-a33c-c644444aa8f3 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:47.720668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-21f47aa7-337a-49cf-a33c-c644444aa8f3 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:21:47.873597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21f47aa7-337a-49cf-a33c-c644444aa8f3 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:47.875765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21f47aa7-337a-49cf-a33c-c644444aa8f3 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.378649 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-72b2e964-8a70-4a1c-8ed1-8242b9d2fbbf tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/a6211e57-3a34-4c5c-8fa9-ce5da2735bfa" status: 202 len: 0 microversion: 2.1 time: 1.906036 Jul 20 04:21:48.379253 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1404/2579] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:21:46 2022] DELETE /compute/v2.1/os-security-groups/a6211e57-3a34-4c5c-8fa9-ce5da2735bfa => generated 0 bytes in 1907 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:21:48.388925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-198b0b4f-ba4d-4bba-a5d8-9224ff60532e tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] Calling method '.version_select at 0x7f06bdf51ca0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:48.556005 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-21f47aa7-337a-49cf-a33c-c644444aa8f3 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 4827 microversion: 2.1 time: 1.033503 Jul 20 04:21:48.557589 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1176/2580] 10.222.0.17 () {58 vars in 1170 bytes} [Wed Jul 20 04:21:47 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 4827 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:48.577380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c6836f1e-eb97-4a91-8d74-c110d9b619ca tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:48.583254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c6836f1e-eb97-4a91-8d74-c110d9b619ca tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Searching by: {'deleted': False, 'project_id': '47be263fa20b4e9ab5a2345de5c3109f'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:21:48.602531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6836f1e-eb97-4a91-8d74-c110d9b619ca tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.603285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6836f1e-eb97-4a91-8d74-c110d9b619ca tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.607252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6836f1e-eb97-4a91-8d74-c110d9b619ca tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.607927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6836f1e-eb97-4a91-8d74-c110d9b619ca tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.699151 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c6836f1e-eb97-4a91-8d74-c110d9b619ca tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?tenant_id=e780b879f5f943468e72977a75ee807d" status: 200 len: 15 microversion: 2.1 time: 0.125374 Jul 20 04:21:48.699762 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1177/2581] 10.222.0.17 () {58 vars in 1230 bytes} [Wed Jul 20 04:21:48 2022] GET /compute/v2.1/servers/detail?tenant_id=e780b879f5f943468e72977a75ee807d => generated 15 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:21:48.722952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea274ae2-1494-4df4-88bb-598a3236b760 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:48.731604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ea274ae2-1494-4df4-88bb-598a3236b760 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Searching by: {'tenant_id': 'e780b879f5f943468e72977a75ee807d', 'deleted': False} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:21:48.750120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea274ae2-1494-4df4-88bb-598a3236b760 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.759083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea274ae2-1494-4df4-88bb-598a3236b760 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.760640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea274ae2-1494-4df4-88bb-598a3236b760 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.761259 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea274ae2-1494-4df4-88bb-598a3236b760 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.833804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-ea274ae2-1494-4df4-88bb-598a3236b760 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:21:48.961497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea274ae2-1494-4df4-88bb-598a3236b760 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.962140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea274ae2-1494-4df4-88bb-598a3236b760 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.318431 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ea274ae2-1494-4df4-88bb-598a3236b760 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e780b879f5f943468e72977a75ee807d" status: 200 len: 4827 microversion: 2.1 time: 0.602398 Jul 20 04:21:49.320749 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1178/2582] 10.222.0.17 () {58 vars in 1256 bytes} [Wed Jul 20 04:21:48 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e780b879f5f943468e72977a75ee807d => generated 4827 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:49.342112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-08d58919-0c0b-4d46-93d3-57047eb15ec1 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:49.347428 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-08d58919-0c0b-4d46-93d3-57047eb15ec1 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Searching by: {'tenant_id': '47be263fa20b4e9ab5a2345de5c3109f', 'deleted': False} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:21:49.369474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08d58919-0c0b-4d46-93d3-57047eb15ec1 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.369944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08d58919-0c0b-4d46-93d3-57047eb15ec1 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.370773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08d58919-0c0b-4d46-93d3-57047eb15ec1 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.371219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08d58919-0c0b-4d46-93d3-57047eb15ec1 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.416572 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-08d58919-0c0b-4d46-93d3-57047eb15ec1 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=47be263fa20b4e9ab5a2345de5c3109f" status: 200 len: 15 microversion: 2.1 time: 0.079425 Jul 20 04:21:49.417948 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1179/2583] 10.222.0.17 () {58 vars in 1256 bytes} [Wed Jul 20 04:21:49 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=47be263fa20b4e9ab5a2345de5c3109f => generated 15 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:21:49.438206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f8349ed6-5919-4bbf-9839-f8ec9264d081 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:49.443406 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f8349ed6-5919-4bbf-9839-f8ec9264d081 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010172 Jul 20 04:21:49.446243 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1180/2584] 10.222.0.17 () {58 vars in 1188 bytes} [Wed Jul 20 04:21:49 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:21:49.468791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-41e8dec7-7579-4ad5-ad1b-4b6912f7ac66 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:49.470131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-41e8dec7-7579-4ad5-ad1b-4b6912f7ac66 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:49.485408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41e8dec7-7579-4ad5-ad1b-4b6912f7ac66 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.486493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41e8dec7-7579-4ad5-ad1b-4b6912f7ac66 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.487544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41e8dec7-7579-4ad5-ad1b-4b6912f7ac66 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.488151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41e8dec7-7579-4ad5-ad1b-4b6912f7ac66 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.605254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:49.647121 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-41e8dec7-7579-4ad5-ad1b-4b6912f7ac66 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9/action" status: 202 len: 0 microversion: 2.1 time: 0.181738 Jul 20 04:21:49.653347 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1181/2585] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:49 2022] POST /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:49.661772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-098f0a87-65a7-4278-a362-d49c9077defc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:49.676066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-098f0a87-65a7-4278-a362-d49c9077defc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:49.677342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-098f0a87-65a7-4278-a362-d49c9077defc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'e780b879f5f943468e72977a75ee807d'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:21:49.687132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-098f0a87-65a7-4278-a362-d49c9077defc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.687590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-098f0a87-65a7-4278-a362-d49c9077defc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.689090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-098f0a87-65a7-4278-a362-d49c9077defc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.689492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-098f0a87-65a7-4278-a362-d49c9077defc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.823558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-098f0a87-65a7-4278-a362-d49c9077defc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:21:49.913840 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-098f0a87-65a7-4278-a362-d49c9077defc tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.258650 Jul 20 04:21:49.916434 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1182/2586] 10.222.0.17 () {58 vars in 1149 bytes} [Wed Jul 20 04:21:49 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:49.926299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d8c13f51-f474-4e72-b613-249867e1cfc9 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:49.927716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d8c13f51-f474-4e72-b613-249867e1cfc9 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:49.939562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8c13f51-f474-4e72-b613-249867e1cfc9 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.940623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8c13f51-f474-4e72-b613-249867e1cfc9 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.941817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8c13f51-f474-4e72-b613-249867e1cfc9 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.942929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8c13f51-f474-4e72-b613-249867e1cfc9 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.047852 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d8c13f51-f474-4e72-b613-249867e1cfc9 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9/action" status: 202 len: 0 microversion: 2.1 time: 0.126383 Jul 20 04:21:50.051936 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1183/2587] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:49 2022] POST /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:21:50.056893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e910c5c8-e688-4e0a-b731-75228116501f tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:50.057546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e910c5c8-e688-4e0a-b731-75228116501f tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:50.064490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e910c5c8-e688-4e0a-b731-75228116501f tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.064944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e910c5c8-e688-4e0a-b731-75228116501f tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.065734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e910c5c8-e688-4e0a-b731-75228116501f tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.066831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e910c5c8-e688-4e0a-b731-75228116501f tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.901636 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e910c5c8-e688-4e0a-b731-75228116501f tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1615 microversion: 2.1 time: 0.848365 Jul 20 04:21:50.903770 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1184/2588] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:50 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1615 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:50.917902 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-198b0b4f-ba4d-4bba-a5d8-9224ff60532e tempest-SecurityGroupsTestJSON-2081207763 tempest-SecurityGroupsTestJSON-2081207763-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/5f622391-c5a2-44d8-9064-7bae04f5f735" status: 202 len: 0 microversion: 2.1 time: 2.533760 Jul 20 04:21:50.920726 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1405/2589] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:21:48 2022] DELETE /compute/v2.1/os-security-groups/5f622391-c5a2-44d8-9064-7bae04f5f735 => generated 0 bytes in 2537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:50.925894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8b6b67b5-016c-4b75-965e-243c4f15b550 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:50.926541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8b6b67b5-016c-4b75-965e-243c4f15b550 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:50.934320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b6b67b5-016c-4b75-965e-243c4f15b550 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.934919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b6b67b5-016c-4b75-965e-243c4f15b550 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.935730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b6b67b5-016c-4b75-965e-243c4f15b550 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.936394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b6b67b5-016c-4b75-965e-243c4f15b550 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:51.599643 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8b6b67b5-016c-4b75-965e-243c4f15b550 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1615 microversion: 2.1 time: 0.677643 Jul 20 04:21:51.629619 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1185/2590] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:50 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1615 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:51.633713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bfbb6abe-ad7a-43a2-8e72-6268521201a1 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:51.639474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bfbb6abe-ad7a-43a2-8e72-6268521201a1 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Searching by: {'host': 'n-h2-826526-5', 'deleted': False} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:21:51.659740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bfbb6abe-ad7a-43a2-8e72-6268521201a1 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:51.660232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bfbb6abe-ad7a-43a2-8e72-6268521201a1 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:51.662577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bfbb6abe-ad7a-43a2-8e72-6268521201a1 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:51.666904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bfbb6abe-ad7a-43a2-8e72-6268521201a1 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:51.907965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-bfbb6abe-ad7a-43a2-8e72-6268521201a1 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:21:52.019143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:52.033047 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bfbb6abe-ad7a-43a2-8e72-6268521201a1 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] 10.222.0.17 "GET /compute/v2.1/servers?host=n-h2-826526-5&all_tenants=1" status: 200 len: 665 microversion: 2.1 time: 0.405031 Jul 20 04:21:52.041833 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1406/2591] 10.222.0.17 () {58 vars in 1189 bytes} [Wed Jul 20 04:21:51 2022] GET /compute/v2.1/servers?host=n-h2-826526-5&all_tenants=1 => generated 665 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:52.052497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5b37658e-b513-4407-901c-2df4c07ed0c3 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:52.057985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5b37658e-b513-4407-901c-2df4c07ed0c3 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:21:52.076200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b37658e-b513-4407-901c-2df4c07ed0c3 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:52.080699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b37658e-b513-4407-901c-2df4c07ed0c3 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:52.082048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b37658e-b513-4407-901c-2df4c07ed0c3 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:52.083311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b37658e-b513-4407-901c-2df4c07ed0c3 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:52.307137 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5b37658e-b513-4407-901c-2df4c07ed0c3 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] 10.222.0.17 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.258772 Jul 20 04:21:52.308483 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1186/2592] 10.222.0.17 () {58 vars in 1195 bytes} [Wed Jul 20 04:21:52 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:21:52.322661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-aa40157c-aa9d-4075-af6b-56511084d8a8 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:52.323658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-aa40157c-aa9d-4075-af6b-56511084d8a8 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:52.334114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa40157c-aa9d-4075-af6b-56511084d8a8 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:52.335016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa40157c-aa9d-4075-af6b-56511084d8a8 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:52.336014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa40157c-aa9d-4075-af6b-56511084d8a8 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:52.336638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa40157c-aa9d-4075-af6b-56511084d8a8 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:52.500477 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-aa40157c-aa9d-4075-af6b-56511084d8a8 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9/action" status: 202 len: 0 microversion: 2.1 time: 0.182233 Jul 20 04:21:52.504031 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1407/2593] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:52 2022] POST /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:52.512844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e159206f-8222-4988-a868-9187f7dacc65 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:52.514361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e159206f-8222-4988-a868-9187f7dacc65 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:52.526396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e159206f-8222-4988-a868-9187f7dacc65 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:52.529775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e159206f-8222-4988-a868-9187f7dacc65 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:52.530919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e159206f-8222-4988-a868-9187f7dacc65 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:52.532870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e159206f-8222-4988-a868-9187f7dacc65 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:52.689574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e159206f-8222-4988-a868-9187f7dacc65 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:52.689906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e159206f-8222-4988-a868-9187f7dacc65 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:52.690381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e159206f-8222-4988-a868-9187f7dacc65 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:52.690793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e159206f-8222-4988-a868-9187f7dacc65 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:52.691222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e159206f-8222-4988-a868-9187f7dacc65 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:52.837455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e159206f-8222-4988-a868-9187f7dacc65 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:52.850422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e159206f-8222-4988-a868-9187f7dacc65 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:52.851100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e159206f-8222-4988-a868-9187f7dacc65 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:52.852228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e159206f-8222-4988-a868-9187f7dacc65 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:52.852958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e159206f-8222-4988-a868-9187f7dacc65 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:52.967765 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e159206f-8222-4988-a868-9187f7dacc65 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "POST /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9/action" status: 202 len: 1068 microversion: 2.1 time: 0.459087 Jul 20 04:21:52.970586 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1187/2594] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:52 2022] POST /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9/action => generated 1068 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 04:21:52.986127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bdf12e6b-7ac1-4ce5-95d0-b77a2b4f69f5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:52.987197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bdf12e6b-7ac1-4ce5-95d0-b77a2b4f69f5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:53.017655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bdf12e6b-7ac1-4ce5-95d0-b77a2b4f69f5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.021625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bdf12e6b-7ac1-4ce5-95d0-b77a2b4f69f5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.025843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bdf12e6b-7ac1-4ce5-95d0-b77a2b4f69f5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.026493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bdf12e6b-7ac1-4ce5-95d0-b77a2b4f69f5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.948525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bdf12e6b-7ac1-4ce5-95d0-b77a2b4f69f5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:53.957212 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bdf12e6b-7ac1-4ce5-95d0-b77a2b4f69f5 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1472 microversion: 2.1 time: 0.975958 Jul 20 04:21:53.967538 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1408/2595] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:52 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1472 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:54.974878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dd9b1d66-3d50-43a8-bf8e-aa99d2cabf0c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:54.976301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dd9b1d66-3d50-43a8-bf8e-aa99d2cabf0c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:54.986113 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd9b1d66-3d50-43a8-bf8e-aa99d2cabf0c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:54.991609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd9b1d66-3d50-43a8-bf8e-aa99d2cabf0c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:54.999390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd9b1d66-3d50-43a8-bf8e-aa99d2cabf0c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.000101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd9b1d66-3d50-43a8-bf8e-aa99d2cabf0c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:56.504608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dd9b1d66-3d50-43a8-bf8e-aa99d2cabf0c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:56.517335 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dd9b1d66-3d50-43a8-bf8e-aa99d2cabf0c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1472 microversion: 2.1 time: 1.546020 Jul 20 04:21:56.518987 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1188/2596] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:54 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1472 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:57.536787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-639635a9-717d-4cd4-815c-336c1d80469c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:57.537752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-639635a9-717d-4cd4-815c-336c1d80469c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:57.563494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-639635a9-717d-4cd4-815c-336c1d80469c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:57.564026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-639635a9-717d-4cd4-815c-336c1d80469c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:57.569928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-639635a9-717d-4cd4-815c-336c1d80469c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:57.570961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-639635a9-717d-4cd4-815c-336c1d80469c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.154927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-639635a9-717d-4cd4-815c-336c1d80469c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:58.168161 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-639635a9-717d-4cd4-815c-336c1d80469c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1472 microversion: 2.1 time: 0.636673 Jul 20 04:21:58.178599 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1409/2597] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:57 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1472 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:59.194855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-864e6d64-5eef-48fa-a121-276b74e5cba1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:59.195600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-864e6d64-5eef-48fa-a121-276b74e5cba1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:59.202314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:59.204368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-864e6d64-5eef-48fa-a121-276b74e5cba1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.205016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-864e6d64-5eef-48fa-a121-276b74e5cba1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.206135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-864e6d64-5eef-48fa-a121-276b74e5cba1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.206747 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-864e6d64-5eef-48fa-a121-276b74e5cba1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.324360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-864e6d64-5eef-48fa-a121-276b74e5cba1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:00.369496 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-864e6d64-5eef-48fa-a121-276b74e5cba1 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1472 microversion: 2.1 time: 1.169441 Jul 20 04:22:00.385474 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1189/2598] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:59 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1472 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:01.392761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-48a8c8f9-8aad-4d8a-9cc4-494d6223caf9 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:01.393602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-48a8c8f9-8aad-4d8a-9cc4-494d6223caf9 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:01.446817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48a8c8f9-8aad-4d8a-9cc4-494d6223caf9 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.463482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48a8c8f9-8aad-4d8a-9cc4-494d6223caf9 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.465104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48a8c8f9-8aad-4d8a-9cc4-494d6223caf9 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.471913 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48a8c8f9-8aad-4d8a-9cc4-494d6223caf9 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.814657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:02.150939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-48a8c8f9-8aad-4d8a-9cc4-494d6223caf9 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:02.171900 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-48a8c8f9-8aad-4d8a-9cc4-494d6223caf9 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1472 microversion: 2.1 time: 0.784156 Jul 20 04:22:02.175292 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1410/2599] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:01 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1472 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:03.198925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf27beb9-e021-4805-b1c1-b8939d00b76e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:03.199741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf27beb9-e021-4805-b1c1-b8939d00b76e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:03.222780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=14 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:03.229512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf27beb9-e021-4805-b1c1-b8939d00b76e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.234441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf27beb9-e021-4805-b1c1-b8939d00b76e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.237293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf27beb9-e021-4805-b1c1-b8939d00b76e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.238097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf27beb9-e021-4805-b1c1-b8939d00b76e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.932825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bf27beb9-e021-4805-b1c1-b8939d00b76e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:03.943371 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf27beb9-e021-4805-b1c1-b8939d00b76e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1472 microversion: 2.1 time: 0.751780 Jul 20 04:22:03.959157 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1190/2600] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:03 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1472 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:04.968350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f1d98da1-d84d-4644-80d9-b568ff22a386 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:04.969773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f1d98da1-d84d-4644-80d9-b568ff22a386 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:04.988881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1d98da1-d84d-4644-80d9-b568ff22a386 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.990366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1d98da1-d84d-4644-80d9-b568ff22a386 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.995670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1d98da1-d84d-4644-80d9-b568ff22a386 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.998285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1d98da1-d84d-4644-80d9-b568ff22a386 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.749871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c552bc1f-d9b6-4d65-b4e6-97a3c02dd640 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Calling method '.version_select at 0x7f06be0e5d30>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:05.815177 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c552bc1f-d9b6-4d65-b4e6-97a3c02dd640 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] 10.222.0.17 "GET /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1" status: 200 len: 637 microversion: 2.1 time: 0.069226 Jul 20 04:22:05.815916 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1191/2601] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:05 2022] GET /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1 => generated 637 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:22:05.828622 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1f24497f-1030-4768-a471-0050edfa3c10 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Action: 'update_all', calling method: .version_select at 0x7f06be062670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:05.951493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-1f24497f-1030-4768-a471-0050edfa3c10 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Getting quotas for project 53ca1e23c1b046de8f5b74cb50f35ee6. Resources: dict_keys(['metadata_items']) {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:05.958368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-1f24497f-1030-4768-a471-0050edfa3c10 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Getting quotas for user 3b8f813ea38d470f95aa50a5666221b9 and project 53ca1e23c1b046de8f5b74cb50f35ee6. Resources: dict_keys(['metadata_items']) {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:06.322617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f1d98da1-d84d-4644-80d9-b568ff22a386 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:06.338470 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f1d98da1-d84d-4644-80d9-b568ff22a386 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1472 microversion: 2.1 time: 1.369088 Jul 20 04:22:06.339732 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1411/2602] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:04 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1472 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:06.640321 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1f24497f-1030-4768-a471-0050edfa3c10 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] 10.222.0.17 "PUT /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.815523 Jul 20 04:22:06.641358 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1192/2603] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:22:05 2022] PUT /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata => generated 61 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:22:06.650363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-80e09b97-6023-4f9d-ba69-c66ca6f222fc tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Calling method '.version_select at 0x7f06be099280>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:07.288335 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-80e09b97-6023-4f9d-ba69-c66ca6f222fc tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] 10.222.0.17 "DELETE /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.641559 Jul 20 04:22:07.289708 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1412/2604] 10.222.0.17 () {58 vars in 1295 bytes} [Wed Jul 20 04:22:06 2022] DELETE /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata/os_version => generated 0 bytes in 644 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:07.301621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ebb0d8a6-5e53-435d-8a89-26e400c48dd3 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Calling method '.version_select at 0x7f06be062ca0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:07.355244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b350ba06-e337-4e48-ba15-10681be0b649 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:07.356577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b350ba06-e337-4e48-ba15-10681be0b649 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:07.363116 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ebb0d8a6-5e53-435d-8a89-26e400c48dd3 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] 10.222.0.17 "GET /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata" status: 200 len: 37 microversion: 2.1 time: 0.067973 Jul 20 04:22:07.365333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b350ba06-e337-4e48-ba15-10681be0b649 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:07.365720 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1193/2605] 10.222.0.17 () {58 vars in 1259 bytes} [Wed Jul 20 04:22:07 2022] GET /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata => generated 37 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:07.366327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b350ba06-e337-4e48-ba15-10681be0b649 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:07.367204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b350ba06-e337-4e48-ba15-10681be0b649 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:07.367776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b350ba06-e337-4e48-ba15-10681be0b649 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:07.376982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a16357a9-3016-4434-b3a9-51329f17405a tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Action: 'update_all', calling method: .version_select at 0x7f06bde19430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:07.514993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-a16357a9-3016-4434-b3a9-51329f17405a tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Getting quotas for project 53ca1e23c1b046de8f5b74cb50f35ee6. Resources: dict_keys(['metadata_items']) {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:07.523309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-a16357a9-3016-4434-b3a9-51329f17405a tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Getting quotas for user 3b8f813ea38d470f95aa50a5666221b9 and project 53ca1e23c1b046de8f5b74cb50f35ee6. Resources: dict_keys(['metadata_items']) {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:08.073860 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a16357a9-3016-4434-b3a9-51329f17405a tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] 10.222.0.17 "PUT /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.701366 Jul 20 04:22:08.075554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b350ba06-e337-4e48-ba15-10681be0b649 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:08.081669 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1194/2606] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:22:07 2022] PUT /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata => generated 61 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:08.087749 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b350ba06-e337-4e48-ba15-10681be0b649 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1478 microversion: 2.1 time: 0.736221 Jul 20 04:22:08.088451 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1413/2607] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:07 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1478 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:08.099169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-03116d69-c32f-497b-83f6-86b89970395e tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Calling method '.version_select at 0x7f06be062040>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:08.175538 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-03116d69-c32f-497b-83f6-86b89970395e tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] 10.222.0.17 "GET /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.092151 Jul 20 04:22:08.177182 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1195/2608] 10.222.0.17 () {58 vars in 1289 bytes} [Wed Jul 20 04:22:08 2022] GET /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata/os_distro => generated 33 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:08.188808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f1323e36-f894-466b-8f46-b2eb2acc8e01 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Action: 'update_all', calling method: .version_select at 0x7f06be0f3670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:08.337244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-f1323e36-f894-466b-8f46-b2eb2acc8e01 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Getting quotas for project 53ca1e23c1b046de8f5b74cb50f35ee6. Resources: dict_keys(['metadata_items']) {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:08.347668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-f1323e36-f894-466b-8f46-b2eb2acc8e01 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Getting quotas for user 3b8f813ea38d470f95aa50a5666221b9 and project 53ca1e23c1b046de8f5b74cb50f35ee6. Resources: dict_keys(['metadata_items']) {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:08.881464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5af9576c-e89e-46d6-bfad-39076a4d196e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1240759741", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "4af6d0f3-f0ce-426d-9f01-7cbd3ae59fb5"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:08.939988 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f1323e36-f894-466b-8f46-b2eb2acc8e01 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] 10.222.0.17 "PUT /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.755338 Jul 20 04:22:08.947193 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1414/2609] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:22:08 2022] PUT /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata => generated 61 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:22:08.951300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-ac6cb16f-cc59-414e-90a4-182f10e03d16 req-9a8c9770-6b82-4d83-a7ce-d1f5440c1d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b80cc2-a403-42e3-a623-aa5896d360e9", "name": "network-vif-unplugged", "status": "completed", "tag": "8266a16e-2ac7-4af1-a58a-e921890fc926"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:08.964974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ac6cb16f-cc59-414e-90a4-182f10e03d16 req-9a8c9770-6b82-4d83-a7ce-d1f5440c1d8a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.965181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ac6cb16f-cc59-414e-90a4-182f10e03d16 req-9a8c9770-6b82-4d83-a7ce-d1f5440c1d8a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.985197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-5af9576c-e89e-46d6-bfad-39076a4d196e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] validate_networks() for [('4af6d0f3-f0ce-426d-9f01-7cbd3ae59fb5', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:22:08.999025 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-ac6cb16f-cc59-414e-90a4-182f10e03d16 req-9a8c9770-6b82-4d83-a7ce-d1f5440c1d8a service nova] Creating event network-vif-unplugged:8266a16e-2ac7-4af1-a58a-e921890fc926 for instance 62b80cc2-a403-42e3-a623-aa5896d360e9 on n-h2-826526-5 Jul 20 04:22:09.004989 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-ac6cb16f-cc59-414e-90a4-182f10e03d16 req-9a8c9770-6b82-4d83-a7ce-d1f5440c1d8a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063099 Jul 20 04:22:09.005944 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1415/2610] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:09.011447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8dc490bd-e727-4e5d-956a-45364e8c7bef tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Calling method '.version_select at 0x7f06c73b24c0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:09.110551 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8dc490bd-e727-4e5d-956a-45364e8c7bef tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] 10.222.0.17 "GET /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.103303 Jul 20 04:22:09.113633 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1416/2611] 10.222.0.17 () {58 vars in 1259 bytes} [Wed Jul 20 04:22:09 2022] GET /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata => generated 61 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:09.120248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0089a7d3-a4cb-441d-a965-82d815f788c9 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:09.121389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0089a7d3-a4cb-441d-a965-82d815f788c9 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:09.130358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0089a7d3-a4cb-441d-a965-82d815f788c9 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:09.131103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0089a7d3-a4cb-441d-a965-82d815f788c9 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:09.132187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0089a7d3-a4cb-441d-a965-82d815f788c9 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:09.133282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0089a7d3-a4cb-441d-a965-82d815f788c9 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:09.515082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0089a7d3-a4cb-441d-a965-82d815f788c9 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:09.526886 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0089a7d3-a4cb-441d-a965-82d815f788c9 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1478 microversion: 2.1 time: 0.411516 Jul 20 04:22:09.527855 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1417/2612] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:09 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1478 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:09.539637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5175d964-8a49-4aab-ac76-f68199f8dd72 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Action: 'update_all', calling method: .version_select at 0x7f06be0f30d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:09.643169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-5175d964-8a49-4aab-ac76-f68199f8dd72 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Getting quotas for project 53ca1e23c1b046de8f5b74cb50f35ee6. Resources: dict_keys(['metadata_items']) {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:09.649227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-5175d964-8a49-4aab-ac76-f68199f8dd72 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Getting quotas for user 3b8f813ea38d470f95aa50a5666221b9 and project 53ca1e23c1b046de8f5b74cb50f35ee6. Resources: dict_keys(['metadata_items']) {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:10.245680 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5175d964-8a49-4aab-ac76-f68199f8dd72 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] 10.222.0.17 "PUT /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.716429 Jul 20 04:22:10.253542 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1418/2613] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:22:09 2022] PUT /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata => generated 61 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:10.280244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-43f495c2-086b-4fc0-b919-3f5b509db3e7 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Action: 'update_all', calling method: .version_select at 0x7f06be0f3550>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:10.344921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-43f495c2-086b-4fc0-b919-3f5b509db3e7 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Getting quotas for project 53ca1e23c1b046de8f5b74cb50f35ee6. Resources: dict_keys(['metadata_items']) {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:10.354349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-43f495c2-086b-4fc0-b919-3f5b509db3e7 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Getting quotas for user 3b8f813ea38d470f95aa50a5666221b9 and project 53ca1e23c1b046de8f5b74cb50f35ee6. Resources: dict_keys(['metadata_items']) {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:10.724099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5af9576c-e89e-46d6-bfad-39076a4d196e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:22:10.725064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5af9576c-e89e-46d6-bfad-39076a4d196e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:22:10.725677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5af9576c-e89e-46d6-bfad-39076a4d196e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:22:10.726271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5af9576c-e89e-46d6-bfad-39076a4d196e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:22:10.726863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5af9576c-e89e-46d6-bfad-39076a4d196e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:22:10.743866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5af9576c-e89e-46d6-bfad-39076a4d196e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:10.744660 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5af9576c-e89e-46d6-bfad-39076a4d196e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:10.745679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5af9576c-e89e-46d6-bfad-39076a4d196e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:10.746301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5af9576c-e89e-46d6-bfad-39076a4d196e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:10.771264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-5af9576c-e89e-46d6-bfad-39076a4d196e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Getting quotas for project baa5e3367dd747cda04291a3f97e7b02. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:10.778454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-5af9576c-e89e-46d6-bfad-39076a4d196e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Getting quotas for user 23bf1fecf0c14154b1057a2ec35005a3 and project baa5e3367dd747cda04291a3f97e7b02. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:10.809571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5af9576c-e89e-46d6-bfad-39076a4d196e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:22:10.822489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5af9576c-e89e-46d6-bfad-39076a4d196e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:22:10.851139 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-43f495c2-086b-4fc0-b919-3f5b509db3e7 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] 10.222.0.17 "PUT /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata" status: 200 len: 64 microversion: 2.1 time: 0.596179 Jul 20 04:22:10.855581 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1419/2614] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:22:10 2022] PUT /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata => generated 64 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:10.858464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-47895934-847c-4055-b4a7-747edd4b90a6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:10.859738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-47895934-847c-4055-b4a7-747edd4b90a6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:10.869706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:10.872541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47895934-847c-4055-b4a7-747edd4b90a6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:10.874073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47895934-847c-4055-b4a7-747edd4b90a6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:10.874642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47895934-847c-4055-b4a7-747edd4b90a6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:10.875293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47895934-847c-4055-b4a7-747edd4b90a6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:11.006063 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5af9576c-e89e-46d6-bfad-39076a4d196e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.302714 Jul 20 04:22:11.009520 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1196/2615] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:22:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:22:11.028183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-67262793-8e4e-4717-93d6-e174631d4bdb tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Calling method '.version_select at 0x7f06bde19b80>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:11.133532 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-67262793-8e4e-4717-93d6-e174631d4bdb tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] 10.222.0.17 "GET /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata" status: 200 len: 64 microversion: 2.1 time: 0.118598 Jul 20 04:22:11.134223 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1197/2616] 10.222.0.17 () {58 vars in 1259 bytes} [Wed Jul 20 04:22:11 2022] GET /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata => generated 64 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:11.139509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-257d6a8f-e20a-4529-9ff0-570550503755 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:11.147313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-257d6a8f-e20a-4529-9ff0-570550503755 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:11.375027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-257d6a8f-e20a-4529-9ff0-570550503755 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:11.384835 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-257d6a8f-e20a-4529-9ff0-570550503755 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1225 microversion: 2.1 time: 0.249183 Jul 20 04:22:11.385889 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1198/2617] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:11 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1225 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:11.400771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-42ad4ddc-bffd-49a0-8dfc-a57112d4a287 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Action: 'update_all', calling method: .version_select at 0x7f06be1643a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:11.492397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-42ad4ddc-bffd-49a0-8dfc-a57112d4a287 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Getting quotas for project 53ca1e23c1b046de8f5b74cb50f35ee6. Resources: dict_keys(['metadata_items']) {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:11.502055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-42ad4ddc-bffd-49a0-8dfc-a57112d4a287 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Getting quotas for user 3b8f813ea38d470f95aa50a5666221b9 and project 53ca1e23c1b046de8f5b74cb50f35ee6. Resources: dict_keys(['metadata_items']) {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:12.149260 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-42ad4ddc-bffd-49a0-8dfc-a57112d4a287 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] 10.222.0.17 "PUT /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.752573 Jul 20 04:22:12.150037 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1199/2618] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:22:11 2022] PUT /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata => generated 61 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:12.164312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c7adec4f-e0f5-4654-b84b-37837ce22907 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Action: 'update', calling method: .version_select at 0x7f06bdda1670>, body: {"meta": {"os_version": "alt"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:12.278603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-c7adec4f-e0f5-4654-b84b-37837ce22907 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Getting quotas for project 53ca1e23c1b046de8f5b74cb50f35ee6. Resources: dict_keys(['metadata_items']) {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:12.305826 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-c7adec4f-e0f5-4654-b84b-37837ce22907 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Getting quotas for user 3b8f813ea38d470f95aa50a5666221b9 and project 53ca1e23c1b046de8f5b74cb50f35ee6. Resources: dict_keys(['metadata_items']) {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:12.625248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-47895934-847c-4055-b4a7-747edd4b90a6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:12.641004 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-47895934-847c-4055-b4a7-747edd4b90a6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1478 microversion: 2.1 time: 1.787420 Jul 20 04:22:12.643996 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1420/2619] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:10 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1478 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:12.657504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c38aedca-e0d0-44f1-b748-f7d6467f4fbf tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:12.657504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c38aedca-e0d0-44f1-b748-f7d6467f4fbf tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:12.668149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c38aedca-e0d0-44f1-b748-f7d6467f4fbf tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:12.668695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c38aedca-e0d0-44f1-b748-f7d6467f4fbf tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:12.669733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c38aedca-e0d0-44f1-b748-f7d6467f4fbf tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:12.670182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c38aedca-e0d0-44f1-b748-f7d6467f4fbf tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:13.114605 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c7adec4f-e0f5-4654-b84b-37837ce22907 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] 10.222.0.17 "PUT /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.958699 Jul 20 04:22:13.115520 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1200/2620] 10.222.0.17 () {60 vars in 1312 bytes} [Wed Jul 20 04:22:12 2022] PUT /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata/os_version => generated 31 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:22:13.126618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cc5fcca1-3753-4134-aa23-c511a3510bde tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Calling method '.version_select at 0x7f06be0e5dc0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:13.199781 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cc5fcca1-3753-4134-aa23-c511a3510bde tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] 10.222.0.17 "GET /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata" status: 200 len: 58 microversion: 2.1 time: 0.076960 Jul 20 04:22:13.200783 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1201/2621] 10.222.0.17 () {58 vars in 1259 bytes} [Wed Jul 20 04:22:13 2022] GET /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata => generated 58 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:22:13.214446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d1461a0-de13-46c6-bfd6-d4647f0ad6b2 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Action: 'update_all', calling method: .version_select at 0x7f06be1e5e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:13.278893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:13.289816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-1d1461a0-de13-46c6-bfd6-d4647f0ad6b2 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Getting quotas for project 53ca1e23c1b046de8f5b74cb50f35ee6. Resources: dict_keys(['metadata_items']) {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:13.307077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-1d1461a0-de13-46c6-bfd6-d4647f0ad6b2 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Getting quotas for user 3b8f813ea38d470f95aa50a5666221b9 and project 53ca1e23c1b046de8f5b74cb50f35ee6. Resources: dict_keys(['metadata_items']) {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:13.531781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c38aedca-e0d0-44f1-b748-f7d6467f4fbf tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:13.542735 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c38aedca-e0d0-44f1-b748-f7d6467f4fbf tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1277 microversion: 2.1 time: 0.899570 Jul 20 04:22:13.543882 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1421/2622] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:12 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1277 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:13.673310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-be15dcdf-1c6f-45f5-b04e-b41e3c120c86 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:13.673977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-be15dcdf-1c6f-45f5-b04e-b41e3c120c86 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:13.689517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be15dcdf-1c6f-45f5-b04e-b41e3c120c86 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.690259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be15dcdf-1c6f-45f5-b04e-b41e3c120c86 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:13.691258 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be15dcdf-1c6f-45f5-b04e-b41e3c120c86 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.691877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be15dcdf-1c6f-45f5-b04e-b41e3c120c86 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.042953 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d1461a0-de13-46c6-bfd6-d4647f0ad6b2 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] 10.222.0.17 "PUT /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.832030 Jul 20 04:22:14.048919 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1202/2623] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:22:13 2022] PUT /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata => generated 61 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:22:14.057660 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a313d4cf-939d-4461-ab61-fadfaff733dd tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Action: 'create', calling method: .version_select at 0x7f06be2dfb80>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:14.122388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-a313d4cf-939d-4461-ab61-fadfaff733dd tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Getting quotas for project 53ca1e23c1b046de8f5b74cb50f35ee6. Resources: dict_keys(['metadata_items']) {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:14.129338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-a313d4cf-939d-4461-ab61-fadfaff733dd tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Getting quotas for user 3b8f813ea38d470f95aa50a5666221b9 and project 53ca1e23c1b046de8f5b74cb50f35ee6. Resources: dict_keys(['metadata_items']) {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:14.433589 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-be15dcdf-1c6f-45f5-b04e-b41e3c120c86 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:14.447319 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-be15dcdf-1c6f-45f5-b04e-b41e3c120c86 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1478 microversion: 2.1 time: 0.777920 Jul 20 04:22:14.449545 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1422/2624] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:13 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1478 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:14.561202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d448fd7a-cc60-436d-87d4-65ca92929d32 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:14.562439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d448fd7a-cc60-436d-87d4-65ca92929d32 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:14.571272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d448fd7a-cc60-436d-87d4-65ca92929d32 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:14.572556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d448fd7a-cc60-436d-87d4-65ca92929d32 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.575764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d448fd7a-cc60-436d-87d4-65ca92929d32 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:14.577614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d448fd7a-cc60-436d-87d4-65ca92929d32 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.683482 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a313d4cf-939d-4461-ab61-fadfaff733dd tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] 10.222.0.17 "POST /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata" status: 200 len: 85 microversion: 2.1 time: 0.632504 Jul 20 04:22:14.684699 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1203/2625] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Jul 20 04:22:14 2022] POST /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata => generated 85 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:14.699576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d7b92f34-0684-4ae3-8a38-85beb934be56 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] Calling method '.version_select at 0x7f06be0e5550>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:14.804203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d448fd7a-cc60-436d-87d4-65ca92929d32 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:14.818015 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d7b92f34-0684-4ae3-8a38-85beb934be56 tempest-ImagesMetadataTestJSON-1511444295 tempest-ImagesMetadataTestJSON-1511444295-project] 10.222.0.17 "GET /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata" status: 200 len: 85 microversion: 2.1 time: 0.125571 Jul 20 04:22:14.822803 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1204/2626] 10.222.0.17 () {58 vars in 1259 bytes} [Wed Jul 20 04:22:14 2022] GET /compute/v2.1/images/d554c2f2-43ad-40bc-a6b8-c8735ac423c1/metadata => generated 85 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:14.867991 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d448fd7a-cc60-436d-87d4-65ca92929d32 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1283 microversion: 2.1 time: 0.305985 Jul 20 04:22:14.874182 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1423/2627] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:14 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1283 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:15.238695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-0aef79d9-6ac5-4271-976f-a18f6ac6d4b3 req-abe3a464-1086-4d76-b6b2-83dc55d27852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b80cc2-a403-42e3-a623-aa5896d360e9", "name": "network-vif-plugged", "status": "completed", "tag": "8266a16e-2ac7-4af1-a58a-e921890fc926"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:15.275427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0aef79d9-6ac5-4271-976f-a18f6ac6d4b3 req-abe3a464-1086-4d76-b6b2-83dc55d27852 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.284624 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0aef79d9-6ac5-4271-976f-a18f6ac6d4b3 req-abe3a464-1086-4d76-b6b2-83dc55d27852 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.303618 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-0aef79d9-6ac5-4271-976f-a18f6ac6d4b3 req-abe3a464-1086-4d76-b6b2-83dc55d27852 service nova] Creating event network-vif-plugged:8266a16e-2ac7-4af1-a58a-e921890fc926 for instance 62b80cc2-a403-42e3-a623-aa5896d360e9 on n-h2-826526-5 Jul 20 04:22:15.320111 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-0aef79d9-6ac5-4271-976f-a18f6ac6d4b3 req-abe3a464-1086-4d76-b6b2-83dc55d27852 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088039 Jul 20 04:22:15.321443 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1205/2628] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:15.475748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-63f5df36-a336-4049-9c0b-421d54b4a29b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:15.480016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-63f5df36-a336-4049-9c0b-421d54b4a29b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:15.518314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63f5df36-a336-4049-9c0b-421d54b4a29b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.518805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63f5df36-a336-4049-9c0b-421d54b4a29b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.520170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63f5df36-a336-4049-9c0b-421d54b4a29b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.525427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63f5df36-a336-4049-9c0b-421d54b4a29b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.892880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8b54faf9-af58-418a-bfd5-d96aa55b4d13 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:15.894229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8b54faf9-af58-418a-bfd5-d96aa55b4d13 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:15.907457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b54faf9-af58-418a-bfd5-d96aa55b4d13 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.907457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b54faf9-af58-418a-bfd5-d96aa55b4d13 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.908592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b54faf9-af58-418a-bfd5-d96aa55b4d13 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.909200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b54faf9-af58-418a-bfd5-d96aa55b4d13 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.201865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8b54faf9-af58-418a-bfd5-d96aa55b4d13 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:16.218210 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8b54faf9-af58-418a-bfd5-d96aa55b4d13 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1283 microversion: 2.1 time: 0.330385 Jul 20 04:22:16.223537 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1206/2629] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:15 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1283 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:17.251504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4af22319-467c-4d63-ba18-dd6e608132f2 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:17.253352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4af22319-467c-4d63-ba18-dd6e608132f2 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:17.266873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4af22319-467c-4d63-ba18-dd6e608132f2 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.268022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4af22319-467c-4d63-ba18-dd6e608132f2 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:17.269652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4af22319-467c-4d63-ba18-dd6e608132f2 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.271365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4af22319-467c-4d63-ba18-dd6e608132f2 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:17.583822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4af22319-467c-4d63-ba18-dd6e608132f2 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:17.596320 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4af22319-467c-4d63-ba18-dd6e608132f2 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1283 microversion: 2.1 time: 0.353429 Jul 20 04:22:17.597182 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1207/2630] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:17 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1283 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:17.924614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-63f5df36-a336-4049-9c0b-421d54b4a29b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:17.943244 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-63f5df36-a336-4049-9c0b-421d54b4a29b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1478 microversion: 2.1 time: 2.479378 Jul 20 04:22:17.943850 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1424/2631] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:15 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1478 bytes in 2481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:18.616461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-41362357-af39-4213-8e09-f197cd2511fa tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:18.617982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-41362357-af39-4213-8e09-f197cd2511fa tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:18.631736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41362357-af39-4213-8e09-f197cd2511fa tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:18.640524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41362357-af39-4213-8e09-f197cd2511fa tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:18.644636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41362357-af39-4213-8e09-f197cd2511fa tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:18.645644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41362357-af39-4213-8e09-f197cd2511fa tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:18.704654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:18.964205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-aabc78ac-47ab-4fff-9d83-3794f1e338a3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:18.965460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-aabc78ac-47ab-4fff-9d83-3794f1e338a3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:18.985192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aabc78ac-47ab-4fff-9d83-3794f1e338a3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:19.001580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aabc78ac-47ab-4fff-9d83-3794f1e338a3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:19.002639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aabc78ac-47ab-4fff-9d83-3794f1e338a3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:19.009153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aabc78ac-47ab-4fff-9d83-3794f1e338a3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:19.278361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-41362357-af39-4213-8e09-f197cd2511fa tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:19.287593 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-41362357-af39-4213-8e09-f197cd2511fa tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1325 microversion: 2.1 time: 0.675364 Jul 20 04:22:19.294113 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1208/2632] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:18 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1325 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:20.047499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-aabc78ac-47ab-4fff-9d83-3794f1e338a3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:20.091165 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-aabc78ac-47ab-4fff-9d83-3794f1e338a3 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1464 microversion: 2.1 time: 1.132100 Jul 20 04:22:20.098860 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1425/2633] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:18 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1464 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:20.122380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c78218b5-1742-4b87-9387-398794662e50 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:20.130732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c78218b5-1742-4b87-9387-398794662e50 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:20.163938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c78218b5-1742-4b87-9387-398794662e50 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:20.166016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c78218b5-1742-4b87-9387-398794662e50 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.167954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c78218b5-1742-4b87-9387-398794662e50 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:20.169994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c78218b5-1742-4b87-9387-398794662e50 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.313899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-50cd6a73-a331-4a27-99cf-d85fa9c52f16 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:20.314759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-50cd6a73-a331-4a27-99cf-d85fa9c52f16 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:20.334052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-50cd6a73-a331-4a27-99cf-d85fa9c52f16 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:20.334582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-50cd6a73-a331-4a27-99cf-d85fa9c52f16 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.335436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-50cd6a73-a331-4a27-99cf-d85fa9c52f16 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:20.338085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-50cd6a73-a331-4a27-99cf-d85fa9c52f16 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.375129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=12 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:20.761154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:20.973271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c78218b5-1742-4b87-9387-398794662e50 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:21.058525 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c78218b5-1742-4b87-9387-398794662e50 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1464 microversion: 2.1 time: 0.950220 Jul 20 04:22:21.067173 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1209/2634] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:20 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1464 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:21.110782 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-580c4460-9473-481a-9132-e95514494f8e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:21.114077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-580c4460-9473-481a-9132-e95514494f8e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:21.123607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-580c4460-9473-481a-9132-e95514494f8e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.124149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-580c4460-9473-481a-9132-e95514494f8e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.124883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-580c4460-9473-481a-9132-e95514494f8e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.125328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-580c4460-9473-481a-9132-e95514494f8e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.341376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-580c4460-9473-481a-9132-e95514494f8e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:22:21.342067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-580c4460-9473-481a-9132-e95514494f8e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:22:21.342741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-580c4460-9473-481a-9132-e95514494f8e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:22:21.343360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-580c4460-9473-481a-9132-e95514494f8e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:22:21.345268 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-580c4460-9473-481a-9132-e95514494f8e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:22:21.519614 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-580c4460-9473-481a-9132-e95514494f8e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:21.543455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-580c4460-9473-481a-9132-e95514494f8e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.543925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-580c4460-9473-481a-9132-e95514494f8e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.556797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-580c4460-9473-481a-9132-e95514494f8e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.557842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-580c4460-9473-481a-9132-e95514494f8e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.653339 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-580c4460-9473-481a-9132-e95514494f8e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "POST /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9/action" status: 202 len: 1068 microversion: 2.1 time: 0.576555 Jul 20 04:22:21.654532 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1210/2635] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:21 2022] POST /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9/action => generated 1068 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 20 04:22:21.683429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-600a6c63-35bf-4b3c-aa67-c39291eb8548 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:21.686204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-600a6c63-35bf-4b3c-aa67-c39291eb8548 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:21.697834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-600a6c63-35bf-4b3c-aa67-c39291eb8548 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.701776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-600a6c63-35bf-4b3c-aa67-c39291eb8548 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.704362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-600a6c63-35bf-4b3c-aa67-c39291eb8548 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.706377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-600a6c63-35bf-4b3c-aa67-c39291eb8548 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.418266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-50cd6a73-a331-4a27-99cf-d85fa9c52f16 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:22.422022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-600a6c63-35bf-4b3c-aa67-c39291eb8548 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:22.423216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:22.440186 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-50cd6a73-a331-4a27-99cf-d85fa9c52f16 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1325 microversion: 2.1 time: 2.131994 Jul 20 04:22:22.443732 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1426/2636] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:20 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1325 bytes in 2136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:22.504329 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-600a6c63-35bf-4b3c-aa67-c39291eb8548 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1473 microversion: 2.1 time: 0.825482 Jul 20 04:22:22.505497 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1211/2637] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:21 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1473 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:23.477658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4fc649f6-aab9-4ae4-bfd7-c8fd54fb270c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:23.483490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4fc649f6-aab9-4ae4-bfd7-c8fd54fb270c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:23.502635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4fc649f6-aab9-4ae4-bfd7-c8fd54fb270c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.503089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4fc649f6-aab9-4ae4-bfd7-c8fd54fb270c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.517227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4fc649f6-aab9-4ae4-bfd7-c8fd54fb270c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.518060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4fc649f6-aab9-4ae4-bfd7-c8fd54fb270c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.747563 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a9e15d29-8d09-4ff6-bbfa-58f504f6479b tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] 10.222.0.17 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.429260 Jul 20 04:22:23.748591 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1427/2638] 10.222.0.17 () {58 vars in 1127 bytes} [Wed Jul 20 04:22:23 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 431 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:22:23.761473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fcede3d8-3e06-4966-9c4c-c4eb7cc87643 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:23.762106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fcede3d8-3e06-4966-9c4c-c4eb7cc87643 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:23.775904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcede3d8-3e06-4966-9c4c-c4eb7cc87643 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.776492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcede3d8-3e06-4966-9c4c-c4eb7cc87643 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.777301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcede3d8-3e06-4966-9c4c-c4eb7cc87643 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.784117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcede3d8-3e06-4966-9c4c-c4eb7cc87643 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:24.145698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=32 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:24.202594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4fc649f6-aab9-4ae4-bfd7-c8fd54fb270c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:24.235115 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4fc649f6-aab9-4ae4-bfd7-c8fd54fb270c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1325 microversion: 2.1 time: 0.757079 Jul 20 04:22:24.237850 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1212/2639] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:23 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1325 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:24.262078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-42f7931b-95ec-46e7-a816-49bf1f9cf02c tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] Calling method '.version_select at 0x7f06be0de4c0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:24.333937 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-42f7931b-95ec-46e7-a816-49bf1f9cf02c tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] HTTP exception thrown: Image not found. Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-42f7931b-95ec-46e7-a816-49bf1f9cf02c tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] Request method failure captured: Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14L_eWICPJyoED_B0aY1ZZKiKLs2c11QPpA0QESUZEfZR_kPi8kujFdKEoez3iS15p3fJotmMUaWOg81a-fEjylZhtDRrPp1JX2FKP90xvRsmWwL6uXKOEF9xHp9OF5dYyKqLHQ_al4K4sNGiYB5ZvE1FMDIb_FWwL4JI1U3FbIc2JM Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: d2e8c406d2d949f786a34f2a237fece2 Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-982262866 Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:22:24.337251 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:22:24.338661 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d2e8c406d2d949f786a34f2a237fece2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d2e8c406d2d949f786a34f2a237fece2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d2e8c406d2d949f786a34f2a237fece2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d2e8c406d2d949f786a34f2a237fece2"}]}] Jul 20 04:22:24.338661 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-982262866 Jul 20 04:22:24.338661 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: d2e8c406d2d949f786a34f2a237fece2 Jul 20 04:22:24.338661 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-982262866 Jul 20 04:22:24.338661 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesDeleteNegativeTestJSON-982262866-project Jul 20 04:22:24.338661 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:22:24.338661 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:22:24.338661 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f89fe189a7c44aa3b950577708be7bf2 Jul 20 04:22:24.338661 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-982262866-project Jul 20 04:22:24.338661 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:22:24.338661 n-d-826526-5 devstack@n-api.service[127870]: exception: Image not found. Jul 20 04:22:24.338661 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '-1'} Jul 20 04:22:24.338661 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:24.338661 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.339582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:24.340855 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:22:24.343278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:22:24.343278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:22:24.343278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.343278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:24.343278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.343278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.343278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:24.343278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:24.343278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:24.343278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:24.343278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:22:24.343278 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.343278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-42f7931b-95ec-46e7-a816-49bf1f9cf02c tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] Returning 404 to user: Image not found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:24.343278 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-42f7931b-95ec-46e7-a816-49bf1f9cf02c tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] 10.222.0.17 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.097961 Jul 20 04:22:24.343278 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1213/2640] 10.222.0.17 () {58 vars in 1133 bytes} [Wed Jul 20 04:22:24 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:22:24.357596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b76e7526-6ed4-4560-94a1-4d27a33dd803 tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] Calling method '.version_select at 0x7f06be164e50>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:24.406912 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-b76e7526-6ed4-4560-94a1-4d27a33dd803 tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] HTTP exception thrown: Image not found. Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b76e7526-6ed4-4560-94a1-4d27a33dd803 tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] Request method failure captured: Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/images/31613754-31ec-4b71-acfe-cf7ec04a2fcj HTTP/1.1 Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14L_eWICPJyoED_B0aY1ZZKiKLs2c11QPpA0QESUZEfZR_kPi8kujFdKEoez3iS15p3fJotmMUaWOg81a-fEjylZhtDRrPp1JX2FKP90xvRsmWwL6uXKOEF9xHp9OF5dYyKqLHQ_al4K4sNGiYB5ZvE1FMDIb_FWwL4JI1U3FbIc2JM Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: d2e8c406d2d949f786a34f2a237fece2 Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-982262866 Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:22:24.413034 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:22:24.414372 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d2e8c406d2d949f786a34f2a237fece2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d2e8c406d2d949f786a34f2a237fece2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d2e8c406d2d949f786a34f2a237fece2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d2e8c406d2d949f786a34f2a237fece2"}]}] Jul 20 04:22:24.414372 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-982262866 Jul 20 04:22:24.414372 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: d2e8c406d2d949f786a34f2a237fece2 Jul 20 04:22:24.414372 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-982262866 Jul 20 04:22:24.414372 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesDeleteNegativeTestJSON-982262866-project Jul 20 04:22:24.414372 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:22:24.414372 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:22:24.414372 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f89fe189a7c44aa3b950577708be7bf2 Jul 20 04:22:24.414372 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-982262866-project Jul 20 04:22:24.414372 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:22:24.414372 n-d-826526-5 devstack@n-api.service[127870]: exception: Image not found. Jul 20 04:22:24.414372 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '31613754-31ec-4b71-acfe-cf7ec04a2fcj'} Jul 20 04:22:24.414372 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 31613754-31ec-4b71-acfe-cf7ec04a2fcj to delete Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:24.415145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 31613754-31ec-4b71-acfe-cf7ec04a2fcj could not be found. Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:24.416449 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:24.417646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:22:24.417646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:22:24.417646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:22:24.417646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.417646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:24.417646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.417646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.417646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:24.417646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:24.417646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:24.417646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:24.417646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:22:24.417646 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.417646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b76e7526-6ed4-4560-94a1-4d27a33dd803 tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] Returning 404 to user: Image not found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:24.417646 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b76e7526-6ed4-4560-94a1-4d27a33dd803 tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] 10.222.0.17 "DELETE /compute/v2.1/images/31613754-31ec-4b71-acfe-cf7ec04a2fcj" status: 404 len: 62 microversion: 2.1 time: 0.066061 Jul 20 04:22:24.425698 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1214/2641] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:24 2022] DELETE /compute/v2.1/images/31613754-31ec-4b71-acfe-cf7ec04a2fcj => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:22:24.438885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a1a19baf-b0d6-4108-9f04-79aeebce184c tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] Calling method '.version_select at 0x7f06be1649d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:24.479038 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-a1a19baf-b0d6-4108-9f04-79aeebce184c tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] HTTP exception thrown: Image not found. Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a1a19baf-b0d6-4108-9f04-79aeebce184c tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] Request method failure captured: Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/images/dcfdc628-3f56-438a-909e-197fbe8631311 HTTP/1.1 Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14L_eWICPJyoED_B0aY1ZZKiKLs2c11QPpA0QESUZEfZR_kPi8kujFdKEoez3iS15p3fJotmMUaWOg81a-fEjylZhtDRrPp1JX2FKP90xvRsmWwL6uXKOEF9xHp9OF5dYyKqLHQ_al4K4sNGiYB5ZvE1FMDIb_FWwL4JI1U3FbIc2JM Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: d2e8c406d2d949f786a34f2a237fece2 Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-982262866 Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:22:24.481904 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:22:24.483374 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d2e8c406d2d949f786a34f2a237fece2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d2e8c406d2d949f786a34f2a237fece2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d2e8c406d2d949f786a34f2a237fece2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d2e8c406d2d949f786a34f2a237fece2"}]}] Jul 20 04:22:24.483374 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-982262866 Jul 20 04:22:24.483374 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: d2e8c406d2d949f786a34f2a237fece2 Jul 20 04:22:24.483374 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-982262866 Jul 20 04:22:24.483374 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesDeleteNegativeTestJSON-982262866-project Jul 20 04:22:24.483374 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:22:24.483374 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:22:24.483374 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f89fe189a7c44aa3b950577708be7bf2 Jul 20 04:22:24.483374 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-982262866-project Jul 20 04:22:24.483374 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:22:24.483374 n-d-826526-5 devstack@n-api.service[127870]: exception: Image not found. Jul 20 04:22:24.483374 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'dcfdc628-3f56-438a-909e-197fbe8631311'} Jul 20 04:22:24.483374 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image dcfdc628-3f56-438a-909e-197fbe8631311 to delete Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:24.484176 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dcfdc628-3f56-438a-909e-197fbe8631311 could not be found. Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:24.485431 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:24.487332 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:22:24.487332 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:22:24.487332 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:22:24.487332 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.487332 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:24.487332 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.487332 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.487332 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:24.487332 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:24.487332 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:24.487332 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:24.487332 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:22:24.487332 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.487332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a1a19baf-b0d6-4108-9f04-79aeebce184c tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] Returning 404 to user: Image not found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:24.487332 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a1a19baf-b0d6-4108-9f04-79aeebce184c tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] 10.222.0.17 "DELETE /compute/v2.1/images/dcfdc628-3f56-438a-909e-197fbe8631311" status: 404 len: 62 microversion: 2.1 time: 0.051015 Jul 20 04:22:24.489649 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1215/2642] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:24 2022] DELETE /compute/v2.1/images/dcfdc628-3f56-438a-909e-197fbe8631311 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:22:24.501784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f1e3a330-5bd9-40f8-89f5-cd00d292f781 tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] Calling method '.version_select at 0x7f06be1e1b80>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:24.556407 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-f1e3a330-5bd9-40f8-89f5-cd00d292f781 tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] HTTP exception thrown: Image not found. Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f1e3a330-5bd9-40f8-89f5-cd00d292f781 tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] Request method failure captured: Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/images/tempest-invalid-564459485 HTTP/1.1 Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14L_eWICPJyoED_B0aY1ZZKiKLs2c11QPpA0QESUZEfZR_kPi8kujFdKEoez3iS15p3fJotmMUaWOg81a-fEjylZhtDRrPp1JX2FKP90xvRsmWwL6uXKOEF9xHp9OF5dYyKqLHQ_al4K4sNGiYB5ZvE1FMDIb_FWwL4JI1U3FbIc2JM Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: d2e8c406d2d949f786a34f2a237fece2 Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-982262866 Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:22:24.560572 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:22:24.563077 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d2e8c406d2d949f786a34f2a237fece2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d2e8c406d2d949f786a34f2a237fece2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d2e8c406d2d949f786a34f2a237fece2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d2e8c406d2d949f786a34f2a237fece2"}]}] Jul 20 04:22:24.563077 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-982262866 Jul 20 04:22:24.563077 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: d2e8c406d2d949f786a34f2a237fece2 Jul 20 04:22:24.563077 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-982262866 Jul 20 04:22:24.563077 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesDeleteNegativeTestJSON-982262866-project Jul 20 04:22:24.563077 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:22:24.563077 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:22:24.563077 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f89fe189a7c44aa3b950577708be7bf2 Jul 20 04:22:24.563077 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-982262866-project Jul 20 04:22:24.563077 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:22:24.563077 n-d-826526-5 devstack@n-api.service[127870]: exception: Image not found. Jul 20 04:22:24.563077 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'tempest-invalid-564459485'} Jul 20 04:22:24.563077 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-564459485 to delete Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:24.566344 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-564459485 could not be found. Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:24.571151 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:24.573870 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:22:24.573870 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:22:24.573870 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:22:24.573870 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.573870 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:24.573870 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.573870 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.573870 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:24.573870 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:24.573870 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:24.573870 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:24.573870 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:22:24.573870 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.573870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f1e3a330-5bd9-40f8-89f5-cd00d292f781 tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] Returning 404 to user: Image not found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:24.573870 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f1e3a330-5bd9-40f8-89f5-cd00d292f781 tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] 10.222.0.17 "DELETE /compute/v2.1/images/tempest-invalid-564459485" status: 404 len: 62 microversion: 2.1 time: 0.071929 Jul 20 04:22:24.579030 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1216/2643] 10.222.0.17 () {58 vars in 1202 bytes} [Wed Jul 20 04:22:24 2022] DELETE /compute/v2.1/images/tempest-invalid-564459485 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:22:24.589417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b338dc57-2b7d-4a33-9cca-52eea4f1a866 tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] Calling method '.version_select at 0x7f06be0c8ca0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:24.647075 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-b338dc57-2b7d-4a33-9cca-52eea4f1a866 tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] HTTP exception thrown: Image not found. Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b338dc57-2b7d-4a33-9cca-52eea4f1a866 tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] Request method failure captured: Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/images/8ced0c64-8d8c-4775-b385-67dbae368e89 HTTP/1.1 Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14L_eWICPJyoED_B0aY1ZZKiKLs2c11QPpA0QESUZEfZR_kPi8kujFdKEoez3iS15p3fJotmMUaWOg81a-fEjylZhtDRrPp1JX2FKP90xvRsmWwL6uXKOEF9xHp9OF5dYyKqLHQ_al4K4sNGiYB5ZvE1FMDIb_FWwL4JI1U3FbIc2JM Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: d2e8c406d2d949f786a34f2a237fece2 Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-982262866 Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:22:24.652197 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:22:24.653524 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d2e8c406d2d949f786a34f2a237fece2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d2e8c406d2d949f786a34f2a237fece2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d2e8c406d2d949f786a34f2a237fece2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d2e8c406d2d949f786a34f2a237fece2"}]}] Jul 20 04:22:24.653524 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-982262866 Jul 20 04:22:24.653524 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: d2e8c406d2d949f786a34f2a237fece2 Jul 20 04:22:24.653524 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-982262866 Jul 20 04:22:24.653524 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesDeleteNegativeTestJSON-982262866-project Jul 20 04:22:24.653524 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:22:24.653524 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:22:24.653524 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f89fe189a7c44aa3b950577708be7bf2 Jul 20 04:22:24.653524 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-982262866-project Jul 20 04:22:24.653524 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:22:24.653524 n-d-826526-5 devstack@n-api.service[127870]: exception: Image not found. Jul 20 04:22:24.653524 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '8ced0c64-8d8c-4775-b385-67dbae368e89'} Jul 20 04:22:24.653524 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8ced0c64-8d8c-4775-b385-67dbae368e89 to delete Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:24.654313 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8ced0c64-8d8c-4775-b385-67dbae368e89 could not be found. Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:24.658599 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:24.660030 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:22:24.660030 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:22:24.660030 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:22:24.660030 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.660030 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:24.660030 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.660030 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:24.660030 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:24.660030 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:24.660030 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:24.660030 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:24.660030 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:22:24.660030 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:24.660030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b338dc57-2b7d-4a33-9cca-52eea4f1a866 tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] Returning 404 to user: Image not found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:24.660030 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b338dc57-2b7d-4a33-9cca-52eea4f1a866 tempest-ImagesDeleteNegativeTestJSON-982262866 tempest-ImagesDeleteNegativeTestJSON-982262866-project] 10.222.0.17 "DELETE /compute/v2.1/images/8ced0c64-8d8c-4775-b385-67dbae368e89" status: 404 len: 62 microversion: 2.1 time: 0.081223 Jul 20 04:22:24.661842 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1217/2644] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:24 2022] DELETE /compute/v2.1/images/8ced0c64-8d8c-4775-b385-67dbae368e89 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:22:24.759112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fcede3d8-3e06-4966-9c4c-c4eb7cc87643 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:24.771111 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fcede3d8-3e06-4966-9c4c-c4eb7cc87643 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1473 microversion: 2.1 time: 1.021376 Jul 20 04:22:24.772176 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1428/2645] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:23 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1473 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:24.866761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-97a16336-e8c5-4412-a5db-4f5acd2cc002 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-2096626439", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "58fce97b-98dc-4a8d-9093-b50ab35a3f5e"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:24.997640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-97a16336-e8c5-4412-a5db-4f5acd2cc002 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] validate_networks() for [('58fce97b-98dc-4a8d-9093-b50ab35a3f5e', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:22:25.264718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8b85c208-32f9-44cd-bca9-03403d89d517 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:25.273831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8b85c208-32f9-44cd-bca9-03403d89d517 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:25.308221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b85c208-32f9-44cd-bca9-03403d89d517 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.314207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b85c208-32f9-44cd-bca9-03403d89d517 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:25.316106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b85c208-32f9-44cd-bca9-03403d89d517 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.324488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b85c208-32f9-44cd-bca9-03403d89d517 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:26.551336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8b85c208-32f9-44cd-bca9-03403d89d517 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:26.575129 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8b85c208-32f9-44cd-bca9-03403d89d517 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1325 microversion: 2.1 time: 1.321059 Jul 20 04:22:26.586246 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1429/2646] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:25 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1325 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:26.591516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-68042502-2056-4641-ba82-65bb102a57c6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:26.592379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-68042502-2056-4641-ba82-65bb102a57c6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:26.600157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68042502-2056-4641-ba82-65bb102a57c6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:26.601201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68042502-2056-4641-ba82-65bb102a57c6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:26.602151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68042502-2056-4641-ba82-65bb102a57c6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:26.602729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68042502-2056-4641-ba82-65bb102a57c6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.025954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-97a16336-e8c5-4412-a5db-4f5acd2cc002 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:22:27.027633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-97a16336-e8c5-4412-a5db-4f5acd2cc002 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:22:27.028765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-97a16336-e8c5-4412-a5db-4f5acd2cc002 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:22:27.029694 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-97a16336-e8c5-4412-a5db-4f5acd2cc002 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:22:27.030632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-97a16336-e8c5-4412-a5db-4f5acd2cc002 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:22:27.069458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97a16336-e8c5-4412-a5db-4f5acd2cc002 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.070622 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97a16336-e8c5-4412-a5db-4f5acd2cc002 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.073893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97a16336-e8c5-4412-a5db-4f5acd2cc002 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.075032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97a16336-e8c5-4412-a5db-4f5acd2cc002 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.225783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-97a16336-e8c5-4412-a5db-4f5acd2cc002 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Getting quotas for project db61812dd23d4638a44417fd3d7cc446. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:27.246054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-97a16336-e8c5-4412-a5db-4f5acd2cc002 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Getting quotas for user 50084863834d461787c5512e7a04bddf and project db61812dd23d4638a44417fd3d7cc446. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:27.293994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-97a16336-e8c5-4412-a5db-4f5acd2cc002 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:22:27.296428 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-97a16336-e8c5-4412-a5db-4f5acd2cc002 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:22:27.498641 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-97a16336-e8c5-4412-a5db-4f5acd2cc002 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.842638 Jul 20 04:22:27.502251 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1218/2647] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:22:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:22:27.535764 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-dbfbb943-2121-4bf7-b3df-a72dd881d692 req-14e23ca6-6067-4ad3-8844-6b8f1cc16e91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55", "tag": "03e1f1bc-ea38-4e03-b054-ea1a7c6f739d"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:27.566143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-dbfbb943-2121-4bf7-b3df-a72dd881d692 req-14e23ca6-6067-4ad3-8844-6b8f1cc16e91 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.566595 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-dbfbb943-2121-4bf7-b3df-a72dd881d692 req-14e23ca6-6067-4ad3-8844-6b8f1cc16e91 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.602095 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-dbfbb943-2121-4bf7-b3df-a72dd881d692 req-14e23ca6-6067-4ad3-8844-6b8f1cc16e91 service nova] Creating event network-changed:03e1f1bc-ea38-4e03-b054-ea1a7c6f739d for instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 on n-h1-826526-5 Jul 20 04:22:27.615859 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-dbfbb943-2121-4bf7-b3df-a72dd881d692 req-14e23ca6-6067-4ad3-8844-6b8f1cc16e91 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109225 Jul 20 04:22:27.618734 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1219/2648] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:27.630948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ced094ec-91b0-4106-abc2-8853e9807425 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:27.631664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ced094ec-91b0-4106-abc2-8853e9807425 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:28.229574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ced094ec-91b0-4106-abc2-8853e9807425 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50084863834d461787c5512e7a04bddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61812dd23d4638a44417fd3d7cc446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:28.245178 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ced094ec-91b0-4106-abc2-8853e9807425 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c" status: 200 len: 1216 microversion: 2.1 time: 0.623030 Jul 20 04:22:28.245828 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1220/2649] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:27 2022] GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c => generated 1216 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:28.263252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6e16dcf3-76cc-4b64-b985-faec5950b7c1 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:28.264535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6e16dcf3-76cc-4b64-b985-faec5950b7c1 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:28.277943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e16dcf3-76cc-4b64-b985-faec5950b7c1 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:28.278819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e16dcf3-76cc-4b64-b985-faec5950b7c1 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:28.279837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e16dcf3-76cc-4b64-b985-faec5950b7c1 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:28.281553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e16dcf3-76cc-4b64-b985-faec5950b7c1 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:28.300495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-68042502-2056-4641-ba82-65bb102a57c6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:28.319585 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-68042502-2056-4641-ba82-65bb102a57c6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1473 microversion: 2.1 time: 1.728681 Jul 20 04:22:28.320903 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1430/2650] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:26 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1473 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:29.255725 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6e16dcf3-76cc-4b64-b985-faec5950b7c1 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:29.269133 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6e16dcf3-76cc-4b64-b985-faec5950b7c1 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1325 microversion: 2.1 time: 1.021045 Jul 20 04:22:29.275418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3a95e69b-73f4-4c06-98e3-cafc3691b369 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:29.276094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3a95e69b-73f4-4c06-98e3-cafc3691b369 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:29.284435 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1221/2651] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:28 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1325 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:29.295619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a95e69b-73f4-4c06-98e3-cafc3691b369 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:29.297455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a95e69b-73f4-4c06-98e3-cafc3691b369 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:29.298814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a95e69b-73f4-4c06-98e3-cafc3691b369 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:29.299257 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a95e69b-73f4-4c06-98e3-cafc3691b369 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:29.341392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7c311b70-8f6f-4f3a-bd83-2846c0463f74 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:29.342063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7c311b70-8f6f-4f3a-bd83-2846c0463f74 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:29.351938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c311b70-8f6f-4f3a-bd83-2846c0463f74 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:29.353482 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c311b70-8f6f-4f3a-bd83-2846c0463f74 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:29.355429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c311b70-8f6f-4f3a-bd83-2846c0463f74 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:29.357156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c311b70-8f6f-4f3a-bd83-2846c0463f74 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:29.807108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3a95e69b-73f4-4c06-98e3-cafc3691b369 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50084863834d461787c5512e7a04bddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61812dd23d4638a44417fd3d7cc446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:29.819843 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3a95e69b-73f4-4c06-98e3-cafc3691b369 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c" status: 200 len: 1268 microversion: 2.1 time: 0.545574 Jul 20 04:22:29.823296 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1431/2652] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:29 2022] GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c => generated 1268 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:30.144321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7c311b70-8f6f-4f3a-bd83-2846c0463f74 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:30.165662 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7c311b70-8f6f-4f3a-bd83-2846c0463f74 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1473 microversion: 2.1 time: 0.827772 Jul 20 04:22:30.167412 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1222/2653] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:29 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1473 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:30.307951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3da11807-73ac-48ec-ace7-631d9c008063 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:30.308820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3da11807-73ac-48ec-ace7-631d9c008063 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:30.323630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3da11807-73ac-48ec-ace7-631d9c008063 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:30.324177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3da11807-73ac-48ec-ace7-631d9c008063 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:30.325189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3da11807-73ac-48ec-ace7-631d9c008063 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:30.325606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3da11807-73ac-48ec-ace7-631d9c008063 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:30.883915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3fa632c8-6d94-4893-a3b0-b9b5a92ecf72 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:30.886097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3fa632c8-6d94-4893-a3b0-b9b5a92ecf72 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:30.906131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3fa632c8-6d94-4893-a3b0-b9b5a92ecf72 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:30.910169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3fa632c8-6d94-4893-a3b0-b9b5a92ecf72 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:30.913498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3fa632c8-6d94-4893-a3b0-b9b5a92ecf72 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:30.915868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3fa632c8-6d94-4893-a3b0-b9b5a92ecf72 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.049088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3da11807-73ac-48ec-ace7-631d9c008063 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:31.083827 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3da11807-73ac-48ec-ace7-631d9c008063 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1325 microversion: 2.1 time: 0.776519 Jul 20 04:22:31.087090 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1432/2654] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:30 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1325 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:31.159231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3fa632c8-6d94-4893-a3b0-b9b5a92ecf72 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50084863834d461787c5512e7a04bddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61812dd23d4638a44417fd3d7cc446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:31.169115 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3fa632c8-6d94-4893-a3b0-b9b5a92ecf72 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c" status: 200 len: 1274 microversion: 2.1 time: 0.320956 Jul 20 04:22:31.181099 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1223/2655] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:30 2022] GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c => generated 1274 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:31.200523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8bbeb2f0-7cc5-48b8-a86f-ab1f8238c0ac tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.201631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8bbeb2f0-7cc5-48b8-a86f-ab1f8238c0ac tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:31.241370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8bbeb2f0-7cc5-48b8-a86f-ab1f8238c0ac tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.244212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8bbeb2f0-7cc5-48b8-a86f-ab1f8238c0ac tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.247789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8bbeb2f0-7cc5-48b8-a86f-ab1f8238c0ac tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.255156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8bbeb2f0-7cc5-48b8-a86f-ab1f8238c0ac tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.683515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8e6b7782-f477-4902-b8d5-488aae8c7ec5 tempest-ListImagesTestJSON-448017200 tempest-ListImagesTestJSON-448017200-project] Calling method '.version_select at 0x7f06bddb2790>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.785442 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8e6b7782-f477-4902-b8d5-488aae8c7ec5 tempest-ListImagesTestJSON-448017200 tempest-ListImagesTestJSON-448017200-project] 10.222.0.17 "GET /compute/v2.1/images/dd295612-2ec2-458d-9fdf-8704437a5c0b" status: 200 len: 784 microversion: 2.1 time: 0.359755 Jul 20 04:22:31.787137 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1224/2656] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:31 2022] GET /compute/v2.1/images/dd295612-2ec2-458d-9fdf-8704437a5c0b => generated 784 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:22:31.830131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d62e7f78-5367-45f3-ab3a-ec3e037ee917 tempest-ListImagesTestJSON-448017200 tempest-ListImagesTestJSON-448017200-project] Calling method '.version_select at 0x7f06be1e1700>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.962008 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d62e7f78-5367-45f3-ab3a-ec3e037ee917 tempest-ListImagesTestJSON-448017200 tempest-ListImagesTestJSON-448017200-project] 10.222.0.17 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.156645 Jul 20 04:22:31.963799 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1225/2657] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 04:22:31 2022] GET /compute/v2.1/images => generated 445 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:31.982771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8bbeb2f0-7cc5-48b8-a86f-ab1f8238c0ac tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:31.992902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b15e7bd2-b459-4e47-a362-d351029f021e tempest-ListImagesTestJSON-448017200 tempest-ListImagesTestJSON-448017200-project] Calling method '.version_select at 0x7f06bddb2310>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.995750 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8bbeb2f0-7cc5-48b8-a86f-ab1f8238c0ac tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1473 microversion: 2.1 time: 0.803715 Jul 20 04:22:31.996463 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1433/2658] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:31 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1473 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:32.093158 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b15e7bd2-b459-4e47-a362-d351029f021e tempest-ListImagesTestJSON-448017200 tempest-ListImagesTestJSON-448017200-project] 10.222.0.17 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.108389 Jul 20 04:22:32.094975 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1226/2659] 10.222.0.17 () {58 vars in 1142 bytes} [Wed Jul 20 04:22:31 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:32.112798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-07bce312-d21b-4df4-b349-bfb55317a0ec tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:32.114223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-07bce312-d21b-4df4-b349-bfb55317a0ec tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:32.123044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07bce312-d21b-4df4-b349-bfb55317a0ec tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.123866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07bce312-d21b-4df4-b349-bfb55317a0ec tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.125524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07bce312-d21b-4df4-b349-bfb55317a0ec tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.126348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07bce312-d21b-4df4-b349-bfb55317a0ec tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.203129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-826e321c-3777-4ecc-b278-ee6c2beb8269 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:32.204064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-826e321c-3777-4ecc-b278-ee6c2beb8269 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:32.224891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-826e321c-3777-4ecc-b278-ee6c2beb8269 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.233968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-826e321c-3777-4ecc-b278-ee6c2beb8269 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.236125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-826e321c-3777-4ecc-b278-ee6c2beb8269 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.237500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-826e321c-3777-4ecc-b278-ee6c2beb8269 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.493581 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-826e321c-3777-4ecc-b278-ee6c2beb8269 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50084863834d461787c5512e7a04bddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61812dd23d4638a44417fd3d7cc446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:32.526328 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-826e321c-3777-4ecc-b278-ee6c2beb8269 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c" status: 200 len: 1274 microversion: 2.1 time: 0.326677 Jul 20 04:22:32.540198 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1227/2660] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:32 2022] GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c => generated 1274 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:33.005205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-07bce312-d21b-4df4-b349-bfb55317a0ec tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:33.017944 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-07bce312-d21b-4df4-b349-bfb55317a0ec tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1325 microversion: 2.1 time: 0.909244 Jul 20 04:22:33.019453 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1434/2661] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:32 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1325 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:33.028599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7332f1cc-6b80-466e-b278-ed26273d9567 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:33.030119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7332f1cc-6b80-466e-b278-ed26273d9567 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:33.058235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7332f1cc-6b80-466e-b278-ed26273d9567 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.058951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7332f1cc-6b80-466e-b278-ed26273d9567 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.059811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7332f1cc-6b80-466e-b278-ed26273d9567 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.060249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7332f1cc-6b80-466e-b278-ed26273d9567 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.553143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8fb760f3-c180-4de1-9748-5fcd148f025a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:33.555018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8fb760f3-c180-4de1-9748-5fcd148f025a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:33.578168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fb760f3-c180-4de1-9748-5fcd148f025a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.580133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fb760f3-c180-4de1-9748-5fcd148f025a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.581982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fb760f3-c180-4de1-9748-5fcd148f025a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.582960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fb760f3-c180-4de1-9748-5fcd148f025a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:34.091246 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8fb760f3-c180-4de1-9748-5fcd148f025a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50084863834d461787c5512e7a04bddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61812dd23d4638a44417fd3d7cc446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:34.106995 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8fb760f3-c180-4de1-9748-5fcd148f025a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c" status: 200 len: 1274 microversion: 2.1 time: 0.559081 Jul 20 04:22:34.108301 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1435/2662] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:33 2022] GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c => generated 1274 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:34.116044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e44d638e-81bc-4e27-9c47-4dc89ef14aa0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:34.119945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e44d638e-81bc-4e27-9c47-4dc89ef14aa0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:34.138787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e44d638e-81bc-4e27-9c47-4dc89ef14aa0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:34.139521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e44d638e-81bc-4e27-9c47-4dc89ef14aa0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:34.141138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e44d638e-81bc-4e27-9c47-4dc89ef14aa0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:34.141593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e44d638e-81bc-4e27-9c47-4dc89ef14aa0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:34.263948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7332f1cc-6b80-466e-b278-ed26273d9567 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:34.291538 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7332f1cc-6b80-466e-b278-ed26273d9567 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1473 microversion: 2.1 time: 1.280529 Jul 20 04:22:34.292155 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1228/2663] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:33 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1473 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:35.006860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1bfb6682-a299-4385-8ee0-6cb8df79bb61 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1733204260", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "c3db3bfb-11a7-406a-b082-1e92336f5a21"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:35.114976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-1bfb6682-a299-4385-8ee0-6cb8df79bb61 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] validate_networks() for [('c3db3bfb-11a7-406a-b082-1e92336f5a21', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:22:35.644189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e44d638e-81bc-4e27-9c47-4dc89ef14aa0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:35.664718 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e44d638e-81bc-4e27-9c47-4dc89ef14aa0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1325 microversion: 2.1 time: 1.554698 Jul 20 04:22:35.665717 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1436/2664] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:34 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1325 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:35.689610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d4757a82-3e65-45b9-943c-49f10313d0f7 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:35.691002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d4757a82-3e65-45b9-943c-49f10313d0f7 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:35.706115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4757a82-3e65-45b9-943c-49f10313d0f7 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:35.709066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4757a82-3e65-45b9-943c-49f10313d0f7 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:35.713238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4757a82-3e65-45b9-943c-49f10313d0f7 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:35.713944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4757a82-3e65-45b9-943c-49f10313d0f7 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.575368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d4757a82-3e65-45b9-943c-49f10313d0f7 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50084863834d461787c5512e7a04bddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61812dd23d4638a44417fd3d7cc446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:36.602450 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d4757a82-3e65-45b9-943c-49f10313d0f7 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c" status: 200 len: 1316 microversion: 2.1 time: 0.934757 Jul 20 04:22:36.634562 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1437/2665] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:35 2022] GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c => generated 1316 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:36.643898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4f24a693-fdd2-4621-b325-2da3fca75556 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:36.650611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4f24a693-fdd2-4621-b325-2da3fca75556 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:36.671420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f24a693-fdd2-4621-b325-2da3fca75556 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.673519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f24a693-fdd2-4621-b325-2da3fca75556 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.677911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f24a693-fdd2-4621-b325-2da3fca75556 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.679569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f24a693-fdd2-4621-b325-2da3fca75556 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.165477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:37.541275 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1bfb6682-a299-4385-8ee0-6cb8df79bb61 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:22:37.544128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1bfb6682-a299-4385-8ee0-6cb8df79bb61 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:22:37.549088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1bfb6682-a299-4385-8ee0-6cb8df79bb61 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:22:37.550052 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1bfb6682-a299-4385-8ee0-6cb8df79bb61 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:22:37.552115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1bfb6682-a299-4385-8ee0-6cb8df79bb61 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:22:37.613076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bfb6682-a299-4385-8ee0-6cb8df79bb61 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.615377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bfb6682-a299-4385-8ee0-6cb8df79bb61 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.619533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bfb6682-a299-4385-8ee0-6cb8df79bb61 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.622437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bfb6682-a299-4385-8ee0-6cb8df79bb61 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.653507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-1bfb6682-a299-4385-8ee0-6cb8df79bb61 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Getting quotas for project ae67de1fefe64bd19a3bf614f02d3535. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:37.674535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-1bfb6682-a299-4385-8ee0-6cb8df79bb61 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Getting quotas for user 1dc60058bea0485ebd4d502b2e7c986b and project ae67de1fefe64bd19a3bf614f02d3535. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:37.736577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1bfb6682-a299-4385-8ee0-6cb8df79bb61 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:22:37.743860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1bfb6682-a299-4385-8ee0-6cb8df79bb61 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:22:37.889166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4f24a693-fdd2-4621-b325-2da3fca75556 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:37.901262 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1bfb6682-a299-4385-8ee0-6cb8df79bb61 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.165920 Jul 20 04:22:37.904675 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1229/2666] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:22:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:22:37.910515 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4f24a693-fdd2-4621-b325-2da3fca75556 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1473 microversion: 2.1 time: 1.271034 Jul 20 04:22:37.913634 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1438/2667] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:36 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1473 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:37.918708 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-57c0c335-14a0-4c80-a1de-fd9041017e63 req-a955bfcd-e22c-4df1-8e0b-b7a87d1bd087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55", "name": "network-vif-plugged", "status": "completed", "tag": "03e1f1bc-ea38-4e03-b054-ea1a7c6f739d"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:37.939958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dff1b7db-3255-4f4b-8864-8e7222f124a0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.943918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dff1b7db-3255-4f4b-8864-8e7222f124a0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:37.980536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dff1b7db-3255-4f4b-8864-8e7222f124a0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.981454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dff1b7db-3255-4f4b-8864-8e7222f124a0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.982516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dff1b7db-3255-4f4b-8864-8e7222f124a0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.982952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-57c0c335-14a0-4c80-a1de-fd9041017e63 req-a955bfcd-e22c-4df1-8e0b-b7a87d1bd087 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.984969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dff1b7db-3255-4f4b-8864-8e7222f124a0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.985895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-57c0c335-14a0-4c80-a1de-fd9041017e63 req-a955bfcd-e22c-4df1-8e0b-b7a87d1bd087 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.040520 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-57c0c335-14a0-4c80-a1de-fd9041017e63 req-a955bfcd-e22c-4df1-8e0b-b7a87d1bd087 service nova] Creating event network-vif-plugged:03e1f1bc-ea38-4e03-b054-ea1a7c6f739d for instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 on n-h1-826526-5 Jul 20 04:22:38.071311 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-57c0c335-14a0-4c80-a1de-fd9041017e63 req-a955bfcd-e22c-4df1-8e0b-b7a87d1bd087 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164722 Jul 20 04:22:38.075664 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1230/2668] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:38.111279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0e39c6ba-4696-40f7-b884-6f428097c26e tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:38.112929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0e39c6ba-4696-40f7-b884-6f428097c26e tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:38.146904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e39c6ba-4696-40f7-b884-6f428097c26e tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.147705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e39c6ba-4696-40f7-b884-6f428097c26e tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.149683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e39c6ba-4696-40f7-b884-6f428097c26e tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.150687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e39c6ba-4696-40f7-b884-6f428097c26e tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.224518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0e39c6ba-4696-40f7-b884-6f428097c26e tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50084863834d461787c5512e7a04bddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61812dd23d4638a44417fd3d7cc446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:39.258629 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0e39c6ba-4696-40f7-b884-6f428097c26e tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c" status: 200 len: 1316 microversion: 2.1 time: 1.161883 Jul 20 04:22:39.261377 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1231/2669] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:38 2022] GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c => generated 1316 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:39.271702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7a9b5907-e551-4e32-9689-713e48668331 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:39.282610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7a9b5907-e551-4e32-9689-713e48668331 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:39.303378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a9b5907-e551-4e32-9689-713e48668331 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:39.303838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a9b5907-e551-4e32-9689-713e48668331 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.312590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a9b5907-e551-4e32-9689-713e48668331 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:39.313356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a9b5907-e551-4e32-9689-713e48668331 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.544840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7a9b5907-e551-4e32-9689-713e48668331 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:39.566122 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7a9b5907-e551-4e32-9689-713e48668331 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1219 microversion: 2.1 time: 0.302651 Jul 20 04:22:39.567538 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1232/2670] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:39 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1219 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:39.573222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-11fa6d72-bb7b-4787-aba0-549e66bde6dd req-639cb54d-3d3e-42d1-a5cf-ef1a2a66c05b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a9bb208-992c-4c4b-b5a6-989e0301427c", "tag": "4994ebae-d9b6-4924-921f-74558ba51721"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:39.603356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-11fa6d72-bb7b-4787-aba0-549e66bde6dd req-639cb54d-3d3e-42d1-a5cf-ef1a2a66c05b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:39.607672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-11fa6d72-bb7b-4787-aba0-549e66bde6dd req-639cb54d-3d3e-42d1-a5cf-ef1a2a66c05b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.647864 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-11fa6d72-bb7b-4787-aba0-549e66bde6dd req-639cb54d-3d3e-42d1-a5cf-ef1a2a66c05b service nova] Creating event network-changed:4994ebae-d9b6-4924-921f-74558ba51721 for instance 1a9bb208-992c-4c4b-b5a6-989e0301427c on n-h1-826526-5 Jul 20 04:22:39.654238 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-11fa6d72-bb7b-4787-aba0-549e66bde6dd req-639cb54d-3d3e-42d1-a5cf-ef1a2a66c05b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084450 Jul 20 04:22:39.656494 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1233/2671] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:39.684158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a8023835-2f55-49c4-8dbd-518069d8d638 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:39.685693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a8023835-2f55-49c4-8dbd-518069d8d638 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:39.709835 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8023835-2f55-49c4-8dbd-518069d8d638 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:39.710603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8023835-2f55-49c4-8dbd-518069d8d638 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.712217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8023835-2f55-49c4-8dbd-518069d8d638 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:39.713015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8023835-2f55-49c4-8dbd-518069d8d638 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.904657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dff1b7db-3255-4f4b-8864-8e7222f124a0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:39.918886 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dff1b7db-3255-4f4b-8864-8e7222f124a0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1325 microversion: 2.1 time: 1.999657 Jul 20 04:22:39.923755 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1439/2672] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1325 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:40.391099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8f877932-85a6-4ede-8520-4d13fedee6be tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Action: 'create', calling method: .version_select at 0x7f06bd49c550>, body: {"keypair": {"name": "tempest-keypair-1921303786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/w5NshNx+XfNyoenW2L1Sjo8JWOZAzgZ6j8M86vWAGLoM5OeAtFoQPHQKDfnifwEsXyFax9CDyd0N5p+Rvhah92KQbbkiUq0j4bqP7Kn/3RZ8QPI3A8f4AuSTF8MhutA=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:40.412886 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-8f877932-85a6-4ede-8520-4d13fedee6be tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Getting quotas for project 24f01857a87340fb92dd0d131450ba7f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:40.417664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a8023835-2f55-49c4-8dbd-518069d8d638 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:40.422431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-8f877932-85a6-4ede-8520-4d13fedee6be tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Getting quotas for user 33872c9031e942379417007db8031323 and project 24f01857a87340fb92dd0d131450ba7f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:40.429737 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a8023835-2f55-49c4-8dbd-518069d8d638 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1473 microversion: 2.1 time: 0.767740 Jul 20 04:22:40.447774 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1234/2673] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:39 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1473 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:40.464518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2c6e094b-35b2-4535-9ddc-29a88c2f320c tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:40.465908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2c6e094b-35b2-4535-9ddc-29a88c2f320c tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:40.473521 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8f877932-85a6-4ede-8520-4d13fedee6be tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.545248 Jul 20 04:22:40.474293 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1440/2674] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:22:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:40.487725 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c6e094b-35b2-4535-9ddc-29a88c2f320c tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:40.488381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c6e094b-35b2-4535-9ddc-29a88c2f320c tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:40.502152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1cabec37-4e50-4907-8045-aec8835f80dc tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Calling method '.version_select at 0x7f06bd4891f0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:40.504783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c6e094b-35b2-4535-9ddc-29a88c2f320c tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:40.505395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c6e094b-35b2-4535-9ddc-29a88c2f320c tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:40.517143 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1cabec37-4e50-4907-8045-aec8835f80dc tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-1921303786" status: 200 len: 498 microversion: 2.1 time: 0.035826 Jul 20 04:22:40.523545 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1441/2675] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jul 20 04:22:40 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1921303786 => generated 498 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:40.539151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-313bd347-2f1a-43ad-8cf4-1a82bc45d889 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Calling method '.version_select at 0x7f06bd44bc10>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:40.550321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:40.621705 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-313bd347-2f1a-43ad-8cf4-1a82bc45d889 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921303786" status: 202 len: 0 microversion: 2.1 time: 0.087462 Jul 20 04:22:40.630170 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1442/2676] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jul 20 04:22:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921303786 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:22:40.647979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3e6e8edd-61af-4da7-a43e-229ee9f1190b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:40.651214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3e6e8edd-61af-4da7-a43e-229ee9f1190b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:40.673410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e6e8edd-61af-4da7-a43e-229ee9f1190b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:40.674035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e6e8edd-61af-4da7-a43e-229ee9f1190b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:40.674953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e6e8edd-61af-4da7-a43e-229ee9f1190b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:40.675432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e6e8edd-61af-4da7-a43e-229ee9f1190b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:40.885613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3e6e8edd-61af-4da7-a43e-229ee9f1190b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:40.910019 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3e6e8edd-61af-4da7-a43e-229ee9f1190b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1285 microversion: 2.1 time: 0.277290 Jul 20 04:22:40.914400 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1443/2677] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:40 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1285 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:40.930944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-989ae7a7-7621-4894-94a6-6f35ab2e66c5 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Action: 'create', calling method: .version_select at 0x7f06be0993a0>, body: {"keypair": {"name": "tempest-keypair-1221823493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL+f/Ka/NXaC1sghJRPhDyFumaH4FJUq38SkZoaR5yczcgFaz93qjKEIop60FfOKVy6jVMxb6i1kWNY6hreztifnDiK+VPAGA5b01an+jGnNIlAkmrWr57KmoqjO4sSuA=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:40.947653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:40.980144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-989ae7a7-7621-4894-94a6-6f35ab2e66c5 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Getting quotas for project 24f01857a87340fb92dd0d131450ba7f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:41.004657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-989ae7a7-7621-4894-94a6-6f35ab2e66c5 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Getting quotas for user 33872c9031e942379417007db8031323 and project 24f01857a87340fb92dd0d131450ba7f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:41.043050 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-989ae7a7-7621-4894-94a6-6f35ab2e66c5 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127036 Jul 20 04:22:41.043699 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1444/2678] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:22:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:41.048994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3b60a035-2e9d-4e99-9f3d-e59d3f2292df tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:41.049905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3b60a035-2e9d-4e99-9f3d-e59d3f2292df tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:41.056930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b60a035-2e9d-4e99-9f3d-e59d3f2292df tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.057377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b60a035-2e9d-4e99-9f3d-e59d3f2292df tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:41.058695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b60a035-2e9d-4e99-9f3d-e59d3f2292df tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.063853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b60a035-2e9d-4e99-9f3d-e59d3f2292df tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:41.339691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3b60a035-2e9d-4e99-9f3d-e59d3f2292df tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:41.349136 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3b60a035-2e9d-4e99-9f3d-e59d3f2292df tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1522 microversion: 2.1 time: 0.304105 Jul 20 04:22:41.361790 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1445/2679] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:41 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:41.367412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ee7a2e28-15aa-4a4b-bbe1-6f4fb87d51ee tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Calling method '.version_select at 0x7f06bd44b8b0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:41.390514 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ee7a2e28-15aa-4a4b-bbe1-6f4fb87d51ee tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221823493" status: 202 len: 0 microversion: 2.1 time: 0.027143 Jul 20 04:22:41.391471 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1446/2680] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jul 20 04:22:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221823493 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:41.398808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5d1b9a52-9377-4723-9162-b627b4e460c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:41.399616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5d1b9a52-9377-4723-9162-b627b4e460c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:41.407426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d1b9a52-9377-4723-9162-b627b4e460c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.407871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d1b9a52-9377-4723-9162-b627b4e460c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:41.408970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d1b9a52-9377-4723-9162-b627b4e460c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.409566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d1b9a52-9377-4723-9162-b627b4e460c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:41.826775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2c6e094b-35b2-4535-9ddc-29a88c2f320c tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50084863834d461787c5512e7a04bddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61812dd23d4638a44417fd3d7cc446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:41.836482 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2c6e094b-35b2-4535-9ddc-29a88c2f320c tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c" status: 200 len: 1316 microversion: 2.1 time: 1.379236 Jul 20 04:22:41.837182 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1235/2681] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:40 2022] GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c => generated 1316 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:41.843861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c625494b-6980-4fe7-a3ee-371500daf14e tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Action: 'create', calling method: .version_select at 0x7f06bddcbf70>, body: {"keypair": {"name": "tempest-keypair-2099199733", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:41.864323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-c625494b-6980-4fe7-a3ee-371500daf14e tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Getting quotas for project 24f01857a87340fb92dd0d131450ba7f. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:41.866330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:41.876566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-c625494b-6980-4fe7-a3ee-371500daf14e tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Getting quotas for user 33872c9031e942379417007db8031323 and project 24f01857a87340fb92dd0d131450ba7f. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:41.922884 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c625494b-6980-4fe7-a3ee-371500daf14e tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.084296 Jul 20 04:22:41.924318 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1236/2682] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:22:41 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:41.934055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ac13ce59-b8cb-4b1a-b37c-8433c038ace6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:41.935121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ac13ce59-b8cb-4b1a-b37c-8433c038ace6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:41.946209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac13ce59-b8cb-4b1a-b37c-8433c038ace6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.947247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac13ce59-b8cb-4b1a-b37c-8433c038ace6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:41.949195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac13ce59-b8cb-4b1a-b37c-8433c038ace6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.950107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac13ce59-b8cb-4b1a-b37c-8433c038ace6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.146464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5d1b9a52-9377-4723-9162-b627b4e460c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:42.167708 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5d1b9a52-9377-4723-9162-b627b4e460c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1522 microversion: 2.1 time: 0.774240 Jul 20 04:22:42.169948 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1447/2683] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:41 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1522 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:42.181348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cf07e4b3-9e61-4209-ae38-78048916e53d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:42.181998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cf07e4b3-9e61-4209-ae38-78048916e53d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:42.205949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf07e4b3-9e61-4209-ae38-78048916e53d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:42.206808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf07e4b3-9e61-4209-ae38-78048916e53d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.208112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf07e4b3-9e61-4209-ae38-78048916e53d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:42.208825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf07e4b3-9e61-4209-ae38-78048916e53d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.370827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cf07e4b3-9e61-4209-ae38-78048916e53d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:42.383727 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cf07e4b3-9e61-4209-ae38-78048916e53d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1273 microversion: 2.1 time: 0.211749 Jul 20 04:22:42.398273 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1448/2684] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:42 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1273 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:42.406895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1bc872f4-6104-4043-a312-cba5ba7f78a3 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Calling method '.version_select at 0x7f06c73b9820>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:42.452513 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1bc872f4-6104-4043-a312-cba5ba7f78a3 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2099199733" status: 202 len: 0 microversion: 2.1 time: 0.052202 Jul 20 04:22:42.454934 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1449/2685] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jul 20 04:22:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2099199733 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:42.471863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8ddfa759-50c2-44ec-8505-dc2c1e371a07 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2015605823", "metadata": {"": ""}}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8ddfa759-50c2-44ec-8505-dc2c1e371a07 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Request method failure captured: Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55/action HTTP/1.1 Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 107 Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14LwP74voquJOtLNC80nY4ZOKAFurQEKphevt3p-NcmTDNTcaWLAg-fckOy-6qaK-Uj-RVjM3uvW0fJ5MaFo9LMosvXLySlQqG8Ey9DlZdPnuDB_iP3TZ5M6YQsQsoNbyd1UqrpYW2iCVzS94npO4hxJNvL7yAIupMlPI-7c7G6uq5M Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:22:42.475804 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:22:42.477789 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_baa5e3367dd747cda04291a3f97e7b02", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}] Jul 20 04:22:42.477789 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:22:42.477789 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:22:42.477789 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:22:42.477789 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:22:42.477789 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:22:42.477789 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:22:42.477789 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 23bf1fecf0c14154b1057a2ec35005a3 Jul 20 04:22:42.477789 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:22:42.477789 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:22:42.477789 n-d-826526-5 devstack@n-api.service[127871]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2015605823", "metadata": {"": ""}}} Jul 20 04:22:42.477789 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2015605823', 'metadata': {'': ''}}}} Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'': ''} Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:42.478790 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:22:42.480971 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:42.482823 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:42.482823 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:42.482823 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:22:42.482823 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:22:42.482823 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:22:42.482823 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:22:42.482823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8ddfa759-50c2-44ec-8505-dc2c1e371a07 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:42.482823 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8ddfa759-50c2-44ec-8505-dc2c1e371a07 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "POST /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55/action" status: 400 len: 170 microversion: 2.1 time: 0.024665 Jul 20 04:22:42.484178 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1450/2686] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Jul 20 04:22:42 2022] POST /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55/action => generated 170 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:22:42.496242 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cb8beff1-2984-40bf-b060-ddcaa7614580 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Action: 'create', calling method: .version_select at 0x7f06bd442dc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-5114845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMt8AWj+/V/Bst+YzIqx2n44U/vozAsqal/i4nX+U5BnB8nqvf7iGNEGOs863zUQKG2IDmoCyENzP8CwylsN0zfuGS+fqlea72sbL/085FTrVCnSumqHz/ReUHyQMjL5A=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:42.500375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ac13ce59-b8cb-4b1a-b37c-8433c038ace6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:42.521329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-cb8beff1-2984-40bf-b060-ddcaa7614580 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Getting quotas for project 24f01857a87340fb92dd0d131450ba7f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:42.523758 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ac13ce59-b8cb-4b1a-b37c-8433c038ace6 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1473 microversion: 2.1 time: 0.595228 Jul 20 04:22:42.525911 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1237/2687] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:41 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1473 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:42.527900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-cb8beff1-2984-40bf-b060-ddcaa7614580 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Getting quotas for user 33872c9031e942379417007db8031323 and project 24f01857a87340fb92dd0d131450ba7f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:42.550335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-59411822-4e42-4375-9b38-aa23f277a22f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:42.551457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-59411822-4e42-4375-9b38-aa23f277a22f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:42.563610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59411822-4e42-4375-9b38-aa23f277a22f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:42.564736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59411822-4e42-4375-9b38-aa23f277a22f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.567793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59411822-4e42-4375-9b38-aa23f277a22f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:42.568554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59411822-4e42-4375-9b38-aa23f277a22f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.587780 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cb8beff1-2984-40bf-b060-ddcaa7614580 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.097058 Jul 20 04:22:42.599539 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1451/2688] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:22:42 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:42.607789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8a29550f-7fc4-4a1c-a677-e29962d32c81 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Action: 'create', calling method: .version_select at 0x7f06c739a9d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1697969672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfKHOuIGfm3w845lFGGpg/6NrqjlO0Dgjo7uUGv0fRiswWKkV2/svHmPlV1RgzRDDhGC/T4szG86I0iBaIWZengCWRzQ3WOOj6kYlHEZiiWFzRYj/4jjZB1c7LFRco8gg=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:42.670481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-8a29550f-7fc4-4a1c-a677-e29962d32c81 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Getting quotas for project 24f01857a87340fb92dd0d131450ba7f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:42.679400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-8a29550f-7fc4-4a1c-a677-e29962d32c81 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Getting quotas for user 33872c9031e942379417007db8031323 and project 24f01857a87340fb92dd0d131450ba7f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:42.726700 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8a29550f-7fc4-4a1c-a677-e29962d32c81 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.125513 Jul 20 04:22:42.727490 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1452/2689] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:22:42 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:22:42.750202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c57ab6c2-7664-4520-846f-8b38f18748c2 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Action: 'create', calling method: .version_select at 0x7f06c73b9820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-238748114", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiKDs+AxAEuoqsEllgjb7X/oDKLdccoridVoQglVXMwivysXqMDo9rJLvmP+nCXkMZ2EkNDMybz/L6pY/lg9h2s4kykNYhd8eoCAcLi7grP0lnqQChHkSST0lJLVRzArw=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:42.777981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c57ab6c2-7664-4520-846f-8b38f18748c2 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Getting quotas for project 24f01857a87340fb92dd0d131450ba7f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:42.801191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c57ab6c2-7664-4520-846f-8b38f18748c2 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Getting quotas for user 33872c9031e942379417007db8031323 and project 24f01857a87340fb92dd0d131450ba7f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:42.834330 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c57ab6c2-7664-4520-846f-8b38f18748c2 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.092042 Jul 20 04:22:42.841681 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1453/2690] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:22:42 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:42.847794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0527681a-8d1b-4520-9403-2fddcbf496d7 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Calling method '.version_select at 0x7f06c73b2670>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:42.851160 n-d-826526-5 devstack@n-api.service[127871]: WARNING oslo_db.sqlalchemy.utils [None req-0527681a-8d1b-4520-9403-2fddcbf496d7 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:22:42.858760 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0527681a-8d1b-4520-9403-2fddcbf496d7 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 1090 microversion: 2.1 time: 0.015294 Jul 20 04:22:42.859728 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1454/2691] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:22:42 2022] GET /compute/v2.1/os-keypairs => generated 1090 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:42.871655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-41bb5048-eda7-48c9-b156-9225179c583a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:42.872520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-41bb5048-eda7-48c9-b156-9225179c583a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:42.883649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41bb5048-eda7-48c9-b156-9225179c583a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:42.884170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41bb5048-eda7-48c9-b156-9225179c583a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.885330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41bb5048-eda7-48c9-b156-9225179c583a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:42.886889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41bb5048-eda7-48c9-b156-9225179c583a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.936674 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:43.197478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-59411822-4e42-4375-9b38-aa23f277a22f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:43.205448 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-59411822-4e42-4375-9b38-aa23f277a22f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1522 microversion: 2.1 time: 0.661489 Jul 20 04:22:43.206058 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1238/2692] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:42 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1522 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:43.226932 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c8bc0f64-6d43-47aa-a589-205788981455 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Calling method '.version_select at 0x7f06be0624c0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:43.264694 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c8bc0f64-6d43-47aa-a589-205788981455 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-238748114" status: 202 len: 0 microversion: 2.1 time: 0.045289 Jul 20 04:22:43.266118 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1239/2693] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:22:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-238748114 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:43.280833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a72bef05-7e3f-4f86-ab01-d5440b6b863c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:43.281681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a72bef05-7e3f-4f86-ab01-d5440b6b863c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:43.291537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a72bef05-7e3f-4f86-ab01-d5440b6b863c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:43.292353 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a72bef05-7e3f-4f86-ab01-d5440b6b863c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:43.294085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a72bef05-7e3f-4f86-ab01-d5440b6b863c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:43.295680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a72bef05-7e3f-4f86-ab01-d5440b6b863c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:43.326351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-41bb5048-eda7-48c9-b156-9225179c583a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50084863834d461787c5512e7a04bddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61812dd23d4638a44417fd3d7cc446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:43.345595 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-41bb5048-eda7-48c9-b156-9225179c583a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c" status: 200 len: 1316 microversion: 2.1 time: 0.479462 Jul 20 04:22:43.346300 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1455/2694] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:42 2022] GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:43.353921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7fdfa9c9-e0bf-4f3b-8b73-f19246aa9351 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Calling method '.version_select at 0x7f06c73b95e0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:43.401891 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7fdfa9c9-e0bf-4f3b-8b73-f19246aa9351 tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1697969672" status: 202 len: 0 microversion: 2.1 time: 0.054024 Jul 20 04:22:43.407217 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1456/2695] 10.222.0.17 () {58 vars in 1277 bytes} [Wed Jul 20 04:22:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1697969672 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:43.414447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5dc94614-94a3-4ba8-b25b-48f5f3b41cf6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:43.415883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5dc94614-94a3-4ba8-b25b-48f5f3b41cf6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:43.433267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dc94614-94a3-4ba8-b25b-48f5f3b41cf6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:43.434297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dc94614-94a3-4ba8-b25b-48f5f3b41cf6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:43.448799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dc94614-94a3-4ba8-b25b-48f5f3b41cf6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:43.449772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dc94614-94a3-4ba8-b25b-48f5f3b41cf6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:43.636799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5dc94614-94a3-4ba8-b25b-48f5f3b41cf6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:43.686290 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5dc94614-94a3-4ba8-b25b-48f5f3b41cf6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1273 microversion: 2.1 time: 0.262675 Jul 20 04:22:43.690267 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1457/2696] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:43 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1273 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:43.705755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5881d6ba-e224-4047-8faf-ccf488f2397e tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] Calling method '.version_select at 0x7f06c739a940>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:43.755023 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5881d6ba-e224-4047-8faf-ccf488f2397e tempest-KeyPairsV2TestJSON-1043447513 tempest-KeyPairsV2TestJSON-1043447513-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-5114845" status: 202 len: 0 microversion: 2.1 time: 0.060837 Jul 20 04:22:43.762102 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1458/2697] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 04:22:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-5114845 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:43.773786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-949856b2-8c38-47fb-aae7-23a5ad7cf030 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:43.780183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-949856b2-8c38-47fb-aae7-23a5ad7cf030 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:43.797382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-949856b2-8c38-47fb-aae7-23a5ad7cf030 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:43.798720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-949856b2-8c38-47fb-aae7-23a5ad7cf030 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:43.802760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-949856b2-8c38-47fb-aae7-23a5ad7cf030 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:43.803493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-949856b2-8c38-47fb-aae7-23a5ad7cf030 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:44.044995 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a72bef05-7e3f-4f86-ab01-d5440b6b863c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:44.074749 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a72bef05-7e3f-4f86-ab01-d5440b6b863c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1522 microversion: 2.1 time: 0.806849 Jul 20 04:22:44.082083 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1240/2698] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:43 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1522 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:44.129093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ff8caf36-68a6-44d7-82e1-b7ce45cfb3b7 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1744434915", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ff8caf36-68a6-44d7-82e1-b7ce45cfb3b7 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Request method failure captured: Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55/action HTTP/1.1 Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 619 Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14LwP74voquJOtLNC80nY4ZOKAFurQEKphevt3p-NcmTDNTcaWLAg-fckOy-6qaK-Uj-RVjM3uvW0fJ5MaFo9LMosvXLySlQqG8Ey9DlZdPnuDB_iP3TZ5M6YQsQsoNbyd1UqrpYW2iCVzS94npO4hxJNvL7yAIupMlPI-7c7G6uq5M Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:22:44.141761 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:22:44.144233 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_baa5e3367dd747cda04291a3f97e7b02", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}] Jul 20 04:22:44.144233 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:22:44.144233 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:22:44.144233 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:22:44.144233 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:22:44.144233 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:22:44.144233 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:22:44.144233 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 23bf1fecf0c14154b1057a2ec35005a3 Jul 20 04:22:44.144233 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:22:44.144233 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:22:44.145314 n-d-826526-5 devstack@n-api.service[127870]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1744434915", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 20 04:22:44.145314 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:22:44.145314 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:22:44.146512 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1744434915', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 20 04:22:44.146512 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:44.146512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:44.146512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:22:44.146512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:22:44.146512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:22:44.146512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:22:44.146512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:22:44.146512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:44.146512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 20 04:22:44.146512 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:22:44.147671 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:22:44.147671 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:22:44.147671 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:22:44.147671 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:44.147671 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 20 04:22:44.147671 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 20 04:22:44.147671 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:44.147671 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:44.147671 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:44.147671 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:44.147671 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:44.147671 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:44.147671 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:44.147671 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:44.147671 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:44.147671 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:44.147671 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:22:44.149729 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:22:44.149729 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:22:44.149729 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:22:44.149729 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:22:44.149729 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:22:44.149729 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:22:44.149729 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:22:44.149729 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:22:44.149729 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:44.149729 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:44.149729 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:44.149729 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:44.154331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:44.154331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:44.154331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:22:44.154331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:22:44.154331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:22:44.154331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:44.162186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ff8caf36-68a6-44d7-82e1-b7ce45cfb3b7 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:44.163553 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ff8caf36-68a6-44d7-82e1-b7ce45cfb3b7 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "POST /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55/action" status: 400 len: 938 microversion: 2.1 time: 0.067462 Jul 20 04:22:44.170506 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1241/2699] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Jul 20 04:22:44 2022] POST /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55/action => generated 938 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:22:44.209274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-27f61ba2-ccdb-4a98-aadf-b06be746e6cc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:44.221480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-27f61ba2-ccdb-4a98-aadf-b06be746e6cc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:44.236286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27f61ba2-ccdb-4a98-aadf-b06be746e6cc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:44.237060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27f61ba2-ccdb-4a98-aadf-b06be746e6cc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:44.238036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27f61ba2-ccdb-4a98-aadf-b06be746e6cc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:44.238707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27f61ba2-ccdb-4a98-aadf-b06be746e6cc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:44.863441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-949856b2-8c38-47fb-aae7-23a5ad7cf030 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:44.876934 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-949856b2-8c38-47fb-aae7-23a5ad7cf030 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1473 microversion: 2.1 time: 1.113473 Jul 20 04:22:44.889769 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1459/2700] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:43 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1473 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:44.897224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4a18e24c-7067-4257-b2a6-cdf2c46e3f27 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:44.898382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4a18e24c-7067-4257-b2a6-cdf2c46e3f27 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:44.925794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4a18e24c-7067-4257-b2a6-cdf2c46e3f27 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:44.927123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4a18e24c-7067-4257-b2a6-cdf2c46e3f27 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:44.928317 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4a18e24c-7067-4257-b2a6-cdf2c46e3f27 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:44.929070 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4a18e24c-7067-4257-b2a6-cdf2c46e3f27 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:45.276053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-27f61ba2-ccdb-4a98-aadf-b06be746e6cc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:45.295595 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-27f61ba2-ccdb-4a98-aadf-b06be746e6cc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1522 microversion: 2.1 time: 1.106779 Jul 20 04:22:45.298904 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1242/2701] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:44 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1522 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:45.314628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-87d84bf2-0598-4c7d-8d20-2e51fa0c0f81 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:45.315927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-87d84bf2-0598-4c7d-8d20-2e51fa0c0f81 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:45.335166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87d84bf2-0598-4c7d-8d20-2e51fa0c0f81 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:45.335634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87d84bf2-0598-4c7d-8d20-2e51fa0c0f81 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:45.339240 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87d84bf2-0598-4c7d-8d20-2e51fa0c0f81 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:45.339702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87d84bf2-0598-4c7d-8d20-2e51fa0c0f81 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:46.057295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4a18e24c-7067-4257-b2a6-cdf2c46e3f27 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50084863834d461787c5512e7a04bddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61812dd23d4638a44417fd3d7cc446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:46.078570 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4a18e24c-7067-4257-b2a6-cdf2c46e3f27 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c" status: 200 len: 1316 microversion: 2.1 time: 1.184825 Jul 20 04:22:46.081566 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1460/2702] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:44 2022] GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c => generated 1316 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:46.093291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1aaaa47b-74fd-4478-b33a-ce7571e55473 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:46.094846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1aaaa47b-74fd-4478-b33a-ce7571e55473 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:46.102161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-87d84bf2-0598-4c7d-8d20-2e51fa0c0f81 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:46.119233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1aaaa47b-74fd-4478-b33a-ce7571e55473 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:46.119617 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-87d84bf2-0598-4c7d-8d20-2e51fa0c0f81 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1315 microversion: 2.1 time: 0.817579 Jul 20 04:22:46.119973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1aaaa47b-74fd-4478-b33a-ce7571e55473 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:46.121156 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1243/2703] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:45 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1315 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:46.123402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1aaaa47b-74fd-4478-b33a-ce7571e55473 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:46.124642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1aaaa47b-74fd-4478-b33a-ce7571e55473 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:46.142297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a5f09b4b-396d-4c35-a283-c7a4c54231b4 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:46.144086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a5f09b4b-396d-4c35-a283-c7a4c54231b4 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:46.160174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5f09b4b-396d-4c35-a283-c7a4c54231b4 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:46.161102 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5f09b4b-396d-4c35-a283-c7a4c54231b4 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:46.162680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5f09b4b-396d-4c35-a283-c7a4c54231b4 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:46.163544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5f09b4b-396d-4c35-a283-c7a4c54231b4 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:46.547649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a5f09b4b-396d-4c35-a283-c7a4c54231b4 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:46.560183 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a5f09b4b-396d-4c35-a283-c7a4c54231b4 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1473 microversion: 2.1 time: 0.437283 Jul 20 04:22:46.561608 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1244/2704] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:46 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1473 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:46.876657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1aaaa47b-74fd-4478-b33a-ce7571e55473 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:46.892160 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1aaaa47b-74fd-4478-b33a-ce7571e55473 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1522 microversion: 2.1 time: 0.808481 Jul 20 04:22:46.908951 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1461/2705] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:46 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1522 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:46.920846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4d5a7f10-e197-4d60-a518-0c46b69635d9 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4d5a7f10-e197-4d60-a518-0c46b69635d9 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Request method failure captured: Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55/action HTTP/1.1 Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 285 Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14LwP74voquJOtLNC80nY4ZOKAFurQEKphevt3p-NcmTDNTcaWLAg-fckOy-6qaK-Uj-RVjM3uvW0fJ5MaFo9LMosvXLySlQqG8Ey9DlZdPnuDB_iP3TZ5M6YQsQsoNbyd1UqrpYW2iCVzS94npO4hxJNvL7yAIupMlPI-7c7G6uq5M Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:22:46.923736 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:22:46.926237 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_baa5e3367dd747cda04291a3f97e7b02", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}] Jul 20 04:22:46.926237 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:22:46.926237 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:22:46.926237 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:22:46.926237 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:22:46.926237 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:22:46.926237 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:22:46.926237 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 23bf1fecf0c14154b1057a2ec35005a3 Jul 20 04:22:46.926237 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:22:46.926237 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:22:46.926237 n-d-826526-5 devstack@n-api.service[127870]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 20 04:22:46.927234 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:22:46.927234 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:22:46.927234 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 20 04:22:46.927234 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:46.927234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:46.927234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:22:46.927234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:22:46.927234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:22:46.927234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:22:46.927234 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:22:46.928380 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:22:46.936213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:22:46.936213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:22:46.936213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:22:46.936213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:22:46.936213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:22:46.936213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:46.936213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:46.936213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:46.936213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:46.936213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:46.936213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:46.936213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:22:46.936213 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:22:46.937418 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:22:46.937418 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:46.937418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4d5a7f10-e197-4d60-a518-0c46b69635d9 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:46.937418 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4d5a7f10-e197-4d60-a518-0c46b69635d9 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "POST /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55/action" status: 400 len: 619 microversion: 2.1 time: 0.014510 Jul 20 04:22:46.937738 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1245/2706] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Jul 20 04:22:46 2022] POST /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55/action => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:22:46.944740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c1c02d0c-5fc7-4112-94e7-db353f8c9752 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:46.946055 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c1c02d0c-5fc7-4112-94e7-db353f8c9752 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:46.953646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1c02d0c-5fc7-4112-94e7-db353f8c9752 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:46.953971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1c02d0c-5fc7-4112-94e7-db353f8c9752 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:46.955107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1c02d0c-5fc7-4112-94e7-db353f8c9752 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:46.956689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1c02d0c-5fc7-4112-94e7-db353f8c9752 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:47.113986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ccae0031-24f6-4ee4-b932-6df040a73e16 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:47.115572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ccae0031-24f6-4ee4-b932-6df040a73e16 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:47.134153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccae0031-24f6-4ee4-b932-6df040a73e16 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:47.135193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccae0031-24f6-4ee4-b932-6df040a73e16 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:47.137969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccae0031-24f6-4ee4-b932-6df040a73e16 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:47.139190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccae0031-24f6-4ee4-b932-6df040a73e16 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:47.487898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c1c02d0c-5fc7-4112-94e7-db353f8c9752 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:47.515902 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c1c02d0c-5fc7-4112-94e7-db353f8c9752 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1522 microversion: 2.1 time: 0.569334 Jul 20 04:22:47.517612 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1462/2707] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:46 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1522 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:47.525363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a37deed5-d2c7-4fa1-98e8-b1c6129b4fe5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:47.534524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a37deed5-d2c7-4fa1-98e8-b1c6129b4fe5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:47.560474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a37deed5-d2c7-4fa1-98e8-b1c6129b4fe5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:47.561873 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a37deed5-d2c7-4fa1-98e8-b1c6129b4fe5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:47.566956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a37deed5-d2c7-4fa1-98e8-b1c6129b4fe5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:47.568564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a37deed5-d2c7-4fa1-98e8-b1c6129b4fe5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:47.640938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:48.001439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a37deed5-d2c7-4fa1-98e8-b1c6129b4fe5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:48.034533 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a37deed5-d2c7-4fa1-98e8-b1c6129b4fe5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1315 microversion: 2.1 time: 0.513404 Jul 20 04:22:48.036981 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1463/2708] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:47 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:48.070300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-9beaf4dd-4337-4343-9f7b-f1439e414098 req-f83b9c5e-e6e7-4d75-b4fa-07e64a111c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a9bb208-992c-4c4b-b5a6-989e0301427c", "name": "network-vif-plugged", "status": "completed", "tag": "4994ebae-d9b6-4924-921f-74558ba51721"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:48.093986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9beaf4dd-4337-4343-9f7b-f1439e414098 req-f83b9c5e-e6e7-4d75-b4fa-07e64a111c7f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:48.096097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9beaf4dd-4337-4343-9f7b-f1439e414098 req-f83b9c5e-e6e7-4d75-b4fa-07e64a111c7f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:48.125617 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9beaf4dd-4337-4343-9f7b-f1439e414098 req-f83b9c5e-e6e7-4d75-b4fa-07e64a111c7f service nova] Creating event network-vif-plugged:4994ebae-d9b6-4924-921f-74558ba51721 for instance 1a9bb208-992c-4c4b-b5a6-989e0301427c on n-h1-826526-5 Jul 20 04:22:48.136691 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-9beaf4dd-4337-4343-9f7b-f1439e414098 req-f83b9c5e-e6e7-4d75-b4fa-07e64a111c7f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097046 Jul 20 04:22:48.138565 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1464/2709] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:48.148300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6fee1c97-5679-4d26-9666-c19dc2c87157 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:48.149846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6fee1c97-5679-4d26-9666-c19dc2c87157 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:48.174867 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6fee1c97-5679-4d26-9666-c19dc2c87157 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:48.175585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6fee1c97-5679-4d26-9666-c19dc2c87157 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:48.178575 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6fee1c97-5679-4d26-9666-c19dc2c87157 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:48.179136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6fee1c97-5679-4d26-9666-c19dc2c87157 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:48.357618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ccae0031-24f6-4ee4-b932-6df040a73e16 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50084863834d461787c5512e7a04bddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61812dd23d4638a44417fd3d7cc446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:48.369156 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ccae0031-24f6-4ee4-b932-6df040a73e16 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c" status: 200 len: 1316 microversion: 2.1 time: 1.262119 Jul 20 04:22:48.388405 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1246/2710] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:47 2022] GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c => generated 1316 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:48.401196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-491880e1-7bf5-4a34-809f-474312e514ef tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:48.403453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-491880e1-7bf5-4a34-809f-474312e514ef tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:48.416230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-491880e1-7bf5-4a34-809f-474312e514ef tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:48.417730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-491880e1-7bf5-4a34-809f-474312e514ef tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:48.419490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-491880e1-7bf5-4a34-809f-474312e514ef tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:48.420722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-491880e1-7bf5-4a34-809f-474312e514ef tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:48.544650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6fee1c97-5679-4d26-9666-c19dc2c87157 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:48.570225 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6fee1c97-5679-4d26-9666-c19dc2c87157 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1522 microversion: 2.1 time: 0.429905 Jul 20 04:22:48.572026 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1465/2711] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:48 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:48.837412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-47ee95a2-d398-43b4-935a-b1e5c0994d29 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Action: 'create', calling method: .version_select at 0x7f06bd49cb80>, body: {"keypair": {"name": "tempest-keypair-679215685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCvXQFK/MEuqj3o5eLPBirpoMwoKDU7Nd6gGvfEYWJhOFi0Rb3lJE5ztV94Keyu+Ao5fQjuyFDCrt495tow8Ku64o6eu6KUYSE8RMykXRIdvB2CR64XBGJ1dVZcqV/+nw=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:48.876974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-47ee95a2-d398-43b4-935a-b1e5c0994d29 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Getting quotas for project 3a190cacaa15402f9e721b899bf8a9ec. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:48.888131 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-47ee95a2-d398-43b4-935a-b1e5c0994d29 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Getting quotas for user 270b1f8473c74a92bdbcb06d7fc619fb and project 3a190cacaa15402f9e721b899bf8a9ec. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:48.913477 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:48.923793 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-47ee95a2-d398-43b4-935a-b1e5c0994d29 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.349666 Jul 20 04:22:48.931049 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1466/2712] 10.222.0.17 () {62 vars in 1198 bytes} [Wed Jul 20 04:22:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 358 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:22:48.937576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4add7c2a-ee32-4573-b85a-0217a15fa6c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-70168041"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:48.938924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4add7c2a-ee32-4573-b85a-0217a15fa6c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:48.948676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4add7c2a-ee32-4573-b85a-0217a15fa6c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:48.949468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4add7c2a-ee32-4573-b85a-0217a15fa6c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:48.950445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4add7c2a-ee32-4573-b85a-0217a15fa6c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:48.951375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4add7c2a-ee32-4573-b85a-0217a15fa6c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.126850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-491880e1-7bf5-4a34-809f-474312e514ef tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:49.149145 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-491880e1-7bf5-4a34-809f-474312e514ef tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1473 microversion: 2.1 time: 0.759069 Jul 20 04:22:49.156603 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1247/2713] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:48 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1473 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:49.173133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b185bfcc-5ec6-4067-95e1-9292989ca053 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Calling method '.version_select at 0x7f06be0624c0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:49.201902 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b185bfcc-5ec6-4067-95e1-9292989ca053 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-679215685" status: 200 len: 512 microversion: 2.2 time: 0.043756 Jul 20 04:22:49.205243 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1248/2714] 10.222.0.17 () {60 vars in 1254 bytes} [Wed Jul 20 04:22:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-679215685 => generated 512 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:49.217699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-88544d64-4108-4cc5-af53-ac678f223be4 req-d220c77d-92bd-4186-9617-9b034f396526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b271cf2-d6b2-479e-8422-2edba3000fa2", "tag": "828d5fbf-9e79-4cb9-a15c-8409a2f81820"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:49.245583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-88544d64-4108-4cc5-af53-ac678f223be4 req-d220c77d-92bd-4186-9617-9b034f396526 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:49.247612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-88544d64-4108-4cc5-af53-ac678f223be4 req-d220c77d-92bd-4186-9617-9b034f396526 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.309035 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-88544d64-4108-4cc5-af53-ac678f223be4 req-d220c77d-92bd-4186-9617-9b034f396526 service nova] Creating event network-changed:828d5fbf-9e79-4cb9-a15c-8409a2f81820 for instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 on n-h2-826526-5 Jul 20 04:22:49.320139 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-88544d64-4108-4cc5-af53-ac678f223be4 req-d220c77d-92bd-4186-9617-9b034f396526 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115081 Jul 20 04:22:49.323560 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1249/2715] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:49.329203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-605d4c4c-b83d-4945-b124-17c8a1356ae0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:49.330065 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-605d4c4c-b83d-4945-b124-17c8a1356ae0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:49.340791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-605d4c4c-b83d-4945-b124-17c8a1356ae0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:49.341293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-605d4c4c-b83d-4945-b124-17c8a1356ae0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.342393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-605d4c4c-b83d-4945-b124-17c8a1356ae0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:49.342807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-605d4c4c-b83d-4945-b124-17c8a1356ae0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.560065 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4add7c2a-ee32-4573-b85a-0217a15fa6c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "POST /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55/action" status: 202 len: 0 microversion: 2.1 time: 0.627241 Jul 20 04:22:49.572199 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1467/2716] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:48 2022] POST /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55/action => generated 0 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:22:49.572199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-df18c88f-3a3c-401b-b032-a97b53a37e9d tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Calling method '.version_select at 0x7f06bdf75310>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:49.651521 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-df18c88f-3a3c-401b-b032-a97b53a37e9d tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-679215685" status: 204 len: 0 microversion: 2.2 time: 0.088010 Jul 20 04:22:49.655795 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1468/2717] 10.222.0.17 () {60 vars in 1257 bytes} [Wed Jul 20 04:22:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-679215685 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:49.674053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d91c9f5-1725-4e83-98ac-f6a27ee7d766 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:49.676851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4d91c9f5-1725-4e83-98ac-f6a27ee7d766 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:49.701505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d91c9f5-1725-4e83-98ac-f6a27ee7d766 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:49.702622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d91c9f5-1725-4e83-98ac-f6a27ee7d766 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.704331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d91c9f5-1725-4e83-98ac-f6a27ee7d766 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:49.705294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d91c9f5-1725-4e83-98ac-f6a27ee7d766 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.967104 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-605d4c4c-b83d-4945-b124-17c8a1356ae0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:49.985384 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-605d4c4c-b83d-4945-b124-17c8a1356ae0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1315 microversion: 2.1 time: 0.657933 Jul 20 04:22:49.986490 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1250/2718] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:49 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:49.998407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-57597c74-aec9-42b3-acfa-fee81253b2bd tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1646666921"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:50.000574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-57597c74-aec9-42b3-acfa-fee81253b2bd tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:50.014590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57597c74-aec9-42b3-acfa-fee81253b2bd tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:50.016401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57597c74-aec9-42b3-acfa-fee81253b2bd tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:50.018269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57597c74-aec9-42b3-acfa-fee81253b2bd tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:50.019355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57597c74-aec9-42b3-acfa-fee81253b2bd tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:50.078307 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-57597c74-aec9-42b3-acfa-fee81253b2bd tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] HTTP exception thrown: Cannot 'createImage' instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 while it is in task_state image_snapshot Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-57597c74-aec9-42b3-acfa-fee81253b2bd tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Request method failure captured: Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55/action HTTP/1.1 Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 85 Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14LwP74voquJOtLNC80nY4ZOKAFurQEKphevt3p-NcmTDNTcaWLAg-fckOy-6qaK-Uj-RVjM3uvW0fJ5MaFo9LMosvXLySlQqG8Ey9DlZdPnuDB_iP3TZ5M6YQsQsoNbyd1UqrpYW2iCVzS94npO4hxJNvL7yAIupMlPI-7c7G6uq5M Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:22:50.080700 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:22:50.082756 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_baa5e3367dd747cda04291a3f97e7b02", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}] Jul 20 04:22:50.082756 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:22:50.082756 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:22:50.082756 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:22:50.082756 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:22:50.082756 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:22:50.082756 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:22:50.082756 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 23bf1fecf0c14154b1057a2ec35005a3 Jul 20 04:22:50.082756 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:22:50.082756 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:22:50.082756 n-d-826526-5 devstack@n-api.service[127870]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1646666921"}} Jul 20 04:22:50.082756 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: exception: Cannot 'createImage' instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 while it is in task_state image_snapshot Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1646666921'}}} Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:50.084491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 while it is in task_state image_snapshot Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 while it is in task_state image_snapshot Jul 20 04:22:50.086331 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:50.088341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-57597c74-aec9-42b3-acfa-fee81253b2bd tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Returning 409 to user: Cannot 'createImage' instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 while it is in task_state image_snapshot {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:50.088341 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-57597c74-aec9-42b3-acfa-fee81253b2bd tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "POST /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55/action" status: 409 len: 159 microversion: 2.1 time: 0.094423 Jul 20 04:22:50.088341 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1251/2719] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:49 2022] POST /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55/action => generated 159 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:22:50.094420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-53826774-9e16-41f7-b8a5-8592716f362c tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Action: 'create', calling method: .version_select at 0x7f06bdda1b80>, body: {"keypair": {"name": "tempest-keypair-990379601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOi5PZizas40TzytO3Wc1qWvTYXn6qFXxPskFA/G1EPlY3eN9EVAn4nXBOEppo+1mBnAZennKpHHhoNR/+RaEOP1nr2/WqwomzzRdn6OPj/B7lbHChp/0DbvwZSJAuR2w=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:50.114517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-53826774-9e16-41f7-b8a5-8592716f362c tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Getting quotas for project 3a190cacaa15402f9e721b899bf8a9ec. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:50.121516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-53826774-9e16-41f7-b8a5-8592716f362c tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Getting quotas for user 270b1f8473c74a92bdbcb06d7fc619fb and project 3a190cacaa15402f9e721b899bf8a9ec. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:50.159259 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-53826774-9e16-41f7-b8a5-8592716f362c tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.073906 Jul 20 04:22:50.165607 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1252/2720] 10.222.0.17 () {62 vars in 1198 bytes} [Wed Jul 20 04:22:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:22:50.172170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-55c071df-c965-42e7-9977-184db288fff6 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '.version_select at 0x7f06bdda1f70>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:50.423380 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-55c071df-c965-42e7-9977-184db288fff6 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "DELETE /compute/v2.1/images/25424b03-a504-4f73-8830-d0fdf969a3ca" status: 204 len: 0 microversion: 2.1 time: 0.254118 Jul 20 04:22:50.425279 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1253/2721] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:50 2022] DELETE /compute/v2.1/images/25424b03-a504-4f73-8830-d0fdf969a3ca => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:50.437173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f656e347-a23a-44bd-bbd2-0932a7e5002b tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Calling method '.version_select at 0x7f06bde57c10>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:50.440618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4d91c9f5-1725-4e83-98ac-f6a27ee7d766 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50084863834d461787c5512e7a04bddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61812dd23d4638a44417fd3d7cc446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:50.448723 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4d91c9f5-1725-4e83-98ac-f6a27ee7d766 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c" status: 200 len: 1316 microversion: 2.1 time: 0.790986 Jul 20 04:22:50.452649 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1469/2722] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:49 2022] GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c => generated 1316 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:50.470413 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f656e347-a23a-44bd-bbd2-0932a7e5002b tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-990379601" status: 204 len: 0 microversion: 2.2 time: 0.043430 Jul 20 04:22:50.477088 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1254/2723] 10.222.0.17 () {60 vars in 1257 bytes} [Wed Jul 20 04:22:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-990379601 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:50.478400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a566facf-c066-40d6-a3c2-9c4d04542ac0 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:50.479426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a566facf-c066-40d6-a3c2-9c4d04542ac0 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:50.482888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f1dd5559-c69e-4dc1-8159-d42ce8b87a3e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:50.483823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f1dd5559-c69e-4dc1-8159-d42ce8b87a3e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:50.491387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1dd5559-c69e-4dc1-8159-d42ce8b87a3e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:50.492336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1dd5559-c69e-4dc1-8159-d42ce8b87a3e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:50.493479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1dd5559-c69e-4dc1-8159-d42ce8b87a3e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:50.494849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1dd5559-c69e-4dc1-8159-d42ce8b87a3e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:50.496302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a566facf-c066-40d6-a3c2-9c4d04542ac0 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:50.496756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a566facf-c066-40d6-a3c2-9c4d04542ac0 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:50.497577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a566facf-c066-40d6-a3c2-9c4d04542ac0 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:50.498017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a566facf-c066-40d6-a3c2-9c4d04542ac0 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:50.763035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f1dd5559-c69e-4dc1-8159-d42ce8b87a3e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:50.791068 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f1dd5559-c69e-4dc1-8159-d42ce8b87a3e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1534 microversion: 2.1 time: 0.310693 Jul 20 04:22:50.794356 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1255/2724] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:50 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1534 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:50.805807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fa7403a5-6861-44e0-86dc-3207744ba2a7 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Action: 'create', calling method: .version_select at 0x7f06be164310>, body: {"keypair": {"name": "tempest-keypair-2006664145", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:50.853099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-fa7403a5-6861-44e0-86dc-3207744ba2a7 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Getting quotas for project 3a190cacaa15402f9e721b899bf8a9ec. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:50.868180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-fa7403a5-6861-44e0-86dc-3207744ba2a7 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Getting quotas for user 270b1f8473c74a92bdbcb06d7fc619fb and project 3a190cacaa15402f9e721b899bf8a9ec. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:50.876722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a566facf-c066-40d6-a3c2-9c4d04542ac0 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:50.895330 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a566facf-c066-40d6-a3c2-9c4d04542ac0 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1473 microversion: 2.1 time: 0.441337 Jul 20 04:22:50.896253 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1470/2725] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:50 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1473 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:50.953393 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fa7403a5-6861-44e0-86dc-3207744ba2a7 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.155353 Jul 20 04:22:50.955678 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1256/2726] 10.222.0.17 () {62 vars in 1198 bytes} [Wed Jul 20 04:22:50 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 160 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:22:50.974661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d9fc5fe2-a5e9-49f8-94d9-fa9b1988ab4b tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Calling method '.version_select at 0x7f06bd470f70>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:51.017954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-59341dbc-e9f8-45ac-9611-3a92efae9f98 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:51.019399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-59341dbc-e9f8-45ac-9611-3a92efae9f98 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:51.058575 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d9fc5fe2-a5e9-49f8-94d9-fa9b1988ab4b tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006664145" status: 204 len: 0 microversion: 2.2 time: 0.090422 Jul 20 04:22:51.059044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59341dbc-e9f8-45ac-9611-3a92efae9f98 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:51.066200 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1471/2727] 10.222.0.17 () {60 vars in 1260 bytes} [Wed Jul 20 04:22:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006664145 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:51.066513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59341dbc-e9f8-45ac-9611-3a92efae9f98 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:51.069047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59341dbc-e9f8-45ac-9611-3a92efae9f98 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:51.069768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59341dbc-e9f8-45ac-9611-3a92efae9f98 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:51.093537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5346f1ae-a7a7-45b7-af1b-add8df18bcf9 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Action: 'create', calling method: .version_select at 0x7f06c7350280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1469371439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0Txt5HJkrqS/A2pOkioNBooXBAebriw5tkiuEMP6HDEsWMD7C0kJ8Q4wXErLxnWPO5fiUTfC28RiJFH7mWumnrUYPWqT/gfiZ1scxP22f84yGMxzO0JIVu4jfkrw7v4Q=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:51.130748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-5346f1ae-a7a7-45b7-af1b-add8df18bcf9 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Getting quotas for project 3a190cacaa15402f9e721b899bf8a9ec. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:51.153267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-5346f1ae-a7a7-45b7-af1b-add8df18bcf9 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Getting quotas for user 270b1f8473c74a92bdbcb06d7fc619fb and project 3a190cacaa15402f9e721b899bf8a9ec. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:51.277427 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5346f1ae-a7a7-45b7-af1b-add8df18bcf9 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.196972 Jul 20 04:22:51.279620 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1472/2728] 10.222.0.17 () {62 vars in 1198 bytes} [Wed Jul 20 04:22:51 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 201 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:22:51.301246 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-68e6debc-6e8b-451f-9c3f-7f1031a37473 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Action: 'create', calling method: .version_select at 0x7f06bdfae670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1876228337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6Ih8QZ2mNWjzHvbH3hvvAIllgTffkw+50e+AD5J30ccA70ifpUeGyW+ATCXPfUOCaZ34ENxQVwCV+eRMe6HA0Cme2XxP/M7GFD8qgWG9IMWYH+/16elvOqKT9rfYwHQA=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:51.335402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-68e6debc-6e8b-451f-9c3f-7f1031a37473 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Getting quotas for project 3a190cacaa15402f9e721b899bf8a9ec. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:51.351448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-68e6debc-6e8b-451f-9c3f-7f1031a37473 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Getting quotas for user 270b1f8473c74a92bdbcb06d7fc619fb and project 3a190cacaa15402f9e721b899bf8a9ec. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:51.420584 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-68e6debc-6e8b-451f-9c3f-7f1031a37473 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.124248 Jul 20 04:22:51.438853 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1473/2729] 10.222.0.17 () {62 vars in 1198 bytes} [Wed Jul 20 04:22:51 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:22:51.451159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d2cf5552-94a9-4635-99cd-2c02d76669e5 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Action: 'create', calling method: .version_select at 0x7f06c73b9f70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1988144181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZjzUF6FrzfSYPWeiMJrok0l8xSyec+Cz10BWCPuc30pMzO4TUgDi6rwkEO3tSQeOYKPBz4oPoTiqs1I5eAIVQiJA/ynVHaY5LsH35hQqUi3Xr7RG6CAwpHbRVz+W6bbA=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:51.486399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-d2cf5552-94a9-4635-99cd-2c02d76669e5 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Getting quotas for project 3a190cacaa15402f9e721b899bf8a9ec. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:51.500471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-d2cf5552-94a9-4635-99cd-2c02d76669e5 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Getting quotas for user 270b1f8473c74a92bdbcb06d7fc619fb and project 3a190cacaa15402f9e721b899bf8a9ec. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:51.544238 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d2cf5552-94a9-4635-99cd-2c02d76669e5 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.103515 Jul 20 04:22:51.548788 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-59341dbc-e9f8-45ac-9611-3a92efae9f98 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:51.550765 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1474/2730] 10.222.0.17 () {62 vars in 1198 bytes} [Wed Jul 20 04:22:51 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:22:51.564232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5f181e34-2382-4afb-8511-e2b206dcd011 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:51.565040 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-59341dbc-e9f8-45ac-9611-3a92efae9f98 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1315 microversion: 2.1 time: 0.561458 Jul 20 04:22:51.565543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5f181e34-2382-4afb-8511-e2b206dcd011 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:51.577333 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1257/2731] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:51 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:51.581380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bb17f37e-df44-4cee-91c8-6c470709e433 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Calling method '.version_select at 0x7f06be2dbd30>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:51.584619 n-d-826526-5 devstack@n-api.service[127870]: WARNING oslo_db.sqlalchemy.utils [None req-bb17f37e-df44-4cee-91c8-6c470709e433 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:22:51.591634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f181e34-2382-4afb-8511-e2b206dcd011 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:51.593279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f181e34-2382-4afb-8511-e2b206dcd011 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:51.595346 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f181e34-2382-4afb-8511-e2b206dcd011 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:51.596204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f181e34-2382-4afb-8511-e2b206dcd011 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:51.606489 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bb17f37e-df44-4cee-91c8-6c470709e433 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.029063 Jul 20 04:22:51.612959 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1258/2732] 10.222.0.17 () {60 vars in 1176 bytes} [Wed Jul 20 04:22:51 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:51.629668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-23ee217b-69e5-4940-be7b-c62f6230b9e7 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Calling method '.version_select at 0x7f06c73af790>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:51.667048 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-23ee217b-69e5-4940-be7b-c62f6230b9e7 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1988144181" status: 204 len: 0 microversion: 2.2 time: 0.052489 Jul 20 04:22:51.667730 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1259/2733] 10.222.0.17 () {60 vars in 1320 bytes} [Wed Jul 20 04:22:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1988144181 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:51.677415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9d9a421b-44fb-4cf3-86a7-ea92097036ad tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Calling method '.version_select at 0x7f06c4a0d4c0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:51.715797 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9d9a421b-44fb-4cf3-86a7-ea92097036ad tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1876228337" status: 204 len: 0 microversion: 2.2 time: 0.038075 Jul 20 04:22:51.718769 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1260/2734] 10.222.0.17 () {60 vars in 1320 bytes} [Wed Jul 20 04:22:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1876228337 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:51.732139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-43f44d7d-02ed-4f75-9795-d04815d81247 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Calling method '.version_select at 0x7f06be2db160>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:51.768698 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-43f44d7d-02ed-4f75-9795-d04815d81247 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1469371439" status: 204 len: 0 microversion: 2.2 time: 0.043287 Jul 20 04:22:51.770379 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1261/2735] 10.222.0.17 () {60 vars in 1320 bytes} [Wed Jul 20 04:22:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1469371439 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:51.792322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0ac2025b-de01-47c6-8096-2be037a55f82 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Action: 'create', calling method: .version_select at 0x7f06bdda1f70>, body: {"keypair": {"name": "tempest-keypair-612396932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJmIZ6knIfB0aMKDNomQRjxAk8fWiAteyakQ/rHX96HbLKKiI/Wh5Gc+uaADljKQrbJglOeD1wGkfxC33VT8eUAT24/xRxUdwbwaWEwCAGMTJotxqI5vsn+wAqdm2XarQ=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:51.826019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-0ac2025b-de01-47c6-8096-2be037a55f82 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Getting quotas for project 3a190cacaa15402f9e721b899bf8a9ec. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:51.833603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-0ac2025b-de01-47c6-8096-2be037a55f82 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Getting quotas for user 270b1f8473c74a92bdbcb06d7fc619fb and project 3a190cacaa15402f9e721b899bf8a9ec. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:51.868587 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0ac2025b-de01-47c6-8096-2be037a55f82 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.084821 Jul 20 04:22:51.884925 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1262/2736] 10.222.0.17 () {62 vars in 1198 bytes} [Wed Jul 20 04:22:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:22:51.891215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ae3c41d8-2eeb-4f63-b75d-9fcd405e8ea3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:51.891955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ae3c41d8-2eeb-4f63-b75d-9fcd405e8ea3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:51.900470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae3c41d8-2eeb-4f63-b75d-9fcd405e8ea3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:51.900941 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae3c41d8-2eeb-4f63-b75d-9fcd405e8ea3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:51.901868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae3c41d8-2eeb-4f63-b75d-9fcd405e8ea3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:51.902313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae3c41d8-2eeb-4f63-b75d-9fcd405e8ea3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:51.977508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5f181e34-2382-4afb-8511-e2b206dcd011 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50084863834d461787c5512e7a04bddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61812dd23d4638a44417fd3d7cc446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:52.002149 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5f181e34-2382-4afb-8511-e2b206dcd011 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c" status: 200 len: 1503 microversion: 2.1 time: 0.449752 Jul 20 04:22:52.003834 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1475/2737] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:51 2022] GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c => generated 1503 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:52.012846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-19715d24-e63e-419d-8f2c-9c877335c4a2 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Calling method '.version_select at 0x7f06bd49c280>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:52.028522 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-19715d24-e63e-419d-8f2c-9c877335c4a2 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-612396932" status: 200 len: 512 microversion: 2.2 time: 0.022750 Jul 20 04:22:52.029966 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1476/2738] 10.222.0.17 () {60 vars in 1254 bytes} [Wed Jul 20 04:22:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-612396932 => generated 512 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:52.038984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d4e8ac64-4da2-4115-903c-3a8716d377af tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:52.040561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d4e8ac64-4da2-4115-903c-3a8716d377af tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:52.054918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4e8ac64-4da2-4115-903c-3a8716d377af tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.055800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4e8ac64-4da2-4115-903c-3a8716d377af tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.057508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4e8ac64-4da2-4115-903c-3a8716d377af tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.060119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4e8ac64-4da2-4115-903c-3a8716d377af tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.179718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ae3c41d8-2eeb-4f63-b75d-9fcd405e8ea3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:52.195245 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ae3c41d8-2eeb-4f63-b75d-9fcd405e8ea3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1540 microversion: 2.1 time: 0.307688 Jul 20 04:22:52.209336 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1263/2739] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:51 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1540 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:52.216114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7d1b38e9-0abb-425c-a194-64d4642a6535 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:52.216821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7d1b38e9-0abb-425c-a194-64d4642a6535 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:52.234965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d1b38e9-0abb-425c-a194-64d4642a6535 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.234965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d1b38e9-0abb-425c-a194-64d4642a6535 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.234965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d1b38e9-0abb-425c-a194-64d4642a6535 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.235704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d1b38e9-0abb-425c-a194-64d4642a6535 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.318597 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7d1b38e9-0abb-425c-a194-64d4642a6535 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.107304 Jul 20 04:22:52.319744 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1264/2740] 10.222.0.17 () {58 vars in 1295 bytes} [Wed Jul 20 04:22:52 2022] DELETE /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c/os-server-password => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:52.325245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-46a454a5-9c82-4168-be55-55725d936201 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Calling method '.version_select at 0x7f06bddb2310>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:52.328792 n-d-826526-5 devstack@n-api.service[127870]: WARNING oslo_db.sqlalchemy.utils [None req-46a454a5-9c82-4168-be55-55725d936201 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:22:52.340965 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-46a454a5-9c82-4168-be55-55725d936201 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.019406 Jul 20 04:22:52.342524 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1265/2741] 10.222.0.17 () {60 vars in 1176 bytes} [Wed Jul 20 04:22:52 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:52.359984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9c0b2ba7-734e-47b4-bdd4-af16fb8e426a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:52.361481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9c0b2ba7-734e-47b4-bdd4-af16fb8e426a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:52.372039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=5 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:52.377121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c0b2ba7-734e-47b4-bdd4-af16fb8e426a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.377963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c0b2ba7-734e-47b4-bdd4-af16fb8e426a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.378971 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c0b2ba7-734e-47b4-bdd4-af16fb8e426a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.379616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c0b2ba7-734e-47b4-bdd4-af16fb8e426a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.414690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:52.434239 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9c0b2ba7-734e-47b4-bdd4-af16fb8e426a tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.081155 Jul 20 04:22:52.437183 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1266/2742] 10.222.0.17 () {58 vars in 1292 bytes} [Wed Jul 20 04:22:52 2022] GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c/os-server-password => generated 16 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:52.442298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ff256941-15c7-4d48-be42-5c6017e1d3e3 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Calling method '.version_select at 0x7f06bddb2c10>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:52.476586 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ff256941-15c7-4d48-be42-5c6017e1d3e3 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-612396932" status: 204 len: 0 microversion: 2.2 time: 0.038012 Jul 20 04:22:52.478621 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1267/2743] 10.222.0.17 () {60 vars in 1257 bytes} [Wed Jul 20 04:22:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-612396932 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:52.494265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a233eceb-7681-4f4a-ab8d-8db6c95d8f37 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:52.496093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a233eceb-7681-4f4a-ab8d-8db6c95d8f37 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:52.515112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a233eceb-7681-4f4a-ab8d-8db6c95d8f37 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.517149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a233eceb-7681-4f4a-ab8d-8db6c95d8f37 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.519275 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a233eceb-7681-4f4a-ab8d-8db6c95d8f37 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.520675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a233eceb-7681-4f4a-ab8d-8db6c95d8f37 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.587423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d4e8ac64-4da2-4115-903c-3a8716d377af tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:52.610556 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d4e8ac64-4da2-4115-903c-3a8716d377af tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1473 microversion: 2.1 time: 0.578499 Jul 20 04:22:52.612173 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1477/2744] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:52 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1473 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:52.620793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a233eceb-7681-4f4a-ab8d-8db6c95d8f37 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:22:52.624874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-10e036c0-6ebf-4b10-8780-80ae8c0a27e0 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Action: 'create', calling method: .version_select at 0x7f06c73b2f70>, body: {"keypair": {"name": "tempest-keypair-921244978", "type": "x509"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:52.657592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-10e036c0-6ebf-4b10-8780-80ae8c0a27e0 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Getting quotas for project 3a190cacaa15402f9e721b899bf8a9ec. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:52.670504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-10e036c0-6ebf-4b10-8780-80ae8c0a27e0 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Getting quotas for user 270b1f8473c74a92bdbcb06d7fc619fb and project 3a190cacaa15402f9e721b899bf8a9ec. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:52.714387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.processutils [None req-10e036c0-6ebf-4b10-8780-80ae8c0a27e0 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmppey0g987/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmppey0g987/temp.key -subj /CN=270b1f8473c74a92bdbcb06d7fc619fb -extensions v3_req_client {{(pid=127871) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 20 04:22:52.807491 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a233eceb-7681-4f4a-ab8d-8db6c95d8f37 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c" status: 204 len: 0 microversion: 2.1 time: 0.323351 Jul 20 04:22:52.808921 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1268/2745] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:52 2022] DELETE /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:52.821613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b6253e31-0f75-4786-ba1f-a37b96e965e6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:52.824356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b6253e31-0f75-4786-ba1f-a37b96e965e6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:52.831808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6253e31-0f75-4786-ba1f-a37b96e965e6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.833273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6253e31-0f75-4786-ba1f-a37b96e965e6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.834675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6253e31-0f75-4786-ba1f-a37b96e965e6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.835522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6253e31-0f75-4786-ba1f-a37b96e965e6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:53.058268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.processutils [None req-10e036c0-6ebf-4b10-8780-80ae8c0a27e0 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmppey0g987/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmppey0g987/temp.key -subj /CN=270b1f8473c74a92bdbcb06d7fc619fb -extensions v3_req_client" returned: 0 in 0.341s {{(pid=127871) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 20 04:22:53.066135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.processutils [None req-10e036c0-6ebf-4b10-8780-80ae8c0a27e0 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmppey0g987/temp.key -password pass: {{(pid=127871) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 20 04:22:53.121306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b6253e31-0f75-4786-ba1f-a37b96e965e6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:53.131490 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b6253e31-0f75-4786-ba1f-a37b96e965e6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1315 microversion: 2.1 time: 0.320099 Jul 20 04:22:53.147500 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1269/2746] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:52 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:53.162760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1dd6df1f-682d-4ad3-86c2-dc5ef691e71b tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:53.163943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1dd6df1f-682d-4ad3-86c2-dc5ef691e71b tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:53.171511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.processutils [None req-10e036c0-6ebf-4b10-8780-80ae8c0a27e0 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] CMD "openssl pkcs12 -export -inkey /tmp/tmppey0g987/temp.key -password pass:" returned: 0 in 0.103s {{(pid=127871) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 20 04:22:53.176182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1dd6df1f-682d-4ad3-86c2-dc5ef691e71b tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:53.177103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1dd6df1f-682d-4ad3-86c2-dc5ef691e71b tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:53.177896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1dd6df1f-682d-4ad3-86c2-dc5ef691e71b tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:53.179881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1dd6df1f-682d-4ad3-86c2-dc5ef691e71b tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:53.246739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-10e036c0-6ebf-4b10-8780-80ae8c0a27e0 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Getting quotas for project 3a190cacaa15402f9e721b899bf8a9ec. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:53.258000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-10e036c0-6ebf-4b10-8780-80ae8c0a27e0 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Getting quotas for user 270b1f8473c74a92bdbcb06d7fc619fb and project 3a190cacaa15402f9e721b899bf8a9ec. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:53.281446 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-10e036c0-6ebf-4b10-8780-80ae8c0a27e0 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.667166 Jul 20 04:22:53.282967 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1478/2747] 10.222.0.17 () {62 vars in 1197 bytes} [Wed Jul 20 04:22:52 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 670 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:53.291577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6d2197a8-ccb6-4c87-b913-1c1a7a804fd3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:53.292563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6d2197a8-ccb6-4c87-b913-1c1a7a804fd3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:53.301469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d2197a8-ccb6-4c87-b913-1c1a7a804fd3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:53.302223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d2197a8-ccb6-4c87-b913-1c1a7a804fd3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:53.303285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d2197a8-ccb6-4c87-b913-1c1a7a804fd3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:53.304218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d2197a8-ccb6-4c87-b913-1c1a7a804fd3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:53.703186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1dd6df1f-682d-4ad3-86c2-dc5ef691e71b tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50084863834d461787c5512e7a04bddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61812dd23d4638a44417fd3d7cc446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:53.715515 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1dd6df1f-682d-4ad3-86c2-dc5ef691e71b tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c" status: 200 len: 1509 microversion: 2.1 time: 0.563415 Jul 20 04:22:53.718990 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1270/2748] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:53 2022] GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c => generated 1509 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:53.730439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-016fa522-2e19-46e5-9dd8-bd1c2cb703c3 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Calling method '.version_select at 0x7f06be2dbd30>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:53.752895 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-016fa522-2e19-46e5-9dd8-bd1c2cb703c3 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-921244978" status: 200 len: 1533 microversion: 2.2 time: 0.031188 Jul 20 04:22:53.754680 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1271/2749] 10.222.0.17 () {60 vars in 1254 bytes} [Wed Jul 20 04:22:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-921244978 => generated 1533 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:53.764575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0b6666f3-57c8-4772-bcda-0d95f9ee9fa8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:53.764575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0b6666f3-57c8-4772-bcda-0d95f9ee9fa8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:53.779067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b6666f3-57c8-4772-bcda-0d95f9ee9fa8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:53.779659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b6666f3-57c8-4772-bcda-0d95f9ee9fa8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:53.782718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b6666f3-57c8-4772-bcda-0d95f9ee9fa8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:53.783304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b6666f3-57c8-4772-bcda-0d95f9ee9fa8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:53.828710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6d2197a8-ccb6-4c87-b913-1c1a7a804fd3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:53.842547 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6d2197a8-ccb6-4c87-b913-1c1a7a804fd3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1540 microversion: 2.1 time: 0.557914 Jul 20 04:22:53.844887 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1479/2750] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:53 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1540 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:53.860553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-280a15fc-3a3d-49fc-b574-68463b227f2f tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Calling method '.version_select at 0x7f06c73b2700>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:53.866226 n-d-826526-5 devstack@n-api.service[127871]: WARNING oslo_db.sqlalchemy.utils [None req-280a15fc-3a3d-49fc-b574-68463b227f2f tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:22:53.877232 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-280a15fc-3a3d-49fc-b574-68463b227f2f tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.030583 Jul 20 04:22:53.878343 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1480/2751] 10.222.0.17 () {60 vars in 1176 bytes} [Wed Jul 20 04:22:53 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:53.890737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-30ebb379-8b0c-40de-bd29-5bbc66ce2727 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] Calling method '.version_select at 0x7f06be0998b0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:53.919421 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-30ebb379-8b0c-40de-bd29-5bbc66ce2727 tempest-KeyPairsV22TestJSON-1959754505 tempest-KeyPairsV22TestJSON-1959754505-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-921244978" status: 204 len: 0 microversion: 2.2 time: 0.032639 Jul 20 04:22:53.927544 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1481/2752] 10.222.0.17 () {60 vars in 1257 bytes} [Wed Jul 20 04:22:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-921244978 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:22:54.136590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0b6666f3-57c8-4772-bcda-0d95f9ee9fa8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:54.145781 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0b6666f3-57c8-4772-bcda-0d95f9ee9fa8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1491 microversion: 2.1 time: 0.390000 Jul 20 04:22:54.149624 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1272/2753] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:53 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1491 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:54.176147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ba9e683e-5c4e-4ac9-8456-6fc9bc510168 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:54.178549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ba9e683e-5c4e-4ac9-8456-6fc9bc510168 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:54.192463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba9e683e-5c4e-4ac9-8456-6fc9bc510168 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:54.196797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba9e683e-5c4e-4ac9-8456-6fc9bc510168 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:54.198168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba9e683e-5c4e-4ac9-8456-6fc9bc510168 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:54.198834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba9e683e-5c4e-4ac9-8456-6fc9bc510168 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:54.769935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-83c77092-be9a-4e2f-ac2b-8290488981f8 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:54.773241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-83c77092-be9a-4e2f-ac2b-8290488981f8 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:54.802513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83c77092-be9a-4e2f-ac2b-8290488981f8 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:54.806778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83c77092-be9a-4e2f-ac2b-8290488981f8 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:54.811178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83c77092-be9a-4e2f-ac2b-8290488981f8 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:54.822085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83c77092-be9a-4e2f-ac2b-8290488981f8 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:55.163257 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ba9e683e-5c4e-4ac9-8456-6fc9bc510168 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:55.191140 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ba9e683e-5c4e-4ac9-8456-6fc9bc510168 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1315 microversion: 2.1 time: 1.036342 Jul 20 04:22:55.192903 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1482/2754] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:54 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1315 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:55.249283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2ed0da52-457a-4470-8bf2-879bba7d297c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:55.251120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2ed0da52-457a-4470-8bf2-879bba7d297c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:55.273725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ed0da52-457a-4470-8bf2-879bba7d297c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.279099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ed0da52-457a-4470-8bf2-879bba7d297c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:55.280923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ed0da52-457a-4470-8bf2-879bba7d297c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.283341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ed0da52-457a-4470-8bf2-879bba7d297c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:55.323731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:55.651301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-83c77092-be9a-4e2f-ac2b-8290488981f8 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50084863834d461787c5512e7a04bddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61812dd23d4638a44417fd3d7cc446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:55.668283 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-83c77092-be9a-4e2f-ac2b-8290488981f8 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c" status: 200 len: 1509 microversion: 2.1 time: 0.929929 Jul 20 04:22:55.669222 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1273/2755] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:54 2022] GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c => generated 1509 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:55.687589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-27f2af9d-4224-42ca-882b-a7a7453d9570 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:55.688349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-27f2af9d-4224-42ca-882b-a7a7453d9570 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:55.717391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27f2af9d-4224-42ca-882b-a7a7453d9570 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.717713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27f2af9d-4224-42ca-882b-a7a7453d9570 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:55.718852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27f2af9d-4224-42ca-882b-a7a7453d9570 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.719645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27f2af9d-4224-42ca-882b-a7a7453d9570 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:56.100293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2ed0da52-457a-4470-8bf2-879bba7d297c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:56.149525 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2ed0da52-457a-4470-8bf2-879bba7d297c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1522 microversion: 2.1 time: 0.954681 Jul 20 04:22:56.153785 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1483/2756] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:55 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1522 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:56.177469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-2e71d045-0908-4702-a9bc-5b5c4c1f2a47 req-9bcf0a29-eb36-449d-88bc-9fcb8acf9d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b80cc2-a403-42e3-a623-aa5896d360e9", "name": "network-vif-unplugged", "status": "completed", "tag": "8266a16e-2ac7-4af1-a58a-e921890fc926"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:56.188192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-2e71d045-0908-4702-a9bc-5b5c4c1f2a47 req-9bcf0a29-eb36-449d-88bc-9fcb8acf9d7e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:56.189326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-2e71d045-0908-4702-a9bc-5b5c4c1f2a47 req-9bcf0a29-eb36-449d-88bc-9fcb8acf9d7e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:56.232448 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-2e71d045-0908-4702-a9bc-5b5c4c1f2a47 req-9bcf0a29-eb36-449d-88bc-9fcb8acf9d7e service nova] Creating event network-vif-unplugged:8266a16e-2ac7-4af1-a58a-e921890fc926 for instance 62b80cc2-a403-42e3-a623-aa5896d360e9 on n-h2-826526-5 Jul 20 04:22:56.266765 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-2e71d045-0908-4702-a9bc-5b5c4c1f2a47 req-9bcf0a29-eb36-449d-88bc-9fcb8acf9d7e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109994 Jul 20 04:22:56.282398 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1484/2757] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:56.306226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-11a5250b-2f1c-49c5-846c-317b1072b47d tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:56.307469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-11a5250b-2f1c-49c5-846c-317b1072b47d tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:56.329479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11a5250b-2f1c-49c5-846c-317b1072b47d tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:56.330106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11a5250b-2f1c-49c5-846c-317b1072b47d tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:56.331388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11a5250b-2f1c-49c5-846c-317b1072b47d tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:56.333852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11a5250b-2f1c-49c5-846c-317b1072b47d tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:56.418841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-11a5250b-2f1c-49c5-846c-317b1072b47d tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:22:56.701064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=91,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:56.740328 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-11a5250b-2f1c-49c5-846c-317b1072b47d tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 204 len: 0 microversion: 2.1 time: 0.448389 Jul 20 04:22:56.745983 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1485/2758] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:56 2022] DELETE /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:56.797352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-aaf660e9-45b2-4af9-91e7-33026185057e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:56.798873 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-aaf660e9-45b2-4af9-91e7-33026185057e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:56.807983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aaf660e9-45b2-4af9-91e7-33026185057e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:56.809156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aaf660e9-45b2-4af9-91e7-33026185057e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:56.810360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aaf660e9-45b2-4af9-91e7-33026185057e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:56.811221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aaf660e9-45b2-4af9-91e7-33026185057e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:56.950854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-27f2af9d-4224-42ca-882b-a7a7453d9570 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:56.965992 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-27f2af9d-4224-42ca-882b-a7a7453d9570 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1479 microversion: 2.1 time: 1.294105 Jul 20 04:22:56.967061 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1274/2759] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:55 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1479 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:56.987602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-b606c5a6-8a48-4891-a11f-60f9cf365a52 req-fc0ed3c5-a913-4c3e-88e2-bd1948eb161f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a9bb208-992c-4c4b-b5a6-989e0301427c", "name": "network-vif-deleted", "tag": "4994ebae-d9b6-4924-921f-74558ba51721"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:57.016253 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b606c5a6-8a48-4891-a11f-60f9cf365a52 req-fc0ed3c5-a913-4c3e-88e2-bd1948eb161f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:57.017458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b606c5a6-8a48-4891-a11f-60f9cf365a52 req-fc0ed3c5-a913-4c3e-88e2-bd1948eb161f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:57.049824 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-b606c5a6-8a48-4891-a11f-60f9cf365a52 req-fc0ed3c5-a913-4c3e-88e2-bd1948eb161f service nova] Creating event network-vif-deleted:4994ebae-d9b6-4924-921f-74558ba51721 for instance 1a9bb208-992c-4c4b-b5a6-989e0301427c on n-h1-826526-5 Jul 20 04:22:57.064643 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-b606c5a6-8a48-4891-a11f-60f9cf365a52 req-fc0ed3c5-a913-4c3e-88e2-bd1948eb161f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093998 Jul 20 04:22:57.068960 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1275/2760] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:57.078710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2ead8617-dcce-474b-b668-9a29f67411bd tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:57.086878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2ead8617-dcce-474b-b668-9a29f67411bd tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:57.100647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ead8617-dcce-474b-b668-9a29f67411bd tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:57.102741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ead8617-dcce-474b-b668-9a29f67411bd tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:57.104512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ead8617-dcce-474b-b668-9a29f67411bd tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:57.105180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ead8617-dcce-474b-b668-9a29f67411bd tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:57.364650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2ead8617-dcce-474b-b668-9a29f67411bd tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50084863834d461787c5512e7a04bddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61812dd23d4638a44417fd3d7cc446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:57.390771 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2ead8617-dcce-474b-b668-9a29f67411bd tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c" status: 200 len: 1301 microversion: 2.1 time: 0.319791 Jul 20 04:22:57.392300 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1276/2761] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:57 2022] GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c => generated 1301 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:57.406048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-648d7650-8874-4d3e-b96b-8984481726df tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:57.407838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-648d7650-8874-4d3e-b96b-8984481726df tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:57.424548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-648d7650-8874-4d3e-b96b-8984481726df tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:57.425701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-648d7650-8874-4d3e-b96b-8984481726df tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:57.427863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-648d7650-8874-4d3e-b96b-8984481726df tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:57.428987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-648d7650-8874-4d3e-b96b-8984481726df tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:57.787301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-aaf660e9-45b2-4af9-91e7-33026185057e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:57.802909 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-aaf660e9-45b2-4af9-91e7-33026185057e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1315 microversion: 2.1 time: 1.052013 Jul 20 04:22:57.816660 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1486/2762] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:56 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1315 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:57.991074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-acc1451e-f303-458c-ae35-3ef3d6209ee4 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:57.991865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-acc1451e-f303-458c-ae35-3ef3d6209ee4 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:58.010915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-acc1451e-f303-458c-ae35-3ef3d6209ee4 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:58.011554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-acc1451e-f303-458c-ae35-3ef3d6209ee4 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:58.012603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-acc1451e-f303-458c-ae35-3ef3d6209ee4 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:58.013150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-acc1451e-f303-458c-ae35-3ef3d6209ee4 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.028393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-648d7650-8874-4d3e-b96b-8984481726df tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:59.079982 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-648d7650-8874-4d3e-b96b-8984481726df tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1528 microversion: 2.1 time: 1.682381 Jul 20 04:22:59.083490 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1277/2763] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:57 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1528 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:59.111255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7a688b2d-8486-4415-82ef-01fcc1bb2fc3 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:59.114868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7a688b2d-8486-4415-82ef-01fcc1bb2fc3 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] [instance: 1a9bb208-992c-4c4b-b5a6-989e0301427c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:59.149449 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a688b2d-8486-4415-82ef-01fcc1bb2fc3 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.153827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a688b2d-8486-4415-82ef-01fcc1bb2fc3 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.160842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a688b2d-8486-4415-82ef-01fcc1bb2fc3 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.162300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a688b2d-8486-4415-82ef-01fcc1bb2fc3 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.234527 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-7a688b2d-8486-4415-82ef-01fcc1bb2fc3 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] HTTP exception thrown: Instance 1a9bb208-992c-4c4b-b5a6-989e0301427c could not be found. Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7a688b2d-8486-4415-82ef-01fcc1bb2fc3 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Request method failure captured: Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c HTTP/1.1 Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14MAtbpJd03ar1ALG55NJ_lYTp5SH_o_LJxKUOY8NKkQ6wLaAluV2DW8EupqNAx-2nmlxe8ia4xFbforUAcZUj_J9YGI08XDxoOipwNZbrLxkAk9l-teuerd-ziiJ_lkVX4mubXC0Vcqr4MpYRCpJIEDskoc2F4AsNdzQxrOqhm1Yrg Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: db61812dd23d4638a44417fd3d7cc446 Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerPasswordTestJSON-1954244653 Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:22:59.241490 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:22:59.244205 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db61812dd23d4638a44417fd3d7cc446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/db61812dd23d4638a44417fd3d7cc446"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_db61812dd23d4638a44417fd3d7cc446", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db61812dd23d4638a44417fd3d7cc446"}]}] Jul 20 04:22:59.244205 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerPasswordTestJSON-1954244653 Jul 20 04:22:59.244205 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: db61812dd23d4638a44417fd3d7cc446 Jul 20 04:22:59.244205 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1954244653 Jul 20 04:22:59.244205 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerPasswordTestJSON-1954244653-project Jul 20 04:22:59.244205 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:22:59.244205 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:22:59.244205 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 50084863834d461787c5512e7a04bddf Jul 20 04:22:59.244205 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerPasswordTestJSON-1954244653-project Jul 20 04:22:59.244205 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:22:59.244205 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 1a9bb208-992c-4c4b-b5a6-989e0301427c could not be found. Jul 20 04:22:59.244205 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '1a9bb208-992c-4c4b-b5a6-989e0301427c'} Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a9bb208-992c-4c4b-b5a6-989e0301427c could not be found. Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:59.247675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:59.252475 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:59.252475 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:59.252475 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:59.252475 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:59.252475 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:59.252475 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:59.252475 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:59.252475 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a9bb208-992c-4c4b-b5a6-989e0301427c could not be found. Jul 20 04:22:59.252475 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:59.252475 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:59.252475 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:59.252475 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:59.252475 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:59.252475 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:59.252475 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:59.252475 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:59.252475 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a9bb208-992c-4c4b-b5a6-989e0301427c could not be found. Jul 20 04:22:59.252475 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:22:59.259514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7a688b2d-8486-4415-82ef-01fcc1bb2fc3 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] Returning 404 to user: Instance 1a9bb208-992c-4c4b-b5a6-989e0301427c could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:59.259973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-acc1451e-f303-458c-ae35-3ef3d6209ee4 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:59.262752 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7a688b2d-8486-4415-82ef-01fcc1bb2fc3 tempest-ServerPasswordTestJSON-1954244653 tempest-ServerPasswordTestJSON-1954244653-project] 10.222.0.17 "GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c" status: 404 len: 111 microversion: 2.1 time: 0.174564 Jul 20 04:22:59.265894 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1278/2764] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:59 2022] GET /compute/v2.1/servers/1a9bb208-992c-4c4b-b5a6-989e0301427c => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:59.275519 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-acc1451e-f303-458c-ae35-3ef3d6209ee4 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1464 microversion: 2.1 time: 1.289268 Jul 20 04:22:59.278993 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1487/2765] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:57 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1464 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:59.292939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-93b08b30-a971-41ed-99e9-f4f66581b1b0 req-95b2025f-092f-43d4-951c-2358db37a5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55", "name": "network-vif-plugged", "status": "completed", "tag": "03e1f1bc-ea38-4e03-b054-ea1a7c6f739d"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:59.327552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-83c81085-3605-48fb-9520-6278cdaf2087 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:59.329400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-83c81085-3605-48fb-9520-6278cdaf2087 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:59.347845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-93b08b30-a971-41ed-99e9-f4f66581b1b0 req-95b2025f-092f-43d4-951c-2358db37a5c5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.350399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83c81085-3605-48fb-9520-6278cdaf2087 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.351966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83c81085-3605-48fb-9520-6278cdaf2087 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.353744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-93b08b30-a971-41ed-99e9-f4f66581b1b0 req-95b2025f-092f-43d4-951c-2358db37a5c5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.354346 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83c81085-3605-48fb-9520-6278cdaf2087 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.354901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83c81085-3605-48fb-9520-6278cdaf2087 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.400074 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-93b08b30-a971-41ed-99e9-f4f66581b1b0 req-95b2025f-092f-43d4-951c-2358db37a5c5 service nova] Creating event network-vif-plugged:03e1f1bc-ea38-4e03-b054-ea1a7c6f739d for instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 on n-h1-826526-5 Jul 20 04:22:59.423181 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-93b08b30-a971-41ed-99e9-f4f66581b1b0 req-95b2025f-092f-43d4-951c-2358db37a5c5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154754 Jul 20 04:22:59.430666 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1279/2766] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:59.449803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a80fd026-21a0-435e-b9b4-7478041dfa8c tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:59.451507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a80fd026-21a0-435e-b9b4-7478041dfa8c tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:59.473500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a80fd026-21a0-435e-b9b4-7478041dfa8c tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.474290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a80fd026-21a0-435e-b9b4-7478041dfa8c tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.475681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a80fd026-21a0-435e-b9b4-7478041dfa8c tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.480990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a80fd026-21a0-435e-b9b4-7478041dfa8c tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.702994 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a80fd026-21a0-435e-b9b4-7478041dfa8c tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9/action" status: 202 len: 0 microversion: 2.1 time: 0.269923 Jul 20 04:22:59.704123 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1280/2767] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:59 2022] POST /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:59.718090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ad69d302-505f-4f92-bf91-f2821e018589 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:59.719194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ad69d302-505f-4f92-bf91-f2821e018589 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:59.742936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad69d302-505f-4f92-bf91-f2821e018589 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.743608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad69d302-505f-4f92-bf91-f2821e018589 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.752757 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad69d302-505f-4f92-bf91-f2821e018589 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.753294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad69d302-505f-4f92-bf91-f2821e018589 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.851896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad69d302-505f-4f92-bf91-f2821e018589 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.855604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad69d302-505f-4f92-bf91-f2821e018589 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.856559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-ad69d302-505f-4f92-bf91-f2821e018589 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lazy-loading 'fault' on Instance uuid 62b80cc2-a403-42e3-a623-aa5896d360e9 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:22:59.996096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-83c81085-3605-48fb-9520-6278cdaf2087 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:00.014958 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-83c81085-3605-48fb-9520-6278cdaf2087 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1315 microversion: 2.1 time: 0.734168 Jul 20 04:23:00.016134 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1488/2768] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:59 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1315 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:00.100388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4e842d43-3eba-4dac-a644-5de39c7e24fb tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:00.102188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4e842d43-3eba-4dac-a644-5de39c7e24fb tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:00.118474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e842d43-3eba-4dac-a644-5de39c7e24fb tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:00.123337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e842d43-3eba-4dac-a644-5de39c7e24fb tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:00.125451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e842d43-3eba-4dac-a644-5de39c7e24fb tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:00.131034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e842d43-3eba-4dac-a644-5de39c7e24fb tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:01.018642 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ad69d302-505f-4f92-bf91-f2821e018589 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1598 microversion: 2.1 time: 1.304716 Jul 20 04:23:01.026526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4e842d43-3eba-4dac-a644-5de39c7e24fb tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:01.036884 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1281/2769] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:59 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1598 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:01.084823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0e1b0530-4858-42f1-93c4-645133b73451 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:01.085491 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4e842d43-3eba-4dac-a644-5de39c7e24fb tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1528 microversion: 2.1 time: 0.986152 Jul 20 04:23:01.122006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0e1b0530-4858-42f1-93c4-645133b73451 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:01.122327 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1489/2770] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:00 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1528 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:01.146020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8a1e47e3-afa0-450c-a461-f245295d4ebe tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:01.153619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8a1e47e3-afa0-450c-a461-f245295d4ebe tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:01.157855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e1b0530-4858-42f1-93c4-645133b73451 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:01.163806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e1b0530-4858-42f1-93c4-645133b73451 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:01.172593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e1b0530-4858-42f1-93c4-645133b73451 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:01.180915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e1b0530-4858-42f1-93c4-645133b73451 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:01.206577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a1e47e3-afa0-450c-a461-f245295d4ebe tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:01.209060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a1e47e3-afa0-450c-a461-f245295d4ebe tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:01.210313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a1e47e3-afa0-450c-a461-f245295d4ebe tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:01.218318 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a1e47e3-afa0-450c-a461-f245295d4ebe tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:01.523417 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8a1e47e3-afa0-450c-a461-f245295d4ebe tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9/action" status: 202 len: 0 microversion: 2.1 time: 0.399412 Jul 20 04:23:01.525888 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1490/2771] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:23:01 2022] POST /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:23:01.539989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2a1797c2-bcc2-4770-a875-70b0a8910905 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:01.547869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2a1797c2-bcc2-4770-a875-70b0a8910905 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:01.564094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2a1797c2-bcc2-4770-a875-70b0a8910905 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:01.569331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2a1797c2-bcc2-4770-a875-70b0a8910905 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:01.570467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2a1797c2-bcc2-4770-a875-70b0a8910905 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:01.571329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2a1797c2-bcc2-4770-a875-70b0a8910905 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:01.846426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=30 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:02.562472 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2a1797c2-bcc2-4770-a875-70b0a8910905 tempest-ServersAdminTestJSON-262874190 tempest-ServersAdminTestJSON-262874190-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1615 microversion: 2.1 time: 1.030675 Jul 20 04:23:02.563272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0e1b0530-4858-42f1-93c4-645133b73451 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:02.569731 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1491/2772] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:01 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1615 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:02.572719 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0e1b0530-4858-42f1-93c4-645133b73451 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1315 microversion: 2.1 time: 1.531461 Jul 20 04:23:02.586772 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1282/2773] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:01 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1315 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:02.592753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-cdb0d626-38c4-4d25-b3f6-fb127ff2f254 req-43852dc2-e5c5-4507-8a8a-978a0f05d9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55", "name": "network-vif-unplugged", "status": "completed", "tag": "03e1f1bc-ea38-4e03-b054-ea1a7c6f739d"}, {"server_uuid": "5b271cf2-d6b2-479e-8422-2edba3000fa2", "name": "network-vif-plugged", "status": "completed", "tag": "828d5fbf-9e79-4cb9-a15c-8409a2f81820"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:02.608815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-74f9cba0-1f0d-44eb-826c-a004753c5d0a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:02.609800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-74f9cba0-1f0d-44eb-826c-a004753c5d0a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:02.620343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-cdb0d626-38c4-4d25-b3f6-fb127ff2f254 req-43852dc2-e5c5-4507-8a8a-978a0f05d9d0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:02.627859 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-cdb0d626-38c4-4d25-b3f6-fb127ff2f254 req-43852dc2-e5c5-4507-8a8a-978a0f05d9d0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.629345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74f9cba0-1f0d-44eb-826c-a004753c5d0a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:02.630028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74f9cba0-1f0d-44eb-826c-a004753c5d0a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.633950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74f9cba0-1f0d-44eb-826c-a004753c5d0a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:02.635676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74f9cba0-1f0d-44eb-826c-a004753c5d0a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.655956 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-cdb0d626-38c4-4d25-b3f6-fb127ff2f254 req-43852dc2-e5c5-4507-8a8a-978a0f05d9d0 service nova] Creating event network-vif-unplugged:03e1f1bc-ea38-4e03-b054-ea1a7c6f739d for instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 on n-h1-826526-5 Jul 20 04:23:02.656608 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-cdb0d626-38c4-4d25-b3f6-fb127ff2f254 req-43852dc2-e5c5-4507-8a8a-978a0f05d9d0 service nova] Creating event network-vif-plugged:828d5fbf-9e79-4cb9-a15c-8409a2f81820 for instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 on n-h2-826526-5 Jul 20 04:23:02.690202 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-cdb0d626-38c4-4d25-b3f6-fb127ff2f254 req-43852dc2-e5c5-4507-8a8a-978a0f05d9d0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.106761 Jul 20 04:23:02.691926 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1492/2774] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:02.715697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5562764a-86c3-4fca-8dc5-4453e25fe5f8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:02.716701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5562764a-86c3-4fca-8dc5-4453e25fe5f8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:02.744793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5562764a-86c3-4fca-8dc5-4453e25fe5f8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:02.745540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5562764a-86c3-4fca-8dc5-4453e25fe5f8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.746585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5562764a-86c3-4fca-8dc5-4453e25fe5f8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:02.747181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5562764a-86c3-4fca-8dc5-4453e25fe5f8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.822740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5562764a-86c3-4fca-8dc5-4453e25fe5f8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:03.002517 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5562764a-86c3-4fca-8dc5-4453e25fe5f8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "DELETE /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c" status: 204 len: 0 microversion: 2.1 time: 0.307140 Jul 20 04:23:03.007818 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1493/2775] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:02 2022] DELETE /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:23:03.015138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6d019273-d46f-4323-ad1b-868f718d8240 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:03.015871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6d019273-d46f-4323-ad1b-868f718d8240 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:03.023558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d019273-d46f-4323-ad1b-868f718d8240 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.024031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d019273-d46f-4323-ad1b-868f718d8240 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.025019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d019273-d46f-4323-ad1b-868f718d8240 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.025550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d019273-d46f-4323-ad1b-868f718d8240 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.028126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-74f9cba0-1f0d-44eb-826c-a004753c5d0a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:03.032344 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:03.038087 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-74f9cba0-1f0d-44eb-826c-a004753c5d0a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 200 len: 1486 microversion: 2.1 time: 0.449083 Jul 20 04:23:03.039056 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1283/2776] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:02 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 1486 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:03.245412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-12b50a86-8ccc-4b4c-8353-032797c03a1e req-aa4345e2-4b3f-4016-b31d-18189b48a2bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55", "name": "network-vif-deleted", "tag": "03e1f1bc-ea38-4e03-b054-ea1a7c6f739d"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:03.272400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=44 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:03.274312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-12b50a86-8ccc-4b4c-8353-032797c03a1e req-aa4345e2-4b3f-4016-b31d-18189b48a2bd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.274938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-12b50a86-8ccc-4b4c-8353-032797c03a1e req-aa4345e2-4b3f-4016-b31d-18189b48a2bd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.318178 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-12b50a86-8ccc-4b4c-8353-032797c03a1e req-aa4345e2-4b3f-4016-b31d-18189b48a2bd service nova] Creating event network-vif-deleted:03e1f1bc-ea38-4e03-b054-ea1a7c6f739d for instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 on n-h1-826526-5 Jul 20 04:23:03.331985 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-12b50a86-8ccc-4b4c-8353-032797c03a1e req-aa4345e2-4b3f-4016-b31d-18189b48a2bd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091216 Jul 20 04:23:03.333521 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1284/2777] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:03.594877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0b9dd762-dd0e-4ee6-822b-01ae06e7a987 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:03.598711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0b9dd762-dd0e-4ee6-822b-01ae06e7a987 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:03.605871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b9dd762-dd0e-4ee6-822b-01ae06e7a987 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.606759 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b9dd762-dd0e-4ee6-822b-01ae06e7a987 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.608248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b9dd762-dd0e-4ee6-822b-01ae06e7a987 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.619022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b9dd762-dd0e-4ee6-822b-01ae06e7a987 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:04.341581 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0b9dd762-dd0e-4ee6-822b-01ae06e7a987 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:04.385886 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0b9dd762-dd0e-4ee6-822b-01ae06e7a987 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1315 microversion: 2.1 time: 0.794172 Jul 20 04:23:04.387435 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1285/2778] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:03 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1315 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:04.409830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-97ad5820-fcd9-44f3-8192-db5d4cda4929 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:04.411578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-97ad5820-fcd9-44f3-8192-db5d4cda4929 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:04.439496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97ad5820-fcd9-44f3-8192-db5d4cda4929 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:04.449234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97ad5820-fcd9-44f3-8192-db5d4cda4929 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:04.452883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97ad5820-fcd9-44f3-8192-db5d4cda4929 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:04.456628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97ad5820-fcd9-44f3-8192-db5d4cda4929 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:04.519436 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-97ad5820-fcd9-44f3-8192-db5d4cda4929 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] HTTP exception thrown: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 could not be found. Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-97ad5820-fcd9-44f3-8192-db5d4cda4929 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Request method failure captured: Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 HTTP/1.1 Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14LwP74voquJOtLNC80nY4ZOKAFurQEKphevt3p-NcmTDNTcaWLAg-fckOy-6qaK-Uj-RVjM3uvW0fJ5MaFo9LMosvXLySlQqG8Ey9DlZdPnuDB_iP3TZ5M6YQsQsoNbyd1UqrpYW2iCVzS94npO4hxJNvL7yAIupMlPI-7c7G6uq5M Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:23:04.522455 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:23:04.526233 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_baa5e3367dd747cda04291a3f97e7b02", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}] Jul 20 04:23:04.526233 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:23:04.526233 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:23:04.526233 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:23:04.526233 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:23:04.526233 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:23:04.526233 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:23:04.526233 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 23bf1fecf0c14154b1057a2ec35005a3 Jul 20 04:23:04.526233 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:23:04.526233 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:23:04.526233 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 could not be found. Jul 20 04:23:04.526233 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55'} Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 could not be found. Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:04.527911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:04.530131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:04.530131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:04.530131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:04.530131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:04.530131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:04.530131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:04.530131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:04.530131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 could not be found. Jul 20 04:23:04.530131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:04.530131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:04.530131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:04.530131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:04.530131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:04.530131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:04.530131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:04.530131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:04.530131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 could not be found. Jul 20 04:23:04.530131 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:04.533045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-97ad5820-fcd9-44f3-8192-db5d4cda4929 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Returning 404 to user: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:04.537041 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-97ad5820-fcd9-44f3-8192-db5d4cda4929 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 404 len: 111 microversion: 2.1 time: 0.135505 Jul 20 04:23:04.538128 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1286/2779] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:04 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:04.578956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-adece7ec-75c1-403e-8471-ffd76d14a072 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Action: 'create', calling method: .version_select at 0x7f06bdddd1f0>, body: {"keypair": {"name": "tempest-keypair-1058420936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBcsnAtEoU9Eft3bY5Fw+iqpdlSkZFcXEhalOW++UoAAfzn2ZIzT1qYrW7KYncfQM7yKZb8glYrIMuEuCcNYbOuC3HLaOdeKDuwE6WFS3qzZ3hM5q37VzXHkYfuJ2fP7A=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:04.627363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-adece7ec-75c1-403e-8471-ffd76d14a072 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Getting quotas for project baa5e3367dd747cda04291a3f97e7b02. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:04.709205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-adece7ec-75c1-403e-8471-ffd76d14a072 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Getting quotas for user 23bf1fecf0c14154b1057a2ec35005a3 and project baa5e3367dd747cda04291a3f97e7b02. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:04.877685 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-adece7ec-75c1-403e-8471-ffd76d14a072 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.322345 Jul 20 04:23:04.881373 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1287/2780] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:23:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:23:04.903522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-01a8bf10-1b3d-438e-80ce-268a6018a408 req-8eaf3f37-78a2-471a-8950-741d3a5e8ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b80cc2-a403-42e3-a623-aa5896d360e9", "name": "network-vif-plugged", "status": "completed", "tag": "8266a16e-2ac7-4af1-a58a-e921890fc926"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:04.920539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-01a8bf10-1b3d-438e-80ce-268a6018a408 req-8eaf3f37-78a2-471a-8950-741d3a5e8ba5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:04.921634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-01a8bf10-1b3d-438e-80ce-268a6018a408 req-8eaf3f37-78a2-471a-8950-741d3a5e8ba5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:04.963663 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-01a8bf10-1b3d-438e-80ce-268a6018a408 req-8eaf3f37-78a2-471a-8950-741d3a5e8ba5 service nova] Creating event network-vif-plugged:8266a16e-2ac7-4af1-a58a-e921890fc926 for instance 62b80cc2-a403-42e3-a623-aa5896d360e9 on n-h2-826526-5 Jul 20 04:23:04.974378 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-01a8bf10-1b3d-438e-80ce-268a6018a408 req-8eaf3f37-78a2-471a-8950-741d3a5e8ba5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088307 Jul 20 04:23:04.975729 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1288/2781] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:05.421404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2a5a6b77-0886-44c5-b6ab-663880dac5bc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:05.424514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2a5a6b77-0886-44c5-b6ab-663880dac5bc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:05.454945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a5a6b77-0886-44c5-b6ab-663880dac5bc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:05.455840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a5a6b77-0886-44c5-b6ab-663880dac5bc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:05.460408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a5a6b77-0886-44c5-b6ab-663880dac5bc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:05.461990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a5a6b77-0886-44c5-b6ab-663880dac5bc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:05.641975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6d019273-d46f-4323-ad1b-868f718d8240 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:05.656850 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6d019273-d46f-4323-ad1b-868f718d8240 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c" status: 200 len: 1470 microversion: 2.1 time: 2.645477 Jul 20 04:23:05.659297 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1494/2782] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:03 2022] GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c => generated 1470 bytes in 2651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:06.692843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-93c294cf-bf3e-4839-8149-5d052bb7ada8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:06.693925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-93c294cf-bf3e-4839-8149-5d052bb7ada8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:06.719462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93c294cf-bf3e-4839-8149-5d052bb7ada8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.724953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93c294cf-bf3e-4839-8149-5d052bb7ada8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.726074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93c294cf-bf3e-4839-8149-5d052bb7ada8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.726620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93c294cf-bf3e-4839-8149-5d052bb7ada8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:07.580590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2a5a6b77-0886-44c5-b6ab-663880dac5bc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:07.629576 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2a5a6b77-0886-44c5-b6ab-663880dac5bc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1315 microversion: 2.1 time: 2.209461 Jul 20 04:23:07.636183 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1289/2783] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:05 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1315 bytes in 2225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:08.068493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-93c294cf-bf3e-4839-8149-5d052bb7ada8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:08.101597 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-93c294cf-bf3e-4839-8149-5d052bb7ada8 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c" status: 200 len: 1470 microversion: 2.1 time: 1.412444 Jul 20 04:23:08.102512 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1495/2784] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:06 2022] GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c => generated 1470 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:08.657334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5e7e7137-fd38-4cd7-87ab-bce345ecd56d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:08.659045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5e7e7137-fd38-4cd7-87ab-bce345ecd56d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:08.694425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e7e7137-fd38-4cd7-87ab-bce345ecd56d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:08.697190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e7e7137-fd38-4cd7-87ab-bce345ecd56d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:08.700846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e7e7137-fd38-4cd7-87ab-bce345ecd56d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:08.703463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e7e7137-fd38-4cd7-87ab-bce345ecd56d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:08.768420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-a12b567a-105f-4232-b795-9e24064b87ea req-3a0258f2-2db6-4587-931d-9353010f0a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b1f0db-8edc-44e8-a1ea-7c5efff1534c", "name": "network-vif-deleted", "tag": "ffb541a6-bf04-450c-9d5f-88a72fda1a31"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:08.810291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a12b567a-105f-4232-b795-9e24064b87ea req-3a0258f2-2db6-4587-931d-9353010f0a8b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:08.810827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a12b567a-105f-4232-b795-9e24064b87ea req-3a0258f2-2db6-4587-931d-9353010f0a8b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:08.847223 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-a12b567a-105f-4232-b795-9e24064b87ea req-3a0258f2-2db6-4587-931d-9353010f0a8b service nova] Creating event network-vif-deleted:ffb541a6-bf04-450c-9d5f-88a72fda1a31 for instance 98b1f0db-8edc-44e8-a1ea-7c5efff1534c on n-h2-826526-5 Jul 20 04:23:08.862839 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-a12b567a-105f-4232-b795-9e24064b87ea req-3a0258f2-2db6-4587-931d-9353010f0a8b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099244 Jul 20 04:23:08.864864 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1496/2785] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:23:09.123225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-103fe4c4-a571-4622-b1df-254c3dca2c3c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:09.141821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-103fe4c4-a571-4622-b1df-254c3dca2c3c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:09.172080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-103fe4c4-a571-4622-b1df-254c3dca2c3c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.176800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-103fe4c4-a571-4622-b1df-254c3dca2c3c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.182113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-103fe4c4-a571-4622-b1df-254c3dca2c3c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.183332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-103fe4c4-a571-4622-b1df-254c3dca2c3c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.223384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:09.241565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-103fe4c4-a571-4622-b1df-254c3dca2c3c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.243264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-103fe4c4-a571-4622-b1df-254c3dca2c3c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.244103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-103fe4c4-a571-4622-b1df-254c3dca2c3c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lazy-loading 'fault' on Instance uuid 98b1f0db-8edc-44e8-a1ea-7c5efff1534c {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:23:09.401635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5e7e7137-fd38-4cd7-87ab-bce345ecd56d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:09.435059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-103fe4c4-a571-4622-b1df-254c3dca2c3c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:09.463700 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5e7e7137-fd38-4cd7-87ab-bce345ecd56d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1502 microversion: 2.1 time: 0.810236 Jul 20 04:23:09.467807 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1290/2786] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:08 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1502 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:09.484729 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-103fe4c4-a571-4622-b1df-254c3dca2c3c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c" status: 200 len: 1304 microversion: 2.1 time: 0.367531 Jul 20 04:23:09.487471 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1497/2787] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:09 2022] GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c => generated 1304 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:09.506319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c5205d11-41ad-4fc0-a094-47468d48f9b9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:09.506995 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c5205d11-41ad-4fc0-a094-47468d48f9b9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:09.535162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5205d11-41ad-4fc0-a094-47468d48f9b9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.536003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5205d11-41ad-4fc0-a094-47468d48f9b9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.537262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5205d11-41ad-4fc0-a094-47468d48f9b9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.538500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5205d11-41ad-4fc0-a094-47468d48f9b9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.643059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c5205d11-41ad-4fc0-a094-47468d48f9b9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:09.886639 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c5205d11-41ad-4fc0-a094-47468d48f9b9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 204 len: 0 microversion: 2.1 time: 0.390264 Jul 20 04:23:09.888281 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1291/2788] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:09 2022] DELETE /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:23:09.899948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-37fea77a-3193-4e60-b2a6-1ba9db2ac69f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:09.901080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-37fea77a-3193-4e60-b2a6-1ba9db2ac69f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:09.913013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37fea77a-3193-4e60-b2a6-1ba9db2ac69f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.916555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37fea77a-3193-4e60-b2a6-1ba9db2ac69f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.919424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37fea77a-3193-4e60-b2a6-1ba9db2ac69f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.922599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37fea77a-3193-4e60-b2a6-1ba9db2ac69f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.519141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-af77016d-b2d4-4529-b27e-3a60bc404a1a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:10.519960 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-af77016d-b2d4-4529-b27e-3a60bc404a1a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 98b1f0db-8edc-44e8-a1ea-7c5efff1534c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:10.533125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af77016d-b2d4-4529-b27e-3a60bc404a1a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.533740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af77016d-b2d4-4529-b27e-3a60bc404a1a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.534962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af77016d-b2d4-4529-b27e-3a60bc404a1a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.535839 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af77016d-b2d4-4529-b27e-3a60bc404a1a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.583551 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-af77016d-b2d4-4529-b27e-3a60bc404a1a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] HTTP exception thrown: Instance 98b1f0db-8edc-44e8-a1ea-7c5efff1534c could not be found. Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-af77016d-b2d4-4529-b27e-3a60bc404a1a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Request method failure captured: Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c HTTP/1.1 Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14KX-4B41quzc6TvaHiPF1oryqgLwqLY7rI4X2pnP-_VmsXGHfiztfQKOHnGZQg6NAK3e_gc7ZpNRFchjoteI_ddTZAwVYDBj9s9kr3LK-nE-S-Me9ARd2QCMk746SKqpEXqp7eTWvbEg6TwPiqRwHZpIu7TNe55hIksCVPC96X2QWc Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: e780b879f5f943468e72977a75ee807d Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersAdminTestJSON-1533684223 Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:23:10.587619 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:23:10.589090 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e780b879f5f943468e72977a75ee807d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e780b879f5f943468e72977a75ee807d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e780b879f5f943468e72977a75ee807d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e780b879f5f943468e72977a75ee807d"}]}] Jul 20 04:23:10.589090 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersAdminTestJSON-1533684223 Jul 20 04:23:10.589090 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: e780b879f5f943468e72977a75ee807d Jul 20 04:23:10.589090 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersAdminTestJSON-1533684223 Jul 20 04:23:10.589090 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersAdminTestJSON-1533684223-project Jul 20 04:23:10.589090 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:23:10.589090 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:23:10.589090 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: cace98c409cd464a93e2d98ff7d1a989 Jul 20 04:23:10.589090 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersAdminTestJSON-1533684223-project Jul 20 04:23:10.589090 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:23:10.589090 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 98b1f0db-8edc-44e8-a1ea-7c5efff1534c could not be found. Jul 20 04:23:10.589090 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '98b1f0db-8edc-44e8-a1ea-7c5efff1534c'} Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98b1f0db-8edc-44e8-a1ea-7c5efff1534c could not be found. Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:10.590017 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:10.591318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:10.591318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:10.591318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:10.591318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:10.591318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:10.591318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:10.591318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:10.591318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98b1f0db-8edc-44e8-a1ea-7c5efff1534c could not be found. Jul 20 04:23:10.591318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:10.591318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:10.591318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:10.591318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:10.591318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:10.591318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:10.591318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:10.591318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:10.591318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98b1f0db-8edc-44e8-a1ea-7c5efff1534c could not be found. Jul 20 04:23:10.591318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:10.592535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-af77016d-b2d4-4529-b27e-3a60bc404a1a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Returning 404 to user: Instance 98b1f0db-8edc-44e8-a1ea-7c5efff1534c could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:10.592535 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-af77016d-b2d4-4529-b27e-3a60bc404a1a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c" status: 404 len: 111 microversion: 2.1 time: 0.075217 Jul 20 04:23:10.592833 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1292/2789] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:10 2022] GET /compute/v2.1/servers/98b1f0db-8edc-44e8-a1ea-7c5efff1534c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:10.605127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-affe314f-341a-41a5-a5fb-09ecb2d00e0e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:10.606784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-affe314f-341a-41a5-a5fb-09ecb2d00e0e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:10.630229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-affe314f-341a-41a5-a5fb-09ecb2d00e0e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.630724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-affe314f-341a-41a5-a5fb-09ecb2d00e0e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.631780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-affe314f-341a-41a5-a5fb-09ecb2d00e0e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.632440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-affe314f-341a-41a5-a5fb-09ecb2d00e0e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.708802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-affe314f-341a-41a5-a5fb-09ecb2d00e0e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:11.013783 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-affe314f-341a-41a5-a5fb-09ecb2d00e0e tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 204 len: 0 microversion: 2.1 time: 0.414783 Jul 20 04:23:11.025627 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1293/2790] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:10 2022] DELETE /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:23:11.041789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-24c6705c-839f-4180-9d05-37c0ba1a4840 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:11.042898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-24c6705c-839f-4180-9d05-37c0ba1a4840 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:11.059199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24c6705c-839f-4180-9d05-37c0ba1a4840 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:11.059979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24c6705c-839f-4180-9d05-37c0ba1a4840 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:11.061693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24c6705c-839f-4180-9d05-37c0ba1a4840 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:11.062513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24c6705c-839f-4180-9d05-37c0ba1a4840 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:11.368103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-37fea77a-3193-4e60-b2a6-1ba9db2ac69f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:11.398613 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-37fea77a-3193-4e60-b2a6-1ba9db2ac69f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1508 microversion: 2.1 time: 1.500923 Jul 20 04:23:11.401335 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1498/2791] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:09 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1508 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:11.600093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-24c6705c-839f-4180-9d05-37c0ba1a4840 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:11.643909 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-24c6705c-839f-4180-9d05-37c0ba1a4840 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1469 microversion: 2.1 time: 0.615457 Jul 20 04:23:11.647330 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1294/2792] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:11 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1469 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:12.428501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-32760461-e423-4c6d-bc2e-4a293ba4d625 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:12.435321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-32760461-e423-4c6d-bc2e-4a293ba4d625 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:12.462538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32760461-e423-4c6d-bc2e-4a293ba4d625 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:12.469701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32760461-e423-4c6d-bc2e-4a293ba4d625 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:12.474209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32760461-e423-4c6d-bc2e-4a293ba4d625 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:12.478687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32760461-e423-4c6d-bc2e-4a293ba4d625 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:12.668037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2e8e8ce7-6f02-45d0-812b-b3692e30320a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:12.671119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2e8e8ce7-6f02-45d0-812b-b3692e30320a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:12.682326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e8e8ce7-6f02-45d0-812b-b3692e30320a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:12.683018 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e8e8ce7-6f02-45d0-812b-b3692e30320a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:12.684163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e8e8ce7-6f02-45d0-812b-b3692e30320a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:12.685009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e8e8ce7-6f02-45d0-812b-b3692e30320a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:13.278658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-32760461-e423-4c6d-bc2e-4a293ba4d625 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:13.292034 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-32760461-e423-4c6d-bc2e-4a293ba4d625 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1508 microversion: 2.1 time: 0.875733 Jul 20 04:23:13.293111 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1499/2793] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:12 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1508 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:13.338356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2e8e8ce7-6f02-45d0-812b-b3692e30320a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:13.361876 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2e8e8ce7-6f02-45d0-812b-b3692e30320a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1469 microversion: 2.1 time: 0.701405 Jul 20 04:23:13.363993 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1295/2794] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:12 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1469 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:14.313803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-08d2065d-9aed-4721-bf8f-0b4d3a36be7f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:14.314927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-08d2065d-9aed-4721-bf8f-0b4d3a36be7f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:14.333006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08d2065d-9aed-4721-bf8f-0b4d3a36be7f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.337517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08d2065d-9aed-4721-bf8f-0b4d3a36be7f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.339210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08d2065d-9aed-4721-bf8f-0b4d3a36be7f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.346685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08d2065d-9aed-4721-bf8f-0b4d3a36be7f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.380623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-11be5e99-c56b-43ac-8ad2-b94e47a4b60b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:14.381288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-11be5e99-c56b-43ac-8ad2-b94e47a4b60b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:14.397299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11be5e99-c56b-43ac-8ad2-b94e47a4b60b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.398161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11be5e99-c56b-43ac-8ad2-b94e47a4b60b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.401207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11be5e99-c56b-43ac-8ad2-b94e47a4b60b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.401685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11be5e99-c56b-43ac-8ad2-b94e47a4b60b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.804896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:15.897412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-11be5e99-c56b-43ac-8ad2-b94e47a4b60b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:15.906500 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-11be5e99-c56b-43ac-8ad2-b94e47a4b60b tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 200 len: 1469 microversion: 2.1 time: 1.530531 Jul 20 04:23:15.911221 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1296/2795] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:14 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 1469 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:15.919414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-78483566-85b6-4d23-9a8b-f9c0e82cb3a5 req-e1242c45-4231-4e5d-9681-f01be22ffd2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b271cf2-d6b2-479e-8422-2edba3000fa2", "name": "network-vif-deleted", "tag": "828d5fbf-9e79-4cb9-a15c-8409a2f81820"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:15.953364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-78483566-85b6-4d23-9a8b-f9c0e82cb3a5 req-e1242c45-4231-4e5d-9681-f01be22ffd2f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:15.954086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-78483566-85b6-4d23-9a8b-f9c0e82cb3a5 req-e1242c45-4231-4e5d-9681-f01be22ffd2f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:15.967564 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-78483566-85b6-4d23-9a8b-f9c0e82cb3a5 req-e1242c45-4231-4e5d-9681-f01be22ffd2f service nova] Creating event network-vif-deleted:828d5fbf-9e79-4cb9-a15c-8409a2f81820 for instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 on n-h2-826526-5 Jul 20 04:23:15.978908 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-78483566-85b6-4d23-9a8b-f9c0e82cb3a5 req-e1242c45-4231-4e5d-9681-f01be22ffd2f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066318 Jul 20 04:23:15.979834 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1297/2796] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:16.130951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-08d2065d-9aed-4721-bf8f-0b4d3a36be7f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:16.149610 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-08d2065d-9aed-4721-bf8f-0b4d3a36be7f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 200 len: 1508 microversion: 2.1 time: 1.841209 Jul 20 04:23:16.150246 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1500/2797] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:14 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 1508 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:16.320306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-950fc00d-8d21-4d87-80f6-aa87c5804b13 req-e0486f2b-ae6b-4728-8d7b-fb0fb95e8ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e657e9b-7218-4037-a681-e00c4b71023b", "name": "network-vif-deleted", "tag": "73a2f40f-aa9f-4110-8c81-c1c7afbe4bcc"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:16.347321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-950fc00d-8d21-4d87-80f6-aa87c5804b13 req-e0486f2b-ae6b-4728-8d7b-fb0fb95e8ae5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.362600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-950fc00d-8d21-4d87-80f6-aa87c5804b13 req-e0486f2b-ae6b-4728-8d7b-fb0fb95e8ae5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.408916 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-950fc00d-8d21-4d87-80f6-aa87c5804b13 req-e0486f2b-ae6b-4728-8d7b-fb0fb95e8ae5 service nova] Creating event network-vif-deleted:73a2f40f-aa9f-4110-8c81-c1c7afbe4bcc for instance 0e657e9b-7218-4037-a681-e00c4b71023b on n-h1-826526-5 Jul 20 04:23:16.429062 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-950fc00d-8d21-4d87-80f6-aa87c5804b13 req-e0486f2b-ae6b-4728-8d7b-fb0fb95e8ae5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120890 Jul 20 04:23:16.429690 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1298/2798] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:16.925662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b552b5ac-9026-4616-ad77-98037b52733c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:16.927061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b552b5ac-9026-4616-ad77-98037b52733c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 0e657e9b-7218-4037-a681-e00c4b71023b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:16.980889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b552b5ac-9026-4616-ad77-98037b52733c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.987368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b552b5ac-9026-4616-ad77-98037b52733c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.988506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b552b5ac-9026-4616-ad77-98037b52733c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.989827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b552b5ac-9026-4616-ad77-98037b52733c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.085057 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-b552b5ac-9026-4616-ad77-98037b52733c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] HTTP exception thrown: Instance 0e657e9b-7218-4037-a681-e00c4b71023b could not be found. Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b552b5ac-9026-4616-ad77-98037b52733c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Request method failure captured: Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b HTTP/1.1 Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14KX-4B41quzc6TvaHiPF1oryqgLwqLY7rI4X2pnP-_VmsXGHfiztfQKOHnGZQg6NAK3e_gc7ZpNRFchjoteI_ddTZAwVYDBj9s9kr3LK-nE-S-Me9ARd2QCMk746SKqpEXqp7eTWvbEg6TwPiqRwHZpIu7TNe55hIksCVPC96X2QWc Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: e780b879f5f943468e72977a75ee807d Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersAdminTestJSON-1533684223 Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:23:17.100806 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:23:17.102489 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e780b879f5f943468e72977a75ee807d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e780b879f5f943468e72977a75ee807d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e780b879f5f943468e72977a75ee807d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e780b879f5f943468e72977a75ee807d"}]}] Jul 20 04:23:17.102489 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersAdminTestJSON-1533684223 Jul 20 04:23:17.102489 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: e780b879f5f943468e72977a75ee807d Jul 20 04:23:17.102489 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersAdminTestJSON-1533684223 Jul 20 04:23:17.102489 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersAdminTestJSON-1533684223-project Jul 20 04:23:17.102489 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:23:17.102489 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:23:17.102489 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: cace98c409cd464a93e2d98ff7d1a989 Jul 20 04:23:17.102489 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersAdminTestJSON-1533684223-project Jul 20 04:23:17.102489 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:23:17.102489 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 0e657e9b-7218-4037-a681-e00c4b71023b could not be found. Jul 20 04:23:17.102489 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '0e657e9b-7218-4037-a681-e00c4b71023b'} Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e657e9b-7218-4037-a681-e00c4b71023b could not be found. Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:17.103309 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:17.104809 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:17.104809 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:17.104809 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:17.104809 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:17.104809 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:17.104809 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:17.104809 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:17.104809 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e657e9b-7218-4037-a681-e00c4b71023b could not be found. Jul 20 04:23:17.104809 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:17.104809 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:17.104809 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:17.104809 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:17.104809 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:17.104809 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:17.104809 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:17.104809 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:17.104809 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e657e9b-7218-4037-a681-e00c4b71023b could not be found. Jul 20 04:23:17.104809 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:17.108183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b552b5ac-9026-4616-ad77-98037b52733c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Returning 404 to user: Instance 0e657e9b-7218-4037-a681-e00c4b71023b could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:17.110500 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b552b5ac-9026-4616-ad77-98037b52733c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b" status: 404 len: 111 microversion: 2.1 time: 0.190375 Jul 20 04:23:17.117206 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1501/2799] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:16 2022] GET /compute/v2.1/servers/0e657e9b-7218-4037-a681-e00c4b71023b => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:17.130062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-41215df4-56bf-40fc-b339-073488b5a8ca tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:17.131049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-41215df4-56bf-40fc-b339-073488b5a8ca tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:17.172842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-24c7a684-0463-4343-a7d4-be1ef02d532c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1071219772", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:17.178762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41215df4-56bf-40fc-b339-073488b5a8ca tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.189653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41215df4-56bf-40fc-b339-073488b5a8ca tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.190923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41215df4-56bf-40fc-b339-073488b5a8ca tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.191569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41215df4-56bf-40fc-b339-073488b5a8ca tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.273641 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-41215df4-56bf-40fc-b339-073488b5a8ca tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:17.335581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-24c7a684-0463-4343-a7d4-be1ef02d532c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] validate_networks() for [('4af6d0f3-f0ce-426d-9f01-7cbd3ae59fb5', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:23:17.476890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:17.541428 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-41215df4-56bf-40fc-b339-073488b5a8ca tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "DELETE /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 204 len: 0 microversion: 2.1 time: 0.417708 Jul 20 04:23:17.553326 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1299/2800] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:17 2022] DELETE /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:23:17.559518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-da18d1f4-b324-4687-b55b-f99d8f02d180 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:17.569186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-da18d1f4-b324-4687-b55b-f99d8f02d180 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:17.589153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da18d1f4-b324-4687-b55b-f99d8f02d180 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.594264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da18d1f4-b324-4687-b55b-f99d8f02d180 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.595775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da18d1f4-b324-4687-b55b-f99d8f02d180 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.596497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da18d1f4-b324-4687-b55b-f99d8f02d180 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.668143 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-da18d1f4-b324-4687-b55b-f99d8f02d180 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 could not be found. Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-da18d1f4-b324-4687-b55b-f99d8f02d180 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 HTTP/1.1 Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:23:17.670036 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:23:17.672132 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:23:17.672132 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:23:17.672132 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:23:17.672132 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:23:17.672132 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:23:17.672132 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:23:17.672132 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:23:17.672132 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:23:17.672132 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:23:17.672132 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:23:17.672132 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 could not be found. Jul 20 04:23:17.672132 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '5b271cf2-d6b2-479e-8422-2edba3000fa2'} Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 could not be found. Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:17.673215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:17.675433 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:17.675433 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:17.675433 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:17.675433 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:17.675433 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:17.675433 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:17.675433 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:17.675433 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 could not be found. Jul 20 04:23:17.675433 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:17.675433 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:17.675433 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:17.675433 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:17.675433 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:17.675433 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:17.675433 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:17.675433 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:17.675433 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 could not be found. Jul 20 04:23:17.675433 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:17.678045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-da18d1f4-b324-4687-b55b-f99d8f02d180 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:17.678368 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-da18d1f4-b324-4687-b55b-f99d8f02d180 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 404 len: 111 microversion: 2.1 time: 0.121907 Jul 20 04:23:17.689828 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1300/2801] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:17 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:17.695207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-280dc6f7-6fd8-40a4-bd4a-b97f9c8fdc45 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:17.696238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-280dc6f7-6fd8-40a4-bd4a-b97f9c8fdc45 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:17.716489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-280dc6f7-6fd8-40a4-bd4a-b97f9c8fdc45 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.718926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-280dc6f7-6fd8-40a4-bd4a-b97f9c8fdc45 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.724318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-280dc6f7-6fd8-40a4-bd4a-b97f9c8fdc45 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.725313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-280dc6f7-6fd8-40a4-bd4a-b97f9c8fdc45 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.732730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:19.354629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-24c7a684-0463-4343-a7d4-be1ef02d532c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:23:19.355313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-24c7a684-0463-4343-a7d4-be1ef02d532c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:23:19.356714 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-24c7a684-0463-4343-a7d4-be1ef02d532c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:23:19.356714 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-24c7a684-0463-4343-a7d4-be1ef02d532c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:23:19.356714 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-24c7a684-0463-4343-a7d4-be1ef02d532c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:23:19.375709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24c7a684-0463-4343-a7d4-be1ef02d532c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.375709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24c7a684-0463-4343-a7d4-be1ef02d532c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.383355 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24c7a684-0463-4343-a7d4-be1ef02d532c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.384324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24c7a684-0463-4343-a7d4-be1ef02d532c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.432962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-24c7a684-0463-4343-a7d4-be1ef02d532c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Getting quotas for project baa5e3367dd747cda04291a3f97e7b02. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:19.444613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-24c7a684-0463-4343-a7d4-be1ef02d532c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Getting quotas for user 23bf1fecf0c14154b1057a2ec35005a3 and project baa5e3367dd747cda04291a3f97e7b02. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:19.472096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-24c7a684-0463-4343-a7d4-be1ef02d532c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:23:19.487062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-24c7a684-0463-4343-a7d4-be1ef02d532c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:23:19.608719 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-24c7a684-0463-4343-a7d4-be1ef02d532c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.457921 Jul 20 04:23:19.617627 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1502/2802] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 2468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:23:19.634794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b6e2c30-ffbc-4e8b-bdf3-a88107dd18cd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1821307272", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "c3db3bfb-11a7-406a-b082-1e92336f5a21"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:19.718521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-9b6e2c30-ffbc-4e8b-bdf3-a88107dd18cd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] validate_networks() for [('c3db3bfb-11a7-406a-b082-1e92336f5a21', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:23:19.857499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-280dc6f7-6fd8-40a4-bd4a-b97f9c8fdc45 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:19.876913 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-280dc6f7-6fd8-40a4-bd4a-b97f9c8fdc45 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1470 microversion: 2.1 time: 2.182369 Jul 20 04:23:19.895485 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1301/2803] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:17 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1470 bytes in 2205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:19.918967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3fec93e9-d32a-4114-99d8-77f363da6402 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:19.922095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3fec93e9-d32a-4114-99d8-77f363da6402 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:20.083894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3fec93e9-d32a-4114-99d8-77f363da6402 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:20.093545 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3fec93e9-d32a-4114-99d8-77f363da6402 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1225 microversion: 2.1 time: 0.193270 Jul 20 04:23:20.106868 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1302/2804] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:19 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1225 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:20.913660 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-193c9a1c-594a-4926-bba6-23987e9db070 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:20.915791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-193c9a1c-594a-4926-bba6-23987e9db070 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:20.938552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-193c9a1c-594a-4926-bba6-23987e9db070 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.939373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-193c9a1c-594a-4926-bba6-23987e9db070 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.944292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-193c9a1c-594a-4926-bba6-23987e9db070 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.945805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-193c9a1c-594a-4926-bba6-23987e9db070 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.289908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-193c9a1c-594a-4926-bba6-23987e9db070 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:21.303186 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-193c9a1c-594a-4926-bba6-23987e9db070 tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1470 microversion: 2.1 time: 0.394576 Jul 20 04:23:21.304733 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1303/2805] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:20 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1470 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:21.310337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ba2155af-61bf-4e38-8eec-dd978a0fb24a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:21.311336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ba2155af-61bf-4e38-8eec-dd978a0fb24a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:21.331643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba2155af-61bf-4e38-8eec-dd978a0fb24a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.332482 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba2155af-61bf-4e38-8eec-dd978a0fb24a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.333584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba2155af-61bf-4e38-8eec-dd978a0fb24a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.334185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba2155af-61bf-4e38-8eec-dd978a0fb24a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.513092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ba2155af-61bf-4e38-8eec-dd978a0fb24a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:21.532383 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ba2155af-61bf-4e38-8eec-dd978a0fb24a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1285 microversion: 2.1 time: 0.226286 Jul 20 04:23:21.533621 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1304/2806] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:21 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1285 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:21.794544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-5d70e6d3-2dbe-4067-91fd-9e99ec13b86a req-f8c289b8-234d-4718-a10e-dbda5fd39d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b80cc2-a403-42e3-a623-aa5896d360e9", "name": "network-vif-deleted", "tag": "8266a16e-2ac7-4af1-a58a-e921890fc926"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:21.819458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5d70e6d3-2dbe-4067-91fd-9e99ec13b86a req-f8c289b8-234d-4718-a10e-dbda5fd39d19 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.820207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5d70e6d3-2dbe-4067-91fd-9e99ec13b86a req-f8c289b8-234d-4718-a10e-dbda5fd39d19 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.852597 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-5d70e6d3-2dbe-4067-91fd-9e99ec13b86a req-f8c289b8-234d-4718-a10e-dbda5fd39d19 service nova] Creating event network-vif-deleted:8266a16e-2ac7-4af1-a58a-e921890fc926 for instance 62b80cc2-a403-42e3-a623-aa5896d360e9 on n-h2-826526-5 Jul 20 04:23:21.862408 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-5d70e6d3-2dbe-4067-91fd-9e99ec13b86a req-f8c289b8-234d-4718-a10e-dbda5fd39d19 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071620 Jul 20 04:23:21.873828 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1305/2807] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:22.104139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-9b6e2c30-ffbc-4e8b-bdf3-a88107dd18cd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:23:22.104901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-9b6e2c30-ffbc-4e8b-bdf3-a88107dd18cd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:23:22.105063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-9b6e2c30-ffbc-4e8b-bdf3-a88107dd18cd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:23:22.105440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-9b6e2c30-ffbc-4e8b-bdf3-a88107dd18cd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:23:22.106203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-9b6e2c30-ffbc-4e8b-bdf3-a88107dd18cd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:23:22.135273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b6e2c30-ffbc-4e8b-bdf3-a88107dd18cd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.135782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b6e2c30-ffbc-4e8b-bdf3-a88107dd18cd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.137181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b6e2c30-ffbc-4e8b-bdf3-a88107dd18cd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.139391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b6e2c30-ffbc-4e8b-bdf3-a88107dd18cd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.195002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-9b6e2c30-ffbc-4e8b-bdf3-a88107dd18cd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Getting quotas for project ae67de1fefe64bd19a3bf614f02d3535. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:22.225855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-9b6e2c30-ffbc-4e8b-bdf3-a88107dd18cd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Getting quotas for user 1dc60058bea0485ebd4d502b2e7c986b and project ae67de1fefe64bd19a3bf614f02d3535. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:22.265353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9b6e2c30-ffbc-4e8b-bdf3-a88107dd18cd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:23:22.276458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9b6e2c30-ffbc-4e8b-bdf3-a88107dd18cd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:23:22.336586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8c1049d6-ed59-40c2-bc94-c9b3b6e3c39a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:22.340584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8c1049d6-ed59-40c2-bc94-c9b3b6e3c39a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:22.363394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c1049d6-ed59-40c2-bc94-c9b3b6e3c39a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.365100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c1049d6-ed59-40c2-bc94-c9b3b6e3c39a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.370605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c1049d6-ed59-40c2-bc94-c9b3b6e3c39a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.373973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c1049d6-ed59-40c2-bc94-c9b3b6e3c39a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.409505 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9b6e2c30-ffbc-4e8b-bdf3-a88107dd18cd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.789939 Jul 20 04:23:22.415025 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1503/2808] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:23:22.432876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-73512999-092d-4ff0-a46d-80ee4f78cbbf tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:22.434037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-73512999-092d-4ff0-a46d-80ee4f78cbbf tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:22.435103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c1049d6-ed59-40c2-bc94-c9b3b6e3c39a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.435740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c1049d6-ed59-40c2-bc94-c9b3b6e3c39a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.436584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-8c1049d6-ed59-40c2-bc94-c9b3b6e3c39a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lazy-loading 'fault' on Instance uuid 62b80cc2-a403-42e3-a623-aa5896d360e9 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:23:22.703117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8c1049d6-ed59-40c2-bc94-c9b3b6e3c39a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace98c409cd464a93e2d98ff7d1a989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e780b879f5f943468e72977a75ee807d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:22.711786 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8c1049d6-ed59-40c2-bc94-c9b3b6e3c39a tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 200 len: 1304 microversion: 2.1 time: 0.386164 Jul 20 04:23:22.718313 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1306/2809] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:22 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 1304 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:22.733816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9e1c075a-a11d-4b8c-9a3c-0b8e9cf3fa97 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:22.735883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9e1c075a-a11d-4b8c-9a3c-0b8e9cf3fa97 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:22.746152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e1c075a-a11d-4b8c-9a3c-0b8e9cf3fa97 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.753437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e1c075a-a11d-4b8c-9a3c-0b8e9cf3fa97 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.754883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e1c075a-a11d-4b8c-9a3c-0b8e9cf3fa97 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.755518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e1c075a-a11d-4b8c-9a3c-0b8e9cf3fa97 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.767452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-73512999-092d-4ff0-a46d-80ee4f78cbbf tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:22.792912 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-73512999-092d-4ff0-a46d-80ee4f78cbbf tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1215 microversion: 2.1 time: 0.369706 Jul 20 04:23:22.798411 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1504/2810] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:22 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1215 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:23.115311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9e1c075a-a11d-4b8c-9a3c-0b8e9cf3fa97 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:23.133529 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9e1c075a-a11d-4b8c-9a3c-0b8e9cf3fa97 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1283 microversion: 2.1 time: 0.413781 Jul 20 04:23:23.135373 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1307/2811] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:22 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1283 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:23.746088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c8b150d8-eba6-468c-8bfb-81f6fa46f67c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:23.747210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c8b150d8-eba6-468c-8bfb-81f6fa46f67c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] [instance: 62b80cc2-a403-42e3-a623-aa5896d360e9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:23.764511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8b150d8-eba6-468c-8bfb-81f6fa46f67c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:23.765746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8b150d8-eba6-468c-8bfb-81f6fa46f67c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:23.767418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8b150d8-eba6-468c-8bfb-81f6fa46f67c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:23.768823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8b150d8-eba6-468c-8bfb-81f6fa46f67c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:23.817997 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-c8b150d8-eba6-468c-8bfb-81f6fa46f67c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] HTTP exception thrown: Instance 62b80cc2-a403-42e3-a623-aa5896d360e9 could not be found. Jul 20 04:23:23.818732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b29078b1-a2bd-4a5d-85f4-80ebddf84cb2 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:23.819515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b29078b1-a2bd-4a5d-85f4-80ebddf84cb2 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c8b150d8-eba6-468c-8bfb-81f6fa46f67c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Request method failure captured: Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 HTTP/1.1 Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14KX-4B41quzc6TvaHiPF1oryqgLwqLY7rI4X2pnP-_VmsXGHfiztfQKOHnGZQg6NAK3e_gc7ZpNRFchjoteI_ddTZAwVYDBj9s9kr3LK-nE-S-Me9ARd2QCMk746SKqpEXqp7eTWvbEg6TwPiqRwHZpIu7TNe55hIksCVPC96X2QWc Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: e780b879f5f943468e72977a75ee807d Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersAdminTestJSON-1533684223 Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:23:23.822153 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:23:23.824123 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e780b879f5f943468e72977a75ee807d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e780b879f5f943468e72977a75ee807d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e780b879f5f943468e72977a75ee807d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e780b879f5f943468e72977a75ee807d"}]}] Jul 20 04:23:23.824123 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersAdminTestJSON-1533684223 Jul 20 04:23:23.824123 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: e780b879f5f943468e72977a75ee807d Jul 20 04:23:23.824123 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersAdminTestJSON-1533684223 Jul 20 04:23:23.824123 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersAdminTestJSON-1533684223-project Jul 20 04:23:23.824123 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:23:23.824123 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:23:23.824123 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: cace98c409cd464a93e2d98ff7d1a989 Jul 20 04:23:23.824123 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersAdminTestJSON-1533684223-project Jul 20 04:23:23.824123 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:23:23.824123 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 62b80cc2-a403-42e3-a623-aa5896d360e9 could not be found. Jul 20 04:23:23.824123 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '62b80cc2-a403-42e3-a623-aa5896d360e9'} Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62b80cc2-a403-42e3-a623-aa5896d360e9 could not be found. Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:23.825143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:23.826608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:23.826608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:23.826608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:23.826608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:23.826608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:23.826608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:23.826608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:23.826608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62b80cc2-a403-42e3-a623-aa5896d360e9 could not be found. Jul 20 04:23:23.826608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:23.826608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:23.826608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:23.826608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:23.826608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:23.826608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:23.826608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:23.826608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:23.826608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62b80cc2-a403-42e3-a623-aa5896d360e9 could not be found. Jul 20 04:23:23.826608 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:23.830774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c8b150d8-eba6-468c-8bfb-81f6fa46f67c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] Returning 404 to user: Instance 62b80cc2-a403-42e3-a623-aa5896d360e9 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:23.832570 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c8b150d8-eba6-468c-8bfb-81f6fa46f67c tempest-ServersAdminTestJSON-1533684223 tempest-ServersAdminTestJSON-1533684223-project] 10.222.0.17 "GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9" status: 404 len: 111 microversion: 2.1 time: 0.098173 Jul 20 04:23:23.837366 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1505/2812] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:23 2022] GET /compute/v2.1/servers/62b80cc2-a403-42e3-a623-aa5896d360e9 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:23.852638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b29078b1-a2bd-4a5d-85f4-80ebddf84cb2 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:23.855038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b29078b1-a2bd-4a5d-85f4-80ebddf84cb2 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:23.856101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b29078b1-a2bd-4a5d-85f4-80ebddf84cb2 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:23.857975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b29078b1-a2bd-4a5d-85f4-80ebddf84cb2 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:24.159261 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f8fabba8-d231-44db-9d84-c3f8b90137e4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:24.160694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f8fabba8-d231-44db-9d84-c3f8b90137e4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:24.185312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8fabba8-d231-44db-9d84-c3f8b90137e4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:24.189422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8fabba8-d231-44db-9d84-c3f8b90137e4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:24.191557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8fabba8-d231-44db-9d84-c3f8b90137e4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:24.192066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8fabba8-d231-44db-9d84-c3f8b90137e4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:24.509988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f8fabba8-d231-44db-9d84-c3f8b90137e4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:24.522916 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f8fabba8-d231-44db-9d84-c3f8b90137e4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1283 microversion: 2.1 time: 0.371012 Jul 20 04:23:24.528393 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1506/2813] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:24 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1283 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:24.685884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b29078b1-a2bd-4a5d-85f4-80ebddf84cb2 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:24.699088 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b29078b1-a2bd-4a5d-85f4-80ebddf84cb2 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1211 microversion: 2.1 time: 0.885526 Jul 20 04:23:24.705509 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1308/2814] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:23 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1211 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:25.546701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-03c7f976-e403-4d51-a477-6db5d3dafd66 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:25.547943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-03c7f976-e403-4d51-a477-6db5d3dafd66 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:25.565909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03c7f976-e403-4d51-a477-6db5d3dafd66 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.566363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03c7f976-e403-4d51-a477-6db5d3dafd66 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.571313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03c7f976-e403-4d51-a477-6db5d3dafd66 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.575124 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03c7f976-e403-4d51-a477-6db5d3dafd66 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.727641 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed366953-205b-4a1e-88f4-3382e7b5d0fc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:25.729212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ed366953-205b-4a1e-88f4-3382e7b5d0fc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:25.742743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed366953-205b-4a1e-88f4-3382e7b5d0fc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.744565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed366953-205b-4a1e-88f4-3382e7b5d0fc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.748938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed366953-205b-4a1e-88f4-3382e7b5d0fc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.749477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed366953-205b-4a1e-88f4-3382e7b5d0fc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.015469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ed366953-205b-4a1e-88f4-3382e7b5d0fc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:26.026165 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ed366953-205b-4a1e-88f4-3382e7b5d0fc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1273 microversion: 2.1 time: 0.302913 Jul 20 04:23:26.037488 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1309/2815] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:25 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1273 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:27.055872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2f863a19-4252-4227-957d-5656fd7fa885 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:27.059553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2f863a19-4252-4227-957d-5656fd7fa885 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:27.079204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2f863a19-4252-4227-957d-5656fd7fa885 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.079892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2f863a19-4252-4227-957d-5656fd7fa885 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.081064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2f863a19-4252-4227-957d-5656fd7fa885 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.081750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2f863a19-4252-4227-957d-5656fd7fa885 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.227638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-03c7f976-e403-4d51-a477-6db5d3dafd66 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:27.255644 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-03c7f976-e403-4d51-a477-6db5d3dafd66 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1325 microversion: 2.1 time: 1.708708 Jul 20 04:23:27.266247 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1507/2816] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:25 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1325 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:27.380844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2f863a19-4252-4227-957d-5656fd7fa885 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:27.399613 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2f863a19-4252-4227-957d-5656fd7fa885 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1273 microversion: 2.1 time: 0.344533 Jul 20 04:23:27.410802 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1310/2817] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:27 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1273 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:28.286966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-98a8b247-cb58-4105-801b-81c08c43c986 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:28.288446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-98a8b247-cb58-4105-801b-81c08c43c986 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:28.293130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:28.329758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98a8b247-cb58-4105-801b-81c08c43c986 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.333432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98a8b247-cb58-4105-801b-81c08c43c986 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:28.344433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98a8b247-cb58-4105-801b-81c08c43c986 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.345318 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98a8b247-cb58-4105-801b-81c08c43c986 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:28.424713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6e51d283-bccd-41b8-b8da-257506419f33 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:28.425519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6e51d283-bccd-41b8-b8da-257506419f33 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:28.452001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e51d283-bccd-41b8-b8da-257506419f33 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.462223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e51d283-bccd-41b8-b8da-257506419f33 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:28.463459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e51d283-bccd-41b8-b8da-257506419f33 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.471885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e51d283-bccd-41b8-b8da-257506419f33 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.486282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-98a8b247-cb58-4105-801b-81c08c43c986 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:29.497487 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-98a8b247-cb58-4105-801b-81c08c43c986 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1325 microversion: 2.1 time: 1.215403 Jul 20 04:23:29.502462 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1508/2818] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:28 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1325 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:29.749608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6e51d283-bccd-41b8-b8da-257506419f33 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:29.759758 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6e51d283-bccd-41b8-b8da-257506419f33 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1315 microversion: 2.1 time: 1.340156 Jul 20 04:23:29.781036 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1311/2819] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:28 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1315 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:29.845567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c7f30d2d-0919-443f-b6a3-ecc019bf3e83 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Calling method '.version_select at 0x7f06be0def70>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:29.915694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG neutronclient.v2_0.client [None req-c7f30d2d-0919-443f-b6a3-ecc019bf3e83 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d1771d73-4410-4a3e-9ded-7cfcb9811c17 does not exist", "detail": ""}} {{(pid=127871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:23:29.916471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.security_group_api [None req-c7f30d2d-0919-443f-b6a3-ecc019bf3e83 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Neutron security group d1771d73-4410-4a3e-9ded-7cfcb9811c17 not found {{(pid=127871) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:23:29.917921 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-c7f30d2d-0919-443f-b6a3-ecc019bf3e83 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] HTTP exception thrown: Security group d1771d73-4410-4a3e-9ded-7cfcb9811c17 does not exist Jul 20 04:23:29.917921 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-27a66fac-565c-4747-8dfd-b7db0d046b78'] Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c7f30d2d-0919-443f-b6a3-ecc019bf3e83 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Request method failure captured: Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/os-security-groups/d1771d73-4410-4a3e-9ded-7cfcb9811c17 HTTP/1.1 Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14NAj8kWrRvrCuq3QYcnKc2_7VI_YszQyQo049rb5dV01WcqkzZwNCq3ai0AZ82qvFmTlJpKS31YMbg1LtI7ljJGD038o-r7-9v5dymSjppp3sBpyCvdL6jWuMcgJet2-D2kj47ytfYZHZ_iwxX2YjKMjkkRURfDTGVlgzZVxXNdIH4 Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 84fc442e3ab74b3b94719cbd11a49e82 Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-309299121 Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:23:29.920486 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:23:29.921911 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/84fc442e3ab74b3b94719cbd11a49e82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/84fc442e3ab74b3b94719cbd11a49e82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_84fc442e3ab74b3b94719cbd11a49e82", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/84fc442e3ab74b3b94719cbd11a49e82"}]}] Jul 20 04:23:29.921911 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-309299121 Jul 20 04:23:29.921911 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 84fc442e3ab74b3b94719cbd11a49e82 Jul 20 04:23:29.921911 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-309299121 Jul 20 04:23:29.921911 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-SecurityGroupsNegativeTestJSON-309299121-project Jul 20 04:23:29.921911 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:23:29.921911 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:23:29.921911 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 04b9edcdccd14844bd573e8643a5358e Jul 20 04:23:29.921911 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-309299121-project Jul 20 04:23:29.921911 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:23:29.921911 n-d-826526-5 devstack@n-api.service[127871]: exception: Security group d1771d73-4410-4a3e-9ded-7cfcb9811c17 does not exist Jul 20 04:23:29.921911 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-27a66fac-565c-4747-8dfd-b7db0d046b78'] Jul 20 04:23:29.921911 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'd1771d73-4410-4a3e-9ded-7cfcb9811c17'} Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:29.922894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:23:29.925700 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:23:29.925700 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:29.925700 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:29.925700 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:23:29.925700 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:23:29.925700 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:23:29.925700 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:23:29.925700 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d1771d73-4410-4a3e-9ded-7cfcb9811c17 does not exist Jul 20 04:23:29.925700 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27a66fac-565c-4747-8dfd-b7db0d046b78'] Jul 20 04:23:29.925700 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.925700 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:29.925700 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.925700 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:29.925700 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:23:29.925700 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:23:29.925700 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:23:29.925700 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:23:29.925700 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d1771d73-4410-4a3e-9ded-7cfcb9811c17 does not exist Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27a66fac-565c-4747-8dfd-b7db0d046b78'] Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d1771d73-4410-4a3e-9ded-7cfcb9811c17 does not exist Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27a66fac-565c-4747-8dfd-b7db0d046b78'] Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.928534 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:29.932964 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:29.932964 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:29.932964 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:29.932964 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:29.932964 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d1771d73-4410-4a3e-9ded-7cfcb9811c17 does not exist Jul 20 04:23:29.932964 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27a66fac-565c-4747-8dfd-b7db0d046b78'] Jul 20 04:23:29.932964 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.937804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c7f30d2d-0919-443f-b6a3-ecc019bf3e83 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Returning 404 to user: Security group d1771d73-4410-4a3e-9ded-7cfcb9811c17 does not exist Jul 20 04:23:29.937804 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-27a66fac-565c-4747-8dfd-b7db0d046b78'] {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:29.939357 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c7f30d2d-0919-443f-b6a3-ecc019bf3e83 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/d1771d73-4410-4a3e-9ded-7cfcb9811c17" status: 404 len: 194 microversion: 2.1 time: 0.433393 Jul 20 04:23:29.940100 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1509/2820] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:23:29 2022] DELETE /compute/v2.1/os-security-groups/d1771d73-4410-4a3e-9ded-7cfcb9811c17 => generated 194 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:29.954925 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bc1315a9-ed94-4eed-9a69-9f9eb9ac9778 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.007405 Jul 20 04:23:29.964112 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1312/2821] 10.222.0.17 () {58 vars in 1163 bytes} [Wed Jul 20 04:23:29 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:23:29.970418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-03a06f56-8478-4aa9-9f6b-f77006bc5363 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Calling method '.version_select at 0x7f06bd4278b0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:30.522562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ec99d93a-90c3-4241-8ef4-305ad4568655 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:30.523366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ec99d93a-90c3-4241-8ef4-305ad4568655 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:30.525928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:30.553771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec99d93a-90c3-4241-8ef4-305ad4568655 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:30.555950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec99d93a-90c3-4241-8ef4-305ad4568655 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:30.558857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec99d93a-90c3-4241-8ef4-305ad4568655 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:30.559356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec99d93a-90c3-4241-8ef4-305ad4568655 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:31.342245 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-03a06f56-8478-4aa9-9f6b-f77006bc5363 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.376314 Jul 20 04:23:31.343420 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1510/2822] 10.222.0.17 () {58 vars in 1157 bytes} [Wed Jul 20 04:23:29 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:31.350679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bad4e10e-091e-4412-8408-43b31a122b7a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:31.351898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bad4e10e-091e-4412-8408-43b31a122b7a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:31.368586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bad4e10e-091e-4412-8408-43b31a122b7a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:31.369048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bad4e10e-091e-4412-8408-43b31a122b7a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:31.376878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bad4e10e-091e-4412-8408-43b31a122b7a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:31.377481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bad4e10e-091e-4412-8408-43b31a122b7a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:32.115862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bad4e10e-091e-4412-8408-43b31a122b7a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:32.124048 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bad4e10e-091e-4412-8408-43b31a122b7a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1315 microversion: 2.1 time: 0.779383 Jul 20 04:23:32.140614 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1511/2823] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:31 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:32.147731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-0507358f-7769-45cd-8278-0dbd0e3073eb req-2d898660-ff61-425e-853e-21bff4a1ac06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8df11745-2849-4490-9cb7-11b948d90254", "tag": "beeb8d4b-1081-4e78-a7e5-cba7f17c9c54"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:32.160021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-0507358f-7769-45cd-8278-0dbd0e3073eb req-2d898660-ff61-425e-853e-21bff4a1ac06 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:32.161367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-0507358f-7769-45cd-8278-0dbd0e3073eb req-2d898660-ff61-425e-853e-21bff4a1ac06 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:32.181083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:32.184334 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-0507358f-7769-45cd-8278-0dbd0e3073eb req-2d898660-ff61-425e-853e-21bff4a1ac06 service nova] Creating event network-changed:beeb8d4b-1081-4e78-a7e5-cba7f17c9c54 for instance 8df11745-2849-4490-9cb7-11b948d90254 on n-h1-826526-5 Jul 20 04:23:32.204541 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-0507358f-7769-45cd-8278-0dbd0e3073eb req-2d898660-ff61-425e-853e-21bff4a1ac06 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062310 Jul 20 04:23:32.205769 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1512/2824] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:32.216777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ff05d8f3-53ae-42cf-a192-d7a9927f93a0 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Calling method '.version_select at 0x7f06c73b2a60>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:32.341722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ec99d93a-90c3-4241-8ef4-305ad4568655 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:32.353401 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ec99d93a-90c3-4241-8ef4-305ad4568655 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1325 microversion: 2.1 time: 1.834850 Jul 20 04:23:32.365318 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1313/2825] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:30 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1325 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:32.790792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=14 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:33.155207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f1dda13c-42e0-4c59-99be-ce53ad083037 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:33.156083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f1dda13c-42e0-4c59-99be-ce53ad083037 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:33.183870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1dda13c-42e0-4c59-99be-ce53ad083037 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:33.196042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1dda13c-42e0-4c59-99be-ce53ad083037 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:33.200746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1dda13c-42e0-4c59-99be-ce53ad083037 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:33.201550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1dda13c-42e0-4c59-99be-ce53ad083037 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:33.987120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG neutronclient.v2_0.client [None req-ff05d8f3-53ae-42cf-a192-d7a9927f93a0 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=127871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:23:33.989091 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-ff05d8f3-53ae-42cf-a192-d7a9927f93a0 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 20 04:23:33.989091 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-98ca5d7e-cb6a-4212-a487-fca06f0ec8f7'] Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ff05d8f3-53ae-42cf-a192-d7a9927f93a0 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Request method failure captured: Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/os-security-groups/a07c42da-4530-4e19-a5bc-7549ab393b88 HTTP/1.1 Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14NAj8kWrRvrCuq3QYcnKc2_7VI_YszQyQo049rb5dV01WcqkzZwNCq3ai0AZ82qvFmTlJpKS31YMbg1LtI7ljJGD038o-r7-9v5dymSjppp3sBpyCvdL6jWuMcgJet2-D2kj47ytfYZHZ_iwxX2YjKMjkkRURfDTGVlgzZVxXNdIH4 Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 84fc442e3ab74b3b94719cbd11a49e82 Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-309299121 Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:23:33.990230 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:23:33.992700 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/84fc442e3ab74b3b94719cbd11a49e82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/84fc442e3ab74b3b94719cbd11a49e82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_84fc442e3ab74b3b94719cbd11a49e82", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/84fc442e3ab74b3b94719cbd11a49e82"}]}] Jul 20 04:23:33.992700 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-309299121 Jul 20 04:23:33.992700 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 84fc442e3ab74b3b94719cbd11a49e82 Jul 20 04:23:33.992700 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-309299121 Jul 20 04:23:33.992700 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-SecurityGroupsNegativeTestJSON-309299121-project Jul 20 04:23:33.992700 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:23:33.992700 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:23:33.992700 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 04b9edcdccd14844bd573e8643a5358e Jul 20 04:23:33.992700 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-309299121-project Jul 20 04:23:33.992700 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:23:33.992700 n-d-826526-5 devstack@n-api.service[127871]: exception: Insufficient rights for removing default security group. Jul 20 04:23:33.992700 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-98ca5d7e-cb6a-4212-a487-fca06f0ec8f7'] Jul 20 04:23:33.992700 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'a07c42da-4530-4e19-a5bc-7549ab393b88'} Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:33.995734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98ca5d7e-cb6a-4212-a487-fca06f0ec8f7'] Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 20 04:23:33.999391 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98ca5d7e-cb6a-4212-a487-fca06f0ec8f7'] Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98ca5d7e-cb6a-4212-a487-fca06f0ec8f7'] Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:34.006864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:34.012218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:34.012218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:34.012218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:34.012218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 20 04:23:34.012218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98ca5d7e-cb6a-4212-a487-fca06f0ec8f7'] Jul 20 04:23:34.012218 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:34.012218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ff05d8f3-53ae-42cf-a192-d7a9927f93a0 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 20 04:23:34.012218 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-98ca5d7e-cb6a-4212-a487-fca06f0ec8f7'] {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:34.012218 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ff05d8f3-53ae-42cf-a192-d7a9927f93a0 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/a07c42da-4530-4e19-a5bc-7549ab393b88" status: 400 len: 182 microversion: 2.1 time: 1.785212 Jul 20 04:23:34.012218 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1513/2826] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:23:32 2022] DELETE /compute/v2.1/os-security-groups/a07c42da-4530-4e19-a5bc-7549ab393b88 => generated 182 bytes in 1787 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:23:34.189247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f1dda13c-42e0-4c59-99be-ce53ad083037 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:34.210354 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f1dda13c-42e0-4c59-99be-ce53ad083037 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1315 microversion: 2.1 time: 1.066756 Jul 20 04:23:34.211348 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1314/2827] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:33 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1315 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:34.221981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-52c0414b-dde0-445f-891d-c6b4dd532f2f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:34.222600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-52c0414b-dde0-445f-891d-c6b4dd532f2f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:34.258123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52c0414b-dde0-445f-891d-c6b4dd532f2f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.258578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52c0414b-dde0-445f-891d-c6b4dd532f2f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:34.259732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52c0414b-dde0-445f-891d-c6b4dd532f2f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.260161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52c0414b-dde0-445f-891d-c6b4dd532f2f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:34.284347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ba5f984a-31d3-4512-8caf-73b45f751fc2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-330558740", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:34.388709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-ba5f984a-31d3-4512-8caf-73b45f751fc2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:23:34.772826 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-52c0414b-dde0-445f-891d-c6b4dd532f2f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:34.780840 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-52c0414b-dde0-445f-891d-c6b4dd532f2f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1325 microversion: 2.1 time: 0.568288 Jul 20 04:23:34.791742 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1315/2828] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:34 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1325 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:34.797738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-15a496dd-1897-46f5-8347-7d63d415daa7 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Calling method '.version_select at 0x7f06be0629d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:34.937631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ba5f984a-31d3-4512-8caf-73b45f751fc2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:23:34.938816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ba5f984a-31d3-4512-8caf-73b45f751fc2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:23:34.939482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ba5f984a-31d3-4512-8caf-73b45f751fc2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:23:34.940040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ba5f984a-31d3-4512-8caf-73b45f751fc2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:23:34.940610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ba5f984a-31d3-4512-8caf-73b45f751fc2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:23:34.964557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba5f984a-31d3-4512-8caf-73b45f751fc2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.965255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba5f984a-31d3-4512-8caf-73b45f751fc2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:34.966293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba5f984a-31d3-4512-8caf-73b45f751fc2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.966887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba5f984a-31d3-4512-8caf-73b45f751fc2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:35.021816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-ba5f984a-31d3-4512-8caf-73b45f751fc2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Getting quotas for project 1b71d158148441319721ea98ef6f799d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:35.057106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-ba5f984a-31d3-4512-8caf-73b45f751fc2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Getting quotas for user 953c7e68040540c2b46a2d5a79fd60d0 and project 1b71d158148441319721ea98ef6f799d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:35.080781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ba5f984a-31d3-4512-8caf-73b45f751fc2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:23:35.083923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ba5f984a-31d3-4512-8caf-73b45f751fc2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:23:35.201444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG neutronclient.v2_0.client [None req-15a496dd-1897-46f5-8347-7d63d415daa7 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 96d7b3e2-b160-4403-b1b4-f1f7d4948649 does not exist", "detail": ""}} {{(pid=127870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:23:35.202327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.security_group_api [None req-15a496dd-1897-46f5-8347-7d63d415daa7 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Neutron security group 96d7b3e2-b160-4403-b1b4-f1f7d4948649 not found {{(pid=127870) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:23:35.203053 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-15a496dd-1897-46f5-8347-7d63d415daa7 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] HTTP exception thrown: Security group 96d7b3e2-b160-4403-b1b4-f1f7d4948649 does not exist Jul 20 04:23:35.203053 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-f88a219e-c050-4251-9970-cb1642a6f7d9'] Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-15a496dd-1897-46f5-8347-7d63d415daa7 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Request method failure captured: Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/os-security-groups/96d7b3e2-b160-4403-b1b4-f1f7d4948649 HTTP/1.1 Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14NAj8kWrRvrCuq3QYcnKc2_7VI_YszQyQo049rb5dV01WcqkzZwNCq3ai0AZ82qvFmTlJpKS31YMbg1LtI7ljJGD038o-r7-9v5dymSjppp3sBpyCvdL6jWuMcgJet2-D2kj47ytfYZHZ_iwxX2YjKMjkkRURfDTGVlgzZVxXNdIH4 Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 84fc442e3ab74b3b94719cbd11a49e82 Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-309299121 Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:23:35.209266 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:23:35.211070 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/84fc442e3ab74b3b94719cbd11a49e82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/84fc442e3ab74b3b94719cbd11a49e82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_84fc442e3ab74b3b94719cbd11a49e82", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/84fc442e3ab74b3b94719cbd11a49e82"}]}] Jul 20 04:23:35.211070 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-309299121 Jul 20 04:23:35.211070 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 84fc442e3ab74b3b94719cbd11a49e82 Jul 20 04:23:35.211070 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-309299121 Jul 20 04:23:35.211070 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-SecurityGroupsNegativeTestJSON-309299121-project Jul 20 04:23:35.211070 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:23:35.211070 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:23:35.211070 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 04b9edcdccd14844bd573e8643a5358e Jul 20 04:23:35.211070 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-309299121-project Jul 20 04:23:35.211070 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:23:35.211070 n-d-826526-5 devstack@n-api.service[127870]: exception: Security group 96d7b3e2-b160-4403-b1b4-f1f7d4948649 does not exist Jul 20 04:23:35.211070 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-f88a219e-c050-4251-9970-cb1642a6f7d9'] Jul 20 04:23:35.211070 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '96d7b3e2-b160-4403-b1b4-f1f7d4948649'} Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:35.212115 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:23:35.213694 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:23:35.213694 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:35.213694 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:35.213694 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:23:35.213694 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:23:35.213694 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:23:35.213694 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:23:35.213694 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 96d7b3e2-b160-4403-b1b4-f1f7d4948649 does not exist Jul 20 04:23:35.213694 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f88a219e-c050-4251-9970-cb1642a6f7d9'] Jul 20 04:23:35.213694 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:35.213694 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:35.213694 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:35.213694 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:35.213694 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:23:35.213694 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:23:35.213694 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:23:35.213694 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:23:35.213694 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 96d7b3e2-b160-4403-b1b4-f1f7d4948649 does not exist Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f88a219e-c050-4251-9970-cb1642a6f7d9'] Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 96d7b3e2-b160-4403-b1b4-f1f7d4948649 does not exist Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f88a219e-c050-4251-9970-cb1642a6f7d9'] Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:35.215074 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:35.216802 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:35.216802 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:35.216802 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:35.216802 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:35.216802 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 96d7b3e2-b160-4403-b1b4-f1f7d4948649 does not exist Jul 20 04:23:35.216802 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f88a219e-c050-4251-9970-cb1642a6f7d9'] Jul 20 04:23:35.216802 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:35.227205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-15a496dd-1897-46f5-8347-7d63d415daa7 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Returning 404 to user: Security group 96d7b3e2-b160-4403-b1b4-f1f7d4948649 does not exist Jul 20 04:23:35.227205 n-d-826526-5 devstack@n-api.service[127870]: Neutron server returns request_ids: ['req-f88a219e-c050-4251-9970-cb1642a6f7d9'] {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:35.229569 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-15a496dd-1897-46f5-8347-7d63d415daa7 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/96d7b3e2-b160-4403-b1b4-f1f7d4948649" status: 404 len: 194 microversion: 2.1 time: 0.436487 Jul 20 04:23:35.237126 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ba5f984a-31d3-4512-8caf-73b45f751fc2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.242539 Jul 20 04:23:35.239479 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1514/2829] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:23:35.241143 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1316/2830] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 04:23:34 2022] GET /compute/v2.1/os-security-groups/96d7b3e2-b160-4403-b1b4-f1f7d4948649 => generated 194 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:35.249372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-5e8f3837-3675-440b-9c87-a1ffc6887b31 req-4434bf69-7159-48a0-8fc0-32bac8579bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea2e899-5a11-4761-b515-230f5e741f57", "tag": "d6467d6e-c88d-404a-a93d-4ac41190e056"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:35.255396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-48b1dc2d-c78a-4137-8000-4b9e532aee29 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:35.256433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-48b1dc2d-c78a-4137-8000-4b9e532aee29 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:35.271019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5e8f3837-3675-440b-9c87-a1ffc6887b31 req-4434bf69-7159-48a0-8fc0-32bac8579bd2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:35.272051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5e8f3837-3675-440b-9c87-a1ffc6887b31 req-4434bf69-7159-48a0-8fc0-32bac8579bd2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:35.292132 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-5e8f3837-3675-440b-9c87-a1ffc6887b31 req-4434bf69-7159-48a0-8fc0-32bac8579bd2 service nova] Creating event network-changed:d6467d6e-c88d-404a-a93d-4ac41190e056 for instance eea2e899-5a11-4761-b515-230f5e741f57 on n-h2-826526-5 Jul 20 04:23:35.297997 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-5e8f3837-3675-440b-9c87-a1ffc6887b31 req-4434bf69-7159-48a0-8fc0-32bac8579bd2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056304 Jul 20 04:23:35.299316 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1515/2831] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:35.309439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cc336f7a-7368-4fd0-8215-c0b4ad9f3ac6 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Action: 'update', calling method: .version_select at 0x7f06c7350280>, body: {"security_group": {"name": "tempest-sg-575763600", "description": "tempest-description-1467798675"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:35.309707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b1dc2d-c78a-4137-8000-4b9e532aee29 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:35.313366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b1dc2d-c78a-4137-8000-4b9e532aee29 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:35.317625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b1dc2d-c78a-4137-8000-4b9e532aee29 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:35.318121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b1dc2d-c78a-4137-8000-4b9e532aee29 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:35.530113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG neutronclient.v2_0.client [None req-cc336f7a-7368-4fd0-8215-c0b4ad9f3ac6 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 24f97648-e057-4ec8-b8a2-0faf97db6c65 does not exist", "detail": ""}} {{(pid=127871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:23:35.531067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.security_group_api [None req-cc336f7a-7368-4fd0-8215-c0b4ad9f3ac6 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Neutron security group 24f97648-e057-4ec8-b8a2-0faf97db6c65 not found {{(pid=127871) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:23:35.531775 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-cc336f7a-7368-4fd0-8215-c0b4ad9f3ac6 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] HTTP exception thrown: Security group 24f97648-e057-4ec8-b8a2-0faf97db6c65 does not exist Jul 20 04:23:35.531775 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-ebecb73c-f343-4b39-b197-4678181e7738'] Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cc336f7a-7368-4fd0-8215-c0b4ad9f3ac6 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Request method failure captured: Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: request: PUT /compute/v2.1/os-security-groups/24f97648-e057-4ec8-b8a2-0faf97db6c65 HTTP/1.1 Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 101 Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14NAj8kWrRvrCuq3QYcnKc2_7VI_YszQyQo049rb5dV01WcqkzZwNCq3ai0AZ82qvFmTlJpKS31YMbg1LtI7ljJGD038o-r7-9v5dymSjppp3sBpyCvdL6jWuMcgJet2-D2kj47ytfYZHZ_iwxX2YjKMjkkRURfDTGVlgzZVxXNdIH4 Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 84fc442e3ab74b3b94719cbd11a49e82 Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-309299121 Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:23:35.534624 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:23:35.540128 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/84fc442e3ab74b3b94719cbd11a49e82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/84fc442e3ab74b3b94719cbd11a49e82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_84fc442e3ab74b3b94719cbd11a49e82", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/84fc442e3ab74b3b94719cbd11a49e82"}]}] Jul 20 04:23:35.540128 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-309299121 Jul 20 04:23:35.540128 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 84fc442e3ab74b3b94719cbd11a49e82 Jul 20 04:23:35.540128 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-309299121 Jul 20 04:23:35.540128 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-SecurityGroupsNegativeTestJSON-309299121-project Jul 20 04:23:35.540128 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:23:35.540128 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:23:35.540128 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 04b9edcdccd14844bd573e8643a5358e Jul 20 04:23:35.540128 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-309299121-project Jul 20 04:23:35.540128 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:23:35.540128 n-d-826526-5 devstack@n-api.service[127871]: {"security_group": {"name": "tempest-sg-575763600", "description": "tempest-description-1467798675"}} Jul 20 04:23:35.540128 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:23:35.540128 n-d-826526-5 devstack@n-api.service[127871]: exception: Security group 24f97648-e057-4ec8-b8a2-0faf97db6c65 does not exist Jul 20 04:23:35.543734 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-ebecb73c-f343-4b39-b197-4678181e7738'] Jul 20 04:23:35.543734 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '24f97648-e057-4ec8-b8a2-0faf97db6c65', 'body': {'security_group': {'name': 'tempest-sg-575763600', 'description': 'tempest-description-1467798675'}}} Jul 20 04:23:35.543734 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:35.543734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:35.543734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:23:35.543734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:23:35.543734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:35.543734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:35.543734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:23:35.543734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:23:35.543734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:35.543734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:35.543734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:23:35.543734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:23:35.543734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:35.543734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:35.543734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:23:35.543734 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 24f97648-e057-4ec8-b8a2-0faf97db6c65 does not exist Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebecb73c-f343-4b39-b197-4678181e7738'] Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:23:35.547500 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 24f97648-e057-4ec8-b8a2-0faf97db6c65 does not exist Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebecb73c-f343-4b39-b197-4678181e7738'] Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 24f97648-e057-4ec8-b8a2-0faf97db6c65 does not exist Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebecb73c-f343-4b39-b197-4678181e7738'] Jul 20 04:23:35.552869 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:35.558628 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:35.558628 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:35.558628 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:35.558628 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:35.558628 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:35.558628 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:35.558628 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:35.558628 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 24f97648-e057-4ec8-b8a2-0faf97db6c65 does not exist Jul 20 04:23:35.558628 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebecb73c-f343-4b39-b197-4678181e7738'] Jul 20 04:23:35.558628 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:23:35.558628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cc336f7a-7368-4fd0-8215-c0b4ad9f3ac6 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] Returning 404 to user: Security group 24f97648-e057-4ec8-b8a2-0faf97db6c65 does not exist Jul 20 04:23:35.558628 n-d-826526-5 devstack@n-api.service[127871]: Neutron server returns request_ids: ['req-ebecb73c-f343-4b39-b197-4678181e7738'] {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:35.558628 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cc336f7a-7368-4fd0-8215-c0b4ad9f3ac6 tempest-SecurityGroupsNegativeTestJSON-309299121 tempest-SecurityGroupsNegativeTestJSON-309299121-project] 10.222.0.17 "PUT /compute/v2.1/os-security-groups/24f97648-e057-4ec8-b8a2-0faf97db6c65" status: 404 len: 194 microversion: 2.1 time: 0.236041 Jul 20 04:23:35.562488 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1516/2832] 10.222.0.17 () {60 vars in 1289 bytes} [Wed Jul 20 04:23:35 2022] PUT /compute/v2.1/os-security-groups/24f97648-e057-4ec8-b8a2-0faf97db6c65 => generated 194 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:35.562488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1b1ccc97-d9b8-46c4-a4ed-daf4374bb7db tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:35.562488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1b1ccc97-d9b8-46c4-a4ed-daf4374bb7db tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:35.760019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1b1ccc97-d9b8-46c4-a4ed-daf4374bb7db tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:35.776332 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1b1ccc97-d9b8-46c4-a4ed-daf4374bb7db tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 200 len: 1221 microversion: 2.1 time: 0.230605 Jul 20 04:23:35.781197 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1517/2833] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:35 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 1221 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:35.800090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e0ee29b8-c6a7-47c4-be6c-f6df1ee922c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:35.801423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e0ee29b8-c6a7-47c4-be6c-f6df1ee922c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:35.813791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0ee29b8-c6a7-47c4-be6c-f6df1ee922c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:35.816929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0ee29b8-c6a7-47c4-be6c-f6df1ee922c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:35.818808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0ee29b8-c6a7-47c4-be6c-f6df1ee922c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:35.820552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0ee29b8-c6a7-47c4-be6c-f6df1ee922c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.446738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-48b1dc2d-c78a-4137-8000-4b9e532aee29 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:36.455491 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-48b1dc2d-c78a-4137-8000-4b9e532aee29 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1315 microversion: 2.1 time: 1.213125 Jul 20 04:23:36.461035 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1317/2834] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:35 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1315 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:36.797366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-49f3051a-028b-448b-b549-cefe007019e6 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:36.798171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-49f3051a-028b-448b-b549-cefe007019e6 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:36.809890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e0ee29b8-c6a7-47c4-be6c-f6df1ee922c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:36.819301 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e0ee29b8-c6a7-47c4-be6c-f6df1ee922c4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1325 microversion: 2.1 time: 1.024242 Jul 20 04:23:36.822827 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1518/2835] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:35 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1325 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:36.825534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49f3051a-028b-448b-b549-cefe007019e6 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.826761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49f3051a-028b-448b-b549-cefe007019e6 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.829634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49f3051a-028b-448b-b549-cefe007019e6 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.832900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49f3051a-028b-448b-b549-cefe007019e6 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.435131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-49f3051a-028b-448b-b549-cefe007019e6 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:37.458521 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-49f3051a-028b-448b-b549-cefe007019e6 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 200 len: 1281 microversion: 2.1 time: 0.664211 Jul 20 04:23:37.465119 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1318/2836] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:36 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 1281 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:37.479753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6fd349aa-7045-4051-a692-856a8f769a90 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.480834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6fd349aa-7045-4051-a692-856a8f769a90 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:37.493340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6fd349aa-7045-4051-a692-856a8f769a90 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.496510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6fd349aa-7045-4051-a692-856a8f769a90 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.498084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6fd349aa-7045-4051-a692-856a8f769a90 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.502756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6fd349aa-7045-4051-a692-856a8f769a90 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.845528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5197c3e4-cf12-4032-b2d4-91dafe936f98 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.846420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5197c3e4-cf12-4032-b2d4-91dafe936f98 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:37.858521 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5197c3e4-cf12-4032-b2d4-91dafe936f98 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.865870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5197c3e4-cf12-4032-b2d4-91dafe936f98 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.866984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5197c3e4-cf12-4032-b2d4-91dafe936f98 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.867567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5197c3e4-cf12-4032-b2d4-91dafe936f98 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:38.370663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5197c3e4-cf12-4032-b2d4-91dafe936f98 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:38.390884 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5197c3e4-cf12-4032-b2d4-91dafe936f98 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1325 microversion: 2.1 time: 0.548480 Jul 20 04:23:38.391723 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1319/2837] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:37 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1325 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:38.484412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-12c9d14f-bb74-4278-949c-0db3eb38d801 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:38.488086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-12c9d14f-bb74-4278-949c-0db3eb38d801 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:38.510048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12c9d14f-bb74-4278-949c-0db3eb38d801 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:38.511866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12c9d14f-bb74-4278-949c-0db3eb38d801 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:38.514906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12c9d14f-bb74-4278-949c-0db3eb38d801 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:38.518097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12c9d14f-bb74-4278-949c-0db3eb38d801 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:38.785677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-12c9d14f-bb74-4278-949c-0db3eb38d801 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:38.801128 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-12c9d14f-bb74-4278-949c-0db3eb38d801 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 200 len: 1279 microversion: 2.1 time: 0.322120 Jul 20 04:23:38.802339 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1320/2838] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:38 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 1279 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:38.806270 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6fd349aa-7045-4051-a692-856a8f769a90 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:38.856405 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6fd349aa-7045-4051-a692-856a8f769a90 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1315 microversion: 2.1 time: 1.380372 Jul 20 04:23:38.868309 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1519/2839] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:37 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1315 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:39.412625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9d476602-6d3d-42ee-ab0a-a885fad53d71 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:39.413258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9d476602-6d3d-42ee-ab0a-a885fad53d71 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:39.429754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d476602-6d3d-42ee-ab0a-a885fad53d71 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:39.429954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d476602-6d3d-42ee-ab0a-a885fad53d71 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.430719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d476602-6d3d-42ee-ab0a-a885fad53d71 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:39.437899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d476602-6d3d-42ee-ab0a-a885fad53d71 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.451875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:39.821071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9913bc1e-d7e0-48c4-ba75-dbdf818679ef tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:39.821836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9913bc1e-d7e0-48c4-ba75-dbdf818679ef tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:39.843914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9913bc1e-d7e0-48c4-ba75-dbdf818679ef tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:39.843914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9913bc1e-d7e0-48c4-ba75-dbdf818679ef tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.843914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9913bc1e-d7e0-48c4-ba75-dbdf818679ef tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:39.843914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9913bc1e-d7e0-48c4-ba75-dbdf818679ef tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.967362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=75 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:40.212005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9913bc1e-d7e0-48c4-ba75-dbdf818679ef tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:40.228424 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9913bc1e-d7e0-48c4-ba75-dbdf818679ef tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 200 len: 1279 microversion: 2.1 time: 0.413120 Jul 20 04:23:40.249061 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1520/2840] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:39 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 1279 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:40.265765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3f71b51d-cbaf-468b-aa7c-22048b3ab40f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:40.271096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3f71b51d-cbaf-468b-aa7c-22048b3ab40f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:40.293300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f71b51d-cbaf-468b-aa7c-22048b3ab40f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.298871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f71b51d-cbaf-468b-aa7c-22048b3ab40f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:40.300010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f71b51d-cbaf-468b-aa7c-22048b3ab40f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.300629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f71b51d-cbaf-468b-aa7c-22048b3ab40f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.079639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9d476602-6d3d-42ee-ab0a-a885fad53d71 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:41.098983 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9d476602-6d3d-42ee-ab0a-a885fad53d71 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1325 microversion: 2.1 time: 1.690886 Jul 20 04:23:41.105514 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1321/2841] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:39 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1325 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:41.249223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3f71b51d-cbaf-468b-aa7c-22048b3ab40f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:41.255793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7415d066-66cc-4a89-a6c9-d7a98efe13d3 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:41.256674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7415d066-66cc-4a89-a6c9-d7a98efe13d3 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:41.272546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7415d066-66cc-4a89-a6c9-d7a98efe13d3 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.273178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7415d066-66cc-4a89-a6c9-d7a98efe13d3 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.274249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7415d066-66cc-4a89-a6c9-d7a98efe13d3 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.274936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7415d066-66cc-4a89-a6c9-d7a98efe13d3 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.285818 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3f71b51d-cbaf-468b-aa7c-22048b3ab40f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1315 microversion: 2.1 time: 1.029987 Jul 20 04:23:41.290555 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1521/2842] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:40 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1315 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:41.477883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7415d066-66cc-4a89-a6c9-d7a98efe13d3 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:41.489955 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7415d066-66cc-4a89-a6c9-d7a98efe13d3 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 200 len: 1279 microversion: 2.1 time: 0.242019 Jul 20 04:23:41.496610 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1322/2843] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:41 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:42.141825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b30f096e-cf48-43e8-aed4-618f90864613 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:42.142857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b30f096e-cf48-43e8-aed4-618f90864613 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:42.153008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b30f096e-cf48-43e8-aed4-618f90864613 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.156303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b30f096e-cf48-43e8-aed4-618f90864613 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.158519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b30f096e-cf48-43e8-aed4-618f90864613 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.159766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b30f096e-cf48-43e8-aed4-618f90864613 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.308834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bb361544-208c-4137-b6f2-519eba410181 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:42.310536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bb361544-208c-4137-b6f2-519eba410181 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:42.331288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb361544-208c-4137-b6f2-519eba410181 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.331669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb361544-208c-4137-b6f2-519eba410181 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.338697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb361544-208c-4137-b6f2-519eba410181 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.340296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb361544-208c-4137-b6f2-519eba410181 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.670559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b30f096e-cf48-43e8-aed4-618f90864613 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:42.731453 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b30f096e-cf48-43e8-aed4-618f90864613 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1325 microversion: 2.1 time: 0.599219 Jul 20 04:23:42.731988 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1522/2844] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:42 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1325 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:42.747561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a7bf83ff-29e6-4c79-9439-97fc5edb3874 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:42.748426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a7bf83ff-29e6-4c79-9439-97fc5edb3874 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:42.762472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7bf83ff-29e6-4c79-9439-97fc5edb3874 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.763338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7bf83ff-29e6-4c79-9439-97fc5edb3874 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.764560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7bf83ff-29e6-4c79-9439-97fc5edb3874 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.765260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7bf83ff-29e6-4c79-9439-97fc5edb3874 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:43.334414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bb361544-208c-4137-b6f2-519eba410181 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:43.356066 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bb361544-208c-4137-b6f2-519eba410181 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1315 microversion: 2.1 time: 1.056060 Jul 20 04:23:43.364655 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1323/2845] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:42 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1315 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:43.752820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-448cd63d-41a0-402a-9bde-fd60598ef548 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:43.753655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-448cd63d-41a0-402a-9bde-fd60598ef548 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:43.770579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-448cd63d-41a0-402a-9bde-fd60598ef548 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:43.771234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-448cd63d-41a0-402a-9bde-fd60598ef548 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:43.775799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-448cd63d-41a0-402a-9bde-fd60598ef548 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:43.776433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-448cd63d-41a0-402a-9bde-fd60598ef548 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:44.395989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-448cd63d-41a0-402a-9bde-fd60598ef548 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:44.411344 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-448cd63d-41a0-402a-9bde-fd60598ef548 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1325 microversion: 2.1 time: 0.662415 Jul 20 04:23:44.421665 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1324/2846] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:43 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1325 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:44.428999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a291050b-fe43-443a-ab04-3298600af0a1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:44.429686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a291050b-fe43-443a-ab04-3298600af0a1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:44.453388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a291050b-fe43-443a-ab04-3298600af0a1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:44.458285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a291050b-fe43-443a-ab04-3298600af0a1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:44.459454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a291050b-fe43-443a-ab04-3298600af0a1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:44.460081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a291050b-fe43-443a-ab04-3298600af0a1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:44.530249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a7bf83ff-29e6-4c79-9439-97fc5edb3874 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:44.542522 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a7bf83ff-29e6-4c79-9439-97fc5edb3874 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 200 len: 1321 microversion: 2.1 time: 1.808972 Jul 20 04:23:44.551062 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1523/2847] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:42 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 1321 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:44.735506 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a291050b-fe43-443a-ab04-3298600af0a1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:44.750875 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a291050b-fe43-443a-ab04-3298600af0a1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1315 microversion: 2.1 time: 0.327946 Jul 20 04:23:44.758718 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1325/2848] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:44 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:45.429466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0b0cad61-11ef-4f9b-bfb7-042961224253 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:45.430531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0b0cad61-11ef-4f9b-bfb7-042961224253 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:45.437674 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:45.448381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b0cad61-11ef-4f9b-bfb7-042961224253 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:45.449254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b0cad61-11ef-4f9b-bfb7-042961224253 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:45.450314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b0cad61-11ef-4f9b-bfb7-042961224253 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:45.450997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b0cad61-11ef-4f9b-bfb7-042961224253 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:45.568552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a38fbc28-f5d5-4014-adce-5522a18e756e tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:45.569833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a38fbc28-f5d5-4014-adce-5522a18e756e tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:45.584119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a38fbc28-f5d5-4014-adce-5522a18e756e tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:45.586323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a38fbc28-f5d5-4014-adce-5522a18e756e tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:45.588015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a38fbc28-f5d5-4014-adce-5522a18e756e tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:45.589633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a38fbc28-f5d5-4014-adce-5522a18e756e tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:45.765531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=8 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:46.134128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0b0cad61-11ef-4f9b-bfb7-042961224253 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:46.142366 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0b0cad61-11ef-4f9b-bfb7-042961224253 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1325 microversion: 2.1 time: 0.716662 Jul 20 04:23:46.156731 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1524/2849] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:45 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1325 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:46.180356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e5a84d7f-14ff-4f22-afd0-363e11f10019 req-0659d051-9dc0-4983-94ad-f663e25e7742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df11745-2849-4490-9cb7-11b948d90254", "name": "network-vif-plugged", "status": "completed", "tag": "beeb8d4b-1081-4e78-a7e5-cba7f17c9c54"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:46.202880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e5a84d7f-14ff-4f22-afd0-363e11f10019 req-0659d051-9dc0-4983-94ad-f663e25e7742 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:46.203473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e5a84d7f-14ff-4f22-afd0-363e11f10019 req-0659d051-9dc0-4983-94ad-f663e25e7742 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:46.234968 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e5a84d7f-14ff-4f22-afd0-363e11f10019 req-0659d051-9dc0-4983-94ad-f663e25e7742 service nova] Creating event network-vif-plugged:beeb8d4b-1081-4e78-a7e5-cba7f17c9c54 for instance 8df11745-2849-4490-9cb7-11b948d90254 on n-h1-826526-5 Jul 20 04:23:46.243375 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e5a84d7f-14ff-4f22-afd0-363e11f10019 req-0659d051-9dc0-4983-94ad-f663e25e7742 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084802 Jul 20 04:23:46.244458 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1525/2850] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:46.249663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e98efc41-c1f9-464e-a5b3-c69c9d3fd7b3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:46.254539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e98efc41-c1f9-464e-a5b3-c69c9d3fd7b3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:46.269147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e98efc41-c1f9-464e-a5b3-c69c9d3fd7b3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:46.270031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e98efc41-c1f9-464e-a5b3-c69c9d3fd7b3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:46.271239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e98efc41-c1f9-464e-a5b3-c69c9d3fd7b3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:46.277011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e98efc41-c1f9-464e-a5b3-c69c9d3fd7b3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:46.369972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a38fbc28-f5d5-4014-adce-5522a18e756e tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:46.382838 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a38fbc28-f5d5-4014-adce-5522a18e756e tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 200 len: 1321 microversion: 2.1 time: 0.814941 Jul 20 04:23:46.383910 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1326/2851] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:45 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 1321 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:46.837518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e98efc41-c1f9-464e-a5b3-c69c9d3fd7b3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:46.873808 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e98efc41-c1f9-464e-a5b3-c69c9d3fd7b3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1315 microversion: 2.1 time: 0.627635 Jul 20 04:23:46.874801 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1526/2852] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:46 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:47.172059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4a7f1cdc-a17f-44aa-82eb-34ff570d4455 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:47.173255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4a7f1cdc-a17f-44aa-82eb-34ff570d4455 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:47.185924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a7f1cdc-a17f-44aa-82eb-34ff570d4455 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.186600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a7f1cdc-a17f-44aa-82eb-34ff570d4455 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.193443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a7f1cdc-a17f-44aa-82eb-34ff570d4455 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.194214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a7f1cdc-a17f-44aa-82eb-34ff570d4455 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.401294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-68d1532a-d7e6-4988-b0a7-a5555c057ed9 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:47.402111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-68d1532a-d7e6-4988-b0a7-a5555c057ed9 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:47.410793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68d1532a-d7e6-4988-b0a7-a5555c057ed9 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.411240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68d1532a-d7e6-4988-b0a7-a5555c057ed9 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.415600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68d1532a-d7e6-4988-b0a7-a5555c057ed9 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.416135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68d1532a-d7e6-4988-b0a7-a5555c057ed9 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:48.227900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4a7f1cdc-a17f-44aa-82eb-34ff570d4455 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:48.241011 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4a7f1cdc-a17f-44aa-82eb-34ff570d4455 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1325 microversion: 2.1 time: 1.072911 Jul 20 04:23:48.245826 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1327/2853] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:47 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1325 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:48.264790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-2c4e433d-ea2a-432f-9120-453d4ee75e7f req-fc8c4b25-0332-4fc8-9a00-b5b545333b52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eb30445-55ef-4283-affc-ae1b7533b9ce", "tag": "62519a2b-711d-43b9-bf4e-2422facec33e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:48.286638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:48.289188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2c4e433d-ea2a-432f-9120-453d4ee75e7f req-fc8c4b25-0332-4fc8-9a00-b5b545333b52 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:48.289561 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2c4e433d-ea2a-432f-9120-453d4ee75e7f req-fc8c4b25-0332-4fc8-9a00-b5b545333b52 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:48.319651 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-2c4e433d-ea2a-432f-9120-453d4ee75e7f req-fc8c4b25-0332-4fc8-9a00-b5b545333b52 service nova] Creating event network-changed:62519a2b-711d-43b9-bf4e-2422facec33e for instance 8eb30445-55ef-4283-affc-ae1b7533b9ce on n-h1-826526-5 Jul 20 04:23:48.326108 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-2c4e433d-ea2a-432f-9120-453d4ee75e7f req-fc8c4b25-0332-4fc8-9a00-b5b545333b52 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078737 Jul 20 04:23:48.327463 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1328/2854] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:48.333513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-76956b0d-925e-40b7-bc13-bf2eeae04129 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:48.334565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-76956b0d-925e-40b7-bc13-bf2eeae04129 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:48.342884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76956b0d-925e-40b7-bc13-bf2eeae04129 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:48.343619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76956b0d-925e-40b7-bc13-bf2eeae04129 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:48.344638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76956b0d-925e-40b7-bc13-bf2eeae04129 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:48.345408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76956b0d-925e-40b7-bc13-bf2eeae04129 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:48.585454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-68d1532a-d7e6-4988-b0a7-a5555c057ed9 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:48.593833 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-68d1532a-d7e6-4988-b0a7-a5555c057ed9 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 200 len: 1321 microversion: 2.1 time: 1.196613 Jul 20 04:23:48.597745 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1527/2855] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:47 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 1321 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:49.238983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-76956b0d-925e-40b7-bc13-bf2eeae04129 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:49.253017 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-76956b0d-925e-40b7-bc13-bf2eeae04129 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1315 microversion: 2.1 time: 0.923870 Jul 20 04:23:49.259759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-18132722-22b4-4ab4-b601-af9ef7614865 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:49.260428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-18132722-22b4-4ab4-b601-af9ef7614865 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:49.262259 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1329/2856] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:48 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1315 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:49.273445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-18132722-22b4-4ab4-b601-af9ef7614865 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.274344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-18132722-22b4-4ab4-b601-af9ef7614865 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.275331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-18132722-22b4-4ab4-b601-af9ef7614865 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.278212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-18132722-22b4-4ab4-b601-af9ef7614865 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.580338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-19df275c-b36e-4859-91ed-a95745bf16f1 req-82a46008-7fe5-4edd-80b4-0360af839dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea2e899-5a11-4761-b515-230f5e741f57", "name": "network-vif-plugged", "status": "completed", "tag": "d6467d6e-c88d-404a-a93d-4ac41190e056"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:49.594308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-19df275c-b36e-4859-91ed-a95745bf16f1 req-82a46008-7fe5-4edd-80b4-0360af839dcc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.604233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-19df275c-b36e-4859-91ed-a95745bf16f1 req-82a46008-7fe5-4edd-80b4-0360af839dcc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.634151 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-19df275c-b36e-4859-91ed-a95745bf16f1 req-82a46008-7fe5-4edd-80b4-0360af839dcc service nova] Creating event network-vif-plugged:d6467d6e-c88d-404a-a93d-4ac41190e056 for instance eea2e899-5a11-4761-b515-230f5e741f57 on n-h2-826526-5 Jul 20 04:23:49.651019 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-19df275c-b36e-4859-91ed-a95745bf16f1 req-82a46008-7fe5-4edd-80b4-0360af839dcc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073182 Jul 20 04:23:49.656036 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1330/2857] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:23:49.681077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4d1ebc6a-c023-45b6-b42d-8cc498c0a02b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:49.685128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4d1ebc6a-c023-45b6-b42d-8cc498c0a02b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:49.711775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d1ebc6a-c023-45b6-b42d-8cc498c0a02b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.712232 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d1ebc6a-c023-45b6-b42d-8cc498c0a02b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.717695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d1ebc6a-c023-45b6-b42d-8cc498c0a02b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.718997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d1ebc6a-c023-45b6-b42d-8cc498c0a02b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:50.408242 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-18132722-22b4-4ab4-b601-af9ef7614865 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:50.420808 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-18132722-22b4-4ab4-b601-af9ef7614865 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1521 microversion: 2.1 time: 1.162473 Jul 20 04:23:50.422807 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1528/2858] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:49 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1521 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:50.429864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-53c94dfe-0bef-446e-aef9-49e18d242156 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:50.430485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-53c94dfe-0bef-446e-aef9-49e18d242156 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:50.448512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-53c94dfe-0bef-446e-aef9-49e18d242156 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:50.450255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-53c94dfe-0bef-446e-aef9-49e18d242156 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:50.451439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-53c94dfe-0bef-446e-aef9-49e18d242156 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:50.454531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-53c94dfe-0bef-446e-aef9-49e18d242156 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:50.467011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4d1ebc6a-c023-45b6-b42d-8cc498c0a02b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:50.481588 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4d1ebc6a-c023-45b6-b42d-8cc498c0a02b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 200 len: 1321 microversion: 2.1 time: 0.818475 Jul 20 04:23:50.482923 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1331/2859] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:49 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 1321 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:50.489514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4d1ebc6a-c023-45b6-b42d-8cc498c0a02b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:50.495058 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4d1ebc6a-c023-45b6-b42d-8cc498c0a02b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.010704 Jul 20 04:23:50.495661 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1332/2860] 10.222.0.17 () {56 vars in 885 bytes} [Wed Jul 20 04:23:50 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 04:23:50.501435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-800978fd-fdc8-4bed-b99f-00ae0901cb45 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:50.517106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-800978fd-fdc8-4bed-b99f-00ae0901cb45 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:50.538224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-800978fd-fdc8-4bed-b99f-00ae0901cb45 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:50.538672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-800978fd-fdc8-4bed-b99f-00ae0901cb45 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:50.539463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-800978fd-fdc8-4bed-b99f-00ae0901cb45 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:50.539897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-800978fd-fdc8-4bed-b99f-00ae0901cb45 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:51.627041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-800978fd-fdc8-4bed-b99f-00ae0901cb45 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:51.653411 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-800978fd-fdc8-4bed-b99f-00ae0901cb45 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1521 microversion: 2.1 time: 1.155294 Jul 20 04:23:51.656613 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1333/2861] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:50 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1521 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:51.684011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-45325dfa-c166-48d8-802b-3f71427c3ae7 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:51.685534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-45325dfa-c166-48d8-802b-3f71427c3ae7 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:51.694792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45325dfa-c166-48d8-802b-3f71427c3ae7 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:51.701106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45325dfa-c166-48d8-802b-3f71427c3ae7 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:51.702362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45325dfa-c166-48d8-802b-3f71427c3ae7 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:51.702802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45325dfa-c166-48d8-802b-3f71427c3ae7 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:52.159145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-53c94dfe-0bef-446e-aef9-49e18d242156 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:52.177039 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-53c94dfe-0bef-446e-aef9-49e18d242156 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1315 microversion: 2.1 time: 1.753061 Jul 20 04:23:52.183390 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1529/2862] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:50 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1315 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:52.192354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-873f1bf6-e74e-4fe5-b752-030073601a24 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1246757512"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:52.206515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-873f1bf6-e74e-4fe5-b752-030073601a24 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:52.226778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-873f1bf6-e74e-4fe5-b752-030073601a24 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:52.230025 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-873f1bf6-e74e-4fe5-b752-030073601a24 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:52.231821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-873f1bf6-e74e-4fe5-b752-030073601a24 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:52.232589 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-873f1bf6-e74e-4fe5-b752-030073601a24 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:52.509205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-45325dfa-c166-48d8-802b-3f71427c3ae7 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:52.529765 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-45325dfa-c166-48d8-802b-3f71427c3ae7 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 200 len: 1321 microversion: 2.1 time: 0.868324 Jul 20 04:23:52.530912 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1334/2863] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:51 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 1321 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:52.848630 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-873f1bf6-e74e-4fe5-b752-030073601a24 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "POST /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254/action" status: 202 len: 0 microversion: 2.1 time: 0.661956 Jul 20 04:23:52.856327 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1530/2864] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:23:52 2022] POST /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:23:52.920288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-29071e69-6f5e-4e91-ad8b-1cd2a4226830 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '.version_select at 0x7f06be04cf70>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:53.210056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-57267e8d-147b-4e15-b80e-ca4756f28929 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:53.212595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-57267e8d-147b-4e15-b80e-ca4756f28929 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:53.235771 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-29071e69-6f5e-4e91-ad8b-1cd2a4226830 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "DELETE /compute/v2.1/images/f13ee601-e939-4e8d-b2ff-794606ab688f" status: 204 len: 0 microversion: 2.1 time: 0.373874 Jul 20 04:23:53.236643 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1335/2865] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:52 2022] DELETE /compute/v2.1/images/f13ee601-e939-4e8d-b2ff-794606ab688f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:23:53.241151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57267e8d-147b-4e15-b80e-ca4756f28929 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:53.241716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57267e8d-147b-4e15-b80e-ca4756f28929 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:53.246078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7a871fef-e681-4d9a-acbc-852e2bb5c1d8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '.version_select at 0x7f06bdda1040>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:53.247513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57267e8d-147b-4e15-b80e-ca4756f28929 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:53.248786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57267e8d-147b-4e15-b80e-ca4756f28929 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:53.295799 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-7a871fef-e681-4d9a-acbc-852e2bb5c1d8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] HTTP exception thrown: Image not found. Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7a871fef-e681-4d9a-acbc-852e2bb5c1d8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Request method failure captured: Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/images/f13ee601-e939-4e8d-b2ff-794606ab688f HTTP/1.1 Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14LwP74voquJOtLNC80nY4ZOKAFurQEKphevt3p-NcmTDNTcaWLAg-fckOy-6qaK-Uj-RVjM3uvW0fJ5MaFo9LMosvXLySlQqG8Ey9DlZdPnuDB_iP3TZ5M6YQsQsoNbyd1UqrpYW2iCVzS94npO4hxJNvL7yAIupMlPI-7c7G6uq5M Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:23:53.298175 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:23:53.299493 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_baa5e3367dd747cda04291a3f97e7b02", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}] Jul 20 04:23:53.299493 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:23:53.299493 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:23:53.299493 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:23:53.299493 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:23:53.299493 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:23:53.299493 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:23:53.299493 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 23bf1fecf0c14154b1057a2ec35005a3 Jul 20 04:23:53.299493 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:23:53.299493 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:23:53.299493 n-d-826526-5 devstack@n-api.service[127870]: exception: Image not found. Jul 20 04:23:53.299493 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'f13ee601-e939-4e8d-b2ff-794606ab688f'} Jul 20 04:23:53.299493 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:53.301806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:53.301806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:23:53.301806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:23:53.301806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:23:53.301806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:23:53.301806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:23:53.301806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:23:53.301806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:23:53.301806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:23:53.301806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:23:53.301806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:23:53.301806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:23:53.301806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:23:53.301806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:23:53.301806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:23:53.301806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:23:53.301806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:23:53.301806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f13ee601-e939-4e8d-b2ff-794606ab688f Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:23:53.304120 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f13ee601-e939-4e8d-b2ff-794606ab688f could not be found. Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:23:53.306079 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:23:53.307233 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:53.307233 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:53.307233 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 04:23:53.307233 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:23:53.307233 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:23:53.307233 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:53.307233 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:53.307233 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:53.307233 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:53.307233 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:53.307233 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:53.307233 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:53.307233 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:53.307233 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:23:53.307233 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:23:53.307233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7a871fef-e681-4d9a-acbc-852e2bb5c1d8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Returning 404 to user: Image not found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:53.308229 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7a871fef-e681-4d9a-acbc-852e2bb5c1d8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/images/f13ee601-e939-4e8d-b2ff-794606ab688f" status: 404 len: 62 microversion: 2.1 time: 0.057540 Jul 20 04:23:53.308229 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1336/2866] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:53 2022] GET /compute/v2.1/images/f13ee601-e939-4e8d-b2ff-794606ab688f => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:23:53.310624 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-81d21fd0-0c26-4acc-a611-aa1ff3547bef tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:53.310624 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-81d21fd0-0c26-4acc-a611-aa1ff3547bef tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:53.334184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81d21fd0-0c26-4acc-a611-aa1ff3547bef tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:53.334644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81d21fd0-0c26-4acc-a611-aa1ff3547bef tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:53.335443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81d21fd0-0c26-4acc-a611-aa1ff3547bef tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:53.335884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81d21fd0-0c26-4acc-a611-aa1ff3547bef tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:53.972386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-57267e8d-147b-4e15-b80e-ca4756f28929 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:53.989259 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-57267e8d-147b-4e15-b80e-ca4756f28929 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1503 microversion: 2.1 time: 0.790526 Jul 20 04:23:54.003015 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1531/2867] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:53 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1503 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:54.019241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b32f3489-7af4-4b1c-a5ad-120d4ab93f60 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:54.020032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b32f3489-7af4-4b1c-a5ad-120d4ab93f60 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:54.038106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b32f3489-7af4-4b1c-a5ad-120d4ab93f60 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:54.038576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b32f3489-7af4-4b1c-a5ad-120d4ab93f60 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:54.039406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b32f3489-7af4-4b1c-a5ad-120d4ab93f60 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:54.040153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b32f3489-7af4-4b1c-a5ad-120d4ab93f60 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:54.338233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-81d21fd0-0c26-4acc-a611-aa1ff3547bef tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:54.351597 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-81d21fd0-0c26-4acc-a611-aa1ff3547bef tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1533 microversion: 2.1 time: 1.044078 Jul 20 04:23:54.352877 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1337/2868] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:53 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1533 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:54.874042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b32f3489-7af4-4b1c-a5ad-120d4ab93f60 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:54.903492 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b32f3489-7af4-4b1c-a5ad-120d4ab93f60 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 200 len: 1321 microversion: 2.1 time: 0.898674 Jul 20 04:23:54.904454 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1532/2869] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:54 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 1321 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:55.386801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-09a4a088-b8c3-4ff6-919d-dd9fb2eae864 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:55.387674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-09a4a088-b8c3-4ff6-919d-dd9fb2eae864 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:55.412419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09a4a088-b8c3-4ff6-919d-dd9fb2eae864 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:55.415783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09a4a088-b8c3-4ff6-919d-dd9fb2eae864 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:55.423420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09a4a088-b8c3-4ff6-919d-dd9fb2eae864 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:55.424174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09a4a088-b8c3-4ff6-919d-dd9fb2eae864 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:55.920911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ee84c3a0-fa02-4bec-b0be-2944b1678f90 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:55.922407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ee84c3a0-fa02-4bec-b0be-2944b1678f90 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:55.929992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee84c3a0-fa02-4bec-b0be-2944b1678f90 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:55.934870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-09a4a088-b8c3-4ff6-919d-dd9fb2eae864 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:55.939694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee84c3a0-fa02-4bec-b0be-2944b1678f90 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:55.940952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee84c3a0-fa02-4bec-b0be-2944b1678f90 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:55.945197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee84c3a0-fa02-4bec-b0be-2944b1678f90 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:55.998806 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-09a4a088-b8c3-4ff6-919d-dd9fb2eae864 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1539 microversion: 2.1 time: 0.622822 Jul 20 04:23:56.002148 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1338/2870] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:55 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1539 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:56.687872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ee84c3a0-fa02-4bec-b0be-2944b1678f90 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:56.699719 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ee84c3a0-fa02-4bec-b0be-2944b1678f90 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 200 len: 1321 microversion: 2.1 time: 0.782905 Jul 20 04:23:56.714780 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1533/2871] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:55 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 1321 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:56.755763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8aa1e094-df66-49d9-bcf9-94867507f83c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06177be1-1e5d-41ed-9468-736617fd807e"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:56.765776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8aa1e094-df66-49d9-bcf9-94867507f83c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:56.779143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8aa1e094-df66-49d9-bcf9-94867507f83c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:56.779606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8aa1e094-df66-49d9-bcf9-94867507f83c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:56.781204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8aa1e094-df66-49d9-bcf9-94867507f83c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:56.782494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8aa1e094-df66-49d9-bcf9-94867507f83c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:57.019174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6675e4cc-536f-43c6-8bad-8e22a6e6c7bc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:57.020048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6675e4cc-536f-43c6-8bad-8e22a6e6c7bc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:57.036303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6675e4cc-536f-43c6-8bad-8e22a6e6c7bc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:57.036708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6675e4cc-536f-43c6-8bad-8e22a6e6c7bc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:57.037540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6675e4cc-536f-43c6-8bad-8e22a6e6c7bc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:57.037898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6675e4cc-536f-43c6-8bad-8e22a6e6c7bc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:57.204218 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8aa1e094-df66-49d9-bcf9-94867507f83c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "POST /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.459967 Jul 20 04:23:57.205345 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1339/2872] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 04:23:56 2022] POST /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57/os-volume_attachments => generated 194 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:57.721433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-39334bdf-8137-42c0-b3ee-6d6095e2d5fb tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:57.722140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-39334bdf-8137-42c0-b3ee-6d6095e2d5fb tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:57.736757 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39334bdf-8137-42c0-b3ee-6d6095e2d5fb tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:57.736757 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39334bdf-8137-42c0-b3ee-6d6095e2d5fb tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:57.737542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39334bdf-8137-42c0-b3ee-6d6095e2d5fb tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:57.737973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39334bdf-8137-42c0-b3ee-6d6095e2d5fb tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:57.738135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6675e4cc-536f-43c6-8bad-8e22a6e6c7bc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:57.769832 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6675e4cc-536f-43c6-8bad-8e22a6e6c7bc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1521 microversion: 2.1 time: 0.748708 Jul 20 04:23:57.772513 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1534/2873] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:57 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1521 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:57.789661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-08ab2ecf-8150-4879-87c1-22c8bdb336c0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:57.791301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-08ab2ecf-8150-4879-87c1-22c8bdb336c0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:57.818394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08ab2ecf-8150-4879-87c1-22c8bdb336c0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:57.819822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08ab2ecf-8150-4879-87c1-22c8bdb336c0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:57.821721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08ab2ecf-8150-4879-87c1-22c8bdb336c0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:57.825705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08ab2ecf-8150-4879-87c1-22c8bdb336c0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:57.893685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-08ab2ecf-8150-4879-87c1-22c8bdb336c0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:57.984669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:58.090630 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-08ab2ecf-8150-4879-87c1-22c8bdb336c0 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 204 len: 0 microversion: 2.1 time: 0.305102 Jul 20 04:23:58.091587 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1535/2874] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:57 2022] DELETE /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:23:58.100712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-26af2cec-cd9c-4084-883f-e935df087d01 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:58.101492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-26af2cec-cd9c-4084-883f-e935df087d01 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:58.119553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26af2cec-cd9c-4084-883f-e935df087d01 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:58.120046 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26af2cec-cd9c-4084-883f-e935df087d01 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:58.121148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26af2cec-cd9c-4084-883f-e935df087d01 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:58.121322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26af2cec-cd9c-4084-883f-e935df087d01 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:58.622620 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-39334bdf-8137-42c0-b3ee-6d6095e2d5fb tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:58.627420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:58.638158 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-39334bdf-8137-42c0-b3ee-6d6095e2d5fb tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 200 len: 1321 microversion: 2.1 time: 0.921159 Jul 20 04:23:58.641920 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1340/2875] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:57 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 1321 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:58.709171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-26af2cec-cd9c-4084-883f-e935df087d01 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:58.722184 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-26af2cec-cd9c-4084-883f-e935df087d01 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1527 microversion: 2.1 time: 0.626092 Jul 20 04:23:58.723073 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1536/2876] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:58 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1527 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:58.860025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-20d8a8c9-9f75-4c24-9c88-da2bd4d40e67 req-a1ac42c2-09bf-4337-8bdb-138c09b3f3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb30445-55ef-4283-affc-ae1b7533b9ce", "name": "network-vif-plugged", "status": "completed", "tag": "62519a2b-711d-43b9-bf4e-2422facec33e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:58.877416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-20d8a8c9-9f75-4c24-9c88-da2bd4d40e67 req-a1ac42c2-09bf-4337-8bdb-138c09b3f3b7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:58.880478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-20d8a8c9-9f75-4c24-9c88-da2bd4d40e67 req-a1ac42c2-09bf-4337-8bdb-138c09b3f3b7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:58.912590 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-20d8a8c9-9f75-4c24-9c88-da2bd4d40e67 req-a1ac42c2-09bf-4337-8bdb-138c09b3f3b7 service nova] Creating event network-vif-plugged:62519a2b-711d-43b9-bf4e-2422facec33e for instance 8eb30445-55ef-4283-affc-ae1b7533b9ce on n-h1-826526-5 Jul 20 04:23:58.923303 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-20d8a8c9-9f75-4c24-9c88-da2bd4d40e67 req-a1ac42c2-09bf-4337-8bdb-138c09b3f3b7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068523 Jul 20 04:23:58.924230 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1341/2877] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:59.656022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4b05ba8d-1ff6-4d10-ad4b-e0d3dd0bd3b7 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:59.656881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4b05ba8d-1ff6-4d10-ad4b-e0d3dd0bd3b7 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:59.660072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:59.686191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b05ba8d-1ff6-4d10-ad4b-e0d3dd0bd3b7 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:59.687621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b05ba8d-1ff6-4d10-ad4b-e0d3dd0bd3b7 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:59.692779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b05ba8d-1ff6-4d10-ad4b-e0d3dd0bd3b7 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:59.694864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b05ba8d-1ff6-4d10-ad4b-e0d3dd0bd3b7 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:59.739699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-92702829-7bc8-4e4b-8a49-cb077e22f44e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:59.741019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-92702829-7bc8-4e4b-8a49-cb077e22f44e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:59.750980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92702829-7bc8-4e4b-8a49-cb077e22f44e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:59.760121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92702829-7bc8-4e4b-8a49-cb077e22f44e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:59.769154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92702829-7bc8-4e4b-8a49-cb077e22f44e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:59.780713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92702829-7bc8-4e4b-8a49-cb077e22f44e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:01.396065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4b05ba8d-1ff6-4d10-ad4b-e0d3dd0bd3b7 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:01.415419 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4b05ba8d-1ff6-4d10-ad4b-e0d3dd0bd3b7 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 200 len: 1321 microversion: 2.1 time: 1.764034 Jul 20 04:24:01.420614 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1537/2878] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:59 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 1321 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:01.969902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-92702829-7bc8-4e4b-8a49-cb077e22f44e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:01.988965 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-92702829-7bc8-4e4b-8a49-cb077e22f44e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1527 microversion: 2.1 time: 2.250605 Jul 20 04:24:01.992084 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1342/2879] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:59 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1527 bytes in 2257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:02.438450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ea08eb50-f417-4042-871c-7c838a28930f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:02.439103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ea08eb50-f417-4042-871c-7c838a28930f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:02.476874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea08eb50-f417-4042-871c-7c838a28930f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:02.486763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea08eb50-f417-4042-871c-7c838a28930f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:02.487553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea08eb50-f417-4042-871c-7c838a28930f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:02.488002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea08eb50-f417-4042-871c-7c838a28930f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:03.018248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-85e194f9-74c2-4324-b6b5-7cf823e6c26b tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:03.020785 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-85e194f9-74c2-4324-b6b5-7cf823e6c26b tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:03.074925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85e194f9-74c2-4324-b6b5-7cf823e6c26b tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:03.077071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85e194f9-74c2-4324-b6b5-7cf823e6c26b tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:03.092560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85e194f9-74c2-4324-b6b5-7cf823e6c26b tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:03.097054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85e194f9-74c2-4324-b6b5-7cf823e6c26b tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:03.171785 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85e194f9-74c2-4324-b6b5-7cf823e6c26b tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:03.173612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85e194f9-74c2-4324-b6b5-7cf823e6c26b tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:03.174799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-85e194f9-74c2-4324-b6b5-7cf823e6c26b tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lazy-loading 'fault' on Instance uuid 8df11745-2849-4490-9cb7-11b948d90254 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:03.312962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ea08eb50-f417-4042-871c-7c838a28930f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:03.331054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-85e194f9-74c2-4324-b6b5-7cf823e6c26b tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:03.331484 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ea08eb50-f417-4042-871c-7c838a28930f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 200 len: 1471 microversion: 2.1 time: 0.900311 Jul 20 04:24:03.332161 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1538/2880] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:02 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 1471 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:03.344713 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-85e194f9-74c2-4324-b6b5-7cf823e6c26b tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 200 len: 1315 microversion: 2.1 time: 0.332868 Jul 20 04:24:03.360017 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1343/2881] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:03 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:03.360452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e36de95a-ee18-4e82-8c29-a58a6cbef1b0 req-e84f6619-aece-4e30-9c5d-55c16300dc6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df11745-2849-4490-9cb7-11b948d90254", "name": "network-vif-deleted", "tag": "beeb8d4b-1081-4e78-a7e5-cba7f17c9c54"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:03.397539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e36de95a-ee18-4e82-8c29-a58a6cbef1b0 req-e84f6619-aece-4e30-9c5d-55c16300dc6c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:03.398437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e36de95a-ee18-4e82-8c29-a58a6cbef1b0 req-e84f6619-aece-4e30-9c5d-55c16300dc6c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:03.432504 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e36de95a-ee18-4e82-8c29-a58a6cbef1b0 req-e84f6619-aece-4e30-9c5d-55c16300dc6c service nova] Creating event network-vif-deleted:beeb8d4b-1081-4e78-a7e5-cba7f17c9c54 for instance 8df11745-2849-4490-9cb7-11b948d90254 on n-h1-826526-5 Jul 20 04:24:03.450508 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e36de95a-ee18-4e82-8c29-a58a6cbef1b0 req-e84f6619-aece-4e30-9c5d-55c16300dc6c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108392 Jul 20 04:24:03.451482 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1539/2882] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:03.730371 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-918029bd-79d7-474d-8e78-44678ca4cdc1 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:03.731598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-918029bd-79d7-474d-8e78-44678ca4cdc1 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] [instance: 5af1d542-29c7-438e-908d-21c74c1f2b08] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:03.759808 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-918029bd-79d7-474d-8e78-44678ca4cdc1 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] HTTP exception thrown: Instance 5af1d542-29c7-438e-908d-21c74c1f2b08 could not be found. Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-918029bd-79d7-474d-8e78-44678ca4cdc1 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Request method failure captured: Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/5af1d542-29c7-438e-908d-21c74c1f2b08/action HTTP/1.1 Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 15 Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14NE1XhSIi-oaxdV-We_CNP45Xi-GGYqKV-cmgvjc7FKT-RhkTj7_f3Xghdh2a_t0qt342p6mo5tX6GujqAPsJr1EtOW_I-MV2rMgarJeD60bKtEj05CaKZPWMI9EIzm9U5P-hUgnHyEK2rirXMmED2vhfAZZZ7kVu-bRQS5_iR8TYs Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: a30f859268e540bd91319ab7d9f351e2 Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-912935600 Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member,admin Jul 20 04:24:03.762036 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member,admin Jul 20 04:24:03.763726 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a30f859268e540bd91319ab7d9f351e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a30f859268e540bd91319ab7d9f351e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a30f859268e540bd91319ab7d9f351e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a30f859268e540bd91319ab7d9f351e2"}]}] Jul 20 04:24:03.763726 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersAdminNegativeTestJSON-912935600 Jul 20 04:24:03.763726 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: a30f859268e540bd91319ab7d9f351e2 Jul 20 04:24:03.763726 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-912935600 Jul 20 04:24:03.763726 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersAdminNegativeTestJSON-912935600-project-admin Jul 20 04:24:03.763726 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:24:03.763726 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:24:03.763726 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 44fa42fc036b4551a7969c3015c04874 Jul 20 04:24:03.763726 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersAdminNegativeTestJSON-912935600-project-admin Jul 20 04:24:03.763726 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:24:03.763726 n-d-826526-5 devstack@n-api.service[127870]: {"migrate": {}} Jul 20 04:24:03.763726 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:24:03.763726 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 5af1d542-29c7-438e-908d-21c74c1f2b08 could not be found. Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '5af1d542-29c7-438e-908d-21c74c1f2b08', 'body': {'migrate': {}}} Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5af1d542-29c7-438e-908d-21c74c1f2b08 could not be found. Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:03.764790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:03.766398 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:03.766398 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:03.766398 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 20 04:24:03.766398 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 20 04:24:03.766398 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:03.766398 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:03.766398 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5af1d542-29c7-438e-908d-21c74c1f2b08 could not be found. Jul 20 04:24:03.766398 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:03.766398 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:03.766398 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:03.766398 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:03.766398 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:03.766398 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:03.766398 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:03.766398 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:03.766398 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5af1d542-29c7-438e-908d-21c74c1f2b08 could not be found. Jul 20 04:24:03.766398 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:03.767651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-918029bd-79d7-474d-8e78-44678ca4cdc1 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Returning 404 to user: Instance 5af1d542-29c7-438e-908d-21c74c1f2b08 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:03.767651 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-918029bd-79d7-474d-8e78-44678ca4cdc1 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/5af1d542-29c7-438e-908d-21c74c1f2b08/action" status: 404 len: 111 microversion: 2.1 time: 0.402012 Jul 20 04:24:03.779103 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1344/2883] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:03 2022] POST /compute/v2.1/servers/5af1d542-29c7-438e-908d-21c74c1f2b08/action => generated 111 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:04.019084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-72d5ddca-cb9a-4e1c-9e64-51ca99519ccf tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-406651952", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:04.141451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-72d5ddca-cb9a-4e1c-9e64-51ca99519ccf tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:24:04.366311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cd8563ca-3391-464e-bc0e-e034aa2175a8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:04.367817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cd8563ca-3391-464e-bc0e-e034aa2175a8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:04.392069 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd8563ca-3391-464e-bc0e-e034aa2175a8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:04.393246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd8563ca-3391-464e-bc0e-e034aa2175a8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:04.397733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd8563ca-3391-464e-bc0e-e034aa2175a8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:04.398894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd8563ca-3391-464e-bc0e-e034aa2175a8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:04.472277 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-cd8563ca-3391-464e-bc0e-e034aa2175a8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] HTTP exception thrown: Instance 8df11745-2849-4490-9cb7-11b948d90254 could not be found. Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cd8563ca-3391-464e-bc0e-e034aa2175a8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Request method failure captured: Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 HTTP/1.1 Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14LwP74voquJOtLNC80nY4ZOKAFurQEKphevt3p-NcmTDNTcaWLAg-fckOy-6qaK-Uj-RVjM3uvW0fJ5MaFo9LMosvXLySlQqG8Ey9DlZdPnuDB_iP3TZ5M6YQsQsoNbyd1UqrpYW2iCVzS94npO4hxJNvL7yAIupMlPI-7c7G6uq5M Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:24:04.474572 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:24:04.476467 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_baa5e3367dd747cda04291a3f97e7b02", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}] Jul 20 04:24:04.476467 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:04.476467 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:24:04.476467 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:04.476467 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:24:04.476467 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:24:04.476467 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:24:04.476467 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 23bf1fecf0c14154b1057a2ec35005a3 Jul 20 04:24:04.476467 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:24:04.476467 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:24:04.476467 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 8df11745-2849-4490-9cb7-11b948d90254 could not be found. Jul 20 04:24:04.476467 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '8df11745-2849-4490-9cb7-11b948d90254'} Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df11745-2849-4490-9cb7-11b948d90254 could not be found. Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:04.477429 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:04.479998 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:04.479998 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:04.479998 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:04.479998 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:04.479998 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:04.479998 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:04.479998 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:04.479998 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df11745-2849-4490-9cb7-11b948d90254 could not be found. Jul 20 04:24:04.479998 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:04.479998 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:04.479998 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:04.479998 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:04.479998 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:04.479998 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:04.479998 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:04.479998 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:04.479998 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df11745-2849-4490-9cb7-11b948d90254 could not be found. Jul 20 04:24:04.479998 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:04.489100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cd8563ca-3391-464e-bc0e-e034aa2175a8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Returning 404 to user: Instance 8df11745-2849-4490-9cb7-11b948d90254 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:04.490951 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cd8563ca-3391-464e-bc0e-e034aa2175a8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 404 len: 111 microversion: 2.1 time: 0.129935 Jul 20 04:24:04.493353 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1345/2884] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:04 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:04.732485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-346f7c5b-8cf3-4e6f-8a37-b7c0aac8a49f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1928204267", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:04.823634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-346f7c5b-8cf3-4e6f-8a37-b7c0aac8a49f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] validate_networks() for [('4af6d0f3-f0ce-426d-9f01-7cbd3ae59fb5', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:24:05.994352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-72d5ddca-cb9a-4e1c-9e64-51ca99519ccf tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:24:05.995320 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-72d5ddca-cb9a-4e1c-9e64-51ca99519ccf tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:24:05.995493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-72d5ddca-cb9a-4e1c-9e64-51ca99519ccf tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:24:05.996396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-72d5ddca-cb9a-4e1c-9e64-51ca99519ccf tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:24:05.997056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-72d5ddca-cb9a-4e1c-9e64-51ca99519ccf tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:24:06.023253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72d5ddca-cb9a-4e1c-9e64-51ca99519ccf tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:06.023822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72d5ddca-cb9a-4e1c-9e64-51ca99519ccf tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:06.024777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72d5ddca-cb9a-4e1c-9e64-51ca99519ccf tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:06.025297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72d5ddca-cb9a-4e1c-9e64-51ca99519ccf tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:06.072762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-72d5ddca-cb9a-4e1c-9e64-51ca99519ccf tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Getting quotas for project 1b71d158148441319721ea98ef6f799d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:06.080000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-72d5ddca-cb9a-4e1c-9e64-51ca99519ccf tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Getting quotas for user 953c7e68040540c2b46a2d5a79fd60d0 and project 1b71d158148441319721ea98ef6f799d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:06.126112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-72d5ddca-cb9a-4e1c-9e64-51ca99519ccf tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:24:06.131052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-72d5ddca-cb9a-4e1c-9e64-51ca99519ccf tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:24:06.257334 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-72d5ddca-cb9a-4e1c-9e64-51ca99519ccf tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.243120 Jul 20 04:24:06.258504 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1540/2885] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:24:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:24:06.269440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7e3f9aae-ad22-4063-b583-bb8eb5ecd331 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:06.270077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7e3f9aae-ad22-4063-b583-bb8eb5ecd331 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:06.800819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7e3f9aae-ad22-4063-b583-bb8eb5ecd331 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:06.822094 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7e3f9aae-ad22-4063-b583-bb8eb5ecd331 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1221 microversion: 2.1 time: 0.557142 Jul 20 04:24:06.823251 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1541/2886] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:06 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1221 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:07.845323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-610c0559-1962-4ab4-9f94-0a4da14998ed tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:07.847386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-610c0559-1962-4ab4-9f94-0a4da14998ed tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:07.873640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-610c0559-1962-4ab4-9f94-0a4da14998ed tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.874513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-610c0559-1962-4ab4-9f94-0a4da14998ed tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.875625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-610c0559-1962-4ab4-9f94-0a4da14998ed tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.878301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-610c0559-1962-4ab4-9f94-0a4da14998ed tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.899305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-346f7c5b-8cf3-4e6f-8a37-b7c0aac8a49f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:24:07.900208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-346f7c5b-8cf3-4e6f-8a37-b7c0aac8a49f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:24:07.900208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-346f7c5b-8cf3-4e6f-8a37-b7c0aac8a49f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:24:07.900642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-346f7c5b-8cf3-4e6f-8a37-b7c0aac8a49f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:24:07.901234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-346f7c5b-8cf3-4e6f-8a37-b7c0aac8a49f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:24:07.919512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-346f7c5b-8cf3-4e6f-8a37-b7c0aac8a49f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.920927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-346f7c5b-8cf3-4e6f-8a37-b7c0aac8a49f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.923735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-346f7c5b-8cf3-4e6f-8a37-b7c0aac8a49f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.925162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-346f7c5b-8cf3-4e6f-8a37-b7c0aac8a49f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:08.003615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-346f7c5b-8cf3-4e6f-8a37-b7c0aac8a49f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Getting quotas for project baa5e3367dd747cda04291a3f97e7b02. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:08.029222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-346f7c5b-8cf3-4e6f-8a37-b7c0aac8a49f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Getting quotas for user 23bf1fecf0c14154b1057a2ec35005a3 and project baa5e3367dd747cda04291a3f97e7b02. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:08.072541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-346f7c5b-8cf3-4e6f-8a37-b7c0aac8a49f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:24:08.079824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-346f7c5b-8cf3-4e6f-8a37-b7c0aac8a49f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:24:08.236055 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-346f7c5b-8cf3-4e6f-8a37-b7c0aac8a49f tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.508752 Jul 20 04:24:08.242457 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1346/2887] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:24:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 3516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:24:08.258496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-81d4a51b-9444-446a-a43c-f7415df863f3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.270919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-81d4a51b-9444-446a-a43c-f7415df863f3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:08.296835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-610c0559-1962-4ab4-9f94-0a4da14998ed tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:08.318773 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-610c0559-1962-4ab4-9f94-0a4da14998ed tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1273 microversion: 2.1 time: 0.474135 Jul 20 04:24:08.319772 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1542/2888] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:07 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1273 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:08.529551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-81d4a51b-9444-446a-a43c-f7415df863f3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:08.538613 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-81d4a51b-9444-446a-a43c-f7415df863f3 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb" status: 200 len: 1225 microversion: 2.1 time: 0.288603 Jul 20 04:24:08.543658 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1347/2889] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb => generated 1225 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:09.359187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b1aec779-1810-4cdc-96f0-2c9e4837a580 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:09.367593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b1aec779-1810-4cdc-96f0-2c9e4837a580 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:09.393141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b1aec779-1810-4cdc-96f0-2c9e4837a580 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:09.395345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b1aec779-1810-4cdc-96f0-2c9e4837a580 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:09.397600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b1aec779-1810-4cdc-96f0-2c9e4837a580 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:09.398753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b1aec779-1810-4cdc-96f0-2c9e4837a580 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:09.562912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-16dff185-c987-4e31-920b-6086e42aabe8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:09.564613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-16dff185-c987-4e31-920b-6086e42aabe8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:09.594222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16dff185-c987-4e31-920b-6086e42aabe8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:09.595798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16dff185-c987-4e31-920b-6086e42aabe8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:09.596932 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16dff185-c987-4e31-920b-6086e42aabe8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:09.600030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16dff185-c987-4e31-920b-6086e42aabe8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:09.622279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b1aec779-1810-4cdc-96f0-2c9e4837a580 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:09.648560 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b1aec779-1810-4cdc-96f0-2c9e4837a580 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1279 microversion: 2.1 time: 0.303512 Jul 20 04:24:09.650927 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1543/2890] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:09 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1279 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:10.185086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-16dff185-c987-4e31-920b-6086e42aabe8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:10.202395 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-16dff185-c987-4e31-920b-6086e42aabe8 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb" status: 200 len: 1221 microversion: 2.1 time: 0.643466 Jul 20 04:24:10.219340 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1348/2891] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:09 2022] GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb => generated 1221 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:10.672774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-be04bcea-a0d7-4778-877c-26d5b9b3917f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:10.678873 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-be04bcea-a0d7-4778-877c-26d5b9b3917f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:10.719601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be04bcea-a0d7-4778-877c-26d5b9b3917f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:10.723226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be04bcea-a0d7-4778-877c-26d5b9b3917f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:10.726016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be04bcea-a0d7-4778-877c-26d5b9b3917f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:10.729797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be04bcea-a0d7-4778-877c-26d5b9b3917f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:11.019619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-be04bcea-a0d7-4778-877c-26d5b9b3917f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:11.032454 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-be04bcea-a0d7-4778-877c-26d5b9b3917f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1279 microversion: 2.1 time: 0.368510 Jul 20 04:24:11.033208 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1544/2892] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:10 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1279 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:11.224368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-23b446b6-9eeb-4bab-80bc-3189959c4579 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:11.224921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-23b446b6-9eeb-4bab-80bc-3189959c4579 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:11.245671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23b446b6-9eeb-4bab-80bc-3189959c4579 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:11.246404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23b446b6-9eeb-4bab-80bc-3189959c4579 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:11.247410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23b446b6-9eeb-4bab-80bc-3189959c4579 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:11.249207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23b446b6-9eeb-4bab-80bc-3189959c4579 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:11.421750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-23b446b6-9eeb-4bab-80bc-3189959c4579 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:11.430775 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-23b446b6-9eeb-4bab-80bc-3189959c4579 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb" status: 200 len: 1283 microversion: 2.1 time: 0.210257 Jul 20 04:24:11.432130 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1349/2893] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:11 2022] GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb => generated 1283 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:12.058975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-20c9dd23-cc8a-4bae-88b7-490364320e2f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:12.060870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-20c9dd23-cc8a-4bae-88b7-490364320e2f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:12.074823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20c9dd23-cc8a-4bae-88b7-490364320e2f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.076481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20c9dd23-cc8a-4bae-88b7-490364320e2f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.078100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20c9dd23-cc8a-4bae-88b7-490364320e2f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.078857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20c9dd23-cc8a-4bae-88b7-490364320e2f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.459252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3c6a1e51-0147-4b22-b134-6e4d1ed55f15 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:12.460147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3c6a1e51-0147-4b22-b134-6e4d1ed55f15 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:12.490667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c6a1e51-0147-4b22-b134-6e4d1ed55f15 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.525792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c6a1e51-0147-4b22-b134-6e4d1ed55f15 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.531668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c6a1e51-0147-4b22-b134-6e4d1ed55f15 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.537205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c6a1e51-0147-4b22-b134-6e4d1ed55f15 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.772794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3c6a1e51-0147-4b22-b134-6e4d1ed55f15 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:12.784680 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3c6a1e51-0147-4b22-b134-6e4d1ed55f15 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb" status: 200 len: 1283 microversion: 2.1 time: 0.331099 Jul 20 04:24:12.800000 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1350/2894] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:12 2022] GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb => generated 1283 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:12.808618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5cb87744-dc66-4f87-9a7b-9727d9adceb7 tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] Calling method '.version_select at 0x7f06bd518160>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:12.878227 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5cb87744-dc66-4f87-9a7b-9727d9adceb7 tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/fef6e61f-5648-4455-9910-07eb7754017c" status: 200 len: 351 microversion: 2.1 time: 0.075700 Jul 20 04:24:12.880538 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1351/2895] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:24:12 2022] GET /compute/v2.1/os-volumes/fef6e61f-5648-4455-9910-07eb7754017c => generated 351 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:13.039917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-20c9dd23-cc8a-4bae-88b7-490364320e2f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:13.072582 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-20c9dd23-cc8a-4bae-88b7-490364320e2f tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1321 microversion: 2.1 time: 1.024908 Jul 20 04:24:13.089586 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1545/2896] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:12 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1321 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:13.824660 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-008f01da-58b5-4398-8814-11be0974ebb5 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:13.826216 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-008f01da-58b5-4398-8814-11be0974ebb5 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:13.837237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-008f01da-58b5-4398-8814-11be0974ebb5 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.837589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-008f01da-58b5-4398-8814-11be0974ebb5 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:13.838724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-008f01da-58b5-4398-8814-11be0974ebb5 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.839413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-008f01da-58b5-4398-8814-11be0974ebb5 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:14.109461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-65a8e0ff-1bc0-47ea-a406-99f6ef466a56 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:14.115748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-65a8e0ff-1bc0-47ea-a406-99f6ef466a56 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:14.167650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65a8e0ff-1bc0-47ea-a406-99f6ef466a56 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:14.168211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65a8e0ff-1bc0-47ea-a406-99f6ef466a56 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:14.180495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65a8e0ff-1bc0-47ea-a406-99f6ef466a56 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:14.186885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-65a8e0ff-1bc0-47ea-a406-99f6ef466a56 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:14.377006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-008f01da-58b5-4398-8814-11be0974ebb5 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:14.402369 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-008f01da-58b5-4398-8814-11be0974ebb5 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb" status: 200 len: 1325 microversion: 2.1 time: 0.594270 Jul 20 04:24:14.404593 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1352/2897] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:13 2022] GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb => generated 1325 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:14.854742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-31bfafce-50cb-472c-84af-3757e9ee2276 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:14.856520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-31bfafce-50cb-472c-84af-3757e9ee2276 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:14.880056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31bfafce-50cb-472c-84af-3757e9ee2276 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:14.880539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31bfafce-50cb-472c-84af-3757e9ee2276 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:14.883544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31bfafce-50cb-472c-84af-3757e9ee2276 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:14.884036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31bfafce-50cb-472c-84af-3757e9ee2276 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:14.943048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-31bfafce-50cb-472c-84af-3757e9ee2276 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:15.096070 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-31bfafce-50cb-472c-84af-3757e9ee2276 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "DELETE /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 204 len: 0 microversion: 2.1 time: 0.249782 Jul 20 04:24:15.100795 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1353/2898] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:14 2022] DELETE /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:24:15.114358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-01168359-dce6-4114-bc10-1d827f4808ab tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:15.116163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-01168359-dce6-4114-bc10-1d827f4808ab tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:15.127368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01168359-dce6-4114-bc10-1d827f4808ab tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:15.129501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01168359-dce6-4114-bc10-1d827f4808ab tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:15.132216 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01168359-dce6-4114-bc10-1d827f4808ab tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:15.133679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01168359-dce6-4114-bc10-1d827f4808ab tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:15.631348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-01168359-dce6-4114-bc10-1d827f4808ab tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:15.649345 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-01168359-dce6-4114-bc10-1d827f4808ab tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1555 microversion: 2.1 time: 0.544595 Jul 20 04:24:15.653302 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1354/2899] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:15 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1555 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:15.669792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7124a84f-f2da-48d8-bb88-5010afd14b7c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:15.670744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7124a84f-f2da-48d8-bb88-5010afd14b7c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:15.680073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7124a84f-f2da-48d8-bb88-5010afd14b7c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:15.682191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7124a84f-f2da-48d8-bb88-5010afd14b7c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:15.683160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7124a84f-f2da-48d8-bb88-5010afd14b7c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:15.684102 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7124a84f-f2da-48d8-bb88-5010afd14b7c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:15.739922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-65a8e0ff-1bc0-47ea-a406-99f6ef466a56 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:15.768841 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-65a8e0ff-1bc0-47ea-a406-99f6ef466a56 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1321 microversion: 2.1 time: 1.673963 Jul 20 04:24:15.770001 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1546/2900] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:14 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1321 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:16.032957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7124a84f-f2da-48d8-bb88-5010afd14b7c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:16.047011 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7124a84f-f2da-48d8-bb88-5010afd14b7c tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb" status: 200 len: 1325 microversion: 2.1 time: 0.391546 Jul 20 04:24:16.051010 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1355/2901] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:15 2022] GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb => generated 1325 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:16.098354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9039b4ac-aa50-418e-9bb7-bd730d5f0af9 tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] Calling method '.version_select at 0x7f06bd41a0d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:16.132195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:16.236919 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9039b4ac-aa50-418e-9bb7-bd730d5f0af9 tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1dc8933d-9026-415f-9b1e-a85b0f1daec1" status: 200 len: 350 microversion: 2.1 time: 0.144097 Jul 20 04:24:16.237606 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1547/2902] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:24:16 2022] GET /compute/v2.1/os-volumes/1dc8933d-9026-415f-9b1e-a85b0f1daec1 => generated 350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:24:16.685908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8a933d36-b228-4da1-adbe-38c2e1ebcd62 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:16.692198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8a933d36-b228-4da1-adbe-38c2e1ebcd62 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:16.721327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a933d36-b228-4da1-adbe-38c2e1ebcd62 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:16.724477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a933d36-b228-4da1-adbe-38c2e1ebcd62 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:16.725606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a933d36-b228-4da1-adbe-38c2e1ebcd62 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:16.728845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a933d36-b228-4da1-adbe-38c2e1ebcd62 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:16.796190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-03e94d65-cfd0-4ce6-8194-179c5e1616b2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:16.797397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-03e94d65-cfd0-4ce6-8194-179c5e1616b2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:16.828026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=8 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:16.846035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03e94d65-cfd0-4ce6-8194-179c5e1616b2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:16.851923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03e94d65-cfd0-4ce6-8194-179c5e1616b2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:16.860903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03e94d65-cfd0-4ce6-8194-179c5e1616b2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:16.862183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03e94d65-cfd0-4ce6-8194-179c5e1616b2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:17.462611 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8a933d36-b228-4da1-adbe-38c2e1ebcd62 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:17.473344 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8a933d36-b228-4da1-adbe-38c2e1ebcd62 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1555 microversion: 2.1 time: 0.799108 Jul 20 04:24:17.474806 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1356/2903] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:16 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1555 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:17.483311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-21cbfcba-daf9-4a98-b1f5-9ada3412901e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:17.490194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-21cbfcba-daf9-4a98-b1f5-9ada3412901e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:17.503283 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21cbfcba-daf9-4a98-b1f5-9ada3412901e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:17.504727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21cbfcba-daf9-4a98-b1f5-9ada3412901e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:17.505786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21cbfcba-daf9-4a98-b1f5-9ada3412901e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:17.506470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21cbfcba-daf9-4a98-b1f5-9ada3412901e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:17.972579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:18.050362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-21cbfcba-daf9-4a98-b1f5-9ada3412901e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:18.059422 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-21cbfcba-daf9-4a98-b1f5-9ada3412901e tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb" status: 200 len: 1325 microversion: 2.1 time: 0.582688 Jul 20 04:24:18.070573 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1357/2904] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:17 2022] GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb => generated 1325 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:18.389333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-43967589-a324-46f7-b474-c6955188bcda req-7ca37dc4-cbf9-4791-8b78-257fe60ee3fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9bcf87e-6961-4469-bd73-169dd130076e", "tag": "530a82b1-42dc-4520-ae04-23d495237c23"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:18.408616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:18.421789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-43967589-a324-46f7-b474-c6955188bcda req-7ca37dc4-cbf9-4791-8b78-257fe60ee3fc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.422427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-43967589-a324-46f7-b474-c6955188bcda req-7ca37dc4-cbf9-4791-8b78-257fe60ee3fc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.479493 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-43967589-a324-46f7-b474-c6955188bcda req-7ca37dc4-cbf9-4791-8b78-257fe60ee3fc service nova] Creating event network-changed:530a82b1-42dc-4520-ae04-23d495237c23 for instance c9bcf87e-6961-4469-bd73-169dd130076e on n-h1-826526-5 Jul 20 04:24:18.500538 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-43967589-a324-46f7-b474-c6955188bcda req-7ca37dc4-cbf9-4791-8b78-257fe60ee3fc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111520 Jul 20 04:24:18.508250 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1358/2905] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:18.528514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-171b29ed-6774-4d42-bf72-010446c60b44 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:18.531740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-171b29ed-6774-4d42-bf72-010446c60b44 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:18.537891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:18.556558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-171b29ed-6774-4d42-bf72-010446c60b44 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.569511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-171b29ed-6774-4d42-bf72-010446c60b44 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.571313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-171b29ed-6774-4d42-bf72-010446c60b44 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.572426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-171b29ed-6774-4d42-bf72-010446c60b44 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:19.051322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-03e94d65-cfd0-4ce6-8194-179c5e1616b2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:19.079072 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-03e94d65-cfd0-4ce6-8194-179c5e1616b2 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1321 microversion: 2.1 time: 2.276458 Jul 20 04:24:19.080151 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1548/2906] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:16 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1321 bytes in 2293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:19.085598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-850d961c-482e-4b44-80c5-c997c5b9c339 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:19.092648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-850d961c-482e-4b44-80c5-c997c5b9c339 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:19.108191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-850d961c-482e-4b44-80c5-c997c5b9c339 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.109344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-850d961c-482e-4b44-80c5-c997c5b9c339 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:19.115401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-850d961c-482e-4b44-80c5-c997c5b9c339 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.118537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-850d961c-482e-4b44-80c5-c997c5b9c339 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:20.045382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-171b29ed-6774-4d42-bf72-010446c60b44 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:20.062890 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-171b29ed-6774-4d42-bf72-010446c60b44 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1555 microversion: 2.1 time: 1.552192 Jul 20 04:24:20.064373 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1359/2907] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:18 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1555 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:20.079778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f15eb6cf-0099-4cfb-8ac3-2a7b73351205 req-d1ba69df-04ae-46d7-b8b5-5555dbccb419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8537862c-9f95-49f8-9518-bd0aedf860eb", "tag": "8a914557-8d49-4e87-94b6-a0b286d07761"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:20.110097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f15eb6cf-0099-4cfb-8ac3-2a7b73351205 req-d1ba69df-04ae-46d7-b8b5-5555dbccb419 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:20.110906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f15eb6cf-0099-4cfb-8ac3-2a7b73351205 req-d1ba69df-04ae-46d7-b8b5-5555dbccb419 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:20.130935 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f15eb6cf-0099-4cfb-8ac3-2a7b73351205 req-d1ba69df-04ae-46d7-b8b5-5555dbccb419 service nova] Creating event network-changed:8a914557-8d49-4e87-94b6-a0b286d07761 for instance 8537862c-9f95-49f8-9518-bd0aedf860eb on n-h2-826526-5 Jul 20 04:24:20.141362 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f15eb6cf-0099-4cfb-8ac3-2a7b73351205 req-d1ba69df-04ae-46d7-b8b5-5555dbccb419 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074794 Jul 20 04:24:20.142836 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1360/2908] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:20.151589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eb647c98-4688-40b0-bafb-4f0c387c2f3a tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] Calling method '.version_select at 0x7f06bdb91040>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:20.239336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-850d961c-482e-4b44-80c5-c997c5b9c339 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:20.275041 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-850d961c-482e-4b44-80c5-c997c5b9c339 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb" status: 200 len: 1325 microversion: 2.1 time: 1.193438 Jul 20 04:24:20.276072 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1549/2909] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:19 2022] GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb => generated 1325 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:20.281225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a4e7a91d-7e9a-4839-9484-e30bd0707974 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:20.292556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a4e7a91d-7e9a-4839-9484-e30bd0707974 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:20.322244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a4e7a91d-7e9a-4839-9484-e30bd0707974 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:20.322694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a4e7a91d-7e9a-4839-9484-e30bd0707974 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:20.331548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a4e7a91d-7e9a-4839-9484-e30bd0707974 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:20.332397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a4e7a91d-7e9a-4839-9484-e30bd0707974 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:20.363683 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eb647c98-4688-40b0-bafb-4f0c387c2f3a tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b47059d8-d768-49b2-8f4b-182cca0b4cb1" status: 200 len: 350 microversion: 2.1 time: 0.218145 Jul 20 04:24:20.365423 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1361/2910] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 04:24:20 2022] GET /compute/v2.1/os-volumes/b47059d8-d768-49b2-8f4b-182cca0b4cb1 => generated 350 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:20.394767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-66732032-9060-462b-aadd-4eada061ac27 tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] Calling method '.version_select at 0x7f06bddb2700>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:20.541839 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-66732032-9060-462b-aadd-4eada061ac27 tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.152124 Jul 20 04:24:20.542440 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1362/2911] 10.222.0.17 () {58 vars in 1133 bytes} [Wed Jul 20 04:24:20 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:20.557258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-71bc0154-5f1e-421d-9721-65d5eb395bd3 tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] Calling method '.version_select at 0x7f06bd518b80>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:20.678213 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-71bc0154-5f1e-421d-9721-65d5eb395bd3 tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.124669 Jul 20 04:24:20.678799 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1363/2912] 10.222.0.17 () {58 vars in 1148 bytes} [Wed Jul 20 04:24:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:20.692883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8da5bee8-2ae5-48fc-94d1-7be47353c3d8 tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] Calling method '.version_select at 0x7f06bde0ba60>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:20.795623 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8da5bee8-2ae5-48fc-94d1-7be47353c3d8 tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.106993 Jul 20 04:24:20.802837 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1364/2913] 10.222.0.17 () {58 vars in 1133 bytes} [Wed Jul 20 04:24:20 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:20.808199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dc291167-c735-4466-9429-58d8a89c3c74 tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] Calling method '.version_select at 0x7f06c4a0d550>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:20.906005 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dc291167-c735-4466-9429-58d8a89c3c74 tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.101725 Jul 20 04:24:20.907675 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1365/2914] 10.222.0.17 () {58 vars in 1166 bytes} [Wed Jul 20 04:24:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:20.921701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1020ef81-f875-4679-b3b8-96a85438c82a tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] Calling method '.version_select at 0x7f06bde0ae50>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:21.047682 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1020ef81-f875-4679-b3b8-96a85438c82a tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.129515 Jul 20 04:24:21.052674 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1366/2915] 10.222.0.17 () {58 vars in 1169 bytes} [Wed Jul 20 04:24:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:21.066233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3ccc6447-eb85-471e-85a3-45b7daaa6e90 tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] Calling method '.version_select at 0x7f06bd5023a0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:21.207025 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3ccc6447-eb85-471e-85a3-45b7daaa6e90 tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.146430 Jul 20 04:24:21.207720 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1367/2916] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jul 20 04:24:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:21.222751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c94e70e0-8a33-41ef-a866-69681ccd5052 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:21.225556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c94e70e0-8a33-41ef-a866-69681ccd5052 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:21.241731 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c94e70e0-8a33-41ef-a866-69681ccd5052 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:21.242497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c94e70e0-8a33-41ef-a866-69681ccd5052 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:21.243582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c94e70e0-8a33-41ef-a866-69681ccd5052 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:21.244866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c94e70e0-8a33-41ef-a866-69681ccd5052 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:21.431108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c94e70e0-8a33-41ef-a866-69681ccd5052 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:21.435953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:21.446337 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c94e70e0-8a33-41ef-a866-69681ccd5052 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1513 microversion: 2.1 time: 0.236679 Jul 20 04:24:21.451719 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1368/2917] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:21 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:21.475905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5775c679-4de2-4ac4-8f66-ea0ca07d4ab2 tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] Calling method '.version_select at 0x7f06bde23b80>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:21.609269 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5775c679-4de2-4ac4-8f66-ea0ca07d4ab2 tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.137857 Jul 20 04:24:21.637452 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1369/2918] 10.222.0.17 () {58 vars in 1187 bytes} [Wed Jul 20 04:24:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:21.643144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5fc44eeb-6bef-4e6c-93fd-ff4e2dabe8af tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:21.644892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5fc44eeb-6bef-4e6c-93fd-ff4e2dabe8af tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:21.653405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fc44eeb-6bef-4e6c-93fd-ff4e2dabe8af tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:21.654656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fc44eeb-6bef-4e6c-93fd-ff4e2dabe8af tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:21.655685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fc44eeb-6bef-4e6c-93fd-ff4e2dabe8af tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:21.656407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fc44eeb-6bef-4e6c-93fd-ff4e2dabe8af tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:21.860031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a4e7a91d-7e9a-4839-9484-e30bd0707974 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:21.871498 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a4e7a91d-7e9a-4839-9484-e30bd0707974 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1321 microversion: 2.1 time: 1.594038 Jul 20 04:24:21.881765 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1550/2919] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:20 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1321 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:21.887059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e7fe6679-d299-4eb8-aa9f-073548b244bf tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] Calling method '.version_select at 0x7f06bd489a60>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:22.090436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5fc44eeb-6bef-4e6c-93fd-ff4e2dabe8af tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:22.117985 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5fc44eeb-6bef-4e6c-93fd-ff4e2dabe8af tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb" status: 200 len: 1325 microversion: 2.1 time: 0.478951 Jul 20 04:24:22.118617 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1370/2920] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:21 2022] GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb => generated 1325 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:22.140893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-75dde3ea-5d63-4d41-b3ea-2ff3b5b39727 req-f30de9e0-e086-44b8-bfa4-0c20ebe30f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea2e899-5a11-4761-b515-230f5e741f57", "name": "network-vif-deleted", "tag": "d6467d6e-c88d-404a-a93d-4ac41190e056"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:22.188703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-75dde3ea-5d63-4d41-b3ea-2ff3b5b39727 req-f30de9e0-e086-44b8-bfa4-0c20ebe30f4f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.189448 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e7fe6679-d299-4eb8-aa9f-073548b244bf tempest-VolumesTestJSON-1757208059 tempest-VolumesTestJSON-1757208059-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.311138 Jul 20 04:24:22.189803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-75dde3ea-5d63-4d41-b3ea-2ff3b5b39727 req-f30de9e0-e086-44b8-bfa4-0c20ebe30f4f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.190344 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1551/2921] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jul 20 04:24:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:22.224481 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-75dde3ea-5d63-4d41-b3ea-2ff3b5b39727 req-f30de9e0-e086-44b8-bfa4-0c20ebe30f4f service nova] Creating event network-vif-deleted:d6467d6e-c88d-404a-a93d-4ac41190e056 for instance eea2e899-5a11-4761-b515-230f5e741f57 on n-h2-826526-5 Jul 20 04:24:22.240877 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-75dde3ea-5d63-4d41-b3ea-2ff3b5b39727 req-f30de9e0-e086-44b8-bfa4-0c20ebe30f4f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116886 Jul 20 04:24:22.246194 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1371/2922] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:22.470742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f22668f7-8530-441e-804e-13fc0aefe640 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:22.471832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f22668f7-8530-441e-804e-13fc0aefe640 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:22.517033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f22668f7-8530-441e-804e-13fc0aefe640 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.517515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f22668f7-8530-441e-804e-13fc0aefe640 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.518725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f22668f7-8530-441e-804e-13fc0aefe640 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.519794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f22668f7-8530-441e-804e-13fc0aefe640 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.774103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f22668f7-8530-441e-804e-13fc0aefe640 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:22.805798 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f22668f7-8530-441e-804e-13fc0aefe640 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1346 microversion: 2.1 time: 0.339679 Jul 20 04:24:22.814016 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1552/2923] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:22 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1346 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:22.896930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7aba8c5d-14dc-4ae7-9cee-82bb1b396f16 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:22.902937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7aba8c5d-14dc-4ae7-9cee-82bb1b396f16 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:22.918565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7aba8c5d-14dc-4ae7-9cee-82bb1b396f16 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.926403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7aba8c5d-14dc-4ae7-9cee-82bb1b396f16 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.928126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7aba8c5d-14dc-4ae7-9cee-82bb1b396f16 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.929219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7aba8c5d-14dc-4ae7-9cee-82bb1b396f16 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.024824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-10bb0a53-140d-4100-9048-13bc0dfaae86 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Action: 'create', calling method: .version_select at 0x7f06bdb45280>, body: {"keypair": {"name": "tempest-keypair-647060892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZgGo6ud5zrmbB7tU5kowhjMH3U9AQ5+D04wudhAtsM8ERFXnVQ4sr89Ru7RJ7RqfD8n6Bqw+HSu8ofgKt6PRaKtdo3fHfBMPr4awU61ckqG1Yoa1PY6VKzJ1rblx848Q=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:23.083285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-10bb0a53-140d-4100-9048-13bc0dfaae86 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Getting quotas for project dd28073732224b22ba367fc99d203235. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:23.107057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-10bb0a53-140d-4100-9048-13bc0dfaae86 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Getting quotas for user e60ea74481504967b171b13213ad7ffd and project dd28073732224b22ba367fc99d203235. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:23.191128 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-10bb0a53-140d-4100-9048-13bc0dfaae86 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.659110 Jul 20 04:24:23.192404 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1372/2924] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:24:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:24:23.213217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e867c542-ba3c-41ff-9a8b-c4dbe66e199a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:23.230366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e867c542-ba3c-41ff-9a8b-c4dbe66e199a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:23.249497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e867c542-ba3c-41ff-9a8b-c4dbe66e199a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.252328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e867c542-ba3c-41ff-9a8b-c4dbe66e199a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.256852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e867c542-ba3c-41ff-9a8b-c4dbe66e199a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.257643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e867c542-ba3c-41ff-9a8b-c4dbe66e199a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:24.017116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e867c542-ba3c-41ff-9a8b-c4dbe66e199a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:24.034167 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e867c542-ba3c-41ff-9a8b-c4dbe66e199a tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb" status: 200 len: 1325 microversion: 2.1 time: 0.831968 Jul 20 04:24:24.034814 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1373/2925] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:23 2022] GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb => generated 1325 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:24.061562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-32381d6a-add8-4f68-950a-52423edb327a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:24.070073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-32381d6a-add8-4f68-950a-52423edb327a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:24.094760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32381d6a-add8-4f68-950a-52423edb327a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:24.095943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32381d6a-add8-4f68-950a-52423edb327a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:24.097588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32381d6a-add8-4f68-950a-52423edb327a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:24.100827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32381d6a-add8-4f68-950a-52423edb327a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:24.426795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-32381d6a-add8-4f68-950a-52423edb327a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:24.452535 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-32381d6a-add8-4f68-950a-52423edb327a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1346 microversion: 2.1 time: 0.416537 Jul 20 04:24:24.453132 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1374/2926] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:24 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1346 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:24.994979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7aba8c5d-14dc-4ae7-9cee-82bb1b396f16 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:25.004142 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7aba8c5d-14dc-4ae7-9cee-82bb1b396f16 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1321 microversion: 2.1 time: 2.118006 Jul 20 04:24:25.012773 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1553/2927] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:22 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1321 bytes in 2128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:25.053571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2b694db4-6bd9-49ff-88c0-ea52553acfec tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:25.054410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2b694db4-6bd9-49ff-88c0-ea52553acfec tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:25.082697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b694db4-6bd9-49ff-88c0-ea52553acfec tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:25.091772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b694db4-6bd9-49ff-88c0-ea52553acfec tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:25.093149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b694db4-6bd9-49ff-88c0-ea52553acfec tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:25.093817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b694db4-6bd9-49ff-88c0-ea52553acfec tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:25.470121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-86665002-55ec-4dd3-b68d-cfce388dec7f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:25.480697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-86665002-55ec-4dd3-b68d-cfce388dec7f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:25.492810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86665002-55ec-4dd3-b68d-cfce388dec7f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:25.500599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86665002-55ec-4dd3-b68d-cfce388dec7f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:25.506117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86665002-55ec-4dd3-b68d-cfce388dec7f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:25.506776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86665002-55ec-4dd3-b68d-cfce388dec7f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.233877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2b694db4-6bd9-49ff-88c0-ea52553acfec tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:26.243069 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2b694db4-6bd9-49ff-88c0-ea52553acfec tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb" status: 200 len: 1325 microversion: 2.1 time: 1.195101 Jul 20 04:24:26.243679 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1375/2928] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:25 2022] GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb => generated 1325 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:26.279726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6e858392-3702-456e-b04b-7f47bfdaf7df tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:26.288454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6e858392-3702-456e-b04b-7f47bfdaf7df tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:26.308248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e858392-3702-456e-b04b-7f47bfdaf7df tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.308726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e858392-3702-456e-b04b-7f47bfdaf7df tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.314312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e858392-3702-456e-b04b-7f47bfdaf7df tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.315126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e858392-3702-456e-b04b-7f47bfdaf7df tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.533289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-86665002-55ec-4dd3-b68d-cfce388dec7f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:26.549959 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-86665002-55ec-4dd3-b68d-cfce388dec7f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1346 microversion: 2.1 time: 1.083682 Jul 20 04:24:26.562458 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1554/2929] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:25 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1346 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:26.801307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-01f7af63-66f6-4790-8c91-fb6dd394c54a req-85e44f1b-68f2-40c9-a65f-ec5ab5776245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8537862c-9f95-49f8-9518-bd0aedf860eb", "name": "network-vif-plugged", "status": "completed", "tag": "8a914557-8d49-4e87-94b6-a0b286d07761"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:26.830168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-01f7af63-66f6-4790-8c91-fb6dd394c54a req-85e44f1b-68f2-40c9-a65f-ec5ab5776245 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.841259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-01f7af63-66f6-4790-8c91-fb6dd394c54a req-85e44f1b-68f2-40c9-a65f-ec5ab5776245 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.896237 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-01f7af63-66f6-4790-8c91-fb6dd394c54a req-85e44f1b-68f2-40c9-a65f-ec5ab5776245 service nova] Creating event network-vif-plugged:8a914557-8d49-4e87-94b6-a0b286d07761 for instance 8537862c-9f95-49f8-9518-bd0aedf860eb on n-h2-826526-5 Jul 20 04:24:26.907536 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-01f7af63-66f6-4790-8c91-fb6dd394c54a req-85e44f1b-68f2-40c9-a65f-ec5ab5776245 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111119 Jul 20 04:24:26.913422 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1555/2930] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:27.265690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cb60dad4-211b-4a50-a757-53d959b2b584 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:27.266770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cb60dad4-211b-4a50-a757-53d959b2b584 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:27.303293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb60dad4-211b-4a50-a757-53d959b2b584 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.311334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb60dad4-211b-4a50-a757-53d959b2b584 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.318087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb60dad4-211b-4a50-a757-53d959b2b584 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.319393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb60dad4-211b-4a50-a757-53d959b2b584 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.409610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:27.670895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6e858392-3702-456e-b04b-7f47bfdaf7df tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:27.689348 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6e858392-3702-456e-b04b-7f47bfdaf7df tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1321 microversion: 2.1 time: 1.435544 Jul 20 04:24:27.691595 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1376/2931] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:26 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1321 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:27.708004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a2fa522a-70ad-4893-a480-498bbb3805f5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:27.709756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a2fa522a-70ad-4893-a480-498bbb3805f5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:27.739373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2fa522a-70ad-4893-a480-498bbb3805f5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.743101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2fa522a-70ad-4893-a480-498bbb3805f5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.754397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2fa522a-70ad-4893-a480-498bbb3805f5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.755758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2fa522a-70ad-4893-a480-498bbb3805f5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.573536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a2fa522a-70ad-4893-a480-498bbb3805f5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:28.603528 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a2fa522a-70ad-4893-a480-498bbb3805f5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1346 microversion: 2.1 time: 0.899048 Jul 20 04:24:28.604550 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1377/2932] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:27 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1346 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:28.708783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0e25c542-3d39-45cb-8daa-277fefc9c306 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:28.710129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0e25c542-3d39-45cb-8daa-277fefc9c306 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:28.724316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e25c542-3d39-45cb-8daa-277fefc9c306 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.727767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e25c542-3d39-45cb-8daa-277fefc9c306 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.729649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e25c542-3d39-45cb-8daa-277fefc9c306 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.736726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e25c542-3d39-45cb-8daa-277fefc9c306 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.887878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cb60dad4-211b-4a50-a757-53d959b2b584 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:28.904034 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cb60dad4-211b-4a50-a757-53d959b2b584 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb" status: 200 len: 1325 microversion: 2.1 time: 1.647229 Jul 20 04:24:28.913558 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1556/2933] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:27 2022] GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb => generated 1325 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:29.105491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0e25c542-3d39-45cb-8daa-277fefc9c306 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:29.113984 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0e25c542-3d39-45cb-8daa-277fefc9c306 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1321 microversion: 2.1 time: 0.409570 Jul 20 04:24:29.126631 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1378/2934] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:28 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1321 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:29.126902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-ce45d5cb-b556-4c9b-adb7-e9661901790e req-8ac22dab-e76a-4006-90b4-c4c6ca985a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9bcf87e-6961-4469-bd73-169dd130076e", "name": "network-vif-plugged", "status": "completed", "tag": "530a82b1-42dc-4520-ae04-23d495237c23"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:29.152148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ce45d5cb-b556-4c9b-adb7-e9661901790e req-8ac22dab-e76a-4006-90b4-c4c6ca985a52 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.152676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ce45d5cb-b556-4c9b-adb7-e9661901790e req-8ac22dab-e76a-4006-90b4-c4c6ca985a52 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.184815 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-ce45d5cb-b556-4c9b-adb7-e9661901790e req-8ac22dab-e76a-4006-90b4-c4c6ca985a52 service nova] Creating event network-vif-plugged:530a82b1-42dc-4520-ae04-23d495237c23 for instance c9bcf87e-6961-4469-bd73-169dd130076e on n-h1-826526-5 Jul 20 04:24:29.198665 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-ce45d5cb-b556-4c9b-adb7-e9661901790e req-8ac22dab-e76a-4006-90b4-c4c6ca985a52 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076509 Jul 20 04:24:29.214083 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1557/2935] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:24:29.621926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1772feb0-86b1-425c-a9c0-8d28f3db5d8e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:29.622793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1772feb0-86b1-425c-a9c0-8d28f3db5d8e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:29.650603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1772feb0-86b1-425c-a9c0-8d28f3db5d8e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.651303 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1772feb0-86b1-425c-a9c0-8d28f3db5d8e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.652650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1772feb0-86b1-425c-a9c0-8d28f3db5d8e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.673163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1772feb0-86b1-425c-a9c0-8d28f3db5d8e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.922011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cb042af2-69ec-4d1d-a08b-570c4aba5c68 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:29.922729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cb042af2-69ec-4d1d-a08b-570c4aba5c68 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:29.931987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:29.945193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb042af2-69ec-4d1d-a08b-570c4aba5c68 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.945719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb042af2-69ec-4d1d-a08b-570c4aba5c68 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.946577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb042af2-69ec-4d1d-a08b-570c4aba5c68 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.947024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb042af2-69ec-4d1d-a08b-570c4aba5c68 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.043044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1772feb0-86b1-425c-a9c0-8d28f3db5d8e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:30.052073 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1772feb0-86b1-425c-a9c0-8d28f3db5d8e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1346 microversion: 2.1 time: 0.434611 Jul 20 04:24:30.058422 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1379/2936] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:29 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1346 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:30.131486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b910aafe-e200-47ee-b6f0-b47f25a81468 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:30.132404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b910aafe-e200-47ee-b6f0-b47f25a81468 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:30.149599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b910aafe-e200-47ee-b6f0-b47f25a81468 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.150549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b910aafe-e200-47ee-b6f0-b47f25a81468 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.152671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b910aafe-e200-47ee-b6f0-b47f25a81468 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.153511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b910aafe-e200-47ee-b6f0-b47f25a81468 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.677094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cb042af2-69ec-4d1d-a08b-570c4aba5c68 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:30.688785 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cb042af2-69ec-4d1d-a08b-570c4aba5c68 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb" status: 200 len: 1521 microversion: 2.1 time: 0.771194 Jul 20 04:24:30.689741 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1558/2937] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:29 2022] GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb => generated 1521 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:30.718976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b910aafe-e200-47ee-b6f0-b47f25a81468 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:30.726093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-aa11778c-5ace-4634-bb1a-80ba38643439 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:30.726593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-aa11778c-5ace-4634-bb1a-80ba38643439 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:30.740042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa11778c-5ace-4634-bb1a-80ba38643439 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.740343 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b910aafe-e200-47ee-b6f0-b47f25a81468 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1321 microversion: 2.1 time: 0.611563 Jul 20 04:24:30.742445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa11778c-5ace-4634-bb1a-80ba38643439 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.743307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa11778c-5ace-4634-bb1a-80ba38643439 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.743755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa11778c-5ace-4634-bb1a-80ba38643439 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.762218 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1380/2938] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:30 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1321 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:30.814383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-aa11778c-5ace-4634-bb1a-80ba38643439 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:31.037514 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-aa11778c-5ace-4634-bb1a-80ba38643439 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb" status: 204 len: 0 microversion: 2.1 time: 0.314867 Jul 20 04:24:31.039677 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1559/2939] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:30 2022] DELETE /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:31.054868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d568597-3295-428d-87d5-c5b8ec33e7be tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:31.055789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d568597-3295-428d-87d5-c5b8ec33e7be tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:31.065524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d568597-3295-428d-87d5-c5b8ec33e7be tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.066488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d568597-3295-428d-87d5-c5b8ec33e7be tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.067440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d568597-3295-428d-87d5-c5b8ec33e7be tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.069100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d568597-3295-428d-87d5-c5b8ec33e7be tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.075838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f013d749-19ac-45b4-90a4-76f2317f57e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:31.076730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f013d749-19ac-45b4-90a4-76f2317f57e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:31.093432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f013d749-19ac-45b4-90a4-76f2317f57e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.098927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f013d749-19ac-45b4-90a4-76f2317f57e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.102279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f013d749-19ac-45b4-90a4-76f2317f57e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.105045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f013d749-19ac-45b4-90a4-76f2317f57e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.408574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f013d749-19ac-45b4-90a4-76f2317f57e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:31.431668 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f013d749-19ac-45b4-90a4-76f2317f57e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1346 microversion: 2.1 time: 0.360079 Jul 20 04:24:31.452701 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1560/2940] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:31 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1346 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:31.765309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a0e162d8-78b8-4b68-a8f5-86954eb618c0 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:31.766205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a0e162d8-78b8-4b68-a8f5-86954eb618c0 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:31.782277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0e162d8-78b8-4b68-a8f5-86954eb618c0 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.783022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0e162d8-78b8-4b68-a8f5-86954eb618c0 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.784012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0e162d8-78b8-4b68-a8f5-86954eb618c0 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.784650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0e162d8-78b8-4b68-a8f5-86954eb618c0 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.804524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d568597-3295-428d-87d5-c5b8ec33e7be tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:31.817003 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d568597-3295-428d-87d5-c5b8ec33e7be tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb" status: 200 len: 1527 microversion: 2.1 time: 0.770684 Jul 20 04:24:31.821240 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1381/2941] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:31 2022] GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb => generated 1527 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:32.181880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a0e162d8-78b8-4b68-a8f5-86954eb618c0 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:32.212730 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a0e162d8-78b8-4b68-a8f5-86954eb618c0 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1471 microversion: 2.1 time: 0.451017 Jul 20 04:24:32.214271 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1561/2942] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:31 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1471 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:32.252236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1df97c2d-75c9-4826-98db-f984adedb70f tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:32.255373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1df97c2d-75c9-4826-98db-f984adedb70f tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:32.265816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1df97c2d-75c9-4826-98db-f984adedb70f tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:32.266757 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1df97c2d-75c9-4826-98db-f984adedb70f tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:32.267798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1df97c2d-75c9-4826-98db-f984adedb70f tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:32.268631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1df97c2d-75c9-4826-98db-f984adedb70f tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:32.343637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-1df97c2d-75c9-4826-98db-f984adedb70f tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Lazy-loading 'flavor' on Instance uuid c9bcf87e-6961-4469-bd73-169dd130076e {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:32.460570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9e5910cb-63c3-4343-80e5-8ee28ae854ca tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:32.462409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9e5910cb-63c3-4343-80e5-8ee28ae854ca tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:32.485087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e5910cb-63c3-4343-80e5-8ee28ae854ca tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:32.488979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e5910cb-63c3-4343-80e5-8ee28ae854ca tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:32.492853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e5910cb-63c3-4343-80e5-8ee28ae854ca tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:32.494052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e5910cb-63c3-4343-80e5-8ee28ae854ca tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:32.496304 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1df97c2d-75c9-4826-98db-f984adedb70f tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e/action" status: 202 len: 0 microversion: 2.1 time: 0.250343 Jul 20 04:24:32.497121 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1382/2943] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:32 2022] POST /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:24:32.505807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5b745fc9-a0a0-4cb7-8a17-a0028ae35b92 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:32.509240 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5b745fc9-a0a0-4cb7-8a17-a0028ae35b92 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:32.522577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b745fc9-a0a0-4cb7-8a17-a0028ae35b92 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:32.527696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b745fc9-a0a0-4cb7-8a17-a0028ae35b92 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:32.529059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b745fc9-a0a0-4cb7-8a17-a0028ae35b92 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:32.533095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b745fc9-a0a0-4cb7-8a17-a0028ae35b92 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:32.727130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9e5910cb-63c3-4343-80e5-8ee28ae854ca tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:32.758916 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9e5910cb-63c3-4343-80e5-8ee28ae854ca tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 200 len: 1346 microversion: 2.1 time: 0.301601 Jul 20 04:24:32.759589 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1562/2944] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:32 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 1346 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:32.839832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2838b9fb-46af-4e43-a6e6-8e47b03ad497 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:32.840586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2838b9fb-46af-4e43-a6e6-8e47b03ad497 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:32.854639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2838b9fb-46af-4e43-a6e6-8e47b03ad497 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:32.856001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2838b9fb-46af-4e43-a6e6-8e47b03ad497 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:32.859040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2838b9fb-46af-4e43-a6e6-8e47b03ad497 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:32.859890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2838b9fb-46af-4e43-a6e6-8e47b03ad497 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:33.138242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:33.638753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2838b9fb-46af-4e43-a6e6-8e47b03ad497 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:33.650128 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2838b9fb-46af-4e43-a6e6-8e47b03ad497 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb" status: 200 len: 1527 microversion: 2.1 time: 0.815062 Jul 20 04:24:33.651387 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1563/2945] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:32 2022] GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb => generated 1527 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:33.780751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-da4cbef4-f5fe-4018-a4f1-f7d9d9ee8d0b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:33.781866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-da4cbef4-f5fe-4018-a4f1-f7d9d9ee8d0b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:33.789809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da4cbef4-f5fe-4018-a4f1-f7d9d9ee8d0b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:33.790798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da4cbef4-f5fe-4018-a4f1-f7d9d9ee8d0b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:33.792046 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da4cbef4-f5fe-4018-a4f1-f7d9d9ee8d0b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:33.792863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da4cbef4-f5fe-4018-a4f1-f7d9d9ee8d0b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:33.819836 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-da4cbef4-f5fe-4018-a4f1-f7d9d9ee8d0b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-da4cbef4-f5fe-4018-a4f1-f7d9d9ee8d0b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 HTTP/1.1 Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:24:33.823039 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:24:33.825203 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:24:33.825203 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:24:33.825203 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:24:33.825203 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:24:33.825203 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:24:33.825203 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:24:33.825203 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:24:33.825203 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:24:33.825203 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:24:33.825203 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:24:33.825203 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:24:33.825203 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'eea2e899-5a11-4761-b515-230f5e741f57'} Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:33.826452 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:33.828496 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:33.828496 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:33.828496 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:33.828496 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:33.828496 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:33.828496 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:33.828496 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:33.828496 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:24:33.828496 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:33.828496 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:33.828496 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:33.828496 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:33.828496 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:33.828496 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:33.828496 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:33.828496 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:33.828496 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:24:33.828496 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:33.832119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-da4cbef4-f5fe-4018-a4f1-f7d9d9ee8d0b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:33.834038 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-da4cbef4-f5fe-4018-a4f1-f7d9d9ee8d0b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 404 len: 111 microversion: 2.1 time: 0.060580 Jul 20 04:24:33.835793 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1564/2946] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:33 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:34.028194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-235031cc-6386-4d12-b53e-51df6dbb8512 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:34.029214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-235031cc-6386-4d12-b53e-51df6dbb8512 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:34.051009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-235031cc-6386-4d12-b53e-51df6dbb8512 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:34.052336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-235031cc-6386-4d12-b53e-51df6dbb8512 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:34.058759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-235031cc-6386-4d12-b53e-51df6dbb8512 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:34.059764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-235031cc-6386-4d12-b53e-51df6dbb8512 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:34.112113 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-235031cc-6386-4d12-b53e-51df6dbb8512 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-235031cc-6386-4d12-b53e-51df6dbb8512 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57/os-volume_attachments HTTP/1.1 Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:24:34.124729 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:24:34.126256 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:24:34.126256 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:24:34.126256 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:24:34.126256 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:24:34.126256 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:24:34.126256 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:24:34.126256 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:24:34.126256 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:24:34.126256 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:24:34.126256 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:24:34.126256 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:24:34.126256 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'server_id': 'eea2e899-5a11-4761-b515-230f5e741f57'} Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:34.127042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:24:34.128340 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:34.129813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-235031cc-6386-4d12-b53e-51df6dbb8512 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:34.129813 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-235031cc-6386-4d12-b53e-51df6dbb8512 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.113366 Jul 20 04:24:34.129813 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1565/2947] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:24:34 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57/os-volume_attachments => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:34.530966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f94a10e3-4287-4f53-888d-413eb0fe3a27 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1910698533", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "c3db3bfb-11a7-406a-b082-1e92336f5a21"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:34.645528 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-f94a10e3-4287-4f53-888d-413eb0fe3a27 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] validate_networks() for [('c3db3bfb-11a7-406a-b082-1e92336f5a21', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:24:35.670324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f94a10e3-4287-4f53-888d-413eb0fe3a27 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:24:35.671333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f94a10e3-4287-4f53-888d-413eb0fe3a27 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:24:35.671771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f94a10e3-4287-4f53-888d-413eb0fe3a27 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:24:35.672924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f94a10e3-4287-4f53-888d-413eb0fe3a27 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:24:35.673641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f94a10e3-4287-4f53-888d-413eb0fe3a27 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:24:35.715585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f94a10e3-4287-4f53-888d-413eb0fe3a27 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:35.716985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f94a10e3-4287-4f53-888d-413eb0fe3a27 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:35.732075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f94a10e3-4287-4f53-888d-413eb0fe3a27 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:35.732939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f94a10e3-4287-4f53-888d-413eb0fe3a27 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:35.902548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-f94a10e3-4287-4f53-888d-413eb0fe3a27 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Getting quotas for project ae67de1fefe64bd19a3bf614f02d3535. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:35.917379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-f94a10e3-4287-4f53-888d-413eb0fe3a27 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Getting quotas for user 1dc60058bea0485ebd4d502b2e7c986b and project ae67de1fefe64bd19a3bf614f02d3535. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:35.944506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f94a10e3-4287-4f53-888d-413eb0fe3a27 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:24:35.949720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f94a10e3-4287-4f53-888d-413eb0fe3a27 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 3261841a-a10c-46ba-8894-77e1e808de20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:24:36.124964 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f94a10e3-4287-4f53-888d-413eb0fe3a27 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.599412 Jul 20 04:24:36.137817 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1566/2948] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:24:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:24:36.189504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6a19129a-fab4-4a1f-9fde-0fca06aadedc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:36.192127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6a19129a-fab4-4a1f-9fde-0fca06aadedc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:36.235041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a19129a-fab4-4a1f-9fde-0fca06aadedc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:36.241761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a19129a-fab4-4a1f-9fde-0fca06aadedc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:36.243606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a19129a-fab4-4a1f-9fde-0fca06aadedc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:36.245128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a19129a-fab4-4a1f-9fde-0fca06aadedc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:36.846212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6a19129a-fab4-4a1f-9fde-0fca06aadedc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf1fecf0c14154b1057a2ec35005a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa5e3367dd747cda04291a3f97e7b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:36.860876 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6a19129a-fab4-4a1f-9fde-0fca06aadedc tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb" status: 200 len: 1310 microversion: 2.1 time: 0.721124 Jul 20 04:24:36.861476 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1567/2949] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:36 2022] GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb => generated 1310 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:36.866409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0a419819-122f-468f-b476-58dad9c25310 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:36.867065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0a419819-122f-468f-b476-58dad9c25310 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 3261841a-a10c-46ba-8894-77e1e808de20] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:37.059598 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5b745fc9-a0a0-4cb7-8a17-a0028ae35b92 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1630 microversion: 2.1 time: 4.557549 Jul 20 04:24:37.069938 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1383/2950] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:32 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1630 bytes in 4569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:37.101410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-cae0d2c6-ffd9-4d92-877b-e1ca18e19168 req-ff7c49ab-a89f-4063-a895-bba3be55391a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8537862c-9f95-49f8-9518-bd0aedf860eb", "name": "network-vif-deleted", "tag": "8a914557-8d49-4e87-94b6-a0b286d07761"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:37.174349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-cae0d2c6-ffd9-4d92-877b-e1ca18e19168 req-ff7c49ab-a89f-4063-a895-bba3be55391a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.183080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-cae0d2c6-ffd9-4d92-877b-e1ca18e19168 req-ff7c49ab-a89f-4063-a895-bba3be55391a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.224659 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-cae0d2c6-ffd9-4d92-877b-e1ca18e19168 req-ff7c49ab-a89f-4063-a895-bba3be55391a service nova] Creating event network-vif-deleted:8a914557-8d49-4e87-94b6-a0b286d07761 for instance 8537862c-9f95-49f8-9518-bd0aedf860eb on n-h2-826526-5 Jul 20 04:24:37.255719 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-cae0d2c6-ffd9-4d92-877b-e1ca18e19168 req-ff7c49ab-a89f-4063-a895-bba3be55391a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177725 Jul 20 04:24:37.261314 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1384/2951] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:37.393592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0a419819-122f-468f-b476-58dad9c25310 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:37.402040 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0a419819-122f-468f-b476-58dad9c25310 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/3261841a-a10c-46ba-8894-77e1e808de20" status: 200 len: 1215 microversion: 2.1 time: 0.539233 Jul 20 04:24:37.414442 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1568/2952] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:36 2022] GET /compute/v2.1/servers/3261841a-a10c-46ba-8894-77e1e808de20 => generated 1215 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:37.432402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a9f73849-816f-4734-8000-19d827efc88b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:37.439320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a9f73849-816f-4734-8000-19d827efc88b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 3261841a-a10c-46ba-8894-77e1e808de20] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:37.530096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a9f73849-816f-4734-8000-19d827efc88b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 3261841a-a10c-46ba-8894-77e1e808de20] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:37.890878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2a0582f4-a575-4dac-a6f6-ce33712494ab tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:37.893159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2a0582f4-a575-4dac-a6f6-ce33712494ab tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8537862c-9f95-49f8-9518-bd0aedf860eb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:37.920679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2a0582f4-a575-4dac-a6f6-ce33712494ab tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.925334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2a0582f4-a575-4dac-a6f6-ce33712494ab tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.932827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2a0582f4-a575-4dac-a6f6-ce33712494ab tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.934081 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2a0582f4-a575-4dac-a6f6-ce33712494ab tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.984808 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-2a0582f4-a575-4dac-a6f6-ce33712494ab tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] HTTP exception thrown: Instance 8537862c-9f95-49f8-9518-bd0aedf860eb could not be found. Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2a0582f4-a575-4dac-a6f6-ce33712494ab tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Request method failure captured: Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb HTTP/1.1 Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14LwP74voquJOtLNC80nY4ZOKAFurQEKphevt3p-NcmTDNTcaWLAg-fckOy-6qaK-Uj-RVjM3uvW0fJ5MaFo9LMosvXLySlQqG8Ey9DlZdPnuDB_iP3TZ5M6YQsQsoNbyd1UqrpYW2iCVzS94npO4hxJNvL7yAIupMlPI-7c7G6uq5M Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:24:37.986949 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:24:37.988765 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_baa5e3367dd747cda04291a3f97e7b02", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}] Jul 20 04:24:37.988765 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:37.988765 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:24:37.988765 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:37.988765 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:24:37.988765 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:24:37.988765 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:24:37.988765 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 23bf1fecf0c14154b1057a2ec35005a3 Jul 20 04:24:37.988765 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:24:37.988765 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:24:37.988765 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 8537862c-9f95-49f8-9518-bd0aedf860eb could not be found. Jul 20 04:24:37.988765 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '8537862c-9f95-49f8-9518-bd0aedf860eb'} Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8537862c-9f95-49f8-9518-bd0aedf860eb could not be found. Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:37.989920 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:37.991979 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:37.991979 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:37.991979 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:37.991979 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:37.991979 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:37.991979 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:37.991979 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:37.991979 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8537862c-9f95-49f8-9518-bd0aedf860eb could not be found. Jul 20 04:24:37.991979 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:37.991979 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:37.991979 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:37.991979 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:37.991979 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:37.991979 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:37.991979 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:37.991979 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:37.991979 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8537862c-9f95-49f8-9518-bd0aedf860eb could not be found. Jul 20 04:24:37.991979 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:37.995881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2a0582f4-a575-4dac-a6f6-ce33712494ab tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Returning 404 to user: Instance 8537862c-9f95-49f8-9518-bd0aedf860eb could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:37.999348 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2a0582f4-a575-4dac-a6f6-ce33712494ab tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb" status: 404 len: 111 microversion: 2.1 time: 0.114818 Jul 20 04:24:38.005258 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1569/2953] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:37 2022] GET /compute/v2.1/servers/8537862c-9f95-49f8-9518-bd0aedf860eb => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:38.019676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a6597ebf-14f6-4e24-8a14-f0c4030810b4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '.version_select at 0x7f06bd431700>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:38.080168 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-a6597ebf-14f6-4e24-8a14-f0c4030810b4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] HTTP exception thrown: Image not found. Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a6597ebf-14f6-4e24-8a14-f0c4030810b4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Request method failure captured: Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/images/f13ee601-e939-4e8d-b2ff-794606ab688f HTTP/1.1 Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14LwP74voquJOtLNC80nY4ZOKAFurQEKphevt3p-NcmTDNTcaWLAg-fckOy-6qaK-Uj-RVjM3uvW0fJ5MaFo9LMosvXLySlQqG8Ey9DlZdPnuDB_iP3TZ5M6YQsQsoNbyd1UqrpYW2iCVzS94npO4hxJNvL7yAIupMlPI-7c7G6uq5M Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:24:38.090539 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:24:38.093409 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_baa5e3367dd747cda04291a3f97e7b02", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}] Jul 20 04:24:38.093409 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:38.093409 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:24:38.093409 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:38.093409 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:24:38.093409 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:24:38.093409 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:24:38.093409 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 23bf1fecf0c14154b1057a2ec35005a3 Jul 20 04:24:38.093409 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:24:38.093409 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:24:38.093409 n-d-826526-5 devstack@n-api.service[127871]: exception: Image not found. Jul 20 04:24:38.093409 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'f13ee601-e939-4e8d-b2ff-794606ab688f'} Jul 20 04:24:38.093409 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f13ee601-e939-4e8d-b2ff-794606ab688f to delete Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:38.095417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f13ee601-e939-4e8d-b2ff-794606ab688f could not be found. Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:38.099220 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:38.103230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:24:38.103230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:24:38.103230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:24:38.103230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.103230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:38.103230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.103230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:38.103230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:38.103230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:38.103230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:38.103230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:38.103230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:24:38.103230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.107570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a6597ebf-14f6-4e24-8a14-f0c4030810b4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Returning 404 to user: Image not found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:38.111030 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a6597ebf-14f6-4e24-8a14-f0c4030810b4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "DELETE /compute/v2.1/images/f13ee601-e939-4e8d-b2ff-794606ab688f" status: 404 len: 62 microversion: 2.1 time: 0.103021 Jul 20 04:24:38.123718 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1570/2954] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:38 2022] DELETE /compute/v2.1/images/f13ee601-e939-4e8d-b2ff-794606ab688f => generated 62 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:24:38.178368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4c61942c-3929-492d-ad84-c72c80b3fbbe tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:38.181905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4c61942c-3929-492d-ad84-c72c80b3fbbe tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:38.234538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c61942c-3929-492d-ad84-c72c80b3fbbe tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.251719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c61942c-3929-492d-ad84-c72c80b3fbbe tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.252660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c61942c-3929-492d-ad84-c72c80b3fbbe tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.253113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c61942c-3929-492d-ad84-c72c80b3fbbe tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.457019 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.scheduler.client.report [None req-a9f73849-816f-4734-8000-19d827efc88b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Deleted allocations for instance 3261841a-a10c-46ba-8894-77e1e808de20 Jul 20 04:24:38.514371 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a9f73849-816f-4734-8000-19d827efc88b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3261841a-a10c-46ba-8894-77e1e808de20" status: 204 len: 0 microversion: 2.1 time: 1.092709 Jul 20 04:24:38.523951 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1385/2955] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:37 2022] DELETE /compute/v2.1/servers/3261841a-a10c-46ba-8894-77e1e808de20 => generated 0 bytes in 1102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:38.546064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-53c0b172-cefa-474f-9229-440f9ecec3fa tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:38.547327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-53c0b172-cefa-474f-9229-440f9ecec3fa tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:38.569333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53c0b172-cefa-474f-9229-440f9ecec3fa tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.569804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53c0b172-cefa-474f-9229-440f9ecec3fa tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.571709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53c0b172-cefa-474f-9229-440f9ecec3fa tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.573820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53c0b172-cefa-474f-9229-440f9ecec3fa tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.605937 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-53c0b172-cefa-474f-9229-440f9ecec3fa tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] HTTP exception thrown: Instance 8df11745-2849-4490-9cb7-11b948d90254 could not be found. Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-53c0b172-cefa-474f-9229-440f9ecec3fa tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Request method failure captured: Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 HTTP/1.1 Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14LwP74voquJOtLNC80nY4ZOKAFurQEKphevt3p-NcmTDNTcaWLAg-fckOy-6qaK-Uj-RVjM3uvW0fJ5MaFo9LMosvXLySlQqG8Ey9DlZdPnuDB_iP3TZ5M6YQsQsoNbyd1UqrpYW2iCVzS94npO4hxJNvL7yAIupMlPI-7c7G6uq5M Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:24:38.624743 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:24:38.626536 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_baa5e3367dd747cda04291a3f97e7b02", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}] Jul 20 04:24:38.626536 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:38.626536 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:24:38.626536 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:38.626536 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:24:38.626536 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:24:38.626536 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:24:38.626536 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 23bf1fecf0c14154b1057a2ec35005a3 Jul 20 04:24:38.626536 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:24:38.626536 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:24:38.626536 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 8df11745-2849-4490-9cb7-11b948d90254 could not be found. Jul 20 04:24:38.626536 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '8df11745-2849-4490-9cb7-11b948d90254'} Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df11745-2849-4490-9cb7-11b948d90254 could not be found. Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:38.627373 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df11745-2849-4490-9cb7-11b948d90254 could not be found. Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df11745-2849-4490-9cb7-11b948d90254 could not be found. Jul 20 04:24:38.629081 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.630506 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-53c0b172-cefa-474f-9229-440f9ecec3fa tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Returning 404 to user: Instance 8df11745-2849-4490-9cb7-11b948d90254 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:38.630506 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-53c0b172-cefa-474f-9229-440f9ecec3fa tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 404 len: 111 microversion: 2.1 time: 0.100554 Jul 20 04:24:38.630506 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1386/2956] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:38 2022] DELETE /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:38.652125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0d4167a4-cb6b-4562-a76a-5548061afb8b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:38.655455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0d4167a4-cb6b-4562-a76a-5548061afb8b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 3261841a-a10c-46ba-8894-77e1e808de20] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:38.682348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d4167a4-cb6b-4562-a76a-5548061afb8b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.682804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d4167a4-cb6b-4562-a76a-5548061afb8b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.683602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d4167a4-cb6b-4562-a76a-5548061afb8b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.684038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d4167a4-cb6b-4562-a76a-5548061afb8b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.715562 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-0d4167a4-cb6b-4562-a76a-5548061afb8b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance 3261841a-a10c-46ba-8894-77e1e808de20 could not be found. Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0d4167a4-cb6b-4562-a76a-5548061afb8b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/3261841a-a10c-46ba-8894-77e1e808de20 HTTP/1.1 Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:24:38.720931 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:24:38.722651 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:24:38.722651 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:24:38.722651 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:24:38.722651 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:24:38.722651 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:24:38.722651 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:24:38.722651 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:24:38.722651 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:24:38.722651 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:24:38.722651 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:24:38.722651 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 3261841a-a10c-46ba-8894-77e1e808de20 could not be found. Jul 20 04:24:38.722651 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '3261841a-a10c-46ba-8894-77e1e808de20'} Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3261841a-a10c-46ba-8894-77e1e808de20 could not be found. Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:38.723751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:38.726075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:38.726075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:38.726075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:38.726075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:38.726075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:38.726075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:38.726075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:38.726075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3261841a-a10c-46ba-8894-77e1e808de20 could not be found. Jul 20 04:24:38.726075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.726075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:38.726075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.726075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:38.726075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:38.726075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:38.726075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:38.726075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:38.726075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3261841a-a10c-46ba-8894-77e1e808de20 could not be found. Jul 20 04:24:38.726075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.730174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0d4167a4-cb6b-4562-a76a-5548061afb8b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance 3261841a-a10c-46ba-8894-77e1e808de20 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:38.732212 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0d4167a4-cb6b-4562-a76a-5548061afb8b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/3261841a-a10c-46ba-8894-77e1e808de20" status: 404 len: 111 microversion: 2.1 time: 0.099825 Jul 20 04:24:38.733279 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1387/2957] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:38 2022] GET /compute/v2.1/servers/3261841a-a10c-46ba-8894-77e1e808de20 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:38.766511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-18b6df97-0501-4488-a925-921762bc21e1 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:38.767361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-18b6df97-0501-4488-a925-921762bc21e1 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 8df11745-2849-4490-9cb7-11b948d90254] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:38.790150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18b6df97-0501-4488-a925-921762bc21e1 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.792056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18b6df97-0501-4488-a925-921762bc21e1 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.797791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18b6df97-0501-4488-a925-921762bc21e1 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.799006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18b6df97-0501-4488-a925-921762bc21e1 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.846006 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-18b6df97-0501-4488-a925-921762bc21e1 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] HTTP exception thrown: Instance 8df11745-2849-4490-9cb7-11b948d90254 could not be found. Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-18b6df97-0501-4488-a925-921762bc21e1 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Request method failure captured: Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 HTTP/1.1 Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14LwP74voquJOtLNC80nY4ZOKAFurQEKphevt3p-NcmTDNTcaWLAg-fckOy-6qaK-Uj-RVjM3uvW0fJ5MaFo9LMosvXLySlQqG8Ey9DlZdPnuDB_iP3TZ5M6YQsQsoNbyd1UqrpYW2iCVzS94npO4hxJNvL7yAIupMlPI-7c7G6uq5M Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:24:38.848525 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:24:38.850015 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_baa5e3367dd747cda04291a3f97e7b02", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}] Jul 20 04:24:38.850015 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:38.850015 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:24:38.850015 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:38.850015 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:24:38.850015 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:24:38.850015 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:24:38.850015 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 23bf1fecf0c14154b1057a2ec35005a3 Jul 20 04:24:38.850015 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:24:38.850015 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:24:38.850015 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 8df11745-2849-4490-9cb7-11b948d90254 could not be found. Jul 20 04:24:38.850015 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '8df11745-2849-4490-9cb7-11b948d90254'} Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df11745-2849-4490-9cb7-11b948d90254 could not be found. Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:38.850825 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:38.852358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:38.852358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:38.852358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:38.852358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:38.852358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:38.852358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:38.852358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:38.852358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df11745-2849-4490-9cb7-11b948d90254 could not be found. Jul 20 04:24:38.852358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.852358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:38.852358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.852358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:38.852358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:38.852358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:38.852358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:38.852358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:38.852358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df11745-2849-4490-9cb7-11b948d90254 could not be found. Jul 20 04:24:38.852358 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.855634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-18b6df97-0501-4488-a925-921762bc21e1 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Returning 404 to user: Instance 8df11745-2849-4490-9cb7-11b948d90254 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:38.860851 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-18b6df97-0501-4488-a925-921762bc21e1 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254" status: 404 len: 111 microversion: 2.1 time: 0.116891 Jul 20 04:24:38.862398 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1388/2958] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:38 2022] GET /compute/v2.1/servers/8df11745-2849-4490-9cb7-11b948d90254 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:38.872413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4dbe736f-40d7-4849-aa23-3a10abf881e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-978049406", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "c3db3bfb-11a7-406a-b082-1e92336f5a21"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:38.880217 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4c61942c-3929-492d-ad84-c72c80b3fbbe tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1613 microversion: 2.1 time: 0.752046 Jul 20 04:24:38.881055 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1571/2959] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:38 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1613 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:38.889952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-beeb9aa3-d684-4673-a079-73589adaa8a6 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '.version_select at 0x7f06bd3fb5e0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:38.937963 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-beeb9aa3-d684-4673-a079-73589adaa8a6 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058420936" status: 202 len: 0 microversion: 2.1 time: 0.055744 Jul 20 04:24:38.938840 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1572/2960] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jul 20 04:24:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058420936 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:24:38.947785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-596ed561-35a7-48df-bb96-718732e1e3a6 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:38.950581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-596ed561-35a7-48df-bb96-718732e1e3a6 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:38.969742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-596ed561-35a7-48df-bb96-718732e1e3a6 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.971508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-596ed561-35a7-48df-bb96-718732e1e3a6 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.973680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-596ed561-35a7-48df-bb96-718732e1e3a6 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.974823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-596ed561-35a7-48df-bb96-718732e1e3a6 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.999556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-4dbe736f-40d7-4849-aa23-3a10abf881e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] validate_networks() for [('c3db3bfb-11a7-406a-b082-1e92336f5a21', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:24:39.056108 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-596ed561-35a7-48df-bb96-718732e1e3a6 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] HTTP exception thrown: Cannot 'migrate' instance c9bcf87e-6961-4469-bd73-169dd130076e while it is in vm_state suspended Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-596ed561-35a7-48df-bb96-718732e1e3a6 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Request method failure captured: Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e/action HTTP/1.1 Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 15 Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14NE1XhSIi-oaxdV-We_CNP45Xi-GGYqKV-cmgvjc7FKT-RhkTj7_f3Xghdh2a_t0qt342p6mo5tX6GujqAPsJr1EtOW_I-MV2rMgarJeD60bKtEj05CaKZPWMI9EIzm9U5P-hUgnHyEK2rirXMmED2vhfAZZZ7kVu-bRQS5_iR8TYs Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: a30f859268e540bd91319ab7d9f351e2 Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-912935600 Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:24:39.060603 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:24:39.063721 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a30f859268e540bd91319ab7d9f351e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a30f859268e540bd91319ab7d9f351e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a30f859268e540bd91319ab7d9f351e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a30f859268e540bd91319ab7d9f351e2"}]}] Jul 20 04:24:39.063721 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersAdminNegativeTestJSON-912935600 Jul 20 04:24:39.063721 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: a30f859268e540bd91319ab7d9f351e2 Jul 20 04:24:39.063721 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-912935600 Jul 20 04:24:39.063721 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersAdminNegativeTestJSON-912935600-project-admin Jul 20 04:24:39.063721 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:24:39.063721 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:24:39.063721 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 44fa42fc036b4551a7969c3015c04874 Jul 20 04:24:39.063721 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersAdminNegativeTestJSON-912935600-project-admin Jul 20 04:24:39.063721 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:24:39.063721 n-d-826526-5 devstack@n-api.service[127871]: {"migrate": {}} Jul 20 04:24:39.063721 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:24:39.063721 n-d-826526-5 devstack@n-api.service[127871]: exception: Cannot 'migrate' instance c9bcf87e-6961-4469-bd73-169dd130076e while it is in vm_state suspended Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'c9bcf87e-6961-4469-bd73-169dd130076e', 'body': {'migrate': {}}} Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c9bcf87e-6961-4469-bd73-169dd130076e in vm_state suspended. Cannot resize while the instance is in this state. Jul 20 04:24:39.065660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance c9bcf87e-6961-4469-bd73-169dd130076e while it is in vm_state suspended Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.075742 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:39.078704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:39.078704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:39.078704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:39.078704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:39.078704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance c9bcf87e-6961-4469-bd73-169dd130076e while it is in vm_state suspended Jul 20 04:24:39.078704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.078704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-596ed561-35a7-48df-bb96-718732e1e3a6 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Returning 409 to user: Cannot 'migrate' instance c9bcf87e-6961-4469-bd73-169dd130076e while it is in vm_state suspended {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:39.078704 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-596ed561-35a7-48df-bb96-718732e1e3a6 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e/action" status: 409 len: 148 microversion: 2.1 time: 0.122504 Jul 20 04:24:39.078704 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1573/2961] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:38 2022] POST /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e/action => generated 148 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-75d9c468-496f-429e-a72b-133326646d37 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-75d9c468-496f-429e-a72b-133326646d37 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Request method failure captured: Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce/action HTTP/1.1 Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 39 Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14NE1XhSIi-oaxdV-We_CNP45Xi-GGYqKV-cmgvjc7FKT-RhkTj7_f3Xghdh2a_t0qt342p6mo5tX6GujqAPsJr1EtOW_I-MV2rMgarJeD60bKtEj05CaKZPWMI9EIzm9U5P-hUgnHyEK2rirXMmED2vhfAZZZ7kVu-bRQS5_iR8TYs Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: a30f859268e540bd91319ab7d9f351e2 Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-912935600 Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:24:39.080116 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:24:39.087086 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a30f859268e540bd91319ab7d9f351e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a30f859268e540bd91319ab7d9f351e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a30f859268e540bd91319ab7d9f351e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a30f859268e540bd91319ab7d9f351e2"}]}] Jul 20 04:24:39.087086 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersAdminNegativeTestJSON-912935600 Jul 20 04:24:39.087086 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: a30f859268e540bd91319ab7d9f351e2 Jul 20 04:24:39.087086 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-912935600 Jul 20 04:24:39.087086 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersAdminNegativeTestJSON-912935600-project-admin Jul 20 04:24:39.087086 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:24:39.087086 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:24:39.087086 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 44fa42fc036b4551a7969c3015c04874 Jul 20 04:24:39.087086 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersAdminNegativeTestJSON-912935600-project-admin Jul 20 04:24:39.087086 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:24:39.087086 n-d-826526-5 devstack@n-api.service[127871]: {"os-resetState": {"state": "invalid"}} Jul 20 04:24:39.087086 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '8eb30445-55ef-4283-affc-ae1b7533b9ce', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:39.088844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:24:39.096807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 20 04:24:39.100653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.100653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-75d9c468-496f-429e-a72b-133326646d37 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:39.100653 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-75d9c468-496f-429e-a72b-133326646d37 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce/action" status: 400 len: 144 microversion: 2.1 time: 0.008041 Jul 20 04:24:39.100653 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1574/2962] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:39 2022] POST /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce/action => generated 144 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:24:39.111722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-953618c9-c422-480f-a3b9-30127fbc7093 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-953618c9-c422-480f-a3b9-30127fbc7093 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Request method failure captured: Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce/action HTTP/1.1 Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 31 Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14NE1XhSIi-oaxdV-We_CNP45Xi-GGYqKV-cmgvjc7FKT-RhkTj7_f3Xghdh2a_t0qt342p6mo5tX6GujqAPsJr1EtOW_I-MV2rMgarJeD60bKtEj05CaKZPWMI9EIzm9U5P-hUgnHyEK2rirXMmED2vhfAZZZ7kVu-bRQS5_iR8TYs Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: a30f859268e540bd91319ab7d9f351e2 Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-912935600 Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:24:39.115644 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:24:39.118748 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a30f859268e540bd91319ab7d9f351e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a30f859268e540bd91319ab7d9f351e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a30f859268e540bd91319ab7d9f351e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a30f859268e540bd91319ab7d9f351e2"}]}] Jul 20 04:24:39.118748 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersAdminNegativeTestJSON-912935600 Jul 20 04:24:39.118748 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: a30f859268e540bd91319ab7d9f351e2 Jul 20 04:24:39.118748 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-912935600 Jul 20 04:24:39.118748 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersAdminNegativeTestJSON-912935600-project-admin Jul 20 04:24:39.118748 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:24:39.118748 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:24:39.118748 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 44fa42fc036b4551a7969c3015c04874 Jul 20 04:24:39.118748 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersAdminNegativeTestJSON-912935600-project-admin Jul 20 04:24:39.118748 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:24:39.118748 n-d-826526-5 devstack@n-api.service[127871]: {"os-resetState": {"state": 1}} Jul 20 04:24:39.118748 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:24:39.118748 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '8eb30445-55ef-4283-affc-ae1b7533b9ce', 'body': {'os-resetState': {'state': 1}}} Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 1 Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:39.120497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 20 04:24:39.123257 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.125910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-953618c9-c422-480f-a3b9-30127fbc7093 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:39.125910 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-953618c9-c422-480f-a3b9-30127fbc7093 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce/action" status: 400 len: 120 microversion: 2.1 time: 0.023245 Jul 20 04:24:39.125910 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1575/2963] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:39 2022] POST /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce/action => generated 120 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:24:39.140036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-64add6e4-3e0b-4472-875d-f361bae7ed36 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:39.144623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-64add6e4-3e0b-4472-875d-f361bae7ed36 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Failed to fetch instance by id 999 {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:24:39.145316 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-64add6e4-3e0b-4472-875d-f361bae7ed36 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-64add6e4-3e0b-4472-875d-f361bae7ed36 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Request method failure captured: Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 37 Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14NE1XhSIi-oaxdV-We_CNP45Xi-GGYqKV-cmgvjc7FKT-RhkTj7_f3Xghdh2a_t0qt342p6mo5tX6GujqAPsJr1EtOW_I-MV2rMgarJeD60bKtEj05CaKZPWMI9EIzm9U5P-hUgnHyEK2rirXMmED2vhfAZZZ7kVu-bRQS5_iR8TYs Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: a30f859268e540bd91319ab7d9f351e2 Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-912935600 Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:24:39.153753 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:24:39.156853 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a30f859268e540bd91319ab7d9f351e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a30f859268e540bd91319ab7d9f351e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a30f859268e540bd91319ab7d9f351e2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a30f859268e540bd91319ab7d9f351e2"}]}] Jul 20 04:24:39.156853 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersAdminNegativeTestJSON-912935600 Jul 20 04:24:39.156853 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: a30f859268e540bd91319ab7d9f351e2 Jul 20 04:24:39.156853 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-912935600 Jul 20 04:24:39.156853 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersAdminNegativeTestJSON-912935600-project-admin Jul 20 04:24:39.156853 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:24:39.156853 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:24:39.156853 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 44fa42fc036b4551a7969c3015c04874 Jul 20 04:24:39.156853 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersAdminNegativeTestJSON-912935600-project-admin Jul 20 04:24:39.156853 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:24:39.156853 n-d-826526-5 devstack@n-api.service[127871]: {"os-resetState": {"state": "error"}} Jul 20 04:24:39.156853 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:24:39.156853 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 999 could not be found. Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:39.158571 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 20 04:24:39.162003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:24:39.162003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:39.162003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:39.162003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 20 04:24:39.162003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.162003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:39.162003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.162003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:39.162003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:39.162003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:39.162003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:39.162003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:39.162003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 20 04:24:39.162003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:39.162003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-64add6e4-3e0b-4472-875d-f361bae7ed36 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:39.162003 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-64add6e4-3e0b-4472-875d-f361bae7ed36 tempest-ServersAdminNegativeTestJSON-912935600 tempest-ServersAdminNegativeTestJSON-912935600-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.026845 Jul 20 04:24:39.165085 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1576/2964] 10.222.0.17 () {60 vars in 1178 bytes} [Wed Jul 20 04:24:39 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:24:39.170516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b08c381b-87f6-4a5c-9b25-c08ae58e1339 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:39.171364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b08c381b-87f6-4a5c-9b25-c08ae58e1339 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:39.201331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b08c381b-87f6-4a5c-9b25-c08ae58e1339 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:39.202113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b08c381b-87f6-4a5c-9b25-c08ae58e1339 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:39.204664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b08c381b-87f6-4a5c-9b25-c08ae58e1339 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:39.205833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b08c381b-87f6-4a5c-9b25-c08ae58e1339 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:39.269944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b08c381b-87f6-4a5c-9b25-c08ae58e1339 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:39.447054 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b08c381b-87f6-4a5c-9b25-c08ae58e1339 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 204 len: 0 microversion: 2.1 time: 0.283855 Jul 20 04:24:39.447674 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1577/2965] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:39 2022] DELETE /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:39.469873 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-72eeb17f-9c15-4131-9da2-f6c18dbf24ba tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:39.471574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-72eeb17f-9c15-4131-9da2-f6c18dbf24ba tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:39.487982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72eeb17f-9c15-4131-9da2-f6c18dbf24ba tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:39.492463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72eeb17f-9c15-4131-9da2-f6c18dbf24ba tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:39.495074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72eeb17f-9c15-4131-9da2-f6c18dbf24ba tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:39.496006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72eeb17f-9c15-4131-9da2-f6c18dbf24ba tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:39.773987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-72eeb17f-9c15-4131-9da2-f6c18dbf24ba tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:39.795963 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-72eeb17f-9c15-4131-9da2-f6c18dbf24ba tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1468 microversion: 2.1 time: 0.343334 Jul 20 04:24:39.804310 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1578/2966] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:39 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1468 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:40.825135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ac7e2a23-3cfb-4655-a869-02337d26769a tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:40.827958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ac7e2a23-3cfb-4655-a869-02337d26769a tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:40.862247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac7e2a23-3cfb-4655-a869-02337d26769a tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:40.864900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac7e2a23-3cfb-4655-a869-02337d26769a tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:40.866622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac7e2a23-3cfb-4655-a869-02337d26769a tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:40.873554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac7e2a23-3cfb-4655-a869-02337d26769a tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:40.878653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:41.041194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-4dbe736f-40d7-4849-aa23-3a10abf881e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:24:41.041751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-4dbe736f-40d7-4849-aa23-3a10abf881e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:24:41.042551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-4dbe736f-40d7-4849-aa23-3a10abf881e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:24:41.043264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-4dbe736f-40d7-4849-aa23-3a10abf881e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:24:41.043962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-4dbe736f-40d7-4849-aa23-3a10abf881e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:24:41.081834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4dbe736f-40d7-4849-aa23-3a10abf881e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:41.082533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4dbe736f-40d7-4849-aa23-3a10abf881e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:41.083477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4dbe736f-40d7-4849-aa23-3a10abf881e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:41.083930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4dbe736f-40d7-4849-aa23-3a10abf881e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:41.151705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-4dbe736f-40d7-4849-aa23-3a10abf881e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Getting quotas for project ae67de1fefe64bd19a3bf614f02d3535. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:41.170451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-4dbe736f-40d7-4849-aa23-3a10abf881e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Getting quotas for user 1dc60058bea0485ebd4d502b2e7c986b and project ae67de1fefe64bd19a3bf614f02d3535. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:41.205445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4dbe736f-40d7-4849-aa23-3a10abf881e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:24:41.210013 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4dbe736f-40d7-4849-aa23-3a10abf881e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:24:41.356609 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4dbe736f-40d7-4849-aa23-3a10abf881e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.492108 Jul 20 04:24:41.357783 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1389/2967] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:24:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:24:41.379780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-899e8613-a149-4051-9340-575281fd99ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:41.380790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-899e8613-a149-4051-9340-575281fd99ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:41.624350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-899e8613-a149-4051-9340-575281fd99ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:41.651811 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-899e8613-a149-4051-9340-575281fd99ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1214 microversion: 2.1 time: 0.285130 Jul 20 04:24:41.658164 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1390/2968] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:41 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1214 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:42.272172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ac7e2a23-3cfb-4655-a869-02337d26769a tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:42.288808 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ac7e2a23-3cfb-4655-a869-02337d26769a tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1468 microversion: 2.1 time: 1.472547 Jul 20 04:24:42.312037 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1579/2969] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:40 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1468 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:42.690301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b4c587df-0a0c-454c-a9a3-cfb90990cb50 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:42.692317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b4c587df-0a0c-454c-a9a3-cfb90990cb50 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:42.721880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b4c587df-0a0c-454c-a9a3-cfb90990cb50 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.723883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b4c587df-0a0c-454c-a9a3-cfb90990cb50 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.724987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b4c587df-0a0c-454c-a9a3-cfb90990cb50 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.734024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b4c587df-0a0c-454c-a9a3-cfb90990cb50 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:43.316675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-388085bc-717d-44a2-b9dd-759f622e86e6 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:43.319021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-388085bc-717d-44a2-b9dd-759f622e86e6 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:43.337697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-388085bc-717d-44a2-b9dd-759f622e86e6 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:43.338816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-388085bc-717d-44a2-b9dd-759f622e86e6 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:43.339792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-388085bc-717d-44a2-b9dd-759f622e86e6 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:43.340631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-388085bc-717d-44a2-b9dd-759f622e86e6 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:43.473747 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b4c587df-0a0c-454c-a9a3-cfb90990cb50 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:43.477903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:43.491379 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b4c587df-0a0c-454c-a9a3-cfb90990cb50 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1210 microversion: 2.1 time: 0.805863 Jul 20 04:24:43.494954 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1391/2970] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:42 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1210 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:43.840889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-388085bc-717d-44a2-b9dd-759f622e86e6 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:43.855942 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-388085bc-717d-44a2-b9dd-759f622e86e6 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1468 microversion: 2.1 time: 0.543922 Jul 20 04:24:43.867689 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1580/2971] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:43 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1468 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:44.285053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-47111e89-dddf-45f0-9d19-ecff68fe5b01 req-c77e6449-fa11-4961-bcb7-3b32510778ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9bcf87e-6961-4469-bd73-169dd130076e", "name": "network-vif-deleted", "tag": "530a82b1-42dc-4520-ae04-23d495237c23"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:44.316032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-47111e89-dddf-45f0-9d19-ecff68fe5b01 req-c77e6449-fa11-4961-bcb7-3b32510778ad service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.318899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-47111e89-dddf-45f0-9d19-ecff68fe5b01 req-c77e6449-fa11-4961-bcb7-3b32510778ad service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.358132 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-47111e89-dddf-45f0-9d19-ecff68fe5b01 req-c77e6449-fa11-4961-bcb7-3b32510778ad service nova] Creating event network-vif-deleted:530a82b1-42dc-4520-ae04-23d495237c23 for instance c9bcf87e-6961-4469-bd73-169dd130076e on n-h1-826526-5 Jul 20 04:24:44.373353 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-47111e89-dddf-45f0-9d19-ecff68fe5b01 req-c77e6449-fa11-4961-bcb7-3b32510778ad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095112 Jul 20 04:24:44.374249 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1392/2972] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:24:44.513016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cd1585a1-432a-44b5-8eaa-0db46f438a12 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.513620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cd1585a1-432a-44b5-8eaa-0db46f438a12 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:44.533788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd1585a1-432a-44b5-8eaa-0db46f438a12 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.535758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd1585a1-432a-44b5-8eaa-0db46f438a12 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.536976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd1585a1-432a-44b5-8eaa-0db46f438a12 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.539638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd1585a1-432a-44b5-8eaa-0db46f438a12 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.637008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-64961824-becf-48ee-8456-d221c162dfe4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '.version_select at 0x7f06bd502a60>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.674532 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-64961824-becf-48ee-8456-d221c162dfe4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] HTTP exception thrown: Image not found. Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-64961824-becf-48ee-8456-d221c162dfe4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Request method failure captured: Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/images/25424b03-a504-4f73-8830-d0fdf969a3ca HTTP/1.1 Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14LwP74voquJOtLNC80nY4ZOKAFurQEKphevt3p-NcmTDNTcaWLAg-fckOy-6qaK-Uj-RVjM3uvW0fJ5MaFo9LMosvXLySlQqG8Ey9DlZdPnuDB_iP3TZ5M6YQsQsoNbyd1UqrpYW2iCVzS94npO4hxJNvL7yAIupMlPI-7c7G6uq5M Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:24:44.678814 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:24:44.680918 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_baa5e3367dd747cda04291a3f97e7b02", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}] Jul 20 04:24:44.680918 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:44.680918 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:24:44.680918 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:44.680918 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:24:44.680918 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:24:44.680918 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:24:44.680918 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 23bf1fecf0c14154b1057a2ec35005a3 Jul 20 04:24:44.680918 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:24:44.680918 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:24:44.680918 n-d-826526-5 devstack@n-api.service[127870]: exception: Image not found. Jul 20 04:24:44.680918 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '25424b03-a504-4f73-8830-d0fdf969a3ca'} Jul 20 04:24:44.680918 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 25424b03-a504-4f73-8830-d0fdf969a3ca to delete Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.681907 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 25424b03-a504-4f73-8830-d0fdf969a3ca could not be found. Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:44.683386 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:44.684772 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:24:44.684772 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:24:44.684772 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:24:44.684772 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.684772 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.684772 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.684772 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.684772 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:44.684772 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:44.684772 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:44.684772 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:44.684772 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:24:44.684772 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.684772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-64961824-becf-48ee-8456-d221c162dfe4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Returning 404 to user: Image not found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:44.684772 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-64961824-becf-48ee-8456-d221c162dfe4 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "DELETE /compute/v2.1/images/25424b03-a504-4f73-8830-d0fdf969a3ca" status: 404 len: 62 microversion: 2.1 time: 0.048822 Jul 20 04:24:44.685811 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1393/2973] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:44 2022] DELETE /compute/v2.1/images/25424b03-a504-4f73-8830-d0fdf969a3ca => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:24:44.691853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e946538a-01c3-47de-a2cb-b3baf603a011 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.692518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e946538a-01c3-47de-a2cb-b3baf603a011 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:44.701796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e946538a-01c3-47de-a2cb-b3baf603a011 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.702259 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e946538a-01c3-47de-a2cb-b3baf603a011 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.703118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e946538a-01c3-47de-a2cb-b3baf603a011 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.703567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e946538a-01c3-47de-a2cb-b3baf603a011 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.725785 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-e946538a-01c3-47de-a2cb-b3baf603a011 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] HTTP exception thrown: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 could not be found. Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e946538a-01c3-47de-a2cb-b3baf603a011 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Request method failure captured: Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 HTTP/1.1 Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14LwP74voquJOtLNC80nY4ZOKAFurQEKphevt3p-NcmTDNTcaWLAg-fckOy-6qaK-Uj-RVjM3uvW0fJ5MaFo9LMosvXLySlQqG8Ey9DlZdPnuDB_iP3TZ5M6YQsQsoNbyd1UqrpYW2iCVzS94npO4hxJNvL7yAIupMlPI-7c7G6uq5M Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:24:44.728333 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:24:44.730047 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_baa5e3367dd747cda04291a3f97e7b02", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}] Jul 20 04:24:44.730047 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:44.730047 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:24:44.730047 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:44.730047 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:24:44.730047 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:24:44.730047 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:24:44.730047 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 23bf1fecf0c14154b1057a2ec35005a3 Jul 20 04:24:44.730047 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:24:44.730047 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:24:44.730047 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 could not be found. Jul 20 04:24:44.730047 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55'} Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 could not be found. Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:44.731047 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 could not be found. Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 could not be found. Jul 20 04:24:44.732867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.736329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e946538a-01c3-47de-a2cb-b3baf603a011 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Returning 404 to user: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:44.737826 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e946538a-01c3-47de-a2cb-b3baf603a011 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 404 len: 111 microversion: 2.1 time: 0.051075 Jul 20 04:24:44.739075 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1394/2974] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:44 2022] DELETE /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:44.749816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3aead6b8-afd7-44ce-8a12-33e669383911 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.750907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3aead6b8-afd7-44ce-8a12-33e669383911 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] [instance: 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:44.762617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3aead6b8-afd7-44ce-8a12-33e669383911 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.763365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3aead6b8-afd7-44ce-8a12-33e669383911 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.764751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3aead6b8-afd7-44ce-8a12-33e669383911 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.766175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3aead6b8-afd7-44ce-8a12-33e669383911 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.778455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cd1585a1-432a-44b5-8eaa-0db46f438a12 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:44.796244 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cd1585a1-432a-44b5-8eaa-0db46f438a12 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1272 microversion: 2.1 time: 0.286911 Jul 20 04:24:44.797753 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-3aead6b8-afd7-44ce-8a12-33e669383911 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] HTTP exception thrown: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 could not be found. Jul 20 04:24:44.812885 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1581/2975] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:44 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1272 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3aead6b8-afd7-44ce-8a12-33e669383911 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Request method failure captured: Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 HTTP/1.1 Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14LwP74voquJOtLNC80nY4ZOKAFurQEKphevt3p-NcmTDNTcaWLAg-fckOy-6qaK-Uj-RVjM3uvW0fJ5MaFo9LMosvXLySlQqG8Ey9DlZdPnuDB_iP3TZ5M6YQsQsoNbyd1UqrpYW2iCVzS94npO4hxJNvL7yAIupMlPI-7c7G6uq5M Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:24:44.822248 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:24:44.824555 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/baa5e3367dd747cda04291a3f97e7b02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_baa5e3367dd747cda04291a3f97e7b02", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/baa5e3367dd747cda04291a3f97e7b02"}]}] Jul 20 04:24:44.824555 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:44.824555 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: baa5e3367dd747cda04291a3f97e7b02 Jul 20 04:24:44.824555 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079 Jul 20 04:24:44.824555 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:24:44.824555 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:24:44.824555 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:24:44.824555 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 23bf1fecf0c14154b1057a2ec35005a3 Jul 20 04:24:44.824555 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1735194079-project Jul 20 04:24:44.824555 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:24:44.824555 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 could not be found. Jul 20 04:24:44.824555 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55'} Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 could not be found. Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:44.825582 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:44.827299 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:44.827299 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:44.827299 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:44.827299 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:44.827299 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:44.827299 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:44.827299 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:44.827299 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 could not be found. Jul 20 04:24:44.827299 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.827299 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.827299 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.827299 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.827299 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:44.827299 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:44.827299 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:44.827299 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:44.827299 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 could not be found. Jul 20 04:24:44.827299 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.831108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3aead6b8-afd7-44ce-8a12-33e669383911 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] Returning 404 to user: Instance 5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:44.833742 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3aead6b8-afd7-44ce-8a12-33e669383911 tempest-ImagesOneServerNegativeTestJSON-1735194079 tempest-ImagesOneServerNegativeTestJSON-1735194079-project] 10.222.0.17 "GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55" status: 404 len: 111 microversion: 2.1 time: 0.089843 Jul 20 04:24:44.839051 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1395/2976] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:44 2022] GET /compute/v2.1/servers/5e96e6fa-d7a9-4d63-b17c-43d6bcea0a55 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:24:44.890190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-56e2d205-bf32-4f75-bcb4-6269e5617b4b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.899785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-56e2d205-bf32-4f75-bcb4-6269e5617b4b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:44.917403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56e2d205-bf32-4f75-bcb4-6269e5617b4b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.924076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56e2d205-bf32-4f75-bcb4-6269e5617b4b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.925774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56e2d205-bf32-4f75-bcb4-6269e5617b4b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.927791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56e2d205-bf32-4f75-bcb4-6269e5617b4b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.079071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56e2d205-bf32-4f75-bcb4-6269e5617b4b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.079852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56e2d205-bf32-4f75-bcb4-6269e5617b4b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.080716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-56e2d205-bf32-4f75-bcb4-6269e5617b4b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lazy-loading 'fault' on Instance uuid c9bcf87e-6961-4469-bd73-169dd130076e {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:45.230455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-56e2d205-bf32-4f75-bcb4-6269e5617b4b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:45.255986 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-56e2d205-bf32-4f75-bcb4-6269e5617b4b tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 200 len: 1311 microversion: 2.1 time: 0.362526 Jul 20 04:24:45.256832 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1582/2977] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:44 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 1311 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:45.828365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6f5d9993-e33e-4da9-8350-955e88b588d6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:45.830612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6f5d9993-e33e-4da9-8350-955e88b588d6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:45.842092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f5d9993-e33e-4da9-8350-955e88b588d6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.843219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f5d9993-e33e-4da9-8350-955e88b588d6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.844245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f5d9993-e33e-4da9-8350-955e88b588d6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.844913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f5d9993-e33e-4da9-8350-955e88b588d6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.194540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6f5d9993-e33e-4da9-8350-955e88b588d6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:46.213344 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6f5d9993-e33e-4da9-8350-955e88b588d6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1272 microversion: 2.1 time: 0.394138 Jul 20 04:24:46.214442 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1396/2978] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:45 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1272 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:46.288004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-33d15867-45a2-409c-80f3-6392dfff7de1 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:46.289283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-33d15867-45a2-409c-80f3-6392dfff7de1 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: c9bcf87e-6961-4469-bd73-169dd130076e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:46.295581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:46.312108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33d15867-45a2-409c-80f3-6392dfff7de1 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.313136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33d15867-45a2-409c-80f3-6392dfff7de1 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.317244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33d15867-45a2-409c-80f3-6392dfff7de1 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.319465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33d15867-45a2-409c-80f3-6392dfff7de1 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.358938 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-33d15867-45a2-409c-80f3-6392dfff7de1 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] HTTP exception thrown: Instance c9bcf87e-6961-4469-bd73-169dd130076e could not be found. Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-33d15867-45a2-409c-80f3-6392dfff7de1 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Request method failure captured: Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e HTTP/1.1 Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14NDyHoRpZfZCxVMxdO6tk92vdXW6TiYDHMw7wnPPQDekS5pTRMEXhF4-st4eknoBD3Kgk-olkne3dmngYBCE6K5ZdaxidatjBMiHgrValnMzYS8OamZhAbfbgb5RFEp2BhtfvkSm7afYMs2W0GCwKtCHwW6airAeSwY5x2JgEGqMcI Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 1b71d158148441319721ea98ef6f799d Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-480751451 Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:24:46.360678 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:24:46.362185 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1b71d158148441319721ea98ef6f799d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1b71d158148441319721ea98ef6f799d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1b71d158148441319721ea98ef6f799d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1b71d158148441319721ea98ef6f799d"}]}] Jul 20 04:24:46.362185 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersAdminNegativeTestJSON-480751451 Jul 20 04:24:46.362185 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 1b71d158148441319721ea98ef6f799d Jul 20 04:24:46.362185 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-480751451 Jul 20 04:24:46.362185 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersAdminNegativeTestJSON-480751451-project Jul 20 04:24:46.362185 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:24:46.362185 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:24:46.362185 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 953c7e68040540c2b46a2d5a79fd60d0 Jul 20 04:24:46.362185 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersAdminNegativeTestJSON-480751451-project Jul 20 04:24:46.362185 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:24:46.362185 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance c9bcf87e-6961-4469-bd73-169dd130076e could not be found. Jul 20 04:24:46.362185 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'c9bcf87e-6961-4469-bd73-169dd130076e'} Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9bcf87e-6961-4469-bd73-169dd130076e could not be found. Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:46.363212 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:46.365996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:46.365996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:46.365996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:46.365996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:46.365996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:46.365996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:46.365996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:46.365996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9bcf87e-6961-4469-bd73-169dd130076e could not be found. Jul 20 04:24:46.365996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:46.365996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:46.365996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:46.365996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:46.365996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:46.365996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:46.365996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:46.365996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:46.365996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9bcf87e-6961-4469-bd73-169dd130076e could not be found. Jul 20 04:24:46.365996 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:24:46.368665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-33d15867-45a2-409c-80f3-6392dfff7de1 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Returning 404 to user: Instance c9bcf87e-6961-4469-bd73-169dd130076e could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:46.368665 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-33d15867-45a2-409c-80f3-6392dfff7de1 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e" status: 404 len: 111 microversion: 2.1 time: 0.081447 Jul 20 04:24:46.372565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5e655d34-9e36-4915-a0dd-ee4786d60c96 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:46.373079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5e655d34-9e36-4915-a0dd-ee4786d60c96 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:46.391363 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1583/2979] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:46 2022] GET /compute/v2.1/servers/c9bcf87e-6961-4469-bd73-169dd130076e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:46.392397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:46.415648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e655d34-9e36-4915-a0dd-ee4786d60c96 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.418351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e655d34-9e36-4915-a0dd-ee4786d60c96 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.419251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e655d34-9e36-4915-a0dd-ee4786d60c96 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.419703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e655d34-9e36-4915-a0dd-ee4786d60c96 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.513455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5e655d34-9e36-4915-a0dd-ee4786d60c96 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:46.731023 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5e655d34-9e36-4915-a0dd-ee4786d60c96 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 204 len: 0 microversion: 2.1 time: 0.358735 Jul 20 04:24:46.733157 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1397/2980] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:46 2022] DELETE /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:46.749583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-79f3a436-5d2b-4c95-acd6-2c7f177b5916 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:46.751285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-79f3a436-5d2b-4c95-acd6-2c7f177b5916 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:46.770659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-79f3a436-5d2b-4c95-acd6-2c7f177b5916 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.772083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-79f3a436-5d2b-4c95-acd6-2c7f177b5916 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.776196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-79f3a436-5d2b-4c95-acd6-2c7f177b5916 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.777869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-79f3a436-5d2b-4c95-acd6-2c7f177b5916 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:47.238327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9dc3573f-5dee-45f4-a002-1efcdb5118f6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:47.239664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9dc3573f-5dee-45f4-a002-1efcdb5118f6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:47.254337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9dc3573f-5dee-45f4-a002-1efcdb5118f6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:47.258011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9dc3573f-5dee-45f4-a002-1efcdb5118f6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:47.261019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9dc3573f-5dee-45f4-a002-1efcdb5118f6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:47.264220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9dc3573f-5dee-45f4-a002-1efcdb5118f6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:47.399612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=8 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:47.465710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-79f3a436-5d2b-4c95-acd6-2c7f177b5916 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:47.502094 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-79f3a436-5d2b-4c95-acd6-2c7f177b5916 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 200 len: 1477 microversion: 2.1 time: 0.764057 Jul 20 04:24:47.511681 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1584/2981] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:46 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 1477 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:48.528586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d3463ebf-2c47-481c-8e72-e6d2f55c1e83 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:48.529272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d3463ebf-2c47-481c-8e72-e6d2f55c1e83 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:48.552488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3463ebf-2c47-481c-8e72-e6d2f55c1e83 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.552787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3463ebf-2c47-481c-8e72-e6d2f55c1e83 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.553706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3463ebf-2c47-481c-8e72-e6d2f55c1e83 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.554220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3463ebf-2c47-481c-8e72-e6d2f55c1e83 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.195632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9dc3573f-5dee-45f4-a002-1efcdb5118f6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:49.210925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d3463ebf-2c47-481c-8e72-e6d2f55c1e83 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:49.211618 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9dc3573f-5dee-45f4-a002-1efcdb5118f6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1314 microversion: 2.1 time: 1.984491 Jul 20 04:24:49.223104 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1398/2982] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:47 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1314 bytes in 1996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:49.231119 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d3463ebf-2c47-481c-8e72-e6d2f55c1e83 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 200 len: 1477 microversion: 2.1 time: 0.704550 Jul 20 04:24:49.232901 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1585/2983] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:48 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 1477 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:49.710407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-482510f8-fedb-4003-a571-0c92ab754c88 req-2357aaae-2b84-44eb-972c-ff4a7416e1cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb30445-55ef-4283-affc-ae1b7533b9ce", "name": "network-vif-deleted", "tag": "62519a2b-711d-43b9-bf4e-2422facec33e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:49.729433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-482510f8-fedb-4003-a571-0c92ab754c88 req-2357aaae-2b84-44eb-972c-ff4a7416e1cd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.729956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-482510f8-fedb-4003-a571-0c92ab754c88 req-2357aaae-2b84-44eb-972c-ff4a7416e1cd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.751246 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-482510f8-fedb-4003-a571-0c92ab754c88 req-2357aaae-2b84-44eb-972c-ff4a7416e1cd service nova] Creating event network-vif-deleted:62519a2b-711d-43b9-bf4e-2422facec33e for instance 8eb30445-55ef-4283-affc-ae1b7533b9ce on n-h1-826526-5 Jul 20 04:24:49.761309 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-482510f8-fedb-4003-a571-0c92ab754c88 req-2357aaae-2b84-44eb-972c-ff4a7416e1cd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055269 Jul 20 04:24:49.768201 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1399/2984] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:50.233621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-407bf878-b5cc-4e90-af95-89635c577917 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:50.234653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-407bf878-b5cc-4e90-af95-89635c577917 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:50.262384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7d0f3076-fdb1-4d9f-ad6b-ee054b9cea29 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:50.268810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7d0f3076-fdb1-4d9f-ad6b-ee054b9cea29 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:50.293222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-407bf878-b5cc-4e90-af95-89635c577917 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.296772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d0f3076-fdb1-4d9f-ad6b-ee054b9cea29 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.298596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-407bf878-b5cc-4e90-af95-89635c577917 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.301609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-407bf878-b5cc-4e90-af95-89635c577917 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.302380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-407bf878-b5cc-4e90-af95-89635c577917 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.304656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d0f3076-fdb1-4d9f-ad6b-ee054b9cea29 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.306274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d0f3076-fdb1-4d9f-ad6b-ee054b9cea29 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.313135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d0f3076-fdb1-4d9f-ad6b-ee054b9cea29 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.435336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d0f3076-fdb1-4d9f-ad6b-ee054b9cea29 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.438945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d0f3076-fdb1-4d9f-ad6b-ee054b9cea29 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.443106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-7d0f3076-fdb1-4d9f-ad6b-ee054b9cea29 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lazy-loading 'fault' on Instance uuid 8eb30445-55ef-4283-affc-ae1b7533b9ce {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:50.698308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7d0f3076-fdb1-4d9f-ad6b-ee054b9cea29 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953c7e68040540c2b46a2d5a79fd60d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b71d158148441319721ea98ef6f799d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:50.711317 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7d0f3076-fdb1-4d9f-ad6b-ee054b9cea29 tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 200 len: 1311 microversion: 2.1 time: 0.456111 Jul 20 04:24:50.712079 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1400/2985] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:50 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 1311 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:50.736043 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-407bf878-b5cc-4e90-af95-89635c577917 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:50.750664 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-407bf878-b5cc-4e90-af95-89635c577917 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1314 microversion: 2.1 time: 0.524654 Jul 20 04:24:50.762836 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1586/2986] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:50 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:51.745799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-92e3124e-4651-462b-9178-2acce37c840e tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:51.749427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-92e3124e-4651-462b-9178-2acce37c840e tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] [instance: 8eb30445-55ef-4283-affc-ae1b7533b9ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:51.762834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:51.773437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-afdd8576-b705-448f-b3d9-e2d4f183a92a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:51.774322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-afdd8576-b705-448f-b3d9-e2d4f183a92a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:51.784059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=10 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:51.814923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afdd8576-b705-448f-b3d9-e2d4f183a92a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:51.821790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afdd8576-b705-448f-b3d9-e2d4f183a92a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:51.822948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afdd8576-b705-448f-b3d9-e2d4f183a92a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:51.823403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afdd8576-b705-448f-b3d9-e2d4f183a92a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:51.836021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92e3124e-4651-462b-9178-2acce37c840e tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:51.837936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92e3124e-4651-462b-9178-2acce37c840e tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:51.842391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92e3124e-4651-462b-9178-2acce37c840e tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:51.844922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92e3124e-4651-462b-9178-2acce37c840e tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:51.886888 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-92e3124e-4651-462b-9178-2acce37c840e tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] HTTP exception thrown: Instance 8eb30445-55ef-4283-affc-ae1b7533b9ce could not be found. Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-92e3124e-4651-462b-9178-2acce37c840e tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Request method failure captured: Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce HTTP/1.1 Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14NDyHoRpZfZCxVMxdO6tk92vdXW6TiYDHMw7wnPPQDekS5pTRMEXhF4-st4eknoBD3Kgk-olkne3dmngYBCE6K5ZdaxidatjBMiHgrValnMzYS8OamZhAbfbgb5RFEp2BhtfvkSm7afYMs2W0GCwKtCHwW6airAeSwY5x2JgEGqMcI Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 1b71d158148441319721ea98ef6f799d Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-480751451 Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:24:51.895753 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:24:51.897482 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1b71d158148441319721ea98ef6f799d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1b71d158148441319721ea98ef6f799d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1b71d158148441319721ea98ef6f799d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1b71d158148441319721ea98ef6f799d"}]}] Jul 20 04:24:51.897482 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersAdminNegativeTestJSON-480751451 Jul 20 04:24:51.897482 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 1b71d158148441319721ea98ef6f799d Jul 20 04:24:51.897482 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-480751451 Jul 20 04:24:51.897482 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersAdminNegativeTestJSON-480751451-project Jul 20 04:24:51.897482 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:24:51.897482 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:24:51.897482 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 953c7e68040540c2b46a2d5a79fd60d0 Jul 20 04:24:51.897482 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersAdminNegativeTestJSON-480751451-project Jul 20 04:24:51.897482 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:24:51.897482 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 8eb30445-55ef-4283-affc-ae1b7533b9ce could not be found. Jul 20 04:24:51.897482 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '8eb30445-55ef-4283-affc-ae1b7533b9ce'} Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eb30445-55ef-4283-affc-ae1b7533b9ce could not be found. Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:51.898669 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:51.902128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:51.902128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:51.902128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:51.902128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:51.902128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:51.902128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:51.902128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:51.902128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eb30445-55ef-4283-affc-ae1b7533b9ce could not be found. Jul 20 04:24:51.902128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:51.902128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:51.902128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:51.902128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:51.902128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:51.902128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:51.902128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:51.902128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:51.902128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eb30445-55ef-4283-affc-ae1b7533b9ce could not be found. Jul 20 04:24:51.902128 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:24:51.905353 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-92e3124e-4651-462b-9178-2acce37c840e tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] Returning 404 to user: Instance 8eb30445-55ef-4283-affc-ae1b7533b9ce could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:51.905353 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-92e3124e-4651-462b-9178-2acce37c840e tempest-ServersAdminNegativeTestJSON-480751451 tempest-ServersAdminNegativeTestJSON-480751451-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce" status: 404 len: 111 microversion: 2.1 time: 0.165183 Jul 20 04:24:51.916435 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1401/2987] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:51 2022] GET /compute/v2.1/servers/8eb30445-55ef-4283-affc-ae1b7533b9ce => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:52.442112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-afdd8576-b705-448f-b3d9-e2d4f183a92a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:52.466547 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-afdd8576-b705-448f-b3d9-e2d4f183a92a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1314 microversion: 2.1 time: 0.698114 Jul 20 04:24:52.478592 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1587/2988] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:51 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:53.501219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bdf10ffc-c7c2-449c-8870-0f47ec1d58d7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:53.507522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bdf10ffc-c7c2-449c-8870-0f47ec1d58d7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:53.527327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdf10ffc-c7c2-449c-8870-0f47ec1d58d7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:53.528092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdf10ffc-c7c2-449c-8870-0f47ec1d58d7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:53.529149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdf10ffc-c7c2-449c-8870-0f47ec1d58d7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:53.529793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdf10ffc-c7c2-449c-8870-0f47ec1d58d7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:54.468021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bdf10ffc-c7c2-449c-8870-0f47ec1d58d7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:54.479200 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bdf10ffc-c7c2-449c-8870-0f47ec1d58d7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1314 microversion: 2.1 time: 0.992558 Jul 20 04:24:54.487667 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1402/2989] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:53 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1314 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:54.610676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-8b5d2c04-5e6b-41a0-9a8b-feb56fec0ee0 req-dc01fc53-bd90-4127-964a-c1ef91a325b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "912b563f-eb41-461a-b923-1c90614de8ce", "tag": "4ccde37d-32fd-4340-862b-4ce4bc72a839"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:54.653588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8b5d2c04-5e6b-41a0-9a8b-feb56fec0ee0 req-dc01fc53-bd90-4127-964a-c1ef91a325b2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:54.657286 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8b5d2c04-5e6b-41a0-9a8b-feb56fec0ee0 req-dc01fc53-bd90-4127-964a-c1ef91a325b2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:54.689326 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-8b5d2c04-5e6b-41a0-9a8b-feb56fec0ee0 req-dc01fc53-bd90-4127-964a-c1ef91a325b2 service nova] Creating event network-changed:4ccde37d-32fd-4340-862b-4ce4bc72a839 for instance 912b563f-eb41-461a-b923-1c90614de8ce on n-h2-826526-5 Jul 20 04:24:54.705712 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-8b5d2c04-5e6b-41a0-9a8b-feb56fec0ee0 req-dc01fc53-bd90-4127-964a-c1ef91a325b2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114694 Jul 20 04:24:54.706728 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1588/2990] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:55.506349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8a548d3c-d1c1-45b9-b541-a944067e6551 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:55.507844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8a548d3c-d1c1-45b9-b541-a944067e6551 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:55.529810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a548d3c-d1c1-45b9-b541-a944067e6551 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:55.532286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a548d3c-d1c1-45b9-b541-a944067e6551 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:55.539396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a548d3c-d1c1-45b9-b541-a944067e6551 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:55.543122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a548d3c-d1c1-45b9-b541-a944067e6551 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:56.127489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8a548d3c-d1c1-45b9-b541-a944067e6551 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:56.142418 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8a548d3c-d1c1-45b9-b541-a944067e6551 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1314 microversion: 2.1 time: 0.641492 Jul 20 04:24:56.151965 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1403/2991] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:55 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:57.200040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d6375f74-b4e6-4f2d-8ac0-6ac73303b9bd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:57.213015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d6375f74-b4e6-4f2d-8ac0-6ac73303b9bd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:57.282587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6375f74-b4e6-4f2d-8ac0-6ac73303b9bd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:57.283344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6375f74-b4e6-4f2d-8ac0-6ac73303b9bd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:57.291156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6375f74-b4e6-4f2d-8ac0-6ac73303b9bd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:57.292056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6375f74-b4e6-4f2d-8ac0-6ac73303b9bd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:58.439825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d6375f74-b4e6-4f2d-8ac0-6ac73303b9bd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:58.454731 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d6375f74-b4e6-4f2d-8ac0-6ac73303b9bd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1314 microversion: 2.1 time: 1.286941 Jul 20 04:24:58.455327 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1589/2992] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:57 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1314 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:59.483365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-729b9c7d-4285-49db-80bd-85eed41009b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:59.483365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-729b9c7d-4285-49db-80bd-85eed41009b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:59.495258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-729b9c7d-4285-49db-80bd-85eed41009b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:59.496627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-729b9c7d-4285-49db-80bd-85eed41009b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:59.499000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-729b9c7d-4285-49db-80bd-85eed41009b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:59.505206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-729b9c7d-4285-49db-80bd-85eed41009b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:59.945745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cb514c31-0478-4356-b145-de5878652819 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2008468101", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:59.952362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:00.012930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-cb514c31-0478-4356-b145-de5878652819 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:25:00.560372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-729b9c7d-4285-49db-80bd-85eed41009b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:00.618823 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-729b9c7d-4285-49db-80bd-85eed41009b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1314 microversion: 2.1 time: 1.141569 Jul 20 04:25:00.622706 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1404/2993] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:59 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1314 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:01.653251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e4845bef-1834-45e9-9b71-b87298c0e343 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:01.654141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e4845bef-1834-45e9-9b71-b87298c0e343 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:01.676058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4845bef-1834-45e9-9b71-b87298c0e343 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:01.683149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4845bef-1834-45e9-9b71-b87298c0e343 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:01.684012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4845bef-1834-45e9-9b71-b87298c0e343 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:01.684493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4845bef-1834-45e9-9b71-b87298c0e343 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:01.992432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-cb514c31-0478-4356-b145-de5878652819 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:25:01.993931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-cb514c31-0478-4356-b145-de5878652819 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:25:01.994952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-cb514c31-0478-4356-b145-de5878652819 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:25:01.995628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-cb514c31-0478-4356-b145-de5878652819 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:25:01.996251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-cb514c31-0478-4356-b145-de5878652819 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:25:02.011388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb514c31-0478-4356-b145-de5878652819 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.012314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb514c31-0478-4356-b145-de5878652819 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.014084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb514c31-0478-4356-b145-de5878652819 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.014795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb514c31-0478-4356-b145-de5878652819 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.053948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-cb514c31-0478-4356-b145-de5878652819 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Getting quotas for project 520e73dd21f841098c2e45179c96ea0c. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:02.062565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-cb514c31-0478-4356-b145-de5878652819 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Getting quotas for user b44cf6ad7295422f8d520f5aa6457b31 and project 520e73dd21f841098c2e45179c96ea0c. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:02.079361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cb514c31-0478-4356-b145-de5878652819 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:25:02.082878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cb514c31-0478-4356-b145-de5878652819 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:25:02.174022 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cb514c31-0478-4356-b145-de5878652819 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.436507 Jul 20 04:25:02.176717 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1590/2994] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:24:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:25:02.192907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-95590188-cbdd-434e-8490-5f935bd7266f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:02.193975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-95590188-cbdd-434e-8490-5f935bd7266f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:02.704760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-95590188-cbdd-434e-8490-5f935bd7266f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44cf6ad7295422f8d520f5aa6457b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520e73dd21f841098c2e45179c96ea0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:02.716187 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-95590188-cbdd-434e-8490-5f935bd7266f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 200 len: 1214 microversion: 2.1 time: 0.532461 Jul 20 04:25:02.729046 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1591/2995] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:02 2022] GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 1214 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:02.739603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-4bb3ab9f-eb98-4bef-a146-a0747ba34e79 req-d19eb0f1-9f44-44cb-ba7d-52b4bedaf022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "912b563f-eb41-461a-b923-1c90614de8ce", "name": "network-vif-plugged", "status": "completed", "tag": "4ccde37d-32fd-4340-862b-4ce4bc72a839"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:02.771682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4bb3ab9f-eb98-4bef-a146-a0747ba34e79 req-d19eb0f1-9f44-44cb-ba7d-52b4bedaf022 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.773763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4bb3ab9f-eb98-4bef-a146-a0747ba34e79 req-d19eb0f1-9f44-44cb-ba7d-52b4bedaf022 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.813626 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-4bb3ab9f-eb98-4bef-a146-a0747ba34e79 req-d19eb0f1-9f44-44cb-ba7d-52b4bedaf022 service nova] Creating event network-vif-plugged:4ccde37d-32fd-4340-862b-4ce4bc72a839 for instance 912b563f-eb41-461a-b923-1c90614de8ce on n-h2-826526-5 Jul 20 04:25:02.848053 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-4bb3ab9f-eb98-4bef-a146-a0747ba34e79 req-d19eb0f1-9f44-44cb-ba7d-52b4bedaf022 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113664 Jul 20 04:25:02.848053 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1592/2996] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:03.566362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e4845bef-1834-45e9-9b71-b87298c0e343 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:03.665944 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e4845bef-1834-45e9-9b71-b87298c0e343 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1314 microversion: 2.1 time: 2.002208 Jul 20 04:25:03.666659 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1405/2997] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:01 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1314 bytes in 2021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:03.737953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-82fe800e-6a92-458d-950e-23eb8809fa2c tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:03.743201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-82fe800e-6a92-458d-950e-23eb8809fa2c tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:03.775002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82fe800e-6a92-458d-950e-23eb8809fa2c tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:03.788982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82fe800e-6a92-458d-950e-23eb8809fa2c tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:03.789937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82fe800e-6a92-458d-950e-23eb8809fa2c tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:03.790406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82fe800e-6a92-458d-950e-23eb8809fa2c tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:04.064446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-82fe800e-6a92-458d-950e-23eb8809fa2c tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44cf6ad7295422f8d520f5aa6457b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520e73dd21f841098c2e45179c96ea0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:04.083587 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-82fe800e-6a92-458d-950e-23eb8809fa2c tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 200 len: 1218 microversion: 2.1 time: 0.352055 Jul 20 04:25:04.084566 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1593/2998] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:03 2022] GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 1218 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:04.686433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e3507a3b-5d0c-47bb-b2fd-a729c874b40d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:04.687404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e3507a3b-5d0c-47bb-b2fd-a729c874b40d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:04.716057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3507a3b-5d0c-47bb-b2fd-a729c874b40d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:04.717122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3507a3b-5d0c-47bb-b2fd-a729c874b40d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:04.721114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3507a3b-5d0c-47bb-b2fd-a729c874b40d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:04.727003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3507a3b-5d0c-47bb-b2fd-a729c874b40d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:05.109703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-21f70937-62e2-40cc-a1ac-5e04b9a936d4 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:05.110299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-21f70937-62e2-40cc-a1ac-5e04b9a936d4 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:05.132226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-21f70937-62e2-40cc-a1ac-5e04b9a936d4 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:05.132818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-21f70937-62e2-40cc-a1ac-5e04b9a936d4 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:05.133675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-21f70937-62e2-40cc-a1ac-5e04b9a936d4 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:05.142480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-21f70937-62e2-40cc-a1ac-5e04b9a936d4 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:05.334569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e3507a3b-5d0c-47bb-b2fd-a729c874b40d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:05.349045 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e3507a3b-5d0c-47bb-b2fd-a729c874b40d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1314 microversion: 2.1 time: 0.664582 Jul 20 04:25:05.356594 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1406/2999] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:04 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:05.553522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-21f70937-62e2-40cc-a1ac-5e04b9a936d4 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44cf6ad7295422f8d520f5aa6457b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520e73dd21f841098c2e45179c96ea0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:05.570117 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-21f70937-62e2-40cc-a1ac-5e04b9a936d4 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 200 len: 1266 microversion: 2.1 time: 0.466019 Jul 20 04:25:05.574485 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1594/3000] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:05 2022] GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 1266 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:06.369496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fb4dde64-a1b3-4c00-9be0-11d2f7c81a3d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:06.370507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fb4dde64-a1b3-4c00-9be0-11d2f7c81a3d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:06.393574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb4dde64-a1b3-4c00-9be0-11d2f7c81a3d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:06.394359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb4dde64-a1b3-4c00-9be0-11d2f7c81a3d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:06.402998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb4dde64-a1b3-4c00-9be0-11d2f7c81a3d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:06.403543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb4dde64-a1b3-4c00-9be0-11d2f7c81a3d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:06.593327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6f36730e-348c-4867-98aa-c45323dbcbfd tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:06.595167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6f36730e-348c-4867-98aa-c45323dbcbfd tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:06.625011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f36730e-348c-4867-98aa-c45323dbcbfd tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:06.626463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f36730e-348c-4867-98aa-c45323dbcbfd tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:06.632939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f36730e-348c-4867-98aa-c45323dbcbfd tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:06.634245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f36730e-348c-4867-98aa-c45323dbcbfd tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:06.921485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6f36730e-348c-4867-98aa-c45323dbcbfd tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44cf6ad7295422f8d520f5aa6457b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520e73dd21f841098c2e45179c96ea0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:06.956283 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6f36730e-348c-4867-98aa-c45323dbcbfd tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 200 len: 1272 microversion: 2.1 time: 0.367863 Jul 20 04:25:06.961959 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1595/3001] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:06 2022] GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 1272 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:07.130180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fb4dde64-a1b3-4c00-9be0-11d2f7c81a3d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:07.141833 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fb4dde64-a1b3-4c00-9be0-11d2f7c81a3d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1501 microversion: 2.1 time: 0.779068 Jul 20 04:25:07.161440 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1407/3002] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:06 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1501 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:07.167502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-db2cc824-4b18-486a-a52f-d4d59668b88e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:07.168931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-db2cc824-4b18-486a-a52f-d4d59668b88e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:07.182906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db2cc824-4b18-486a-a52f-d4d59668b88e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:07.189030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db2cc824-4b18-486a-a52f-d4d59668b88e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:07.190951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db2cc824-4b18-486a-a52f-d4d59668b88e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:07.192727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db2cc824-4b18-486a-a52f-d4d59668b88e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:07.365911 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-db2cc824-4b18-486a-a52f-d4d59668b88e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "POST /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce/action" status: 202 len: 0 microversion: 2.1 time: 0.203620 Jul 20 04:25:07.373160 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1596/3003] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:25:07 2022] POST /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:25:07.379272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-117dc913-e0f7-4068-b375-621ad8b32e49 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:07.380843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-117dc913-e0f7-4068-b375-621ad8b32e49 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:07.398951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-117dc913-e0f7-4068-b375-621ad8b32e49 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:07.400097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-117dc913-e0f7-4068-b375-621ad8b32e49 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:07.402570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-117dc913-e0f7-4068-b375-621ad8b32e49 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:07.404059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-117dc913-e0f7-4068-b375-621ad8b32e49 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:07.999422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-117dc913-e0f7-4068-b375-621ad8b32e49 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:08.017298 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-117dc913-e0f7-4068-b375-621ad8b32e49 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1506 microversion: 2.1 time: 0.645635 Jul 20 04:25:08.021415 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1408/3004] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:07 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1506 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:08.031441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1c82dc37-e85a-4b88-b8ce-828781ca810a tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:08.036455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1c82dc37-e85a-4b88-b8ce-828781ca810a tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:08.059735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c82dc37-e85a-4b88-b8ce-828781ca810a tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:08.060732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c82dc37-e85a-4b88-b8ce-828781ca810a tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:08.064196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c82dc37-e85a-4b88-b8ce-828781ca810a tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:08.065041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c82dc37-e85a-4b88-b8ce-828781ca810a tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:08.541137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8b20efa6-b78e-4748-957a-a128e005059b tempest-AbsoluteLimitsNegativeTestJSON-1815664448 tempest-AbsoluteLimitsNegativeTestJSON-1815664448-project] Calling method '.version_select at 0x7f06bd43b1f0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:08.589123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b20efa6-b78e-4748-957a-a128e005059b tempest-AbsoluteLimitsNegativeTestJSON-1815664448 tempest-AbsoluteLimitsNegativeTestJSON-1815664448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:08.592000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b20efa6-b78e-4748-957a-a128e005059b tempest-AbsoluteLimitsNegativeTestJSON-1815664448 tempest-AbsoluteLimitsNegativeTestJSON-1815664448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:08.596754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b20efa6-b78e-4748-957a-a128e005059b tempest-AbsoluteLimitsNegativeTestJSON-1815664448 tempest-AbsoluteLimitsNegativeTestJSON-1815664448-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:08.597319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b20efa6-b78e-4748-957a-a128e005059b tempest-AbsoluteLimitsNegativeTestJSON-1815664448 tempest-AbsoluteLimitsNegativeTestJSON-1815664448-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:08.670828 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8b20efa6-b78e-4748-957a-a128e005059b tempest-AbsoluteLimitsNegativeTestJSON-1815664448 tempest-AbsoluteLimitsNegativeTestJSON-1815664448-project] 10.222.0.17 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.965428 Jul 20 04:25:08.691439 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1597/3005] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 04:25:07 2022] GET /compute/v2.1/limits => generated 511 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:25:08.937413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1c82dc37-e85a-4b88-b8ce-828781ca810a tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44cf6ad7295422f8d520f5aa6457b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520e73dd21f841098c2e45179c96ea0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:08.955701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-418411c7-8f83-4bd4-a6e1-c3f2556a3931 tempest-AbsoluteLimitsNegativeTestJSON-1815664448 tempest-AbsoluteLimitsNegativeTestJSON-1815664448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-878560004", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:08.959528 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1c82dc37-e85a-4b88-b8ce-828781ca810a tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 200 len: 1314 microversion: 2.1 time: 0.936031 Jul 20 04:25:08.960723 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1409/3006] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:08 2022] GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 1314 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:09.040214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ec025fbe-f433-47f4-bf43-fda89c3524b7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:09.040845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ec025fbe-f433-47f4-bf43-fda89c3524b7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:09.059188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec025fbe-f433-47f4-bf43-fda89c3524b7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:09.059812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec025fbe-f433-47f4-bf43-fda89c3524b7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:09.070360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec025fbe-f433-47f4-bf43-fda89c3524b7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:09.071031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec025fbe-f433-47f4-bf43-fda89c3524b7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:09.130067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-418411c7-8f83-4bd4-a6e1-c3f2556a3931 tempest-AbsoluteLimitsNegativeTestJSON-1815664448 tempest-AbsoluteLimitsNegativeTestJSON-1815664448-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:25:10.254754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-418411c7-8f83-4bd4-a6e1-c3f2556a3931 tempest-AbsoluteLimitsNegativeTestJSON-1815664448 tempest-AbsoluteLimitsNegativeTestJSON-1815664448-project] Getting quotas for project 6eba1117d9204136ac6d095b912b457f. Resources: dict_keys(['metadata_items']) {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:10.270031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-418411c7-8f83-4bd4-a6e1-c3f2556a3931 tempest-AbsoluteLimitsNegativeTestJSON-1815664448 tempest-AbsoluteLimitsNegativeTestJSON-1815664448-project] Getting quotas for user 91b90093b0b04a3a8e006572ff168374 and project 6eba1117d9204136ac6d095b912b457f. Resources: dict_keys(['metadata_items']) {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:10.297701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ec025fbe-f433-47f4-bf43-fda89c3524b7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:10.312348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:10.317690 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-418411c7-8f83-4bd4-a6e1-c3f2556a3931 tempest-AbsoluteLimitsNegativeTestJSON-1815664448 tempest-AbsoluteLimitsNegativeTestJSON-1815664448-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 20 04:25:10.322919 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ec025fbe-f433-47f4-bf43-fda89c3524b7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1486 microversion: 2.1 time: 1.287779 Jul 20 04:25:10.323811 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1410/3007] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:09 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1486 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-418411c7-8f83-4bd4-a6e1-c3f2556a3931 tempest-AbsoluteLimitsNegativeTestJSON-1815664448 tempest-AbsoluteLimitsNegativeTestJSON-1815664448-project] Request method failure captured: Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 1751 Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Oj0CshmaHxIvoLAJ5567j72BizrTHtP11tKYCdCSFFZUDaAuoH8eLo33OXZDdC4HCCBeOZGiIRn44jXrRYgJFj3eixOJj0VBDK_2gguQ4sE6zImla8JNU0lx7d7kM1Wgkn9MDd5djX6jyzERF9PuGBWRtp3cbx0GQnjW1n_qhydwc Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 6eba1117d9204136ac6d095b912b457f Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1815664448 Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6eba1117d9204136ac6d095b912b457f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6eba1117d9204136ac6d095b912b457f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6eba1117d9204136ac6d095b912b457f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6eba1117d9204136ac6d095b912b457f"}]}] Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1815664448 Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 6eba1117d9204136ac6d095b912b457f Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1815664448 Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1815664448-project Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 91b90093b0b04a3a8e006572ff168374 Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1815664448-project Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-878560004", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:25:10.323942 n-d-826526-5 devstack@n-api.service[127871]: exception: Maximum number of metadata items exceeds 128 Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-878560004', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:10.326865 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:10.330728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:10.330728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:25:10.330728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 04:25:10.330728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 04:25:10.330728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 20 04:25:10.330728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:25:10.330728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:10.330728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:25:10.330728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:10.330728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:10.330728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:10.330728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:10.330728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:10.330728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 20 04:25:10.330728 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:25:10.334160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-418411c7-8f83-4bd4-a6e1-c3f2556a3931 tempest-AbsoluteLimitsNegativeTestJSON-1815664448 tempest-AbsoluteLimitsNegativeTestJSON-1815664448-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:10.334160 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-418411c7-8f83-4bd4-a6e1-c3f2556a3931 tempest-AbsoluteLimitsNegativeTestJSON-1815664448 tempest-AbsoluteLimitsNegativeTestJSON-1815664448-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.383980 Jul 20 04:25:10.337810 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1598/3008] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Jul 20 04:25:08 2022] POST /compute/v2.1/servers => generated 87 bytes in 1389 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:25:10.348648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-db887aaa-15e5-4877-8cc3-c9b78046db87 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:10.349280 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-db887aaa-15e5-4877-8cc3-c9b78046db87 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:10.351820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0766db0f-3ba9-461d-891a-b23fd1227b51 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:10.352796 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0766db0f-3ba9-461d-891a-b23fd1227b51 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:10.358395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db887aaa-15e5-4877-8cc3-c9b78046db87 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:10.358858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db887aaa-15e5-4877-8cc3-c9b78046db87 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:10.360017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db887aaa-15e5-4877-8cc3-c9b78046db87 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:10.360501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db887aaa-15e5-4877-8cc3-c9b78046db87 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:10.367872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0766db0f-3ba9-461d-891a-b23fd1227b51 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:10.386862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0766db0f-3ba9-461d-891a-b23fd1227b51 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:10.395277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0766db0f-3ba9-461d-891a-b23fd1227b51 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:10.402889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0766db0f-3ba9-461d-891a-b23fd1227b51 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:10.488825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0766db0f-3ba9-461d-891a-b23fd1227b51 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:25:10.504661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:10.703160 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0766db0f-3ba9-461d-891a-b23fd1227b51 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "DELETE /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 204 len: 0 microversion: 2.1 time: 0.361556 Jul 20 04:25:10.704355 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1599/3009] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:25:10 2022] DELETE /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:10.715710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a708b95f-379e-44a1-b8ac-4e041d8b30d1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:10.717047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a708b95f-379e-44a1-b8ac-4e041d8b30d1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:10.724735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a708b95f-379e-44a1-b8ac-4e041d8b30d1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:10.725794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a708b95f-379e-44a1-b8ac-4e041d8b30d1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:10.727527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a708b95f-379e-44a1-b8ac-4e041d8b30d1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:10.728363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a708b95f-379e-44a1-b8ac-4e041d8b30d1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:10.935280 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-db887aaa-15e5-4877-8cc3-c9b78046db87 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44cf6ad7295422f8d520f5aa6457b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520e73dd21f841098c2e45179c96ea0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:10.947333 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-db887aaa-15e5-4877-8cc3-c9b78046db87 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 200 len: 1314 microversion: 2.1 time: 0.611665 Jul 20 04:25:10.950552 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1411/3010] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:10 2022] GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:11.399216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a708b95f-379e-44a1-b8ac-4e041d8b30d1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:11.414368 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a708b95f-379e-44a1-b8ac-4e041d8b30d1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1492 microversion: 2.1 time: 0.704946 Jul 20 04:25:11.415400 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1600/3011] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:10 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1492 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:11.967968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5361e9bf-bff1-4048-96b1-d772c61951d0 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:11.968982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5361e9bf-bff1-4048-96b1-d772c61951d0 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:12.025008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5361e9bf-bff1-4048-96b1-d772c61951d0 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:12.025008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5361e9bf-bff1-4048-96b1-d772c61951d0 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:12.025008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5361e9bf-bff1-4048-96b1-d772c61951d0 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:12.038405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5361e9bf-bff1-4048-96b1-d772c61951d0 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:12.208576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b2dd9367-81de-4408-8af5-88659e32bbd5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-83159663", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1c5f3e11-e1d2-4582-9716-8510f89252b7"}], "security_groups": [{"name": "tempest-securitygroup--882235476"}], "key_name": "tempest-keypair-647060892", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "c99cec81-6f55-40d5-bcd4-5360c88b05c1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:12.710289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-b2dd9367-81de-4408-8af5-88659e32bbd5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] validate_networks() for [('1c5f3e11-e1d2-4582-9716-8510f89252b7', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:25:12.998221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5361e9bf-bff1-4048-96b1-d772c61951d0 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44cf6ad7295422f8d520f5aa6457b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520e73dd21f841098c2e45179c96ea0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:13.014106 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5361e9bf-bff1-4048-96b1-d772c61951d0 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 200 len: 1314 microversion: 2.1 time: 1.048948 Jul 20 04:25:13.017514 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1412/3012] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:11 2022] GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 1314 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:13.027594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-58b338cb-60bf-472e-b42e-635187617b79 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:13.030097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-58b338cb-60bf-472e-b42e-635187617b79 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:13.046813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58b338cb-60bf-472e-b42e-635187617b79 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:13.047474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58b338cb-60bf-472e-b42e-635187617b79 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:13.053943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58b338cb-60bf-472e-b42e-635187617b79 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:13.053943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58b338cb-60bf-472e-b42e-635187617b79 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:13.900865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-58b338cb-60bf-472e-b42e-635187617b79 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:13.923438 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-58b338cb-60bf-472e-b42e-635187617b79 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1492 microversion: 2.1 time: 0.904699 Jul 20 04:25:13.939094 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1413/3013] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:13 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1492 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:13.955401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-06e01561-9db2-48af-ab71-bd075db24986 req-0f5150ce-40a7-4085-b0b3-1778307ed591 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c88ee78-71e7-46ea-8958-769172283f17", "tag": "f15900e8-ef81-47a9-bc1c-a664b5572a88"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:13.985478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-06e01561-9db2-48af-ab71-bd075db24986 req-0f5150ce-40a7-4085-b0b3-1778307ed591 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:13.989100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-06e01561-9db2-48af-ab71-bd075db24986 req-0f5150ce-40a7-4085-b0b3-1778307ed591 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:14.031904 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-06e01561-9db2-48af-ab71-bd075db24986 req-0f5150ce-40a7-4085-b0b3-1778307ed591 service nova] Creating event network-changed:f15900e8-ef81-47a9-bc1c-a664b5572a88 for instance 3c88ee78-71e7-46ea-8958-769172283f17 on n-h1-826526-5 Jul 20 04:25:14.042432 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-06e01561-9db2-48af-ab71-bd075db24986 req-0f5150ce-40a7-4085-b0b3-1778307ed591 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101233 Jul 20 04:25:14.046945 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1414/3014] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:14.062353 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-425380e0-be69-4c37-8048-24ca2eda81b1 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:14.063844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-425380e0-be69-4c37-8048-24ca2eda81b1 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:14.086191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-425380e0-be69-4c37-8048-24ca2eda81b1 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:14.086468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-425380e0-be69-4c37-8048-24ca2eda81b1 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:14.089407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-425380e0-be69-4c37-8048-24ca2eda81b1 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:14.091478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-425380e0-be69-4c37-8048-24ca2eda81b1 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:14.649004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-b2dd9367-81de-4408-8af5-88659e32bbd5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Getting quotas for project dd28073732224b22ba367fc99d203235. Resources: dict_keys(['metadata_items']) {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:14.666486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-b2dd9367-81de-4408-8af5-88659e32bbd5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Getting quotas for user e60ea74481504967b171b13213ad7ffd and project dd28073732224b22ba367fc99d203235. Resources: dict_keys(['metadata_items']) {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:14.694787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b2dd9367-81de-4408-8af5-88659e32bbd5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:25:14.695776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b2dd9367-81de-4408-8af5-88659e32bbd5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:25:14.696310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b2dd9367-81de-4408-8af5-88659e32bbd5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:25:14.696705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b2dd9367-81de-4408-8af5-88659e32bbd5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:25:14.700191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b2dd9367-81de-4408-8af5-88659e32bbd5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:25:14.729940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b2dd9367-81de-4408-8af5-88659e32bbd5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:14.733995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b2dd9367-81de-4408-8af5-88659e32bbd5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:14.735240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b2dd9367-81de-4408-8af5-88659e32bbd5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:14.735922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b2dd9367-81de-4408-8af5-88659e32bbd5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:14.794916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-b2dd9367-81de-4408-8af5-88659e32bbd5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Getting quotas for project dd28073732224b22ba367fc99d203235. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:14.807655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-b2dd9367-81de-4408-8af5-88659e32bbd5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Getting quotas for user e60ea74481504967b171b13213ad7ffd and project dd28073732224b22ba367fc99d203235. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:14.990747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b2dd9367-81de-4408-8af5-88659e32bbd5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:25:14.993098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b2dd9367-81de-4408-8af5-88659e32bbd5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c99cec81-6f55-40d5-bcd4-5360c88b05c1',volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:25:15.189783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-425380e0-be69-4c37-8048-24ca2eda81b1 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44cf6ad7295422f8d520f5aa6457b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520e73dd21f841098c2e45179c96ea0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:15.198051 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-425380e0-be69-4c37-8048-24ca2eda81b1 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 200 len: 1314 microversion: 2.1 time: 1.150028 Jul 20 04:25:15.198723 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1415/3015] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:14 2022] GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 1314 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:15.226616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f4f6bf9b-f228-403f-8956-006b2d495215 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:15.227074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f4f6bf9b-f228-403f-8956-006b2d495215 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:15.268691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4f6bf9b-f228-403f-8956-006b2d495215 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:15.269695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4f6bf9b-f228-403f-8956-006b2d495215 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:15.271248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4f6bf9b-f228-403f-8956-006b2d495215 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:15.273197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4f6bf9b-f228-403f-8956-006b2d495215 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:15.294574 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b2dd9367-81de-4408-8af5-88659e32bbd5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.098678 Jul 20 04:25:15.300769 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1601/3016] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:25:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 3109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:25:15.656717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f4f6bf9b-f228-403f-8956-006b2d495215 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:15.715144 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f4f6bf9b-f228-403f-8956-006b2d495215 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 200 len: 1450 microversion: 2.1 time: 0.489429 Jul 20 04:25:15.730686 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1416/3017] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:15 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 1450 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:15.756994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4f1b2221-b375-4866-ba75-79b965509184 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:15.778860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3ada581d-1ddd-4ad7-832e-d30357d3d39b tempest-AZV2TestJSON-1178918299 tempest-AZV2TestJSON-1178918299-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:15.782973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ada581d-1ddd-4ad7-832e-d30357d3d39b tempest-AZV2TestJSON-1178918299 tempest-AZV2TestJSON-1178918299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:15.783494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ada581d-1ddd-4ad7-832e-d30357d3d39b tempest-AZV2TestJSON-1178918299 tempest-AZV2TestJSON-1178918299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:15.784451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ada581d-1ddd-4ad7-832e-d30357d3d39b tempest-AZV2TestJSON-1178918299 tempest-AZV2TestJSON-1178918299-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:15.784888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ada581d-1ddd-4ad7-832e-d30357d3d39b tempest-AZV2TestJSON-1178918299 tempest-AZV2TestJSON-1178918299-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:15.790199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4f1b2221-b375-4866-ba75-79b965509184 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:15.904243 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3ada581d-1ddd-4ad7-832e-d30357d3d39b tempest-AZV2TestJSON-1178918299 tempest-AZV2TestJSON-1178918299-project] 10.222.0.17 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.601443 Jul 20 04:25:15.906527 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1602/3018] 10.222.0.17 () {58 vars in 1163 bytes} [Wed Jul 20 04:25:15 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:25:16.044057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-036786f8-bd4c-4ee2-9836-2edbcf6f6e02 req-40155e70-6c02-42f8-872d-dbfb89f31125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "912b563f-eb41-461a-b923-1c90614de8ce", "name": "network-vif-deleted", "tag": "4ccde37d-32fd-4340-862b-4ce4bc72a839"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:16.057927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-036786f8-bd4c-4ee2-9836-2edbcf6f6e02 req-40155e70-6c02-42f8-872d-dbfb89f31125 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:16.058616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-036786f8-bd4c-4ee2-9836-2edbcf6f6e02 req-40155e70-6c02-42f8-872d-dbfb89f31125 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:16.085834 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-036786f8-bd4c-4ee2-9836-2edbcf6f6e02 req-40155e70-6c02-42f8-872d-dbfb89f31125 service nova] Creating event network-vif-deleted:4ccde37d-32fd-4340-862b-4ce4bc72a839 for instance 912b563f-eb41-461a-b923-1c90614de8ce on n-h2-826526-5 Jul 20 04:25:16.100945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4f1b2221-b375-4866-ba75-79b965509184 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:16.106195 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-036786f8-bd4c-4ee2-9836-2edbcf6f6e02 req-40155e70-6c02-42f8-872d-dbfb89f31125 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198399 Jul 20 04:25:16.106815 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1603/3019] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:16.110491 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4f1b2221-b375-4866-ba75-79b965509184 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1119 microversion: 2.1 time: 0.379457 Jul 20 04:25:16.119630 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1417/3020] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:15 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1119 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:16.217962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f8f64866-5553-45ce-a9de-279090a08a68 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:16.219458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f8f64866-5553-45ce-a9de-279090a08a68 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:16.237868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8f64866-5553-45ce-a9de-279090a08a68 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:16.242218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8f64866-5553-45ce-a9de-279090a08a68 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:16.245243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8f64866-5553-45ce-a9de-279090a08a68 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:16.247963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8f64866-5553-45ce-a9de-279090a08a68 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:16.609304 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f8f64866-5553-45ce-a9de-279090a08a68 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44cf6ad7295422f8d520f5aa6457b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520e73dd21f841098c2e45179c96ea0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:16.628188 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f8f64866-5553-45ce-a9de-279090a08a68 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 200 len: 1314 microversion: 2.1 time: 0.412959 Jul 20 04:25:16.638175 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1604/3021] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:16 2022] GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:16.744985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c9913ddf-33b8-4129-99fa-303d69efc7c0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:16.745649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c9913ddf-33b8-4129-99fa-303d69efc7c0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:16.790545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:16.794645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9913ddf-33b8-4129-99fa-303d69efc7c0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:16.795397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9913ddf-33b8-4129-99fa-303d69efc7c0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:16.796745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9913ddf-33b8-4129-99fa-303d69efc7c0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:16.798079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9913ddf-33b8-4129-99fa-303d69efc7c0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:16.846603 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-c9913ddf-33b8-4129-99fa-303d69efc7c0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance 912b563f-eb41-461a-b923-1c90614de8ce could not be found. Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c9913ddf-33b8-4129-99fa-303d69efc7c0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce HTTP/1.1 Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 912b563f-eb41-461a-b923-1c90614de8ce could not be found. Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '912b563f-eb41-461a-b923-1c90614de8ce'} Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 912b563f-eb41-461a-b923-1c90614de8ce could not be found. Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 912b563f-eb41-461a-b923-1c90614de8ce could not be found. Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:16.853336 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:25:16.858486 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:16.858486 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:16.858486 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:16.858486 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:16.858486 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:16.858486 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 912b563f-eb41-461a-b923-1c90614de8ce could not be found. Jul 20 04:25:16.858486 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:25:16.863025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c9913ddf-33b8-4129-99fa-303d69efc7c0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance 912b563f-eb41-461a-b923-1c90614de8ce could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:16.864656 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c9913ddf-33b8-4129-99fa-303d69efc7c0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 404 len: 111 microversion: 2.1 time: 0.123949 Jul 20 04:25:16.872314 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1418/3022] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:16 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:17.077989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0254e350-f828-432b-9ba1-aa9f321c2bee tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1510126345", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "c3db3bfb-11a7-406a-b082-1e92336f5a21"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:17.133068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8b57546b-afd5-4895-b7f0-5a9a8a51cd75 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:17.134452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8b57546b-afd5-4895-b7f0-5a9a8a51cd75 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:17.163962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b57546b-afd5-4895-b7f0-5a9a8a51cd75 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:17.165596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b57546b-afd5-4895-b7f0-5a9a8a51cd75 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:17.172050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b57546b-afd5-4895-b7f0-5a9a8a51cd75 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:17.174172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b57546b-afd5-4895-b7f0-5a9a8a51cd75 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:17.177168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-0254e350-f828-432b-9ba1-aa9f321c2bee tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] validate_networks() for [('c3db3bfb-11a7-406a-b082-1e92336f5a21', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:25:17.522452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8b57546b-afd5-4895-b7f0-5a9a8a51cd75 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:17.542381 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8b57546b-afd5-4895-b7f0-5a9a8a51cd75 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1217 microversion: 2.1 time: 0.417748 Jul 20 04:25:17.554499 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1419/3023] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:17 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1217 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:17.648027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-153dea67-0fa8-497e-9f35-a26e4d18b3b5 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:17.649023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-153dea67-0fa8-497e-9f35-a26e4d18b3b5 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:17.668122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153dea67-0fa8-497e-9f35-a26e4d18b3b5 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:17.668666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153dea67-0fa8-497e-9f35-a26e4d18b3b5 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:17.673520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153dea67-0fa8-497e-9f35-a26e4d18b3b5 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:17.681106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153dea67-0fa8-497e-9f35-a26e4d18b3b5 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:19.055439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0254e350-f828-432b-9ba1-aa9f321c2bee tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:25:19.056533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0254e350-f828-432b-9ba1-aa9f321c2bee tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:25:19.057564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0254e350-f828-432b-9ba1-aa9f321c2bee tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:25:19.060242 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0254e350-f828-432b-9ba1-aa9f321c2bee tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:25:19.061005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0254e350-f828-432b-9ba1-aa9f321c2bee tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:25:19.110324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0254e350-f828-432b-9ba1-aa9f321c2bee tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:19.110775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0254e350-f828-432b-9ba1-aa9f321c2bee tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:19.111974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0254e350-f828-432b-9ba1-aa9f321c2bee tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:19.113797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0254e350-f828-432b-9ba1-aa9f321c2bee tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:19.174705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-0254e350-f828-432b-9ba1-aa9f321c2bee tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Getting quotas for project ae67de1fefe64bd19a3bf614f02d3535. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:19.190378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-0254e350-f828-432b-9ba1-aa9f321c2bee tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Getting quotas for user 1dc60058bea0485ebd4d502b2e7c986b and project ae67de1fefe64bd19a3bf614f02d3535. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:19.209665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:19.228463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0254e350-f828-432b-9ba1-aa9f321c2bee tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:25:19.241111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0254e350-f828-432b-9ba1-aa9f321c2bee tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:25:19.281363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-153dea67-0fa8-497e-9f35-a26e4d18b3b5 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44cf6ad7295422f8d520f5aa6457b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520e73dd21f841098c2e45179c96ea0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:19.350567 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0254e350-f828-432b-9ba1-aa9f321c2bee tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.276875 Jul 20 04:25:19.351463 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1605/3024] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:25:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:25:19.365325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-263f9707-b6f9-4413-a769-b4866f5aceb5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:19.368076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-263f9707-b6f9-4413-a769-b4866f5aceb5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:19.370407 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-153dea67-0fa8-497e-9f35-a26e4d18b3b5 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 200 len: 1314 microversion: 2.1 time: 1.726180 Jul 20 04:25:19.384034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-263f9707-b6f9-4413-a769-b4866f5aceb5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:19.387671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-263f9707-b6f9-4413-a769-b4866f5aceb5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:19.389907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-263f9707-b6f9-4413-a769-b4866f5aceb5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:19.391612 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1420/3025] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:17 2022] GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 1314 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:19.392475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-263f9707-b6f9-4413-a769-b4866f5aceb5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:19.408574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-044a9e73-d3a5-4eb7-94d6-bd15101d85e4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:19.409702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-044a9e73-d3a5-4eb7-94d6-bd15101d85e4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:19.707516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-263f9707-b6f9-4413-a769-b4866f5aceb5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:19.747571 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-263f9707-b6f9-4413-a769-b4866f5aceb5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1235 microversion: 2.1 time: 0.390801 Jul 20 04:25:19.770205 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1606/3026] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:19 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1235 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:19.876541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-044a9e73-d3a5-4eb7-94d6-bd15101d85e4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:19.906401 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-044a9e73-d3a5-4eb7-94d6-bd15101d85e4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1215 microversion: 2.1 time: 0.512747 Jul 20 04:25:19.917416 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1421/3027] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:19 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1215 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:20.398517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8ab9b377-d26a-458d-a7ef-e4f65224622f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:20.399145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8ab9b377-d26a-458d-a7ef-e4f65224622f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:20.418349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8ab9b377-d26a-458d-a7ef-e4f65224622f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:20.419251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8ab9b377-d26a-458d-a7ef-e4f65224622f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:20.421947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8ab9b377-d26a-458d-a7ef-e4f65224622f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:20.423761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8ab9b377-d26a-458d-a7ef-e4f65224622f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:20.777113 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e23acbc5-19c5-461e-bbf0-444d3791d937 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:20.777898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e23acbc5-19c5-461e-bbf0-444d3791d937 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:20.809832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e23acbc5-19c5-461e-bbf0-444d3791d937 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:20.812004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e23acbc5-19c5-461e-bbf0-444d3791d937 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:20.813300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e23acbc5-19c5-461e-bbf0-444d3791d937 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:20.816992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e23acbc5-19c5-461e-bbf0-444d3791d937 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:21.100230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e23acbc5-19c5-461e-bbf0-444d3791d937 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:21.110413 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e23acbc5-19c5-461e-bbf0-444d3791d937 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1235 microversion: 2.1 time: 0.339378 Jul 20 04:25:21.135028 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1422/3028] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:20 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1235 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:21.149497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f29f5a38-06b7-434c-bf9b-04651084e82e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:21.154791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f29f5a38-06b7-434c-bf9b-04651084e82e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:21.179326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f29f5a38-06b7-434c-bf9b-04651084e82e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:21.181152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f29f5a38-06b7-434c-bf9b-04651084e82e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:21.182256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f29f5a38-06b7-434c-bf9b-04651084e82e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:21.186005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f29f5a38-06b7-434c-bf9b-04651084e82e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:21.432643 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8ab9b377-d26a-458d-a7ef-e4f65224622f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44cf6ad7295422f8d520f5aa6457b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520e73dd21f841098c2e45179c96ea0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:21.446355 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8ab9b377-d26a-458d-a7ef-e4f65224622f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 200 len: 1314 microversion: 2.1 time: 1.051249 Jul 20 04:25:21.447456 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1607/3029] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:20 2022] GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 1314 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:21.530354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f29f5a38-06b7-434c-bf9b-04651084e82e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:21.540603 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f29f5a38-06b7-434c-bf9b-04651084e82e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1211 microversion: 2.1 time: 0.402661 Jul 20 04:25:21.552234 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1423/3030] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:21 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1211 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:22.141654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c70d7590-fc58-40d7-a844-6cffebfcb632 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:22.142452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c70d7590-fc58-40d7-a844-6cffebfcb632 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:22.154375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c70d7590-fc58-40d7-a844-6cffebfcb632 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:22.159284 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c70d7590-fc58-40d7-a844-6cffebfcb632 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:22.160317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c70d7590-fc58-40d7-a844-6cffebfcb632 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:22.161086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c70d7590-fc58-40d7-a844-6cffebfcb632 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:22.492583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c70d7590-fc58-40d7-a844-6cffebfcb632 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:22.505789 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c70d7590-fc58-40d7-a844-6cffebfcb632 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1235 microversion: 2.1 time: 0.367866 Jul 20 04:25:22.506583 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1424/3031] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:22 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1235 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:22.519325 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6d60fd90-3f83-4757-bc56-32643b01e2d1 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:22.521692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6d60fd90-3f83-4757-bc56-32643b01e2d1 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:22.546183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d60fd90-3f83-4757-bc56-32643b01e2d1 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:22.546960 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d60fd90-3f83-4757-bc56-32643b01e2d1 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:22.549257 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d60fd90-3f83-4757-bc56-32643b01e2d1 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:22.553905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d60fd90-3f83-4757-bc56-32643b01e2d1 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:22.674862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-97c2daf3-2ca6-44be-aa39-e0db2fc0f7ed req-a923c979-4103-47f9-85d6-4896107328f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c88ee78-71e7-46ea-8958-769172283f17", "name": "network-vif-plugged", "status": "completed", "tag": "f15900e8-ef81-47a9-bc1c-a664b5572a88"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:22.697060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-97c2daf3-2ca6-44be-aa39-e0db2fc0f7ed req-a923c979-4103-47f9-85d6-4896107328f8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:22.698592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-97c2daf3-2ca6-44be-aa39-e0db2fc0f7ed req-a923c979-4103-47f9-85d6-4896107328f8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:22.723512 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-97c2daf3-2ca6-44be-aa39-e0db2fc0f7ed req-a923c979-4103-47f9-85d6-4896107328f8 service nova] Creating event network-vif-plugged:f15900e8-ef81-47a9-bc1c-a664b5572a88 for instance 3c88ee78-71e7-46ea-8958-769172283f17 on n-h1-826526-5 Jul 20 04:25:22.737538 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-97c2daf3-2ca6-44be-aa39-e0db2fc0f7ed req-a923c979-4103-47f9-85d6-4896107328f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.750412 Jul 20 04:25:22.738870 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1608/3032] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:22.744423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d360d8f3-a187-47d5-a879-181d57d65054 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:22.754369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d360d8f3-a187-47d5-a879-181d57d65054 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:22.784645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d360d8f3-a187-47d5-a879-181d57d65054 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:22.787644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d360d8f3-a187-47d5-a879-181d57d65054 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:22.788655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d360d8f3-a187-47d5-a879-181d57d65054 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:22.789112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d360d8f3-a187-47d5-a879-181d57d65054 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:23.036677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d360d8f3-a187-47d5-a879-181d57d65054 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:23.052236 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d360d8f3-a187-47d5-a879-181d57d65054 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1273 microversion: 2.1 time: 0.311207 Jul 20 04:25:23.052891 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1609/3033] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:22 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1273 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:23.192520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6d60fd90-3f83-4757-bc56-32643b01e2d1 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44cf6ad7295422f8d520f5aa6457b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520e73dd21f841098c2e45179c96ea0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:23.203218 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6d60fd90-3f83-4757-bc56-32643b01e2d1 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 200 len: 1314 microversion: 2.1 time: 0.695412 Jul 20 04:25:23.203827 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1425/3034] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:22 2022] GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 1314 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:23.523325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8f183ace-27d1-4363-8e2a-57cab1b24e48 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:23.523950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8f183ace-27d1-4363-8e2a-57cab1b24e48 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:23.542115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f183ace-27d1-4363-8e2a-57cab1b24e48 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:23.542574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f183ace-27d1-4363-8e2a-57cab1b24e48 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:23.546264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f183ace-27d1-4363-8e2a-57cab1b24e48 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:23.547396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f183ace-27d1-4363-8e2a-57cab1b24e48 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:24.069893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-97076abe-2b83-41fb-be3f-efab24b3920f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:24.070522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-97076abe-2b83-41fb-be3f-efab24b3920f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:24.087120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97076abe-2b83-41fb-be3f-efab24b3920f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:24.089600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97076abe-2b83-41fb-be3f-efab24b3920f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:24.090482 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97076abe-2b83-41fb-be3f-efab24b3920f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:24.091068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97076abe-2b83-41fb-be3f-efab24b3920f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:24.251042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8f183ace-27d1-4363-8e2a-57cab1b24e48 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:24.267414 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8f183ace-27d1-4363-8e2a-57cab1b24e48 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1302 microversion: 2.1 time: 0.748026 Jul 20 04:25:24.286023 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1610/3035] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:23 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1302 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:24.295788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9538d27f-28c5-4694-bf36-35052bf40918 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:24.297525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9538d27f-28c5-4694-bf36-35052bf40918 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:24.309134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9538d27f-28c5-4694-bf36-35052bf40918 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:24.311532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9538d27f-28c5-4694-bf36-35052bf40918 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:24.313477 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9538d27f-28c5-4694-bf36-35052bf40918 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:24.316471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9538d27f-28c5-4694-bf36-35052bf40918 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:24.450767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-97076abe-2b83-41fb-be3f-efab24b3920f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:24.467892 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-97076abe-2b83-41fb-be3f-efab24b3920f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1273 microversion: 2.1 time: 0.400521 Jul 20 04:25:24.468550 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1426/3036] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:24 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1273 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:25.292511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1bdd3916-5ab2-497b-8f89-5ddb6fdd502d tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:25.293129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1bdd3916-5ab2-497b-8f89-5ddb6fdd502d tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:25.307137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bdd3916-5ab2-497b-8f89-5ddb6fdd502d tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:25.316710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bdd3916-5ab2-497b-8f89-5ddb6fdd502d tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:25.317872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bdd3916-5ab2-497b-8f89-5ddb6fdd502d tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:25.318421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bdd3916-5ab2-497b-8f89-5ddb6fdd502d tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:25.565390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9538d27f-28c5-4694-bf36-35052bf40918 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44cf6ad7295422f8d520f5aa6457b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520e73dd21f841098c2e45179c96ea0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:25.598624 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9538d27f-28c5-4694-bf36-35052bf40918 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 200 len: 1314 microversion: 2.1 time: 1.306019 Jul 20 04:25:25.599645 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1611/3037] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:24 2022] GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 1314 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:25.634493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4487fe33-7511-4429-b34e-8f8dff515a2b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:25.636143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4487fe33-7511-4429-b34e-8f8dff515a2b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:25.667174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4487fe33-7511-4429-b34e-8f8dff515a2b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:25.671252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4487fe33-7511-4429-b34e-8f8dff515a2b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:25.673473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4487fe33-7511-4429-b34e-8f8dff515a2b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:25.676988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4487fe33-7511-4429-b34e-8f8dff515a2b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:26.577914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1bdd3916-5ab2-497b-8f89-5ddb6fdd502d tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:26.613224 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1bdd3916-5ab2-497b-8f89-5ddb6fdd502d tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1302 microversion: 2.1 time: 1.318545 Jul 20 04:25:26.634735 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1427/3038] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:25 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1302 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:26.642149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9107c1e2-3635-4d63-b24f-b7ed0e3063b4 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:26.643475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9107c1e2-3635-4d63-b24f-b7ed0e3063b4 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:26.653477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9107c1e2-3635-4d63-b24f-b7ed0e3063b4 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:26.654511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9107c1e2-3635-4d63-b24f-b7ed0e3063b4 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:26.655828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9107c1e2-3635-4d63-b24f-b7ed0e3063b4 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:26.656728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9107c1e2-3635-4d63-b24f-b7ed0e3063b4 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:27.445690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4487fe33-7511-4429-b34e-8f8dff515a2b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:27.459911 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4487fe33-7511-4429-b34e-8f8dff515a2b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1315 microversion: 2.1 time: 1.843466 Jul 20 04:25:27.472037 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1612/3039] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:25 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1315 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:27.474789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9107c1e2-3635-4d63-b24f-b7ed0e3063b4 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44cf6ad7295422f8d520f5aa6457b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520e73dd21f841098c2e45179c96ea0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:27.508431 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9107c1e2-3635-4d63-b24f-b7ed0e3063b4 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 200 len: 1464 microversion: 2.1 time: 0.870894 Jul 20 04:25:27.512438 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1428/3040] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:26 2022] GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 1464 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:27.640177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d28d59fb-97c1-4d01-9dec-25e65af14abf tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:27.642451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d28d59fb-97c1-4d01-9dec-25e65af14abf tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:27.663779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d28d59fb-97c1-4d01-9dec-25e65af14abf tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:27.664286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d28d59fb-97c1-4d01-9dec-25e65af14abf tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:27.668432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d28d59fb-97c1-4d01-9dec-25e65af14abf tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:27.676790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d28d59fb-97c1-4d01-9dec-25e65af14abf tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:28.498193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-da261531-8aa8-44c2-80da-ce43a4bc810c tempest-TenantUsagesTestJSON-365960919 tempest-TenantUsagesTestJSON-365960919-project-admin] Calling method '.version_select at 0x7f06bd43bdc0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:28.565155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da261531-8aa8-44c2-80da-ce43a4bc810c tempest-TenantUsagesTestJSON-365960919 tempest-TenantUsagesTestJSON-365960919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:28.592078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da261531-8aa8-44c2-80da-ce43a4bc810c tempest-TenantUsagesTestJSON-365960919 tempest-TenantUsagesTestJSON-365960919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:28.674666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=11 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:28.677382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da261531-8aa8-44c2-80da-ce43a4bc810c tempest-TenantUsagesTestJSON-365960919 tempest-TenantUsagesTestJSON-365960919-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:28.678054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da261531-8aa8-44c2-80da-ce43a4bc810c tempest-TenantUsagesTestJSON-365960919 tempest-TenantUsagesTestJSON-365960919-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:28.701311 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-da261531-8aa8-44c2-80da-ce43a4bc810c tempest-TenantUsagesTestJSON-365960919 tempest-TenantUsagesTestJSON-365960919-project-admin] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage/520e73dd21f841098c2e45179c96ea0c?start=2022-07-19T04%3A25%3A27.530958&end=2022-07-21T04%3A25%3A27.530958" status: 200 len: 691 microversion: 2.1 time: 1.165054 Jul 20 04:25:28.702981 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1613/3041] 10.222.0.17 () {58 vars in 1411 bytes} [Wed Jul 20 04:25:27 2022] GET /compute/v2.1/os-simple-tenant-usage/520e73dd21f841098c2e45179c96ea0c?start=2022-07-19T04%3A25%3A27.530958&end=2022-07-21T04%3A25%3A27.530958 => generated 691 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:28.710576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-682f3ae7-93f1-4f01-b854-63c20795322b req-76ef0d7b-49d2-4c16-bbe9-778e1ead1f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "802d383f-a9d5-4707-9a0c-7138b63d3ca9", "tag": "ceb0eff4-396b-4903-83cc-997cf4deb834"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:28.721037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-682f3ae7-93f1-4f01-b854-63c20795322b req-76ef0d7b-49d2-4c16-bbe9-778e1ead1f02 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:28.721876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-682f3ae7-93f1-4f01-b854-63c20795322b req-76ef0d7b-49d2-4c16-bbe9-778e1ead1f02 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:28.738297 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-682f3ae7-93f1-4f01-b854-63c20795322b req-76ef0d7b-49d2-4c16-bbe9-778e1ead1f02 service nova] Creating event network-changed:ceb0eff4-396b-4903-83cc-997cf4deb834 for instance 802d383f-a9d5-4707-9a0c-7138b63d3ca9 on n-h2-826526-5 Jul 20 04:25:28.746166 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-682f3ae7-93f1-4f01-b854-63c20795322b req-76ef0d7b-49d2-4c16-bbe9-778e1ead1f02 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041527 Jul 20 04:25:28.747225 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1614/3042] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:28.753624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7644cc26-c7cd-40bc-9428-6294dfb7ef39 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:28.755437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7644cc26-c7cd-40bc-9428-6294dfb7ef39 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:28.766039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7644cc26-c7cd-40bc-9428-6294dfb7ef39 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:28.767190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7644cc26-c7cd-40bc-9428-6294dfb7ef39 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:28.770007 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7644cc26-c7cd-40bc-9428-6294dfb7ef39 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:28.771824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7644cc26-c7cd-40bc-9428-6294dfb7ef39 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:29.064131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d28d59fb-97c1-4d01-9dec-25e65af14abf tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:29.080610 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d28d59fb-97c1-4d01-9dec-25e65af14abf tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1302 microversion: 2.1 time: 1.447227 Jul 20 04:25:29.081722 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1429/3043] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:27 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1302 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:29.102473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-23b828fe-484b-441d-8393-bc6b5586c0d5 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '.version_select at 0x7f06bd45e160>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:29.132858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23b828fe-484b-441d-8393-bc6b5586c0d5 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:29.136529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23b828fe-484b-441d-8393-bc6b5586c0d5 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:29.205103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23b828fe-484b-441d-8393-bc6b5586c0d5 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:29.205507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23b828fe-484b-441d-8393-bc6b5586c0d5 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:29.210514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=30 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:29.240037 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-23b828fe-484b-441d-8393-bc6b5586c0d5 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage/520e73dd21f841098c2e45179c96ea0c?start=2022-07-19T04%3A25%3A27.530958&end=2022-07-21T04%3A25%3A27.530958" status: 200 len: 695 microversion: 2.1 time: 0.154281 Jul 20 04:25:29.243165 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1430/3044] 10.222.0.17 () {58 vars in 1411 bytes} [Wed Jul 20 04:25:29 2022] GET /compute/v2.1/os-simple-tenant-usage/520e73dd21f841098c2e45179c96ea0c?start=2022-07-19T04%3A25%3A27.530958&end=2022-07-21T04%3A25%3A27.530958 => generated 695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:29.270377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-650f5028-1afe-4a09-a646-515ab85a951c tempest-TenantUsagesTestJSON-365960919 tempest-TenantUsagesTestJSON-365960919-project-admin] Calling method '.version_select at 0x7f06bd45e280>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:29.292582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-650f5028-1afe-4a09-a646-515ab85a951c tempest-TenantUsagesTestJSON-365960919 tempest-TenantUsagesTestJSON-365960919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:29.297750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-650f5028-1afe-4a09-a646-515ab85a951c tempest-TenantUsagesTestJSON-365960919 tempest-TenantUsagesTestJSON-365960919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:29.338183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-650f5028-1afe-4a09-a646-515ab85a951c tempest-TenantUsagesTestJSON-365960919 tempest-TenantUsagesTestJSON-365960919-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:29.338665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-650f5028-1afe-4a09-a646-515ab85a951c tempest-TenantUsagesTestJSON-365960919 tempest-TenantUsagesTestJSON-365960919-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:29.769818 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-650f5028-1afe-4a09-a646-515ab85a951c tempest-TenantUsagesTestJSON-365960919 tempest-TenantUsagesTestJSON-365960919-project-admin] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A25%3A27.530958&end=2022-07-21T04%3A25%3A27.530958&detailed=1" status: 200 len: 36519 microversion: 2.1 time: 0.509966 Jul 20 04:25:29.771553 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1431/3045] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Jul 20 04:25:29 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A25%3A27.530958&end=2022-07-21T04%3A25%3A27.530958&detailed=1 => generated 36519 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:25:29.836364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0e371ab5-31cf-49f4-9b94-36ed227bcd16 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:29.838509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0e371ab5-31cf-49f4-9b94-36ed227bcd16 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:29.850766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e371ab5-31cf-49f4-9b94-36ed227bcd16 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:29.851572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e371ab5-31cf-49f4-9b94-36ed227bcd16 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:29.852776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e371ab5-31cf-49f4-9b94-36ed227bcd16 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:29.853448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e371ab5-31cf-49f4-9b94-36ed227bcd16 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:29.864539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:29.907723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:29.932526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0e371ab5-31cf-49f4-9b94-36ed227bcd16 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:25:30.146310 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0e371ab5-31cf-49f4-9b94-36ed227bcd16 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 204 len: 0 microversion: 2.1 time: 0.324942 Jul 20 04:25:30.147682 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1432/3046] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:25:29 2022] DELETE /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:30.156022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-61f0988c-820a-4b00-b905-57e05fddd57f tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:30.156782 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-61f0988c-820a-4b00-b905-57e05fddd57f tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:30.176584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61f0988c-820a-4b00-b905-57e05fddd57f tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:30.184647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61f0988c-820a-4b00-b905-57e05fddd57f tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:30.185834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61f0988c-820a-4b00-b905-57e05fddd57f tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:30.186474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61f0988c-820a-4b00-b905-57e05fddd57f tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:30.395794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7644cc26-c7cd-40bc-9428-6294dfb7ef39 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:30.406680 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7644cc26-c7cd-40bc-9428-6294dfb7ef39 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1315 microversion: 2.1 time: 1.657815 Jul 20 04:25:30.412748 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1615/3047] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:28 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1315 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:30.425821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3b39719c-4ab1-402b-abb7-931401e3ec0d tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:30.426720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3b39719c-4ab1-402b-abb7-931401e3ec0d tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:30.444944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b39719c-4ab1-402b-abb7-931401e3ec0d tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:30.445719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b39719c-4ab1-402b-abb7-931401e3ec0d tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:30.446743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b39719c-4ab1-402b-abb7-931401e3ec0d tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:30.447337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b39719c-4ab1-402b-abb7-931401e3ec0d tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:31.118873 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3b39719c-4ab1-402b-abb7-931401e3ec0d tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44cf6ad7295422f8d520f5aa6457b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520e73dd21f841098c2e45179c96ea0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:31.133827 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3b39719c-4ab1-402b-abb7-931401e3ec0d tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 200 len: 1470 microversion: 2.1 time: 0.719573 Jul 20 04:25:31.149822 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1616/3048] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:30 2022] GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 1470 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:31.301982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-61f0988c-820a-4b00-b905-57e05fddd57f tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:31.310220 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-61f0988c-820a-4b00-b905-57e05fddd57f tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1302 microversion: 2.1 time: 1.158564 Jul 20 04:25:31.314686 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1433/3049] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:30 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1302 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:31.393729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-99b4baaa-b14a-4b77-81aa-7a6a58e2b7d1 req-4e4aae6d-e8d1-4c16-8157-5c5995f5d8ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e82edc2-fbf4-4e3f-b3b2-f937cd316135", "tag": "83456d49-d3e2-4124-ab2c-f3c45c93e1d0"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:31.415159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-99b4baaa-b14a-4b77-81aa-7a6a58e2b7d1 req-4e4aae6d-e8d1-4c16-8157-5c5995f5d8ff service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:31.433334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-99b4baaa-b14a-4b77-81aa-7a6a58e2b7d1 req-4e4aae6d-e8d1-4c16-8157-5c5995f5d8ff service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:31.435364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5b369746-1ac8-40b1-8a98-682d4b73f353 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:31.436015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5b369746-1ac8-40b1-8a98-682d4b73f353 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:31.454080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b369746-1ac8-40b1-8a98-682d4b73f353 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:31.454616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b369746-1ac8-40b1-8a98-682d4b73f353 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:31.457667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b369746-1ac8-40b1-8a98-682d4b73f353 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:31.458140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b369746-1ac8-40b1-8a98-682d4b73f353 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:31.472613 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-99b4baaa-b14a-4b77-81aa-7a6a58e2b7d1 req-4e4aae6d-e8d1-4c16-8157-5c5995f5d8ff service nova] Creating event network-changed:83456d49-d3e2-4124-ab2c-f3c45c93e1d0 for instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 on n-h1-826526-5 Jul 20 04:25:31.488813 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-99b4baaa-b14a-4b77-81aa-7a6a58e2b7d1 req-4e4aae6d-e8d1-4c16-8157-5c5995f5d8ff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099852 Jul 20 04:25:31.496014 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1617/3050] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:32.114794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5b369746-1ac8-40b1-8a98-682d4b73f353 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:32.132012 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5b369746-1ac8-40b1-8a98-682d4b73f353 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1315 microversion: 2.1 time: 0.703583 Jul 20 04:25:32.132697 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1434/3051] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:31 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1315 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:32.158028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ea5ac5f7-b974-4749-9e48-c1e38c439499 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:32.158723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ea5ac5f7-b974-4749-9e48-c1e38c439499 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:32.176843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea5ac5f7-b974-4749-9e48-c1e38c439499 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:32.177495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea5ac5f7-b974-4749-9e48-c1e38c439499 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:32.178562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea5ac5f7-b974-4749-9e48-c1e38c439499 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:32.179205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea5ac5f7-b974-4749-9e48-c1e38c439499 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:32.332833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c841703b-b748-4fb6-a3e7-dc56841b7a85 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:32.333559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c841703b-b748-4fb6-a3e7-dc56841b7a85 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:32.362307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c841703b-b748-4fb6-a3e7-dc56841b7a85 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:32.363052 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c841703b-b748-4fb6-a3e7-dc56841b7a85 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:32.364233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c841703b-b748-4fb6-a3e7-dc56841b7a85 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:32.364926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c841703b-b748-4fb6-a3e7-dc56841b7a85 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:33.061318 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ea5ac5f7-b974-4749-9e48-c1e38c439499 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44cf6ad7295422f8d520f5aa6457b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520e73dd21f841098c2e45179c96ea0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:33.094752 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ea5ac5f7-b974-4749-9e48-c1e38c439499 tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 200 len: 1470 microversion: 2.1 time: 0.942183 Jul 20 04:25:33.098380 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1618/3052] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:32 2022] GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 1470 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:33.158482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dbca4521-8d78-47bf-8c63-14cb5c9d920b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:33.159304 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dbca4521-8d78-47bf-8c63-14cb5c9d920b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:33.180750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbca4521-8d78-47bf-8c63-14cb5c9d920b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:33.181216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbca4521-8d78-47bf-8c63-14cb5c9d920b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:33.188301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbca4521-8d78-47bf-8c63-14cb5c9d920b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:33.190966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbca4521-8d78-47bf-8c63-14cb5c9d920b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:33.545620 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c841703b-b748-4fb6-a3e7-dc56841b7a85 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:33.563387 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c841703b-b748-4fb6-a3e7-dc56841b7a85 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1290 microversion: 2.1 time: 1.234424 Jul 20 04:25:33.564999 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1435/3053] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:32 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1290 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:34.128781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b4807755-8ff1-45d9-87ef-61f2b602ec1f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:34.129479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b4807755-8ff1-45d9-87ef-61f2b602ec1f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:34.154141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b4807755-8ff1-45d9-87ef-61f2b602ec1f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:34.154942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b4807755-8ff1-45d9-87ef-61f2b602ec1f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:34.156331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b4807755-8ff1-45d9-87ef-61f2b602ec1f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:34.161873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b4807755-8ff1-45d9-87ef-61f2b602ec1f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:34.281344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dbca4521-8d78-47bf-8c63-14cb5c9d920b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:34.291080 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dbca4521-8d78-47bf-8c63-14cb5c9d920b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1315 microversion: 2.1 time: 1.143604 Jul 20 04:25:34.298092 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1619/3054] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:33 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1315 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:34.601173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7dde72cd-9b64-4255-bd53-0354dc5cfb50 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:34.602692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7dde72cd-9b64-4255-bd53-0354dc5cfb50 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:34.648630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7dde72cd-9b64-4255-bd53-0354dc5cfb50 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:34.651047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7dde72cd-9b64-4255-bd53-0354dc5cfb50 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:34.657825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7dde72cd-9b64-4255-bd53-0354dc5cfb50 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:34.663884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7dde72cd-9b64-4255-bd53-0354dc5cfb50 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:34.694584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:35.202659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b4807755-8ff1-45d9-87ef-61f2b602ec1f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44cf6ad7295422f8d520f5aa6457b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520e73dd21f841098c2e45179c96ea0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:35.217919 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b4807755-8ff1-45d9-87ef-61f2b602ec1f tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 200 len: 1470 microversion: 2.1 time: 1.092937 Jul 20 04:25:35.229948 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1436/3055] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:34 2022] GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 1470 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:35.244957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-ce55a296-7e7f-4c8e-8066-58020821050c req-34e131ec-bf18-4b81-abb7-711235937582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c88ee78-71e7-46ea-8958-769172283f17", "name": "network-vif-deleted", "tag": "f15900e8-ef81-47a9-bc1c-a664b5572a88"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:35.264469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ce55a296-7e7f-4c8e-8066-58020821050c req-34e131ec-bf18-4b81-abb7-711235937582 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:35.264733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ce55a296-7e7f-4c8e-8066-58020821050c req-34e131ec-bf18-4b81-abb7-711235937582 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:35.333467 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-ce55a296-7e7f-4c8e-8066-58020821050c req-34e131ec-bf18-4b81-abb7-711235937582 service nova] Creating event network-vif-deleted:f15900e8-ef81-47a9-bc1c-a664b5572a88 for instance 3c88ee78-71e7-46ea-8958-769172283f17 on n-h1-826526-5 Jul 20 04:25:35.345424 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-ce55a296-7e7f-4c8e-8066-58020821050c req-34e131ec-bf18-4b81-abb7-711235937582 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111863 Jul 20 04:25:35.354071 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1437/3056] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:35.360208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-405457e9-9eb1-41c1-a5a4-4c5086ab911a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:35.365426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-405457e9-9eb1-41c1-a5a4-4c5086ab911a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:35.413153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-405457e9-9eb1-41c1-a5a4-4c5086ab911a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:35.413864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-405457e9-9eb1-41c1-a5a4-4c5086ab911a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:35.416482 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-405457e9-9eb1-41c1-a5a4-4c5086ab911a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:35.417386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-405457e9-9eb1-41c1-a5a4-4c5086ab911a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:35.576704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7dde72cd-9b64-4255-bd53-0354dc5cfb50 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:35.588755 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7dde72cd-9b64-4255-bd53-0354dc5cfb50 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1290 microversion: 2.1 time: 0.998919 Jul 20 04:25:35.601189 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1620/3057] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:34 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1290 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:36.269614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9789f842-45b2-4237-8baf-df597899fb6a tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:36.271538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9789f842-45b2-4237-8baf-df597899fb6a tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] [instance: 3c88ee78-71e7-46ea-8958-769172283f17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:36.321384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9789f842-45b2-4237-8baf-df597899fb6a tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.322296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9789f842-45b2-4237-8baf-df597899fb6a tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:36.323929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9789f842-45b2-4237-8baf-df597899fb6a tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.324865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9789f842-45b2-4237-8baf-df597899fb6a tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:36.344954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-405457e9-9eb1-41c1-a5a4-4c5086ab911a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:36.368933 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-405457e9-9eb1-41c1-a5a4-4c5086ab911a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1315 microversion: 2.1 time: 1.013203 Jul 20 04:25:36.369759 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-9789f842-45b2-4237-8baf-df597899fb6a tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] HTTP exception thrown: Instance 3c88ee78-71e7-46ea-8958-769172283f17 could not be found. Jul 20 04:25:36.370737 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1438/3058] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:35 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1315 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9789f842-45b2-4237-8baf-df597899fb6a tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Request method failure captured: Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 HTTP/1.1 Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14OZaeHhQYFFgKLczanbiMhz2gHg6aOx6NigPXLIUXiF-cYAGj7GPVR1V4xp2SHElQtq8YyAw9LEhDnrMMuGO5leA2siuQFEc2mncieCePoRoNqB9dChf4ypxrdTl2NR_TlRHVFMyDf3hV6EnRY7QS10gggswqroRGOBNLZ4jFUUQaU Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 520e73dd21f841098c2e45179c96ea0c Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TenantUsagesTestJSON-2015598657 Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/520e73dd21f841098c2e45179c96ea0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/520e73dd21f841098c2e45179c96ea0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_520e73dd21f841098c2e45179c96ea0c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/520e73dd21f841098c2e45179c96ea0c"}]}] Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TenantUsagesTestJSON-2015598657 Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 520e73dd21f841098c2e45179c96ea0c Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TenantUsagesTestJSON-2015598657 Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TenantUsagesTestJSON-2015598657-project Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: b44cf6ad7295422f8d520f5aa6457b31 Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TenantUsagesTestJSON-2015598657-project Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 3c88ee78-71e7-46ea-8958-769172283f17 could not be found. Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '3c88ee78-71e7-46ea-8958-769172283f17'} Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c88ee78-71e7-46ea-8958-769172283f17 could not be found. Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c88ee78-71e7-46ea-8958-769172283f17 could not be found. Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:36.387031 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:25:36.393086 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:36.393086 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:36.393086 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:36.393086 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:36.393086 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:36.393086 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c88ee78-71e7-46ea-8958-769172283f17 could not be found. Jul 20 04:25:36.393086 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:25:36.393086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9789f842-45b2-4237-8baf-df597899fb6a tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] Returning 404 to user: Instance 3c88ee78-71e7-46ea-8958-769172283f17 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:36.393086 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9789f842-45b2-4237-8baf-df597899fb6a tempest-TenantUsagesTestJSON-2015598657 tempest-TenantUsagesTestJSON-2015598657-project] 10.222.0.17 "GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17" status: 404 len: 111 microversion: 2.1 time: 0.133266 Jul 20 04:25:36.393086 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1621/3059] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:36 2022] GET /compute/v2.1/servers/3c88ee78-71e7-46ea-8958-769172283f17 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:36.611921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fd14bc56-6390-4772-a6e9-b2e6b3cb3dec tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:36.618155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fd14bc56-6390-4772-a6e9-b2e6b3cb3dec tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:36.649062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd14bc56-6390-4772-a6e9-b2e6b3cb3dec tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.649941 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd14bc56-6390-4772-a6e9-b2e6b3cb3dec tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:36.651263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd14bc56-6390-4772-a6e9-b2e6b3cb3dec tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.652059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd14bc56-6390-4772-a6e9-b2e6b3cb3dec tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.390747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dc94fc86-c970-4606-ad1a-aa8096e83c4f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:37.391407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dc94fc86-c970-4606-ad1a-aa8096e83c4f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:37.430084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc94fc86-c970-4606-ad1a-aa8096e83c4f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:37.430808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc94fc86-c970-4606-ad1a-aa8096e83c4f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.431717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc94fc86-c970-4606-ad1a-aa8096e83c4f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:37.432184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc94fc86-c970-4606-ad1a-aa8096e83c4f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:38.251582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fd14bc56-6390-4772-a6e9-b2e6b3cb3dec tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:38.259592 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fd14bc56-6390-4772-a6e9-b2e6b3cb3dec tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1290 microversion: 2.1 time: 1.655910 Jul 20 04:25:38.260199 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1439/3060] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:36 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1290 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:38.309879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dc94fc86-c970-4606-ad1a-aa8096e83c4f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:38.329739 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dc94fc86-c970-4606-ad1a-aa8096e83c4f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1315 microversion: 2.1 time: 0.944292 Jul 20 04:25:38.331034 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1622/3061] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:37 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1315 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:39.280724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a1499788-da75-4fea-ba1b-d4230c8cab82 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:39.282234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a1499788-da75-4fea-ba1b-d4230c8cab82 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:39.303480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1499788-da75-4fea-ba1b-d4230c8cab82 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:39.305467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1499788-da75-4fea-ba1b-d4230c8cab82 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:39.307599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1499788-da75-4fea-ba1b-d4230c8cab82 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:39.309772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1499788-da75-4fea-ba1b-d4230c8cab82 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:39.345419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:39.351890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1486aaa2-e147-4b8b-a1fc-605a7035e4d8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:39.354375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1486aaa2-e147-4b8b-a1fc-605a7035e4d8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:39.371078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1486aaa2-e147-4b8b-a1fc-605a7035e4d8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:39.371078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1486aaa2-e147-4b8b-a1fc-605a7035e4d8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:39.381642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1486aaa2-e147-4b8b-a1fc-605a7035e4d8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:39.382284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1486aaa2-e147-4b8b-a1fc-605a7035e4d8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:39.425495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:40.148056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a1499788-da75-4fea-ba1b-d4230c8cab82 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:40.173597 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a1499788-da75-4fea-ba1b-d4230c8cab82 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1290 microversion: 2.1 time: 0.899234 Jul 20 04:25:40.183930 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1440/3062] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:39 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1290 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:40.280406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1486aaa2-e147-4b8b-a1fc-605a7035e4d8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:40.291280 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1486aaa2-e147-4b8b-a1fc-605a7035e4d8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1315 microversion: 2.1 time: 0.947685 Jul 20 04:25:40.296482 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1623/3063] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:39 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1315 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:41.202400 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e4f6d4ac-28b1-48c9-ad8a-cff447d91697 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:41.204524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e4f6d4ac-28b1-48c9-ad8a-cff447d91697 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:41.232766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4f6d4ac-28b1-48c9-ad8a-cff447d91697 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:41.247486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4f6d4ac-28b1-48c9-ad8a-cff447d91697 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:41.249933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4f6d4ac-28b1-48c9-ad8a-cff447d91697 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:41.250833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4f6d4ac-28b1-48c9-ad8a-cff447d91697 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:41.318124 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d92edc3d-f8e2-43e8-9477-2fe6332475be tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:41.319087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d92edc3d-f8e2-43e8-9477-2fe6332475be tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:41.335415 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d92edc3d-f8e2-43e8-9477-2fe6332475be tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:41.336092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d92edc3d-f8e2-43e8-9477-2fe6332475be tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:41.338493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d92edc3d-f8e2-43e8-9477-2fe6332475be tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:41.340608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d92edc3d-f8e2-43e8-9477-2fe6332475be tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:42.293675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e4f6d4ac-28b1-48c9-ad8a-cff447d91697 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:42.308013 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e4f6d4ac-28b1-48c9-ad8a-cff447d91697 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1290 microversion: 2.1 time: 1.112952 Jul 20 04:25:42.308912 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1441/3064] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:41 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1290 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:42.431894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d92edc3d-f8e2-43e8-9477-2fe6332475be tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:42.461384 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d92edc3d-f8e2-43e8-9477-2fe6332475be tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1315 microversion: 2.1 time: 1.149296 Jul 20 04:25:42.468834 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1624/3065] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:41 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1315 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:43.306108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f72c3f8f-315b-4c83-ba2b-bcc9feb855c4 req-07663edd-8e8f-4991-bfba-a032f7f1e572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e82edc2-fbf4-4e3f-b3b2-f937cd316135", "name": "network-vif-plugged", "status": "completed", "tag": "83456d49-d3e2-4124-ab2c-f3c45c93e1d0"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:43.331918 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f72c3f8f-315b-4c83-ba2b-bcc9feb855c4 req-07663edd-8e8f-4991-bfba-a032f7f1e572 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:43.337043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f72c3f8f-315b-4c83-ba2b-bcc9feb855c4 req-07663edd-8e8f-4991-bfba-a032f7f1e572 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:43.349909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cca50c9f-f53f-4d1e-b34e-71ed7e35ab04 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:43.351757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cca50c9f-f53f-4d1e-b34e-71ed7e35ab04 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:43.365285 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f72c3f8f-315b-4c83-ba2b-bcc9feb855c4 req-07663edd-8e8f-4991-bfba-a032f7f1e572 service nova] Creating event network-vif-plugged:83456d49-d3e2-4124-ab2c-f3c45c93e1d0 for instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 on n-h1-826526-5 Jul 20 04:25:43.374218 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f72c3f8f-315b-4c83-ba2b-bcc9feb855c4 req-07663edd-8e8f-4991-bfba-a032f7f1e572 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071829 Jul 20 04:25:43.377123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cca50c9f-f53f-4d1e-b34e-71ed7e35ab04 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:43.378432 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1442/3066] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:43.384889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cca50c9f-f53f-4d1e-b34e-71ed7e35ab04 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:43.387556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cca50c9f-f53f-4d1e-b34e-71ed7e35ab04 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:43.390542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cca50c9f-f53f-4d1e-b34e-71ed7e35ab04 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:43.494976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d79f24d6-2779-460f-ab47-1603961baed8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:43.495692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d79f24d6-2779-460f-ab47-1603961baed8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:43.510354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d79f24d6-2779-460f-ab47-1603961baed8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:43.511119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d79f24d6-2779-460f-ab47-1603961baed8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:43.519274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d79f24d6-2779-460f-ab47-1603961baed8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:43.522742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d79f24d6-2779-460f-ab47-1603961baed8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:44.457224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cca50c9f-f53f-4d1e-b34e-71ed7e35ab04 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:44.474237 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cca50c9f-f53f-4d1e-b34e-71ed7e35ab04 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1290 microversion: 2.1 time: 1.133733 Jul 20 04:25:44.478978 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1625/3067] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:43 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1290 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:44.554912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d79f24d6-2779-460f-ab47-1603961baed8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:44.575009 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d79f24d6-2779-460f-ab47-1603961baed8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1315 microversion: 2.1 time: 1.084554 Jul 20 04:25:44.578800 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1443/3068] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:43 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1315 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:45.512834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-af03a199-cee7-4a97-b93a-a8cad0b6b68d tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:45.516810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-af03a199-cee7-4a97-b93a-a8cad0b6b68d tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:45.531263 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af03a199-cee7-4a97-b93a-a8cad0b6b68d tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:45.532337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af03a199-cee7-4a97-b93a-a8cad0b6b68d tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:45.533467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af03a199-cee7-4a97-b93a-a8cad0b6b68d tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:45.534213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af03a199-cee7-4a97-b93a-a8cad0b6b68d tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:45.633571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ac032dfc-b8a5-4cd0-bbb5-7ddc2970b207 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:45.635279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ac032dfc-b8a5-4cd0-bbb5-7ddc2970b207 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:45.654283 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac032dfc-b8a5-4cd0-bbb5-7ddc2970b207 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:45.656016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac032dfc-b8a5-4cd0-bbb5-7ddc2970b207 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:45.660550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac032dfc-b8a5-4cd0-bbb5-7ddc2970b207 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:45.661979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac032dfc-b8a5-4cd0-bbb5-7ddc2970b207 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:46.054079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-af03a199-cee7-4a97-b93a-a8cad0b6b68d tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:46.078852 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-af03a199-cee7-4a97-b93a-a8cad0b6b68d tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1290 microversion: 2.1 time: 0.576753 Jul 20 04:25:46.080474 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1626/3069] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:45 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1290 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:46.153962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ac032dfc-b8a5-4cd0-bbb5-7ddc2970b207 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:46.173202 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ac032dfc-b8a5-4cd0-bbb5-7ddc2970b207 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1502 microversion: 2.1 time: 0.581452 Jul 20 04:25:46.177684 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1444/3070] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:45 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1502 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:46.198506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6ba9ece1-34f5-46f0-a857-967bbe39fe3b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:46.199817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6ba9ece1-34f5-46f0-a857-967bbe39fe3b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:46.217896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ba9ece1-34f5-46f0-a857-967bbe39fe3b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:46.218385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ba9ece1-34f5-46f0-a857-967bbe39fe3b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:46.222888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ba9ece1-34f5-46f0-a857-967bbe39fe3b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:46.225598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ba9ece1-34f5-46f0-a857-967bbe39fe3b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:46.289437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-6ba9ece1-34f5-46f0-a857-967bbe39fe3b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lazy-loading 'flavor' on Instance uuid 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:25:47.095685 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6ba9ece1-34f5-46f0-a857-967bbe39fe3b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "POST /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135/action" status: 202 len: 0 microversion: 2.1 time: 0.903005 Jul 20 04:25:47.098563 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1627/3071] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:25:46 2022] POST /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135/action => generated 0 bytes in 910 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:25:47.099940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-37de081e-73e8-4de3-bc01-65ed767bbc40 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:47.102111 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-37de081e-73e8-4de3-bc01-65ed767bbc40 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:47.116767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c2cd2514-373f-4e8f-9cd0-b6a2ba47b2bd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:47.117350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:47.122366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c2cd2514-373f-4e8f-9cd0-b6a2ba47b2bd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:47.125414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37de081e-73e8-4de3-bc01-65ed767bbc40 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:47.126654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37de081e-73e8-4de3-bc01-65ed767bbc40 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:47.127761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37de081e-73e8-4de3-bc01-65ed767bbc40 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:47.131058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37de081e-73e8-4de3-bc01-65ed767bbc40 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:47.153003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2cd2514-373f-4e8f-9cd0-b6a2ba47b2bd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:47.155098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2cd2514-373f-4e8f-9cd0-b6a2ba47b2bd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:47.157400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2cd2514-373f-4e8f-9cd0-b6a2ba47b2bd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:47.157912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2cd2514-373f-4e8f-9cd0-b6a2ba47b2bd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:47.487966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-37de081e-73e8-4de3-bc01-65ed767bbc40 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:47.498932 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-37de081e-73e8-4de3-bc01-65ed767bbc40 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1290 microversion: 2.1 time: 0.402578 Jul 20 04:25:47.516311 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1445/3072] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:47 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1290 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:48.528694 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a57a582f-98db-4f96-b428-4e55fd3641b5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:48.530423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a57a582f-98db-4f96-b428-4e55fd3641b5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:48.545310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a57a582f-98db-4f96-b428-4e55fd3641b5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:48.552741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a57a582f-98db-4f96-b428-4e55fd3641b5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:48.558445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a57a582f-98db-4f96-b428-4e55fd3641b5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:48.559151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a57a582f-98db-4f96-b428-4e55fd3641b5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:49.318844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a57a582f-98db-4f96-b428-4e55fd3641b5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:49.333611 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a57a582f-98db-4f96-b428-4e55fd3641b5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1290 microversion: 2.1 time: 0.809261 Jul 20 04:25:49.336788 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1446/3073] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:48 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1290 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:49.352496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-1d29debf-79f0-4bbf-ba8d-52b1cc08038b req-b9ce1c79-c83f-4840-8862-db1ed9c3b5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802d383f-a9d5-4707-9a0c-7138b63d3ca9", "name": "network-vif-plugged", "status": "completed", "tag": "ceb0eff4-396b-4903-83cc-997cf4deb834"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:49.380866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c2cd2514-373f-4e8f-9cd0-b6a2ba47b2bd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:49.396053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-1d29debf-79f0-4bbf-ba8d-52b1cc08038b req-b9ce1c79-c83f-4840-8862-db1ed9c3b5bf service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:49.396831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-1d29debf-79f0-4bbf-ba8d-52b1cc08038b req-b9ce1c79-c83f-4840-8862-db1ed9c3b5bf service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:49.399809 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c2cd2514-373f-4e8f-9cd0-b6a2ba47b2bd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1508 microversion: 2.1 time: 2.293792 Jul 20 04:25:49.401948 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1628/3074] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:47 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1508 bytes in 2298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:49.436529 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-1d29debf-79f0-4bbf-ba8d-52b1cc08038b req-b9ce1c79-c83f-4840-8862-db1ed9c3b5bf service nova] Creating event network-vif-plugged:ceb0eff4-396b-4903-83cc-997cf4deb834 for instance 802d383f-a9d5-4707-9a0c-7138b63d3ca9 on n-h2-826526-5 Jul 20 04:25:49.448208 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-1d29debf-79f0-4bbf-ba8d-52b1cc08038b req-b9ce1c79-c83f-4840-8862-db1ed9c3b5bf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109893 Jul 20 04:25:49.449412 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1447/3075] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:50.352629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2238169d-ce5e-413c-9bba-6198406e804c tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:50.353644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2238169d-ce5e-413c-9bba-6198406e804c tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:50.371591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:50.378543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2238169d-ce5e-413c-9bba-6198406e804c tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:50.384521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2238169d-ce5e-413c-9bba-6198406e804c tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:50.386484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2238169d-ce5e-413c-9bba-6198406e804c tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:50.387367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2238169d-ce5e-413c-9bba-6198406e804c tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:50.426435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a6f1daba-759f-4477-9421-ffc613b66217 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:50.427322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a6f1daba-759f-4477-9421-ffc613b66217 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:50.442398 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6f1daba-759f-4477-9421-ffc613b66217 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:50.447938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6f1daba-759f-4477-9421-ffc613b66217 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:50.448942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6f1daba-759f-4477-9421-ffc613b66217 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:50.449393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6f1daba-759f-4477-9421-ffc613b66217 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:50.860246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a6f1daba-759f-4477-9421-ffc613b66217 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:50.877151 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a6f1daba-759f-4477-9421-ffc613b66217 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1508 microversion: 2.1 time: 0.456236 Jul 20 04:25:50.878414 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1448/3076] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:50 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1508 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:51.254334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2238169d-ce5e-413c-9bba-6198406e804c tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:51.264529 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2238169d-ce5e-413c-9bba-6198406e804c tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1290 microversion: 2.1 time: 0.915709 Jul 20 04:25:51.274830 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1629/3077] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:50 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1290 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:51.900895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b69228d9-1772-4d96-b2b3-4af68550f4c3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:51.902385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b69228d9-1772-4d96-b2b3-4af68550f4c3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:51.934192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b69228d9-1772-4d96-b2b3-4af68550f4c3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:51.935982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b69228d9-1772-4d96-b2b3-4af68550f4c3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:51.937895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b69228d9-1772-4d96-b2b3-4af68550f4c3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:51.939943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b69228d9-1772-4d96-b2b3-4af68550f4c3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:51.985608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:52.292737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-78381eb8-20d2-4acc-ada2-1109947b1818 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:52.293600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-78381eb8-20d2-4acc-ada2-1109947b1818 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:52.307404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78381eb8-20d2-4acc-ada2-1109947b1818 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:52.308544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78381eb8-20d2-4acc-ada2-1109947b1818 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:52.310370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78381eb8-20d2-4acc-ada2-1109947b1818 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:52.313371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78381eb8-20d2-4acc-ada2-1109947b1818 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:52.705588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b69228d9-1772-4d96-b2b3-4af68550f4c3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:52.722156 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b69228d9-1772-4d96-b2b3-4af68550f4c3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1508 microversion: 2.1 time: 0.826360 Jul 20 04:25:52.722776 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1449/3078] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:51 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1508 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:53.741552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1b24b7d6-58f3-4f39-b81b-69b69f68c010 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:53.743581 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1b24b7d6-58f3-4f39-b81b-69b69f68c010 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:53.763224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1b24b7d6-58f3-4f39-b81b-69b69f68c010 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:53.764390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1b24b7d6-58f3-4f39-b81b-69b69f68c010 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:53.765475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1b24b7d6-58f3-4f39-b81b-69b69f68c010 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:53.766385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1b24b7d6-58f3-4f39-b81b-69b69f68c010 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:54.016211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-78381eb8-20d2-4acc-ada2-1109947b1818 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:54.054076 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-78381eb8-20d2-4acc-ada2-1109947b1818 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1481 microversion: 2.1 time: 1.766944 Jul 20 04:25:54.066045 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1630/3079] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:52 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1481 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:54.078231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3ff488ab-4f1e-4a70-963d-cf8889bbe788 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:54.083646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3ff488ab-4f1e-4a70-963d-cf8889bbe788 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:54.115247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ff488ab-4f1e-4a70-963d-cf8889bbe788 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:54.116145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ff488ab-4f1e-4a70-963d-cf8889bbe788 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:54.117705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ff488ab-4f1e-4a70-963d-cf8889bbe788 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:54.118515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ff488ab-4f1e-4a70-963d-cf8889bbe788 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:54.383724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1b24b7d6-58f3-4f39-b81b-69b69f68c010 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:54.401187 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1b24b7d6-58f3-4f39-b81b-69b69f68c010 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1508 microversion: 2.1 time: 0.660991 Jul 20 04:25:54.402027 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1450/3080] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:53 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1508 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:54.847358 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3ff488ab-4f1e-4a70-963d-cf8889bbe788 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.778020 Jul 20 04:25:54.847999 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1631/3081] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:25:54 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9/os-interface => generated 284 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:25:55.437729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1769f3e6-d39a-4466-a8b4-8bc47d4e049c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:55.450412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1769f3e6-d39a-4466-a8b4-8bc47d4e049c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:55.472982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1769f3e6-d39a-4466-a8b4-8bc47d4e049c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:55.474225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1769f3e6-d39a-4466-a8b4-8bc47d4e049c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:55.476772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1769f3e6-d39a-4466-a8b4-8bc47d4e049c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:55.477621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1769f3e6-d39a-4466-a8b4-8bc47d4e049c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:57.458074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1769f3e6-d39a-4466-a8b4-8bc47d4e049c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:57.483066 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1769f3e6-d39a-4466-a8b4-8bc47d4e049c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1508 microversion: 2.1 time: 2.055856 Jul 20 04:25:57.488801 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1451/3082] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:55 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1508 bytes in 2062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:58.527062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6294a824-d44a-4987-bf95-fca1a2d055ff tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:58.528298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6294a824-d44a-4987-bf95-fca1a2d055ff tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:58.538849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6294a824-d44a-4987-bf95-fca1a2d055ff tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:58.551063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6294a824-d44a-4987-bf95-fca1a2d055ff tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:58.552215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6294a824-d44a-4987-bf95-fca1a2d055ff tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:58.554639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6294a824-d44a-4987-bf95-fca1a2d055ff tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:00.110950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bb4c8daa-4df0-485e-9038-1d8e0f2a28d0 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:00.111995 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bb4c8daa-4df0-485e-9038-1d8e0f2a28d0 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:00.137331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb4c8daa-4df0-485e-9038-1d8e0f2a28d0 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:00.139081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb4c8daa-4df0-485e-9038-1d8e0f2a28d0 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:00.141909 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb4c8daa-4df0-485e-9038-1d8e0f2a28d0 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:00.143519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb4c8daa-4df0-485e-9038-1d8e0f2a28d0 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:00.422891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6294a824-d44a-4987-bf95-fca1a2d055ff tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:00.455695 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6294a824-d44a-4987-bf95-fca1a2d055ff tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1508 microversion: 2.1 time: 1.932332 Jul 20 04:26:00.466652 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1632/3083] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:58 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1508 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:00.472152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-2c664e07-91b0-45e0-b9f6-55eedb74784b req-75494c26-1a51-42f4-b630-21ffc525a7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "802d383f-a9d5-4707-9a0c-7138b63d3ca9", "tag": "ceb0eff4-396b-4903-83cc-997cf4deb834"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:00.508432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-2c664e07-91b0-45e0-b9f6-55eedb74784b req-75494c26-1a51-42f4-b630-21ffc525a7e2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:00.508891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-2c664e07-91b0-45e0-b9f6-55eedb74784b req-75494c26-1a51-42f4-b630-21ffc525a7e2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:00.566129 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-2c664e07-91b0-45e0-b9f6-55eedb74784b req-75494c26-1a51-42f4-b630-21ffc525a7e2 service nova] Creating event network-changed:ceb0eff4-396b-4903-83cc-997cf4deb834 for instance 802d383f-a9d5-4707-9a0c-7138b63d3ca9 on n-h2-826526-5 Jul 20 04:26:00.590125 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-2c664e07-91b0-45e0-b9f6-55eedb74784b req-75494c26-1a51-42f4-b630-21ffc525a7e2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120985 Jul 20 04:26:00.591458 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1633/3084] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:00.811706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bb4c8daa-4df0-485e-9038-1d8e0f2a28d0 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:00.821448 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bb4c8daa-4df0-485e-9038-1d8e0f2a28d0 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1481 microversion: 2.1 time: 0.719167 Jul 20 04:26:00.822254 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1452/3085] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:00 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1481 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:01.473870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-74315470-68b1-41b8-b759-f1d98dcb71f6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:01.474562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-74315470-68b1-41b8-b759-f1d98dcb71f6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:01.488952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-74315470-68b1-41b8-b759-f1d98dcb71f6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:01.492833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-74315470-68b1-41b8-b759-f1d98dcb71f6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:01.494210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-74315470-68b1-41b8-b759-f1d98dcb71f6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:01.496497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-74315470-68b1-41b8-b759-f1d98dcb71f6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:03.357024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-74315470-68b1-41b8-b759-f1d98dcb71f6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:03.392897 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-74315470-68b1-41b8-b759-f1d98dcb71f6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1508 microversion: 2.1 time: 1.921587 Jul 20 04:26:03.397747 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1634/3086] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:01 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1508 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:04.417758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c2aa4956-e47f-4797-b3f2-1df9965e395d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:04.420751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c2aa4956-e47f-4797-b3f2-1df9965e395d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:04.445332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c2aa4956-e47f-4797-b3f2-1df9965e395d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:04.450503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c2aa4956-e47f-4797-b3f2-1df9965e395d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:04.456302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c2aa4956-e47f-4797-b3f2-1df9965e395d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:04.457361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c2aa4956-e47f-4797-b3f2-1df9965e395d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:05.978665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c2aa4956-e47f-4797-b3f2-1df9965e395d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:06.005426 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c2aa4956-e47f-4797-b3f2-1df9965e395d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1508 microversion: 2.1 time: 1.594458 Jul 20 04:26:06.030585 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1453/3087] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:04 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1508 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:07.041678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bd278e97-6568-4167-beed-416733b81b2f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:07.043615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bd278e97-6568-4167-beed-416733b81b2f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:07.086128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd278e97-6568-4167-beed-416733b81b2f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:07.086954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd278e97-6568-4167-beed-416733b81b2f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:07.100998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd278e97-6568-4167-beed-416733b81b2f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:07.106602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd278e97-6568-4167-beed-416733b81b2f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:07.249502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:09.647864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bd278e97-6568-4167-beed-416733b81b2f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:09.680931 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bd278e97-6568-4167-beed-416733b81b2f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1508 microversion: 2.1 time: 2.644577 Jul 20 04:26:09.698759 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1635/3088] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:07 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1508 bytes in 2659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:10.713803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fe44089d-d41e-48fb-9ab7-91def2b17945 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:10.715057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fe44089d-d41e-48fb-9ab7-91def2b17945 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:10.738050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe44089d-d41e-48fb-9ab7-91def2b17945 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:10.752220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe44089d-d41e-48fb-9ab7-91def2b17945 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:10.755177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe44089d-d41e-48fb-9ab7-91def2b17945 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:10.756536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe44089d-d41e-48fb-9ab7-91def2b17945 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:12.066352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fe44089d-d41e-48fb-9ab7-91def2b17945 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:12.078883 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fe44089d-d41e-48fb-9ab7-91def2b17945 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1508 microversion: 2.1 time: 1.369061 Jul 20 04:26:12.098384 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1454/3089] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:10 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1508 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:13.123353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fe16907f-4696-4afb-bc91-74b7ec0a3361 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:13.127181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fe16907f-4696-4afb-bc91-74b7ec0a3361 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:13.178250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe16907f-4696-4afb-bc91-74b7ec0a3361 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:13.180319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe16907f-4696-4afb-bc91-74b7ec0a3361 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:13.183127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe16907f-4696-4afb-bc91-74b7ec0a3361 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:13.186716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe16907f-4696-4afb-bc91-74b7ec0a3361 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:14.273998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fe16907f-4696-4afb-bc91-74b7ec0a3361 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:14.298419 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fe16907f-4696-4afb-bc91-74b7ec0a3361 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1529 microversion: 2.1 time: 1.185869 Jul 20 04:26:14.312615 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1636/3090] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:13 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1529 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:15.338878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b9b5ee97-767b-4e61-85bf-1a6d37e34f0c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:15.340699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b9b5ee97-767b-4e61-85bf-1a6d37e34f0c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:15.378943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9b5ee97-767b-4e61-85bf-1a6d37e34f0c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:15.387023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9b5ee97-767b-4e61-85bf-1a6d37e34f0c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:15.391159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9b5ee97-767b-4e61-85bf-1a6d37e34f0c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:15.396927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9b5ee97-767b-4e61-85bf-1a6d37e34f0c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:16.073041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b9b5ee97-767b-4e61-85bf-1a6d37e34f0c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:16.119506 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b9b5ee97-767b-4e61-85bf-1a6d37e34f0c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1524 microversion: 2.1 time: 0.788448 Jul 20 04:26:16.129928 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1455/3091] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:15 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1524 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:17.169088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-89664084-2bf9-4f80-af19-f0b9d2a9c59d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:17.171151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-89664084-2bf9-4f80-af19-f0b9d2a9c59d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:17.252349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89664084-2bf9-4f80-af19-f0b9d2a9c59d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:17.253219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89664084-2bf9-4f80-af19-f0b9d2a9c59d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:17.274599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89664084-2bf9-4f80-af19-f0b9d2a9c59d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:17.276937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89664084-2bf9-4f80-af19-f0b9d2a9c59d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:17.811045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-904aac0d-14b5-468a-bc25-1ccacbaa2faa tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-567728436", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "2efae4a8-78b0-43da-ae4b-ec878f622346"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:17.835574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=22 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:20.661059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-89664084-2bf9-4f80-af19-f0b9d2a9c59d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:20.745729 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-89664084-2bf9-4f80-af19-f0b9d2a9c59d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1524 microversion: 2.1 time: 3.589380 Jul 20 04:26:20.753123 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1637/3092] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:17 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1524 bytes in 3599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:21.785611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f97b2b6e-21b9-4953-866b-17fb010f7ceb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:21.786512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f97b2b6e-21b9-4953-866b-17fb010f7ceb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:21.819824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=18 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:21.824091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f97b2b6e-21b9-4953-866b-17fb010f7ceb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:21.828069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f97b2b6e-21b9-4953-866b-17fb010f7ceb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:21.832707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f97b2b6e-21b9-4953-866b-17fb010f7ceb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:21.837331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f97b2b6e-21b9-4953-866b-17fb010f7ceb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:23.629628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f97b2b6e-21b9-4953-866b-17fb010f7ceb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:23.667749 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f97b2b6e-21b9-4953-866b-17fb010f7ceb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1524 microversion: 2.1 time: 1.888153 Jul 20 04:26:23.682868 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1638/3093] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:21 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1524 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:24.055899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-ec5a4e92-c48e-46b8-9323-66b7e11ae9c6 req-7ed4aa6b-6133-43b3-86a6-b4fe951270d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e82edc2-fbf4-4e3f-b3b2-f937cd316135", "name": "network-vif-plugged", "status": "completed", "tag": "83456d49-d3e2-4124-ab2c-f3c45c93e1d0"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:24.085105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ec5a4e92-c48e-46b8-9323-66b7e11ae9c6 req-7ed4aa6b-6133-43b3-86a6-b4fe951270d8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:24.085566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ec5a4e92-c48e-46b8-9323-66b7e11ae9c6 req-7ed4aa6b-6133-43b3-86a6-b4fe951270d8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:24.128174 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-ec5a4e92-c48e-46b8-9323-66b7e11ae9c6 req-7ed4aa6b-6133-43b3-86a6-b4fe951270d8 service nova] Creating event network-vif-plugged:83456d49-d3e2-4124-ab2c-f3c45c93e1d0 for instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 on n-h1-826526-5 Jul 20 04:26:24.145841 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-ec5a4e92-c48e-46b8-9323-66b7e11ae9c6 req-7ed4aa6b-6133-43b3-86a6-b4fe951270d8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094017 Jul 20 04:26:24.153563 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1639/3094] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:26:24.714783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-084f0cfb-0c67-4d7f-b328-dbe4028bc6ec tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:24.716694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-084f0cfb-0c67-4d7f-b328-dbe4028bc6ec tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:24.740920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-084f0cfb-0c67-4d7f-b328-dbe4028bc6ec tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:24.741667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-084f0cfb-0c67-4d7f-b328-dbe4028bc6ec tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:24.742946 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-084f0cfb-0c67-4d7f-b328-dbe4028bc6ec tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:24.743682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-084f0cfb-0c67-4d7f-b328-dbe4028bc6ec tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:26.110718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=40 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:26.430021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-084f0cfb-0c67-4d7f-b328-dbe4028bc6ec tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:26.454805 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-084f0cfb-0c67-4d7f-b328-dbe4028bc6ec tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1524 microversion: 2.1 time: 1.750610 Jul 20 04:26:26.482533 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1640/3095] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:24 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1524 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:27.503527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c6723214-efec-4199-a669-171ab51afbe9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:27.512724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c6723214-efec-4199-a669-171ab51afbe9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:27.553111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6723214-efec-4199-a669-171ab51afbe9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:27.553926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6723214-efec-4199-a669-171ab51afbe9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:27.555242 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6723214-efec-4199-a669-171ab51afbe9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:27.556059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6723214-efec-4199-a669-171ab51afbe9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:27.922796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:28.330388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c6723214-efec-4199-a669-171ab51afbe9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:28.401554 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c6723214-efec-4199-a669-171ab51afbe9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1524 microversion: 2.1 time: 0.905287 Jul 20 04:26:28.428782 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1641/3096] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:27 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1524 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:29.307768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f29e7186-0927-41a7-b2bd-9e02ce14d935 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:29.330814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f29e7186-0927-41a7-b2bd-9e02ce14d935 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:29.340587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f29e7186-0927-41a7-b2bd-9e02ce14d935 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Searching by: {'deleted': False, 'project_id': 'dd28073732224b22ba367fc99d203235'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:26:29.411221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f29e7186-0927-41a7-b2bd-9e02ce14d935 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:29.412032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f29e7186-0927-41a7-b2bd-9e02ce14d935 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:29.418002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f29e7186-0927-41a7-b2bd-9e02ce14d935 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:29.421615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f29e7186-0927-41a7-b2bd-9e02ce14d935 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:29.548060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-f29e7186-0927-41a7-b2bd-9e02ce14d935 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:26:29.703838 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f29e7186-0927-41a7-b2bd-9e02ce14d935 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.405521 Jul 20 04:26:29.709650 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1642/3097] 10.222.0.17 () {58 vars in 1124 bytes} [Wed Jul 20 04:26:29 2022] GET /compute/v2.1/servers => generated 342 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:29.737864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3c47a7c2-21ec-49dd-a5ee-101725f767ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:29.738496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3c47a7c2-21ec-49dd-a5ee-101725f767ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:29.765240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c47a7c2-21ec-49dd-a5ee-101725f767ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:29.773751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c47a7c2-21ec-49dd-a5ee-101725f767ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:29.774977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c47a7c2-21ec-49dd-a5ee-101725f767ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:29.778321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c47a7c2-21ec-49dd-a5ee-101725f767ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:31.212246 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3c47a7c2-21ec-49dd-a5ee-101725f767ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:31.224548 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3c47a7c2-21ec-49dd-a5ee-101725f767ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1524 microversion: 2.1 time: 1.499646 Jul 20 04:26:31.239445 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1643/3098] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:29 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1524 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:31.244727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-abcd6287-63a1-4cc3-b36b-65d95e087f5a tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:31.264521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-abcd6287-63a1-4cc3-b36b-65d95e087f5a tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:31.270100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-abcd6287-63a1-4cc3-b36b-65d95e087f5a tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Searching by: {'deleted': False, 'project_id': 'dd28073732224b22ba367fc99d203235'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:26:31.292228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abcd6287-63a1-4cc3-b36b-65d95e087f5a tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:31.296087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abcd6287-63a1-4cc3-b36b-65d95e087f5a tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:31.297900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abcd6287-63a1-4cc3-b36b-65d95e087f5a tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:31.306357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abcd6287-63a1-4cc3-b36b-65d95e087f5a tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:31.370939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-abcd6287-63a1-4cc3-b36b-65d95e087f5a tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:26:31.557048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-abcd6287-63a1-4cc3-b36b-65d95e087f5a tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:31.581633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abcd6287-63a1-4cc3-b36b-65d95e087f5a tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:31.582140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abcd6287-63a1-4cc3-b36b-65d95e087f5a tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:31.959617 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-abcd6287-63a1-4cc3-b36b-65d95e087f5a tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.718271 Jul 20 04:26:31.967657 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1644/3099] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:26:31 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:31.999770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-548aedbb-80a1-4432-b8f3-94efc492c1d0 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:32.038822 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-548aedbb-80a1-4432-b8f3-94efc492c1d0 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.046033 Jul 20 04:26:32.045807 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1645/3100] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:26:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:32.250161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2edc8fc2-b554-411a-996b-acf05a69f63e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:32.253678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2edc8fc2-b554-411a-996b-acf05a69f63e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:32.294114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2edc8fc2-b554-411a-996b-acf05a69f63e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:32.294915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2edc8fc2-b554-411a-996b-acf05a69f63e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:32.308801 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2edc8fc2-b554-411a-996b-acf05a69f63e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:32.313165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2edc8fc2-b554-411a-996b-acf05a69f63e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:33.049370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2edc8fc2-b554-411a-996b-acf05a69f63e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:33.061751 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2edc8fc2-b554-411a-996b-acf05a69f63e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1524 microversion: 2.1 time: 0.819464 Jul 20 04:26:33.067958 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1646/3101] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:32 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1524 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:33.093775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1d241253-6986-4139-99fa-86656d0cd826 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:33.097003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1d241253-6986-4139-99fa-86656d0cd826 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:33.115546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d241253-6986-4139-99fa-86656d0cd826 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:33.118476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d241253-6986-4139-99fa-86656d0cd826 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:33.120713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d241253-6986-4139-99fa-86656d0cd826 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:33.121451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d241253-6986-4139-99fa-86656d0cd826 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:33.168611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1d241253-6986-4139-99fa-86656d0cd826 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:26:33.310603 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1d241253-6986-4139-99fa-86656d0cd826 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "DELETE /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 204 len: 0 microversion: 2.1 time: 0.240115 Jul 20 04:26:33.314463 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1647/3102] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:26:33 2022] DELETE /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:26:33.330072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0171ffc5-5a93-4f64-b806-fae496b6ee05 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:33.333885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0171ffc5-5a93-4f64-b806-fae496b6ee05 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:33.346405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0171ffc5-5a93-4f64-b806-fae496b6ee05 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:33.347772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0171ffc5-5a93-4f64-b806-fae496b6ee05 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:33.350189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0171ffc5-5a93-4f64-b806-fae496b6ee05 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:33.350956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0171ffc5-5a93-4f64-b806-fae496b6ee05 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:33.958111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0171ffc5-5a93-4f64-b806-fae496b6ee05 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:34.003589 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0171ffc5-5a93-4f64-b806-fae496b6ee05 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1606 microversion: 2.1 time: 0.684667 Jul 20 04:26:34.016302 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1648/3103] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:33 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1606 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:34.087537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-499136dc-ea42-4da0-bb7f-fb8226463861 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:34.088802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-499136dc-ea42-4da0-bb7f-fb8226463861 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:34.110147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-499136dc-ea42-4da0-bb7f-fb8226463861 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:34.110963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-499136dc-ea42-4da0-bb7f-fb8226463861 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:34.112950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-499136dc-ea42-4da0-bb7f-fb8226463861 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:34.113806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-499136dc-ea42-4da0-bb7f-fb8226463861 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:34.886675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-499136dc-ea42-4da0-bb7f-fb8226463861 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:34.930353 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-499136dc-ea42-4da0-bb7f-fb8226463861 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1524 microversion: 2.1 time: 0.842584 Jul 20 04:26:34.936466 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1649/3104] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:34 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1524 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:35.045188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-92b600b5-2674-4fff-898f-2bbfa2cef3c4 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:35.049092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-92b600b5-2674-4fff-898f-2bbfa2cef3c4 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:35.093773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-92b600b5-2674-4fff-898f-2bbfa2cef3c4 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:35.095071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-92b600b5-2674-4fff-898f-2bbfa2cef3c4 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:35.098897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-92b600b5-2674-4fff-898f-2bbfa2cef3c4 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:35.102012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-92b600b5-2674-4fff-898f-2bbfa2cef3c4 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:35.937020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-92b600b5-2674-4fff-898f-2bbfa2cef3c4 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:35.943585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:35.985245 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-92b600b5-2674-4fff-898f-2bbfa2cef3c4 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1606 microversion: 2.1 time: 0.952673 Jul 20 04:26:35.988183 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1650/3105] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:35 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1606 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:35.997488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c63d24fa-ef50-46f1-bb2e-1cb8b096cd8d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:35.998953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c63d24fa-ef50-46f1-bb2e-1cb8b096cd8d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:36.021898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c63d24fa-ef50-46f1-bb2e-1cb8b096cd8d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:36.023338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c63d24fa-ef50-46f1-bb2e-1cb8b096cd8d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:36.024850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c63d24fa-ef50-46f1-bb2e-1cb8b096cd8d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:36.025756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c63d24fa-ef50-46f1-bb2e-1cb8b096cd8d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:36.546291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c63d24fa-ef50-46f1-bb2e-1cb8b096cd8d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:36.556612 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c63d24fa-ef50-46f1-bb2e-1cb8b096cd8d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1524 microversion: 2.1 time: 0.565612 Jul 20 04:26:36.559305 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1651/3106] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:35 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1524 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:37.011667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-26e0b503-087f-4756-9e83-a1dbf4add4c0 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:37.013289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-26e0b503-087f-4756-9e83-a1dbf4add4c0 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:37.029463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26e0b503-087f-4756-9e83-a1dbf4add4c0 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:37.031771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26e0b503-087f-4756-9e83-a1dbf4add4c0 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:37.032983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26e0b503-087f-4756-9e83-a1dbf4add4c0 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:37.034609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26e0b503-087f-4756-9e83-a1dbf4add4c0 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:37.383082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-26e0b503-087f-4756-9e83-a1dbf4add4c0 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:37.404147 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-26e0b503-087f-4756-9e83-a1dbf4add4c0 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1606 microversion: 2.1 time: 0.390645 Jul 20 04:26:37.404637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-904aac0d-14b5-468a-bc25-1ccacbaa2faa tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] validate_networks() for [('2efae4a8-78b0-43da-ae4b-ec878f622346', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:26:37.405481 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1652/3107] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:37 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1606 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:37.577054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fa1a81cf-d8c6-47e9-b981-e3739e0d19b5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:37.577753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fa1a81cf-d8c6-47e9-b981-e3739e0d19b5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:37.588249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa1a81cf-d8c6-47e9-b981-e3739e0d19b5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:37.593655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa1a81cf-d8c6-47e9-b981-e3739e0d19b5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:37.597144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa1a81cf-d8c6-47e9-b981-e3739e0d19b5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:37.597835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa1a81cf-d8c6-47e9-b981-e3739e0d19b5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:37.905813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fa1a81cf-d8c6-47e9-b981-e3739e0d19b5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:37.920599 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fa1a81cf-d8c6-47e9-b981-e3739e0d19b5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1524 microversion: 2.1 time: 0.348014 Jul 20 04:26:37.922057 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1653/3108] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:37 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1524 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:38.431583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-505a4013-d83e-457a-b7ef-8adb43decb10 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:38.433381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-505a4013-d83e-457a-b7ef-8adb43decb10 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:38.471218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-505a4013-d83e-457a-b7ef-8adb43decb10 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:38.475837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-505a4013-d83e-457a-b7ef-8adb43decb10 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:38.481661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-505a4013-d83e-457a-b7ef-8adb43decb10 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:38.484147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-505a4013-d83e-457a-b7ef-8adb43decb10 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:38.837486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-505a4013-d83e-457a-b7ef-8adb43decb10 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:38.879925 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-505a4013-d83e-457a-b7ef-8adb43decb10 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1539 microversion: 2.1 time: 0.460378 Jul 20 04:26:38.888805 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1654/3109] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:38 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1539 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:38.952461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d11fc543-7882-4674-b9e3-4f9a5cbc1a5a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:38.953416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d11fc543-7882-4674-b9e3-4f9a5cbc1a5a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:38.964950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d11fc543-7882-4674-b9e3-4f9a5cbc1a5a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:38.969696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d11fc543-7882-4674-b9e3-4f9a5cbc1a5a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:38.971384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d11fc543-7882-4674-b9e3-4f9a5cbc1a5a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:38.975823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d11fc543-7882-4674-b9e3-4f9a5cbc1a5a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:39.857312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d11fc543-7882-4674-b9e3-4f9a5cbc1a5a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:39.878858 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d11fc543-7882-4674-b9e3-4f9a5cbc1a5a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1524 microversion: 2.1 time: 0.931194 Jul 20 04:26:39.880303 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1655/3110] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:38 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1524 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:39.911764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b7047ba8-52b2-4af4-b3b2-2131c25169ab tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:39.913342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b7047ba8-52b2-4af4-b3b2-2131c25169ab tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:39.960835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b7047ba8-52b2-4af4-b3b2-2131c25169ab tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:39.961781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b7047ba8-52b2-4af4-b3b2-2131c25169ab tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:39.962771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b7047ba8-52b2-4af4-b3b2-2131c25169ab tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:39.964442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b7047ba8-52b2-4af4-b3b2-2131c25169ab tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:40.855394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b7047ba8-52b2-4af4-b3b2-2131c25169ab tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:40.878604 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b7047ba8-52b2-4af4-b3b2-2131c25169ab tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1539 microversion: 2.1 time: 0.983424 Jul 20 04:26:40.914720 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1656/3111] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:39 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1539 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:40.923590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-62edd9c8-3a72-4177-ae58-85dbc2430787 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:40.937000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-62edd9c8-3a72-4177-ae58-85dbc2430787 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:40.962446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62edd9c8-3a72-4177-ae58-85dbc2430787 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:40.963303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62edd9c8-3a72-4177-ae58-85dbc2430787 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:40.964302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62edd9c8-3a72-4177-ae58-85dbc2430787 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:40.964957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62edd9c8-3a72-4177-ae58-85dbc2430787 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:41.198427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-904aac0d-14b5-468a-bc25-1ccacbaa2faa tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:26:41.200534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-904aac0d-14b5-468a-bc25-1ccacbaa2faa tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:26:41.201374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-904aac0d-14b5-468a-bc25-1ccacbaa2faa tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:26:41.202631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-904aac0d-14b5-468a-bc25-1ccacbaa2faa tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:26:41.203268 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-904aac0d-14b5-468a-bc25-1ccacbaa2faa tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:26:41.244896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-904aac0d-14b5-468a-bc25-1ccacbaa2faa tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:41.248174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-904aac0d-14b5-468a-bc25-1ccacbaa2faa tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:41.250177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-904aac0d-14b5-468a-bc25-1ccacbaa2faa tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:41.253966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-904aac0d-14b5-468a-bc25-1ccacbaa2faa tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:41.336590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:41.379231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-904aac0d-14b5-468a-bc25-1ccacbaa2faa tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Getting quotas for project 948326ddffa847bf900ddb0e59857004. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:41.404546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-904aac0d-14b5-468a-bc25-1ccacbaa2faa tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Getting quotas for user 05aaa42fb4ae4f47a216c8f9288061c2 and project 948326ddffa847bf900ddb0e59857004. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:41.445489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-904aac0d-14b5-468a-bc25-1ccacbaa2faa tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:26:41.456472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-904aac0d-14b5-468a-bc25-1ccacbaa2faa tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:26:41.547368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:41.604070 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-904aac0d-14b5-468a-bc25-1ccacbaa2faa tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 24.314459 Jul 20 04:26:41.612554 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1456/3112] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:26:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 24324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:26:41.643828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2c8fdfc5-f404-4309-852b-ed9f8a2c3725 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:41.647276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2c8fdfc5-f404-4309-852b-ed9f8a2c3725 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:42.200676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2c8fdfc5-f404-4309-852b-ed9f8a2c3725 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05aaa42fb4ae4f47a216c8f9288061c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948326ddffa847bf900ddb0e59857004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:42.217079 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2c8fdfc5-f404-4309-852b-ed9f8a2c3725 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 200 len: 1215 microversion: 2.1 time: 0.595496 Jul 20 04:26:42.229026 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1457/3113] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:41 2022] GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 1215 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:42.235309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed76b115-c7be-46ae-8172-d3db44025201 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:42.245977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ed76b115-c7be-46ae-8172-d3db44025201 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:42.259474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed76b115-c7be-46ae-8172-d3db44025201 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:42.264052 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed76b115-c7be-46ae-8172-d3db44025201 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:42.267053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed76b115-c7be-46ae-8172-d3db44025201 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:42.268696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed76b115-c7be-46ae-8172-d3db44025201 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:42.330895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-62edd9c8-3a72-4177-ae58-85dbc2430787 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:42.381151 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-62edd9c8-3a72-4177-ae58-85dbc2430787 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1524 microversion: 2.1 time: 1.461567 Jul 20 04:26:42.388187 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1657/3114] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:40 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1524 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:42.435652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-323780e0-53bc-4580-9a93-b81b446e9494 req-0456453b-18ff-4042-a154-3ca9e4438540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802d383f-a9d5-4707-9a0c-7138b63d3ca9", "name": "network-vif-deleted", "tag": "ceb0eff4-396b-4903-83cc-997cf4deb834"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:42.495045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-323780e0-53bc-4580-9a93-b81b446e9494 req-0456453b-18ff-4042-a154-3ca9e4438540 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:42.495517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-323780e0-53bc-4580-9a93-b81b446e9494 req-0456453b-18ff-4042-a154-3ca9e4438540 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:42.583352 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-323780e0-53bc-4580-9a93-b81b446e9494 req-0456453b-18ff-4042-a154-3ca9e4438540 service nova] Creating event network-vif-deleted:ceb0eff4-396b-4903-83cc-997cf4deb834 for instance 802d383f-a9d5-4707-9a0c-7138b63d3ca9 on n-h2-826526-5 Jul 20 04:26:42.604928 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-323780e0-53bc-4580-9a93-b81b446e9494 req-0456453b-18ff-4042-a154-3ca9e4438540 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205786 Jul 20 04:26:42.606853 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1658/3115] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:42.909190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ed76b115-c7be-46ae-8172-d3db44025201 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:42.967398 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ed76b115-c7be-46ae-8172-d3db44025201 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1539 microversion: 2.1 time: 0.733748 Jul 20 04:26:42.969370 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1458/3116] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:42 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1539 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:43.237942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c5b13499-1364-4f87-8d5b-da25ea146596 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:43.238662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c5b13499-1364-4f87-8d5b-da25ea146596 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:43.371166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c5b13499-1364-4f87-8d5b-da25ea146596 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05aaa42fb4ae4f47a216c8f9288061c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948326ddffa847bf900ddb0e59857004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:43.389482 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c5b13499-1364-4f87-8d5b-da25ea146596 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 200 len: 1215 microversion: 2.1 time: 0.158656 Jul 20 04:26:43.408739 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1659/3117] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:43 2022] GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 1215 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:43.417751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2e05f2e6-91fe-4d38-baa4-d391d0032dfd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:43.419284 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2e05f2e6-91fe-4d38-baa4-d391d0032dfd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:43.430540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e05f2e6-91fe-4d38-baa4-d391d0032dfd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:43.437944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e05f2e6-91fe-4d38-baa4-d391d0032dfd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:43.439210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e05f2e6-91fe-4d38-baa4-d391d0032dfd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:43.439840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e05f2e6-91fe-4d38-baa4-d391d0032dfd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:44.000484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-02a9bea2-4e0c-434a-a2e9-b8f630d40a44 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:44.001109 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-02a9bea2-4e0c-434a-a2e9-b8f630d40a44 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:44.074639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-02a9bea2-4e0c-434a-a2e9-b8f630d40a44 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:44.075382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-02a9bea2-4e0c-434a-a2e9-b8f630d40a44 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:44.083601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-02a9bea2-4e0c-434a-a2e9-b8f630d40a44 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:44.088445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-02a9bea2-4e0c-434a-a2e9-b8f630d40a44 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:44.759962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-02a9bea2-4e0c-434a-a2e9-b8f630d40a44 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:44.808629 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-02a9bea2-4e0c-434a-a2e9-b8f630d40a44 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1250 microversion: 2.1 time: 0.813987 Jul 20 04:26:44.831323 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1660/3118] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:43 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1250 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:44.851199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3fa33267-2260-4c19-9578-8cfe6c59d213 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:44.853711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3fa33267-2260-4c19-9578-8cfe6c59d213 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:44.867479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fa33267-2260-4c19-9578-8cfe6c59d213 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:44.868691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fa33267-2260-4c19-9578-8cfe6c59d213 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:44.871198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fa33267-2260-4c19-9578-8cfe6c59d213 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:44.874332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fa33267-2260-4c19-9578-8cfe6c59d213 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:45.335110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3fa33267-2260-4c19-9578-8cfe6c59d213 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05aaa42fb4ae4f47a216c8f9288061c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948326ddffa847bf900ddb0e59857004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:45.367329 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3fa33267-2260-4c19-9578-8cfe6c59d213 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 200 len: 1267 microversion: 2.1 time: 0.532946 Jul 20 04:26:45.384952 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1661/3119] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:44 2022] GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 1267 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:45.755727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2e05f2e6-91fe-4d38-baa4-d391d0032dfd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:45.824057 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2e05f2e6-91fe-4d38-baa4-d391d0032dfd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1524 microversion: 2.1 time: 2.396284 Jul 20 04:26:45.829371 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1459/3120] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:43 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1524 bytes in 2417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:45.861870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-df4cd2a0-4cc5-4a37-9657-379907bd39b8 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:45.868108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-df4cd2a0-4cc5-4a37-9657-379907bd39b8 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:45.923666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df4cd2a0-4cc5-4a37-9657-379907bd39b8 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:45.924360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df4cd2a0-4cc5-4a37-9657-379907bd39b8 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:45.939595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df4cd2a0-4cc5-4a37-9657-379907bd39b8 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:45.941250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df4cd2a0-4cc5-4a37-9657-379907bd39b8 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:46.187789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-df4cd2a0-4cc5-4a37-9657-379907bd39b8 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:46.216139 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-df4cd2a0-4cc5-4a37-9657-379907bd39b8 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1250 microversion: 2.1 time: 0.369921 Jul 20 04:26:46.233114 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1662/3121] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:45 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1250 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:46.410727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2d9b19f1-009d-4ec3-adef-0b9e53d0e045 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:46.413254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2d9b19f1-009d-4ec3-adef-0b9e53d0e045 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:46.488871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d9b19f1-009d-4ec3-adef-0b9e53d0e045 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:46.489922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d9b19f1-009d-4ec3-adef-0b9e53d0e045 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:46.498537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d9b19f1-009d-4ec3-adef-0b9e53d0e045 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:46.502004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d9b19f1-009d-4ec3-adef-0b9e53d0e045 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:46.861693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-51037342-cde3-41a9-8555-653270f90dfa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:46.862644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-51037342-cde3-41a9-8555-653270f90dfa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:46.882582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51037342-cde3-41a9-8555-653270f90dfa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:46.883051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51037342-cde3-41a9-8555-653270f90dfa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:46.883939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51037342-cde3-41a9-8555-653270f90dfa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:46.884337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51037342-cde3-41a9-8555-653270f90dfa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:46.944137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2d9b19f1-009d-4ec3-adef-0b9e53d0e045 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05aaa42fb4ae4f47a216c8f9288061c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948326ddffa847bf900ddb0e59857004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:46.974654 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2d9b19f1-009d-4ec3-adef-0b9e53d0e045 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 200 len: 1273 microversion: 2.1 time: 0.571561 Jul 20 04:26:46.976205 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1460/3122] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:46 2022] GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 1273 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:47.250113 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3326b64f-cf1f-47cc-8cdf-ad7dd9a591fd tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:47.253723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3326b64f-cf1f-47cc-8cdf-ad7dd9a591fd tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:47.288164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3326b64f-cf1f-47cc-8cdf-ad7dd9a591fd tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:47.304420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3326b64f-cf1f-47cc-8cdf-ad7dd9a591fd tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:47.306656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3326b64f-cf1f-47cc-8cdf-ad7dd9a591fd tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:47.315713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3326b64f-cf1f-47cc-8cdf-ad7dd9a591fd tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:47.747351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3326b64f-cf1f-47cc-8cdf-ad7dd9a591fd tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:47.775792 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3326b64f-cf1f-47cc-8cdf-ad7dd9a591fd tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1250 microversion: 2.1 time: 0.530662 Jul 20 04:26:47.796363 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1461/3123] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:47 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1250 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:48.005879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2ad11d9c-198c-4198-964e-41782a9f52ee tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:48.006886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2ad11d9c-198c-4198-964e-41782a9f52ee tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:48.058328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ad11d9c-198c-4198-964e-41782a9f52ee tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:48.063297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ad11d9c-198c-4198-964e-41782a9f52ee tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:48.068556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ad11d9c-198c-4198-964e-41782a9f52ee tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:48.081263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ad11d9c-198c-4198-964e-41782a9f52ee tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:48.326605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-51037342-cde3-41a9-8555-653270f90dfa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:48.342069 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-51037342-cde3-41a9-8555-653270f90dfa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1524 microversion: 2.1 time: 1.488276 Jul 20 04:26:48.359660 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1663/3124] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:46 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1524 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:48.813861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6d41458c-b1d1-4334-bc94-61e45caf8c26 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:48.818619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6d41458c-b1d1-4334-bc94-61e45caf8c26 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:48.859437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d41458c-b1d1-4334-bc94-61e45caf8c26 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:48.865453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d41458c-b1d1-4334-bc94-61e45caf8c26 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:48.869133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d41458c-b1d1-4334-bc94-61e45caf8c26 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:48.870463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d41458c-b1d1-4334-bc94-61e45caf8c26 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:49.075616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2ad11d9c-198c-4198-964e-41782a9f52ee tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05aaa42fb4ae4f47a216c8f9288061c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948326ddffa847bf900ddb0e59857004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:49.108651 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2ad11d9c-198c-4198-964e-41782a9f52ee tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 200 len: 1315 microversion: 2.1 time: 1.110119 Jul 20 04:26:49.120541 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1462/3125] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:47 2022] GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 1315 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:49.141104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6d41458c-b1d1-4334-bc94-61e45caf8c26 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:49.165709 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6d41458c-b1d1-4334-bc94-61e45caf8c26 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1250 microversion: 2.1 time: 0.354001 Jul 20 04:26:49.178990 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1664/3126] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:48 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1250 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:49.387261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3ec7f03c-7358-4092-ae86-2516fbe8d3b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:49.388842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3ec7f03c-7358-4092-ae86-2516fbe8d3b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:49.431309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ec7f03c-7358-4092-ae86-2516fbe8d3b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:49.432199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ec7f03c-7358-4092-ae86-2516fbe8d3b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:49.433601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ec7f03c-7358-4092-ae86-2516fbe8d3b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:49.434385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ec7f03c-7358-4092-ae86-2516fbe8d3b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:50.149223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ebbfbd27-4958-41ca-b1df-83bbced7d2c9 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:50.153933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ebbfbd27-4958-41ca-b1df-83bbced7d2c9 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:50.201107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebbfbd27-4958-41ca-b1df-83bbced7d2c9 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:50.202096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebbfbd27-4958-41ca-b1df-83bbced7d2c9 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:50.209937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebbfbd27-4958-41ca-b1df-83bbced7d2c9 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:50.210844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebbfbd27-4958-41ca-b1df-83bbced7d2c9 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:50.866805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3ec7f03c-7358-4092-ae86-2516fbe8d3b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:50.902749 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3ec7f03c-7358-4092-ae86-2516fbe8d3b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1524 microversion: 2.1 time: 1.536254 Jul 20 04:26:50.906347 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1463/3127] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:49 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1524 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:50.932174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d18045df-3d1a-4f56-8776-5ef7d9d1b249 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:50.940070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d18045df-3d1a-4f56-8776-5ef7d9d1b249 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:51.002979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d18045df-3d1a-4f56-8776-5ef7d9d1b249 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:51.005145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d18045df-3d1a-4f56-8776-5ef7d9d1b249 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:51.008530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d18045df-3d1a-4f56-8776-5ef7d9d1b249 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:51.010894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d18045df-3d1a-4f56-8776-5ef7d9d1b249 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:51.087327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ebbfbd27-4958-41ca-b1df-83bbced7d2c9 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05aaa42fb4ae4f47a216c8f9288061c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948326ddffa847bf900ddb0e59857004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:51.128135 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ebbfbd27-4958-41ca-b1df-83bbced7d2c9 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 200 len: 1315 microversion: 2.1 time: 0.987689 Jul 20 04:26:51.135221 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1665/3128] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:50 2022] GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 1315 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:51.249308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d18045df-3d1a-4f56-8776-5ef7d9d1b249 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:51.276687 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d18045df-3d1a-4f56-8776-5ef7d9d1b249 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1250 microversion: 2.1 time: 0.366868 Jul 20 04:26:51.279104 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1464/3129] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:50 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1250 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:51.960888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d0e3f71d-e8ee-4a69-9f2a-effd9037f5ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:51.967057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d0e3f71d-e8ee-4a69-9f2a-effd9037f5ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:51.981971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:52.008939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0e3f71d-e8ee-4a69-9f2a-effd9037f5ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:52.025517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0e3f71d-e8ee-4a69-9f2a-effd9037f5ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:52.026959 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0e3f71d-e8ee-4a69-9f2a-effd9037f5ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:52.036768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0e3f71d-e8ee-4a69-9f2a-effd9037f5ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:52.165650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-10c37342-8920-4e4d-89e7-b2f671a86a5a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:52.166988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-10c37342-8920-4e4d-89e7-b2f671a86a5a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:52.177349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:52.185739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10c37342-8920-4e4d-89e7-b2f671a86a5a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:52.188989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10c37342-8920-4e4d-89e7-b2f671a86a5a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:52.191554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10c37342-8920-4e4d-89e7-b2f671a86a5a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:52.192846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10c37342-8920-4e4d-89e7-b2f671a86a5a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:52.209435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:52.841980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-10c37342-8920-4e4d-89e7-b2f671a86a5a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05aaa42fb4ae4f47a216c8f9288061c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948326ddffa847bf900ddb0e59857004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:52.857465 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-10c37342-8920-4e4d-89e7-b2f671a86a5a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 200 len: 1315 microversion: 2.1 time: 0.697112 Jul 20 04:26:52.888449 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1465/3130] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:52 2022] GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 1315 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:52.908979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed6516fe-01e7-49c3-b044-d8abfca227f5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:52.910677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ed6516fe-01e7-49c3-b044-d8abfca227f5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:52.963946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed6516fe-01e7-49c3-b044-d8abfca227f5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:52.973901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed6516fe-01e7-49c3-b044-d8abfca227f5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:52.978513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed6516fe-01e7-49c3-b044-d8abfca227f5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:52.982585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed6516fe-01e7-49c3-b044-d8abfca227f5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:53.383872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:53.400876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d0e3f71d-e8ee-4a69-9f2a-effd9037f5ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:53.455674 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d0e3f71d-e8ee-4a69-9f2a-effd9037f5ae tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1524 microversion: 2.1 time: 1.517271 Jul 20 04:26:53.481246 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1666/3131] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:51 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1524 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:53.846959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ed6516fe-01e7-49c3-b044-d8abfca227f5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:53.913903 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ed6516fe-01e7-49c3-b044-d8abfca227f5 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1250 microversion: 2.1 time: 1.006872 Jul 20 04:26:53.915826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b302e198-ce76-453b-9b34-0f9f35e87358 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:53.921254 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1466/3132] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:52 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1250 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:53.946178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b302e198-ce76-453b-9b34-0f9f35e87358 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:53.982596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b302e198-ce76-453b-9b34-0f9f35e87358 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:53.986046 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b302e198-ce76-453b-9b34-0f9f35e87358 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:53.991755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b302e198-ce76-453b-9b34-0f9f35e87358 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:53.992292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b302e198-ce76-453b-9b34-0f9f35e87358 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:54.362792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-47be5fec-d41b-4419-89f4-7a08670203be req-4ca8d178-f861-46d3-9789-9c03b8a4fe6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9b3d603-3c77-4a2e-a1be-3c78608f71bb", "tag": "ad6d6bae-542e-4fa9-80cc-5a0b288bc30a"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:54.435400 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-47be5fec-d41b-4419-89f4-7a08670203be req-4ca8d178-f861-46d3-9789-9c03b8a4fe6b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:54.445531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-47be5fec-d41b-4419-89f4-7a08670203be req-4ca8d178-f861-46d3-9789-9c03b8a4fe6b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:54.531498 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-47be5fec-d41b-4419-89f4-7a08670203be req-4ca8d178-f861-46d3-9789-9c03b8a4fe6b service nova] Creating event network-changed:ad6d6bae-542e-4fa9-80cc-5a0b288bc30a for instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb on n-h1-826526-5 Jul 20 04:26:54.601642 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-47be5fec-d41b-4419-89f4-7a08670203be req-4ca8d178-f861-46d3-9789-9c03b8a4fe6b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228458 Jul 20 04:26:54.628952 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1467/3133] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:54.696963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7ca7a503-159f-4255-9070-ac547fa37a30 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:54.699335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7ca7a503-159f-4255-9070-ac547fa37a30 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:54.768138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ca7a503-159f-4255-9070-ac547fa37a30 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:54.770326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ca7a503-159f-4255-9070-ac547fa37a30 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:54.772599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ca7a503-159f-4255-9070-ac547fa37a30 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:54.776552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ca7a503-159f-4255-9070-ac547fa37a30 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:55.534326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7ca7a503-159f-4255-9070-ac547fa37a30 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:55.561109 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7ca7a503-159f-4255-9070-ac547fa37a30 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1524 microversion: 2.1 time: 0.916102 Jul 20 04:26:55.563293 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1468/3134] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:54 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1524 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:55.579349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-85f8ab5b-f717-405d-8197-7724f660f2df tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:55.586387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-85f8ab5b-f717-405d-8197-7724f660f2df tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:55.607250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85f8ab5b-f717-405d-8197-7724f660f2df tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:55.612774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85f8ab5b-f717-405d-8197-7724f660f2df tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:55.617183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85f8ab5b-f717-405d-8197-7724f660f2df tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:55.618344 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85f8ab5b-f717-405d-8197-7724f660f2df tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:55.708176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b302e198-ce76-453b-9b34-0f9f35e87358 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05aaa42fb4ae4f47a216c8f9288061c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948326ddffa847bf900ddb0e59857004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:55.754206 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b302e198-ce76-453b-9b34-0f9f35e87358 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 200 len: 1315 microversion: 2.1 time: 1.843322 Jul 20 04:26:55.754908 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1667/3135] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:53 2022] GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 1315 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:55.957133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-85f8ab5b-f717-405d-8197-7724f660f2df tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:55.975062 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-85f8ab5b-f717-405d-8197-7724f660f2df tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1250 microversion: 2.1 time: 0.407474 Jul 20 04:26:55.978019 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1469/3136] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:55 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1250 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:56.599102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-faf17409-15a8-48ff-bbf7-db34b681cb8d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:56.601584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-faf17409-15a8-48ff-bbf7-db34b681cb8d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:56.635762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-faf17409-15a8-48ff-bbf7-db34b681cb8d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:56.640069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-faf17409-15a8-48ff-bbf7-db34b681cb8d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:56.647856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-faf17409-15a8-48ff-bbf7-db34b681cb8d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:56.648538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-faf17409-15a8-48ff-bbf7-db34b681cb8d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:56.773178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-006b7934-b493-4893-86dc-2f11674c3be3 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:56.773994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-006b7934-b493-4893-86dc-2f11674c3be3 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:56.796583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-006b7934-b493-4893-86dc-2f11674c3be3 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:56.798520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-006b7934-b493-4893-86dc-2f11674c3be3 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:56.801226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-006b7934-b493-4893-86dc-2f11674c3be3 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:56.801997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-006b7934-b493-4893-86dc-2f11674c3be3 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:58.058397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-faf17409-15a8-48ff-bbf7-db34b681cb8d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:58.096854 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-faf17409-15a8-48ff-bbf7-db34b681cb8d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1506 microversion: 2.1 time: 1.509851 Jul 20 04:26:58.097849 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1668/3137] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:56 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1506 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:58.102930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e11c34c3-549d-4f4d-9731-5faa700692e7 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:58.103546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e11c34c3-549d-4f4d-9731-5faa700692e7 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:58.135665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e11c34c3-549d-4f4d-9731-5faa700692e7 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:58.136465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e11c34c3-549d-4f4d-9731-5faa700692e7 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:58.137274 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e11c34c3-549d-4f4d-9731-5faa700692e7 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:58.137710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e11c34c3-549d-4f4d-9731-5faa700692e7 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:58.223209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:58.343478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-006b7934-b493-4893-86dc-2f11674c3be3 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05aaa42fb4ae4f47a216c8f9288061c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948326ddffa847bf900ddb0e59857004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:58.366994 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-006b7934-b493-4893-86dc-2f11674c3be3 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 200 len: 1315 microversion: 2.1 time: 1.597603 Jul 20 04:26:58.375464 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1470/3138] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:56 2022] GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 1315 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:58.521141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e11c34c3-549d-4f4d-9731-5faa700692e7 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:58.553936 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e11c34c3-549d-4f4d-9731-5faa700692e7 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1250 microversion: 2.1 time: 0.437786 Jul 20 04:26:58.555976 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1669/3139] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:58 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1250 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:59.126550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7c5e70e1-2078-458d-8e8f-929e45e73bf8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:59.127445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7c5e70e1-2078-458d-8e8f-929e45e73bf8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:59.143375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c5e70e1-2078-458d-8e8f-929e45e73bf8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:59.145567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c5e70e1-2078-458d-8e8f-929e45e73bf8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:59.147461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c5e70e1-2078-458d-8e8f-929e45e73bf8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:59.148812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c5e70e1-2078-458d-8e8f-929e45e73bf8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:59.391259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f76af8fe-f1a6-4490-a56b-d31bb906223e tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:59.392213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f76af8fe-f1a6-4490-a56b-d31bb906223e tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:59.405485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f76af8fe-f1a6-4490-a56b-d31bb906223e tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:59.406240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f76af8fe-f1a6-4490-a56b-d31bb906223e tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:59.408229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f76af8fe-f1a6-4490-a56b-d31bb906223e tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:59.409268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f76af8fe-f1a6-4490-a56b-d31bb906223e tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:59.609075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7c5e70e1-2078-458d-8e8f-929e45e73bf8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:59.640918 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7c5e70e1-2078-458d-8e8f-929e45e73bf8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1506 microversion: 2.1 time: 0.516045 Jul 20 04:26:59.654303 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1471/3140] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:59 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1506 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:59.665098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2fa9c0a5-265f-4314-b05a-dc8f2376ed76 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:59.666513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2fa9c0a5-265f-4314-b05a-dc8f2376ed76 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:59.676746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2fa9c0a5-265f-4314-b05a-dc8f2376ed76 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:59.677948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2fa9c0a5-265f-4314-b05a-dc8f2376ed76 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:59.680248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2fa9c0a5-265f-4314-b05a-dc8f2376ed76 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:59.681417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2fa9c0a5-265f-4314-b05a-dc8f2376ed76 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:59.730665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2fa9c0a5-265f-4314-b05a-dc8f2376ed76 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:59.732832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2fa9c0a5-265f-4314-b05a-dc8f2376ed76 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:59.733900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-2fa9c0a5-265f-4314-b05a-dc8f2376ed76 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lazy-loading 'fault' on Instance uuid 802d383f-a9d5-4707-9a0c-7138b63d3ca9 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:26:59.821519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2fa9c0a5-265f-4314-b05a-dc8f2376ed76 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60ea74481504967b171b13213ad7ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd28073732224b22ba367fc99d203235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:59.843911 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2fa9c0a5-265f-4314-b05a-dc8f2376ed76 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 200 len: 1255 microversion: 2.1 time: 0.186779 Jul 20 04:26:59.848472 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1472/3141] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:59 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 1255 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:00.095203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-a7f6deba-2772-4223-a67b-e674204262cb req-598bef45-ca7f-4458-9ef3-32df0a367aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e82edc2-fbf4-4e3f-b3b2-f937cd316135", "name": "network-vif-unplugged", "status": "completed", "tag": "83456d49-d3e2-4124-ab2c-f3c45c93e1d0"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:00.161065 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a7f6deba-2772-4223-a67b-e674204262cb req-598bef45-ca7f-4458-9ef3-32df0a367aad service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:00.161065 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a7f6deba-2772-4223-a67b-e674204262cb req-598bef45-ca7f-4458-9ef3-32df0a367aad service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:00.204327 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-a7f6deba-2772-4223-a67b-e674204262cb req-598bef45-ca7f-4458-9ef3-32df0a367aad service nova] Creating event network-vif-unplugged:83456d49-d3e2-4124-ab2c-f3c45c93e1d0 for instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 on n-h1-826526-5 Jul 20 04:27:00.219103 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-a7f6deba-2772-4223-a67b-e674204262cb req-598bef45-ca7f-4458-9ef3-32df0a367aad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129426 Jul 20 04:27:00.222765 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1473/3142] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:00.663762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-52d88239-62a4-4d99-a765-a2592cf2fe73 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:00.664707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-52d88239-62a4-4d99-a765-a2592cf2fe73 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:00.678908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52d88239-62a4-4d99-a765-a2592cf2fe73 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:00.682153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52d88239-62a4-4d99-a765-a2592cf2fe73 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:00.683362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52d88239-62a4-4d99-a765-a2592cf2fe73 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:00.684108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52d88239-62a4-4d99-a765-a2592cf2fe73 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:00.936713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f76af8fe-f1a6-4490-a56b-d31bb906223e tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05aaa42fb4ae4f47a216c8f9288061c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948326ddffa847bf900ddb0e59857004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:00.959387 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f76af8fe-f1a6-4490-a56b-d31bb906223e tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 200 len: 1315 microversion: 2.1 time: 1.573530 Jul 20 04:27:00.965517 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1670/3143] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:59 2022] GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 1315 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:01.000099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7389d3ee-56d5-4071-bceb-79c82ad0d7d3 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:01.000927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7389d3ee-56d5-4071-bceb-79c82ad0d7d3 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] [instance: 802d383f-a9d5-4707-9a0c-7138b63d3ca9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:01.044082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7389d3ee-56d5-4071-bceb-79c82ad0d7d3 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:01.052375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7389d3ee-56d5-4071-bceb-79c82ad0d7d3 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:01.057512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7389d3ee-56d5-4071-bceb-79c82ad0d7d3 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:01.059276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7389d3ee-56d5-4071-bceb-79c82ad0d7d3 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:01.156434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-52d88239-62a4-4d99-a765-a2592cf2fe73 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:01.161353 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-7389d3ee-56d5-4071-bceb-79c82ad0d7d3 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] HTTP exception thrown: Instance 802d383f-a9d5-4707-9a0c-7138b63d3ca9 could not be found. Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7389d3ee-56d5-4071-bceb-79c82ad0d7d3 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Request method failure captured: Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 HTTP/1.1 Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14N2EifAZYf1k9ZDfg3DMTiHmb6EacDsEXS-1SjepYBucfbRvUYmMUy26Uzcp6Z2ceCQcUuCcxeFpDPSbik4iRhXEX2239Lw2A608pLRaDkWCTcryNIdklTlIPP096B45fzsapUWD6VzbuKpTNFkpnoWVbo7JxiDc51_Zgjuih7b66Q Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: dd28073732224b22ba367fc99d203235 Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestBootFromVolume-1250393905 Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dd28073732224b22ba367fc99d203235"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/dd28073732224b22ba367fc99d203235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_dd28073732224b22ba367fc99d203235", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dd28073732224b22ba367fc99d203235"}]}] Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestBootFromVolume-1250393905 Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: dd28073732224b22ba367fc99d203235 Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1250393905 Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestBootFromVolume-1250393905-project Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: e60ea74481504967b171b13213ad7ffd Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestBootFromVolume-1250393905-project Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 802d383f-a9d5-4707-9a0c-7138b63d3ca9 could not be found. Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '802d383f-a9d5-4707-9a0c-7138b63d3ca9'} Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 802d383f-a9d5-4707-9a0c-7138b63d3ca9 could not be found. Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802d383f-a9d5-4707-9a0c-7138b63d3ca9 could not be found. Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:01.177737 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:27:01.187290 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:01.187290 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:01.187290 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:01.187290 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:01.187290 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:01.187290 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802d383f-a9d5-4707-9a0c-7138b63d3ca9 could not be found. Jul 20 04:27:01.187290 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:27:01.194368 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-52d88239-62a4-4d99-a765-a2592cf2fe73 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1506 microversion: 2.1 time: 0.523841 Jul 20 04:27:01.195896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7389d3ee-56d5-4071-bceb-79c82ad0d7d3 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Returning 404 to user: Instance 802d383f-a9d5-4707-9a0c-7138b63d3ca9 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:01.197616 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7389d3ee-56d5-4071-bceb-79c82ad0d7d3 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9" status: 404 len: 111 microversion: 2.1 time: 0.229879 Jul 20 04:27:01.204073 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1671/3144] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:00 2022] GET /compute/v2.1/servers/802d383f-a9d5-4707-9a0c-7138b63d3ca9 => generated 111 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:01.212739 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1474/3145] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:00 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:01.223874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f34ac8c2-269d-4624-850f-1cfbd6d6fb91 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] Calling method '.version_select at 0x7f06bdeb9700>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:01.271160 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f34ac8c2-269d-4624-850f-1cfbd6d6fb91 tempest-ServersTestBootFromVolume-1250393905 tempest-ServersTestBootFromVolume-1250393905-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-647060892" status: 202 len: 0 microversion: 2.1 time: 0.065420 Jul 20 04:27:01.271766 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1672/3146] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jul 20 04:27:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-647060892 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:27:01.997192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-610a6aaf-b70b-467a-8f45-6842d644950a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:01.998260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-610a6aaf-b70b-467a-8f45-6842d644950a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:02.024392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-610a6aaf-b70b-467a-8f45-6842d644950a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:02.026514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-610a6aaf-b70b-467a-8f45-6842d644950a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:02.029759 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-610a6aaf-b70b-467a-8f45-6842d644950a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:02.030648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-610a6aaf-b70b-467a-8f45-6842d644950a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:02.052631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:02.219140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-15998413-fc75-47b8-b322-f91df8276aa0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:02.219836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-15998413-fc75-47b8-b322-f91df8276aa0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:02.234978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-15998413-fc75-47b8-b322-f91df8276aa0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:02.235840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-15998413-fc75-47b8-b322-f91df8276aa0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:02.246761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-15998413-fc75-47b8-b322-f91df8276aa0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:02.247442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-15998413-fc75-47b8-b322-f91df8276aa0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:03.033460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-15998413-fc75-47b8-b322-f91df8276aa0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:03.066367 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-15998413-fc75-47b8-b322-f91df8276aa0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1506 microversion: 2.1 time: 0.851270 Jul 20 04:27:03.066995 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1673/3147] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:02 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1506 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:03.332005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-610a6aaf-b70b-467a-8f45-6842d644950a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05aaa42fb4ae4f47a216c8f9288061c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948326ddffa847bf900ddb0e59857004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:03.345207 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-610a6aaf-b70b-467a-8f45-6842d644950a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 200 len: 1315 microversion: 2.1 time: 1.355133 Jul 20 04:27:03.346784 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1475/3148] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:01 2022] GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 1315 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:03.684663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-1e18acce-b5d0-4e7d-9d12-499e6dec200a req-0ea5bcfe-50f7-4da9-8e84-86335568f9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b3d603-3c77-4a2e-a1be-3c78608f71bb", "name": "network-vif-plugged", "status": "completed", "tag": "ad6d6bae-542e-4fa9-80cc-5a0b288bc30a"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:03.703496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1e18acce-b5d0-4e7d-9d12-499e6dec200a req-0ea5bcfe-50f7-4da9-8e84-86335568f9f5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:03.704466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1e18acce-b5d0-4e7d-9d12-499e6dec200a req-0ea5bcfe-50f7-4da9-8e84-86335568f9f5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:03.736779 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-1e18acce-b5d0-4e7d-9d12-499e6dec200a req-0ea5bcfe-50f7-4da9-8e84-86335568f9f5 service nova] Creating event network-vif-plugged:ad6d6bae-542e-4fa9-80cc-5a0b288bc30a for instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb on n-h1-826526-5 Jul 20 04:27:03.750006 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-1e18acce-b5d0-4e7d-9d12-499e6dec200a req-0ea5bcfe-50f7-4da9-8e84-86335568f9f5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068790 Jul 20 04:27:03.752880 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1674/3149] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:27:04.097823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-657858e6-0d76-4e50-96b4-fd97e6b5682d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:04.098941 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-657858e6-0d76-4e50-96b4-fd97e6b5682d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:04.119760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-657858e6-0d76-4e50-96b4-fd97e6b5682d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:04.120599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-657858e6-0d76-4e50-96b4-fd97e6b5682d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:04.121999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-657858e6-0d76-4e50-96b4-fd97e6b5682d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:04.122793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-657858e6-0d76-4e50-96b4-fd97e6b5682d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:04.364252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-41e7fdac-b085-432a-90ee-6e059df3414a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:04.371357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-41e7fdac-b085-432a-90ee-6e059df3414a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:04.382901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41e7fdac-b085-432a-90ee-6e059df3414a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:04.387811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41e7fdac-b085-432a-90ee-6e059df3414a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:04.401724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41e7fdac-b085-432a-90ee-6e059df3414a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:04.404578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41e7fdac-b085-432a-90ee-6e059df3414a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:04.947965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-657858e6-0d76-4e50-96b4-fd97e6b5682d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:04.958512 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-657858e6-0d76-4e50-96b4-fd97e6b5682d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 200 len: 1449 microversion: 2.1 time: 0.866967 Jul 20 04:27:04.978272 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1476/3150] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:04 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 1449 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:05.007485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d985faf8-5018-452f-ae35-593cdc4f2160 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:05.008125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d985faf8-5018-452f-ae35-593cdc4f2160 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:05.068698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d985faf8-5018-452f-ae35-593cdc4f2160 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:05.069465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d985faf8-5018-452f-ae35-593cdc4f2160 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:05.070896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d985faf8-5018-452f-ae35-593cdc4f2160 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:05.071422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d985faf8-5018-452f-ae35-593cdc4f2160 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:05.119427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-41e7fdac-b085-432a-90ee-6e059df3414a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05aaa42fb4ae4f47a216c8f9288061c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948326ddffa847bf900ddb0e59857004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:05.155844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d985faf8-5018-452f-ae35-593cdc4f2160 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:27:05.167910 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-41e7fdac-b085-432a-90ee-6e059df3414a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 200 len: 1315 microversion: 2.1 time: 0.807859 Jul 20 04:27:05.172850 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1675/3151] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:04 2022] GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 1315 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:05.191464 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.compute.api [None req-d985faf8-5018-452f-ae35-593cdc4f2160 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Working on deleting snapshot 3d1d0e85-59eb-48d8-9656-0d0ae792af0a from shelved instance... Jul 20 04:27:06.187982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-14e6e8c2-4aea-4a28-adc5-4a1228b72db2 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:06.188870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-14e6e8c2-4aea-4a28-adc5-4a1228b72db2 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:06.205537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14e6e8c2-4aea-4a28-adc5-4a1228b72db2 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:06.206029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14e6e8c2-4aea-4a28-adc5-4a1228b72db2 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:06.216800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14e6e8c2-4aea-4a28-adc5-4a1228b72db2 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:06.217188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14e6e8c2-4aea-4a28-adc5-4a1228b72db2 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:06.623133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-14e6e8c2-4aea-4a28-adc5-4a1228b72db2 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05aaa42fb4ae4f47a216c8f9288061c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948326ddffa847bf900ddb0e59857004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:06.640014 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-14e6e8c2-4aea-4a28-adc5-4a1228b72db2 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 200 len: 1503 microversion: 2.1 time: 0.456593 Jul 20 04:27:06.661006 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1676/3152] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:06 2022] GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 1503 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:06.680412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3e397781-db17-4190-8f60-5df3bb4c2f0c tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:06.685481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3e397781-db17-4190-8f60-5df3bb4c2f0c tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:06.709068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e397781-db17-4190-8f60-5df3bb4c2f0c tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:06.710090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e397781-db17-4190-8f60-5df3bb4c2f0c tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:06.711134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e397781-db17-4190-8f60-5df3bb4c2f0c tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:06.711930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e397781-db17-4190-8f60-5df3bb4c2f0c tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:06.858059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3e397781-db17-4190-8f60-5df3bb4c2f0c tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:27:07.124321 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3e397781-db17-4190-8f60-5df3bb4c2f0c tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 204 len: 0 microversion: 2.1 time: 0.454566 Jul 20 04:27:07.125868 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1677/3153] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:06 2022] DELETE /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:27:07.142067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-35cc1f45-bf44-44b2-b6e3-477b94dea697 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:07.150598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35cc1f45-bf44-44b2-b6e3-477b94dea697 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:07.162029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35cc1f45-bf44-44b2-b6e3-477b94dea697 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:07.162884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35cc1f45-bf44-44b2-b6e3-477b94dea697 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:07.164708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35cc1f45-bf44-44b2-b6e3-477b94dea697 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:07.165696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35cc1f45-bf44-44b2-b6e3-477b94dea697 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:07.464446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-35cc1f45-bf44-44b2-b6e3-477b94dea697 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05aaa42fb4ae4f47a216c8f9288061c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948326ddffa847bf900ddb0e59857004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:07.486977 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-35cc1f45-bf44-44b2-b6e3-477b94dea697 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 200 len: 1509 microversion: 2.1 time: 0.354397 Jul 20 04:27:07.488765 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1678/3154] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:07 2022] GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 1509 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:07.619863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d985faf8-5018-452f-ae35-593cdc4f2160 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Doing local delete in cell fbf41b76-8148-4f7f-88f5-d6fd988c2859(cell1) {{(pid=127870) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 20 04:27:07.621739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d985faf8-5018-452f-ae35-593cdc4f2160 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:07.622414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d985faf8-5018-452f-ae35-593cdc4f2160 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:07.623298 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.compute.api [None req-d985faf8-5018-452f-ae35-593cdc4f2160 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 20 04:27:07.630399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-d985faf8-5018-452f-ae35-593cdc4f2160 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] deallocate_for_instance() {{(pid=127870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 20 04:27:08.509520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5abbb5d4-b362-47b4-9f03-c9e029b8f59b tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:08.510244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5abbb5d4-b362-47b4-9f03-c9e029b8f59b tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:08.531826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5abbb5d4-b362-47b4-9f03-c9e029b8f59b tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:08.532804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5abbb5d4-b362-47b4-9f03-c9e029b8f59b tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:08.539016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5abbb5d4-b362-47b4-9f03-c9e029b8f59b tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:08.540097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5abbb5d4-b362-47b4-9f03-c9e029b8f59b tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.369125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5abbb5d4-b362-47b4-9f03-c9e029b8f59b tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05aaa42fb4ae4f47a216c8f9288061c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948326ddffa847bf900ddb0e59857004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:09.456341 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5abbb5d4-b362-47b4-9f03-c9e029b8f59b tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 200 len: 1509 microversion: 2.1 time: 0.949402 Jul 20 04:27:09.458979 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1679/3155] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:08 2022] GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 1509 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:10.686577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-c265faf5-d4d6-4c6d-8946-30cc5b77f234 req-d6f76067-b787-4c9e-b4c2-2bd0ba13c389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b3d603-3c77-4a2e-a1be-3c78608f71bb", "name": "network-vif-deleted", "tag": "ad6d6bae-542e-4fa9-80cc-5a0b288bc30a"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:10.724246 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c265faf5-d4d6-4c6d-8946-30cc5b77f234 req-d6f76067-b787-4c9e-b4c2-2bd0ba13c389 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:10.728531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c265faf5-d4d6-4c6d-8946-30cc5b77f234 req-d6f76067-b787-4c9e-b4c2-2bd0ba13c389 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:10.789798 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-c265faf5-d4d6-4c6d-8946-30cc5b77f234 req-d6f76067-b787-4c9e-b4c2-2bd0ba13c389 service nova] Creating event network-vif-deleted:ad6d6bae-542e-4fa9-80cc-5a0b288bc30a for instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb on n-h1-826526-5 Jul 20 04:27:10.805243 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-c265faf5-d4d6-4c6d-8946-30cc5b77f234 req-d6f76067-b787-4c9e-b4c2-2bd0ba13c389 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.376119 Jul 20 04:27:10.806223 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1680/3156] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:10.811408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-002a85b6-5109-4124-8804-8af1de457add tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:10.812107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-002a85b6-5109-4124-8804-8af1de457add tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:10.831599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-002a85b6-5109-4124-8804-8af1de457add tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:10.833119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-002a85b6-5109-4124-8804-8af1de457add tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:10.834364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-002a85b6-5109-4124-8804-8af1de457add tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:10.835003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-002a85b6-5109-4124-8804-8af1de457add tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:10.918927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-002a85b6-5109-4124-8804-8af1de457add tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:10.920588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-002a85b6-5109-4124-8804-8af1de457add tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:10.921130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-002a85b6-5109-4124-8804-8af1de457add tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lazy-loading 'fault' on Instance uuid e9b3d603-3c77-4a2e-a1be-3c78608f71bb {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:27:11.084952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-002a85b6-5109-4124-8804-8af1de457add tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05aaa42fb4ae4f47a216c8f9288061c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948326ddffa847bf900ddb0e59857004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:11.098487 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-002a85b6-5109-4124-8804-8af1de457add tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 200 len: 1305 microversion: 2.1 time: 0.290579 Jul 20 04:27:11.100427 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1681/3157] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:10 2022] GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 1305 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:11.172796 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-298ceec1-bed2-4503-b00d-7e0ac7cf4efd req-f89887e6-0c3b-41a7-8cc8-916f96bdfd6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e82edc2-fbf4-4e3f-b3b2-f937cd316135", "name": "network-vif-deleted", "tag": "83456d49-d3e2-4124-ab2c-f3c45c93e1d0"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:11.192860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-d985faf8-5018-452f-ae35-593cdc4f2160 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Updating instance_info_cache with network_info: [] {{(pid=127870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:27:11.222297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-298ceec1-bed2-4503-b00d-7e0ac7cf4efd req-f89887e6-0c3b-41a7-8cc8-916f96bdfd6a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:11.234622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-298ceec1-bed2-4503-b00d-7e0ac7cf4efd req-f89887e6-0c3b-41a7-8cc8-916f96bdfd6a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:11.330761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.compute.server_external_events [req-298ceec1-bed2-4503-b00d-7e0ac7cf4efd req-f89887e6-0c3b-41a7-8cc8-916f96bdfd6a service nova] Unable to find a host for instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135. Dropping event network-vif-deleted {{(pid=127871) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 04:27:11.336245 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-298ceec1-bed2-4503-b00d-7e0ac7cf4efd req-f89887e6-0c3b-41a7-8cc8-916f96bdfd6a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.168573 Jul 20 04:27:11.339624 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1682/3158] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 175 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 04:27:11.444194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:11.689677 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d985faf8-5018-452f-ae35-593cdc4f2160 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 204 len: 0 microversion: 2.1 time: 6.714356 Jul 20 04:27:11.691894 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1477/3159] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:04 2022] DELETE /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 0 bytes in 6717 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:27:11.707366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-897e1aca-f6e1-4a67-9181-077179ea47e7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:11.722600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-897e1aca-f6e1-4a67-9181-077179ea47e7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:11.749491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-897e1aca-f6e1-4a67-9181-077179ea47e7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:11.751835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-897e1aca-f6e1-4a67-9181-077179ea47e7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:11.755718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-897e1aca-f6e1-4a67-9181-077179ea47e7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:11.757044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-897e1aca-f6e1-4a67-9181-077179ea47e7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:11.795410 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-897e1aca-f6e1-4a67-9181-077179ea47e7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 could not be found. Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-897e1aca-f6e1-4a67-9181-077179ea47e7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 HTTP/1.1 Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 could not be found. Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '5e82edc2-fbf4-4e3f-b3b2-f937cd316135'} Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 could not be found. Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 could not be found. Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:11.800798 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:27:11.805633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:11.805633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:11.805633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:11.805633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:11.805633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:11.805633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 could not be found. Jul 20 04:27:11.805633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:27:11.810213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-897e1aca-f6e1-4a67-9181-077179ea47e7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:11.815665 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-897e1aca-f6e1-4a67-9181-077179ea47e7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 404 len: 111 microversion: 2.1 time: 0.116615 Jul 20 04:27:11.817528 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1683/3160] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:11 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:12.121787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ad54e97d-23d5-430b-b92b-a483f12c61d5 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:12.122434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ad54e97d-23d5-430b-b92b-a483f12c61d5 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:12.137903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad54e97d-23d5-430b-b92b-a483f12c61d5 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.138426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad54e97d-23d5-430b-b92b-a483f12c61d5 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.139279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad54e97d-23d5-430b-b92b-a483f12c61d5 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.139729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad54e97d-23d5-430b-b92b-a483f12c61d5 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.155298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f6dec506-0cfc-4556-a911-b1261fa03871 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-741930859", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "c3db3bfb-11a7-406a-b082-1e92336f5a21"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:12.187985 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-ad54e97d-23d5-430b-b92b-a483f12c61d5 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] HTTP exception thrown: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ad54e97d-23d5-430b-b92b-a483f12c61d5 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Request method failure captured: Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb HTTP/1.1 Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14Po9BwLeH12x0ONfvqpaNjXM_UOyeRtSuHqdHqepe0yHTNie4NGsazFg8XiZnJigD9l-U6ulEhzm3XCviVrJCc1Kb_Rn3tGNrEt4d5iyyGWY1qHlarxPO6IInDgTrtcJguYK2A8iMAVBnODRngwbP3UO2Be05C4t42sGvW9sw-q7Ko Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 948326ddffa847bf900ddb0e59857004 Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/948326ddffa847bf900ddb0e59857004"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/948326ddffa847bf900ddb0e59857004"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_948326ddffa847bf900ddb0e59857004", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/948326ddffa847bf900ddb0e59857004"}]}] Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 948326ddffa847bf900ddb0e59857004 Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesNegativeTestJSON-808846879-project Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 05aaa42fb4ae4f47a216c8f9288061c2 Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesNegativeTestJSON-808846879-project Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'e9b3d603-3c77-4a2e-a1be-3c78608f71bb'} Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:12.195619 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.202254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.202254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:12.202254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:12.202254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:12.202254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:12.202254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.202254 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.207979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ad54e97d-23d5-430b-b92b-a483f12c61d5 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Returning 404 to user: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:12.211174 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ad54e97d-23d5-430b-b92b-a483f12c61d5 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 404 len: 111 microversion: 2.1 time: 0.094288 Jul 20 04:27:12.212056 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1478/3161] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:12 2022] GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:12.231515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4254c2ae-2d30-4697-9cb9-27a898d24985 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1563275457", "metadata": {"image_type": "test"}}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:12.235886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4254c2ae-2d30-4697-9cb9-27a898d24985 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:12.253526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4254c2ae-2d30-4697-9cb9-27a898d24985 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.256687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4254c2ae-2d30-4697-9cb9-27a898d24985 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.259183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-f6dec506-0cfc-4556-a911-b1261fa03871 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] validate_networks() for [('c3db3bfb-11a7-406a-b082-1e92336f5a21', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:27:12.261025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4254c2ae-2d30-4697-9cb9-27a898d24985 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.262040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4254c2ae-2d30-4697-9cb9-27a898d24985 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.283116 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-4254c2ae-2d30-4697-9cb9-27a898d24985 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] HTTP exception thrown: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4254c2ae-2d30-4697-9cb9-27a898d24985 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Request method failure captured: Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb/action HTTP/1.1 Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 112 Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14Po9BwLeH12x0ONfvqpaNjXM_UOyeRtSuHqdHqepe0yHTNie4NGsazFg8XiZnJigD9l-U6ulEhzm3XCviVrJCc1Kb_Rn3tGNrEt4d5iyyGWY1qHlarxPO6IInDgTrtcJguYK2A8iMAVBnODRngwbP3UO2Be05C4t42sGvW9sw-q7Ko Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 948326ddffa847bf900ddb0e59857004 Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/948326ddffa847bf900ddb0e59857004"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/948326ddffa847bf900ddb0e59857004"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_948326ddffa847bf900ddb0e59857004", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/948326ddffa847bf900ddb0e59857004"}]}] Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 948326ddffa847bf900ddb0e59857004 Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesNegativeTestJSON-808846879-project Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 05aaa42fb4ae4f47a216c8f9288061c2 Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesNegativeTestJSON-808846879-project Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1563275457", "metadata": {"image_type": "test"}}} Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'e9b3d603-3c77-4a2e-a1be-3c78608f71bb', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1563275457', 'metadata': {'image_type': 'test'}}}} Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:27:12.286217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:12.294028 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:12.294028 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:12.294028 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:12.294028 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.294028 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.294028 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:12.294028 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.294028 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.294028 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:12.294028 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:12.294028 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:12.294028 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:12.294028 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.294028 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.303754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4254c2ae-2d30-4697-9cb9-27a898d24985 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Returning 404 to user: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:12.309036 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4254c2ae-2d30-4697-9cb9-27a898d24985 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "POST /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb/action" status: 404 len: 111 microversion: 2.1 time: 0.090264 Jul 20 04:27:12.318277 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1479/3162] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Jul 20 04:27:12 2022] POST /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb/action => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:12.327867 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4ef7a098-d177-4a6a-9007-a0742394a4c8 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1288665209", "metadata": {"image_type": "test"}}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:12.329323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4ef7a098-d177-4a6a-9007-a0742394a4c8 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Failed to fetch instance by id tempest-invalid-1331491720 {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:27:12.330146 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-4ef7a098-d177-4a6a-9007-a0742394a4c8 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] HTTP exception thrown: Instance tempest-invalid-1331491720 could not be found. Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4ef7a098-d177-4a6a-9007-a0742394a4c8 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Request method failure captured: Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/tempest-invalid-1331491720/action HTTP/1.1 Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 112 Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14Po9BwLeH12x0ONfvqpaNjXM_UOyeRtSuHqdHqepe0yHTNie4NGsazFg8XiZnJigD9l-U6ulEhzm3XCviVrJCc1Kb_Rn3tGNrEt4d5iyyGWY1qHlarxPO6IInDgTrtcJguYK2A8iMAVBnODRngwbP3UO2Be05C4t42sGvW9sw-q7Ko Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 948326ddffa847bf900ddb0e59857004 Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/948326ddffa847bf900ddb0e59857004"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/948326ddffa847bf900ddb0e59857004"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_948326ddffa847bf900ddb0e59857004", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/948326ddffa847bf900ddb0e59857004"}]}] Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 948326ddffa847bf900ddb0e59857004 Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesNegativeTestJSON-808846879-project Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 05aaa42fb4ae4f47a216c8f9288061c2 Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesNegativeTestJSON-808846879-project Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1288665209", "metadata": {"image_type": "test"}}} Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance tempest-invalid-1331491720 could not be found. Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'tempest-invalid-1331491720', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1288665209', 'metadata': {'image_type': 'test'}}}} Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1331491720 could not be found. Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:12.333211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1331491720 could not be found. Jul 20 04:27:12.340887 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.340887 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:12.340887 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.340887 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.340887 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:12.340887 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:12.340887 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:12.340887 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:12.340887 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1331491720 could not be found. Jul 20 04:27:12.340887 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.346999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4ef7a098-d177-4a6a-9007-a0742394a4c8 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Returning 404 to user: Instance tempest-invalid-1331491720 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:12.348864 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4ef7a098-d177-4a6a-9007-a0742394a4c8 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "POST /compute/v2.1/servers/tempest-invalid-1331491720/action" status: 404 len: 101 microversion: 2.1 time: 0.026772 Jul 20 04:27:12.354279 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1480/3163] 10.222.0.17 () {60 vars in 1248 bytes} [Wed Jul 20 04:27:12 2022] POST /compute/v2.1/servers/tempest-invalid-1331491720/action => generated 101 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:12.360817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6a5b6042-e0f5-47e3-bec9-a3fb48719e28 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1689516801"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:12.362310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6a5b6042-e0f5-47e3-bec9-a3fb48719e28 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:27:12.363322 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-6a5b6042-e0f5-47e3-bec9-a3fb48719e28 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6a5b6042-e0f5-47e3-bec9-a3fb48719e28 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Request method failure captured: Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 57 Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14Po9BwLeH12x0ONfvqpaNjXM_UOyeRtSuHqdHqepe0yHTNie4NGsazFg8XiZnJigD9l-U6ulEhzm3XCviVrJCc1Kb_Rn3tGNrEt4d5iyyGWY1qHlarxPO6IInDgTrtcJguYK2A8iMAVBnODRngwbP3UO2Be05C4t42sGvW9sw-q7Ko Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 948326ddffa847bf900ddb0e59857004 Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/948326ddffa847bf900ddb0e59857004"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/948326ddffa847bf900ddb0e59857004"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_948326ddffa847bf900ddb0e59857004", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/948326ddffa847bf900ddb0e59857004"}]}] Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 948326ddffa847bf900ddb0e59857004 Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesNegativeTestJSON-808846879-project Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 05aaa42fb4ae4f47a216c8f9288061c2 Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesNegativeTestJSON-808846879-project Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: {"createImage": {"name": "tempest-test-snap-1689516801"}} Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1689516801'}}} Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:27:12.366058 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.371440 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:12.371440 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.371440 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.371440 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:12.371440 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:12.371440 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:12.371440 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:12.371440 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:27:12.371440 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.374558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6a5b6042-e0f5-47e3-bec9-a3fb48719e28 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:12.375228 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6a5b6042-e0f5-47e3-bec9-a3fb48719e28 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.019367 Jul 20 04:27:12.376037 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1481/3164] 10.222.0.17 () {60 vars in 1274 bytes} [Wed Jul 20 04:27:12 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:12.397838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5d52f6ba-1dfb-46e5-8410-87fea316744a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-512563959"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:12.400054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5d52f6ba-1dfb-46e5-8410-87fea316744a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:27:12.400936 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-5d52f6ba-1dfb-46e5-8410-87fea316744a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5d52f6ba-1dfb-46e5-8410-87fea316744a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Request method failure captured: Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 56 Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14Po9BwLeH12x0ONfvqpaNjXM_UOyeRtSuHqdHqepe0yHTNie4NGsazFg8XiZnJigD9l-U6ulEhzm3XCviVrJCc1Kb_Rn3tGNrEt4d5iyyGWY1qHlarxPO6IInDgTrtcJguYK2A8iMAVBnODRngwbP3UO2Be05C4t42sGvW9sw-q7Ko Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 948326ddffa847bf900ddb0e59857004 Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/948326ddffa847bf900ddb0e59857004"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/948326ddffa847bf900ddb0e59857004"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_948326ddffa847bf900ddb0e59857004", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/948326ddffa847bf900ddb0e59857004"}]}] Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 948326ddffa847bf900ddb0e59857004 Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesNegativeTestJSON-808846879-project Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 05aaa42fb4ae4f47a216c8f9288061c2 Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesNegativeTestJSON-808846879-project Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: {"createImage": {"name": "tempest-test-snap-512563959"}} Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-512563959'}}} Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:27:12.403446 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.408991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:12.408991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.408991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.408991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:12.408991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:12.408991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:12.408991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:12.408991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:27:12.408991 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.411519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5d52f6ba-1dfb-46e5-8410-87fea316744a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:12.414702 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5d52f6ba-1dfb-46e5-8410-87fea316744a tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.022691 Jul 20 04:27:12.423286 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1482/3165] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Jul 20 04:27:12 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:27:12.438036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-70cf8b93-4d55-462e-81e0-f89936a6111e tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:12.438581 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-70cf8b93-4d55-462e-81e0-f89936a6111e tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:12.467466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70cf8b93-4d55-462e-81e0-f89936a6111e tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.468132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70cf8b93-4d55-462e-81e0-f89936a6111e tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.469127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70cf8b93-4d55-462e-81e0-f89936a6111e tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.469589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70cf8b93-4d55-462e-81e0-f89936a6111e tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.514723 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-70cf8b93-4d55-462e-81e0-f89936a6111e tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] HTTP exception thrown: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-70cf8b93-4d55-462e-81e0-f89936a6111e tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Request method failure captured: Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb HTTP/1.1 Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14Po9BwLeH12x0ONfvqpaNjXM_UOyeRtSuHqdHqepe0yHTNie4NGsazFg8XiZnJigD9l-U6ulEhzm3XCviVrJCc1Kb_Rn3tGNrEt4d5iyyGWY1qHlarxPO6IInDgTrtcJguYK2A8iMAVBnODRngwbP3UO2Be05C4t42sGvW9sw-q7Ko Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 948326ddffa847bf900ddb0e59857004 Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/948326ddffa847bf900ddb0e59857004"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/948326ddffa847bf900ddb0e59857004"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_948326ddffa847bf900ddb0e59857004", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/948326ddffa847bf900ddb0e59857004"}]}] Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 948326ddffa847bf900ddb0e59857004 Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesNegativeTestJSON-808846879-project Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 05aaa42fb4ae4f47a216c8f9288061c2 Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesNegativeTestJSON-808846879-project Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'e9b3d603-3c77-4a2e-a1be-3c78608f71bb'} Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:12.518881 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:12.535290 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.535290 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.535290 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:12.535290 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.535290 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.535290 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:12.535290 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:12.535290 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:12.535290 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:12.535290 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.535290 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.535290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-70cf8b93-4d55-462e-81e0-f89936a6111e tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Returning 404 to user: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:12.535290 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-70cf8b93-4d55-462e-81e0-f89936a6111e tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 404 len: 111 microversion: 2.1 time: 0.100593 Jul 20 04:27:12.535290 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1483/3166] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:12 2022] DELETE /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:12.539426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-39eff728-45ed-4be7-ad71-5bd261e37698 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:12.539426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-39eff728-45ed-4be7-ad71-5bd261e37698 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] [instance: e9b3d603-3c77-4a2e-a1be-3c78608f71bb] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:12.555282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39eff728-45ed-4be7-ad71-5bd261e37698 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.558245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39eff728-45ed-4be7-ad71-5bd261e37698 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.561748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39eff728-45ed-4be7-ad71-5bd261e37698 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.562213 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39eff728-45ed-4be7-ad71-5bd261e37698 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.609043 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-39eff728-45ed-4be7-ad71-5bd261e37698 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] HTTP exception thrown: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-39eff728-45ed-4be7-ad71-5bd261e37698 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Request method failure captured: Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb HTTP/1.1 Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14Po9BwLeH12x0ONfvqpaNjXM_UOyeRtSuHqdHqepe0yHTNie4NGsazFg8XiZnJigD9l-U6ulEhzm3XCviVrJCc1Kb_Rn3tGNrEt4d5iyyGWY1qHlarxPO6IInDgTrtcJguYK2A8iMAVBnODRngwbP3UO2Be05C4t42sGvW9sw-q7Ko Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 948326ddffa847bf900ddb0e59857004 Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/948326ddffa847bf900ddb0e59857004"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/948326ddffa847bf900ddb0e59857004"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_948326ddffa847bf900ddb0e59857004", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/948326ddffa847bf900ddb0e59857004"}]}] Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 948326ddffa847bf900ddb0e59857004 Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-808846879 Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ImagesNegativeTestJSON-808846879-project Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 05aaa42fb4ae4f47a216c8f9288061c2 Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ImagesNegativeTestJSON-808846879-project Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'e9b3d603-3c77-4a2e-a1be-3c78608f71bb'} Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:12.610829 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.621143 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:12.621143 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:12.621143 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:12.621143 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:12.621143 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:12.621143 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. Jul 20 04:27:12.621143 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:27:12.621143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-39eff728-45ed-4be7-ad71-5bd261e37698 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] Returning 404 to user: Instance e9b3d603-3c77-4a2e-a1be-3c78608f71bb could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:12.621143 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-39eff728-45ed-4be7-ad71-5bd261e37698 tempest-ImagesNegativeTestJSON-808846879 tempest-ImagesNegativeTestJSON-808846879-project] 10.222.0.17 "GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb" status: 404 len: 111 microversion: 2.1 time: 0.080522 Jul 20 04:27:12.621143 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1484/3167] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:12 2022] GET /compute/v2.1/servers/e9b3d603-3c77-4a2e-a1be-3c78608f71bb => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:14.658720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f6dec506-0cfc-4556-a911-b1261fa03871 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:27:14.659168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f6dec506-0cfc-4556-a911-b1261fa03871 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:27:14.660030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f6dec506-0cfc-4556-a911-b1261fa03871 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:27:14.660463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f6dec506-0cfc-4556-a911-b1261fa03871 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:27:14.661079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f6dec506-0cfc-4556-a911-b1261fa03871 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:27:14.692697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f6dec506-0cfc-4556-a911-b1261fa03871 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.693625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f6dec506-0cfc-4556-a911-b1261fa03871 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.702914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f6dec506-0cfc-4556-a911-b1261fa03871 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.702914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f6dec506-0cfc-4556-a911-b1261fa03871 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.735887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-f6dec506-0cfc-4556-a911-b1261fa03871 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Getting quotas for project ae67de1fefe64bd19a3bf614f02d3535. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:27:14.746607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-f6dec506-0cfc-4556-a911-b1261fa03871 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Getting quotas for user 1dc60058bea0485ebd4d502b2e7c986b and project ae67de1fefe64bd19a3bf614f02d3535. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:27:14.788393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f6dec506-0cfc-4556-a911-b1261fa03871 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:27:14.791500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f6dec506-0cfc-4556-a911-b1261fa03871 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:27:14.910383 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f6dec506-0cfc-4556-a911-b1261fa03871 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.758361 Jul 20 04:27:14.913677 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1684/3168] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:27:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:27:14.927581 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c33a7236-6fca-4744-9aab-0b79a83fb6a3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:14.929164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c33a7236-6fca-4744-9aab-0b79a83fb6a3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:15.509197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c33a7236-6fca-4744-9aab-0b79a83fb6a3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:15.525759 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c33a7236-6fca-4744-9aab-0b79a83fb6a3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1214 microversion: 2.1 time: 0.605524 Jul 20 04:27:15.526972 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1485/3169] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:14 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1214 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:16.550806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d004dcda-15bb-4c96-aeaa-cc7c26affacf tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:16.552322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d004dcda-15bb-4c96-aeaa-cc7c26affacf tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:16.567811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d004dcda-15bb-4c96-aeaa-cc7c26affacf tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:16.568695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d004dcda-15bb-4c96-aeaa-cc7c26affacf tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:16.569919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d004dcda-15bb-4c96-aeaa-cc7c26affacf tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:16.572074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d004dcda-15bb-4c96-aeaa-cc7c26affacf tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:17.037181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d004dcda-15bb-4c96-aeaa-cc7c26affacf tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:17.051561 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d004dcda-15bb-4c96-aeaa-cc7c26affacf tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1266 microversion: 2.1 time: 0.512243 Jul 20 04:27:17.058761 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1685/3170] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:16 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1266 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:17.426273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c03e3f30-d2f6-4787-aed2-7acdb0b15f17 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Action: 'create', calling method: .version_select at 0x7f06be1e1700>, body: {"keypair": {"name": "tempest-keypair-1468724138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1p0FX7R7EvSR07yLvVMjoHZsS/230LcbfZ04aKJOJU+HskBGVrROq9JErMcV7Dmc+PklKtiqLpAht8FgoZudDmMaVnDeOwYAUvyzNKZ94lSozI44bvgmZgZSfoze4g/w=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:17.487425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-c03e3f30-d2f6-4787-aed2-7acdb0b15f17 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Getting quotas for project 85cca0080e7e458ab2569764f77b8c71. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:27:17.504558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-c03e3f30-d2f6-4787-aed2-7acdb0b15f17 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Getting quotas for user 7e9b9e0c72784fca90beb852a0957789 and project 85cca0080e7e458ab2569764f77b8c71. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:27:17.596740 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c03e3f30-d2f6-4787-aed2-7acdb0b15f17 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.174369 Jul 20 04:27:17.600004 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1486/3171] 10.222.0.17 () {62 vars in 1199 bytes} [Wed Jul 20 04:27:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 178 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:27:18.076005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b338bf63-b55c-4b07-aa80-57534b4124d0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:18.077594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b338bf63-b55c-4b07-aa80-57534b4124d0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:18.086212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b338bf63-b55c-4b07-aa80-57534b4124d0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:18.087225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b338bf63-b55c-4b07-aa80-57534b4124d0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:18.088665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b338bf63-b55c-4b07-aa80-57534b4124d0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:18.089590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b338bf63-b55c-4b07-aa80-57534b4124d0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:18.316741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b338bf63-b55c-4b07-aa80-57534b4124d0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:18.328203 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b338bf63-b55c-4b07-aa80-57534b4124d0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1272 microversion: 2.1 time: 0.256224 Jul 20 04:27:18.330533 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1686/3172] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:18 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1272 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:19.354603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2d0acca5-0634-4cba-bfed-123b190605f7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:19.360736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2d0acca5-0634-4cba-bfed-123b190605f7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:19.376973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d0acca5-0634-4cba-bfed-123b190605f7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:19.378014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d0acca5-0634-4cba-bfed-123b190605f7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:19.379479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d0acca5-0634-4cba-bfed-123b190605f7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:19.383347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d0acca5-0634-4cba-bfed-123b190605f7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:19.580820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2d0acca5-0634-4cba-bfed-123b190605f7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:19.590589 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2d0acca5-0634-4cba-bfed-123b190605f7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1272 microversion: 2.1 time: 0.241082 Jul 20 04:27:19.596798 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1487/3173] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:19 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1272 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:20.621732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5be03419-136a-402c-8bf1-7b9c43d118aa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:20.622593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5be03419-136a-402c-8bf1-7b9c43d118aa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:20.637638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5be03419-136a-402c-8bf1-7b9c43d118aa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:20.638373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5be03419-136a-402c-8bf1-7b9c43d118aa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:20.639336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5be03419-136a-402c-8bf1-7b9c43d118aa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:20.639927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5be03419-136a-402c-8bf1-7b9c43d118aa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:21.494600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5be03419-136a-402c-8bf1-7b9c43d118aa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:21.520478 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5be03419-136a-402c-8bf1-7b9c43d118aa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1272 microversion: 2.1 time: 0.902347 Jul 20 04:27:21.537198 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1687/3174] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:20 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1272 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:22.551198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ae45ee68-93da-411a-bd25-ada54dae7b85 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:22.555220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ae45ee68-93da-411a-bd25-ada54dae7b85 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:22.588362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae45ee68-93da-411a-bd25-ada54dae7b85 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:22.590127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae45ee68-93da-411a-bd25-ada54dae7b85 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:22.595927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae45ee68-93da-411a-bd25-ada54dae7b85 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:22.597023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae45ee68-93da-411a-bd25-ada54dae7b85 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:23.592242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ae45ee68-93da-411a-bd25-ada54dae7b85 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:23.611707 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ae45ee68-93da-411a-bd25-ada54dae7b85 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1314 microversion: 2.1 time: 1.071786 Jul 20 04:27:23.624807 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1488/3175] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:22 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1314 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:24.631004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-956ce202-26da-4b82-9015-dd8f9c9859cc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:24.631665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-956ce202-26da-4b82-9015-dd8f9c9859cc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:24.635013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:24.661769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-956ce202-26da-4b82-9015-dd8f9c9859cc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:24.662238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-956ce202-26da-4b82-9015-dd8f9c9859cc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:24.665213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-956ce202-26da-4b82-9015-dd8f9c9859cc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:24.667012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-956ce202-26da-4b82-9015-dd8f9c9859cc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:24.749738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:24.802036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:25.846814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-956ce202-26da-4b82-9015-dd8f9c9859cc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:25.849628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:25.862435 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-956ce202-26da-4b82-9015-dd8f9c9859cc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1314 microversion: 2.1 time: 1.235569 Jul 20 04:27:25.863345 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1688/3176] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:24 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1314 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:26.404293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-7b5c9cbc-a366-478e-8548-3a3098efcc6a req-f44a4bee-1db3-4119-875a-3a00f6a3cb10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ced3e0e-76cd-4980-8996-eac7e9cb559b", "tag": "7cc32bb9-4220-4014-bf36-15752c5231cd"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:26.419881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7b5c9cbc-a366-478e-8548-3a3098efcc6a req-f44a4bee-1db3-4119-875a-3a00f6a3cb10 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.421256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7b5c9cbc-a366-478e-8548-3a3098efcc6a req-f44a4bee-1db3-4119-875a-3a00f6a3cb10 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.436188 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-7b5c9cbc-a366-478e-8548-3a3098efcc6a req-f44a4bee-1db3-4119-875a-3a00f6a3cb10 service nova] Creating event network-changed:7cc32bb9-4220-4014-bf36-15752c5231cd for instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b on n-h1-826526-5 Jul 20 04:27:26.445738 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-7b5c9cbc-a366-478e-8548-3a3098efcc6a req-f44a4bee-1db3-4119-875a-3a00f6a3cb10 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046076 Jul 20 04:27:26.454279 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1489/3177] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:26.514401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c9005c01-d1c7-49ec-a8b8-7aa69cd0b778 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1316120458", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e93423e2-022a-46bf-9014-734fd7c65698"}, {"port": "79dd747c-56b7-4275-b234-425b37c3aaf3", "tag": "port-1"}, {"port": "d88e9d40-f883-487c-b169-78e7f289e235", "tag": "port-2"}, {"uuid": "81c5215d-9532-4ade-828d-0610ed0383bf", "tag": "net-1"}, {"uuid": "81c5215d-9532-4ade-828d-0610ed0383bf"}, {"uuid": "1aa1ae4a-58a2-4b46-8e30-8005bc4e7d96", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "1aa1ae4a-58a2-4b46-8e30-8005bc4e7d96", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d85700ad-363f-42eb-ab3b-b0455b4c209d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "0bdf8f9f-29cd-4a28-a39c-ebfb4df9b52c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0189d626-75a7-416c-ad6a-0dc95fb06918", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--21605761"}], "key_name": "tempest-keypair-1468724138", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:26.916305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-30eca1d6-0c1e-44e3-a522-e187a4623c53 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:26.917765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-30eca1d6-0c1e-44e3-a522-e187a4623c53 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:26.966977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30eca1d6-0c1e-44e3-a522-e187a4623c53 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.971763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30eca1d6-0c1e-44e3-a522-e187a4623c53 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.972719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30eca1d6-0c1e-44e3-a522-e187a4623c53 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.974764 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30eca1d6-0c1e-44e3-a522-e187a4623c53 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:27.236976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-c9005c01-d1c7-49ec-a8b8-7aa69cd0b778 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] validate_networks() for [('e93423e2-022a-46bf-9014-734fd7c65698', None, None, None, None, None), (None, None, '79dd747c-56b7-4275-b234-425b37c3aaf3', None, None, None), (None, None, 'd88e9d40-f883-487c-b169-78e7f289e235', None, None, None), ('81c5215d-9532-4ade-828d-0610ed0383bf', None, None, None, None, None), ('81c5215d-9532-4ade-828d-0610ed0383bf', None, None, None, None, None), ('1aa1ae4a-58a2-4b46-8e30-8005bc4e7d96', '10.2.2.100', None, None, None, None), ('1aa1ae4a-58a2-4b46-8e30-8005bc4e7d96', '10.2.2.200', None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:27:27.538349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:28.724765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-30eca1d6-0c1e-44e3-a522-e187a4623c53 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:28.741208 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-30eca1d6-0c1e-44e3-a522-e187a4623c53 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1314 microversion: 2.1 time: 1.851340 Jul 20 04:27:28.743860 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1490/3178] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:26 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1314 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:29.764001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-750e3d99-6462-410e-a855-500862184dbc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:29.765500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-750e3d99-6462-410e-a855-500862184dbc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:29.779444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-750e3d99-6462-410e-a855-500862184dbc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:29.779906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-750e3d99-6462-410e-a855-500862184dbc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:29.784589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-750e3d99-6462-410e-a855-500862184dbc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:29.787338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-750e3d99-6462-410e-a855-500862184dbc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.495145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-750e3d99-6462-410e-a855-500862184dbc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:30.528882 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-750e3d99-6462-410e-a855-500862184dbc tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1314 microversion: 2.1 time: 0.765802 Jul 20 04:27:30.544337 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1491/3179] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:29 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1314 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:31.553483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d165871d-286d-426c-ac94-53c0f01b30b6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:31.560713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d165871d-286d-426c-ac94-53c0f01b30b6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:31.581030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d165871d-286d-426c-ac94-53c0f01b30b6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:31.583506 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d165871d-286d-426c-ac94-53c0f01b30b6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:31.584753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d165871d-286d-426c-ac94-53c0f01b30b6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:31.587591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d165871d-286d-426c-ac94-53c0f01b30b6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:32.569636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d165871d-286d-426c-ac94-53c0f01b30b6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:32.574090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:32.590306 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d165871d-286d-426c-ac94-53c0f01b30b6 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1314 microversion: 2.1 time: 1.042024 Jul 20 04:27:32.591192 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1492/3180] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:31 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1314 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:33.612977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0465b6b4-e845-4dbc-a2e6-1c9d56f576a8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:33.615814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0465b6b4-e845-4dbc-a2e6-1c9d56f576a8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:33.646332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0465b6b4-e845-4dbc-a2e6-1c9d56f576a8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:33.647653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0465b6b4-e845-4dbc-a2e6-1c9d56f576a8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:33.649601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0465b6b4-e845-4dbc-a2e6-1c9d56f576a8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:33.650740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0465b6b4-e845-4dbc-a2e6-1c9d56f576a8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:34.582120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0465b6b4-e845-4dbc-a2e6-1c9d56f576a8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:34.590653 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0465b6b4-e845-4dbc-a2e6-1c9d56f576a8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1314 microversion: 2.1 time: 0.986184 Jul 20 04:27:34.600645 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1493/3181] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:33 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1314 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:34.605890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-a70f847f-3f89-46c0-989c-1c8c6b68d2c9 req-c5b26f0e-016b-462d-a786-415c95883bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ced3e0e-76cd-4980-8996-eac7e9cb559b", "name": "network-vif-plugged", "status": "completed", "tag": "7cc32bb9-4220-4014-bf36-15752c5231cd"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:34.617820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a70f847f-3f89-46c0-989c-1c8c6b68d2c9 req-c5b26f0e-016b-462d-a786-415c95883bda service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:34.618793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a70f847f-3f89-46c0-989c-1c8c6b68d2c9 req-c5b26f0e-016b-462d-a786-415c95883bda service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:34.638370 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-a70f847f-3f89-46c0-989c-1c8c6b68d2c9 req-c5b26f0e-016b-462d-a786-415c95883bda service nova] Creating event network-vif-plugged:7cc32bb9-4220-4014-bf36-15752c5231cd for instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b on n-h1-826526-5 Jul 20 04:27:34.644640 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-a70f847f-3f89-46c0-989c-1c8c6b68d2c9 req-c5b26f0e-016b-462d-a786-415c95883bda service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042561 Jul 20 04:27:34.645515 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1494/3182] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:34.678947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-09aa2d37-dad6-4fa9-8e75-f82d562d063f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be053790>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:34.804823 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-09aa2d37-dad6-4fa9-8e75-f82d562d063f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/33fe81d9-c99c-4429-baab-ff0fec92ee3e" status: 200 len: 661 microversion: 2.1 time: 0.155092 Jul 20 04:27:34.809925 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1495/3183] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:27:34 2022] GET /compute/v2.1/images/33fe81d9-c99c-4429-baab-ff0fec92ee3e => generated 661 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:34.836108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2afb61b6-3031-468d-8ae2-94d69e3c58b5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be0c83a0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:34.908065 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2afb61b6-3031-468d-8ae2-94d69e3c58b5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/33fe81d9-c99c-4429-baab-ff0fec92ee3e" status: 200 len: 661 microversion: 2.1 time: 0.087860 Jul 20 04:27:34.913294 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1496/3184] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:27:34 2022] GET /compute/v2.1/images/33fe81d9-c99c-4429-baab-ff0fec92ee3e => generated 661 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:36.070378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f6698d12-045d-4091-ae34-1f3d6fc76bad tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:36.077734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f6698d12-045d-4091-ae34-1f3d6fc76bad tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:36.102021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6698d12-045d-4091-ae34-1f3d6fc76bad tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:36.103153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6698d12-045d-4091-ae34-1f3d6fc76bad tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:36.111327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6698d12-045d-4091-ae34-1f3d6fc76bad tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:36.112355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6698d12-045d-4091-ae34-1f3d6fc76bad tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:36.688154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:37.272103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f6698d12-045d-4091-ae34-1f3d6fc76bad tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:37.292143 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f6698d12-045d-4091-ae34-1f3d6fc76bad tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1314 microversion: 2.1 time: 1.686819 Jul 20 04:27:37.293916 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1497/3185] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:35 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1314 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:37.306514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4c71d95f-7a55-4773-a3b6-6d914553aa5f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bde5fee0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:37.384910 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4c71d95f-7a55-4773-a3b6-6d914553aa5f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/78a58835-87b7-457b-8cb6-70d508b2ac93" status: 200 len: 661 microversion: 2.1 time: 0.088327 Jul 20 04:27:37.385825 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1498/3186] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:27:37 2022] GET /compute/v2.1/images/78a58835-87b7-457b-8cb6-70d508b2ac93 => generated 661 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:37.398844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8ab83dbd-f50e-4ffa-8a1a-0e460c531d37 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be1fe3a0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:37.445721 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8ab83dbd-f50e-4ffa-8a1a-0e460c531d37 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/78a58835-87b7-457b-8cb6-70d508b2ac93" status: 200 len: 661 microversion: 2.1 time: 0.050822 Jul 20 04:27:37.456380 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1499/3187] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:27:37 2022] GET /compute/v2.1/images/78a58835-87b7-457b-8cb6-70d508b2ac93 => generated 661 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:38.322544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-33706bc1-db0e-4ae1-987b-3b685516404d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:38.324383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-33706bc1-db0e-4ae1-987b-3b685516404d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:38.338390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33706bc1-db0e-4ae1-987b-3b685516404d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:38.338847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33706bc1-db0e-4ae1-987b-3b685516404d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:38.340122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33706bc1-db0e-4ae1-987b-3b685516404d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:38.340122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33706bc1-db0e-4ae1-987b-3b685516404d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:39.320876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-33706bc1-db0e-4ae1-987b-3b685516404d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:39.357245 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-33706bc1-db0e-4ae1-987b-3b685516404d tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1502 microversion: 2.1 time: 1.043072 Jul 20 04:27:39.369412 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1500/3188] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:38 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1502 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:39.400002 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-35420216-8986-48f7-a355-ba7818fa3223 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:39.442737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35420216-8986-48f7-a355-ba7818fa3223 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:39.449066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35420216-8986-48f7-a355-ba7818fa3223 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:39.581861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=5 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:39.651478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-35420216-8986-48f7-a355-ba7818fa3223 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Going to try to stop instance {{(pid=127870) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:27:39.840543 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-35420216-8986-48f7-a355-ba7818fa3223 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "POST /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b/action" status: 202 len: 0 microversion: 2.1 time: 0.468596 Jul 20 04:27:39.849934 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1501/3189] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:27:39 2022] POST /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:27:39.890183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aed6fb76-8c2d-47c2-8a94-b60efc68601c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:39.893628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aed6fb76-8c2d-47c2-8a94-b60efc68601c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:39.901745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c9005c01-d1c7-49ec-a8b8-7aa69cd0b778 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:27:39.902384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c9005c01-d1c7-49ec-a8b8-7aa69cd0b778 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:27:39.902924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c9005c01-d1c7-49ec-a8b8-7aa69cd0b778 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:27:39.903406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c9005c01-d1c7-49ec-a8b8-7aa69cd0b778 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:27:39.903906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c9005c01-d1c7-49ec-a8b8-7aa69cd0b778 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:27:39.925767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aed6fb76-8c2d-47c2-8a94-b60efc68601c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:39.934099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aed6fb76-8c2d-47c2-8a94-b60efc68601c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:39.936437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aed6fb76-8c2d-47c2-8a94-b60efc68601c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:39.943776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aed6fb76-8c2d-47c2-8a94-b60efc68601c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:39.944001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9005c01-d1c7-49ec-a8b8-7aa69cd0b778 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:39.945496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9005c01-d1c7-49ec-a8b8-7aa69cd0b778 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:39.952401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9005c01-d1c7-49ec-a8b8-7aa69cd0b778 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:39.952963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9005c01-d1c7-49ec-a8b8-7aa69cd0b778 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:40.034798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c9005c01-d1c7-49ec-a8b8-7aa69cd0b778 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Getting quotas for project 85cca0080e7e458ab2569764f77b8c71. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:27:40.046089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c9005c01-d1c7-49ec-a8b8-7aa69cd0b778 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Getting quotas for user 7e9b9e0c72784fca90beb852a0957789 and project 85cca0080e7e458ab2569764f77b8c71. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:27:40.354062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c9005c01-d1c7-49ec-a8b8-7aa69cd0b778 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:27:40.359033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c9005c01-d1c7-49ec-a8b8-7aa69cd0b778 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d85700ad-363f-42eb-ab3b-b0455b4c209d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='0bdf8f9f-29cd-4a28-a39c-ebfb4df9b52c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0189d626-75a7-416c-ad6a-0dc95fb06918',volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:27:40.793546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aed6fb76-8c2d-47c2-8a94-b60efc68601c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:40.809064 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aed6fb76-8c2d-47c2-8a94-b60efc68601c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1512 microversion: 2.1 time: 0.955848 Jul 20 04:27:40.823126 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1502/3190] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:39 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1512 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:40.837225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0916e357-e2e5-4d05-b7e1-c78a39ad21d2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bd5183a0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:40.902883 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0916e357-e2e5-4d05-b7e1-c78a39ad21d2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/322cfa12-e360-4912-8b56-9df255c696a2" status: 200 len: 661 microversion: 2.1 time: 0.077842 Jul 20 04:27:40.904121 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1503/3191] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:27:40 2022] GET /compute/v2.1/images/322cfa12-e360-4912-8b56-9df255c696a2 => generated 661 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:40.916734 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c9005c01-d1c7-49ec-a8b8-7aa69cd0b778 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 14.412058 Jul 20 04:27:40.917946 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1689/3192] 10.222.0.17 () {62 vars in 1188 bytes} [Wed Jul 20 04:27:26 2022] POST /compute/v2.1/servers => generated 404 bytes in 14415 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:27:40.932063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c27a9417-0eb1-461f-9906-0c30e224dc55 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be053040>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:40.934885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-972ef559-a02e-4908-89e9-3fcc0596ea18 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:40.936896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-972ef559-a02e-4908-89e9-3fcc0596ea18 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:41.011030 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c27a9417-0eb1-461f-9906-0c30e224dc55 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/322cfa12-e360-4912-8b56-9df255c696a2" status: 200 len: 661 microversion: 2.1 time: 0.098449 Jul 20 04:27:41.012287 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1504/3193] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:27:40 2022] GET /compute/v2.1/images/322cfa12-e360-4912-8b56-9df255c696a2 => generated 661 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:41.100513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-972ef559-a02e-4908-89e9-3fcc0596ea18 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:41.114066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-972ef559-a02e-4908-89e9-3fcc0596ea18 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:41.118466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-972ef559-a02e-4908-89e9-3fcc0596ea18 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:41.122147 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-972ef559-a02e-4908-89e9-3fcc0596ea18 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1286 microversion: 2.32 time: 0.196939 Jul 20 04:27:41.124730 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1690/3194] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:40 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1286 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:41.212436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6c869564-5057-47ba-9487-2f8db834fe56 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1106647034", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:41.296986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-6c869564-5057-47ba-9487-2f8db834fe56 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] validate_networks() for None {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:27:41.836238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d146b705-041a-42da-b25c-5602c3700f3f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:41.837473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d146b705-041a-42da-b25c-5602c3700f3f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:41.846260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d146b705-041a-42da-b25c-5602c3700f3f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.846802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d146b705-041a-42da-b25c-5602c3700f3f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:41.847858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d146b705-041a-42da-b25c-5602c3700f3f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.848536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d146b705-041a-42da-b25c-5602c3700f3f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:42.086391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d146b705-041a-42da-b25c-5602c3700f3f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:42.144002 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d146b705-041a-42da-b25c-5602c3700f3f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1512 microversion: 2.1 time: 0.299453 Jul 20 04:27:42.148034 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1691/3195] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:41 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1512 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:42.153712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b9e037b-3e43-44c1-a24f-469287ffaab4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:42.154668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9b9e037b-3e43-44c1-a24f-469287ffaab4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:42.223268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9b9e037b-3e43-44c1-a24f-469287ffaab4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:42.232404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9b9e037b-3e43-44c1-a24f-469287ffaab4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:42.233880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9b9e037b-3e43-44c1-a24f-469287ffaab4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:42.235972 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9b9e037b-3e43-44c1-a24f-469287ffaab4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1286 microversion: 2.32 time: 0.086171 Jul 20 04:27:42.247955 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1692/3196] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:42 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:42.465711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6c869564-5057-47ba-9487-2f8db834fe56 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:27:42.467565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6c869564-5057-47ba-9487-2f8db834fe56 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:27:42.468976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6c869564-5057-47ba-9487-2f8db834fe56 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:27:42.469921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6c869564-5057-47ba-9487-2f8db834fe56 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:27:42.470894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6c869564-5057-47ba-9487-2f8db834fe56 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:27:42.481999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:42.503205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c869564-5057-47ba-9487-2f8db834fe56 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:42.504720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c869564-5057-47ba-9487-2f8db834fe56 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:42.506680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c869564-5057-47ba-9487-2f8db834fe56 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:42.507798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c869564-5057-47ba-9487-2f8db834fe56 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:42.576812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-6c869564-5057-47ba-9487-2f8db834fe56 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Getting quotas for project c026c4ebe6564bb99c52f70fdec12ca3. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:27:42.655858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-6c869564-5057-47ba-9487-2f8db834fe56 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Getting quotas for user dc7cb2c568004f36991bd7ef01accca3 and project c026c4ebe6564bb99c52f70fdec12ca3. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:27:42.776806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6c869564-5057-47ba-9487-2f8db834fe56 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:27:42.804353 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6c869564-5057-47ba-9487-2f8db834fe56 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:27:43.125873 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6c869564-5057-47ba-9487-2f8db834fe56 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.915381 Jul 20 04:27:43.129616 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1505/3197] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:27:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:27:43.182116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3c0f20c4-2559-4583-84e8-7369c88999a0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:43.193153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3c0f20c4-2559-4583-84e8-7369c88999a0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:43.255648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c0f20c4-2559-4583-84e8-7369c88999a0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:43.259660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c0f20c4-2559-4583-84e8-7369c88999a0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:43.262751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c0f20c4-2559-4583-84e8-7369c88999a0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:43.263810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-821ca849-c4a0-4f43-bbac-0819bf4bb767 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:43.270221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c0f20c4-2559-4583-84e8-7369c88999a0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:43.275264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-821ca849-c4a0-4f43-bbac-0819bf4bb767 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:43.346320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-821ca849-c4a0-4f43-bbac-0819bf4bb767 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:43.356475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-821ca849-c4a0-4f43-bbac-0819bf4bb767 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:43.368665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-821ca849-c4a0-4f43-bbac-0819bf4bb767 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:43.373516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-821ca849-c4a0-4f43-bbac-0819bf4bb767 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:43.709615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-821ca849-c4a0-4f43-bbac-0819bf4bb767 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:43.759144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-821ca849-c4a0-4f43-bbac-0819bf4bb767 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:43.775117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-821ca849-c4a0-4f43-bbac-0819bf4bb767 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:43.780018 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-821ca849-c4a0-4f43-bbac-0819bf4bb767 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1520 microversion: 2.32 time: 0.526553 Jul 20 04:27:43.782292 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1506/3198] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:43 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1520 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:43.802003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1836f43a-42a7-42e9-9ec4-b85e54d0fc90 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-816772596", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:43.936173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3c0f20c4-2559-4583-84e8-7369c88999a0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:43.974020 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3c0f20c4-2559-4583-84e8-7369c88999a0 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1512 microversion: 2.1 time: 0.807579 Jul 20 04:27:43.993264 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1693/3199] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:43 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1512 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:43.995374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-1836f43a-42a7-42e9-9ec4-b85e54d0fc90 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] validate_networks() for None {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:27:44.820438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-236e0d4e-0a59-42d5-a17d-1c8d92c78932 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:44.824787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-236e0d4e-0a59-42d5-a17d-1c8d92c78932 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:44.865717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-236e0d4e-0a59-42d5-a17d-1c8d92c78932 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:44.866757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-236e0d4e-0a59-42d5-a17d-1c8d92c78932 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:44.875962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-236e0d4e-0a59-42d5-a17d-1c8d92c78932 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:44.882854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-236e0d4e-0a59-42d5-a17d-1c8d92c78932 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:45.930267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-236e0d4e-0a59-42d5-a17d-1c8d92c78932 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:45.943892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-236e0d4e-0a59-42d5-a17d-1c8d92c78932 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:45.945919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-236e0d4e-0a59-42d5-a17d-1c8d92c78932 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:45.947344 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-236e0d4e-0a59-42d5-a17d-1c8d92c78932 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1594 microversion: 2.32 time: 1.135881 Jul 20 04:27:45.966842 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1694/3200] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:44 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1594 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:27:45.984918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7548f494-06c7-4d69-b05e-de2e218b7204 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:45.986353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7548f494-06c7-4d69-b05e-de2e218b7204 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:45.999942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7548f494-06c7-4d69-b05e-de2e218b7204 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:46.001373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7548f494-06c7-4d69-b05e-de2e218b7204 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:46.003017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7548f494-06c7-4d69-b05e-de2e218b7204 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:46.003975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7548f494-06c7-4d69-b05e-de2e218b7204 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:46.353527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1836f43a-42a7-42e9-9ec4-b85e54d0fc90 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:27:46.354904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1836f43a-42a7-42e9-9ec4-b85e54d0fc90 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:27:46.355768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1836f43a-42a7-42e9-9ec4-b85e54d0fc90 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:27:46.357155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1836f43a-42a7-42e9-9ec4-b85e54d0fc90 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:27:46.358009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1836f43a-42a7-42e9-9ec4-b85e54d0fc90 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:27:46.392505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1836f43a-42a7-42e9-9ec4-b85e54d0fc90 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:46.393659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1836f43a-42a7-42e9-9ec4-b85e54d0fc90 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:46.395287 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1836f43a-42a7-42e9-9ec4-b85e54d0fc90 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:46.396247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1836f43a-42a7-42e9-9ec4-b85e54d0fc90 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:46.441729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-1836f43a-42a7-42e9-9ec4-b85e54d0fc90 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Getting quotas for project c026c4ebe6564bb99c52f70fdec12ca3. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:27:46.454392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-1836f43a-42a7-42e9-9ec4-b85e54d0fc90 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Getting quotas for user dc7cb2c568004f36991bd7ef01accca3 and project c026c4ebe6564bb99c52f70fdec12ca3. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:27:46.483048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1836f43a-42a7-42e9-9ec4-b85e54d0fc90 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:27:46.489923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1836f43a-42a7-42e9-9ec4-b85e54d0fc90 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:27:46.587573 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1836f43a-42a7-42e9-9ec4-b85e54d0fc90 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.802370 Jul 20 04:27:46.588546 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1507/3201] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:27:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:27:46.600341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0e1a8dc9-b921-43a3-8954-39093815ac4f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:46.600341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0e1a8dc9-b921-43a3-8954-39093815ac4f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:46.817375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0e1a8dc9-b921-43a3-8954-39093815ac4f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:46.835700 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0e1a8dc9-b921-43a3-8954-39093815ac4f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1217 microversion: 2.1 time: 0.240402 Jul 20 04:27:46.837177 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1508/3202] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:46 2022] GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1217 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:46.971232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7548f494-06c7-4d69-b05e-de2e218b7204 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:46.991206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7927ccfc-983d-45cf-a106-60265647a939 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:46.993098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7927ccfc-983d-45cf-a106-60265647a939 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:47.011504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7927ccfc-983d-45cf-a106-60265647a939 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:47.012014 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7548f494-06c7-4d69-b05e-de2e218b7204 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1512 microversion: 2.1 time: 1.036629 Jul 20 04:27:47.012792 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1695/3203] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:45 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1512 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:47.024848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7927ccfc-983d-45cf-a106-60265647a939 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:47.029158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7927ccfc-983d-45cf-a106-60265647a939 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:47.030233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7927ccfc-983d-45cf-a106-60265647a939 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:47.390459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7927ccfc-983d-45cf-a106-60265647a939 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:47.415201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7927ccfc-983d-45cf-a106-60265647a939 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:47.424171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7927ccfc-983d-45cf-a106-60265647a939 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:47.432136 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7927ccfc-983d-45cf-a106-60265647a939 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1594 microversion: 2.32 time: 0.445282 Jul 20 04:27:47.450659 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1509/3204] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:46 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1594 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:27:47.868756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6bce555b-4337-4a92-a925-16fbd9968152 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:47.869191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6bce555b-4337-4a92-a925-16fbd9968152 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:47.935733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6bce555b-4337-4a92-a925-16fbd9968152 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:47.940767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6bce555b-4337-4a92-a925-16fbd9968152 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:47.943692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6bce555b-4337-4a92-a925-16fbd9968152 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:47.944300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6bce555b-4337-4a92-a925-16fbd9968152 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:48.040613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-07317489-a46d-47c2-a909-8f8ebc23a2c1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:48.041236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-07317489-a46d-47c2-a909-8f8ebc23a2c1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:48.067254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07317489-a46d-47c2-a909-8f8ebc23a2c1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:48.067879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07317489-a46d-47c2-a909-8f8ebc23a2c1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:48.068759 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07317489-a46d-47c2-a909-8f8ebc23a2c1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:48.069198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07317489-a46d-47c2-a909-8f8ebc23a2c1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:48.230904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6bce555b-4337-4a92-a925-16fbd9968152 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:48.254646 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6bce555b-4337-4a92-a925-16fbd9968152 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1213 microversion: 2.1 time: 0.392375 Jul 20 04:27:48.260500 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1696/3205] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:47 2022] GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1213 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:48.458200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a7e5901b-ab6f-420a-ac76-fbd7f573d5c4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:48.458967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a7e5901b-ab6f-420a-ac76-fbd7f573d5c4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:48.474428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7e5901b-ab6f-420a-ac76-fbd7f573d5c4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:48.475675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7e5901b-ab6f-420a-ac76-fbd7f573d5c4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:48.477119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7e5901b-ab6f-420a-ac76-fbd7f573d5c4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:48.477568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7e5901b-ab6f-420a-ac76-fbd7f573d5c4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:48.797641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a7e5901b-ab6f-420a-ac76-fbd7f573d5c4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:48.816462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a7e5901b-ab6f-420a-ac76-fbd7f573d5c4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:48.819865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a7e5901b-ab6f-420a-ac76-fbd7f573d5c4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:48.822647 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a7e5901b-ab6f-420a-ac76-fbd7f573d5c4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1594 microversion: 2.32 time: 0.369759 Jul 20 04:27:48.826729 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1697/3206] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:48 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1594 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:27:49.277488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a7510690-1f9f-432c-b20a-862809f6ada8 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:49.278954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a7510690-1f9f-432c-b20a-862809f6ada8 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:49.305178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7510690-1f9f-432c-b20a-862809f6ada8 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:49.305635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7510690-1f9f-432c-b20a-862809f6ada8 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:49.306433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7510690-1f9f-432c-b20a-862809f6ada8 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:49.306908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7510690-1f9f-432c-b20a-862809f6ada8 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:49.359343 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-07317489-a46d-47c2-a909-8f8ebc23a2c1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:49.391628 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-07317489-a46d-47c2-a909-8f8ebc23a2c1 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1512 microversion: 2.1 time: 1.352305 Jul 20 04:27:49.397311 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1510/3207] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:48 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1512 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:49.602012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a7510690-1f9f-432c-b20a-862809f6ada8 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:49.615476 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a7510690-1f9f-432c-b20a-862809f6ada8 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1275 microversion: 2.1 time: 0.342090 Jul 20 04:27:49.634598 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1698/3208] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:49 2022] GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1275 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:49.854679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6ebd5ffd-e180-4125-9e9d-d2548bfbc94f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:49.855661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6ebd5ffd-e180-4125-9e9d-d2548bfbc94f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:49.884075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6ebd5ffd-e180-4125-9e9d-d2548bfbc94f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:49.884857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6ebd5ffd-e180-4125-9e9d-d2548bfbc94f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:49.886115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6ebd5ffd-e180-4125-9e9d-d2548bfbc94f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:49.887108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6ebd5ffd-e180-4125-9e9d-d2548bfbc94f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:50.417507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9c4f3a4c-ee08-4f98-a9b8-d500d1e3e3d3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:50.418329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9c4f3a4c-ee08-4f98-a9b8-d500d1e3e3d3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:50.420630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:50.443840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c4f3a4c-ee08-4f98-a9b8-d500d1e3e3d3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:50.452848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c4f3a4c-ee08-4f98-a9b8-d500d1e3e3d3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:50.456616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c4f3a4c-ee08-4f98-a9b8-d500d1e3e3d3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:50.458659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c4f3a4c-ee08-4f98-a9b8-d500d1e3e3d3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:50.826918 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6ebd5ffd-e180-4125-9e9d-d2548bfbc94f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:50.843935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6ebd5ffd-e180-4125-9e9d-d2548bfbc94f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:50.845533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6ebd5ffd-e180-4125-9e9d-d2548bfbc94f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:50.846736 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6ebd5ffd-e180-4125-9e9d-d2548bfbc94f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1660 microversion: 2.32 time: 1.006569 Jul 20 04:27:50.847298 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1511/3209] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:49 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1660 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:50.862324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5f337314-8b2c-4588-8022-bce16df55881 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:50.864554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5f337314-8b2c-4588-8022-bce16df55881 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:50.886951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f337314-8b2c-4588-8022-bce16df55881 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:50.887402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f337314-8b2c-4588-8022-bce16df55881 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:50.888190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f337314-8b2c-4588-8022-bce16df55881 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:50.888676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f337314-8b2c-4588-8022-bce16df55881 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:51.135312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9c4f3a4c-ee08-4f98-a9b8-d500d1e3e3d3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:51.152901 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9c4f3a4c-ee08-4f98-a9b8-d500d1e3e3d3 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1512 microversion: 2.1 time: 0.739416 Jul 20 04:27:51.158896 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1699/3210] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:50 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1512 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:51.272916 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5f337314-8b2c-4588-8022-bce16df55881 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:51.285261 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5f337314-8b2c-4588-8022-bce16df55881 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1275 microversion: 2.1 time: 0.430977 Jul 20 04:27:51.286046 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1512/3211] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:50 2022] GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1275 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:51.869728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b4de36bc-78d4-4fd6-9af3-11a238c61da2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:51.870552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b4de36bc-78d4-4fd6-9af3-11a238c61da2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:51.881464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4de36bc-78d4-4fd6-9af3-11a238c61da2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:51.885984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4de36bc-78d4-4fd6-9af3-11a238c61da2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:51.888372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4de36bc-78d4-4fd6-9af3-11a238c61da2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:51.889051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4de36bc-78d4-4fd6-9af3-11a238c61da2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.176935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0f042fc1-e425-4b2a-8273-d026bec34864 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:52.177983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0f042fc1-e425-4b2a-8273-d026bec34864 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:52.206440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f042fc1-e425-4b2a-8273-d026bec34864 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.207879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f042fc1-e425-4b2a-8273-d026bec34864 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.212820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f042fc1-e425-4b2a-8273-d026bec34864 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.215206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f042fc1-e425-4b2a-8273-d026bec34864 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.231193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=10 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:52.479730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b4de36bc-78d4-4fd6-9af3-11a238c61da2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:52.496173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b4de36bc-78d4-4fd6-9af3-11a238c61da2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:52.501860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b4de36bc-78d4-4fd6-9af3-11a238c61da2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:52.508907 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b4de36bc-78d4-4fd6-9af3-11a238c61da2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1660 microversion: 2.32 time: 0.646139 Jul 20 04:27:52.510156 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1700/3212] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:51 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1660 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:52.534506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d988488e-d594-4c1f-b9b3-7d73ab00e859 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:52.535271 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d988488e-d594-4c1f-b9b3-7d73ab00e859 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:52.569875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d988488e-d594-4c1f-b9b3-7d73ab00e859 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.572592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d988488e-d594-4c1f-b9b3-7d73ab00e859 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.573872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d988488e-d594-4c1f-b9b3-7d73ab00e859 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.576950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d988488e-d594-4c1f-b9b3-7d73ab00e859 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:53.146314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d988488e-d594-4c1f-b9b3-7d73ab00e859 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:53.196041 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d988488e-d594-4c1f-b9b3-7d73ab00e859 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1317 microversion: 2.1 time: 0.665299 Jul 20 04:27:53.197078 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1701/3213] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:52 2022] GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1317 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:53.432281 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0f042fc1-e425-4b2a-8273-d026bec34864 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:53.455442 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0f042fc1-e425-4b2a-8273-d026bec34864 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1512 microversion: 2.1 time: 1.281800 Jul 20 04:27:53.466346 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1513/3214] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:52 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1512 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:53.537204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7ff40dc1-1bec-47bd-85d2-1bb7def91855 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:53.541979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7ff40dc1-1bec-47bd-85d2-1bb7def91855 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:53.566759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ff40dc1-1bec-47bd-85d2-1bb7def91855 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:53.567227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ff40dc1-1bec-47bd-85d2-1bb7def91855 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:53.568063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ff40dc1-1bec-47bd-85d2-1bb7def91855 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:53.568788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ff40dc1-1bec-47bd-85d2-1bb7def91855 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:54.221399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b212aa8f-8ddf-4692-b840-7916f6a33bca tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:54.222287 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b212aa8f-8ddf-4692-b840-7916f6a33bca tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:54.239152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b212aa8f-8ddf-4692-b840-7916f6a33bca tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:54.242859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b212aa8f-8ddf-4692-b840-7916f6a33bca tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:54.247236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b212aa8f-8ddf-4692-b840-7916f6a33bca tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:54.253098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b212aa8f-8ddf-4692-b840-7916f6a33bca tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:54.886981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7ff40dc1-1bec-47bd-85d2-1bb7def91855 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:54.905257 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7ff40dc1-1bec-47bd-85d2-1bb7def91855 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:54.909788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7ff40dc1-1bec-47bd-85d2-1bb7def91855 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:54.916689 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7ff40dc1-1bec-47bd-85d2-1bb7def91855 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1705 microversion: 2.32 time: 1.386923 Jul 20 04:27:54.917954 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1702/3215] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:53 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1705 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:54.931516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a1954ba8-fb7a-4f0b-9440-8d6024adbbf9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:54.934659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a1954ba8-fb7a-4f0b-9440-8d6024adbbf9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:54.949547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1954ba8-fb7a-4f0b-9440-8d6024adbbf9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:54.951235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1954ba8-fb7a-4f0b-9440-8d6024adbbf9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:54.953317 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1954ba8-fb7a-4f0b-9440-8d6024adbbf9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:54.956168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1954ba8-fb7a-4f0b-9440-8d6024adbbf9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:55.577800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b212aa8f-8ddf-4692-b840-7916f6a33bca tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:55.594785 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b212aa8f-8ddf-4692-b840-7916f6a33bca tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1317 microversion: 2.1 time: 1.375207 Jul 20 04:27:55.596820 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1514/3216] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:54 2022] GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1317 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:55.610518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-65997872-a429-453a-8c17-a7d9fc9096a7 req-d6bccba5-6cde-4d8b-bab9-7b97f9513e9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b", "tag": "f5248619-09e7-4707-9127-fb95dc122bcf"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:55.639374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-65997872-a429-453a-8c17-a7d9fc9096a7 req-d6bccba5-6cde-4d8b-bab9-7b97f9513e9d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:55.642965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-65997872-a429-453a-8c17-a7d9fc9096a7 req-d6bccba5-6cde-4d8b-bab9-7b97f9513e9d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:55.679233 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-65997872-a429-453a-8c17-a7d9fc9096a7 req-d6bccba5-6cde-4d8b-bab9-7b97f9513e9d service nova] Creating event network-changed:f5248619-09e7-4707-9127-fb95dc122bcf for instance a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b on n-h2-826526-5 Jul 20 04:27:55.691320 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-65997872-a429-453a-8c17-a7d9fc9096a7 req-d6bccba5-6cde-4d8b-bab9-7b97f9513e9d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090358 Jul 20 04:27:55.691973 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1515/3217] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:55.927770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a1954ba8-fb7a-4f0b-9440-8d6024adbbf9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:55.943531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8c6a6dd4-054a-46d6-8a7e-dcc82bdb8420 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:55.947585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8c6a6dd4-054a-46d6-8a7e-dcc82bdb8420 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:55.955877 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a1954ba8-fb7a-4f0b-9440-8d6024adbbf9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1512 microversion: 2.1 time: 1.028940 Jul 20 04:27:55.956989 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1703/3218] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:54 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1512 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:55.977909 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c6a6dd4-054a-46d6-8a7e-dcc82bdb8420 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:55.978392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c6a6dd4-054a-46d6-8a7e-dcc82bdb8420 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:55.979319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c6a6dd4-054a-46d6-8a7e-dcc82bdb8420 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:55.979966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c6a6dd4-054a-46d6-8a7e-dcc82bdb8420 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:56.419042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:56.619089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d5c052c3-d146-482f-8fc1-09ecd111b3e2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:56.620189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d5c052c3-d146-482f-8fc1-09ecd111b3e2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:56.647150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5c052c3-d146-482f-8fc1-09ecd111b3e2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:56.647618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5c052c3-d146-482f-8fc1-09ecd111b3e2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:56.648934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5c052c3-d146-482f-8fc1-09ecd111b3e2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:56.649989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5c052c3-d146-482f-8fc1-09ecd111b3e2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:56.835798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=14 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:57.062333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8c6a6dd4-054a-46d6-8a7e-dcc82bdb8420 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:57.085847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8c6a6dd4-054a-46d6-8a7e-dcc82bdb8420 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:57.087692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8c6a6dd4-054a-46d6-8a7e-dcc82bdb8420 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:57.088891 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8c6a6dd4-054a-46d6-8a7e-dcc82bdb8420 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1705 microversion: 2.32 time: 1.152808 Jul 20 04:27:57.098961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d5c052c3-d146-482f-8fc1-09ecd111b3e2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:57.101222 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1516/3219] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:55 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1705 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:57.109025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-935ed6b9-ece7-4f5a-86b3-52da421ca5f5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:57.109785 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d5c052c3-d146-482f-8fc1-09ecd111b3e2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1317 microversion: 2.1 time: 0.499832 Jul 20 04:27:57.109927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-935ed6b9-ece7-4f5a-86b3-52da421ca5f5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:57.110398 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1704/3220] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:56 2022] GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:57.119801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-935ed6b9-ece7-4f5a-86b3-52da421ca5f5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:57.120525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-935ed6b9-ece7-4f5a-86b3-52da421ca5f5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:57.121887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-935ed6b9-ece7-4f5a-86b3-52da421ca5f5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:57.122422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-935ed6b9-ece7-4f5a-86b3-52da421ca5f5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:57.757838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-f1601c46-1d3f-4d44-a31e-f81b39f7ce77 req-6f1329a7-9224-4576-b28b-85f7e80faafb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d12f9b2-058c-4fe2-964b-81217cb46489", "tag": "09e0f809-5b7f-42cb-bbac-f315284f1a91"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:57.781115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f1601c46-1d3f-4d44-a31e-f81b39f7ce77 req-6f1329a7-9224-4576-b28b-85f7e80faafb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:57.781787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f1601c46-1d3f-4d44-a31e-f81b39f7ce77 req-6f1329a7-9224-4576-b28b-85f7e80faafb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:57.798623 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-f1601c46-1d3f-4d44-a31e-f81b39f7ce77 req-6f1329a7-9224-4576-b28b-85f7e80faafb service nova] Creating event network-changed:09e0f809-5b7f-42cb-bbac-f315284f1a91 for instance 1d12f9b2-058c-4fe2-964b-81217cb46489 on n-h1-826526-5 Jul 20 04:27:57.806014 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-f1601c46-1d3f-4d44-a31e-f81b39f7ce77 req-6f1329a7-9224-4576-b28b-85f7e80faafb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054065 Jul 20 04:27:57.808191 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1705/3221] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:58.110201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c2cbc279-9404-4914-aa11-9ff2b150d45a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:58.111431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c2cbc279-9404-4914-aa11-9ff2b150d45a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:58.133172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2cbc279-9404-4914-aa11-9ff2b150d45a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:58.138358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2cbc279-9404-4914-aa11-9ff2b150d45a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:58.139539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2cbc279-9404-4914-aa11-9ff2b150d45a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:58.145132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2cbc279-9404-4914-aa11-9ff2b150d45a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:58.881468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c2cbc279-9404-4914-aa11-9ff2b150d45a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:58.899645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c2cbc279-9404-4914-aa11-9ff2b150d45a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:58.905978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c2cbc279-9404-4914-aa11-9ff2b150d45a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:58.907482 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c2cbc279-9404-4914-aa11-9ff2b150d45a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1705 microversion: 2.32 time: 0.803384 Jul 20 04:27:58.912515 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1706/3222] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:58 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1705 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:27:58.924508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-39eb6b8c-7daf-4886-aaed-0eaac974e396 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:58.925431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-39eb6b8c-7daf-4886-aaed-0eaac974e396 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:58.941029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39eb6b8c-7daf-4886-aaed-0eaac974e396 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:58.945451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39eb6b8c-7daf-4886-aaed-0eaac974e396 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:58.946700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39eb6b8c-7daf-4886-aaed-0eaac974e396 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:58.949372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39eb6b8c-7daf-4886-aaed-0eaac974e396 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:59.175170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-935ed6b9-ece7-4f5a-86b3-52da421ca5f5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:59.195998 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-935ed6b9-ece7-4f5a-86b3-52da421ca5f5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1512 microversion: 2.1 time: 2.093320 Jul 20 04:27:59.197202 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1517/3223] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:57 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1512 bytes in 2095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:59.808438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-39eb6b8c-7daf-4886-aaed-0eaac974e396 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:59.819383 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-39eb6b8c-7daf-4886-aaed-0eaac974e396 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1317 microversion: 2.1 time: 0.905250 Jul 20 04:27:59.832548 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1707/3224] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:58 2022] GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1317 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:59.931850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e269497b-fa05-4f93-9b6f-c7833b230a27 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:59.932789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e269497b-fa05-4f93-9b6f-c7833b230a27 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:59.945031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e269497b-fa05-4f93-9b6f-c7833b230a27 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:59.945739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e269497b-fa05-4f93-9b6f-c7833b230a27 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:59.947187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e269497b-fa05-4f93-9b6f-c7833b230a27 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:59.951497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e269497b-fa05-4f93-9b6f-c7833b230a27 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:00.231622 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-840dd762-3799-4ab8-bb1b-d9568b0e6c53 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Action: 'create', calling method: .version_select at 0x7f06be2dbee0>, body: {"keypair": {"name": "tempest-keypair-128568005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjDjgX5ViG2gwvNpNLpzbokiCWDTv2Qste8Olq/RgBNpkrwAJS8hLzMgXxuembSbZufFRxKBX6HqHMXGUS7JMrhfOG8y5kPk36MLdKnCYnOIkDCpc4aEYCaQY9PAPZijQ=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:00.256762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-840dd762-3799-4ab8-bb1b-d9568b0e6c53 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Getting quotas for project 0fd9c3c8c865481cadc7099860706164. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:28:00.274159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-840dd762-3799-4ab8-bb1b-d9568b0e6c53 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Getting quotas for user 9b9bde7d1dd74c0da55025a63131897e and project 0fd9c3c8c865481cadc7099860706164. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:28:00.309578 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-840dd762-3799-4ab8-bb1b-d9568b0e6c53 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.520177 Jul 20 04:28:00.317447 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1518/3225] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:27:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:00.325429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c1e86cf2-6f54-489b-8ecd-a8ff83c55683 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:00.330220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c1e86cf2-6f54-489b-8ecd-a8ff83c55683 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:00.338923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1e86cf2-6f54-489b-8ecd-a8ff83c55683 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:00.339839 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1e86cf2-6f54-489b-8ecd-a8ff83c55683 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:00.340935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1e86cf2-6f54-489b-8ecd-a8ff83c55683 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:00.341533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1e86cf2-6f54-489b-8ecd-a8ff83c55683 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:00.372014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:00.999253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e269497b-fa05-4f93-9b6f-c7833b230a27 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:01.005423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:01.046600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e269497b-fa05-4f93-9b6f-c7833b230a27 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:01.052315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e269497b-fa05-4f93-9b6f-c7833b230a27 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:01.056198 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e269497b-fa05-4f93-9b6f-c7833b230a27 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1750 microversion: 2.32 time: 1.127627 Jul 20 04:28:01.057369 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1708/3226] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:59 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1750 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:01.075463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1f54d43b-8977-4828-994a-26ebc83ed89b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:01.084298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1f54d43b-8977-4828-994a-26ebc83ed89b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:01.110972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f54d43b-8977-4828-994a-26ebc83ed89b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:01.112352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f54d43b-8977-4828-994a-26ebc83ed89b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:01.122335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f54d43b-8977-4828-994a-26ebc83ed89b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:01.123230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f54d43b-8977-4828-994a-26ebc83ed89b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:01.424878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1f54d43b-8977-4828-994a-26ebc83ed89b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:01.438805 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1f54d43b-8977-4828-994a-26ebc83ed89b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1317 microversion: 2.1 time: 0.376945 Jul 20 04:28:01.440586 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1709/3227] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:01 2022] GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:01.581315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c1e86cf2-6f54-489b-8ecd-a8ff83c55683 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:01.604554 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c1e86cf2-6f54-489b-8ecd-a8ff83c55683 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1512 microversion: 2.1 time: 1.285152 Jul 20 04:28:01.616746 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1519/3228] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:00 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1512 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:01.720962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-5149d73e-401a-4e5d-837e-7ac1e0258f27 req-9206df00-0d98-4571-8276-285212fd7568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b", "name": "network-vif-plugged", "status": "completed", "tag": "f5248619-09e7-4707-9127-fb95dc122bcf"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:01.745416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5149d73e-401a-4e5d-837e-7ac1e0258f27 req-9206df00-0d98-4571-8276-285212fd7568 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:01.749218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5149d73e-401a-4e5d-837e-7ac1e0258f27 req-9206df00-0d98-4571-8276-285212fd7568 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:01.800124 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-5149d73e-401a-4e5d-837e-7ac1e0258f27 req-9206df00-0d98-4571-8276-285212fd7568 service nova] Creating event network-vif-plugged:f5248619-09e7-4707-9127-fb95dc122bcf for instance a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b on n-h2-826526-5 Jul 20 04:28:01.834495 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-5149d73e-401a-4e5d-837e-7ac1e0258f27 req-9206df00-0d98-4571-8276-285212fd7568 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117965 Jul 20 04:28:01.835140 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1710/3229] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:02.082266 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-79526c7c-f6ce-4ad3-bc61-8d6a0c4e3b81 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:02.083046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-79526c7c-f6ce-4ad3-bc61-8d6a0c4e3b81 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:02.091383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79526c7c-f6ce-4ad3-bc61-8d6a0c4e3b81 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:02.091904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79526c7c-f6ce-4ad3-bc61-8d6a0c4e3b81 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:02.093447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79526c7c-f6ce-4ad3-bc61-8d6a0c4e3b81 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:02.094330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79526c7c-f6ce-4ad3-bc61-8d6a0c4e3b81 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:02.469691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-210ac632-8049-48cb-b9d2-381053d6c647 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:02.470906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-210ac632-8049-48cb-b9d2-381053d6c647 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:02.495478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-210ac632-8049-48cb-b9d2-381053d6c647 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:02.497581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-210ac632-8049-48cb-b9d2-381053d6c647 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:02.498890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-210ac632-8049-48cb-b9d2-381053d6c647 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:02.500900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-210ac632-8049-48cb-b9d2-381053d6c647 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:03.112562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-210ac632-8049-48cb-b9d2-381053d6c647 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:03.127710 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-210ac632-8049-48cb-b9d2-381053d6c647 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1317 microversion: 2.1 time: 0.664549 Jul 20 04:28:03.131482 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1711/3230] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:02 2022] GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1317 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:03.149724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3f0cbb9b-c76b-458c-a986-067acb74feb8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:03.164878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3f0cbb9b-c76b-458c-a986-067acb74feb8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:03.188746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f0cbb9b-c76b-458c-a986-067acb74feb8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:03.189199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f0cbb9b-c76b-458c-a986-067acb74feb8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:03.190011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f0cbb9b-c76b-458c-a986-067acb74feb8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:03.190463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f0cbb9b-c76b-458c-a986-067acb74feb8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:03.814476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-79526c7c-f6ce-4ad3-bc61-8d6a0c4e3b81 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:03.835586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-79526c7c-f6ce-4ad3-bc61-8d6a0c4e3b81 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:03.851016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-79526c7c-f6ce-4ad3-bc61-8d6a0c4e3b81 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:03.857862 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-79526c7c-f6ce-4ad3-bc61-8d6a0c4e3b81 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1750 microversion: 2.32 time: 1.783649 Jul 20 04:28:03.858994 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1520/3231] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:02 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1750 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:03.932112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3f0cbb9b-c76b-458c-a986-067acb74feb8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:03.962223 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3f0cbb9b-c76b-458c-a986-067acb74feb8 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1512 microversion: 2.1 time: 0.819023 Jul 20 04:28:03.969412 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1712/3232] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:03 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1512 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:04.148888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cd2581df-c86b-40f0-84e2-dcbd71e13b3f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:04.149527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cd2581df-c86b-40f0-84e2-dcbd71e13b3f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:04.185284 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd2581df-c86b-40f0-84e2-dcbd71e13b3f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:04.187812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd2581df-c86b-40f0-84e2-dcbd71e13b3f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:04.191191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd2581df-c86b-40f0-84e2-dcbd71e13b3f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:04.193553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd2581df-c86b-40f0-84e2-dcbd71e13b3f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:04.747672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-4b2b3e88-5d73-4f1e-aa12-b140bb363281 req-53f8f7bc-1e89-4eec-a7cc-64616d413c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d12f9b2-058c-4fe2-964b-81217cb46489", "name": "network-vif-plugged", "status": "completed", "tag": "09e0f809-5b7f-42cb-bbac-f315284f1a91"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:04.763631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4b2b3e88-5d73-4f1e-aa12-b140bb363281 req-53f8f7bc-1e89-4eec-a7cc-64616d413c02 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:04.764072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4b2b3e88-5d73-4f1e-aa12-b140bb363281 req-53f8f7bc-1e89-4eec-a7cc-64616d413c02 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:04.801400 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-4b2b3e88-5d73-4f1e-aa12-b140bb363281 req-53f8f7bc-1e89-4eec-a7cc-64616d413c02 service nova] Creating event network-vif-plugged:09e0f809-5b7f-42cb-bbac-f315284f1a91 for instance 1d12f9b2-058c-4fe2-964b-81217cb46489 on n-h1-826526-5 Jul 20 04:28:04.807192 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-4b2b3e88-5d73-4f1e-aa12-b140bb363281 req-53f8f7bc-1e89-4eec-a7cc-64616d413c02 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063498 Jul 20 04:28:04.807761 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1713/3233] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:04.879571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e301dd84-478d-4a90-b925-e620292cf137 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:04.880802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e301dd84-478d-4a90-b925-e620292cf137 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:04.895089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e301dd84-478d-4a90-b925-e620292cf137 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:04.905075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e301dd84-478d-4a90-b925-e620292cf137 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:04.906456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e301dd84-478d-4a90-b925-e620292cf137 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:04.907417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e301dd84-478d-4a90-b925-e620292cf137 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:05.239084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cd2581df-c86b-40f0-84e2-dcbd71e13b3f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:05.277648 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cd2581df-c86b-40f0-84e2-dcbd71e13b3f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1317 microversion: 2.1 time: 1.131158 Jul 20 04:28:05.281025 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1521/3234] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:04 2022] GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1317 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:05.293363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-43aae3be-727b-4289-9ba2-99c25fdd3127 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:05.297858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-43aae3be-727b-4289-9ba2-99c25fdd3127 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:05.325961 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43aae3be-727b-4289-9ba2-99c25fdd3127 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:05.327152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43aae3be-727b-4289-9ba2-99c25fdd3127 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:05.329466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43aae3be-727b-4289-9ba2-99c25fdd3127 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:05.332613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43aae3be-727b-4289-9ba2-99c25fdd3127 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:06.355028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e301dd84-478d-4a90-b925-e620292cf137 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:06.365356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e301dd84-478d-4a90-b925-e620292cf137 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:06.376016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e301dd84-478d-4a90-b925-e620292cf137 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:06.379299 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e301dd84-478d-4a90-b925-e620292cf137 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1750 microversion: 2.32 time: 1.504939 Jul 20 04:28:06.381263 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1714/3235] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:04 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1750 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:06.394325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cd9b2be1-cf82-4675-b9f0-ede51929642b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:06.403690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cd9b2be1-cf82-4675-b9f0-ede51929642b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:06.428364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd9b2be1-cf82-4675-b9f0-ede51929642b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:06.437990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd9b2be1-cf82-4675-b9f0-ede51929642b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:06.439027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd9b2be1-cf82-4675-b9f0-ede51929642b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:06.440390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd9b2be1-cf82-4675-b9f0-ede51929642b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:06.759168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-43aae3be-727b-4289-9ba2-99c25fdd3127 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:06.788537 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-43aae3be-727b-4289-9ba2-99c25fdd3127 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1489 microversion: 2.1 time: 1.505629 Jul 20 04:28:06.790231 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1522/3236] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:05 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1489 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:06.825560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5814b579-9547-4d71-ba15-ed4d3397eb01 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:06.829114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5814b579-9547-4d71-ba15-ed4d3397eb01 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:06.861847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5814b579-9547-4d71-ba15-ed4d3397eb01 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:06.869073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5814b579-9547-4d71-ba15-ed4d3397eb01 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:06.870077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5814b579-9547-4d71-ba15-ed4d3397eb01 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:06.870524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5814b579-9547-4d71-ba15-ed4d3397eb01 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:06.962416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5814b579-9547-4d71-ba15-ed4d3397eb01 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:28:07.182239 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5814b579-9547-4d71-ba15-ed4d3397eb01 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 204 len: 0 microversion: 2.1 time: 0.374651 Jul 20 04:28:07.190504 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1523/3237] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:28:06 2022] DELETE /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:28:07.204788 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9aa02c64-b324-41c3-ad1d-eb9be8c3322b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:07.205729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9aa02c64-b324-41c3-ad1d-eb9be8c3322b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:07.219350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9aa02c64-b324-41c3-ad1d-eb9be8c3322b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:07.220173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9aa02c64-b324-41c3-ad1d-eb9be8c3322b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:07.221324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9aa02c64-b324-41c3-ad1d-eb9be8c3322b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:07.221913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9aa02c64-b324-41c3-ad1d-eb9be8c3322b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:07.924894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cd9b2be1-cf82-4675-b9f0-ede51929642b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:07.938518 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cd9b2be1-cf82-4675-b9f0-ede51929642b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1317 microversion: 2.1 time: 1.555108 Jul 20 04:28:07.950903 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1715/3238] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:06 2022] GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1317 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:07.957122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-22f0cda6-105d-4e40-9e74-ff166d6f6014 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:07.957751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-22f0cda6-105d-4e40-9e74-ff166d6f6014 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:07.969337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22f0cda6-105d-4e40-9e74-ff166d6f6014 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:07.970028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22f0cda6-105d-4e40-9e74-ff166d6f6014 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:07.971014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22f0cda6-105d-4e40-9e74-ff166d6f6014 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:07.971605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22f0cda6-105d-4e40-9e74-ff166d6f6014 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:08.132510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9aa02c64-b324-41c3-ad1d-eb9be8c3322b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:08.147275 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9aa02c64-b324-41c3-ad1d-eb9be8c3322b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1495 microversion: 2.1 time: 0.953402 Jul 20 04:28:08.149464 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1524/3239] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:07 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1495 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:08.957699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6234024f-8ae0-4bfc-b33d-83ff77cf925e tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:08.958319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6234024f-8ae0-4bfc-b33d-83ff77cf925e tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:08.968194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6234024f-8ae0-4bfc-b33d-83ff77cf925e tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:08.968315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6234024f-8ae0-4bfc-b33d-83ff77cf925e tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:08.971011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6234024f-8ae0-4bfc-b33d-83ff77cf925e tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:08.971841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6234024f-8ae0-4bfc-b33d-83ff77cf925e tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:09.499283 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6234024f-8ae0-4bfc-b33d-83ff77cf925e tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:09.533106 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6234024f-8ae0-4bfc-b33d-83ff77cf925e tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1466 microversion: 2.1 time: 0.580631 Jul 20 04:28:09.534723 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1525/3240] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:08 2022] GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1466 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:09.542775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0c485e14-261c-4e7a-87f1-b68f3139558e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:09.544414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0c485e14-261c-4e7a-87f1-b68f3139558e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:09.603545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c485e14-261c-4e7a-87f1-b68f3139558e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:09.604006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c485e14-261c-4e7a-87f1-b68f3139558e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:09.604975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c485e14-261c-4e7a-87f1-b68f3139558e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:09.605429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c485e14-261c-4e7a-87f1-b68f3139558e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:09.768908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-22f0cda6-105d-4e40-9e74-ff166d6f6014 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:09.801641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-22f0cda6-105d-4e40-9e74-ff166d6f6014 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:09.803349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-22f0cda6-105d-4e40-9e74-ff166d6f6014 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:09.804729 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-22f0cda6-105d-4e40-9e74-ff166d6f6014 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1795 microversion: 2.32 time: 1.852596 Jul 20 04:28:09.805392 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1716/3241] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:07 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1795 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:09.845449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-31a6c7d5-daf0-4e43-9d71-d2c96b0f04ce tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:09.857248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-31a6c7d5-daf0-4e43-9d71-d2c96b0f04ce tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:09.881480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:09.883759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31a6c7d5-daf0-4e43-9d71-d2c96b0f04ce tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:09.884587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31a6c7d5-daf0-4e43-9d71-d2c96b0f04ce tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:09.885639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31a6c7d5-daf0-4e43-9d71-d2c96b0f04ce tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:09.894924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31a6c7d5-daf0-4e43-9d71-d2c96b0f04ce tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:10.286880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:10.396621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0c485e14-261c-4e7a-87f1-b68f3139558e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:10.447435 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0c485e14-261c-4e7a-87f1-b68f3139558e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1495 microversion: 2.1 time: 0.909268 Jul 20 04:28:10.451610 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1526/3242] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:09 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1495 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:10.829687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ac8f2d79-cf31-4d7c-9860-4ab3867e53a1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:10.834231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ac8f2d79-cf31-4d7c-9860-4ab3867e53a1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:10.859006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac8f2d79-cf31-4d7c-9860-4ab3867e53a1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:10.859006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac8f2d79-cf31-4d7c-9860-4ab3867e53a1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:10.867691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac8f2d79-cf31-4d7c-9860-4ab3867e53a1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:10.874809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac8f2d79-cf31-4d7c-9860-4ab3867e53a1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:11.144907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-31a6c7d5-daf0-4e43-9d71-d2c96b0f04ce tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:11.159504 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-31a6c7d5-daf0-4e43-9d71-d2c96b0f04ce tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b" status: 200 len: 1467 microversion: 2.1 time: 1.327619 Jul 20 04:28:11.162972 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1717/3243] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:09 2022] GET /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b => generated 1467 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:11.190677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a3f85d4a-1b48-4415-aaf3-01127374919c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-409405286"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:11.192156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a3f85d4a-1b48-4415-aaf3-01127374919c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:11.205433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a3f85d4a-1b48-4415-aaf3-01127374919c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:11.213615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a3f85d4a-1b48-4415-aaf3-01127374919c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:11.215064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a3f85d4a-1b48-4415-aaf3-01127374919c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:11.216357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a3f85d4a-1b48-4415-aaf3-01127374919c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:11.763461 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a3f85d4a-1b48-4415-aaf3-01127374919c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "POST /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b/action" status: 202 len: 0 microversion: 2.1 time: 0.576845 Jul 20 04:28:11.766464 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1718/3244] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:28:11 2022] POST /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 20 04:28:11.775654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2d03c8c6-5930-4549-868c-250a1a925cbd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:11.776746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2d03c8c6-5930-4549-868c-250a1a925cbd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:11.784945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d03c8c6-5930-4549-868c-250a1a925cbd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:11.785820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d03c8c6-5930-4549-868c-250a1a925cbd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:11.786767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d03c8c6-5930-4549-868c-250a1a925cbd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:11.787358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d03c8c6-5930-4549-868c-250a1a925cbd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:12.464182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ac8f2d79-cf31-4d7c-9860-4ab3867e53a1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:12.485582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ac8f2d79-cf31-4d7c-9860-4ab3867e53a1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:12.489378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ac8f2d79-cf31-4d7c-9860-4ab3867e53a1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:12.492011 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ac8f2d79-cf31-4d7c-9860-4ab3867e53a1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1840 microversion: 2.32 time: 1.670719 Jul 20 04:28:12.500029 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1527/3245] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:10 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1840 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:12.519140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a77fe76c-d682-4c2f-a214-275480632548 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdddd280>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:12.587560 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a77fe76c-d682-4c2f-a214-275480632548 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.085723 Jul 20 04:28:12.589611 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1528/3246] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:12 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:12.602112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-375ed0ed-1968-42bb-a2cd-5e1d11172c49 req-d4a7a458-73ca-492a-a960-9e51181fcbfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ced3e0e-76cd-4980-8996-eac7e9cb559b", "name": "network-vif-unplugged", "status": "completed", "tag": "7cc32bb9-4220-4014-bf36-15752c5231cd"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:12.618130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-375ed0ed-1968-42bb-a2cd-5e1d11172c49 req-d4a7a458-73ca-492a-a960-9e51181fcbfe service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:12.629464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-375ed0ed-1968-42bb-a2cd-5e1d11172c49 req-d4a7a458-73ca-492a-a960-9e51181fcbfe service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:12.644856 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-375ed0ed-1968-42bb-a2cd-5e1d11172c49 req-d4a7a458-73ca-492a-a960-9e51181fcbfe service nova] Creating event network-vif-unplugged:7cc32bb9-4220-4014-bf36-15752c5231cd for instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b on n-h1-826526-5 Jul 20 04:28:12.654274 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-375ed0ed-1968-42bb-a2cd-5e1d11172c49 req-d4a7a458-73ca-492a-a960-9e51181fcbfe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060409 Jul 20 04:28:12.655312 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1529/3247] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:13.015194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2d03c8c6-5930-4549-868c-250a1a925cbd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:13.046011 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2d03c8c6-5930-4549-868c-250a1a925cbd tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1495 microversion: 2.1 time: 1.271692 Jul 20 04:28:13.051868 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1719/3248] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:11 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1495 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:13.177135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-9c2932f2-ef69-4ac4-88da-1f368e10fc24 req-ab6abc91-8ccb-495e-a453-8b7f63315df9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "tag": "76dffb6b-943c-49a9-abbd-14d1036220db"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:13.195632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:13.224159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-9c2932f2-ef69-4ac4-88da-1f368e10fc24 req-ab6abc91-8ccb-495e-a453-8b7f63315df9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:13.226197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-9c2932f2-ef69-4ac4-88da-1f368e10fc24 req-ab6abc91-8ccb-495e-a453-8b7f63315df9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:13.322098 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-9c2932f2-ef69-4ac4-88da-1f368e10fc24 req-ab6abc91-8ccb-495e-a453-8b7f63315df9 service nova] Creating event network-changed:76dffb6b-943c-49a9-abbd-14d1036220db for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:28:13.363335 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-9c2932f2-ef69-4ac4-88da-1f368e10fc24 req-ab6abc91-8ccb-495e-a453-8b7f63315df9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190307 Jul 20 04:28:13.377385 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1530/3249] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:13.522824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-430604f4-c830-41e3-8d29-cc6cb11bb229 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:13.524130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-430604f4-c830-41e3-8d29-cc6cb11bb229 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:13.559510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-430604f4-c830-41e3-8d29-cc6cb11bb229 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:13.560189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-430604f4-c830-41e3-8d29-cc6cb11bb229 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:13.569030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-430604f4-c830-41e3-8d29-cc6cb11bb229 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:13.569720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-430604f4-c830-41e3-8d29-cc6cb11bb229 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:13.610521 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f6ad9387-bc40-4a99-ab31-2ef5437fcfcc tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be1bc550>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:13.728799 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f6ad9387-bc40-4a99-ab31-2ef5437fcfcc tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.124018 Jul 20 04:28:13.732678 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1531/3250] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:13 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:14.069770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4b42081b-5d2d-4689-91ef-45d0135e63e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:14.070966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4b42081b-5d2d-4689-91ef-45d0135e63e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:14.102178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b42081b-5d2d-4689-91ef-45d0135e63e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:14.104001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b42081b-5d2d-4689-91ef-45d0135e63e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:14.106338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b42081b-5d2d-4689-91ef-45d0135e63e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:14.107903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b42081b-5d2d-4689-91ef-45d0135e63e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:14.340952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4b42081b-5d2d-4689-91ef-45d0135e63e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:14.352549 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4b42081b-5d2d-4689-91ef-45d0135e63e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 200 len: 1453 microversion: 2.1 time: 0.288827 Jul 20 04:28:14.362495 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1532/3251] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:14 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 1453 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:14.772849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c57a6847-8dbc-4e56-909b-1390c02a9576 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be2ba9d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:14.903698 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c57a6847-8dbc-4e56-909b-1390c02a9576 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.159939 Jul 20 04:28:14.933489 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1533/3252] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:14 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:15.059362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b146b3a9-7439-4281-b48e-105c243807b1 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "a49536cd-309b-4810-949f-f1a33e7fdf89"}], "security_groups": [{"name": "tempest-securitygroup--775846072"}], "key_name": "tempest-keypair-128568005", "user_data": "}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:15.389527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-b146b3a9-7439-4281-b48e-105c243807b1 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] validate_networks() for [('a49536cd-309b-4810-949f-f1a33e7fdf89', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:28:16.860720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-430604f4-c830-41e3-8d29-cc6cb11bb229 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:16.953622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-430604f4-c830-41e3-8d29-cc6cb11bb229 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:16.974643 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-430604f4-c830-41e3-8d29-cc6cb11bb229 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:16.976755 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-430604f4-c830-41e3-8d29-cc6cb11bb229 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1840 microversion: 2.32 time: 3.461485 Jul 20 04:28:16.992850 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1720/3253] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:13 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1840 bytes in 3479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:17.044664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f0053773-676f-42f4-a82c-6ff7b9e5cd85 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:17.045918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f0053773-676f-42f4-a82c-6ff7b9e5cd85 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:17.076423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0053773-676f-42f4-a82c-6ff7b9e5cd85 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:17.077041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0053773-676f-42f4-a82c-6ff7b9e5cd85 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:17.094015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0053773-676f-42f4-a82c-6ff7b9e5cd85 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:17.094503 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0053773-676f-42f4-a82c-6ff7b9e5cd85 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:17.180204 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-f0053773-676f-42f4-a82c-6ff7b9e5cd85 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b could not be found. Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f0053773-676f-42f4-a82c-6ff7b9e5cd85 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b HTTP/1.1 Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b could not be found. Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '5ced3e0e-76cd-4980-8996-eac7e9cb559b'} Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b could not be found. Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b could not be found. Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:17.210227 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:28:17.215045 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:17.215045 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:17.215045 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:17.215045 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:28:17.215045 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:28:17.215045 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b could not be found. Jul 20 04:28:17.215045 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:28:17.215045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f0053773-676f-42f4-a82c-6ff7b9e5cd85 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:28:17.215045 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f0053773-676f-42f4-a82c-6ff7b9e5cd85 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 404 len: 111 microversion: 2.1 time: 0.213760 Jul 20 04:28:17.216634 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1721/3254] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:16 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 111 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:28:17.247177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-8b0d99e0-fab6-4a0e-bdfb-d673b04ac311 req-22210477-6786-464a-bc61-3891bc8aa109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "tag": "79dd747c-56b7-4275-b234-425b37c3aaf3"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:17.278142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8b0d99e0-fab6-4a0e-bdfb-d673b04ac311 req-22210477-6786-464a-bc61-3891bc8aa109 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:17.278629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8b0d99e0-fab6-4a0e-bdfb-d673b04ac311 req-22210477-6786-464a-bc61-3891bc8aa109 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:17.327394 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-8b0d99e0-fab6-4a0e-bdfb-d673b04ac311 req-22210477-6786-464a-bc61-3891bc8aa109 service nova] Creating event network-changed:79dd747c-56b7-4275-b234-425b37c3aaf3 for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:28:17.343175 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-8b0d99e0-fab6-4a0e-bdfb-d673b04ac311 req-22210477-6786-464a-bc61-3891bc8aa109 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124656 Jul 20 04:28:17.343849 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1722/3255] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:17.366895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-36d248e4-dd03-4ff9-964f-5443ef21ecef tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdf758b0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:17.549570 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-36d248e4-dd03-4ff9-964f-5443ef21ecef tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.196919 Jul 20 04:28:17.551180 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1723/3256] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:17 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:17.655494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-6d9bb982-8998-43f9-84cb-f6ed814565fd req-6ac30b7b-5705-46dc-9a42-096d442dd49e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ced3e0e-76cd-4980-8996-eac7e9cb559b", "name": "network-vif-deleted", "tag": "7cc32bb9-4220-4014-bf36-15752c5231cd"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:17.729032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-6d9bb982-8998-43f9-84cb-f6ed814565fd req-6ac30b7b-5705-46dc-9a42-096d442dd49e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:17.730552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-6d9bb982-8998-43f9-84cb-f6ed814565fd req-6ac30b7b-5705-46dc-9a42-096d442dd49e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:17.820153 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-6d9bb982-8998-43f9-84cb-f6ed814565fd req-6ac30b7b-5705-46dc-9a42-096d442dd49e service nova] Creating event network-vif-deleted:7cc32bb9-4220-4014-bf36-15752c5231cd for instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b on n-h1-826526-5 Jul 20 04:28:17.837306 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-6d9bb982-8998-43f9-84cb-f6ed814565fd req-6ac30b7b-5705-46dc-9a42-096d442dd49e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.257256 Jul 20 04:28:17.841249 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1724/3257] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:17.924969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ea749904-d204-44de-ab85-dffbb16fe6b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-834891762", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "c3db3bfb-11a7-406a-b082-1e92336f5a21"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:18.197569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-ea749904-d204-44de-ab85-dffbb16fe6b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] validate_networks() for [('c3db3bfb-11a7-406a-b082-1e92336f5a21', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:28:18.304946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b146b3a9-7439-4281-b48e-105c243807b1 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:28:18.306627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b146b3a9-7439-4281-b48e-105c243807b1 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:28:18.309361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b146b3a9-7439-4281-b48e-105c243807b1 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:28:18.318993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b146b3a9-7439-4281-b48e-105c243807b1 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:28:18.322014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b146b3a9-7439-4281-b48e-105c243807b1 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:28:18.453632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b146b3a9-7439-4281-b48e-105c243807b1 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:18.454575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b146b3a9-7439-4281-b48e-105c243807b1 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:18.456171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b146b3a9-7439-4281-b48e-105c243807b1 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:18.456999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b146b3a9-7439-4281-b48e-105c243807b1 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:18.559982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-b146b3a9-7439-4281-b48e-105c243807b1 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Getting quotas for project 0fd9c3c8c865481cadc7099860706164. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:28:18.570834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-b146b3a9-7439-4281-b48e-105c243807b1 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Getting quotas for user 9b9bde7d1dd74c0da55025a63131897e and project 0fd9c3c8c865481cadc7099860706164. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:28:18.588093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b146b3a9-7439-4281-b48e-105c243807b1 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:28:18.591702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b146b3a9-7439-4281-b48e-105c243807b1 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:28:18.721766 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b146b3a9-7439-4281-b48e-105c243807b1 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.677030 Jul 20 04:28:18.724122 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1534/3258] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:28:15 2022] POST /compute/v2.1/servers => generated 408 bytes in 3682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:28:18.753246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-32c24a32-4569-4b9f-ba8a-3c7ba5973a70 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:18.754050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-32c24a32-4569-4b9f-ba8a-3c7ba5973a70 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:18.791604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32c24a32-4569-4b9f-ba8a-3c7ba5973a70 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:18.792066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32c24a32-4569-4b9f-ba8a-3c7ba5973a70 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:18.792938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32c24a32-4569-4b9f-ba8a-3c7ba5973a70 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:18.793391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32c24a32-4569-4b9f-ba8a-3c7ba5973a70 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:20.519145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ea749904-d204-44de-ab85-dffbb16fe6b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:28:20.519915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ea749904-d204-44de-ab85-dffbb16fe6b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:28:20.520877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ea749904-d204-44de-ab85-dffbb16fe6b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:28:20.521638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ea749904-d204-44de-ab85-dffbb16fe6b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:28:20.522411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ea749904-d204-44de-ab85-dffbb16fe6b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:28:20.566465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea749904-d204-44de-ab85-dffbb16fe6b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:20.568874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea749904-d204-44de-ab85-dffbb16fe6b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:20.569938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea749904-d204-44de-ab85-dffbb16fe6b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:20.572631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea749904-d204-44de-ab85-dffbb16fe6b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:20.653583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-ea749904-d204-44de-ab85-dffbb16fe6b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Getting quotas for project ae67de1fefe64bd19a3bf614f02d3535. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:28:20.677387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-ea749904-d204-44de-ab85-dffbb16fe6b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Getting quotas for user 1dc60058bea0485ebd4d502b2e7c986b and project ae67de1fefe64bd19a3bf614f02d3535. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:28:20.720384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ea749904-d204-44de-ab85-dffbb16fe6b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:28:20.726936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ea749904-d204-44de-ab85-dffbb16fe6b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:28:21.054275 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ea749904-d204-44de-ab85-dffbb16fe6b4 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.138183 Jul 20 04:28:21.065144 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1725/3259] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:28:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:28:21.097442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9a106fdc-4d36-42a5-80f5-ed8f94f6044b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bd3ee160>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:21.143786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-32c24a32-4569-4b9f-ba8a-3c7ba5973a70 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:21.210594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-32c24a32-4569-4b9f-ba8a-3c7ba5973a70 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:21.228059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-32c24a32-4569-4b9f-ba8a-3c7ba5973a70 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:21.246463 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-32c24a32-4569-4b9f-ba8a-3c7ba5973a70 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1849 microversion: 2.32 time: 2.510132 Jul 20 04:28:21.257315 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1535/3260] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:18 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1849 bytes in 2532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:21.292722 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9a106fdc-4d36-42a5-80f5-ed8f94f6044b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.222696 Jul 20 04:28:21.299448 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1726/3261] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:21 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:21.304581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-897fc900-7e49-401d-a537-1bfcdce0aa90 req-48faee76-66d7-4bed-9b44-774b4a8b8350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b", "name": "network-vif-plugged", "status": "completed", "tag": "f5248619-09e7-4707-9127-fb95dc122bcf"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:21.307951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-87113821-1e35-428b-b596-a96ee70f6736 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:21.316502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-87113821-1e35-428b-b596-a96ee70f6736 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:21.326447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-897fc900-7e49-401d-a537-1bfcdce0aa90 req-48faee76-66d7-4bed-9b44-774b4a8b8350 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.326905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-897fc900-7e49-401d-a537-1bfcdce0aa90 req-48faee76-66d7-4bed-9b44-774b4a8b8350 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:21.364645 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-897fc900-7e49-401d-a537-1bfcdce0aa90 req-48faee76-66d7-4bed-9b44-774b4a8b8350 service nova] Creating event network-vif-plugged:f5248619-09e7-4707-9127-fb95dc122bcf for instance a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b on n-h2-826526-5 Jul 20 04:28:21.371598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87113821-1e35-428b-b596-a96ee70f6736 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.373338 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-897fc900-7e49-401d-a537-1bfcdce0aa90 req-48faee76-66d7-4bed-9b44-774b4a8b8350 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072484 Jul 20 04:28:21.377025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87113821-1e35-428b-b596-a96ee70f6736 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:21.384700 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1727/3262] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:21.390675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-92de4d41-c78e-4064-959b-3458af59ec26 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:21.391048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87113821-1e35-428b-b596-a96ee70f6736 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.391494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-92de4d41-c78e-4064-959b-3458af59ec26 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:21.395999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87113821-1e35-428b-b596-a96ee70f6736 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:21.988102 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-87113821-1e35-428b-b596-a96ee70f6736 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bde7d1dd74c0da55025a63131897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd9c3c8c865481cadc7099860706164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:22.042096 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-87113821-1e35-428b-b596-a96ee70f6736 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16" status: 200 len: 1285 microversion: 2.1 time: 0.780120 Jul 20 04:28:22.045993 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1536/3263] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:21 2022] GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 => generated 1285 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:22.292529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e9d54e9b-c9b9-4b2f-bd91-e56999f76177 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:22.297582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e9d54e9b-c9b9-4b2f-bd91-e56999f76177 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:22.336111 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9d54e9b-c9b9-4b2f-bd91-e56999f76177 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:22.337317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9d54e9b-c9b9-4b2f-bd91-e56999f76177 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.338962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9d54e9b-c9b9-4b2f-bd91-e56999f76177 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:22.342493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9d54e9b-c9b9-4b2f-bd91-e56999f76177 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.567411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-92de4d41-c78e-4064-959b-3458af59ec26 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:22.575639 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-92de4d41-c78e-4064-959b-3458af59ec26 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1214 microversion: 2.1 time: 1.189440 Jul 20 04:28:22.581539 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1728/3264] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:21 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1214 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:22.600460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-91f53901-d8a3-452c-9756-01b2b00e6407 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be09a0d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:22.742465 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-91f53901-d8a3-452c-9756-01b2b00e6407 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.159058 Jul 20 04:28:22.744609 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1729/3265] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:22 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:22.777339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-d3bec6ec-362f-4f6d-b658-d23e43918a34 req-7f268e7c-08c3-4812-80e2-9e104fef7286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "tag": "d88e9d40-f883-487c-b169-78e7f289e235"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:22.866116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d3bec6ec-362f-4f6d-b658-d23e43918a34 req-7f268e7c-08c3-4812-80e2-9e104fef7286 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:22.869960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d3bec6ec-362f-4f6d-b658-d23e43918a34 req-7f268e7c-08c3-4812-80e2-9e104fef7286 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.923621 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-d3bec6ec-362f-4f6d-b658-d23e43918a34 req-7f268e7c-08c3-4812-80e2-9e104fef7286 service nova] Creating event network-changed:d88e9d40-f883-487c-b169-78e7f289e235 for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:28:22.959215 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-d3bec6ec-362f-4f6d-b658-d23e43918a34 req-7f268e7c-08c3-4812-80e2-9e104fef7286 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200046 Jul 20 04:28:22.960596 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1730/3266] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:23.079514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2fa6b654-1320-4257-964e-6eb1290804f5 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:23.084133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2fa6b654-1320-4257-964e-6eb1290804f5 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:23.105893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2fa6b654-1320-4257-964e-6eb1290804f5 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:23.106869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2fa6b654-1320-4257-964e-6eb1290804f5 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:23.108514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2fa6b654-1320-4257-964e-6eb1290804f5 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:23.109318 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2fa6b654-1320-4257-964e-6eb1290804f5 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:23.583865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2fa6b654-1320-4257-964e-6eb1290804f5 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bde7d1dd74c0da55025a63131897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd9c3c8c865481cadc7099860706164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:23.594418 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2fa6b654-1320-4257-964e-6eb1290804f5 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16" status: 200 len: 1283 microversion: 2.1 time: 0.521260 Jul 20 04:28:23.595034 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1731/3267] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:23 2022] GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 => generated 1283 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:23.613390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-924dde2e-9c71-40b5-824d-9ff38353921c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:23.613954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-924dde2e-9c71-40b5-824d-9ff38353921c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:23.655381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-924dde2e-9c71-40b5-824d-9ff38353921c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:23.655838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-924dde2e-9c71-40b5-824d-9ff38353921c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:23.670372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-924dde2e-9c71-40b5-824d-9ff38353921c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:23.677115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-924dde2e-9c71-40b5-824d-9ff38353921c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:23.913126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-924dde2e-9c71-40b5-824d-9ff38353921c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:23.922600 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-924dde2e-9c71-40b5-824d-9ff38353921c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1266 microversion: 2.1 time: 0.316892 Jul 20 04:28:23.930245 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1732/3268] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:23 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1266 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:23.944633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-941e897d-cf9a-4ffe-bcd8-25e212d0e6d7 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be0f33a0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:24.046339 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-941e897d-cf9a-4ffe-bcd8-25e212d0e6d7 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.114789 Jul 20 04:28:24.047229 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1733/3269] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:23 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:24.632601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0e8defca-c10a-482f-95ba-ab1fa3010156 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:24.633600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0e8defca-c10a-482f-95ba-ab1fa3010156 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:24.658650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0e8defca-c10a-482f-95ba-ab1fa3010156 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:24.666468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0e8defca-c10a-482f-95ba-ab1fa3010156 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:24.668111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0e8defca-c10a-482f-95ba-ab1fa3010156 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:24.671707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0e8defca-c10a-482f-95ba-ab1fa3010156 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:24.768408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:24.801994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e9d54e9b-c9b9-4b2f-bd91-e56999f76177 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:24.831037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e9d54e9b-c9b9-4b2f-bd91-e56999f76177 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:24.838250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e9d54e9b-c9b9-4b2f-bd91-e56999f76177 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:24.840653 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e9d54e9b-c9b9-4b2f-bd91-e56999f76177 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 2.557539 Jul 20 04:28:24.856349 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1537/3270] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:22 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 2575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:28:24.964255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1337675c-1844-40fe-9d81-fa007653af95 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:24.965252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1337675c-1844-40fe-9d81-fa007653af95 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:25.008888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1337675c-1844-40fe-9d81-fa007653af95 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.016721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1337675c-1844-40fe-9d81-fa007653af95 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:25.023213 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1337675c-1844-40fe-9d81-fa007653af95 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.025337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1337675c-1844-40fe-9d81-fa007653af95 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:25.166633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0e8defca-c10a-482f-95ba-ab1fa3010156 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bde7d1dd74c0da55025a63131897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd9c3c8c865481cadc7099860706164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:25.180211 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0e8defca-c10a-482f-95ba-ab1fa3010156 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16" status: 200 len: 1283 microversion: 2.1 time: 0.557806 Jul 20 04:28:25.181178 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1734/3271] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:24 2022] GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 => generated 1283 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:25.186032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cba86cec-9725-4377-9c57-14f8aa8d6725 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be07f9d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:25.371843 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cba86cec-9725-4377-9c57-14f8aa8d6725 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.189539 Jul 20 04:28:25.372795 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1735/3272] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:25 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:25.880814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-72337f67-569e-4229-82a8-b5d390480093 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:25.899575 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-72337f67-569e-4229-82a8-b5d390480093 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:25.932472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72337f67-569e-4229-82a8-b5d390480093 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.933683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72337f67-569e-4229-82a8-b5d390480093 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:25.941836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72337f67-569e-4229-82a8-b5d390480093 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.942894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72337f67-569e-4229-82a8-b5d390480093 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:26.305045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1337675c-1844-40fe-9d81-fa007653af95 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:26.325699 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1337675c-1844-40fe-9d81-fa007653af95 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1272 microversion: 2.1 time: 1.366086 Jul 20 04:28:26.341512 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1538/3273] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:24 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1272 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:26.354741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-892901b7-457d-4d93-8779-ac3ce2cebe88 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:26.367414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-892901b7-457d-4d93-8779-ac3ce2cebe88 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:26.426441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-892901b7-457d-4d93-8779-ac3ce2cebe88 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:26.432601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-892901b7-457d-4d93-8779-ac3ce2cebe88 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:26.439325 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-892901b7-457d-4d93-8779-ac3ce2cebe88 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:26.442282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-892901b7-457d-4d93-8779-ac3ce2cebe88 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:26.518785 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:26.627704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-72337f67-569e-4229-82a8-b5d390480093 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:26.646576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-72337f67-569e-4229-82a8-b5d390480093 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:26.656048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-72337f67-569e-4229-82a8-b5d390480093 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:26.663816 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-72337f67-569e-4229-82a8-b5d390480093 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 0.791738 Jul 20 04:28:26.673644 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1736/3274] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:25 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:28:26.678712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9690789f-a1fa-4577-adfa-4803cdee65de tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be07f9d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:26.788216 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9690789f-a1fa-4577-adfa-4803cdee65de tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.113211 Jul 20 04:28:26.789539 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1737/3275] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:26 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:27.357543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e86df1b8-6872-470b-94eb-2b5ddcbc1839 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:27.364056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e86df1b8-6872-470b-94eb-2b5ddcbc1839 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:27.412521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e86df1b8-6872-470b-94eb-2b5ddcbc1839 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.422634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e86df1b8-6872-470b-94eb-2b5ddcbc1839 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:27.426421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e86df1b8-6872-470b-94eb-2b5ddcbc1839 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.434580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e86df1b8-6872-470b-94eb-2b5ddcbc1839 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:27.492141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-892901b7-457d-4d93-8779-ac3ce2cebe88 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bde7d1dd74c0da55025a63131897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd9c3c8c865481cadc7099860706164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:27.524625 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-892901b7-457d-4d93-8779-ac3ce2cebe88 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16" status: 200 len: 1283 microversion: 2.1 time: 1.180378 Jul 20 04:28:27.525942 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1539/3276] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:26 2022] GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 => generated 1283 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:27.706258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ceb195ca-4acf-4e4d-b6b9-32bbd0b8bc0f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:27.708647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ceb195ca-4acf-4e4d-b6b9-32bbd0b8bc0f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:27.739241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ceb195ca-4acf-4e4d-b6b9-32bbd0b8bc0f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.743500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ceb195ca-4acf-4e4d-b6b9-32bbd0b8bc0f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:27.750775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ceb195ca-4acf-4e4d-b6b9-32bbd0b8bc0f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.760557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ceb195ca-4acf-4e4d-b6b9-32bbd0b8bc0f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:28.496032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:28.581181 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:30.602829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:31.119175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e86df1b8-6872-470b-94eb-2b5ddcbc1839 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:31.175239 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e86df1b8-6872-470b-94eb-2b5ddcbc1839 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1314 microversion: 2.1 time: 3.814836 Jul 20 04:28:31.185117 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1738/3277] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:27 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1314 bytes in 3839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:31.254163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-78eeeb87-bbea-4bc3-bd8c-b7031187853f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdf393a0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:31.458361 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-78eeeb87-bbea-4bc3-bd8c-b7031187853f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.262697 Jul 20 04:28:31.461851 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1739/3278] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:31 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:31.474382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d3b361f0-4712-4e10-b0ed-8217cbff178d tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:31.478524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d3b361f0-4712-4e10-b0ed-8217cbff178d tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:31.502805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3b361f0-4712-4e10-b0ed-8217cbff178d tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:31.503520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3b361f0-4712-4e10-b0ed-8217cbff178d tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:31.504929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3b361f0-4712-4e10-b0ed-8217cbff178d tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:31.509460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3b361f0-4712-4e10-b0ed-8217cbff178d tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:31.971171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ceb195ca-4acf-4e4d-b6b9-32bbd0b8bc0f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:32.001476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ceb195ca-4acf-4e4d-b6b9-32bbd0b8bc0f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:32.009162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ceb195ca-4acf-4e4d-b6b9-32bbd0b8bc0f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:32.018635 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ceb195ca-4acf-4e4d-b6b9-32bbd0b8bc0f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 4.312275 Jul 20 04:28:32.031467 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1540/3279] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:27 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 4330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:32.049878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-64aba8db-b08f-4ed9-aae8-cc2bd41362a3 req-878de576-a9e2-4e99-ac55-4a33d1de162f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "tag": "5181d6ac-4b81-40aa-b0f8-6206c7cc13b0"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:32.082719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-64aba8db-b08f-4ed9-aae8-cc2bd41362a3 req-878de576-a9e2-4e99-ac55-4a33d1de162f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:32.083853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-64aba8db-b08f-4ed9-aae8-cc2bd41362a3 req-878de576-a9e2-4e99-ac55-4a33d1de162f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:32.123083 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-64aba8db-b08f-4ed9-aae8-cc2bd41362a3 req-878de576-a9e2-4e99-ac55-4a33d1de162f service nova] Creating event network-changed:5181d6ac-4b81-40aa-b0f8-6206c7cc13b0 for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:28:32.146377 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-64aba8db-b08f-4ed9-aae8-cc2bd41362a3 req-878de576-a9e2-4e99-ac55-4a33d1de162f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113039 Jul 20 04:28:32.150218 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1541/3280] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:32.202812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6770b5af-c2ce-43ed-b81f-afca9388bebe tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:32.203568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6770b5af-c2ce-43ed-b81f-afca9388bebe tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:32.228044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6770b5af-c2ce-43ed-b81f-afca9388bebe tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:32.231045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6770b5af-c2ce-43ed-b81f-afca9388bebe tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:32.233752 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6770b5af-c2ce-43ed-b81f-afca9388bebe tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:32.234466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6770b5af-c2ce-43ed-b81f-afca9388bebe tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:32.575140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=8 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:32.814462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d3b361f0-4712-4e10-b0ed-8217cbff178d tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bde7d1dd74c0da55025a63131897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd9c3c8c865481cadc7099860706164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:32.827883 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d3b361f0-4712-4e10-b0ed-8217cbff178d tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16" status: 200 len: 1350 microversion: 2.1 time: 1.364244 Jul 20 04:28:32.838967 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1740/3281] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:31 2022] GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 => generated 1350 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:32.885885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4a56ee49-83ed-424a-bb3c-135462943bbf tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdf758b0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:33.059045 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4a56ee49-83ed-424a-bb3c-135462943bbf tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.211942 Jul 20 04:28:33.073721 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1741/3282] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:32 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:33.120767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b562623-12c9-48d8-a98f-8026c773f975 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:33.130321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9b562623-12c9-48d8-a98f-8026c773f975 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:33.167507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b562623-12c9-48d8-a98f-8026c773f975 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:33.181371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b562623-12c9-48d8-a98f-8026c773f975 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:33.190287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b562623-12c9-48d8-a98f-8026c773f975 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:33.193624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b562623-12c9-48d8-a98f-8026c773f975 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:34.055560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6770b5af-c2ce-43ed-b81f-afca9388bebe tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:34.068728 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6770b5af-c2ce-43ed-b81f-afca9388bebe tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1314 microversion: 2.1 time: 1.870105 Jul 20 04:28:34.084385 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1542/3283] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:32 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1314 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:34.089650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9d3859de-03bd-4009-8652-a6b9699a8fc7 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:34.105165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9d3859de-03bd-4009-8652-a6b9699a8fc7 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:34.149335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d3859de-03bd-4009-8652-a6b9699a8fc7 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:34.150482 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d3859de-03bd-4009-8652-a6b9699a8fc7 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:34.156174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d3859de-03bd-4009-8652-a6b9699a8fc7 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:34.156885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d3859de-03bd-4009-8652-a6b9699a8fc7 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:35.045703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9b562623-12c9-48d8-a98f-8026c773f975 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:35.072138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9b562623-12c9-48d8-a98f-8026c773f975 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:35.088671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9b562623-12c9-48d8-a98f-8026c773f975 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:35.092401 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9b562623-12c9-48d8-a98f-8026c773f975 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 2.010299 Jul 20 04:28:35.093050 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1742/3284] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:33 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 2019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:35.110352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5c08ec9b-6849-423f-98ff-224c48ff2032 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be0b1d30>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:35.247411 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5c08ec9b-6849-423f-98ff-224c48ff2032 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.135074 Jul 20 04:28:35.248138 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1743/3285] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:35 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:35.279326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-30b690a3-9f52-4f81-9a19-f09dbd63b02e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:35.280545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-30b690a3-9f52-4f81-9a19-f09dbd63b02e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:35.328554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30b690a3-9f52-4f81-9a19-f09dbd63b02e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:35.335683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30b690a3-9f52-4f81-9a19-f09dbd63b02e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:35.343549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30b690a3-9f52-4f81-9a19-f09dbd63b02e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:35.344342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30b690a3-9f52-4f81-9a19-f09dbd63b02e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:35.423029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9d3859de-03bd-4009-8652-a6b9699a8fc7 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bde7d1dd74c0da55025a63131897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd9c3c8c865481cadc7099860706164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:35.439724 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9d3859de-03bd-4009-8652-a6b9699a8fc7 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16" status: 200 len: 1350 microversion: 2.1 time: 1.353842 Jul 20 04:28:35.449543 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1543/3286] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:34 2022] GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 => generated 1350 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:36.119071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4226ee22-e2b9-492a-9fff-f9b45aae4991 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:36.120091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4226ee22-e2b9-492a-9fff-f9b45aae4991 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:36.147305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-30b690a3-9f52-4f81-9a19-f09dbd63b02e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:36.150439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4226ee22-e2b9-492a-9fff-f9b45aae4991 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:36.153996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4226ee22-e2b9-492a-9fff-f9b45aae4991 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:36.158561 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4226ee22-e2b9-492a-9fff-f9b45aae4991 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:36.163865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4226ee22-e2b9-492a-9fff-f9b45aae4991 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:36.173811 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-30b690a3-9f52-4f81-9a19-f09dbd63b02e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1314 microversion: 2.1 time: 0.921228 Jul 20 04:28:36.175022 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1744/3287] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:35 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1314 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:36.261029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2809774b-7eda-4d58-8ad7-6c400b23d4f6 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdf39430>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:36.334587 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2809774b-7eda-4d58-8ad7-6c400b23d4f6 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.077358 Jul 20 04:28:36.335758 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1745/3288] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:36 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:36.481205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f015d77a-55dd-4d05-930d-97edf5f5a369 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:36.482159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f015d77a-55dd-4d05-930d-97edf5f5a369 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:36.494378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f015d77a-55dd-4d05-930d-97edf5f5a369 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:36.495988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f015d77a-55dd-4d05-930d-97edf5f5a369 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:36.497031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f015d77a-55dd-4d05-930d-97edf5f5a369 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:36.500295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f015d77a-55dd-4d05-930d-97edf5f5a369 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:38.224627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4226ee22-e2b9-492a-9fff-f9b45aae4991 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:38.244939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4226ee22-e2b9-492a-9fff-f9b45aae4991 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:38.251059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4226ee22-e2b9-492a-9fff-f9b45aae4991 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:38.255351 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4226ee22-e2b9-492a-9fff-f9b45aae4991 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 2.142702 Jul 20 04:28:38.258644 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1544/3289] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:36 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:38.272914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-51a5acd7-4332-4209-9642-c369f3a77379 req-3ec59430-06f0-4045-b980-63ab8e6a4c1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2494990e-0404-4826-99c9-cbe63a142b16", "tag": "d532bee4-df8a-472a-9525-e2595f7f5a06"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:38.294154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-51a5acd7-4332-4209-9642-c369f3a77379 req-3ec59430-06f0-4045-b980-63ab8e6a4c1f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:38.297962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-51a5acd7-4332-4209-9642-c369f3a77379 req-3ec59430-06f0-4045-b980-63ab8e6a4c1f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:38.341240 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-51a5acd7-4332-4209-9642-c369f3a77379 req-3ec59430-06f0-4045-b980-63ab8e6a4c1f service nova] Creating event network-changed:d532bee4-df8a-472a-9525-e2595f7f5a06 for instance 2494990e-0404-4826-99c9-cbe63a142b16 on n-h1-826526-5 Jul 20 04:28:38.359958 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-51a5acd7-4332-4209-9642-c369f3a77379 req-3ec59430-06f0-4045-b980-63ab8e6a4c1f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097404 Jul 20 04:28:38.363548 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1545/3290] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:38.382989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-01199ca9-e542-4d3a-8466-f1174515ff67 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:38.393610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-01199ca9-e542-4d3a-8466-f1174515ff67 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:38.404724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f015d77a-55dd-4d05-930d-97edf5f5a369 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bde7d1dd74c0da55025a63131897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd9c3c8c865481cadc7099860706164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:38.419459 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f015d77a-55dd-4d05-930d-97edf5f5a369 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16" status: 200 len: 1350 microversion: 2.1 time: 1.946030 Jul 20 04:28:38.433298 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1746/3291] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:36 2022] GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 => generated 1350 bytes in 1960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:38.435525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01199ca9-e542-4d3a-8466-f1174515ff67 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:38.443933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01199ca9-e542-4d3a-8466-f1174515ff67 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:38.444825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01199ca9-e542-4d3a-8466-f1174515ff67 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:38.445281 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01199ca9-e542-4d3a-8466-f1174515ff67 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:38.454165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-961aaf01-83f5-4dcf-ae94-fbef97dc7b3f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdee6790>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:38.571873 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-961aaf01-83f5-4dcf-ae94-fbef97dc7b3f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.134867 Jul 20 04:28:38.574447 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1747/3292] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:38 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:38.598460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-eb319422-d8d1-415a-a15a-56d6332b6044 req-acbba171-80a9-4a58-9e82-2bb03a23815e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e14c167-ccb8-40a9-a747-7a07ea907d97", "tag": "8f916cd4-f49b-48c0-b604-e38dfb707781"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:38.643310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-eb319422-d8d1-415a-a15a-56d6332b6044 req-acbba171-80a9-4a58-9e82-2bb03a23815e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:38.659913 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-eb319422-d8d1-415a-a15a-56d6332b6044 req-acbba171-80a9-4a58-9e82-2bb03a23815e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:38.708913 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-eb319422-d8d1-415a-a15a-56d6332b6044 req-acbba171-80a9-4a58-9e82-2bb03a23815e service nova] Creating event network-changed:8f916cd4-f49b-48c0-b604-e38dfb707781 for instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 on n-h1-826526-5 Jul 20 04:28:38.718777 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-eb319422-d8d1-415a-a15a-56d6332b6044 req-acbba171-80a9-4a58-9e82-2bb03a23815e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128046 Jul 20 04:28:38.719784 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1748/3293] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:28:39.280791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bd1b9b2f-131f-496f-953d-c59bf94abd2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:39.281527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bd1b9b2f-131f-496f-953d-c59bf94abd2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:39.293466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd1b9b2f-131f-496f-953d-c59bf94abd2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:39.293922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd1b9b2f-131f-496f-953d-c59bf94abd2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:39.294720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd1b9b2f-131f-496f-953d-c59bf94abd2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:39.295164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd1b9b2f-131f-496f-953d-c59bf94abd2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:39.753856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-01199ca9-e542-4d3a-8466-f1174515ff67 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:39.771824 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-01199ca9-e542-4d3a-8466-f1174515ff67 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1314 microversion: 2.1 time: 1.401144 Jul 20 04:28:39.773122 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1546/3294] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:38 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1314 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:39.778249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4d4de5af-4521-4218-978c-e7ad967d875f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:39.788473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4d4de5af-4521-4218-978c-e7ad967d875f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:39.812825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d4de5af-4521-4218-978c-e7ad967d875f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:39.813648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d4de5af-4521-4218-978c-e7ad967d875f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:39.814883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d4de5af-4521-4218-978c-e7ad967d875f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:39.815484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d4de5af-4521-4218-978c-e7ad967d875f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:40.396850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bd1b9b2f-131f-496f-953d-c59bf94abd2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:40.407974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bd1b9b2f-131f-496f-953d-c59bf94abd2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:40.415645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bd1b9b2f-131f-496f-953d-c59bf94abd2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:40.417136 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bd1b9b2f-131f-496f-953d-c59bf94abd2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.143339 Jul 20 04:28:40.418237 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1749/3295] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:39 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:40.426176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6cad1178-20ca-4233-8a4f-c62928f50021 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bd3ee550>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:40.485451 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6cad1178-20ca-4233-8a4f-c62928f50021 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.065914 Jul 20 04:28:40.493442 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1750/3296] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:40 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:40.809069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d507bfae-4a0e-4d97-a4c5-9d329d9db368 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:40.810482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d507bfae-4a0e-4d97-a4c5-9d329d9db368 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:40.849595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:40.851626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d507bfae-4a0e-4d97-a4c5-9d329d9db368 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:40.853407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d507bfae-4a0e-4d97-a4c5-9d329d9db368 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:40.854875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d507bfae-4a0e-4d97-a4c5-9d329d9db368 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:40.855537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d507bfae-4a0e-4d97-a4c5-9d329d9db368 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:42.227619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d507bfae-4a0e-4d97-a4c5-9d329d9db368 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:42.241261 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d507bfae-4a0e-4d97-a4c5-9d329d9db368 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1314 microversion: 2.1 time: 1.453500 Jul 20 04:28:42.244450 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1751/3297] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:40 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1314 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:42.245403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4d4de5af-4521-4218-978c-e7ad967d875f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bde7d1dd74c0da55025a63131897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd9c3c8c865481cadc7099860706164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:42.258909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-a034f6ae-1fcd-4b5b-ae1b-f9d6fa2df61c req-ea6bcca2-d0a8-4fe7-945a-3a176d486393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "tag": "3d36c00c-1614-411a-9eac-9454a83272e6"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:42.276813 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4d4de5af-4521-4218-978c-e7ad967d875f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16" status: 200 len: 1350 microversion: 2.1 time: 2.496276 Jul 20 04:28:42.283751 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1547/3298] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:39 2022] GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 => generated 1350 bytes in 2509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:42.297190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-672e724b-50d6-405f-bdb6-0b6b84a90b4d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:42.304507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-672e724b-50d6-405f-bdb6-0b6b84a90b4d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:42.306222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a034f6ae-1fcd-4b5b-ae1b-f9d6fa2df61c req-ea6bcca2-d0a8-4fe7-945a-3a176d486393 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:42.307450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a034f6ae-1fcd-4b5b-ae1b-f9d6fa2df61c req-ea6bcca2-d0a8-4fe7-945a-3a176d486393 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:42.325307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-672e724b-50d6-405f-bdb6-0b6b84a90b4d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:42.330281 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-672e724b-50d6-405f-bdb6-0b6b84a90b4d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:42.331333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-672e724b-50d6-405f-bdb6-0b6b84a90b4d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:42.331933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-672e724b-50d6-405f-bdb6-0b6b84a90b4d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:42.336812 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-a034f6ae-1fcd-4b5b-ae1b-f9d6fa2df61c req-ea6bcca2-d0a8-4fe7-945a-3a176d486393 service nova] Creating event network-changed:3d36c00c-1614-411a-9eac-9454a83272e6 for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:28:42.349541 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-a034f6ae-1fcd-4b5b-ae1b-f9d6fa2df61c req-ea6bcca2-d0a8-4fe7-945a-3a176d486393 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103413 Jul 20 04:28:42.352602 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1752/3299] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:42.368981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d1ad96da-0d37-48e9-9522-e4ae71a626f8 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be301dc0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:42.450147 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d1ad96da-0d37-48e9-9522-e4ae71a626f8 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.095324 Jul 20 04:28:42.457816 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1753/3300] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:42 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:43.266496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c272ca32-847b-4861-a27b-b2cda8083af7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:43.267433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c272ca32-847b-4861-a27b-b2cda8083af7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:43.278747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c272ca32-847b-4861-a27b-b2cda8083af7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:43.290950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c272ca32-847b-4861-a27b-b2cda8083af7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:43.298841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c272ca32-847b-4861-a27b-b2cda8083af7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:43.299993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c272ca32-847b-4861-a27b-b2cda8083af7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:43.480377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-672e724b-50d6-405f-bdb6-0b6b84a90b4d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:43.523751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-672e724b-50d6-405f-bdb6-0b6b84a90b4d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:43.530804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-672e724b-50d6-405f-bdb6-0b6b84a90b4d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:43.542196 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-672e724b-50d6-405f-bdb6-0b6b84a90b4d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.256084 Jul 20 04:28:43.546297 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1548/3301] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:42 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:43.577326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c84e1a7c-f0c2-4c47-a3f0-067bcabd602f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:43.579002 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c84e1a7c-f0c2-4c47-a3f0-067bcabd602f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:43.604030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c84e1a7c-f0c2-4c47-a3f0-067bcabd602f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:43.605776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c84e1a7c-f0c2-4c47-a3f0-067bcabd602f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:43.607492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c84e1a7c-f0c2-4c47-a3f0-067bcabd602f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:43.621408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c84e1a7c-f0c2-4c47-a3f0-067bcabd602f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:44.706327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c84e1a7c-f0c2-4c47-a3f0-067bcabd602f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bde7d1dd74c0da55025a63131897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd9c3c8c865481cadc7099860706164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:44.728975 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c84e1a7c-f0c2-4c47-a3f0-067bcabd602f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16" status: 200 len: 1350 microversion: 2.1 time: 1.181152 Jul 20 04:28:44.741762 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1549/3302] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:43 2022] GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 => generated 1350 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:44.760048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3edcac01-afff-49ed-89cd-632c0c7f469f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06c4162430>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:44.894676 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3edcac01-afff-49ed-89cd-632c0c7f469f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.151649 Jul 20 04:28:44.895430 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1550/3303] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:44 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:44.916027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2341e691-bd82-4a46-9fca-671dc3519cc4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:44.918199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2341e691-bd82-4a46-9fca-671dc3519cc4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:44.926260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:44.942750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2341e691-bd82-4a46-9fca-671dc3519cc4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:44.950287 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2341e691-bd82-4a46-9fca-671dc3519cc4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:44.951899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2341e691-bd82-4a46-9fca-671dc3519cc4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:44.956475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2341e691-bd82-4a46-9fca-671dc3519cc4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:45.130603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c272ca32-847b-4861-a27b-b2cda8083af7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:45.147092 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c272ca32-847b-4861-a27b-b2cda8083af7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1314 microversion: 2.1 time: 1.882858 Jul 20 04:28:45.148961 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1754/3304] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:43 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1314 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:45.161870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-23aecc1e-425b-4b69-8ce9-6b99d912d565 req-476abfd7-24ee-4338-a656-9d5d6600ea7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2494990e-0404-4826-99c9-cbe63a142b16", "name": "network-vif-plugged", "status": "completed", "tag": "d532bee4-df8a-472a-9525-e2595f7f5a06"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:45.200636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-23aecc1e-425b-4b69-8ce9-6b99d912d565 req-476abfd7-24ee-4338-a656-9d5d6600ea7d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:45.205761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-23aecc1e-425b-4b69-8ce9-6b99d912d565 req-476abfd7-24ee-4338-a656-9d5d6600ea7d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:45.242135 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-23aecc1e-425b-4b69-8ce9-6b99d912d565 req-476abfd7-24ee-4338-a656-9d5d6600ea7d service nova] Creating event network-vif-plugged:d532bee4-df8a-472a-9525-e2595f7f5a06 for instance 2494990e-0404-4826-99c9-cbe63a142b16 on n-h1-826526-5 Jul 20 04:28:45.248647 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-23aecc1e-425b-4b69-8ce9-6b99d912d565 req-476abfd7-24ee-4338-a656-9d5d6600ea7d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094559 Jul 20 04:28:45.252109 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1755/3305] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:45.757947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-76d9e71f-c407-4e5b-a3b9-af07df64b728 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:45.758981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-76d9e71f-c407-4e5b-a3b9-af07df64b728 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:45.779508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76d9e71f-c407-4e5b-a3b9-af07df64b728 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:45.780209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76d9e71f-c407-4e5b-a3b9-af07df64b728 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:45.781945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76d9e71f-c407-4e5b-a3b9-af07df64b728 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:45.784235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76d9e71f-c407-4e5b-a3b9-af07df64b728 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:45.907543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2341e691-bd82-4a46-9fca-671dc3519cc4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:45.950382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2341e691-bd82-4a46-9fca-671dc3519cc4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:45.954350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2341e691-bd82-4a46-9fca-671dc3519cc4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:45.966361 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2341e691-bd82-4a46-9fca-671dc3519cc4 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.065584 Jul 20 04:28:45.985212 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1551/3306] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:44 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:46.015033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fc3ac3ef-7501-47b6-b86c-c6c18b5ce262 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be0c8c10>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:46.181544 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fc3ac3ef-7501-47b6-b86c-c6c18b5ce262 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.194742 Jul 20 04:28:46.190939 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1552/3307] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:45 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:46.196690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3925d3f9-a5c4-45df-a067-626ee87c6824 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:46.202852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3925d3f9-a5c4-45df-a067-626ee87c6824 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:46.219883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3925d3f9-a5c4-45df-a067-626ee87c6824 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:46.225505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3925d3f9-a5c4-45df-a067-626ee87c6824 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:46.236059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3925d3f9-a5c4-45df-a067-626ee87c6824 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:46.236784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3925d3f9-a5c4-45df-a067-626ee87c6824 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:47.546070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3925d3f9-a5c4-45df-a067-626ee87c6824 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:47.589430 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3925d3f9-a5c4-45df-a067-626ee87c6824 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1314 microversion: 2.1 time: 1.390508 Jul 20 04:28:47.604952 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1553/3308] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:46 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1314 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:47.649758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e4b971d0-5034-4a6d-930a-cab48bceb5fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:47.654949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e4b971d0-5034-4a6d-930a-cab48bceb5fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:47.667094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4b971d0-5034-4a6d-930a-cab48bceb5fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:47.669444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4b971d0-5034-4a6d-930a-cab48bceb5fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:47.673182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4b971d0-5034-4a6d-930a-cab48bceb5fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:47.673985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4b971d0-5034-4a6d-930a-cab48bceb5fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:47.832191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-76d9e71f-c407-4e5b-a3b9-af07df64b728 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bde7d1dd74c0da55025a63131897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd9c3c8c865481cadc7099860706164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:47.850147 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-76d9e71f-c407-4e5b-a3b9-af07df64b728 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16" status: 200 len: 1350 microversion: 2.1 time: 2.091707 Jul 20 04:28:47.853898 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1756/3309] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:45 2022] GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 => generated 1350 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:47.861810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-95054cf1-7431-4a4f-a688-2dea41569d90 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdf753a0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:48.078506 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-95054cf1-7431-4a4f-a688-2dea41569d90 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.223008 Jul 20 04:28:48.087103 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1757/3310] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:47 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:48.626554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5f41fb85-adc7-48b6-9d13-6bd2356f16fb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:48.627808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5f41fb85-adc7-48b6-9d13-6bd2356f16fb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:48.649758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f41fb85-adc7-48b6-9d13-6bd2356f16fb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:48.651954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f41fb85-adc7-48b6-9d13-6bd2356f16fb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:48.655140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f41fb85-adc7-48b6-9d13-6bd2356f16fb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:48.656146 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f41fb85-adc7-48b6-9d13-6bd2356f16fb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:49.195505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5f41fb85-adc7-48b6-9d13-6bd2356f16fb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:49.204776 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5f41fb85-adc7-48b6-9d13-6bd2356f16fb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1314 microversion: 2.1 time: 0.587045 Jul 20 04:28:49.209317 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1758/3311] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:48 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:49.222123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ce53633c-8dd8-4d35-a018-5cedc9444920 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:49.225587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ce53633c-8dd8-4d35-a018-5cedc9444920 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:49.243377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce53633c-8dd8-4d35-a018-5cedc9444920 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:49.248067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce53633c-8dd8-4d35-a018-5cedc9444920 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:49.249357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce53633c-8dd8-4d35-a018-5cedc9444920 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:49.250222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce53633c-8dd8-4d35-a018-5cedc9444920 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:49.442323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e4b971d0-5034-4a6d-930a-cab48bceb5fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:49.464053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e4b971d0-5034-4a6d-930a-cab48bceb5fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:49.474915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e4b971d0-5034-4a6d-930a-cab48bceb5fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:49.476680 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e4b971d0-5034-4a6d-930a-cab48bceb5fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.842054 Jul 20 04:28:49.477824 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1554/3312] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:47 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:49.488299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7098bfd8-d968-4de9-878d-5f1bf0f8772d tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be2f8790>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:49.599011 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7098bfd8-d968-4de9-878d-5f1bf0f8772d tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.119661 Jul 20 04:28:49.605052 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1555/3313] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:49 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:49.846568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ce53633c-8dd8-4d35-a018-5cedc9444920 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bde7d1dd74c0da55025a63131897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd9c3c8c865481cadc7099860706164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:49.870265 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ce53633c-8dd8-4d35-a018-5cedc9444920 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16" status: 200 len: 1539 microversion: 2.1 time: 0.658177 Jul 20 04:28:49.874795 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1759/3314] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:49 2022] GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 => generated 1539 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:49.895564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f1e5547b-3ef0-45ac-9418-e2f2cd5803a7 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:49.896800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f1e5547b-3ef0-45ac-9418-e2f2cd5803a7 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:49.915919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1e5547b-3ef0-45ac-9418-e2f2cd5803a7 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:49.919712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1e5547b-3ef0-45ac-9418-e2f2cd5803a7 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:49.923770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1e5547b-3ef0-45ac-9418-e2f2cd5803a7 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:49.925967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1e5547b-3ef0-45ac-9418-e2f2cd5803a7 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.234584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-24d1c2ef-9a2d-4881-a058-270b9f375b6f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:50.239320 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-24d1c2ef-9a2d-4881-a058-270b9f375b6f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:50.299888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24d1c2ef-9a2d-4881-a058-270b9f375b6f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:50.303302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24d1c2ef-9a2d-4881-a058-270b9f375b6f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.312323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24d1c2ef-9a2d-4881-a058-270b9f375b6f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:50.315203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24d1c2ef-9a2d-4881-a058-270b9f375b6f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.750365 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f1e5547b-3ef0-45ac-9418-e2f2cd5803a7 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.860589 Jul 20 04:28:50.751311 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1556/3315] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:28:49 2022] GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16/os-interface => generated 284 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:50.773700 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e62756a6-5a4c-43f0-af76-6f03ff98cc24 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:50.781477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e62756a6-5a4c-43f0-af76-6f03ff98cc24 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:50.812215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e62756a6-5a4c-43f0-af76-6f03ff98cc24 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:50.813409 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e62756a6-5a4c-43f0-af76-6f03ff98cc24 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.818698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e62756a6-5a4c-43f0-af76-6f03ff98cc24 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:50.821214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e62756a6-5a4c-43f0-af76-6f03ff98cc24 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.979402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-24d1c2ef-9a2d-4881-a058-270b9f375b6f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:51.016678 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-24d1c2ef-9a2d-4881-a058-270b9f375b6f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1314 microversion: 2.1 time: 0.792202 Jul 20 04:28:51.035929 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1760/3316] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:50 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1314 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:51.041290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-416588ef-edd9-479e-a8cb-140a9d2519c9 req-0086fe0e-580c-4111-a248-dbcdd4e32a7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "tag": "a31c0a5e-56a2-4356-95b1-8a55b29d3c84"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:51.065708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-416588ef-edd9-479e-a8cb-140a9d2519c9 req-0086fe0e-580c-4111-a248-dbcdd4e32a7c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:51.066726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-416588ef-edd9-479e-a8cb-140a9d2519c9 req-0086fe0e-580c-4111-a248-dbcdd4e32a7c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:51.100598 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-416588ef-edd9-479e-a8cb-140a9d2519c9 req-0086fe0e-580c-4111-a248-dbcdd4e32a7c service nova] Creating event network-changed:a31c0a5e-56a2-4356-95b1-8a55b29d3c84 for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:28:51.112294 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-416588ef-edd9-479e-a8cb-140a9d2519c9 req-0086fe0e-580c-4111-a248-dbcdd4e32a7c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074795 Jul 20 04:28:51.121519 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1761/3317] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:51.149044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7af4e93b-24a5-4e2a-abff-52568617049a tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bda3f160>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:51.286329 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7af4e93b-24a5-4e2a-abff-52568617049a tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.163006 Jul 20 04:28:51.286955 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1762/3318] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:51 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:51.314367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-26c2a304-7c00-45e1-873b-6c425c26ddd8 req-a7076b13-b187-4df0-b414-46d80f54b926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e14c167-ccb8-40a9-a747-7a07ea907d97", "name": "network-vif-plugged", "status": "completed", "tag": "8f916cd4-f49b-48c0-b604-e38dfb707781"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:51.358105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-26c2a304-7c00-45e1-873b-6c425c26ddd8 req-a7076b13-b187-4df0-b414-46d80f54b926 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:51.358591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-26c2a304-7c00-45e1-873b-6c425c26ddd8 req-a7076b13-b187-4df0-b414-46d80f54b926 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:51.449770 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-26c2a304-7c00-45e1-873b-6c425c26ddd8 req-a7076b13-b187-4df0-b414-46d80f54b926 service nova] Creating event network-vif-plugged:8f916cd4-f49b-48c0-b604-e38dfb707781 for instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 on n-h1-826526-5 Jul 20 04:28:51.471285 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-26c2a304-7c00-45e1-873b-6c425c26ddd8 req-a7076b13-b187-4df0-b414-46d80f54b926 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182845 Jul 20 04:28:51.490816 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1763/3319] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:52.041699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-014a939a-f2e2-4691-ad21-5e19dda0a07a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:52.042428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-014a939a-f2e2-4691-ad21-5e19dda0a07a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:52.062406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-014a939a-f2e2-4691-ad21-5e19dda0a07a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:52.062861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-014a939a-f2e2-4691-ad21-5e19dda0a07a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:52.063642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-014a939a-f2e2-4691-ad21-5e19dda0a07a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:52.073947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-014a939a-f2e2-4691-ad21-5e19dda0a07a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:52.209839 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e62756a6-5a4c-43f0-af76-6f03ff98cc24 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:52.231361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e62756a6-5a4c-43f0-af76-6f03ff98cc24 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:52.238737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e62756a6-5a4c-43f0-af76-6f03ff98cc24 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:52.242008 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e62756a6-5a4c-43f0-af76-6f03ff98cc24 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.489480 Jul 20 04:28:52.245687 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1557/3320] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:50 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:52.305860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b3b1b6f1-eea4-4cca-8023-d62ce7f79925 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be2ccca0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:52.390877 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b3b1b6f1-eea4-4cca-8023-d62ce7f79925 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.089482 Jul 20 04:28:52.396924 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1558/3321] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:52 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:53.222033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-014a939a-f2e2-4691-ad21-5e19dda0a07a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:53.241816 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-014a939a-f2e2-4691-ad21-5e19dda0a07a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1314 microversion: 2.1 time: 1.206732 Jul 20 04:28:53.247299 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1764/3322] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:52 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1314 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:53.272238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bca4abc3-e6df-413f-8e1e-cce48fc50277 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:53.274663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bca4abc3-e6df-413f-8e1e-cce48fc50277 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:53.290528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bca4abc3-e6df-413f-8e1e-cce48fc50277 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:53.300049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bca4abc3-e6df-413f-8e1e-cce48fc50277 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:53.301015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bca4abc3-e6df-413f-8e1e-cce48fc50277 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:53.301474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bca4abc3-e6df-413f-8e1e-cce48fc50277 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:53.407811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3814032e-37c0-441f-8392-d5e50875190f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be0e9ee0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:53.525556 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3814032e-37c0-441f-8392-d5e50875190f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1452 microversion: 2.1 time: 0.123464 Jul 20 04:28:53.529551 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1765/3323] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:53 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1452 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:54.244333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-f1b90d40-93ef-4f2a-9990-e33520ea6ce5 req-21352883-978a-4822-8bbc-a920318c6b49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "tag": "8ef7c976-1682-4334-a2e1-0641c7cbd89c"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:54.258323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f1b90d40-93ef-4f2a-9990-e33520ea6ce5 req-21352883-978a-4822-8bbc-a920318c6b49 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:54.258779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f1b90d40-93ef-4f2a-9990-e33520ea6ce5 req-21352883-978a-4822-8bbc-a920318c6b49 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:54.296516 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-f1b90d40-93ef-4f2a-9990-e33520ea6ce5 req-21352883-978a-4822-8bbc-a920318c6b49 service nova] Creating event network-changed:8ef7c976-1682-4334-a2e1-0641c7cbd89c for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:28:54.309187 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-f1b90d40-93ef-4f2a-9990-e33520ea6ce5 req-21352883-978a-4822-8bbc-a920318c6b49 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073792 Jul 20 04:28:54.313001 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1766/3324] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 20 04:28:54.351847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-416e6718-f3ed-4e22-929d-b60d406265d9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:54.361253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-416e6718-f3ed-4e22-929d-b60d406265d9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:54.380761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-416e6718-f3ed-4e22-929d-b60d406265d9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:54.383539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-416e6718-f3ed-4e22-929d-b60d406265d9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:54.386792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-416e6718-f3ed-4e22-929d-b60d406265d9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:54.391590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-416e6718-f3ed-4e22-929d-b60d406265d9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:54.409053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:54.560613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bca4abc3-e6df-413f-8e1e-cce48fc50277 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:54.573423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bca4abc3-e6df-413f-8e1e-cce48fc50277 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:54.574995 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bca4abc3-e6df-413f-8e1e-cce48fc50277 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:54.576306 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bca4abc3-e6df-413f-8e1e-cce48fc50277 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.308780 Jul 20 04:28:54.587618 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1559/3325] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:53 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:54.593848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-71b058ed-c0f5-4c44-8534-2aaca4e168af tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be7b4e50>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:54.685737 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-71b058ed-c0f5-4c44-8534-2aaca4e168af tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1461 microversion: 2.1 time: 0.094883 Jul 20 04:28:54.688475 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1560/3326] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:54 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1461 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:54.705261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea100794-a88a-4303-a6da-ad8c547aa189 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdddd280>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:54.794248 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ea100794-a88a-4303-a6da-ad8c547aa189 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 200 len: 1461 microversion: 2.1 time: 0.095619 Jul 20 04:28:54.795698 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1561/3327] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:54 2022] GET /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 1461 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:54.814779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dd50fc38-6a20-4f4b-9810-7a822fbeae2b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:54.815822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dd50fc38-6a20-4f4b-9810-7a822fbeae2b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:54.831734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd50fc38-6a20-4f4b-9810-7a822fbeae2b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:54.832448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd50fc38-6a20-4f4b-9810-7a822fbeae2b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:54.833396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd50fc38-6a20-4f4b-9810-7a822fbeae2b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:54.833989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd50fc38-6a20-4f4b-9810-7a822fbeae2b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:55.641659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-416e6718-f3ed-4e22-929d-b60d406265d9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:55.661326 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-416e6718-f3ed-4e22-929d-b60d406265d9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1502 microversion: 2.1 time: 1.339710 Jul 20 04:28:55.661842 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1767/3328] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:54 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1502 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:55.674756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e83e0d50-e16b-4ed1-a3b8-79c39ba5f8c2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:55.680661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e83e0d50-e16b-4ed1-a3b8-79c39ba5f8c2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:55.697938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e83e0d50-e16b-4ed1-a3b8-79c39ba5f8c2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:55.698769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e83e0d50-e16b-4ed1-a3b8-79c39ba5f8c2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:55.699827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e83e0d50-e16b-4ed1-a3b8-79c39ba5f8c2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:55.700585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e83e0d50-e16b-4ed1-a3b8-79c39ba5f8c2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:55.703775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dd50fc38-6a20-4f4b-9810-7a822fbeae2b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:55.718231 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dd50fc38-6a20-4f4b-9810-7a822fbeae2b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b" status: 200 len: 1467 microversion: 2.1 time: 0.910831 Jul 20 04:28:55.719549 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1562/3329] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:54 2022] GET /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b => generated 1467 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:55.749754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-06eddbbf-3a4f-427a-92a1-42291731ba7b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:55.757112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-06eddbbf-3a4f-427a-92a1-42291731ba7b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:55.775253 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06eddbbf-3a4f-427a-92a1-42291731ba7b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:55.779526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06eddbbf-3a4f-427a-92a1-42291731ba7b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:55.782794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06eddbbf-3a4f-427a-92a1-42291731ba7b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:55.783251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06eddbbf-3a4f-427a-92a1-42291731ba7b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:55.826580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:55.850433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-06eddbbf-3a4f-427a-92a1-42291731ba7b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lazy-loading 'flavor' on Instance uuid 4e14c167-ccb8-40a9-a747-7a07ea907d97 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:28:56.110825 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-06eddbbf-3a4f-427a-92a1-42291731ba7b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "POST /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97/action" status: 202 len: 0 microversion: 2.1 time: 0.375210 Jul 20 04:28:56.112054 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1563/3330] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:28:55 2022] POST /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:28:56.148317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2c02c295-baf6-45f3-b8f0-2e08758b8066 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-187617467"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:56.149960 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2c02c295-baf6-45f3-b8f0-2e08758b8066 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:56.169180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c02c295-baf6-45f3-b8f0-2e08758b8066 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:56.170068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c02c295-baf6-45f3-b8f0-2e08758b8066 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:56.170994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c02c295-baf6-45f3-b8f0-2e08758b8066 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:56.171583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c02c295-baf6-45f3-b8f0-2e08758b8066 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:56.293732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e83e0d50-e16b-4ed1-a3b8-79c39ba5f8c2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:56.309145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e83e0d50-e16b-4ed1-a3b8-79c39ba5f8c2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:56.311339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e83e0d50-e16b-4ed1-a3b8-79c39ba5f8c2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:56.312682 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e83e0d50-e16b-4ed1-a3b8-79c39ba5f8c2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 0.649771 Jul 20 04:28:56.313235 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1768/3331] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:55 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:56.329027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-178e179a-19f2-443a-9e13-434bfd9c3d19 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:56.333140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-178e179a-19f2-443a-9e13-434bfd9c3d19 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:56.351237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-178e179a-19f2-443a-9e13-434bfd9c3d19 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:56.351705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-178e179a-19f2-443a-9e13-434bfd9c3d19 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:56.352830 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-178e179a-19f2-443a-9e13-434bfd9c3d19 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:56.353017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-178e179a-19f2-443a-9e13-434bfd9c3d19 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:56.671921 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2c02c295-baf6-45f3-b8f0-2e08758b8066 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "POST /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489/action" status: 202 len: 0 microversion: 2.1 time: 0.543663 Jul 20 04:28:56.672770 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1564/3332] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:28:56 2022] POST /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:28:56.685334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-89de7e29-a52f-4105-92c8-b6f0cd123160 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be92d310>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:56.798392 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-89de7e29-a52f-4105-92c8-b6f0cd123160 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.118900 Jul 20 04:28:56.815687 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1565/3333] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:56 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:57.343557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-502a8faf-aeb2-4bba-a4b4-f8f2fb36c5e3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:57.343557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-502a8faf-aeb2-4bba-a4b4-f8f2fb36c5e3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:57.381071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-502a8faf-aeb2-4bba-a4b4-f8f2fb36c5e3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:57.381532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-502a8faf-aeb2-4bba-a4b4-f8f2fb36c5e3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:57.382327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-502a8faf-aeb2-4bba-a4b4-f8f2fb36c5e3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:57.382770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-502a8faf-aeb2-4bba-a4b4-f8f2fb36c5e3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:58.031748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-178e179a-19f2-443a-9e13-434bfd9c3d19 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:58.104033 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-178e179a-19f2-443a-9e13-434bfd9c3d19 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1510 microversion: 2.1 time: 1.780740 Jul 20 04:28:58.109592 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1769/3334] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:56 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1510 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:58.123936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d433f209-1582-4b1c-8c66-3e180e67f0f8 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be0b1040>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:58.198312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-502a8faf-aeb2-4bba-a4b4-f8f2fb36c5e3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:58.254410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-502a8faf-aeb2-4bba-a4b4-f8f2fb36c5e3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:58.258468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-502a8faf-aeb2-4bba-a4b4-f8f2fb36c5e3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:58.261865 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-502a8faf-aeb2-4bba-a4b4-f8f2fb36c5e3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 0.925468 Jul 20 04:28:58.277739 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1566/3335] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:57 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:28:58.313569 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d433f209-1582-4b1c-8c66-3e180e67f0f8 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.199022 Jul 20 04:28:58.318202 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1770/3336] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:28:58 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:59.141093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-70bc2f7a-28b6-419c-91b4-ef945559c63b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:59.141866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-70bc2f7a-28b6-419c-91b4-ef945559c63b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:59.183071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70bc2f7a-28b6-419c-91b4-ef945559c63b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:59.183531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70bc2f7a-28b6-419c-91b4-ef945559c63b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:59.186656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70bc2f7a-28b6-419c-91b4-ef945559c63b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:59.194882 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70bc2f7a-28b6-419c-91b4-ef945559c63b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:59.294728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9edb1ed8-6620-4ed7-9762-6889944eeba6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:59.296082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9edb1ed8-6620-4ed7-9762-6889944eeba6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:59.308587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9edb1ed8-6620-4ed7-9762-6889944eeba6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:59.309606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9edb1ed8-6620-4ed7-9762-6889944eeba6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:59.311256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9edb1ed8-6620-4ed7-9762-6889944eeba6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:59.313092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9edb1ed8-6620-4ed7-9762-6889944eeba6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:00.528716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9edb1ed8-6620-4ed7-9762-6889944eeba6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:00.543494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9edb1ed8-6620-4ed7-9762-6889944eeba6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:00.545259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9edb1ed8-6620-4ed7-9762-6889944eeba6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:00.551308 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9edb1ed8-6620-4ed7-9762-6889944eeba6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.262166 Jul 20 04:29:00.553032 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1771/3337] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:59 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:29:00.572641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bf574dec-dda1-4dbd-b684-f256b4482ee6 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be6b70d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:00.661938 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bf574dec-dda1-4dbd-b684-f256b4482ee6 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.106744 Jul 20 04:29:00.662551 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1772/3338] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:00 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:00.669278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e127b2b2-3b6f-4954-babe-d8a5e646558a req-64691f04-e0c3-4cd6-8a39-4f2b59823b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2494990e-0404-4826-99c9-cbe63a142b16", "tag": "d532bee4-df8a-472a-9525-e2595f7f5a06"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:00.715562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e127b2b2-3b6f-4954-babe-d8a5e646558a req-64691f04-e0c3-4cd6-8a39-4f2b59823b61 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:00.716024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e127b2b2-3b6f-4954-babe-d8a5e646558a req-64691f04-e0c3-4cd6-8a39-4f2b59823b61 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:00.751928 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e127b2b2-3b6f-4954-babe-d8a5e646558a req-64691f04-e0c3-4cd6-8a39-4f2b59823b61 service nova] Creating event network-changed:d532bee4-df8a-472a-9525-e2595f7f5a06 for instance 2494990e-0404-4826-99c9-cbe63a142b16 on n-h1-826526-5 Jul 20 04:29:00.773109 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e127b2b2-3b6f-4954-babe-d8a5e646558a req-64691f04-e0c3-4cd6-8a39-4f2b59823b61 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105187 Jul 20 04:29:00.774032 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1773/3339] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:00.798421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-d6edf81f-a3cf-4bb7-b4a3-34087dee8f19 req-ea3dfdc9-80c8-4e16-b69e-d2d443159414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b", "name": "network-vif-unplugged", "status": "completed", "tag": "f5248619-09e7-4707-9127-fb95dc122bcf"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:00.810392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d6edf81f-a3cf-4bb7-b4a3-34087dee8f19 req-ea3dfdc9-80c8-4e16-b69e-d2d443159414 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:00.811130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d6edf81f-a3cf-4bb7-b4a3-34087dee8f19 req-ea3dfdc9-80c8-4e16-b69e-d2d443159414 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:00.839353 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-d6edf81f-a3cf-4bb7-b4a3-34087dee8f19 req-ea3dfdc9-80c8-4e16-b69e-d2d443159414 service nova] Creating event network-vif-unplugged:f5248619-09e7-4707-9127-fb95dc122bcf for instance a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b on n-h2-826526-5 Jul 20 04:29:00.848948 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-d6edf81f-a3cf-4bb7-b4a3-34087dee8f19 req-ea3dfdc9-80c8-4e16-b69e-d2d443159414 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069609 Jul 20 04:29:00.850410 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1774/3340] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:01.239651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-70bc2f7a-28b6-419c-91b4-ef945559c63b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:01.262749 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-70bc2f7a-28b6-419c-91b4-ef945559c63b tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1493 microversion: 2.1 time: 2.129091 Jul 20 04:29:01.263371 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1567/3341] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:59 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1493 bytes in 2131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:01.286439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8b286d6c-d5d4-4800-8ebe-0d246349ffc5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:01.287037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8b286d6c-d5d4-4800-8ebe-0d246349ffc5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:01.314460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b286d6c-d5d4-4800-8ebe-0d246349ffc5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:01.314929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b286d6c-d5d4-4800-8ebe-0d246349ffc5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:01.315744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b286d6c-d5d4-4800-8ebe-0d246349ffc5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:01.316192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b286d6c-d5d4-4800-8ebe-0d246349ffc5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:01.415731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8b286d6c-d5d4-4800-8ebe-0d246349ffc5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:29:01.563442 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:29:01.564355 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 04:29:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 (ip 10.222.0.17) !!! Jul 20 04:29:01.575703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b650ef02-d20e-46dd-b12c-876d8ee1272c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:01.576896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b650ef02-d20e-46dd-b12c-876d8ee1272c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:01.631525 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8b286d6c-d5d4-4800-8ebe-0d246349ffc5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 204 len: 0 microversion: 2.1 time: 0.347703 Jul 20 04:29:01.636119 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1775/3342] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:29:01 2022] DELETE /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:29:01.644912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b650ef02-d20e-46dd-b12c-876d8ee1272c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:01.646591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b650ef02-d20e-46dd-b12c-876d8ee1272c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:01.647483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b650ef02-d20e-46dd-b12c-876d8ee1272c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:01.647939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b650ef02-d20e-46dd-b12c-876d8ee1272c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:01.660578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5eb290fb-f107-435a-b5e6-e1ea962742fa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:01.661980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5eb290fb-f107-435a-b5e6-e1ea962742fa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:01.684066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eb290fb-f107-435a-b5e6-e1ea962742fa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:01.686431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eb290fb-f107-435a-b5e6-e1ea962742fa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:01.689161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eb290fb-f107-435a-b5e6-e1ea962742fa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:01.690219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eb290fb-f107-435a-b5e6-e1ea962742fa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:02.528553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b650ef02-d20e-46dd-b12c-876d8ee1272c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:02.566228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b650ef02-d20e-46dd-b12c-876d8ee1272c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:02.577354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b650ef02-d20e-46dd-b12c-876d8ee1272c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:02.584474 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b650ef02-d20e-46dd-b12c-876d8ee1272c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.016217 Jul 20 04:29:02.601928 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1568/3343] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:01 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:02.637227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3dc96ad4-4dba-491e-aff8-9dee440a2ec1 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be7b4550>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:02.747511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5eb290fb-f107-435a-b5e6-e1ea962742fa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:02.749906 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3dc96ad4-4dba-491e-aff8-9dee440a2ec1 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.146246 Jul 20 04:29:02.750799 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1569/3344] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:02 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:02.782780 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5eb290fb-f107-435a-b5e6-e1ea962742fa tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1499 microversion: 2.1 time: 1.140896 Jul 20 04:29:02.797239 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1776/3345] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:01 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1499 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:03.608190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-88fd8c73-74e0-4bdf-8c90-250bd2953555 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:03.630847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-88fd8c73-74e0-4bdf-8c90-250bd2953555 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:03.649324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-88fd8c73-74e0-4bdf-8c90-250bd2953555 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:03.650023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-88fd8c73-74e0-4bdf-8c90-250bd2953555 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:03.650972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-88fd8c73-74e0-4bdf-8c90-250bd2953555 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:03.651567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-88fd8c73-74e0-4bdf-8c90-250bd2953555 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:03.766840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-90969fc1-c2ba-422c-af50-cc2e8bcb0070 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdee6790>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:03.927040 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-90969fc1-c2ba-422c-af50-cc2e8bcb0070 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.164389 Jul 20 04:29:03.927852 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1777/3346] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:03 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:03.946821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-359ad28a-9824-49a2-a860-4e8d4224c657 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:03.957407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-359ad28a-9824-49a2-a860-4e8d4224c657 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:03.974411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-359ad28a-9824-49a2-a860-4e8d4224c657 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:03.975143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-359ad28a-9824-49a2-a860-4e8d4224c657 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:03.976163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-359ad28a-9824-49a2-a860-4e8d4224c657 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:03.977213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-359ad28a-9824-49a2-a860-4e8d4224c657 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:05.365610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-359ad28a-9824-49a2-a860-4e8d4224c657 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:05.385769 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-359ad28a-9824-49a2-a860-4e8d4224c657 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1499 microversion: 2.1 time: 1.451533 Jul 20 04:29:05.392942 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1778/3347] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:03 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1499 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:05.407045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5128b6f6-a395-404c-af1d-30bd7e4379d4 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be301dc0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:05.522303 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5128b6f6-a395-404c-af1d-30bd7e4379d4 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.119316 Jul 20 04:29:05.523844 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1779/3348] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:05 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:06.409416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a830fdd1-9fc8-44ab-83d7-af61cf4a625a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:06.410077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a830fdd1-9fc8-44ab-83d7-af61cf4a625a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:06.422845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a830fdd1-9fc8-44ab-83d7-af61cf4a625a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:06.430576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a830fdd1-9fc8-44ab-83d7-af61cf4a625a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:06.435674 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a830fdd1-9fc8-44ab-83d7-af61cf4a625a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:06.438836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a830fdd1-9fc8-44ab-83d7-af61cf4a625a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:06.673677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-88fd8c73-74e0-4bdf-8c90-250bd2953555 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:06.684902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-88fd8c73-74e0-4bdf-8c90-250bd2953555 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:06.686474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-88fd8c73-74e0-4bdf-8c90-250bd2953555 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:06.687664 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-88fd8c73-74e0-4bdf-8c90-250bd2953555 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 3.083540 Jul 20 04:29:06.718831 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1570/3349] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:03 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 3115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:06.732390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e20b8116-cf83-4ffd-8a8c-33bca0c5b055 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be2f81f0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:06.825023 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e20b8116-cf83-4ffd-8a8c-33bca0c5b055 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.104968 Jul 20 04:29:06.825682 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1571/3350] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:06 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:06.835802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-750f6428-4bb2-452b-88dc-5962b5f9b82d req-e9d9af85-6151-4e86-9980-cce03e654252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d12f9b2-058c-4fe2-964b-81217cb46489", "name": "network-vif-plugged", "status": "completed", "tag": "09e0f809-5b7f-42cb-bbac-f315284f1a91"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:06.869475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-750f6428-4bb2-452b-88dc-5962b5f9b82d req-e9d9af85-6151-4e86-9980-cce03e654252 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:06.869929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-750f6428-4bb2-452b-88dc-5962b5f9b82d req-e9d9af85-6151-4e86-9980-cce03e654252 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:06.906321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a830fdd1-9fc8-44ab-83d7-af61cf4a625a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc60058bea0485ebd4d502b2e7c986b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae67de1fefe64bd19a3bf614f02d3535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:06.908006 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-750f6428-4bb2-452b-88dc-5962b5f9b82d req-e9d9af85-6151-4e86-9980-cce03e654252 service nova] Creating event network-vif-plugged:09e0f809-5b7f-42cb-bbac-f315284f1a91 for instance 1d12f9b2-058c-4fe2-964b-81217cb46489 on n-h1-826526-5 Jul 20 04:29:06.922914 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a830fdd1-9fc8-44ab-83d7-af61cf4a625a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 200 len: 1457 microversion: 2.1 time: 0.514590 Jul 20 04:29:06.932707 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1780/3351] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:06 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 1457 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:06.937424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-71913664-6ff1-4ebe-bf74-0e6f739b00d3 req-4cb76d10-b131-41a4-a16f-43bdbd4cd3cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e14c167-ccb8-40a9-a747-7a07ea907d97", "name": "network-vif-deleted", "tag": "8f916cd4-f49b-48c0-b604-e38dfb707781"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:06.939365 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-750f6428-4bb2-452b-88dc-5962b5f9b82d req-e9d9af85-6151-4e86-9980-cce03e654252 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111480 Jul 20 04:29:06.944297 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1572/3352] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:06.960142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-71913664-6ff1-4ebe-bf74-0e6f739b00d3 req-4cb76d10-b131-41a4-a16f-43bdbd4cd3cb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:06.961396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-71913664-6ff1-4ebe-bf74-0e6f739b00d3 req-4cb76d10-b131-41a4-a16f-43bdbd4cd3cb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:06.974590 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-71913664-6ff1-4ebe-bf74-0e6f739b00d3 req-4cb76d10-b131-41a4-a16f-43bdbd4cd3cb service nova] Creating event network-vif-deleted:8f916cd4-f49b-48c0-b604-e38dfb707781 for instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 on n-h1-826526-5 Jul 20 04:29:06.980119 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-71913664-6ff1-4ebe-bf74-0e6f739b00d3 req-4cb76d10-b131-41a4-a16f-43bdbd4cd3cb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054600 Jul 20 04:29:06.981465 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1781/3353] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:07.709491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-35ece5b8-903d-4b3a-b8e8-ee0a8bf573e9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:07.710338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-35ece5b8-903d-4b3a-b8e8-ee0a8bf573e9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:07.729819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35ece5b8-903d-4b3a-b8e8-ee0a8bf573e9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:07.730353 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35ece5b8-903d-4b3a-b8e8-ee0a8bf573e9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:07.732581 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35ece5b8-903d-4b3a-b8e8-ee0a8bf573e9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:07.733040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35ece5b8-903d-4b3a-b8e8-ee0a8bf573e9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:07.839889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b494de8c-bae4-44a5-abdc-0a37de487088 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be337d30>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:07.941749 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b494de8c-bae4-44a5-abdc-0a37de487088 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.106164 Jul 20 04:29:07.944754 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1782/3354] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:07 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:07.951495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e78f855c-d401-4aa4-9669-3c233d1b4b0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:07.957122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e78f855c-d401-4aa4-9669-3c233d1b4b0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:07.983446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e78f855c-d401-4aa4-9669-3c233d1b4b0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:07.984448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e78f855c-d401-4aa4-9669-3c233d1b4b0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:07.986751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e78f855c-d401-4aa4-9669-3c233d1b4b0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:07.988429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e78f855c-d401-4aa4-9669-3c233d1b4b0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.023101 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-e78f855c-d401-4aa4-9669-3c233d1b4b0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 could not be found. Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e78f855c-d401-4aa4-9669-3c233d1b4b0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 HTTP/1.1 Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 could not be found. Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '4e14c167-ccb8-40a9-a747-7a07ea907d97'} Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 could not be found. Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 could not be found. Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.026629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.030290 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.030290 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.030290 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.030290 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:08.030290 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:08.030290 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 could not be found. Jul 20 04:29:08.030290 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.033529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e78f855c-d401-4aa4-9669-3c233d1b4b0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:08.036115 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e78f855c-d401-4aa4-9669-3c233d1b4b0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 404 len: 111 microversion: 2.1 time: 0.089004 Jul 20 04:29:08.036981 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1783/3355] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:07 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:08.053185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2c317ef8-10a2-4429-9c7e-39dea215f6c7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:08.066647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2c317ef8-10a2-4429-9c7e-39dea215f6c7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:08.085707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c317ef8-10a2-4429-9c7e-39dea215f6c7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.086365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c317ef8-10a2-4429-9c7e-39dea215f6c7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.087295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c317ef8-10a2-4429-9c7e-39dea215f6c7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.087882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c317ef8-10a2-4429-9c7e-39dea215f6c7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.106829 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-2c317ef8-10a2-4429-9c7e-39dea215f6c7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 could not be found. Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2c317ef8-10a2-4429-9c7e-39dea215f6c7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 HTTP/1.1 Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 could not be found. Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '4e14c167-ccb8-40a9-a747-7a07ea907d97'} Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 could not be found. Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:08.109058 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:08.114568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 could not be found. Jul 20 04:29:08.114568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.114568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.114568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.114568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.114568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.114568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.114568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:08.114568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:08.114568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 could not be found. Jul 20 04:29:08.114568 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.116748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2c317ef8-10a2-4429-9c7e-39dea215f6c7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:08.117840 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2c317ef8-10a2-4429-9c7e-39dea215f6c7 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 404 len: 111 microversion: 2.1 time: 0.068678 Jul 20 04:29:08.119188 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1784/3356] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:29:08 2022] DELETE /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:08.139380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5e03a6dc-2ec9-4b53-8149-d1409498ae0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:08.141503 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5e03a6dc-2ec9-4b53-8149-d1409498ae0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 4e14c167-ccb8-40a9-a747-7a07ea907d97] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:08.184893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e03a6dc-2ec9-4b53-8149-d1409498ae0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.187116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e03a6dc-2ec9-4b53-8149-d1409498ae0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.202024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e03a6dc-2ec9-4b53-8149-d1409498ae0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.204770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e03a6dc-2ec9-4b53-8149-d1409498ae0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.238760 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-5e03a6dc-2ec9-4b53-8149-d1409498ae0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 could not be found. Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5e03a6dc-2ec9-4b53-8149-d1409498ae0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 HTTP/1.1 Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 could not be found. Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '4e14c167-ccb8-40a9-a747-7a07ea907d97'} Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 could not be found. Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 could not be found. Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.238864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.242785 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.242785 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.242785 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.242785 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:08.242785 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:08.242785 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 could not be found. Jul 20 04:29:08.242785 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.242785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5e03a6dc-2ec9-4b53-8149-d1409498ae0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance 4e14c167-ccb8-40a9-a747-7a07ea907d97 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:08.242785 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5e03a6dc-2ec9-4b53-8149-d1409498ae0a tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97" status: 404 len: 111 microversion: 2.1 time: 0.117095 Jul 20 04:29:08.247058 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1785/3357] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:08 2022] GET /compute/v2.1/servers/4e14c167-ccb8-40a9-a747-7a07ea907d97 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:08.272792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6100b045-f166-4a31-8db0-71d6fa68ae39 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:08.273319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6100b045-f166-4a31-8db0-71d6fa68ae39 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:08.289362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6100b045-f166-4a31-8db0-71d6fa68ae39 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.292120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6100b045-f166-4a31-8db0-71d6fa68ae39 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.293072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6100b045-f166-4a31-8db0-71d6fa68ae39 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.293667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6100b045-f166-4a31-8db0-71d6fa68ae39 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.327198 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-6100b045-f166-4a31-8db0-71d6fa68ae39 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b could not be found. Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6100b045-f166-4a31-8db0-71d6fa68ae39 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b HTTP/1.1 Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b could not be found. Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '5ced3e0e-76cd-4980-8996-eac7e9cb559b'} Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b could not be found. Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:08.334260 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:08.338507 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b could not be found. Jul 20 04:29:08.338507 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.338507 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.338507 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.338507 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.338507 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.338507 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.338507 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:08.338507 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:08.338507 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b could not be found. Jul 20 04:29:08.338507 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.350897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6100b045-f166-4a31-8db0-71d6fa68ae39 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:08.354708 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6100b045-f166-4a31-8db0-71d6fa68ae39 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 404 len: 111 microversion: 2.1 time: 0.103348 Jul 20 04:29:08.359415 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1786/3358] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:29:08 2022] DELETE /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:08.366539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5433bba9-1293-40d0-9f79-f50843a11412 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:08.367229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5433bba9-1293-40d0-9f79-f50843a11412 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5ced3e0e-76cd-4980-8996-eac7e9cb559b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:08.375384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5433bba9-1293-40d0-9f79-f50843a11412 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.375848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5433bba9-1293-40d0-9f79-f50843a11412 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.377116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5433bba9-1293-40d0-9f79-f50843a11412 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.377760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5433bba9-1293-40d0-9f79-f50843a11412 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.402304 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-5433bba9-1293-40d0-9f79-f50843a11412 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b could not be found. Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5433bba9-1293-40d0-9f79-f50843a11412 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b HTTP/1.1 Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b could not be found. Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '5ced3e0e-76cd-4980-8996-eac7e9cb559b'} Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b could not be found. Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b could not be found. Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.405414 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.411132 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.411132 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.411132 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.411132 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:08.411132 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:08.411132 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b could not be found. Jul 20 04:29:08.411132 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.414403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5433bba9-1293-40d0-9f79-f50843a11412 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance 5ced3e0e-76cd-4980-8996-eac7e9cb559b could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:08.415521 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5433bba9-1293-40d0-9f79-f50843a11412 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b" status: 404 len: 111 microversion: 2.1 time: 0.053178 Jul 20 04:29:08.417536 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1787/3359] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:08 2022] GET /compute/v2.1/servers/5ced3e0e-76cd-4980-8996-eac7e9cb559b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:08.429417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-965ab7bb-52fe-4e26-a677-74bf75c100e2 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:08.429981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-965ab7bb-52fe-4e26-a677-74bf75c100e2 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:08.441958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-965ab7bb-52fe-4e26-a677-74bf75c100e2 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.443091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-965ab7bb-52fe-4e26-a677-74bf75c100e2 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.444504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-965ab7bb-52fe-4e26-a677-74bf75c100e2 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.445438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-965ab7bb-52fe-4e26-a677-74bf75c100e2 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.479466 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-965ab7bb-52fe-4e26-a677-74bf75c100e2 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 could not be found. Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-965ab7bb-52fe-4e26-a677-74bf75c100e2 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 HTTP/1.1 Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 could not be found. Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '5e82edc2-fbf4-4e3f-b3b2-f937cd316135'} Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 could not be found. Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:08.482925 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:08.487880 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 could not be found. Jul 20 04:29:08.487880 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.487880 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.487880 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.487880 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.487880 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.487880 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.487880 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:08.487880 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:08.487880 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 could not be found. Jul 20 04:29:08.487880 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.491041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-965ab7bb-52fe-4e26-a677-74bf75c100e2 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:08.494724 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-965ab7bb-52fe-4e26-a677-74bf75c100e2 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 404 len: 111 microversion: 2.1 time: 0.070737 Jul 20 04:29:08.495397 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1788/3360] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:29:08 2022] DELETE /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:08.505169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5ee874d8-fb52-421a-ad28-eb27259bdceb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:08.509884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5ee874d8-fb52-421a-ad28-eb27259bdceb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5e82edc2-fbf4-4e3f-b3b2-f937cd316135] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:08.524958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ee874d8-fb52-421a-ad28-eb27259bdceb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.526325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ee874d8-fb52-421a-ad28-eb27259bdceb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.531117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ee874d8-fb52-421a-ad28-eb27259bdceb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.531774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ee874d8-fb52-421a-ad28-eb27259bdceb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.560036 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-5ee874d8-fb52-421a-ad28-eb27259bdceb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 could not be found. Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5ee874d8-fb52-421a-ad28-eb27259bdceb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 HTTP/1.1 Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 could not be found. Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '5e82edc2-fbf4-4e3f-b3b2-f937cd316135'} Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 could not be found. Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 could not be found. Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.570326 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.574028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.574028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.574028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.574028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:08.574028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:08.574028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 could not be found. Jul 20 04:29:08.574028 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.575593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5ee874d8-fb52-421a-ad28-eb27259bdceb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance 5e82edc2-fbf4-4e3f-b3b2-f937cd316135 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:08.576730 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5ee874d8-fb52-421a-ad28-eb27259bdceb tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135" status: 404 len: 111 microversion: 2.1 time: 0.075580 Jul 20 04:29:08.577863 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1789/3361] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:08 2022] GET /compute/v2.1/servers/5e82edc2-fbf4-4e3f-b3b2-f937cd316135 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:08.589692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-69adb8af-66dd-4719-b8bd-95f45943ca04 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:08.591079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-69adb8af-66dd-4719-b8bd-95f45943ca04 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:08.616600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69adb8af-66dd-4719-b8bd-95f45943ca04 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.617293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69adb8af-66dd-4719-b8bd-95f45943ca04 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.619924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69adb8af-66dd-4719-b8bd-95f45943ca04 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.621670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69adb8af-66dd-4719-b8bd-95f45943ca04 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.670776 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-69adb8af-66dd-4719-b8bd-95f45943ca04 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance 912b563f-eb41-461a-b923-1c90614de8ce could not be found. Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-69adb8af-66dd-4719-b8bd-95f45943ca04 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce HTTP/1.1 Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 912b563f-eb41-461a-b923-1c90614de8ce could not be found. Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '912b563f-eb41-461a-b923-1c90614de8ce'} Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 912b563f-eb41-461a-b923-1c90614de8ce could not be found. Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:08.673582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:08.677279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 912b563f-eb41-461a-b923-1c90614de8ce could not be found. Jul 20 04:29:08.677279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.677279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.677279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.677279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.677279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.677279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.677279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:08.677279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:08.677279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 912b563f-eb41-461a-b923-1c90614de8ce could not be found. Jul 20 04:29:08.677279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.681841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-69adb8af-66dd-4719-b8bd-95f45943ca04 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance 912b563f-eb41-461a-b923-1c90614de8ce could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:08.684246 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-69adb8af-66dd-4719-b8bd-95f45943ca04 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "DELETE /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 404 len: 111 microversion: 2.1 time: 0.099525 Jul 20 04:29:08.686268 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1790/3362] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:29:08 2022] DELETE /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:29:08.700951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-edb70336-4d40-4943-bb12-4c2b3066d9b9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:08.702840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-edb70336-4d40-4943-bb12-4c2b3066d9b9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 912b563f-eb41-461a-b923-1c90614de8ce] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:08.723436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edb70336-4d40-4943-bb12-4c2b3066d9b9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.725304 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edb70336-4d40-4943-bb12-4c2b3066d9b9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.726292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edb70336-4d40-4943-bb12-4c2b3066d9b9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.727878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edb70336-4d40-4943-bb12-4c2b3066d9b9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.770154 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-edb70336-4d40-4943-bb12-4c2b3066d9b9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance 912b563f-eb41-461a-b923-1c90614de8ce could not be found. Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-edb70336-4d40-4943-bb12-4c2b3066d9b9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce HTTP/1.1 Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 912b563f-eb41-461a-b923-1c90614de8ce could not be found. Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '912b563f-eb41-461a-b923-1c90614de8ce'} Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 912b563f-eb41-461a-b923-1c90614de8ce could not be found. Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 912b563f-eb41-461a-b923-1c90614de8ce could not be found. Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.772312 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.775879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.775879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.775879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.775879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:08.775879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:08.775879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 912b563f-eb41-461a-b923-1c90614de8ce could not be found. Jul 20 04:29:08.775879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.779404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-edb70336-4d40-4943-bb12-4c2b3066d9b9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance 912b563f-eb41-461a-b923-1c90614de8ce could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:08.781295 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-edb70336-4d40-4943-bb12-4c2b3066d9b9 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce" status: 404 len: 111 microversion: 2.1 time: 0.089445 Jul 20 04:29:08.784461 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1791/3363] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:08 2022] GET /compute/v2.1/servers/912b563f-eb41-461a-b923-1c90614de8ce => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:08.793993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-38d585fa-278f-4c88-9b17-3e4b72ab3e6e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:08.794829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-38d585fa-278f-4c88-9b17-3e4b72ab3e6e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 3261841a-a10c-46ba-8894-77e1e808de20] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:08.812380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38d585fa-278f-4c88-9b17-3e4b72ab3e6e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.813024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38d585fa-278f-4c88-9b17-3e4b72ab3e6e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.816451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38d585fa-278f-4c88-9b17-3e4b72ab3e6e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.818021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38d585fa-278f-4c88-9b17-3e4b72ab3e6e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.863461 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-38d585fa-278f-4c88-9b17-3e4b72ab3e6e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance 3261841a-a10c-46ba-8894-77e1e808de20 could not be found. Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-38d585fa-278f-4c88-9b17-3e4b72ab3e6e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/3261841a-a10c-46ba-8894-77e1e808de20 HTTP/1.1 Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 3261841a-a10c-46ba-8894-77e1e808de20 could not be found. Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '3261841a-a10c-46ba-8894-77e1e808de20'} Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3261841a-a10c-46ba-8894-77e1e808de20 could not be found. Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:08.867704 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:08.871039 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3261841a-a10c-46ba-8894-77e1e808de20 could not be found. Jul 20 04:29:08.871039 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.871039 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.871039 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.871039 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.871039 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.871039 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.871039 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:08.871039 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:08.871039 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3261841a-a10c-46ba-8894-77e1e808de20 could not be found. Jul 20 04:29:08.871039 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.874690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-35ece5b8-903d-4b3a-b8e8-ee0a8bf573e9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:08.883543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-35ece5b8-903d-4b3a-b8e8-ee0a8bf573e9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:08.886212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-35ece5b8-903d-4b3a-b8e8-ee0a8bf573e9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:08.887908 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-35ece5b8-903d-4b3a-b8e8-ee0a8bf573e9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.184156 Jul 20 04:29:08.888484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-38d585fa-278f-4c88-9b17-3e4b72ab3e6e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance 3261841a-a10c-46ba-8894-77e1e808de20 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:08.891655 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-38d585fa-278f-4c88-9b17-3e4b72ab3e6e tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3261841a-a10c-46ba-8894-77e1e808de20" status: 404 len: 111 microversion: 2.1 time: 0.101406 Jul 20 04:29:08.895750 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1573/3364] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:07 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:08.898428 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1792/3365] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:29:08 2022] DELETE /compute/v2.1/servers/3261841a-a10c-46ba-8894-77e1e808de20 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:08.906229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f767e435-037d-4453-b26e-d0c1208ea501 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:08.906968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f767e435-037d-4453-b26e-d0c1208ea501 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 3261841a-a10c-46ba-8894-77e1e808de20] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:08.923880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f767e435-037d-4453-b26e-d0c1208ea501 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.924375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f767e435-037d-4453-b26e-d0c1208ea501 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.925216 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f767e435-037d-4453-b26e-d0c1208ea501 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.925656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f767e435-037d-4453-b26e-d0c1208ea501 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.957996 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-f767e435-037d-4453-b26e-d0c1208ea501 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance 3261841a-a10c-46ba-8894-77e1e808de20 could not be found. Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f767e435-037d-4453-b26e-d0c1208ea501 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/3261841a-a10c-46ba-8894-77e1e808de20 HTTP/1.1 Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 3261841a-a10c-46ba-8894-77e1e808de20 could not be found. Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '3261841a-a10c-46ba-8894-77e1e808de20'} Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3261841a-a10c-46ba-8894-77e1e808de20 could not be found. Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3261841a-a10c-46ba-8894-77e1e808de20 could not be found. Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:08.959751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.963621 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:08.963621 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:08.963621 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:08.963621 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:08.963621 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:08.963621 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3261841a-a10c-46ba-8894-77e1e808de20 could not be found. Jul 20 04:29:08.963621 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:08.963621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f767e435-037d-4453-b26e-d0c1208ea501 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance 3261841a-a10c-46ba-8894-77e1e808de20 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:08.963621 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f767e435-037d-4453-b26e-d0c1208ea501 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/3261841a-a10c-46ba-8894-77e1e808de20" status: 404 len: 111 microversion: 2.1 time: 0.064342 Jul 20 04:29:08.963621 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1574/3366] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:08 2022] GET /compute/v2.1/servers/3261841a-a10c-46ba-8894-77e1e808de20 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:08.980559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1608bdbb-8655-40f1-a47f-9437ad225a60 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be0b1f70>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:09.070209 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1608bdbb-8655-40f1-a47f-9437ad225a60 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.117181 Jul 20 04:29:09.071609 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1793/3367] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:08 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:09.909254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7e3c5e36-71d7-44d2-85c1-c49dbae40443 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:09.910951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7e3c5e36-71d7-44d2-85c1-c49dbae40443 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:09.939842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e3c5e36-71d7-44d2-85c1-c49dbae40443 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:09.941114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e3c5e36-71d7-44d2-85c1-c49dbae40443 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:09.945805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e3c5e36-71d7-44d2-85c1-c49dbae40443 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:09.948975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e3c5e36-71d7-44d2-85c1-c49dbae40443 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:10.087140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5e97562e-3958-4c17-925a-8a0d8cd01559 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdf22790>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:10.176370 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5e97562e-3958-4c17-925a-8a0d8cd01559 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.095722 Jul 20 04:29:10.181152 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1794/3368] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:10 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:11.194517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ac06b056-e346-4983-8d36-d824e2e9c2d4 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be0deee0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:11.209657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7e3c5e36-71d7-44d2-85c1-c49dbae40443 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:11.246913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7e3c5e36-71d7-44d2-85c1-c49dbae40443 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:11.249594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7e3c5e36-71d7-44d2-85c1-c49dbae40443 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:11.251039 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7e3c5e36-71d7-44d2-85c1-c49dbae40443 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.347876 Jul 20 04:29:11.251818 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1575/3369] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:09 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:11.311029 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ac06b056-e346-4983-8d36-d824e2e9c2d4 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.122339 Jul 20 04:29:11.311770 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1795/3370] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:11 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:12.271489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2260d550-f4af-4338-8bae-aa92a08715ee tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:12.282336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2260d550-f4af-4338-8bae-aa92a08715ee tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:12.301485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2260d550-f4af-4338-8bae-aa92a08715ee tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.301938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2260d550-f4af-4338-8bae-aa92a08715ee tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:12.305053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2260d550-f4af-4338-8bae-aa92a08715ee tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.305692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2260d550-f4af-4338-8bae-aa92a08715ee tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:12.326831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9fce1095-d760-492a-a305-06946ebcc09b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdf301f0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:12.436640 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9fce1095-d760-492a-a305-06946ebcc09b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.116432 Jul 20 04:29:12.444881 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1796/3371] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:12 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:12.936339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2260d550-f4af-4338-8bae-aa92a08715ee tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:12.946680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2260d550-f4af-4338-8bae-aa92a08715ee tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:12.954006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2260d550-f4af-4338-8bae-aa92a08715ee tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:12.957048 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2260d550-f4af-4338-8bae-aa92a08715ee tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 0.689985 Jul 20 04:29:12.960391 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1576/3372] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:12 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:13.451793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fd927121-bea4-4538-9e9c-76c0cb2e0a43 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdee6af0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:13.527920 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fd927121-bea4-4538-9e9c-76c0cb2e0a43 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.081178 Jul 20 04:29:13.540655 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1797/3373] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:13 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:13.981299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b1aadd13-0fac-4f5a-9f35-35e90fa5135b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:13.983434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b1aadd13-0fac-4f5a-9f35-35e90fa5135b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:14.027612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1aadd13-0fac-4f5a-9f35-35e90fa5135b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:14.040759 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1aadd13-0fac-4f5a-9f35-35e90fa5135b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:14.053084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1aadd13-0fac-4f5a-9f35-35e90fa5135b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:14.054100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1aadd13-0fac-4f5a-9f35-35e90fa5135b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:14.549776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ff45574b-94f0-42b8-b215-0b3054946f46 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdf39af0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:14.636033 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ff45574b-94f0-42b8-b215-0b3054946f46 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.091600 Jul 20 04:29:14.644687 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1798/3374] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:14 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:15.199323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b1aadd13-0fac-4f5a-9f35-35e90fa5135b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:15.230375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b1aadd13-0fac-4f5a-9f35-35e90fa5135b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:15.277428 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b1aadd13-0fac-4f5a-9f35-35e90fa5135b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:15.286915 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b1aadd13-0fac-4f5a-9f35-35e90fa5135b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.312300 Jul 20 04:29:15.292727 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1577/3375] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:13 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:15.660903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-091b12e7-affa-4f62-9ae8-9c2fb54b24e8 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be09a0d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:15.858030 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-091b12e7-affa-4f62-9ae8-9c2fb54b24e8 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.203732 Jul 20 04:29:15.864582 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1799/3376] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:15 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:16.312004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-19b73ec8-6fec-49ef-a6ee-7d041162ae44 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:16.312652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-19b73ec8-6fec-49ef-a6ee-7d041162ae44 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:16.327593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=38 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:16.329328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19b73ec8-6fec-49ef-a6ee-7d041162ae44 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:16.329781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19b73ec8-6fec-49ef-a6ee-7d041162ae44 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:16.330569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19b73ec8-6fec-49ef-a6ee-7d041162ae44 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:16.331003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19b73ec8-6fec-49ef-a6ee-7d041162ae44 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:16.885067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1fc02dd0-9080-4c7b-8bd8-61025154f8b4 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be47ddc0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:17.045467 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1fc02dd0-9080-4c7b-8bd8-61025154f8b4 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.176620 Jul 20 04:29:17.052741 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1800/3377] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:16 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:17.240860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6e1032af-2201-4cf4-aea8-75a54bf8bf9f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:17.241563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6e1032af-2201-4cf4-aea8-75a54bf8bf9f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:17.259578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:17.276167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e1032af-2201-4cf4-aea8-75a54bf8bf9f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.290126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e1032af-2201-4cf4-aea8-75a54bf8bf9f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.307393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e1032af-2201-4cf4-aea8-75a54bf8bf9f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.309316 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e1032af-2201-4cf4-aea8-75a54bf8bf9f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.405695 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-6e1032af-2201-4cf4-aea8-75a54bf8bf9f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6e1032af-2201-4cf4-aea8-75a54bf8bf9f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 HTTP/1.1 Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'eea2e899-5a11-4761-b515-230f5e741f57'} Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:17.430854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:17.435024 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:29:17.435024 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.435024 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:17.435024 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.435024 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:17.435024 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:17.435024 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:17.435024 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:17.435024 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:17.435024 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:29:17.435024 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.435024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6e1032af-2201-4cf4-aea8-75a54bf8bf9f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:17.435024 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6e1032af-2201-4cf4-aea8-75a54bf8bf9f tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "DELETE /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 404 len: 111 microversion: 2.1 time: 0.199779 Jul 20 04:29:17.446482 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1801/3378] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:29:17 2022] DELETE /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:17.489659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3f692bb5-8b03-40c0-9ac5-4b2744debb58 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:17.490572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3f692bb5-8b03-40c0-9ac5-4b2744debb58 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: eea2e899-5a11-4761-b515-230f5e741f57] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:17.536810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f692bb5-8b03-40c0-9ac5-4b2744debb58 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.541351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f692bb5-8b03-40c0-9ac5-4b2744debb58 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.542232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f692bb5-8b03-40c0-9ac5-4b2744debb58 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.542693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f692bb5-8b03-40c0-9ac5-4b2744debb58 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.652621 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-3f692bb5-8b03-40c0-9ac5-4b2744debb58 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3f692bb5-8b03-40c0-9ac5-4b2744debb58 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 HTTP/1.1 Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'eea2e899-5a11-4761-b515-230f5e741f57'} Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:17.654235 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.657828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:17.657828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:17.657828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:17.657828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:17.657828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:17.657828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. Jul 20 04:29:17.657828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.679898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3f692bb5-8b03-40c0-9ac5-4b2744debb58 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance eea2e899-5a11-4761-b515-230f5e741f57 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:17.681813 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3f692bb5-8b03-40c0-9ac5-4b2744debb58 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57" status: 404 len: 111 microversion: 2.1 time: 0.225165 Jul 20 04:29:17.683165 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1802/3379] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:17 2022] GET /compute/v2.1/servers/eea2e899-5a11-4761-b515-230f5e741f57 => generated 111 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:29:17.702311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-19b73ec8-6fec-49ef-a6ee-7d041162ae44 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:17.710104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cb05414e-b985-4025-83cc-b42055c955e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:17.715524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cb05414e-b985-4025-83cc-b42055c955e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:17.733718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-19b73ec8-6fec-49ef-a6ee-7d041162ae44 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:17.740975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-19b73ec8-6fec-49ef-a6ee-7d041162ae44 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:17.746164 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-19b73ec8-6fec-49ef-a6ee-7d041162ae44 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.436192 Jul 20 04:29:17.748424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb05414e-b985-4025-83cc-b42055c955e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.751864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb05414e-b985-4025-83cc-b42055c955e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.755860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb05414e-b985-4025-83cc-b42055c955e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.757733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb05414e-b985-4025-83cc-b42055c955e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.760641 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1578/3380] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:16 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:17.851484 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-cb05414e-b985-4025-83cc-b42055c955e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 could not be found. Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cb05414e-b985-4025-83cc-b42055c955e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 HTTP/1.1 Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 could not be found. Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '5b271cf2-d6b2-479e-8422-2edba3000fa2'} Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 could not be found. Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:17.859135 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:17.863268 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 could not be found. Jul 20 04:29:17.863268 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.863268 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:17.863268 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.863268 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:17.863268 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:17.863268 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:17.863268 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:17.863268 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:17.863268 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 could not be found. Jul 20 04:29:17.863268 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.871192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cb05414e-b985-4025-83cc-b42055c955e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:17.878429 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cb05414e-b985-4025-83cc-b42055c955e5 tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 404 len: 111 microversion: 2.1 time: 0.188209 Jul 20 04:29:17.883783 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1803/3381] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:29:17 2022] DELETE /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:17.892683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9efe0439-a2f9-4b12-aa86-395fd70b402c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:17.893889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9efe0439-a2f9-4b12-aa86-395fd70b402c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] [instance: 5b271cf2-d6b2-479e-8422-2edba3000fa2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:17.915112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9efe0439-a2f9-4b12-aa86-395fd70b402c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.916381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9efe0439-a2f9-4b12-aa86-395fd70b402c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.921568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9efe0439-a2f9-4b12-aa86-395fd70b402c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.926487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9efe0439-a2f9-4b12-aa86-395fd70b402c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:18.001759 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-9efe0439-a2f9-4b12-aa86-395fd70b402c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] HTTP exception thrown: Instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 could not be found. Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9efe0439-a2f9-4b12-aa86-395fd70b402c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Request method failure captured: Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 HTTP/1.1 Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14MKOT0O3XoGZp0xSCMqslG65YvPFoIB3vrLi7TCEH3qKkZdeggsa52ZS2rhcYR54lo4n7lsPT5vICLhGJKxhIwQOXM5ig9M4jjMS97XSRQJsaZuZ0GgUd12LTFPAzy3lh_-xuMYJz1qNvIiBZxyvSvja5QxpaFvh_R6tILTQzASTrI Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ae67de1fefe64bd19a3bf614f02d3535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ae67de1fefe64bd19a3bf614f02d3535", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ae67de1fefe64bd19a3bf614f02d3535"}]}] Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: ae67de1fefe64bd19a3bf614f02d3535 Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-DeleteServersTestJSON-1917183491 Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 1dc60058bea0485ebd4d502b2e7c986b Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-DeleteServersTestJSON-1917183491-project Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 could not be found. Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '5b271cf2-d6b2-479e-8422-2edba3000fa2'} Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 could not be found. Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 could not be found. Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:18.005863 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:18.009416 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:18.009416 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:18.009416 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:18.009416 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:18.009416 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:18.009416 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 could not be found. Jul 20 04:29:18.009416 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:18.016738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9efe0439-a2f9-4b12-aa86-395fd70b402c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] Returning 404 to user: Instance 5b271cf2-d6b2-479e-8422-2edba3000fa2 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:18.018095 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9efe0439-a2f9-4b12-aa86-395fd70b402c tempest-DeleteServersTestJSON-1917183491 tempest-DeleteServersTestJSON-1917183491-project] 10.222.0.17 "GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2" status: 404 len: 111 microversion: 2.1 time: 0.130316 Jul 20 04:29:18.028924 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1579/3382] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:17 2022] GET /compute/v2.1/servers/5b271cf2-d6b2-479e-8422-2edba3000fa2 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:18.064866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-acb439ac-00f3-4e6f-b1a6-e5eb830df45b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bd49c9d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:18.239991 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-acb439ac-00f3-4e6f-b1a6-e5eb830df45b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.178747 Jul 20 04:29:18.252984 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1804/3383] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:18 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:18.792033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ba4c99e9-f0e9-40dc-ba33-ca5ac589637f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:18.792704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ba4c99e9-f0e9-40dc-ba33-ca5ac589637f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:18.826437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba4c99e9-f0e9-40dc-ba33-ca5ac589637f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:18.829240 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba4c99e9-f0e9-40dc-ba33-ca5ac589637f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:18.834060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba4c99e9-f0e9-40dc-ba33-ca5ac589637f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:18.843074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba4c99e9-f0e9-40dc-ba33-ca5ac589637f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.269394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-33912062-fc51-41d5-b25d-5ee8676f94be tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be0e9040>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:19.417492 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-33912062-fc51-41d5-b25d-5ee8676f94be tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.154389 Jul 20 04:29:19.439586 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1805/3384] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:19 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:20.452661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f7d918d0-055e-4621-b137-c176601410cf tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bddbbdc0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.608585 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f7d918d0-055e-4621-b137-c176601410cf tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.164326 Jul 20 04:29:20.619386 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1806/3385] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:20 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:20.665347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ba4c99e9-f0e9-40dc-ba33-ca5ac589637f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:20.675896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ba4c99e9-f0e9-40dc-ba33-ca5ac589637f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:20.687970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ba4c99e9-f0e9-40dc-ba33-ca5ac589637f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:20.689296 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ba4c99e9-f0e9-40dc-ba33-ca5ac589637f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.916258 Jul 20 04:29:20.689970 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1580/3386] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:18 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:21.626632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-245402ee-3877-41c6-93aa-d660a9661301 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be07fa60>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:21.690893 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-245402ee-3877-41c6-93aa-d660a9661301 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.071722 Jul 20 04:29:21.694121 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1807/3387] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:21 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:21.717751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-778a47ae-02d2-4a81-9032-0cf30b85e118 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:21.719114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-778a47ae-02d2-4a81-9032-0cf30b85e118 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:21.727568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-778a47ae-02d2-4a81-9032-0cf30b85e118 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.728417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-778a47ae-02d2-4a81-9032-0cf30b85e118 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.729474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-778a47ae-02d2-4a81-9032-0cf30b85e118 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.730500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-778a47ae-02d2-4a81-9032-0cf30b85e118 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:22.596173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-778a47ae-02d2-4a81-9032-0cf30b85e118 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:22.619039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-778a47ae-02d2-4a81-9032-0cf30b85e118 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:22.630416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-778a47ae-02d2-4a81-9032-0cf30b85e118 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:22.633058 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-778a47ae-02d2-4a81-9032-0cf30b85e118 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 0.921715 Jul 20 04:29:22.660712 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1581/3388] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:21 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:22.709492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-23e5bd0d-565d-4b89-ab3d-0919c507525f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bd3a5700>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:22.845416 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-23e5bd0d-565d-4b89-ab3d-0919c507525f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.140552 Jul 20 04:29:22.853437 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1808/3389] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:22 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:23.670843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2fb3c42a-e2fd-4dd5-af59-5c58ee24f490 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:23.671619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2fb3c42a-e2fd-4dd5-af59-5c58ee24f490 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:23.692714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2fb3c42a-e2fd-4dd5-af59-5c58ee24f490 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:23.693266 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2fb3c42a-e2fd-4dd5-af59-5c58ee24f490 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:23.696313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2fb3c42a-e2fd-4dd5-af59-5c58ee24f490 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:23.698260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2fb3c42a-e2fd-4dd5-af59-5c58ee24f490 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:23.766385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:23.866283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f3fecc9b-7770-4d87-afe6-1f5d3d0ead0a tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be07f9d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:24.057474 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f3fecc9b-7770-4d87-afe6-1f5d3d0ead0a tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.199471 Jul 20 04:29:24.069858 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1809/3390] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:23 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:24.646156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2fb3c42a-e2fd-4dd5-af59-5c58ee24f490 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:24.698416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2fb3c42a-e2fd-4dd5-af59-5c58ee24f490 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:24.706949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2fb3c42a-e2fd-4dd5-af59-5c58ee24f490 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:24.717618 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2fb3c42a-e2fd-4dd5-af59-5c58ee24f490 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.051611 Jul 20 04:29:24.727895 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1582/3391] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:23 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:25.085360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-477ce3b9-34e6-40b9-9d09-2b33f5303b4b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bddbb160>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:25.272594 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-477ce3b9-34e6-40b9-9d09-2b33f5303b4b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.183680 Jul 20 04:29:25.277117 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1810/3392] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:25 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:25.747281 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c30faa05-13c9-41fe-9e14-e709e0121a18 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:25.748981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c30faa05-13c9-41fe-9e14-e709e0121a18 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:25.773161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c30faa05-13c9-41fe-9e14-e709e0121a18 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:25.773903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c30faa05-13c9-41fe-9e14-e709e0121a18 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:25.777657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c30faa05-13c9-41fe-9e14-e709e0121a18 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:25.778405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c30faa05-13c9-41fe-9e14-e709e0121a18 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:26.299164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-49b66e8b-ca9a-4993-b5a5-d38e94e5c224 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be0e9820>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:26.301289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c30faa05-13c9-41fe-9e14-e709e0121a18 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:26.332125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c30faa05-13c9-41fe-9e14-e709e0121a18 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:26.333800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c30faa05-13c9-41fe-9e14-e709e0121a18 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:26.343403 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c30faa05-13c9-41fe-9e14-e709e0121a18 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 0.600188 Jul 20 04:29:26.357770 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1583/3393] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:25 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:26.393385 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-49b66e8b-ca9a-4993-b5a5-d38e94e5c224 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.102977 Jul 20 04:29:26.399330 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1811/3394] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:26 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:27.378038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d8feb7e-b151-42bd-881b-7908516f41c9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:27.397957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d8feb7e-b151-42bd-881b-7908516f41c9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:27.412385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1ddd65ac-b95f-4e8e-babd-77a59eeef0bc tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be5aae50>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:27.466512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d8feb7e-b151-42bd-881b-7908516f41c9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:27.467595 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d8feb7e-b151-42bd-881b-7908516f41c9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:27.469904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d8feb7e-b151-42bd-881b-7908516f41c9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:27.470695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d8feb7e-b151-42bd-881b-7908516f41c9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:27.575345 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1ddd65ac-b95f-4e8e-babd-77a59eeef0bc tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.170772 Jul 20 04:29:27.576770 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1812/3395] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:27 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:28.585777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=5 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:28.587577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:28.595398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-39bdbab2-986a-4503-a7ab-0d08ba03eb92 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be0e9700>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:28.708343 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-39bdbab2-986a-4503-a7ab-0d08ba03eb92 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.123093 Jul 20 04:29:28.728501 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1813/3396] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:28 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:28.829278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d8feb7e-b151-42bd-881b-7908516f41c9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:28.845568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d8feb7e-b151-42bd-881b-7908516f41c9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:28.853826 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d8feb7e-b151-42bd-881b-7908516f41c9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:28.862883 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d8feb7e-b151-42bd-881b-7908516f41c9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.496479 Jul 20 04:29:28.864535 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1584/3397] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:27 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:29.737611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-34add379-4d42-4502-a7e7-950071992dff tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bddbb9d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:29.823057 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-34add379-4d42-4502-a7e7-950071992dff tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.089527 Jul 20 04:29:29.823686 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1814/3398] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:29 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:29.883314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-26716e88-d5fc-4a4e-9194-d574d567fac6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:29.883939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-26716e88-d5fc-4a4e-9194-d574d567fac6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:29.898262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26716e88-d5fc-4a4e-9194-d574d567fac6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:29.898723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26716e88-d5fc-4a4e-9194-d574d567fac6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:29.899520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26716e88-d5fc-4a4e-9194-d574d567fac6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:29.900035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26716e88-d5fc-4a4e-9194-d574d567fac6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:30.342906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-019dc4e1-9c72-4007-bed9-aca76b62a88d tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:30.343704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-019dc4e1-9c72-4007-bed9-aca76b62a88d tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:30.361017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-26716e88-d5fc-4a4e-9194-d574d567fac6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:30.365449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-019dc4e1-9c72-4007-bed9-aca76b62a88d tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:30.371988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-26716e88-d5fc-4a4e-9194-d574d567fac6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:30.373488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-019dc4e1-9c72-4007-bed9-aca76b62a88d tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:30.375294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-019dc4e1-9c72-4007-bed9-aca76b62a88d tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:30.381511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-019dc4e1-9c72-4007-bed9-aca76b62a88d tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:30.389407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-26716e88-d5fc-4a4e-9194-d574d567fac6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:30.400881 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-26716e88-d5fc-4a4e-9194-d574d567fac6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 0.515239 Jul 20 04:29:30.415819 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1585/3399] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:29 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:30.440955 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-019dc4e1-9c72-4007-bed9-aca76b62a88d tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:29:30.579123 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-019dc4e1-9c72-4007-bed9-aca76b62a88d tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16" status: 204 len: 0 microversion: 2.1 time: 0.240003 Jul 20 04:29:30.580618 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1815/3400] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:29:30 2022] DELETE /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:29:30.591261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cdb56a4e-b6a5-4037-a945-886747ed848f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:30.591903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cdb56a4e-b6a5-4037-a945-886747ed848f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:30.612055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdb56a4e-b6a5-4037-a945-886747ed848f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:30.612870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdb56a4e-b6a5-4037-a945-886747ed848f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:30.613874 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdb56a4e-b6a5-4037-a945-886747ed848f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:30.614508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdb56a4e-b6a5-4037-a945-886747ed848f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:30.809799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cdb56a4e-b6a5-4037-a945-886747ed848f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bde7d1dd74c0da55025a63131897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd9c3c8c865481cadc7099860706164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:30.820071 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cdb56a4e-b6a5-4037-a945-886747ed848f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16" status: 200 len: 1663 microversion: 2.1 time: 0.234305 Jul 20 04:29:30.820958 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1586/3401] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:30 2022] GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 => generated 1663 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:30.837407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9a4b8cea-ff53-4ae1-a6d9-414d42f80be6 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdda6040>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:30.958058 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9a4b8cea-ff53-4ae1-a6d9-414d42f80be6 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.125246 Jul 20 04:29:30.959053 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1816/3402] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:30 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:31.431893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c67f9808-8185-40dd-9e65-c7a5a7bbaa4b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:31.435568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c67f9808-8185-40dd-9e65-c7a5a7bbaa4b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:31.457860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c67f9808-8185-40dd-9e65-c7a5a7bbaa4b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:31.460162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c67f9808-8185-40dd-9e65-c7a5a7bbaa4b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:31.464007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c67f9808-8185-40dd-9e65-c7a5a7bbaa4b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:31.467298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c67f9808-8185-40dd-9e65-c7a5a7bbaa4b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:31.839478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-646320d0-9395-4b77-b5b0-23bb42cb9096 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:31.840374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-646320d0-9395-4b77-b5b0-23bb42cb9096 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:31.864476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-646320d0-9395-4b77-b5b0-23bb42cb9096 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:31.865111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-646320d0-9395-4b77-b5b0-23bb42cb9096 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:31.866107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-646320d0-9395-4b77-b5b0-23bb42cb9096 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:31.870258 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-646320d0-9395-4b77-b5b0-23bb42cb9096 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:32.363132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c67f9808-8185-40dd-9e65-c7a5a7bbaa4b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:32.387712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c67f9808-8185-40dd-9e65-c7a5a7bbaa4b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:32.400511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c67f9808-8185-40dd-9e65-c7a5a7bbaa4b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:32.412516 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c67f9808-8185-40dd-9e65-c7a5a7bbaa4b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 0.979684 Jul 20 04:29:32.415079 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1587/3403] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:31 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:32.450070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9b7fd059-9b81-4402-9531-5556398aefc7 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be2f8dc0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:32.553729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-646320d0-9395-4b77-b5b0-23bb42cb9096 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bde7d1dd74c0da55025a63131897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd9c3c8c865481cadc7099860706164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:32.566346 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-646320d0-9395-4b77-b5b0-23bb42cb9096 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16" status: 200 len: 1663 microversion: 2.1 time: 0.732189 Jul 20 04:29:32.569403 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9b7fd059-9b81-4402-9531-5556398aefc7 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.132372 Jul 20 04:29:32.570141 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1588/3404] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:32 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:32.579427 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1817/3405] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:31 2022] GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 => generated 1663 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:33.440889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b5950458-7e79-4fe4-b4e8-507d84979162 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:33.441977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b5950458-7e79-4fe4-b4e8-507d84979162 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:33.466617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b5950458-7e79-4fe4-b4e8-507d84979162 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:33.470603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b5950458-7e79-4fe4-b4e8-507d84979162 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:33.480008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b5950458-7e79-4fe4-b4e8-507d84979162 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:33.481209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b5950458-7e79-4fe4-b4e8-507d84979162 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:33.585328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d674503e-5dd5-47c2-93ef-145b57f10046 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdd3a9d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:33.677119 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d674503e-5dd5-47c2-93ef-145b57f10046 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.097739 Jul 20 04:29:33.678199 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1818/3406] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:33 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:33.692358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8929e78e-b4b4-419e-9358-3c404f320c6e tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:33.693335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8929e78e-b4b4-419e-9358-3c404f320c6e tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:33.713856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8929e78e-b4b4-419e-9358-3c404f320c6e tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:33.714738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8929e78e-b4b4-419e-9358-3c404f320c6e tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:33.715795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8929e78e-b4b4-419e-9358-3c404f320c6e tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:33.717553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8929e78e-b4b4-419e-9358-3c404f320c6e tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:34.512438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8929e78e-b4b4-419e-9358-3c404f320c6e tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bde7d1dd74c0da55025a63131897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd9c3c8c865481cadc7099860706164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:34.532625 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8929e78e-b4b4-419e-9358-3c404f320c6e tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16" status: 200 len: 1663 microversion: 2.1 time: 0.853044 Jul 20 04:29:34.537176 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1819/3407] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:33 2022] GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 => generated 1663 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:34.695159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-13966690-73c0-49ca-bdd8-04d0fcbc154b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be3eee50>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:34.784967 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-13966690-73c0-49ca-bdd8-04d0fcbc154b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1452 microversion: 2.1 time: 0.097421 Jul 20 04:29:34.792919 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1820/3408] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:34 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:35.112706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b5950458-7e79-4fe4-b4e8-507d84979162 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:35.130473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b5950458-7e79-4fe4-b4e8-507d84979162 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:35.131968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b5950458-7e79-4fe4-b4e8-507d84979162 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:35.133174 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b5950458-7e79-4fe4-b4e8-507d84979162 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.697878 Jul 20 04:29:35.134085 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1589/3409] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:33 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:35.556076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-db63fa1c-eb4f-4c9a-9e4e-47009089ce20 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:35.557756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-db63fa1c-eb4f-4c9a-9e4e-47009089ce20 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:35.576759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db63fa1c-eb4f-4c9a-9e4e-47009089ce20 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:35.577699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db63fa1c-eb4f-4c9a-9e4e-47009089ce20 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:35.578786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db63fa1c-eb4f-4c9a-9e4e-47009089ce20 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:35.580295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db63fa1c-eb4f-4c9a-9e4e-47009089ce20 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:35.799144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c74e1abf-4a01-400a-b496-d7aec7ba84f7 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06c741a0d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:35.869853 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c74e1abf-4a01-400a-b496-d7aec7ba84f7 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1461 microversion: 2.1 time: 0.074569 Jul 20 04:29:35.871003 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1590/3410] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:35 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1461 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:35.887386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-31e6fe90-6981-4ea8-81a6-074b62696de0 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bddf3040>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:35.973951 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-31e6fe90-6981-4ea8-81a6-074b62696de0 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 200 len: 1461 microversion: 2.1 time: 0.090775 Jul 20 04:29:35.974882 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1591/3411] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:35 2022] GET /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 1461 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:35.987929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-362d3160-ba4b-4483-a615-d95bc318c5e4 req-9b9091a4-0c6d-472a-a77f-f0500810a888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2494990e-0404-4826-99c9-cbe63a142b16", "name": "network-vif-unplugged", "status": "completed", "tag": "d532bee4-df8a-472a-9525-e2595f7f5a06"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:36.015632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-362d3160-ba4b-4483-a615-d95bc318c5e4 req-9b9091a4-0c6d-472a-a77f-f0500810a888 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:36.016410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-362d3160-ba4b-4483-a615-d95bc318c5e4 req-9b9091a4-0c6d-472a-a77f-f0500810a888 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:36.046065 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-362d3160-ba4b-4483-a615-d95bc318c5e4 req-9b9091a4-0c6d-472a-a77f-f0500810a888 service nova] Creating event network-vif-unplugged:d532bee4-df8a-472a-9525-e2595f7f5a06 for instance 2494990e-0404-4826-99c9-cbe63a142b16 on n-h1-826526-5 Jul 20 04:29:36.060900 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-362d3160-ba4b-4483-a615-d95bc318c5e4 req-9b9091a4-0c6d-472a-a77f-f0500810a888 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083434 Jul 20 04:29:36.080365 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1592/3412] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:36.086804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4da6af1a-b2f7-482e-91ad-0ce1305721a7 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:36.087859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4da6af1a-b2f7-482e-91ad-0ce1305721a7 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:36.108964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4da6af1a-b2f7-482e-91ad-0ce1305721a7 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:36.109776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4da6af1a-b2f7-482e-91ad-0ce1305721a7 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:36.111447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4da6af1a-b2f7-482e-91ad-0ce1305721a7 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:36.112237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4da6af1a-b2f7-482e-91ad-0ce1305721a7 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:36.558784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-db63fa1c-eb4f-4c9a-9e4e-47009089ce20 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bde7d1dd74c0da55025a63131897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd9c3c8c865481cadc7099860706164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:36.571570 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-db63fa1c-eb4f-4c9a-9e4e-47009089ce20 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16" status: 200 len: 1663 microversion: 2.1 time: 1.021263 Jul 20 04:29:36.572161 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1821/3413] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:35 2022] GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 => generated 1663 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:36.585743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-28ef2673-3161-4402-ae74-b692e1ea23fd tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:36.589212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-28ef2673-3161-4402-ae74-b692e1ea23fd tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:36.606799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28ef2673-3161-4402-ae74-b692e1ea23fd tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:36.607263 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28ef2673-3161-4402-ae74-b692e1ea23fd tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:36.608421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28ef2673-3161-4402-ae74-b692e1ea23fd tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:36.608874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28ef2673-3161-4402-ae74-b692e1ea23fd tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:37.264130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-28ef2673-3161-4402-ae74-b692e1ea23fd tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:37.297990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-28ef2673-3161-4402-ae74-b692e1ea23fd tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:37.302538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-28ef2673-3161-4402-ae74-b692e1ea23fd tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:37.306486 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-28ef2673-3161-4402-ae74-b692e1ea23fd tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 0.728974 Jul 20 04:29:37.308908 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1822/3414] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:36 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:37.382779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-1c8ce440-ab60-4c02-bbee-246ade9a3e77 req-60e049d3-07a9-4031-b342-373af5c0d914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2494990e-0404-4826-99c9-cbe63a142b16", "name": "network-vif-deleted", "tag": "d532bee4-df8a-472a-9525-e2595f7f5a06"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:37.430113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1c8ce440-ab60-4c02-bbee-246ade9a3e77 req-60e049d3-07a9-4031-b342-373af5c0d914 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:37.431047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1c8ce440-ab60-4c02-bbee-246ade9a3e77 req-60e049d3-07a9-4031-b342-373af5c0d914 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:37.485142 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-1c8ce440-ab60-4c02-bbee-246ade9a3e77 req-60e049d3-07a9-4031-b342-373af5c0d914 service nova] Creating event network-vif-deleted:d532bee4-df8a-472a-9525-e2595f7f5a06 for instance 2494990e-0404-4826-99c9-cbe63a142b16 on n-h1-826526-5 Jul 20 04:29:37.502575 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-1c8ce440-ab60-4c02-bbee-246ade9a3e77 req-60e049d3-07a9-4031-b342-373af5c0d914 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130892 Jul 20 04:29:37.503993 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1823/3415] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:29:37.599034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-42f62995-c886-47d8-9391-d9525df8ba48 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:37.602629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-42f62995-c886-47d8-9391-d9525df8ba48 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:37.628136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42f62995-c886-47d8-9391-d9525df8ba48 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:37.629263 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42f62995-c886-47d8-9391-d9525df8ba48 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:37.630926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42f62995-c886-47d8-9391-d9525df8ba48 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:37.631784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42f62995-c886-47d8-9391-d9525df8ba48 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:37.678090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4da6af1a-b2f7-482e-91ad-0ce1305721a7 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:37.695968 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4da6af1a-b2f7-482e-91ad-0ce1305721a7 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1466 microversion: 2.1 time: 1.613555 Jul 20 04:29:37.698356 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1593/3416] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:36 2022] GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1466 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:37.734348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-526cdc3a-e2c0-4e6d-afbc-7a2175d6ca9d tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1446854801"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:37.736741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-526cdc3a-e2c0-4e6d-afbc-7a2175d6ca9d tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:37.745531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42f62995-c886-47d8-9391-d9525df8ba48 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:37.748999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42f62995-c886-47d8-9391-d9525df8ba48 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:37.749529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-42f62995-c886-47d8-9391-d9525df8ba48 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lazy-loading 'fault' on Instance uuid 2494990e-0404-4826-99c9-cbe63a142b16 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:29:37.761096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-526cdc3a-e2c0-4e6d-afbc-7a2175d6ca9d tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:37.765629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-526cdc3a-e2c0-4e6d-afbc-7a2175d6ca9d tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:37.767873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-526cdc3a-e2c0-4e6d-afbc-7a2175d6ca9d tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:37.776957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-526cdc3a-e2c0-4e6d-afbc-7a2175d6ca9d tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:38.417434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-42f62995-c886-47d8-9391-d9525df8ba48 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bde7d1dd74c0da55025a63131897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd9c3c8c865481cadc7099860706164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:38.430711 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-42f62995-c886-47d8-9391-d9525df8ba48 tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16" status: 200 len: 1315 microversion: 2.1 time: 0.842864 Jul 20 04:29:38.433022 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1824/3417] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:37 2022] GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 => generated 1315 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:38.439125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-287331af-3f2b-4e61-97f2-08bbebdfe628 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:38.440052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-287331af-3f2b-4e61-97f2-08bbebdfe628 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:38.449027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-287331af-3f2b-4e61-97f2-08bbebdfe628 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:38.449835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-287331af-3f2b-4e61-97f2-08bbebdfe628 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:38.452603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-287331af-3f2b-4e61-97f2-08bbebdfe628 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:38.453372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-287331af-3f2b-4e61-97f2-08bbebdfe628 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:38.607810 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-526cdc3a-e2c0-4e6d-afbc-7a2175d6ca9d tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "POST /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b/action" status: 202 len: 0 microversion: 2.1 time: 0.880254 Jul 20 04:29:38.616693 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1594/3418] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:29:37 2022] POST /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b/action => generated 0 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:29:38.638432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9208ad7d-f891-4431-964f-dd43f078c49e tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be505670>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:38.753213 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9208ad7d-f891-4431-964f-dd43f078c49e tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.129051 Jul 20 04:29:38.758998 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1595/3419] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:38 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:39.455455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-29b522cc-24dc-4a59-ae62-a632c2c99cdb tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:39.456293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-29b522cc-24dc-4a59-ae62-a632c2c99cdb tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] [instance: 2494990e-0404-4826-99c9-cbe63a142b16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:39.483228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29b522cc-24dc-4a59-ae62-a632c2c99cdb tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:39.488812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29b522cc-24dc-4a59-ae62-a632c2c99cdb tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:39.490140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29b522cc-24dc-4a59-ae62-a632c2c99cdb tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:39.491216 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29b522cc-24dc-4a59-ae62-a632c2c99cdb tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:39.511039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-287331af-3f2b-4e61-97f2-08bbebdfe628 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:39.528881 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-29b522cc-24dc-4a59-ae62-a632c2c99cdb tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] HTTP exception thrown: Instance 2494990e-0404-4826-99c9-cbe63a142b16 could not be found. Jul 20 04:29:39.532677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-287331af-3f2b-4e61-97f2-08bbebdfe628 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-29b522cc-24dc-4a59-ae62-a632c2c99cdb tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Request method failure captured: Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 HTTP/1.1 Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14RP1suXTTrbqJSw-_Hco2miMu17mUAqijDoh9TQ7_xYjo1rmuoae_mCI6AAbOynFC5Co-T_NNPjMI98Z3Z4KaXmXczS0T7r62tITZ8HDk7Mo4h0XaPWBeqXGo-l9YEkAUURLu4-POHL7ZMlwgBYMJj7eQWQbvmJclR1uUlrGc3j7Jk Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 0fd9c3c8c865481cadc7099860706164 Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersTestFqdnHostnames-2021328757 Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fd9c3c8c865481cadc7099860706164"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0fd9c3c8c865481cadc7099860706164"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0fd9c3c8c865481cadc7099860706164", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fd9c3c8c865481cadc7099860706164"}]}] Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersTestFqdnHostnames-2021328757 Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 0fd9c3c8c865481cadc7099860706164 Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-2021328757 Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersTestFqdnHostnames-2021328757-project Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 9b9bde7d1dd74c0da55025a63131897e Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersTestFqdnHostnames-2021328757-project Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 2494990e-0404-4826-99c9-cbe63a142b16 could not be found. Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '2494990e-0404-4826-99c9-cbe63a142b16'} Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2494990e-0404-4826-99c9-cbe63a142b16 could not be found. Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2494990e-0404-4826-99c9-cbe63a142b16 could not be found. Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:39.534274 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:39.550217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:39.550217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:39.550217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:39.550217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:39.550217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:39.550217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2494990e-0404-4826-99c9-cbe63a142b16 could not be found. Jul 20 04:29:39.550217 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:39.550781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-287331af-3f2b-4e61-97f2-08bbebdfe628 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:39.550781 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-287331af-3f2b-4e61-97f2-08bbebdfe628 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.101476 Jul 20 04:29:39.550781 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1825/3420] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:38 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:39.555125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-29b522cc-24dc-4a59-ae62-a632c2c99cdb tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Returning 404 to user: Instance 2494990e-0404-4826-99c9-cbe63a142b16 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:39.557116 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-29b522cc-24dc-4a59-ae62-a632c2c99cdb tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16" status: 404 len: 111 microversion: 2.1 time: 0.110494 Jul 20 04:29:39.560042 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1596/3421] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:39 2022] GET /compute/v2.1/servers/2494990e-0404-4826-99c9-cbe63a142b16 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:39.568719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-66f7c2c2-7a10-49b2-b070-650525b3276f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] Calling method '.version_select at 0x7f06be0f35e0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:39.607595 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-66f7c2c2-7a10-49b2-b070-650525b3276f tempest-ServersTestFqdnHostnames-2021328757 tempest-ServersTestFqdnHostnames-2021328757-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-128568005" status: 202 len: 0 microversion: 2.1 time: 0.043027 Jul 20 04:29:39.614078 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1826/3422] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jul 20 04:29:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-128568005 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:29:39.769580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cb24c94b-4f85-494f-8872-fb8c5a727a8a tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bddf3e50>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:39.835811 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cb24c94b-4f85-494f-8872-fb8c5a727a8a tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.071105 Jul 20 04:29:39.864697 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1597/3423] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:39 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:40.555463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-48802815-e6ab-4e9b-b43c-15969e01b6fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:40.557011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-48802815-e6ab-4e9b-b43c-15969e01b6fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:40.587178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48802815-e6ab-4e9b-b43c-15969e01b6fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:40.587858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48802815-e6ab-4e9b-b43c-15969e01b6fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:40.596985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-4fc57d76-dec9-4d90-9901-45c9ae1880bd req-81fb19dd-9c29-4780-8d6c-66a1e7d0a6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d12f9b2-058c-4fe2-964b-81217cb46489", "name": "network-vif-unplugged", "status": "completed", "tag": "09e0f809-5b7f-42cb-bbac-f315284f1a91"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:40.605842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48802815-e6ab-4e9b-b43c-15969e01b6fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:40.607524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48802815-e6ab-4e9b-b43c-15969e01b6fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:40.622420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4fc57d76-dec9-4d90-9901-45c9ae1880bd req-81fb19dd-9c29-4780-8d6c-66a1e7d0a6f1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:40.622809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4fc57d76-dec9-4d90-9901-45c9ae1880bd req-81fb19dd-9c29-4780-8d6c-66a1e7d0a6f1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:40.698056 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-4fc57d76-dec9-4d90-9901-45c9ae1880bd req-81fb19dd-9c29-4780-8d6c-66a1e7d0a6f1 service nova] Creating event network-vif-unplugged:09e0f809-5b7f-42cb-bbac-f315284f1a91 for instance 1d12f9b2-058c-4fe2-964b-81217cb46489 on n-h1-826526-5 Jul 20 04:29:40.722002 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-4fc57d76-dec9-4d90-9901-45c9ae1880bd req-81fb19dd-9c29-4780-8d6c-66a1e7d0a6f1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129888 Jul 20 04:29:40.728709 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1598/3424] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:40.882948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e740b7bc-1c32-4d4c-8068-e1b4c3cd228d tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be92d040>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:40.972544 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e740b7bc-1c32-4d4c-8068-e1b4c3cd228d tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.104129 Jul 20 04:29:40.983916 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1599/3425] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:40 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:41.826517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-48802815-e6ab-4e9b-b43c-15969e01b6fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:41.841346 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-48802815-e6ab-4e9b-b43c-15969e01b6fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:41.849820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-48802815-e6ab-4e9b-b43c-15969e01b6fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:41.853740 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-48802815-e6ab-4e9b-b43c-15969e01b6fc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.300035 Jul 20 04:29:41.853740 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1827/3426] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:40 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:41.992421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-038fb4f1-f654-4c8b-a5bd-5a442bbc21d0 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be143f70>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:42.069180 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-038fb4f1-f654-4c8b-a5bd-5a442bbc21d0 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.081050 Jul 20 04:29:42.069976 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1600/3427] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:41 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:42.873322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cc798df0-7ab1-4ec8-ba17-708dcc6d8200 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:42.874700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cc798df0-7ab1-4ec8-ba17-708dcc6d8200 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:42.893814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc798df0-7ab1-4ec8-ba17-708dcc6d8200 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:42.898677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc798df0-7ab1-4ec8-ba17-708dcc6d8200 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:42.899790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc798df0-7ab1-4ec8-ba17-708dcc6d8200 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:42.901185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc798df0-7ab1-4ec8-ba17-708dcc6d8200 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:43.086056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5db6a003-8556-4553-a668-7fdd6155868e tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be2dbee0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:43.218439 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5db6a003-8556-4553-a668-7fdd6155868e tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.138180 Jul 20 04:29:43.230173 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1601/3428] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:43 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:44.241831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3d6257a2-1c28-43ad-a839-254b04b9573b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be2cf430>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:44.361135 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3d6257a2-1c28-43ad-a839-254b04b9573b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.123992 Jul 20 04:29:44.362094 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1602/3429] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:44 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:44.380733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cc798df0-7ab1-4ec8-ba17-708dcc6d8200 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:44.409538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cc798df0-7ab1-4ec8-ba17-708dcc6d8200 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:44.417104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cc798df0-7ab1-4ec8-ba17-708dcc6d8200 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:44.423717 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cc798df0-7ab1-4ec8-ba17-708dcc6d8200 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.553307 Jul 20 04:29:44.426746 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1828/3430] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:42 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:44.685747 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7e995111-2c6d-4597-9c61-7af71a0c6972 tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1135088346", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:44.689306 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-7e995111-2c6d-4597-9c61-7af71a0c6972 tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] HTTP exception thrown: min_count must be <= max_count Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7e995111-2c6d-4597-9c61-7af71a0c6972 tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] Request method failure captured: Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 184 Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14S47k89rGJjBL7_Sa-a_bfUBVlpP3kwP9Eo4D6vaP1Q_UFgQL4GJp4qLtNPS7RsT8yqwK6FcX3CveKMlo7UIknEAq1fyQ278E5O0AfRZgzq972-4Bqdc7fwS80pRmd9uLEkYCLUY5XtNJnT2wjy-OyIwLPx7bJU7ss02ksw9y0RVDE Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 1bf0322818384689bb4cb95548cb9d33 Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-63038101 Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1bf0322818384689bb4cb95548cb9d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1bf0322818384689bb4cb95548cb9d33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1bf0322818384689bb4cb95548cb9d33", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1bf0322818384689bb4cb95548cb9d33"}]}] Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-63038101 Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 1bf0322818384689bb4cb95548cb9d33 Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-63038101 Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-MultipleCreateNegativeTestJSON-63038101-project Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: fa642c1a0cc44c399236324dac44e6f8 Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-63038101-project Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1135088346", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: exception: min_count must be <= max_count Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1135088346', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 20 04:29:44.693335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.699428 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7e995111-2c6d-4597-9c61-7af71a0c6972 tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] Returning 400 to user: min_count must be <= max_count {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:44.700950 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7e995111-2c6d-4597-9c61-7af71a0c6972 tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.209363 Jul 20 04:29:44.702094 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1603/3431] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:44 2022] POST /compute/v2.1/servers => generated 74 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:29:44.768294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a7eeeecf-78c6-4f77-b4f2-56e0a09c457f tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-185169494", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "max_count": 0}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a7eeeecf-78c6-4f77-b4f2-56e0a09c457f tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] Request method failure captured: Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 167 Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14S47k89rGJjBL7_Sa-a_bfUBVlpP3kwP9Eo4D6vaP1Q_UFgQL4GJp4qLtNPS7RsT8yqwK6FcX3CveKMlo7UIknEAq1fyQ278E5O0AfRZgzq972-4Bqdc7fwS80pRmd9uLEkYCLUY5XtNJnT2wjy-OyIwLPx7bJU7ss02ksw9y0RVDE Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 1bf0322818384689bb4cb95548cb9d33 Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-63038101 Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1bf0322818384689bb4cb95548cb9d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1bf0322818384689bb4cb95548cb9d33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1bf0322818384689bb4cb95548cb9d33", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1bf0322818384689bb4cb95548cb9d33"}]}] Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-63038101 Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 1bf0322818384689bb4cb95548cb9d33 Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-63038101 Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-MultipleCreateNegativeTestJSON-63038101-project Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: fa642c1a0cc44c399236324dac44e6f8 Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-63038101-project Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-185169494", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "max_count": 0}} Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-185169494', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'max_count': 0}}} Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 0 Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:29:44.772471 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:29:44.777053 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:29:44.777053 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:29:44.777053 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:29:44.777053 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:29:44.777053 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.777053 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:44.777053 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.777053 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:44.777053 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:44.777053 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:44.777053 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:29:44.777053 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:29:44.777053 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:29:44.777053 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.780994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a7eeeecf-78c6-4f77-b4f2-56e0a09c457f tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:44.783857 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a7eeeecf-78c6-4f77-b4f2-56e0a09c457f tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.022231 Jul 20 04:29:44.787325 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1829/3432] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:44 2022] POST /compute/v2.1/servers => generated 130 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:29:44.845776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e56a63db-db83-405c-8280-9500542b5413 tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-253062925", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "max_count": 2.5}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e56a63db-db83-405c-8280-9500542b5413 tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] Request method failure captured: Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 169 Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14S47k89rGJjBL7_Sa-a_bfUBVlpP3kwP9Eo4D6vaP1Q_UFgQL4GJp4qLtNPS7RsT8yqwK6FcX3CveKMlo7UIknEAq1fyQ278E5O0AfRZgzq972-4Bqdc7fwS80pRmd9uLEkYCLUY5XtNJnT2wjy-OyIwLPx7bJU7ss02ksw9y0RVDE Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 1bf0322818384689bb4cb95548cb9d33 Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-63038101 Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1bf0322818384689bb4cb95548cb9d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1bf0322818384689bb4cb95548cb9d33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1bf0322818384689bb4cb95548cb9d33", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1bf0322818384689bb4cb95548cb9d33"}]}] Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-63038101 Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 1bf0322818384689bb4cb95548cb9d33 Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-63038101 Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-MultipleCreateNegativeTestJSON-63038101-project Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: fa642c1a0cc44c399236324dac44e6f8 Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-63038101-project Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-253062925", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "max_count": 2.5}} Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-253062925', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'max_count': 2.5}}} Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 2.5 Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:29:44.849219 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:29:44.853166 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:29:44.853166 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:29:44.853166 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:29:44.853166 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:29:44.853166 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:29:44.853166 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.853166 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:44.853166 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.853166 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:44.853166 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:44.853166 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:44.853166 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:29:44.853166 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:29:44.853166 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:29:44.853166 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.856925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e56a63db-db83-405c-8280-9500542b5413 tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:44.858212 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e56a63db-db83-405c-8280-9500542b5413 tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017101 Jul 20 04:29:44.862590 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1604/3433] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:44 2022] POST /compute/v2.1/servers => generated 139 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:29:44.930436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-006b515e-3f34-4196-a4bb-c1c557a649bb tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1726055452", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "min_count": 0}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-006b515e-3f34-4196-a4bb-c1c557a649bb tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] Request method failure captured: Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 168 Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14S47k89rGJjBL7_Sa-a_bfUBVlpP3kwP9Eo4D6vaP1Q_UFgQL4GJp4qLtNPS7RsT8yqwK6FcX3CveKMlo7UIknEAq1fyQ278E5O0AfRZgzq972-4Bqdc7fwS80pRmd9uLEkYCLUY5XtNJnT2wjy-OyIwLPx7bJU7ss02ksw9y0RVDE Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 1bf0322818384689bb4cb95548cb9d33 Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-63038101 Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1bf0322818384689bb4cb95548cb9d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1bf0322818384689bb4cb95548cb9d33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1bf0322818384689bb4cb95548cb9d33", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1bf0322818384689bb4cb95548cb9d33"}]}] Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-63038101 Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 1bf0322818384689bb4cb95548cb9d33 Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-63038101 Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-MultipleCreateNegativeTestJSON-63038101-project Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: fa642c1a0cc44c399236324dac44e6f8 Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-63038101-project Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1726055452", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "min_count": 0}} Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1726055452', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'min_count': 0}}} Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 0 Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:29:44.933497 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:29:44.937781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:29:44.937781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:29:44.937781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:29:44.937781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:29:44.937781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.937781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:44.937781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.937781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:44.937781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:44.937781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:44.937781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:29:44.937781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:29:44.937781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:29:44.937781 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.939334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-006b515e-3f34-4196-a4bb-c1c557a649bb tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:44.940508 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-006b515e-3f34-4196-a4bb-c1c557a649bb tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.014873 Jul 20 04:29:44.952949 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1830/3434] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:44 2022] POST /compute/v2.1/servers => generated 130 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:29:45.011646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2cbf8359-ed0c-4437-b087-f2fec51d271b tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-129473321", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "min_count": 2.5}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2cbf8359-ed0c-4437-b087-f2fec51d271b tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] Request method failure captured: Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 169 Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14S47k89rGJjBL7_Sa-a_bfUBVlpP3kwP9Eo4D6vaP1Q_UFgQL4GJp4qLtNPS7RsT8yqwK6FcX3CveKMlo7UIknEAq1fyQ278E5O0AfRZgzq972-4Bqdc7fwS80pRmd9uLEkYCLUY5XtNJnT2wjy-OyIwLPx7bJU7ss02ksw9y0RVDE Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 1bf0322818384689bb4cb95548cb9d33 Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-63038101 Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1bf0322818384689bb4cb95548cb9d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1bf0322818384689bb4cb95548cb9d33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1bf0322818384689bb4cb95548cb9d33", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1bf0322818384689bb4cb95548cb9d33"}]}] Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-63038101 Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 1bf0322818384689bb4cb95548cb9d33 Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-63038101 Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-MultipleCreateNegativeTestJSON-63038101-project Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: fa642c1a0cc44c399236324dac44e6f8 Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-63038101-project Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-129473321", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "min_count": 2.5}} Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-129473321', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'min_count': 2.5}}} Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 2.5 Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:29:45.019188 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:29:45.024023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:29:45.024023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:29:45.024023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:29:45.024023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:29:45.024023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:29:45.024023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:45.024023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:45.024023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:45.024023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:45.024023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:45.024023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:45.024023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:29:45.024023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:29:45.024023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:29:45.024023 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:29:45.027559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2cbf8359-ed0c-4437-b087-f2fec51d271b tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:45.030650 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2cbf8359-ed0c-4437-b087-f2fec51d271b tempest-MultipleCreateNegativeTestJSON-63038101 tempest-MultipleCreateNegativeTestJSON-63038101-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.024729 Jul 20 04:29:45.039011 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1605/3435] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:45 2022] POST /compute/v2.1/servers => generated 139 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:29:45.378849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a328d883-98a6-432e-bd1c-1819037861e2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bddbb790>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:45.443552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-de2a01c4-b1eb-42c7-a094-9778c838c040 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:45.445317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-de2a01c4-b1eb-42c7-a094-9778c838c040 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:45.464203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de2a01c4-b1eb-42c7-a094-9778c838c040 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:45.466935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de2a01c4-b1eb-42c7-a094-9778c838c040 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:45.477912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de2a01c4-b1eb-42c7-a094-9778c838c040 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:45.478691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de2a01c4-b1eb-42c7-a094-9778c838c040 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:45.490808 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a328d883-98a6-432e-bd1c-1819037861e2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.118582 Jul 20 04:29:45.508566 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1831/3436] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:45 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:46.109537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-de2a01c4-b1eb-42c7-a094-9778c838c040 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:46.123011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-de2a01c4-b1eb-42c7-a094-9778c838c040 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:46.135684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-de2a01c4-b1eb-42c7-a094-9778c838c040 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:46.143794 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-de2a01c4-b1eb-42c7-a094-9778c838c040 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 0.704659 Jul 20 04:29:46.150233 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1606/3437] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:45 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:29:46.521955 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bcf09d02-b74e-431d-841c-d33bc0b78935 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be6b7ca0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:46.657614 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bcf09d02-b74e-431d-841c-d33bc0b78935 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.139863 Jul 20 04:29:46.658793 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1832/3438] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:46 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:47.164751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f888d991-41e8-4dfb-bb77-f09784f259f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:47.165381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f888d991-41e8-4dfb-bb77-f09784f259f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:47.195793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=34 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:47.204392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f888d991-41e8-4dfb-bb77-f09784f259f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:47.204905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f888d991-41e8-4dfb-bb77-f09784f259f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:47.205757 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f888d991-41e8-4dfb-bb77-f09784f259f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:47.206202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f888d991-41e8-4dfb-bb77-f09784f259f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:47.673230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b63d9fa-046f-4400-ab3f-00ee8e27efbd tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bddbb4c0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:47.756889 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9b63d9fa-046f-4400-ab3f-00ee8e27efbd tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.089648 Jul 20 04:29:47.758644 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1833/3439] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:47 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:48.715737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f888d991-41e8-4dfb-bb77-f09784f259f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:48.744098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f888d991-41e8-4dfb-bb77-f09784f259f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:48.746280 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f888d991-41e8-4dfb-bb77-f09784f259f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:48.773595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1c7fa3ef-aebd-469a-8664-290eccd7b1b5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be0de670>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:48.779971 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f888d991-41e8-4dfb-bb77-f09784f259f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.620507 Jul 20 04:29:48.785043 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1607/3440] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:47 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:48.862156 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1c7fa3ef-aebd-469a-8664-290eccd7b1b5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.094945 Jul 20 04:29:48.870221 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1834/3441] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:48 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:49.803794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e248c2f7-1273-44e4-b4cd-948bfcafa9b1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:49.805163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e248c2f7-1273-44e4-b4cd-948bfcafa9b1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:49.828042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e248c2f7-1273-44e4-b4cd-948bfcafa9b1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:49.832821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e248c2f7-1273-44e4-b4cd-948bfcafa9b1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:49.835732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e248c2f7-1273-44e4-b4cd-948bfcafa9b1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:49.842615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e248c2f7-1273-44e4-b4cd-948bfcafa9b1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:49.877190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1b9c507f-76b7-4296-9a07-f8f99a3971e4 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdd14310>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:49.999291 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1b9c507f-76b7-4296-9a07-f8f99a3971e4 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.127836 Jul 20 04:29:49.999877 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1835/3442] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:49 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:50.673340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e248c2f7-1273-44e4-b4cd-948bfcafa9b1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:50.688202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e248c2f7-1273-44e4-b4cd-948bfcafa9b1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:50.693254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e248c2f7-1273-44e4-b4cd-948bfcafa9b1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:50.696841 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e248c2f7-1273-44e4-b4cd-948bfcafa9b1 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 0.895880 Jul 20 04:29:50.700082 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1608/3443] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:49 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:51.018359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f83e39df-cc67-4b75-ab6f-0e412b4154ad tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bda678b0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:51.096190 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f83e39df-cc67-4b75-ab6f-0e412b4154ad tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.086317 Jul 20 04:29:51.107116 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1836/3444] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:51 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:51.716933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3bace60b-fbbf-4cc0-8cb6-b2b022177ff2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:51.718131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3bace60b-fbbf-4cc0-8cb6-b2b022177ff2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:51.758388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3bace60b-fbbf-4cc0-8cb6-b2b022177ff2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:51.768877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3bace60b-fbbf-4cc0-8cb6-b2b022177ff2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:51.774177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3bace60b-fbbf-4cc0-8cb6-b2b022177ff2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:51.782767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3bace60b-fbbf-4cc0-8cb6-b2b022177ff2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:52.118778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f993ea1c-2a8b-49bb-bbbc-93074a862a4d tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdf39280>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:52.295342 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f993ea1c-2a8b-49bb-bbbc-93074a862a4d tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.183870 Jul 20 04:29:52.296143 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1837/3445] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:52 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:52.751969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3bace60b-fbbf-4cc0-8cb6-b2b022177ff2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:52.783887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3bace60b-fbbf-4cc0-8cb6-b2b022177ff2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:52.791704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3bace60b-fbbf-4cc0-8cb6-b2b022177ff2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:52.796580 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3bace60b-fbbf-4cc0-8cb6-b2b022177ff2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.082520 Jul 20 04:29:52.798939 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1609/3446] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:51 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:53.317449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6c30efef-0fba-41ff-be42-a72fd5c248ee tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bda67f70>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:53.335587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:53.466865 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6c30efef-0fba-41ff-be42-a72fd5c248ee tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.158430 Jul 20 04:29:53.473344 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1838/3447] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:53 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:53.818262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d87a36c8-4c45-4ad2-a339-b82c6d7caf2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:53.818879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d87a36c8-4c45-4ad2-a339-b82c6d7caf2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:53.841191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d87a36c8-4c45-4ad2-a339-b82c6d7caf2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:53.843654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d87a36c8-4c45-4ad2-a339-b82c6d7caf2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.849201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d87a36c8-4c45-4ad2-a339-b82c6d7caf2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:53.849593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d87a36c8-4c45-4ad2-a339-b82c6d7caf2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.921735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:54.482611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-84b490e5-2705-40ed-884f-bb2a2b1d5cec tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bddbb9d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:54.492759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:54.599547 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-84b490e5-2705-40ed-884f-bb2a2b1d5cec tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.121933 Jul 20 04:29:54.603884 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1839/3448] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:54 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:54.838255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-af721203-716b-4234-853b-1a21b025e4a8 req-959e3956-e197-4aae-b8d1-dd9844f164cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "name": "network-vif-plugged", "status": "completed", "tag": "76dffb6b-943c-49a9-abbd-14d1036220db"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:54.899534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-af721203-716b-4234-853b-1a21b025e4a8 req-959e3956-e197-4aae-b8d1-dd9844f164cd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:54.900306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-af721203-716b-4234-853b-1a21b025e4a8 req-959e3956-e197-4aae-b8d1-dd9844f164cd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:54.963614 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-af721203-716b-4234-853b-1a21b025e4a8 req-959e3956-e197-4aae-b8d1-dd9844f164cd service nova] Creating event network-vif-plugged:76dffb6b-943c-49a9-abbd-14d1036220db for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:29:54.976430 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-af721203-716b-4234-853b-1a21b025e4a8 req-959e3956-e197-4aae-b8d1-dd9844f164cd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147339 Jul 20 04:29:54.980883 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1840/3449] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:55.250683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d87a36c8-4c45-4ad2-a339-b82c6d7caf2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:55.262995 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d87a36c8-4c45-4ad2-a339-b82c6d7caf2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:55.266261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d87a36c8-4c45-4ad2-a339-b82c6d7caf2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:55.280878 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d87a36c8-4c45-4ad2-a339-b82c6d7caf2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.468651 Jul 20 04:29:55.288181 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1610/3450] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:53 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:55.631834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-63ac0622-7972-4832-a8ee-ecfebfe9c8cc tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdded9d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:55.743304 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-63ac0622-7972-4832-a8ee-ecfebfe9c8cc tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.124466 Jul 20 04:29:55.743910 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1841/3451] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:55 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:56.313067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-595e7003-0e45-444f-9cd7-d0926dfb5d47 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:56.313699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-595e7003-0e45-444f-9cd7-d0926dfb5d47 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:56.343142 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-595e7003-0e45-444f-9cd7-d0926dfb5d47 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:56.343887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-595e7003-0e45-444f-9cd7-d0926dfb5d47 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:56.344791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-595e7003-0e45-444f-9cd7-d0926dfb5d47 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:56.345239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-595e7003-0e45-444f-9cd7-d0926dfb5d47 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:56.758241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b8a5b383-f5b0-46c6-8fc0-4027205333bb tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bda67b80>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:56.860732 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b8a5b383-f5b0-46c6-8fc0-4027205333bb tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.107091 Jul 20 04:29:56.861888 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1842/3452] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:56 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:57.193523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-595e7003-0e45-444f-9cd7-d0926dfb5d47 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:57.219415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-595e7003-0e45-444f-9cd7-d0926dfb5d47 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:57.250952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-595e7003-0e45-444f-9cd7-d0926dfb5d47 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:57.264563 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-595e7003-0e45-444f-9cd7-d0926dfb5d47 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 0.960696 Jul 20 04:29:57.265542 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1611/3453] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:56 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:57.875708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c82d667-1b0b-4898-9b26-09abd22a486b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bda673a0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:58.107463 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0c82d667-1b0b-4898-9b26-09abd22a486b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.230287 Jul 20 04:29:58.108172 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1843/3454] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:57 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:58.283944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7ce0ffd9-2f17-4655-8257-9ed7e8a6bb6a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:58.284599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7ce0ffd9-2f17-4655-8257-9ed7e8a6bb6a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:58.300447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ce0ffd9-2f17-4655-8257-9ed7e8a6bb6a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:58.310426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ce0ffd9-2f17-4655-8257-9ed7e8a6bb6a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:58.311980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ce0ffd9-2f17-4655-8257-9ed7e8a6bb6a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:58.315456 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ce0ffd9-2f17-4655-8257-9ed7e8a6bb6a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:59.123190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5e249c62-f881-4688-a164-229865763d2a tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdd3a040>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:59.224424 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5e249c62-f881-4688-a164-229865763d2a tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.106949 Jul 20 04:29:59.225059 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1844/3455] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:59 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:59.267975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-5adc4703-43d3-47d6-bb8a-03528ceb48fe req-5d5694b0-fd5f-447f-8570-04d122062efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "name": "network-vif-plugged", "status": "completed", "tag": "79dd747c-56b7-4275-b234-425b37c3aaf3"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:59.303498 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5adc4703-43d3-47d6-bb8a-03528ceb48fe req-5d5694b0-fd5f-447f-8570-04d122062efc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:59.305709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5adc4703-43d3-47d6-bb8a-03528ceb48fe req-5d5694b0-fd5f-447f-8570-04d122062efc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:59.341830 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-5adc4703-43d3-47d6-bb8a-03528ceb48fe req-5d5694b0-fd5f-447f-8570-04d122062efc service nova] Creating event network-vif-plugged:79dd747c-56b7-4275-b234-425b37c3aaf3 for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:29:59.354341 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-5adc4703-43d3-47d6-bb8a-03528ceb48fe req-5d5694b0-fd5f-447f-8570-04d122062efc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091453 Jul 20 04:29:59.363746 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1845/3456] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:29:59.373256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7ce0ffd9-2f17-4655-8257-9ed7e8a6bb6a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:59.403631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7ce0ffd9-2f17-4655-8257-9ed7e8a6bb6a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:59.405805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7ce0ffd9-2f17-4655-8257-9ed7e8a6bb6a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:59.407062 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7ce0ffd9-2f17-4655-8257-9ed7e8a6bb6a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.127188 Jul 20 04:29:59.424817 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1612/3457] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:58 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:00.243444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ab686399-ee6a-462d-83ac-c2c16d21aea6 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdded9d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:00.331414 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ab686399-ee6a-462d-83ac-c2c16d21aea6 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.095067 Jul 20 04:30:00.332241 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1846/3458] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:00 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:00.426368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-80c6f1c3-a4b0-47bc-b946-3d8acf84b81d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:00.427605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-80c6f1c3-a4b0-47bc-b946-3d8acf84b81d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:00.440341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80c6f1c3-a4b0-47bc-b946-3d8acf84b81d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:00.441098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80c6f1c3-a4b0-47bc-b946-3d8acf84b81d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:00.445395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80c6f1c3-a4b0-47bc-b946-3d8acf84b81d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:00.446044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80c6f1c3-a4b0-47bc-b946-3d8acf84b81d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.325109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-80c6f1c3-a4b0-47bc-b946-3d8acf84b81d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:01.346737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-90bc4343-d2d4-4c66-835d-93e63efbc495 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be47d820>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:01.365831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-80c6f1c3-a4b0-47bc-b946-3d8acf84b81d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:01.391347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-80c6f1c3-a4b0-47bc-b946-3d8acf84b81d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:01.393034 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-80c6f1c3-a4b0-47bc-b946-3d8acf84b81d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 0.971617 Jul 20 04:30:01.394816 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1613/3459] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:00 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:30:01.447759 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-90bc4343-d2d4-4c66-835d-93e63efbc495 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.105821 Jul 20 04:30:01.449351 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1847/3460] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:01 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:02.415241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-80d4f142-e636-4be1-adb2-e0ba4d43321a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:02.416242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-80d4f142-e636-4be1-adb2-e0ba4d43321a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:02.429105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80d4f142-e636-4be1-adb2-e0ba4d43321a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.437637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80d4f142-e636-4be1-adb2-e0ba4d43321a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.441121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80d4f142-e636-4be1-adb2-e0ba4d43321a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.443952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80d4f142-e636-4be1-adb2-e0ba4d43321a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.462671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-455159af-4024-4bca-a966-63933e4b9767 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bda673a0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:02.585600 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-455159af-4024-4bca-a966-63933e4b9767 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.127491 Jul 20 04:30:02.592507 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1848/3461] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:02 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:03.603417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-97ebf08b-782a-4214-9b91-6b838dfce80b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdee6af0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:03.717011 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-97ebf08b-782a-4214-9b91-6b838dfce80b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.120915 Jul 20 04:30:03.718299 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1849/3462] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:03 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:03.940636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-80d4f142-e636-4be1-adb2-e0ba4d43321a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:03.956576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-80d4f142-e636-4be1-adb2-e0ba4d43321a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:03.963660 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-80d4f142-e636-4be1-adb2-e0ba4d43321a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:03.969314 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-80d4f142-e636-4be1-adb2-e0ba4d43321a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.558043 Jul 20 04:30:03.970349 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1614/3463] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:02 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:04.739401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-796f5b29-ac10-46e0-bed7-6cc22da1db59 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdded9d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:04.843125 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-796f5b29-ac10-46e0-bed7-6cc22da1db59 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.115850 Jul 20 04:30:04.851052 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1850/3464] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:04 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:04.988687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-de7b4397-c405-4caa-a95c-35c2d5264c7c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:04.989482 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-de7b4397-c405-4caa-a95c-35c2d5264c7c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:05.008050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de7b4397-c405-4caa-a95c-35c2d5264c7c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.008760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de7b4397-c405-4caa-a95c-35c2d5264c7c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.009707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de7b4397-c405-4caa-a95c-35c2d5264c7c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.010263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de7b4397-c405-4caa-a95c-35c2d5264c7c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.413859 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-2a7d24e1-5eff-4a47-b24e-ee310d8e01bd req-cd757c27-7e78-4b77-a7cd-529aa103a3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "name": "network-vif-plugged", "status": "completed", "tag": "a31c0a5e-56a2-4356-95b1-8a55b29d3c84"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:05.478504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-2a7d24e1-5eff-4a47-b24e-ee310d8e01bd req-cd757c27-7e78-4b77-a7cd-529aa103a3df service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.481639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-2a7d24e1-5eff-4a47-b24e-ee310d8e01bd req-cd757c27-7e78-4b77-a7cd-529aa103a3df service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.554939 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-2a7d24e1-5eff-4a47-b24e-ee310d8e01bd req-cd757c27-7e78-4b77-a7cd-529aa103a3df service nova] Creating event network-vif-plugged:a31c0a5e-56a2-4356-95b1-8a55b29d3c84 for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:30:05.579399 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-2a7d24e1-5eff-4a47-b24e-ee310d8e01bd req-cd757c27-7e78-4b77-a7cd-529aa103a3df service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200315 Jul 20 04:30:05.588177 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1851/3465] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 20 04:30:05.606530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-de7b4397-c405-4caa-a95c-35c2d5264c7c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:05.618485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-de7b4397-c405-4caa-a95c-35c2d5264c7c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:05.646415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-de7b4397-c405-4caa-a95c-35c2d5264c7c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:05.656674 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-de7b4397-c405-4caa-a95c-35c2d5264c7c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 0.663042 Jul 20 04:30:05.664139 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1615/3466] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:04 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:05.858941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4e5dbc4f-dfda-4948-8fbd-98f3a2204667 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be0b1280>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:05.975919 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4e5dbc4f-dfda-4948-8fbd-98f3a2204667 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.121073 Jul 20 04:30:05.977078 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1852/3467] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:05 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:06.693467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-423a70bb-449b-4bf7-a07e-4e068618458a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:06.694766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-423a70bb-449b-4bf7-a07e-4e068618458a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:06.715979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-423a70bb-449b-4bf7-a07e-4e068618458a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:06.722194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-423a70bb-449b-4bf7-a07e-4e068618458a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:06.724032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-423a70bb-449b-4bf7-a07e-4e068618458a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:06.729437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-423a70bb-449b-4bf7-a07e-4e068618458a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:06.993546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4b067784-4545-4ba0-a967-68198d330d5d tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdd14430>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:07.138285 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4b067784-4545-4ba0-a967-68198d330d5d tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.152480 Jul 20 04:30:07.146947 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1853/3468] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:06 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:08.040672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-80269003-9df4-43d0-9c44-51499dd2c1c4 req-8d94ab2e-71ff-4779-b5cb-0b36b16dce38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "name": "network-vif-plugged", "status": "completed", "tag": "3d36c00c-1614-411a-9eac-9454a83272e6"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:08.103216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-80269003-9df4-43d0-9c44-51499dd2c1c4 req-8d94ab2e-71ff-4779-b5cb-0b36b16dce38 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.103996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-80269003-9df4-43d0-9c44-51499dd2c1c4 req-8d94ab2e-71ff-4779-b5cb-0b36b16dce38 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.161254 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-80269003-9df4-43d0-9c44-51499dd2c1c4 req-8d94ab2e-71ff-4779-b5cb-0b36b16dce38 service nova] Creating event network-vif-plugged:3d36c00c-1614-411a-9eac-9454a83272e6 for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:30:08.176759 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-80269003-9df4-43d0-9c44-51499dd2c1c4 req-8d94ab2e-71ff-4779-b5cb-0b36b16dce38 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137592 Jul 20 04:30:08.178693 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1854/3469] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:08.184073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3a18e6b9-8745-4081-bdba-81af6f26ab09 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be3eb280>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:08.284278 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3a18e6b9-8745-4081-bdba-81af6f26ab09 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.103932 Jul 20 04:30:08.285159 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1855/3470] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:08 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:09.297429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cc61d436-ae2c-44d9-84e5-a07bcc00beef tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bddbb280>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:09.412410 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cc61d436-ae2c-44d9-84e5-a07bcc00beef tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.118829 Jul 20 04:30:09.413392 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1856/3471] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:09 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:10.378990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-423a70bb-449b-4bf7-a07e-4e068618458a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:10.412813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-423a70bb-449b-4bf7-a07e-4e068618458a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:10.414676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-423a70bb-449b-4bf7-a07e-4e068618458a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:10.415943 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-423a70bb-449b-4bf7-a07e-4e068618458a tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 3.737004 Jul 20 04:30:10.428082 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1616/3472] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:06 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 3750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:10.431280 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-019b76ca-5eb9-4eb3-bbe5-64f7313cf243 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be0f3670>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:10.525727 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-019b76ca-5eb9-4eb3-bbe5-64f7313cf243 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.098331 Jul 20 04:30:10.526344 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1857/3473] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:10 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:10.644904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-373ee091-f9f2-4585-ac32-cb0680699a47 req-c059dfb4-8219-4800-a6f3-7395c8fadd9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b", "name": "network-vif-plugged", "status": "completed", "tag": "f5248619-09e7-4707-9127-fb95dc122bcf"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:10.689726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-373ee091-f9f2-4585-ac32-cb0680699a47 req-c059dfb4-8219-4800-a6f3-7395c8fadd9b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:10.701596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-373ee091-f9f2-4585-ac32-cb0680699a47 req-c059dfb4-8219-4800-a6f3-7395c8fadd9b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:10.750385 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-373ee091-f9f2-4585-ac32-cb0680699a47 req-c059dfb4-8219-4800-a6f3-7395c8fadd9b service nova] Creating event network-vif-plugged:f5248619-09e7-4707-9127-fb95dc122bcf for instance a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b on n-h2-826526-5 Jul 20 04:30:10.755780 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-373ee091-f9f2-4585-ac32-cb0680699a47 req-c059dfb4-8219-4800-a6f3-7395c8fadd9b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115168 Jul 20 04:30:10.757649 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1617/3474] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:30:11.442740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2b73cdc6-e156-46ae-96cf-20281e5b7a94 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:11.444990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2b73cdc6-e156-46ae-96cf-20281e5b7a94 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:11.480553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b73cdc6-e156-46ae-96cf-20281e5b7a94 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:11.487032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b73cdc6-e156-46ae-96cf-20281e5b7a94 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:11.490017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b73cdc6-e156-46ae-96cf-20281e5b7a94 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:11.493753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b73cdc6-e156-46ae-96cf-20281e5b7a94 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:11.724852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c4ca5600-c899-43de-817b-210c60a312f3 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-718831595", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "960b4b1d-1fb9-4635-ae62-ae660712feb1"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:11.891505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-c4ca5600-c899-43de-817b-210c60a312f3 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] validate_networks() for [('960b4b1d-1fb9-4635-ae62-ae660712feb1', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:30:12.777956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2b73cdc6-e156-46ae-96cf-20281e5b7a94 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:12.796141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2b73cdc6-e156-46ae-96cf-20281e5b7a94 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:12.797691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2b73cdc6-e156-46ae-96cf-20281e5b7a94 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:12.798839 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2b73cdc6-e156-46ae-96cf-20281e5b7a94 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.364916 Jul 20 04:30:12.799406 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1618/3475] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:11 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:30:12.863750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7c9a3f4e-ef67-49f7-8c52-0a61c5481b06 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06c746a9d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:13.028519 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7c9a3f4e-ef67-49f7-8c52-0a61c5481b06 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.227804 Jul 20 04:30:13.043319 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1619/3476] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:12 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:13.823926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-544f4e86-751f-44f6-a97a-23f1228a9077 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:13.825185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-544f4e86-751f-44f6-a97a-23f1228a9077 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:13.885214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-544f4e86-751f-44f6-a97a-23f1228a9077 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:13.886047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-544f4e86-751f-44f6-a97a-23f1228a9077 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:13.887747 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-544f4e86-751f-44f6-a97a-23f1228a9077 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:13.907377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-544f4e86-751f-44f6-a97a-23f1228a9077 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:14.976570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c4ca5600-c899-43de-817b-210c60a312f3 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:30:14.977129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c4ca5600-c899-43de-817b-210c60a312f3 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:30:14.978281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c4ca5600-c899-43de-817b-210c60a312f3 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:30:14.978785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c4ca5600-c899-43de-817b-210c60a312f3 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:30:14.979322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c4ca5600-c899-43de-817b-210c60a312f3 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:30:15.001910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4ca5600-c899-43de-817b-210c60a312f3 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:15.006996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4ca5600-c899-43de-817b-210c60a312f3 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:15.009184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4ca5600-c899-43de-817b-210c60a312f3 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:15.019835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4ca5600-c899-43de-817b-210c60a312f3 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:15.047306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-544f4e86-751f-44f6-a97a-23f1228a9077 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:15.058771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-544f4e86-751f-44f6-a97a-23f1228a9077 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:15.076919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-544f4e86-751f-44f6-a97a-23f1228a9077 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:15.084236 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-544f4e86-751f-44f6-a97a-23f1228a9077 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.270625 Jul 20 04:30:15.087802 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1620/3477] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:13 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:30:15.088961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c4ca5600-c899-43de-817b-210c60a312f3 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Getting quotas for project 193c97c8ebe3454687b2701015fac182. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:15.110029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b2250654-3948-42c5-a823-4d07f2e8a68e tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06c746af70>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:15.118793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c4ca5600-c899-43de-817b-210c60a312f3 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Getting quotas for user e260c28ea7964a36a2df4da221ef0187 and project 193c97c8ebe3454687b2701015fac182. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:15.169292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c4ca5600-c899-43de-817b-210c60a312f3 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:30:15.183757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c4ca5600-c899-43de-817b-210c60a312f3 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:30:15.252706 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b2250654-3948-42c5-a823-4d07f2e8a68e tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.156718 Jul 20 04:30:15.254113 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1621/3478] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:15 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:15.281459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-1244b013-61a6-46f4-a477-f5d56f497ab0 req-b15941c2-ab9c-4250-a7b3-156836a88b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "name": "network-vif-plugged", "status": "completed", "tag": "8ef7c976-1682-4334-a2e1-0641c7cbd89c"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:15.321963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-1244b013-61a6-46f4-a477-f5d56f497ab0 req-b15941c2-ab9c-4250-a7b3-156836a88b93 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:15.325854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-1244b013-61a6-46f4-a477-f5d56f497ab0 req-b15941c2-ab9c-4250-a7b3-156836a88b93 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:15.377664 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-1244b013-61a6-46f4-a477-f5d56f497ab0 req-b15941c2-ab9c-4250-a7b3-156836a88b93 service nova] Creating event network-vif-plugged:8ef7c976-1682-4334-a2e1-0641c7cbd89c for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:30:15.379669 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c4ca5600-c899-43de-817b-210c60a312f3 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.261852 Jul 20 04:30:15.385567 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1858/3479] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:30:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 4273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:30:15.401943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7eab2c69-f0a5-4c99-9d65-98f3aa7084a0 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:15.406531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7eab2c69-f0a5-4c99-9d65-98f3aa7084a0 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:15.412805 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-1244b013-61a6-46f4-a477-f5d56f497ab0 req-b15941c2-ab9c-4250-a7b3-156836a88b93 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155897 Jul 20 04:30:15.419912 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1622/3480] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:15.586886 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7eab2c69-f0a5-4c99-9d65-98f3aa7084a0 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:15.607727 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7eab2c69-f0a5-4c99-9d65-98f3aa7084a0 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1223 microversion: 2.1 time: 0.216715 Jul 20 04:30:15.612563 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1859/3481] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:15 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1223 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:16.107310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-25d78585-959b-4b78-a574-45d631d50c95 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:16.108032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-25d78585-959b-4b78-a574-45d631d50c95 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:16.130641 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25d78585-959b-4b78-a574-45d631d50c95 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:16.131105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25d78585-959b-4b78-a574-45d631d50c95 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:16.142685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25d78585-959b-4b78-a574-45d631d50c95 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:16.143389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25d78585-959b-4b78-a574-45d631d50c95 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:16.267703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-161a229d-f1bc-4898-a9fa-61a9138539c5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdf40040>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:16.418644 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-161a229d-f1bc-4898-a9fa-61a9138539c5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.155087 Jul 20 04:30:16.420511 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1860/3482] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:16 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:16.648568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0343cdb5-62db-4fc0-9439-cb30f92062e8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:16.655140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0343cdb5-62db-4fc0-9439-cb30f92062e8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:17.336655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-25d78585-959b-4b78-a574-45d631d50c95 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:17.358912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-25d78585-959b-4b78-a574-45d631d50c95 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:17.362900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-25d78585-959b-4b78-a574-45d631d50c95 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:17.368786 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-25d78585-959b-4b78-a574-45d631d50c95 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.265382 Jul 20 04:30:17.381277 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1623/3483] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:16 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:17.433126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f52b6290-826b-4ed3-8bb8-e768de43e1b1 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be5ab310>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:17.512821 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f52b6290-826b-4ed3-8bb8-e768de43e1b1 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.083989 Jul 20 04:30:17.514980 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1624/3484] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:17 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:17.962829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0343cdb5-62db-4fc0-9439-cb30f92062e8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:17.970803 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0343cdb5-62db-4fc0-9439-cb30f92062e8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1223 microversion: 2.1 time: 1.342698 Jul 20 04:30:17.975085 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1861/3485] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:16 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1223 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:18.393275 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ead75f4f-9c84-480b-9cc1-a63e1907cd1c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:18.394067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ead75f4f-9c84-480b-9cc1-a63e1907cd1c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:18.395872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=30 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:18.420116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ead75f4f-9c84-480b-9cc1-a63e1907cd1c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:18.420601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ead75f4f-9c84-480b-9cc1-a63e1907cd1c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:18.421401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ead75f4f-9c84-480b-9cc1-a63e1907cd1c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:18.421846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ead75f4f-9c84-480b-9cc1-a63e1907cd1c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:18.529373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a948d26c-8c4b-4672-a58f-48fc1f6c433d tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be453a60>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:18.627308 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a948d26c-8c4b-4672-a58f-48fc1f6c433d tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.104103 Jul 20 04:30:18.630404 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1862/3486] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:18 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:18.992282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f4670057-93f7-416f-b032-33d3b3a4843b tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:18.992928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f4670057-93f7-416f-b032-33d3b3a4843b tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:19.009167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4670057-93f7-416f-b032-33d3b3a4843b tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:19.009927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4670057-93f7-416f-b032-33d3b3a4843b tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:19.010900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4670057-93f7-416f-b032-33d3b3a4843b tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:19.011926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4670057-93f7-416f-b032-33d3b3a4843b tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:19.270321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f4670057-93f7-416f-b032-33d3b3a4843b tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:19.278658 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f4670057-93f7-416f-b032-33d3b3a4843b tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1281 microversion: 2.1 time: 0.291099 Jul 20 04:30:19.283294 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1863/3487] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:18 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1281 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:19.642606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e36c17f9-703c-4fe2-bb1d-5f2395b6527c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdf22b80>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:19.735434 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e36c17f9-703c-4fe2-bb1d-5f2395b6527c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1453 microversion: 2.1 time: 0.097648 Jul 20 04:30:19.736365 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1864/3488] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:19 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:20.304510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4c4c7c80-4090-46e8-a295-0570ca3ba938 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:20.305556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4c4c7c80-4090-46e8-a295-0570ca3ba938 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:20.327073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c4c7c80-4090-46e8-a295-0570ca3ba938 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:20.327526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c4c7c80-4090-46e8-a295-0570ca3ba938 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:20.344475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c4c7c80-4090-46e8-a295-0570ca3ba938 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:20.344475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c4c7c80-4090-46e8-a295-0570ca3ba938 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:20.632137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ead75f4f-9c84-480b-9cc1-a63e1907cd1c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:20.693441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ead75f4f-9c84-480b-9cc1-a63e1907cd1c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:20.700443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ead75f4f-9c84-480b-9cc1-a63e1907cd1c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:20.706926 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ead75f4f-9c84-480b-9cc1-a63e1907cd1c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 2.318690 Jul 20 04:30:20.722591 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1625/3489] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:18 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 2336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:20.749976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-36eedf7e-a881-49fd-9bdf-e35a0eecfd86 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be2ccd30>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:20.855886 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-36eedf7e-a881-49fd-9bdf-e35a0eecfd86 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1462 microversion: 2.1 time: 0.110823 Jul 20 04:30:20.856804 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1626/3490] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:20 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1462 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:20.885177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-82b7b680-fc95-444d-98ce-a40d2b7af9b9 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be981700>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:20.907787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4c4c7c80-4090-46e8-a295-0570ca3ba938 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:20.925739 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4c4c7c80-4090-46e8-a295-0570ca3ba938 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1281 microversion: 2.1 time: 0.626200 Jul 20 04:30:20.930550 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1865/3491] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:20 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1281 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:21.053929 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-82b7b680-fc95-444d-98ce-a40d2b7af9b9 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 200 len: 1462 microversion: 2.1 time: 0.188951 Jul 20 04:30:21.055849 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1627/3492] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:20 2022] GET /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 1462 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:21.068226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bda3c826-1cfb-4ff1-899e-f10396ff3bd2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:21.069182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bda3c826-1cfb-4ff1-899e-f10396ff3bd2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:21.076609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bda3c826-1cfb-4ff1-899e-f10396ff3bd2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:21.077489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bda3c826-1cfb-4ff1-899e-f10396ff3bd2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:21.079030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bda3c826-1cfb-4ff1-899e-f10396ff3bd2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:21.080035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bda3c826-1cfb-4ff1-899e-f10396ff3bd2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:21.729896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c97b5472-9c9d-49e9-a1be-2618abd27994 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:21.730612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c97b5472-9c9d-49e9-a1be-2618abd27994 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:21.749099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c97b5472-9c9d-49e9-a1be-2618abd27994 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:21.751804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c97b5472-9c9d-49e9-a1be-2618abd27994 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:21.758119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c97b5472-9c9d-49e9-a1be-2618abd27994 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:21.758782 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c97b5472-9c9d-49e9-a1be-2618abd27994 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:21.770248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bda3c826-1cfb-4ff1-899e-f10396ff3bd2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:21.794956 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bda3c826-1cfb-4ff1-899e-f10396ff3bd2 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b" status: 200 len: 1480 microversion: 2.1 time: 0.727952 Jul 20 04:30:21.799974 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1866/3493] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:21 2022] GET /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b => generated 1480 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:21.856135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-bc1fee8e-a275-4381-b1a3-c20d10508c66 req-e9758229-ed7f-4858-b240-de6c30f1eebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "name": "network-vif-plugged", "status": "completed", "tag": "5181d6ac-4b81-40aa-b0f8-6206c7cc13b0"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:21.909234 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bc1fee8e-a275-4381-b1a3-c20d10508c66 req-e9758229-ed7f-4858-b240-de6c30f1eebf service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:21.927215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bc1fee8e-a275-4381-b1a3-c20d10508c66 req-e9758229-ed7f-4858-b240-de6c30f1eebf service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:21.975681 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-bc1fee8e-a275-4381-b1a3-c20d10508c66 req-e9758229-ed7f-4858-b240-de6c30f1eebf service nova] Creating event network-vif-plugged:5181d6ac-4b81-40aa-b0f8-6206c7cc13b0 for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:30:21.991640 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-bc1fee8e-a275-4381-b1a3-c20d10508c66 req-e9758229-ed7f-4858-b240-de6c30f1eebf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180096 Jul 20 04:30:22.003898 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1867/3494] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:22.015162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2bc8f89d-f963-4bbf-9475-57a1f1554fca tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:22.039415 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2bc8f89d-f963-4bbf-9475-57a1f1554fca tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:22.063157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bc8f89d-f963-4bbf-9475-57a1f1554fca tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:22.066658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bc8f89d-f963-4bbf-9475-57a1f1554fca tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:22.067711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bc8f89d-f963-4bbf-9475-57a1f1554fca tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:22.071939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bc8f89d-f963-4bbf-9475-57a1f1554fca tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:22.527066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2bc8f89d-f963-4bbf-9475-57a1f1554fca tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:22.560818 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2bc8f89d-f963-4bbf-9475-57a1f1554fca tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1281 microversion: 2.1 time: 0.552428 Jul 20 04:30:22.562136 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1868/3495] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:22 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1281 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:22.819964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-60f28602-05f2-40f9-991e-c06617c04ea5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:22.823881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-60f28602-05f2-40f9-991e-c06617c04ea5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:22.851695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60f28602-05f2-40f9-991e-c06617c04ea5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:22.859185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60f28602-05f2-40f9-991e-c06617c04ea5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:22.860407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60f28602-05f2-40f9-991e-c06617c04ea5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:22.860861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60f28602-05f2-40f9-991e-c06617c04ea5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:23.014863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c97b5472-9c9d-49e9-a1be-2618abd27994 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:23.035254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c97b5472-9c9d-49e9-a1be-2618abd27994 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:23.058490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c97b5472-9c9d-49e9-a1be-2618abd27994 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:23.065799 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c97b5472-9c9d-49e9-a1be-2618abd27994 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.341310 Jul 20 04:30:23.078309 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1628/3496] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:21 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:30:23.577891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f4d24891-1097-42c5-9956-aea203c865b8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:23.578521 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f4d24891-1097-42c5-9956-aea203c865b8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:23.588848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4d24891-1097-42c5-9956-aea203c865b8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:23.591917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4d24891-1097-42c5-9956-aea203c865b8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:23.594188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4d24891-1097-42c5-9956-aea203c865b8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:23.594807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4d24891-1097-42c5-9956-aea203c865b8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:23.601329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-60f28602-05f2-40f9-991e-c06617c04ea5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:23.641354 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-60f28602-05f2-40f9-991e-c06617c04ea5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b" status: 200 len: 1467 microversion: 2.1 time: 0.828497 Jul 20 04:30:23.651017 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1869/3497] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:22 2022] GET /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b => generated 1467 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:23.660349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-37a819c1-9613-43af-a496-722540e54f54 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdf30160>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:23.983457 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-37a819c1-9613-43af-a496-722540e54f54 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images?changes-since=2022-07-20T04%3A27%3A37Z" status: 200 len: 2373 microversion: 2.1 time: 0.326950 Jul 20 04:30:23.985218 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1870/3498] 10.222.0.17 () {58 vars in 1198 bytes} [Wed Jul 20 04:30:23 2022] GET /compute/v2.1/images?changes-since=2022-07-20T04%3A27%3A37Z => generated 2373 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:24.025947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-aca157ed-6a71-450d-a19c-51376352f0cd tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdf40940>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:24.140753 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-aca157ed-6a71-450d-a19c-51376352f0cd tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-198662073" status: 200 len: 484 microversion: 2.1 time: 0.131710 Jul 20 04:30:24.151106 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1871/3499] 10.222.0.17 () {58 vars in 1228 bytes} [Wed Jul 20 04:30:24 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-198662073 => generated 484 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:24.185234 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f65bd39f-312b-4bf2-bdc6-b96ead5c400b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:24.188390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f65bd39f-312b-4bf2-bdc6-b96ead5c400b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:24.205878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:24.213051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f65bd39f-312b-4bf2-bdc6-b96ead5c400b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:24.224986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f65bd39f-312b-4bf2-bdc6-b96ead5c400b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:24.225999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f65bd39f-312b-4bf2-bdc6-b96ead5c400b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:24.226544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f65bd39f-312b-4bf2-bdc6-b96ead5c400b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:24.716470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f4d24891-1097-42c5-9956-aea203c865b8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:24.719345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=78 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:24.734755 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f4d24891-1097-42c5-9956-aea203c865b8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1323 microversion: 2.1 time: 1.159389 Jul 20 04:30:24.746753 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1629/3500] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:23 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1323 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:24.763677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d1ddb466-ffef-4e94-8be9-95e2020ff346 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be1bcaf0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:24.977103 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d1ddb466-ffef-4e94-8be9-95e2020ff346 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images?server=a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b" status: 200 len: 957 microversion: 2.1 time: 0.226564 Jul 20 04:30:24.978254 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1630/3501] 10.222.0.17 () {58 vars in 1208 bytes} [Wed Jul 20 04:30:24 2022] GET /compute/v2.1/images?server=a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b => generated 957 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:25.004629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f65bd39f-312b-4bf2-bdc6-b96ead5c400b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:25.007531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=47 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:25.020919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f65bd39f-312b-4bf2-bdc6-b96ead5c400b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:25.026584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f65bd39f-312b-4bf2-bdc6-b96ead5c400b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:25.035436 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f65bd39f-312b-4bf2-bdc6-b96ead5c400b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 0.881952 Jul 20 04:30:25.046826 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1872/3502] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:24 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:25.051956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1d86c7a1-4ae2-4b08-a421-ca670c680964 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdded310>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:25.066397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:25.161375 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1d86c7a1-4ae2-4b08-a421-ca670c680964 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fv2.1%2Fservers%2F1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 484 microversion: 2.1 time: 0.113056 Jul 20 04:30:25.162129 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1873/3503] 10.222.0.17 () {58 vars in 1316 bytes} [Wed Jul 20 04:30:25 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fv2.1%2Fservers%2F1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 484 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:25.172642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-72d75d0b-c852-40ba-9515-50d431b2fc79 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be651ca0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:25.238585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-01474f6f-07b0-4d02-9736-ec40b14b0bd1 req-c50f3663-f22e-4fdb-bd44-a4a89798b8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "name": "network-vif-plugged", "status": "completed", "tag": "d88e9d40-f883-487c-b169-78e7f289e235"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:25.298680 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-72d75d0b-c852-40ba-9515-50d431b2fc79 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fservers%2F1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 484 microversion: 2.1 time: 0.129853 Jul 20 04:30:25.299181 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-01474f6f-07b0-4d02-9736-ec40b14b0bd1 req-c50f3663-f22e-4fdb-bd44-a4a89798b8b3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:25.299871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-01474f6f-07b0-4d02-9736-ec40b14b0bd1 req-c50f3663-f22e-4fdb-bd44-a4a89798b8b3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:25.311847 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1874/3504] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Jul 20 04:30:25 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fservers%2F1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 484 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:25.316940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ba55e78b-40dd-4537-9943-a748eb5ebf61 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdded310>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:25.330184 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-01474f6f-07b0-4d02-9736-ec40b14b0bd1 req-c50f3663-f22e-4fdb-bd44-a4a89798b8b3 service nova] Creating event network-vif-plugged:d88e9d40-f883-487c-b169-78e7f289e235 for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:30:25.345402 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-01474f6f-07b0-4d02-9736-ec40b14b0bd1 req-c50f3663-f22e-4fdb-bd44-a4a89798b8b3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.365724 Jul 20 04:30:25.346193 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1631/3505] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:25.568957 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ba55e78b-40dd-4537-9943-a748eb5ebf61 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.239913 Jul 20 04:30:25.569673 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1875/3506] 10.222.0.17 () {58 vars in 1148 bytes} [Wed Jul 20 04:30:25 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:25.583093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2b849754-37d2-4899-99d6-c0463aa7acc0 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bddcbdc0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:25.724122 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2b849754-37d2-4899-99d6-c0463aa7acc0 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.145092 Jul 20 04:30:25.736737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8962b8f9-2dbd-44d0-a780-2ee741367de1 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdfa8dc0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:25.738369 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1632/3507] 10.222.0.17 () {58 vars in 1148 bytes} [Wed Jul 20 04:30:25 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:25.757445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5c202731-533a-4645-8bb3-f4f8890ea281 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:25.763113 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5c202731-533a-4645-8bb3-f4f8890ea281 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:25.798821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c202731-533a-4645-8bb3-f4f8890ea281 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:25.799373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c202731-533a-4645-8bb3-f4f8890ea281 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:25.800217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c202731-533a-4645-8bb3-f4f8890ea281 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:25.807487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c202731-533a-4645-8bb3-f4f8890ea281 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:25.852970 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8962b8f9-2dbd-44d0-a780-2ee741367de1 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.115451 Jul 20 04:30:25.853620 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1876/3508] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:30:25 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:30:25.872562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4250abc2-89d4-46e1-af72-d15cf8aa6be0 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bebc0e50>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:26.107114 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4250abc2-89d4-46e1-af72-d15cf8aa6be0 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/detail?changes-since=2022-07-20T04%3A27%3A32Z" status: 200 len: 6325 microversion: 2.1 time: 0.242809 Jul 20 04:30:26.108520 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1877/3509] 10.222.0.17 () {58 vars in 1219 bytes} [Wed Jul 20 04:30:25 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-20T04%3A27%3A32Z => generated 6325 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:26.126160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-37676b37-005a-418e-b86f-b18b35a3af83 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:26.130033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-37676b37-005a-418e-b86f-b18b35a3af83 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:26.139325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37676b37-005a-418e-b86f-b18b35a3af83 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:26.139907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37676b37-005a-418e-b86f-b18b35a3af83 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:26.140842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37676b37-005a-418e-b86f-b18b35a3af83 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:26.141543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37676b37-005a-418e-b86f-b18b35a3af83 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:26.570757 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5c202731-533a-4645-8bb3-f4f8890ea281 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:26.583741 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5c202731-533a-4645-8bb3-f4f8890ea281 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1323 microversion: 2.1 time: 0.826452 Jul 20 04:30:26.590961 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1633/3510] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:25 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1323 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:26.627959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4475d0c8-dafe-4fa7-8f80-0db83e46a232 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06c741a040>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:26.839202 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4475d0c8-dafe-4fa7-8f80-0db83e46a232 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-198662073" status: 200 len: 664 microversion: 2.1 time: 0.246996 Jul 20 04:30:26.842352 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1634/3511] 10.222.0.17 () {58 vars in 1249 bytes} [Wed Jul 20 04:30:26 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-198662073 => generated 664 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:26.861030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5306e73a-d7d0-411c-988a-2e997b578e03 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be065670>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:26.985887 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5306e73a-d7d0-411c-988a-2e997b578e03 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fv2.1%2Fservers%2F1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1464 microversion: 2.1 time: 0.131782 Jul 20 04:30:26.991116 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1635/3512] 10.222.0.17 () {58 vars in 1337 bytes} [Wed Jul 20 04:30:26 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fv2.1%2Fservers%2F1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1464 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:27.003123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3276cc53-d63f-411f-ac1b-d02d1bb3c8e1 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06c741aa60>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:27.098173 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3276cc53-d63f-411f-ac1b-d02d1bb3c8e1 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fservers%2F1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1464 microversion: 2.1 time: 0.102553 Jul 20 04:30:27.099553 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1636/3513] 10.222.0.17 () {58 vars in 1323 bytes} [Wed Jul 20 04:30:26 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fservers%2F1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1464 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:27.122531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed7e5ecf-9e33-474b-b144-e14b51829a5c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be95e280>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:27.317636 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ed7e5ecf-9e33-474b-b144-e14b51829a5c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7100 microversion: 2.1 time: 0.203567 Jul 20 04:30:27.321563 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1637/3514] 10.222.0.17 () {58 vars in 1169 bytes} [Wed Jul 20 04:30:27 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7100 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:27.337933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-09c05c76-e71d-49fb-a401-96936cd6a97f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be92dc10>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:27.473433 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-09c05c76-e71d-49fb-a401-96936cd6a97f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.139666 Jul 20 04:30:27.475687 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1638/3515] 10.222.0.17 () {58 vars in 1169 bytes} [Wed Jul 20 04:30:27 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:27.491387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-8f5cdbdb-5f7f-42bd-aa00-5e54d61cf8ae req-41ac2382-60b6-4e55-b322-65a509ca4fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b", "name": "network-vif-unplugged", "status": "completed", "tag": "f5248619-09e7-4707-9127-fb95dc122bcf"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:27.518623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8f5cdbdb-5f7f-42bd-aa00-5e54d61cf8ae req-41ac2382-60b6-4e55-b322-65a509ca4fb6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:27.519068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8f5cdbdb-5f7f-42bd-aa00-5e54d61cf8ae req-41ac2382-60b6-4e55-b322-65a509ca4fb6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:27.557915 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-8f5cdbdb-5f7f-42bd-aa00-5e54d61cf8ae req-41ac2382-60b6-4e55-b322-65a509ca4fb6 service nova] Creating event network-vif-unplugged:f5248619-09e7-4707-9127-fb95dc122bcf for instance a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b on n-h2-826526-5 Jul 20 04:30:27.572020 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-8f5cdbdb-5f7f-42bd-aa00-5e54d61cf8ae req-41ac2382-60b6-4e55-b322-65a509ca4fb6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093448 Jul 20 04:30:27.575789 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1639/3516] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:27.589577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ba4ff259-869f-4c13-9c11-7c396a5720f6 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06c741a040>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:27.686953 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ba4ff259-869f-4c13-9c11-7c396a5720f6 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/dd295612-2ec2-458d-9fdf-8704437a5c0b" status: 200 len: 784 microversion: 2.1 time: 0.108953 Jul 20 04:30:27.687713 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1640/3517] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:27 2022] GET /compute/v2.1/images/dd295612-2ec2-458d-9fdf-8704437a5c0b => generated 784 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:27.703437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf60e9af-e4c7-4450-a59b-ec19b75a4948 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:27.706340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf60e9af-e4c7-4450-a59b-ec19b75a4948 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:27.723321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf60e9af-e4c7-4450-a59b-ec19b75a4948 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:27.729089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf60e9af-e4c7-4450-a59b-ec19b75a4948 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:27.730095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf60e9af-e4c7-4450-a59b-ec19b75a4948 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:27.730954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf60e9af-e4c7-4450-a59b-ec19b75a4948 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:27.920542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-37676b37-005a-418e-b86f-b18b35a3af83 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:27.941724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-37676b37-005a-418e-b86f-b18b35a3af83 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:27.949552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-37676b37-005a-418e-b86f-b18b35a3af83 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:27.951126 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-37676b37-005a-418e-b86f-b18b35a3af83 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1870 microversion: 2.32 time: 1.834841 Jul 20 04:30:27.951827 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1878/3518] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:26 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1870 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:27.965866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e0031747-de79-4cd8-848d-26f66ae5f6ca tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdfa8ee0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:27.985417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=10 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:28.096161 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e0031747-de79-4cd8-848d-26f66ae5f6ca tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.141875 Jul 20 04:30:28.096911 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1879/3519] 10.222.0.17 () {58 vars in 1157 bytes} [Wed Jul 20 04:30:27 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:28.122004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-06d274d7-2c99-4b7e-bff5-0634215f4e82 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdfa8e50>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:29.273773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bf60e9af-e4c7-4450-a59b-ec19b75a4948 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:29.286322 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf60e9af-e4c7-4450-a59b-ec19b75a4948 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1323 microversion: 2.1 time: 1.597283 Jul 20 04:30:29.299887 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1641/3520] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:27 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1323 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:29.307960 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9bf27210-6fd7-431c-af19-1373d2964aa8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:29.317961 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9bf27210-6fd7-431c-af19-1373d2964aa8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:29.335199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9bf27210-6fd7-431c-af19-1373d2964aa8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:29.336467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9bf27210-6fd7-431c-af19-1373d2964aa8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:29.338499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9bf27210-6fd7-431c-af19-1373d2964aa8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:29.340318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9bf27210-6fd7-431c-af19-1373d2964aa8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:29.579935 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-06d274d7-2c99-4b7e-bff5-0634215f4e82 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "DELETE /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a" status: 204 len: 0 microversion: 2.1 time: 1.473452 Jul 20 04:30:29.581934 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1880/3521] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:28 2022] DELETE /compute/v2.1/images/157c9c47-5d29-4fe9-b808-4c779ce9743a => generated 0 bytes in 1476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:29.598960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2d955b51-4173-4090-84e6-23d318f17851 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdd14e50>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:30.614647 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2d955b51-4173-4090-84e6-23d318f17851 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "DELETE /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75" status: 204 len: 0 microversion: 2.1 time: 1.027049 Jul 20 04:30:30.621843 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1881/3522] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:29 2022] DELETE /compute/v2.1/images/f3d14706-9c43-4415-8254-061b71483c75 => generated 0 bytes in 1029 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:30.628424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3c8bd234-c0a1-483c-920c-a680dd17418f tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:30.634237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3c8bd234-c0a1-483c-920c-a680dd17418f tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:30.655097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c8bd234-c0a1-483c-920c-a680dd17418f tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:30.657908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c8bd234-c0a1-483c-920c-a680dd17418f tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:30.660737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c8bd234-c0a1-483c-920c-a680dd17418f tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:30.662886 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c8bd234-c0a1-483c-920c-a680dd17418f tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:31.178706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9bf27210-6fd7-431c-af19-1373d2964aa8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:31.218703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9bf27210-6fd7-431c-af19-1373d2964aa8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:31.226957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9bf27210-6fd7-431c-af19-1373d2964aa8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:31.231552 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9bf27210-6fd7-431c-af19-1373d2964aa8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 2823 microversion: 2.32 time: 1.930074 Jul 20 04:30:31.244142 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1642/3523] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:29 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 2823 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:31.282686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f0eb4bba-ef3b-4856-b454-c93f95b61221 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be2f8670>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:31.895601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3c8bd234-c0a1-483c-920c-a680dd17418f tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:31.909958 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3c8bd234-c0a1-483c-920c-a680dd17418f tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1323 microversion: 2.1 time: 1.286599 Jul 20 04:30:31.921480 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1882/3524] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:30 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1323 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:31.939279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b87f6e07-cf3f-4600-970a-0297957db406 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:31.941038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b87f6e07-cf3f-4600-970a-0297957db406 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:31.964185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b87f6e07-cf3f-4600-970a-0297957db406 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:31.969000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b87f6e07-cf3f-4600-970a-0297957db406 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:31.972736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b87f6e07-cf3f-4600-970a-0297957db406 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:31.973486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b87f6e07-cf3f-4600-970a-0297957db406 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:32.327311 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f0eb4bba-ef3b-4856-b454-c93f95b61221 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "DELETE /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807" status: 204 len: 0 microversion: 2.1 time: 1.076636 Jul 20 04:30:32.328853 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1643/3525] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:31 2022] DELETE /compute/v2.1/images/3a8989eb-932a-4179-b456-0c3513690807 => generated 0 bytes in 1084 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:32.553134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-a166d0e5-555b-42e4-b63a-e5994c100c7e req-63ea0bb0-0cbc-4400-8abe-4ff6dfdf865b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cd034ab-f55b-4d96-99f2-5db7cc26944a", "tag": "d85df00a-5f5a-4c4b-829d-d45fe5fb695f"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:32.578333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a166d0e5-555b-42e4-b63a-e5994c100c7e req-63ea0bb0-0cbc-4400-8abe-4ff6dfdf865b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:32.582181 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a166d0e5-555b-42e4-b63a-e5994c100c7e req-63ea0bb0-0cbc-4400-8abe-4ff6dfdf865b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:32.633376 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-a166d0e5-555b-42e4-b63a-e5994c100c7e req-63ea0bb0-0cbc-4400-8abe-4ff6dfdf865b service nova] Creating event network-changed:d85df00a-5f5a-4c4b-829d-d45fe5fb695f for instance 7cd034ab-f55b-4d96-99f2-5db7cc26944a on n-h1-826526-5 Jul 20 04:30:32.650670 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-a166d0e5-555b-42e4-b63a-e5994c100c7e req-63ea0bb0-0cbc-4400-8abe-4ff6dfdf865b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.320145 Jul 20 04:30:32.658994 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1644/3526] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:32.670827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e2adc0a0-6eb3-4fcb-a74d-95d822b9eb27 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:32.671202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e2adc0a0-6eb3-4fcb-a74d-95d822b9eb27 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:32.704531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2adc0a0-6eb3-4fcb-a74d-95d822b9eb27 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:32.708096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2adc0a0-6eb3-4fcb-a74d-95d822b9eb27 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:32.709536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2adc0a0-6eb3-4fcb-a74d-95d822b9eb27 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:32.713102 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2adc0a0-6eb3-4fcb-a74d-95d822b9eb27 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:32.859799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e2adc0a0-6eb3-4fcb-a74d-95d822b9eb27 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:30:33.170473 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e2adc0a0-6eb3-4fcb-a74d-95d822b9eb27 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 204 len: 0 microversion: 2.1 time: 0.509853 Jul 20 04:30:33.171133 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1645/3527] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:30:32 2022] DELETE /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:33.191273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-07478a70-d9f3-46f8-b02a-745a7bc5ff94 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:33.192470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-07478a70-d9f3-46f8-b02a-745a7bc5ff94 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:33.207793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07478a70-d9f3-46f8-b02a-745a7bc5ff94 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:33.213312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07478a70-d9f3-46f8-b02a-745a7bc5ff94 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:33.214459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07478a70-d9f3-46f8-b02a-745a7bc5ff94 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:33.215266 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07478a70-d9f3-46f8-b02a-745a7bc5ff94 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:33.340350 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b87f6e07-cf3f-4600-970a-0297957db406 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede/os-interface" status: 200 len: 1830 microversion: 2.32 time: 1.414615 Jul 20 04:30:33.341042 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1883/3528] 10.222.0.17 () {60 vars in 1315 bytes} [Wed Jul 20 04:30:31 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede/os-interface => generated 1830 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:33.346171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b5810894-ae7c-4d94-b35e-a11b5f48f86f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:33.346792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b5810894-ae7c-4d94-b35e-a11b5f48f86f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:33.353985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5810894-ae7c-4d94-b35e-a11b5f48f86f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:33.354633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5810894-ae7c-4d94-b35e-a11b5f48f86f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:33.355597 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5810894-ae7c-4d94-b35e-a11b5f48f86f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:33.356340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5810894-ae7c-4d94-b35e-a11b5f48f86f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:33.902051 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-07478a70-d9f3-46f8-b02a-745a7bc5ff94 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:33.917301 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-07478a70-d9f3-46f8-b02a-745a7bc5ff94 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1323 microversion: 2.1 time: 0.741852 Jul 20 04:30:33.924859 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1646/3529] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:33 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1323 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:34.450187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b5810894-ae7c-4d94-b35e-a11b5f48f86f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:34.470757 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b5810894-ae7c-4d94-b35e-a11b5f48f86f tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1472 microversion: 2.1 time: 1.128360 Jul 20 04:30:34.471401 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1884/3530] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:33 2022] GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1472 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:34.938440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ad24931a-47ae-4937-9c64-a93f29018133 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:34.939061 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ad24931a-47ae-4937-9c64-a93f29018133 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:34.988043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad24931a-47ae-4937-9c64-a93f29018133 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:34.988551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad24931a-47ae-4937-9c64-a93f29018133 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:34.995193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad24931a-47ae-4937-9c64-a93f29018133 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:35.002342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad24931a-47ae-4937-9c64-a93f29018133 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:35.163964 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:30:35.164402 n-d-826526-5 devstack@n-api.service[127870]: Wed Jul 20 04:30:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a (ip 10.222.0.17) !!! Jul 20 04:30:35.493200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d7f89666-03e9-44ea-872d-72365da7ddaf tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:35.501535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d7f89666-03e9-44ea-872d-72365da7ddaf tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:35.567204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7f89666-03e9-44ea-872d-72365da7ddaf tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:35.571399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7f89666-03e9-44ea-872d-72365da7ddaf tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:35.574013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7f89666-03e9-44ea-872d-72365da7ddaf tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:35.586138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7f89666-03e9-44ea-872d-72365da7ddaf tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:36.724519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d7f89666-03e9-44ea-872d-72365da7ddaf tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:36.740807 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d7f89666-03e9-44ea-872d-72365da7ddaf tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1472 microversion: 2.1 time: 1.251770 Jul 20 04:30:36.741698 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1885/3531] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:35 2022] GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1472 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:36.765439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ad24931a-47ae-4937-9c64-a93f29018133 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:36.786261 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ad24931a-47ae-4937-9c64-a93f29018133 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1323 microversion: 2.1 time: 1.852698 Jul 20 04:30:36.797545 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1647/3532] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:34 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1323 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:37.759473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9f66fcc4-3ee1-4cfa-93b9-ce4287e20f96 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:37.760930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9f66fcc4-3ee1-4cfa-93b9-ce4287e20f96 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:37.775181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f66fcc4-3ee1-4cfa-93b9-ce4287e20f96 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.778200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f66fcc4-3ee1-4cfa-93b9-ce4287e20f96 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.779296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f66fcc4-3ee1-4cfa-93b9-ce4287e20f96 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.785121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f66fcc4-3ee1-4cfa-93b9-ce4287e20f96 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.809652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c1dc99fd-1431-45ce-8842-d1c998360acd tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:37.812602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c1dc99fd-1431-45ce-8842-d1c998360acd tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:37.848015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1dc99fd-1431-45ce-8842-d1c998360acd tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.851601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1dc99fd-1431-45ce-8842-d1c998360acd tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.856880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1dc99fd-1431-45ce-8842-d1c998360acd tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.859686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1dc99fd-1431-45ce-8842-d1c998360acd tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:39.204090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c1dc99fd-1431-45ce-8842-d1c998360acd tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:39.294483 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c1dc99fd-1431-45ce-8842-d1c998360acd tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1323 microversion: 2.1 time: 1.493820 Jul 20 04:30:39.303912 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1648/3533] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:37 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1323 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:39.962482 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-5022a81e-7443-4868-885e-685f5d9e050e req-488819bd-c681-428b-91d5-5e24fd9c467d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d12f9b2-058c-4fe2-964b-81217cb46489", "name": "network-vif-deleted", "tag": "09e0f809-5b7f-42cb-bbac-f315284f1a91"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:39.995609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5022a81e-7443-4868-885e-685f5d9e050e req-488819bd-c681-428b-91d5-5e24fd9c467d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:39.996060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5022a81e-7443-4868-885e-685f5d9e050e req-488819bd-c681-428b-91d5-5e24fd9c467d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:40.045545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9f66fcc4-3ee1-4cfa-93b9-ce4287e20f96 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:40.054986 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9f66fcc4-3ee1-4cfa-93b9-ce4287e20f96 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 200 len: 1472 microversion: 2.1 time: 2.301034 Jul 20 04:30:40.060041 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1886/3534] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:37 2022] GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 1472 bytes in 2307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:40.066884 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-5022a81e-7443-4868-885e-685f5d9e050e req-488819bd-c681-428b-91d5-5e24fd9c467d service nova] Creating event network-vif-deleted:09e0f809-5b7f-42cb-bbac-f315284f1a91 for instance 1d12f9b2-058c-4fe2-964b-81217cb46489 on n-h1-826526-5 Jul 20 04:30:40.082281 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-5022a81e-7443-4868-885e-685f5d9e050e req-488819bd-c681-428b-91d5-5e24fd9c467d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124095 Jul 20 04:30:40.085050 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1649/3535] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:40.321637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-35a55911-687c-462a-a14e-7f92bd219fca tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:40.322647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35a55911-687c-462a-a14e-7f92bd219fca tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:40.359218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35a55911-687c-462a-a14e-7f92bd219fca tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:40.361309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35a55911-687c-462a-a14e-7f92bd219fca tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:40.375682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35a55911-687c-462a-a14e-7f92bd219fca tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:40.388493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35a55911-687c-462a-a14e-7f92bd219fca tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:41.087509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a8910324-26ac-4def-9855-4a6f1aabb3cb tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:41.088325 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a8910324-26ac-4def-9855-4a6f1aabb3cb tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: 1d12f9b2-058c-4fe2-964b-81217cb46489] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:41.115188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8910324-26ac-4def-9855-4a6f1aabb3cb tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.115671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8910324-26ac-4def-9855-4a6f1aabb3cb tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:41.116549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8910324-26ac-4def-9855-4a6f1aabb3cb tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.116993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8910324-26ac-4def-9855-4a6f1aabb3cb tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:41.159176 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-a8910324-26ac-4def-9855-4a6f1aabb3cb tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] HTTP exception thrown: Instance 1d12f9b2-058c-4fe2-964b-81217cb46489 could not be found. Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a8910324-26ac-4def-9855-4a6f1aabb3cb tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Request method failure captured: Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 HTTP/1.1 Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14QzHTAQDB4xDCLW6Wzn4o2DP--_ixNT3JFLjyEtUUsO8V_a6MOF3bIEjhANnh6dp5W88yw02x62pqs7iY8Z3dfHxjwDu_Tk0qJ8Ceis5nCGJGg7VV0zKbIHZ315mGWBvu25Qw5RL7QwtzuiLb_XarswT90GXIFaapmHJhEseOl9zsA Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c026c4ebe6564bb99c52f70fdec12ca3 Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ListImageFiltersTestJSON-659889395 Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c026c4ebe6564bb99c52f70fdec12ca3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c026c4ebe6564bb99c52f70fdec12ca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c026c4ebe6564bb99c52f70fdec12ca3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c026c4ebe6564bb99c52f70fdec12ca3"}]}] Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ListImageFiltersTestJSON-659889395 Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c026c4ebe6564bb99c52f70fdec12ca3 Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-659889395 Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ListImageFiltersTestJSON-659889395-project Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dc7cb2c568004f36991bd7ef01accca3 Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ListImageFiltersTestJSON-659889395-project Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 1d12f9b2-058c-4fe2-964b-81217cb46489 could not be found. Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '1d12f9b2-058c-4fe2-964b-81217cb46489'} Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d12f9b2-058c-4fe2-964b-81217cb46489 could not be found. Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d12f9b2-058c-4fe2-964b-81217cb46489 could not be found. Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:41.160859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:41.165569 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:41.165569 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:41.165569 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:41.165569 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:41.165569 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:41.165569 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d12f9b2-058c-4fe2-964b-81217cb46489 could not be found. Jul 20 04:30:41.165569 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:41.165569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a8910324-26ac-4def-9855-4a6f1aabb3cb tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Returning 404 to user: Instance 1d12f9b2-058c-4fe2-964b-81217cb46489 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:41.165569 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a8910324-26ac-4def-9855-4a6f1aabb3cb tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489" status: 404 len: 111 microversion: 2.1 time: 0.088906 Jul 20 04:30:41.178195 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1650/3536] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:41 2022] GET /compute/v2.1/servers/1d12f9b2-058c-4fe2-964b-81217cb46489 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:41.193558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e957a5b9-c7b3-4eb9-bcbf-1679ba162384 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:41.194021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e957a5b9-c7b3-4eb9-bcbf-1679ba162384 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:41.216946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e957a5b9-c7b3-4eb9-bcbf-1679ba162384 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.217404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e957a5b9-c7b3-4eb9-bcbf-1679ba162384 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:41.218222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e957a5b9-c7b3-4eb9-bcbf-1679ba162384 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.218670 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e957a5b9-c7b3-4eb9-bcbf-1679ba162384 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:41.337649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e957a5b9-c7b3-4eb9-bcbf-1679ba162384 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:30:41.435949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-35a55911-687c-462a-a14e-7f92bd219fca tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:41.456638 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-35a55911-687c-462a-a14e-7f92bd219fca tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1323 microversion: 2.1 time: 1.139127 Jul 20 04:30:41.458142 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1887/3537] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:40 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1323 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:41.552799 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e957a5b9-c7b3-4eb9-bcbf-1679ba162384 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b" status: 204 len: 0 microversion: 2.1 time: 0.372603 Jul 20 04:30:41.557667 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1651/3538] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:30:41 2022] DELETE /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:41.578280 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b637b5c0-2fd5-445d-b032-15e9254a694c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:41.584979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b637b5c0-2fd5-445d-b032-15e9254a694c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:41.645647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b637b5c0-2fd5-445d-b032-15e9254a694c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.646114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b637b5c0-2fd5-445d-b032-15e9254a694c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:41.646928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b637b5c0-2fd5-445d-b032-15e9254a694c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.647363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b637b5c0-2fd5-445d-b032-15e9254a694c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:41.940025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-ff0f68c2-8996-4424-8cfe-85a2079b778d req-df0849bb-d048-407a-8d7d-32069ef07ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "tag": "76dffb6b-943c-49a9-abbd-14d1036220db"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:41.962178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ff0f68c2-8996-4424-8cfe-85a2079b778d req-df0849bb-d048-407a-8d7d-32069ef07ec2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.968011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ff0f68c2-8996-4424-8cfe-85a2079b778d req-df0849bb-d048-407a-8d7d-32069ef07ec2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:42.005342 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-ff0f68c2-8996-4424-8cfe-85a2079b778d req-df0849bb-d048-407a-8d7d-32069ef07ec2 service nova] Creating event network-changed:76dffb6b-943c-49a9-abbd-14d1036220db for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:30:42.021872 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-ff0f68c2-8996-4424-8cfe-85a2079b778d req-df0849bb-d048-407a-8d7d-32069ef07ec2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087419 Jul 20 04:30:42.025909 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1652/3539] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:30:42.375702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b637b5c0-2fd5-445d-b032-15e9254a694c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:42.388563 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b637b5c0-2fd5-445d-b032-15e9254a694c tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b" status: 200 len: 1473 microversion: 2.1 time: 0.829085 Jul 20 04:30:42.390630 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1888/3540] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:41 2022] GET /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b => generated 1473 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:42.477108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-83df3b05-ecbc-40bb-80aa-dbe9b51a7bda tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:42.477826 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-83df3b05-ecbc-40bb-80aa-dbe9b51a7bda tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:42.525100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83df3b05-ecbc-40bb-80aa-dbe9b51a7bda tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:42.529580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83df3b05-ecbc-40bb-80aa-dbe9b51a7bda tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:42.530725 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83df3b05-ecbc-40bb-80aa-dbe9b51a7bda tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:42.546663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83df3b05-ecbc-40bb-80aa-dbe9b51a7bda tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:42.871348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-83df3b05-ecbc-40bb-80aa-dbe9b51a7bda tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:42.885246 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-83df3b05-ecbc-40bb-80aa-dbe9b51a7bda tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1323 microversion: 2.1 time: 0.413150 Jul 20 04:30:42.897591 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1653/3541] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:42 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1323 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:43.416206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-08749f82-299e-4a88-88de-8833426ee2a5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:43.417496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-08749f82-299e-4a88-88de-8833426ee2a5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:43.429097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08749f82-299e-4a88-88de-8833426ee2a5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:43.432924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08749f82-299e-4a88-88de-8833426ee2a5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.434034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08749f82-299e-4a88-88de-8833426ee2a5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:43.435818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08749f82-299e-4a88-88de-8833426ee2a5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.920709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-903741c6-a10d-40a7-8e08-85ae9bd96980 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:43.921331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-903741c6-a10d-40a7-8e08-85ae9bd96980 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:43.943431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-903741c6-a10d-40a7-8e08-85ae9bd96980 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:43.943885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-903741c6-a10d-40a7-8e08-85ae9bd96980 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.944724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-903741c6-a10d-40a7-8e08-85ae9bd96980 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:43.945158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-903741c6-a10d-40a7-8e08-85ae9bd96980 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:44.596429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-08749f82-299e-4a88-88de-8833426ee2a5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cb2c568004f36991bd7ef01accca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c026c4ebe6564bb99c52f70fdec12ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:44.610122 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-08749f82-299e-4a88-88de-8833426ee2a5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b" status: 200 len: 1473 microversion: 2.1 time: 1.204760 Jul 20 04:30:44.622459 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1889/3542] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:43 2022] GET /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b => generated 1473 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:44.653744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-3e0f9720-d2a1-4e10-ab6c-c0ab854a67ee req-7f50651c-e7af-496b-a099-a237613f6183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd034ab-f55b-4d96-99f2-5db7cc26944a", "name": "network-vif-plugged", "status": "completed", "tag": "d85df00a-5f5a-4c4b-829d-d45fe5fb695f"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:44.693632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3e0f9720-d2a1-4e10-ab6c-c0ab854a67ee req-7f50651c-e7af-496b-a099-a237613f6183 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:44.694151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3e0f9720-d2a1-4e10-ab6c-c0ab854a67ee req-7f50651c-e7af-496b-a099-a237613f6183 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:44.742573 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-3e0f9720-d2a1-4e10-ab6c-c0ab854a67ee req-7f50651c-e7af-496b-a099-a237613f6183 service nova] Creating event network-vif-plugged:d85df00a-5f5a-4c4b-829d-d45fe5fb695f for instance 7cd034ab-f55b-4d96-99f2-5db7cc26944a on n-h1-826526-5 Jul 20 04:30:44.765413 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-3e0f9720-d2a1-4e10-ab6c-c0ab854a67ee req-7f50651c-e7af-496b-a099-a237613f6183 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141102 Jul 20 04:30:44.766085 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1890/3543] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:44.805636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-903741c6-a10d-40a7-8e08-85ae9bd96980 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:44.823568 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-903741c6-a10d-40a7-8e08-85ae9bd96980 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1323 microversion: 2.1 time: 0.909744 Jul 20 04:30:44.827562 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1654/3544] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:43 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1323 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:44.839722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-20134e0a-ffb3-4de6-b6e9-072f62d30cc5 req-44a5c575-9ec9-4458-a0af-37d6476cc5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b", "name": "network-vif-deleted", "tag": "f5248619-09e7-4707-9127-fb95dc122bcf"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:44.857632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-20134e0a-ffb3-4de6-b6e9-072f62d30cc5 req-44a5c575-9ec9-4458-a0af-37d6476cc5c7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:44.858315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-20134e0a-ffb3-4de6-b6e9-072f62d30cc5 req-44a5c575-9ec9-4458-a0af-37d6476cc5c7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:44.880101 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-20134e0a-ffb3-4de6-b6e9-072f62d30cc5 req-44a5c575-9ec9-4458-a0af-37d6476cc5c7 service nova] Creating event network-vif-deleted:f5248619-09e7-4707-9127-fb95dc122bcf for instance a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b on n-h2-826526-5 Jul 20 04:30:44.906235 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-20134e0a-ffb3-4de6-b6e9-072f62d30cc5 req-44a5c575-9ec9-4458-a0af-37d6476cc5c7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070837 Jul 20 04:30:44.907417 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1891/3545] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:45.642325 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-324b1712-c21d-4273-b538-13c5228b603b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:45.644085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-324b1712-c21d-4273-b538-13c5228b603b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] [instance: a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:45.660380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-324b1712-c21d-4273-b538-13c5228b603b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:45.661375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-324b1712-c21d-4273-b538-13c5228b603b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:45.662758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-324b1712-c21d-4273-b538-13c5228b603b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:45.667266 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-324b1712-c21d-4273-b538-13c5228b603b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:45.713519 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-324b1712-c21d-4273-b538-13c5228b603b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] HTTP exception thrown: Instance a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b could not be found. Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-324b1712-c21d-4273-b538-13c5228b603b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Request method failure captured: Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b HTTP/1.1 Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14QzHTAQDB4xDCLW6Wzn4o2DP--_ixNT3JFLjyEtUUsO8V_a6MOF3bIEjhANnh6dp5W88yw02x62pqs7iY8Z3dfHxjwDu_Tk0qJ8Ceis5nCGJGg7VV0zKbIHZ315mGWBvu25Qw5RL7QwtzuiLb_XarswT90GXIFaapmHJhEseOl9zsA Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c026c4ebe6564bb99c52f70fdec12ca3 Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ListImageFiltersTestJSON-659889395 Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c026c4ebe6564bb99c52f70fdec12ca3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c026c4ebe6564bb99c52f70fdec12ca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c026c4ebe6564bb99c52f70fdec12ca3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c026c4ebe6564bb99c52f70fdec12ca3"}]}] Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ListImageFiltersTestJSON-659889395 Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c026c4ebe6564bb99c52f70fdec12ca3 Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-659889395 Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ListImageFiltersTestJSON-659889395-project Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dc7cb2c568004f36991bd7ef01accca3 Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ListImageFiltersTestJSON-659889395-project Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b could not be found. Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b'} Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b could not be found. Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b could not be found. Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:45.730766 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:45.744946 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:45.744946 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:45.744946 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:45.744946 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:45.744946 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:45.744946 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b could not be found. Jul 20 04:30:45.744946 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:45.744946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-324b1712-c21d-4273-b538-13c5228b603b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Returning 404 to user: Instance a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:45.744946 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-324b1712-c21d-4273-b538-13c5228b603b tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b" status: 404 len: 111 microversion: 2.1 time: 0.108065 Jul 20 04:30:45.755302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ea421fba-22a8-41e6-9d7e-773ea232f971 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be3f8310>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:45.770533 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1655/3546] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:45 2022] GET /compute/v2.1/servers/a8ec9e09-9aef-45d3-9c3b-3dd2c102ae7b => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:45.845617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c67fb0a9-1a9b-4b51-99ff-4dba7044a1ff tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:45.846755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c67fb0a9-1a9b-4b51-99ff-4dba7044a1ff tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:45.879396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c67fb0a9-1a9b-4b51-99ff-4dba7044a1ff tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:45.883196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c67fb0a9-1a9b-4b51-99ff-4dba7044a1ff tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:45.884563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c67fb0a9-1a9b-4b51-99ff-4dba7044a1ff tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:45.885297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c67fb0a9-1a9b-4b51-99ff-4dba7044a1ff tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.270643 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ea421fba-22a8-41e6-9d7e-773ea232f971 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "DELETE /compute/v2.1/images/322cfa12-e360-4912-8b56-9df255c696a2" status: 204 len: 0 microversion: 2.1 time: 0.521396 Jul 20 04:30:46.271293 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1892/3547] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:45 2022] DELETE /compute/v2.1/images/322cfa12-e360-4912-8b56-9df255c696a2 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:30:46.280447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-eff2afd9-cb0f-4b28-8f62-96560b7764f5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06be1ddaf0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:46.388364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c67fb0a9-1a9b-4b51-99ff-4dba7044a1ff tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:46.396247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:46.401116 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c67fb0a9-1a9b-4b51-99ff-4dba7044a1ff tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1323 microversion: 2.1 time: 0.561055 Jul 20 04:30:46.418567 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1656/3548] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:45 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1323 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:46.815128 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-eff2afd9-cb0f-4b28-8f62-96560b7764f5 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "DELETE /compute/v2.1/images/78a58835-87b7-457b-8cb6-70d508b2ac93" status: 204 len: 0 microversion: 2.1 time: 0.539331 Jul 20 04:30:46.823356 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1893/3549] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:46 2022] DELETE /compute/v2.1/images/78a58835-87b7-457b-8cb6-70d508b2ac93 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:30:46.826703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3ad9b8ba-dc72-4008-abcd-ee8717f53ba0 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] Calling method '.version_select at 0x7f06bdb8b1f0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:47.324032 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3ad9b8ba-dc72-4008-abcd-ee8717f53ba0 tempest-ListImageFiltersTestJSON-659889395 tempest-ListImageFiltersTestJSON-659889395-project] 10.222.0.17 "DELETE /compute/v2.1/images/33fe81d9-c99c-4429-baab-ff0fec92ee3e" status: 204 len: 0 microversion: 2.1 time: 0.501388 Jul 20 04:30:47.325665 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1657/3550] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:46 2022] DELETE /compute/v2.1/images/33fe81d9-c99c-4429-baab-ff0fec92ee3e => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:47.437814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9c2e8028-0875-45c0-b645-82edf28be938 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:47.439008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9c2e8028-0875-45c0-b645-82edf28be938 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:47.474939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c2e8028-0875-45c0-b645-82edf28be938 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:47.482507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c2e8028-0875-45c0-b645-82edf28be938 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:47.491618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c2e8028-0875-45c0-b645-82edf28be938 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:47.492199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c2e8028-0875-45c0-b645-82edf28be938 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:47.552359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-58b22698-c8d9-424a-831a-b8bf319c7898 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Action: 'create', calling method: .version_select at 0x7f06be47d1f0>, body: {"keypair": {"name": "tempest-keypair-679597744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlMXBPQXaFi1VgNxrHe+kwY6olWZaVJ3wuiOdWF3HFYa2syaNGk5Pfeqf2NkMDIR+85dn4Pu8Z/P35oi3tCIWUKwXPguAv0+3XigmkLPcLztNgKaoUSWwrxCkATpvCuTg=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:47.629709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-58b22698-c8d9-424a-831a-b8bf319c7898 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Getting quotas for project 62e4a9ab93cb459fb20e059cdb8a220f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:47.653499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-58b22698-c8d9-424a-831a-b8bf319c7898 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Getting quotas for user 2b2af1cff4e141ba84b1317d67290e17 and project 62e4a9ab93cb459fb20e059cdb8a220f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:47.768580 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-58b22698-c8d9-424a-831a-b8bf319c7898 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.499394 Jul 20 04:30:47.770618 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1894/3551] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:30:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:48.382598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9c2e8028-0875-45c0-b645-82edf28be938 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:48.405495 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9c2e8028-0875-45c0-b645-82edf28be938 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1518 microversion: 2.1 time: 0.976192 Jul 20 04:30:48.429090 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1658/3552] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:47 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1518 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:48.713780 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-702f4845-113e-47e1-96f2-8646b64e63c5 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-115801279", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "960b4b1d-1fb9-4635-ae62-ae660712feb1"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-702f4845-113e-47e1-96f2-8646b64e63c5 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Request method failure captured: Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 242 Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14TScRJf6Ym_JUOVIst4GvdrrAHTvfx-Gg1_ubvxzx6ktycqSMyRBDcUXqWdn_ZdaYv9v_dyI2XLBeX4H1ijlHeH6BG08SO-E7IG-Bi6icNr3VP8rz9Hz-ppuuORhXWM7dTrNQQqlDzcrElUBagQRbCLBd4-IUwD2N0waJ7D-vXWcaM Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 193c97c8ebe3454687b2701015fac182 Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/193c97c8ebe3454687b2701015fac182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/193c97c8ebe3454687b2701015fac182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_193c97c8ebe3454687b2701015fac182", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/193c97c8ebe3454687b2701015fac182"}]}] Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 193c97c8ebe3454687b2701015fac182 Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerMetadataNegativeTestJSON-1455569431-project Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: e260c28ea7964a36a2df4da221ef0187 Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1455569431-project Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-115801279", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "960b4b1d-1fb9-4635-ae62-ae660712feb1"}]}} Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-115801279', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '960b4b1d-1fb9-4635-ae62-ae660712feb1'}]}}} Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:48.718018 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:48.722052 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:30:48.722052 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:30:48.722052 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:30:48.722052 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:30:48.722052 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:30:48.722052 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:30:48.722052 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:48.722052 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.722052 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:48.722052 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.722052 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:48.722052 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:48.722052 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:48.722052 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:30:48.722052 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:30:48.722052 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:48.722052 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.724484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-702f4845-113e-47e1-96f2-8646b64e63c5 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:48.727568 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-702f4845-113e-47e1-96f2-8646b64e63c5 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.017764 Jul 20 04:30:48.728430 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1895/3553] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:30:48 2022] POST /compute/v2.1/servers => generated 175 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:30:48.739746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8190251e-0e6f-4116-96a3-355f507b4070 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:48.740704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8190251e-0e6f-4116-96a3-355f507b4070 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: ee228086-eda9-4e77-a09d-693a943fcde0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:48.743924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:48.758057 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-8190251e-0e6f-4116-96a3-355f507b4070 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] HTTP exception thrown: Instance ee228086-eda9-4e77-a09d-693a943fcde0 could not be found. Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8190251e-0e6f-4116-96a3-355f507b4070 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Request method failure captured: Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/ee228086-eda9-4e77-a09d-693a943fcde0/metadata HTTP/1.1 Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14TScRJf6Ym_JUOVIst4GvdrrAHTvfx-Gg1_ubvxzx6ktycqSMyRBDcUXqWdn_ZdaYv9v_dyI2XLBeX4H1ijlHeH6BG08SO-E7IG-Bi6icNr3VP8rz9Hz-ppuuORhXWM7dTrNQQqlDzcrElUBagQRbCLBd4-IUwD2N0waJ7D-vXWcaM Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 193c97c8ebe3454687b2701015fac182 Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/193c97c8ebe3454687b2701015fac182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/193c97c8ebe3454687b2701015fac182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_193c97c8ebe3454687b2701015fac182", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/193c97c8ebe3454687b2701015fac182"}]}] Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 193c97c8ebe3454687b2701015fac182 Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerMetadataNegativeTestJSON-1455569431-project Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: e260c28ea7964a36a2df4da221ef0187 Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1455569431-project Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance ee228086-eda9-4e77-a09d-693a943fcde0 could not be found. Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'server_id': 'ee228086-eda9-4e77-a09d-693a943fcde0'} Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee228086-eda9-4e77-a09d-693a943fcde0 could not be found. Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee228086-eda9-4e77-a09d-693a943fcde0 could not be found. Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:48.762404 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:48.766191 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:48.766191 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:48.766191 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee228086-eda9-4e77-a09d-693a943fcde0 could not be found. Jul 20 04:30:48.766191 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.768008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8190251e-0e6f-4116-96a3-355f507b4070 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Returning 404 to user: Instance ee228086-eda9-4e77-a09d-693a943fcde0 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:48.769629 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8190251e-0e6f-4116-96a3-355f507b4070 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/ee228086-eda9-4e77-a09d-693a943fcde0/metadata" status: 404 len: 111 microversion: 2.1 time: 0.033925 Jul 20 04:30:48.770775 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1659/3554] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:30:48 2022] GET /compute/v2.1/servers/ee228086-eda9-4e77-a09d-693a943fcde0/metadata => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:48.915826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-59d37ff1-7f7e-471d-8bf2-7ab7b616e96a tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1354495562", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "960b4b1d-1fb9-4635-ae62-ae660712feb1"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-59d37ff1-7f7e-471d-8bf2-7ab7b616e96a tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Request method failure captured: Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 499 Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14TScRJf6Ym_JUOVIst4GvdrrAHTvfx-Gg1_ubvxzx6ktycqSMyRBDcUXqWdn_ZdaYv9v_dyI2XLBeX4H1ijlHeH6BG08SO-E7IG-Bi6icNr3VP8rz9Hz-ppuuORhXWM7dTrNQQqlDzcrElUBagQRbCLBd4-IUwD2N0waJ7D-vXWcaM Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 193c97c8ebe3454687b2701015fac182 Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/193c97c8ebe3454687b2701015fac182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/193c97c8ebe3454687b2701015fac182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_193c97c8ebe3454687b2701015fac182", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/193c97c8ebe3454687b2701015fac182"}]}] Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 193c97c8ebe3454687b2701015fac182 Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerMetadataNegativeTestJSON-1455569431-project Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: e260c28ea7964a36a2df4da221ef0187 Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1455569431-project Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1354495562", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "960b4b1d-1fb9-4635-ae62-ae660712feb1"}]}} Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1354495562', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '960b4b1d-1fb9-4635-ae62-ae660712feb1'}]}}} Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:30:48.925756 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:48.928831 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.933332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-59d37ff1-7f7e-471d-8bf2-7ab7b616e96a tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:48.934379 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-59d37ff1-7f7e-471d-8bf2-7ab7b616e96a tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.023853 Jul 20 04:30:48.945366 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1896/3555] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:30:48 2022] POST /compute/v2.1/servers => generated 687 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:30:49.175510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c90fd99b-ae98-473c-af3c-53939a95c773 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-767108854", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "960b4b1d-1fb9-4635-ae62-ae660712feb1"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c90fd99b-ae98-473c-af3c-53939a95c773 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Request method failure captured: Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 499 Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14TScRJf6Ym_JUOVIst4GvdrrAHTvfx-Gg1_ubvxzx6ktycqSMyRBDcUXqWdn_ZdaYv9v_dyI2XLBeX4H1ijlHeH6BG08SO-E7IG-Bi6icNr3VP8rz9Hz-ppuuORhXWM7dTrNQQqlDzcrElUBagQRbCLBd4-IUwD2N0waJ7D-vXWcaM Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 193c97c8ebe3454687b2701015fac182 Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/193c97c8ebe3454687b2701015fac182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/193c97c8ebe3454687b2701015fac182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_193c97c8ebe3454687b2701015fac182", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/193c97c8ebe3454687b2701015fac182"}]}] Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 193c97c8ebe3454687b2701015fac182 Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerMetadataNegativeTestJSON-1455569431-project Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: e260c28ea7964a36a2df4da221ef0187 Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1455569431-project Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-767108854", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "960b4b1d-1fb9-4635-ae62-ae660712feb1"}]}} Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-767108854', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '960b4b1d-1fb9-4635-ae62-ae660712feb1'}]}}} Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:30:49.181911 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:49.186867 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.195404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c90fd99b-ae98-473c-af3c-53939a95c773 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:49.199018 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c90fd99b-ae98-473c-af3c-53939a95c773 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.029689 Jul 20 04:30:49.202824 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1660/3556] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:30:49 2022] POST /compute/v2.1/servers => generated 689 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:30:49.351918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dfe36c59-a664-4690-893d-f2d01d4adddf tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-34619700", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "960b4b1d-1fb9-4635-ae62-ae660712feb1"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dfe36c59-a664-4690-893d-f2d01d4adddf tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Request method failure captured: Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 752 Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14TScRJf6Ym_JUOVIst4GvdrrAHTvfx-Gg1_ubvxzx6ktycqSMyRBDcUXqWdn_ZdaYv9v_dyI2XLBeX4H1ijlHeH6BG08SO-E7IG-Bi6icNr3VP8rz9Hz-ppuuORhXWM7dTrNQQqlDzcrElUBagQRbCLBd4-IUwD2N0waJ7D-vXWcaM Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 193c97c8ebe3454687b2701015fac182 Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/193c97c8ebe3454687b2701015fac182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/193c97c8ebe3454687b2701015fac182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_193c97c8ebe3454687b2701015fac182", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/193c97c8ebe3454687b2701015fac182"}]}] Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 193c97c8ebe3454687b2701015fac182 Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerMetadataNegativeTestJSON-1455569431-project Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: e260c28ea7964a36a2df4da221ef0187 Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1455569431-project Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-34619700", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "960b4b1d-1fb9-4635-ae62-ae660712feb1"}]}} Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-34619700', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '960b4b1d-1fb9-4635-ae62-ae660712feb1'}]}}} Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:30:49.357132 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:30:49.359726 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:30:49.361946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:49.361946 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.364342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dfe36c59-a664-4690-893d-f2d01d4adddf tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:49.365474 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dfe36c59-a664-4690-893d-f2d01d4adddf tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.018218 Jul 20 04:30:49.383785 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1897/3557] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:30:49 2022] POST /compute/v2.1/servers => generated 1197 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 20 04:30:49.498915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-74392e81-c5af-40d9-9f0e-4e43e7d7cb02 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1953473164", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "960b4b1d-1fb9-4635-ae62-ae660712feb1"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-74392e81-c5af-40d9-9f0e-4e43e7d7cb02 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Request method failure captured: Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 1266 Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14TScRJf6Ym_JUOVIst4GvdrrAHTvfx-Gg1_ubvxzx6ktycqSMyRBDcUXqWdn_ZdaYv9v_dyI2XLBeX4H1ijlHeH6BG08SO-E7IG-Bi6icNr3VP8rz9Hz-ppuuORhXWM7dTrNQQqlDzcrElUBagQRbCLBd4-IUwD2N0waJ7D-vXWcaM Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 193c97c8ebe3454687b2701015fac182 Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/193c97c8ebe3454687b2701015fac182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/193c97c8ebe3454687b2701015fac182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_193c97c8ebe3454687b2701015fac182", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/193c97c8ebe3454687b2701015fac182"}]}] Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 193c97c8ebe3454687b2701015fac182 Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerMetadataNegativeTestJSON-1455569431-project Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: e260c28ea7964a36a2df4da221ef0187 Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1455569431-project Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1953473164", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "960b4b1d-1fb9-4635-ae62-ae660712feb1"}]}} Jul 20 04:30:49.502302 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:30:49.504817 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:49.504817 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1953473164', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '960b4b1d-1fb9-4635-ae62-ae660712feb1'}]}}} Jul 20 04:30:49.504817 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:49.504817 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:49.504817 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:30:49.504817 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:30:49.504817 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:30:49.504817 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:30:49.504817 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:49.504817 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.504817 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:30:49.504817 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:30:49.504817 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:30:49.504817 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:30:49.504817 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:30:49.504817 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.504817 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:30:49.506258 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:30:49.508211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:30:49.508211 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.517497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-74392e81-c5af-40d9-9f0e-4e43e7d7cb02 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:49.517497 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-74392e81-c5af-40d9-9f0e-4e43e7d7cb02 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.016839 Jul 20 04:30:49.523391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5d8e2898-3d35-414a-96e3-bb589ac6e0aa tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:49.524170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5d8e2898-3d35-414a-96e3-bb589ac6e0aa tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: c625319b-9653-45c0-acd1-cbc301171cde] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:49.532889 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1661/3558] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Jul 20 04:30:49 2022] POST /compute/v2.1/servers => generated 2221 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 20 04:30:49.541946 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-5d8e2898-3d35-414a-96e3-bb589ac6e0aa tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] HTTP exception thrown: Instance c625319b-9653-45c0-acd1-cbc301171cde could not be found. Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5d8e2898-3d35-414a-96e3-bb589ac6e0aa tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Request method failure captured: Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/c625319b-9653-45c0-acd1-cbc301171cde/metadata/test2 HTTP/1.1 Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14TScRJf6Ym_JUOVIst4GvdrrAHTvfx-Gg1_ubvxzx6ktycqSMyRBDcUXqWdn_ZdaYv9v_dyI2XLBeX4H1ijlHeH6BG08SO-E7IG-Bi6icNr3VP8rz9Hz-ppuuORhXWM7dTrNQQqlDzcrElUBagQRbCLBd4-IUwD2N0waJ7D-vXWcaM Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 193c97c8ebe3454687b2701015fac182 Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/193c97c8ebe3454687b2701015fac182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/193c97c8ebe3454687b2701015fac182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_193c97c8ebe3454687b2701015fac182", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/193c97c8ebe3454687b2701015fac182"}]}] Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 193c97c8ebe3454687b2701015fac182 Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerMetadataNegativeTestJSON-1455569431-project Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: e260c28ea7964a36a2df4da221ef0187 Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1455569431-project Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance c625319b-9653-45c0-acd1-cbc301171cde could not be found. Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'server_id': 'c625319b-9653-45c0-acd1-cbc301171cde', 'id': 'test2'} Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c625319b-9653-45c0-acd1-cbc301171cde could not be found. Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c625319b-9653-45c0-acd1-cbc301171cde could not be found. Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:49.546490 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:49.551479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:49.551479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:49.551479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c625319b-9653-45c0-acd1-cbc301171cde could not be found. Jul 20 04:30:49.551479 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:49.553686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5d8e2898-3d35-414a-96e3-bb589ac6e0aa tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Returning 404 to user: Instance c625319b-9653-45c0-acd1-cbc301171cde could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:49.554732 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5d8e2898-3d35-414a-96e3-bb589ac6e0aa tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/c625319b-9653-45c0-acd1-cbc301171cde/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.035517 Jul 20 04:30:49.559947 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1898/3559] 10.222.0.17 () {58 vars in 1280 bytes} [Wed Jul 20 04:30:49 2022] GET /compute/v2.1/servers/c625319b-9653-45c0-acd1-cbc301171cde/metadata/test2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:49.577172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d1f4f4e0-3a14-403d-b49b-460a6a03eb81 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:49.591292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d1f4f4e0-3a14-403d-b49b-460a6a03eb81 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:49.633128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1f4f4e0-3a14-403d-b49b-460a6a03eb81 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:49.635853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1f4f4e0-3a14-403d-b49b-460a6a03eb81 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:49.637638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1f4f4e0-3a14-403d-b49b-460a6a03eb81 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:49.643504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1f4f4e0-3a14-403d-b49b-460a6a03eb81 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:49.777356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d1f4f4e0-3a14-403d-b49b-460a6a03eb81 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:30:50.040786 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d1f4f4e0-3a14-403d-b49b-460a6a03eb81 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 204 len: 0 microversion: 2.1 time: 0.466449 Jul 20 04:30:50.049609 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1662/3560] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:30:49 2022] DELETE /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:50.061414 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2ac9ab97-9636-4592-a23e-63bac06f2533 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:50.062418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2ac9ab97-9636-4592-a23e-63bac06f2533 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:50.103773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ac9ab97-9636-4592-a23e-63bac06f2533 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:50.107990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ac9ab97-9636-4592-a23e-63bac06f2533 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:50.113393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ac9ab97-9636-4592-a23e-63bac06f2533 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:50.113973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ac9ab97-9636-4592-a23e-63bac06f2533 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:51.098542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2ac9ab97-9636-4592-a23e-63bac06f2533 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:51.110433 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2ac9ab97-9636-4592-a23e-63bac06f2533 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1524 microversion: 2.1 time: 1.055206 Jul 20 04:30:51.114431 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1899/3561] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:50 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1524 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:52.136970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-364b4966-5242-4259-bf1f-ebbfb682f6b8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:52.139540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-364b4966-5242-4259-bf1f-ebbfb682f6b8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:52.156246 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-364b4966-5242-4259-bf1f-ebbfb682f6b8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:52.156725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-364b4966-5242-4259-bf1f-ebbfb682f6b8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:52.157523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-364b4966-5242-4259-bf1f-ebbfb682f6b8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:52.157973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-364b4966-5242-4259-bf1f-ebbfb682f6b8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:52.428084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-82b2b0cc-cce0-47d1-a4de-c70ce85257e6 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Action: 'create', calling method: .version_select at 0x7f06be2f8310>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMc2cp2bvA4uIx1oUP2OqF3E/zGG6Ek+/6Urra5X3IIQ2Z4d7JqFFI1GcX8vdLc2nBlADEvv8qYoLAau9XNd7/04nWiOuRU2JbkSOWqMvfl2Bd/npPKvTJsoERNLw3DOCA=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:52.457379 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-82b2b0cc-cce0-47d1-a4de-c70ce85257e6 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-82b2b0cc-cce0-47d1-a4de-c70ce85257e6 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Request method failure captured: Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 257 Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14T7cKbRm_PoK5L22TuwWQ7sUrEfxx7WMZZ5pL6snZ9hjupar00_C8d9jlSGuT0fmrDcZ0kCi39bDXeZqElrA9QDap7XJ1xsVybsyD7A3YUPhBy8DnlKrOzSLGLpEGGCMc1B4z3xM67xzfz66kQEcWVYVZVYujf7GAtzVIiyKR_87pw Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 41764c3824d442de826e8c879a5b249c Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/41764c3824d442de826e8c879a5b249c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/41764c3824d442de826e8c879a5b249c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_41764c3824d442de826e8c879a5b249c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/41764c3824d442de826e8c879a5b249c"}]}] Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 41764c3824d442de826e8c879a5b249c Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-KeyPairsNegativeTestJSON-297957709-project Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 1cbd6a652ef3457e8aa58ba1734dc968 Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-KeyPairsNegativeTestJSON-297957709-project Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMc2cp2bvA4uIx1oUP2OqF3E/zGG6Ek+/6Urra5X3IIQ2Z4d7JqFFI1GcX8vdLc2nBlADEvv8qYoLAau9XNd7/04nWiOuRU2JbkSOWqMvfl2Bd/npPKvTJsoERNLw3DOCA=="}} Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMc2cp2bvA4uIx1oUP2OqF3E/zGG6Ek+/6Urra5X3IIQ2Z4d7JqFFI1GcX8vdLc2nBlADEvv8qYoLAau9XNd7/04nWiOuRU2JbkSOWqMvfl2Bd/npPKvTJsoERNLw3DOCA=='}}} Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:30:52.469263 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:30:52.473410 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:52.476246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-82b2b0cc-cce0-47d1-a4de-c70ce85257e6 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:52.477410 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-82b2b0cc-cce0-47d1-a4de-c70ce85257e6 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.413980 Jul 20 04:30:52.478496 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1663/3562] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:30:52 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 416 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:30:52.490999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f31f4d61-aa14-45c3-9e96-16395813bf5e tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Action: 'create', calling method: .version_select at 0x7f06be065c10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-313846738", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:52.563474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-f31f4d61-aa14-45c3-9e96-16395813bf5e tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Getting quotas for project 41764c3824d442de826e8c879a5b249c. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:52.584597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-f31f4d61-aa14-45c3-9e96-16395813bf5e tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Getting quotas for user 1cbd6a652ef3457e8aa58ba1734dc968 and project 41764c3824d442de826e8c879a5b249c. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:52.635288 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-f31f4d61-aa14-45c3-9e96-16395813bf5e tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f31f4d61-aa14-45c3-9e96-16395813bf5e tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Request method failure captured: Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 2166 Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14T7cKbRm_PoK5L22TuwWQ7sUrEfxx7WMZZ5pL6snZ9hjupar00_C8d9jlSGuT0fmrDcZ0kCi39bDXeZqElrA9QDap7XJ1xsVybsyD7A3YUPhBy8DnlKrOzSLGLpEGGCMc1B4z3xM67xzfz66kQEcWVYVZVYujf7GAtzVIiyKR_87pw Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 41764c3824d442de826e8c879a5b249c Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/41764c3824d442de826e8c879a5b249c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/41764c3824d442de826e8c879a5b249c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_41764c3824d442de826e8c879a5b249c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/41764c3824d442de826e8c879a5b249c"}]}] Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 41764c3824d442de826e8c879a5b249c Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-KeyPairsNegativeTestJSON-297957709-project Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 1cbd6a652ef3457e8aa58ba1734dc968 Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-KeyPairsNegativeTestJSON-297957709-project Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-313846738", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:30:52.656356 n-d-826526-5 devstack@n-api.service[127870]: exception: Keypair data is invalid: failed to generate fingerprint Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-313846738', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:52.658528 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f31f4d61-aa14-45c3-9e96-16395813bf5e tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f31f4d61-aa14-45c3-9e96-16395813bf5e tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.174034 Jul 20 04:30:52.663351 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1664/3563] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Jul 20 04:30:52 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 20 04:30:52.676014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7f5e4256-629b-4e58-bade-dbae01f72438 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Action: 'create', calling method: .version_select at 0x7f06be065940>, body: {"keypair": {"name": "tempest-keypair-922546670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaE+sV2xATvVAnj8zbITtTug8HdJ5Q0B2u/fWNOs1Ir4qK1P4r0i90qjm1oqiS1eulYp0jcK0rvSyQ1vpfyJZ7eY5PaMUqDiA5AnNrrVXGl0+9HKyuv7+G3Jh8oE+gOuQ=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:52.760983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-7f5e4256-629b-4e58-bade-dbae01f72438 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Getting quotas for project 41764c3824d442de826e8c879a5b249c. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:52.781877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-7f5e4256-629b-4e58-bade-dbae01f72438 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Getting quotas for user 1cbd6a652ef3457e8aa58ba1734dc968 and project 41764c3824d442de826e8c879a5b249c. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:52.843390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-364b4966-5242-4259-bf1f-ebbfb682f6b8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:52.855561 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-364b4966-5242-4259-bf1f-ebbfb682f6b8 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1524 microversion: 2.1 time: 0.723674 Jul 20 04:30:52.874469 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1900/3564] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:52 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1524 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:52.909100 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7f5e4256-629b-4e58-bade-dbae01f72438 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.240369 Jul 20 04:30:52.910878 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1665/3565] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:30:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:52.926012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-44aa27ae-de2a-4c01-bdb2-be472103011d tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Action: 'create', calling method: .version_select at 0x7f06bddbb280>, body: {"keypair": {"name": "tempest-keypair-922546670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPeofFr5fR5ZDnJhlS8pixLZ9b+AfbXu/0gj8E1FASC4ZhsYAud7gqmeJlcYyCj0rHnUdg73HV3f1nVS/z9YzpvaE1t/bmkIPRke2zvtV90MC5WyuSNzVizU8rGh+M9jQ=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:52.974946 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-44aa27ae-de2a-4c01-bdb2-be472103011d tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Getting quotas for project 41764c3824d442de826e8c879a5b249c. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:52.989750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-44aa27ae-de2a-4c01-bdb2-be472103011d tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Getting quotas for user 1cbd6a652ef3457e8aa58ba1734dc968 and project 41764c3824d442de826e8c879a5b249c. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:53.134171 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-44aa27ae-de2a-4c01-bdb2-be472103011d tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] HTTP exception thrown: Key pair 'tempest-keypair-922546670' already exists. Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-44aa27ae-de2a-4c01-bdb2-be472103011d tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Request method failure captured: Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 272 Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14T7cKbRm_PoK5L22TuwWQ7sUrEfxx7WMZZ5pL6snZ9hjupar00_C8d9jlSGuT0fmrDcZ0kCi39bDXeZqElrA9QDap7XJ1xsVybsyD7A3YUPhBy8DnlKrOzSLGLpEGGCMc1B4z3xM67xzfz66kQEcWVYVZVYujf7GAtzVIiyKR_87pw Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 41764c3824d442de826e8c879a5b249c Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/41764c3824d442de826e8c879a5b249c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/41764c3824d442de826e8c879a5b249c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_41764c3824d442de826e8c879a5b249c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/41764c3824d442de826e8c879a5b249c"}]}] Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 41764c3824d442de826e8c879a5b249c Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-KeyPairsNegativeTestJSON-297957709-project Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1cbd6a652ef3457e8aa58ba1734dc968 Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-KeyPairsNegativeTestJSON-297957709-project Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: {"keypair": {"name": "tempest-keypair-922546670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPeofFr5fR5ZDnJhlS8pixLZ9b+AfbXu/0gj8E1FASC4ZhsYAud7gqmeJlcYyCj0rHnUdg73HV3f1nVS/z9YzpvaE1t/bmkIPRke2zvtV90MC5WyuSNzVizU8rGh+M9jQ=="}} Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: exception: Key pair 'tempest-keypair-922546670' already exists. Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-922546670', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPeofFr5fR5ZDnJhlS8pixLZ9b+AfbXu/0gj8E1FASC4ZhsYAud7gqmeJlcYyCj0rHnUdg73HV3f1nVS/z9YzpvaE1t/bmkIPRke2zvtV90MC5WyuSNzVizU8rGh+M9jQ=='}}} Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '1cbd6a652ef3457e8aa58ba1734dc968-tempest-keypair-922546670' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 20 04:30:53.153193 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi session.flush() Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:30:53.157890 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '1cbd6a652ef3457e8aa58ba1734dc968-tempest-keypair-922546670' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 20, 4, 30, 53, 81408), 'updated_at': None, 'name': 'tempest-keypair-922546670', 'user_id': '1cbd6a652ef3457e8aa58ba1734dc968', 'fingerprint': '80:4b:5a:56:1e:2e:a3:42:f7:6d:00:c0:19:2f:7d:89', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPeofFr5fR5ZDnJhlS8pixLZ9b+AfbXu/0gj8E1FASC4ZhsYAud7gqmeJlcYyCj0rHnUdg73HV3f1nVS/z9YzpvaE1t/bmkIPRke2zvtV90MC5WyuSNzVizU8rGh+M9jQ==', 'type': 'ssh'}] Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi keypair.create() Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._create() Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-922546670' already exists. Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 20 04:30:53.166253 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-922546670' already exists. Jul 20 04:30:53.180850 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.180850 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:53.180850 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.180850 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.180850 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:53.180850 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:53.180850 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:53.180850 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:53.180850 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-922546670' already exists. Jul 20 04:30:53.180850 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.180850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-44aa27ae-de2a-4c01-bdb2-be472103011d tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Returning 409 to user: Key pair 'tempest-keypair-922546670' already exists. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:53.180850 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-44aa27ae-de2a-4c01-bdb2-be472103011d tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.239678 Jul 20 04:30:53.180850 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1901/3566] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:30:52 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 244 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:30:53.187983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8836a1c5-5dcb-4821-8814-ee2fbbbecad6 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Calling method '.version_select at 0x7f06bd537940>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:53.310243 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8836a1c5-5dcb-4821-8814-ee2fbbbecad6 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-922546670" status: 202 len: 0 microversion: 2.1 time: 0.144605 Jul 20 04:30:53.316876 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1666/3567] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jul 20 04:30:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-922546670 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:30:53.327141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-56bf10a6-b329-48bc-a532-3a0fa91c9cc9 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Action: 'create', calling method: .version_select at 0x7f06be3f8310>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOibZsBuZ0NzqOjb2xgj47ccKPW4Froh9XT/Gebocw7Sf7Mqc3I7oe6EnTZj49slWROkkcG1iMdUjpbDg7INngcrBFq6/8xH51bH0CPpGWxItT3h4GirD1jRS5ydeSRIgQ=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-56bf10a6-b329-48bc-a532-3a0fa91c9cc9 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Request method failure captured: Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 247 Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14T7cKbRm_PoK5L22TuwWQ7sUrEfxx7WMZZ5pL6snZ9hjupar00_C8d9jlSGuT0fmrDcZ0kCi39bDXeZqElrA9QDap7XJ1xsVybsyD7A3YUPhBy8DnlKrOzSLGLpEGGCMc1B4z3xM67xzfz66kQEcWVYVZVYujf7GAtzVIiyKR_87pw Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 41764c3824d442de826e8c879a5b249c Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/41764c3824d442de826e8c879a5b249c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/41764c3824d442de826e8c879a5b249c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_41764c3824d442de826e8c879a5b249c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/41764c3824d442de826e8c879a5b249c"}]}] Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 41764c3824d442de826e8c879a5b249c Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-KeyPairsNegativeTestJSON-297957709-project Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1cbd6a652ef3457e8aa58ba1734dc968 Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-KeyPairsNegativeTestJSON-297957709-project Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOibZsBuZ0NzqOjb2xgj47ccKPW4Froh9XT/Gebocw7Sf7Mqc3I7oe6EnTZj49slWROkkcG1iMdUjpbDg7INngcrBFq6/8xH51bH0CPpGWxItT3h4GirD1jRS5ydeSRIgQ=="}} Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOibZsBuZ0NzqOjb2xgj47ccKPW4Froh9XT/Gebocw7Sf7Mqc3I7oe6EnTZj49slWROkkcG1iMdUjpbDg7INngcrBFq6/8xH51bH0CPpGWxItT3h4GirD1jRS5ydeSRIgQ=='}}} Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi '' Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:30:53.332523 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:30:53.337229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:30:53.337229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:30:53.337229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:30:53.337229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:30:53.337229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:30:53.337229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.337229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:53.337229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.337229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.337229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:53.337229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:53.337229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:30:53.337229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:30:53.337229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:30:53.337229 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.337229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-56bf10a6-b329-48bc-a532-3a0fa91c9cc9 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:53.339013 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-56bf10a6-b329-48bc-a532-3a0fa91c9cc9 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.017716 Jul 20 04:30:53.346383 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1902/3568] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:30:53 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:30:53.356197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf23ee98-e268-4a0e-b1ef-8fe0337c9b48 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Action: 'create', calling method: .version_select at 0x7f06be2cc430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1761200054", "public_key": " "}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:53.393989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-cf23ee98-e268-4a0e-b1ef-8fe0337c9b48 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Getting quotas for project 41764c3824d442de826e8c879a5b249c. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:53.415519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-cf23ee98-e268-4a0e-b1ef-8fe0337c9b48 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Getting quotas for user 1cbd6a652ef3457e8aa58ba1734dc968 and project 41764c3824d442de826e8c879a5b249c. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:53.523872 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-cf23ee98-e268-4a0e-b1ef-8fe0337c9b48 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf23ee98-e268-4a0e-b1ef-8fe0337c9b48 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Request method failure captured: Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 95 Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14T7cKbRm_PoK5L22TuwWQ7sUrEfxx7WMZZ5pL6snZ9hjupar00_C8d9jlSGuT0fmrDcZ0kCi39bDXeZqElrA9QDap7XJ1xsVybsyD7A3YUPhBy8DnlKrOzSLGLpEGGCMc1B4z3xM67xzfz66kQEcWVYVZVYujf7GAtzVIiyKR_87pw Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 41764c3824d442de826e8c879a5b249c Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/41764c3824d442de826e8c879a5b249c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/41764c3824d442de826e8c879a5b249c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_41764c3824d442de826e8c879a5b249c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/41764c3824d442de826e8c879a5b249c"}]}] Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 41764c3824d442de826e8c879a5b249c Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-KeyPairsNegativeTestJSON-297957709-project Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 1cbd6a652ef3457e8aa58ba1734dc968 Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-KeyPairsNegativeTestJSON-297957709-project Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1761200054", "public_key": " "}} Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: exception: Keypair data is invalid: failed to generate fingerprint Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1761200054', 'public_key': ' '}}} Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.531959 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 20 04:30:53.537283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.547151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf23ee98-e268-4a0e-b1ef-8fe0337c9b48 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:53.553740 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cf23ee98-e268-4a0e-b1ef-8fe0337c9b48 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.201658 Jul 20 04:30:53.557395 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1667/3569] 10.222.0.17 () {60 vars in 1157 bytes} [Wed Jul 20 04:30:53 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:30:53.575209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e55fc337-6266-422f-ba68-6a4d80eab80d tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Action: 'create', calling method: .version_select at 0x7f06be6513a0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5/WsMISFkkml5URX17EsUJ2Jt3Habxb/9IvJ3OCy6uqgN/4P/tBfyl1TokGvalrq1EJJUze7CHC/ekGNs5WOd8gnVqHpvu1QVZsbbjS4Nh7gVyUUEMov62BHfJP5C4Jw=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e55fc337-6266-422f-ba68-6a4d80eab80d tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Request method failure captured: Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 507 Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14T7cKbRm_PoK5L22TuwWQ7sUrEfxx7WMZZ5pL6snZ9hjupar00_C8d9jlSGuT0fmrDcZ0kCi39bDXeZqElrA9QDap7XJ1xsVybsyD7A3YUPhBy8DnlKrOzSLGLpEGGCMc1B4z3xM67xzfz66kQEcWVYVZVYujf7GAtzVIiyKR_87pw Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 41764c3824d442de826e8c879a5b249c Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/41764c3824d442de826e8c879a5b249c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/41764c3824d442de826e8c879a5b249c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_41764c3824d442de826e8c879a5b249c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/41764c3824d442de826e8c879a5b249c"}]}] Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 41764c3824d442de826e8c879a5b249c Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-KeyPairsNegativeTestJSON-297957709-project Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1cbd6a652ef3457e8aa58ba1734dc968 Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-KeyPairsNegativeTestJSON-297957709-project Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5/WsMISFkkml5URX17EsUJ2Jt3Habxb/9IvJ3OCy6uqgN/4P/tBfyl1TokGvalrq1EJJUze7CHC/ekGNs5WOd8gnVqHpvu1QVZsbbjS4Nh7gVyUUEMov62BHfJP5C4Jw=="}} Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5/WsMISFkkml5URX17EsUJ2Jt3Habxb/9IvJ3OCy6uqgN/4P/tBfyl1TokGvalrq1EJJUze7CHC/ekGNs5WOd8gnVqHpvu1QVZsbbjS4Nh7gVyUUEMov62BHfJP5C4Jw=='}}} Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 20 04:30:53.578828 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 04:30:53.582806 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.588724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e55fc337-6266-422f-ba68-6a4d80eab80d tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:53.591174 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e55fc337-6266-422f-ba68-6a4d80eab80d tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.025676 Jul 20 04:30:53.594223 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1903/3570] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:30:53 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:30:53.609881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3a4fc543-362a-429c-b1f7-c428a74f4cd1 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Action: 'create', calling method: .version_select at 0x7f06be5ab5e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1251594765", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:53.665496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-3a4fc543-362a-429c-b1f7-c428a74f4cd1 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Getting quotas for project 41764c3824d442de826e8c879a5b249c. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:53.686861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-3a4fc543-362a-429c-b1f7-c428a74f4cd1 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Getting quotas for user 1cbd6a652ef3457e8aa58ba1734dc968 and project 41764c3824d442de826e8c879a5b249c. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:53.745220 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-3a4fc543-362a-429c-b1f7-c428a74f4cd1 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3a4fc543-362a-429c-b1f7-c428a74f4cd1 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Request method failure captured: Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 118 Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14T7cKbRm_PoK5L22TuwWQ7sUrEfxx7WMZZ5pL6snZ9hjupar00_C8d9jlSGuT0fmrDcZ0kCi39bDXeZqElrA9QDap7XJ1xsVybsyD7A3YUPhBy8DnlKrOzSLGLpEGGCMc1B4z3xM67xzfz66kQEcWVYVZVYujf7GAtzVIiyKR_87pw Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 41764c3824d442de826e8c879a5b249c Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/41764c3824d442de826e8c879a5b249c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/41764c3824d442de826e8c879a5b249c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_41764c3824d442de826e8c879a5b249c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/41764c3824d442de826e8c879a5b249c"}]}] Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 41764c3824d442de826e8c879a5b249c Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-KeyPairsNegativeTestJSON-297957709-project Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 1cbd6a652ef3457e8aa58ba1734dc968 Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-KeyPairsNegativeTestJSON-297957709-project Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1251594765", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: method: Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: exception: Keypair data is invalid: failed to generate fingerprint Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1251594765', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 20 04:30:53.752701 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 20 04:30:53.759075 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.766477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3a4fc543-362a-429c-b1f7-c428a74f4cd1 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:53.767606 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3a4fc543-362a-429c-b1f7-c428a74f4cd1 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.167683 Jul 20 04:30:53.780466 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1668/3571] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:30:53 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 20 04:30:53.800591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3e573c71-35e2-4aca-9d16-a933459f94e7 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Calling method '.version_select at 0x7f06bdf303a0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:53.830061 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-3e573c71-35e2-4aca-9d16-a933459f94e7 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1593615998 not found for user 1cbd6a652ef3457e8aa58ba1734dc968 Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3e573c71-35e2-4aca-9d16-a933459f94e7 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Request method failure captured: Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1593615998 HTTP/1.1 Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14T7cKbRm_PoK5L22TuwWQ7sUrEfxx7WMZZ5pL6snZ9hjupar00_C8d9jlSGuT0fmrDcZ0kCi39bDXeZqElrA9QDap7XJ1xsVybsyD7A3YUPhBy8DnlKrOzSLGLpEGGCMc1B4z3xM67xzfz66kQEcWVYVZVYujf7GAtzVIiyKR_87pw Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 41764c3824d442de826e8c879a5b249c Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/41764c3824d442de826e8c879a5b249c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/41764c3824d442de826e8c879a5b249c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_41764c3824d442de826e8c879a5b249c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/41764c3824d442de826e8c879a5b249c"}]}] Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 41764c3824d442de826e8c879a5b249c Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-297957709 Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-KeyPairsNegativeTestJSON-297957709-project Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1cbd6a652ef3457e8aa58ba1734dc968 Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-KeyPairsNegativeTestJSON-297957709-project Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: method: Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: exception: Keypair tempest-keypair-non-existent-1593615998 not found for user 1cbd6a652ef3457e8aa58ba1734dc968 Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'tempest-keypair-non-existent-1593615998'} Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1593615998 not found for user 1cbd6a652ef3457e8aa58ba1734dc968 Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.837060 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1593615998 not found for user 1cbd6a652ef3457e8aa58ba1734dc968 Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1593615998 not found for user 1cbd6a652ef3457e8aa58ba1734dc968 Jul 20 04:30:53.841425 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:53.857821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3e573c71-35e2-4aca-9d16-a933459f94e7 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1593615998 not found for user 1cbd6a652ef3457e8aa58ba1734dc968 {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:53.860974 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3e573c71-35e2-4aca-9d16-a933459f94e7 tempest-KeyPairsNegativeTestJSON-297957709 tempest-KeyPairsNegativeTestJSON-297957709-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1593615998" status: 404 len: 145 microversion: 2.1 time: 0.078069 Jul 20 04:30:53.863350 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1904/3572] 10.222.0.17 () {58 vars in 1259 bytes} [Wed Jul 20 04:30:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1593615998 => generated 145 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:53.881649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-259e96a3-f3e6-45ae-b078-0866a7a57783 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:53.882527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-259e96a3-f3e6-45ae-b078-0866a7a57783 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:53.900302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-259e96a3-f3e6-45ae-b078-0866a7a57783 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:53.918228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-259e96a3-f3e6-45ae-b078-0866a7a57783 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:53.921882 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-259e96a3-f3e6-45ae-b078-0866a7a57783 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:53.924741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-259e96a3-f3e6-45ae-b078-0866a7a57783 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:54.803443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-259e96a3-f3e6-45ae-b078-0866a7a57783 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:54.814192 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-259e96a3-f3e6-45ae-b078-0866a7a57783 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1524 microversion: 2.1 time: 0.938484 Jul 20 04:30:54.830430 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1669/3573] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:53 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1524 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:55.849528 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-285be22a-a3a8-44da-98fc-e50f39fcd0e1 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:55.850174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-285be22a-a3a8-44da-98fc-e50f39fcd0e1 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:55.877946 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:55.884325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-285be22a-a3a8-44da-98fc-e50f39fcd0e1 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:55.884807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-285be22a-a3a8-44da-98fc-e50f39fcd0e1 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:55.885617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-285be22a-a3a8-44da-98fc-e50f39fcd0e1 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:55.894720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-285be22a-a3a8-44da-98fc-e50f39fcd0e1 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:55.933272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=70 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:56.136920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ca3a8406-9780-4666-85c1-63dad5b15fa8 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1554824063", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4b52a5c6-1c41-4b66-a161-9c12be217c7f"}], "security_groups": [{"name": "tempest-securitygroup--79908112"}], "key_name": "tempest-keypair-679597744", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:56.214641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-285be22a-a3a8-44da-98fc-e50f39fcd0e1 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260c28ea7964a36a2df4da221ef0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c97c8ebe3454687b2701015fac182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:56.237163 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-285be22a-a3a8-44da-98fc-e50f39fcd0e1 tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 200 len: 1482 microversion: 2.1 time: 0.400403 Jul 20 04:30:56.240066 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1905/3574] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:55 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 1482 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:56.254606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e79dcf94-d115-41ac-8984-e86d21d932e8 req-91d17f85-ad9c-4c72-b6cb-4f11f9b3d499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd034ab-f55b-4d96-99f2-5db7cc26944a", "name": "network-vif-deleted", "tag": "d85df00a-5f5a-4c4b-829d-d45fe5fb695f"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:56.292500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e79dcf94-d115-41ac-8984-e86d21d932e8 req-91d17f85-ad9c-4c72-b6cb-4f11f9b3d499 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:56.293314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e79dcf94-d115-41ac-8984-e86d21d932e8 req-91d17f85-ad9c-4c72-b6cb-4f11f9b3d499 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:56.319989 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e79dcf94-d115-41ac-8984-e86d21d932e8 req-91d17f85-ad9c-4c72-b6cb-4f11f9b3d499 service nova] Creating event network-vif-deleted:d85df00a-5f5a-4c4b-829d-d45fe5fb695f for instance 7cd034ab-f55b-4d96-99f2-5db7cc26944a on n-h1-826526-5 Jul 20 04:30:56.332019 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e79dcf94-d115-41ac-8984-e86d21d932e8 req-91d17f85-ad9c-4c72-b6cb-4f11f9b3d499 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085140 Jul 20 04:30:56.339841 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1906/3575] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:56.567936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-ca3a8406-9780-4666-85c1-63dad5b15fa8 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] validate_networks() for [('4b52a5c6-1c41-4b66-a161-9c12be217c7f', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:30:57.270893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-97f5a05d-9cd1-4bea-9975-4284b466370e tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:57.271899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-97f5a05d-9cd1-4bea-9975-4284b466370e tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] [instance: 7cd034ab-f55b-4d96-99f2-5db7cc26944a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:57.285711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97f5a05d-9cd1-4bea-9975-4284b466370e tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:57.287269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97f5a05d-9cd1-4bea-9975-4284b466370e tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:57.288568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97f5a05d-9cd1-4bea-9975-4284b466370e tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:57.290183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97f5a05d-9cd1-4bea-9975-4284b466370e tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:57.305284 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-97f5a05d-9cd1-4bea-9975-4284b466370e tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] HTTP exception thrown: Instance 7cd034ab-f55b-4d96-99f2-5db7cc26944a could not be found. Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-97f5a05d-9cd1-4bea-9975-4284b466370e tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Request method failure captured: Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a HTTP/1.1 Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14TScRJf6Ym_JUOVIst4GvdrrAHTvfx-Gg1_ubvxzx6ktycqSMyRBDcUXqWdn_ZdaYv9v_dyI2XLBeX4H1ijlHeH6BG08SO-E7IG-Bi6icNr3VP8rz9Hz-ppuuORhXWM7dTrNQQqlDzcrElUBagQRbCLBd4-IUwD2N0waJ7D-vXWcaM Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 193c97c8ebe3454687b2701015fac182 Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/193c97c8ebe3454687b2701015fac182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/193c97c8ebe3454687b2701015fac182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_193c97c8ebe3454687b2701015fac182", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/193c97c8ebe3454687b2701015fac182"}]}] Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 193c97c8ebe3454687b2701015fac182 Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1455569431 Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerMetadataNegativeTestJSON-1455569431-project Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: e260c28ea7964a36a2df4da221ef0187 Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1455569431-project Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 7cd034ab-f55b-4d96-99f2-5db7cc26944a could not be found. Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '7cd034ab-f55b-4d96-99f2-5db7cc26944a'} Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cd034ab-f55b-4d96-99f2-5db7cc26944a could not be found. Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cd034ab-f55b-4d96-99f2-5db7cc26944a could not be found. Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:57.307666 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:57.312807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:57.312807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:57.312807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:57.312807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:57.312807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:57.312807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:57.312807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cd034ab-f55b-4d96-99f2-5db7cc26944a could not be found. Jul 20 04:30:57.312807 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:30:57.314328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-97f5a05d-9cd1-4bea-9975-4284b466370e tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] Returning 404 to user: Instance 7cd034ab-f55b-4d96-99f2-5db7cc26944a could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:57.315418 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-97f5a05d-9cd1-4bea-9975-4284b466370e tempest-ServerMetadataNegativeTestJSON-1455569431 tempest-ServerMetadataNegativeTestJSON-1455569431-project] 10.222.0.17 "GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a" status: 404 len: 111 microversion: 2.1 time: 0.051178 Jul 20 04:30:57.331992 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1907/3576] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:57 2022] GET /compute/v2.1/servers/7cd034ab-f55b-4d96-99f2-5db7cc26944a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:58.216891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-ca3a8406-9780-4666-85c1-63dad5b15fa8 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Getting quotas for project 62e4a9ab93cb459fb20e059cdb8a220f. Resources: dict_keys(['metadata_items']) {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:58.224616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-ca3a8406-9780-4666-85c1-63dad5b15fa8 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Getting quotas for user 2b2af1cff4e141ba84b1317d67290e17 and project 62e4a9ab93cb459fb20e059cdb8a220f. Resources: dict_keys(['metadata_items']) {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:58.261972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ca3a8406-9780-4666-85c1-63dad5b15fa8 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:30:58.262641 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ca3a8406-9780-4666-85c1-63dad5b15fa8 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:30:58.263502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ca3a8406-9780-4666-85c1-63dad5b15fa8 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:30:58.264280 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ca3a8406-9780-4666-85c1-63dad5b15fa8 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:30:58.265049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ca3a8406-9780-4666-85c1-63dad5b15fa8 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:30:58.292150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca3a8406-9780-4666-85c1-63dad5b15fa8 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:58.292643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca3a8406-9780-4666-85c1-63dad5b15fa8 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:58.296601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca3a8406-9780-4666-85c1-63dad5b15fa8 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:58.297422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca3a8406-9780-4666-85c1-63dad5b15fa8 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:58.346699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-ca3a8406-9780-4666-85c1-63dad5b15fa8 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Getting quotas for project 62e4a9ab93cb459fb20e059cdb8a220f. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:58.367729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-ca3a8406-9780-4666-85c1-63dad5b15fa8 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Getting quotas for user 2b2af1cff4e141ba84b1317d67290e17 and project 62e4a9ab93cb459fb20e059cdb8a220f. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:58.415193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ca3a8406-9780-4666-85c1-63dad5b15fa8 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:30:58.420208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ca3a8406-9780-4666-85c1-63dad5b15fa8 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:30:58.542041 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ca3a8406-9780-4666-85c1-63dad5b15fa8 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.410289 Jul 20 04:30:58.542934 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1670/3577] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:30:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 2412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:30:58.553249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-91a05916-f367-4ea3-ae44-d185efe8af4f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:58.554018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-91a05916-f367-4ea3-ae44-d185efe8af4f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:59.179098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-91a05916-f367-4ea3-ae44-d185efe8af4f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:59.193736 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-91a05916-f367-4ea3-ae44-d185efe8af4f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1269 microversion: 2.1 time: 0.642469 Jul 20 04:30:59.208299 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1908/3578] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:58 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1269 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:00.214420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-282c3e94-bfe3-4206-8859-d27fdd66a0a0 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:00.216095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-282c3e94-bfe3-4206-8859-d27fdd66a0a0 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:00.237508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-282c3e94-bfe3-4206-8859-d27fdd66a0a0 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:00.238233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-282c3e94-bfe3-4206-8859-d27fdd66a0a0 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:00.241971 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-282c3e94-bfe3-4206-8859-d27fdd66a0a0 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:00.247321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-282c3e94-bfe3-4206-8859-d27fdd66a0a0 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:00.703511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-282c3e94-bfe3-4206-8859-d27fdd66a0a0 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:00.711001 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-282c3e94-bfe3-4206-8859-d27fdd66a0a0 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1339 microversion: 2.1 time: 0.500657 Jul 20 04:31:00.711578 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1671/3579] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:00 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1339 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:01.730431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-383e84db-9c7f-48e1-ba6f-bddfddbe36b4 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:01.731929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-383e84db-9c7f-48e1-ba6f-bddfddbe36b4 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:01.744779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-383e84db-9c7f-48e1-ba6f-bddfddbe36b4 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:01.745655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-383e84db-9c7f-48e1-ba6f-bddfddbe36b4 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:01.749190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-383e84db-9c7f-48e1-ba6f-bddfddbe36b4 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:01.749800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-383e84db-9c7f-48e1-ba6f-bddfddbe36b4 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:02.394956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-383e84db-9c7f-48e1-ba6f-bddfddbe36b4 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:02.407698 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-383e84db-9c7f-48e1-ba6f-bddfddbe36b4 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1327 microversion: 2.1 time: 0.681948 Jul 20 04:31:02.426232 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1909/3580] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:01 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1327 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:03.427963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-50c20d95-529f-424c-8229-55b5b85fdb98 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:03.429500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-50c20d95-529f-424c-8229-55b5b85fdb98 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:03.448765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50c20d95-529f-424c-8229-55b5b85fdb98 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:03.451768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50c20d95-529f-424c-8229-55b5b85fdb98 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:03.452140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50c20d95-529f-424c-8229-55b5b85fdb98 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:03.453726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50c20d95-529f-424c-8229-55b5b85fdb98 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:04.148767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-50c20d95-529f-424c-8229-55b5b85fdb98 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:04.178323 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-50c20d95-529f-424c-8229-55b5b85fdb98 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1393 microversion: 2.1 time: 0.751403 Jul 20 04:31:04.188171 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1672/3581] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:03 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1393 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:05.212738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-40c7698d-a9a2-4380-917c-736188f261d6 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:05.213560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-40c7698d-a9a2-4380-917c-736188f261d6 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:05.249956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40c7698d-a9a2-4380-917c-736188f261d6 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:05.253289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40c7698d-a9a2-4380-917c-736188f261d6 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:05.255735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40c7698d-a9a2-4380-917c-736188f261d6 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:05.257882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40c7698d-a9a2-4380-917c-736188f261d6 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:06.672218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-40c7698d-a9a2-4380-917c-736188f261d6 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:06.684141 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-40c7698d-a9a2-4380-917c-736188f261d6 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1393 microversion: 2.1 time: 1.477374 Jul 20 04:31:06.684771 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1910/3582] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:05 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1393 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:07.706904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-af937b34-8a29-4095-a8a9-ff6d84602ee1 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:07.707569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-af937b34-8a29-4095-a8a9-ff6d84602ee1 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:07.730224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af937b34-8a29-4095-a8a9-ff6d84602ee1 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:07.737375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af937b34-8a29-4095-a8a9-ff6d84602ee1 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:07.738860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af937b34-8a29-4095-a8a9-ff6d84602ee1 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:07.739586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af937b34-8a29-4095-a8a9-ff6d84602ee1 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:08.318683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:08.392968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=26 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:08.997318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-af937b34-8a29-4095-a8a9-ff6d84602ee1 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:09.021510 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-af937b34-8a29-4095-a8a9-ff6d84602ee1 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1393 microversion: 2.1 time: 1.321779 Jul 20 04:31:09.027214 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1673/3583] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:07 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1393 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:10.044351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dc7c64b8-265e-43da-b35b-b2704a00850c tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:10.045434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dc7c64b8-265e-43da-b35b-b2704a00850c tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:10.062418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=10 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:10.074397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc7c64b8-265e-43da-b35b-b2704a00850c tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:10.075053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc7c64b8-265e-43da-b35b-b2704a00850c tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:10.076053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc7c64b8-265e-43da-b35b-b2704a00850c tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:10.077900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc7c64b8-265e-43da-b35b-b2704a00850c tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:10.376195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-984b5919-3b81-4d98-bc4b-5c7f08ee95fa req-d01b98de-1b9e-4e75-b758-9d6988c95ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77b7b690-49b0-4475-bf8e-77d17ed76c70", "tag": "70aafaef-c7de-42aa-a442-bc353be736e5"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:10.449610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-984b5919-3b81-4d98-bc4b-5c7f08ee95fa req-d01b98de-1b9e-4e75-b758-9d6988c95ed0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:10.453354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-984b5919-3b81-4d98-bc4b-5c7f08ee95fa req-d01b98de-1b9e-4e75-b758-9d6988c95ed0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:10.504385 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-984b5919-3b81-4d98-bc4b-5c7f08ee95fa req-d01b98de-1b9e-4e75-b758-9d6988c95ed0 service nova] Creating event network-changed:70aafaef-c7de-42aa-a442-bc353be736e5 for instance 77b7b690-49b0-4475-bf8e-77d17ed76c70 on n-h1-826526-5 Jul 20 04:31:10.519360 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-984b5919-3b81-4d98-bc4b-5c7f08ee95fa req-d01b98de-1b9e-4e75-b758-9d6988c95ed0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149377 Jul 20 04:31:10.521889 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1674/3584] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:11.278355 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dc7c64b8-265e-43da-b35b-b2704a00850c tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:11.292861 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dc7c64b8-265e-43da-b35b-b2704a00850c tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1393 microversion: 2.1 time: 1.252134 Jul 20 04:31:11.298964 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1911/3585] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:10 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1393 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:12.068250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-df18106f-e2f1-4698-85a6-4c80b5260902 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:12.069264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-df18106f-e2f1-4698-85a6-4c80b5260902 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:12.110376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df18106f-e2f1-4698-85a6-4c80b5260902 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:12.111000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df18106f-e2f1-4698-85a6-4c80b5260902 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:12.111863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df18106f-e2f1-4698-85a6-4c80b5260902 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:12.112327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df18106f-e2f1-4698-85a6-4c80b5260902 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:12.330809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-199fc0e9-2bde-442d-811a-b3c5f4511032 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:12.332461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-199fc0e9-2bde-442d-811a-b3c5f4511032 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:12.344544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-199fc0e9-2bde-442d-811a-b3c5f4511032 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:12.359360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-199fc0e9-2bde-442d-811a-b3c5f4511032 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:12.364761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-199fc0e9-2bde-442d-811a-b3c5f4511032 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:12.366476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-199fc0e9-2bde-442d-811a-b3c5f4511032 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:12.979731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-199fc0e9-2bde-442d-811a-b3c5f4511032 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:12.988530 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-199fc0e9-2bde-442d-811a-b3c5f4511032 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1393 microversion: 2.1 time: 0.664629 Jul 20 04:31:12.990643 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1912/3586] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:12 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1393 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:13.138204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-df18106f-e2f1-4698-85a6-4c80b5260902 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:13.198394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-df18106f-e2f1-4698-85a6-4c80b5260902 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:13.211576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-df18106f-e2f1-4698-85a6-4c80b5260902 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:13.213651 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-df18106f-e2f1-4698-85a6-4c80b5260902 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 2941 microversion: 2.32 time: 1.680599 Jul 20 04:31:13.228300 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1675/3587] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:11 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 2941 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:13.239686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-11055b0c-a2ad-44bd-a0f1-a6687bc97383 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:13.240198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-11055b0c-a2ad-44bd-a0f1-a6687bc97383 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:13.254687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11055b0c-a2ad-44bd-a0f1-a6687bc97383 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:13.255878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11055b0c-a2ad-44bd-a0f1-a6687bc97383 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:13.257623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11055b0c-a2ad-44bd-a0f1-a6687bc97383 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:13.258826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11055b0c-a2ad-44bd-a0f1-a6687bc97383 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:13.654565 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-11055b0c-a2ad-44bd-a0f1-a6687bc97383 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.416328 Jul 20 04:31:13.657133 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1913/3588] 10.222.0.17 () {60 vars in 1315 bytes} [Wed Jul 20 04:31:13 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede/os-interface => generated 1830 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:14.009874 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dcdff888-b3dd-450d-9505-7bd436bb801f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:14.012100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dcdff888-b3dd-450d-9505-7bd436bb801f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:14.022538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcdff888-b3dd-450d-9505-7bd436bb801f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:14.023423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcdff888-b3dd-450d-9505-7bd436bb801f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:14.024683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcdff888-b3dd-450d-9505-7bd436bb801f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:14.025292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcdff888-b3dd-450d-9505-7bd436bb801f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:14.371009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dcdff888-b3dd-450d-9505-7bd436bb801f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:14.397472 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dcdff888-b3dd-450d-9505-7bd436bb801f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1393 microversion: 2.1 time: 0.392092 Jul 20 04:31:14.408642 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1676/3589] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:14 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1393 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:15.436772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-04e47632-2d16-4837-bdc3-643e01b2e7d4 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:15.438201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-04e47632-2d16-4837-bdc3-643e01b2e7d4 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:15.449150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-04e47632-2d16-4837-bdc3-643e01b2e7d4 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:15.450035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-04e47632-2d16-4837-bdc3-643e01b2e7d4 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:15.451093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-04e47632-2d16-4837-bdc3-643e01b2e7d4 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:15.451741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-04e47632-2d16-4837-bdc3-643e01b2e7d4 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:16.369766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-04e47632-2d16-4837-bdc3-643e01b2e7d4 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:16.385769 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-04e47632-2d16-4837-bdc3-643e01b2e7d4 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1393 microversion: 2.1 time: 0.974797 Jul 20 04:31:16.398858 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1914/3590] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:15 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1393 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:16.985263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94a2c52f-3635-4da8-a911-910e6121621c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-261056302", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "24e87f45-00cc-4a88-bd41-d4609744971e"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:17.107698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-94a2c52f-3635-4da8-a911-910e6121621c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] validate_networks() for [('24e87f45-00cc-4a88-bd41-d4609744971e', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:31:17.409352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8c04684d-8023-4226-877f-62005a47c665 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:17.410113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8c04684d-8023-4226-877f-62005a47c665 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:17.462364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c04684d-8023-4226-877f-62005a47c665 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:17.463014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c04684d-8023-4226-877f-62005a47c665 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:17.469144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c04684d-8023-4226-877f-62005a47c665 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:17.469784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c04684d-8023-4226-877f-62005a47c665 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:18.222731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8c04684d-8023-4226-877f-62005a47c665 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:18.243273 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8c04684d-8023-4226-877f-62005a47c665 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1393 microversion: 2.1 time: 0.841334 Jul 20 04:31:18.243875 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1915/3591] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:17 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1393 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:18.847798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-94a2c52f-3635-4da8-a911-910e6121621c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:31:18.848378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-94a2c52f-3635-4da8-a911-910e6121621c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:31:18.848972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-94a2c52f-3635-4da8-a911-910e6121621c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:31:18.849430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-94a2c52f-3635-4da8-a911-910e6121621c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:31:18.849822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-94a2c52f-3635-4da8-a911-910e6121621c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:31:18.868501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94a2c52f-3635-4da8-a911-910e6121621c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:18.871993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94a2c52f-3635-4da8-a911-910e6121621c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:18.873377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94a2c52f-3635-4da8-a911-910e6121621c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:18.876682 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94a2c52f-3635-4da8-a911-910e6121621c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:18.910039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:18.934965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:18.953068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-94a2c52f-3635-4da8-a911-910e6121621c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Getting quotas for project db61fc3387294fe19b5ee8f565883102. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:31:18.998948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-94a2c52f-3635-4da8-a911-910e6121621c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Getting quotas for user b397b39ad73c446ab43a47cf6401ac52 and project db61fc3387294fe19b5ee8f565883102. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:31:19.042103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-94a2c52f-3635-4da8-a911-910e6121621c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Going to run 3 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:31:19.049523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-94a2c52f-3635-4da8-a911-910e6121621c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 522460f3-4bad-4790-b516-b1a3be971f45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:31:19.146223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-94a2c52f-3635-4da8-a911-910e6121621c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: ab277261-8f75-4ad3-89d1-6ef43801e981] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=522460f3-4bad-4790-b516-b1a3be971f45,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:31:19.244993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-94a2c52f-3635-4da8-a911-910e6121621c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=ab277261-8f75-4ad3-89d1-6ef43801e981,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:31:19.261733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cc86485c-4385-4aaf-b640-2524c106c947 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:19.262458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cc86485c-4385-4aaf-b640-2524c106c947 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:19.281089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc86485c-4385-4aaf-b640-2524c106c947 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:19.281880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc86485c-4385-4aaf-b640-2524c106c947 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:19.286472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc86485c-4385-4aaf-b640-2524c106c947 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:19.289692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc86485c-4385-4aaf-b640-2524c106c947 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:19.397796 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-94a2c52f-3635-4da8-a911-910e6121621c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.693758 Jul 20 04:31:19.404314 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1677/3592] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:31:19.419714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ee2e692f-2811-4d12-8eec-c120783eebc7 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:19.431170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ee2e692f-2811-4d12-8eec-c120783eebc7 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:19.433591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ee2e692f-2811-4d12-8eec-c120783eebc7 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Searching by: {'deleted': False, 'project_id': 'db61fc3387294fe19b5ee8f565883102'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:31:19.506217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee2e692f-2811-4d12-8eec-c120783eebc7 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:19.507308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee2e692f-2811-4d12-8eec-c120783eebc7 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:19.508511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee2e692f-2811-4d12-8eec-c120783eebc7 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:19.509216 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee2e692f-2811-4d12-8eec-c120783eebc7 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:19.554224 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ee2e692f-2811-4d12-8eec-c120783eebc7 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.140923 Jul 20 04:31:19.555574 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1678/3593] 10.222.0.17 () {58 vars in 1124 bytes} [Wed Jul 20 04:31:19 2022] GET /compute/v2.1/servers => generated 1015 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:19.571684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-29ef1d8c-e1ce-4074-8ca7-0c5b451b5de6 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:19.573197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-29ef1d8c-e1ce-4074-8ca7-0c5b451b5de6 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:19.804043 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cc86485c-4385-4aaf-b640-2524c106c947 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:19.813661 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cc86485c-4385-4aaf-b640-2524c106c947 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1393 microversion: 2.1 time: 0.556471 Jul 20 04:31:19.814126 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1916/3594] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:19 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1393 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:20.020679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-29ef1d8c-e1ce-4074-8ca7-0c5b451b5de6 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:20.031642 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-29ef1d8c-e1ce-4074-8ca7-0c5b451b5de6 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1222 microversion: 2.1 time: 0.465353 Jul 20 04:31:20.046864 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1679/3595] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:19 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1222 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:20.831721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d3b4d456-e6af-486b-9fb3-4a7b027fcd2b tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:20.833198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d3b4d456-e6af-486b-9fb3-4a7b027fcd2b tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:20.843579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3b4d456-e6af-486b-9fb3-4a7b027fcd2b tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:20.844069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3b4d456-e6af-486b-9fb3-4a7b027fcd2b tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:20.844847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3b4d456-e6af-486b-9fb3-4a7b027fcd2b tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:20.845291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3b4d456-e6af-486b-9fb3-4a7b027fcd2b tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:21.068703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8e2866ae-5d33-4e22-8ff7-1c6464b13293 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:21.070527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8e2866ae-5d33-4e22-8ff7-1c6464b13293 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:21.308046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8e2866ae-5d33-4e22-8ff7-1c6464b13293 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:21.326455 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8e2866ae-5d33-4e22-8ff7-1c6464b13293 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1222 microversion: 2.1 time: 0.271588 Jul 20 04:31:21.336496 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1680/3596] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:21 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1222 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:21.357101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-dbb1dd4d-1f08-4b44-bae1-543f6093d664 req-82304ada-5697-456c-b04e-5632ee532b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b7b690-49b0-4475-bf8e-77d17ed76c70", "name": "network-vif-plugged", "status": "completed", "tag": "70aafaef-c7de-42aa-a442-bc353be736e5"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:21.397857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-dbb1dd4d-1f08-4b44-bae1-543f6093d664 req-82304ada-5697-456c-b04e-5632ee532b9b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:21.401543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-dbb1dd4d-1f08-4b44-bae1-543f6093d664 req-82304ada-5697-456c-b04e-5632ee532b9b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:21.420624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d3b4d456-e6af-486b-9fb3-4a7b027fcd2b tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:21.436934 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d3b4d456-e6af-486b-9fb3-4a7b027fcd2b tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1393 microversion: 2.1 time: 0.609766 Jul 20 04:31:21.439508 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1917/3597] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:20 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1393 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:21.446305 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-dbb1dd4d-1f08-4b44-bae1-543f6093d664 req-82304ada-5697-456c-b04e-5632ee532b9b service nova] Creating event network-vif-plugged:70aafaef-c7de-42aa-a442-bc353be736e5 for instance 77b7b690-49b0-4475-bf8e-77d17ed76c70 on n-h1-826526-5 Jul 20 04:31:21.461038 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-dbb1dd4d-1f08-4b44-bae1-543f6093d664 req-82304ada-5697-456c-b04e-5632ee532b9b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125952 Jul 20 04:31:21.464662 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1681/3598] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:22.345054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1c731a1b-5294-4a49-a45d-e9becb03c356 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:22.345900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1c731a1b-5294-4a49-a45d-e9becb03c356 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:22.359641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c731a1b-5294-4a49-a45d-e9becb03c356 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.360149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c731a1b-5294-4a49-a45d-e9becb03c356 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.375466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c731a1b-5294-4a49-a45d-e9becb03c356 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.376009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c731a1b-5294-4a49-a45d-e9becb03c356 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.463084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7d529d6f-51a7-41a3-981a-59cba1e049a2 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:22.463839 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7d529d6f-51a7-41a3-981a-59cba1e049a2 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:22.533914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d529d6f-51a7-41a3-981a-59cba1e049a2 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.534578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d529d6f-51a7-41a3-981a-59cba1e049a2 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.535724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d529d6f-51a7-41a3-981a-59cba1e049a2 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.548397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d529d6f-51a7-41a3-981a-59cba1e049a2 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.829571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1c731a1b-5294-4a49-a45d-e9becb03c356 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:22.851849 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1c731a1b-5294-4a49-a45d-e9becb03c356 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1218 microversion: 2.1 time: 0.512567 Jul 20 04:31:22.852479 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1918/3599] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:22 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1218 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:23.101739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7d529d6f-51a7-41a3-981a-59cba1e049a2 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:23.129838 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7d529d6f-51a7-41a3-981a-59cba1e049a2 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1393 microversion: 2.1 time: 0.667315 Jul 20 04:31:23.131262 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1682/3600] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:22 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1393 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:23.873330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ff147593-5bc3-44f8-9420-1f1a4c774dd3 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:23.874344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ff147593-5bc3-44f8-9420-1f1a4c774dd3 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:23.915150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff147593-5bc3-44f8-9420-1f1a4c774dd3 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:23.915719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff147593-5bc3-44f8-9420-1f1a4c774dd3 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:23.935158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff147593-5bc3-44f8-9420-1f1a4c774dd3 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:23.935953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff147593-5bc3-44f8-9420-1f1a4c774dd3 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:24.149048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3a270623-16ac-4ac3-9685-b3266f20e768 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:24.149606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3a270623-16ac-4ac3-9685-b3266f20e768 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:24.163914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a270623-16ac-4ac3-9685-b3266f20e768 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:24.164667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a270623-16ac-4ac3-9685-b3266f20e768 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:24.167838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a270623-16ac-4ac3-9685-b3266f20e768 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:24.168076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a270623-16ac-4ac3-9685-b3266f20e768 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:24.424639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ff147593-5bc3-44f8-9420-1f1a4c774dd3 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:24.436244 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ff147593-5bc3-44f8-9420-1f1a4c774dd3 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1280 microversion: 2.1 time: 0.570294 Jul 20 04:31:24.441717 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1919/3601] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:23 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1280 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:24.944891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3a270623-16ac-4ac3-9685-b3266f20e768 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:24.959614 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3a270623-16ac-4ac3-9685-b3266f20e768 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1573 microversion: 2.1 time: 0.814374 Jul 20 04:31:24.976561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ddf0f6e8-ad46-48c3-9886-9b6d7039cbc9 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:24.977097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ddf0f6e8-ad46-48c3-9886-9b6d7039cbc9 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:24.981652 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1683/3602] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:24 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1573 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:24.989474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ddf0f6e8-ad46-48c3-9886-9b6d7039cbc9 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:24.997570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ddf0f6e8-ad46-48c3-9886-9b6d7039cbc9 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:24.999143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ddf0f6e8-ad46-48c3-9886-9b6d7039cbc9 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:24.999807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ddf0f6e8-ad46-48c3-9886-9b6d7039cbc9 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:25.458500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0164c9c3-fd8d-4d0c-9a41-5780037c5bfb tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:25.459401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0164c9c3-fd8d-4d0c-9a41-5780037c5bfb tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:25.482616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0164c9c3-fd8d-4d0c-9a41-5780037c5bfb tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:25.484970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0164c9c3-fd8d-4d0c-9a41-5780037c5bfb tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:25.485913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0164c9c3-fd8d-4d0c-9a41-5780037c5bfb tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:25.486368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0164c9c3-fd8d-4d0c-9a41-5780037c5bfb tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:25.591459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0164c9c3-fd8d-4d0c-9a41-5780037c5bfb tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:25.610660 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0164c9c3-fd8d-4d0c-9a41-5780037c5bfb tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1280 microversion: 2.1 time: 0.157042 Jul 20 04:31:25.613123 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1684/3603] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:25 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1280 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:25.684688 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ddf0f6e8-ad46-48c3-9886-9b6d7039cbc9 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.711528 Jul 20 04:31:25.685957 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1920/3604] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:31:24 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70/os-interface => generated 284 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:31:26.639153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6799d4e3-fa75-4d6b-bda1-feb103590318 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:26.641959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6799d4e3-fa75-4d6b-bda1-feb103590318 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:26.651848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6799d4e3-fa75-4d6b-bda1-feb103590318 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:26.652647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6799d4e3-fa75-4d6b-bda1-feb103590318 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:26.653786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6799d4e3-fa75-4d6b-bda1-feb103590318 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:26.654424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6799d4e3-fa75-4d6b-bda1-feb103590318 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:26.874385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6799d4e3-fa75-4d6b-bda1-feb103590318 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:26.911984 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6799d4e3-fa75-4d6b-bda1-feb103590318 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1280 microversion: 2.1 time: 0.279223 Jul 20 04:31:26.917519 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1685/3605] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:26 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1280 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:27.954479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4b564d95-4dd5-424a-8b3f-7b5184be11d0 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:27.955895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4b564d95-4dd5-424a-8b3f-7b5184be11d0 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:27.968762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=34 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:27.973776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b564d95-4dd5-424a-8b3f-7b5184be11d0 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:27.974844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b564d95-4dd5-424a-8b3f-7b5184be11d0 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.975820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b564d95-4dd5-424a-8b3f-7b5184be11d0 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:27.979034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b564d95-4dd5-424a-8b3f-7b5184be11d0 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.992699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=78 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:28.082163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4b564d95-4dd5-424a-8b3f-7b5184be11d0 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:28.099290 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4b564d95-4dd5-424a-8b3f-7b5184be11d0 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1280 microversion: 2.1 time: 0.153951 Jul 20 04:31:28.102348 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1921/3606] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:27 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1280 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:29.122675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-087a4a06-c184-42c2-be84-50a6114d05b5 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:29.123998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-087a4a06-c184-42c2-be84-50a6114d05b5 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:29.139342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-087a4a06-c184-42c2-be84-50a6114d05b5 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:29.147903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-087a4a06-c184-42c2-be84-50a6114d05b5 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:29.148796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-087a4a06-c184-42c2-be84-50a6114d05b5 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:29.149219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-087a4a06-c184-42c2-be84-50a6114d05b5 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:29.475521 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-087a4a06-c184-42c2-be84-50a6114d05b5 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:29.498212 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-087a4a06-c184-42c2-be84-50a6114d05b5 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1280 microversion: 2.1 time: 0.379468 Jul 20 04:31:29.504512 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1686/3607] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:29 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1280 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:29.724886 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-6f4fa7b6-193e-471f-80cd-05c8582f6f7d req-d3b95141-10e0-432a-8798-4cc08488785d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "522460f3-4bad-4790-b516-b1a3be971f45", "tag": "6bcb24bd-5d7f-49c5-99bb-e55cb6b2f3be"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:29.768943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-6f4fa7b6-193e-471f-80cd-05c8582f6f7d req-d3b95141-10e0-432a-8798-4cc08488785d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:29.769710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-6f4fa7b6-193e-471f-80cd-05c8582f6f7d req-d3b95141-10e0-432a-8798-4cc08488785d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:29.800991 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-6f4fa7b6-193e-471f-80cd-05c8582f6f7d req-d3b95141-10e0-432a-8798-4cc08488785d service nova] Creating event network-changed:6bcb24bd-5d7f-49c5-99bb-e55cb6b2f3be for instance 522460f3-4bad-4790-b516-b1a3be971f45 on n-h2-826526-5 Jul 20 04:31:29.817271 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-6f4fa7b6-193e-471f-80cd-05c8582f6f7d req-d3b95141-10e0-432a-8798-4cc08488785d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098769 Jul 20 04:31:29.818469 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1922/3608] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:30.522359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-79d2f621-9e14-4f66-b1e8-184e28c16b5a tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:30.523886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-79d2f621-9e14-4f66-b1e8-184e28c16b5a tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:30.527475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:30.533950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79d2f621-9e14-4f66-b1e8-184e28c16b5a tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:30.534474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79d2f621-9e14-4f66-b1e8-184e28c16b5a tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:30.535518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79d2f621-9e14-4f66-b1e8-184e28c16b5a tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:30.536086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79d2f621-9e14-4f66-b1e8-184e28c16b5a tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:30.733693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-79d2f621-9e14-4f66-b1e8-184e28c16b5a tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:30.748359 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-79d2f621-9e14-4f66-b1e8-184e28c16b5a tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1280 microversion: 2.1 time: 0.231453 Jul 20 04:31:30.752313 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1687/3609] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:30 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1280 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:30.775273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-107bd949-3654-4a94-9840-7d3987573bb3 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:30.779527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-107bd949-3654-4a94-9840-7d3987573bb3 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:30.796631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-2e46b942-1849-4f2f-b670-5c4dde7a5fe0 req-8a7570f6-d035-456b-8618-3c172328c9bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77b7b690-49b0-4475-bf8e-77d17ed76c70", "tag": "70aafaef-c7de-42aa-a442-bc353be736e5"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:30.801632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-107bd949-3654-4a94-9840-7d3987573bb3 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:30.802336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-107bd949-3654-4a94-9840-7d3987573bb3 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:30.806125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-107bd949-3654-4a94-9840-7d3987573bb3 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:30.807485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-107bd949-3654-4a94-9840-7d3987573bb3 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:30.826924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2e46b942-1849-4f2f-b670-5c4dde7a5fe0 req-8a7570f6-d035-456b-8618-3c172328c9bc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:30.827846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2e46b942-1849-4f2f-b670-5c4dde7a5fe0 req-8a7570f6-d035-456b-8618-3c172328c9bc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:30.847617 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-2e46b942-1849-4f2f-b670-5c4dde7a5fe0 req-8a7570f6-d035-456b-8618-3c172328c9bc service nova] Creating event network-changed:70aafaef-c7de-42aa-a442-bc353be736e5 for instance 77b7b690-49b0-4475-bf8e-77d17ed76c70 on n-h1-826526-5 Jul 20 04:31:30.862148 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-2e46b942-1849-4f2f-b670-5c4dde7a5fe0 req-8a7570f6-d035-456b-8618-3c172328c9bc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076216 Jul 20 04:31:30.863508 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1688/3610] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:31.772189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-99909e75-769f-4455-a0fd-22354ebb470b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:31.773615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-99909e75-769f-4455-a0fd-22354ebb470b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:31.775946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=10 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:31.801039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-99909e75-769f-4455-a0fd-22354ebb470b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:31.809174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-99909e75-769f-4455-a0fd-22354ebb470b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:31.813368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-107bd949-3654-4a94-9840-7d3987573bb3 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:31.818876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-99909e75-769f-4455-a0fd-22354ebb470b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:31.825132 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-107bd949-3654-4a94-9840-7d3987573bb3 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1573 microversion: 2.1 time: 1.070446 Jul 20 04:31:31.826634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-99909e75-769f-4455-a0fd-22354ebb470b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:31.833499 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1923/3611] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:30 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1573 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:33.344760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-99909e75-769f-4455-a0fd-22354ebb470b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:33.382065 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-99909e75-769f-4455-a0fd-22354ebb470b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1322 microversion: 2.1 time: 1.609894 Jul 20 04:31:33.384409 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1689/3612] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:31 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1322 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:34.399497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f08120fb-123d-4e4f-b310-762f11037efe tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:34.400093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f08120fb-123d-4e4f-b310-762f11037efe tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:34.411804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f08120fb-123d-4e4f-b310-762f11037efe tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:34.412674 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f08120fb-123d-4e4f-b310-762f11037efe tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:34.413906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f08120fb-123d-4e4f-b310-762f11037efe tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:34.414731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f08120fb-123d-4e4f-b310-762f11037efe tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:34.436474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-344cd35a-a44f-4c89-9666-e599a15646ed req-afc5fd59-b58c-4662-9411-0222e7449768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab277261-8f75-4ad3-89d1-6ef43801e981", "tag": "23d3c54d-bc46-4749-8869-f4b3028043af"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:34.476163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-344cd35a-a44f-4c89-9666-e599a15646ed req-afc5fd59-b58c-4662-9411-0222e7449768 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:34.477862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-344cd35a-a44f-4c89-9666-e599a15646ed req-afc5fd59-b58c-4662-9411-0222e7449768 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:34.506649 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-344cd35a-a44f-4c89-9666-e599a15646ed req-afc5fd59-b58c-4662-9411-0222e7449768 service nova] Creating event network-changed:23d3c54d-bc46-4749-8869-f4b3028043af for instance ab277261-8f75-4ad3-89d1-6ef43801e981 on n-h1-826526-5 Jul 20 04:31:34.516589 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-344cd35a-a44f-4c89-9666-e599a15646ed req-afc5fd59-b58c-4662-9411-0222e7449768 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093284 Jul 20 04:31:34.517975 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1690/3613] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:34.770452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-7ea3108d-9e65-4d04-81fb-b373ae767661 req-b8bb45c0-d50e-4901-8e20-bdb9dcccfc8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522460f3-4bad-4790-b516-b1a3be971f45", "name": "network-vif-plugged", "status": "completed", "tag": "6bcb24bd-5d7f-49c5-99bb-e55cb6b2f3be"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:34.806730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f08120fb-123d-4e4f-b310-762f11037efe tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:34.812963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7ea3108d-9e65-4d04-81fb-b373ae767661 req-b8bb45c0-d50e-4901-8e20-bdb9dcccfc8e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:34.814652 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f08120fb-123d-4e4f-b310-762f11037efe tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1322 microversion: 2.1 time: 0.419194 Jul 20 04:31:34.817195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7ea3108d-9e65-4d04-81fb-b373ae767661 req-b8bb45c0-d50e-4901-8e20-bdb9dcccfc8e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:34.824993 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1924/3614] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:34 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:34.872223 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-7ea3108d-9e65-4d04-81fb-b373ae767661 req-b8bb45c0-d50e-4901-8e20-bdb9dcccfc8e service nova] Creating event network-vif-plugged:6bcb24bd-5d7f-49c5-99bb-e55cb6b2f3be for instance 522460f3-4bad-4790-b516-b1a3be971f45 on n-h2-826526-5 Jul 20 04:31:34.887236 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-7ea3108d-9e65-4d04-81fb-b373ae767661 req-b8bb45c0-d50e-4901-8e20-bdb9dcccfc8e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117225 Jul 20 04:31:34.911102 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1691/3615] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:31:35.831437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c3302f4-e882-4a74-9c97-444a745e3c4e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:35.832143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0c3302f4-e882-4a74-9c97-444a745e3c4e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:35.851089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c3302f4-e882-4a74-9c97-444a745e3c4e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:35.851547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c3302f4-e882-4a74-9c97-444a745e3c4e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:35.852497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c3302f4-e882-4a74-9c97-444a745e3c4e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:35.852935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c3302f4-e882-4a74-9c97-444a745e3c4e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:36.369458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0c3302f4-e882-4a74-9c97-444a745e3c4e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:36.382456 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0c3302f4-e882-4a74-9c97-444a745e3c4e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1322 microversion: 2.1 time: 0.555063 Jul 20 04:31:36.413074 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1925/3616] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:35 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1322 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:37.297042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-547ebd04-2ada-471b-86bd-de9049e14ef6 req-a3e5e6ad-f6bf-490d-aeb2-fe9684a381fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f9344d-d994-4d4a-9d6d-84271f21c242", "tag": "e5d4382a-ba64-42e8-aba7-38faffb1fd51"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:37.343002 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-547ebd04-2ada-471b-86bd-de9049e14ef6 req-a3e5e6ad-f6bf-490d-aeb2-fe9684a381fd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:37.343447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-547ebd04-2ada-471b-86bd-de9049e14ef6 req-a3e5e6ad-f6bf-490d-aeb2-fe9684a381fd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:37.413505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3f9a3eb6-beb4-4f59-8c49-a22ee32487ba tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:37.414641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3f9a3eb6-beb4-4f59-8c49-a22ee32487ba tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:37.423066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f9a3eb6-beb4-4f59-8c49-a22ee32487ba tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:37.423694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f9a3eb6-beb4-4f59-8c49-a22ee32487ba tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:37.424666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f9a3eb6-beb4-4f59-8c49-a22ee32487ba tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:37.425244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f9a3eb6-beb4-4f59-8c49-a22ee32487ba tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:37.445292 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-547ebd04-2ada-471b-86bd-de9049e14ef6 req-a3e5e6ad-f6bf-490d-aeb2-fe9684a381fd service nova] Creating event network-changed:e5d4382a-ba64-42e8-aba7-38faffb1fd51 for instance 77f9344d-d994-4d4a-9d6d-84271f21c242 on n-h2-826526-5 Jul 20 04:31:37.460409 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-547ebd04-2ada-471b-86bd-de9049e14ef6 req-a3e5e6ad-f6bf-490d-aeb2-fe9684a381fd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175656 Jul 20 04:31:37.461030 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1692/3617] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:38.120797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3f9a3eb6-beb4-4f59-8c49-a22ee32487ba tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:38.135796 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3f9a3eb6-beb4-4f59-8c49-a22ee32487ba tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1322 microversion: 2.1 time: 0.726737 Jul 20 04:31:38.138011 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1926/3618] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:37 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1322 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:39.159077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0c40440f-2adb-46ce-b2ab-fc3e9989556d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:39.159794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0c40440f-2adb-46ce-b2ab-fc3e9989556d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:39.191400 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c40440f-2adb-46ce-b2ab-fc3e9989556d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:39.193912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c40440f-2adb-46ce-b2ab-fc3e9989556d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:39.199689 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c40440f-2adb-46ce-b2ab-fc3e9989556d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:39.206195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c40440f-2adb-46ce-b2ab-fc3e9989556d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:39.698906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0c40440f-2adb-46ce-b2ab-fc3e9989556d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:39.716997 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0c40440f-2adb-46ce-b2ab-fc3e9989556d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1322 microversion: 2.1 time: 0.564865 Jul 20 04:31:39.719255 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1693/3619] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:39 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1322 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:40.752963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-521e0e7d-6a9b-4415-b873-b229fec49d63 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:40.756121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-521e0e7d-6a9b-4415-b873-b229fec49d63 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:40.779409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-521e0e7d-6a9b-4415-b873-b229fec49d63 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:40.784450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-521e0e7d-6a9b-4415-b873-b229fec49d63 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:40.785468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-521e0e7d-6a9b-4415-b873-b229fec49d63 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:40.786881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-521e0e7d-6a9b-4415-b873-b229fec49d63 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.883138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-521e0e7d-6a9b-4415-b873-b229fec49d63 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:41.896717 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-521e0e7d-6a9b-4415-b873-b229fec49d63 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1322 microversion: 2.1 time: 1.164850 Jul 20 04:31:41.901272 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1927/3620] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:40 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1322 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:42.931972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5af1aae6-46fe-400e-b740-32aebd0fa64f tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:42.932794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5af1aae6-46fe-400e-b740-32aebd0fa64f tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:42.943671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5af1aae6-46fe-400e-b740-32aebd0fa64f tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.946435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5af1aae6-46fe-400e-b740-32aebd0fa64f tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.947611 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5af1aae6-46fe-400e-b740-32aebd0fa64f tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.948181 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5af1aae6-46fe-400e-b740-32aebd0fa64f tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:43.396309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5af1aae6-46fe-400e-b740-32aebd0fa64f tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:43.421375 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5af1aae6-46fe-400e-b740-32aebd0fa64f tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1322 microversion: 2.1 time: 0.494286 Jul 20 04:31:43.428464 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1694/3621] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:42 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1322 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:44.445302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-23452068-5b47-4b0f-b4fc-30c4e584e331 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:44.447589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-23452068-5b47-4b0f-b4fc-30c4e584e331 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:44.468456 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23452068-5b47-4b0f-b4fc-30c4e584e331 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.470250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f13deae9-0999-4340-8fa2-0bbc8090c165 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2128113678", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:44.471652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23452068-5b47-4b0f-b4fc-30c4e584e331 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.473427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23452068-5b47-4b0f-b4fc-30c4e584e331 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.477632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23452068-5b47-4b0f-b4fc-30c4e584e331 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.573498 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-f13deae9-0999-4340-8fa2-0bbc8090c165 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] validate_networks() for [('2d36d8d3-a9ee-4445-85c8-50d1135e9282', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:31:44.917229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-23452068-5b47-4b0f-b4fc-30c4e584e331 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:44.940282 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-23452068-5b47-4b0f-b4fc-30c4e584e331 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1322 microversion: 2.1 time: 0.500942 Jul 20 04:31:44.949123 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1695/3622] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:44 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1322 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:44.997425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e1898839-4aab-448c-a8e1-e1838fe81411 req-b916b751-0df5-47d9-80b1-f81996b60fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f9344d-d994-4d4a-9d6d-84271f21c242", "name": "network-vif-plugged", "status": "completed", "tag": "e5d4382a-ba64-42e8-aba7-38faffb1fd51"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:45.034672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e1898839-4aab-448c-a8e1-e1838fe81411 req-b916b751-0df5-47d9-80b1-f81996b60fd4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.036792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e1898839-4aab-448c-a8e1-e1838fe81411 req-b916b751-0df5-47d9-80b1-f81996b60fd4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.063414 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e1898839-4aab-448c-a8e1-e1838fe81411 req-b916b751-0df5-47d9-80b1-f81996b60fd4 service nova] Creating event network-vif-plugged:e5d4382a-ba64-42e8-aba7-38faffb1fd51 for instance 77f9344d-d994-4d4a-9d6d-84271f21c242 on n-h2-826526-5 Jul 20 04:31:45.090431 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e1898839-4aab-448c-a8e1-e1838fe81411 req-b916b751-0df5-47d9-80b1-f81996b60fd4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099411 Jul 20 04:31:45.094214 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1696/3623] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:45.959996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f13deae9-0999-4340-8fa2-0bbc8090c165 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:31:45.961205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f13deae9-0999-4340-8fa2-0bbc8090c165 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:31:45.961910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f13deae9-0999-4340-8fa2-0bbc8090c165 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:31:45.962516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f13deae9-0999-4340-8fa2-0bbc8090c165 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:31:45.963118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f13deae9-0999-4340-8fa2-0bbc8090c165 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:31:45.973183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d2e1ace2-a2f2-4620-a491-44649182c0d3 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:45.973993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d2e1ace2-a2f2-4620-a491-44649182c0d3 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:45.984020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f13deae9-0999-4340-8fa2-0bbc8090c165 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.984708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f13deae9-0999-4340-8fa2-0bbc8090c165 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.985699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f13deae9-0999-4340-8fa2-0bbc8090c165 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.986297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f13deae9-0999-4340-8fa2-0bbc8090c165 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.989212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2e1ace2-a2f2-4620-a491-44649182c0d3 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.989687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2e1ace2-a2f2-4620-a491-44649182c0d3 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.993841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2e1ace2-a2f2-4620-a491-44649182c0d3 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.994307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2e1ace2-a2f2-4620-a491-44649182c0d3 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:46.010571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-f13deae9-0999-4340-8fa2-0bbc8090c165 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Getting quotas for project d1e98a37424940769eebbb38c1af937f. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:31:46.018822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-f13deae9-0999-4340-8fa2-0bbc8090c165 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Getting quotas for user bdc18c445e334a60a66a3f20b37ace48 and project d1e98a37424940769eebbb38c1af937f. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:31:46.036178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f13deae9-0999-4340-8fa2-0bbc8090c165 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:31:46.039386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f13deae9-0999-4340-8fa2-0bbc8090c165 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:31:46.153161 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f13deae9-0999-4340-8fa2-0bbc8090c165 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.913820 Jul 20 04:31:46.158916 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1928/3624] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 1920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:31:46.164865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3b52bc9e-cebe-4855-8ec2-551efc56038b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:46.165543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3b52bc9e-cebe-4855-8ec2-551efc56038b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:46.331160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3b52bc9e-cebe-4855-8ec2-551efc56038b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:46.339776 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3b52bc9e-cebe-4855-8ec2-551efc56038b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1214 microversion: 2.1 time: 0.179639 Jul 20 04:31:46.340461 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1929/3625] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:46 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1214 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:46.465733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d2e1ace2-a2f2-4620-a491-44649182c0d3 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:46.477586 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d2e1ace2-a2f2-4620-a491-44649182c0d3 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1322 microversion: 2.1 time: 0.513379 Jul 20 04:31:46.479252 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1697/3626] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:45 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1322 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:47.141617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-f2b23429-20cf-4eed-8341-392a1d6ec711 req-4ab25b17-a189-42ee-a802-886f0ad96666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab277261-8f75-4ad3-89d1-6ef43801e981", "name": "network-vif-plugged", "status": "completed", "tag": "23d3c54d-bc46-4749-8869-f4b3028043af"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:47.165210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f2b23429-20cf-4eed-8341-392a1d6ec711 req-4ab25b17-a189-42ee-a802-886f0ad96666 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:47.172536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f2b23429-20cf-4eed-8341-392a1d6ec711 req-4ab25b17-a189-42ee-a802-886f0ad96666 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:47.209993 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-f2b23429-20cf-4eed-8341-392a1d6ec711 req-4ab25b17-a189-42ee-a802-886f0ad96666 service nova] Creating event network-vif-plugged:23d3c54d-bc46-4749-8869-f4b3028043af for instance ab277261-8f75-4ad3-89d1-6ef43801e981 on n-h1-826526-5 Jul 20 04:31:47.220655 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-f2b23429-20cf-4eed-8341-392a1d6ec711 req-4ab25b17-a189-42ee-a802-886f0ad96666 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084039 Jul 20 04:31:47.221947 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1930/3627] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:47.364237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-de46fb31-92b0-4b44-a634-b3a9328b1859 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:47.366370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-de46fb31-92b0-4b44-a634-b3a9328b1859 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:47.376623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de46fb31-92b0-4b44-a634-b3a9328b1859 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:47.377392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de46fb31-92b0-4b44-a634-b3a9328b1859 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:47.379472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de46fb31-92b0-4b44-a634-b3a9328b1859 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:47.380603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de46fb31-92b0-4b44-a634-b3a9328b1859 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:47.501814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dc5a3aeb-2629-4fd8-80d8-de634b3de198 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:47.503362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dc5a3aeb-2629-4fd8-80d8-de634b3de198 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:47.517872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc5a3aeb-2629-4fd8-80d8-de634b3de198 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:47.518978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc5a3aeb-2629-4fd8-80d8-de634b3de198 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:47.520077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc5a3aeb-2629-4fd8-80d8-de634b3de198 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:47.520765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc5a3aeb-2629-4fd8-80d8-de634b3de198 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:47.696518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-de46fb31-92b0-4b44-a634-b3a9328b1859 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:47.711646 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-de46fb31-92b0-4b44-a634-b3a9328b1859 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1210 microversion: 2.1 time: 0.356904 Jul 20 04:31:47.723901 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1698/3628] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:47 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1210 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:47.900871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dc5a3aeb-2629-4fd8-80d8-de634b3de198 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:47.911069 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dc5a3aeb-2629-4fd8-80d8-de634b3de198 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 200 len: 1515 microversion: 2.1 time: 0.419149 Jul 20 04:31:47.942032 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1931/3629] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:47 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 1515 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:47.960172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d6d61c0c-c94d-433f-8c08-cfbb9810cb8b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:47.961657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d6d61c0c-c94d-433f-8c08-cfbb9810cb8b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: ab277261-8f75-4ad3-89d1-6ef43801e981] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:47.976510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6d61c0c-c94d-433f-8c08-cfbb9810cb8b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:47.977487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6d61c0c-c94d-433f-8c08-cfbb9810cb8b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:47.979995 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6d61c0c-c94d-433f-8c08-cfbb9810cb8b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:47.990436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6d61c0c-c94d-433f-8c08-cfbb9810cb8b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:48.583658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d6d61c0c-c94d-433f-8c08-cfbb9810cb8b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:48.598714 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d6d61c0c-c94d-433f-8c08-cfbb9810cb8b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/ab277261-8f75-4ad3-89d1-6ef43801e981" status: 200 len: 1322 microversion: 2.1 time: 0.643015 Jul 20 04:31:48.606330 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1699/3630] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:47 2022] GET /compute/v2.1/servers/ab277261-8f75-4ad3-89d1-6ef43801e981 => generated 1322 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:48.732844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-eb231312-d089-45a1-b4d8-62a1030111b2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:48.734037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-eb231312-d089-45a1-b4d8-62a1030111b2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:48.757573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb231312-d089-45a1-b4d8-62a1030111b2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:48.759760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb231312-d089-45a1-b4d8-62a1030111b2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:48.768868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb231312-d089-45a1-b4d8-62a1030111b2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:48.770024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb231312-d089-45a1-b4d8-62a1030111b2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:48.931816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-eb231312-d089-45a1-b4d8-62a1030111b2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:48.956786 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-eb231312-d089-45a1-b4d8-62a1030111b2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1284 microversion: 2.1 time: 0.228894 Jul 20 04:31:48.971230 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1932/3631] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:48 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1284 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:49.634456 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5686fb91-31cc-4405-9f13-073e45584577 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:49.637760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5686fb91-31cc-4405-9f13-073e45584577 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: ab277261-8f75-4ad3-89d1-6ef43801e981] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:49.645456 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=9 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:49.647405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5686fb91-31cc-4405-9f13-073e45584577 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.648110 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5686fb91-31cc-4405-9f13-073e45584577 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.649407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5686fb91-31cc-4405-9f13-073e45584577 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.650010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5686fb91-31cc-4405-9f13-073e45584577 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.723755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=94 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:49.978179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-443225eb-440c-4ce2-8c6d-e6321d2025ab tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:49.978806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-443225eb-440c-4ce2-8c6d-e6321d2025ab tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:49.990936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-443225eb-440c-4ce2-8c6d-e6321d2025ab tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.991393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-443225eb-440c-4ce2-8c6d-e6321d2025ab tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.992195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-443225eb-440c-4ce2-8c6d-e6321d2025ab tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.993661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-443225eb-440c-4ce2-8c6d-e6321d2025ab tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.014754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5686fb91-31cc-4405-9f13-073e45584577 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:50.027352 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5686fb91-31cc-4405-9f13-073e45584577 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/ab277261-8f75-4ad3-89d1-6ef43801e981" status: 200 len: 1516 microversion: 2.1 time: 0.407939 Jul 20 04:31:50.032585 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1700/3632] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:49 2022] GET /compute/v2.1/servers/ab277261-8f75-4ad3-89d1-6ef43801e981 => generated 1516 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:50.049867 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c13a37da-b3a7-4560-b30a-eca4e4d92e69 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:50.050896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c13a37da-b3a7-4560-b30a-eca4e4d92e69 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 522460f3-4bad-4790-b516-b1a3be971f45] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:50.063767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c13a37da-b3a7-4560-b30a-eca4e4d92e69 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.069865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c13a37da-b3a7-4560-b30a-eca4e4d92e69 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.071696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c13a37da-b3a7-4560-b30a-eca4e4d92e69 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.073568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c13a37da-b3a7-4560-b30a-eca4e4d92e69 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.407663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-443225eb-440c-4ce2-8c6d-e6321d2025ab tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:50.419775 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-443225eb-440c-4ce2-8c6d-e6321d2025ab tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1314 microversion: 2.1 time: 0.443511 Jul 20 04:31:50.421277 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1933/3633] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:49 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:50.648107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c13a37da-b3a7-4560-b30a-eca4e4d92e69 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:50.663168 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c13a37da-b3a7-4560-b30a-eca4e4d92e69 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45" status: 200 len: 1516 microversion: 2.1 time: 0.618591 Jul 20 04:31:50.667891 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1701/3634] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:50 2022] GET /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45 => generated 1516 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:50.684666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2bae17f1-1ff8-4967-b911-300f5a04ffa9 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:50.685928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2bae17f1-1ff8-4967-b911-300f5a04ffa9 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 522460f3-4bad-4790-b516-b1a3be971f45] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:50.693195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bae17f1-1ff8-4967-b911-300f5a04ffa9 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.693939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bae17f1-1ff8-4967-b911-300f5a04ffa9 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.695287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bae17f1-1ff8-4967-b911-300f5a04ffa9 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.696367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bae17f1-1ff8-4967-b911-300f5a04ffa9 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.734710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2bae17f1-1ff8-4967-b911-300f5a04ffa9 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 522460f3-4bad-4790-b516-b1a3be971f45] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:31:50.905015 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2bae17f1-1ff8-4967-b911-300f5a04ffa9 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "DELETE /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45" status: 204 len: 0 microversion: 2.1 time: 0.225009 Jul 20 04:31:50.906503 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1934/3635] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:31:50 2022] DELETE /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:31:50.916309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-83f17d5e-1fdb-4b9e-8c8e-ec218e694392 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:50.918019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-83f17d5e-1fdb-4b9e-8c8e-ec218e694392 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 522460f3-4bad-4790-b516-b1a3be971f45] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:50.927113 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83f17d5e-1fdb-4b9e-8c8e-ec218e694392 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.927569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83f17d5e-1fdb-4b9e-8c8e-ec218e694392 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.928555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83f17d5e-1fdb-4b9e-8c8e-ec218e694392 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.928989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83f17d5e-1fdb-4b9e-8c8e-ec218e694392 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.182284 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-83f17d5e-1fdb-4b9e-8c8e-ec218e694392 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:51.194284 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-83f17d5e-1fdb-4b9e-8c8e-ec218e694392 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45" status: 200 len: 1522 microversion: 2.1 time: 0.282610 Jul 20 04:31:51.198510 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1702/3636] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:50 2022] GET /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:51.440422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e0430a21-a385-4d3a-92b5-4dcebcd0f4d4 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:51.441180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e0430a21-a385-4d3a-92b5-4dcebcd0f4d4 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:51.458643 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0430a21-a385-4d3a-92b5-4dcebcd0f4d4 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.459380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0430a21-a385-4d3a-92b5-4dcebcd0f4d4 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.460570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0430a21-a385-4d3a-92b5-4dcebcd0f4d4 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.461256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0430a21-a385-4d3a-92b5-4dcebcd0f4d4 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.654535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e0430a21-a385-4d3a-92b5-4dcebcd0f4d4 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:51.665259 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e0430a21-a385-4d3a-92b5-4dcebcd0f4d4 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1314 microversion: 2.1 time: 0.230463 Jul 20 04:31:51.669624 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1935/3637] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:51 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:51.865398 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-670270b0-fccc-4cfe-9f33-3f33ccb92fe3 req-431cbfea-7d7e-4bec-8711-362105cef4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2594c4f-6103-4c9d-979f-3640a04aa4ff", "tag": "676e2415-ffca-452e-9e59-41a2ecb711ce"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:51.882307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-670270b0-fccc-4cfe-9f33-3f33ccb92fe3 req-431cbfea-7d7e-4bec-8711-362105cef4e3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.882763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-670270b0-fccc-4cfe-9f33-3f33ccb92fe3 req-431cbfea-7d7e-4bec-8711-362105cef4e3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.921902 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-670270b0-fccc-4cfe-9f33-3f33ccb92fe3 req-431cbfea-7d7e-4bec-8711-362105cef4e3 service nova] Creating event network-changed:676e2415-ffca-452e-9e59-41a2ecb711ce for instance b2594c4f-6103-4c9d-979f-3640a04aa4ff on n-h1-826526-5 Jul 20 04:31:51.932807 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-670270b0-fccc-4cfe-9f33-3f33ccb92fe3 req-431cbfea-7d7e-4bec-8711-362105cef4e3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077964 Jul 20 04:31:51.933436 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1703/3638] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:31:52.217564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1e33bb1e-f548-4887-b087-d8e35c757607 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:52.219916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1e33bb1e-f548-4887-b087-d8e35c757607 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 522460f3-4bad-4790-b516-b1a3be971f45] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:52.228515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e33bb1e-f548-4887-b087-d8e35c757607 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.229378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e33bb1e-f548-4887-b087-d8e35c757607 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.230687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e33bb1e-f548-4887-b087-d8e35c757607 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.231324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e33bb1e-f548-4887-b087-d8e35c757607 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.405092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1e33bb1e-f548-4887-b087-d8e35c757607 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:52.421410 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1e33bb1e-f548-4887-b087-d8e35c757607 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45" status: 200 len: 1522 microversion: 2.1 time: 0.209201 Jul 20 04:31:52.422304 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1936/3639] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:52 2022] GET /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:52.694578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4d249941-0535-4be6-b968-712ff028f3ff tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:52.699161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4d249941-0535-4be6-b968-712ff028f3ff tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:52.709246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d249941-0535-4be6-b968-712ff028f3ff tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.710014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d249941-0535-4be6-b968-712ff028f3ff tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.711273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d249941-0535-4be6-b968-712ff028f3ff tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.711878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d249941-0535-4be6-b968-712ff028f3ff tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.387177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4d249941-0535-4be6-b968-712ff028f3ff tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:53.405274 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4d249941-0535-4be6-b968-712ff028f3ff tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1314 microversion: 2.1 time: 0.722894 Jul 20 04:31:53.409528 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1704/3640] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:52 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1314 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:53.444156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-93796a97-55fb-40b8-9fc1-5eb979eb22ff tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:53.446165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-93796a97-55fb-40b8-9fc1-5eb979eb22ff tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 522460f3-4bad-4790-b516-b1a3be971f45] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:53.472241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93796a97-55fb-40b8-9fc1-5eb979eb22ff tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.474703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93796a97-55fb-40b8-9fc1-5eb979eb22ff tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.479437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93796a97-55fb-40b8-9fc1-5eb979eb22ff tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.483900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93796a97-55fb-40b8-9fc1-5eb979eb22ff tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.698327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-93796a97-55fb-40b8-9fc1-5eb979eb22ff tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:53.713652 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-93796a97-55fb-40b8-9fc1-5eb979eb22ff tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45" status: 200 len: 1480 microversion: 2.1 time: 0.279135 Jul 20 04:31:53.718146 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1937/3641] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:53 2022] GET /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45 => generated 1480 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:53.972778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-793b09ca-c94d-4093-a5bc-3166983e6991 req-07bff272-75ba-49b2-b983-2cbb584e3e50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522460f3-4bad-4790-b516-b1a3be971f45", "name": "network-vif-deleted", "tag": "6bcb24bd-5d7f-49c5-99bb-e55cb6b2f3be"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:53.996188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-793b09ca-c94d-4093-a5bc-3166983e6991 req-07bff272-75ba-49b2-b983-2cbb584e3e50 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.999584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-793b09ca-c94d-4093-a5bc-3166983e6991 req-07bff272-75ba-49b2-b983-2cbb584e3e50 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.046692 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-793b09ca-c94d-4093-a5bc-3166983e6991 req-07bff272-75ba-49b2-b983-2cbb584e3e50 service nova] Creating event network-vif-deleted:6bcb24bd-5d7f-49c5-99bb-e55cb6b2f3be for instance 522460f3-4bad-4790-b516-b1a3be971f45 on n-h2-826526-5 Jul 20 04:31:54.076761 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-793b09ca-c94d-4093-a5bc-3166983e6991 req-07bff272-75ba-49b2-b983-2cbb584e3e50 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103134 Jul 20 04:31:54.078347 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1705/3642] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:54.429705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-69449522-4ba1-40d2-9559-93f21c444e89 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:54.430636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-69449522-4ba1-40d2-9559-93f21c444e89 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:54.442062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69449522-4ba1-40d2-9559-93f21c444e89 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.445662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69449522-4ba1-40d2-9559-93f21c444e89 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.448704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69449522-4ba1-40d2-9559-93f21c444e89 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.449535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69449522-4ba1-40d2-9559-93f21c444e89 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.762975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7ab55027-fac2-4c31-8d27-9ef419ce7c9b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:54.764469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7ab55027-fac2-4c31-8d27-9ef419ce7c9b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 522460f3-4bad-4790-b516-b1a3be971f45] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:54.779627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ab55027-fac2-4c31-8d27-9ef419ce7c9b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.780738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ab55027-fac2-4c31-8d27-9ef419ce7c9b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.781645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ab55027-fac2-4c31-8d27-9ef419ce7c9b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.785029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-69449522-4ba1-40d2-9559-93f21c444e89 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:54.785902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ab55027-fac2-4c31-8d27-9ef419ce7c9b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.796111 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-69449522-4ba1-40d2-9559-93f21c444e89 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1314 microversion: 2.1 time: 0.372019 Jul 20 04:31:54.806175 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1938/3643] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:54 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:54.824693 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-7ab55027-fac2-4c31-8d27-9ef419ce7c9b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] HTTP exception thrown: Instance 522460f3-4bad-4790-b516-b1a3be971f45 could not be found. Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7ab55027-fac2-4c31-8d27-9ef419ce7c9b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Request method failure captured: Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45 HTTP/1.1 Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14UUS0QYCyHI3x7SVIWPhZsaKoRULplNUGPk1bVzJ_764ObMLgbj2B8jrh-2dkWT675hKygFJWybbvPSpV4xy5sO-hcvqL-S0-JMW1MnLL0GBV9ATbPk11D7LC3U716_viBSKQGT4mJFdouOYfM3Hb17LEL3wjkhOhMWGdHNMxNfhno Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: db61fc3387294fe19b5ee8f565883102 Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db61fc3387294fe19b5ee8f565883102"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/db61fc3387294fe19b5ee8f565883102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_db61fc3387294fe19b5ee8f565883102", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db61fc3387294fe19b5ee8f565883102"}]}] Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: db61fc3387294fe19b5ee8f565883102 Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ListServersNegativeTestJSON-604717230-project Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: b397b39ad73c446ab43a47cf6401ac52 Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ListServersNegativeTestJSON-604717230-project Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 522460f3-4bad-4790-b516-b1a3be971f45 could not be found. Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '522460f3-4bad-4790-b516-b1a3be971f45'} Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522460f3-4bad-4790-b516-b1a3be971f45 could not be found. Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522460f3-4bad-4790-b516-b1a3be971f45 could not be found. Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:54.830968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.835001 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:54.835001 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:54.835001 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:54.835001 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:54.835001 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:54.835001 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522460f3-4bad-4790-b516-b1a3be971f45 could not be found. Jul 20 04:31:54.835001 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.835001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7ab55027-fac2-4c31-8d27-9ef419ce7c9b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Returning 404 to user: Instance 522460f3-4bad-4790-b516-b1a3be971f45 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:54.835001 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7ab55027-fac2-4c31-8d27-9ef419ce7c9b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45" status: 404 len: 111 microversion: 2.1 time: 0.088856 Jul 20 04:31:54.835566 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1706/3644] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:54 2022] GET /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:31:54.846091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-03272ebd-761c-486c-a637-6c58c8c8af1c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:54.860232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-03272ebd-761c-486c-a637-6c58c8c8af1c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:54.861675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-03272ebd-761c-486c-a637-6c58c8c8af1c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'db61fc3387294fe19b5ee8f565883102'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:31:54.872576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03272ebd-761c-486c-a637-6c58c8c8af1c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.873258 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03272ebd-761c-486c-a637-6c58c8c8af1c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.874368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03272ebd-761c-486c-a637-6c58c8c8af1c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.875026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03272ebd-761c-486c-a637-6c58c8c8af1c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.958777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:54.979618 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-03272ebd-761c-486c-a637-6c58c8c8af1c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.138129 Jul 20 04:31:54.981222 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1939/3645] 10.222.0.17 () {58 vars in 1229 bytes} [Wed Jul 20 04:31:54 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:31:54.991873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-73504799-5f0c-4caa-9ab2-8c760cbda72b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-73504799-5f0c-4caa-9ab2-8c760cbda72b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Request method failure captured: Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14UUS0QYCyHI3x7SVIWPhZsaKoRULplNUGPk1bVzJ_764ObMLgbj2B8jrh-2dkWT675hKygFJWybbvPSpV4xy5sO-hcvqL-S0-JMW1MnLL0GBV9ATbPk11D7LC3U716_viBSKQGT4mJFdouOYfM3Hb17LEL3wjkhOhMWGdHNMxNfhno Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: db61fc3387294fe19b5ee8f565883102 Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db61fc3387294fe19b5ee8f565883102"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/db61fc3387294fe19b5ee8f565883102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_db61fc3387294fe19b5ee8f565883102", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db61fc3387294fe19b5ee8f565883102"}]}] Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: db61fc3387294fe19b5ee8f565883102 Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ListServersNegativeTestJSON-604717230-project Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: b397b39ad73c446ab43a47cf6401ac52 Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ListServersNegativeTestJSON-604717230-project Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: action_args: {} Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 20 04:31:54.994626 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:31:54.998888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:31:54.998888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:31:54.998888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:31:54.998888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 20 04:31:54.998888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.998888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:54.998888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.998888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:54.998888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:54.998888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:54.998888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:31:54.998888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:31:54.998888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 20 04:31:54.998888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.998888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-73504799-5f0c-4caa-9ab2-8c760cbda72b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:55.001057 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-73504799-5f0c-4caa-9ab2-8c760cbda72b tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.012097 Jul 20 04:31:55.001927 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1707/3646] 10.222.0.17 () {58 vars in 1181 bytes} [Wed Jul 20 04:31:54 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:31:55.012515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-09736489-e35e-4357-9ca5-9add3d989b0e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.015791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-09736489-e35e-4357-9ca5-9add3d989b0e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.016468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-09736489-e35e-4357-9ca5-9add3d989b0e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Searching by: {'deleted': False, 'project_id': 'db61fc3387294fe19b5ee8f565883102'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:31:55.022844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09736489-e35e-4357-9ca5-9add3d989b0e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.023758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09736489-e35e-4357-9ca5-9add3d989b0e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.024996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09736489-e35e-4357-9ca5-9add3d989b0e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.025640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09736489-e35e-4357-9ca5-9add3d989b0e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.070622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-09736489-e35e-4357-9ca5-9add3d989b0e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:31:55.101700 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-09736489-e35e-4357-9ca5-9add3d989b0e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.093535 Jul 20 04:31:55.102294 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1940/3647] 10.222.0.17 () {58 vars in 1124 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers => generated 681 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:55.118848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1b52ad7e-9710-4b0d-b884-1e2510d31c83 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.124095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1b52ad7e-9710-4b0d-b884-1e2510d31c83 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.125209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.compute.servers [None req-1b52ad7e-9710-4b0d-b884-1e2510d31c83 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Removing options 'limit' from query {{(pid=127870) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:31:55.126499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1b52ad7e-9710-4b0d-b884-1e2510d31c83 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Searching by: {'deleted': False, 'project_id': 'db61fc3387294fe19b5ee8f565883102'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:31:55.133302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1b52ad7e-9710-4b0d-b884-1e2510d31c83 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.134160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1b52ad7e-9710-4b0d-b884-1e2510d31c83 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.135192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1b52ad7e-9710-4b0d-b884-1e2510d31c83 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.135825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1b52ad7e-9710-4b0d-b884-1e2510d31c83 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.173214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-1b52ad7e-9710-4b0d-b884-1e2510d31c83 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:31:55.203321 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1b52ad7e-9710-4b0d-b884-1e2510d31c83 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.093237 Jul 20 04:31:55.204221 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1708/3648] 10.222.0.17 () {58 vars in 1143 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:55.217160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-85d44541-c378-4143-b94a-0f0c6e45b566 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-85d44541-c378-4143-b94a-0f0c6e45b566 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Request method failure captured: Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14UUS0QYCyHI3x7SVIWPhZsaKoRULplNUGPk1bVzJ_764ObMLgbj2B8jrh-2dkWT675hKygFJWybbvPSpV4xy5sO-hcvqL-S0-JMW1MnLL0GBV9ATbPk11D7LC3U716_viBSKQGT4mJFdouOYfM3Hb17LEL3wjkhOhMWGdHNMxNfhno Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: db61fc3387294fe19b5ee8f565883102 Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db61fc3387294fe19b5ee8f565883102"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/db61fc3387294fe19b5ee8f565883102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_db61fc3387294fe19b5ee8f565883102", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db61fc3387294fe19b5ee8f565883102"}]}] Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: db61fc3387294fe19b5ee8f565883102 Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ListServersNegativeTestJSON-604717230-project Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: b397b39ad73c446ab43a47cf6401ac52 Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ListServersNegativeTestJSON-604717230-project Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: action_args: {} Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi '-1' Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 20 04:31:55.220209 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 20 04:31:55.225402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:31:55.225402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:31:55.225402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:31:55.225402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:31:55.225402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 20 04:31:55.225402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:31:55.225402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:55.225402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:31:55.225402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:55.225402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:55.225402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:55.225402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:31:55.225402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:31:55.225402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 20 04:31:55.225402 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:31:55.225402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-85d44541-c378-4143-b94a-0f0c6e45b566 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:55.225402 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-85d44541-c378-4143-b94a-0f0c6e45b566 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.010586 Jul 20 04:31:55.225402 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1941/3649] 10.222.0.17 () {58 vars in 1141 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:31:55.232538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-491de356-4b46-4b94-a6de-798e5b95bd56 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-491de356-4b46-4b94-a6de-798e5b95bd56 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Request method failure captured: Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14UUS0QYCyHI3x7SVIWPhZsaKoRULplNUGPk1bVzJ_764ObMLgbj2B8jrh-2dkWT675hKygFJWybbvPSpV4xy5sO-hcvqL-S0-JMW1MnLL0GBV9ATbPk11D7LC3U716_viBSKQGT4mJFdouOYfM3Hb17LEL3wjkhOhMWGdHNMxNfhno Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: db61fc3387294fe19b5ee8f565883102 Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db61fc3387294fe19b5ee8f565883102"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/db61fc3387294fe19b5ee8f565883102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_db61fc3387294fe19b5ee8f565883102", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db61fc3387294fe19b5ee8f565883102"}]}] Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: db61fc3387294fe19b5ee8f565883102 Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ListServersNegativeTestJSON-604717230-project Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: b397b39ad73c446ab43a47cf6401ac52 Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ListServersNegativeTestJSON-604717230-project Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: action_args: {} Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'testing' Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 20 04:31:55.235265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 20 04:31:55.242145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:31:55.242145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:31:55.242145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:31:55.242145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:31:55.242145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 20 04:31:55.242145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:55.242145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:55.242145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:55.242145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:55.242145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:55.242145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:55.242145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:31:55.242145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:31:55.242145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 20 04:31:55.242145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:55.242145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-491de356-4b46-4b94-a6de-798e5b95bd56 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:55.242145 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-491de356-4b46-4b94-a6de-798e5b95bd56 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.008429 Jul 20 04:31:55.242145 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1709/3650] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:31:55.249345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e4eafde4-4be9-4bea-897b-66d8ca6aa576 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.252960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e4eafde4-4be9-4bea-897b-66d8ca6aa576 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.253740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e4eafde4-4be9-4bea-897b-66d8ca6aa576 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'db61fc3387294fe19b5ee8f565883102'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:31:55.261633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.compute.servers [None req-e4eafde4-4be9-4bea-897b-66d8ca6aa576 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Flavor 'non_existing_flavor' could not be found {{(pid=127871) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 20 04:31:55.262656 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e4eafde4-4be9-4bea-897b-66d8ca6aa576 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.017364 Jul 20 04:31:55.263235 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1942/3651] 10.222.0.17 () {58 vars in 1177 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:31:55.274450 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9ff68802-4bb2-4514-922f-332f94d76b57 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.279446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9ff68802-4bb2-4514-922f-332f94d76b57 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.280129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9ff68802-4bb2-4514-922f-332f94d76b57 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'db61fc3387294fe19b5ee8f565883102'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:31:55.286385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9ff68802-4bb2-4514-922f-332f94d76b57 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.286834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9ff68802-4bb2-4514-922f-332f94d76b57 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.287625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9ff68802-4bb2-4514-922f-332f94d76b57 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.288060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9ff68802-4bb2-4514-922f-332f94d76b57 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.390073 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9ff68802-4bb2-4514-922f-332f94d76b57 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.119634 Jul 20 04:31:55.390849 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1710/3652] 10.222.0.17 () {58 vars in 1173 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:31:55.401725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2ed61069-dd18-4d37-abc0-868e0a3605b6 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.405696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2ed61069-dd18-4d37-abc0-868e0a3605b6 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.406578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2ed61069-dd18-4d37-abc0-868e0a3605b6 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'db61fc3387294fe19b5ee8f565883102'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:31:55.415951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ed61069-dd18-4d37-abc0-868e0a3605b6 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.416712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ed61069-dd18-4d37-abc0-868e0a3605b6 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.417568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ed61069-dd18-4d37-abc0-868e0a3605b6 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.418017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ed61069-dd18-4d37-abc0-868e0a3605b6 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.512101 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2ed61069-dd18-4d37-abc0-868e0a3605b6 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.114312 Jul 20 04:31:55.514096 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1943/3653] 10.222.0.17 () {58 vars in 1183 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:31:55.526511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-26777498-b9d8-4c35-83aa-e3ddc01b1b4d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.529907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-26777498-b9d8-4c35-83aa-e3ddc01b1b4d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.530723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-26777498-b9d8-4c35-83aa-e3ddc01b1b4d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Searching by: {'deleted': False, 'project_id': 'db61fc3387294fe19b5ee8f565883102'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:31:55.539793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26777498-b9d8-4c35-83aa-e3ddc01b1b4d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.540693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26777498-b9d8-4c35-83aa-e3ddc01b1b4d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.542149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26777498-b9d8-4c35-83aa-e3ddc01b1b4d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.542877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26777498-b9d8-4c35-83aa-e3ddc01b1b4d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.585894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-26777498-b9d8-4c35-83aa-e3ddc01b1b4d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:31:55.627848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-26777498-b9d8-4c35-83aa-e3ddc01b1b4d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.634821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26777498-b9d8-4c35-83aa-e3ddc01b1b4d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.635344 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26777498-b9d8-4c35-83aa-e3ddc01b1b4d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.816457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-eca48dcc-4535-4e67-9446-81dcc8fdc7c3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.817499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-eca48dcc-4535-4e67-9446-81dcc8fdc7c3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:55.843283 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-26777498-b9d8-4c35-83aa-e3ddc01b1b4d tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.321731 Jul 20 04:31:55.844399 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1711/3654] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:55.845651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eca48dcc-4535-4e67-9446-81dcc8fdc7c3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.847458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eca48dcc-4535-4e67-9446-81dcc8fdc7c3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.850667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eca48dcc-4535-4e67-9446-81dcc8fdc7c3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.851678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eca48dcc-4535-4e67-9446-81dcc8fdc7c3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.874787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b87464c3-d23f-487c-84ea-e83beedc855c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.881801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b87464c3-d23f-487c-84ea-e83beedc855c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.885574 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b87464c3-d23f-487c-84ea-e83beedc855c tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.017096 Jul 20 04:31:55.886489 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1712/3655] 10.222.0.17 () {58 vars in 1177 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:31:55.898068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-112a1f27-718f-46d0-aab0-ca07a386465e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.916706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-112a1f27-718f-46d0-aab0-ca07a386465e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.920071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-112a1f27-718f-46d0-aab0-ca07a386465e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Searching by: {'deleted': False, 'project_id': 'db61fc3387294fe19b5ee8f565883102'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:31:55.934206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-112a1f27-718f-46d0-aab0-ca07a386465e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.934660 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-112a1f27-718f-46d0-aab0-ca07a386465e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.935786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-112a1f27-718f-46d0-aab0-ca07a386465e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.936223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-112a1f27-718f-46d0-aab0-ca07a386465e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.005494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-112a1f27-718f-46d0-aab0-ca07a386465e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:31:56.061424 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-112a1f27-718f-46d0-aab0-ca07a386465e tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.162799 Jul 20 04:31:56.063768 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1713/3656] 10.222.0.17 () {58 vars in 1124 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers => generated 681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:56.077789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-02987d20-f277-4beb-a36f-13280ee47e94 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:56.081291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-02987d20-f277-4beb-a36f-13280ee47e94 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 522460f3-4bad-4790-b516-b1a3be971f45] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:56.099042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02987d20-f277-4beb-a36f-13280ee47e94 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.101767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02987d20-f277-4beb-a36f-13280ee47e94 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.105299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02987d20-f277-4beb-a36f-13280ee47e94 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.106374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02987d20-f277-4beb-a36f-13280ee47e94 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.134354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-eca48dcc-4535-4e67-9446-81dcc8fdc7c3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:56.141366 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-02987d20-f277-4beb-a36f-13280ee47e94 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] HTTP exception thrown: Instance 522460f3-4bad-4790-b516-b1a3be971f45 could not be found. Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-02987d20-f277-4beb-a36f-13280ee47e94 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Request method failure captured: Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45 HTTP/1.1 Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14UUS0QYCyHI3x7SVIWPhZsaKoRULplNUGPk1bVzJ_764ObMLgbj2B8jrh-2dkWT675hKygFJWybbvPSpV4xy5sO-hcvqL-S0-JMW1MnLL0GBV9ATbPk11D7LC3U716_viBSKQGT4mJFdouOYfM3Hb17LEL3wjkhOhMWGdHNMxNfhno Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: db61fc3387294fe19b5ee8f565883102 Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db61fc3387294fe19b5ee8f565883102"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/db61fc3387294fe19b5ee8f565883102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_db61fc3387294fe19b5ee8f565883102", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db61fc3387294fe19b5ee8f565883102"}]}] Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: db61fc3387294fe19b5ee8f565883102 Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ListServersNegativeTestJSON-604717230-project Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: b397b39ad73c446ab43a47cf6401ac52 Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ListServersNegativeTestJSON-604717230-project Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 522460f3-4bad-4790-b516-b1a3be971f45 could not be found. Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '522460f3-4bad-4790-b516-b1a3be971f45'} Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522460f3-4bad-4790-b516-b1a3be971f45 could not be found. Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:31:56.144441 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:56.162022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522460f3-4bad-4790-b516-b1a3be971f45 could not be found. Jul 20 04:31:56.162022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:56.162022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:56.162022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:56.162022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:56.162022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:56.162022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:56.162022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:56.162022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:56.162022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522460f3-4bad-4790-b516-b1a3be971f45 could not be found. Jul 20 04:31:56.162022 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:31:56.162671 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-eca48dcc-4535-4e67-9446-81dcc8fdc7c3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1314 microversion: 2.1 time: 0.340363 Jul 20 04:31:56.163987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-02987d20-f277-4beb-a36f-13280ee47e94 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Returning 404 to user: Instance 522460f3-4bad-4790-b516-b1a3be971f45 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:56.164663 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1944/3657] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:56.166880 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-02987d20-f277-4beb-a36f-13280ee47e94 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "DELETE /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45" status: 404 len: 111 microversion: 2.1 time: 0.096339 Jul 20 04:31:56.170022 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1714/3658] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:31:56 2022] DELETE /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:31:56.181690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e8a64181-1742-4f1a-8d81-b2befa0f9425 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:56.181690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e8a64181-1742-4f1a-8d81-b2befa0f9425 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: ab277261-8f75-4ad3-89d1-6ef43801e981] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:56.195650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8a64181-1742-4f1a-8d81-b2befa0f9425 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.195650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8a64181-1742-4f1a-8d81-b2befa0f9425 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.195947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8a64181-1742-4f1a-8d81-b2befa0f9425 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.196780 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8a64181-1742-4f1a-8d81-b2befa0f9425 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.228622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e8a64181-1742-4f1a-8d81-b2befa0f9425 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: ab277261-8f75-4ad3-89d1-6ef43801e981] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:31:56.341536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=8 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:56.369093 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e8a64181-1742-4f1a-8d81-b2befa0f9425 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ab277261-8f75-4ad3-89d1-6ef43801e981" status: 204 len: 0 microversion: 2.1 time: 0.191914 Jul 20 04:31:56.370663 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1945/3659] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:31:56 2022] DELETE /compute/v2.1/servers/ab277261-8f75-4ad3-89d1-6ef43801e981 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:31:56.379015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4ff09c01-3496-4507-b4a9-4da70f2832ce tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:56.380251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4ff09c01-3496-4507-b4a9-4da70f2832ce tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:56.392752 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ff09c01-3496-4507-b4a9-4da70f2832ce tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.393927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ff09c01-3496-4507-b4a9-4da70f2832ce tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.397875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ff09c01-3496-4507-b4a9-4da70f2832ce tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.402538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ff09c01-3496-4507-b4a9-4da70f2832ce tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.485634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4ff09c01-3496-4507-b4a9-4da70f2832ce tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:31:56.694684 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4ff09c01-3496-4507-b4a9-4da70f2832ce tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "DELETE /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 204 len: 0 microversion: 2.1 time: 0.317330 Jul 20 04:31:56.701405 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1715/3660] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:31:56 2022] DELETE /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:31:56.711826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f1dffbfd-b740-4f38-8081-2d7e5e7604d8 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:56.713172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f1dffbfd-b740-4f38-8081-2d7e5e7604d8 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 522460f3-4bad-4790-b516-b1a3be971f45] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:56.729480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1dffbfd-b740-4f38-8081-2d7e5e7604d8 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.730499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1dffbfd-b740-4f38-8081-2d7e5e7604d8 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.734738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1dffbfd-b740-4f38-8081-2d7e5e7604d8 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.736910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1dffbfd-b740-4f38-8081-2d7e5e7604d8 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.763136 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-f1dffbfd-b740-4f38-8081-2d7e5e7604d8 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] HTTP exception thrown: Instance 522460f3-4bad-4790-b516-b1a3be971f45 could not be found. Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f1dffbfd-b740-4f38-8081-2d7e5e7604d8 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Request method failure captured: Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45 HTTP/1.1 Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14UUS0QYCyHI3x7SVIWPhZsaKoRULplNUGPk1bVzJ_764ObMLgbj2B8jrh-2dkWT675hKygFJWybbvPSpV4xy5sO-hcvqL-S0-JMW1MnLL0GBV9ATbPk11D7LC3U716_viBSKQGT4mJFdouOYfM3Hb17LEL3wjkhOhMWGdHNMxNfhno Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: db61fc3387294fe19b5ee8f565883102 Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db61fc3387294fe19b5ee8f565883102"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/db61fc3387294fe19b5ee8f565883102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_db61fc3387294fe19b5ee8f565883102", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db61fc3387294fe19b5ee8f565883102"}]}] Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: db61fc3387294fe19b5ee8f565883102 Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ListServersNegativeTestJSON-604717230-project Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: b397b39ad73c446ab43a47cf6401ac52 Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ListServersNegativeTestJSON-604717230-project Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 522460f3-4bad-4790-b516-b1a3be971f45 could not be found. Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '522460f3-4bad-4790-b516-b1a3be971f45'} Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522460f3-4bad-4790-b516-b1a3be971f45 could not be found. Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522460f3-4bad-4790-b516-b1a3be971f45 could not be found. Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:56.765722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:31:56.769845 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:56.769845 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:56.769845 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:56.769845 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:56.769845 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:56.769845 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522460f3-4bad-4790-b516-b1a3be971f45 could not be found. Jul 20 04:31:56.769845 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:31:56.772039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f1dffbfd-b740-4f38-8081-2d7e5e7604d8 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Returning 404 to user: Instance 522460f3-4bad-4790-b516-b1a3be971f45 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:56.784628 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f1dffbfd-b740-4f38-8081-2d7e5e7604d8 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45" status: 404 len: 111 microversion: 2.1 time: 0.074075 Jul 20 04:31:56.785538 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1946/3661] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:56 2022] GET /compute/v2.1/servers/522460f3-4bad-4790-b516-b1a3be971f45 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:31:56.800224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8fc429c6-d63e-41d7-969e-613f6bdfb698 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:56.801729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8fc429c6-d63e-41d7-969e-613f6bdfb698 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: ab277261-8f75-4ad3-89d1-6ef43801e981] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:56.816546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8fc429c6-d63e-41d7-969e-613f6bdfb698 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.818489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8fc429c6-d63e-41d7-969e-613f6bdfb698 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.819624 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8fc429c6-d63e-41d7-969e-613f6bdfb698 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.821328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8fc429c6-d63e-41d7-969e-613f6bdfb698 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.139174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8fc429c6-d63e-41d7-969e-613f6bdfb698 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:57.174286 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cde2876b-b2e7-442d-ad61-b02d87c0d89b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:57.175322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cde2876b-b2e7-442d-ad61-b02d87c0d89b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:57.187287 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8fc429c6-d63e-41d7-969e-613f6bdfb698 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/ab277261-8f75-4ad3-89d1-6ef43801e981" status: 200 len: 1522 microversion: 2.1 time: 0.393102 Jul 20 04:31:57.187972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cde2876b-b2e7-442d-ad61-b02d87c0d89b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.188618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cde2876b-b2e7-442d-ad61-b02d87c0d89b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.189573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cde2876b-b2e7-442d-ad61-b02d87c0d89b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.190166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cde2876b-b2e7-442d-ad61-b02d87c0d89b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.200888 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1716/3662] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:56 2022] GET /compute/v2.1/servers/ab277261-8f75-4ad3-89d1-6ef43801e981 => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:57.447973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cde2876b-b2e7-442d-ad61-b02d87c0d89b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:57.459597 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cde2876b-b2e7-442d-ad61-b02d87c0d89b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1314 microversion: 2.1 time: 0.289578 Jul 20 04:31:57.460519 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1947/3663] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:57 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:58.209092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3f978122-e22c-46d0-a7a5-5c2c9a527ada tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:58.210732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3f978122-e22c-46d0-a7a5-5c2c9a527ada tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: ab277261-8f75-4ad3-89d1-6ef43801e981] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:58.230793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f978122-e22c-46d0-a7a5-5c2c9a527ada tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.231275 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f978122-e22c-46d0-a7a5-5c2c9a527ada tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.232807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f978122-e22c-46d0-a7a5-5c2c9a527ada tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.233880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f978122-e22c-46d0-a7a5-5c2c9a527ada tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.478757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c29fb9bf-6e5c-41c1-84d3-3378c06eff86 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:58.479794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c29fb9bf-6e5c-41c1-84d3-3378c06eff86 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:58.492730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:58.528699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c29fb9bf-6e5c-41c1-84d3-3378c06eff86 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.529863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c29fb9bf-6e5c-41c1-84d3-3378c06eff86 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.534101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c29fb9bf-6e5c-41c1-84d3-3378c06eff86 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.536255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c29fb9bf-6e5c-41c1-84d3-3378c06eff86 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.606783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3f978122-e22c-46d0-a7a5-5c2c9a527ada tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:58.625679 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3f978122-e22c-46d0-a7a5-5c2c9a527ada tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/ab277261-8f75-4ad3-89d1-6ef43801e981" status: 200 len: 1522 microversion: 2.1 time: 0.423169 Jul 20 04:31:58.629288 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1717/3664] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:58 2022] GET /compute/v2.1/servers/ab277261-8f75-4ad3-89d1-6ef43801e981 => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:58.983729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-8d335c27-f0c3-4460-9b3c-dd4e0ac5362c req-47e18c77-9bd7-4ece-8f3a-2f4cd2f17443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab277261-8f75-4ad3-89d1-6ef43801e981", "name": "network-vif-deleted", "tag": "23d3c54d-bc46-4749-8869-f4b3028043af"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:59.000931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8d335c27-f0c3-4460-9b3c-dd4e0ac5362c req-47e18c77-9bd7-4ece-8f3a-2f4cd2f17443 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.001720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8d335c27-f0c3-4460-9b3c-dd4e0ac5362c req-47e18c77-9bd7-4ece-8f3a-2f4cd2f17443 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.043244 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-8d335c27-f0c3-4460-9b3c-dd4e0ac5362c req-47e18c77-9bd7-4ece-8f3a-2f4cd2f17443 service nova] Creating event network-vif-deleted:23d3c54d-bc46-4749-8869-f4b3028043af for instance ab277261-8f75-4ad3-89d1-6ef43801e981 on n-h1-826526-5 Jul 20 04:31:59.055360 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-8d335c27-f0c3-4460-9b3c-dd4e0ac5362c req-47e18c77-9bd7-4ece-8f3a-2f4cd2f17443 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078413 Jul 20 04:31:59.060785 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1718/3665] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:31:59.140254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea4efd5b-30c6-415e-ae27-c0eb294fd07e tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:59.159048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ea4efd5b-30c6-415e-ae27-c0eb294fd07e tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:59.162454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ea4efd5b-30c6-415e-ae27-c0eb294fd07e tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Searching by: {'deleted': False, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:31:59.190020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea4efd5b-30c6-415e-ae27-c0eb294fd07e tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.192651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea4efd5b-30c6-415e-ae27-c0eb294fd07e tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.196432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea4efd5b-30c6-415e-ae27-c0eb294fd07e tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.198265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea4efd5b-30c6-415e-ae27-c0eb294fd07e tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.249885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c29fb9bf-6e5c-41c1-84d3-3378c06eff86 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:59.262960 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c29fb9bf-6e5c-41c1-84d3-3378c06eff86 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1314 microversion: 2.1 time: 0.789610 Jul 20 04:31:59.263561 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1948/3666] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:58 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1314 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:59.286016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-ea4efd5b-30c6-415e-ae27-c0eb294fd07e tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:31:59.339704 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ea4efd5b-30c6-415e-ae27-c0eb294fd07e tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.224130 Jul 20 04:31:59.348252 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1719/3667] 10.222.0.17 () {58 vars in 1124 bytes} [Wed Jul 20 04:31:59 2022] GET /compute/v2.1/servers => generated 334 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:31:59.352097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-061ddb0c-6483-48a4-bf17-d347e5d5c095 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:59.356323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-061ddb0c-6483-48a4-bf17-d347e5d5c095 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:59.357210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-061ddb0c-6483-48a4-bf17-d347e5d5c095 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Searching by: {'deleted': False, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:31:59.372224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-061ddb0c-6483-48a4-bf17-d347e5d5c095 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.372499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-061ddb0c-6483-48a4-bf17-d347e5d5c095 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.373278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-061ddb0c-6483-48a4-bf17-d347e5d5c095 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.376023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-061ddb0c-6483-48a4-bf17-d347e5d5c095 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.448912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-061ddb0c-6483-48a4-bf17-d347e5d5c095 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:31:59.550711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-061ddb0c-6483-48a4-bf17-d347e5d5c095 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:59.576318 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-061ddb0c-6483-48a4-bf17-d347e5d5c095 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.577062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-061ddb0c-6483-48a4-bf17-d347e5d5c095 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.611529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f3adcbe0-7541-4468-a460-06afa116a30f req-6311b3cf-4554-4585-b4ed-097042ee956e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2594c4f-6103-4c9d-979f-3640a04aa4ff", "name": "network-vif-plugged", "status": "completed", "tag": "676e2415-ffca-452e-9e59-41a2ecb711ce"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:59.640105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f3adcbe0-7541-4468-a460-06afa116a30f req-6311b3cf-4554-4585-b4ed-097042ee956e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.640666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f3adcbe0-7541-4468-a460-06afa116a30f req-6311b3cf-4554-4585-b4ed-097042ee956e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.708052 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f3adcbe0-7541-4468-a460-06afa116a30f req-6311b3cf-4554-4585-b4ed-097042ee956e service nova] Creating event network-vif-plugged:676e2415-ffca-452e-9e59-41a2ecb711ce for instance b2594c4f-6103-4c9d-979f-3640a04aa4ff on n-h1-826526-5 Jul 20 04:31:59.715366 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f3adcbe0-7541-4468-a460-06afa116a30f req-6311b3cf-4554-4585-b4ed-097042ee956e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108303 Jul 20 04:31:59.717002 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1720/3668] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:59.722861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0057e744-3920-429e-b47a-e9f35edd3f71 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:59.723918 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0057e744-3920-429e-b47a-e9f35edd3f71 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: ab277261-8f75-4ad3-89d1-6ef43801e981] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:59.732663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0057e744-3920-429e-b47a-e9f35edd3f71 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.733692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0057e744-3920-429e-b47a-e9f35edd3f71 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.735492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0057e744-3920-429e-b47a-e9f35edd3f71 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.736753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0057e744-3920-429e-b47a-e9f35edd3f71 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.743496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:59.854018 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0057e744-3920-429e-b47a-e9f35edd3f71 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.854780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0057e744-3920-429e-b47a-e9f35edd3f71 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.856416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-0057e744-3920-429e-b47a-e9f35edd3f71 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lazy-loading 'fault' on Instance uuid ab277261-8f75-4ad3-89d1-6ef43801e981 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:31:59.979832 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-061ddb0c-6483-48a4-bf17-d347e5d5c095 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.631660 Jul 20 04:31:59.981140 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1949/3669] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:31:59 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:00.001252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-340f2b2d-17dd-4c13-a3d2-0219f66b15ed tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:00.005997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0057e744-3920-429e-b47a-e9f35edd3f71 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b397b39ad73c446ab43a47cf6401ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db61fc3387294fe19b5ee8f565883102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:00.018326 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-340f2b2d-17dd-4c13-a3d2-0219f66b15ed tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020622 Jul 20 04:32:00.019734 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1950/3670] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:31:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:32:00.023145 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0057e744-3920-429e-b47a-e9f35edd3f71 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/ab277261-8f75-4ad3-89d1-6ef43801e981" status: 200 len: 1312 microversion: 2.1 time: 0.298058 Jul 20 04:32:00.026956 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1721/3671] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:59 2022] GET /compute/v2.1/servers/ab277261-8f75-4ad3-89d1-6ef43801e981 => generated 1312 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:00.279770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-aead4f79-fd99-4d67-996c-dcee8ac7cdb5 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:00.280724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-aead4f79-fd99-4d67-996c-dcee8ac7cdb5 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:00.293354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aead4f79-fd99-4d67-996c-dcee8ac7cdb5 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.295091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aead4f79-fd99-4d67-996c-dcee8ac7cdb5 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.298584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aead4f79-fd99-4d67-996c-dcee8ac7cdb5 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.299244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aead4f79-fd99-4d67-996c-dcee8ac7cdb5 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.798186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-aead4f79-fd99-4d67-996c-dcee8ac7cdb5 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:00.810710 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-aead4f79-fd99-4d67-996c-dcee8ac7cdb5 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1314 microversion: 2.1 time: 0.535245 Jul 20 04:32:00.811640 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1951/3672] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:00 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:00.912818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-23071ea1-aca9-405e-8561-5c927aa643d9 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:00.913417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-23071ea1-aca9-405e-8561-5c927aa643d9 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:00.921903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23071ea1-aca9-405e-8561-5c927aa643d9 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.922456 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23071ea1-aca9-405e-8561-5c927aa643d9 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.923490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23071ea1-aca9-405e-8561-5c927aa643d9 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.923933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23071ea1-aca9-405e-8561-5c927aa643d9 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.955308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-23071ea1-aca9-405e-8561-5c927aa643d9 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:32:01.057631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-32f2aeb6-b90c-4678-9c3a-1f1d00a95f52 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:01.060556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-32f2aeb6-b90c-4678-9c3a-1f1d00a95f52 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: ab277261-8f75-4ad3-89d1-6ef43801e981] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:01.114540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32f2aeb6-b90c-4678-9c3a-1f1d00a95f52 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.118834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32f2aeb6-b90c-4678-9c3a-1f1d00a95f52 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.122035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32f2aeb6-b90c-4678-9c3a-1f1d00a95f52 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.125606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32f2aeb6-b90c-4678-9c3a-1f1d00a95f52 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.128894 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-23071ea1-aca9-405e-8561-5c927aa643d9 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "DELETE /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 204 len: 0 microversion: 2.1 time: 0.220306 Jul 20 04:32:01.129714 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1722/3673] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:32:00 2022] DELETE /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:32:01.140659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e0f6540d-dd82-4b30-9668-2dd878323de3 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:01.144370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e0f6540d-dd82-4b30-9668-2dd878323de3 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:01.156347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0f6540d-dd82-4b30-9668-2dd878323de3 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.157180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0f6540d-dd82-4b30-9668-2dd878323de3 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.158160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0f6540d-dd82-4b30-9668-2dd878323de3 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.158823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0f6540d-dd82-4b30-9668-2dd878323de3 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.170044 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-32f2aeb6-b90c-4678-9c3a-1f1d00a95f52 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] HTTP exception thrown: Instance ab277261-8f75-4ad3-89d1-6ef43801e981 could not be found. Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-32f2aeb6-b90c-4678-9c3a-1f1d00a95f52 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Request method failure captured: Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/ab277261-8f75-4ad3-89d1-6ef43801e981 HTTP/1.1 Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14UUS0QYCyHI3x7SVIWPhZsaKoRULplNUGPk1bVzJ_764ObMLgbj2B8jrh-2dkWT675hKygFJWybbvPSpV4xy5sO-hcvqL-S0-JMW1MnLL0GBV9ATbPk11D7LC3U716_viBSKQGT4mJFdouOYfM3Hb17LEL3wjkhOhMWGdHNMxNfhno Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: db61fc3387294fe19b5ee8f565883102 Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db61fc3387294fe19b5ee8f565883102"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/db61fc3387294fe19b5ee8f565883102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_db61fc3387294fe19b5ee8f565883102", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db61fc3387294fe19b5ee8f565883102"}]}] Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: db61fc3387294fe19b5ee8f565883102 Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ListServersNegativeTestJSON-604717230-project Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: b397b39ad73c446ab43a47cf6401ac52 Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ListServersNegativeTestJSON-604717230-project Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance ab277261-8f75-4ad3-89d1-6ef43801e981 could not be found. Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'ab277261-8f75-4ad3-89d1-6ef43801e981'} Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab277261-8f75-4ad3-89d1-6ef43801e981 could not be found. Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab277261-8f75-4ad3-89d1-6ef43801e981 could not be found. Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:01.180482 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.185063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:01.185063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:01.185063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:01.185063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:01.185063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:01.185063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab277261-8f75-4ad3-89d1-6ef43801e981 could not be found. Jul 20 04:32:01.185063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.185063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-32f2aeb6-b90c-4678-9c3a-1f1d00a95f52 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Returning 404 to user: Instance ab277261-8f75-4ad3-89d1-6ef43801e981 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:01.185063 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-32f2aeb6-b90c-4678-9c3a-1f1d00a95f52 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/ab277261-8f75-4ad3-89d1-6ef43801e981" status: 404 len: 111 microversion: 2.1 time: 0.142260 Jul 20 04:32:01.189594 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1952/3674] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:01 2022] GET /compute/v2.1/servers/ab277261-8f75-4ad3-89d1-6ef43801e981 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:32:01.200452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-1299ec30-5f70-4576-98fb-32657760620b req-3899a134-0acc-4728-9e5f-895368a81052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f9344d-d994-4d4a-9d6d-84271f21c242", "name": "network-vif-deleted", "tag": "e5d4382a-ba64-42e8-aba7-38faffb1fd51"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:01.225083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1299ec30-5f70-4576-98fb-32657760620b req-3899a134-0acc-4728-9e5f-895368a81052 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.229313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1299ec30-5f70-4576-98fb-32657760620b req-3899a134-0acc-4728-9e5f-895368a81052 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.264723 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-1299ec30-5f70-4576-98fb-32657760620b req-3899a134-0acc-4728-9e5f-895368a81052 service nova] Creating event network-vif-deleted:e5d4382a-ba64-42e8-aba7-38faffb1fd51 for instance 77f9344d-d994-4d4a-9d6d-84271f21c242 on n-h2-826526-5 Jul 20 04:32:01.278319 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-1299ec30-5f70-4576-98fb-32657760620b req-3899a134-0acc-4728-9e5f-895368a81052 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087097 Jul 20 04:32:01.283694 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1953/3675] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:01.293526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6ca6d5c2-045b-4f3a-b37e-1dd2d229c935 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:01.300412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6ca6d5c2-045b-4f3a-b37e-1dd2d229c935 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] [instance: 77f9344d-d994-4d4a-9d6d-84271f21c242] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:01.314323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ca6d5c2-045b-4f3a-b37e-1dd2d229c935 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.317263 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ca6d5c2-045b-4f3a-b37e-1dd2d229c935 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.318236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ca6d5c2-045b-4f3a-b37e-1dd2d229c935 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.318832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ca6d5c2-045b-4f3a-b37e-1dd2d229c935 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.354417 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-6ca6d5c2-045b-4f3a-b37e-1dd2d229c935 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] HTTP exception thrown: Instance 77f9344d-d994-4d4a-9d6d-84271f21c242 could not be found. Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6ca6d5c2-045b-4f3a-b37e-1dd2d229c935 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Request method failure captured: Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 HTTP/1.1 Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14UUS0QYCyHI3x7SVIWPhZsaKoRULplNUGPk1bVzJ_764ObMLgbj2B8jrh-2dkWT675hKygFJWybbvPSpV4xy5sO-hcvqL-S0-JMW1MnLL0GBV9ATbPk11D7LC3U716_viBSKQGT4mJFdouOYfM3Hb17LEL3wjkhOhMWGdHNMxNfhno Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: db61fc3387294fe19b5ee8f565883102 Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db61fc3387294fe19b5ee8f565883102"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/db61fc3387294fe19b5ee8f565883102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_db61fc3387294fe19b5ee8f565883102", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db61fc3387294fe19b5ee8f565883102"}]}] Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: db61fc3387294fe19b5ee8f565883102 Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-604717230 Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ListServersNegativeTestJSON-604717230-project Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: b397b39ad73c446ab43a47cf6401ac52 Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ListServersNegativeTestJSON-604717230-project Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 77f9344d-d994-4d4a-9d6d-84271f21c242 could not be found. Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '77f9344d-d994-4d4a-9d6d-84271f21c242'} Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f9344d-d994-4d4a-9d6d-84271f21c242 could not be found. Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f9344d-d994-4d4a-9d6d-84271f21c242 could not be found. Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:01.356300 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.360936 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:01.360936 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:01.360936 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:01.360936 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:01.360936 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:01.360936 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f9344d-d994-4d4a-9d6d-84271f21c242 could not be found. Jul 20 04:32:01.360936 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.367566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6ca6d5c2-045b-4f3a-b37e-1dd2d229c935 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] Returning 404 to user: Instance 77f9344d-d994-4d4a-9d6d-84271f21c242 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:01.368850 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6ca6d5c2-045b-4f3a-b37e-1dd2d229c935 tempest-ListServersNegativeTestJSON-604717230 tempest-ListServersNegativeTestJSON-604717230-project] 10.222.0.17 "GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242" status: 404 len: 111 microversion: 2.1 time: 0.083812 Jul 20 04:32:01.373458 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1954/3676] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:01 2022] GET /compute/v2.1/servers/77f9344d-d994-4d4a-9d6d-84271f21c242 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:32:01.650698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e0f6540d-dd82-4b30-9668-2dd878323de3 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:01.660924 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e0f6540d-dd82-4b30-9668-2dd878323de3 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1698 microversion: 2.1 time: 0.525672 Jul 20 04:32:01.662522 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1723/3677] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:01 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1698 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:01.829858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6a5038d3-cf31-4abd-878d-977460c7c1e1 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:01.831075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6a5038d3-cf31-4abd-878d-977460c7c1e1 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:01.848321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a5038d3-cf31-4abd-878d-977460c7c1e1 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.849021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a5038d3-cf31-4abd-878d-977460c7c1e1 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.851066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a5038d3-cf31-4abd-878d-977460c7c1e1 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.851661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a5038d3-cf31-4abd-878d-977460c7c1e1 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.337835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6a5038d3-cf31-4abd-878d-977460c7c1e1 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:02.357068 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6a5038d3-cf31-4abd-878d-977460c7c1e1 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1314 microversion: 2.1 time: 0.531500 Jul 20 04:32:02.357704 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1955/3678] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:01 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:02.679258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ba7fcaf8-234a-4ea8-8ef8-3ccf49375218 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:02.680013 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ba7fcaf8-234a-4ea8-8ef8-3ccf49375218 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:02.718048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba7fcaf8-234a-4ea8-8ef8-3ccf49375218 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.718670 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba7fcaf8-234a-4ea8-8ef8-3ccf49375218 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.719526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba7fcaf8-234a-4ea8-8ef8-3ccf49375218 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.719973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba7fcaf8-234a-4ea8-8ef8-3ccf49375218 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:03.374490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2ccbb351-ddf6-4cf5-af55-7e835507b17c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:03.375332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2ccbb351-ddf6-4cf5-af55-7e835507b17c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:03.394367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ccbb351-ddf6-4cf5-af55-7e835507b17c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:03.400798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ccbb351-ddf6-4cf5-af55-7e835507b17c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:03.403702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ccbb351-ddf6-4cf5-af55-7e835507b17c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:03.405431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ccbb351-ddf6-4cf5-af55-7e835507b17c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:03.454000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ba7fcaf8-234a-4ea8-8ef8-3ccf49375218 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:03.485951 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ba7fcaf8-234a-4ea8-8ef8-3ccf49375218 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1698 microversion: 2.1 time: 0.808001 Jul 20 04:32:03.487383 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1724/3679] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:02 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1698 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:03.932320 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2ccbb351-ddf6-4cf5-af55-7e835507b17c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:03.940767 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2ccbb351-ddf6-4cf5-af55-7e835507b17c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1500 microversion: 2.1 time: 0.570590 Jul 20 04:32:03.941422 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1956/3680] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:03 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1500 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:03.958319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c21a421a-7c6d-4e76-9663-6c06ef0fcba5 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:03.960293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c21a421a-7c6d-4e76-9663-6c06ef0fcba5 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:03.979315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c21a421a-7c6d-4e76-9663-6c06ef0fcba5 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:03.982019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c21a421a-7c6d-4e76-9663-6c06ef0fcba5 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:03.985239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c21a421a-7c6d-4e76-9663-6c06ef0fcba5 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:03.986209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c21a421a-7c6d-4e76-9663-6c06ef0fcba5 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.060428 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-c21a421a-7c6d-4e76-9663-6c06ef0fcba5 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lazy-loading 'flavor' on Instance uuid b2594c4f-6103-4c9d-979f-3640a04aa4ff {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:32:04.268607 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c21a421a-7c6d-4e76-9663-6c06ef0fcba5 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "POST /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff/action" status: 200 len: 32 microversion: 2.1 time: 0.314598 Jul 20 04:32:04.275217 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1725/3681] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:03 2022] POST /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff/action => generated 32 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:32:04.289061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fd66bde1-3216-44bf-9ad2-abb070a66b91 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:04.289808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fd66bde1-3216-44bf-9ad2-abb070a66b91 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:04.316475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd66bde1-3216-44bf-9ad2-abb070a66b91 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.316932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd66bde1-3216-44bf-9ad2-abb070a66b91 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.317734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd66bde1-3216-44bf-9ad2-abb070a66b91 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.318175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd66bde1-3216-44bf-9ad2-abb070a66b91 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.503920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3c648ae4-d0de-4509-8fdf-f23399e43e3f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:04.504863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3c648ae4-d0de-4509-8fdf-f23399e43e3f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:04.517952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c648ae4-d0de-4509-8fdf-f23399e43e3f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.518411 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c648ae4-d0de-4509-8fdf-f23399e43e3f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.519205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c648ae4-d0de-4509-8fdf-f23399e43e3f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.519642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c648ae4-d0de-4509-8fdf-f23399e43e3f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:05.270399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fd66bde1-3216-44bf-9ad2-abb070a66b91 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:05.279596 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fd66bde1-3216-44bf-9ad2-abb070a66b91 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1506 microversion: 2.1 time: 0.997897 Jul 20 04:32:05.280203 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1957/3682] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:04 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1506 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:05.626573 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:05.745755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3c648ae4-d0de-4509-8fdf-f23399e43e3f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:05.765765 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3c648ae4-d0de-4509-8fdf-f23399e43e3f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1698 microversion: 2.1 time: 1.266043 Jul 20 04:32:05.767013 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1726/3683] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:04 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1698 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:06.299164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e4b4044f-cd62-4132-8563-cbfd89bb495c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:06.300571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e4b4044f-cd62-4132-8563-cbfd89bb495c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:06.311540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4b4044f-cd62-4132-8563-cbfd89bb495c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.314525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4b4044f-cd62-4132-8563-cbfd89bb495c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.317101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4b4044f-cd62-4132-8563-cbfd89bb495c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.319928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4b4044f-cd62-4132-8563-cbfd89bb495c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.791464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f9625ae6-76ad-48fb-8cac-77e030b8a6a7 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:06.793329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f9625ae6-76ad-48fb-8cac-77e030b8a6a7 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:06.803645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9625ae6-76ad-48fb-8cac-77e030b8a6a7 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.804803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9625ae6-76ad-48fb-8cac-77e030b8a6a7 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.805925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9625ae6-76ad-48fb-8cac-77e030b8a6a7 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.809327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9625ae6-76ad-48fb-8cac-77e030b8a6a7 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:07.359538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e4b4044f-cd62-4132-8563-cbfd89bb495c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:07.382788 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e4b4044f-cd62-4132-8563-cbfd89bb495c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1506 microversion: 2.1 time: 1.087702 Jul 20 04:32:07.385471 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1958/3684] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:06 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1506 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:07.596616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f9625ae6-76ad-48fb-8cac-77e030b8a6a7 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:07.669704 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f9625ae6-76ad-48fb-8cac-77e030b8a6a7 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1632 microversion: 2.1 time: 0.884578 Jul 20 04:32:07.675965 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1727/3685] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:06 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1632 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:08.148739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-579d9686-9cdc-45eb-9a22-b1886bf2dd98 req-9867cf19-b2bb-4874-8847-166eb7f26600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b7b690-49b0-4475-bf8e-77d17ed76c70", "name": "network-vif-deleted", "tag": "70aafaef-c7de-42aa-a442-bc353be736e5"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:08.242187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-579d9686-9cdc-45eb-9a22-b1886bf2dd98 req-9867cf19-b2bb-4874-8847-166eb7f26600 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:08.262727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-579d9686-9cdc-45eb-9a22-b1886bf2dd98 req-9867cf19-b2bb-4874-8847-166eb7f26600 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:08.338598 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-579d9686-9cdc-45eb-9a22-b1886bf2dd98 req-9867cf19-b2bb-4874-8847-166eb7f26600 service nova] Creating event network-vif-deleted:70aafaef-c7de-42aa-a442-bc353be736e5 for instance 77b7b690-49b0-4475-bf8e-77d17ed76c70 on n-h1-826526-5 Jul 20 04:32:08.354216 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-579d9686-9cdc-45eb-9a22-b1886bf2dd98 req-9867cf19-b2bb-4874-8847-166eb7f26600 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227287 Jul 20 04:32:08.376667 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1959/3686] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:08.411263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a54f4363-1249-48ee-9de1-aba1bc2f3aed tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:08.412771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a54f4363-1249-48ee-9de1-aba1bc2f3aed tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:08.425364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a54f4363-1249-48ee-9de1-aba1bc2f3aed tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:08.430977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a54f4363-1249-48ee-9de1-aba1bc2f3aed tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:08.435734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a54f4363-1249-48ee-9de1-aba1bc2f3aed tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:08.439743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a54f4363-1249-48ee-9de1-aba1bc2f3aed tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:08.700625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-edf46cca-89b5-425d-9d93-e80655fed04f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:08.701602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-edf46cca-89b5-425d-9d93-e80655fed04f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:08.724897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edf46cca-89b5-425d-9d93-e80655fed04f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:08.726073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edf46cca-89b5-425d-9d93-e80655fed04f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:08.727612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edf46cca-89b5-425d-9d93-e80655fed04f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:08.728588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edf46cca-89b5-425d-9d93-e80655fed04f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:08.944567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edf46cca-89b5-425d-9d93-e80655fed04f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:08.946058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edf46cca-89b5-425d-9d93-e80655fed04f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:08.957561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-edf46cca-89b5-425d-9d93-e80655fed04f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lazy-loading 'fault' on Instance uuid 77b7b690-49b0-4475-bf8e-77d17ed76c70 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:32:09.034680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:09.167455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-edf46cca-89b5-425d-9d93-e80655fed04f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2af1cff4e141ba84b1317d67290e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e4a9ab93cb459fb20e059cdb8a220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:09.199617 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-edf46cca-89b5-425d-9d93-e80655fed04f tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 200 len: 1359 microversion: 2.1 time: 0.499210 Jul 20 04:32:09.224239 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1960/3687] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:08 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 1359 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:09.241684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=10 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:09.985367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a54f4363-1249-48ee-9de1-aba1bc2f3aed tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:10.074800 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a54f4363-1249-48ee-9de1-aba1bc2f3aed tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1506 microversion: 2.1 time: 1.632539 Jul 20 04:32:10.079669 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1728/3688] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:08 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1506 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:10.233020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6356d17a-5744-4fe3-ba43-de0416b0472c tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:10.236683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6356d17a-5744-4fe3-ba43-de0416b0472c tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] [instance: 77b7b690-49b0-4475-bf8e-77d17ed76c70] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:10.276772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=10 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:10.287833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:10.303607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6356d17a-5744-4fe3-ba43-de0416b0472c tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:10.305153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6356d17a-5744-4fe3-ba43-de0416b0472c tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:10.312479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6356d17a-5744-4fe3-ba43-de0416b0472c tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:10.312704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6356d17a-5744-4fe3-ba43-de0416b0472c tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:10.406539 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-6356d17a-5744-4fe3-ba43-de0416b0472c tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] HTTP exception thrown: Instance 77b7b690-49b0-4475-bf8e-77d17ed76c70 could not be found. Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6356d17a-5744-4fe3-ba43-de0416b0472c tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Request method failure captured: Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 HTTP/1.1 Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14T3ljsRGgS9ZrEUsC-zKt1puWFquA1TJTMame9D2Zt_fwqpiBiqIq-FMQ9w_ur44E9W_aOnWjs28it_3czsdcapmUD8gvapaBsaJu9V6iq1LY77wucuoNgObd5j_ZU5i7-avyWVONEpMcXgW3WGTiGQp5q8pcHKjOzMz24aP746fNE Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 62e4a9ab93cb459fb20e059cdb8a220f Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestJSON-1236142120 Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/62e4a9ab93cb459fb20e059cdb8a220f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/62e4a9ab93cb459fb20e059cdb8a220f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_62e4a9ab93cb459fb20e059cdb8a220f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/62e4a9ab93cb459fb20e059cdb8a220f"}]}] Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestJSON-1236142120 Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 62e4a9ab93cb459fb20e059cdb8a220f Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestJSON-1236142120 Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestJSON-1236142120-project Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 2b2af1cff4e141ba84b1317d67290e17 Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestJSON-1236142120-project Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 77b7b690-49b0-4475-bf8e-77d17ed76c70 could not be found. Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '77b7b690-49b0-4475-bf8e-77d17ed76c70'} Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77b7b690-49b0-4475-bf8e-77d17ed76c70 could not be found. Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77b7b690-49b0-4475-bf8e-77d17ed76c70 could not be found. Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:32:10.409545 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:10.413792 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:10.413792 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:10.413792 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:10.413792 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:10.413792 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77b7b690-49b0-4475-bf8e-77d17ed76c70 could not be found. Jul 20 04:32:10.413792 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:32:10.416441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6356d17a-5744-4fe3-ba43-de0416b0472c tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Returning 404 to user: Instance 77b7b690-49b0-4475-bf8e-77d17ed76c70 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:10.417599 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6356d17a-5744-4fe3-ba43-de0416b0472c tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70" status: 404 len: 111 microversion: 2.1 time: 0.193777 Jul 20 04:32:10.418431 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1961/3689] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:10 2022] GET /compute/v2.1/servers/77b7b690-49b0-4475-bf8e-77d17ed76c70 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:32:10.439434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e8e84352-c285-4cc1-9422-02a073617a31 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] Calling method '.version_select at 0x7f06bd26f160>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:10.525981 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e8e84352-c285-4cc1-9422-02a073617a31 tempest-ServersTestJSON-1236142120 tempest-ServersTestJSON-1236142120-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-679597744" status: 202 len: 0 microversion: 2.1 time: 0.094198 Jul 20 04:32:10.527507 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1729/3690] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jul 20 04:32:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-679597744 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:32:11.097887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7f114c56-61d2-4fa7-b10d-d6de2841af09 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:11.099053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7f114c56-61d2-4fa7-b10d-d6de2841af09 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:11.113870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f114c56-61d2-4fa7-b10d-d6de2841af09 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:11.115103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f114c56-61d2-4fa7-b10d-d6de2841af09 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:11.117483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f114c56-61d2-4fa7-b10d-d6de2841af09 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:11.123209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f114c56-61d2-4fa7-b10d-d6de2841af09 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:11.802837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7f114c56-61d2-4fa7-b10d-d6de2841af09 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:11.820998 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7f114c56-61d2-4fa7-b10d-d6de2841af09 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1506 microversion: 2.1 time: 0.728450 Jul 20 04:32:11.822517 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1962/3691] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:11 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1506 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:12.845174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-61d84b48-d4c0-481c-bbe0-38523cb0a4ea tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:12.850468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-61d84b48-d4c0-481c-bbe0-38523cb0a4ea tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:12.912390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61d84b48-d4c0-481c-bbe0-38523cb0a4ea tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.913063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61d84b48-d4c0-481c-bbe0-38523cb0a4ea tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:12.914086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61d84b48-d4c0-481c-bbe0-38523cb0a4ea tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.914669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61d84b48-d4c0-481c-bbe0-38523cb0a4ea tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:13.670999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-61d84b48-d4c0-481c-bbe0-38523cb0a4ea tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:13.689695 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-61d84b48-d4c0-481c-bbe0-38523cb0a4ea tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1506 microversion: 2.1 time: 0.853534 Jul 20 04:32:13.696810 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1730/3692] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:12 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1506 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:14.734916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7f6df586-06ca-4840-a42a-8d6fe46de294 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:14.736600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7f6df586-06ca-4840-a42a-8d6fe46de294 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:14.774357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f6df586-06ca-4840-a42a-8d6fe46de294 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:14.776749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f6df586-06ca-4840-a42a-8d6fe46de294 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:14.778736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f6df586-06ca-4840-a42a-8d6fe46de294 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:14.779412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f6df586-06ca-4840-a42a-8d6fe46de294 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:15.851039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7f6df586-06ca-4840-a42a-8d6fe46de294 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:15.868488 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7f6df586-06ca-4840-a42a-8d6fe46de294 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1506 microversion: 2.1 time: 1.143372 Jul 20 04:32:15.872480 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1963/3693] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:14 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1506 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:16.898884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e4649424-22dc-4f8b-bf27-3fdba5285366 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:16.898884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e4649424-22dc-4f8b-bf27-3fdba5285366 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:16.922597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4649424-22dc-4f8b-bf27-3fdba5285366 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:16.924297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4649424-22dc-4f8b-bf27-3fdba5285366 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:16.928937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4649424-22dc-4f8b-bf27-3fdba5285366 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:16.929979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4649424-22dc-4f8b-bf27-3fdba5285366 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:17.563838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e4649424-22dc-4f8b-bf27-3fdba5285366 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:17.575481 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e4649424-22dc-4f8b-bf27-3fdba5285366 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1506 microversion: 2.1 time: 0.683289 Jul 20 04:32:17.586304 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1731/3694] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:16 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1506 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:18.596607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d19aba5f-e9d3-495a-99f3-8c6567bd7687 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:18.597830 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d19aba5f-e9d3-495a-99f3-8c6567bd7687 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:18.645005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d19aba5f-e9d3-495a-99f3-8c6567bd7687 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:18.646987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d19aba5f-e9d3-495a-99f3-8c6567bd7687 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:18.650716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d19aba5f-e9d3-495a-99f3-8c6567bd7687 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:18.651269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d19aba5f-e9d3-495a-99f3-8c6567bd7687 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:19.313687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d19aba5f-e9d3-495a-99f3-8c6567bd7687 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:19.330689 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d19aba5f-e9d3-495a-99f3-8c6567bd7687 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1506 microversion: 2.1 time: 0.738540 Jul 20 04:32:19.332587 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1964/3695] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:18 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1506 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:20.357235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3f12040c-4e85-4f85-883c-1ccd3837b98e tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:20.358276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3f12040c-4e85-4f85-883c-1ccd3837b98e tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:20.375465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:20.387120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f12040c-4e85-4f85-883c-1ccd3837b98e tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:20.388355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f12040c-4e85-4f85-883c-1ccd3837b98e tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:20.390260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f12040c-4e85-4f85-883c-1ccd3837b98e tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:20.391065 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f12040c-4e85-4f85-883c-1ccd3837b98e tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:20.828314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3f12040c-4e85-4f85-883c-1ccd3837b98e tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:20.864977 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3f12040c-4e85-4f85-883c-1ccd3837b98e tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1506 microversion: 2.1 time: 0.512625 Jul 20 04:32:20.867773 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1732/3696] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:20 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1506 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:21.890034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6accac6e-55bb-4430-9d41-3a2d862fd092 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:21.893664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6accac6e-55bb-4430-9d41-3a2d862fd092 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:21.917727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6accac6e-55bb-4430-9d41-3a2d862fd092 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:21.918027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6accac6e-55bb-4430-9d41-3a2d862fd092 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:21.918837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6accac6e-55bb-4430-9d41-3a2d862fd092 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:21.919285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6accac6e-55bb-4430-9d41-3a2d862fd092 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:22.558633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6accac6e-55bb-4430-9d41-3a2d862fd092 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:22.587250 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6accac6e-55bb-4430-9d41-3a2d862fd092 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1506 microversion: 2.1 time: 0.704566 Jul 20 04:32:22.594509 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1965/3697] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:21 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1506 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:23.612698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8eb509d5-15e3-41b8-8886-956a8f0279d1 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:23.613334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8eb509d5-15e3-41b8-8886-956a8f0279d1 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:23.644519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8eb509d5-15e3-41b8-8886-956a8f0279d1 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:23.652785 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8eb509d5-15e3-41b8-8886-956a8f0279d1 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:23.655889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8eb509d5-15e3-41b8-8886-956a8f0279d1 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:23.656793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8eb509d5-15e3-41b8-8886-956a8f0279d1 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:26.351278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8eb509d5-15e3-41b8-8886-956a8f0279d1 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:26.384419 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8eb509d5-15e3-41b8-8886-956a8f0279d1 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1506 microversion: 2.1 time: 2.776576 Jul 20 04:32:26.385405 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1733/3698] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:23 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1506 bytes in 2779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:27.403956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-58a2c6a6-4d1a-4358-a8c0-a85f08c43191 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:27.405457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-58a2c6a6-4d1a-4358-a8c0-a85f08c43191 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:27.421720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58a2c6a6-4d1a-4358-a8c0-a85f08c43191 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.423714 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58a2c6a6-4d1a-4358-a8c0-a85f08c43191 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.425665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58a2c6a6-4d1a-4358-a8c0-a85f08c43191 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.427080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58a2c6a6-4d1a-4358-a8c0-a85f08c43191 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:28.441905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-58a2c6a6-4d1a-4358-a8c0-a85f08c43191 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:28.460838 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-58a2c6a6-4d1a-4358-a8c0-a85f08c43191 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1506 microversion: 2.1 time: 1.058496 Jul 20 04:32:28.467049 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1966/3699] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:27 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1506 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:29.484355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed1bfbb9-c020-46f5-946a-a1e15173a3fb tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:29.485721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ed1bfbb9-c020-46f5-946a-a1e15173a3fb tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:29.549405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed1bfbb9-c020-46f5-946a-a1e15173a3fb tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:29.557072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed1bfbb9-c020-46f5-946a-a1e15173a3fb tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:29.558355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed1bfbb9-c020-46f5-946a-a1e15173a3fb tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:29.559078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed1bfbb9-c020-46f5-946a-a1e15173a3fb tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:30.439084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ed1bfbb9-c020-46f5-946a-a1e15173a3fb tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:30.441871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:30.478302 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ed1bfbb9-c020-46f5-946a-a1e15173a3fb tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1486 microversion: 2.1 time: 1.001495 Jul 20 04:32:30.490766 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1734/3700] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:29 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1486 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:30.848795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ca740e59-445f-469c-a519-a14a2405a5d3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-847595767", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:30.877440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=42 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:30.949006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-ca740e59-445f-469c-a519-a14a2405a5d3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] validate_networks() for [('2d36d8d3-a9ee-4445-85c8-50d1135e9282', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:32:34.460182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ca740e59-445f-469c-a519-a14a2405a5d3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:32:34.461795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ca740e59-445f-469c-a519-a14a2405a5d3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:32:34.462492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ca740e59-445f-469c-a519-a14a2405a5d3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:32:34.463012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ca740e59-445f-469c-a519-a14a2405a5d3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:32:34.464157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ca740e59-445f-469c-a519-a14a2405a5d3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:32:34.503618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca740e59-445f-469c-a519-a14a2405a5d3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:34.504519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca740e59-445f-469c-a519-a14a2405a5d3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:34.505752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca740e59-445f-469c-a519-a14a2405a5d3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:34.506471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca740e59-445f-469c-a519-a14a2405a5d3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:34.540899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-ca740e59-445f-469c-a519-a14a2405a5d3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Getting quotas for project d1e98a37424940769eebbb38c1af937f. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:32:34.560193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-ca740e59-445f-469c-a519-a14a2405a5d3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Getting quotas for user bdc18c445e334a60a66a3f20b37ace48 and project d1e98a37424940769eebbb38c1af937f. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:32:34.585110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ca740e59-445f-469c-a519-a14a2405a5d3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:32:34.588236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ca740e59-445f-469c-a519-a14a2405a5d3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:32:34.678419 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ca740e59-445f-469c-a519-a14a2405a5d3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.835184 Jul 20 04:32:34.679826 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1967/3701] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:32:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 3837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:32:34.693798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7bd50164-2823-4ae0-a0a5-290c5c89c5cb tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:34.695063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7bd50164-2823-4ae0-a0a5-290c5c89c5cb tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:34.894319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7bd50164-2823-4ae0-a0a5-290c5c89c5cb tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:34.905271 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7bd50164-2823-4ae0-a0a5-290c5c89c5cb tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1213 microversion: 2.1 time: 0.216101 Jul 20 04:32:34.906128 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1735/3702] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:34 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1213 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:35.203708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a08144c6-7dea-4e38-a03a-cbc2124a9c19 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'create', calling method: .version_select at 0x7f06c73508b0>, body: {"keypair": {"name": "tempest-keypair-999992406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7N53528cF50QQKcjK3WCPWDl6NoQlw8kmZ7GXOd43Ae9j01W32ThgmExfGtJY2zX8tXDMo/T01jXAE6f5VIsrVElsX2fWPlfUAHqljqnfm8YkWhdCNO8H5nQll4IRCfw=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:35.281214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-a08144c6-7dea-4e38-a03a-cbc2124a9c19 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Getting quotas for project fcd6c40faa19476db37fa7897dea5840. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:32:35.326542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-a08144c6-7dea-4e38-a03a-cbc2124a9c19 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Getting quotas for user f50ac97f2ef04752bd49148748e39eb8 and project fcd6c40faa19476db37fa7897dea5840. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:32:35.412282 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a08144c6-7dea-4e38-a03a-cbc2124a9c19 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.635818 Jul 20 04:32:35.414123 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1968/3703] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:32:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:32:35.937699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-97b6c6da-b193-4290-b0ee-1a6bdb0f6676 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:35.938351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-97b6c6da-b193-4290-b0ee-1a6bdb0f6676 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:36.066875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97b6c6da-b193-4290-b0ee-1a6bdb0f6676 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:36.097456 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97b6c6da-b193-4290-b0ee-1a6bdb0f6676 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:36.098835 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97b6c6da-b193-4290-b0ee-1a6bdb0f6676 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:36.124816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97b6c6da-b193-4290-b0ee-1a6bdb0f6676 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:36.511317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-97b6c6da-b193-4290-b0ee-1a6bdb0f6676 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:36.573943 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-97b6c6da-b193-4290-b0ee-1a6bdb0f6676 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1217 microversion: 2.1 time: 0.643981 Jul 20 04:32:36.599667 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1736/3704] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:35 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1217 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:37.607202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8b6850e4-f6e1-4cba-8afa-f1dfa0377740 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:37.608003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8b6850e4-f6e1-4cba-8afa-f1dfa0377740 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:37.641315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b6850e4-f6e1-4cba-8afa-f1dfa0377740 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:37.641315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b6850e4-f6e1-4cba-8afa-f1dfa0377740 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:37.649243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b6850e4-f6e1-4cba-8afa-f1dfa0377740 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:37.654997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b6850e4-f6e1-4cba-8afa-f1dfa0377740 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:38.057379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8b6850e4-f6e1-4cba-8afa-f1dfa0377740 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:38.080895 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8b6850e4-f6e1-4cba-8afa-f1dfa0377740 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1273 microversion: 2.1 time: 0.466050 Jul 20 04:32:38.081583 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1969/3705] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:37 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1273 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:39.110309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c012823c-d1b9-4b84-9c52-aac5795c827f tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:39.112562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c012823c-d1b9-4b84-9c52-aac5795c827f tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:39.126729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c012823c-d1b9-4b84-9c52-aac5795c827f tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:39.128241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c012823c-d1b9-4b84-9c52-aac5795c827f tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:39.129879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c012823c-d1b9-4b84-9c52-aac5795c827f tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:39.130908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c012823c-d1b9-4b84-9c52-aac5795c827f tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:39.658559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c012823c-d1b9-4b84-9c52-aac5795c827f tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:39.675597 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c012823c-d1b9-4b84-9c52-aac5795c827f tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1271 microversion: 2.1 time: 0.580114 Jul 20 04:32:39.686650 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1737/3706] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:39 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1271 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:40.710383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7357f4ce-6220-43fe-b585-22b88d5baec3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:40.721368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7357f4ce-6220-43fe-b585-22b88d5baec3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:40.756772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7357f4ce-6220-43fe-b585-22b88d5baec3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:40.761626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7357f4ce-6220-43fe-b585-22b88d5baec3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:40.762991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7357f4ce-6220-43fe-b585-22b88d5baec3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:40.763744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7357f4ce-6220-43fe-b585-22b88d5baec3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:40.778966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=44 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:41.330398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7357f4ce-6220-43fe-b585-22b88d5baec3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:41.353857 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7357f4ce-6220-43fe-b585-22b88d5baec3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1271 microversion: 2.1 time: 0.651897 Jul 20 04:32:41.359008 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1970/3707] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:40 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1271 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:42.376178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f90482c1-d5d1-48a0-8a24-50e11741a195 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:42.378429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f90482c1-d5d1-48a0-8a24-50e11741a195 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:42.398671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f90482c1-d5d1-48a0-8a24-50e11741a195 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:42.400061 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f90482c1-d5d1-48a0-8a24-50e11741a195 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:42.420872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f90482c1-d5d1-48a0-8a24-50e11741a195 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:42.423952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f90482c1-d5d1-48a0-8a24-50e11741a195 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:43.907204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-01aefe3e-893f-4636-a481-f242c240abb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1334318498", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69228133-6b77-4fda-a084-e067c6109be5"}], "security_groups": [{"name": "tempest-securitygroup--799714278"}], "key_name": "tempest-keypair-999992406", "user_data": "}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:43.968824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f90482c1-d5d1-48a0-8a24-50e11741a195 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:43.996765 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f90482c1-d5d1-48a0-8a24-50e11741a195 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1313 microversion: 2.1 time: 1.625635 Jul 20 04:32:44.002914 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1738/3708] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:42 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1313 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:44.533052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:44.981985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-01aefe3e-893f-4636-a481-f242c240abb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] validate_networks() for [('69228133-6b77-4fda-a084-e067c6109be5', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:32:45.028125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ca7eaee9-ec2b-4ba2-881d-4a80fbebe3ce tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:45.028966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ca7eaee9-ec2b-4ba2-881d-4a80fbebe3ce tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:45.052401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:45.058120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca7eaee9-ec2b-4ba2-881d-4a80fbebe3ce tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:45.058487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca7eaee9-ec2b-4ba2-881d-4a80fbebe3ce tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:45.059293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca7eaee9-ec2b-4ba2-881d-4a80fbebe3ce tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:45.077166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca7eaee9-ec2b-4ba2-881d-4a80fbebe3ce tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:45.358258 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=10 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:46.248044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ca7eaee9-ec2b-4ba2-881d-4a80fbebe3ce tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:46.296611 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ca7eaee9-ec2b-4ba2-881d-4a80fbebe3ce tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1313 microversion: 2.1 time: 1.261690 Jul 20 04:32:46.333524 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1739/3709] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:45 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1313 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:46.641163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-824dde3d-5051-4eb0-b7a0-7fc429e9494c req-2ea250ef-d8f0-463f-bcd1-5d6665a5f9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19855b43-dd90-497e-a6b4-57b18b4833a3", "tag": "33987e6a-19b7-4f7d-923f-c402b445d43a"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:46.689410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-824dde3d-5051-4eb0-b7a0-7fc429e9494c req-2ea250ef-d8f0-463f-bcd1-5d6665a5f9c6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:46.690281 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-824dde3d-5051-4eb0-b7a0-7fc429e9494c req-2ea250ef-d8f0-463f-bcd1-5d6665a5f9c6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:46.720679 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-824dde3d-5051-4eb0-b7a0-7fc429e9494c req-2ea250ef-d8f0-463f-bcd1-5d6665a5f9c6 service nova] Creating event network-changed:33987e6a-19b7-4f7d-923f-c402b445d43a for instance 19855b43-dd90-497e-a6b4-57b18b4833a3 on n-h2-826526-5 Jul 20 04:32:46.730381 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-824dde3d-5051-4eb0-b7a0-7fc429e9494c req-2ea250ef-d8f0-463f-bcd1-5d6665a5f9c6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100863 Jul 20 04:32:46.737763 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1740/3710] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 20 04:32:47.340077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9d7b0b65-c78c-4e93-a8f1-6f8e385f415b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:47.345127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9d7b0b65-c78c-4e93-a8f1-6f8e385f415b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:47.387887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d7b0b65-c78c-4e93-a8f1-6f8e385f415b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:47.390695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d7b0b65-c78c-4e93-a8f1-6f8e385f415b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:47.392531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d7b0b65-c78c-4e93-a8f1-6f8e385f415b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:47.393663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d7b0b65-c78c-4e93-a8f1-6f8e385f415b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:48.484952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9d7b0b65-c78c-4e93-a8f1-6f8e385f415b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:48.532077 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9d7b0b65-c78c-4e93-a8f1-6f8e385f415b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1313 microversion: 2.1 time: 1.196581 Jul 20 04:32:48.533972 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1741/3711] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:47 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1313 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:48.961140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-01aefe3e-893f-4636-a481-f242c240abb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:32:48.962685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-01aefe3e-893f-4636-a481-f242c240abb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:32:48.963675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-01aefe3e-893f-4636-a481-f242c240abb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:32:48.964954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-01aefe3e-893f-4636-a481-f242c240abb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:32:48.965874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-01aefe3e-893f-4636-a481-f242c240abb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:32:49.041622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-01aefe3e-893f-4636-a481-f242c240abb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:49.044520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-01aefe3e-893f-4636-a481-f242c240abb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:49.049611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-01aefe3e-893f-4636-a481-f242c240abb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:49.052635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-01aefe3e-893f-4636-a481-f242c240abb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:49.162578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-01aefe3e-893f-4636-a481-f242c240abb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Getting quotas for project fcd6c40faa19476db37fa7897dea5840. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:32:49.190967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-01aefe3e-893f-4636-a481-f242c240abb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Getting quotas for user f50ac97f2ef04752bd49148748e39eb8 and project fcd6c40faa19476db37fa7897dea5840. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:32:49.252807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-01aefe3e-893f-4636-a481-f242c240abb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:32:49.269546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-01aefe3e-893f-4636-a481-f242c240abb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:32:49.568233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ce1eb533-fc41-438f-8879-5fccd585a11a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:49.570227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ce1eb533-fc41-438f-8879-5fccd585a11a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:49.617619 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-01aefe3e-893f-4636-a481-f242c240abb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 5.715050 Jul 20 04:32:49.626745 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1971/3712] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:32:43 2022] POST /compute/v2.1/servers => generated 408 bytes in 5726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:32:49.638534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-da536558-2223-4736-9026-415dadae310b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:49.643568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-da536558-2223-4736-9026-415dadae310b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:49.650611 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce1eb533-fc41-438f-8879-5fccd585a11a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:49.689180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce1eb533-fc41-438f-8879-5fccd585a11a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:49.693218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce1eb533-fc41-438f-8879-5fccd585a11a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:49.715322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce1eb533-fc41-438f-8879-5fccd585a11a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:49.977740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-da536558-2223-4736-9026-415dadae310b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:49.993851 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-da536558-2223-4736-9026-415dadae310b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1238 microversion: 2.1 time: 0.361679 Jul 20 04:32:49.995224 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1972/3713] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:49 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1238 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:51.023637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2120d62b-8480-4948-b601-5d46e8edb5ae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:51.025120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2120d62b-8480-4948-b601-5d46e8edb5ae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:51.206039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ce1eb533-fc41-438f-8879-5fccd585a11a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:51.222222 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ce1eb533-fc41-438f-8879-5fccd585a11a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1313 microversion: 2.1 time: 1.664183 Jul 20 04:32:51.236592 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1742/3714] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:49 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1313 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:51.310436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2120d62b-8480-4948-b601-5d46e8edb5ae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:51.364853 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2120d62b-8480-4948-b601-5d46e8edb5ae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1238 microversion: 2.1 time: 0.336572 Jul 20 04:32:51.376066 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1973/3715] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:51 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1238 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:52.255412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-699470c2-cc29-40d9-a559-241813ac025c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:52.256102 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-699470c2-cc29-40d9-a559-241813ac025c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:52.259464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=28 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:52.279676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-699470c2-cc29-40d9-a559-241813ac025c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:52.280430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-699470c2-cc29-40d9-a559-241813ac025c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:52.283157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-699470c2-cc29-40d9-a559-241813ac025c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:52.283618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-699470c2-cc29-40d9-a559-241813ac025c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:52.397879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ddcc95ae-4ee1-4f1a-9f3a-28cce0e1714c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:52.398689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ddcc95ae-4ee1-4f1a-9f3a-28cce0e1714c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:52.427696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ddcc95ae-4ee1-4f1a-9f3a-28cce0e1714c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:52.428121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ddcc95ae-4ee1-4f1a-9f3a-28cce0e1714c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:52.439271 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ddcc95ae-4ee1-4f1a-9f3a-28cce0e1714c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:52.439724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ddcc95ae-4ee1-4f1a-9f3a-28cce0e1714c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:52.690064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ddcc95ae-4ee1-4f1a-9f3a-28cce0e1714c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:52.697890 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ddcc95ae-4ee1-4f1a-9f3a-28cce0e1714c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1290 microversion: 2.1 time: 0.303798 Jul 20 04:32:52.698578 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1974/3716] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:52 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1290 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:53.116941 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-699470c2-cc29-40d9-a559-241813ac025c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:53.128640 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-699470c2-cc29-40d9-a559-241813ac025c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1313 microversion: 2.1 time: 0.877266 Jul 20 04:32:53.129297 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1743/3717] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:52 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1313 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:53.719126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-96fecb17-092a-4df1-a0aa-8c3776a2e03b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:53.719754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-96fecb17-092a-4df1-a0aa-8c3776a2e03b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:53.739142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96fecb17-092a-4df1-a0aa-8c3776a2e03b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:53.739633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96fecb17-092a-4df1-a0aa-8c3776a2e03b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:53.740598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96fecb17-092a-4df1-a0aa-8c3776a2e03b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:53.741042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96fecb17-092a-4df1-a0aa-8c3776a2e03b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:53.977847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-96fecb17-092a-4df1-a0aa-8c3776a2e03b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:53.992050 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-96fecb17-092a-4df1-a0aa-8c3776a2e03b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1296 microversion: 2.1 time: 0.276658 Jul 20 04:32:53.992712 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1975/3718] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:53 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1296 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:54.164548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a002a60d-6f4b-4bf9-85e5-58bd196e033a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:54.165769 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a002a60d-6f4b-4bf9-85e5-58bd196e033a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:54.230010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a002a60d-6f4b-4bf9-85e5-58bd196e033a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:54.230833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a002a60d-6f4b-4bf9-85e5-58bd196e033a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:54.232336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a002a60d-6f4b-4bf9-85e5-58bd196e033a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:54.233198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a002a60d-6f4b-4bf9-85e5-58bd196e033a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:55.057223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5f2e8f04-f088-4a88-a2ed-bcffa85ddebd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:55.058046 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5f2e8f04-f088-4a88-a2ed-bcffa85ddebd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:55.096352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f2e8f04-f088-4a88-a2ed-bcffa85ddebd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:55.097415 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f2e8f04-f088-4a88-a2ed-bcffa85ddebd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:55.098843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f2e8f04-f088-4a88-a2ed-bcffa85ddebd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:55.099633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f2e8f04-f088-4a88-a2ed-bcffa85ddebd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:55.367450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5f2e8f04-f088-4a88-a2ed-bcffa85ddebd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:55.376385 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5f2e8f04-f088-4a88-a2ed-bcffa85ddebd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1296 microversion: 2.1 time: 0.363342 Jul 20 04:32:55.376999 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1976/3719] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:55 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1296 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:56.075003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a002a60d-6f4b-4bf9-85e5-58bd196e033a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:56.097685 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a002a60d-6f4b-4bf9-85e5-58bd196e033a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1313 microversion: 2.1 time: 1.940907 Jul 20 04:32:56.107082 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1744/3720] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:54 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1313 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:56.395811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a76b709a-63cd-46b0-aac7-dafa9029947f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:56.396887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a76b709a-63cd-46b0-aac7-dafa9029947f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:56.405712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a76b709a-63cd-46b0-aac7-dafa9029947f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:56.406158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a76b709a-63cd-46b0-aac7-dafa9029947f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:56.406943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a76b709a-63cd-46b0-aac7-dafa9029947f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:56.407379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a76b709a-63cd-46b0-aac7-dafa9029947f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:56.879980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a76b709a-63cd-46b0-aac7-dafa9029947f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:56.912239 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a76b709a-63cd-46b0-aac7-dafa9029947f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1363 microversion: 2.1 time: 0.519975 Jul 20 04:32:56.933813 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1977/3721] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:56 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1363 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:57.118172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fd49ce2f-0466-4a4c-8243-1ce646af79e2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:57.119967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fd49ce2f-0466-4a4c-8243-1ce646af79e2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:57.155214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd49ce2f-0466-4a4c-8243-1ce646af79e2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.157401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd49ce2f-0466-4a4c-8243-1ce646af79e2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.162668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd49ce2f-0466-4a4c-8243-1ce646af79e2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.172338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-8142ecaf-57e3-44bf-8069-6aec217372fc req-ad5233e9-9f74-4f2d-9e30-d4ef64a69743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19855b43-dd90-497e-a6b4-57b18b4833a3", "name": "network-vif-plugged", "status": "completed", "tag": "33987e6a-19b7-4f7d-923f-c402b445d43a"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:57.178706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd49ce2f-0466-4a4c-8243-1ce646af79e2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.210347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8142ecaf-57e3-44bf-8069-6aec217372fc req-ad5233e9-9f74-4f2d-9e30-d4ef64a69743 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.211154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8142ecaf-57e3-44bf-8069-6aec217372fc req-ad5233e9-9f74-4f2d-9e30-d4ef64a69743 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.267084 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-8142ecaf-57e3-44bf-8069-6aec217372fc req-ad5233e9-9f74-4f2d-9e30-d4ef64a69743 service nova] Creating event network-vif-plugged:33987e6a-19b7-4f7d-923f-c402b445d43a for instance 19855b43-dd90-497e-a6b4-57b18b4833a3 on n-h2-826526-5 Jul 20 04:32:57.291508 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-8142ecaf-57e3-44bf-8069-6aec217372fc req-ad5233e9-9f74-4f2d-9e30-d4ef64a69743 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125132 Jul 20 04:32:57.295327 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1978/3722] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:57.947856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4055e5e9-3923-4bfb-a649-dc7bf00aef94 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:57.952649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4055e5e9-3923-4bfb-a649-dc7bf00aef94 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:57.985922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4055e5e9-3923-4bfb-a649-dc7bf00aef94 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.986385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4055e5e9-3923-4bfb-a649-dc7bf00aef94 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.987184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4055e5e9-3923-4bfb-a649-dc7bf00aef94 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.987628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4055e5e9-3923-4bfb-a649-dc7bf00aef94 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:58.772044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fd49ce2f-0466-4a4c-8243-1ce646af79e2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:58.817940 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fd49ce2f-0466-4a4c-8243-1ce646af79e2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1313 microversion: 2.1 time: 1.707127 Jul 20 04:32:58.818800 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1745/3723] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:57 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1313 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:59.018848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-017ac0dd-1079-42e4-98f8-300fa07873cb req-b2941ebc-d962-46ad-a819-4f3c636584d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2db32d6-491e-4d61-81b0-571b1c7073ff", "tag": "44e02028-8e3e-412c-b0ec-8a5e5b769d7c"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:59.074416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-017ac0dd-1079-42e4-98f8-300fa07873cb req-b2941ebc-d962-46ad-a819-4f3c636584d7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.080998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-017ac0dd-1079-42e4-98f8-300fa07873cb req-b2941ebc-d962-46ad-a819-4f3c636584d7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.121335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:59.146589 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-017ac0dd-1079-42e4-98f8-300fa07873cb req-b2941ebc-d962-46ad-a819-4f3c636584d7 service nova] Creating event network-changed:44e02028-8e3e-412c-b0ec-8a5e5b769d7c for instance f2db32d6-491e-4d61-81b0-571b1c7073ff on n-h1-826526-5 Jul 20 04:32:59.168220 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-017ac0dd-1079-42e4-98f8-300fa07873cb req-b2941ebc-d962-46ad-a819-4f3c636584d7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155704 Jul 20 04:32:59.173225 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1746/3724] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:59.433757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4055e5e9-3923-4bfb-a649-dc7bf00aef94 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:59.491550 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4055e5e9-3923-4bfb-a649-dc7bf00aef94 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1363 microversion: 2.1 time: 1.547893 Jul 20 04:32:59.507333 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1979/3725] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:57 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1363 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:59.850263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-84ccb93c-50f6-4096-b3db-d49a45ec2567 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:59.851623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-84ccb93c-50f6-4096-b3db-d49a45ec2567 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:59.893295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84ccb93c-50f6-4096-b3db-d49a45ec2567 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.894111 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84ccb93c-50f6-4096-b3db-d49a45ec2567 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.895430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84ccb93c-50f6-4096-b3db-d49a45ec2567 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.904731 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84ccb93c-50f6-4096-b3db-d49a45ec2567 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:00.484807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-84ccb93c-50f6-4096-b3db-d49a45ec2567 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:00.511470 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-84ccb93c-50f6-4096-b3db-d49a45ec2567 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1499 microversion: 2.1 time: 0.672110 Jul 20 04:33:00.533985 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1747/3726] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:59 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1499 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:00.534373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3d8eb634-0d74-4c99-962f-54f8a7738cb7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:00.535577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3d8eb634-0d74-4c99-962f-54f8a7738cb7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:00.556409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3d8eb634-0d74-4c99-962f-54f8a7738cb7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:00.557327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3d8eb634-0d74-4c99-962f-54f8a7738cb7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:00.558365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3d8eb634-0d74-4c99-962f-54f8a7738cb7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:00.558965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3d8eb634-0d74-4c99-962f-54f8a7738cb7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:00.570881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-153f619e-48ce-4775-9a00-3495a9f79061 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:00.572800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-153f619e-48ce-4775-9a00-3495a9f79061 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:00.616931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153f619e-48ce-4775-9a00-3495a9f79061 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:00.626238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153f619e-48ce-4775-9a00-3495a9f79061 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:00.633901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153f619e-48ce-4775-9a00-3495a9f79061 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:00.634690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153f619e-48ce-4775-9a00-3495a9f79061 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:00.728605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-153f619e-48ce-4775-9a00-3495a9f79061 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lazy-loading 'flavor' on Instance uuid 19855b43-dd90-497e-a6b4-57b18b4833a3 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:33:01.111246 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-153f619e-48ce-4775-9a00-3495a9f79061 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "POST /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3/action" status: 200 len: 32 microversion: 2.1 time: 0.554284 Jul 20 04:33:01.113526 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1748/3727] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:33:00 2022] POST /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3/action => generated 32 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:33:01.163119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-add03865-f09c-40e6-986d-85f187167ff2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:01.163119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-add03865-f09c-40e6-986d-85f187167ff2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:01.175610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-add03865-f09c-40e6-986d-85f187167ff2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:01.176071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-add03865-f09c-40e6-986d-85f187167ff2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:01.178378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-add03865-f09c-40e6-986d-85f187167ff2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:01.179715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-add03865-f09c-40e6-986d-85f187167ff2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:01.248495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3d8eb634-0d74-4c99-962f-54f8a7738cb7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:01.262271 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3d8eb634-0d74-4c99-962f-54f8a7738cb7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1363 microversion: 2.1 time: 0.732236 Jul 20 04:33:01.272772 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1980/3728] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:00 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1363 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:01.644126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-add03865-f09c-40e6-986d-85f187167ff2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:01.663138 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-add03865-f09c-40e6-986d-85f187167ff2 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1505 microversion: 2.1 time: 0.528372 Jul 20 04:33:01.681328 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1749/3729] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:01 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1505 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:02.281658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-580cbad9-b622-426f-af59-71b1773927b2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:02.282912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-580cbad9-b622-426f-af59-71b1773927b2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:02.292041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=10 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:02.296675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=7 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:02.298502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-580cbad9-b622-426f-af59-71b1773927b2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:02.301824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-580cbad9-b622-426f-af59-71b1773927b2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:02.305204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-580cbad9-b622-426f-af59-71b1773927b2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:02.309757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-580cbad9-b622-426f-af59-71b1773927b2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:02.720913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-14ccd327-b1ec-456d-96c3-e340e12c2e74 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:02.721538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-14ccd327-b1ec-456d-96c3-e340e12c2e74 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:02.740900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14ccd327-b1ec-456d-96c3-e340e12c2e74 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:02.741402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14ccd327-b1ec-456d-96c3-e340e12c2e74 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:02.742128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14ccd327-b1ec-456d-96c3-e340e12c2e74 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:02.742564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14ccd327-b1ec-456d-96c3-e340e12c2e74 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:03.339196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-580cbad9-b622-426f-af59-71b1773927b2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:03.387586 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-580cbad9-b622-426f-af59-71b1773927b2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1363 microversion: 2.1 time: 1.104093 Jul 20 04:33:03.390569 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1981/3730] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:02 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1363 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:04.119751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-14ccd327-b1ec-456d-96c3-e340e12c2e74 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:04.149959 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-14ccd327-b1ec-456d-96c3-e340e12c2e74 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1505 microversion: 2.1 time: 1.435479 Jul 20 04:33:04.160713 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1750/3731] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:02 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1505 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:04.413777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-554a7ed8-048c-4140-bd46-0b280b26b580 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:04.415210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-554a7ed8-048c-4140-bd46-0b280b26b580 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:04.463252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-554a7ed8-048c-4140-bd46-0b280b26b580 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:04.464584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-554a7ed8-048c-4140-bd46-0b280b26b580 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:04.475044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-554a7ed8-048c-4140-bd46-0b280b26b580 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:04.478550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-554a7ed8-048c-4140-bd46-0b280b26b580 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.252611 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e856e532-156d-41bc-9246-0c801e724551 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:05.254068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e856e532-156d-41bc-9246-0c801e724551 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:05.285099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e856e532-156d-41bc-9246-0c801e724551 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.296857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e856e532-156d-41bc-9246-0c801e724551 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.300512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e856e532-156d-41bc-9246-0c801e724551 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.307603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e856e532-156d-41bc-9246-0c801e724551 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.445639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:05.446531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-554a7ed8-048c-4140-bd46-0b280b26b580 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:05.457025 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-554a7ed8-048c-4140-bd46-0b280b26b580 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1363 microversion: 2.1 time: 1.050014 Jul 20 04:33:05.467497 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1982/3732] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:04 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1363 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:05.767975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e856e532-156d-41bc-9246-0c801e724551 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:05.787483 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e856e532-156d-41bc-9246-0c801e724551 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1505 microversion: 2.1 time: 0.540573 Jul 20 04:33:05.789096 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1751/3733] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:05 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:06.487435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1df23ace-2fe1-4118-8965-f959a1c3f0d8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:06.489048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1df23ace-2fe1-4118-8965-f959a1c3f0d8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:06.519353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1df23ace-2fe1-4118-8965-f959a1c3f0d8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:06.519975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1df23ace-2fe1-4118-8965-f959a1c3f0d8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:06.521172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1df23ace-2fe1-4118-8965-f959a1c3f0d8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:06.521750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1df23ace-2fe1-4118-8965-f959a1c3f0d8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:06.810505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4b252af9-1363-4530-a486-49fa753eab34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:06.813634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4b252af9-1363-4530-a486-49fa753eab34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:06.851401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b252af9-1363-4530-a486-49fa753eab34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:06.854207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b252af9-1363-4530-a486-49fa753eab34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:06.857635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b252af9-1363-4530-a486-49fa753eab34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:06.859934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b252af9-1363-4530-a486-49fa753eab34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:07.170576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1df23ace-2fe1-4118-8965-f959a1c3f0d8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:07.185300 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1df23ace-2fe1-4118-8965-f959a1c3f0d8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1363 microversion: 2.1 time: 0.701997 Jul 20 04:33:07.189549 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1983/3734] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:06 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1363 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:07.396492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4b252af9-1363-4530-a486-49fa753eab34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:07.410013 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4b252af9-1363-4530-a486-49fa753eab34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1505 microversion: 2.1 time: 0.607442 Jul 20 04:33:07.424106 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1752/3735] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:06 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1505 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:08.223725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2b76d01d-6478-4bb7-9d92-ec51675a8b3b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:08.229747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2b76d01d-6478-4bb7-9d92-ec51675a8b3b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:08.264298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b76d01d-6478-4bb7-9d92-ec51675a8b3b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:08.277868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b76d01d-6478-4bb7-9d92-ec51675a8b3b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:08.302491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b76d01d-6478-4bb7-9d92-ec51675a8b3b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:08.304628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b76d01d-6478-4bb7-9d92-ec51675a8b3b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:08.443593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f3602d57-871b-406a-9cd7-5483a02ec190 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:08.444687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f3602d57-871b-406a-9cd7-5483a02ec190 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:08.483228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3602d57-871b-406a-9cd7-5483a02ec190 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:08.483930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3602d57-871b-406a-9cd7-5483a02ec190 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:08.485219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3602d57-871b-406a-9cd7-5483a02ec190 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:08.485918 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3602d57-871b-406a-9cd7-5483a02ec190 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:09.130190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f3602d57-871b-406a-9cd7-5483a02ec190 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:09.152242 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f3602d57-871b-406a-9cd7-5483a02ec190 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1505 microversion: 2.1 time: 0.714826 Jul 20 04:33:09.165292 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1753/3736] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:08 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1505 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:09.866732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-7453a9f9-6d24-41c6-8072-d33d726fc2d1 req-ea1f1a8f-5fb1-41e3-9b5b-828af4b27f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2db32d6-491e-4d61-81b0-571b1c7073ff", "name": "network-vif-plugged", "status": "completed", "tag": "44e02028-8e3e-412c-b0ec-8a5e5b769d7c"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:09.877453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7453a9f9-6d24-41c6-8072-d33d726fc2d1 req-ea1f1a8f-5fb1-41e3-9b5b-828af4b27f66 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:09.878167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7453a9f9-6d24-41c6-8072-d33d726fc2d1 req-ea1f1a8f-5fb1-41e3-9b5b-828af4b27f66 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:09.926105 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-7453a9f9-6d24-41c6-8072-d33d726fc2d1 req-ea1f1a8f-5fb1-41e3-9b5b-828af4b27f66 service nova] Creating event network-vif-plugged:44e02028-8e3e-412c-b0ec-8a5e5b769d7c for instance f2db32d6-491e-4d61-81b0-571b1c7073ff on n-h1-826526-5 Jul 20 04:33:09.942942 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-7453a9f9-6d24-41c6-8072-d33d726fc2d1 req-ea1f1a8f-5fb1-41e3-9b5b-828af4b27f66 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077965 Jul 20 04:33:09.948509 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1754/3737] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:10.005826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2b76d01d-6478-4bb7-9d92-ec51675a8b3b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:10.028581 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2b76d01d-6478-4bb7-9d92-ec51675a8b3b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1363 microversion: 2.1 time: 1.815036 Jul 20 04:33:10.041747 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1984/3738] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:08 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1363 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:10.200808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-033695bc-333a-407c-9505-58c08289eaee tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:10.201778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-033695bc-333a-407c-9505-58c08289eaee tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:10.219631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-033695bc-333a-407c-9505-58c08289eaee tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.222630 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-033695bc-333a-407c-9505-58c08289eaee tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.228938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-033695bc-333a-407c-9505-58c08289eaee tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.229994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-033695bc-333a-407c-9505-58c08289eaee tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.053472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-52029b27-d6ab-473b-b39c-49dc1b9fac3f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:11.054258 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-52029b27-d6ab-473b-b39c-49dc1b9fac3f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:11.073882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52029b27-d6ab-473b-b39c-49dc1b9fac3f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.081521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52029b27-d6ab-473b-b39c-49dc1b9fac3f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.086745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52029b27-d6ab-473b-b39c-49dc1b9fac3f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.087508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52029b27-d6ab-473b-b39c-49dc1b9fac3f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.168330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=70 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:11.663099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-52029b27-d6ab-473b-b39c-49dc1b9fac3f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:11.690473 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-52029b27-d6ab-473b-b39c-49dc1b9fac3f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1363 microversion: 2.1 time: 0.643117 Jul 20 04:33:11.695792 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1985/3739] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:11 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1363 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:12.038671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-033695bc-333a-407c-9505-58c08289eaee tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:12.072781 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-033695bc-333a-407c-9505-58c08289eaee tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1505 microversion: 2.1 time: 1.889825 Jul 20 04:33:12.076921 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1755/3740] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:10 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1505 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:12.732221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fd14ea47-b36e-4aa6-a30c-6f19065815dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:12.733589 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fd14ea47-b36e-4aa6-a30c-6f19065815dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:12.776155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd14ea47-b36e-4aa6-a30c-6f19065815dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:12.778402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd14ea47-b36e-4aa6-a30c-6f19065815dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:12.785051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd14ea47-b36e-4aa6-a30c-6f19065815dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:12.785635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd14ea47-b36e-4aa6-a30c-6f19065815dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.128823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5fcd4e44-d910-491e-bf9c-51f32305e8f6 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:13.135406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5fcd4e44-d910-491e-bf9c-51f32305e8f6 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:13.202505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fcd4e44-d910-491e-bf9c-51f32305e8f6 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.220239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fcd4e44-d910-491e-bf9c-51f32305e8f6 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.223042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fcd4e44-d910-491e-bf9c-51f32305e8f6 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.229727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fcd4e44-d910-491e-bf9c-51f32305e8f6 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.249392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fd14ea47-b36e-4aa6-a30c-6f19065815dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:13.263003 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fd14ea47-b36e-4aa6-a30c-6f19065815dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1550 microversion: 2.1 time: 0.554199 Jul 20 04:33:13.277507 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1986/3741] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:12 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1550 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:13.301830 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bf01028b-28e8-47ed-b8eb-9881cf88d2ac tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:13.305711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bf01028b-28e8-47ed-b8eb-9881cf88d2ac tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:13.319719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf01028b-28e8-47ed-b8eb-9881cf88d2ac tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.325223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf01028b-28e8-47ed-b8eb-9881cf88d2ac tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.326326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf01028b-28e8-47ed-b8eb-9881cf88d2ac tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.340601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf01028b-28e8-47ed-b8eb-9881cf88d2ac tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.571852 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bf01028b-28e8-47ed-b8eb-9881cf88d2ac tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.278481 Jul 20 04:33:13.572500 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1987/3742] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:33:13 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/os-interface => generated 284 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:33:13.720512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5fcd4e44-d910-491e-bf9c-51f32305e8f6 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:13.736189 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5fcd4e44-d910-491e-bf9c-51f32305e8f6 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1505 microversion: 2.1 time: 0.636435 Jul 20 04:33:13.740480 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1756/3743] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:13 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1505 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:14.763984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-50619153-82c2-4fb3-96b9-3b291bd6ba0b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:14.764810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-50619153-82c2-4fb3-96b9-3b291bd6ba0b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:14.781548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-50619153-82c2-4fb3-96b9-3b291bd6ba0b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:14.781990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-50619153-82c2-4fb3-96b9-3b291bd6ba0b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:14.782954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-50619153-82c2-4fb3-96b9-3b291bd6ba0b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:14.783545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-50619153-82c2-4fb3-96b9-3b291bd6ba0b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:15.336988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-50619153-82c2-4fb3-96b9-3b291bd6ba0b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:15.357471 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-50619153-82c2-4fb3-96b9-3b291bd6ba0b tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1505 microversion: 2.1 time: 0.598070 Jul 20 04:33:15.359394 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1988/3744] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:14 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1505 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:16.378201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-685c5c6c-8258-4d3f-b316-fade34ebd6a3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:16.379373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-685c5c6c-8258-4d3f-b316-fade34ebd6a3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:16.389685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-685c5c6c-8258-4d3f-b316-fade34ebd6a3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:16.394757 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-685c5c6c-8258-4d3f-b316-fade34ebd6a3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:16.395803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-685c5c6c-8258-4d3f-b316-fade34ebd6a3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:16.396998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-685c5c6c-8258-4d3f-b316-fade34ebd6a3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:16.763514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-685c5c6c-8258-4d3f-b316-fade34ebd6a3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:16.780924 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-685c5c6c-8258-4d3f-b316-fade34ebd6a3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1505 microversion: 2.1 time: 0.407404 Jul 20 04:33:16.793696 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1757/3745] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:16 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:17.029395 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-dc046abd-14a6-4656-af96-c24f1d055d4d req-af9e45da-0f4f-4cbf-b01b-320fbe94650a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2db32d6-491e-4d61-81b0-571b1c7073ff", "tag": "44e02028-8e3e-412c-b0ec-8a5e5b769d7c"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:17.039568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-dc046abd-14a6-4656-af96-c24f1d055d4d req-af9e45da-0f4f-4cbf-b01b-320fbe94650a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:17.040026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-dc046abd-14a6-4656-af96-c24f1d055d4d req-af9e45da-0f4f-4cbf-b01b-320fbe94650a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:17.072595 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-dc046abd-14a6-4656-af96-c24f1d055d4d req-af9e45da-0f4f-4cbf-b01b-320fbe94650a service nova] Creating event network-changed:44e02028-8e3e-412c-b0ec-8a5e5b769d7c for instance f2db32d6-491e-4d61-81b0-571b1c7073ff on n-h1-826526-5 Jul 20 04:33:17.089829 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-dc046abd-14a6-4656-af96-c24f1d055d4d req-af9e45da-0f4f-4cbf-b01b-320fbe94650a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.363977 Jul 20 04:33:17.091852 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1989/3746] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:17.816053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e25dcf20-3b7f-46e7-8611-ec5bc759365c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:17.817389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e25dcf20-3b7f-46e7-8611-ec5bc759365c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:17.831852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e25dcf20-3b7f-46e7-8611-ec5bc759365c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:17.843407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e25dcf20-3b7f-46e7-8611-ec5bc759365c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:17.844851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e25dcf20-3b7f-46e7-8611-ec5bc759365c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:17.845513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e25dcf20-3b7f-46e7-8611-ec5bc759365c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.451925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e25dcf20-3b7f-46e7-8611-ec5bc759365c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:18.485383 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e25dcf20-3b7f-46e7-8611-ec5bc759365c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1505 microversion: 2.1 time: 0.673368 Jul 20 04:33:18.493655 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1758/3747] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:17 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1505 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:18.690388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2cf6e532-1364-4f6c-bd45-b94a4fd69e65 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:18.691168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2cf6e532-1364-4f6c-bd45-b94a4fd69e65 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:18.711598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2cf6e532-1364-4f6c-bd45-b94a4fd69e65 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.712132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2cf6e532-1364-4f6c-bd45-b94a4fd69e65 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.738141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2cf6e532-1364-4f6c-bd45-b94a4fd69e65 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.738592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2cf6e532-1364-4f6c-bd45-b94a4fd69e65 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.863983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2cf6e532-1364-4f6c-bd45-b94a4fd69e65 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:33:19.142944 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2cf6e532-1364-4f6c-bd45-b94a4fd69e65 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 204 len: 0 microversion: 2.32 time: 0.454168 Jul 20 04:33:19.145532 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1990/3748] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:33:18 2022] DELETE /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:33:19.162750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d170c049-dc88-4dc1-b7ec-250b751f6575 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:19.173992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d170c049-dc88-4dc1-b7ec-250b751f6575 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:19.236908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d170c049-dc88-4dc1-b7ec-250b751f6575 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:19.238642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d170c049-dc88-4dc1-b7ec-250b751f6575 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:19.240747 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d170c049-dc88-4dc1-b7ec-250b751f6575 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:19.243897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d170c049-dc88-4dc1-b7ec-250b751f6575 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:19.537062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ff071d3c-fc44-4a11-a17d-9cacd0347277 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:19.540547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ff071d3c-fc44-4a11-a17d-9cacd0347277 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:19.579950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff071d3c-fc44-4a11-a17d-9cacd0347277 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:19.581689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff071d3c-fc44-4a11-a17d-9cacd0347277 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:19.583649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff071d3c-fc44-4a11-a17d-9cacd0347277 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:19.584955 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff071d3c-fc44-4a11-a17d-9cacd0347277 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:19.880784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d170c049-dc88-4dc1-b7ec-250b751f6575 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:19.893823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d170c049-dc88-4dc1-b7ec-250b751f6575 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:19.898127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d170c049-dc88-4dc1-b7ec-250b751f6575 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:19.899713 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d170c049-dc88-4dc1-b7ec-250b751f6575 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 2947 microversion: 2.32 time: 0.748117 Jul 20 04:33:19.913418 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1759/3749] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:19 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 2947 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:20.360909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ff071d3c-fc44-4a11-a17d-9cacd0347277 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:20.399922 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ff071d3c-fc44-4a11-a17d-9cacd0347277 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1505 microversion: 2.1 time: 0.884051 Jul 20 04:33:20.406680 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1991/3750] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:19 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1505 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:20.926257 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-df7d1edf-6379-41c4-92e7-a4589f083e97 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:20.927623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-df7d1edf-6379-41c4-92e7-a4589f083e97 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:20.946905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df7d1edf-6379-41c4-92e7-a4589f083e97 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:20.953074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df7d1edf-6379-41c4-92e7-a4589f083e97 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:20.964578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df7d1edf-6379-41c4-92e7-a4589f083e97 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:20.965612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df7d1edf-6379-41c4-92e7-a4589f083e97 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:21.435364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4f4cd085-f28b-4573-a081-83e83459f15a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:21.440167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4f4cd085-f28b-4573-a081-83e83459f15a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:21.465511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f4cd085-f28b-4573-a081-83e83459f15a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:21.466651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f4cd085-f28b-4573-a081-83e83459f15a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:21.468411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f4cd085-f28b-4573-a081-83e83459f15a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:21.469510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f4cd085-f28b-4573-a081-83e83459f15a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:21.814624 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-df7d1edf-6379-41c4-92e7-a4589f083e97 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:21.855894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-df7d1edf-6379-41c4-92e7-a4589f083e97 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:21.872994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-df7d1edf-6379-41c4-92e7-a4589f083e97 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:21.879790 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-df7d1edf-6379-41c4-92e7-a4589f083e97 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 2947 microversion: 2.32 time: 0.957351 Jul 20 04:33:21.889953 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1760/3751] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:20 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 2947 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:22.083677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4f4cd085-f28b-4573-a081-83e83459f15a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:22.123254 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4f4cd085-f28b-4573-a081-83e83459f15a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1505 microversion: 2.1 time: 0.694745 Jul 20 04:33:22.124869 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1992/3752] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:21 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1505 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:22.922034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-190475cd-4c6c-4298-881d-279d6b41dafc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:22.922919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-190475cd-4c6c-4298-881d-279d6b41dafc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:22.927582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=36 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:22.955526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-190475cd-4c6c-4298-881d-279d6b41dafc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:22.956217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-190475cd-4c6c-4298-881d-279d6b41dafc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:22.962459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-190475cd-4c6c-4298-881d-279d6b41dafc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:22.963160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-190475cd-4c6c-4298-881d-279d6b41dafc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:23.149946 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-238846eb-74d3-4a83-81ac-590e4bb34f95 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:23.150681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-238846eb-74d3-4a83-81ac-590e4bb34f95 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:23.176653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-238846eb-74d3-4a83-81ac-590e4bb34f95 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:23.177689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-238846eb-74d3-4a83-81ac-590e4bb34f95 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:23.178704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-238846eb-74d3-4a83-81ac-590e4bb34f95 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:23.189792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-238846eb-74d3-4a83-81ac-590e4bb34f95 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:23.617059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-238846eb-74d3-4a83-81ac-590e4bb34f95 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:23.671314 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-238846eb-74d3-4a83-81ac-590e4bb34f95 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1505 microversion: 2.1 time: 0.525872 Jul 20 04:33:23.680059 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1993/3753] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:23 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1505 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:24.212868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-190475cd-4c6c-4298-881d-279d6b41dafc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:24.265578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-190475cd-4c6c-4298-881d-279d6b41dafc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:24.278831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-190475cd-4c6c-4298-881d-279d6b41dafc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:24.285381 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-190475cd-4c6c-4298-881d-279d6b41dafc tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 2947 microversion: 2.32 time: 1.367166 Jul 20 04:33:24.289807 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1761/3754] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:22 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 2947 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:24.692056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b04aafef-9d80-4514-8ef4-7b728fb02395 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:24.692789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b04aafef-9d80-4514-8ef4-7b728fb02395 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:24.714428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b04aafef-9d80-4514-8ef4-7b728fb02395 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.726176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b04aafef-9d80-4514-8ef4-7b728fb02395 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.739494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b04aafef-9d80-4514-8ef4-7b728fb02395 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.749479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b04aafef-9d80-4514-8ef4-7b728fb02395 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:25.254060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b04aafef-9d80-4514-8ef4-7b728fb02395 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:25.285686 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b04aafef-9d80-4514-8ef4-7b728fb02395 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1485 microversion: 2.1 time: 0.598380 Jul 20 04:33:25.289756 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1994/3755] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:24 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1485 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:25.309980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0acff9f5-b86b-4eb9-9876-c0897c549d81 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:25.310778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0acff9f5-b86b-4eb9-9876-c0897c549d81 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:25.338966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0acff9f5-b86b-4eb9-9876-c0897c549d81 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:25.343052 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0acff9f5-b86b-4eb9-9876-c0897c549d81 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:25.343945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0acff9f5-b86b-4eb9-9876-c0897c549d81 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:25.344453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0acff9f5-b86b-4eb9-9876-c0897c549d81 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:25.360745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-41426a84-71de-4877-92da-b85bf6f7fac3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:25.362444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-41426a84-71de-4877-92da-b85bf6f7fac3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:25.395825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41426a84-71de-4877-92da-b85bf6f7fac3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:25.398196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41426a84-71de-4877-92da-b85bf6f7fac3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:25.405160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41426a84-71de-4877-92da-b85bf6f7fac3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:25.408608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41426a84-71de-4877-92da-b85bf6f7fac3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:25.620145 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0acff9f5-b86b-4eb9-9876-c0897c549d81 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "POST /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3/action" status: 202 len: 0 microversion: 2.1 time: 0.313851 Jul 20 04:33:25.632055 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1762/3756] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:33:25 2022] POST /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:33:25.654770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9f0692b9-e44b-4eb5-bdcc-4ccca1215b34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:25.659967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9f0692b9-e44b-4eb5-bdcc-4ccca1215b34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:25.686117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f0692b9-e44b-4eb5-bdcc-4ccca1215b34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:25.687680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f0692b9-e44b-4eb5-bdcc-4ccca1215b34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:25.690954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f0692b9-e44b-4eb5-bdcc-4ccca1215b34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:25.691759 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f0692b9-e44b-4eb5-bdcc-4ccca1215b34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:27.241884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-41426a84-71de-4877-92da-b85bf6f7fac3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:27.290251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-41426a84-71de-4877-92da-b85bf6f7fac3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:27.305863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-41426a84-71de-4877-92da-b85bf6f7fac3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:27.307769 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-41426a84-71de-4877-92da-b85bf6f7fac3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 2926 microversion: 2.32 time: 1.990265 Jul 20 04:33:27.332835 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1995/3757] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:25 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 2926 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:27.442985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9f0692b9-e44b-4eb5-bdcc-4ccca1215b34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:27.480073 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9f0692b9-e44b-4eb5-bdcc-4ccca1215b34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1493 microversion: 2.1 time: 1.845872 Jul 20 04:33:27.489336 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1763/3758] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:25 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1493 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:27.901807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-81c6fdbf-5d2d-462a-99e2-8e0f6402c93f req-804496ab-490c-44b5-ab1d-0a97494e2364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "name": "network-vif-unplugged", "status": "completed", "tag": "76dffb6b-943c-49a9-abbd-14d1036220db"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:27.936788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-81c6fdbf-5d2d-462a-99e2-8e0f6402c93f req-804496ab-490c-44b5-ab1d-0a97494e2364 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:27.937449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-81c6fdbf-5d2d-462a-99e2-8e0f6402c93f req-804496ab-490c-44b5-ab1d-0a97494e2364 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:27.971906 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-81c6fdbf-5d2d-462a-99e2-8e0f6402c93f req-804496ab-490c-44b5-ab1d-0a97494e2364 service nova] Creating event network-vif-unplugged:76dffb6b-943c-49a9-abbd-14d1036220db for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:33:27.992339 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-81c6fdbf-5d2d-462a-99e2-8e0f6402c93f req-804496ab-490c-44b5-ab1d-0a97494e2364 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096391 Jul 20 04:33:27.996890 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1996/3759] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:33:28.355872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2c32462b-a1e3-40d6-943a-409a4eb57d33 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:28.356533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2c32462b-a1e3-40d6-943a-409a4eb57d33 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:28.375892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c32462b-a1e3-40d6-943a-409a4eb57d33 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:28.376531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c32462b-a1e3-40d6-943a-409a4eb57d33 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:28.377833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c32462b-a1e3-40d6-943a-409a4eb57d33 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:28.378394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c32462b-a1e3-40d6-943a-409a4eb57d33 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:28.510195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8c5d3a3e-48f5-44b7-9d57-67a582fb3ac0 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:28.513141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8c5d3a3e-48f5-44b7-9d57-67a582fb3ac0 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:28.554459 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c5d3a3e-48f5-44b7-9d57-67a582fb3ac0 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:28.556448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c5d3a3e-48f5-44b7-9d57-67a582fb3ac0 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:28.557648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c5d3a3e-48f5-44b7-9d57-67a582fb3ac0 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:28.559650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c5d3a3e-48f5-44b7-9d57-67a582fb3ac0 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:29.135046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2c32462b-a1e3-40d6-943a-409a4eb57d33 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:29.155027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2c32462b-a1e3-40d6-943a-409a4eb57d33 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:29.160537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2c32462b-a1e3-40d6-943a-409a4eb57d33 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:29.168652 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2c32462b-a1e3-40d6-943a-409a4eb57d33 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 2905 microversion: 2.32 time: 0.816036 Jul 20 04:33:29.172100 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1764/3760] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:28 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 2905 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:29.240121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8c5d3a3e-48f5-44b7-9d57-67a582fb3ac0 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:29.277521 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8c5d3a3e-48f5-44b7-9d57-67a582fb3ac0 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1493 microversion: 2.1 time: 0.773511 Jul 20 04:33:29.294890 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1997/3761] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:28 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1493 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:29.539792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-775868e4-abc5-46b7-a115-8b2bd2c7117c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1626963853", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "f6037d71-c80c-42d4-b7df-76ef4babc455"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:29.757955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-775868e4-abc5-46b7-a115-8b2bd2c7117c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] validate_networks() for [('f6037d71-c80c-42d4-b7df-76ef4babc455', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:33:30.170724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-9bd29f08-80a1-47c8-ae46-ab209b029673 req-94acd0f3-ecbb-49af-a6b0-4bf9dcc49305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "name": "network-vif-unplugged", "status": "completed", "tag": "8ef7c976-1682-4334-a2e1-0641c7cbd89c"}, {"server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "name": "network-vif-unplugged", "status": "completed", "tag": "5181d6ac-4b81-40aa-b0f8-6206c7cc13b0"}, {"server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "name": "network-vif-unplugged", "status": "completed", "tag": "a31c0a5e-56a2-4356-95b1-8a55b29d3c84"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:30.210394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9bd29f08-80a1-47c8-ae46-ab209b029673 req-94acd0f3-ecbb-49af-a6b0-4bf9dcc49305 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:30.210935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9bd29f08-80a1-47c8-ae46-ab209b029673 req-94acd0f3-ecbb-49af-a6b0-4bf9dcc49305 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:30.255283 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9bd29f08-80a1-47c8-ae46-ab209b029673 req-94acd0f3-ecbb-49af-a6b0-4bf9dcc49305 service nova] Creating event network-vif-unplugged:8ef7c976-1682-4334-a2e1-0641c7cbd89c for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:33:30.256493 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9bd29f08-80a1-47c8-ae46-ab209b029673 req-94acd0f3-ecbb-49af-a6b0-4bf9dcc49305 service nova] Creating event network-vif-unplugged:5181d6ac-4b81-40aa-b0f8-6206c7cc13b0 for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:33:30.259466 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9bd29f08-80a1-47c8-ae46-ab209b029673 req-94acd0f3-ecbb-49af-a6b0-4bf9dcc49305 service nova] Creating event network-vif-unplugged:a31c0a5e-56a2-4356-95b1-8a55b29d3c84 for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:33:30.281727 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-9bd29f08-80a1-47c8-ae46-ab209b029673 req-94acd0f3-ecbb-49af-a6b0-4bf9dcc49305 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.117565 Jul 20 04:33:30.282358 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1998/3762] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:30.303174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d2e985d8-3bc2-46e1-ac25-df27515c8167 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:30.328151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d2e985d8-3bc2-46e1-ac25-df27515c8167 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:30.347057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2e985d8-3bc2-46e1-ac25-df27515c8167 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:30.348755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2e985d8-3bc2-46e1-ac25-df27515c8167 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:30.352806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2e985d8-3bc2-46e1-ac25-df27515c8167 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:30.361605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2e985d8-3bc2-46e1-ac25-df27515c8167 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:30.974354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d2e985d8-3bc2-46e1-ac25-df27515c8167 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:30.990232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d2e985d8-3bc2-46e1-ac25-df27515c8167 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:30.993006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d2e985d8-3bc2-46e1-ac25-df27515c8167 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:30.996607 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d2e985d8-3bc2-46e1-ac25-df27515c8167 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 2905 microversion: 2.32 time: 0.708018 Jul 20 04:33:30.997366 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 1999/3763] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:30 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 2905 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:31.004295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2aae8c25-d1ab-4111-946d-d3323d888f34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:31.004917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2aae8c25-d1ab-4111-946d-d3323d888f34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:31.029968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2aae8c25-d1ab-4111-946d-d3323d888f34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:31.032595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2aae8c25-d1ab-4111-946d-d3323d888f34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:31.035717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2aae8c25-d1ab-4111-946d-d3323d888f34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:31.036368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2aae8c25-d1ab-4111-946d-d3323d888f34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:31.085184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-775868e4-abc5-46b7-a115-8b2bd2c7117c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:33:31.087311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-775868e4-abc5-46b7-a115-8b2bd2c7117c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:33:31.088070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-775868e4-abc5-46b7-a115-8b2bd2c7117c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:33:31.088789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-775868e4-abc5-46b7-a115-8b2bd2c7117c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:33:31.089612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-775868e4-abc5-46b7-a115-8b2bd2c7117c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:33:31.122809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-775868e4-abc5-46b7-a115-8b2bd2c7117c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:31.123824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-775868e4-abc5-46b7-a115-8b2bd2c7117c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:31.125148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-775868e4-abc5-46b7-a115-8b2bd2c7117c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:31.127186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-775868e4-abc5-46b7-a115-8b2bd2c7117c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:31.181420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-775868e4-abc5-46b7-a115-8b2bd2c7117c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Getting quotas for project 9ec608ff77894cd7b35ce5dbdffcd775. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:33:31.214987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-775868e4-abc5-46b7-a115-8b2bd2c7117c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Getting quotas for user d2cd39643e804592be29c8bf6552f1dc and project 9ec608ff77894cd7b35ce5dbdffcd775. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:33:31.243051 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-775868e4-abc5-46b7-a115-8b2bd2c7117c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:33:31.248465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-775868e4-abc5-46b7-a115-8b2bd2c7117c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:33:31.360972 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-775868e4-abc5-46b7-a115-8b2bd2c7117c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.823065 Jul 20 04:33:31.362424 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1765/3764] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:33:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:33:31.382025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-41291f80-fb15-4201-bfbd-cc67d00b16b3 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:31.384364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-41291f80-fb15-4201-bfbd-cc67d00b16b3 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:31.567659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-41291f80-fb15-4201-bfbd-cc67d00b16b3 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:31.604111 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-41291f80-fb15-4201-bfbd-cc67d00b16b3 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 200 len: 1219 microversion: 2.1 time: 0.234140 Jul 20 04:33:31.611028 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1766/3765] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:31 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 1219 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:31.689276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2aae8c25-d1ab-4111-946d-d3323d888f34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:31.701652 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2aae8c25-d1ab-4111-946d-d3323d888f34 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1499 microversion: 2.1 time: 0.702268 Jul 20 04:33:31.703628 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2000/3766] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:30 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1499 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:31.729480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-73c43461-9749-46e7-a91c-e62bfbbb5955 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:31.730418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-73c43461-9749-46e7-a91c-e62bfbbb5955 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:31.743070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c43461-9749-46e7-a91c-e62bfbbb5955 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:31.747764 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c43461-9749-46e7-a91c-e62bfbbb5955 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:31.753463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c43461-9749-46e7-a91c-e62bfbbb5955 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:31.753991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c43461-9749-46e7-a91c-e62bfbbb5955 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:31.899594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-73c43461-9749-46e7-a91c-e62bfbbb5955 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:33:32.022237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-069de143-4a34-4356-9c01-7e7117227b5f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:32.023710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-069de143-4a34-4356-9c01-7e7117227b5f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:32.031430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:32.035378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-069de143-4a34-4356-9c01-7e7117227b5f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:32.036419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-069de143-4a34-4356-9c01-7e7117227b5f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:32.038264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-069de143-4a34-4356-9c01-7e7117227b5f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:32.039305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-069de143-4a34-4356-9c01-7e7117227b5f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:32.201150 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-73c43461-9749-46e7-a91c-e62bfbbb5955 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "DELETE /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 204 len: 0 microversion: 2.1 time: 0.477424 Jul 20 04:33:32.209935 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1767/3767] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:33:31 2022] DELETE /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:33:32.242820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-de382158-095d-4154-8544-90705fb9c9b8 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:32.244371 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-de382158-095d-4154-8544-90705fb9c9b8 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:32.274058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de382158-095d-4154-8544-90705fb9c9b8 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:32.275085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de382158-095d-4154-8544-90705fb9c9b8 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:32.282116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de382158-095d-4154-8544-90705fb9c9b8 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:32.283261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de382158-095d-4154-8544-90705fb9c9b8 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:32.873129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-de382158-095d-4154-8544-90705fb9c9b8 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:32.924218 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-de382158-095d-4154-8544-90705fb9c9b8 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1505 microversion: 2.1 time: 0.707884 Jul 20 04:33:32.937266 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1768/3768] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:32 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1505 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:32.961097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-65b3ba63-2855-45f4-b7de-ff2ba4de7b58 req-a5a42b30-f783-4938-8cb2-36a6b57b7aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "name": "network-vif-deleted", "tag": "76dffb6b-943c-49a9-abbd-14d1036220db"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:32.981814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-069de143-4a34-4356-9c01-7e7117227b5f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:32.993264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-069de143-4a34-4356-9c01-7e7117227b5f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:33.011336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-069de143-4a34-4356-9c01-7e7117227b5f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:33.019300 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-069de143-4a34-4356-9c01-7e7117227b5f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 2860 microversion: 2.32 time: 0.998105 Jul 20 04:33:33.019979 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2001/3769] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:32 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 2860 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:33.023176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-65b3ba63-2855-45f4-b7de-ff2ba4de7b58 req-a5a42b30-f783-4938-8cb2-36a6b57b7aef service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:33.023942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-65b3ba63-2855-45f4-b7de-ff2ba4de7b58 req-a5a42b30-f783-4938-8cb2-36a6b57b7aef service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:33.031136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-1ff9eb97-8177-4c17-a9a4-dedfc8e3fa06 req-03407e0f-62ea-444f-8852-a6d89979b48c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "name": "network-vif-unplugged", "status": "completed", "tag": "3d36c00c-1614-411a-9eac-9454a83272e6"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:33.063353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:33.074375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1ff9eb97-8177-4c17-a9a4-dedfc8e3fa06 req-03407e0f-62ea-444f-8852-a6d89979b48c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:33.074910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1ff9eb97-8177-4c17-a9a4-dedfc8e3fa06 req-03407e0f-62ea-444f-8852-a6d89979b48c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:33.086325 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-65b3ba63-2855-45f4-b7de-ff2ba4de7b58 req-a5a42b30-f783-4938-8cb2-36a6b57b7aef service nova] Creating event network-vif-deleted:76dffb6b-943c-49a9-abbd-14d1036220db for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:33:33.098259 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-65b3ba63-2855-45f4-b7de-ff2ba4de7b58 req-a5a42b30-f783-4938-8cb2-36a6b57b7aef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158834 Jul 20 04:33:33.105197 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1769/3770] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:33.119082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7deea506-0936-4cb7-9a4d-d6d9eeea4d63 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:33.121336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7deea506-0936-4cb7-9a4d-d6d9eeea4d63 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:33.141510 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-1ff9eb97-8177-4c17-a9a4-dedfc8e3fa06 req-03407e0f-62ea-444f-8852-a6d89979b48c service nova] Creating event network-vif-unplugged:3d36c00c-1614-411a-9eac-9454a83272e6 for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:33:33.148219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7deea506-0936-4cb7-9a4d-d6d9eeea4d63 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:33.149659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7deea506-0936-4cb7-9a4d-d6d9eeea4d63 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:33.151052 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7deea506-0936-4cb7-9a4d-d6d9eeea4d63 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:33.151854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7deea506-0936-4cb7-9a4d-d6d9eeea4d63 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:33.156044 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-1ff9eb97-8177-4c17-a9a4-dedfc8e3fa06 req-03407e0f-62ea-444f-8852-a6d89979b48c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128291 Jul 20 04:33:33.157023 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2002/3771] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:33.459467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7deea506-0936-4cb7-9a4d-d6d9eeea4d63 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:33.471583 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7deea506-0936-4cb7-9a4d-d6d9eeea4d63 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 200 len: 1215 microversion: 2.1 time: 0.363472 Jul 20 04:33:33.491820 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1770/3772] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:33 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 1215 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:33.947311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8fee362a-a6f4-4d30-b720-782cdcae4219 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:33.948794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8fee362a-a6f4-4d30-b720-782cdcae4219 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:33.974879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fee362a-a6f4-4d30-b720-782cdcae4219 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:33.981283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fee362a-a6f4-4d30-b720-782cdcae4219 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:33.994175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fee362a-a6f4-4d30-b720-782cdcae4219 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:33.994952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fee362a-a6f4-4d30-b720-782cdcae4219 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:34.016339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:34.039093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-76b22b23-d333-4f60-9563-2e75041c8f16 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:34.040114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-76b22b23-d333-4f60-9563-2e75041c8f16 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:34.051029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76b22b23-d333-4f60-9563-2e75041c8f16 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:34.055647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76b22b23-d333-4f60-9563-2e75041c8f16 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:34.056934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76b22b23-d333-4f60-9563-2e75041c8f16 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:34.057564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76b22b23-d333-4f60-9563-2e75041c8f16 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:34.323382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8fee362a-a6f4-4d30-b720-782cdcae4219 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:34.345399 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8fee362a-a6f4-4d30-b720-782cdcae4219 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1505 microversion: 2.1 time: 0.401540 Jul 20 04:33:34.347525 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2003/3773] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:33 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:34.504529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d3c40796-f491-4607-892b-1b5dff03e9e7 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:34.506282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d3c40796-f491-4607-892b-1b5dff03e9e7 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:34.538398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3c40796-f491-4607-892b-1b5dff03e9e7 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:34.539120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3c40796-f491-4607-892b-1b5dff03e9e7 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:34.540089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3c40796-f491-4607-892b-1b5dff03e9e7 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:34.540662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3c40796-f491-4607-892b-1b5dff03e9e7 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:34.735996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d3c40796-f491-4607-892b-1b5dff03e9e7 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:34.747618 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d3c40796-f491-4607-892b-1b5dff03e9e7 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 200 len: 1277 microversion: 2.1 time: 0.250996 Jul 20 04:33:34.749401 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2004/3774] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:34 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:35.366187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0855e89f-d406-4b92-98b0-e81daa01389a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:35.368789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0855e89f-d406-4b92-98b0-e81daa01389a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:35.396019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0855e89f-d406-4b92-98b0-e81daa01389a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:35.398198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0855e89f-d406-4b92-98b0-e81daa01389a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:35.401450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0855e89f-d406-4b92-98b0-e81daa01389a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:35.402193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0855e89f-d406-4b92-98b0-e81daa01389a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:35.778504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-76b22b23-d333-4f60-9563-2e75041c8f16 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:35.791711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-76b22b23-d333-4f60-9563-2e75041c8f16 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:35.801348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-76b22b23-d333-4f60-9563-2e75041c8f16 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:35.802924 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-76b22b23-d333-4f60-9563-2e75041c8f16 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 2860 microversion: 2.32 time: 1.767913 Jul 20 04:33:35.806242 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1771/3775] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:34 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 2860 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:33:35.813676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7cb8877d-0cec-4111-89bd-ca10d5be17f2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:35.814915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7cb8877d-0cec-4111-89bd-ca10d5be17f2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:35.821265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0855e89f-d406-4b92-98b0-e81daa01389a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:35.833756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7cb8877d-0cec-4111-89bd-ca10d5be17f2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:35.836720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7cb8877d-0cec-4111-89bd-ca10d5be17f2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:35.837819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7cb8877d-0cec-4111-89bd-ca10d5be17f2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:35.838538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7cb8877d-0cec-4111-89bd-ca10d5be17f2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:35.847051 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0855e89f-d406-4b92-98b0-e81daa01389a tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 200 len: 1463 microversion: 2.1 time: 0.484970 Jul 20 04:33:35.851255 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2005/3776] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:35 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 1463 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:36.122791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7cb8877d-0cec-4111-89bd-ca10d5be17f2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:36.125177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-81bd3280-920e-4da4-a736-7366bce62aca req-bc0b4942-a901-44d1-83b0-b245a67ff6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19855b43-dd90-497e-a6b4-57b18b4833a3", "name": "network-vif-deleted", "tag": "33987e6a-19b7-4f7d-923f-c402b445d43a"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:36.134476 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7cb8877d-0cec-4111-89bd-ca10d5be17f2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 200 len: 1277 microversion: 2.1 time: 0.326653 Jul 20 04:33:36.135808 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1772/3777] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:35 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 1277 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:36.175734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-81bd3280-920e-4da4-a736-7366bce62aca req-bc0b4942-a901-44d1-83b0-b245a67ff6a8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:36.176235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-81bd3280-920e-4da4-a736-7366bce62aca req-bc0b4942-a901-44d1-83b0-b245a67ff6a8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:36.231788 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-81bd3280-920e-4da4-a736-7366bce62aca req-bc0b4942-a901-44d1-83b0-b245a67ff6a8 service nova] Creating event network-vif-deleted:33987e6a-19b7-4f7d-923f-c402b445d43a for instance 19855b43-dd90-497e-a6b4-57b18b4833a3 on n-h2-826526-5 Jul 20 04:33:36.249466 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-81bd3280-920e-4da4-a736-7366bce62aca req-bc0b4942-a901-44d1-83b0-b245a67ff6a8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130386 Jul 20 04:33:36.261009 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2006/3778] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:33:36.825662 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3226ddac-cfd9-4b78-8c6e-df52f1606166 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:36.826394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3226ddac-cfd9-4b78-8c6e-df52f1606166 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:36.862476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3226ddac-cfd9-4b78-8c6e-df52f1606166 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:36.877471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b2d35c4f-9b0b-4dc9-853e-4eacf3a41ace tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:36.878387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b2d35c4f-9b0b-4dc9-853e-4eacf3a41ace tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: 19855b43-dd90-497e-a6b4-57b18b4833a3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:36.882707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3226ddac-cfd9-4b78-8c6e-df52f1606166 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:36.891848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3226ddac-cfd9-4b78-8c6e-df52f1606166 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:36.894583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3226ddac-cfd9-4b78-8c6e-df52f1606166 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:36.915456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b2d35c4f-9b0b-4dc9-853e-4eacf3a41ace tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:36.915925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b2d35c4f-9b0b-4dc9-853e-4eacf3a41ace tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:36.923629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b2d35c4f-9b0b-4dc9-853e-4eacf3a41ace tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:36.924289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b2d35c4f-9b0b-4dc9-853e-4eacf3a41ace tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:36.949677 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-b2d35c4f-9b0b-4dc9-853e-4eacf3a41ace tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] HTTP exception thrown: Instance 19855b43-dd90-497e-a6b4-57b18b4833a3 could not be found. Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b2d35c4f-9b0b-4dc9-853e-4eacf3a41ace tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Request method failure captured: Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 HTTP/1.1 Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14UvPPNSLi_M-xoxEO4IIjvkD-vZtli1BF_7YdTVVacb2Oog0PnUuy3HpHpy40-W9kZlragCq2lfKXPGzmJ8YWlsaoiXviTexfTv_Vl55YsC6TW8sc6RxbNDmSPqLXlvOxBSeXuUVlVnqvobkHa54LhsD0kWb82530yrd-mgaySxgRo Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: d1e98a37424940769eebbb38c1af937f Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerRescueTestJSON-1198080738 Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d1e98a37424940769eebbb38c1af937f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d1e98a37424940769eebbb38c1af937f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d1e98a37424940769eebbb38c1af937f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d1e98a37424940769eebbb38c1af937f"}]}] Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerRescueTestJSON-1198080738 Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: d1e98a37424940769eebbb38c1af937f Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerRescueTestJSON-1198080738 Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerRescueTestJSON-1198080738-project Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: bdc18c445e334a60a66a3f20b37ace48 Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerRescueTestJSON-1198080738-project Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 19855b43-dd90-497e-a6b4-57b18b4833a3 could not be found. Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '19855b43-dd90-497e-a6b4-57b18b4833a3'} Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19855b43-dd90-497e-a6b4-57b18b4833a3 could not be found. Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19855b43-dd90-497e-a6b4-57b18b4833a3 could not be found. Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:36.952098 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:33:36.958457 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:36.958457 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:36.958457 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:36.958457 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:33:36.958457 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:33:36.958457 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19855b43-dd90-497e-a6b4-57b18b4833a3 could not be found. Jul 20 04:33:36.958457 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:33:36.961034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b2d35c4f-9b0b-4dc9-853e-4eacf3a41ace tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Returning 404 to user: Instance 19855b43-dd90-497e-a6b4-57b18b4833a3 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:33:36.962225 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b2d35c4f-9b0b-4dc9-853e-4eacf3a41ace tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3" status: 404 len: 111 microversion: 2.1 time: 0.093520 Jul 20 04:33:36.963502 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2007/3779] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:36 2022] GET /compute/v2.1/servers/19855b43-dd90-497e-a6b4-57b18b4833a3 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:33:36.977280 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-972e2e25-b8ce-4e26-81ee-7238cd911400 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:36.978675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-972e2e25-b8ce-4e26-81ee-7238cd911400 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:36.987518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-972e2e25-b8ce-4e26-81ee-7238cd911400 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:36.988505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-972e2e25-b8ce-4e26-81ee-7238cd911400 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:36.989601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-972e2e25-b8ce-4e26-81ee-7238cd911400 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:36.990458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-972e2e25-b8ce-4e26-81ee-7238cd911400 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:37.029424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-972e2e25-b8ce-4e26-81ee-7238cd911400 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:33:37.157838 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-972e2e25-b8ce-4e26-81ee-7238cd911400 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 204 len: 0 microversion: 2.1 time: 0.189041 Jul 20 04:33:37.159275 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2008/3780] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:33:36 2022] DELETE /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:33:37.170935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-87aa5cc2-da18-4121-a981-6f4c8f73923f tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:37.172204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-87aa5cc2-da18-4121-a981-6f4c8f73923f tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:37.179003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-87aa5cc2-da18-4121-a981-6f4c8f73923f tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:37.179520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-87aa5cc2-da18-4121-a981-6f4c8f73923f tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:37.180365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-87aa5cc2-da18-4121-a981-6f4c8f73923f tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:37.180835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-87aa5cc2-da18-4121-a981-6f4c8f73923f tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:37.322632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-87aa5cc2-da18-4121-a981-6f4c8f73923f tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:37.346097 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-87aa5cc2-da18-4121-a981-6f4c8f73923f tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 200 len: 1277 microversion: 2.1 time: 0.184647 Jul 20 04:33:37.348331 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2009/3781] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:37 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:37.356588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-445069c5-d246-4a8f-a3ee-d046e106fca3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:37.357527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-445069c5-d246-4a8f-a3ee-d046e106fca3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:37.370532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-445069c5-d246-4a8f-a3ee-d046e106fca3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:37.372130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-445069c5-d246-4a8f-a3ee-d046e106fca3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:37.374553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-445069c5-d246-4a8f-a3ee-d046e106fca3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:37.375238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-445069c5-d246-4a8f-a3ee-d046e106fca3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:37.588638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3226ddac-cfd9-4b78-8c6e-df52f1606166 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:37.602818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3226ddac-cfd9-4b78-8c6e-df52f1606166 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:37.616395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3226ddac-cfd9-4b78-8c6e-df52f1606166 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:37.618756 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3226ddac-cfd9-4b78-8c6e-df52f1606166 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 2574 microversion: 2.32 time: 0.798697 Jul 20 04:33:37.620367 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1773/3782] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:36 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 2574 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:33:37.646048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-445069c5-d246-4a8f-a3ee-d046e106fca3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:37.669311 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-445069c5-d246-4a8f-a3ee-d046e106fca3 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1492 microversion: 2.1 time: 0.319033 Jul 20 04:33:37.669943 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2010/3783] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:37 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1492 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:37.945240 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f0f0490c-967a-4a37-92f2-5a7e66025de1 req-8c1b16a3-b8ab-4998-805f-6ffbad225931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "name": "network-vif-deleted", "tag": "a31c0a5e-56a2-4356-95b1-8a55b29d3c84"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:37.967209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f0f0490c-967a-4a37-92f2-5a7e66025de1 req-8c1b16a3-b8ab-4998-805f-6ffbad225931 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:37.969089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f0f0490c-967a-4a37-92f2-5a7e66025de1 req-8c1b16a3-b8ab-4998-805f-6ffbad225931 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:37.992792 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f0f0490c-967a-4a37-92f2-5a7e66025de1 req-8c1b16a3-b8ab-4998-805f-6ffbad225931 service nova] Creating event network-vif-deleted:a31c0a5e-56a2-4356-95b1-8a55b29d3c84 for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:33:38.000762 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f0f0490c-967a-4a37-92f2-5a7e66025de1 req-8c1b16a3-b8ab-4998-805f-6ffbad225931 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062147 Jul 20 04:33:38.002082 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1774/3784] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:38.373109 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-84f9fc2d-8531-42c0-a7d7-b4a029d179ae tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:38.373958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-84f9fc2d-8531-42c0-a7d7-b4a029d179ae tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:38.399487 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84f9fc2d-8531-42c0-a7d7-b4a029d179ae tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.399951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84f9fc2d-8531-42c0-a7d7-b4a029d179ae tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.400792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84f9fc2d-8531-42c0-a7d7-b4a029d179ae tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.401218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84f9fc2d-8531-42c0-a7d7-b4a029d179ae tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.640535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2043f50d-cc10-4faa-bcdf-1e7445f71434 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:38.641609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2043f50d-cc10-4faa-bcdf-1e7445f71434 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:38.675456 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2043f50d-cc10-4faa-bcdf-1e7445f71434 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.675881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2043f50d-cc10-4faa-bcdf-1e7445f71434 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.703959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2043f50d-cc10-4faa-bcdf-1e7445f71434 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.710397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2043f50d-cc10-4faa-bcdf-1e7445f71434 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.804969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-84f9fc2d-8531-42c0-a7d7-b4a029d179ae tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:38.813609 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-84f9fc2d-8531-42c0-a7d7-b4a029d179ae tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 200 len: 1319 microversion: 2.1 time: 0.444278 Jul 20 04:33:38.819215 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2011/3785] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:38 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 1319 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:38.830113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-969079b2-8782-4735-8a29-30facad1f200 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:38.833005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-969079b2-8782-4735-8a29-30facad1f200 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:38.849645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-969079b2-8782-4735-8a29-30facad1f200 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.850101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-969079b2-8782-4735-8a29-30facad1f200 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.852419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-969079b2-8782-4735-8a29-30facad1f200 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.853890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-969079b2-8782-4735-8a29-30facad1f200 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:39.079858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-969079b2-8782-4735-8a29-30facad1f200 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:39.091205 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-969079b2-8782-4735-8a29-30facad1f200 tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1492 microversion: 2.1 time: 0.270332 Jul 20 04:33:39.091979 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2012/3786] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:38 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1492 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:39.286152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2043f50d-cc10-4faa-bcdf-1e7445f71434 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:39.329576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2043f50d-cc10-4faa-bcdf-1e7445f71434 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:39.334908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2043f50d-cc10-4faa-bcdf-1e7445f71434 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:39.337905 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2043f50d-cc10-4faa-bcdf-1e7445f71434 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 2415 microversion: 2.32 time: 0.700623 Jul 20 04:33:39.340911 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1775/3787] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:38 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 2415 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:39.843308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8f355ae1-c1bf-4b7c-9bdb-012ceb39151d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:39.844583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8f355ae1-c1bf-4b7c-9bdb-012ceb39151d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:39.856139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f355ae1-c1bf-4b7c-9bdb-012ceb39151d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:39.861026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f355ae1-c1bf-4b7c-9bdb-012ceb39151d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:39.866031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f355ae1-c1bf-4b7c-9bdb-012ceb39151d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:39.866785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f355ae1-c1bf-4b7c-9bdb-012ceb39151d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:40.110951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-81556556-07cb-4350-ae45-27ea0f64228c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:40.111711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-81556556-07cb-4350-ae45-27ea0f64228c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:40.134651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81556556-07cb-4350-ae45-27ea0f64228c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:40.135752 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81556556-07cb-4350-ae45-27ea0f64228c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:40.136723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81556556-07cb-4350-ae45-27ea0f64228c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:40.137272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81556556-07cb-4350-ae45-27ea0f64228c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:40.489389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8f355ae1-c1bf-4b7c-9bdb-012ceb39151d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:40.561126 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8f355ae1-c1bf-4b7c-9bdb-012ceb39151d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 200 len: 1319 microversion: 2.1 time: 0.701927 Jul 20 04:33:40.578064 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2013/3788] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:39 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 1319 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:40.595405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5706e703-71b3-40f8-9349-38fcb263496f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:40.598871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5706e703-71b3-40f8-9349-38fcb263496f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:40.660564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5706e703-71b3-40f8-9349-38fcb263496f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:40.672753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5706e703-71b3-40f8-9349-38fcb263496f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:40.674252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5706e703-71b3-40f8-9349-38fcb263496f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:40.676916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5706e703-71b3-40f8-9349-38fcb263496f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:40.886421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-81556556-07cb-4350-ae45-27ea0f64228c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18c445e334a60a66a3f20b37ace48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e98a37424940769eebbb38c1af937f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:40.923045 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-81556556-07cb-4350-ae45-27ea0f64228c tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 200 len: 1450 microversion: 2.1 time: 0.817217 Jul 20 04:33:40.926683 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1776/3789] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:40 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 1450 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:40.984525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-91675fab-d75c-49a2-beb8-d6df5370623e req-914e07bf-4817-47b6-ac68-08e280fe1d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2594c4f-6103-4c9d-979f-3640a04aa4ff", "name": "network-vif-deleted", "tag": "676e2415-ffca-452e-9e59-41a2ecb711ce"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:41.008367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-91675fab-d75c-49a2-beb8-d6df5370623e req-914e07bf-4817-47b6-ac68-08e280fe1d5f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:41.008859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-91675fab-d75c-49a2-beb8-d6df5370623e req-914e07bf-4817-47b6-ac68-08e280fe1d5f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:41.038241 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-91675fab-d75c-49a2-beb8-d6df5370623e req-914e07bf-4817-47b6-ac68-08e280fe1d5f service nova] Creating event network-vif-deleted:676e2415-ffca-452e-9e59-41a2ecb711ce for instance b2594c4f-6103-4c9d-979f-3640a04aa4ff on n-h1-826526-5 Jul 20 04:33:41.055738 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-91675fab-d75c-49a2-beb8-d6df5370623e req-914e07bf-4817-47b6-ac68-08e280fe1d5f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122848 Jul 20 04:33:41.057730 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1777/3790] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:41.429039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-fc988e65-b15e-4eda-a562-14eda7b3b1b3 req-6f37996f-6933-4ff4-824b-7f5f2657947e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "name": "network-vif-deleted", "tag": "5181d6ac-4b81-40aa-b0f8-6206c7cc13b0"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:41.457720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:41.491609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-fc988e65-b15e-4eda-a562-14eda7b3b1b3 req-6f37996f-6933-4ff4-824b-7f5f2657947e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:41.497878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-fc988e65-b15e-4eda-a562-14eda7b3b1b3 req-6f37996f-6933-4ff4-824b-7f5f2657947e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:41.518073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5706e703-71b3-40f8-9349-38fcb263496f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:41.541687 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-fc988e65-b15e-4eda-a562-14eda7b3b1b3 req-6f37996f-6933-4ff4-824b-7f5f2657947e service nova] Creating event network-vif-deleted:5181d6ac-4b81-40aa-b0f8-6206c7cc13b0 for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:33:41.552964 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-fc988e65-b15e-4eda-a562-14eda7b3b1b3 req-6f37996f-6933-4ff4-824b-7f5f2657947e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132752 Jul 20 04:33:41.554805 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1778/3791] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:33:41.559634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5706e703-71b3-40f8-9349-38fcb263496f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:41.567401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5706e703-71b3-40f8-9349-38fcb263496f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:41.575369 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5706e703-71b3-40f8-9349-38fcb263496f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 2370 microversion: 2.32 time: 0.993559 Jul 20 04:33:41.576806 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2014/3792] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:40 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 2370 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:41.612486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-feca2be7-7313-471a-98df-e7bd2c3bc056 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:41.642415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-feca2be7-7313-471a-98df-e7bd2c3bc056 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:41.688413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:41.691846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-feca2be7-7313-471a-98df-e7bd2c3bc056 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:41.692635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-feca2be7-7313-471a-98df-e7bd2c3bc056 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:41.693923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-feca2be7-7313-471a-98df-e7bd2c3bc056 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:41.694657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-feca2be7-7313-471a-98df-e7bd2c3bc056 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:41.946882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-847ee38c-5c4e-4012-8452-ec337497f92d tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:41.948025 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-847ee38c-5c4e-4012-8452-ec337497f92d tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] [instance: b2594c4f-6103-4c9d-979f-3640a04aa4ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:41.962066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-847ee38c-5c4e-4012-8452-ec337497f92d tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:41.963233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-847ee38c-5c4e-4012-8452-ec337497f92d tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:41.966921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-847ee38c-5c4e-4012-8452-ec337497f92d tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:41.968032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-847ee38c-5c4e-4012-8452-ec337497f92d tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:41.998356 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-847ee38c-5c4e-4012-8452-ec337497f92d tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] HTTP exception thrown: Instance b2594c4f-6103-4c9d-979f-3640a04aa4ff could not be found. Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-847ee38c-5c4e-4012-8452-ec337497f92d tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Request method failure captured: Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff HTTP/1.1 Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14UvPPNSLi_M-xoxEO4IIjvkD-vZtli1BF_7YdTVVacb2Oog0PnUuy3HpHpy40-W9kZlragCq2lfKXPGzmJ8YWlsaoiXviTexfTv_Vl55YsC6TW8sc6RxbNDmSPqLXlvOxBSeXuUVlVnqvobkHa54LhsD0kWb82530yrd-mgaySxgRo Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: d1e98a37424940769eebbb38c1af937f Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerRescueTestJSON-1198080738 Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d1e98a37424940769eebbb38c1af937f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d1e98a37424940769eebbb38c1af937f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d1e98a37424940769eebbb38c1af937f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d1e98a37424940769eebbb38c1af937f"}]}] Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerRescueTestJSON-1198080738 Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: d1e98a37424940769eebbb38c1af937f Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerRescueTestJSON-1198080738 Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerRescueTestJSON-1198080738-project Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: bdc18c445e334a60a66a3f20b37ace48 Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerRescueTestJSON-1198080738-project Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance b2594c4f-6103-4c9d-979f-3640a04aa4ff could not be found. Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'b2594c4f-6103-4c9d-979f-3640a04aa4ff'} Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2594c4f-6103-4c9d-979f-3640a04aa4ff could not be found. Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2594c4f-6103-4c9d-979f-3640a04aa4ff could not be found. Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:42.000441 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:33:42.009040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:42.009040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:42.009040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:42.009040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:33:42.009040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:33:42.009040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2594c4f-6103-4c9d-979f-3640a04aa4ff could not be found. Jul 20 04:33:42.009040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:33:42.009040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-847ee38c-5c4e-4012-8452-ec337497f92d tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] Returning 404 to user: Instance b2594c4f-6103-4c9d-979f-3640a04aa4ff could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:33:42.009040 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-847ee38c-5c4e-4012-8452-ec337497f92d tempest-ServerRescueTestJSON-1198080738 tempest-ServerRescueTestJSON-1198080738-project] 10.222.0.17 "GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff" status: 404 len: 111 microversion: 2.1 time: 0.063674 Jul 20 04:33:42.013082 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2015/3793] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:41 2022] GET /compute/v2.1/servers/b2594c4f-6103-4c9d-979f-3640a04aa4ff => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:33:42.628071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2d38e866-7464-4eea-91cb-c19f9ee12c4e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:42.629509 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2d38e866-7464-4eea-91cb-c19f9ee12c4e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:42.638040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d38e866-7464-4eea-91cb-c19f9ee12c4e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:42.639671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d38e866-7464-4eea-91cb-c19f9ee12c4e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:42.641481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d38e866-7464-4eea-91cb-c19f9ee12c4e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:42.642313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d38e866-7464-4eea-91cb-c19f9ee12c4e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:42.985054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-feca2be7-7313-471a-98df-e7bd2c3bc056 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:42.999024 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-feca2be7-7313-471a-98df-e7bd2c3bc056 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 200 len: 1319 microversion: 2.1 time: 1.395191 Jul 20 04:33:43.001345 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1779/3794] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:41 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 1319 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:43.449628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2d38e866-7464-4eea-91cb-c19f9ee12c4e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:43.466404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2d38e866-7464-4eea-91cb-c19f9ee12c4e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:43.472178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2d38e866-7464-4eea-91cb-c19f9ee12c4e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:43.473541 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2d38e866-7464-4eea-91cb-c19f9ee12c4e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 2257 microversion: 2.32 time: 0.850957 Jul 20 04:33:43.491449 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2016/3795] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:42 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 2257 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:43.636754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-9c9297b2-994d-459d-8c1c-efbe811c1eef req-d9825c13-6e68-4754-a21d-467e1a68a41f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f506656-eef4-4b57-9559-0471bed3136e", "tag": "9d9ea71b-b365-4f8e-912e-6aa5c5eaeb26"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:43.660629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-9c9297b2-994d-459d-8c1c-efbe811c1eef req-d9825c13-6e68-4754-a21d-467e1a68a41f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:43.661385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-9c9297b2-994d-459d-8c1c-efbe811c1eef req-d9825c13-6e68-4754-a21d-467e1a68a41f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:43.697941 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-9c9297b2-994d-459d-8c1c-efbe811c1eef req-d9825c13-6e68-4754-a21d-467e1a68a41f service nova] Creating event network-changed:9d9ea71b-b365-4f8e-912e-6aa5c5eaeb26 for instance 5f506656-eef4-4b57-9559-0471bed3136e on n-h1-826526-5 Jul 20 04:33:43.713002 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-9c9297b2-994d-459d-8c1c-efbe811c1eef req-d9825c13-6e68-4754-a21d-467e1a68a41f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080960 Jul 20 04:33:43.715266 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1780/3796] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:44.036471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-682013cb-4e41-45d2-b5b0-986905700cf9 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:44.042763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-682013cb-4e41-45d2-b5b0-986905700cf9 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:44.064727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-682013cb-4e41-45d2-b5b0-986905700cf9 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:44.065834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-682013cb-4e41-45d2-b5b0-986905700cf9 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:44.070828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-682013cb-4e41-45d2-b5b0-986905700cf9 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:44.072005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-682013cb-4e41-45d2-b5b0-986905700cf9 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:44.452633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-682013cb-4e41-45d2-b5b0-986905700cf9 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:44.468215 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-682013cb-4e41-45d2-b5b0-986905700cf9 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 200 len: 1319 microversion: 2.1 time: 0.441339 Jul 20 04:33:44.469316 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2017/3797] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:44 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:44.501459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-08aa1875-c6fc-49db-b0e9-27f27eb8b78c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:44.502376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-08aa1875-c6fc-49db-b0e9-27f27eb8b78c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:44.519674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08aa1875-c6fc-49db-b0e9-27f27eb8b78c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:44.520173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08aa1875-c6fc-49db-b0e9-27f27eb8b78c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:44.524186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08aa1875-c6fc-49db-b0e9-27f27eb8b78c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:44.524680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08aa1875-c6fc-49db-b0e9-27f27eb8b78c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:45.502705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fa63cc0c-6f10-44af-8029-67bafabc61eb tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:45.507177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fa63cc0c-6f10-44af-8029-67bafabc61eb tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:45.525842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa63cc0c-6f10-44af-8029-67bafabc61eb tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:45.529763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa63cc0c-6f10-44af-8029-67bafabc61eb tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:45.532817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa63cc0c-6f10-44af-8029-67bafabc61eb tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:45.534763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa63cc0c-6f10-44af-8029-67bafabc61eb tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:45.605205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-08aa1875-c6fc-49db-b0e9-27f27eb8b78c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:45.662876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-08aa1875-c6fc-49db-b0e9-27f27eb8b78c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:45.675396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-08aa1875-c6fc-49db-b0e9-27f27eb8b78c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:45.678191 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-08aa1875-c6fc-49db-b0e9-27f27eb8b78c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 2212 microversion: 2.32 time: 1.182493 Jul 20 04:33:45.684955 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1781/3798] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:44 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 2212 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:45.960027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-c39e4627-5b45-4cd9-8d69-9fb1a5be2f2e req-5398da39-e541-42e4-9ce8-07421b85d304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "name": "network-vif-deleted", "tag": "3d36c00c-1614-411a-9eac-9454a83272e6"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:46.005025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c39e4627-5b45-4cd9-8d69-9fb1a5be2f2e req-5398da39-e541-42e4-9ce8-07421b85d304 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:46.007647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c39e4627-5b45-4cd9-8d69-9fb1a5be2f2e req-5398da39-e541-42e4-9ce8-07421b85d304 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:46.053836 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-c39e4627-5b45-4cd9-8d69-9fb1a5be2f2e req-5398da39-e541-42e4-9ce8-07421b85d304 service nova] Creating event network-vif-deleted:3d36c00c-1614-411a-9eac-9454a83272e6 for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:33:46.071849 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-c39e4627-5b45-4cd9-8d69-9fb1a5be2f2e req-5398da39-e541-42e4-9ce8-07421b85d304 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120565 Jul 20 04:33:46.072497 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1782/3799] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:33:46.090558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fa63cc0c-6f10-44af-8029-67bafabc61eb tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:46.104729 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fa63cc0c-6f10-44af-8029-67bafabc61eb tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 200 len: 1319 microversion: 2.1 time: 0.610053 Jul 20 04:33:46.117538 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2018/3800] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:45 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 1319 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:46.705227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5ac246d0-171e-45e7-8483-11ccb184067e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:46.705942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5ac246d0-171e-45e7-8483-11ccb184067e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:46.726064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ac246d0-171e-45e7-8483-11ccb184067e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:46.727983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ac246d0-171e-45e7-8483-11ccb184067e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:46.734362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ac246d0-171e-45e7-8483-11ccb184067e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:46.737963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ac246d0-171e-45e7-8483-11ccb184067e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:47.021173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5ac246d0-171e-45e7-8483-11ccb184067e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:47.061526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5ac246d0-171e-45e7-8483-11ccb184067e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:47.074824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5ac246d0-171e-45e7-8483-11ccb184067e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:47.079633 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5ac246d0-171e-45e7-8483-11ccb184067e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.378684 Jul 20 04:33:47.091083 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1783/3801] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:46 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:47.129660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-414f1e3b-b4ea-4275-8ab1-881803b77a9c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:47.131940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-414f1e3b-b4ea-4275-8ab1-881803b77a9c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:47.155260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-414f1e3b-b4ea-4275-8ab1-881803b77a9c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:47.156079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-414f1e3b-b4ea-4275-8ab1-881803b77a9c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:47.161868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-414f1e3b-b4ea-4275-8ab1-881803b77a9c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:47.163832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-414f1e3b-b4ea-4275-8ab1-881803b77a9c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:48.127177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-36f0d54c-7634-4347-a80e-f1641a066d8b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:48.133038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-36f0d54c-7634-4347-a80e-f1641a066d8b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:48.142707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36f0d54c-7634-4347-a80e-f1641a066d8b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:48.143432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36f0d54c-7634-4347-a80e-f1641a066d8b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:48.144443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36f0d54c-7634-4347-a80e-f1641a066d8b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:48.145237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36f0d54c-7634-4347-a80e-f1641a066d8b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:48.321723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-36f0d54c-7634-4347-a80e-f1641a066d8b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:48.358945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-36f0d54c-7634-4347-a80e-f1641a066d8b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:48.363307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-36f0d54c-7634-4347-a80e-f1641a066d8b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:48.374023 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-36f0d54c-7634-4347-a80e-f1641a066d8b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.255540 Jul 20 04:33:48.377115 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1784/3802] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:48 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:33:48.390098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-07f5c768-74f6-4f65-8486-5cd2e4db3555 req-7f0e65ed-b44a-42d7-b0c2-c438cea52b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af76412-dcc5-4a08-8492-910e244a4ede", "name": "network-vif-deleted", "tag": "8ef7c976-1682-4334-a2e1-0641c7cbd89c"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:48.407182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-414f1e3b-b4ea-4275-8ab1-881803b77a9c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:48.420125 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-414f1e3b-b4ea-4275-8ab1-881803b77a9c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 200 len: 1319 microversion: 2.1 time: 1.296740 Jul 20 04:33:48.425563 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2019/3803] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:47 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 1319 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:48.441386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-07f5c768-74f6-4f65-8486-5cd2e4db3555 req-7f0e65ed-b44a-42d7-b0c2-c438cea52b70 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:48.442208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-07f5c768-74f6-4f65-8486-5cd2e4db3555 req-7f0e65ed-b44a-42d7-b0c2-c438cea52b70 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:48.496494 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-07f5c768-74f6-4f65-8486-5cd2e4db3555 req-7f0e65ed-b44a-42d7-b0c2-c438cea52b70 service nova] Creating event network-vif-deleted:8ef7c976-1682-4334-a2e1-0641c7cbd89c for instance 0af76412-dcc5-4a08-8492-910e244a4ede on n-h2-826526-5 Jul 20 04:33:48.536076 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-07f5c768-74f6-4f65-8486-5cd2e4db3555 req-7f0e65ed-b44a-42d7-b0c2-c438cea52b70 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157187 Jul 20 04:33:48.542774 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1785/3804] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:49.408342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d7613a49-2f96-4b2b-a39c-68d9c7bf0ec0 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:49.409525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d7613a49-2f96-4b2b-a39c-68d9c7bf0ec0 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:49.450716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7d5f2578-de28-4a4b-be7a-609bf5b2bac4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:49.451584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7d5f2578-de28-4a4b-be7a-609bf5b2bac4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:49.466656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7613a49-2f96-4b2b-a39c-68d9c7bf0ec0 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.467417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7613a49-2f96-4b2b-a39c-68d9c7bf0ec0 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.473443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7613a49-2f96-4b2b-a39c-68d9c7bf0ec0 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.473898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7613a49-2f96-4b2b-a39c-68d9c7bf0ec0 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.482619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d5f2578-de28-4a4b-be7a-609bf5b2bac4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.500571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d5f2578-de28-4a4b-be7a-609bf5b2bac4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.501527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d5f2578-de28-4a4b-be7a-609bf5b2bac4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.501912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d5f2578-de28-4a4b-be7a-609bf5b2bac4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.596554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:49.825905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d7613a49-2f96-4b2b-a39c-68d9c7bf0ec0 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:49.835855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d7613a49-2f96-4b2b-a39c-68d9c7bf0ec0 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:49.837487 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d7613a49-2f96-4b2b-a39c-68d9c7bf0ec0 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:49.851719 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d7613a49-2f96-4b2b-a39c-68d9c7bf0ec0 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.447643 Jul 20 04:33:49.852759 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2020/3805] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:49 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:33:49.920936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-80b52d7e-083a-42cd-ab09-e91227b22a0e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:49.922121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-80b52d7e-083a-42cd-ab09-e91227b22a0e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:49.930194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-80b52d7e-083a-42cd-ab09-e91227b22a0e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.930649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-80b52d7e-083a-42cd-ab09-e91227b22a0e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.931446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-80b52d7e-083a-42cd-ab09-e91227b22a0e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.931883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-80b52d7e-083a-42cd-ab09-e91227b22a0e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:50.022975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7d5f2578-de28-4a4b-be7a-609bf5b2bac4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:50.050003 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7d5f2578-de28-4a4b-be7a-609bf5b2bac4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 200 len: 1319 microversion: 2.1 time: 0.604711 Jul 20 04:33:50.057677 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1786/3806] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:49 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 1319 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:50.600562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-80b52d7e-083a-42cd-ab09-e91227b22a0e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:50.620669 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-80b52d7e-083a-42cd-ab09-e91227b22a0e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.697004 Jul 20 04:33:50.625328 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2021/3807] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:49 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:50.655237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-342459d7-01af-4213-b789-12ff98d5e1b7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:50.670128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-342459d7-01af-4213-b789-12ff98d5e1b7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:50.703679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-342459d7-01af-4213-b789-12ff98d5e1b7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:50.709841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-342459d7-01af-4213-b789-12ff98d5e1b7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:50.719883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-342459d7-01af-4213-b789-12ff98d5e1b7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:50.724498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-342459d7-01af-4213-b789-12ff98d5e1b7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:50.884183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-52e4ac76-0dba-419e-ac09-45abcd896016 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:50.884888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-52e4ac76-0dba-419e-ac09-45abcd896016 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:50.915257 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52e4ac76-0dba-419e-ac09-45abcd896016 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:50.915723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52e4ac76-0dba-419e-ac09-45abcd896016 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:50.919057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52e4ac76-0dba-419e-ac09-45abcd896016 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:50.929529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52e4ac76-0dba-419e-ac09-45abcd896016 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:51.712571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-52e4ac76-0dba-419e-ac09-45abcd896016 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:51.727454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-52e4ac76-0dba-419e-ac09-45abcd896016 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:51.731974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-52e4ac76-0dba-419e-ac09-45abcd896016 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:51.742118 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-52e4ac76-0dba-419e-ac09-45abcd896016 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.864089 Jul 20 04:33:51.743541 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2022/3808] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:50 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:51.750719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-13b46443-1c4c-4bf9-9d05-70baa1868ce2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:51.763077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-13b46443-1c4c-4bf9-9d05-70baa1868ce2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:51.781108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13b46443-1c4c-4bf9-9d05-70baa1868ce2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:51.781561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13b46443-1c4c-4bf9-9d05-70baa1868ce2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:51.782380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13b46443-1c4c-4bf9-9d05-70baa1868ce2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:51.782822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13b46443-1c4c-4bf9-9d05-70baa1868ce2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:52.462703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-13b46443-1c4c-4bf9-9d05-70baa1868ce2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:52.472908 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-13b46443-1c4c-4bf9-9d05-70baa1868ce2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 200 len: 1319 microversion: 2.1 time: 0.727985 Jul 20 04:33:52.473915 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2023/3809] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:51 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 1319 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:52.538648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-342459d7-01af-4213-b789-12ff98d5e1b7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:52.553020 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-342459d7-01af-4213-b789-12ff98d5e1b7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 1.904463 Jul 20 04:33:52.553904 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1787/3810] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:50 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:52.572847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-198ca13a-bd1a-4457-9725-8c21883fb96d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:52.573728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-198ca13a-bd1a-4457-9725-8c21883fb96d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:52.588605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-198ca13a-bd1a-4457-9725-8c21883fb96d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:52.589163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-198ca13a-bd1a-4457-9725-8c21883fb96d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:52.590866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-198ca13a-bd1a-4457-9725-8c21883fb96d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:52.593461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-198ca13a-bd1a-4457-9725-8c21883fb96d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:52.770850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8559fabd-fe96-49d7-a50e-f5a2912d2d2d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:52.771715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8559fabd-fe96-49d7-a50e-f5a2912d2d2d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:52.790935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8559fabd-fe96-49d7-a50e-f5a2912d2d2d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:52.804575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8559fabd-fe96-49d7-a50e-f5a2912d2d2d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:52.807399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8559fabd-fe96-49d7-a50e-f5a2912d2d2d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:52.817937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8559fabd-fe96-49d7-a50e-f5a2912d2d2d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:53.060350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8559fabd-fe96-49d7-a50e-f5a2912d2d2d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:53.063534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:53.091202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8559fabd-fe96-49d7-a50e-f5a2912d2d2d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:53.101933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8559fabd-fe96-49d7-a50e-f5a2912d2d2d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:53.105340 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8559fabd-fe96-49d7-a50e-f5a2912d2d2d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.340242 Jul 20 04:33:53.120406 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1788/3811] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:52 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:53.402678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-198ca13a-bd1a-4457-9725-8c21883fb96d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:53.411510 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-198ca13a-bd1a-4457-9725-8c21883fb96d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.843713 Jul 20 04:33:53.412117 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2024/3812] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:52 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:53.431771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6198a6a9-3d09-4121-a4f9-cfd41cdee100 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-86066887"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:53.433004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6198a6a9-3d09-4121-a4f9-cfd41cdee100 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:53.445037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:53.448560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6198a6a9-3d09-4121-a4f9-cfd41cdee100 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:53.449567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6198a6a9-3d09-4121-a4f9-cfd41cdee100 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:53.450689 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6198a6a9-3d09-4121-a4f9-cfd41cdee100 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:53.451285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6198a6a9-3d09-4121-a4f9-cfd41cdee100 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:53.493424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7cab34bd-ca94-4108-971f-88e69a80bbb4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:53.497926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7cab34bd-ca94-4108-971f-88e69a80bbb4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:53.519921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7cab34bd-ca94-4108-971f-88e69a80bbb4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:53.529496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7cab34bd-ca94-4108-971f-88e69a80bbb4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:53.530776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7cab34bd-ca94-4108-971f-88e69a80bbb4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:53.531439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7cab34bd-ca94-4108-971f-88e69a80bbb4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:54.189203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7cab34bd-ca94-4108-971f-88e69a80bbb4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:54.217399 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7cab34bd-ca94-4108-971f-88e69a80bbb4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 200 len: 1319 microversion: 2.1 time: 0.726156 Jul 20 04:33:54.218794 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2025/3813] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:53 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 1319 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:54.256971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-04475c7b-18ef-4917-afb5-eb6c36c0d6f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:54.258036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-04475c7b-18ef-4917-afb5-eb6c36c0d6f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:54.284057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-04475c7b-18ef-4917-afb5-eb6c36c0d6f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:54.290491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-04475c7b-18ef-4917-afb5-eb6c36c0d6f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:54.291671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-04475c7b-18ef-4917-afb5-eb6c36c0d6f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:54.298973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-04475c7b-18ef-4917-afb5-eb6c36c0d6f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:54.348459 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6198a6a9-3d09-4121-a4f9-cfd41cdee100 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 202 len: 0 microversion: 2.1 time: 0.920894 Jul 20 04:33:54.373924 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1789/3814] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:33:53 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 0 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 20 04:33:54.715136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-24f2d08b-cd14-4d10-9c35-11e0dac7b7e2 req-82bc27e1-4c9c-47dc-911b-5ae5bd37d183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f506656-eef4-4b57-9559-0471bed3136e", "name": "network-vif-plugged", "status": "completed", "tag": "9d9ea71b-b365-4f8e-912e-6aa5c5eaeb26"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:54.746692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-04475c7b-18ef-4917-afb5-eb6c36c0d6f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:54.757565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-04475c7b-18ef-4917-afb5-eb6c36c0d6f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:54.759126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-04475c7b-18ef-4917-afb5-eb6c36c0d6f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:54.784115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-24f2d08b-cd14-4d10-9c35-11e0dac7b7e2 req-82bc27e1-4c9c-47dc-911b-5ae5bd37d183 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:54.788565 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-04475c7b-18ef-4917-afb5-eb6c36c0d6f2 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.564946 Jul 20 04:33:54.805073 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2026/3815] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:54 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:54.810709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-24f2d08b-cd14-4d10-9c35-11e0dac7b7e2 req-82bc27e1-4c9c-47dc-911b-5ae5bd37d183 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:54.872742 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-24f2d08b-cd14-4d10-9c35-11e0dac7b7e2 req-82bc27e1-4c9c-47dc-911b-5ae5bd37d183 service nova] Creating event network-vif-plugged:9d9ea71b-b365-4f8e-912e-6aa5c5eaeb26 for instance 5f506656-eef4-4b57-9559-0471bed3136e on n-h1-826526-5 Jul 20 04:33:54.891159 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-24f2d08b-cd14-4d10-9c35-11e0dac7b7e2 req-82bc27e1-4c9c-47dc-911b-5ae5bd37d183 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185075 Jul 20 04:33:54.892107 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1790/3816] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:33:55.252780 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9f84606a-c149-48c2-89a5-d7e45d52eefb tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:55.255225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9f84606a-c149-48c2-89a5-d7e45d52eefb tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:55.281281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f84606a-c149-48c2-89a5-d7e45d52eefb tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:55.282319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f84606a-c149-48c2-89a5-d7e45d52eefb tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:55.283920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f84606a-c149-48c2-89a5-d7e45d52eefb tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:55.284822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f84606a-c149-48c2-89a5-d7e45d52eefb tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:55.820801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed727933-b338-4c39-866e-f892658c8b6b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:55.823627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ed727933-b338-4c39-866e-f892658c8b6b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:55.865053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed727933-b338-4c39-866e-f892658c8b6b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:55.865053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed727933-b338-4c39-866e-f892658c8b6b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:55.867557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed727933-b338-4c39-866e-f892658c8b6b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:55.868333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed727933-b338-4c39-866e-f892658c8b6b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:55.870852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9f84606a-c149-48c2-89a5-d7e45d52eefb tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:55.880836 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9f84606a-c149-48c2-89a5-d7e45d52eefb tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 200 len: 1319 microversion: 2.1 time: 0.635094 Jul 20 04:33:55.893343 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2027/3817] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:55 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 1319 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:56.043754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ed727933-b338-4c39-866e-f892658c8b6b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:56.060060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ed727933-b338-4c39-866e-f892658c8b6b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:56.066638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ed727933-b338-4c39-866e-f892658c8b6b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:56.071515 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ed727933-b338-4c39-866e-f892658c8b6b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.262073 Jul 20 04:33:56.078492 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1791/3818] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:55 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:56.923006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0b8b6478-0ce6-4980-9493-737cb9d19fa2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:56.924615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0b8b6478-0ce6-4980-9493-737cb9d19fa2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:56.934844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b8b6478-0ce6-4980-9493-737cb9d19fa2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:56.939493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b8b6478-0ce6-4980-9493-737cb9d19fa2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:56.940731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b8b6478-0ce6-4980-9493-737cb9d19fa2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:56.942028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b8b6478-0ce6-4980-9493-737cb9d19fa2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:57.100546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dd3b345c-d911-4d21-87e4-b3ba1e428056 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:57.101208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dd3b345c-d911-4d21-87e4-b3ba1e428056 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:57.136428 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd3b345c-d911-4d21-87e4-b3ba1e428056 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:57.137440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd3b345c-d911-4d21-87e4-b3ba1e428056 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:57.144789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd3b345c-d911-4d21-87e4-b3ba1e428056 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:57.145354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd3b345c-d911-4d21-87e4-b3ba1e428056 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:57.340232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0b8b6478-0ce6-4980-9493-737cb9d19fa2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:57.346749 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0b8b6478-0ce6-4980-9493-737cb9d19fa2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 200 len: 1508 microversion: 2.1 time: 0.428579 Jul 20 04:33:57.352096 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2028/3819] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:56 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 1508 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:57.527315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dd3b345c-d911-4d21-87e4-b3ba1e428056 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:57.538077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dd3b345c-d911-4d21-87e4-b3ba1e428056 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:57.548703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dd3b345c-d911-4d21-87e4-b3ba1e428056 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:57.551921 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dd3b345c-d911-4d21-87e4-b3ba1e428056 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.456948 Jul 20 04:33:57.558038 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1792/3820] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:57 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:33:58.578189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2188c11a-3214-48ad-b16c-8325d4cb3f05 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:58.579853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2188c11a-3214-48ad-b16c-8325d4cb3f05 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:58.597729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2188c11a-3214-48ad-b16c-8325d4cb3f05 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.598460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2188c11a-3214-48ad-b16c-8325d4cb3f05 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.599601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2188c11a-3214-48ad-b16c-8325d4cb3f05 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.600254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2188c11a-3214-48ad-b16c-8325d4cb3f05 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:59.883521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2188c11a-3214-48ad-b16c-8325d4cb3f05 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:59.899760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2188c11a-3214-48ad-b16c-8325d4cb3f05 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:59.904668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2188c11a-3214-48ad-b16c-8325d4cb3f05 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:59.908851 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2188c11a-3214-48ad-b16c-8325d4cb3f05 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 1.332426 Jul 20 04:33:59.926857 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2029/3821] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:58 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:00.933186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b2a36f6c-4ed4-4f39-84cc-4f4ba9b922d3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:00.933997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b2a36f6c-4ed4-4f39-84cc-4f4ba9b922d3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:00.956128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2a36f6c-4ed4-4f39-84cc-4f4ba9b922d3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:00.959293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2a36f6c-4ed4-4f39-84cc-4f4ba9b922d3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:00.964038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2a36f6c-4ed4-4f39-84cc-4f4ba9b922d3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:00.964508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2a36f6c-4ed4-4f39-84cc-4f4ba9b922d3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.383852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b2a36f6c-4ed4-4f39-84cc-4f4ba9b922d3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:02.403737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b2a36f6c-4ed4-4f39-84cc-4f4ba9b922d3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:02.417770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b2a36f6c-4ed4-4f39-84cc-4f4ba9b922d3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:02.419033 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b2a36f6c-4ed4-4f39-84cc-4f4ba9b922d3 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 1.491738 Jul 20 04:34:02.419605 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1793/3822] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:00 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:03.440482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7eb3fd83-412f-4a75-9c5b-1c23868ed766 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:03.441257 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7eb3fd83-412f-4a75-9c5b-1c23868ed766 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:03.462505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7eb3fd83-412f-4a75-9c5b-1c23868ed766 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.462967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7eb3fd83-412f-4a75-9c5b-1c23868ed766 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:03.471890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7eb3fd83-412f-4a75-9c5b-1c23868ed766 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.478725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7eb3fd83-412f-4a75-9c5b-1c23868ed766 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:05.167855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7eb3fd83-412f-4a75-9c5b-1c23868ed766 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:05.236347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7eb3fd83-412f-4a75-9c5b-1c23868ed766 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:05.237970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7eb3fd83-412f-4a75-9c5b-1c23868ed766 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:05.239241 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7eb3fd83-412f-4a75-9c5b-1c23868ed766 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 1.805830 Jul 20 04:34:05.239831 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2030/3823] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:03 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:06.261203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-73b07384-a80f-41bc-8d88-eb3f4bad1e9f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:06.262076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-73b07384-a80f-41bc-8d88-eb3f4bad1e9f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:06.320703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73b07384-a80f-41bc-8d88-eb3f4bad1e9f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:06.327624 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73b07384-a80f-41bc-8d88-eb3f4bad1e9f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:06.328918 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73b07384-a80f-41bc-8d88-eb3f4bad1e9f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:06.329787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73b07384-a80f-41bc-8d88-eb3f4bad1e9f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:06.745199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-73b07384-a80f-41bc-8d88-eb3f4bad1e9f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:06.806942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-73b07384-a80f-41bc-8d88-eb3f4bad1e9f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:06.818276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-73b07384-a80f-41bc-8d88-eb3f4bad1e9f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:06.827327 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-73b07384-a80f-41bc-8d88-eb3f4bad1e9f tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.564528 Jul 20 04:34:06.828238 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1794/3824] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:06 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:07.858633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9a126615-8371-4682-8638-2267b875a601 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:07.864446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9a126615-8371-4682-8638-2267b875a601 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:07.877206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:07.881773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a126615-8371-4682-8638-2267b875a601 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:07.885036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a126615-8371-4682-8638-2267b875a601 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:07.886417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a126615-8371-4682-8638-2267b875a601 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:07.887027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a126615-8371-4682-8638-2267b875a601 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:08.395779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9a126615-8371-4682-8638-2267b875a601 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:08.407178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9a126615-8371-4682-8638-2267b875a601 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:08.408767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9a126615-8371-4682-8638-2267b875a601 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:08.416885 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9a126615-8371-4682-8638-2267b875a601 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.564227 Jul 20 04:34:08.436844 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2031/3825] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:07 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:08.999904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-fd2c4022-773c-4e46-a161-e6e0c0ef685e req-37db7394-60a4-4320-b892-358fe3e7d287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2db32d6-491e-4d61-81b0-571b1c7073ff", "name": "network-vif-plugged", "status": "completed", "tag": "44e02028-8e3e-412c-b0ec-8a5e5b769d7c"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:09.036934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-fd2c4022-773c-4e46-a161-e6e0c0ef685e req-37db7394-60a4-4320-b892-358fe3e7d287 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:09.039262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-fd2c4022-773c-4e46-a161-e6e0c0ef685e req-37db7394-60a4-4320-b892-358fe3e7d287 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:09.110011 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-fd2c4022-773c-4e46-a161-e6e0c0ef685e req-37db7394-60a4-4320-b892-358fe3e7d287 service nova] Creating event network-vif-plugged:44e02028-8e3e-412c-b0ec-8a5e5b769d7c for instance f2db32d6-491e-4d61-81b0-571b1c7073ff on n-h1-826526-5 Jul 20 04:34:09.154341 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-fd2c4022-773c-4e46-a161-e6e0c0ef685e req-37db7394-60a4-4320-b892-358fe3e7d287 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156067 Jul 20 04:34:09.156034 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1795/3826] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:34:09.438101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5ee3bcf9-90d5-4c03-b653-9cdb3cbde605 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:09.442307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5ee3bcf9-90d5-4c03-b653-9cdb3cbde605 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:09.506477 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ee3bcf9-90d5-4c03-b653-9cdb3cbde605 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:09.506985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ee3bcf9-90d5-4c03-b653-9cdb3cbde605 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:09.507868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ee3bcf9-90d5-4c03-b653-9cdb3cbde605 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:09.514577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ee3bcf9-90d5-4c03-b653-9cdb3cbde605 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:09.952703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5ee3bcf9-90d5-4c03-b653-9cdb3cbde605 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:09.963129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5ee3bcf9-90d5-4c03-b653-9cdb3cbde605 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:10.005685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5ee3bcf9-90d5-4c03-b653-9cdb3cbde605 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:10.020050 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5ee3bcf9-90d5-4c03-b653-9cdb3cbde605 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.583553 Jul 20 04:34:10.028807 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2032/3827] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:09 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:11.054545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5e22ecce-83ab-44f1-acab-1daca52669ad tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:11.058663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5e22ecce-83ab-44f1-acab-1daca52669ad tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:11.108738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e22ecce-83ab-44f1-acab-1daca52669ad tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:11.109569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e22ecce-83ab-44f1-acab-1daca52669ad tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:11.135593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e22ecce-83ab-44f1-acab-1daca52669ad tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:11.140683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e22ecce-83ab-44f1-acab-1daca52669ad tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:11.853000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5e22ecce-83ab-44f1-acab-1daca52669ad tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:11.874906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5e22ecce-83ab-44f1-acab-1daca52669ad tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:11.876701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5e22ecce-83ab-44f1-acab-1daca52669ad tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:11.878050 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5e22ecce-83ab-44f1-acab-1daca52669ad tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.835302 Jul 20 04:34:11.878498 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1796/3828] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:11 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:12.913571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c930f072-ae16-4698-bad1-87f2b0959e2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:12.914428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c930f072-ae16-4698-bad1-87f2b0959e2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:12.947280 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c930f072-ae16-4698-bad1-87f2b0959e2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:12.967628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c930f072-ae16-4698-bad1-87f2b0959e2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:12.968858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c930f072-ae16-4698-bad1-87f2b0959e2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:12.973874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c930f072-ae16-4698-bad1-87f2b0959e2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.086418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c930f072-ae16-4698-bad1-87f2b0959e2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:14.105125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c930f072-ae16-4698-bad1-87f2b0959e2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:14.106622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c930f072-ae16-4698-bad1-87f2b0959e2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:14.123557 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c930f072-ae16-4698-bad1-87f2b0959e2c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 1.213956 Jul 20 04:34:14.124477 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2033/3829] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:12 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:34:15.161235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-27792e6a-ed7d-4258-a25c-bb584fd25c2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:15.162397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-27792e6a-ed7d-4258-a25c-bb584fd25c2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:15.208500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27792e6a-ed7d-4258-a25c-bb584fd25c2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:15.214005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27792e6a-ed7d-4258-a25c-bb584fd25c2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:15.218635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27792e6a-ed7d-4258-a25c-bb584fd25c2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:15.219213 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27792e6a-ed7d-4258-a25c-bb584fd25c2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:17.238973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-27792e6a-ed7d-4258-a25c-bb584fd25c2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:17.260790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-27792e6a-ed7d-4258-a25c-bb584fd25c2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:17.267783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-27792e6a-ed7d-4258-a25c-bb584fd25c2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:17.274931 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-27792e6a-ed7d-4258-a25c-bb584fd25c2b tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 2.120719 Jul 20 04:34:17.278301 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1797/3830] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:15 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 2129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:17.435067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c9380d69-b612-4073-9afc-ae635414c70f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-149046475", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:18.319255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c8523c10-3a79-42c5-a02b-451a61e51e90 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:18.319890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c8523c10-3a79-42c5-a02b-451a61e51e90 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:18.368896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8523c10-3a79-42c5-a02b-451a61e51e90 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:18.369390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8523c10-3a79-42c5-a02b-451a61e51e90 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:18.370220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8523c10-3a79-42c5-a02b-451a61e51e90 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:18.377221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8523c10-3a79-42c5-a02b-451a61e51e90 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:18.871612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c8523c10-3a79-42c5-a02b-451a61e51e90 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:18.928959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c8523c10-3a79-42c5-a02b-451a61e51e90 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:18.937470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c8523c10-3a79-42c5-a02b-451a61e51e90 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:18.940922 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c8523c10-3a79-42c5-a02b-451a61e51e90 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.626901 Jul 20 04:34:18.950728 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1798/3831] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:18 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:19.977922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4d98e555-528b-4ba0-b4bf-63545943b00d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:19.978735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4d98e555-528b-4ba0-b4bf-63545943b00d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:20.005653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d98e555-528b-4ba0-b4bf-63545943b00d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:20.007955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d98e555-528b-4ba0-b4bf-63545943b00d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:20.009737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d98e555-528b-4ba0-b4bf-63545943b00d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:20.013175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d98e555-528b-4ba0-b4bf-63545943b00d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:20.334369 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4d98e555-528b-4ba0-b4bf-63545943b00d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:20.349435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4d98e555-528b-4ba0-b4bf-63545943b00d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:20.367628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4d98e555-528b-4ba0-b4bf-63545943b00d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:20.369226 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4d98e555-528b-4ba0-b4bf-63545943b00d tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.399583 Jul 20 04:34:20.380662 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1799/3832] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:19 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:21.345751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c69e801e-8433-48fa-a373-7f1097617081 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Action: 'create', calling method: .version_select at 0x7f06bd279550>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1348993298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExgaGX6b7YoB0Oi2CmsMvbwOKIEm7N+2GcBl1yYoytpk+E4cj1bylkXdq9gQoGUI5qVezmmsZYze4xR2CU8PnV4oqpf4i1IzU/i8jXa7J1kdQOaIzhfTV1K7RsQ0+U4wA=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:21.396786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-c69e801e-8433-48fa-a373-7f1097617081 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Getting quotas for project 4e7c35e7aceb481ca2b168017a8e6e20. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:21.420397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-c69e801e-8433-48fa-a373-7f1097617081 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Getting quotas for user 7e7cd6c38a334a8690ad3f627d502e63 and project 4e7c35e7aceb481ca2b168017a8e6e20. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:21.514325 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c69e801e-8433-48fa-a373-7f1097617081 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.132050 Jul 20 04:34:21.518093 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1800/3833] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:34:20 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:21.542836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-20ce39c5-6f05-421e-bfb5-d651731dbfe8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:21.548923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-20ce39c5-6f05-421e-bfb5-d651731dbfe8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:21.574862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-20ce39c5-6f05-421e-bfb5-d651731dbfe8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:21.578269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-20ce39c5-6f05-421e-bfb5-d651731dbfe8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:21.583342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-20ce39c5-6f05-421e-bfb5-d651731dbfe8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:21.584709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-20ce39c5-6f05-421e-bfb5-d651731dbfe8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:21.991468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-20ce39c5-6f05-421e-bfb5-d651731dbfe8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:22.021895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-20ce39c5-6f05-421e-bfb5-d651731dbfe8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:22.023486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-20ce39c5-6f05-421e-bfb5-d651731dbfe8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:22.040398 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-20ce39c5-6f05-421e-bfb5-d651731dbfe8 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.519101 Jul 20 04:34:22.043016 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1801/3834] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:21 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:23.063619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-10bdd6a2-647d-4132-8ec4-132240816fe6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:23.064676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-10bdd6a2-647d-4132-8ec4-132240816fe6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:23.097201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10bdd6a2-647d-4132-8ec4-132240816fe6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:23.102847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10bdd6a2-647d-4132-8ec4-132240816fe6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:23.113606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10bdd6a2-647d-4132-8ec4-132240816fe6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:23.119765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10bdd6a2-647d-4132-8ec4-132240816fe6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:23.754210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-10bdd6a2-647d-4132-8ec4-132240816fe6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:23.757318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:23.801605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-10bdd6a2-647d-4132-8ec4-132240816fe6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:23.807894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-10bdd6a2-647d-4132-8ec4-132240816fe6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:23.821115 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-10bdd6a2-647d-4132-8ec4-132240816fe6 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.759771 Jul 20 04:34:23.838017 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1802/3835] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:23 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:24.093084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=83 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:24.854782 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d2486c3f-ce18-405a-b155-7f16d04e4ff9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:24.855422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d2486c3f-ce18-405a-b155-7f16d04e4ff9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:24.862779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:24.894751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2486c3f-ce18-405a-b155-7f16d04e4ff9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:24.905433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2486c3f-ce18-405a-b155-7f16d04e4ff9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:24.917196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2486c3f-ce18-405a-b155-7f16d04e4ff9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:24.920179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2486c3f-ce18-405a-b155-7f16d04e4ff9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:25.308586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d2486c3f-ce18-405a-b155-7f16d04e4ff9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:25.333366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d2486c3f-ce18-405a-b155-7f16d04e4ff9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:25.345284 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d2486c3f-ce18-405a-b155-7f16d04e4ff9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:25.351338 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d2486c3f-ce18-405a-b155-7f16d04e4ff9 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.500734 Jul 20 04:34:25.365447 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1803/3836] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:24 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:26.374478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-963b602e-b0b5-43c4-93d2-a419c49e1612 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:26.376714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-963b602e-b0b5-43c4-93d2-a419c49e1612 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:26.418745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-963b602e-b0b5-43c4-93d2-a419c49e1612 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:26.419394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-963b602e-b0b5-43c4-93d2-a419c49e1612 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:26.432399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-963b602e-b0b5-43c4-93d2-a419c49e1612 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:26.433492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-963b602e-b0b5-43c4-93d2-a419c49e1612 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:26.810442 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-963b602e-b0b5-43c4-93d2-a419c49e1612 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:26.868175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-963b602e-b0b5-43c4-93d2-a419c49e1612 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:26.870916 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-963b602e-b0b5-43c4-93d2-a419c49e1612 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:26.873205 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-963b602e-b0b5-43c4-93d2-a419c49e1612 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.505401 Jul 20 04:34:26.889160 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1804/3837] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:26 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:27.027373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d4cc0098-cca1-4579-a7b5-4e52b50c89eb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-2109064042", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "6eeca984-bcb1-4382-9afc-a69f1d4f125f"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:27.464628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=7 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:31.466864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:32.560486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-c9380d69-b612-4073-9afc-ae635414c70f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:34:32.585147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-d4cc0098-cca1-4579-a7b5-4e52b50c89eb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] validate_networks() for [('6eeca984-bcb1-4382-9afc-a69f1d4f125f', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:34:33.613117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c9380d69-b612-4073-9afc-ae635414c70f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:34:33.613646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c9380d69-b612-4073-9afc-ae635414c70f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:34:33.614374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c9380d69-b612-4073-9afc-ae635414c70f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:34:33.614796 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c9380d69-b612-4073-9afc-ae635414c70f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:34:33.615398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c9380d69-b612-4073-9afc-ae635414c70f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:34:33.654441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9380d69-b612-4073-9afc-ae635414c70f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.680779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9380d69-b612-4073-9afc-ae635414c70f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.681823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9380d69-b612-4073-9afc-ae635414c70f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.682268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9380d69-b612-4073-9afc-ae635414c70f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.753910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c9380d69-b612-4073-9afc-ae635414c70f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Getting quotas for project 315f772f396147ea89da0f9f051d9fee. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:33.787413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c9380d69-b612-4073-9afc-ae635414c70f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Getting quotas for user 43f66821062041b8a6330b883de2754f and project 315f772f396147ea89da0f9f051d9fee. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:33.848882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c9380d69-b612-4073-9afc-ae635414c70f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:34:33.855673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c9380d69-b612-4073-9afc-ae635414c70f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:34:33.887175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-d4cc0098-cca1-4579-a7b5-4e52b50c89eb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:34:33.887652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-d4cc0098-cca1-4579-a7b5-4e52b50c89eb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:34:33.888053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-d4cc0098-cca1-4579-a7b5-4e52b50c89eb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:34:33.888491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-d4cc0098-cca1-4579-a7b5-4e52b50c89eb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:34:33.889224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-d4cc0098-cca1-4579-a7b5-4e52b50c89eb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:34:33.919565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4cc0098-cca1-4579-a7b5-4e52b50c89eb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.920214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4cc0098-cca1-4579-a7b5-4e52b50c89eb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.921033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4cc0098-cca1-4579-a7b5-4e52b50c89eb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.921473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4cc0098-cca1-4579-a7b5-4e52b50c89eb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.019023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-d4cc0098-cca1-4579-a7b5-4e52b50c89eb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Getting quotas for project 9c844eeb3da94157a49e1232388bcf4f. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:34.042842 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c9380d69-b612-4073-9afc-ae635414c70f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 16.611632 Jul 20 04:34:34.049994 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2034/3838] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:34:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 16620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:34:34.060280 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-47acffb8-84fb-4523-a400-9f1b4dc07fcb tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-2018656709", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1348993298", "security_groups": [{"name": "tempest-secgroup-smoke-874743850"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "848bb3b0-a13a-4bb8-8d7d-3564af5c7e83"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:34.063065 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-d4cc0098-cca1-4579-a7b5-4e52b50c89eb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Getting quotas for user e17483da2268411e852efa8a0b5437b3 and project 9c844eeb3da94157a49e1232388bcf4f. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:34.122438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d4cc0098-cca1-4579-a7b5-4e52b50c89eb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:34:34.126732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d4cc0098-cca1-4579-a7b5-4e52b50c89eb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:34:34.320249 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d4cc0098-cca1-4579-a7b5-4e52b50c89eb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 7.429478 Jul 20 04:34:34.323766 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1805/3839] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 04:34:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 7434 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:34:34.336852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-95aab598-c7b3-4b54-a65e-814733391f66 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:34.338125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-95aab598-c7b3-4b54-a65e-814733391f66 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:34.347446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95aab598-c7b3-4b54-a65e-814733391f66 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.348197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95aab598-c7b3-4b54-a65e-814733391f66 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.349326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95aab598-c7b3-4b54-a65e-814733391f66 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.350715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95aab598-c7b3-4b54-a65e-814733391f66 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.511561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-47acffb8-84fb-4523-a400-9f1b4dc07fcb tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] validate_networks() for [('848bb3b0-a13a-4bb8-8d7d-3564af5c7e83', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:34:34.673028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-95aab598-c7b3-4b54-a65e-814733391f66 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:34.689941 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-95aab598-c7b3-4b54-a65e-814733391f66 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:34.691480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-95aab598-c7b3-4b54-a65e-814733391f66 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e9b9e0c72784fca90beb852a0957789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cca0080e7e458ab2569764f77b8c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:34.719442 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-95aab598-c7b3-4b54-a65e-814733391f66 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 200 len: 1605 microversion: 2.32 time: 0.392630 Jul 20 04:34:34.720113 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1806/3840] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:34 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 1605 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:34.750494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-558356c3-6344-45ea-b904-f659ce3aa489 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Action: 'create', calling method: .version_select at 0x7f06bd1a04c0>, body: {"keypair": {"name": "tempest-keypair-1488040510", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5peRM2w0xCUnf5YJUG3aFh7/jpZv4aHYtIZf35bzAg+ucp7zeWHieT3d5ONu1lP548QuplnRXbnS8RLozd9OYip5ZX5cB+9sHVIGPpF11NJoVNK0Fc68Jj8YVxIpW64w=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:34.861910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-558356c3-6344-45ea-b904-f659ce3aa489 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Getting quotas for project 4689a1d17c764689be54e7506f1ab82f. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:34.904493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-558356c3-6344-45ea-b904-f659ce3aa489 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Getting quotas for user 9d9c9a24493b4f2299dffb11b8addc4d and project 4689a1d17c764689be54e7506f1ab82f. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:35.192716 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-558356c3-6344-45ea-b904-f659ce3aa489 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.454397 Jul 20 04:34:35.198259 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1807/3841] 10.222.0.17 () {62 vars in 1199 bytes} [Wed Jul 20 04:34:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 473 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:34:35.239770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f3a59571-2727-41eb-a545-27854f2da79b tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:35.255920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f3a59571-2727-41eb-a545-27854f2da79b tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:35.663545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f3a59571-2727-41eb-a545-27854f2da79b tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f66821062041b8a6330b883de2754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f772f396147ea89da0f9f051d9fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:35.738325 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f3a59571-2727-41eb-a545-27854f2da79b tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989" status: 200 len: 1213 microversion: 2.1 time: 0.531226 Jul 20 04:34:35.739390 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1808/3842] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:35 2022] GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 => generated 1213 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:35.815694 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0ad76439-c1de-4bc3-8b21-27e7be2c3a5a tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:35.829545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0ad76439-c1de-4bc3-8b21-27e7be2c3a5a tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:36.176879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0ad76439-c1de-4bc3-8b21-27e7be2c3a5a tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:36.190886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0ad76439-c1de-4bc3-8b21-27e7be2c3a5a tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:36.198683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0ad76439-c1de-4bc3-8b21-27e7be2c3a5a tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:36.204182 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0ad76439-c1de-4bc3-8b21-27e7be2c3a5a tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3" status: 200 len: 1262 microversion: 2.26 time: 0.452327 Jul 20 04:34:36.210002 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1809/3843] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:35 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3 => generated 1262 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:36.228043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8378ec7c-69ac-4a2f-bf28-fc30ec1fe693 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:36.231620 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8378ec7c-69ac-4a2f-bf28-fc30ec1fe693 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:36.257698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8378ec7c-69ac-4a2f-bf28-fc30ec1fe693 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.265529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8378ec7c-69ac-4a2f-bf28-fc30ec1fe693 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.270041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8378ec7c-69ac-4a2f-bf28-fc30ec1fe693 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.270665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8378ec7c-69ac-4a2f-bf28-fc30ec1fe693 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.350015 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-8378ec7c-69ac-4a2f-bf28-fc30ec1fe693 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] HTTP exception thrown: Instance 0af76412-dcc5-4a08-8492-910e244a4ede could not be found. Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8378ec7c-69ac-4a2f-bf28-fc30ec1fe693 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Request method failure captured: Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede HTTP/1.1 Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14PJnAd5Cv8FkRavfjEsyDoUjIDGTtg9gA8bC6X1J-8QElL1k8d4BXOaDJnGsegwi7ftwRTm1G24aWCRaNlCFsjRJ8CTzHKTIJhGZ8i10StjYdlCynXY87weXCbDHtSuiyO7eU_6IZ6zjAB50vx2hii0OfNTDAF7BPZcFvnPC2Nmokg Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.32 Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 85cca0080e7e458ab2569764f77b8c71 Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TaggedBootDevicesTest-894115946 Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85cca0080e7e458ab2569764f77b8c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/85cca0080e7e458ab2569764f77b8c71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_85cca0080e7e458ab2569764f77b8c71", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85cca0080e7e458ab2569764f77b8c71"}]}] Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TaggedBootDevicesTest-894115946 Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 85cca0080e7e458ab2569764f77b8c71 Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TaggedBootDevicesTest-894115946 Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TaggedBootDevicesTest-894115946-project Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 7e9b9e0c72784fca90beb852a0957789 Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TaggedBootDevicesTest-894115946-project Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 0af76412-dcc5-4a08-8492-910e244a4ede could not be found. Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '0af76412-dcc5-4a08-8492-910e244a4ede'} Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0af76412-dcc5-4a08-8492-910e244a4ede could not be found. Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0af76412-dcc5-4a08-8492-910e244a4ede could not be found. Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:36.359145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:34:36.369530 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:36.369530 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:36.369530 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:36.369530 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:36.369530 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:36.369530 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0af76412-dcc5-4a08-8492-910e244a4ede could not be found. Jul 20 04:34:36.369530 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:34:36.369530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8378ec7c-69ac-4a2f-bf28-fc30ec1fe693 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Returning 404 to user: Instance 0af76412-dcc5-4a08-8492-910e244a4ede could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:36.369530 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8378ec7c-69ac-4a2f-bf28-fc30ec1fe693 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 404 len: 111 microversion: 2.32 time: 0.153026 Jul 20 04:34:36.369530 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1810/3844] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:36 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:34:36.397948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1e396b6a-54f9-4562-9479-0fd76520a84c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '.version_select at 0x7f06bd1a00d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:36.465895 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1e396b6a-54f9-4562-9479-0fd76520a84c tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1468724138" status: 204 len: 0 microversion: 2.32 time: 0.088379 Jul 20 04:34:36.475977 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1811/3845] 10.222.0.17 () {60 vars in 1261 bytes} [Wed Jul 20 04:34:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1468724138 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:34:36.609935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-47acffb8-84fb-4523-a400-9f1b4dc07fcb tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Getting quotas for project 4e7c35e7aceb481ca2b168017a8e6e20. Resources: dict_keys(['metadata_items']) {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:36.663176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-47acffb8-84fb-4523-a400-9f1b4dc07fcb tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Getting quotas for user 7e7cd6c38a334a8690ad3f627d502e63 and project 4e7c35e7aceb481ca2b168017a8e6e20. Resources: dict_keys(['metadata_items']) {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:36.726996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-47acffb8-84fb-4523-a400-9f1b4dc07fcb tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:34:36.728775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-47acffb8-84fb-4523-a400-9f1b4dc07fcb tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:34:36.731468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-47acffb8-84fb-4523-a400-9f1b4dc07fcb tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:34:36.733648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-47acffb8-84fb-4523-a400-9f1b4dc07fcb tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:34:36.735937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-47acffb8-84fb-4523-a400-9f1b4dc07fcb tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:34:36.757533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ad8167a2-2b03-4de8-9640-9c3a7a94db20 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:36.758222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ad8167a2-2b03-4de8-9640-9c3a7a94db20 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:36.796926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47acffb8-84fb-4523-a400-9f1b4dc07fcb tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.798691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47acffb8-84fb-4523-a400-9f1b4dc07fcb tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.800866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47acffb8-84fb-4523-a400-9f1b4dc07fcb tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.802874 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad8167a2-2b03-4de8-9640-9c3a7a94db20 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.803834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47acffb8-84fb-4523-a400-9f1b4dc07fcb tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.813225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad8167a2-2b03-4de8-9640-9c3a7a94db20 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.815112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad8167a2-2b03-4de8-9640-9c3a7a94db20 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.832133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad8167a2-2b03-4de8-9640-9c3a7a94db20 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.909584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-47acffb8-84fb-4523-a400-9f1b4dc07fcb tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Getting quotas for project 4e7c35e7aceb481ca2b168017a8e6e20. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:36.928247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-47acffb8-84fb-4523-a400-9f1b4dc07fcb tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Getting quotas for user 7e7cd6c38a334a8690ad3f627d502e63 and project 4e7c35e7aceb481ca2b168017a8e6e20. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:36.972902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-47acffb8-84fb-4523-a400-9f1b4dc07fcb tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:34:36.979657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-47acffb8-84fb-4523-a400-9f1b4dc07fcb tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:34:37.101799 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-47acffb8-84fb-4523-a400-9f1b4dc07fcb tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.050290 Jul 20 04:34:37.112710 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2035/3846] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:34:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 3061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:34:37.121520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7815f4bd-a6e8-4346-aca6-44862e8aaa49 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:37.139971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7815f4bd-a6e8-4346-aca6-44862e8aaa49 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:37.337639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7815f4bd-a6e8-4346-aca6-44862e8aaa49 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:37.367431 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7815f4bd-a6e8-4346-aca6-44862e8aaa49 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1303 microversion: 2.1 time: 0.251987 Jul 20 04:34:37.369547 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2036/3847] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:37 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1303 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:37.381185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-24478216-ee87-45ef-9940-a95676ecca42 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:37.382668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-24478216-ee87-45ef-9940-a95676ecca42 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:37.397741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24478216-ee87-45ef-9940-a95676ecca42 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:37.398990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24478216-ee87-45ef-9940-a95676ecca42 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:37.400721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24478216-ee87-45ef-9940-a95676ecca42 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:37.401881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24478216-ee87-45ef-9940-a95676ecca42 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:37.691063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-24478216-ee87-45ef-9940-a95676ecca42 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:37.745511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-24478216-ee87-45ef-9940-a95676ecca42 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:37.765765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-24478216-ee87-45ef-9940-a95676ecca42 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:37.774880 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-24478216-ee87-45ef-9940-a95676ecca42 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3" status: 200 len: 1258 microversion: 2.26 time: 0.394524 Jul 20 04:34:37.781323 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2037/3848] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:37 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3 => generated 1258 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:38.294537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ad8167a2-2b03-4de8-9640-9c3a7a94db20 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f66821062041b8a6330b883de2754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f772f396147ea89da0f9f051d9fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:38.307337 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ad8167a2-2b03-4de8-9640-9c3a7a94db20 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989" status: 200 len: 1209 microversion: 2.1 time: 1.551660 Jul 20 04:34:38.308512 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1812/3849] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:36 2022] GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 => generated 1209 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:38.388339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ce952380-1ed3-4cf5-bf4a-a804f0686055 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:38.389424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ce952380-1ed3-4cf5-bf4a-a804f0686055 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:38.412292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce952380-1ed3-4cf5-bf4a-a804f0686055 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:38.414853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce952380-1ed3-4cf5-bf4a-a804f0686055 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:38.415722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce952380-1ed3-4cf5-bf4a-a804f0686055 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:38.416171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce952380-1ed3-4cf5-bf4a-a804f0686055 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:38.630667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ce952380-1ed3-4cf5-bf4a-a804f0686055 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:38.648121 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ce952380-1ed3-4cf5-bf4a-a804f0686055 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1307 microversion: 2.1 time: 0.260383 Jul 20 04:34:38.652077 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2038/3850] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:38 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1307 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:38.802981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e5e5f51b-24ad-4aba-af60-644e834f8fc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:38.803261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e5e5f51b-24ad-4aba-af60-644e834f8fc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:38.838159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5e5f51b-24ad-4aba-af60-644e834f8fc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:38.839241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5e5f51b-24ad-4aba-af60-644e834f8fc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:38.842245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5e5f51b-24ad-4aba-af60-644e834f8fc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:38.843007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5e5f51b-24ad-4aba-af60-644e834f8fc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:39.326724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a0104937-6636-4ef6-b9ba-41cd70878fe8 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:39.328010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a0104937-6636-4ef6-b9ba-41cd70878fe8 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:39.352277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0104937-6636-4ef6-b9ba-41cd70878fe8 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:39.353541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0104937-6636-4ef6-b9ba-41cd70878fe8 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:39.360051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0104937-6636-4ef6-b9ba-41cd70878fe8 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:39.360625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0104937-6636-4ef6-b9ba-41cd70878fe8 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:39.646630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a0104937-6636-4ef6-b9ba-41cd70878fe8 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f66821062041b8a6330b883de2754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f772f396147ea89da0f9f051d9fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:39.674623 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a0104937-6636-4ef6-b9ba-41cd70878fe8 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989" status: 200 len: 1271 microversion: 2.1 time: 0.351815 Jul 20 04:34:39.686572 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2039/3851] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:39 2022] GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 => generated 1271 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:39.693736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3091c8ad-b746-47ef-bb25-fd653e182c33 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:39.695027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3091c8ad-b746-47ef-bb25-fd653e182c33 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:39.704368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3091c8ad-b746-47ef-bb25-fd653e182c33 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:39.705282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3091c8ad-b746-47ef-bb25-fd653e182c33 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:39.706614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3091c8ad-b746-47ef-bb25-fd653e182c33 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:39.707261 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3091c8ad-b746-47ef-bb25-fd653e182c33 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.005290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e5e5f51b-24ad-4aba-af60-644e834f8fc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:40.024570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e5e5f51b-24ad-4aba-af60-644e834f8fc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:40.026987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e5e5f51b-24ad-4aba-af60-644e834f8fc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:40.028612 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e5e5f51b-24ad-4aba-af60-644e834f8fc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3" status: 200 len: 1322 microversion: 2.26 time: 1.231097 Jul 20 04:34:40.048357 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1813/3852] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:38 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3 => generated 1322 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:40.279616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3091c8ad-b746-47ef-bb25-fd653e182c33 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:40.301988 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3091c8ad-b746-47ef-bb25-fd653e182c33 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1355 microversion: 2.1 time: 0.613174 Jul 20 04:34:40.306880 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2040/3853] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:39 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1355 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:40.693248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f26d807f-2d2f-4273-a2bc-077e83281f40 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:40.694305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f26d807f-2d2f-4273-a2bc-077e83281f40 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:40.701181 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f26d807f-2d2f-4273-a2bc-077e83281f40 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:40.714677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f26d807f-2d2f-4273-a2bc-077e83281f40 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.715764 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f26d807f-2d2f-4273-a2bc-077e83281f40 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:40.716488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f26d807f-2d2f-4273-a2bc-077e83281f40 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:41.102470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ebf9752e-b973-4097-b048-48d499d6a5a8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:41.110665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ebf9752e-b973-4097-b048-48d499d6a5a8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:41.170883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebf9752e-b973-4097-b048-48d499d6a5a8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:41.176436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebf9752e-b973-4097-b048-48d499d6a5a8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:41.179839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebf9752e-b973-4097-b048-48d499d6a5a8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:41.180572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebf9752e-b973-4097-b048-48d499d6a5a8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:42.454233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ebf9752e-b973-4097-b048-48d499d6a5a8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:42.464979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ebf9752e-b973-4097-b048-48d499d6a5a8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:42.466639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ebf9752e-b973-4097-b048-48d499d6a5a8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:42.467879 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ebf9752e-b973-4097-b048-48d499d6a5a8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3" status: 200 len: 1362 microversion: 2.26 time: 1.412035 Jul 20 04:34:42.482612 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2041/3854] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:41 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3 => generated 1362 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:42.496495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8be8b20d-979b-4d9a-9db1-049c85a152d4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:42.497335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8be8b20d-979b-4d9a-9db1-049c85a152d4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:42.521401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8be8b20d-979b-4d9a-9db1-049c85a152d4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:42.521866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8be8b20d-979b-4d9a-9db1-049c85a152d4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:42.522919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8be8b20d-979b-4d9a-9db1-049c85a152d4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:42.523447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8be8b20d-979b-4d9a-9db1-049c85a152d4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:42.726909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8be8b20d-979b-4d9a-9db1-049c85a152d4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:42.746952 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8be8b20d-979b-4d9a-9db1-049c85a152d4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1361 microversion: 2.1 time: 0.262336 Jul 20 04:34:42.776923 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2042/3855] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:42 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1361 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:43.505399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-532840b8-858b-4ef6-a6ca-f97478918b04 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:43.506199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-532840b8-858b-4ef6-a6ca-f97478918b04 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:43.527102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-532840b8-858b-4ef6-a6ca-f97478918b04 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.527905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-532840b8-858b-4ef6-a6ca-f97478918b04 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.528944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-532840b8-858b-4ef6-a6ca-f97478918b04 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.529574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-532840b8-858b-4ef6-a6ca-f97478918b04 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.970936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:44.049259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-532840b8-858b-4ef6-a6ca-f97478918b04 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:44.061473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-532840b8-858b-4ef6-a6ca-f97478918b04 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:44.063448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-532840b8-858b-4ef6-a6ca-f97478918b04 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:44.072607 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-532840b8-858b-4ef6-a6ca-f97478918b04 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3" status: 200 len: 1362 microversion: 2.26 time: 0.570951 Jul 20 04:34:44.075564 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2043/3856] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:43 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3 => generated 1362 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:44.088861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-82f9f27d-c555-445f-a439-2867b4ec7920 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:44.089931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-82f9f27d-c555-445f-a439-2867b4ec7920 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:44.100287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82f9f27d-c555-445f-a439-2867b4ec7920 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.102180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82f9f27d-c555-445f-a439-2867b4ec7920 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.103914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82f9f27d-c555-445f-a439-2867b4ec7920 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.107778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82f9f27d-c555-445f-a439-2867b4ec7920 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.379240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-82f9f27d-c555-445f-a439-2867b4ec7920 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:44.406057 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-82f9f27d-c555-445f-a439-2867b4ec7920 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1361 microversion: 2.1 time: 0.316685 Jul 20 04:34:44.406762 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2044/3857] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:44 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1361 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:44.423801 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-5525d8d5-a6ef-4a06-b28e-e59147851c9a req-87899760-0ab9-45b7-9672-2a3210a2bc7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f22b3cf-7413-4a8e-971e-60c5f72f25c3", "tag": "efa36460-bce4-4fac-860d-23ab4044e65e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:44.461993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5525d8d5-a6ef-4a06-b28e-e59147851c9a req-87899760-0ab9-45b7-9672-2a3210a2bc7a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.468122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5525d8d5-a6ef-4a06-b28e-e59147851c9a req-87899760-0ab9-45b7-9672-2a3210a2bc7a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.501235 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-5525d8d5-a6ef-4a06-b28e-e59147851c9a req-87899760-0ab9-45b7-9672-2a3210a2bc7a service nova] Creating event network-changed:efa36460-bce4-4fac-860d-23ab4044e65e for instance 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 on n-h2-826526-5 Jul 20 04:34:44.517697 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-5525d8d5-a6ef-4a06-b28e-e59147851c9a req-87899760-0ab9-45b7-9672-2a3210a2bc7a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099122 Jul 20 04:34:44.519709 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2045/3858] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:44.539823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0af26e1e-9111-44b7-a3bd-7af4dc55bfa9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:44.540957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0af26e1e-9111-44b7-a3bd-7af4dc55bfa9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:44.568819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0af26e1e-9111-44b7-a3bd-7af4dc55bfa9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.569277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0af26e1e-9111-44b7-a3bd-7af4dc55bfa9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.575586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0af26e1e-9111-44b7-a3bd-7af4dc55bfa9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.576711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0af26e1e-9111-44b7-a3bd-7af4dc55bfa9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.882929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f26d807f-2d2f-4273-a2bc-077e83281f40 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f66821062041b8a6330b883de2754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f772f396147ea89da0f9f051d9fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:44.902104 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f26d807f-2d2f-4273-a2bc-077e83281f40 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989" status: 200 len: 1313 microversion: 2.1 time: 4.212594 Jul 20 04:34:44.906074 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1814/3859] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:40 2022] GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 => generated 1313 bytes in 4217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:45.095575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-426fa310-e3e1-463e-a8aa-dd4b61715c3d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:45.097394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-426fa310-e3e1-463e-a8aa-dd4b61715c3d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:45.119257 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-426fa310-e3e1-463e-a8aa-dd4b61715c3d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.121161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-426fa310-e3e1-463e-a8aa-dd4b61715c3d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.124145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-426fa310-e3e1-463e-a8aa-dd4b61715c3d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.128659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-426fa310-e3e1-463e-a8aa-dd4b61715c3d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.219423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0af26e1e-9111-44b7-a3bd-7af4dc55bfa9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:45.240023 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0af26e1e-9111-44b7-a3bd-7af4dc55bfa9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.714687 Jul 20 04:34:45.242333 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2046/3860] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:44 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:45.262372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7f5dd9d6-083e-4712-a54f-666c1345b2aa tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-967654515"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:45.264726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7f5dd9d6-083e-4712-a54f-666c1345b2aa tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:45.281195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f5dd9d6-083e-4712-a54f-666c1345b2aa tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.284248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f5dd9d6-083e-4712-a54f-666c1345b2aa tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.297394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f5dd9d6-083e-4712-a54f-666c1345b2aa tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.298217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f5dd9d6-083e-4712-a54f-666c1345b2aa tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.854775 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7f5dd9d6-083e-4712-a54f-666c1345b2aa tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 202 len: 0 microversion: 2.1 time: 0.597368 Jul 20 04:34:45.878204 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2047/3861] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:45 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 0 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Jul 20 04:34:45.900294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c28ce32a-3f24-457a-9513-f59d7021c33d tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:45.902124 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c28ce32a-3f24-457a-9513-f59d7021c33d tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:45.915836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c28ce32a-3f24-457a-9513-f59d7021c33d tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.916312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c28ce32a-3f24-457a-9513-f59d7021c33d tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.917313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c28ce32a-3f24-457a-9513-f59d7021c33d tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.917919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c28ce32a-3f24-457a-9513-f59d7021c33d tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:46.182272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=14 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:46.555191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-426fa310-e3e1-463e-a8aa-dd4b61715c3d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:46.582664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-426fa310-e3e1-463e-a8aa-dd4b61715c3d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:46.584778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-426fa310-e3e1-463e-a8aa-dd4b61715c3d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:46.586028 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-426fa310-e3e1-463e-a8aa-dd4b61715c3d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3" status: 200 len: 1362 microversion: 2.26 time: 1.496307 Jul 20 04:34:46.592840 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1815/3862] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:45 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3 => generated 1362 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:34:46.639597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-754e4a6c-787b-4de1-9175-c6e2a1b06360 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:46.640558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-754e4a6c-787b-4de1-9175-c6e2a1b06360 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:46.654791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-754e4a6c-787b-4de1-9175-c6e2a1b06360 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:46.663003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-754e4a6c-787b-4de1-9175-c6e2a1b06360 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:46.664048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-754e4a6c-787b-4de1-9175-c6e2a1b06360 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:46.664648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-754e4a6c-787b-4de1-9175-c6e2a1b06360 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:46.861919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:47.257170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c28ce32a-3f24-457a-9513-f59d7021c33d tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:47.273412 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c28ce32a-3f24-457a-9513-f59d7021c33d tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1428 microversion: 2.1 time: 1.391517 Jul 20 04:34:47.285799 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2048/3863] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:45 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1428 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:47.327110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-b856f370-6db1-4593-9d82-8eb5a443ad5f req-f0443764-55c1-4129-96a5-5ff7f1cf6cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2db32d6-491e-4d61-81b0-571b1c7073ff", "name": "network-vif-unplugged", "status": "completed", "tag": "44e02028-8e3e-412c-b0ec-8a5e5b769d7c"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:47.343894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-b856f370-6db1-4593-9d82-8eb5a443ad5f req-f0443764-55c1-4129-96a5-5ff7f1cf6cee service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.344872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-b856f370-6db1-4593-9d82-8eb5a443ad5f req-f0443764-55c1-4129-96a5-5ff7f1cf6cee service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.368494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=18 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:47.375299 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-b856f370-6db1-4593-9d82-8eb5a443ad5f req-f0443764-55c1-4129-96a5-5ff7f1cf6cee service nova] Creating event network-vif-unplugged:44e02028-8e3e-412c-b0ec-8a5e5b769d7c for instance f2db32d6-491e-4d61-81b0-571b1c7073ff on n-h1-826526-5 Jul 20 04:34:47.389796 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-b856f370-6db1-4593-9d82-8eb5a443ad5f req-f0443764-55c1-4129-96a5-5ff7f1cf6cee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100359 Jul 20 04:34:47.390896 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2049/3864] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:47.609188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a21d1343-976e-4c06-bd18-16524654773a tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:47.610491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a21d1343-976e-4c06-bd18-16524654773a tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:47.635759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a21d1343-976e-4c06-bd18-16524654773a tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.641081 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a21d1343-976e-4c06-bd18-16524654773a tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.642642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a21d1343-976e-4c06-bd18-16524654773a tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.644881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a21d1343-976e-4c06-bd18-16524654773a tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:48.095431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-754e4a6c-787b-4de1-9175-c6e2a1b06360 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f66821062041b8a6330b883de2754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f772f396147ea89da0f9f051d9fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:48.106068 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-754e4a6c-787b-4de1-9175-c6e2a1b06360 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989" status: 200 len: 1313 microversion: 2.1 time: 1.499041 Jul 20 04:34:48.114290 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1816/3865] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:46 2022] GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 => generated 1313 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:48.236130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a21d1343-976e-4c06-bd18-16524654773a tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:48.250782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a21d1343-976e-4c06-bd18-16524654773a tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:48.252579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a21d1343-976e-4c06-bd18-16524654773a tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:48.257509 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a21d1343-976e-4c06-bd18-16524654773a tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3" status: 200 len: 1362 microversion: 2.26 time: 0.653513 Jul 20 04:34:48.269938 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2050/3866] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:47 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3 => generated 1362 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:48.294222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-76513ac6-d850-4d69-96ca-a9ad62bbf3fd tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:48.295120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-76513ac6-d850-4d69-96ca-a9ad62bbf3fd tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:48.310921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76513ac6-d850-4d69-96ca-a9ad62bbf3fd tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:48.312596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76513ac6-d850-4d69-96ca-a9ad62bbf3fd tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:48.314301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76513ac6-d850-4d69-96ca-a9ad62bbf3fd tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:48.314952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76513ac6-d850-4d69-96ca-a9ad62bbf3fd tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:49.140962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f0999e3f-40ff-4b8b-8763-dea38a4c9be4 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:49.141870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f0999e3f-40ff-4b8b-8763-dea38a4c9be4 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:49.152685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0999e3f-40ff-4b8b-8763-dea38a4c9be4 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:49.153404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0999e3f-40ff-4b8b-8763-dea38a4c9be4 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:49.154592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0999e3f-40ff-4b8b-8763-dea38a4c9be4 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:49.160578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0999e3f-40ff-4b8b-8763-dea38a4c9be4 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:49.220184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-76513ac6-d850-4d69-96ca-a9ad62bbf3fd tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:49.244003 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-76513ac6-d850-4d69-96ca-a9ad62bbf3fd tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1428 microversion: 2.1 time: 0.953622 Jul 20 04:34:49.255743 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1817/3867] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:48 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1428 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:49.272424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e01db452-17a3-4ade-8036-3d1af81cd313 req-3180d29f-7951-4188-ac77-656e9aa12aec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b99493a-f245-4470-ae4f-a36b41b59989", "tag": "58b0b6a7-09ee-4dac-9463-8338167fe870"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:49.296292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e01db452-17a3-4ade-8036-3d1af81cd313 req-3180d29f-7951-4188-ac77-656e9aa12aec service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:49.297042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e01db452-17a3-4ade-8036-3d1af81cd313 req-3180d29f-7951-4188-ac77-656e9aa12aec service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:49.330548 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e01db452-17a3-4ade-8036-3d1af81cd313 req-3180d29f-7951-4188-ac77-656e9aa12aec service nova] Creating event network-changed:58b0b6a7-09ee-4dac-9463-8338167fe870 for instance 1b99493a-f245-4470-ae4f-a36b41b59989 on n-h2-826526-5 Jul 20 04:34:49.343389 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e01db452-17a3-4ade-8036-3d1af81cd313 req-3180d29f-7951-4188-ac77-656e9aa12aec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086222 Jul 20 04:34:49.344419 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1818/3868] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:49.361120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-73a4408d-f221-4a92-b8db-8b17b2267cd8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:49.362224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-73a4408d-f221-4a92-b8db-8b17b2267cd8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:49.374617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73a4408d-f221-4a92-b8db-8b17b2267cd8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:49.378859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73a4408d-f221-4a92-b8db-8b17b2267cd8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:49.380224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73a4408d-f221-4a92-b8db-8b17b2267cd8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:49.380932 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73a4408d-f221-4a92-b8db-8b17b2267cd8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:49.998721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f0999e3f-40ff-4b8b-8763-dea38a4c9be4 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f66821062041b8a6330b883de2754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f772f396147ea89da0f9f051d9fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:50.009879 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f0999e3f-40ff-4b8b-8763-dea38a4c9be4 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989" status: 200 len: 1313 microversion: 2.1 time: 0.873269 Jul 20 04:34:50.014179 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2051/3869] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:49 2022] GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 => generated 1313 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:50.032989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5a6113ae-e623-4fce-8596-fafc4e8addac tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1613569777", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "98d93fbd-2f1a-4407-af40-3f11d9b43323"}, {"port": "50ce2932-58a2-45c9-b274-8dcf3d6b3bef", "tag": "port-1"}, {"port": "c4064929-4a6b-4ed2-b2fd-7b46e126bcec", "tag": "port-2"}, {"uuid": "00fdda4a-9b19-486c-bb88-3ab05cae1b57", "tag": "net-1"}, {"uuid": "00fdda4a-9b19-486c-bb88-3ab05cae1b57"}, {"uuid": "84edf4db-f03e-4903-ba6f-aef4f9e2fe4a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "84edf4db-f03e-4903-ba6f-aef4f9e2fe4a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "be8d44ad-3510-4287-b65b-7e5de9de26bd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "cab7a5e2-ea40-4a0c-944f-f60c8bddc62d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "90a4e76a-1164-4f30-8b5e-3a5cd1ed5bb5", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1487713846"}], "key_name": "tempest-keypair-1488040510", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:50.220361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-73a4408d-f221-4a92-b8db-8b17b2267cd8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:50.241487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-73a4408d-f221-4a92-b8db-8b17b2267cd8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:50.263766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-73a4408d-f221-4a92-b8db-8b17b2267cd8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:50.269055 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-73a4408d-f221-4a92-b8db-8b17b2267cd8 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3" status: 200 len: 1362 microversion: 2.26 time: 0.919111 Jul 20 04:34:50.279950 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1819/3870] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:49 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3 => generated 1362 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:50.293636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-407c3f89-1b48-433f-90fb-3b8e2133f569 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a7c77bd-6adf-4ace-88ff-3c4e744fe03f", "device": "/dev/sdb"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:50.299625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-407c3f89-1b48-433f-90fb-3b8e2133f569 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:50.311989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-407c3f89-1b48-433f-90fb-3b8e2133f569 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.314266 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-407c3f89-1b48-433f-90fb-3b8e2133f569 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.318376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-407c3f89-1b48-433f-90fb-3b8e2133f569 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.320163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-407c3f89-1b48-433f-90fb-3b8e2133f569 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.411015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-5a6113ae-e623-4fce-8596-fafc4e8addac tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] validate_networks() for [('98d93fbd-2f1a-4407-af40-3f11d9b43323', None, None, None, None, None), (None, None, '50ce2932-58a2-45c9-b274-8dcf3d6b3bef', None, None, None), (None, None, 'c4064929-4a6b-4ed2-b2fd-7b46e126bcec', None, None, None), ('00fdda4a-9b19-486c-bb88-3ab05cae1b57', None, None, None, None, None), ('00fdda4a-9b19-486c-bb88-3ab05cae1b57', None, None, None, None, None), ('84edf4db-f03e-4903-ba6f-aef4f9e2fe4a', '10.2.2.100', None, None, None, None), ('84edf4db-f03e-4903-ba6f-aef4f9e2fe4a', '10.2.2.200', None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:34:50.844940 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-407c3f89-1b48-433f-90fb-3b8e2133f569 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "POST /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.567830 Jul 20 04:34:50.846262 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1820/3871] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 04:34:50 2022] POST /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e/os-volume_attachments => generated 194 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:50.873474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c712a942-a3ac-4b3e-8113-02463681f347 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:50.876234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c712a942-a3ac-4b3e-8113-02463681f347 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:50.920174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c712a942-a3ac-4b3e-8113-02463681f347 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.924153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c712a942-a3ac-4b3e-8113-02463681f347 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.935841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c712a942-a3ac-4b3e-8113-02463681f347 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.939230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c712a942-a3ac-4b3e-8113-02463681f347 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:51.316969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c712a942-a3ac-4b3e-8113-02463681f347 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:51.330441 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c712a942-a3ac-4b3e-8113-02463681f347 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1428 microversion: 2.1 time: 0.481549 Jul 20 04:34:51.340084 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1821/3872] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:50 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1428 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:51.352915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dab3fd88-bb92-4b89-a42c-bd8c97d8298d tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:51.353992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dab3fd88-bb92-4b89-a42c-bd8c97d8298d tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:51.373761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dab3fd88-bb92-4b89-a42c-bd8c97d8298d tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:51.377120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dab3fd88-bb92-4b89-a42c-bd8c97d8298d tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:51.381235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dab3fd88-bb92-4b89-a42c-bd8c97d8298d tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:51.382092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dab3fd88-bb92-4b89-a42c-bd8c97d8298d tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:52.486441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dab3fd88-bb92-4b89-a42c-bd8c97d8298d tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f66821062041b8a6330b883de2754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f772f396147ea89da0f9f051d9fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:52.496417 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dab3fd88-bb92-4b89-a42c-bd8c97d8298d tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989" status: 200 len: 1313 microversion: 2.1 time: 1.159436 Jul 20 04:34:52.503886 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1822/3873] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:51 2022] GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 => generated 1313 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:52.518260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-123ea798-e5d5-4c8b-a5bc-19d40a85fc76 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:52.520006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-123ea798-e5d5-4c8b-a5bc-19d40a85fc76 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:52.546885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-123ea798-e5d5-4c8b-a5bc-19d40a85fc76 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:52.547336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-123ea798-e5d5-4c8b-a5bc-19d40a85fc76 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:52.548120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-123ea798-e5d5-4c8b-a5bc-19d40a85fc76 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:52.548577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-123ea798-e5d5-4c8b-a5bc-19d40a85fc76 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:52.984614 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-123ea798-e5d5-4c8b-a5bc-19d40a85fc76 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:52.994225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-123ea798-e5d5-4c8b-a5bc-19d40a85fc76 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:53.000109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-123ea798-e5d5-4c8b-a5bc-19d40a85fc76 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:53.003744 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-123ea798-e5d5-4c8b-a5bc-19d40a85fc76 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3" status: 200 len: 1362 microversion: 2.26 time: 0.498512 Jul 20 04:34:53.006478 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1823/3874] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:52 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3 => generated 1362 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:53.022906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-bf5293e0-1e6f-44d5-9ac1-4a1b985aa7fa req-3afabaa7-5e51-4fc9-9d47-10bd7859db69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5723a8e0-f05f-4500-b469-dfac24f274e5", "tag": "c4b357f9-9159-4bdb-af37-462721b72996"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:53.062937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-bf5293e0-1e6f-44d5-9ac1-4a1b985aa7fa req-3afabaa7-5e51-4fc9-9d47-10bd7859db69 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.065567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-bf5293e0-1e6f-44d5-9ac1-4a1b985aa7fa req-3afabaa7-5e51-4fc9-9d47-10bd7859db69 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.075782 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:53.102392 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-bf5293e0-1e6f-44d5-9ac1-4a1b985aa7fa req-3afabaa7-5e51-4fc9-9d47-10bd7859db69 service nova] Creating event network-changed:c4b357f9-9159-4bdb-af37-462721b72996 for instance 5723a8e0-f05f-4500-b469-dfac24f274e5 on n-h1-826526-5 Jul 20 04:34:53.119476 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-bf5293e0-1e6f-44d5-9ac1-4a1b985aa7fa req-3afabaa7-5e51-4fc9-9d47-10bd7859db69 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108856 Jul 20 04:34:53.120851 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1824/3875] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:53.134636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-31b53b83-d987-4e0c-9011-77782aac71c4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:53.138868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-31b53b83-d987-4e0c-9011-77782aac71c4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:53.157267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31b53b83-d987-4e0c-9011-77782aac71c4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.161346 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31b53b83-d987-4e0c-9011-77782aac71c4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.163242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31b53b83-d987-4e0c-9011-77782aac71c4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.165356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31b53b83-d987-4e0c-9011-77782aac71c4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.601057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-31b53b83-d987-4e0c-9011-77782aac71c4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:53.613223 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-31b53b83-d987-4e0c-9011-77782aac71c4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1428 microversion: 2.1 time: 0.485576 Jul 20 04:34:53.614096 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1825/3876] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:53 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1428 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:53.626453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6af3df42-bbd3-4f05-a365-02c502cb8839 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:53.629392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6af3df42-bbd3-4f05-a365-02c502cb8839 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:53.639771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6af3df42-bbd3-4f05-a365-02c502cb8839 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.640942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6af3df42-bbd3-4f05-a365-02c502cb8839 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.643148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6af3df42-bbd3-4f05-a365-02c502cb8839 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.644106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6af3df42-bbd3-4f05-a365-02c502cb8839 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:54.435935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6af3df42-bbd3-4f05-a365-02c502cb8839 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f66821062041b8a6330b883de2754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f772f396147ea89da0f9f051d9fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:54.452141 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6af3df42-bbd3-4f05-a365-02c502cb8839 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989" status: 200 len: 1313 microversion: 2.1 time: 0.835490 Jul 20 04:34:54.454537 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1826/3877] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:53 2022] GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 => generated 1313 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:54.471616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4f9311ed-aaff-4eb9-85ff-bf37660a886d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:54.474265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4f9311ed-aaff-4eb9-85ff-bf37660a886d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:54.502310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f9311ed-aaff-4eb9-85ff-bf37660a886d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:54.502794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f9311ed-aaff-4eb9-85ff-bf37660a886d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:54.503604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f9311ed-aaff-4eb9-85ff-bf37660a886d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:54.504208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f9311ed-aaff-4eb9-85ff-bf37660a886d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:54.922655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4f9311ed-aaff-4eb9-85ff-bf37660a886d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:54.940339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4f9311ed-aaff-4eb9-85ff-bf37660a886d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:54.944721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4f9311ed-aaff-4eb9-85ff-bf37660a886d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:54.955796 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4f9311ed-aaff-4eb9-85ff-bf37660a886d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3" status: 200 len: 1362 microversion: 2.26 time: 0.499817 Jul 20 04:34:54.959485 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1827/3878] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:54 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3 => generated 1362 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:54.974647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8d51144e-6f25-4f56-bba5-10c234e8c9ca tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:54.983501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8d51144e-6f25-4f56-bba5-10c234e8c9ca tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:54.998390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:55.000069 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d51144e-6f25-4f56-bba5-10c234e8c9ca tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:55.006031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d51144e-6f25-4f56-bba5-10c234e8c9ca tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:55.007267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d51144e-6f25-4f56-bba5-10c234e8c9ca tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:55.007712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d51144e-6f25-4f56-bba5-10c234e8c9ca tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.251270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8d51144e-6f25-4f56-bba5-10c234e8c9ca tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:56.265911 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8d51144e-6f25-4f56-bba5-10c234e8c9ca tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1428 microversion: 2.1 time: 1.302188 Jul 20 04:34:56.270421 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1828/3879] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:54 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1428 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:56.283576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-c630e832-b9e9-47f5-affd-2338596eaad1 req-b0957fab-5730-460d-9a73-6a9a9b31384d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f22b3cf-7413-4a8e-971e-60c5f72f25c3", "name": "network-vif-plugged", "status": "completed", "tag": "efa36460-bce4-4fac-860d-23ab4044e65e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:56.298247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c630e832-b9e9-47f5-affd-2338596eaad1 req-b0957fab-5730-460d-9a73-6a9a9b31384d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.298707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c630e832-b9e9-47f5-affd-2338596eaad1 req-b0957fab-5730-460d-9a73-6a9a9b31384d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.346649 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-c630e832-b9e9-47f5-affd-2338596eaad1 req-b0957fab-5730-460d-9a73-6a9a9b31384d service nova] Creating event network-vif-plugged:efa36460-bce4-4fac-860d-23ab4044e65e for instance 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 on n-h2-826526-5 Jul 20 04:34:56.362668 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-c630e832-b9e9-47f5-affd-2338596eaad1 req-b0957fab-5730-460d-9a73-6a9a9b31384d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090830 Jul 20 04:34:56.363514 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1829/3880] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:56.374170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-57cb582f-29ce-4eef-8974-5e76c8068c76 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:56.376966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-57cb582f-29ce-4eef-8974-5e76c8068c76 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:56.421119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57cb582f-29ce-4eef-8974-5e76c8068c76 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.421847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57cb582f-29ce-4eef-8974-5e76c8068c76 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.422968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57cb582f-29ce-4eef-8974-5e76c8068c76 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.424349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57cb582f-29ce-4eef-8974-5e76c8068c76 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.463078 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-57cb582f-29ce-4eef-8974-5e76c8068c76 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] HTTP exception thrown: Instance 0af76412-dcc5-4a08-8492-910e244a4ede could not be found. Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-57cb582f-29ce-4eef-8974-5e76c8068c76 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Request method failure captured: Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede HTTP/1.1 Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14PJnAd5Cv8FkRavfjEsyDoUjIDGTtg9gA8bC6X1J-8QElL1k8d4BXOaDJnGsegwi7ftwRTm1G24aWCRaNlCFsjRJ8CTzHKTIJhGZ8i10StjYdlCynXY87weXCbDHtSuiyO7eU_6IZ6zjAB50vx2hii0OfNTDAF7BPZcFvnPC2Nmokg Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.32 Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 85cca0080e7e458ab2569764f77b8c71 Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TaggedBootDevicesTest-894115946 Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85cca0080e7e458ab2569764f77b8c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/85cca0080e7e458ab2569764f77b8c71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_85cca0080e7e458ab2569764f77b8c71", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85cca0080e7e458ab2569764f77b8c71"}]}] Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TaggedBootDevicesTest-894115946 Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 85cca0080e7e458ab2569764f77b8c71 Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TaggedBootDevicesTest-894115946 Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TaggedBootDevicesTest-894115946-project Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 7e9b9e0c72784fca90beb852a0957789 Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TaggedBootDevicesTest-894115946-project Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 0af76412-dcc5-4a08-8492-910e244a4ede could not be found. Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '0af76412-dcc5-4a08-8492-910e244a4ede'} Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0af76412-dcc5-4a08-8492-910e244a4ede could not be found. Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:56.468488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:56.473370 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0af76412-dcc5-4a08-8492-910e244a4ede could not be found. Jul 20 04:34:56.473370 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:34:56.473370 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:56.473370 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:34:56.473370 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:56.473370 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:56.473370 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:56.473370 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:56.473370 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:56.473370 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0af76412-dcc5-4a08-8492-910e244a4ede could not be found. Jul 20 04:34:56.473370 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:34:56.478725 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-57cb582f-29ce-4eef-8974-5e76c8068c76 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Returning 404 to user: Instance 0af76412-dcc5-4a08-8492-910e244a4ede could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:56.479943 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-57cb582f-29ce-4eef-8974-5e76c8068c76 tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 404 len: 111 microversion: 2.32 time: 0.115300 Jul 20 04:34:56.483476 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1830/3881] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:34:56 2022] DELETE /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:34:56.496843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e07b7613-c297-4675-83a5-95111572327b tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:56.499239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e07b7613-c297-4675-83a5-95111572327b tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:56.512376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e07b7613-c297-4675-83a5-95111572327b tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.515629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e07b7613-c297-4675-83a5-95111572327b tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.518236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e07b7613-c297-4675-83a5-95111572327b tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.518910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e07b7613-c297-4675-83a5-95111572327b tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.837175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e07b7613-c297-4675-83a5-95111572327b tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f66821062041b8a6330b883de2754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f772f396147ea89da0f9f051d9fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:56.850011 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e07b7613-c297-4675-83a5-95111572327b tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989" status: 200 len: 1313 microversion: 2.1 time: 0.365112 Jul 20 04:34:56.851186 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1831/3882] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:56 2022] GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:56.865599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3a6a6269-28bc-43ce-b536-f85c8c34dfc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:56.866568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3a6a6269-28bc-43ce-b536-f85c8c34dfc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:56.878311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a6a6269-28bc-43ce-b536-f85c8c34dfc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.879145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a6a6269-28bc-43ce-b536-f85c8c34dfc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.880207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a6a6269-28bc-43ce-b536-f85c8c34dfc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.880922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a6a6269-28bc-43ce-b536-f85c8c34dfc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.914828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-5a6113ae-e623-4fce-8596-fafc4e8addac tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:34:56.916490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-5a6113ae-e623-4fce-8596-fafc4e8addac tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:34:56.917050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-5a6113ae-e623-4fce-8596-fafc4e8addac tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:34:56.917486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-5a6113ae-e623-4fce-8596-fafc4e8addac tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:34:56.917946 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-5a6113ae-e623-4fce-8596-fafc4e8addac tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:34:56.934496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a6113ae-e623-4fce-8596-fafc4e8addac tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.937279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a6113ae-e623-4fce-8596-fafc4e8addac tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.938133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a6113ae-e623-4fce-8596-fafc4e8addac tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.938579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a6113ae-e623-4fce-8596-fafc4e8addac tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.959252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:56.973093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-5a6113ae-e623-4fce-8596-fafc4e8addac tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Getting quotas for project 4689a1d17c764689be54e7506f1ab82f. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:56.982035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-5a6113ae-e623-4fce-8596-fafc4e8addac tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Getting quotas for user 9d9c9a24493b4f2299dffb11b8addc4d and project 4689a1d17c764689be54e7506f1ab82f. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:57.228047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3a6a6269-28bc-43ce-b536-f85c8c34dfc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:57.240314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3a6a6269-28bc-43ce-b536-f85c8c34dfc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:57.248966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3a6a6269-28bc-43ce-b536-f85c8c34dfc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:57.252004 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3a6a6269-28bc-43ce-b536-f85c8c34dfc6 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3" status: 200 len: 1362 microversion: 2.26 time: 0.390366 Jul 20 04:34:57.253616 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1832/3883] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:56 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3 => generated 1362 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:57.259476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c3bb86a3-174b-4733-9f29-26dae9bf8d7e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:57.260715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c3bb86a3-174b-4733-9f29-26dae9bf8d7e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] [instance: 0af76412-dcc5-4a08-8492-910e244a4ede] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:57.267913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3bb86a3-174b-4733-9f29-26dae9bf8d7e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:57.268877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3bb86a3-174b-4733-9f29-26dae9bf8d7e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:57.270671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3bb86a3-174b-4733-9f29-26dae9bf8d7e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:57.271499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3bb86a3-174b-4733-9f29-26dae9bf8d7e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:57.294589 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-c3bb86a3-174b-4733-9f29-26dae9bf8d7e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] HTTP exception thrown: Instance 0af76412-dcc5-4a08-8492-910e244a4ede could not be found. Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c3bb86a3-174b-4733-9f29-26dae9bf8d7e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Request method failure captured: Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede HTTP/1.1 Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14PJnAd5Cv8FkRavfjEsyDoUjIDGTtg9gA8bC6X1J-8QElL1k8d4BXOaDJnGsegwi7ftwRTm1G24aWCRaNlCFsjRJ8CTzHKTIJhGZ8i10StjYdlCynXY87weXCbDHtSuiyO7eU_6IZ6zjAB50vx2hii0OfNTDAF7BPZcFvnPC2Nmokg Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.32 Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 85cca0080e7e458ab2569764f77b8c71 Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TaggedBootDevicesTest-894115946 Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85cca0080e7e458ab2569764f77b8c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/85cca0080e7e458ab2569764f77b8c71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_85cca0080e7e458ab2569764f77b8c71", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85cca0080e7e458ab2569764f77b8c71"}]}] Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TaggedBootDevicesTest-894115946 Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 85cca0080e7e458ab2569764f77b8c71 Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TaggedBootDevicesTest-894115946 Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TaggedBootDevicesTest-894115946-project Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 7e9b9e0c72784fca90beb852a0957789 Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TaggedBootDevicesTest-894115946-project Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 0af76412-dcc5-4a08-8492-910e244a4ede could not be found. Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '0af76412-dcc5-4a08-8492-910e244a4ede'} Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0af76412-dcc5-4a08-8492-910e244a4ede could not be found. Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0af76412-dcc5-4a08-8492-910e244a4ede could not be found. Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:57.296675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:34:57.302283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:57.302283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:57.302283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:57.302283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:57.302283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:57.302283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0af76412-dcc5-4a08-8492-910e244a4ede could not be found. Jul 20 04:34:57.302283 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:34:57.303375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c3bb86a3-174b-4733-9f29-26dae9bf8d7e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] Returning 404 to user: Instance 0af76412-dcc5-4a08-8492-910e244a4ede could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:57.304506 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c3bb86a3-174b-4733-9f29-26dae9bf8d7e tempest-TaggedBootDevicesTest-894115946 tempest-TaggedBootDevicesTest-894115946-project] 10.222.0.17 "GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede" status: 404 len: 111 microversion: 2.32 time: 0.049542 Jul 20 04:34:57.305456 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1833/3884] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:57 2022] GET /compute/v2.1/servers/0af76412-dcc5-4a08-8492-910e244a4ede => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:34:57.310523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5a6113ae-e623-4fce-8596-fafc4e8addac tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:34:57.311877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4f49a99b-f4d6-49fe-8c41-005067b174b9 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:57.312806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4f49a99b-f4d6-49fe-8c41-005067b174b9 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:57.313704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5a6113ae-e623-4fce-8596-fafc4e8addac tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='be8d44ad-3510-4287-b65b-7e5de9de26bd',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='cab7a5e2-ea40-4a0c-944f-f60c8bddc62d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='90a4e76a-1164-4f30-8b5e-3a5cd1ed5bb5',volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:34:57.323120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f49a99b-f4d6-49fe-8c41-005067b174b9 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:57.323834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f49a99b-f4d6-49fe-8c41-005067b174b9 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:57.324920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f49a99b-f4d6-49fe-8c41-005067b174b9 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:57.325572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f49a99b-f4d6-49fe-8c41-005067b174b9 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:57.583963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4f49a99b-f4d6-49fe-8c41-005067b174b9 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:57.599925 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4f49a99b-f4d6-49fe-8c41-005067b174b9 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1428 microversion: 2.1 time: 0.292229 Jul 20 04:34:57.613480 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1834/3885] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:57 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1428 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:57.870870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-09069176-a4c7-4b85-aad9-d20b1feef7f0 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:57.872297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-09069176-a4c7-4b85-aad9-d20b1feef7f0 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:57.896810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09069176-a4c7-4b85-aad9-d20b1feef7f0 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:57.897552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09069176-a4c7-4b85-aad9-d20b1feef7f0 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:57.898519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09069176-a4c7-4b85-aad9-d20b1feef7f0 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:57.899102 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09069176-a4c7-4b85-aad9-d20b1feef7f0 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:58.220622 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-09069176-a4c7-4b85-aad9-d20b1feef7f0 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f66821062041b8a6330b883de2754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f772f396147ea89da0f9f051d9fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:58.232545 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-09069176-a4c7-4b85-aad9-d20b1feef7f0 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989" status: 200 len: 1313 microversion: 2.1 time: 0.368339 Jul 20 04:34:58.255464 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1835/3886] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:57 2022] GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:58.261420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:58.276721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8bbd0d28-3cfe-4d0e-81cf-c2882fd0c03f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:58.278255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8bbd0d28-3cfe-4d0e-81cf-c2882fd0c03f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:58.289232 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8bbd0d28-3cfe-4d0e-81cf-c2882fd0c03f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:58.289976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8bbd0d28-3cfe-4d0e-81cf-c2882fd0c03f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:58.291376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8bbd0d28-3cfe-4d0e-81cf-c2882fd0c03f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:58.292286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8bbd0d28-3cfe-4d0e-81cf-c2882fd0c03f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:58.480548 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5a6113ae-e623-4fce-8596-fafc4e8addac tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 8.460844 Jul 20 04:34:58.519507 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2052/3887] 10.222.0.17 () {62 vars in 1188 bytes} [Wed Jul 20 04:34:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 8499 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:34:58.524116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-99826597-443a-401f-b1a8-a5e25d19fbec req-fd1f07ca-4765-4911-88f0-cc5f3e8943fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2db32d6-491e-4d61-81b0-571b1c7073ff", "name": "network-vif-plugged", "status": "completed", "tag": "44e02028-8e3e-412c-b0ec-8a5e5b769d7c"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:58.575845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-99826597-443a-401f-b1a8-a5e25d19fbec req-fd1f07ca-4765-4911-88f0-cc5f3e8943fc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:58.581985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-99826597-443a-401f-b1a8-a5e25d19fbec req-fd1f07ca-4765-4911-88f0-cc5f3e8943fc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:58.607460 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-99826597-443a-401f-b1a8-a5e25d19fbec req-fd1f07ca-4765-4911-88f0-cc5f3e8943fc service nova] Creating event network-vif-plugged:44e02028-8e3e-412c-b0ec-8a5e5b769d7c for instance f2db32d6-491e-4d61-81b0-571b1c7073ff on n-h1-826526-5 Jul 20 04:34:58.618639 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-99826597-443a-401f-b1a8-a5e25d19fbec req-fd1f07ca-4765-4911-88f0-cc5f3e8943fc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102704 Jul 20 04:34:58.623889 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2053/3888] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:58.668761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-44af6501-ecc2-46c5-8fea-cb24e2601806 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:58.669744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-44af6501-ecc2-46c5-8fea-cb24e2601806 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:58.752848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8bbd0d28-3cfe-4d0e-81cf-c2882fd0c03f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:58.779722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8bbd0d28-3cfe-4d0e-81cf-c2882fd0c03f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:58.785620 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8bbd0d28-3cfe-4d0e-81cf-c2882fd0c03f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:58.790347 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8bbd0d28-3cfe-4d0e-81cf-c2882fd0c03f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3" status: 200 len: 1545 microversion: 2.26 time: 0.521301 Jul 20 04:34:58.793888 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1836/3889] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:58 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3 => generated 1545 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:58.808937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dcdd51db-c017-4a2d-bfbc-5e8b2b9e35f1 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:58.814652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dcdd51db-c017-4a2d-bfbc-5e8b2b9e35f1 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:58.838786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcdd51db-c017-4a2d-bfbc-5e8b2b9e35f1 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:58.843318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcdd51db-c017-4a2d-bfbc-5e8b2b9e35f1 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:58.847391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcdd51db-c017-4a2d-bfbc-5e8b2b9e35f1 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:58.848443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcdd51db-c017-4a2d-bfbc-5e8b2b9e35f1 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:58.913758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-44af6501-ecc2-46c5-8fea-cb24e2601806 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:58.927356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-44af6501-ecc2-46c5-8fea-cb24e2601806 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:58.934026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-44af6501-ecc2-46c5-8fea-cb24e2601806 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:58.937836 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-44af6501-ecc2-46c5-8fea-cb24e2601806 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1286 microversion: 2.42 time: 0.309066 Jul 20 04:34:58.938478 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2054/3890] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:58 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1286 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:58.964440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-56e61446-e359-464a-a263-45a515cf8204 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '.version_select at 0x7f06bd2593a0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:58.991077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56e61446-e359-464a-a263-45a515cf8204 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:58.992275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56e61446-e359-464a-a263-45a515cf8204 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:58.992893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-56e61446-e359-464a-a263-45a515cf8204 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:59.004347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56e61446-e359-464a-a263-45a515cf8204 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.004347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56e61446-e359-464a-a263-45a515cf8204 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.004347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56e61446-e359-464a-a263-45a515cf8204 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.004347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56e61446-e359-464a-a263-45a515cf8204 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.049940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56e61446-e359-464a-a263-45a515cf8204 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.050418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56e61446-e359-464a-a263-45a515cf8204 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.080684 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56e61446-e359-464a-a263-45a515cf8204 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.080978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56e61446-e359-464a-a263-45a515cf8204 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.156537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-56e61446-e359-464a-a263-45a515cf8204 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lazy-loading 'flavor' on Instance uuid 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:34:59.186109 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-56e61446-e359-464a-a263-45a515cf8204 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "PUT /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags/tempest-tag-1307103456" status: 201 len: 0 microversion: 2.26 time: 0.246111 Jul 20 04:34:59.187286 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2055/3891] 10.222.0.17 () {62 vars in 1379 bytes} [Wed Jul 20 04:34:58 2022] PUT /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags/tempest-tag-1307103456 => generated 0 bytes in 248 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 20 04:34:59.210737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-56e42f12-8ebe-4b5d-aab4-b41589aa1b16 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '.version_select at 0x7f06bd259dc0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:59.237938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56e42f12-8ebe-4b5d-aab4-b41589aa1b16 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.248976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56e42f12-8ebe-4b5d-aab4-b41589aa1b16 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.292186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dcdd51db-c017-4a2d-bfbc-5e8b2b9e35f1 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:59.303103 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-56e42f12-8ebe-4b5d-aab4-b41589aa1b16 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags/tempest-tag-1307103456" status: 204 len: 0 microversion: 2.26 time: 0.104923 Jul 20 04:34:59.303975 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2056/3892] 10.222.0.17 () {60 vars in 1360 bytes} [Wed Jul 20 04:34:59 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags/tempest-tag-1307103456 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:34:59.313875 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dcdd51db-c017-4a2d-bfbc-5e8b2b9e35f1 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1428 microversion: 2.1 time: 0.515890 Jul 20 04:34:59.315217 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1837/3893] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:58 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1428 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:59.325350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0ff729e5-8642-4e8a-9526-5e1cf00dddfb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '.version_select at 0x7f06bd208940>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:59.330958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d45c6fe2-8187-4f00-b1e0-17ac4d8912c3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:59.331591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d45c6fe2-8187-4f00-b1e0-17ac4d8912c3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:59.343687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ff729e5-8642-4e8a-9526-5e1cf00dddfb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.344838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ff729e5-8642-4e8a-9526-5e1cf00dddfb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.345896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0ff729e5-8642-4e8a-9526-5e1cf00dddfb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:59.346976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d45c6fe2-8187-4f00-b1e0-17ac4d8912c3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.347438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d45c6fe2-8187-4f00-b1e0-17ac4d8912c3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.348342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d45c6fe2-8187-4f00-b1e0-17ac4d8912c3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.348876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d45c6fe2-8187-4f00-b1e0-17ac4d8912c3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.370415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ff729e5-8642-4e8a-9526-5e1cf00dddfb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.371564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ff729e5-8642-4e8a-9526-5e1cf00dddfb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.373391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ff729e5-8642-4e8a-9526-5e1cf00dddfb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.374187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ff729e5-8642-4e8a-9526-5e1cf00dddfb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.407858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ff729e5-8642-4e8a-9526-5e1cf00dddfb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.409155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ff729e5-8642-4e8a-9526-5e1cf00dddfb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.465906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-0ff729e5-8642-4e8a-9526-5e1cf00dddfb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lazy-loading 'flavor' on Instance uuid 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:34:59.492224 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0ff729e5-8642-4e8a-9526-5e1cf00dddfb tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags" status: 204 len: 0 microversion: 2.26 time: 0.175066 Jul 20 04:34:59.503333 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1838/3894] 10.222.0.17 () {60 vars in 1294 bytes} [Wed Jul 20 04:34:59 2022] DELETE /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:34:59.519068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-306d9e35-2272-459c-8f51-98f947cdc817 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '.version_select at 0x7f06bd1415e0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:59.545715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-306d9e35-2272-459c-8f51-98f947cdc817 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.549259 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-306d9e35-2272-459c-8f51-98f947cdc817 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.584176 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-306d9e35-2272-459c-8f51-98f947cdc817 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags" status: 200 len: 12 microversion: 2.26 time: 0.073840 Jul 20 04:34:59.593229 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1839/3895] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Jul 20 04:34:59 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags => generated 12 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:59.601305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-93e012ae-033b-4480-993c-7ae9ab835d02 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '.version_select at 0x7f06bd141160>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:59.649776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93e012ae-033b-4480-993c-7ae9ab835d02 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.650243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93e012ae-033b-4480-993c-7ae9ab835d02 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.650994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-93e012ae-033b-4480-993c-7ae9ab835d02 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:59.667211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93e012ae-033b-4480-993c-7ae9ab835d02 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.667934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93e012ae-033b-4480-993c-7ae9ab835d02 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.669140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93e012ae-033b-4480-993c-7ae9ab835d02 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.669857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93e012ae-033b-4480-993c-7ae9ab835d02 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.758920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93e012ae-033b-4480-993c-7ae9ab835d02 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.759532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93e012ae-033b-4480-993c-7ae9ab835d02 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.783226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93e012ae-033b-4480-993c-7ae9ab835d02 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.783562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93e012ae-033b-4480-993c-7ae9ab835d02 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.872464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-93e012ae-033b-4480-993c-7ae9ab835d02 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lazy-loading 'flavor' on Instance uuid 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:34:59.880981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d45c6fe2-8187-4f00-b1e0-17ac4d8912c3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f66821062041b8a6330b883de2754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f772f396147ea89da0f9f051d9fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:59.902151 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d45c6fe2-8187-4f00-b1e0-17ac4d8912c3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989" status: 200 len: 1313 microversion: 2.1 time: 0.596344 Jul 20 04:34:59.904221 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-93e012ae-033b-4480-993c-7ae9ab835d02 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "PUT /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags/tempest-tag-1950720037" status: 201 len: 0 microversion: 2.26 time: 0.308681 Jul 20 04:34:59.906190 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1840/3896] 10.222.0.17 () {62 vars in 1379 bytes} [Wed Jul 20 04:34:59 2022] PUT /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags/tempest-tag-1950720037 => generated 0 bytes in 312 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 20 04:34:59.922768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2c56d390-b292-4ab8-8b25-39ac58a1b788 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '.version_select at 0x7f06bd141820>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:59.924615 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2057/3897] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:59 2022] GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 => generated 1313 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:59.944139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c56d390-b292-4ab8-8b25-39ac58a1b788 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.944976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c56d390-b292-4ab8-8b25-39ac58a1b788 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.971909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d761b99a-c7bf-4444-8e45-b3aa793fcc0b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:59.972570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d761b99a-c7bf-4444-8e45-b3aa793fcc0b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:59.987829 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2c56d390-b292-4ab8-8b25-39ac58a1b788 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags" status: 200 len: 36 microversion: 2.26 time: 0.069151 Jul 20 04:34:59.995500 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1841/3898] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Jul 20 04:34:59 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags => generated 36 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:00.013554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-40c9884a-9222-41f2-8a74-6d895202651d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '.version_select at 0x7f06bd1baf70>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:00.039186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40c9884a-9222-41f2-8a74-6d895202651d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.039877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40c9884a-9222-41f2-8a74-6d895202651d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.040560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-40c9884a-9222-41f2-8a74-6d895202651d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:00.058890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d761b99a-c7bf-4444-8e45-b3aa793fcc0b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:00.060828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40c9884a-9222-41f2-8a74-6d895202651d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.061530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40c9884a-9222-41f2-8a74-6d895202651d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.062475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40c9884a-9222-41f2-8a74-6d895202651d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.063061 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40c9884a-9222-41f2-8a74-6d895202651d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.067782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d761b99a-c7bf-4444-8e45-b3aa793fcc0b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:00.071339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d761b99a-c7bf-4444-8e45-b3aa793fcc0b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:00.072981 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d761b99a-c7bf-4444-8e45-b3aa793fcc0b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1286 microversion: 2.42 time: 0.105071 Jul 20 04:35:00.074300 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2058/3899] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:59 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:00.097137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:00.101450 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40c9884a-9222-41f2-8a74-6d895202651d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.102270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40c9884a-9222-41f2-8a74-6d895202651d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.164855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-40c9884a-9222-41f2-8a74-6d895202651d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lazy-loading 'flavor' on Instance uuid 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:00.225305 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-40c9884a-9222-41f2-8a74-6d895202651d tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags/tempest-tag-1950720037" status: 204 len: 0 microversion: 2.26 time: 0.228541 Jul 20 04:35:00.226584 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1842/3900] 10.222.0.17 () {60 vars in 1363 bytes} [Wed Jul 20 04:34:59 2022] DELETE /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags/tempest-tag-1950720037 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:35:00.245315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-130f7e28-3ca1-4972-a741-3ed9e0a4ba35 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '.version_select at 0x7f06bd30c4c0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:00.276465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-130f7e28-3ca1-4972-a741-3ed9e0a4ba35 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.282945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-130f7e28-3ca1-4972-a741-3ed9e0a4ba35 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.308555 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-130f7e28-3ca1-4972-a741-3ed9e0a4ba35 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags" status: 200 len: 12 microversion: 2.26 time: 0.076478 Jul 20 04:35:00.327155 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2059/3901] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Jul 20 04:35:00 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags => generated 12 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:00.334433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f434aa4c-c9f7-43be-8058-f70ee07e8856 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '.version_select at 0x7f06bd1ba8b0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:00.341925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e28641b4-b454-449f-84f8-81409f663ec4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:00.346127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e28641b4-b454-449f-84f8-81409f663ec4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:00.349331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f434aa4c-c9f7-43be-8058-f70ee07e8856 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.349798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f434aa4c-c9f7-43be-8058-f70ee07e8856 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.350298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f434aa4c-c9f7-43be-8058-f70ee07e8856 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:00.365942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f434aa4c-c9f7-43be-8058-f70ee07e8856 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.366407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f434aa4c-c9f7-43be-8058-f70ee07e8856 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.367296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f434aa4c-c9f7-43be-8058-f70ee07e8856 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.367650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f434aa4c-c9f7-43be-8058-f70ee07e8856 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.375139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e28641b4-b454-449f-84f8-81409f663ec4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.376961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e28641b4-b454-449f-84f8-81409f663ec4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.379112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e28641b4-b454-449f-84f8-81409f663ec4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.381876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e28641b4-b454-449f-84f8-81409f663ec4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.440323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f434aa4c-c9f7-43be-8058-f70ee07e8856 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.440805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f434aa4c-c9f7-43be-8058-f70ee07e8856 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.465657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-f434aa4c-c9f7-43be-8058-f70ee07e8856 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lazy-loading 'flavor' on Instance uuid 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:00.505800 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f434aa4c-c9f7-43be-8058-f70ee07e8856 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags" status: 204 len: 0 microversion: 2.26 time: 0.180148 Jul 20 04:35:00.513004 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1843/3902] 10.222.0.17 () {60 vars in 1294 bytes} [Wed Jul 20 04:35:00 2022] DELETE /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 04:35:00.523305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-884f65ee-648a-42ac-bb0d-67c7a5a9924f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '.version_select at 0x7f06bd1c1310>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:00.538044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-884f65ee-648a-42ac-bb0d-67c7a5a9924f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.538886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-884f65ee-648a-42ac-bb0d-67c7a5a9924f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.539649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-884f65ee-648a-42ac-bb0d-67c7a5a9924f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:00.555355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-884f65ee-648a-42ac-bb0d-67c7a5a9924f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.558965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-884f65ee-648a-42ac-bb0d-67c7a5a9924f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.565086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-884f65ee-648a-42ac-bb0d-67c7a5a9924f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.569037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-884f65ee-648a-42ac-bb0d-67c7a5a9924f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.613118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-884f65ee-648a-42ac-bb0d-67c7a5a9924f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.614230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-884f65ee-648a-42ac-bb0d-67c7a5a9924f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.632001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-884f65ee-648a-42ac-bb0d-67c7a5a9924f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.632755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-884f65ee-648a-42ac-bb0d-67c7a5a9924f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.671244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-884f65ee-648a-42ac-bb0d-67c7a5a9924f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lazy-loading 'flavor' on Instance uuid 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:00.719095 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-884f65ee-648a-42ac-bb0d-67c7a5a9924f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "PUT /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags/tempest-tag-1613748116" status: 201 len: 0 microversion: 2.26 time: 0.203362 Jul 20 04:35:00.724189 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1844/3903] 10.222.0.17 () {62 vars in 1379 bytes} [Wed Jul 20 04:35:00 2022] PUT /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags/tempest-tag-1613748116 => generated 0 bytes in 208 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 20 04:35:00.748934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-14c1c3f3-b7fc-4b40-9e22-541a743d7d5f req-0340598c-a1c5-4d7d-8256-d62d0a90a1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b99493a-f245-4470-ae4f-a36b41b59989", "name": "network-vif-plugged", "status": "completed", "tag": "58b0b6a7-09ee-4dac-9463-8338167fe870"}, {"server_uuid": "5723a8e0-f05f-4500-b469-dfac24f274e5", "name": "network-vif-plugged", "status": "completed", "tag": "c4b357f9-9159-4bdb-af37-462721b72996"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:00.779349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e28641b4-b454-449f-84f8-81409f663ec4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:00.779962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-14c1c3f3-b7fc-4b40-9e22-541a743d7d5f req-0340598c-a1c5-4d7d-8256-d62d0a90a1f8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.781091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-14c1c3f3-b7fc-4b40-9e22-541a743d7d5f req-0340598c-a1c5-4d7d-8256-d62d0a90a1f8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.800277 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e28641b4-b454-449f-84f8-81409f663ec4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1428 microversion: 2.1 time: 0.470490 Jul 20 04:35:00.805427 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2060/3904] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:00 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1428 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:00.830325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4e29bf12-ddef-4b2f-ac55-5943be63c6a9 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '.version_select at 0x7f06bd30c9d0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:00.833334 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-14c1c3f3-b7fc-4b40-9e22-541a743d7d5f req-0340598c-a1c5-4d7d-8256-d62d0a90a1f8 service nova] Creating event network-vif-plugged:58b0b6a7-09ee-4dac-9463-8338167fe870 for instance 1b99493a-f245-4470-ae4f-a36b41b59989 on n-h2-826526-5 Jul 20 04:35:00.834662 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-14c1c3f3-b7fc-4b40-9e22-541a743d7d5f req-0340598c-a1c5-4d7d-8256-d62d0a90a1f8 service nova] Creating event network-vif-plugged:c4b357f9-9159-4bdb-af37-462721b72996 for instance 5723a8e0-f05f-4500-b469-dfac24f274e5 on n-h1-826526-5 Jul 20 04:35:00.882605 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-14c1c3f3-b7fc-4b40-9e22-541a743d7d5f req-0340598c-a1c5-4d7d-8256-d62d0a90a1f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.155452 Jul 20 04:35:00.883559 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1845/3905] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:00.906325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e29bf12-ddef-4b2f-ac55-5943be63c6a9 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.908291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e29bf12-ddef-4b2f-ac55-5943be63c6a9 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.909536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4e29bf12-ddef-4b2f-ac55-5943be63c6a9 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:00.946236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-03f5a6c2-f7ab-456f-80e5-a7b8a3e4f9f3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:00.947882 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-03f5a6c2-f7ab-456f-80e5-a7b8a3e4f9f3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:00.952751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e29bf12-ddef-4b2f-ac55-5943be63c6a9 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.958814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e29bf12-ddef-4b2f-ac55-5943be63c6a9 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.964442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e29bf12-ddef-4b2f-ac55-5943be63c6a9 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.967130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e29bf12-ddef-4b2f-ac55-5943be63c6a9 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.983694 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03f5a6c2-f7ab-456f-80e5-a7b8a3e4f9f3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.001160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03f5a6c2-f7ab-456f-80e5-a7b8a3e4f9f3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.004963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03f5a6c2-f7ab-456f-80e5-a7b8a3e4f9f3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.008627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03f5a6c2-f7ab-456f-80e5-a7b8a3e4f9f3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.097924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e29bf12-ddef-4b2f-ac55-5943be63c6a9 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.106540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e29bf12-ddef-4b2f-ac55-5943be63c6a9 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.148658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e29bf12-ddef-4b2f-ac55-5943be63c6a9 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.149121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e29bf12-ddef-4b2f-ac55-5943be63c6a9 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.229388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-4e29bf12-ddef-4b2f-ac55-5943be63c6a9 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lazy-loading 'flavor' on Instance uuid 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:01.279577 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4e29bf12-ddef-4b2f-ac55-5943be63c6a9 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "PUT /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags/tempest-tag-677723177" status: 201 len: 0 microversion: 2.26 time: 0.463171 Jul 20 04:35:01.285866 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2061/3906] 10.222.0.17 () {62 vars in 1376 bytes} [Wed Jul 20 04:35:00 2022] PUT /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags/tempest-tag-677723177 => generated 0 bytes in 474 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 20 04:35:01.287162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6d08b38c-af46-4d79-9ac6-032c6031ac5c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:01.298495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6d08b38c-af46-4d79-9ac6-032c6031ac5c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:01.509363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6d08b38c-af46-4d79-9ac6-032c6031ac5c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:01.524534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6d08b38c-af46-4d79-9ac6-032c6031ac5c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:01.527263 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6d08b38c-af46-4d79-9ac6-032c6031ac5c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:01.532936 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6d08b38c-af46-4d79-9ac6-032c6031ac5c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1286 microversion: 2.42 time: 0.247906 Jul 20 04:35:01.537078 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2062/3907] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:01 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1286 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:01.555640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dc4b2e6b-06e6-45d3-b222-f999ff7dc831 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '.version_select at 0x7f06bd30c310>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:01.599127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc4b2e6b-06e6-45d3-b222-f999ff7dc831 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.600011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc4b2e6b-06e6-45d3-b222-f999ff7dc831 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.604190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dc4b2e6b-06e6-45d3-b222-f999ff7dc831 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:01.650267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc4b2e6b-06e6-45d3-b222-f999ff7dc831 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.652055 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc4b2e6b-06e6-45d3-b222-f999ff7dc831 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.658947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-03f5a6c2-f7ab-456f-80e5-a7b8a3e4f9f3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f66821062041b8a6330b883de2754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f772f396147ea89da0f9f051d9fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:01.668920 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-03f5a6c2-f7ab-456f-80e5-a7b8a3e4f9f3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989" status: 200 len: 1313 microversion: 2.1 time: 0.739979 Jul 20 04:35:01.669200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc4b2e6b-06e6-45d3-b222-f999ff7dc831 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.669894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc4b2e6b-06e6-45d3-b222-f999ff7dc831 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.687281 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1846/3908] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:00 2022] GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 => generated 1313 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:01.744080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc4b2e6b-06e6-45d3-b222-f999ff7dc831 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.744080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc4b2e6b-06e6-45d3-b222-f999ff7dc831 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.795384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-dc4b2e6b-06e6-45d3-b222-f999ff7dc831 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lazy-loading 'flavor' on Instance uuid 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:01.819573 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dc4b2e6b-06e6-45d3-b222-f999ff7dc831 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags" status: 204 len: 0 microversion: 2.26 time: 0.281079 Jul 20 04:35:01.820935 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2063/3909] 10.222.0.17 () {60 vars in 1294 bytes} [Wed Jul 20 04:35:01 2022] DELETE /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:35:01.835252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-21389774-87a1-4a81-a65c-496a79de6bff tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:01.835481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-68e98372-32c0-4099-a926-e1ffd69805a9 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '.version_select at 0x7f06bd279c10>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:01.840530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-21389774-87a1-4a81-a65c-496a79de6bff tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:01.854433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-21389774-87a1-4a81-a65c-496a79de6bff tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.856423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-21389774-87a1-4a81-a65c-496a79de6bff tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.857632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-21389774-87a1-4a81-a65c-496a79de6bff tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.858083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-21389774-87a1-4a81-a65c-496a79de6bff tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.869540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68e98372-32c0-4099-a926-e1ffd69805a9 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.870490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68e98372-32c0-4099-a926-e1ffd69805a9 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.903619 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-68e98372-32c0-4099-a926-e1ffd69805a9 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags" status: 200 len: 12 microversion: 2.26 time: 0.075959 Jul 20 04:35:01.911665 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1847/3910] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Jul 20 04:35:01 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags => generated 12 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:01.922669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-49398b2f-80a2-400b-83f6-449feba02574 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '.version_select at 0x7f06bd208940>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:01.960103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49398b2f-80a2-400b-83f6-449feba02574 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.965007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49398b2f-80a2-400b-83f6-449feba02574 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.966271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-49398b2f-80a2-400b-83f6-449feba02574 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:01.990662 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49398b2f-80a2-400b-83f6-449feba02574 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.993619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49398b2f-80a2-400b-83f6-449feba02574 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.995735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49398b2f-80a2-400b-83f6-449feba02574 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.999404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49398b2f-80a2-400b-83f6-449feba02574 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.094707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49398b2f-80a2-400b-83f6-449feba02574 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.095299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49398b2f-80a2-400b-83f6-449feba02574 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.122343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-21389774-87a1-4a81-a65c-496a79de6bff tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:02.128876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-49398b2f-80a2-400b-83f6-449feba02574 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lazy-loading 'flavor' on Instance uuid 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:02.149625 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-49398b2f-80a2-400b-83f6-449feba02574 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags" status: 204 len: 0 microversion: 2.26 time: 0.234221 Jul 20 04:35:02.156507 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1848/3911] 10.222.0.17 () {60 vars in 1294 bytes} [Wed Jul 20 04:35:01 2022] DELETE /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:35:02.163128 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-21389774-87a1-4a81-a65c-496a79de6bff tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1428 microversion: 2.1 time: 0.329094 Jul 20 04:35:02.163944 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2064/3912] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:01 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1428 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:02.176551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-53a4e1a3-44db-491f-a464-ad4514cc072f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '.version_select at 0x7f06bd279d30>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:02.190105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53a4e1a3-44db-491f-a464-ad4514cc072f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.191166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53a4e1a3-44db-491f-a464-ad4514cc072f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.192030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-53a4e1a3-44db-491f-a464-ad4514cc072f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:02.206076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53a4e1a3-44db-491f-a464-ad4514cc072f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.206922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53a4e1a3-44db-491f-a464-ad4514cc072f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.209119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53a4e1a3-44db-491f-a464-ad4514cc072f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.209907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53a4e1a3-44db-491f-a464-ad4514cc072f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.287836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53a4e1a3-44db-491f-a464-ad4514cc072f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.288316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53a4e1a3-44db-491f-a464-ad4514cc072f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.322076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53a4e1a3-44db-491f-a464-ad4514cc072f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.322528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53a4e1a3-44db-491f-a464-ad4514cc072f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.381468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-53a4e1a3-44db-491f-a464-ad4514cc072f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lazy-loading 'flavor' on Instance uuid 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:02.431427 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-53a4e1a3-44db-491f-a464-ad4514cc072f tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "PUT /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags/tempest-tag-103397749" status: 201 len: 0 microversion: 2.26 time: 0.272420 Jul 20 04:35:02.447176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1e9696fa-bbe0-455d-a93e-b59f6c358132 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '.version_select at 0x7f06bd30c1f0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:02.456122 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1849/3913] 10.222.0.17 () {62 vars in 1376 bytes} [Wed Jul 20 04:35:02 2022] PUT /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags/tempest-tag-103397749 => generated 0 bytes in 298 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 20 04:35:02.483158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e9696fa-bbe0-455d-a93e-b59f6c358132 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.483588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e9696fa-bbe0-455d-a93e-b59f6c358132 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.484082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1e9696fa-bbe0-455d-a93e-b59f6c358132 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:02.508921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e9696fa-bbe0-455d-a93e-b59f6c358132 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.509392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e9696fa-bbe0-455d-a93e-b59f6c358132 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.523681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e9696fa-bbe0-455d-a93e-b59f6c358132 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.524623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e9696fa-bbe0-455d-a93e-b59f6c358132 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.566307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-17d6aa0d-5286-405c-8ed7-4919e7d103de tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:02.566928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-17d6aa0d-5286-405c-8ed7-4919e7d103de tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:02.592637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17d6aa0d-5286-405c-8ed7-4919e7d103de tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.593155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17d6aa0d-5286-405c-8ed7-4919e7d103de tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.593777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17d6aa0d-5286-405c-8ed7-4919e7d103de tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.594215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17d6aa0d-5286-405c-8ed7-4919e7d103de tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.670169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e9696fa-bbe0-455d-a93e-b59f6c358132 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.670979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e9696fa-bbe0-455d-a93e-b59f6c358132 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.718894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e9696fa-bbe0-455d-a93e-b59f6c358132 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.721319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e9696fa-bbe0-455d-a93e-b59f6c358132 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.827964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-1e9696fa-bbe0-455d-a93e-b59f6c358132 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lazy-loading 'flavor' on Instance uuid 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:02.860186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-17d6aa0d-5286-405c-8ed7-4919e7d103de tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:02.893845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-17d6aa0d-5286-405c-8ed7-4919e7d103de tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:02.897544 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1e9696fa-bbe0-455d-a93e-b59f6c358132 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "PUT /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags/tempest-tag-790477134" status: 201 len: 0 microversion: 2.26 time: 0.456891 Jul 20 04:35:02.899476 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2065/3914] 10.222.0.17 () {62 vars in 1376 bytes} [Wed Jul 20 04:35:02 2022] PUT /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags/tempest-tag-790477134 => generated 0 bytes in 460 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 20 04:35:02.908365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-17d6aa0d-5286-405c-8ed7-4919e7d103de tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:02.915249 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-17d6aa0d-5286-405c-8ed7-4919e7d103de tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1576 microversion: 2.42 time: 0.350209 Jul 20 04:35:02.917379 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1850/3915] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:02 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1576 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:35:02.921570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bdbdaea0-11b9-47eb-9d5b-ed56bdbc2a3f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:02.931152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bdbdaea0-11b9-47eb-9d5b-ed56bdbc2a3f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:02.944338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4f79d26b-3d84-44cb-81ac-8f751c7a439e tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Action: 'update_all', calling method: .version_select at 0x7f06bd170c10>, body: {"tags": ["tempest-tag-70017324", "tempest-tag-181639520"]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:02.948577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bdbdaea0-11b9-47eb-9d5b-ed56bdbc2a3f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.952811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bdbdaea0-11b9-47eb-9d5b-ed56bdbc2a3f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.954340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bdbdaea0-11b9-47eb-9d5b-ed56bdbc2a3f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.955354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bdbdaea0-11b9-47eb-9d5b-ed56bdbc2a3f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.992414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f79d26b-3d84-44cb-81ac-8f751c7a439e tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.993148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f79d26b-3d84-44cb-81ac-8f751c7a439e tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.993930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4f79d26b-3d84-44cb-81ac-8f751c7a439e tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:03.042100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f79d26b-3d84-44cb-81ac-8f751c7a439e tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:03.042833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f79d26b-3d84-44cb-81ac-8f751c7a439e tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:03.044671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f79d26b-3d84-44cb-81ac-8f751c7a439e tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:03.044871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f79d26b-3d84-44cb-81ac-8f751c7a439e tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:03.103906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f79d26b-3d84-44cb-81ac-8f751c7a439e tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:03.105502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f79d26b-3d84-44cb-81ac-8f751c7a439e tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:03.131323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-4f79d26b-3d84-44cb-81ac-8f751c7a439e tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lazy-loading 'flavor' on Instance uuid 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:03.180134 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4f79d26b-3d84-44cb-81ac-8f751c7a439e tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "PUT /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags" status: 200 len: 59 microversion: 2.26 time: 0.260780 Jul 20 04:35:03.181741 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1851/3916] 10.222.0.17 () {62 vars in 1311 bytes} [Wed Jul 20 04:35:02 2022] PUT /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags => generated 59 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:03.189908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-676acc82-8ce9-48e4-b00b-b7835780ecd7 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:03.190700 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-676acc82-8ce9-48e4-b00b-b7835780ecd7 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:03.203631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-676acc82-8ce9-48e4-b00b-b7835780ecd7 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:03.203631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-676acc82-8ce9-48e4-b00b-b7835780ecd7 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:03.205829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-676acc82-8ce9-48e4-b00b-b7835780ecd7 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:03.209678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-676acc82-8ce9-48e4-b00b-b7835780ecd7 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:03.451352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bdbdaea0-11b9-47eb-9d5b-ed56bdbc2a3f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f66821062041b8a6330b883de2754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f772f396147ea89da0f9f051d9fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:03.467127 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bdbdaea0-11b9-47eb-9d5b-ed56bdbc2a3f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989" status: 200 len: 1463 microversion: 2.1 time: 0.564909 Jul 20 04:35:03.467968 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2066/3917] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:02 2022] GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 => generated 1463 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:03.475077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-10a6c0d7-0f32-4ddd-a1eb-8afe211dbb03 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '.version_select at 0x7f06bd29c5e0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:03.500014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-10a6c0d7-0f32-4ddd-a1eb-8afe211dbb03 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:03.505142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-10a6c0d7-0f32-4ddd-a1eb-8afe211dbb03 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:03.535051 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-10a6c0d7-0f32-4ddd-a1eb-8afe211dbb03 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags" status: 200 len: 59 microversion: 2.26 time: 0.065311 Jul 20 04:35:03.538878 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2067/3918] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Jul 20 04:35:03 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags => generated 59 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:03.545633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8b4352a6-9ba9-41bb-a366-e95ed5fa972f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84742c70-d6bf-4422-8bf1-956972245130", "device": "/dev/sdb"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:03.551474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8b4352a6-9ba9-41bb-a366-e95ed5fa972f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:03.561994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b4352a6-9ba9-41bb-a366-e95ed5fa972f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:03.562681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b4352a6-9ba9-41bb-a366-e95ed5fa972f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:03.564321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b4352a6-9ba9-41bb-a366-e95ed5fa972f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:03.566068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b4352a6-9ba9-41bb-a366-e95ed5fa972f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:03.598057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:04.180614 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-676acc82-8ce9-48e4-b00b-b7835780ecd7 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:04.183350 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-676acc82-8ce9-48e4-b00b-b7835780ecd7 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1608 microversion: 2.1 time: 0.998067 Jul 20 04:35:04.186752 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1852/3919] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:03 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1608 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:04.204090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d273e060-09b6-419a-9ac2-9d6bb9ab434c tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '.version_select at 0x7f06bdb8bdc0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:04.224066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d273e060-09b6-419a-9ac2-9d6bb9ab434c tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.224793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d273e060-09b6-419a-9ac2-9d6bb9ab434c tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.229223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d273e060-09b6-419a-9ac2-9d6bb9ab434c tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:04.244367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d273e060-09b6-419a-9ac2-9d6bb9ab434c tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.246299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d273e060-09b6-419a-9ac2-9d6bb9ab434c tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.248525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d273e060-09b6-419a-9ac2-9d6bb9ab434c tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.250376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d273e060-09b6-419a-9ac2-9d6bb9ab434c tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.301157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:04.309043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d273e060-09b6-419a-9ac2-9d6bb9ab434c tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.309609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d273e060-09b6-419a-9ac2-9d6bb9ab434c tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.340997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-d273e060-09b6-419a-9ac2-9d6bb9ab434c tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lazy-loading 'flavor' on Instance uuid 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:04.376750 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d273e060-09b6-419a-9ac2-9d6bb9ab434c tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags" status: 204 len: 0 microversion: 2.26 time: 0.189996 Jul 20 04:35:04.377776 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1853/3920] 10.222.0.17 () {60 vars in 1294 bytes} [Wed Jul 20 04:35:04 2022] DELETE /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3/tags => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:35:04.385288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eea02ebd-2fb8-45bb-ae06-7060b4bbcc01 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:04.386063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eea02ebd-2fb8-45bb-ae06-7060b4bbcc01 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:04.392887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eea02ebd-2fb8-45bb-ae06-7060b4bbcc01 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.393442 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eea02ebd-2fb8-45bb-ae06-7060b4bbcc01 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.394445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eea02ebd-2fb8-45bb-ae06-7060b4bbcc01 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.394963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eea02ebd-2fb8-45bb-ae06-7060b4bbcc01 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.398690 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8b4352a6-9ba9-41bb-a366-e95ed5fa972f tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "POST /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.838093 Jul 20 04:35:04.402673 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2068/3921] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 04:35:03 2022] POST /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989/os-volume_attachments => generated 194 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:04.421103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9306e461-66a6-4d96-91d4-a655280cd8be tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:04.421728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9306e461-66a6-4d96-91d4-a655280cd8be tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:04.454669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9306e461-66a6-4d96-91d4-a655280cd8be tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.457754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9306e461-66a6-4d96-91d4-a655280cd8be tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.458662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9306e461-66a6-4d96-91d4-a655280cd8be tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.459083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9306e461-66a6-4d96-91d4-a655280cd8be tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.765248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eea02ebd-2fb8-45bb-ae06-7060b4bbcc01 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:04.779050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eea02ebd-2fb8-45bb-ae06-7060b4bbcc01 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:04.788900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eea02ebd-2fb8-45bb-ae06-7060b4bbcc01 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:04.795599 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eea02ebd-2fb8-45bb-ae06-7060b4bbcc01 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1594 microversion: 2.42 time: 0.416680 Jul 20 04:35:04.808647 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1854/3922] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:04 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1594 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:04.816838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4f0c1be7-4c8a-40ac-bcc8-8a540b46c193 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:04.829264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4f0c1be7-4c8a-40ac-bcc8-8a540b46c193 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:04.862156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f0c1be7-4c8a-40ac-bcc8-8a540b46c193 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.863123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9306e461-66a6-4d96-91d4-a655280cd8be tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:04.873124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f0c1be7-4c8a-40ac-bcc8-8a540b46c193 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.881431 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9306e461-66a6-4d96-91d4-a655280cd8be tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1608 microversion: 2.1 time: 0.471225 Jul 20 04:35:04.882063 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2069/3923] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:04 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1608 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:04.883373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f0c1be7-4c8a-40ac-bcc8-8a540b46c193 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.886438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f0c1be7-4c8a-40ac-bcc8-8a540b46c193 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.904977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9fa8a033-19f2-4932-b4ff-c09dd8caede8 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:04.905820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9fa8a033-19f2-4932-b4ff-c09dd8caede8 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:04.924097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fa8a033-19f2-4932-b4ff-c09dd8caede8 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.925713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fa8a033-19f2-4932-b4ff-c09dd8caede8 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.933515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fa8a033-19f2-4932-b4ff-c09dd8caede8 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.936870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fa8a033-19f2-4932-b4ff-c09dd8caede8 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:05.002501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4f0c1be7-4c8a-40ac-bcc8-8a540b46c193 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:35:05.317662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9fa8a033-19f2-4932-b4ff-c09dd8caede8 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:05.332544 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9fa8a033-19f2-4932-b4ff-c09dd8caede8 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1608 microversion: 2.1 time: 0.438024 Jul 20 04:35:05.343939 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2070/3924] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:04 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1608 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:05.826120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ecd906c0-78ef-4bf8-9113-1df5219ebd83 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:05.836636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ecd906c0-78ef-4bf8-9113-1df5219ebd83 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:05.891652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ecd906c0-78ef-4bf8-9113-1df5219ebd83 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:05.895849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ecd906c0-78ef-4bf8-9113-1df5219ebd83 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:05.900027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ecd906c0-78ef-4bf8-9113-1df5219ebd83 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:05.903781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ecd906c0-78ef-4bf8-9113-1df5219ebd83 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.088957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ecd906c0-78ef-4bf8-9113-1df5219ebd83 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:06.107775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ecd906c0-78ef-4bf8-9113-1df5219ebd83 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:06.113192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ecd906c0-78ef-4bf8-9113-1df5219ebd83 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:06.117613 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ecd906c0-78ef-4bf8-9113-1df5219ebd83 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1594 microversion: 2.42 time: 0.300419 Jul 20 04:35:06.118506 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2071/3925] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:05 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1594 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:35:06.255688 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4f0c1be7-4c8a-40ac-bcc8-8a540b46c193 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3" status: 204 len: 0 microversion: 2.26 time: 1.442397 Jul 20 04:35:06.274437 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1855/3926] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:35:04 2022] DELETE /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3 => generated 0 bytes in 1462 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:35:06.281334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-71194f8f-4a43-4e99-b7d3-8d1989cdc790 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:06.282562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-71194f8f-4a43-4e99-b7d3-8d1989cdc790 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:06.305787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71194f8f-4a43-4e99-b7d3-8d1989cdc790 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:06.307253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71194f8f-4a43-4e99-b7d3-8d1989cdc790 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.313211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71194f8f-4a43-4e99-b7d3-8d1989cdc790 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:06.314802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71194f8f-4a43-4e99-b7d3-8d1989cdc790 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.959948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:07.117127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-71194f8f-4a43-4e99-b7d3-8d1989cdc790 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:07.126742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-71194f8f-4a43-4e99-b7d3-8d1989cdc790 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:07.132949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-71194f8f-4a43-4e99-b7d3-8d1989cdc790 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:07.135924 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-71194f8f-4a43-4e99-b7d3-8d1989cdc790 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3" status: 200 len: 1551 microversion: 2.26 time: 0.860109 Jul 20 04:35:07.140311 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2072/3927] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:06 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3 => generated 1551 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:35:07.142970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-83fe073b-2714-4f89-8274-43cb4695324a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:07.144083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-83fe073b-2714-4f89-8274-43cb4695324a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:07.169043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83fe073b-2714-4f89-8274-43cb4695324a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:07.169808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83fe073b-2714-4f89-8274-43cb4695324a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:07.170843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83fe073b-2714-4f89-8274-43cb4695324a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:07.173267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83fe073b-2714-4f89-8274-43cb4695324a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:07.590861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-83fe073b-2714-4f89-8274-43cb4695324a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:07.601182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-83fe073b-2714-4f89-8274-43cb4695324a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:07.610552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-83fe073b-2714-4f89-8274-43cb4695324a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:07.626546 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-83fe073b-2714-4f89-8274-43cb4695324a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1662 microversion: 2.42 time: 0.491499 Jul 20 04:35:07.628163 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1856/3928] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:07 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1662 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:08.169829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0640ed44-664a-4724-904b-dea12f35e75b tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:08.170452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0640ed44-664a-4724-904b-dea12f35e75b tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:08.212936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0640ed44-664a-4724-904b-dea12f35e75b tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:08.216322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0640ed44-664a-4724-904b-dea12f35e75b tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:08.219303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0640ed44-664a-4724-904b-dea12f35e75b tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:08.221584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0640ed44-664a-4724-904b-dea12f35e75b tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:08.651586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ab11a9aa-b419-4e38-84cf-4ec0a18ba8e7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:08.652522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ab11a9aa-b419-4e38-84cf-4ec0a18ba8e7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:08.682768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab11a9aa-b419-4e38-84cf-4ec0a18ba8e7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:08.683938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab11a9aa-b419-4e38-84cf-4ec0a18ba8e7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:08.687754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab11a9aa-b419-4e38-84cf-4ec0a18ba8e7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:08.690848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab11a9aa-b419-4e38-84cf-4ec0a18ba8e7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:08.739771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0640ed44-664a-4724-904b-dea12f35e75b tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:08.770031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0640ed44-664a-4724-904b-dea12f35e75b tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:08.771825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0640ed44-664a-4724-904b-dea12f35e75b tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:08.785283 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0640ed44-664a-4724-904b-dea12f35e75b tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3" status: 200 len: 1551 microversion: 2.26 time: 0.624838 Jul 20 04:35:08.786524 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2073/3929] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:08 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3 => generated 1551 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:09.025403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-de96646e-112b-4063-b703-caf1486b33a5 req-e0c08edf-4ff9-49d3-a60b-22da701c4d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f22b3cf-7413-4a8e-971e-60c5f72f25c3", "name": "network-vif-deleted", "tag": "efa36460-bce4-4fac-860d-23ab4044e65e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:09.061656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-de96646e-112b-4063-b703-caf1486b33a5 req-e0c08edf-4ff9-49d3-a60b-22da701c4d54 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:09.065219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-de96646e-112b-4063-b703-caf1486b33a5 req-e0c08edf-4ff9-49d3-a60b-22da701c4d54 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:09.175767 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-de96646e-112b-4063-b703-caf1486b33a5 req-e0c08edf-4ff9-49d3-a60b-22da701c4d54 service nova] Creating event network-vif-deleted:efa36460-bce4-4fac-860d-23ab4044e65e for instance 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 on n-h2-826526-5 Jul 20 04:35:09.210800 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-de96646e-112b-4063-b703-caf1486b33a5 req-e0c08edf-4ff9-49d3-a60b-22da701c4d54 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183695 Jul 20 04:35:09.214737 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2074/3930] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:09.248549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ab11a9aa-b419-4e38-84cf-4ec0a18ba8e7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:09.269806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ab11a9aa-b419-4e38-84cf-4ec0a18ba8e7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:09.290014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ab11a9aa-b419-4e38-84cf-4ec0a18ba8e7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:09.299925 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ab11a9aa-b419-4e38-84cf-4ec0a18ba8e7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1662 microversion: 2.42 time: 0.648834 Jul 20 04:35:09.317894 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1857/3931] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:08 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1662 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:35:09.813195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2b850a8c-1318-4d8a-a83f-0b2e918640e0 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:09.814207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2b850a8c-1318-4d8a-a83f-0b2e918640e0 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:09.837398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b850a8c-1318-4d8a-a83f-0b2e918640e0 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:09.839435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b850a8c-1318-4d8a-a83f-0b2e918640e0 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:09.843286 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b850a8c-1318-4d8a-a83f-0b2e918640e0 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:09.844850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b850a8c-1318-4d8a-a83f-0b2e918640e0 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:09.975656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b850a8c-1318-4d8a-a83f-0b2e918640e0 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:09.975656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b850a8c-1318-4d8a-a83f-0b2e918640e0 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:09.975656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-2b850a8c-1318-4d8a-a83f-0b2e918640e0 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lazy-loading 'fault' on Instance uuid 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:10.282384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2b850a8c-1318-4d8a-a83f-0b2e918640e0 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:10.301779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2b850a8c-1318-4d8a-a83f-0b2e918640e0 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:10.303957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2b850a8c-1318-4d8a-a83f-0b2e918640e0 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e17483da2268411e852efa8a0b5437b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c844eeb3da94157a49e1232388bcf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:10.306258 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2b850a8c-1318-4d8a-a83f-0b2e918640e0 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3" status: 200 len: 1352 microversion: 2.26 time: 0.497686 Jul 20 04:35:10.309411 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2075/3932] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:09 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3 => generated 1352 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:10.325043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-322dfe0d-d18b-459d-9fe3-7de580897c98 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:10.326889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-322dfe0d-d18b-459d-9fe3-7de580897c98 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:10.345097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-322dfe0d-d18b-459d-9fe3-7de580897c98 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:10.345860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-322dfe0d-d18b-459d-9fe3-7de580897c98 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:10.347190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-322dfe0d-d18b-459d-9fe3-7de580897c98 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:10.354177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-322dfe0d-d18b-459d-9fe3-7de580897c98 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:10.401395 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-bcb3ff4c-b42e-42aa-b4a1-4c110b754a79 req-29cf502e-ee53-4684-9cba-0448ab2fcb5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5723a8e0-f05f-4500-b469-dfac24f274e5", "tag": "c4b357f9-9159-4bdb-af37-462721b72996"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:10.437155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bcb3ff4c-b42e-42aa-b4a1-4c110b754a79 req-29cf502e-ee53-4684-9cba-0448ab2fcb5a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:10.443578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bcb3ff4c-b42e-42aa-b4a1-4c110b754a79 req-29cf502e-ee53-4684-9cba-0448ab2fcb5a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:10.488819 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-bcb3ff4c-b42e-42aa-b4a1-4c110b754a79 req-29cf502e-ee53-4684-9cba-0448ab2fcb5a service nova] Creating event network-changed:c4b357f9-9159-4bdb-af37-462721b72996 for instance 5723a8e0-f05f-4500-b469-dfac24f274e5 on n-h1-826526-5 Jul 20 04:35:10.497064 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-bcb3ff4c-b42e-42aa-b4a1-4c110b754a79 req-29cf502e-ee53-4684-9cba-0448ab2fcb5a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099286 Jul 20 04:35:10.497675 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2076/3933] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:10.813637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-322dfe0d-d18b-459d-9fe3-7de580897c98 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:10.831841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-322dfe0d-d18b-459d-9fe3-7de580897c98 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:10.843195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-322dfe0d-d18b-459d-9fe3-7de580897c98 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:10.849384 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-322dfe0d-d18b-459d-9fe3-7de580897c98 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1709 microversion: 2.42 time: 0.529508 Jul 20 04:35:10.863642 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1858/3934] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:10 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1709 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:11.340279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6c4a50b5-0bd9-47cf-b004-cc3b22287755 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:11.341649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6c4a50b5-0bd9-47cf-b004-cc3b22287755 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] [instance: 3f22b3cf-7413-4a8e-971e-60c5f72f25c3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:11.367104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c4a50b5-0bd9-47cf-b004-cc3b22287755 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:11.367556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c4a50b5-0bd9-47cf-b004-cc3b22287755 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:11.368377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c4a50b5-0bd9-47cf-b004-cc3b22287755 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:11.368857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c4a50b5-0bd9-47cf-b004-cc3b22287755 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:11.413035 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-6c4a50b5-0bd9-47cf-b004-cc3b22287755 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] HTTP exception thrown: Instance 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 could not be found. Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6c4a50b5-0bd9-47cf-b004-cc3b22287755 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Request method failure captured: Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3 HTTP/1.1 Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14XSmgB1AL5Gd9F2qCkMY4BEaF3wwMKSEDXTm4cBABbK5LFHH4aCI7WqKRK7_6weIpAVTjAwivaozI717w7vC9CXyFPEmt8N6-w6xGswYAGAhY5vT95bm5Zi9WM9Gagu7ZIqNA3ptYnNQd73hQo5s-vJiEZUns6r9n6zTt19-vPCCD4 Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-Openstack-Nova-Api-Version: 2.26 Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 9c844eeb3da94157a49e1232388bcf4f Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerTagsTestJSON-1153742820 Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c844eeb3da94157a49e1232388bcf4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9c844eeb3da94157a49e1232388bcf4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9c844eeb3da94157a49e1232388bcf4f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9c844eeb3da94157a49e1232388bcf4f"}]}] Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerTagsTestJSON-1153742820 Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 9c844eeb3da94157a49e1232388bcf4f Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerTagsTestJSON-1153742820 Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerTagsTestJSON-1153742820-project Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: e17483da2268411e852efa8a0b5437b3 Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerTagsTestJSON-1153742820-project Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 could not be found. Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '3f22b3cf-7413-4a8e-971e-60c5f72f25c3'} Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 could not be found. Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 could not be found. Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:11.414758 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:35:11.419590 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:11.419590 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:11.419590 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:11.419590 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:11.419590 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:11.419590 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 could not be found. Jul 20 04:35:11.419590 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:35:11.419590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6c4a50b5-0bd9-47cf-b004-cc3b22287755 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] Returning 404 to user: Instance 3f22b3cf-7413-4a8e-971e-60c5f72f25c3 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:11.419590 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6c4a50b5-0bd9-47cf-b004-cc3b22287755 tempest-ServerTagsTestJSON-1153742820 tempest-ServerTagsTestJSON-1153742820-project] 10.222.0.17 "GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3" status: 404 len: 111 microversion: 2.26 time: 0.081618 Jul 20 04:35:11.419590 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2077/3935] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:11 2022] GET /compute/v2.1/servers/3f22b3cf-7413-4a8e-971e-60c5f72f25c3 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:35:11.870783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fd90a5fb-c2d4-4102-a109-2fd626654ace tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:11.872141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fd90a5fb-c2d4-4102-a109-2fd626654ace tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:11.888477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd90a5fb-c2d4-4102-a109-2fd626654ace tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:11.889293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd90a5fb-c2d4-4102-a109-2fd626654ace tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:11.890488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd90a5fb-c2d4-4102-a109-2fd626654ace tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:11.891227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd90a5fb-c2d4-4102-a109-2fd626654ace tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:13.254950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fd90a5fb-c2d4-4102-a109-2fd626654ace tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:13.279147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fd90a5fb-c2d4-4102-a109-2fd626654ace tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:13.285185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fd90a5fb-c2d4-4102-a109-2fd626654ace tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:13.286579 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fd90a5fb-c2d4-4102-a109-2fd626654ace tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1709 microversion: 2.42 time: 1.420299 Jul 20 04:35:13.294140 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1859/3936] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:11 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1709 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:14.315590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bc6d9334-aee9-418b-ada7-3b348b23e015 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:14.316863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bc6d9334-aee9-418b-ada7-3b348b23e015 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:14.329619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=12 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:14.337736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc6d9334-aee9-418b-ada7-3b348b23e015 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:14.338433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc6d9334-aee9-418b-ada7-3b348b23e015 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:14.339369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc6d9334-aee9-418b-ada7-3b348b23e015 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:14.340043 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc6d9334-aee9-418b-ada7-3b348b23e015 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:14.685958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bc6d9334-aee9-418b-ada7-3b348b23e015 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:14.708385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bc6d9334-aee9-418b-ada7-3b348b23e015 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:14.709893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bc6d9334-aee9-418b-ada7-3b348b23e015 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:14.711299 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bc6d9334-aee9-418b-ada7-3b348b23e015 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1756 microversion: 2.42 time: 0.400255 Jul 20 04:35:14.712458 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2078/3937] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:14 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1756 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:15.731465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-50aece5a-32d4-43f8-9a53-c99a55c9f60c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:15.732782 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-50aece5a-32d4-43f8-9a53-c99a55c9f60c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:15.749275 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50aece5a-32d4-43f8-9a53-c99a55c9f60c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:15.753235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50aece5a-32d4-43f8-9a53-c99a55c9f60c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:15.755094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50aece5a-32d4-43f8-9a53-c99a55c9f60c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:15.755783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50aece5a-32d4-43f8-9a53-c99a55c9f60c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:16.492172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-50aece5a-32d4-43f8-9a53-c99a55c9f60c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:16.512637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-50aece5a-32d4-43f8-9a53-c99a55c9f60c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:16.522632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-50aece5a-32d4-43f8-9a53-c99a55c9f60c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:16.534266 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-50aece5a-32d4-43f8-9a53-c99a55c9f60c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1803 microversion: 2.42 time: 0.798517 Jul 20 04:35:16.535022 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1860/3938] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:15 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1803 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:17.557499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fac454d6-3c0b-451a-9c4e-12b77e353b09 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:17.559002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fac454d6-3c0b-451a-9c4e-12b77e353b09 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:17.611948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fac454d6-3c0b-451a-9c4e-12b77e353b09 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.612648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fac454d6-3c0b-451a-9c4e-12b77e353b09 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.613646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fac454d6-3c0b-451a-9c4e-12b77e353b09 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.615988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fac454d6-3c0b-451a-9c4e-12b77e353b09 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.849773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-06064cfa-9134-4f29-a7a9-a9870a043fe7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:17.851496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-06064cfa-9134-4f29-a7a9-a9870a043fe7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:17.881870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06064cfa-9134-4f29-a7a9-a9870a043fe7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.882650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06064cfa-9134-4f29-a7a9-a9870a043fe7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.883737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06064cfa-9134-4f29-a7a9-a9870a043fe7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.884440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06064cfa-9134-4f29-a7a9-a9870a043fe7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:18.309742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fac454d6-3c0b-451a-9c4e-12b77e353b09 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:18.352226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fac454d6-3c0b-451a-9c4e-12b77e353b09 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:18.355169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fac454d6-3c0b-451a-9c4e-12b77e353b09 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:18.368391 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fac454d6-3c0b-451a-9c4e-12b77e353b09 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1850 microversion: 2.42 time: 0.815213 Jul 20 04:35:18.369776 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2079/3939] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:17 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1850 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:18.655736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-8166821d-c171-4371-a92d-cef11fbedcca req-014d30e9-5b19-400c-b332-39b4ec268d77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "tag": "b15665c3-c608-4291-ba03-0645e53bbcc0"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:18.683082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8166821d-c171-4371-a92d-cef11fbedcca req-014d30e9-5b19-400c-b332-39b4ec268d77 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:18.686306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8166821d-c171-4371-a92d-cef11fbedcca req-014d30e9-5b19-400c-b332-39b4ec268d77 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:18.716960 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-8166821d-c171-4371-a92d-cef11fbedcca req-014d30e9-5b19-400c-b332-39b4ec268d77 service nova] Creating event network-changed:b15665c3-c608-4291-ba03-0645e53bbcc0 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:35:18.729942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-06064cfa-9134-4f29-a7a9-a9870a043fe7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:18.738698 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-06064cfa-9134-4f29-a7a9-a9870a043fe7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.894626 Jul 20 04:35:18.755142 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1861/3940] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:17 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:18.755516 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-8166821d-c171-4371-a92d-cef11fbedcca req-014d30e9-5b19-400c-b332-39b4ec268d77 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097231 Jul 20 04:35:18.758574 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2080/3941] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:18.762810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ad13dce0-2abc-4191-a6e0-b9212ffe47c3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1447178901"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:18.764001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ad13dce0-2abc-4191-a6e0-b9212ffe47c3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:18.782037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad13dce0-2abc-4191-a6e0-b9212ffe47c3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:18.782504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad13dce0-2abc-4191-a6e0-b9212ffe47c3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:18.783315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad13dce0-2abc-4191-a6e0-b9212ffe47c3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:18.783762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad13dce0-2abc-4191-a6e0-b9212ffe47c3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:19.395578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-31e98c8e-e7a4-4ddb-bcf4-2aad8cc697bc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:19.397177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-31e98c8e-e7a4-4ddb-bcf4-2aad8cc697bc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:19.424138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31e98c8e-e7a4-4ddb-bcf4-2aad8cc697bc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:19.428775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31e98c8e-e7a4-4ddb-bcf4-2aad8cc697bc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:19.430022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31e98c8e-e7a4-4ddb-bcf4-2aad8cc697bc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:19.432325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31e98c8e-e7a4-4ddb-bcf4-2aad8cc697bc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:19.549536 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ad13dce0-2abc-4191-a6e0-b9212ffe47c3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 202 len: 0 microversion: 2.1 time: 0.793015 Jul 20 04:35:19.553327 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1862/3942] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:35:18 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 0 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 20 04:35:19.581758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-09350c6b-d0b2-4bcb-9720-c7b7b2cc9503 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:19.583153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-09350c6b-d0b2-4bcb-9720-c7b7b2cc9503 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:19.607678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09350c6b-d0b2-4bcb-9720-c7b7b2cc9503 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:19.608152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09350c6b-d0b2-4bcb-9720-c7b7b2cc9503 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:19.613179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09350c6b-d0b2-4bcb-9720-c7b7b2cc9503 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:19.616922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09350c6b-d0b2-4bcb-9720-c7b7b2cc9503 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:19.936545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-31e98c8e-e7a4-4ddb-bcf4-2aad8cc697bc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:19.975446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-31e98c8e-e7a4-4ddb-bcf4-2aad8cc697bc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:19.977357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-31e98c8e-e7a4-4ddb-bcf4-2aad8cc697bc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:19.978644 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-31e98c8e-e7a4-4ddb-bcf4-2aad8cc697bc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1850 microversion: 2.42 time: 0.594423 Jul 20 04:35:20.001389 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2081/3943] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:19 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1850 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:35:20.128082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-09350c6b-d0b2-4bcb-9720-c7b7b2cc9503 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:20.147409 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-09350c6b-d0b2-4bcb-9720-c7b7b2cc9503 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1679 microversion: 2.1 time: 0.571465 Jul 20 04:35:20.159604 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1863/3944] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:19 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1679 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:20.858130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-508e81bd-1e94-4cf4-87b2-dd88c79157ac req-7a0d8fd6-2a26-4caa-83c8-bfcec0d41afd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "tag": "50ce2932-58a2-45c9-b274-8dcf3d6b3bef"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:20.888051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-508e81bd-1e94-4cf4-87b2-dd88c79157ac req-7a0d8fd6-2a26-4caa-83c8-bfcec0d41afd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:20.891854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-508e81bd-1e94-4cf4-87b2-dd88c79157ac req-7a0d8fd6-2a26-4caa-83c8-bfcec0d41afd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:20.950904 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-508e81bd-1e94-4cf4-87b2-dd88c79157ac req-7a0d8fd6-2a26-4caa-83c8-bfcec0d41afd service nova] Creating event network-changed:50ce2932-58a2-45c9-b274-8dcf3d6b3bef for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:35:20.964203 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-508e81bd-1e94-4cf4-87b2-dd88c79157ac req-7a0d8fd6-2a26-4caa-83c8-bfcec0d41afd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109805 Jul 20 04:35:20.971954 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2082/3945] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:21.013152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-95cf21f3-59b3-4e81-8477-e7193ba09953 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:21.016959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-95cf21f3-59b3-4e81-8477-e7193ba09953 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:21.029999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95cf21f3-59b3-4e81-8477-e7193ba09953 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:21.038054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95cf21f3-59b3-4e81-8477-e7193ba09953 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:21.041941 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95cf21f3-59b3-4e81-8477-e7193ba09953 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:21.045865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95cf21f3-59b3-4e81-8477-e7193ba09953 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:21.167968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b325aff6-7379-4766-85de-1b4b81b808ca tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:21.169142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b325aff6-7379-4766-85de-1b4b81b808ca tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:21.181071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b325aff6-7379-4766-85de-1b4b81b808ca tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:21.183195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b325aff6-7379-4766-85de-1b4b81b808ca tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:21.185002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b325aff6-7379-4766-85de-1b4b81b808ca tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:21.186064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b325aff6-7379-4766-85de-1b4b81b808ca tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:21.459231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b325aff6-7379-4766-85de-1b4b81b808ca tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:21.478139 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b325aff6-7379-4766-85de-1b4b81b808ca tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1687 microversion: 2.1 time: 0.313668 Jul 20 04:35:21.492477 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2083/3946] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:21 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1687 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:21.503853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-ebba868f-577b-4d24-84af-f97c6b8573db req-a6db868a-39c6-4dc9-b263-ee442a17489f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2db32d6-491e-4d61-81b0-571b1c7073ff", "name": "network-vif-unplugged", "status": "completed", "tag": "44e02028-8e3e-412c-b0ec-8a5e5b769d7c"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:21.521774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ebba868f-577b-4d24-84af-f97c6b8573db req-a6db868a-39c6-4dc9-b263-ee442a17489f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:21.524103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ebba868f-577b-4d24-84af-f97c6b8573db req-a6db868a-39c6-4dc9-b263-ee442a17489f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:21.543653 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-ebba868f-577b-4d24-84af-f97c6b8573db req-a6db868a-39c6-4dc9-b263-ee442a17489f service nova] Creating event network-vif-unplugged:44e02028-8e3e-412c-b0ec-8a5e5b769d7c for instance f2db32d6-491e-4d61-81b0-571b1c7073ff on n-h1-826526-5 Jul 20 04:35:21.553330 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-ebba868f-577b-4d24-84af-f97c6b8573db req-a6db868a-39c6-4dc9-b263-ee442a17489f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055357 Jul 20 04:35:21.554784 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2084/3947] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:21.688186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-95cf21f3-59b3-4e81-8477-e7193ba09953 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:21.719764 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-95cf21f3-59b3-4e81-8477-e7193ba09953 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:21.725128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-95cf21f3-59b3-4e81-8477-e7193ba09953 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:21.726802 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-95cf21f3-59b3-4e81-8477-e7193ba09953 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1871 microversion: 2.42 time: 0.723097 Jul 20 04:35:21.739324 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1864/3948] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:21 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1871 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:22.497329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-15dc26ac-f35d-4794-b105-c3f0415aa165 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:22.498057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-15dc26ac-f35d-4794-b105-c3f0415aa165 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:22.517343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-15dc26ac-f35d-4794-b105-c3f0415aa165 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.519917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-15dc26ac-f35d-4794-b105-c3f0415aa165 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.520733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-15dc26ac-f35d-4794-b105-c3f0415aa165 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.521172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-15dc26ac-f35d-4794-b105-c3f0415aa165 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.745974 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bdd0586d-3f94-41eb-a781-cfd61a324d0f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:22.746597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bdd0586d-3f94-41eb-a781-cfd61a324d0f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:22.756075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdd0586d-3f94-41eb-a781-cfd61a324d0f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.756572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdd0586d-3f94-41eb-a781-cfd61a324d0f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.757373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdd0586d-3f94-41eb-a781-cfd61a324d0f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.767940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdd0586d-3f94-41eb-a781-cfd61a324d0f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.801462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-15dc26ac-f35d-4794-b105-c3f0415aa165 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:22.812131 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-15dc26ac-f35d-4794-b105-c3f0415aa165 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1687 microversion: 2.1 time: 0.319086 Jul 20 04:35:22.813382 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2085/3949] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:22 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1687 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:23.020722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-b1a3b846-e762-4ea6-a96f-9c8136e85b56 req-e466400b-22b3-475b-8542-f93364316529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "tag": "c4064929-4a6b-4ed2-b2fd-7b46e126bcec"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:23.046269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-b1a3b846-e762-4ea6-a96f-9c8136e85b56 req-e466400b-22b3-475b-8542-f93364316529 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:23.049760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-b1a3b846-e762-4ea6-a96f-9c8136e85b56 req-e466400b-22b3-475b-8542-f93364316529 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:23.089986 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-b1a3b846-e762-4ea6-a96f-9c8136e85b56 req-e466400b-22b3-475b-8542-f93364316529 service nova] Creating event network-changed:c4064929-4a6b-4ed2-b2fd-7b46e126bcec for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:35:23.105656 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-b1a3b846-e762-4ea6-a96f-9c8136e85b56 req-e466400b-22b3-475b-8542-f93364316529 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089312 Jul 20 04:35:23.108222 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2086/3950] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:23.602134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bdd0586d-3f94-41eb-a781-cfd61a324d0f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:23.631722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bdd0586d-3f94-41eb-a781-cfd61a324d0f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:23.633993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bdd0586d-3f94-41eb-a781-cfd61a324d0f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:23.634481 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bdd0586d-3f94-41eb-a781-cfd61a324d0f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 0.892643 Jul 20 04:35:23.654753 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1865/3951] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:22 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:23.847915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f9548d91-a18a-4c23-9d99-708cb7b3ef78 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:23.849190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f9548d91-a18a-4c23-9d99-708cb7b3ef78 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:23.891513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9548d91-a18a-4c23-9d99-708cb7b3ef78 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:23.892587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9548d91-a18a-4c23-9d99-708cb7b3ef78 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:23.893908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9548d91-a18a-4c23-9d99-708cb7b3ef78 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:23.896741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9548d91-a18a-4c23-9d99-708cb7b3ef78 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:24.253190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f9548d91-a18a-4c23-9d99-708cb7b3ef78 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:24.263124 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f9548d91-a18a-4c23-9d99-708cb7b3ef78 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1687 microversion: 2.1 time: 0.434327 Jul 20 04:35:24.274229 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2087/3952] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:23 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1687 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:24.654130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-83252364-f821-41b5-97b3-7d43da27cf9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:24.654759 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-83252364-f821-41b5-97b3-7d43da27cf9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:24.675689 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:24.678300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83252364-f821-41b5-97b3-7d43da27cf9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:24.678773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83252364-f821-41b5-97b3-7d43da27cf9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:24.679588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83252364-f821-41b5-97b3-7d43da27cf9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:24.680037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83252364-f821-41b5-97b3-7d43da27cf9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:24.740794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=1,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:25.281752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0760ed79-8226-4b5f-8458-9b9272b4b716 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:25.282377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0760ed79-8226-4b5f-8458-9b9272b4b716 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:25.295684 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0760ed79-8226-4b5f-8458-9b9272b4b716 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.296111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0760ed79-8226-4b5f-8458-9b9272b4b716 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.296926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0760ed79-8226-4b5f-8458-9b9272b4b716 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.297361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0760ed79-8226-4b5f-8458-9b9272b4b716 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.325985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:25.718021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-83252364-f821-41b5-97b3-7d43da27cf9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:25.735420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0760ed79-8226-4b5f-8458-9b9272b4b716 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:25.743030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-83252364-f821-41b5-97b3-7d43da27cf9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:25.748119 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0760ed79-8226-4b5f-8458-9b9272b4b716 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 0.471213 Jul 20 04:35:25.753466 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2088/3953] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:25 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:25.754126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-83252364-f821-41b5-97b3-7d43da27cf9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:25.758542 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-83252364-f821-41b5-97b3-7d43da27cf9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 1.108127 Jul 20 04:35:25.773065 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1866/3954] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:24 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:25.861920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-96c114c8-8623-4635-b5ee-30bc1682fae0 req-30334785-1dd9-4e1a-86ea-e20da774d494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "tag": "df96a5ee-70af-4221-9452-816a07265909"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:25.887872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-96c114c8-8623-4635-b5ee-30bc1682fae0 req-30334785-1dd9-4e1a-86ea-e20da774d494 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.888357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-96c114c8-8623-4635-b5ee-30bc1682fae0 req-30334785-1dd9-4e1a-86ea-e20da774d494 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.963608 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-96c114c8-8623-4635-b5ee-30bc1682fae0 req-30334785-1dd9-4e1a-86ea-e20da774d494 service nova] Creating event network-changed:df96a5ee-70af-4221-9452-816a07265909 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:35:25.983813 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-96c114c8-8623-4635-b5ee-30bc1682fae0 req-30334785-1dd9-4e1a-86ea-e20da774d494 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126116 Jul 20 04:35:25.986711 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1867/3955] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:26.267398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-1a1d654f-ec2d-4b2b-ad15-8991538307a1 req-c9c1383d-0949-418a-b907-297c466a9a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2db32d6-491e-4d61-81b0-571b1c7073ff", "name": "network-vif-plugged", "status": "completed", "tag": "44e02028-8e3e-412c-b0ec-8a5e5b769d7c"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:26.290363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1a1d654f-ec2d-4b2b-ad15-8991538307a1 req-c9c1383d-0949-418a-b907-297c466a9a7c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:26.297082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1a1d654f-ec2d-4b2b-ad15-8991538307a1 req-c9c1383d-0949-418a-b907-297c466a9a7c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:26.350370 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-1a1d654f-ec2d-4b2b-ad15-8991538307a1 req-c9c1383d-0949-418a-b907-297c466a9a7c service nova] Creating event network-vif-plugged:44e02028-8e3e-412c-b0ec-8a5e5b769d7c for instance f2db32d6-491e-4d61-81b0-571b1c7073ff on n-h1-826526-5 Jul 20 04:35:26.370864 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-1a1d654f-ec2d-4b2b-ad15-8991538307a1 req-c9c1383d-0949-418a-b907-297c466a9a7c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.570399 Jul 20 04:35:26.372085 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2089/3956] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:26.775479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-25d4109b-3c60-45f2-8d7c-340689a69aaa tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:26.785405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-97fff8bf-e923-4178-be03-aa390d7637f7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:26.797068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-97fff8bf-e923-4178-be03-aa390d7637f7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:26.797650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-25d4109b-3c60-45f2-8d7c-340689a69aaa tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:26.827145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97fff8bf-e923-4178-be03-aa390d7637f7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:26.838013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97fff8bf-e923-4178-be03-aa390d7637f7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:26.838666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25d4109b-3c60-45f2-8d7c-340689a69aaa tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:26.839267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97fff8bf-e923-4178-be03-aa390d7637f7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:26.839736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97fff8bf-e923-4178-be03-aa390d7637f7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:26.839975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25d4109b-3c60-45f2-8d7c-340689a69aaa tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:26.841215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25d4109b-3c60-45f2-8d7c-340689a69aaa tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:26.842380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25d4109b-3c60-45f2-8d7c-340689a69aaa tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:27.249401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-25d4109b-3c60-45f2-8d7c-340689a69aaa tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:27.267472 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-25d4109b-3c60-45f2-8d7c-340689a69aaa tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 0.490758 Jul 20 04:35:27.268780 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1868/3957] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:26 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:28.289746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8856c3e4-b380-4ed0-a11f-a450d8b248cd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:28.290770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8856c3e4-b380-4ed0-a11f-a450d8b248cd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:28.323143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8856c3e4-b380-4ed0-a11f-a450d8b248cd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.332982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8856c3e4-b380-4ed0-a11f-a450d8b248cd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.334899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8856c3e4-b380-4ed0-a11f-a450d8b248cd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.342432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8856c3e4-b380-4ed0-a11f-a450d8b248cd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.418015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-97fff8bf-e923-4178-be03-aa390d7637f7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:28.459530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-97fff8bf-e923-4178-be03-aa390d7637f7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:28.478894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-97fff8bf-e923-4178-be03-aa390d7637f7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:28.483096 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-97fff8bf-e923-4178-be03-aa390d7637f7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 1.705446 Jul 20 04:35:28.486346 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2090/3958] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:26 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:29.231487 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-81a27278-6e18-4200-826e-4722ad7ac5b4 req-167ae6b0-3831-4049-bd1a-b50eb93cb82f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "tag": "e016c9d4-88ef-4886-8546-1f27d3e3dab0"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:29.279083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=93 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:29.281533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-81a27278-6e18-4200-826e-4722ad7ac5b4 req-167ae6b0-3831-4049-bd1a-b50eb93cb82f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:29.282045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-81a27278-6e18-4200-826e-4722ad7ac5b4 req-167ae6b0-3831-4049-bd1a-b50eb93cb82f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:29.338059 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-81a27278-6e18-4200-826e-4722ad7ac5b4 req-167ae6b0-3831-4049-bd1a-b50eb93cb82f service nova] Creating event network-changed:e016c9d4-88ef-4886-8546-1f27d3e3dab0 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:35:29.387123 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-81a27278-6e18-4200-826e-4722ad7ac5b4 req-167ae6b0-3831-4049-bd1a-b50eb93cb82f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161974 Jul 20 04:35:29.392541 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2091/3959] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 20 04:35:29.516757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-af7df538-968d-4cb2-90d0-57420f4f1a4e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:29.517483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-af7df538-968d-4cb2-90d0-57420f4f1a4e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:29.542003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af7df538-968d-4cb2-90d0-57420f4f1a4e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:29.542501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af7df538-968d-4cb2-90d0-57420f4f1a4e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:29.543401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af7df538-968d-4cb2-90d0-57420f4f1a4e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:29.543886 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af7df538-968d-4cb2-90d0-57420f4f1a4e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:31.247522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8856c3e4-b380-4ed0-a11f-a450d8b248cd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:31.257335 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8856c3e4-b380-4ed0-a11f-a450d8b248cd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 2.973264 Jul 20 04:35:31.273513 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1869/3960] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:28 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 2990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:31.311572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-af7df538-968d-4cb2-90d0-57420f4f1a4e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:31.336656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-af7df538-968d-4cb2-90d0-57420f4f1a4e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:31.346479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-af7df538-968d-4cb2-90d0-57420f4f1a4e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:31.353620 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-af7df538-968d-4cb2-90d0-57420f4f1a4e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 1.841614 Jul 20 04:35:31.357667 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2092/3961] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:29 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:35:32.281378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fc6659e6-ee5e-4a84-8c8c-bf44ca9be304 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:32.282006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fc6659e6-ee5e-4a84-8c8c-bf44ca9be304 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:32.331826 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc6659e6-ee5e-4a84-8c8c-bf44ca9be304 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:32.336223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc6659e6-ee5e-4a84-8c8c-bf44ca9be304 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:32.337394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc6659e6-ee5e-4a84-8c8c-bf44ca9be304 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:32.337996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc6659e6-ee5e-4a84-8c8c-bf44ca9be304 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:32.375657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8a134e43-aa50-420e-9e20-9b081026c7fd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:32.376429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8a134e43-aa50-420e-9e20-9b081026c7fd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:32.389500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a134e43-aa50-420e-9e20-9b081026c7fd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:32.389948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a134e43-aa50-420e-9e20-9b081026c7fd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:32.397580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a134e43-aa50-420e-9e20-9b081026c7fd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:32.398044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a134e43-aa50-420e-9e20-9b081026c7fd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:33.326645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8a134e43-aa50-420e-9e20-9b081026c7fd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:33.341683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8a134e43-aa50-420e-9e20-9b081026c7fd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:33.354958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8a134e43-aa50-420e-9e20-9b081026c7fd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:33.356815 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8a134e43-aa50-420e-9e20-9b081026c7fd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 0.985509 Jul 20 04:35:33.357608 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2093/3962] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:32 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:33.443832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fc6659e6-ee5e-4a84-8c8c-bf44ca9be304 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:33.481950 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fc6659e6-ee5e-4a84-8c8c-bf44ca9be304 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 1.200663 Jul 20 04:35:33.484387 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1870/3963] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:32 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:33.815475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-179ba0ef-6e47-4e92-a911-12efc7b17ce0 req-a3b58e36-2a4d-4317-b02d-da6137ad1980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "tag": "36e158ad-7ae1-4798-87f8-e0e9306b63a1"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:33.838341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-179ba0ef-6e47-4e92-a911-12efc7b17ce0 req-a3b58e36-2a4d-4317-b02d-da6137ad1980 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:33.839168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-179ba0ef-6e47-4e92-a911-12efc7b17ce0 req-a3b58e36-2a4d-4317-b02d-da6137ad1980 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:33.889621 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-179ba0ef-6e47-4e92-a911-12efc7b17ce0 req-a3b58e36-2a4d-4317-b02d-da6137ad1980 service nova] Creating event network-changed:36e158ad-7ae1-4798-87f8-e0e9306b63a1 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:35:33.910004 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-179ba0ef-6e47-4e92-a911-12efc7b17ce0 req-a3b58e36-2a4d-4317-b02d-da6137ad1980 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.301765 Jul 20 04:35:33.913576 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2094/3964] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:34.379413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-811c06c8-3b21-4ada-a553-e3ac100ae1c0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:34.381438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-811c06c8-3b21-4ada-a553-e3ac100ae1c0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:34.420005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-811c06c8-3b21-4ada-a553-e3ac100ae1c0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.420871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-811c06c8-3b21-4ada-a553-e3ac100ae1c0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:34.422891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-811c06c8-3b21-4ada-a553-e3ac100ae1c0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.425777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-811c06c8-3b21-4ada-a553-e3ac100ae1c0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:34.508675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fff8737b-8a45-4687-b7b4-93221e271877 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:34.513205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fff8737b-8a45-4687-b7b4-93221e271877 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:34.537810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fff8737b-8a45-4687-b7b4-93221e271877 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.538635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fff8737b-8a45-4687-b7b4-93221e271877 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:34.548089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fff8737b-8a45-4687-b7b4-93221e271877 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.548909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fff8737b-8a45-4687-b7b4-93221e271877 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:35.624987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-811c06c8-3b21-4ada-a553-e3ac100ae1c0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:35.643983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-811c06c8-3b21-4ada-a553-e3ac100ae1c0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:35.652641 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-811c06c8-3b21-4ada-a553-e3ac100ae1c0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:35.658389 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-811c06c8-3b21-4ada-a553-e3ac100ae1c0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 1.287092 Jul 20 04:35:35.663808 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1871/3965] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:34 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:35:36.094712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fff8737b-8a45-4687-b7b4-93221e271877 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:36.114238 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fff8737b-8a45-4687-b7b4-93221e271877 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 1.610308 Jul 20 04:35:36.115517 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2095/3966] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:34 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:36.691548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-23daf7f9-0075-48b7-99a9-c145afaf692d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:36.698719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-23daf7f9-0075-48b7-99a9-c145afaf692d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:36.723142 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23daf7f9-0075-48b7-99a9-c145afaf692d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:36.724159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23daf7f9-0075-48b7-99a9-c145afaf692d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:36.725198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23daf7f9-0075-48b7-99a9-c145afaf692d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:36.727523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-23daf7f9-0075-48b7-99a9-c145afaf692d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:36.742201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-80d3cb6a-f034-45e1-bf17-39baa4324e2e req-ed2b5cd4-5719-464d-8e6a-8f6d598dfef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "tag": "cf17085b-ec85-44f7-b1fe-988fc64af716"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:36.774249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-80d3cb6a-f034-45e1-bf17-39baa4324e2e req-ed2b5cd4-5719-464d-8e6a-8f6d598dfef8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:36.776015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-80d3cb6a-f034-45e1-bf17-39baa4324e2e req-ed2b5cd4-5719-464d-8e6a-8f6d598dfef8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:36.830417 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-80d3cb6a-f034-45e1-bf17-39baa4324e2e req-ed2b5cd4-5719-464d-8e6a-8f6d598dfef8 service nova] Creating event network-changed:cf17085b-ec85-44f7-b1fe-988fc64af716 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:35:36.854269 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-80d3cb6a-f034-45e1-bf17-39baa4324e2e req-ed2b5cd4-5719-464d-8e6a-8f6d598dfef8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116188 Jul 20 04:35:36.857503 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2096/3967] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:37.183685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-02c68729-da0c-4d69-9572-70f6f1758d9f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:37.185206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-02c68729-da0c-4d69-9572-70f6f1758d9f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:37.222387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-02c68729-da0c-4d69-9572-70f6f1758d9f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:37.223251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-02c68729-da0c-4d69-9572-70f6f1758d9f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:37.228742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-02c68729-da0c-4d69-9572-70f6f1758d9f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:37.229633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-02c68729-da0c-4d69-9572-70f6f1758d9f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:37.660237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-23daf7f9-0075-48b7-99a9-c145afaf692d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:37.674775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-23daf7f9-0075-48b7-99a9-c145afaf692d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:37.676412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-23daf7f9-0075-48b7-99a9-c145afaf692d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:37.677631 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-23daf7f9-0075-48b7-99a9-c145afaf692d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 0.999379 Jul 20 04:35:37.701497 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1872/3968] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:36 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:37.937890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-02c68729-da0c-4d69-9572-70f6f1758d9f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:37.948473 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-02c68729-da0c-4d69-9572-70f6f1758d9f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 0.802194 Jul 20 04:35:37.982515 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2097/3969] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:37 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:38.701970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d28a8da1-efa4-4647-a561-d62a9647951b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:38.711049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d28a8da1-efa4-4647-a561-d62a9647951b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:38.742881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d28a8da1-efa4-4647-a561-d62a9647951b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:38.743663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d28a8da1-efa4-4647-a561-d62a9647951b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:38.745052 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d28a8da1-efa4-4647-a561-d62a9647951b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:38.745817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d28a8da1-efa4-4647-a561-d62a9647951b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:39.003444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5fbddca4-19c6-4e9e-b78d-29ff87742c57 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:39.005776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5fbddca4-19c6-4e9e-b78d-29ff87742c57 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:39.039938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5fbddca4-19c6-4e9e-b78d-29ff87742c57 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:39.041182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5fbddca4-19c6-4e9e-b78d-29ff87742c57 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:39.044998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5fbddca4-19c6-4e9e-b78d-29ff87742c57 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:39.045703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5fbddca4-19c6-4e9e-b78d-29ff87742c57 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:39.692062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5fbddca4-19c6-4e9e-b78d-29ff87742c57 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:39.712496 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5fbddca4-19c6-4e9e-b78d-29ff87742c57 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 0.716615 Jul 20 04:35:39.717111 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2098/3970] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:38 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:39.919276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d28a8da1-efa4-4647-a561-d62a9647951b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:39.942890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d28a8da1-efa4-4647-a561-d62a9647951b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:39.946137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d28a8da1-efa4-4647-a561-d62a9647951b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:39.955332 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d28a8da1-efa4-4647-a561-d62a9647951b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 1.262236 Jul 20 04:35:39.980875 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1873/3971] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:38 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:40.743538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-00ba134a-a9f9-404d-9f02-d37acfe378d9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:40.745157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-00ba134a-a9f9-404d-9f02-d37acfe378d9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:40.762943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00ba134a-a9f9-404d-9f02-d37acfe378d9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:40.769967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00ba134a-a9f9-404d-9f02-d37acfe378d9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:40.772969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00ba134a-a9f9-404d-9f02-d37acfe378d9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:40.779458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00ba134a-a9f9-404d-9f02-d37acfe378d9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:41.001083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8ba5421b-d585-4689-abc8-3cadd927ec95 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:41.002627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8ba5421b-d585-4689-abc8-3cadd927ec95 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:41.021586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8ba5421b-d585-4689-abc8-3cadd927ec95 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:41.026194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8ba5421b-d585-4689-abc8-3cadd927ec95 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:41.030771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8ba5421b-d585-4689-abc8-3cadd927ec95 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:41.035625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8ba5421b-d585-4689-abc8-3cadd927ec95 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:41.241930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-00ba134a-a9f9-404d-9f02-d37acfe378d9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:41.258247 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-00ba134a-a9f9-404d-9f02-d37acfe378d9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 0.519253 Jul 20 04:35:41.259221 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2099/3972] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:40 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:41.421648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-342dcf2f-41eb-430a-8f19-932dfebf173e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Action: 'create', calling method: .version_select at 0x7f06bd2f0280>, body: {"keypair": {"name": "tempest-keypair-753052154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoUMU3j5z8TlngIX1J/2XQ5oRQfMSt7Z/47PIoDOUCkXMC29ZrhLkJn/Ub0ZEuXrkRJxOygNzk2Zd68UBGT17cY0uVYNxzokyRcCeReq2F3xi0Zuu/TcUxXODmeX0zjRQ=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:41.487808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-342dcf2f-41eb-430a-8f19-932dfebf173e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Getting quotas for project f84badb51e2d4e30bd5b50e2b1f8be56. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:35:41.523255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-342dcf2f-41eb-430a-8f19-932dfebf173e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Getting quotas for user 45d83caaa8704fb0a6cd0d527870b33e and project f84badb51e2d4e30bd5b50e2b1f8be56. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:35:41.628418 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-342dcf2f-41eb-430a-8f19-932dfebf173e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.367541 Jul 20 04:35:41.635872 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2100/3973] 10.222.0.17 () {62 vars in 1199 bytes} [Wed Jul 20 04:35:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 376 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:35:42.289877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-44f6aa73-94e9-479d-81fa-faa7d529642a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:42.319833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-44f6aa73-94e9-479d-81fa-faa7d529642a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:42.343878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44f6aa73-94e9-479d-81fa-faa7d529642a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:42.344424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44f6aa73-94e9-479d-81fa-faa7d529642a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:42.346382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44f6aa73-94e9-479d-81fa-faa7d529642a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:42.347723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44f6aa73-94e9-479d-81fa-faa7d529642a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:43.079631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8ba5421b-d585-4689-abc8-3cadd927ec95 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:43.081162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-44f6aa73-94e9-479d-81fa-faa7d529642a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:43.092040 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-44f6aa73-94e9-479d-81fa-faa7d529642a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 0.810211 Jul 20 04:35:43.113567 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2101/3974] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:42 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:43.126518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8ba5421b-d585-4689-abc8-3cadd927ec95 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:43.135715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8ba5421b-d585-4689-abc8-3cadd927ec95 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:43.147934 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8ba5421b-d585-4689-abc8-3cadd927ec95 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 2.153455 Jul 20 04:35:43.166936 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1874/3975] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:40 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 2155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:35:44.118569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-47821e00-d6ee-4222-9e35-f7896c04bf1d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:44.120040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-47821e00-d6ee-4222-9e35-f7896c04bf1d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:44.153133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47821e00-d6ee-4222-9e35-f7896c04bf1d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:44.156658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47821e00-d6ee-4222-9e35-f7896c04bf1d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:44.157546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47821e00-d6ee-4222-9e35-f7896c04bf1d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:44.158002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47821e00-d6ee-4222-9e35-f7896c04bf1d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:44.170423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ab457055-46ba-44b8-a73a-349e677f012e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:44.171203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ab457055-46ba-44b8-a73a-349e677f012e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:44.223922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab457055-46ba-44b8-a73a-349e677f012e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:44.230356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab457055-46ba-44b8-a73a-349e677f012e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:44.231525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab457055-46ba-44b8-a73a-349e677f012e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:44.231992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab457055-46ba-44b8-a73a-349e677f012e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:44.949507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-47821e00-d6ee-4222-9e35-f7896c04bf1d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:44.962851 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-47821e00-d6ee-4222-9e35-f7896c04bf1d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 0.845737 Jul 20 04:35:44.965288 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2102/3976] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:44 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:45.890775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ab457055-46ba-44b8-a73a-349e677f012e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:45.905766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ab457055-46ba-44b8-a73a-349e677f012e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:45.912581 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ab457055-46ba-44b8-a73a-349e677f012e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:45.915328 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ab457055-46ba-44b8-a73a-349e677f012e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 1.751912 Jul 20 04:35:45.930419 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1875/3977] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:44 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:46.003545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8c814ffe-98ab-4f6a-86ee-caa2f6142a9a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:46.004861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8c814ffe-98ab-4f6a-86ee-caa2f6142a9a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:46.013639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c814ffe-98ab-4f6a-86ee-caa2f6142a9a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:46.014499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c814ffe-98ab-4f6a-86ee-caa2f6142a9a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:46.015464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c814ffe-98ab-4f6a-86ee-caa2f6142a9a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:46.016064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c814ffe-98ab-4f6a-86ee-caa2f6142a9a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:46.650925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8c814ffe-98ab-4f6a-86ee-caa2f6142a9a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:46.662638 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8c814ffe-98ab-4f6a-86ee-caa2f6142a9a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 0.677560 Jul 20 04:35:46.663465 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2103/3978] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:45 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:46.937023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c6ce0503-42f3-4233-9108-66000bc40d3e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:46.939477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c6ce0503-42f3-4233-9108-66000bc40d3e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:46.980143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6ce0503-42f3-4233-9108-66000bc40d3e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:46.980914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6ce0503-42f3-4233-9108-66000bc40d3e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:46.984139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6ce0503-42f3-4233-9108-66000bc40d3e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:46.989943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6ce0503-42f3-4233-9108-66000bc40d3e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:47.312476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4ace8d14-b50e-4118-932f-347714e04e54 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:47.313532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4ace8d14-b50e-4118-932f-347714e04e54 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:47.336847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ace8d14-b50e-4118-932f-347714e04e54 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:47.337742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ace8d14-b50e-4118-932f-347714e04e54 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:47.338841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ace8d14-b50e-4118-932f-347714e04e54 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:47.340174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ace8d14-b50e-4118-932f-347714e04e54 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:47.446913 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4ace8d14-b50e-4118-932f-347714e04e54 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.139955 Jul 20 04:35:47.448178 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2104/3979] 10.222.0.17 () {58 vars in 1292 bytes} [Wed Jul 20 04:35:47 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5/os-server-password => generated 116 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:35:47.680856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-012d290c-dae4-4b49-8288-a01b865e28dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:47.681717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-012d290c-dae4-4b49-8288-a01b865e28dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:47.691744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-012d290c-dae4-4b49-8288-a01b865e28dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:47.702096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-012d290c-dae4-4b49-8288-a01b865e28dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:47.703339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-012d290c-dae4-4b49-8288-a01b865e28dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:47.703992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-012d290c-dae4-4b49-8288-a01b865e28dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:48.181917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-012d290c-dae4-4b49-8288-a01b865e28dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:48.215132 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-012d290c-dae4-4b49-8288-a01b865e28dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 0.538038 Jul 20 04:35:48.226750 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2105/3980] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:47 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:49.263497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e8b9586f-e1aa-4ab0-a834-7d44568e9080 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:49.265136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e8b9586f-e1aa-4ab0-a834-7d44568e9080 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:49.344813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8b9586f-e1aa-4ab0-a834-7d44568e9080 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.348968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8b9586f-e1aa-4ab0-a834-7d44568e9080 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:49.362326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8b9586f-e1aa-4ab0-a834-7d44568e9080 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.374854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8b9586f-e1aa-4ab0-a834-7d44568e9080 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:49.699523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c6ce0503-42f3-4233-9108-66000bc40d3e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:49.716160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c6ce0503-42f3-4233-9108-66000bc40d3e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:49.728430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c6ce0503-42f3-4233-9108-66000bc40d3e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:49.737708 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c6ce0503-42f3-4233-9108-66000bc40d3e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 2.797877 Jul 20 04:35:49.739019 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1876/3981] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:46 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 2808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:49.965377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e8b9586f-e1aa-4ab0-a834-7d44568e9080 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:50.029104 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e8b9586f-e1aa-4ab0-a834-7d44568e9080 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 0.779268 Jul 20 04:35:50.050012 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2106/3982] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:49 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:50.773971 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1b10f138-af42-4bcc-be4f-9e25a7c0293e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:50.779540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1b10f138-af42-4bcc-be4f-9e25a7c0293e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:50.838224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1b10f138-af42-4bcc-be4f-9e25a7c0293e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:50.840948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1b10f138-af42-4bcc-be4f-9e25a7c0293e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:50.873786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1b10f138-af42-4bcc-be4f-9e25a7c0293e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:50.890222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1b10f138-af42-4bcc-be4f-9e25a7c0293e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:51.057151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d823ae73-5cbb-4005-bb8f-09d7240ce5a0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:51.058221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d823ae73-5cbb-4005-bb8f-09d7240ce5a0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:51.105644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d823ae73-5cbb-4005-bb8f-09d7240ce5a0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:51.106838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d823ae73-5cbb-4005-bb8f-09d7240ce5a0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:51.111721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d823ae73-5cbb-4005-bb8f-09d7240ce5a0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:51.114742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d823ae73-5cbb-4005-bb8f-09d7240ce5a0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:51.545079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:51.711206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d823ae73-5cbb-4005-bb8f-09d7240ce5a0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:51.748464 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d823ae73-5cbb-4005-bb8f-09d7240ce5a0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 0.698404 Jul 20 04:35:51.755058 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2107/3983] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:51 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:52.402540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1b10f138-af42-4bcc-be4f-9e25a7c0293e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:52.421455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1b10f138-af42-4bcc-be4f-9e25a7c0293e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:52.422991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1b10f138-af42-4bcc-be4f-9e25a7c0293e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:52.424231 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1b10f138-af42-4bcc-be4f-9e25a7c0293e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 1.659603 Jul 20 04:35:52.424831 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1877/3984] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:50 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:52.463415 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-01de6ef9-0260-4e68-a442-9b3b233d0f5a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-103171286", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7cb0783-8099-436e-bf0c-ef0b452074e0"}], "security_groups": [{"name": "tempest-securitygroup--1208458091"}], "key_name": "tempest-keypair-753052154", "user_data": "}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:52.766428 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b06d9336-08eb-4e93-8521-9d87c550ee38 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:52.767227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b06d9336-08eb-4e93-8521-9d87c550ee38 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:52.777750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b06d9336-08eb-4e93-8521-9d87c550ee38 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:52.789478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b06d9336-08eb-4e93-8521-9d87c550ee38 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:52.790350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b06d9336-08eb-4e93-8521-9d87c550ee38 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:52.790799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b06d9336-08eb-4e93-8521-9d87c550ee38 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:53.113194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-01de6ef9-0260-4e68-a442-9b3b233d0f5a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] validate_networks() for [('d7cb0783-8099-436e-bf0c-ef0b452074e0', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:35:53.187463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b06d9336-08eb-4e93-8521-9d87c550ee38 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:53.204410 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b06d9336-08eb-4e93-8521-9d87c550ee38 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 0.442055 Jul 20 04:35:53.205043 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1878/3985] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:52 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:53.457181 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dbda16a0-81f6-4cc2-8020-dfac025fa7eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:53.458549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dbda16a0-81f6-4cc2-8020-dfac025fa7eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:53.473497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbda16a0-81f6-4cc2-8020-dfac025fa7eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:53.478327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbda16a0-81f6-4cc2-8020-dfac025fa7eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:53.486856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbda16a0-81f6-4cc2-8020-dfac025fa7eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:53.489038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbda16a0-81f6-4cc2-8020-dfac025fa7eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:54.286055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dbda16a0-81f6-4cc2-8020-dfac025fa7eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:54.311300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dbda16a0-81f6-4cc2-8020-dfac025fa7eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:54.312898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dbda16a0-81f6-4cc2-8020-dfac025fa7eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:54.329393 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dbda16a0-81f6-4cc2-8020-dfac025fa7eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 0.875361 Jul 20 04:35:54.330191 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1879/3986] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:53 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:54.347610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d95b6ad9-bf7b-4f76-9a77-92d8208cb5fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:54.348238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d95b6ad9-bf7b-4f76-9a77-92d8208cb5fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:54.374884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d95b6ad9-bf7b-4f76-9a77-92d8208cb5fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:54.375348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d95b6ad9-bf7b-4f76-9a77-92d8208cb5fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:54.381178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d95b6ad9-bf7b-4f76-9a77-92d8208cb5fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:54.382183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d95b6ad9-bf7b-4f76-9a77-92d8208cb5fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:54.737422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d95b6ad9-bf7b-4f76-9a77-92d8208cb5fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:54.767285 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d95b6ad9-bf7b-4f76-9a77-92d8208cb5fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 0.427527 Jul 20 04:35:54.779184 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1880/3987] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:54 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:55.375792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cd5ebde8-9d66-476f-bab2-8f69d52cfadf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:55.385904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cd5ebde8-9d66-476f-bab2-8f69d52cfadf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:55.406167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=30 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:55.412010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd5ebde8-9d66-476f-bab2-8f69d52cfadf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:55.415431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd5ebde8-9d66-476f-bab2-8f69d52cfadf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:55.416674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd5ebde8-9d66-476f-bab2-8f69d52cfadf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:55.417907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd5ebde8-9d66-476f-bab2-8f69d52cfadf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:55.434788 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=84 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:55.475492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-01de6ef9-0260-4e68-a442-9b3b233d0f5a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:35:55.477244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-01de6ef9-0260-4e68-a442-9b3b233d0f5a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:35:55.478270 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-01de6ef9-0260-4e68-a442-9b3b233d0f5a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:35:55.479223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-01de6ef9-0260-4e68-a442-9b3b233d0f5a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:35:55.480129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-01de6ef9-0260-4e68-a442-9b3b233d0f5a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:35:55.513543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-01de6ef9-0260-4e68-a442-9b3b233d0f5a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:55.514846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-01de6ef9-0260-4e68-a442-9b3b233d0f5a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:55.516184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-01de6ef9-0260-4e68-a442-9b3b233d0f5a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:55.518408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-01de6ef9-0260-4e68-a442-9b3b233d0f5a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:55.537113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=95 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:55.555098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-01de6ef9-0260-4e68-a442-9b3b233d0f5a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Getting quotas for project f84badb51e2d4e30bd5b50e2b1f8be56. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:35:55.566799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-01de6ef9-0260-4e68-a442-9b3b233d0f5a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Getting quotas for user 45d83caaa8704fb0a6cd0d527870b33e and project f84badb51e2d4e30bd5b50e2b1f8be56. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:35:55.613739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-01de6ef9-0260-4e68-a442-9b3b233d0f5a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:35:55.616271 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-01de6ef9-0260-4e68-a442-9b3b233d0f5a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:35:55.708135 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-01de6ef9-0260-4e68-a442-9b3b233d0f5a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.259968 Jul 20 04:35:55.718701 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2108/3988] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 04:35:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 3272 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:35:55.724215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e6116576-02c3-459d-b469-6e519d7cf72b tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:55.733377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e6116576-02c3-459d-b469-6e519d7cf72b tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:55.744323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6116576-02c3-459d-b469-6e519d7cf72b tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:55.748051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6116576-02c3-459d-b469-6e519d7cf72b tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:55.749171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6116576-02c3-459d-b469-6e519d7cf72b tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:55.749519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cd5ebde8-9d66-476f-bab2-8f69d52cfadf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:55.750700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6116576-02c3-459d-b469-6e519d7cf72b tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:55.764922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cd5ebde8-9d66-476f-bab2-8f69d52cfadf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:55.784054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cd5ebde8-9d66-476f-bab2-8f69d52cfadf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:55.787433 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cd5ebde8-9d66-476f-bab2-8f69d52cfadf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 0.431726 Jul 20 04:35:55.788214 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1881/3989] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:55 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:55.813337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a872ed77-bb4a-459e-9549-051fe44a946f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:55.814523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a872ed77-bb4a-459e-9549-051fe44a946f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:55.915247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a872ed77-bb4a-459e-9549-051fe44a946f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:55.931399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a872ed77-bb4a-459e-9549-051fe44a946f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:55.933271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a872ed77-bb4a-459e-9549-051fe44a946f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:55.934609 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a872ed77-bb4a-459e-9549-051fe44a946f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1280 microversion: 2.20 time: 0.128862 Jul 20 04:35:55.935703 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1882/3990] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:55 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1280 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:55.944902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-00212e13-c6fd-43c3-8b9f-5017d368a170 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:55.945915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-00212e13-c6fd-43c3-8b9f-5017d368a170 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:55.959940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00212e13-c6fd-43c3-8b9f-5017d368a170 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:55.963573 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00212e13-c6fd-43c3-8b9f-5017d368a170 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:55.964446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00212e13-c6fd-43c3-8b9f-5017d368a170 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:55.964901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00212e13-c6fd-43c3-8b9f-5017d368a170 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:56.002249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-e6116576-02c3-459d-b469-6e519d7cf72b tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lazy-loading 'services' on Instance uuid 5f506656-eef4-4b57-9559-0471bed3136e {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:56.261076 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e6116576-02c3-459d-b469-6e519d7cf72b tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e/os-volume_attachments/9a7c77bd-6adf-4ace-88ff-3c4e744fe03f" status: 202 len: 0 microversion: 2.1 time: 0.540761 Jul 20 04:35:56.261959 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2109/3991] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 04:35:55 2022] DELETE /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e/os-volume_attachments/9a7c77bd-6adf-4ace-88ff-3c4e744fe03f => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:35:56.333272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-00212e13-c6fd-43c3-8b9f-5017d368a170 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:56.354228 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-00212e13-c6fd-43c3-8b9f-5017d368a170 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 0.416830 Jul 20 04:35:56.358453 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1883/3992] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:55 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:56.810383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2489daa6-1ac1-49c2-8e1e-982d5213d6d7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:56.811998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2489daa6-1ac1-49c2-8e1e-982d5213d6d7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:56.826518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2489daa6-1ac1-49c2-8e1e-982d5213d6d7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:56.837968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2489daa6-1ac1-49c2-8e1e-982d5213d6d7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:56.839313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2489daa6-1ac1-49c2-8e1e-982d5213d6d7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:56.842909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2489daa6-1ac1-49c2-8e1e-982d5213d6d7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:56.964068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c2543866-f2bc-4999-ba4e-9ba7972d6718 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:56.964903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c2543866-f2bc-4999-ba4e-9ba7972d6718 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:57.553716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2489daa6-1ac1-49c2-8e1e-982d5213d6d7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:57.570538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2489daa6-1ac1-49c2-8e1e-982d5213d6d7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:57.580200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2489daa6-1ac1-49c2-8e1e-982d5213d6d7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:57.587699 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2489daa6-1ac1-49c2-8e1e-982d5213d6d7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 0.782942 Jul 20 04:35:57.593404 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2110/3993] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:56 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:57.614253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bae762b8-d5ea-491d-8141-dc335fcbcd95 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:57.615031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bae762b8-d5ea-491d-8141-dc335fcbcd95 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:57.622078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bae762b8-d5ea-491d-8141-dc335fcbcd95 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:57.622625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bae762b8-d5ea-491d-8141-dc335fcbcd95 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:57.623499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bae762b8-d5ea-491d-8141-dc335fcbcd95 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:57.624018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bae762b8-d5ea-491d-8141-dc335fcbcd95 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:57.941847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bae762b8-d5ea-491d-8141-dc335fcbcd95 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:57.952832 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bae762b8-d5ea-491d-8141-dc335fcbcd95 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 0.342502 Jul 20 04:35:57.955615 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2111/3994] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:57 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:57.999206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c2543866-f2bc-4999-ba4e-9ba7972d6718 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:58.027258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c2543866-f2bc-4999-ba4e-9ba7972d6718 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:58.033635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c2543866-f2bc-4999-ba4e-9ba7972d6718 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:58.053762 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c2543866-f2bc-4999-ba4e-9ba7972d6718 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1280 microversion: 2.20 time: 1.093500 Jul 20 04:35:58.054492 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1884/3995] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:56 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1280 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:35:58.614575 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e12d85cc-bef4-4821-9853-065fb620379f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:58.616284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e12d85cc-bef4-4821-9853-065fb620379f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:58.631493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e12d85cc-bef4-4821-9853-065fb620379f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:58.632168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e12d85cc-bef4-4821-9853-065fb620379f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:58.633170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e12d85cc-bef4-4821-9853-065fb620379f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:58.633784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e12d85cc-bef4-4821-9853-065fb620379f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:58.973228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3fafc700-635d-49c3-b211-7ea7de2f5291 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:58.973801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3fafc700-635d-49c3-b211-7ea7de2f5291 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:58.990189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3fafc700-635d-49c3-b211-7ea7de2f5291 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:58.990959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3fafc700-635d-49c3-b211-7ea7de2f5291 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:58.991935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3fafc700-635d-49c3-b211-7ea7de2f5291 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:58.993711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3fafc700-635d-49c3-b211-7ea7de2f5291 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:59.025170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e12d85cc-bef4-4821-9853-065fb620379f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:59.040888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e12d85cc-bef4-4821-9853-065fb620379f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:59.045479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e12d85cc-bef4-4821-9853-065fb620379f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:59.055850 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e12d85cc-bef4-4821-9853-065fb620379f tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 0.443465 Jul 20 04:35:59.071347 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2112/3996] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:58 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:59.076512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c5e6b1a4-450e-46d1-812c-7daafde2e48c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:59.080235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c5e6b1a4-450e-46d1-812c-7daafde2e48c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:59.087074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5e6b1a4-450e-46d1-812c-7daafde2e48c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:59.087814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5e6b1a4-450e-46d1-812c-7daafde2e48c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:59.089084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5e6b1a4-450e-46d1-812c-7daafde2e48c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:59.094878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5e6b1a4-450e-46d1-812c-7daafde2e48c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:59.227623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c5e6b1a4-450e-46d1-812c-7daafde2e48c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:59.236646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c5e6b1a4-450e-46d1-812c-7daafde2e48c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:59.239894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c5e6b1a4-450e-46d1-812c-7daafde2e48c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:59.241089 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c5e6b1a4-450e-46d1-812c-7daafde2e48c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1338 microversion: 2.20 time: 0.168407 Jul 20 04:35:59.241659 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2113/3997] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:59 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1338 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:59.753840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3fafc700-635d-49c3-b211-7ea7de2f5291 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:59.765603 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3fafc700-635d-49c3-b211-7ea7de2f5291 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 0.796532 Jul 20 04:35:59.770736 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1885/3998] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:58 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:00.080835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-066ba1ae-a1ab-4a63-8bc4-ee03ae19aca0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:00.080835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-066ba1ae-a1ab-4a63-8bc4-ee03ae19aca0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:00.092825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:00.131213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-066ba1ae-a1ab-4a63-8bc4-ee03ae19aca0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:00.131672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-066ba1ae-a1ab-4a63-8bc4-ee03ae19aca0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:00.132701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-066ba1ae-a1ab-4a63-8bc4-ee03ae19aca0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:00.133550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-066ba1ae-a1ab-4a63-8bc4-ee03ae19aca0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:00.261993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6a365e4a-a6b2-46c5-b5b8-6519390f128a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:00.262783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6a365e4a-a6b2-46c5-b5b8-6519390f128a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:00.290245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a365e4a-a6b2-46c5-b5b8-6519390f128a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:00.298717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a365e4a-a6b2-46c5-b5b8-6519390f128a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:00.325239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a365e4a-a6b2-46c5-b5b8-6519390f128a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:00.330972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a365e4a-a6b2-46c5-b5b8-6519390f128a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:01.029543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6a365e4a-a6b2-46c5-b5b8-6519390f128a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:01.053105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6a365e4a-a6b2-46c5-b5b8-6519390f128a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:01.055504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6a365e4a-a6b2-46c5-b5b8-6519390f128a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:01.061799 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6a365e4a-a6b2-46c5-b5b8-6519390f128a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1406 microversion: 2.20 time: 0.805706 Jul 20 04:36:01.065485 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1886/3999] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:00 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1406 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:01.090027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf27fa8b-222a-4ac3-b0d1-5a45d621dc00 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:01.092238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf27fa8b-222a-4ac3-b0d1-5a45d621dc00 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:01.120239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf27fa8b-222a-4ac3-b0d1-5a45d621dc00 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:01.121380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf27fa8b-222a-4ac3-b0d1-5a45d621dc00 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:01.126717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf27fa8b-222a-4ac3-b0d1-5a45d621dc00 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:01.127947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf27fa8b-222a-4ac3-b0d1-5a45d621dc00 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:01.451230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-066ba1ae-a1ab-4a63-8bc4-ee03ae19aca0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:01.470392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-066ba1ae-a1ab-4a63-8bc4-ee03ae19aca0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:01.476549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-066ba1ae-a1ab-4a63-8bc4-ee03ae19aca0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:01.477796 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-066ba1ae-a1ab-4a63-8bc4-ee03ae19aca0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 1.405010 Jul 20 04:36:01.478376 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2114/4000] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:00 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:01.694633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bf27fa8b-222a-4ac3-b0d1-5a45d621dc00 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:01.710729 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf27fa8b-222a-4ac3-b0d1-5a45d621dc00 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1682 microversion: 2.1 time: 0.639894 Jul 20 04:36:01.712130 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1887/4001] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:01 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1682 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:02.086568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e2084ace-8323-448f-bcc7-70425172c33b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:02.087419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e2084ace-8323-448f-bcc7-70425172c33b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:02.106504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e2084ace-8323-448f-bcc7-70425172c33b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:02.108642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e2084ace-8323-448f-bcc7-70425172c33b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:02.113108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e2084ace-8323-448f-bcc7-70425172c33b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:02.113766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e2084ace-8323-448f-bcc7-70425172c33b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:02.498636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-352536f8-7827-4cff-9f3b-d43b4c112ff6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:02.499256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-352536f8-7827-4cff-9f3b-d43b4c112ff6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:02.514443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-352536f8-7827-4cff-9f3b-d43b4c112ff6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:02.531179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-352536f8-7827-4cff-9f3b-d43b4c112ff6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:02.532667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-352536f8-7827-4cff-9f3b-d43b4c112ff6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:02.537157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-352536f8-7827-4cff-9f3b-d43b4c112ff6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:03.059878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e2084ace-8323-448f-bcc7-70425172c33b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:03.077523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e2084ace-8323-448f-bcc7-70425172c33b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:03.078919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e2084ace-8323-448f-bcc7-70425172c33b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:03.080168 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e2084ace-8323-448f-bcc7-70425172c33b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1406 microversion: 2.20 time: 0.997670 Jul 20 04:36:03.120571 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2115/4002] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:02 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1406 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:03.151267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b8c99cb4-9f51-4496-9b79-08c84cce6a88 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:03.154852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b8c99cb4-9f51-4496-9b79-08c84cce6a88 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:03.201162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8c99cb4-9f51-4496-9b79-08c84cce6a88 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:03.204254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8c99cb4-9f51-4496-9b79-08c84cce6a88 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:03.205619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8c99cb4-9f51-4496-9b79-08c84cce6a88 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:03.210911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8c99cb4-9f51-4496-9b79-08c84cce6a88 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:03.488206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-352536f8-7827-4cff-9f3b-d43b4c112ff6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:03.501818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-352536f8-7827-4cff-9f3b-d43b4c112ff6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:03.523632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-352536f8-7827-4cff-9f3b-d43b4c112ff6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:03.526379 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-352536f8-7827-4cff-9f3b-d43b4c112ff6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 1.032645 Jul 20 04:36:03.540629 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1888/4003] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:02 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:03.546968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-574a4a9d-bfcf-45ae-ae20-466f80c700cf req-2b4c7a36-e741-4c37-8816-371c5928cf80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ebac50-3466-4fdc-8ca1-59b0001e2581", "tag": "e0f13bf8-3ce6-42eb-a36c-5d668ff79e32"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:03.586260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-574a4a9d-bfcf-45ae-ae20-466f80c700cf req-2b4c7a36-e741-4c37-8816-371c5928cf80 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:03.586723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-574a4a9d-bfcf-45ae-ae20-466f80c700cf req-2b4c7a36-e741-4c37-8816-371c5928cf80 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:03.608216 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-574a4a9d-bfcf-45ae-ae20-466f80c700cf req-2b4c7a36-e741-4c37-8816-371c5928cf80 service nova] Creating event network-changed:e0f13bf8-3ce6-42eb-a36c-5d668ff79e32 for instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 on n-h2-826526-5 Jul 20 04:36:03.620618 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-574a4a9d-bfcf-45ae-ae20-466f80c700cf req-2b4c7a36-e741-4c37-8816-371c5928cf80 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077443 Jul 20 04:36:03.625492 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1889/4004] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:03.861464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b8c99cb4-9f51-4496-9b79-08c84cce6a88 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:03.870761 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b8c99cb4-9f51-4496-9b79-08c84cce6a88 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.745732 Jul 20 04:36:03.874215 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2116/4005] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:03 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:04.127677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4cd7647b-55f3-4b13-91e3-33845140435b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:04.129195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4cd7647b-55f3-4b13-91e3-33845140435b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:04.145828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cd7647b-55f3-4b13-91e3-33845140435b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.146746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cd7647b-55f3-4b13-91e3-33845140435b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:04.147794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cd7647b-55f3-4b13-91e3-33845140435b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.148613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cd7647b-55f3-4b13-91e3-33845140435b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:04.315311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4cd7647b-55f3-4b13-91e3-33845140435b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:04.329989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4cd7647b-55f3-4b13-91e3-33845140435b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:04.333398 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4cd7647b-55f3-4b13-91e3-33845140435b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:04.336675 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4cd7647b-55f3-4b13-91e3-33845140435b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1406 microversion: 2.20 time: 0.211892 Jul 20 04:36:04.340297 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1890/4006] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:04 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:04.548315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-54d4d308-1578-452d-a6d0-8c6f6e4b135d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:04.549035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-54d4d308-1578-452d-a6d0-8c6f6e4b135d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:04.563010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54d4d308-1578-452d-a6d0-8c6f6e4b135d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.563615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54d4d308-1578-452d-a6d0-8c6f6e4b135d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:04.564689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54d4d308-1578-452d-a6d0-8c6f6e4b135d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.566455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54d4d308-1578-452d-a6d0-8c6f6e4b135d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:05.097082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0eb466db-c630-430e-94b7-f827a6a6621d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:05.097866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0eb466db-c630-430e-94b7-f827a6a6621d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:05.106737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0eb466db-c630-430e-94b7-f827a6a6621d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:05.107332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0eb466db-c630-430e-94b7-f827a6a6621d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:05.108232 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0eb466db-c630-430e-94b7-f827a6a6621d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:05.108842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0eb466db-c630-430e-94b7-f827a6a6621d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:05.148215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-54d4d308-1578-452d-a6d0-8c6f6e4b135d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:05.159473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-54d4d308-1578-452d-a6d0-8c6f6e4b135d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:05.161480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-54d4d308-1578-452d-a6d0-8c6f6e4b135d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:05.162951 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-54d4d308-1578-452d-a6d0-8c6f6e4b135d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 0.619912 Jul 20 04:36:05.197066 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2117/4007] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:04 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:05.361630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-aa28ddfd-cf50-4603-ad2a-92f3100b25e6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:05.362851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-aa28ddfd-cf50-4603-ad2a-92f3100b25e6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:05.373061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa28ddfd-cf50-4603-ad2a-92f3100b25e6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:05.373628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0eb466db-c630-430e-94b7-f827a6a6621d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:05.381210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa28ddfd-cf50-4603-ad2a-92f3100b25e6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:05.382666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa28ddfd-cf50-4603-ad2a-92f3100b25e6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:05.382796 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0eb466db-c630-430e-94b7-f827a6a6621d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.289925 Jul 20 04:36:05.383459 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa28ddfd-cf50-4603-ad2a-92f3100b25e6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:05.387894 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1891/4008] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:05 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:05.537446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:05.603559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:06.182602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eac3905e-c1d6-4eae-90d2-bb23013bb555 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:06.183276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eac3905e-c1d6-4eae-90d2-bb23013bb555 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:06.183405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-aa28ddfd-cf50-4603-ad2a-92f3100b25e6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:06.198457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-aa28ddfd-cf50-4603-ad2a-92f3100b25e6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:06.202938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-aa28ddfd-cf50-4603-ad2a-92f3100b25e6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:06.204880 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-aa28ddfd-cf50-4603-ad2a-92f3100b25e6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1406 microversion: 2.20 time: 0.852227 Jul 20 04:36:06.210080 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2118/4009] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:05 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1406 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:06.211013 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eac3905e-c1d6-4eae-90d2-bb23013bb555 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:06.211799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eac3905e-c1d6-4eae-90d2-bb23013bb555 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:06.213426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eac3905e-c1d6-4eae-90d2-bb23013bb555 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:06.215258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eac3905e-c1d6-4eae-90d2-bb23013bb555 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:06.503093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eac3905e-c1d6-4eae-90d2-bb23013bb555 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:06.522447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eac3905e-c1d6-4eae-90d2-bb23013bb555 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:06.523991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eac3905e-c1d6-4eae-90d2-bb23013bb555 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:06.535198 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eac3905e-c1d6-4eae-90d2-bb23013bb555 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 0.354267 Jul 20 04:36:06.536101 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1892/4010] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:06 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:07.235153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3271715e-6e80-42a8-8486-c89f1c55bd11 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.236996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3271715e-6e80-42a8-8486-c89f1c55bd11 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.247743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3271715e-6e80-42a8-8486-c89f1c55bd11 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.248900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3271715e-6e80-42a8-8486-c89f1c55bd11 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.249917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3271715e-6e80-42a8-8486-c89f1c55bd11 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.250524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3271715e-6e80-42a8-8486-c89f1c55bd11 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.311360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4c33ec8d-2f1a-4854-9226-d6b7efcafcfc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.312004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4c33ec8d-2f1a-4854-9226-d6b7efcafcfc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.325312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c33ec8d-2f1a-4854-9226-d6b7efcafcfc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.326863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c33ec8d-2f1a-4854-9226-d6b7efcafcfc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.331521 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c33ec8d-2f1a-4854-9226-d6b7efcafcfc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.332551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c33ec8d-2f1a-4854-9226-d6b7efcafcfc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.517237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3271715e-6e80-42a8-8486-c89f1c55bd11 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:07.552788 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4c33ec8d-2f1a-4854-9226-d6b7efcafcfc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:07.561671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3271715e-6e80-42a8-8486-c89f1c55bd11 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:07.562583 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4c33ec8d-2f1a-4854-9226-d6b7efcafcfc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.255494 Jul 20 04:36:07.573997 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1893/4011] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:07 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:07.573997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-9506f0a0-dc55-4b8b-afa8-d46cb7130e16 req-8ccb14f6-43a6-40cb-890a-82a17c84479c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2db32d6-491e-4d61-81b0-571b1c7073ff", "name": "network-vif-unplugged", "status": "completed", "tag": "44e02028-8e3e-412c-b0ec-8a5e5b769d7c"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:07.576251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3271715e-6e80-42a8-8486-c89f1c55bd11 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:07.577897 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3271715e-6e80-42a8-8486-c89f1c55bd11 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1406 microversion: 2.20 time: 0.347458 Jul 20 04:36:07.578797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-9506f0a0-dc55-4b8b-afa8-d46cb7130e16 req-8ccb14f6-43a6-40cb-890a-82a17c84479c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.580069 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-9506f0a0-dc55-4b8b-afa8-d46cb7130e16 req-8ccb14f6-43a6-40cb-890a-82a17c84479c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.589526 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2119/4012] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:07 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1406 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:07.596416 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-9506f0a0-dc55-4b8b-afa8-d46cb7130e16 req-8ccb14f6-43a6-40cb-890a-82a17c84479c service nova] Creating event network-vif-unplugged:44e02028-8e3e-412c-b0ec-8a5e5b769d7c for instance f2db32d6-491e-4d61-81b0-571b1c7073ff on n-h1-826526-5 Jul 20 04:36:07.603257 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-9506f0a0-dc55-4b8b-afa8-d46cb7130e16 req-8ccb14f6-43a6-40cb-890a-82a17c84479c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038189 Jul 20 04:36:07.607261 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b87753dc-4905-456d-8ab9-ccbb2f66ae9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.608184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b87753dc-4905-456d-8ab9-ccbb2f66ae9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.616573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b87753dc-4905-456d-8ab9-ccbb2f66ae9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.617808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b87753dc-4905-456d-8ab9-ccbb2f66ae9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.618896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b87753dc-4905-456d-8ab9-ccbb2f66ae9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.619945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b87753dc-4905-456d-8ab9-ccbb2f66ae9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.620198 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1894/4013] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:07.635008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9e23a66a-f4cc-4bcf-b185-e7fb1c3946be tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.635888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9e23a66a-f4cc-4bcf-b185-e7fb1c3946be tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.647560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e23a66a-f4cc-4bcf-b185-e7fb1c3946be tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.651706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e23a66a-f4cc-4bcf-b185-e7fb1c3946be tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.652710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e23a66a-f4cc-4bcf-b185-e7fb1c3946be tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.653410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e23a66a-f4cc-4bcf-b185-e7fb1c3946be tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.836471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9e23a66a-f4cc-4bcf-b185-e7fb1c3946be tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:07.853358 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9e23a66a-f4cc-4bcf-b185-e7fb1c3946be tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.226562 Jul 20 04:36:07.856072 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1895/4014] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:07 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:07.871821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-38b8567c-612b-4202-ad5a-1fdb3c5be3db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.872716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-38b8567c-612b-4202-ad5a-1fdb3c5be3db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.879634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38b8567c-612b-4202-ad5a-1fdb3c5be3db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.880385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38b8567c-612b-4202-ad5a-1fdb3c5be3db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.881351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38b8567c-612b-4202-ad5a-1fdb3c5be3db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.881949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38b8567c-612b-4202-ad5a-1fdb3c5be3db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.004986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:08.129193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-38b8567c-612b-4202-ad5a-1fdb3c5be3db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:08.138403 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-38b8567c-612b-4202-ad5a-1fdb3c5be3db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.270778 Jul 20 04:36:08.148559 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1896/4015] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:07 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:08.155317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-97ef4055-040e-494d-bbf1-3f17a174c5fe tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:08.156449 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-97ef4055-040e-494d-bbf1-3f17a174c5fe tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:08.163402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97ef4055-040e-494d-bbf1-3f17a174c5fe tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.164006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97ef4055-040e-494d-bbf1-3f17a174c5fe tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.164863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97ef4055-040e-494d-bbf1-3f17a174c5fe tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.165428 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97ef4055-040e-494d-bbf1-3f17a174c5fe tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.187636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b87753dc-4905-456d-8ab9-ccbb2f66ae9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:08.198371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b87753dc-4905-456d-8ab9-ccbb2f66ae9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:08.200099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b87753dc-4905-456d-8ab9-ccbb2f66ae9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:08.201397 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b87753dc-4905-456d-8ab9-ccbb2f66ae9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 0.610844 Jul 20 04:36:08.202544 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2120/4016] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:07 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:08.286790 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-97ef4055-040e-494d-bbf1-3f17a174c5fe tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 202 len: 0 microversion: 2.1 time: 0.135515 Jul 20 04:36:08.296693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-54d5606e-7f58-4c1e-a154-4f20a9567152 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:08.298027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-54d5606e-7f58-4c1e-a154-4f20a9567152 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:08.301779 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1897/4017] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:08 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:36:08.306360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54d5606e-7f58-4c1e-a154-4f20a9567152 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.307225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54d5606e-7f58-4c1e-a154-4f20a9567152 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.308650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54d5606e-7f58-4c1e-a154-4f20a9567152 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.309627 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54d5606e-7f58-4c1e-a154-4f20a9567152 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.595077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-54d5606e-7f58-4c1e-a154-4f20a9567152 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:08.598062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7808ed95-3799-4543-ac25-2706fe6671af tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:08.599644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7808ed95-3799-4543-ac25-2706fe6671af tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:08.607299 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-54d5606e-7f58-4c1e-a154-4f20a9567152 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1671 microversion: 2.1 time: 0.311659 Jul 20 04:36:08.622018 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2121/4018] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:08 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1671 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:08.625575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7808ed95-3799-4543-ac25-2706fe6671af tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.630538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7808ed95-3799-4543-ac25-2706fe6671af tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.637901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7808ed95-3799-4543-ac25-2706fe6671af tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.638777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7808ed95-3799-4543-ac25-2706fe6671af tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.971600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3f330160-c097-4070-ae77-4b634b48875e tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:08.972778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3f330160-c097-4070-ae77-4b634b48875e tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:08.999132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f330160-c097-4070-ae77-4b634b48875e tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.999627 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f330160-c097-4070-ae77-4b634b48875e tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.000466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f330160-c097-4070-ae77-4b634b48875e tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.004015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f330160-c097-4070-ae77-4b634b48875e tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.083850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3f330160-c097-4070-ae77-4b634b48875e tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:36:09.141895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7808ed95-3799-4543-ac25-2706fe6671af tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:09.154840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7808ed95-3799-4543-ac25-2706fe6671af tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:09.160321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7808ed95-3799-4543-ac25-2706fe6671af tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:09.162636 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7808ed95-3799-4543-ac25-2706fe6671af tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1406 microversion: 2.20 time: 0.569552 Jul 20 04:36:09.164352 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1898/4019] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:08 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1406 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:09.222584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c90fe529-0aaa-49b5-8e39-149295fdd85b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:09.223747 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c90fe529-0aaa-49b5-8e39-149295fdd85b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:09.245438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c90fe529-0aaa-49b5-8e39-149295fdd85b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.247286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c90fe529-0aaa-49b5-8e39-149295fdd85b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.251510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c90fe529-0aaa-49b5-8e39-149295fdd85b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.253838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c90fe529-0aaa-49b5-8e39-149295fdd85b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.283258 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3f330160-c097-4070-ae77-4b634b48875e tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 204 len: 0 microversion: 2.1 time: 0.312277 Jul 20 04:36:09.284323 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2122/4020] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:08 2022] DELETE /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:36:09.303999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bafd5d1c-8fc1-4724-9735-d3c6edb798f2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:09.305665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bafd5d1c-8fc1-4724-9735-d3c6edb798f2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:09.313348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bafd5d1c-8fc1-4724-9735-d3c6edb798f2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.314191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bafd5d1c-8fc1-4724-9735-d3c6edb798f2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.315240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bafd5d1c-8fc1-4724-9735-d3c6edb798f2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.315893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bafd5d1c-8fc1-4724-9735-d3c6edb798f2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.320898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:09.561241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c90fe529-0aaa-49b5-8e39-149295fdd85b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:09.583255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c90fe529-0aaa-49b5-8e39-149295fdd85b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:09.586644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c90fe529-0aaa-49b5-8e39-149295fdd85b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:09.588085 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c90fe529-0aaa-49b5-8e39-149295fdd85b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 0.372035 Jul 20 04:36:09.614342 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1899/4021] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:09 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:09.640736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0470ebad-ac25-46e9-85e6-1111cb9de2e2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:09.641709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0470ebad-ac25-46e9-85e6-1111cb9de2e2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:09.652865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0470ebad-ac25-46e9-85e6-1111cb9de2e2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.653372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0470ebad-ac25-46e9-85e6-1111cb9de2e2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.655797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0470ebad-ac25-46e9-85e6-1111cb9de2e2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.655797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0470ebad-ac25-46e9-85e6-1111cb9de2e2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.666673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:09.907366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0470ebad-ac25-46e9-85e6-1111cb9de2e2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:09.928103 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0470ebad-ac25-46e9-85e6-1111cb9de2e2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1671 microversion: 2.1 time: 0.302876 Jul 20 04:36:09.928765 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1900/4022] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:09 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1671 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:09.944406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-ea58f6e5-d766-49b7-88f7-e44a4dc15600 req-44a77cb9-d558-47de-8ca7-9881835a484a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ebac50-3466-4fdc-8ca1-59b0001e2581", "name": "network-vif-plugged", "status": "completed", "tag": "e0f13bf8-3ce6-42eb-a36c-5d668ff79e32"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:09.964717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ea58f6e5-d766-49b7-88f7-e44a4dc15600 req-44a77cb9-d558-47de-8ca7-9881835a484a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.965170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ea58f6e5-d766-49b7-88f7-e44a4dc15600 req-44a77cb9-d558-47de-8ca7-9881835a484a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.980936 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-ea58f6e5-d766-49b7-88f7-e44a4dc15600 req-44a77cb9-d558-47de-8ca7-9881835a484a service nova] Creating event network-vif-plugged:e0f13bf8-3ce6-42eb-a36c-5d668ff79e32 for instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 on n-h2-826526-5 Jul 20 04:36:09.991180 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-ea58f6e5-d766-49b7-88f7-e44a4dc15600 req-44a77cb9-d558-47de-8ca7-9881835a484a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061074 Jul 20 04:36:09.992150 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1901/4023] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:10.183854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6a03e15f-0db2-4913-b33c-57986fb23650 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:10.184597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6a03e15f-0db2-4913-b33c-57986fb23650 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:10.198847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a03e15f-0db2-4913-b33c-57986fb23650 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.199299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a03e15f-0db2-4913-b33c-57986fb23650 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.200096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a03e15f-0db2-4913-b33c-57986fb23650 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.200566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a03e15f-0db2-4913-b33c-57986fb23650 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.312800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bafd5d1c-8fc1-4724-9735-d3c6edb798f2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:10.323150 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bafd5d1c-8fc1-4724-9735-d3c6edb798f2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 200 len: 1514 microversion: 2.1 time: 1.033739 Jul 20 04:36:10.334632 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2123/4024] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:09 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 1514 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:10.419599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6a03e15f-0db2-4913-b33c-57986fb23650 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:10.435270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6a03e15f-0db2-4913-b33c-57986fb23650 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:10.440545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6a03e15f-0db2-4913-b33c-57986fb23650 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:10.442286 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6a03e15f-0db2-4913-b33c-57986fb23650 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1406 microversion: 2.20 time: 0.262838 Jul 20 04:36:10.445420 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1902/4025] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:10 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:10.616198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4e69ccce-38c5-44ee-a9bc-e97d016ddee7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:10.617234 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4e69ccce-38c5-44ee-a9bc-e97d016ddee7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:10.630843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e69ccce-38c5-44ee-a9bc-e97d016ddee7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.631535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e69ccce-38c5-44ee-a9bc-e97d016ddee7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.632566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e69ccce-38c5-44ee-a9bc-e97d016ddee7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.634669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e69ccce-38c5-44ee-a9bc-e97d016ddee7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.946894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6fa9e2f8-955c-44c8-a1e1-b214e1ec7317 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:10.947652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6fa9e2f8-955c-44c8-a1e1-b214e1ec7317 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:10.964180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6fa9e2f8-955c-44c8-a1e1-b214e1ec7317 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.964794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6fa9e2f8-955c-44c8-a1e1-b214e1ec7317 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.965996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6fa9e2f8-955c-44c8-a1e1-b214e1ec7317 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.966775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6fa9e2f8-955c-44c8-a1e1-b214e1ec7317 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:11.006431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4e69ccce-38c5-44ee-a9bc-e97d016ddee7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:11.022610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4e69ccce-38c5-44ee-a9bc-e97d016ddee7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:11.024544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4e69ccce-38c5-44ee-a9bc-e97d016ddee7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:11.026539 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4e69ccce-38c5-44ee-a9bc-e97d016ddee7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 0.415122 Jul 20 04:36:11.029859 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2124/4026] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:10 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:11.265859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6fa9e2f8-955c-44c8-a1e1-b214e1ec7317 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:11.274636 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6fa9e2f8-955c-44c8-a1e1-b214e1ec7317 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1671 microversion: 2.1 time: 0.332350 Jul 20 04:36:11.285209 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1903/4027] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:10 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1671 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:11.341059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-14e8b843-9a22-490a-9f93-982983e01362 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:11.341868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-14e8b843-9a22-490a-9f93-982983e01362 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:11.356970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14e8b843-9a22-490a-9f93-982983e01362 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:11.360883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14e8b843-9a22-490a-9f93-982983e01362 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:11.362312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14e8b843-9a22-490a-9f93-982983e01362 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:11.363973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14e8b843-9a22-490a-9f93-982983e01362 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:11.463387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d3f3d2a-5ea0-470d-8c3c-1ca2d21234ee tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:11.463568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d3f3d2a-5ea0-470d-8c3c-1ca2d21234ee tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:11.482494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d3f3d2a-5ea0-470d-8c3c-1ca2d21234ee tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:11.485111 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d3f3d2a-5ea0-470d-8c3c-1ca2d21234ee tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:11.490813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d3f3d2a-5ea0-470d-8c3c-1ca2d21234ee tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:11.492088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d3f3d2a-5ea0-470d-8c3c-1ca2d21234ee tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:11.652590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-14e8b843-9a22-490a-9f93-982983e01362 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:11.666258 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-14e8b843-9a22-490a-9f93-982983e01362 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 200 len: 1514 microversion: 2.1 time: 0.329099 Jul 20 04:36:11.676762 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2125/4028] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:11 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 1514 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:11.794296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e8d98a73-4f94-4589-a3ff-11698907c839 req-e03c5499-ebc3-41aa-b1cc-47d4710a9d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f506656-eef4-4b57-9559-0471bed3136e", "name": "network-vif-deleted", "tag": "9d9ea71b-b365-4f8e-912e-6aa5c5eaeb26"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:11.819518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e8d98a73-4f94-4589-a3ff-11698907c839 req-e03c5499-ebc3-41aa-b1cc-47d4710a9d33 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:11.820344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e8d98a73-4f94-4589-a3ff-11698907c839 req-e03c5499-ebc3-41aa-b1cc-47d4710a9d33 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:11.847187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d3f3d2a-5ea0-470d-8c3c-1ca2d21234ee tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:11.859842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d3f3d2a-5ea0-470d-8c3c-1ca2d21234ee tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:11.863246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d3f3d2a-5ea0-470d-8c3c-1ca2d21234ee tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:11.865821 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e8d98a73-4f94-4589-a3ff-11698907c839 req-e03c5499-ebc3-41aa-b1cc-47d4710a9d33 service nova] Creating event network-vif-deleted:9d9ea71b-b365-4f8e-912e-6aa5c5eaeb26 for instance 5f506656-eef4-4b57-9559-0471bed3136e on n-h1-826526-5 Jul 20 04:36:11.867372 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d3f3d2a-5ea0-470d-8c3c-1ca2d21234ee tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1597 microversion: 2.20 time: 0.409186 Jul 20 04:36:11.886153 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1904/4029] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:11 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1597 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:11.892653 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e8d98a73-4f94-4589-a3ff-11698907c839 req-e03c5499-ebc3-41aa-b1cc-47d4710a9d33 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102051 Jul 20 04:36:11.894642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-58f5d42a-2600-492a-9322-81a59249da06 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:11.908552 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2126/4030] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:36:11.909214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-58f5d42a-2600-492a-9322-81a59249da06 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:11.916928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58f5d42a-2600-492a-9322-81a59249da06 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:11.918330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58f5d42a-2600-492a-9322-81a59249da06 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:11.919656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58f5d42a-2600-492a-9322-81a59249da06 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:11.920288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58f5d42a-2600-492a-9322-81a59249da06 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:12.051227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5a6c7ad1-aa51-467d-9776-be57c6cc1b72 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:12.051945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5a6c7ad1-aa51-467d-9776-be57c6cc1b72 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:12.067653 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-58f5d42a-2600-492a-9322-81a59249da06 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.179939 Jul 20 04:36:12.068250 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1905/4031] 10.222.0.17 () {60 vars in 1315 bytes} [Wed Jul 20 04:36:11 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:36:12.087768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a6c7ad1-aa51-467d-9776-be57c6cc1b72 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:12.088730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a6c7ad1-aa51-467d-9776-be57c6cc1b72 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:12.090754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a6c7ad1-aa51-467d-9776-be57c6cc1b72 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:12.091867 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a6c7ad1-aa51-467d-9776-be57c6cc1b72 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:12.293824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4bd2aa54-3308-49fb-a69f-f0711610a114 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:12.294530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4bd2aa54-3308-49fb-a69f-f0711610a114 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:12.304484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4bd2aa54-3308-49fb-a69f-f0711610a114 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:12.309746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4bd2aa54-3308-49fb-a69f-f0711610a114 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:12.310756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4bd2aa54-3308-49fb-a69f-f0711610a114 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:12.311222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4bd2aa54-3308-49fb-a69f-f0711610a114 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:12.574945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5a6c7ad1-aa51-467d-9776-be57c6cc1b72 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:12.599730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5a6c7ad1-aa51-467d-9776-be57c6cc1b72 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:12.606255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5a6c7ad1-aa51-467d-9776-be57c6cc1b72 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:12.619726 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5a6c7ad1-aa51-467d-9776-be57c6cc1b72 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 0.562486 Jul 20 04:36:12.629489 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2127/4032] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:12 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:12.659170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4bd2aa54-3308-49fb-a69f-f0711610a114 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:12.667497 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4bd2aa54-3308-49fb-a69f-f0711610a114 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.378916 Jul 20 04:36:12.669950 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1906/4033] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:12 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:12.695461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-00c1925b-3495-49b4-a129-5c1ca09250e4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:12.696050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-00c1925b-3495-49b4-a129-5c1ca09250e4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 5f506656-eef4-4b57-9559-0471bed3136e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:12.696377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7b69eec2-f85a-40fc-bac0-703daf9f15c9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:12.701299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7b69eec2-f85a-40fc-bac0-703daf9f15c9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:12.703151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00c1925b-3495-49b4-a129-5c1ca09250e4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:12.703787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00c1925b-3495-49b4-a129-5c1ca09250e4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:12.704798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00c1925b-3495-49b4-a129-5c1ca09250e4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:12.705404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00c1925b-3495-49b4-a129-5c1ca09250e4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:12.713329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b69eec2-f85a-40fc-bac0-703daf9f15c9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:12.714311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b69eec2-f85a-40fc-bac0-703daf9f15c9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:12.716562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b69eec2-f85a-40fc-bac0-703daf9f15c9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:12.717512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b69eec2-f85a-40fc-bac0-703daf9f15c9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:12.728362 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-00c1925b-3495-49b4-a129-5c1ca09250e4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] HTTP exception thrown: Instance 5f506656-eef4-4b57-9559-0471bed3136e could not be found. Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-00c1925b-3495-49b4-a129-5c1ca09250e4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Request method failure captured: Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e HTTP/1.1 Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Ub5vekHRS3Hfq4mTEVvhoHkv8cWNaG9M-paafXaeFyeqwnADXb9sncsdoJnnQu0Lgl6MbUPe3RAvBGn6oPHCzyDGNyP32bdxJdvf44034x78VRadDxGBz8vGc7Dtd6T2MDPGpXbswJxucDlbUV9C-IBGGs3Nlo0j4xYgLo2v_hra0 Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 9ec608ff77894cd7b35ce5dbdffcd775 Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1674289088 Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9ec608ff77894cd7b35ce5dbdffcd775"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9ec608ff77894cd7b35ce5dbdffcd775"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9ec608ff77894cd7b35ce5dbdffcd775", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9ec608ff77894cd7b35ce5dbdffcd775"}]}] Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-VolumesSnapshotTestJSON-1674289088 Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 9ec608ff77894cd7b35ce5dbdffcd775 Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1674289088 Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-VolumesSnapshotTestJSON-1674289088-project Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: d2cd39643e804592be29c8bf6552f1dc Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-VolumesSnapshotTestJSON-1674289088-project Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 5f506656-eef4-4b57-9559-0471bed3136e could not be found. Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '5f506656-eef4-4b57-9559-0471bed3136e'} Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f506656-eef4-4b57-9559-0471bed3136e could not be found. Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f506656-eef4-4b57-9559-0471bed3136e could not be found. Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:12.730864 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:36:12.737735 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:12.737735 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:12.737735 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:12.737735 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:12.737735 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:12.737735 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f506656-eef4-4b57-9559-0471bed3136e could not be found. Jul 20 04:36:12.737735 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:36:12.742507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-00c1925b-3495-49b4-a129-5c1ca09250e4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Returning 404 to user: Instance 5f506656-eef4-4b57-9559-0471bed3136e could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:12.743708 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-00c1925b-3495-49b4-a129-5c1ca09250e4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e" status: 404 len: 111 microversion: 2.1 time: 0.058254 Jul 20 04:36:12.744968 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2128/4034] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:12 2022] GET /compute/v2.1/servers/5f506656-eef4-4b57-9559-0471bed3136e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:12.812024 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7b69eec2-f85a-40fc-bac0-703daf9f15c9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 200 len: 322 microversion: 2.1 time: 0.119205 Jul 20 04:36:12.813932 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1907/4035] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:12 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 322 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:12.823180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f9575a6b-455e-43b2-9174-035ba64ec0d3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:12.824134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f9575a6b-455e-43b2-9174-035ba64ec0d3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:12.836313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9575a6b-455e-43b2-9174-035ba64ec0d3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:12.837161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9575a6b-455e-43b2-9174-035ba64ec0d3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:12.841829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9575a6b-455e-43b2-9174-035ba64ec0d3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:12.843010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9575a6b-455e-43b2-9174-035ba64ec0d3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.435517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f9575a6b-455e-43b2-9174-035ba64ec0d3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:13.448350 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f9575a6b-455e-43b2-9174-035ba64ec0d3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.629556 Jul 20 04:36:13.451633 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2129/4036] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:12 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:13.470800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-929e6bb7-5d81-4632-bb45-dec2416c6231 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:13.473255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-929e6bb7-5d81-4632-bb45-dec2416c6231 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:13.488378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-929e6bb7-5d81-4632-bb45-dec2416c6231 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.489322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-929e6bb7-5d81-4632-bb45-dec2416c6231 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.491625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-929e6bb7-5d81-4632-bb45-dec2416c6231 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.492073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-929e6bb7-5d81-4632-bb45-dec2416c6231 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.663464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d941e588-c07e-4b4d-bd49-3cb3a79074eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:13.665732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d941e588-c07e-4b4d-bd49-3cb3a79074eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:13.678214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d941e588-c07e-4b4d-bd49-3cb3a79074eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.678676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d941e588-c07e-4b4d-bd49-3cb3a79074eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.679482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d941e588-c07e-4b4d-bd49-3cb3a79074eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.679927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d941e588-c07e-4b4d-bd49-3cb3a79074eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.817732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-929e6bb7-5d81-4632-bb45-dec2416c6231 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:13.831562 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-929e6bb7-5d81-4632-bb45-dec2416c6231 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.365470 Jul 20 04:36:13.833335 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1908/4037] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:13 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:13.858860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf446e5c-7c91-47e8-b478-51cc393c4872 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:13.859984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf446e5c-7c91-47e8-b478-51cc393c4872 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:13.869625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf446e5c-7c91-47e8-b478-51cc393c4872 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.870266 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf446e5c-7c91-47e8-b478-51cc393c4872 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.871505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf446e5c-7c91-47e8-b478-51cc393c4872 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.872122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf446e5c-7c91-47e8-b478-51cc393c4872 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:14.326894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bf446e5c-7c91-47e8-b478-51cc393c4872 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:14.339040 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf446e5c-7c91-47e8-b478-51cc393c4872 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.487068 Jul 20 04:36:14.352582 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1909/4038] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:13 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:14.357814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-036a14c3-74de-4211-a42e-0041a29833d4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:14.358656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-036a14c3-74de-4211-a42e-0041a29833d4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:14.365486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-036a14c3-74de-4211-a42e-0041a29833d4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:14.366178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-036a14c3-74de-4211-a42e-0041a29833d4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:14.367127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-036a14c3-74de-4211-a42e-0041a29833d4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:14.367729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-036a14c3-74de-4211-a42e-0041a29833d4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:14.488393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d941e588-c07e-4b4d-bd49-3cb3a79074eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:14.532424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d941e588-c07e-4b4d-bd49-3cb3a79074eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:14.536639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d941e588-c07e-4b4d-bd49-3cb3a79074eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:14.540672 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d941e588-c07e-4b4d-bd49-3cb3a79074eb tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 0.881196 Jul 20 04:36:14.544034 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2130/4039] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:13 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:14.566904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-036a14c3-74de-4211-a42e-0041a29833d4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:14.574986 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-036a14c3-74de-4211-a42e-0041a29833d4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.220871 Jul 20 04:36:14.578700 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1910/4040] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:14 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:14.777654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-69a778d3-e101-4704-9f2a-84ab8947e736 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-518822930", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "69228133-6b77-4fda-a084-e067c6109be5"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:14.901914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-69a778d3-e101-4704-9f2a-84ab8947e736 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] validate_networks() for [('69228133-6b77-4fda-a084-e067c6109be5', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:36:14.906316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-97958717-3314-4a2b-b8bb-8f91267ac0ba req-0528b41b-8811-463f-8d9a-628538f60629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ebac50-3466-4fdc-8ca1-59b0001e2581", "tag": "e0f13bf8-3ce6-42eb-a36c-5d668ff79e32"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:14.932438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-97958717-3314-4a2b-b8bb-8f91267ac0ba req-0528b41b-8811-463f-8d9a-628538f60629 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:14.933181 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-97958717-3314-4a2b-b8bb-8f91267ac0ba req-0528b41b-8811-463f-8d9a-628538f60629 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:14.965532 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-97958717-3314-4a2b-b8bb-8f91267ac0ba req-0528b41b-8811-463f-8d9a-628538f60629 service nova] Creating event network-changed:e0f13bf8-3ce6-42eb-a36c-5d668ff79e32 for instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 on n-h2-826526-5 Jul 20 04:36:14.986426 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-97958717-3314-4a2b-b8bb-8f91267ac0ba req-0528b41b-8811-463f-8d9a-628538f60629 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085594 Jul 20 04:36:14.988201 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1911/4041] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:15.563101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-845b8016-78f4-4e6f-baef-940db162c9a8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:15.563974 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-845b8016-78f4-4e6f-baef-940db162c9a8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:15.577466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-845b8016-78f4-4e6f-baef-940db162c9a8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:15.579726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-845b8016-78f4-4e6f-baef-940db162c9a8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:15.581405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-845b8016-78f4-4e6f-baef-940db162c9a8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:15.587515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-845b8016-78f4-4e6f-baef-940db162c9a8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:16.725186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-69a778d3-e101-4704-9f2a-84ab8947e736 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:36:16.725691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-69a778d3-e101-4704-9f2a-84ab8947e736 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:36:16.726079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-69a778d3-e101-4704-9f2a-84ab8947e736 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:36:16.726490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-69a778d3-e101-4704-9f2a-84ab8947e736 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:36:16.726903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-69a778d3-e101-4704-9f2a-84ab8947e736 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:36:16.738426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69a778d3-e101-4704-9f2a-84ab8947e736 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:16.738927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69a778d3-e101-4704-9f2a-84ab8947e736 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:16.739889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69a778d3-e101-4704-9f2a-84ab8947e736 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:16.740379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69a778d3-e101-4704-9f2a-84ab8947e736 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:16.792086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-69a778d3-e101-4704-9f2a-84ab8947e736 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Getting quotas for project fcd6c40faa19476db37fa7897dea5840. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:16.807181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-69a778d3-e101-4704-9f2a-84ab8947e736 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Getting quotas for user f50ac97f2ef04752bd49148748e39eb8 and project fcd6c40faa19476db37fa7897dea5840. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:16.840490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-69a778d3-e101-4704-9f2a-84ab8947e736 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:36:16.846179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-69a778d3-e101-4704-9f2a-84ab8947e736 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:36:16.980450 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-69a778d3-e101-4704-9f2a-84ab8947e736 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.208705 Jul 20 04:36:16.983145 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2131/4042] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:36:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:36:16.999055 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-29014fc1-78df-41bd-a399-0dc27371835b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:16.999996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-29014fc1-78df-41bd-a399-0dc27371835b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:17.036832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-845b8016-78f4-4e6f-baef-940db162c9a8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:17.050982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-845b8016-78f4-4e6f-baef-940db162c9a8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:17.058396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-845b8016-78f4-4e6f-baef-940db162c9a8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:17.060013 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-845b8016-78f4-4e6f-baef-940db162c9a8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1892 microversion: 2.42 time: 1.502721 Jul 20 04:36:17.075361 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1912/4043] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:15 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1892 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:17.208850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-29014fc1-78df-41bd-a399-0dc27371835b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:17.231392 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-29014fc1-78df-41bd-a399-0dc27371835b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1214 microversion: 2.1 time: 0.240971 Jul 20 04:36:17.235166 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2132/4044] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:16 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1214 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:17.398877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6f5e9b0e-d93e-41c9-830d-2011e917dad1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-212067818", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "a44503e7-5485-4047-9e8f-c8ecfbacee10"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:17.510920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-6f5e9b0e-d93e-41c9-830d-2011e917dad1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] validate_networks() for [('a44503e7-5485-4047-9e8f-c8ecfbacee10', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:36:18.082861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-588216bb-037e-4013-bd46-72f0c997cfcd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:18.083591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-588216bb-037e-4013-bd46-72f0c997cfcd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:18.106684 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-588216bb-037e-4013-bd46-72f0c997cfcd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:18.107344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-588216bb-037e-4013-bd46-72f0c997cfcd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:18.110294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-588216bb-037e-4013-bd46-72f0c997cfcd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:18.110820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-588216bb-037e-4013-bd46-72f0c997cfcd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:18.209196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6f5e9b0e-d93e-41c9-830d-2011e917dad1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:36:18.210309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6f5e9b0e-d93e-41c9-830d-2011e917dad1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:36:18.212069 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6f5e9b0e-d93e-41c9-830d-2011e917dad1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:36:18.214228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6f5e9b0e-d93e-41c9-830d-2011e917dad1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:36:18.214924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6f5e9b0e-d93e-41c9-830d-2011e917dad1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:36:18.258961 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f5e9b0e-d93e-41c9-830d-2011e917dad1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:18.265800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f5e9b0e-d93e-41c9-830d-2011e917dad1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:18.266892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f5e9b0e-d93e-41c9-830d-2011e917dad1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:18.268645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f5e9b0e-d93e-41c9-830d-2011e917dad1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:18.330944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-6f5e9b0e-d93e-41c9-830d-2011e917dad1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Getting quotas for project 3946bd28f7c44d5eb9a550efb7b3ab50. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:18.340712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-6f5e9b0e-d93e-41c9-830d-2011e917dad1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Getting quotas for user f3b497b40aed4f41a049781e5c0013d4 and project 3946bd28f7c44d5eb9a550efb7b3ab50. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:18.396116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6f5e9b0e-d93e-41c9-830d-2011e917dad1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:36:18.399980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6f5e9b0e-d93e-41c9-830d-2011e917dad1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:36:18.492637 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6f5e9b0e-d93e-41c9-830d-2011e917dad1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.414443 Jul 20 04:36:18.506228 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1913/4045] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:36:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:36:18.523040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-043963fe-ccac-4401-b107-974f853f2e27 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:18.523812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-043963fe-ccac-4401-b107-974f853f2e27 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:18.532157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-043963fe-ccac-4401-b107-974f853f2e27 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:18.533047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-043963fe-ccac-4401-b107-974f853f2e27 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:18.534161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-043963fe-ccac-4401-b107-974f853f2e27 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:18.534614 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-043963fe-ccac-4401-b107-974f853f2e27 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:18.631114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-043963fe-ccac-4401-b107-974f853f2e27 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:18.646354 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-043963fe-ccac-4401-b107-974f853f2e27 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1266 microversion: 2.1 time: 0.133427 Jul 20 04:36:18.666771 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1914/4046] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:18 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:18.693101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c12b4574-19c1-485b-88dd-462eb6858e5d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1281515929", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "a44503e7-5485-4047-9e8f-c8ecfbacee10"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:18.715811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-588216bb-037e-4013-bd46-72f0c997cfcd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:18.738428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-588216bb-037e-4013-bd46-72f0c997cfcd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:18.745172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-588216bb-037e-4013-bd46-72f0c997cfcd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:18.753360 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-588216bb-037e-4013-bd46-72f0c997cfcd tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.670250 Jul 20 04:36:18.754327 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2133/4047] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:18 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:18.809653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-c12b4574-19c1-485b-88dd-462eb6858e5d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] validate_networks() for [('a44503e7-5485-4047-9e8f-c8ecfbacee10', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:36:19.685209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b5949c1c-7e2b-4d30-a486-dcfc3be91878 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:19.687492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b5949c1c-7e2b-4d30-a486-dcfc3be91878 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:19.704134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5949c1c-7e2b-4d30-a486-dcfc3be91878 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.705021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5949c1c-7e2b-4d30-a486-dcfc3be91878 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.706350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5949c1c-7e2b-4d30-a486-dcfc3be91878 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.707055 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5949c1c-7e2b-4d30-a486-dcfc3be91878 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.895036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b5949c1c-7e2b-4d30-a486-dcfc3be91878 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:19.904377 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b5949c1c-7e2b-4d30-a486-dcfc3be91878 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1272 microversion: 2.1 time: 0.224046 Jul 20 04:36:19.909930 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2134/4048] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:19 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1272 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:19.926059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-44d10830-9332-4301-8815-45b199513bc7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:19.928391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-44d10830-9332-4301-8815-45b199513bc7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:19.944861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44d10830-9332-4301-8815-45b199513bc7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.947428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44d10830-9332-4301-8815-45b199513bc7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.948540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44d10830-9332-4301-8815-45b199513bc7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.949865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44d10830-9332-4301-8815-45b199513bc7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.962697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-c12b4574-19c1-485b-88dd-462eb6858e5d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:36:19.963782 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-c12b4574-19c1-485b-88dd-462eb6858e5d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:36:19.964681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-c12b4574-19c1-485b-88dd-462eb6858e5d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:36:19.965370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-c12b4574-19c1-485b-88dd-462eb6858e5d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:36:19.966334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-c12b4574-19c1-485b-88dd-462eb6858e5d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:36:19.985330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c12b4574-19c1-485b-88dd-462eb6858e5d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.985594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c12b4574-19c1-485b-88dd-462eb6858e5d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.995742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c12b4574-19c1-485b-88dd-462eb6858e5d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.996208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c12b4574-19c1-485b-88dd-462eb6858e5d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:20.128869 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-c12b4574-19c1-485b-88dd-462eb6858e5d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Getting quotas for project 3946bd28f7c44d5eb9a550efb7b3ab50. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:20.149129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-c12b4574-19c1-485b-88dd-462eb6858e5d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Getting quotas for user f3b497b40aed4f41a049781e5c0013d4 and project 3946bd28f7c44d5eb9a550efb7b3ab50. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:20.205972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c12b4574-19c1-485b-88dd-462eb6858e5d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:36:20.215878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c12b4574-19c1-485b-88dd-462eb6858e5d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 2c2adc32-835f-427a-89df-e95652a204a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:36:20.297543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:20.320638 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c12b4574-19c1-485b-88dd-462eb6858e5d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.652598 Jul 20 04:36:20.321674 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1915/4049] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:36:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:36:20.454386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bac2b4d7-59b5-4d08-8093-5afa6f55dc23 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-571799479", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "451", "networks": [{"uuid": "a44503e7-5485-4047-9e8f-c8ecfbacee10"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:20.570952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-44d10830-9332-4301-8815-45b199513bc7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:20.587460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-44d10830-9332-4301-8815-45b199513bc7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:20.591906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-44d10830-9332-4301-8815-45b199513bc7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:20.604922 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-44d10830-9332-4301-8815-45b199513bc7 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.684869 Jul 20 04:36:20.612459 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2135/4050] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:19 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:20.675320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-bac2b4d7-59b5-4d08-8093-5afa6f55dc23 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] validate_networks() for [('a44503e7-5485-4047-9e8f-c8ecfbacee10', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:36:20.931716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d3e49868-5c1d-4bc9-8314-c5f3a86e2c3d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:20.932580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d3e49868-5c1d-4bc9-8314-c5f3a86e2c3d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:20.968648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3e49868-5c1d-4bc9-8314-c5f3a86e2c3d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:20.972157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3e49868-5c1d-4bc9-8314-c5f3a86e2c3d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:20.974312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3e49868-5c1d-4bc9-8314-c5f3a86e2c3d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:20.978087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3e49868-5c1d-4bc9-8314-c5f3a86e2c3d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:21.228398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d3e49868-5c1d-4bc9-8314-c5f3a86e2c3d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:21.240752 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d3e49868-5c1d-4bc9-8314-c5f3a86e2c3d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1272 microversion: 2.1 time: 0.317219 Jul 20 04:36:21.242456 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2136/4051] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:20 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1272 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:21.620044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ff6d5dbc-1bc7-4a32-b3c9-fa9b1733bc99 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:21.621178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ff6d5dbc-1bc7-4a32-b3c9-fa9b1733bc99 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:21.643056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff6d5dbc-1bc7-4a32-b3c9-fa9b1733bc99 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:21.644755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff6d5dbc-1bc7-4a32-b3c9-fa9b1733bc99 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:21.650077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff6d5dbc-1bc7-4a32-b3c9-fa9b1733bc99 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:21.654007 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff6d5dbc-1bc7-4a32-b3c9-fa9b1733bc99 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:22.063152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ff6d5dbc-1bc7-4a32-b3c9-fa9b1733bc99 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:22.086808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ff6d5dbc-1bc7-4a32-b3c9-fa9b1733bc99 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:22.089012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ff6d5dbc-1bc7-4a32-b3c9-fa9b1733bc99 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:22.090580 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ff6d5dbc-1bc7-4a32-b3c9-fa9b1733bc99 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.475412 Jul 20 04:36:22.091397 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2137/4052] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:21 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:22.260375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9583139b-12c6-412a-b905-a05d19f92188 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:22.261300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9583139b-12c6-412a-b905-a05d19f92188 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:22.272035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9583139b-12c6-412a-b905-a05d19f92188 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:22.275083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9583139b-12c6-412a-b905-a05d19f92188 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:22.276115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9583139b-12c6-412a-b905-a05d19f92188 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:22.276690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9583139b-12c6-412a-b905-a05d19f92188 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:22.671040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9583139b-12c6-412a-b905-a05d19f92188 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:22.679549 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9583139b-12c6-412a-b905-a05d19f92188 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1314 microversion: 2.1 time: 0.424187 Jul 20 04:36:22.688484 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2138/4053] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:22 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:22.826262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-bac2b4d7-59b5-4d08-8093-5afa6f55dc23 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:36:22.826902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-bac2b4d7-59b5-4d08-8093-5afa6f55dc23 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:36:22.827423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-bac2b4d7-59b5-4d08-8093-5afa6f55dc23 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:36:22.827848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-bac2b4d7-59b5-4d08-8093-5afa6f55dc23 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:36:22.828295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-bac2b4d7-59b5-4d08-8093-5afa6f55dc23 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:36:22.847056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bac2b4d7-59b5-4d08-8093-5afa6f55dc23 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:22.848047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bac2b4d7-59b5-4d08-8093-5afa6f55dc23 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:22.849346 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bac2b4d7-59b5-4d08-8093-5afa6f55dc23 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:22.850094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bac2b4d7-59b5-4d08-8093-5afa6f55dc23 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:22.908355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-bac2b4d7-59b5-4d08-8093-5afa6f55dc23 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Getting quotas for project 3946bd28f7c44d5eb9a550efb7b3ab50. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:22.927304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-bac2b4d7-59b5-4d08-8093-5afa6f55dc23 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Getting quotas for user f3b497b40aed4f41a049781e5c0013d4 and project 3946bd28f7c44d5eb9a550efb7b3ab50. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:22.965137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bac2b4d7-59b5-4d08-8093-5afa6f55dc23 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:36:22.967763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bac2b4d7-59b5-4d08-8093-5afa6f55dc23 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:36:23.027071 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bac2b4d7-59b5-4d08-8093-5afa6f55dc23 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.577827 Jul 20 04:36:23.028586 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1916/4054] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:36:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:36:23.042630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-00f7c985-8045-43f2-a5e3-ac1b7a60a5d7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:23.043649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-00f7c985-8045-43f2-a5e3-ac1b7a60a5d7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:23.109623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-de20d7a9-aede-4b40-8b5f-11dfc2cdf010 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:23.110289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-de20d7a9-aede-4b40-8b5f-11dfc2cdf010 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:23.119179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de20d7a9-aede-4b40-8b5f-11dfc2cdf010 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:23.119641 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de20d7a9-aede-4b40-8b5f-11dfc2cdf010 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:23.120462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de20d7a9-aede-4b40-8b5f-11dfc2cdf010 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:23.138932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-00f7c985-8045-43f2-a5e3-ac1b7a60a5d7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:23.140040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de20d7a9-aede-4b40-8b5f-11dfc2cdf010 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:23.162373 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-00f7c985-8045-43f2-a5e3-ac1b7a60a5d7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1220 microversion: 2.1 time: 0.125373 Jul 20 04:36:23.163551 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2139/4055] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:23 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1220 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:23.703616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-be1020a7-a4ce-4e9d-9767-85384f58d271 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:23.704375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-be1020a7-a4ce-4e9d-9767-85384f58d271 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:23.719516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be1020a7-a4ce-4e9d-9767-85384f58d271 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:23.722204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be1020a7-a4ce-4e9d-9767-85384f58d271 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:23.742357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be1020a7-a4ce-4e9d-9767-85384f58d271 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:23.743310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be1020a7-a4ce-4e9d-9767-85384f58d271 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:24.081386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-be1020a7-a4ce-4e9d-9767-85384f58d271 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:24.099647 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-be1020a7-a4ce-4e9d-9767-85384f58d271 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1314 microversion: 2.1 time: 0.400390 Jul 20 04:36:24.104689 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2140/4056] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:23 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:24.179024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-97b2d297-91bd-47db-8df8-ac09e86edede tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:24.179642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-97b2d297-91bd-47db-8df8-ac09e86edede tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:24.203659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97b2d297-91bd-47db-8df8-ac09e86edede tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:24.204113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97b2d297-91bd-47db-8df8-ac09e86edede tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:24.213380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97b2d297-91bd-47db-8df8-ac09e86edede tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:24.213813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97b2d297-91bd-47db-8df8-ac09e86edede tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:24.430599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-97b2d297-91bd-47db-8df8-ac09e86edede tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:24.449634 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-97b2d297-91bd-47db-8df8-ac09e86edede tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1216 microversion: 2.1 time: 0.274405 Jul 20 04:36:24.457137 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2141/4057] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:24 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1216 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:24.846038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-de20d7a9-aede-4b40-8b5f-11dfc2cdf010 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:24.884935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-de20d7a9-aede-4b40-8b5f-11dfc2cdf010 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:24.894533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-de20d7a9-aede-4b40-8b5f-11dfc2cdf010 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:24.903182 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-de20d7a9-aede-4b40-8b5f-11dfc2cdf010 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 1.793278 Jul 20 04:36:24.908534 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1917/4058] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:23 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 1803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:25.120541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1f95d20d-fdab-4c3b-90a7-f2d7889c014c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:25.121483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1f95d20d-fdab-4c3b-90a7-f2d7889c014c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:25.137748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f95d20d-fdab-4c3b-90a7-f2d7889c014c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:25.138624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f95d20d-fdab-4c3b-90a7-f2d7889c014c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:25.139713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f95d20d-fdab-4c3b-90a7-f2d7889c014c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:25.140491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f95d20d-fdab-4c3b-90a7-f2d7889c014c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:25.343461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1f95d20d-fdab-4c3b-90a7-f2d7889c014c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:25.359323 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1f95d20d-fdab-4c3b-90a7-f2d7889c014c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1314 microversion: 2.1 time: 0.241708 Jul 20 04:36:25.360840 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2142/4059] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:25 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:25.468297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0115ce91-7b69-4f3e-bac3-838ce5f7c513 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:25.469030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0115ce91-7b69-4f3e-bac3-838ce5f7c513 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:25.489633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0115ce91-7b69-4f3e-bac3-838ce5f7c513 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:25.496004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0115ce91-7b69-4f3e-bac3-838ce5f7c513 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:25.502418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0115ce91-7b69-4f3e-bac3-838ce5f7c513 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:25.512430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0115ce91-7b69-4f3e-bac3-838ce5f7c513 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:25.735783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0115ce91-7b69-4f3e-bac3-838ce5f7c513 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:25.749724 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0115ce91-7b69-4f3e-bac3-838ce5f7c513 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1278 microversion: 2.1 time: 0.285420 Jul 20 04:36:25.751496 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1918/4060] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:25 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1278 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:25.930836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-700d9071-d115-4256-abff-922f20009d3d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:25.931689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-700d9071-d115-4256-abff-922f20009d3d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:25.940012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-700d9071-d115-4256-abff-922f20009d3d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:25.940541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-700d9071-d115-4256-abff-922f20009d3d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:25.941425 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-700d9071-d115-4256-abff-922f20009d3d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:25.942034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-700d9071-d115-4256-abff-922f20009d3d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:26.057564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f0d87bce-de45-4242-bca1-7c9afe6bfe1f req-80927d16-7731-4bff-ba03-c0f0cb55e2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57a59f2d-88a3-408a-a465-f86f983a11be", "tag": "c57b06f0-d23a-409f-9a66-3993cae11b08"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:26.092917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f0d87bce-de45-4242-bca1-7c9afe6bfe1f req-80927d16-7731-4bff-ba03-c0f0cb55e2b1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:26.093392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f0d87bce-de45-4242-bca1-7c9afe6bfe1f req-80927d16-7731-4bff-ba03-c0f0cb55e2b1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:26.126346 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f0d87bce-de45-4242-bca1-7c9afe6bfe1f req-80927d16-7731-4bff-ba03-c0f0cb55e2b1 service nova] Creating event network-changed:c57b06f0-d23a-409f-9a66-3993cae11b08 for instance 57a59f2d-88a3-408a-a465-f86f983a11be on n-h2-826526-5 Jul 20 04:36:26.135928 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f0d87bce-de45-4242-bca1-7c9afe6bfe1f req-80927d16-7731-4bff-ba03-c0f0cb55e2b1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083464 Jul 20 04:36:26.143629 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1919/4061] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:26.215433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-52dee102-252d-4cc9-b7a5-1375315df6b2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-649843496", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "f6037d71-c80c-42d4-b7df-76ef4babc455"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:26.296890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-52dee102-252d-4cc9-b7a5-1375315df6b2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] validate_networks() for [('f6037d71-c80c-42d4-b7df-76ef4babc455', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:36:26.446557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-700d9071-d115-4256-abff-922f20009d3d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:26.449055 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:26.461343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-700d9071-d115-4256-abff-922f20009d3d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:26.469622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-700d9071-d115-4256-abff-922f20009d3d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:26.471332 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-700d9071-d115-4256-abff-922f20009d3d tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.553017 Jul 20 04:36:26.477961 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2143/4062] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:25 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:26.488982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-772928bd-aa22-4bec-89b6-fb9d9622b584 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:26.489871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-772928bd-aa22-4bec-89b6-fb9d9622b584 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:26.501240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-772928bd-aa22-4bec-89b6-fb9d9622b584 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:26.501908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-772928bd-aa22-4bec-89b6-fb9d9622b584 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:26.503052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-772928bd-aa22-4bec-89b6-fb9d9622b584 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:26.503709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-772928bd-aa22-4bec-89b6-fb9d9622b584 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:26.753222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-772928bd-aa22-4bec-89b6-fb9d9622b584 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:26.767095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:26.778792 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-772928bd-aa22-4bec-89b6-fb9d9622b584 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1314 microversion: 2.1 time: 0.294446 Jul 20 04:36:26.780217 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2144/4063] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:26 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:26.788804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8e404842-6be9-462a-aacc-6d55503ebdec tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:26.789911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8e404842-6be9-462a-aacc-6d55503ebdec tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:26.809896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8e404842-6be9-462a-aacc-6d55503ebdec tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:26.810999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8e404842-6be9-462a-aacc-6d55503ebdec tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:26.812027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8e404842-6be9-462a-aacc-6d55503ebdec tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:26.812767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8e404842-6be9-462a-aacc-6d55503ebdec tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:26.955488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8e404842-6be9-462a-aacc-6d55503ebdec tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:26.968390 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8e404842-6be9-462a-aacc-6d55503ebdec tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1278 microversion: 2.1 time: 0.186774 Jul 20 04:36:26.969340 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2145/4064] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:26 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:27.246047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-0701e858-81c0-4dff-9174-f5ee1be31d1c req-5d92d3b1-2052-4125-8fa9-b5251eba72a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2adc32-835f-427a-89df-e95652a204a3", "tag": "ce282bc6-b2bb-4a44-8a82-f1ce93047f6f"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:27.257689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-0701e858-81c0-4dff-9174-f5ee1be31d1c req-5d92d3b1-2052-4125-8fa9-b5251eba72a4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:27.258775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-0701e858-81c0-4dff-9174-f5ee1be31d1c req-5d92d3b1-2052-4125-8fa9-b5251eba72a4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:27.309345 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-0701e858-81c0-4dff-9174-f5ee1be31d1c req-5d92d3b1-2052-4125-8fa9-b5251eba72a4 service nova] Creating event network-changed:ce282bc6-b2bb-4a44-8a82-f1ce93047f6f for instance 2c2adc32-835f-427a-89df-e95652a204a3 on n-h2-826526-5 Jul 20 04:36:27.317932 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-0701e858-81c0-4dff-9174-f5ee1be31d1c req-5d92d3b1-2052-4125-8fa9-b5251eba72a4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093405 Jul 20 04:36:27.324947 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2146/4065] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:27.492360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4afb8f43-e500-4eee-9001-91edb4792eb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:27.493774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4afb8f43-e500-4eee-9001-91edb4792eb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:27.506220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4afb8f43-e500-4eee-9001-91edb4792eb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:27.506671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4afb8f43-e500-4eee-9001-91edb4792eb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:27.521263 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4afb8f43-e500-4eee-9001-91edb4792eb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:27.534341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4afb8f43-e500-4eee-9001-91edb4792eb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:27.890801 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4afb8f43-e500-4eee-9001-91edb4792eb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:27.901485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4afb8f43-e500-4eee-9001-91edb4792eb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:27.906639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4afb8f43-e500-4eee-9001-91edb4792eb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:27.925228 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4afb8f43-e500-4eee-9001-91edb4792eb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.437838 Jul 20 04:36:27.927566 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2147/4066] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:27 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:27.943601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0a26d7f8-1e01-459e-8475-56cca7ee4217 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:27.948578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0a26d7f8-1e01-459e-8475-56cca7ee4217 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:27.970676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a26d7f8-1e01-459e-8475-56cca7ee4217 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:27.972011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a26d7f8-1e01-459e-8475-56cca7ee4217 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:27.973061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a26d7f8-1e01-459e-8475-56cca7ee4217 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:27.974099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a26d7f8-1e01-459e-8475-56cca7ee4217 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:28.185051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0a26d7f8-1e01-459e-8475-56cca7ee4217 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:28.203365 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0a26d7f8-1e01-459e-8475-56cca7ee4217 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1314 microversion: 2.1 time: 0.268353 Jul 20 04:36:28.205237 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2148/4067] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:27 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:28.215741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1fd9ce40-807d-4c20-a62d-cee28ad1704c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:28.217498 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1fd9ce40-807d-4c20-a62d-cee28ad1704c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:28.227981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1fd9ce40-807d-4c20-a62d-cee28ad1704c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:28.228734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1fd9ce40-807d-4c20-a62d-cee28ad1704c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:28.229860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1fd9ce40-807d-4c20-a62d-cee28ad1704c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:28.230471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1fd9ce40-807d-4c20-a62d-cee28ad1704c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:28.464835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1fd9ce40-807d-4c20-a62d-cee28ad1704c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:28.474748 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1fd9ce40-807d-4c20-a62d-cee28ad1704c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1320 microversion: 2.1 time: 0.267188 Jul 20 04:36:28.490591 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2149/4068] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:28 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1320 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:28.546295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-87a74c91-f6ab-4377-a53b-3c1a1a7abedd req-2d656888-c628-4681-bb97-edbf5345ac1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "964438a8-b527-40c0-b62b-f21bc79d5f1a", "tag": "48c7f7ac-66da-445b-9bc0-c6f6dc93a1f6"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:28.570568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-87a74c91-f6ab-4377-a53b-3c1a1a7abedd req-2d656888-c628-4681-bb97-edbf5345ac1e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:28.571382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-87a74c91-f6ab-4377-a53b-3c1a1a7abedd req-2d656888-c628-4681-bb97-edbf5345ac1e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:28.603898 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-87a74c91-f6ab-4377-a53b-3c1a1a7abedd req-2d656888-c628-4681-bb97-edbf5345ac1e service nova] Creating event network-changed:48c7f7ac-66da-445b-9bc0-c6f6dc93a1f6 for instance 964438a8-b527-40c0-b62b-f21bc79d5f1a on n-h1-826526-5 Jul 20 04:36:28.608714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-52dee102-252d-4cc9-b7a5-1375315df6b2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:36:28.609810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-52dee102-252d-4cc9-b7a5-1375315df6b2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:36:28.611041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-52dee102-252d-4cc9-b7a5-1375315df6b2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:36:28.611982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-52dee102-252d-4cc9-b7a5-1375315df6b2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:36:28.612710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-52dee102-252d-4cc9-b7a5-1375315df6b2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:36:28.619402 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-87a74c91-f6ab-4377-a53b-3c1a1a7abedd req-2d656888-c628-4681-bb97-edbf5345ac1e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078804 Jul 20 04:36:28.620023 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2150/4069] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:28.625978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52dee102-252d-4cc9-b7a5-1375315df6b2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:28.626731 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52dee102-252d-4cc9-b7a5-1375315df6b2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:28.628204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52dee102-252d-4cc9-b7a5-1375315df6b2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:28.628938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52dee102-252d-4cc9-b7a5-1375315df6b2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:28.676600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-52dee102-252d-4cc9-b7a5-1375315df6b2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Getting quotas for project 9ec608ff77894cd7b35ce5dbdffcd775. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:28.685223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-52dee102-252d-4cc9-b7a5-1375315df6b2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Getting quotas for user d2cd39643e804592be29c8bf6552f1dc and project 9ec608ff77894cd7b35ce5dbdffcd775. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:28.703845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-52dee102-252d-4cc9-b7a5-1375315df6b2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:36:28.707593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-52dee102-252d-4cc9-b7a5-1375315df6b2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:36:28.807831 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-52dee102-252d-4cc9-b7a5-1375315df6b2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.603565 Jul 20 04:36:28.808930 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1920/4070] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:36:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:36:28.820015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0d192d96-93c6-425d-9c7d-1151e0f3d1c5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:28.820755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0d192d96-93c6-425d-9c7d-1151e0f3d1c5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:28.838365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:28.903619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0d192d96-93c6-425d-9c7d-1151e0f3d1c5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:28.911591 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0d192d96-93c6-425d-9c7d-1151e0f3d1c5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1218 microversion: 2.1 time: 0.095750 Jul 20 04:36:28.915423 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2151/4071] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:28 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:28.949544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-756dded8-273a-47b2-80d5-ee115ed29138 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:28.950181 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-756dded8-273a-47b2-80d5-ee115ed29138 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:28.969351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-756dded8-273a-47b2-80d5-ee115ed29138 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:28.969893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-756dded8-273a-47b2-80d5-ee115ed29138 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:28.970577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-756dded8-273a-47b2-80d5-ee115ed29138 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:28.971134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-756dded8-273a-47b2-80d5-ee115ed29138 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:29.224239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0e960784-b6b3-449c-b551-8f6183c6bc53 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:29.225216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0e960784-b6b3-449c-b551-8f6183c6bc53 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:29.236392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0e960784-b6b3-449c-b551-8f6183c6bc53 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:29.237200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0e960784-b6b3-449c-b551-8f6183c6bc53 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:29.238220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0e960784-b6b3-449c-b551-8f6183c6bc53 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:29.240686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0e960784-b6b3-449c-b551-8f6183c6bc53 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:29.613087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0e960784-b6b3-449c-b551-8f6183c6bc53 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:29.632821 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0e960784-b6b3-449c-b551-8f6183c6bc53 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1314 microversion: 2.1 time: 0.411634 Jul 20 04:36:29.643455 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2152/4072] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:29 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:29.648964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a15fa729-d043-423d-81fc-c282eed6d2f7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:29.649848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a15fa729-d043-423d-81fc-c282eed6d2f7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:29.673299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a15fa729-d043-423d-81fc-c282eed6d2f7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:29.680000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a15fa729-d043-423d-81fc-c282eed6d2f7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:29.681277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a15fa729-d043-423d-81fc-c282eed6d2f7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:29.681915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a15fa729-d043-423d-81fc-c282eed6d2f7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:29.715211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-756dded8-273a-47b2-80d5-ee115ed29138 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:29.731665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-756dded8-273a-47b2-80d5-ee115ed29138 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:29.734308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-756dded8-273a-47b2-80d5-ee115ed29138 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:29.735684 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-756dded8-273a-47b2-80d5-ee115ed29138 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.791046 Jul 20 04:36:29.739099 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1921/4073] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:28 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:29.893797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a15fa729-d043-423d-81fc-c282eed6d2f7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:29.903647 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a15fa729-d043-423d-81fc-c282eed6d2f7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1320 microversion: 2.1 time: 0.258285 Jul 20 04:36:29.904917 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2153/4074] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:29 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1320 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:29.930167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-124e1081-cace-4b6e-a50a-d6b619e1b4b6 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:29.930961 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-124e1081-cace-4b6e-a50a-d6b619e1b4b6 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:29.941115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-124e1081-cace-4b6e-a50a-d6b619e1b4b6 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:29.950039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-124e1081-cace-4b6e-a50a-d6b619e1b4b6 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:29.951245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-124e1081-cace-4b6e-a50a-d6b619e1b4b6 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:29.951796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-124e1081-cace-4b6e-a50a-d6b619e1b4b6 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:29.957251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:30.123316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-124e1081-cace-4b6e-a50a-d6b619e1b4b6 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:30.145251 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-124e1081-cace-4b6e-a50a-d6b619e1b4b6 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1214 microversion: 2.1 time: 0.219904 Jul 20 04:36:30.146530 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1922/4075] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:29 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1214 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:30.656882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f2cd094f-eb9b-4895-bcca-ec402dcfd142 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:30.658178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f2cd094f-eb9b-4895-bcca-ec402dcfd142 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:30.673652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2cd094f-eb9b-4895-bcca-ec402dcfd142 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.674439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2cd094f-eb9b-4895-bcca-ec402dcfd142 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:30.677390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2cd094f-eb9b-4895-bcca-ec402dcfd142 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.678045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2cd094f-eb9b-4895-bcca-ec402dcfd142 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:30.690472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-0e1af80c-2296-4e9f-b764-3a61bd2dd5a9 req-90ab89c7-2020-4b53-ac9d-467956753e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd93ad5b-3aba-4a42-8b3d-4220e88bb810", "tag": "d96d8269-9882-4f7a-9157-4229a2fbfb80"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:30.737668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0e1af80c-2296-4e9f-b764-3a61bd2dd5a9 req-90ab89c7-2020-4b53-ac9d-467956753e9c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.738406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0e1af80c-2296-4e9f-b764-3a61bd2dd5a9 req-90ab89c7-2020-4b53-ac9d-467956753e9c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:30.802420 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-0e1af80c-2296-4e9f-b764-3a61bd2dd5a9 req-90ab89c7-2020-4b53-ac9d-467956753e9c service nova] Creating event network-changed:d96d8269-9882-4f7a-9157-4229a2fbfb80 for instance bd93ad5b-3aba-4a42-8b3d-4220e88bb810 on n-h1-826526-5 Jul 20 04:36:30.830479 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-0e1af80c-2296-4e9f-b764-3a61bd2dd5a9 req-90ab89c7-2020-4b53-ac9d-467956753e9c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144451 Jul 20 04:36:30.833917 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1923/4076] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:36:30.856845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed43d9a2-541c-401f-83eb-dd0ed20486c4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:30.864566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ed43d9a2-541c-401f-83eb-dd0ed20486c4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:30.872156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed43d9a2-541c-401f-83eb-dd0ed20486c4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.880968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed43d9a2-541c-401f-83eb-dd0ed20486c4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:30.882140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed43d9a2-541c-401f-83eb-dd0ed20486c4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.882584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed43d9a2-541c-401f-83eb-dd0ed20486c4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:31.082932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f2cd094f-eb9b-4895-bcca-ec402dcfd142 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:31.092014 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f2cd094f-eb9b-4895-bcca-ec402dcfd142 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1314 microversion: 2.1 time: 0.439466 Jul 20 04:36:31.102110 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2154/4077] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:30 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:31.117968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9372a381-16e9-43d6-b204-f660c43b45ee tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:31.119043 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9372a381-16e9-43d6-b204-f660c43b45ee tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:31.127635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9372a381-16e9-43d6-b204-f660c43b45ee tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:31.128354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9372a381-16e9-43d6-b204-f660c43b45ee tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:31.129567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9372a381-16e9-43d6-b204-f660c43b45ee tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:31.130245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9372a381-16e9-43d6-b204-f660c43b45ee tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:31.431277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9372a381-16e9-43d6-b204-f660c43b45ee tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:31.444616 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9372a381-16e9-43d6-b204-f660c43b45ee tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1320 microversion: 2.1 time: 0.340235 Jul 20 04:36:31.447834 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2155/4078] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:31 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1320 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:31.456138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0b3bc3a1-ed58-4c3d-94f1-1f3f2d0c2df5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:31.465730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0b3bc3a1-ed58-4c3d-94f1-1f3f2d0c2df5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:31.486517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b3bc3a1-ed58-4c3d-94f1-1f3f2d0c2df5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:31.487232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b3bc3a1-ed58-4c3d-94f1-1f3f2d0c2df5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:31.488308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b3bc3a1-ed58-4c3d-94f1-1f3f2d0c2df5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:31.488955 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b3bc3a1-ed58-4c3d-94f1-1f3f2d0c2df5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:31.594408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0b3bc3a1-ed58-4c3d-94f1-1f3f2d0c2df5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:31.607718 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0b3bc3a1-ed58-4c3d-94f1-1f3f2d0c2df5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1276 microversion: 2.1 time: 0.153291 Jul 20 04:36:31.623868 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2156/4079] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:31 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:31.630880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ed43d9a2-541c-401f-83eb-dd0ed20486c4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:31.641549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ed43d9a2-541c-401f-83eb-dd0ed20486c4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:31.644027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ed43d9a2-541c-401f-83eb-dd0ed20486c4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:31.645265 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ed43d9a2-541c-401f-83eb-dd0ed20486c4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.808295 Jul 20 04:36:31.648686 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1924/4080] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:30 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:32.114766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2daae26d-9421-4c8d-8f9d-79b06ca3ba8b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:32.116742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2daae26d-9421-4c8d-8f9d-79b06ca3ba8b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:32.128247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2daae26d-9421-4c8d-8f9d-79b06ca3ba8b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:32.130412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2daae26d-9421-4c8d-8f9d-79b06ca3ba8b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:32.131234 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2daae26d-9421-4c8d-8f9d-79b06ca3ba8b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:32.134964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2daae26d-9421-4c8d-8f9d-79b06ca3ba8b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:32.465698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea75b558-8a85-4242-9e01-56420dfd814a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:32.466478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ea75b558-8a85-4242-9e01-56420dfd814a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:32.476435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea75b558-8a85-4242-9e01-56420dfd814a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:32.477206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea75b558-8a85-4242-9e01-56420dfd814a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:32.478187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea75b558-8a85-4242-9e01-56420dfd814a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:32.478814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea75b558-8a85-4242-9e01-56420dfd814a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:32.519940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2daae26d-9421-4c8d-8f9d-79b06ca3ba8b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:32.532468 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2daae26d-9421-4c8d-8f9d-79b06ca3ba8b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1314 microversion: 2.1 time: 0.422869 Jul 20 04:36:32.537467 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2157/4081] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:32 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:32.626770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8dc11a93-8273-45ed-af88-1b1907d7fdb0 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:32.628362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8dc11a93-8273-45ed-af88-1b1907d7fdb0 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:32.651785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8dc11a93-8273-45ed-af88-1b1907d7fdb0 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:32.652802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8dc11a93-8273-45ed-af88-1b1907d7fdb0 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:32.654313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8dc11a93-8273-45ed-af88-1b1907d7fdb0 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:32.654912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8dc11a93-8273-45ed-af88-1b1907d7fdb0 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:33.116977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8dc11a93-8273-45ed-af88-1b1907d7fdb0 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:33.131357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ea75b558-8a85-4242-9e01-56420dfd814a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:33.141653 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ea75b558-8a85-4242-9e01-56420dfd814a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1320 microversion: 2.1 time: 0.680644 Jul 20 04:36:33.142478 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8dc11a93-8273-45ed-af88-1b1907d7fdb0 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1318 microversion: 2.1 time: 0.505285 Jul 20 04:36:33.143422 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2158/4082] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:32 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1318 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:33.146101 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1925/4083] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:32 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1320 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:33.169368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-84e6e6ad-6ed6-4194-9210-d66c622cb3f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:33.184094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-84e6e6ad-6ed6-4194-9210-d66c622cb3f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:33.246814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84e6e6ad-6ed6-4194-9210-d66c622cb3f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:33.247402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84e6e6ad-6ed6-4194-9210-d66c622cb3f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:33.254687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84e6e6ad-6ed6-4194-9210-d66c622cb3f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:33.255842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84e6e6ad-6ed6-4194-9210-d66c622cb3f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:33.300547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-2b9672e2-3da9-490d-82bd-9cc0ef7d587e req-3c930df7-648a-4cec-b6a0-9e40094b417c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2adc32-835f-427a-89df-e95652a204a3", "name": "network-vif-plugged", "status": "completed", "tag": "ce282bc6-b2bb-4a44-8a82-f1ce93047f6f"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:33.316864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2b9672e2-3da9-490d-82bd-9cc0ef7d587e req-3c930df7-648a-4cec-b6a0-9e40094b417c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:33.317004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2b9672e2-3da9-490d-82bd-9cc0ef7d587e req-3c930df7-648a-4cec-b6a0-9e40094b417c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:33.357944 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-2b9672e2-3da9-490d-82bd-9cc0ef7d587e req-3c930df7-648a-4cec-b6a0-9e40094b417c service nova] Creating event network-vif-plugged:ce282bc6-b2bb-4a44-8a82-f1ce93047f6f for instance 2c2adc32-835f-427a-89df-e95652a204a3 on n-h2-826526-5 Jul 20 04:36:33.379937 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-2b9672e2-3da9-490d-82bd-9cc0ef7d587e req-3c930df7-648a-4cec-b6a0-9e40094b417c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081715 Jul 20 04:36:33.380227 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1926/4084] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:36:33.578077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2277110c-0bd4-4227-be37-f0ec04f4217f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:33.579241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2277110c-0bd4-4227-be37-f0ec04f4217f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:33.592753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2277110c-0bd4-4227-be37-f0ec04f4217f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:33.593214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2277110c-0bd4-4227-be37-f0ec04f4217f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:33.594722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2277110c-0bd4-4227-be37-f0ec04f4217f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:33.594722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2277110c-0bd4-4227-be37-f0ec04f4217f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:33.741828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-84e6e6ad-6ed6-4194-9210-d66c622cb3f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:33.755921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-84e6e6ad-6ed6-4194-9210-d66c622cb3f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:33.762287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-84e6e6ad-6ed6-4194-9210-d66c622cb3f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:33.763680 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-84e6e6ad-6ed6-4194-9210-d66c622cb3f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.608278 Jul 20 04:36:33.764255 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2159/4085] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:33 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:33.902915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2277110c-0bd4-4227-be37-f0ec04f4217f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:33.911220 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2277110c-0bd4-4227-be37-f0ec04f4217f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1314 microversion: 2.1 time: 0.356782 Jul 20 04:36:33.914838 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1927/4086] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:33 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:34.169114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ac3b35dd-38c7-4723-8f8b-7a4035698b30 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:34.169980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c656d84e-4f00-4378-9835-a2f8daab2317 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:34.171255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ac3b35dd-38c7-4723-8f8b-7a4035698b30 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:34.171759 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c656d84e-4f00-4378-9835-a2f8daab2317 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:34.190718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c656d84e-4f00-4378-9835-a2f8daab2317 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.192296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c656d84e-4f00-4378-9835-a2f8daab2317 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.193071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac3b35dd-38c7-4723-8f8b-7a4035698b30 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.195255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac3b35dd-38c7-4723-8f8b-7a4035698b30 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.195643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c656d84e-4f00-4378-9835-a2f8daab2317 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.197030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c656d84e-4f00-4378-9835-a2f8daab2317 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.198013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac3b35dd-38c7-4723-8f8b-7a4035698b30 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.199197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac3b35dd-38c7-4723-8f8b-7a4035698b30 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.418349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c656d84e-4f00-4378-9835-a2f8daab2317 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:34.427598 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c656d84e-4f00-4378-9835-a2f8daab2317 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1320 microversion: 2.1 time: 0.271183 Jul 20 04:36:34.429108 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1928/4087] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:34 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1320 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:34.434351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-9cd37c3c-88da-4921-adc6-9bdee258a02e req-4839f4cc-c7c0-48c6-b819-01fb4bc7c697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3feb0068-8615-4241-ae94-33f175a3d7f8", "tag": "7d2d2ee3-b619-4cf7-8f59-bc0abdfedab1"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:34.443390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-9cd37c3c-88da-4921-adc6-9bdee258a02e req-4839f4cc-c7c0-48c6-b819-01fb4bc7c697 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.444111 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-9cd37c3c-88da-4921-adc6-9bdee258a02e req-4839f4cc-c7c0-48c6-b819-01fb4bc7c697 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.458551 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-9cd37c3c-88da-4921-adc6-9bdee258a02e req-4839f4cc-c7c0-48c6-b819-01fb4bc7c697 service nova] Creating event network-changed:7d2d2ee3-b619-4cf7-8f59-bc0abdfedab1 for instance 3feb0068-8615-4241-ae94-33f175a3d7f8 on n-h2-826526-5 Jul 20 04:36:34.464565 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-9cd37c3c-88da-4921-adc6-9bdee258a02e req-4839f4cc-c7c0-48c6-b819-01fb4bc7c697 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033894 Jul 20 04:36:34.468187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ac3b35dd-38c7-4723-8f8b-7a4035698b30 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:34.472618 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1929/4088] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:34.481292 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ac3b35dd-38c7-4723-8f8b-7a4035698b30 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1318 microversion: 2.1 time: 0.324311 Jul 20 04:36:34.482087 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2160/4089] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:34 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:34.791337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ec7b3f1c-1e58-48ef-93d5-5edfea194292 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:34.792034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ec7b3f1c-1e58-48ef-93d5-5edfea194292 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:34.807219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec7b3f1c-1e58-48ef-93d5-5edfea194292 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.808171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec7b3f1c-1e58-48ef-93d5-5edfea194292 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.809570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec7b3f1c-1e58-48ef-93d5-5edfea194292 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.810505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec7b3f1c-1e58-48ef-93d5-5edfea194292 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.931462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-447847c9-8457-402a-b6d1-399ee740a4c5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:34.933301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-447847c9-8457-402a-b6d1-399ee740a4c5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:34.941466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-447847c9-8457-402a-b6d1-399ee740a4c5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.942916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-447847c9-8457-402a-b6d1-399ee740a4c5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.943937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-447847c9-8457-402a-b6d1-399ee740a4c5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.944648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-447847c9-8457-402a-b6d1-399ee740a4c5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.190971 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ec7b3f1c-1e58-48ef-93d5-5edfea194292 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:35.206504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ec7b3f1c-1e58-48ef-93d5-5edfea194292 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:35.210475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ec7b3f1c-1e58-48ef-93d5-5edfea194292 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:35.220588 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ec7b3f1c-1e58-48ef-93d5-5edfea194292 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.435068 Jul 20 04:36:35.222295 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1930/4090] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:34 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:35.250605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-447847c9-8457-402a-b6d1-399ee740a4c5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:35.263793 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-447847c9-8457-402a-b6d1-399ee740a4c5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1314 microversion: 2.1 time: 0.338493 Jul 20 04:36:35.265188 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2161/4091] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:34 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:35.432221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-571c3475-0b86-4181-af29-90aa39e76bbe req-7ab7fcff-7dcf-4cdb-a152-6952c0dd7c56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964438a8-b527-40c0-b62b-f21bc79d5f1a", "name": "network-vif-plugged", "status": "completed", "tag": "48c7f7ac-66da-445b-9bc0-c6f6dc93a1f6"}, {"server_uuid": "57a59f2d-88a3-408a-a465-f86f983a11be", "name": "network-vif-plugged", "status": "completed", "tag": "c57b06f0-d23a-409f-9a66-3993cae11b08"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:35.453174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-258cdf9f-16a5-4b4a-aa38-ed77137c2858 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:35.453744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-258cdf9f-16a5-4b4a-aa38-ed77137c2858 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:35.465203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-258cdf9f-16a5-4b4a-aa38-ed77137c2858 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.469010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-258cdf9f-16a5-4b4a-aa38-ed77137c2858 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.471002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-258cdf9f-16a5-4b4a-aa38-ed77137c2858 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.474856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-258cdf9f-16a5-4b4a-aa38-ed77137c2858 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.489940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-571c3475-0b86-4181-af29-90aa39e76bbe req-7ab7fcff-7dcf-4cdb-a152-6952c0dd7c56 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.491140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-571c3475-0b86-4181-af29-90aa39e76bbe req-7ab7fcff-7dcf-4cdb-a152-6952c0dd7c56 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.531027 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-571c3475-0b86-4181-af29-90aa39e76bbe req-7ab7fcff-7dcf-4cdb-a152-6952c0dd7c56 service nova] Creating event network-vif-plugged:48c7f7ac-66da-445b-9bc0-c6f6dc93a1f6 for instance 964438a8-b527-40c0-b62b-f21bc79d5f1a on n-h1-826526-5 Jul 20 04:36:35.532999 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-571c3475-0b86-4181-af29-90aa39e76bbe req-7ab7fcff-7dcf-4cdb-a152-6952c0dd7c56 service nova] Creating event network-vif-plugged:c57b06f0-d23a-409f-9a66-3993cae11b08 for instance 57a59f2d-88a3-408a-a465-f86f983a11be on n-h2-826526-5 Jul 20 04:36:35.546280 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-571c3475-0b86-4181-af29-90aa39e76bbe req-7ab7fcff-7dcf-4cdb-a152-6952c0dd7c56 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.118258 Jul 20 04:36:35.547204 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1931/4092] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:35.557012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-24ab7cf4-cc7f-4eb0-b287-22ba5950fabc tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:35.558455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-24ab7cf4-cc7f-4eb0-b287-22ba5950fabc tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:35.571789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24ab7cf4-cc7f-4eb0-b287-22ba5950fabc tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.572884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24ab7cf4-cc7f-4eb0-b287-22ba5950fabc tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.577672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24ab7cf4-cc7f-4eb0-b287-22ba5950fabc tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.578424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24ab7cf4-cc7f-4eb0-b287-22ba5950fabc tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.841983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-258cdf9f-16a5-4b4a-aa38-ed77137c2858 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:35.852451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:35.860063 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-258cdf9f-16a5-4b4a-aa38-ed77137c2858 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1320 microversion: 2.1 time: 0.410594 Jul 20 04:36:35.861111 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2162/4093] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:35 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1320 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:35.986078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-24ab7cf4-cc7f-4eb0-b287-22ba5950fabc tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:35.997711 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-24ab7cf4-cc7f-4eb0-b287-22ba5950fabc tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1318 microversion: 2.1 time: 0.448968 Jul 20 04:36:36.000573 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1932/4094] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:35 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:36.240382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c615d06a-41a7-42fb-8ecc-10c37a0101af tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:36.241269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c615d06a-41a7-42fb-8ecc-10c37a0101af tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:36.249054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c615d06a-41a7-42fb-8ecc-10c37a0101af tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:36.249899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c615d06a-41a7-42fb-8ecc-10c37a0101af tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:36.251302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c615d06a-41a7-42fb-8ecc-10c37a0101af tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:36.252514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c615d06a-41a7-42fb-8ecc-10c37a0101af tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:36.285382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-be0f933b-5000-4720-b75c-3e2f1b0cf503 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:36.286025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-be0f933b-5000-4720-b75c-3e2f1b0cf503 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:36.304010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be0f933b-5000-4720-b75c-3e2f1b0cf503 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:36.304349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be0f933b-5000-4720-b75c-3e2f1b0cf503 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:36.305134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be0f933b-5000-4720-b75c-3e2f1b0cf503 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:36.305751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be0f933b-5000-4720-b75c-3e2f1b0cf503 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:36.524029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-be0f933b-5000-4720-b75c-3e2f1b0cf503 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:36.538265 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-be0f933b-5000-4720-b75c-3e2f1b0cf503 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1314 microversion: 2.1 time: 0.252837 Jul 20 04:36:36.539398 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1933/4095] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:36 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:36.560183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c615d06a-41a7-42fb-8ecc-10c37a0101af tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:36.573730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c615d06a-41a7-42fb-8ecc-10c37a0101af tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:36.576209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c615d06a-41a7-42fb-8ecc-10c37a0101af tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:36.577822 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c615d06a-41a7-42fb-8ecc-10c37a0101af tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.341841 Jul 20 04:36:36.590096 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2163/4096] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:36 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:36.885807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-01887ae1-6905-4f82-902e-52730a953ac0 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:36.886811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-01887ae1-6905-4f82-902e-52730a953ac0 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:36.901305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01887ae1-6905-4f82-902e-52730a953ac0 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:36.902364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01887ae1-6905-4f82-902e-52730a953ac0 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:36.903305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01887ae1-6905-4f82-902e-52730a953ac0 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:36.903855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01887ae1-6905-4f82-902e-52730a953ac0 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:37.026913 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-130030cc-fe42-40c2-b920-ae1d9c3bebf4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:37.027538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-130030cc-fe42-40c2-b920-ae1d9c3bebf4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:37.041832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-130030cc-fe42-40c2-b920-ae1d9c3bebf4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:37.042287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-130030cc-fe42-40c2-b920-ae1d9c3bebf4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:37.043247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-130030cc-fe42-40c2-b920-ae1d9c3bebf4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:37.043892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-130030cc-fe42-40c2-b920-ae1d9c3bebf4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:37.128895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-01887ae1-6905-4f82-902e-52730a953ac0 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:37.139405 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-01887ae1-6905-4f82-902e-52730a953ac0 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1320 microversion: 2.1 time: 0.265311 Jul 20 04:36:37.140840 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1934/4097] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:36 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1320 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:37.280203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-130030cc-fe42-40c2-b920-ae1d9c3bebf4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:37.291552 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-130030cc-fe42-40c2-b920-ae1d9c3bebf4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1318 microversion: 2.1 time: 0.277583 Jul 20 04:36:37.293233 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2164/4098] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:37 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:37.557663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2e3b391a-28e9-4424-9f6d-2d4b4227a2df tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:37.558662 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2e3b391a-28e9-4424-9f6d-2d4b4227a2df tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:37.565373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e3b391a-28e9-4424-9f6d-2d4b4227a2df tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:37.566119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e3b391a-28e9-4424-9f6d-2d4b4227a2df tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:37.567080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e3b391a-28e9-4424-9f6d-2d4b4227a2df tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:37.567689 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e3b391a-28e9-4424-9f6d-2d4b4227a2df tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:37.597569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-300a8f01-3a3f-4d95-a534-1cb8677b6a65 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:37.598105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-300a8f01-3a3f-4d95-a534-1cb8677b6a65 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:37.615849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-300a8f01-3a3f-4d95-a534-1cb8677b6a65 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:37.616555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-300a8f01-3a3f-4d95-a534-1cb8677b6a65 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:37.617527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-300a8f01-3a3f-4d95-a534-1cb8677b6a65 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:37.620755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-300a8f01-3a3f-4d95-a534-1cb8677b6a65 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:37.766908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2e3b391a-28e9-4424-9f6d-2d4b4227a2df tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:37.775261 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2e3b391a-28e9-4424-9f6d-2d4b4227a2df tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1314 microversion: 2.1 time: 0.221198 Jul 20 04:36:37.776252 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1935/4099] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:37 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:37.983513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-300a8f01-3a3f-4d95-a534-1cb8677b6a65 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:37.994911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-300a8f01-3a3f-4d95-a534-1cb8677b6a65 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:37.997230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-300a8f01-3a3f-4d95-a534-1cb8677b6a65 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:37.998589 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-300a8f01-3a3f-4d95-a534-1cb8677b6a65 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.405114 Jul 20 04:36:37.999499 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2165/4100] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:37 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:38.161750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b9eeb9ec-6a89-454c-80c7-433631ba9658 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:38.161750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b9eeb9ec-6a89-454c-80c7-433631ba9658 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:38.173762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9eeb9ec-6a89-454c-80c7-433631ba9658 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:38.173762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9eeb9ec-6a89-454c-80c7-433631ba9658 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:38.173762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9eeb9ec-6a89-454c-80c7-433631ba9658 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:38.173762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9eeb9ec-6a89-454c-80c7-433631ba9658 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:38.313092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d73cc6b7-de68-4948-bf16-2b3276b2062a tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:38.314732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d73cc6b7-de68-4948-bf16-2b3276b2062a tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:38.327424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b9eeb9ec-6a89-454c-80c7-433631ba9658 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:38.332019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d73cc6b7-de68-4948-bf16-2b3276b2062a tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:38.334289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d73cc6b7-de68-4948-bf16-2b3276b2062a tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:38.335609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d73cc6b7-de68-4948-bf16-2b3276b2062a tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:38.336290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d73cc6b7-de68-4948-bf16-2b3276b2062a tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:38.336563 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b9eeb9ec-6a89-454c-80c7-433631ba9658 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1320 microversion: 2.1 time: 0.179836 Jul 20 04:36:38.341444 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1936/4101] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:38 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1320 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:38.517305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d73cc6b7-de68-4948-bf16-2b3276b2062a tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:38.525634 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d73cc6b7-de68-4948-bf16-2b3276b2062a tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1318 microversion: 2.1 time: 0.219806 Jul 20 04:36:38.526241 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2166/4102] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:38 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:38.805411 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:38.806243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=24 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:38.811214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aa65eda5-5e0a-4220-b394-c52b0e0aece2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:38.812480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aa65eda5-5e0a-4220-b394-c52b0e0aece2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:38.822084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa65eda5-5e0a-4220-b394-c52b0e0aece2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:38.822925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa65eda5-5e0a-4220-b394-c52b0e0aece2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:38.824681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa65eda5-5e0a-4220-b394-c52b0e0aece2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:38.825642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa65eda5-5e0a-4220-b394-c52b0e0aece2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:39.008373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aa65eda5-5e0a-4220-b394-c52b0e0aece2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:39.020355 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aa65eda5-5e0a-4220-b394-c52b0e0aece2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1502 microversion: 2.1 time: 0.226161 Jul 20 04:36:39.021241 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1937/4103] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:38 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1502 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:39.027576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-456bb88f-840c-4c4f-a3af-5ade79311577 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:39.028394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-456bb88f-840c-4c4f-a3af-5ade79311577 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:39.041625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dd541dd5-154b-4ddf-8436-b1cd785270e9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:39.042067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=12 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:39.051759 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd541dd5-154b-4ddf-8436-b1cd785270e9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:39.052136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd541dd5-154b-4ddf-8436-b1cd785270e9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:39.072114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-456bb88f-840c-4c4f-a3af-5ade79311577 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:39.072690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-456bb88f-840c-4c4f-a3af-5ade79311577 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:39.073700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-456bb88f-840c-4c4f-a3af-5ade79311577 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:39.074355 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-456bb88f-840c-4c4f-a3af-5ade79311577 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:39.109290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dd541dd5-154b-4ddf-8436-b1cd785270e9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Going to try to stop instance {{(pid=127870) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:36:39.230859 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dd541dd5-154b-4ddf-8436-b1cd785270e9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be/action" status: 202 len: 0 microversion: 2.1 time: 0.189518 Jul 20 04:36:39.232775 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1938/4104] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:39 2022] POST /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:36:39.247975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e7f00855-f67d-471d-a3f1-a1549849e720 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:39.251033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e7f00855-f67d-471d-a3f1-a1549849e720 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:39.268863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7f00855-f67d-471d-a3f1-a1549849e720 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:39.271880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7f00855-f67d-471d-a3f1-a1549849e720 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:39.274593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7f00855-f67d-471d-a3f1-a1549849e720 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:39.275051 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7f00855-f67d-471d-a3f1-a1549849e720 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:39.377877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-456bb88f-840c-4c4f-a3af-5ade79311577 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:39.390925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-456bb88f-840c-4c4f-a3af-5ade79311577 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:39.392934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-456bb88f-840c-4c4f-a3af-5ade79311577 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:39.394504 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-456bb88f-840c-4c4f-a3af-5ade79311577 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.371489 Jul 20 04:36:39.406904 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2167/4105] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:39 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:39.415266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-081a91b1-7d37-4d44-ae59-84fc0656861d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:39.416860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-081a91b1-7d37-4d44-ae59-84fc0656861d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:39.423940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-081a91b1-7d37-4d44-ae59-84fc0656861d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:39.424819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-081a91b1-7d37-4d44-ae59-84fc0656861d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:39.425787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-081a91b1-7d37-4d44-ae59-84fc0656861d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:39.426563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-081a91b1-7d37-4d44-ae59-84fc0656861d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:39.601006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e7f00855-f67d-471d-a3f1-a1549849e720 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:39.612159 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e7f00855-f67d-471d-a3f1-a1549849e720 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.373878 Jul 20 04:36:39.612795 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1939/4106] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:39 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:39.618571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f08e1daf-5f6d-4e32-a0a1-4366fbb0a5f4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:39.619423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f08e1daf-5f6d-4e32-a0a1-4366fbb0a5f4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:39.628525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f08e1daf-5f6d-4e32-a0a1-4366fbb0a5f4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:39.629262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f08e1daf-5f6d-4e32-a0a1-4366fbb0a5f4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:39.631034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f08e1daf-5f6d-4e32-a0a1-4366fbb0a5f4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:39.631687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f08e1daf-5f6d-4e32-a0a1-4366fbb0a5f4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:39.659003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:39.682444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-081a91b1-7d37-4d44-ae59-84fc0656861d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:39.692319 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-081a91b1-7d37-4d44-ae59-84fc0656861d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1320 microversion: 2.1 time: 0.284091 Jul 20 04:36:39.703322 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2168/4107] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:39 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1320 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:39.815016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f08e1daf-5f6d-4e32-a0a1-4366fbb0a5f4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:39.825761 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f08e1daf-5f6d-4e32-a0a1-4366fbb0a5f4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1318 microversion: 2.1 time: 0.210661 Jul 20 04:36:39.833304 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1940/4108] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:39 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:40.415185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7fd3fc45-a672-4830-af78-563126eb9896 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:40.417174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7fd3fc45-a672-4830-af78-563126eb9896 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:40.428440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fd3fc45-a672-4830-af78-563126eb9896 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:40.429198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fd3fc45-a672-4830-af78-563126eb9896 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:40.430176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fd3fc45-a672-4830-af78-563126eb9896 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:40.430779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fd3fc45-a672-4830-af78-563126eb9896 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:40.630186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8a73f1d7-aa7b-43b9-aa12-b4bfebc95525 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:40.632610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8a73f1d7-aa7b-43b9-aa12-b4bfebc95525 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:40.640185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a73f1d7-aa7b-43b9-aa12-b4bfebc95525 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:40.641269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a73f1d7-aa7b-43b9-aa12-b4bfebc95525 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:40.642202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a73f1d7-aa7b-43b9-aa12-b4bfebc95525 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:40.643105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a73f1d7-aa7b-43b9-aa12-b4bfebc95525 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:40.706226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7fd3fc45-a672-4830-af78-563126eb9896 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:40.717008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7fd3fc45-a672-4830-af78-563126eb9896 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:40.719611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7fd3fc45-a672-4830-af78-563126eb9896 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:40.721191 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7fd3fc45-a672-4830-af78-563126eb9896 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.311572 Jul 20 04:36:40.722751 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2169/4109] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:40 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:40.728189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c3de0215-4c5a-46e5-b89d-093ab5a02b1a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:40.729018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c3de0215-4c5a-46e5-b89d-093ab5a02b1a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:40.736383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3de0215-4c5a-46e5-b89d-093ab5a02b1a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:40.737067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3de0215-4c5a-46e5-b89d-093ab5a02b1a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:40.738023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3de0215-4c5a-46e5-b89d-093ab5a02b1a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:40.738627 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3de0215-4c5a-46e5-b89d-093ab5a02b1a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:40.887600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8a73f1d7-aa7b-43b9-aa12-b4bfebc95525 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:40.899376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c3de0215-4c5a-46e5-b89d-093ab5a02b1a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:40.899703 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8a73f1d7-aa7b-43b9-aa12-b4bfebc95525 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.273662 Jul 20 04:36:40.911704 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1941/4110] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:40 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:40.912140 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c3de0215-4c5a-46e5-b89d-093ab5a02b1a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1320 microversion: 2.1 time: 0.188111 Jul 20 04:36:40.913035 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2170/4111] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:40 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1320 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:40.919430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-65921d48-bc8e-4c97-a7ec-a77d6fed04ec tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:40.925235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-65921d48-bc8e-4c97-a7ec-a77d6fed04ec tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:40.932396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65921d48-bc8e-4c97-a7ec-a77d6fed04ec tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:40.933140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65921d48-bc8e-4c97-a7ec-a77d6fed04ec tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:40.934095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65921d48-bc8e-4c97-a7ec-a77d6fed04ec tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:40.934707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65921d48-bc8e-4c97-a7ec-a77d6fed04ec tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:41.106960 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-65921d48-bc8e-4c97-a7ec-a77d6fed04ec tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:41.121565 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-65921d48-bc8e-4c97-a7ec-a77d6fed04ec tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1318 microversion: 2.1 time: 0.207587 Jul 20 04:36:41.123032 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1942/4112] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:40 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:41.168377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-62d93eab-e4a9-41dc-9014-53e031bd8b00 req-298c8ba6-65be-4ad3-9339-cf3362316d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "name": "network-vif-plugged", "status": "completed", "tag": "b15665c3-c608-4291-ba03-0645e53bbcc0"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:41.188522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-62d93eab-e4a9-41dc-9014-53e031bd8b00 req-298c8ba6-65be-4ad3-9339-cf3362316d56 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:41.189282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-62d93eab-e4a9-41dc-9014-53e031bd8b00 req-298c8ba6-65be-4ad3-9339-cf3362316d56 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:41.204647 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-62d93eab-e4a9-41dc-9014-53e031bd8b00 req-298c8ba6-65be-4ad3-9339-cf3362316d56 service nova] Creating event network-vif-plugged:b15665c3-c608-4291-ba03-0645e53bbcc0 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:36:41.211584 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-62d93eab-e4a9-41dc-9014-53e031bd8b00 req-298c8ba6-65be-4ad3-9339-cf3362316d56 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046768 Jul 20 04:36:41.212631 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2171/4113] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:41.745040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3b72ad4e-02af-446e-b916-244b2546d69b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:41.746324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3b72ad4e-02af-446e-b916-244b2546d69b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:41.755374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b72ad4e-02af-446e-b916-244b2546d69b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:41.756234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b72ad4e-02af-446e-b916-244b2546d69b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:41.757265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b72ad4e-02af-446e-b916-244b2546d69b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:41.758491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b72ad4e-02af-446e-b916-244b2546d69b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:41.921736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3ff53586-612b-421d-a0b3-ee8328483d7d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:41.923597 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3ff53586-612b-421d-a0b3-ee8328483d7d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:41.945065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ff53586-612b-421d-a0b3-ee8328483d7d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:41.945844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ff53586-612b-421d-a0b3-ee8328483d7d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:41.948498 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ff53586-612b-421d-a0b3-ee8328483d7d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:41.949331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ff53586-612b-421d-a0b3-ee8328483d7d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:41.989177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3b72ad4e-02af-446e-b916-244b2546d69b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:42.033022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3b72ad4e-02af-446e-b916-244b2546d69b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:42.035226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3b72ad4e-02af-446e-b916-244b2546d69b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:42.037026 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3b72ad4e-02af-446e-b916-244b2546d69b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.299439 Jul 20 04:36:42.039730 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1943/4114] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:41 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:42.057687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6a79ac41-30dd-48b6-a4a3-74ec9c640db5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:42.059109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6a79ac41-30dd-48b6-a4a3-74ec9c640db5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:42.066816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a79ac41-30dd-48b6-a4a3-74ec9c640db5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:42.067679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a79ac41-30dd-48b6-a4a3-74ec9c640db5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:42.069177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a79ac41-30dd-48b6-a4a3-74ec9c640db5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:42.069987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a79ac41-30dd-48b6-a4a3-74ec9c640db5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:42.157764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3ff53586-612b-421d-a0b3-ee8328483d7d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:42.166117 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3ff53586-612b-421d-a0b3-ee8328483d7d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.251814 Jul 20 04:36:42.167301 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2172/4115] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:41 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:42.172298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-77f59224-b0c1-4b69-aaee-45abdd24f8f4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:42.173223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-77f59224-b0c1-4b69-aaee-45abdd24f8f4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:42.179807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-77f59224-b0c1-4b69-aaee-45abdd24f8f4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:42.180530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-77f59224-b0c1-4b69-aaee-45abdd24f8f4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:42.181580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-77f59224-b0c1-4b69-aaee-45abdd24f8f4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:42.182608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-77f59224-b0c1-4b69-aaee-45abdd24f8f4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:42.239482 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6a79ac41-30dd-48b6-a4a3-74ec9c640db5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:42.249419 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6a79ac41-30dd-48b6-a4a3-74ec9c640db5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1320 microversion: 2.1 time: 0.207901 Jul 20 04:36:42.251001 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1944/4116] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:42 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1320 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:42.365104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-77f59224-b0c1-4b69-aaee-45abdd24f8f4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:42.373219 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-77f59224-b0c1-4b69-aaee-45abdd24f8f4 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1318 microversion: 2.1 time: 0.204652 Jul 20 04:36:42.373936 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2173/4117] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:42 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:43.058324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5d659822-4da8-44a2-873b-653e70ba7bcf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:43.058904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5d659822-4da8-44a2-873b-653e70ba7bcf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:43.066510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5d659822-4da8-44a2-873b-653e70ba7bcf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.066957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5d659822-4da8-44a2-873b-653e70ba7bcf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.067721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5d659822-4da8-44a2-873b-653e70ba7bcf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.068162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5d659822-4da8-44a2-873b-653e70ba7bcf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.186745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8f72cc62-9c9e-421d-ba70-4bb5d5702548 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:43.188092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8f72cc62-9c9e-421d-ba70-4bb5d5702548 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:43.205338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f72cc62-9c9e-421d-ba70-4bb5d5702548 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.205795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f72cc62-9c9e-421d-ba70-4bb5d5702548 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.209082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f72cc62-9c9e-421d-ba70-4bb5d5702548 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.209575 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f72cc62-9c9e-421d-ba70-4bb5d5702548 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.283064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5d659822-4da8-44a2-873b-653e70ba7bcf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:43.301205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5d659822-4da8-44a2-873b-653e70ba7bcf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:43.302842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5d659822-4da8-44a2-873b-653e70ba7bcf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:43.304180 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5d659822-4da8-44a2-873b-653e70ba7bcf tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.250182 Jul 20 04:36:43.305206 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1945/4118] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:43 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:43.310374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-aaa5364a-4e07-4468-85b2-32416ef1c308 req-dc563ddd-24e8-4081-81d7-0d089446838b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3feb0068-8615-4241-ae94-33f175a3d7f8", "name": "network-vif-plugged", "status": "completed", "tag": "7d2d2ee3-b619-4cf7-8f59-bc0abdfedab1"}, {"server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "name": "network-vif-plugged", "status": "completed", "tag": "50ce2932-58a2-45c9-b274-8dcf3d6b3bef"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:43.321666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-aaa5364a-4e07-4468-85b2-32416ef1c308 req-dc563ddd-24e8-4081-81d7-0d089446838b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.322254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-aaa5364a-4e07-4468-85b2-32416ef1c308 req-dc563ddd-24e8-4081-81d7-0d089446838b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.337186 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-aaa5364a-4e07-4468-85b2-32416ef1c308 req-dc563ddd-24e8-4081-81d7-0d089446838b service nova] Creating event network-vif-plugged:7d2d2ee3-b619-4cf7-8f59-bc0abdfedab1 for instance 3feb0068-8615-4241-ae94-33f175a3d7f8 on n-h2-826526-5 Jul 20 04:36:43.337703 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-aaa5364a-4e07-4468-85b2-32416ef1c308 req-dc563ddd-24e8-4081-81d7-0d089446838b service nova] Creating event network-vif-plugged:50ce2932-58a2-45c9-b274-8dcf3d6b3bef for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:36:43.349677 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-aaa5364a-4e07-4468-85b2-32416ef1c308 req-dc563ddd-24e8-4081-81d7-0d089446838b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042328 Jul 20 04:36:43.350481 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1946/4119] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:43.360947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6d887db5-8e44-4e41-a7cd-d120ceb90853 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:43.362009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6d887db5-8e44-4e41-a7cd-d120ceb90853 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:43.369882 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d887db5-8e44-4e41-a7cd-d120ceb90853 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.371359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d887db5-8e44-4e41-a7cd-d120ceb90853 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.372533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d887db5-8e44-4e41-a7cd-d120ceb90853 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.373366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d887db5-8e44-4e41-a7cd-d120ceb90853 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.476422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8f72cc62-9c9e-421d-ba70-4bb5d5702548 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:43.488161 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8f72cc62-9c9e-421d-ba70-4bb5d5702548 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.307996 Jul 20 04:36:43.489021 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2174/4120] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:43 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:43.494075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-22881651-2d99-498c-998f-ad926bfc1e48 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:43.494894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-22881651-2d99-498c-998f-ad926bfc1e48 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:43.503065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22881651-2d99-498c-998f-ad926bfc1e48 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.503472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22881651-2d99-498c-998f-ad926bfc1e48 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.504241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22881651-2d99-498c-998f-ad926bfc1e48 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.505075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22881651-2d99-498c-998f-ad926bfc1e48 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.580300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6d887db5-8e44-4e41-a7cd-d120ceb90853 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:43.589195 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6d887db5-8e44-4e41-a7cd-d120ceb90853 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1320 microversion: 2.1 time: 0.237402 Jul 20 04:36:43.589781 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1947/4121] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:43 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1320 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:43.695150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-22881651-2d99-498c-998f-ad926bfc1e48 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:43.703698 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-22881651-2d99-498c-998f-ad926bfc1e48 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1318 microversion: 2.1 time: 0.213103 Jul 20 04:36:43.711907 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2175/4122] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:43 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:44.325846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b10e2d0e-9e78-4d0d-bce8-e4e6d34f6e44 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:44.327433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b10e2d0e-9e78-4d0d-bce8-e4e6d34f6e44 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:44.335648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b10e2d0e-9e78-4d0d-bce8-e4e6d34f6e44 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:44.336718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b10e2d0e-9e78-4d0d-bce8-e4e6d34f6e44 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:44.338824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b10e2d0e-9e78-4d0d-bce8-e4e6d34f6e44 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:44.339405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b10e2d0e-9e78-4d0d-bce8-e4e6d34f6e44 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:44.534558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0152c83b-512d-4b48-a5a2-e70e772eb310 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:44.535812 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0152c83b-512d-4b48-a5a2-e70e772eb310 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:44.572370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b10e2d0e-9e78-4d0d-bce8-e4e6d34f6e44 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:44.581063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0152c83b-512d-4b48-a5a2-e70e772eb310 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:44.581823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0152c83b-512d-4b48-a5a2-e70e772eb310 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:44.583050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0152c83b-512d-4b48-a5a2-e70e772eb310 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:44.584236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0152c83b-512d-4b48-a5a2-e70e772eb310 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:44.589858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b10e2d0e-9e78-4d0d-bce8-e4e6d34f6e44 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:44.592616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b10e2d0e-9e78-4d0d-bce8-e4e6d34f6e44 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:44.594465 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b10e2d0e-9e78-4d0d-bce8-e4e6d34f6e44 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.272621 Jul 20 04:36:44.595684 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1948/4123] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:44 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:44.606661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-076cf845-0f41-425b-a4f1-ad542501bf2d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:44.610854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-076cf845-0f41-425b-a4f1-ad542501bf2d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:44.622211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-076cf845-0f41-425b-a4f1-ad542501bf2d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:44.623119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-076cf845-0f41-425b-a4f1-ad542501bf2d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:44.624131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-076cf845-0f41-425b-a4f1-ad542501bf2d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:44.624790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-076cf845-0f41-425b-a4f1-ad542501bf2d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:44.801373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-076cf845-0f41-425b-a4f1-ad542501bf2d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:44.810411 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-076cf845-0f41-425b-a4f1-ad542501bf2d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1320 microversion: 2.1 time: 0.207906 Jul 20 04:36:44.825040 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1949/4124] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:44 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1320 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:44.825040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e69ceb30-5c57-402d-80b5-ce0f8de4b5f8 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:44.825040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e69ceb30-5c57-402d-80b5-ce0f8de4b5f8 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:44.825040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e69ceb30-5c57-402d-80b5-ce0f8de4b5f8 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:44.825040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e69ceb30-5c57-402d-80b5-ce0f8de4b5f8 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:44.825998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e69ceb30-5c57-402d-80b5-ce0f8de4b5f8 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:44.825998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e69ceb30-5c57-402d-80b5-ce0f8de4b5f8 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:44.855535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0152c83b-512d-4b48-a5a2-e70e772eb310 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:44.866511 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0152c83b-512d-4b48-a5a2-e70e772eb310 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.362353 Jul 20 04:36:44.868059 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2176/4125] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:44 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:45.027942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e69ceb30-5c57-402d-80b5-ce0f8de4b5f8 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:45.035910 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e69ceb30-5c57-402d-80b5-ce0f8de4b5f8 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1318 microversion: 2.1 time: 0.223234 Jul 20 04:36:45.036777 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1950/4126] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:44 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:45.614980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f1c4acaa-7ae3-40ee-b357-071fb7fd1dda tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:45.615607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f1c4acaa-7ae3-40ee-b357-071fb7fd1dda tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:45.626786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1c4acaa-7ae3-40ee-b357-071fb7fd1dda tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:45.627696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1c4acaa-7ae3-40ee-b357-071fb7fd1dda tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:45.628765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1c4acaa-7ae3-40ee-b357-071fb7fd1dda tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:45.629471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1c4acaa-7ae3-40ee-b357-071fb7fd1dda tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:45.846288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-96b18cf8-2d3d-4f09-8f0b-2cf00c962f26 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:45.848193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-96b18cf8-2d3d-4f09-8f0b-2cf00c962f26 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:45.864624 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:45.873139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96b18cf8-2d3d-4f09-8f0b-2cf00c962f26 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:45.873738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96b18cf8-2d3d-4f09-8f0b-2cf00c962f26 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:45.874648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96b18cf8-2d3d-4f09-8f0b-2cf00c962f26 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:45.875193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96b18cf8-2d3d-4f09-8f0b-2cf00c962f26 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:45.880592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f1c4acaa-7ae3-40ee-b357-071fb7fd1dda tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:45.894130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f1c4acaa-7ae3-40ee-b357-071fb7fd1dda tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:45.900630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f1c4acaa-7ae3-40ee-b357-071fb7fd1dda tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:45.902163 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f1c4acaa-7ae3-40ee-b357-071fb7fd1dda tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.292309 Jul 20 04:36:45.909685 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2177/4127] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:45 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:45.915215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-451f3988-262c-42e3-866f-7a5595e7b8df tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:45.916107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-451f3988-262c-42e3-866f-7a5595e7b8df tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:45.930108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-451f3988-262c-42e3-866f-7a5595e7b8df tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:45.932885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-451f3988-262c-42e3-866f-7a5595e7b8df tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:45.933880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-451f3988-262c-42e3-866f-7a5595e7b8df tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:45.934328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-451f3988-262c-42e3-866f-7a5595e7b8df tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:46.120604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-96b18cf8-2d3d-4f09-8f0b-2cf00c962f26 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:46.129863 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-96b18cf8-2d3d-4f09-8f0b-2cf00c962f26 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1320 microversion: 2.1 time: 0.290539 Jul 20 04:36:46.131257 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1951/4128] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:45 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1320 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:46.136569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bacda16d-b518-4b2f-8c88-84110d699ded tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:46.137382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bacda16d-b518-4b2f-8c88-84110d699ded tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:46.144186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bacda16d-b518-4b2f-8c88-84110d699ded tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:46.144878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bacda16d-b518-4b2f-8c88-84110d699ded tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:46.145935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bacda16d-b518-4b2f-8c88-84110d699ded tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:46.146537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bacda16d-b518-4b2f-8c88-84110d699ded tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:46.238657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-451f3988-262c-42e3-866f-7a5595e7b8df tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:46.254518 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-451f3988-262c-42e3-866f-7a5595e7b8df tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.343066 Jul 20 04:36:46.256350 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2178/4129] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:45 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:46.265429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e8e4e4bf-2c62-413b-a1d0-d4340cff318e req-3b8bf805-14df-4a45-912d-284f458348b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd93ad5b-3aba-4a42-8b3d-4220e88bb810", "name": "network-vif-plugged", "status": "completed", "tag": "d96d8269-9882-4f7a-9157-4229a2fbfb80"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:46.284821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e8e4e4bf-2c62-413b-a1d0-d4340cff318e req-3b8bf805-14df-4a45-912d-284f458348b2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:46.285955 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e8e4e4bf-2c62-413b-a1d0-d4340cff318e req-3b8bf805-14df-4a45-912d-284f458348b2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:46.308185 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e8e4e4bf-2c62-413b-a1d0-d4340cff318e req-3b8bf805-14df-4a45-912d-284f458348b2 service nova] Creating event network-vif-plugged:d96d8269-9882-4f7a-9157-4229a2fbfb80 for instance bd93ad5b-3aba-4a42-8b3d-4220e88bb810 on n-h1-826526-5 Jul 20 04:36:46.318419 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e8e4e4bf-2c62-413b-a1d0-d4340cff318e req-3b8bf805-14df-4a45-912d-284f458348b2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059642 Jul 20 04:36:46.319872 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2179/4130] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:46.356987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bacda16d-b518-4b2f-8c88-84110d699ded tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:46.366316 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bacda16d-b518-4b2f-8c88-84110d699ded tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1508 microversion: 2.1 time: 0.233712 Jul 20 04:36:46.383698 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1952/4131] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:46 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1508 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:46.389551 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a353686e-d473-4bea-80eb-773f5c375b91 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72d6a8e1-5953-406d-8082-ebd6970edd67", "device": "/dev/sdb"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:46.390988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a353686e-d473-4bea-80eb-773f5c375b91 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:46.414602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a353686e-d473-4bea-80eb-773f5c375b91 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:46.415406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a353686e-d473-4bea-80eb-773f5c375b91 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:46.416488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a353686e-d473-4bea-80eb-773f5c375b91 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:46.417105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a353686e-d473-4bea-80eb-773f5c375b91 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:46.526673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:46.774502 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a353686e-d473-4bea-80eb-773f5c375b91 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "POST /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.389435 Jul 20 04:36:46.776278 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2180/4132] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 04:36:46 2022] POST /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8/os-volume_attachments => generated 194 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:46.928043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-009ca3f2-c2f8-4647-b689-28fed7faf101 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:46.929362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-009ca3f2-c2f8-4647-b689-28fed7faf101 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:46.937517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-009ca3f2-c2f8-4647-b689-28fed7faf101 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:46.937982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-009ca3f2-c2f8-4647-b689-28fed7faf101 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:46.939500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-009ca3f2-c2f8-4647-b689-28fed7faf101 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:46.939972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-009ca3f2-c2f8-4647-b689-28fed7faf101 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:47.162355 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c4b64a56-e84e-47ec-bd3f-e8ea49d6bba6 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:47.163121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c4b64a56-e84e-47ec-bd3f-e8ea49d6bba6 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:47.185993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4b64a56-e84e-47ec-bd3f-e8ea49d6bba6 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:47.186483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4b64a56-e84e-47ec-bd3f-e8ea49d6bba6 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:47.190280 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4b64a56-e84e-47ec-bd3f-e8ea49d6bba6 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:47.191148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4b64a56-e84e-47ec-bd3f-e8ea49d6bba6 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:47.281770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-009ca3f2-c2f8-4647-b689-28fed7faf101 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:47.300230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-009ca3f2-c2f8-4647-b689-28fed7faf101 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:47.301993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-009ca3f2-c2f8-4647-b689-28fed7faf101 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:47.307347 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-009ca3f2-c2f8-4647-b689-28fed7faf101 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.383349 Jul 20 04:36:47.307964 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1953/4133] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:46 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:47.321339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-96bf0916-e508-4cb0-9a98-f002c927000b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:47.327180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-96bf0916-e508-4cb0-9a98-f002c927000b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:47.338336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96bf0916-e508-4cb0-9a98-f002c927000b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:47.343449 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96bf0916-e508-4cb0-9a98-f002c927000b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:47.344961 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96bf0916-e508-4cb0-9a98-f002c927000b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:47.346007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96bf0916-e508-4cb0-9a98-f002c927000b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:47.447009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c4b64a56-e84e-47ec-bd3f-e8ea49d6bba6 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:47.467616 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c4b64a56-e84e-47ec-bd3f-e8ea49d6bba6 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1320 microversion: 2.1 time: 0.310935 Jul 20 04:36:47.468473 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2181/4134] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:47 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1320 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:47.677154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-96bf0916-e508-4cb0-9a98-f002c927000b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:47.700031 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-96bf0916-e508-4cb0-9a98-f002c927000b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.387536 Jul 20 04:36:47.704670 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1954/4135] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:47 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:48.328795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-05984be3-39cb-4901-a698-4abfcdb4465e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:48.329858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-05984be3-39cb-4901-a698-4abfcdb4465e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:48.340861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-05984be3-39cb-4901-a698-4abfcdb4465e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.341561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-05984be3-39cb-4901-a698-4abfcdb4465e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.342544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-05984be3-39cb-4901-a698-4abfcdb4465e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.343295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-05984be3-39cb-4901-a698-4abfcdb4465e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.348357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e1e52083-ac29-42a1-955a-c127c20a8b38 req-6df3e4be-4616-4fc0-bf07-3815d41c96ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "name": "network-vif-plugged", "status": "completed", "tag": "36e158ad-7ae1-4798-87f8-e0e9306b63a1"}, {"server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "name": "network-vif-plugged", "status": "completed", "tag": "cf17085b-ec85-44f7-b1fe-988fc64af716"}, {"server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "name": "network-vif-plugged", "status": "completed", "tag": "df96a5ee-70af-4221-9452-816a07265909"}, {"server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "name": "network-vif-plugged", "status": "completed", "tag": "c4064929-4a6b-4ed2-b2fd-7b46e126bcec"}, {"server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "name": "network-vif-plugged", "status": "completed", "tag": "e016c9d4-88ef-4886-8546-1f27d3e3dab0"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:48.360151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e1e52083-ac29-42a1-955a-c127c20a8b38 req-6df3e4be-4616-4fc0-bf07-3815d41c96ab service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.360923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e1e52083-ac29-42a1-955a-c127c20a8b38 req-6df3e4be-4616-4fc0-bf07-3815d41c96ab service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.376280 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e1e52083-ac29-42a1-955a-c127c20a8b38 req-6df3e4be-4616-4fc0-bf07-3815d41c96ab service nova] Creating event network-vif-plugged:36e158ad-7ae1-4798-87f8-e0e9306b63a1 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:36:48.377373 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e1e52083-ac29-42a1-955a-c127c20a8b38 req-6df3e4be-4616-4fc0-bf07-3815d41c96ab service nova] Creating event network-vif-plugged:cf17085b-ec85-44f7-b1fe-988fc64af716 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:36:48.378335 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e1e52083-ac29-42a1-955a-c127c20a8b38 req-6df3e4be-4616-4fc0-bf07-3815d41c96ab service nova] Creating event network-vif-plugged:df96a5ee-70af-4221-9452-816a07265909 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:36:48.378990 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e1e52083-ac29-42a1-955a-c127c20a8b38 req-6df3e4be-4616-4fc0-bf07-3815d41c96ab service nova] Creating event network-vif-plugged:c4064929-4a6b-4ed2-b2fd-7b46e126bcec for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:36:48.379654 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e1e52083-ac29-42a1-955a-c127c20a8b38 req-6df3e4be-4616-4fc0-bf07-3815d41c96ab service nova] Creating event network-vif-plugged:e016c9d4-88ef-4886-8546-1f27d3e3dab0 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:36:48.389912 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e1e52083-ac29-42a1-955a-c127c20a8b38 req-6df3e4be-4616-4fc0-bf07-3815d41c96ab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.050148 Jul 20 04:36:48.391091 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1955/4136] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:36:48.486109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6feed1f3-af01-4006-a885-f51f562bd99a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:48.488315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6feed1f3-af01-4006-a885-f51f562bd99a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:48.497882 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6feed1f3-af01-4006-a885-f51f562bd99a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.498414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6feed1f3-af01-4006-a885-f51f562bd99a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.499277 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6feed1f3-af01-4006-a885-f51f562bd99a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.499735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6feed1f3-af01-4006-a885-f51f562bd99a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.615678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-05984be3-39cb-4901-a698-4abfcdb4465e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:48.635718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-05984be3-39cb-4901-a698-4abfcdb4465e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:48.641333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-05984be3-39cb-4901-a698-4abfcdb4465e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:48.645104 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-05984be3-39cb-4901-a698-4abfcdb4465e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.321443 Jul 20 04:36:48.647036 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2182/4137] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:48 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:48.722279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-38076c0d-c59b-4535-ad96-88a22d3ba24a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:48.723499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-38076c0d-c59b-4535-ad96-88a22d3ba24a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:48.729461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38076c0d-c59b-4535-ad96-88a22d3ba24a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.729949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38076c0d-c59b-4535-ad96-88a22d3ba24a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.731058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38076c0d-c59b-4535-ad96-88a22d3ba24a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.731642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38076c0d-c59b-4535-ad96-88a22d3ba24a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.764594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6feed1f3-af01-4006-a885-f51f562bd99a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:48.783334 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6feed1f3-af01-4006-a885-f51f562bd99a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1510 microversion: 2.1 time: 0.301813 Jul 20 04:36:48.800876 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1956/4138] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:48 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1510 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:48.818189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-212dc90a-d252-447b-9774-2378a5068a77 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:48.819101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-212dc90a-d252-447b-9774-2378a5068a77 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:48.826239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-212dc90a-d252-447b-9774-2378a5068a77 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.827026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-212dc90a-d252-447b-9774-2378a5068a77 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.828216 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-212dc90a-d252-447b-9774-2378a5068a77 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.828915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-212dc90a-d252-447b-9774-2378a5068a77 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.040331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-212dc90a-d252-447b-9774-2378a5068a77 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:49.052193 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-212dc90a-d252-447b-9774-2378a5068a77 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1511 microversion: 2.1 time: 0.239997 Jul 20 04:36:49.053468 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1957/4139] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:48 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1511 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:49.073763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-19b282d4-4b66-4cff-9ef7-cd7855f43d18 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:49.074698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-19b282d4-4b66-4cff-9ef7-cd7855f43d18 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 2c2adc32-835f-427a-89df-e95652a204a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:49.082228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19b282d4-4b66-4cff-9ef7-cd7855f43d18 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.082698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19b282d4-4b66-4cff-9ef7-cd7855f43d18 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.083705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19b282d4-4b66-4cff-9ef7-cd7855f43d18 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.092903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19b282d4-4b66-4cff-9ef7-cd7855f43d18 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.115619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:49.306466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-19b282d4-4b66-4cff-9ef7-cd7855f43d18 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:49.316520 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-19b282d4-4b66-4cff-9ef7-cd7855f43d18 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3" status: 200 len: 1511 microversion: 2.1 time: 0.246126 Jul 20 04:36:49.317463 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1958/4140] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:49 2022] GET /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3 => generated 1511 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:49.335156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f47078b7-b46c-4910-abd3-de1a06380f87 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:49.339162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f47078b7-b46c-4910-abd3-de1a06380f87 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:49.340065 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f47078b7-b46c-4910-abd3-de1a06380f87 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:49.348507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-38076c0d-c59b-4535-ad96-88a22d3ba24a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:49.353509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f47078b7-b46c-4910-abd3-de1a06380f87 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.353984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f47078b7-b46c-4910-abd3-de1a06380f87 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.354778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f47078b7-b46c-4910-abd3-de1a06380f87 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.355226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f47078b7-b46c-4910-abd3-de1a06380f87 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.357972 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-38076c0d-c59b-4535-ad96-88a22d3ba24a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.639484 Jul 20 04:36:49.358597 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2183/4141] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:48 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:49.467767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-f47078b7-b46c-4910-abd3-de1a06380f87 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:36:49.577510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f47078b7-b46c-4910-abd3-de1a06380f87 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:49.585068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f47078b7-b46c-4910-abd3-de1a06380f87 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.585452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f47078b7-b46c-4910-abd3-de1a06380f87 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.675303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-898cc7da-656d-46e5-8cb4-a367dc524670 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:49.676289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-898cc7da-656d-46e5-8cb4-a367dc524670 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:49.692306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-898cc7da-656d-46e5-8cb4-a367dc524670 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.692675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-898cc7da-656d-46e5-8cb4-a367dc524670 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.693753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-898cc7da-656d-46e5-8cb4-a367dc524670 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.694369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-898cc7da-656d-46e5-8cb4-a367dc524670 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.767858 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f47078b7-b46c-4910-abd3-de1a06380f87 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 0.437518 Jul 20 04:36:49.769390 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1959/4142] 10.222.0.17 () {58 vars in 1166 bytes} [Wed Jul 20 04:36:49 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:49.789367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c6282320-5b81-428f-a733-c2fd5c90236a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:49.793531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c6282320-5b81-428f-a733-c2fd5c90236a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:49.794560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c6282320-5b81-428f-a733-c2fd5c90236a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-212067818', 'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:49.800823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6282320-5b81-428f-a733-c2fd5c90236a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.801447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6282320-5b81-428f-a733-c2fd5c90236a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.802411 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6282320-5b81-428f-a733-c2fd5c90236a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.803013 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6282320-5b81-428f-a733-c2fd5c90236a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.912390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-c6282320-5b81-428f-a733-c2fd5c90236a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:36:49.988060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c6282320-5b81-428f-a733-c2fd5c90236a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:49.995511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6282320-5b81-428f-a733-c2fd5c90236a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.995966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6282320-5b81-428f-a733-c2fd5c90236a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.000301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-898cc7da-656d-46e5-8cb4-a367dc524670 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.013297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-898cc7da-656d-46e5-8cb4-a367dc524670 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.015305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-898cc7da-656d-46e5-8cb4-a367dc524670 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.017434 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-898cc7da-656d-46e5-8cb4-a367dc524670 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1880 microversion: 2.42 time: 0.354204 Jul 20 04:36:50.037178 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2184/4143] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:49 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1880 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:50.136290 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c6282320-5b81-428f-a733-c2fd5c90236a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-212067818" status: 200 len: 1514 microversion: 2.1 time: 0.350573 Jul 20 04:36:50.140247 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1960/4144] 10.222.0.17 () {58 vars in 1260 bytes} [Wed Jul 20 04:36:49 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-212067818 => generated 1514 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:50.163605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4b117e30-4a96-43ac-adef-fd192922fec1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:50.167552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4b117e30-4a96-43ac-adef-fd192922fec1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.169308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4b117e30-4a96-43ac-adef-fd192922fec1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:50.177408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b117e30-4a96-43ac-adef-fd192922fec1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.178131 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b117e30-4a96-43ac-adef-fd192922fec1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.179719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b117e30-4a96-43ac-adef-fd192922fec1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.180369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b117e30-4a96-43ac-adef-fd192922fec1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.304187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-4b117e30-4a96-43ac-adef-fd192922fec1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:36:50.378467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94386aac-113f-4830-938a-26fb36e7948f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:50.379282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-94386aac-113f-4830-938a-26fb36e7948f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:50.388733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94386aac-113f-4830-938a-26fb36e7948f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.389543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94386aac-113f-4830-938a-26fb36e7948f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.390977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94386aac-113f-4830-938a-26fb36e7948f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.391685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94386aac-113f-4830-938a-26fb36e7948f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.397896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4b117e30-4a96-43ac-adef-fd192922fec1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.406526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b117e30-4a96-43ac-adef-fd192922fec1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.406982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b117e30-4a96-43ac-adef-fd192922fec1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.587160 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4b117e30-4a96-43ac-adef-fd192922fec1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 0.427919 Jul 20 04:36:50.602367 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2185/4145] 10.222.0.17 () {58 vars in 1172 bytes} [Wed Jul 20 04:36:50 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:50.619708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-80ec7e79-795c-4d91-859d-1c8867be85f0 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:50.637709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-80ec7e79-795c-4d91-859d-1c8867be85f0 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:50.646818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-80ec7e79-795c-4d91-859d-1c8867be85f0 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.647619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-80ec7e79-795c-4d91-859d-1c8867be85f0 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.649465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-80ec7e79-795c-4d91-859d-1c8867be85f0 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.650320 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-80ec7e79-795c-4d91-859d-1c8867be85f0 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.662986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-94386aac-113f-4830-938a-26fb36e7948f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.673137 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-94386aac-113f-4830-938a-26fb36e7948f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.301301 Jul 20 04:36:50.683079 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1961/4146] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:50 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:50.683079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-18cab8dc-dd53-4115-b435-099e1e60045b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:50.683079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-18cab8dc-dd53-4115-b435-099e1e60045b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.683079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.compute.servers [None req-18cab8dc-dd53-4115-b435-099e1e60045b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Removing options 'limit' from query {{(pid=127870) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:36:50.683805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-18cab8dc-dd53-4115-b435-099e1e60045b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:50.690474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18cab8dc-dd53-4115-b435-099e1e60045b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.690927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18cab8dc-dd53-4115-b435-099e1e60045b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.692683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18cab8dc-dd53-4115-b435-099e1e60045b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.693131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18cab8dc-dd53-4115-b435-099e1e60045b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.707247 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-80ec7e79-795c-4d91-859d-1c8867be85f0 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/ips" status: 200 len: 151 microversion: 2.20 time: 0.103146 Jul 20 04:36:50.708771 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2186/4147] 10.222.0.17 () {60 vars in 1288 bytes} [Wed Jul 20 04:36:50 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/ips => generated 151 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:36:50.735406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-18cab8dc-dd53-4115-b435-099e1e60045b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.742654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18cab8dc-dd53-4115-b435-099e1e60045b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.743611 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18cab8dc-dd53-4115-b435-099e1e60045b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.920251 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-18cab8dc-dd53-4115-b435-099e1e60045b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.245090 Jul 20 04:36:50.921366 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1962/4148] 10.222.0.17 () {58 vars in 1160 bytes} [Wed Jul 20 04:36:50 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:50.940145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-64af8dcb-400b-4f2d-8ccb-5957d9e24815 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:50.946281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-64af8dcb-400b-4f2d-8ccb-5957d9e24815 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.947392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-64af8dcb-400b-4f2d-8ccb-5957d9e24815 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:50.958736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64af8dcb-400b-4f2d-8ccb-5957d9e24815 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.959382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64af8dcb-400b-4f2d-8ccb-5957d9e24815 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.960381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64af8dcb-400b-4f2d-8ccb-5957d9e24815 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.961621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64af8dcb-400b-4f2d-8ccb-5957d9e24815 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.037302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8d486ab4-128d-4e83-a0d3-e584c02eaec6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:51.037950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8d486ab4-128d-4e83-a0d3-e584c02eaec6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:51.069803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d486ab4-128d-4e83-a0d3-e584c02eaec6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.070284 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d486ab4-128d-4e83-a0d3-e584c02eaec6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.071899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d486ab4-128d-4e83-a0d3-e584c02eaec6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.072358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d486ab4-128d-4e83-a0d3-e584c02eaec6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.223694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-64af8dcb-400b-4f2d-8ccb-5957d9e24815 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:36:51.340556 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-64af8dcb-400b-4f2d-8ccb-5957d9e24815 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.404078 Jul 20 04:36:51.343170 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2187/4149] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:36:50 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:51.360372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a80026bd-761d-47cd-ab71-a56ec8f9a45d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:51.365144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a80026bd-761d-47cd-ab71-a56ec8f9a45d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:51.365897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.compute.servers [None req-a80026bd-761d-47cd-ab71-a56ec8f9a45d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Removing options 'limit' from query {{(pid=127871) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:36:51.366957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a80026bd-761d-47cd-ab71-a56ec8f9a45d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:51.376839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a80026bd-761d-47cd-ab71-a56ec8f9a45d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.378006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a80026bd-761d-47cd-ab71-a56ec8f9a45d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.379216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a80026bd-761d-47cd-ab71-a56ec8f9a45d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.380141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a80026bd-761d-47cd-ab71-a56ec8f9a45d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.419590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-a80026bd-761d-47cd-ab71-a56ec8f9a45d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:36:51.499447 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a80026bd-761d-47cd-ab71-a56ec8f9a45d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.144917 Jul 20 04:36:51.508099 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2188/4150] 10.222.0.17 () {58 vars in 1149 bytes} [Wed Jul 20 04:36:51 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:51.513934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d2c1cc4d-b054-4858-bdf1-2934bd574471 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:51.518285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d2c1cc4d-b054-4858-bdf1-2934bd574471 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:51.519247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d2c1cc4d-b054-4858-bdf1-2934bd574471 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:51.525960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2c1cc4d-b054-4858-bdf1-2934bd574471 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.526495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2c1cc4d-b054-4858-bdf1-2934bd574471 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.527600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2c1cc4d-b054-4858-bdf1-2934bd574471 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.528423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2c1cc4d-b054-4858-bdf1-2934bd574471 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.543687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8d486ab4-128d-4e83-a0d3-e584c02eaec6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:51.557964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8d486ab4-128d-4e83-a0d3-e584c02eaec6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:51.565093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8d486ab4-128d-4e83-a0d3-e584c02eaec6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:51.566722 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8d486ab4-128d-4e83-a0d3-e584c02eaec6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 2837 microversion: 2.42 time: 0.534406 Jul 20 04:36:51.570048 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1963/4151] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:51 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 2837 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:51.581153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-d2c1cc4d-b054-4858-bdf1-2934bd574471 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:36:51.588893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-514cf79e-dcd1-4fef-86e3-869a93a753d2 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:51.589902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-514cf79e-dcd1-4fef-86e3-869a93a753d2 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:51.606484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-514cf79e-dcd1-4fef-86e3-869a93a753d2 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.607779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-514cf79e-dcd1-4fef-86e3-869a93a753d2 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.610308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-514cf79e-dcd1-4fef-86e3-869a93a753d2 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.611773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-514cf79e-dcd1-4fef-86e3-869a93a753d2 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.638890 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d2c1cc4d-b054-4858-bdf1-2934bd574471 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.129536 Jul 20 04:36:51.647937 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2189/4152] 10.222.0.17 () {58 vars in 1124 bytes} [Wed Jul 20 04:36:51 2022] GET /compute/v2.1/servers => generated 1010 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:51.653500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e0d07014-0aaf-437e-95c6-e6c44183afe0 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:51.657629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e0d07014-0aaf-437e-95c6-e6c44183afe0 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:51.658648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e0d07014-0aaf-437e-95c6-e6c44183afe0 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:51.673294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0d07014-0aaf-437e-95c6-e6c44183afe0 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.673920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0d07014-0aaf-437e-95c6-e6c44183afe0 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.674877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0d07014-0aaf-437e-95c6-e6c44183afe0 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.675472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0d07014-0aaf-437e-95c6-e6c44183afe0 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.877047 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-514cf79e-dcd1-4fef-86e3-869a93a753d2 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.291257 Jul 20 04:36:51.878518 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1964/4153] 10.222.0.17 () {60 vars in 1315 bytes} [Wed Jul 20 04:36:51 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869/os-interface => generated 1831 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:51.891585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-e0d07014-0aaf-437e-95c6-e6c44183afe0 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:36:51.909420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf9d2477-f58e-4f96-98b2-556e59b9de79 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:51.910043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf9d2477-f58e-4f96-98b2-556e59b9de79 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:51.920106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf9d2477-f58e-4f96-98b2-556e59b9de79 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.920773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf9d2477-f58e-4f96-98b2-556e59b9de79 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.921385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf9d2477-f58e-4f96-98b2-556e59b9de79 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.921815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf9d2477-f58e-4f96-98b2-556e59b9de79 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:52.039459 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e0d07014-0aaf-437e-95c6-e6c44183afe0 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.389787 Jul 20 04:36:52.040632 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2190/4154] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:36:51 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:52.060588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cbe1a6e2-9192-4883-af3c-8d356e41a445 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:52.067989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cbe1a6e2-9192-4883-af3c-8d356e41a445 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:52.068806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.compute.servers [None req-cbe1a6e2-9192-4883-af3c-8d356e41a445 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Removing options 'limit' from query {{(pid=127871) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:36:52.069956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cbe1a6e2-9192-4883-af3c-8d356e41a445 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:52.078674 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cbe1a6e2-9192-4883-af3c-8d356e41a445 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.079502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cbe1a6e2-9192-4883-af3c-8d356e41a445 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:52.080933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cbe1a6e2-9192-4883-af3c-8d356e41a445 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.081955 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cbe1a6e2-9192-4883-af3c-8d356e41a445 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:52.150284 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cbe1a6e2-9192-4883-af3c-8d356e41a445 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.095900 Jul 20 04:36:52.164772 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2191/4155] 10.222.0.17 () {58 vars in 1139 bytes} [Wed Jul 20 04:36:52 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:52.191187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-da503d57-01ee-42ac-86fa-f9264a79ac36 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:52.228076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-da503d57-01ee-42ac-86fa-f9264a79ac36 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:52.249118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-da503d57-01ee-42ac-86fa-f9264a79ac36 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-212067818', 'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:52.275612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da503d57-01ee-42ac-86fa-f9264a79ac36 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.276749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da503d57-01ee-42ac-86fa-f9264a79ac36 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:52.288790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da503d57-01ee-42ac-86fa-f9264a79ac36 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.291682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da503d57-01ee-42ac-86fa-f9264a79ac36 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:52.333531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bf9d2477-f58e-4f96-98b2-556e59b9de79 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:52.346163 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf9d2477-f58e-4f96-98b2-556e59b9de79 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.465767 Jul 20 04:36:52.355753 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1965/4156] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:51 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:52.448578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-da503d57-01ee-42ac-86fa-f9264a79ac36 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:36:52.533692 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-da503d57-01ee-42ac-86fa-f9264a79ac36 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-212067818" status: 200 len: 345 microversion: 2.1 time: 0.367488 Jul 20 04:36:52.534617 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2192/4157] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Jul 20 04:36:52 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-212067818 => generated 345 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:52.549621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-92fb4b66-1766-4f47-b970-8fc262db5cd1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:52.579075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92fb4b66-1766-4f47-b970-8fc262db5cd1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.579614 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92fb4b66-1766-4f47-b970-8fc262db5cd1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:52.673651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-92fb4b66-1766-4f47-b970-8fc262db5cd1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Going to try to stop instance {{(pid=127870) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:36:52.758229 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-92fb4b66-1766-4f47-b970-8fc262db5cd1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "POST /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a/action" status: 202 len: 0 microversion: 2.1 time: 0.213997 Jul 20 04:36:52.760593 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1966/4158] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:52 2022] POST /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:36:52.771458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5b699bb9-aa6d-4c43-bc9e-4b118faba46a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:52.772092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5b699bb9-aa6d-4c43-bc9e-4b118faba46a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:52.802912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b699bb9-aa6d-4c43-bc9e-4b118faba46a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.809727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b699bb9-aa6d-4c43-bc9e-4b118faba46a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:52.812649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b699bb9-aa6d-4c43-bc9e-4b118faba46a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.813101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b699bb9-aa6d-4c43-bc9e-4b118faba46a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.225642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5b699bb9-aa6d-4c43-bc9e-4b118faba46a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:53.241061 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5b699bb9-aa6d-4c43-bc9e-4b118faba46a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1521 microversion: 2.1 time: 0.473678 Jul 20 04:36:53.241980 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2193/4159] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:52 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:53.364254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c702ca60-0663-476f-95e4-499fbe164824 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:53.365336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c702ca60-0663-476f-95e4-499fbe164824 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:53.391968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c702ca60-0663-476f-95e4-499fbe164824 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:53.397199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c702ca60-0663-476f-95e4-499fbe164824 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.403931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c702ca60-0663-476f-95e4-499fbe164824 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:53.404787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c702ca60-0663-476f-95e4-499fbe164824 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.665120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c702ca60-0663-476f-95e4-499fbe164824 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:53.683828 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c702ca60-0663-476f-95e4-499fbe164824 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.324142 Jul 20 04:36:53.685135 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1967/4160] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:53 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:53.930329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-45561d24-3647-471f-9549-3e55c85d2847 req-a57967ae-74f8-4175-a796-72e74517e9aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "tag": "b15665c3-c608-4291-ba03-0645e53bbcc0"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:53.947885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-45561d24-3647-471f-9549-3e55c85d2847 req-a57967ae-74f8-4175-a796-72e74517e9aa service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:53.947885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-45561d24-3647-471f-9549-3e55c85d2847 req-a57967ae-74f8-4175-a796-72e74517e9aa service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.964148 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-45561d24-3647-471f-9549-3e55c85d2847 req-a57967ae-74f8-4175-a796-72e74517e9aa service nova] Creating event network-changed:b15665c3-c608-4291-ba03-0645e53bbcc0 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:36:53.970455 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-45561d24-3647-471f-9549-3e55c85d2847 req-a57967ae-74f8-4175-a796-72e74517e9aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044627 Jul 20 04:36:53.975645 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2194/4161] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:54.266053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-68bc5f54-f6f6-4486-a2f7-99d1fb9819b8 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:54.269922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-68bc5f54-f6f6-4486-a2f7-99d1fb9819b8 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:54.285598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68bc5f54-f6f6-4486-a2f7-99d1fb9819b8 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.286488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68bc5f54-f6f6-4486-a2f7-99d1fb9819b8 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.287744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68bc5f54-f6f6-4486-a2f7-99d1fb9819b8 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.288535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68bc5f54-f6f6-4486-a2f7-99d1fb9819b8 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.589290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-68bc5f54-f6f6-4486-a2f7-99d1fb9819b8 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:54.601165 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-68bc5f54-f6f6-4486-a2f7-99d1fb9819b8 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1521 microversion: 2.1 time: 0.345132 Jul 20 04:36:54.602057 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1968/4162] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:54 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:54.707751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-61a1f824-3498-465c-91e9-5e01d04ec4d7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:54.708505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-61a1f824-3498-465c-91e9-5e01d04ec4d7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:54.717000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61a1f824-3498-465c-91e9-5e01d04ec4d7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.717752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61a1f824-3498-465c-91e9-5e01d04ec4d7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.746282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61a1f824-3498-465c-91e9-5e01d04ec4d7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.746282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61a1f824-3498-465c-91e9-5e01d04ec4d7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.791924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:55.043719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bcd16563-4d27-4c00-8459-9814c58af90e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:55.044370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bcd16563-4d27-4c00-8459-9814c58af90e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:55.061107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-61a1f824-3498-465c-91e9-5e01d04ec4d7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:55.062513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcd16563-4d27-4c00-8459-9814c58af90e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.065304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcd16563-4d27-4c00-8459-9814c58af90e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.066992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcd16563-4d27-4c00-8459-9814c58af90e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.067607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcd16563-4d27-4c00-8459-9814c58af90e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.091873 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-61a1f824-3498-465c-91e9-5e01d04ec4d7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.388710 Jul 20 04:36:55.097850 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2195/4163] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:54 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:55.138140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-bcd16563-4d27-4c00-8459-9814c58af90e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lazy-loading 'flavor' on Instance uuid 90ebac50-3466-4fdc-8ca1-59b0001e2581 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:36:55.618801 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bcd16563-4d27-4c00-8459-9814c58af90e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "POST /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/action" status: 202 len: 0 microversion: 2.20 time: 0.579966 Jul 20 04:36:55.622995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dee5ce32-df8f-438c-8db8-14c26e733578 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:55.623864 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1969/4164] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jul 20 04:36:55 2022] POST /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:55.630017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fb7302b3-c072-489d-9181-88483581e395 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:55.633610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dee5ce32-df8f-438c-8db8-14c26e733578 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:55.644050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fb7302b3-c072-489d-9181-88483581e395 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:55.647337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dee5ce32-df8f-438c-8db8-14c26e733578 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.648146 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dee5ce32-df8f-438c-8db8-14c26e733578 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.659396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dee5ce32-df8f-438c-8db8-14c26e733578 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.659860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dee5ce32-df8f-438c-8db8-14c26e733578 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.662804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb7302b3-c072-489d-9181-88483581e395 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.663459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb7302b3-c072-489d-9181-88483581e395 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.664380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb7302b3-c072-489d-9181-88483581e395 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.667381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb7302b3-c072-489d-9181-88483581e395 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.988247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dee5ce32-df8f-438c-8db8-14c26e733578 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:55.997640 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dee5ce32-df8f-438c-8db8-14c26e733578 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1521 microversion: 2.1 time: 0.379002 Jul 20 04:36:56.006496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fb7302b3-c072-489d-9181-88483581e395 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:56.007880 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2196/4165] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:55 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:56.021786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fb7302b3-c072-489d-9181-88483581e395 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:56.024377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fb7302b3-c072-489d-9181-88483581e395 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:56.025846 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fb7302b3-c072-489d-9181-88483581e395 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1722 microversion: 2.20 time: 0.400224 Jul 20 04:36:56.034431 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1970/4166] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:55 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1722 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:56.122070 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-64f5388f-3c6c-4934-90dc-5989f5cf2f2f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:56.122700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-64f5388f-3c6c-4934-90dc-5989f5cf2f2f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:56.131240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64f5388f-3c6c-4934-90dc-5989f5cf2f2f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.131690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64f5388f-3c6c-4934-90dc-5989f5cf2f2f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.132485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64f5388f-3c6c-4934-90dc-5989f5cf2f2f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.133097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64f5388f-3c6c-4934-90dc-5989f5cf2f2f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.305385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-64f5388f-3c6c-4934-90dc-5989f5cf2f2f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:56.314390 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-64f5388f-3c6c-4934-90dc-5989f5cf2f2f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.203833 Jul 20 04:36:56.315280 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2197/4167] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:56 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:57.015076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-29c8749d-e5c0-48c3-8a1e-5b03bdf3caf9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:57.015755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-29c8749d-e5c0-48c3-8a1e-5b03bdf3caf9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:57.023813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29c8749d-e5c0-48c3-8a1e-5b03bdf3caf9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.024300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29c8749d-e5c0-48c3-8a1e-5b03bdf3caf9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.025120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29c8749d-e5c0-48c3-8a1e-5b03bdf3caf9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.025564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29c8749d-e5c0-48c3-8a1e-5b03bdf3caf9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.030552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:57.046741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-489abcdc-6671-437d-8107-5a81648dc77d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:57.047742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-489abcdc-6671-437d-8107-5a81648dc77d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:57.061223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-489abcdc-6671-437d-8107-5a81648dc77d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.061805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-489abcdc-6671-437d-8107-5a81648dc77d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.062688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-489abcdc-6671-437d-8107-5a81648dc77d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.063172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-489abcdc-6671-437d-8107-5a81648dc77d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.185009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-29c8749d-e5c0-48c3-8a1e-5b03bdf3caf9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:57.199910 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-29c8749d-e5c0-48c3-8a1e-5b03bdf3caf9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1521 microversion: 2.1 time: 0.188570 Jul 20 04:36:57.201218 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1971/4168] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:57 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:57.258439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-489abcdc-6671-437d-8107-5a81648dc77d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:57.267973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-489abcdc-6671-437d-8107-5a81648dc77d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:57.269517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-489abcdc-6671-437d-8107-5a81648dc77d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:57.273262 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-489abcdc-6671-437d-8107-5a81648dc77d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1722 microversion: 2.20 time: 0.231588 Jul 20 04:36:57.274159 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2198/4169] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:57 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:57.335500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2179f15a-ca8f-4661-9b50-d79bc790e8ca tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:57.335808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2179f15a-ca8f-4661-9b50-d79bc790e8ca tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:57.342417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2179f15a-ca8f-4661-9b50-d79bc790e8ca tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.342875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2179f15a-ca8f-4661-9b50-d79bc790e8ca tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.343655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2179f15a-ca8f-4661-9b50-d79bc790e8ca tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.344087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2179f15a-ca8f-4661-9b50-d79bc790e8ca tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.493382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2179f15a-ca8f-4661-9b50-d79bc790e8ca tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:57.503452 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2179f15a-ca8f-4661-9b50-d79bc790e8ca tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.172170 Jul 20 04:36:57.504049 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1972/4170] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:57 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:58.224633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d5361c4-af5b-44eb-a956-8032cd6f6d2c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:58.226444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4d5361c4-af5b-44eb-a956-8032cd6f6d2c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:58.232341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:58.239978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d5361c4-af5b-44eb-a956-8032cd6f6d2c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:58.240457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d5361c4-af5b-44eb-a956-8032cd6f6d2c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:58.241235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d5361c4-af5b-44eb-a956-8032cd6f6d2c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:58.241667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d5361c4-af5b-44eb-a956-8032cd6f6d2c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:58.292582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e914f2d3-374c-4837-b265-04bbfc5ae1d1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:58.293179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e914f2d3-374c-4837-b265-04bbfc5ae1d1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:58.303076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e914f2d3-374c-4837-b265-04bbfc5ae1d1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:58.303528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e914f2d3-374c-4837-b265-04bbfc5ae1d1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:58.304330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e914f2d3-374c-4837-b265-04bbfc5ae1d1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:58.304844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e914f2d3-374c-4837-b265-04bbfc5ae1d1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:58.447918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4d5361c4-af5b-44eb-a956-8032cd6f6d2c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:58.462218 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4d5361c4-af5b-44eb-a956-8032cd6f6d2c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1521 microversion: 2.1 time: 0.242880 Jul 20 04:36:58.463776 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2199/4171] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:58 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:58.493232 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e914f2d3-374c-4837-b265-04bbfc5ae1d1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:58.505276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e914f2d3-374c-4837-b265-04bbfc5ae1d1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:58.507328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e914f2d3-374c-4837-b265-04bbfc5ae1d1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:58.508673 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e914f2d3-374c-4837-b265-04bbfc5ae1d1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1722 microversion: 2.20 time: 0.220141 Jul 20 04:36:58.509552 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1973/4172] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:58 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:58.525540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ca31de53-3ed4-4222-b41c-c7bf000c3a3a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:58.526166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ca31de53-3ed4-4222-b41c-c7bf000c3a3a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:58.532515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca31de53-3ed4-4222-b41c-c7bf000c3a3a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:58.532972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca31de53-3ed4-4222-b41c-c7bf000c3a3a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:58.533756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca31de53-3ed4-4222-b41c-c7bf000c3a3a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:58.534199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca31de53-3ed4-4222-b41c-c7bf000c3a3a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:58.741588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ca31de53-3ed4-4222-b41c-c7bf000c3a3a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:58.750027 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ca31de53-3ed4-4222-b41c-c7bf000c3a3a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.228465 Jul 20 04:36:58.751080 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2200/4173] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:58 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:59.481432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f13a92f4-8e79-4323-8f87-f98ca799585b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:59.483770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f13a92f4-8e79-4323-8f87-f98ca799585b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:59.494535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f13a92f4-8e79-4323-8f87-f98ca799585b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.498306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f13a92f4-8e79-4323-8f87-f98ca799585b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.500320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f13a92f4-8e79-4323-8f87-f98ca799585b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.501941 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f13a92f4-8e79-4323-8f87-f98ca799585b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.529995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5609cd35-7ae5-41e0-b37d-67b3962dc4b7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:59.531515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5609cd35-7ae5-41e0-b37d-67b3962dc4b7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:59.549485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5609cd35-7ae5-41e0-b37d-67b3962dc4b7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.550621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5609cd35-7ae5-41e0-b37d-67b3962dc4b7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.552292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5609cd35-7ae5-41e0-b37d-67b3962dc4b7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.553328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5609cd35-7ae5-41e0-b37d-67b3962dc4b7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.747572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5609cd35-7ae5-41e0-b37d-67b3962dc4b7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:59.765524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5609cd35-7ae5-41e0-b37d-67b3962dc4b7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:59.765881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f13a92f4-8e79-4323-8f87-f98ca799585b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:59.770562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5609cd35-7ae5-41e0-b37d-67b3962dc4b7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:59.773324 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5609cd35-7ae5-41e0-b37d-67b3962dc4b7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1722 microversion: 2.20 time: 0.249506 Jul 20 04:36:59.774214 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f13a92f4-8e79-4323-8f87-f98ca799585b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1521 microversion: 2.1 time: 0.297079 Jul 20 04:36:59.775371 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2201/4174] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:59 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:59.783825 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1974/4175] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:59 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:59.789413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-00c1cc9b-da4e-42de-a2e7-0a5f3dd97b1a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:59.790968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-00c1cc9b-da4e-42de-a2e7-0a5f3dd97b1a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:59.804216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00c1cc9b-da4e-42de-a2e7-0a5f3dd97b1a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.805338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00c1cc9b-da4e-42de-a2e7-0a5f3dd97b1a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.807378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00c1cc9b-da4e-42de-a2e7-0a5f3dd97b1a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.808595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00c1cc9b-da4e-42de-a2e7-0a5f3dd97b1a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.973863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-00c1cc9b-da4e-42de-a2e7-0a5f3dd97b1a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:59.986550 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-00c1cc9b-da4e-42de-a2e7-0a5f3dd97b1a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.205775 Jul 20 04:36:59.986550 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2202/4176] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:59 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:00.791891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a544c338-69fa-46f4-a397-25fc1e41f2d7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:00.792686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8f578b59-1fa1-4459-ae18-f2a89ad20e20 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:00.792686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8f578b59-1fa1-4459-ae18-f2a89ad20e20 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:00.794383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a544c338-69fa-46f4-a397-25fc1e41f2d7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:00.799373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:00.800743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:00.801152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:00.803590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f578b59-1fa1-4459-ae18-f2a89ad20e20 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:00.804197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f578b59-1fa1-4459-ae18-f2a89ad20e20 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:00.805187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a544c338-69fa-46f4-a397-25fc1e41f2d7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:00.805428 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f578b59-1fa1-4459-ae18-f2a89ad20e20 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:00.805875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f578b59-1fa1-4459-ae18-f2a89ad20e20 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:00.806341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a544c338-69fa-46f4-a397-25fc1e41f2d7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:00.807395 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a544c338-69fa-46f4-a397-25fc1e41f2d7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:00.808058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a544c338-69fa-46f4-a397-25fc1e41f2d7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.027764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a544c338-69fa-46f4-a397-25fc1e41f2d7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:01.041749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a544c338-69fa-46f4-a397-25fc1e41f2d7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:01.044536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a544c338-69fa-46f4-a397-25fc1e41f2d7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:01.045836 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a544c338-69fa-46f4-a397-25fc1e41f2d7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1722 microversion: 2.20 time: 0.258167 Jul 20 04:37:01.053442 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2203/4177] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:00 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:01.060522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-56d30835-4efe-492a-ba43-12b48a2fd497 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:01.061610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-56d30835-4efe-492a-ba43-12b48a2fd497 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:01.069350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56d30835-4efe-492a-ba43-12b48a2fd497 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:01.069531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8f578b59-1fa1-4459-ae18-f2a89ad20e20 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:01.069807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56d30835-4efe-492a-ba43-12b48a2fd497 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.070638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56d30835-4efe-492a-ba43-12b48a2fd497 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:01.071171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56d30835-4efe-492a-ba43-12b48a2fd497 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.085969 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8f578b59-1fa1-4459-ae18-f2a89ad20e20 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1521 microversion: 2.1 time: 0.298266 Jul 20 04:37:01.088085 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1975/4178] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:00 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:01.285015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-56d30835-4efe-492a-ba43-12b48a2fd497 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:01.301106 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-56d30835-4efe-492a-ba43-12b48a2fd497 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.245981 Jul 20 04:37:01.302145 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2204/4179] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:01 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:02.067720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3f436ae2-6cfc-4ed5-b02a-fbe204ae423e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:02.068632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3f436ae2-6cfc-4ed5-b02a-fbe204ae423e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:02.075539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f436ae2-6cfc-4ed5-b02a-fbe204ae423e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:02.076058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f436ae2-6cfc-4ed5-b02a-fbe204ae423e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:02.076876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f436ae2-6cfc-4ed5-b02a-fbe204ae423e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:02.077283 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f436ae2-6cfc-4ed5-b02a-fbe204ae423e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:02.107063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0dda5ba2-58d6-4ee2-acf4-1df831eee11e tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:02.108040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0dda5ba2-58d6-4ee2-acf4-1df831eee11e tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:02.118338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0dda5ba2-58d6-4ee2-acf4-1df831eee11e tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:02.118853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0dda5ba2-58d6-4ee2-acf4-1df831eee11e tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:02.119661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0dda5ba2-58d6-4ee2-acf4-1df831eee11e tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:02.120083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0dda5ba2-58d6-4ee2-acf4-1df831eee11e tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:02.303719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3f436ae2-6cfc-4ed5-b02a-fbe204ae423e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:02.313983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3f436ae2-6cfc-4ed5-b02a-fbe204ae423e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:02.315874 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3f436ae2-6cfc-4ed5-b02a-fbe204ae423e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:02.317729 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3f436ae2-6cfc-4ed5-b02a-fbe204ae423e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1722 microversion: 2.20 time: 0.255557 Jul 20 04:37:02.318496 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1976/4180] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:02 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:02.335966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2074c6c8-b8ba-403d-8e64-3794dfc27725 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:02.336955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2074c6c8-b8ba-403d-8e64-3794dfc27725 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:02.344573 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2074c6c8-b8ba-403d-8e64-3794dfc27725 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:02.345320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2074c6c8-b8ba-403d-8e64-3794dfc27725 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:02.346421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2074c6c8-b8ba-403d-8e64-3794dfc27725 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:02.347071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2074c6c8-b8ba-403d-8e64-3794dfc27725 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:02.396085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0dda5ba2-58d6-4ee2-acf4-1df831eee11e tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:02.408018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=14 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:02.434776 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0dda5ba2-58d6-4ee2-acf4-1df831eee11e tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1521 microversion: 2.1 time: 0.328356 Jul 20 04:37:02.458592 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2205/4181] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:02 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:02.544114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2074c6c8-b8ba-403d-8e64-3794dfc27725 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:02.555030 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2074c6c8-b8ba-403d-8e64-3794dfc27725 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.223073 Jul 20 04:37:02.555692 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1977/4182] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:02 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:03.338872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cda8b05f-db23-4fd5-b2ba-01875529a21c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:03.339483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cda8b05f-db23-4fd5-b2ba-01875529a21c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:03.347214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cda8b05f-db23-4fd5-b2ba-01875529a21c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:03.348327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cda8b05f-db23-4fd5-b2ba-01875529a21c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.349325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cda8b05f-db23-4fd5-b2ba-01875529a21c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:03.349957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cda8b05f-db23-4fd5-b2ba-01875529a21c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.472571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d3775e48-e22d-4b3e-943c-05c141d229ab tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:03.480286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d3775e48-e22d-4b3e-943c-05c141d229ab tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:03.495738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d3775e48-e22d-4b3e-943c-05c141d229ab tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:03.496414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d3775e48-e22d-4b3e-943c-05c141d229ab tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.497128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d3775e48-e22d-4b3e-943c-05c141d229ab tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:03.497569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d3775e48-e22d-4b3e-943c-05c141d229ab tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.611580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cda8b05f-db23-4fd5-b2ba-01875529a21c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:03.630570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cda8b05f-db23-4fd5-b2ba-01875529a21c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:03.632859 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cda8b05f-db23-4fd5-b2ba-01875529a21c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:03.634478 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cda8b05f-db23-4fd5-b2ba-01875529a21c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1722 microversion: 2.20 time: 0.299557 Jul 20 04:37:03.637386 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2206/4183] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:03 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:03.641437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-572f6391-b90e-4b4f-a009-384864e2bce6 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:03.642101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-572f6391-b90e-4b4f-a009-384864e2bce6 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:03.663128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-572f6391-b90e-4b4f-a009-384864e2bce6 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:03.663732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-572f6391-b90e-4b4f-a009-384864e2bce6 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.664875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-572f6391-b90e-4b4f-a009-384864e2bce6 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:03.667454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-572f6391-b90e-4b4f-a009-384864e2bce6 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.806287 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d3775e48-e22d-4b3e-943c-05c141d229ab tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:03.826178 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d3775e48-e22d-4b3e-943c-05c141d229ab tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1521 microversion: 2.1 time: 0.354571 Jul 20 04:37:03.827843 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1978/4184] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:03 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:04.178291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-572f6391-b90e-4b4f-a009-384864e2bce6 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:04.190615 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-572f6391-b90e-4b4f-a009-384864e2bce6 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.553715 Jul 20 04:37:04.191609 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2207/4185] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:03 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:04.656939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a42a0e43-3e80-4723-8592-314192c50202 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:04.657553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a42a0e43-3e80-4723-8592-314192c50202 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:04.669044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a42a0e43-3e80-4723-8592-314192c50202 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:04.669781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a42a0e43-3e80-4723-8592-314192c50202 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:04.671339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a42a0e43-3e80-4723-8592-314192c50202 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:04.671992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a42a0e43-3e80-4723-8592-314192c50202 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:04.843137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3e110dcd-124e-4fc4-8cbd-abae74c18338 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:04.843774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3e110dcd-124e-4fc4-8cbd-abae74c18338 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:04.870068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e110dcd-124e-4fc4-8cbd-abae74c18338 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:04.870691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e110dcd-124e-4fc4-8cbd-abae74c18338 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:04.871675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e110dcd-124e-4fc4-8cbd-abae74c18338 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:04.872360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e110dcd-124e-4fc4-8cbd-abae74c18338 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:04.917643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a42a0e43-3e80-4723-8592-314192c50202 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:04.927820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a42a0e43-3e80-4723-8592-314192c50202 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:04.930804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a42a0e43-3e80-4723-8592-314192c50202 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:04.933250 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a42a0e43-3e80-4723-8592-314192c50202 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1722 microversion: 2.20 time: 0.280764 Jul 20 04:37:04.934569 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1979/4186] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:04 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:05.198492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3e110dcd-124e-4fc4-8cbd-abae74c18338 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:05.209000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f82febcd-4933-47ef-a7a9-5ad3f8fe9ea1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:05.209892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f82febcd-4933-47ef-a7a9-5ad3f8fe9ea1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:05.225481 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3e110dcd-124e-4fc4-8cbd-abae74c18338 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1521 microversion: 2.1 time: 0.386203 Jul 20 04:37:05.227673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f82febcd-4933-47ef-a7a9-5ad3f8fe9ea1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:05.228872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f82febcd-4933-47ef-a7a9-5ad3f8fe9ea1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:05.229470 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2208/4187] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:04 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1521 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:05.230703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f82febcd-4933-47ef-a7a9-5ad3f8fe9ea1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:05.231310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f82febcd-4933-47ef-a7a9-5ad3f8fe9ea1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:05.438477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f82febcd-4933-47ef-a7a9-5ad3f8fe9ea1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:05.450030 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f82febcd-4933-47ef-a7a9-5ad3f8fe9ea1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.244963 Jul 20 04:37:05.451279 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1980/4188] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:05 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:05.957799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-83bb679e-2455-4a65-b28b-a20c7974891f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:05.959490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-83bb679e-2455-4a65-b28b-a20c7974891f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:05.972680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83bb679e-2455-4a65-b28b-a20c7974891f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:05.972680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83bb679e-2455-4a65-b28b-a20c7974891f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:05.986983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83bb679e-2455-4a65-b28b-a20c7974891f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:05.990641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83bb679e-2455-4a65-b28b-a20c7974891f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:06.254419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a7861d1c-3775-4ecb-8f6b-e0ce0ed07874 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:06.255258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a7861d1c-3775-4ecb-8f6b-e0ce0ed07874 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:06.272649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7861d1c-3775-4ecb-8f6b-e0ce0ed07874 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:06.272649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7861d1c-3775-4ecb-8f6b-e0ce0ed07874 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:06.273103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7861d1c-3775-4ecb-8f6b-e0ce0ed07874 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:06.273908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7861d1c-3775-4ecb-8f6b-e0ce0ed07874 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:06.374947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-83bb679e-2455-4a65-b28b-a20c7974891f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:06.390168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-83bb679e-2455-4a65-b28b-a20c7974891f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:06.391942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-83bb679e-2455-4a65-b28b-a20c7974891f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:06.399038 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-83bb679e-2455-4a65-b28b-a20c7974891f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1722 microversion: 2.20 time: 0.447471 Jul 20 04:37:06.402899 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2209/4189] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:05 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1722 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:06.484460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-26430bbc-758e-4d98-91d6-e6698f562bdb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:06.485720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-26430bbc-758e-4d98-91d6-e6698f562bdb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:06.503252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26430bbc-758e-4d98-91d6-e6698f562bdb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:06.504062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26430bbc-758e-4d98-91d6-e6698f562bdb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:06.505101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26430bbc-758e-4d98-91d6-e6698f562bdb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:06.505547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26430bbc-758e-4d98-91d6-e6698f562bdb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:06.524207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a7861d1c-3775-4ecb-8f6b-e0ce0ed07874 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:06.536302 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a7861d1c-3775-4ecb-8f6b-e0ce0ed07874 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1521 microversion: 2.1 time: 0.286429 Jul 20 04:37:06.547040 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1981/4190] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:06 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:06.718784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-26430bbc-758e-4d98-91d6-e6698f562bdb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:06.727354 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-26430bbc-758e-4d98-91d6-e6698f562bdb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.256702 Jul 20 04:37:06.728030 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2210/4191] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:06 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:07.450727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9a1a07c9-2bf1-4168-954e-917fcc8cbd28 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:07.454667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9a1a07c9-2bf1-4168-954e-917fcc8cbd28 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:07.477546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a1a07c9-2bf1-4168-954e-917fcc8cbd28 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:07.478351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a1a07c9-2bf1-4168-954e-917fcc8cbd28 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:07.479488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a1a07c9-2bf1-4168-954e-917fcc8cbd28 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:07.480387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a1a07c9-2bf1-4168-954e-917fcc8cbd28 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:07.554684 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-55701ef9-aa07-45f7-ae9b-8c0aea1cdd2d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:07.555606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-55701ef9-aa07-45f7-ae9b-8c0aea1cdd2d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:07.593975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55701ef9-aa07-45f7-ae9b-8c0aea1cdd2d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:07.603445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55701ef9-aa07-45f7-ae9b-8c0aea1cdd2d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:07.604495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55701ef9-aa07-45f7-ae9b-8c0aea1cdd2d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:07.605057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55701ef9-aa07-45f7-ae9b-8c0aea1cdd2d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:07.783378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9a1a07c9-2bf1-4168-954e-917fcc8cbd28 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:07.802956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9a1a07c9-2bf1-4168-954e-917fcc8cbd28 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:07.804875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9a1a07c9-2bf1-4168-954e-917fcc8cbd28 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:07.806976 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9a1a07c9-2bf1-4168-954e-917fcc8cbd28 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1743 microversion: 2.20 time: 0.383218 Jul 20 04:37:07.808341 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1982/4192] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:07 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1743 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:07.814493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c80692ca-f97f-4bc1-92e0-43d1ad5a3d33 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:07.815378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c80692ca-f97f-4bc1-92e0-43d1ad5a3d33 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:07.828959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c80692ca-f97f-4bc1-92e0-43d1ad5a3d33 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:07.829707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c80692ca-f97f-4bc1-92e0-43d1ad5a3d33 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:07.830695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c80692ca-f97f-4bc1-92e0-43d1ad5a3d33 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:07.831457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c80692ca-f97f-4bc1-92e0-43d1ad5a3d33 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:07.933680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-55701ef9-aa07-45f7-ae9b-8c0aea1cdd2d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:07.959265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:07.967494 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-55701ef9-aa07-45f7-ae9b-8c0aea1cdd2d tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1521 microversion: 2.1 time: 0.416824 Jul 20 04:37:07.973807 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2211/4193] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:07 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:08.115614 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c80692ca-f97f-4bc1-92e0-43d1ad5a3d33 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:08.125224 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c80692ca-f97f-4bc1-92e0-43d1ad5a3d33 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.315296 Jul 20 04:37:08.125996 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1983/4194] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:07 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:08.833075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1799501c-dbff-4c3e-bb8d-888d7e8571b8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:08.833912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1799501c-dbff-4c3e-bb8d-888d7e8571b8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:08.844041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1799501c-dbff-4c3e-bb8d-888d7e8571b8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:08.844875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1799501c-dbff-4c3e-bb8d-888d7e8571b8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:08.845946 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1799501c-dbff-4c3e-bb8d-888d7e8571b8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:08.846620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1799501c-dbff-4c3e-bb8d-888d7e8571b8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:08.998316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e311635f-5adf-4e84-9188-a6ae78d15c04 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:09.001125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e311635f-5adf-4e84-9188-a6ae78d15c04 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:09.015197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e311635f-5adf-4e84-9188-a6ae78d15c04 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:09.016522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e311635f-5adf-4e84-9188-a6ae78d15c04 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:09.018506 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e311635f-5adf-4e84-9188-a6ae78d15c04 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:09.019812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e311635f-5adf-4e84-9188-a6ae78d15c04 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:09.088116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1799501c-dbff-4c3e-bb8d-888d7e8571b8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:09.111777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1799501c-dbff-4c3e-bb8d-888d7e8571b8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:09.113766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1799501c-dbff-4c3e-bb8d-888d7e8571b8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:09.115688 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1799501c-dbff-4c3e-bb8d-888d7e8571b8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1743 microversion: 2.20 time: 0.288925 Jul 20 04:37:09.116907 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2212/4195] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:08 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1743 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:09.145689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2f90f6cb-cef7-4d72-95f1-1a573a347ee3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:09.146732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2f90f6cb-cef7-4d72-95f1-1a573a347ee3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:09.265611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f90f6cb-cef7-4d72-95f1-1a573a347ee3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:09.266073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f90f6cb-cef7-4d72-95f1-1a573a347ee3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:09.266953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f90f6cb-cef7-4d72-95f1-1a573a347ee3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:09.267396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f90f6cb-cef7-4d72-95f1-1a573a347ee3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:09.530385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e311635f-5adf-4e84-9188-a6ae78d15c04 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:09.540892 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e311635f-5adf-4e84-9188-a6ae78d15c04 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1521 microversion: 2.1 time: 0.551392 Jul 20 04:37:09.551982 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1984/4196] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:08 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1521 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:09.768061 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f2bebab7-752a-41ae-a78a-41cfc89a74d3 req-7a719660-7239-4481-8b54-5b5fec239c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ebac50-3466-4fdc-8ca1-59b0001e2581", "name": "network-vif-plugged", "status": "completed", "tag": "e0f13bf8-3ce6-42eb-a36c-5d668ff79e32"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:09.787956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f2bebab7-752a-41ae-a78a-41cfc89a74d3 req-7a719660-7239-4481-8b54-5b5fec239c89 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:09.791492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f2bebab7-752a-41ae-a78a-41cfc89a74d3 req-7a719660-7239-4481-8b54-5b5fec239c89 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:09.824086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2f90f6cb-cef7-4d72-95f1-1a573a347ee3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:09.841967 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f2bebab7-752a-41ae-a78a-41cfc89a74d3 req-7a719660-7239-4481-8b54-5b5fec239c89 service nova] Creating event network-vif-plugged:e0f13bf8-3ce6-42eb-a36c-5d668ff79e32 for instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 on n-h2-826526-5 Jul 20 04:37:09.850467 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f2bebab7-752a-41ae-a78a-41cfc89a74d3 req-7a719660-7239-4481-8b54-5b5fec239c89 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090939 Jul 20 04:37:09.857937 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2f90f6cb-cef7-4d72-95f1-1a573a347ee3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1512 microversion: 2.1 time: 0.716527 Jul 20 04:37:09.858469 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2213/4197] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:09 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1512 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:09.860630 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1985/4198] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:10.135648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b3f359aa-4594-4a6c-b441-9205b5f62e8d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:10.136666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b3f359aa-4594-4a6c-b441-9205b5f62e8d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:10.147198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b3f359aa-4594-4a6c-b441-9205b5f62e8d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:10.147937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b3f359aa-4594-4a6c-b441-9205b5f62e8d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:10.149451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b3f359aa-4594-4a6c-b441-9205b5f62e8d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:10.150015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b3f359aa-4594-4a6c-b441-9205b5f62e8d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:10.377690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b3f359aa-4594-4a6c-b441-9205b5f62e8d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:10.389407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b3f359aa-4594-4a6c-b441-9205b5f62e8d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:10.391168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b3f359aa-4594-4a6c-b441-9205b5f62e8d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:10.392522 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b3f359aa-4594-4a6c-b441-9205b5f62e8d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1738 microversion: 2.20 time: 0.261981 Jul 20 04:37:10.396316 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2214/4199] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:10 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1738 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:10.561930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e32f1a2e-733b-4a29-909d-22e74770da94 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:10.562885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e32f1a2e-733b-4a29-909d-22e74770da94 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:10.600658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e32f1a2e-733b-4a29-909d-22e74770da94 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:10.603827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e32f1a2e-733b-4a29-909d-22e74770da94 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:10.606276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e32f1a2e-733b-4a29-909d-22e74770da94 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:10.607042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e32f1a2e-733b-4a29-909d-22e74770da94 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:10.884903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2eb0578f-528a-4fa1-8823-f6406831c5fc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:10.890565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2eb0578f-528a-4fa1-8823-f6406831c5fc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:10.908629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e32f1a2e-733b-4a29-909d-22e74770da94 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:10.926259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2eb0578f-528a-4fa1-8823-f6406831c5fc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:10.926831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2eb0578f-528a-4fa1-8823-f6406831c5fc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:10.927866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2eb0578f-528a-4fa1-8823-f6406831c5fc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:10.928510 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e32f1a2e-733b-4a29-909d-22e74770da94 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1521 microversion: 2.1 time: 0.364880 Jul 20 04:37:10.929398 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1986/4200] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:10 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:10.929592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2eb0578f-528a-4fa1-8823-f6406831c5fc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:11.233022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2eb0578f-528a-4fa1-8823-f6406831c5fc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:11.252207 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2eb0578f-528a-4fa1-8823-f6406831c5fc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1489 microversion: 2.1 time: 0.372800 Jul 20 04:37:11.253503 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2215/4201] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:10 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1489 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:11.273779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-121df0d9-8d3e-436d-84fc-9c7313d224f2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:11.275197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-121df0d9-8d3e-436d-84fc-9c7313d224f2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:11.281945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-121df0d9-8d3e-436d-84fc-9c7313d224f2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.282727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-121df0d9-8d3e-436d-84fc-9c7313d224f2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:11.283743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-121df0d9-8d3e-436d-84fc-9c7313d224f2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.284614 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-121df0d9-8d3e-436d-84fc-9c7313d224f2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:11.371238 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-121df0d9-8d3e-436d-84fc-9c7313d224f2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 200 len: 161 microversion: 2.1 time: 0.104861 Jul 20 04:37:11.373421 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1987/4202] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:11 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 161 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:11.383047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-50673e49-873d-4c81-834c-4beb0190bf88 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:11.383664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-50673e49-873d-4c81-834c-4beb0190bf88 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:11.406939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-50673e49-873d-4c81-834c-4beb0190bf88 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.407427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-50673e49-873d-4c81-834c-4beb0190bf88 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:11.408249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-50673e49-873d-4c81-834c-4beb0190bf88 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.408712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-50673e49-873d-4c81-834c-4beb0190bf88 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:11.419930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-38fde572-bbf4-4c95-a253-a570c41cd62d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:11.421372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-38fde572-bbf4-4c95-a253-a570c41cd62d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:11.444017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38fde572-bbf4-4c95-a253-a570c41cd62d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.444591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38fde572-bbf4-4c95-a253-a570c41cd62d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:11.446493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38fde572-bbf4-4c95-a253-a570c41cd62d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.454441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-38fde572-bbf4-4c95-a253-a570c41cd62d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:11.857265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-50673e49-873d-4c81-834c-4beb0190bf88 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:11.868524 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-50673e49-873d-4c81-834c-4beb0190bf88 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.489561 Jul 20 04:37:11.899288 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2216/4203] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:11 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:11.914741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-06fad915-4117-4c4c-b490-472b5dd5fb74 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:11.918583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-06fad915-4117-4c4c-b490-472b5dd5fb74 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:11.924429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-38fde572-bbf4-4c95-a253-a570c41cd62d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:11.928224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:11.937436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-38fde572-bbf4-4c95-a253-a570c41cd62d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:11.943338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-38fde572-bbf4-4c95-a253-a570c41cd62d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:11.944076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06fad915-4117-4c4c-b490-472b5dd5fb74 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.945821 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-38fde572-bbf4-4c95-a253-a570c41cd62d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1738 microversion: 2.20 time: 0.531276 Jul 20 04:37:11.946612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06fad915-4117-4c4c-b490-472b5dd5fb74 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:11.946942 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1988/4204] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:11 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1738 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:11.950231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06fad915-4117-4c4c-b490-472b5dd5fb74 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.952799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5833154d-e391-41cd-8cad-cfbb6761d9be tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:11.954918 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5833154d-e391-41cd-8cad-cfbb6761d9be tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:11.955912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06fad915-4117-4c4c-b490-472b5dd5fb74 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:11.985338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5833154d-e391-41cd-8cad-cfbb6761d9be tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.986133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5833154d-e391-41cd-8cad-cfbb6761d9be tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:11.989806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5833154d-e391-41cd-8cad-cfbb6761d9be tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.990474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5833154d-e391-41cd-8cad-cfbb6761d9be tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:12.326791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5833154d-e391-41cd-8cad-cfbb6761d9be tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:12.343077 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5833154d-e391-41cd-8cad-cfbb6761d9be tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1521 microversion: 2.1 time: 0.394734 Jul 20 04:37:12.344074 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1989/4205] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:11 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:12.367954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-06fad915-4117-4c4c-b490-472b5dd5fb74 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:12.391327 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-06fad915-4117-4c4c-b490-472b5dd5fb74 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.482241 Jul 20 04:37:12.395217 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2217/4206] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:11 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:12.413824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f825be5d-d6a7-4412-86d5-342884b10cef tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:12.414453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f825be5d-d6a7-4412-86d5-342884b10cef tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:12.423603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f825be5d-d6a7-4412-86d5-342884b10cef tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:12.424150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f825be5d-d6a7-4412-86d5-342884b10cef tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:12.425456 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f825be5d-d6a7-4412-86d5-342884b10cef tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:12.425961 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f825be5d-d6a7-4412-86d5-342884b10cef tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:12.691783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f825be5d-d6a7-4412-86d5-342884b10cef tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:12.701327 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f825be5d-d6a7-4412-86d5-342884b10cef tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.291909 Jul 20 04:37:12.702548 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1990/4207] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:12 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:12.718188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fe48d5e3-466e-4597-ab73-4e57974c3841 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:12.719983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fe48d5e3-466e-4597-ab73-4e57974c3841 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:12.735786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe48d5e3-466e-4597-ab73-4e57974c3841 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:12.737457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe48d5e3-466e-4597-ab73-4e57974c3841 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:12.738857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe48d5e3-466e-4597-ab73-4e57974c3841 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:12.739713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe48d5e3-466e-4597-ab73-4e57974c3841 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:13.022396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ee5c2bca-671c-4a52-98d8-ac79a0555d6f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:13.023057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ee5c2bca-671c-4a52-98d8-ac79a0555d6f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:13.070916 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee5c2bca-671c-4a52-98d8-ac79a0555d6f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:13.072072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee5c2bca-671c-4a52-98d8-ac79a0555d6f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:13.073759 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee5c2bca-671c-4a52-98d8-ac79a0555d6f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:13.074840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee5c2bca-671c-4a52-98d8-ac79a0555d6f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:13.197083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fe48d5e3-466e-4597-ab73-4e57974c3841 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:13.224597 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fe48d5e3-466e-4597-ab73-4e57974c3841 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.510285 Jul 20 04:37:13.233542 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2218/4208] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:12 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:13.342669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c45d1ff2-605c-4786-b4e5-cf8ce4890025 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1452371083", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "69228133-6b77-4fda-a084-e067c6109be5"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:13.445566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-c45d1ff2-605c-4786-b4e5-cf8ce4890025 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] validate_networks() for [('69228133-6b77-4fda-a084-e067c6109be5', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:37:13.453026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ee5c2bca-671c-4a52-98d8-ac79a0555d6f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:13.465460 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ee5c2bca-671c-4a52-98d8-ac79a0555d6f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:13.467493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ee5c2bca-671c-4a52-98d8-ac79a0555d6f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:13.468789 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ee5c2bca-671c-4a52-98d8-ac79a0555d6f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1738 microversion: 2.20 time: 0.499151 Jul 20 04:37:13.469675 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1991/4209] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:12 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1738 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:13.475413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-33972065-8ac2-47ee-8cef-f71fcff2b353 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:13.476042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-33972065-8ac2-47ee-8cef-f71fcff2b353 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:13.484793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33972065-8ac2-47ee-8cef-f71fcff2b353 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:13.485310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33972065-8ac2-47ee-8cef-f71fcff2b353 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:13.486318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33972065-8ac2-47ee-8cef-f71fcff2b353 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:13.486831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33972065-8ac2-47ee-8cef-f71fcff2b353 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:13.878225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-33972065-8ac2-47ee-8cef-f71fcff2b353 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:13.897599 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-33972065-8ac2-47ee-8cef-f71fcff2b353 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1498 microversion: 2.1 time: 0.424960 Jul 20 04:37:13.898298 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1992/4210] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:13 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1498 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:13.931043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9b4ad4ac-e308-43d2-9c46-462f4150b991 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:13.939535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9b4ad4ac-e308-43d2-9c46-462f4150b991 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:13.942712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9b4ad4ac-e308-43d2-9c46-462f4150b991 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:13.955195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9b4ad4ac-e308-43d2-9c46-462f4150b991 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:13.955747 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9b4ad4ac-e308-43d2-9c46-462f4150b991 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:13.964930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9b4ad4ac-e308-43d2-9c46-462f4150b991 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:13.965387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9b4ad4ac-e308-43d2-9c46-462f4150b991 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:14.029637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-9b4ad4ac-e308-43d2-9c46-462f4150b991 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:37:14.110265 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9b4ad4ac-e308-43d2-9c46-462f4150b991 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.192599 Jul 20 04:37:14.111206 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1993/4211] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Jul 20 04:37:13 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:14.126601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a550dd5c-e58b-4c95-9549-7bb1e0388fb3 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:14.137894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a550dd5c-e58b-4c95-9549-7bb1e0388fb3 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:14.138340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a550dd5c-e58b-4c95-9549-7bb1e0388fb3 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:14.208101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c45d1ff2-605c-4786-b4e5-cf8ce4890025 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:37:14.209890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c45d1ff2-605c-4786-b4e5-cf8ce4890025 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:37:14.210651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c45d1ff2-605c-4786-b4e5-cf8ce4890025 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:37:14.211333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c45d1ff2-605c-4786-b4e5-cf8ce4890025 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:37:14.212141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-c45d1ff2-605c-4786-b4e5-cf8ce4890025 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:37:14.213266 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a550dd5c-e58b-4c95-9549-7bb1e0388fb3 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Going to try to start instance {{(pid=127870) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:37:14.226245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c45d1ff2-605c-4786-b4e5-cf8ce4890025 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:14.226976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c45d1ff2-605c-4786-b4e5-cf8ce4890025 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:14.228013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c45d1ff2-605c-4786-b4e5-cf8ce4890025 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:14.228715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c45d1ff2-605c-4786-b4e5-cf8ce4890025 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:14.253332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c45d1ff2-605c-4786-b4e5-cf8ce4890025 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Getting quotas for project fcd6c40faa19476db37fa7897dea5840. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:37:14.261444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c45d1ff2-605c-4786-b4e5-cf8ce4890025 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Getting quotas for user f50ac97f2ef04752bd49148748e39eb8 and project fcd6c40faa19476db37fa7897dea5840. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:37:14.276935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c45d1ff2-605c-4786-b4e5-cf8ce4890025 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:37:14.280187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c45d1ff2-605c-4786-b4e5-cf8ce4890025 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:37:14.329732 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a550dd5c-e58b-4c95-9549-7bb1e0388fb3 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "POST /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a/action" status: 202 len: 0 microversion: 2.1 time: 0.205995 Jul 20 04:37:14.331514 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1994/4212] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:14 2022] POST /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:14.344967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-44eab4f3-5648-4a29-a9dc-8490e0219fb9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:14.345738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-44eab4f3-5648-4a29-a9dc-8490e0219fb9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:14.361549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44eab4f3-5648-4a29-a9dc-8490e0219fb9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:14.363574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44eab4f3-5648-4a29-a9dc-8490e0219fb9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:14.374892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44eab4f3-5648-4a29-a9dc-8490e0219fb9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:14.375332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44eab4f3-5648-4a29-a9dc-8490e0219fb9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:14.408110 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c45d1ff2-605c-4786-b4e5-cf8ce4890025 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.072443 Jul 20 04:37:14.409853 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2219/4213] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:37:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:37:14.421147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-35184b99-f0ee-472e-9b58-98393af10a75 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:14.423414 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35184b99-f0ee-472e-9b58-98393af10a75 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:14.683165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-35184b99-f0ee-472e-9b58-98393af10a75 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:14.692369 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-35184b99-f0ee-472e-9b58-98393af10a75 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 200 len: 1215 microversion: 2.1 time: 0.276314 Jul 20 04:37:14.703540 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2220/4214] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:14 2022] GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 1215 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:14.717667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fa1a5222-89a2-43b9-966e-f09e0b97803d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:14.718593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fa1a5222-89a2-43b9-966e-f09e0b97803d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:14.761659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa1a5222-89a2-43b9-966e-f09e0b97803d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:14.764164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa1a5222-89a2-43b9-966e-f09e0b97803d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:14.765189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa1a5222-89a2-43b9-966e-f09e0b97803d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:14.771375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa1a5222-89a2-43b9-966e-f09e0b97803d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:15.310969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fa1a5222-89a2-43b9-966e-f09e0b97803d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:15.326802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fa1a5222-89a2-43b9-966e-f09e0b97803d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:15.330221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fa1a5222-89a2-43b9-966e-f09e0b97803d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:15.332173 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fa1a5222-89a2-43b9-966e-f09e0b97803d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1738 microversion: 2.20 time: 0.627184 Jul 20 04:37:15.333893 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2221/4215] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:14 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1738 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:15.512957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-44eab4f3-5648-4a29-a9dc-8490e0219fb9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:15.525323 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-44eab4f3-5648-4a29-a9dc-8490e0219fb9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1507 microversion: 2.1 time: 1.187807 Jul 20 04:37:15.526330 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1995/4216] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:14 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1507 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:15.722460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ec52f68e-0810-4ce6-8818-8a757e6f7ddb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:15.723120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ec52f68e-0810-4ce6-8818-8a757e6f7ddb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:15.743807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec52f68e-0810-4ce6-8818-8a757e6f7ddb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:15.746376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec52f68e-0810-4ce6-8818-8a757e6f7ddb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:15.759154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec52f68e-0810-4ce6-8818-8a757e6f7ddb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:15.761359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec52f68e-0810-4ce6-8818-8a757e6f7ddb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:15.980515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ec52f68e-0810-4ce6-8818-8a757e6f7ddb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:16.002150 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ec52f68e-0810-4ce6-8818-8a757e6f7ddb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 200 len: 1219 microversion: 2.1 time: 0.284973 Jul 20 04:37:16.005183 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2222/4217] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:15 2022] GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 1219 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:16.353063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d35d0821-faaf-4382-9c6d-0ee11a4c5869 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:16.354719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d35d0821-faaf-4382-9c6d-0ee11a4c5869 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:16.377264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=98 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:16.385795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d35d0821-faaf-4382-9c6d-0ee11a4c5869 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:16.386586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d35d0821-faaf-4382-9c6d-0ee11a4c5869 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:16.389182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d35d0821-faaf-4382-9c6d-0ee11a4c5869 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:16.392461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d35d0821-faaf-4382-9c6d-0ee11a4c5869 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:16.546864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-209c4016-88f5-4032-a91c-3878e5905d33 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:16.547917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-209c4016-88f5-4032-a91c-3878e5905d33 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:16.569409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-209c4016-88f5-4032-a91c-3878e5905d33 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:16.570023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-209c4016-88f5-4032-a91c-3878e5905d33 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:16.573365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-209c4016-88f5-4032-a91c-3878e5905d33 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:16.573824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-209c4016-88f5-4032-a91c-3878e5905d33 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:17.172297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-209c4016-88f5-4032-a91c-3878e5905d33 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:17.190659 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-209c4016-88f5-4032-a91c-3878e5905d33 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1507 microversion: 2.1 time: 0.649518 Jul 20 04:37:17.191267 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2223/4218] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:16 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1507 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:17.214538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-25bf8994-4d3c-42a2-93d6-0da605f38828 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:17.215852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-25bf8994-4d3c-42a2-93d6-0da605f38828 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:17.276155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-25bf8994-4d3c-42a2-93d6-0da605f38828 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:17.289110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-25bf8994-4d3c-42a2-93d6-0da605f38828 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:17.301058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-25bf8994-4d3c-42a2-93d6-0da605f38828 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:17.306994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-25bf8994-4d3c-42a2-93d6-0da605f38828 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:17.410898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d35d0821-faaf-4382-9c6d-0ee11a4c5869 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:17.448885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d35d0821-faaf-4382-9c6d-0ee11a4c5869 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:17.469011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d35d0821-faaf-4382-9c6d-0ee11a4c5869 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:17.470300 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d35d0821-faaf-4382-9c6d-0ee11a4c5869 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1738 microversion: 2.20 time: 1.122777 Jul 20 04:37:17.491772 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1996/4219] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:16 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1738 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:17.537493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-25bf8994-4d3c-42a2-93d6-0da605f38828 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:17.559841 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-25bf8994-4d3c-42a2-93d6-0da605f38828 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 200 len: 1267 microversion: 2.1 time: 0.357584 Jul 20 04:37:17.560724 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2224/4220] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:17 2022] GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 1267 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:18.219753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-023e4523-5077-4f66-82ab-4687ab75fca9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:18.220818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-023e4523-5077-4f66-82ab-4687ab75fca9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:18.245969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-023e4523-5077-4f66-82ab-4687ab75fca9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:18.248947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-023e4523-5077-4f66-82ab-4687ab75fca9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:18.276816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-023e4523-5077-4f66-82ab-4687ab75fca9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:18.278229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-023e4523-5077-4f66-82ab-4687ab75fca9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:18.508010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c39fc67b-b4f8-4522-ae1a-709193622059 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:18.510956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c39fc67b-b4f8-4522-ae1a-709193622059 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:18.528326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c39fc67b-b4f8-4522-ae1a-709193622059 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:18.530813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c39fc67b-b4f8-4522-ae1a-709193622059 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:18.533048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c39fc67b-b4f8-4522-ae1a-709193622059 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:18.534561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c39fc67b-b4f8-4522-ae1a-709193622059 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:19.014921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-023e4523-5077-4f66-82ab-4687ab75fca9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:19.045955 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-023e4523-5077-4f66-82ab-4687ab75fca9 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1507 microversion: 2.1 time: 0.834322 Jul 20 04:37:19.049514 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1997/4221] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:18 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1507 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:19.067273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3a4ac91b-f6d6-40f6-83ae-f058d5919db3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:19.069812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3a4ac91b-f6d6-40f6-83ae-f058d5919db3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:19.085500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a4ac91b-f6d6-40f6-83ae-f058d5919db3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:19.085955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a4ac91b-f6d6-40f6-83ae-f058d5919db3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:19.089059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a4ac91b-f6d6-40f6-83ae-f058d5919db3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:19.092435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a4ac91b-f6d6-40f6-83ae-f058d5919db3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:19.490993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3a4ac91b-f6d6-40f6-83ae-f058d5919db3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:19.523541 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3a4ac91b-f6d6-40f6-83ae-f058d5919db3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 200 len: 1273 microversion: 2.1 time: 0.472541 Jul 20 04:37:19.530504 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1998/4222] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:19 2022] GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 1273 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:19.882103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c39fc67b-b4f8-4522-ae1a-709193622059 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:19.896649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c39fc67b-b4f8-4522-ae1a-709193622059 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:19.907403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c39fc67b-b4f8-4522-ae1a-709193622059 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:19.918122 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c39fc67b-b4f8-4522-ae1a-709193622059 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1738 microversion: 2.20 time: 1.418425 Jul 20 04:37:19.924026 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2225/4223] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:18 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1738 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:20.109485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e8b76cf0-9ca8-4afd-9b59-59d9bc0e2f40 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:20.110915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e8b76cf0-9ca8-4afd-9b59-59d9bc0e2f40 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:20.168771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8b76cf0-9ca8-4afd-9b59-59d9bc0e2f40 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.177008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8b76cf0-9ca8-4afd-9b59-59d9bc0e2f40 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.179710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8b76cf0-9ca8-4afd-9b59-59d9bc0e2f40 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.196092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8b76cf0-9ca8-4afd-9b59-59d9bc0e2f40 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.556093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e6d7db1d-20a7-483f-a348-2fbff990c409 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:20.557149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e6d7db1d-20a7-483f-a348-2fbff990c409 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:20.574445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6d7db1d-20a7-483f-a348-2fbff990c409 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.594290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6d7db1d-20a7-483f-a348-2fbff990c409 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.599538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6d7db1d-20a7-483f-a348-2fbff990c409 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.602146 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6d7db1d-20a7-483f-a348-2fbff990c409 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.743301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e8b76cf0-9ca8-4afd-9b59-59d9bc0e2f40 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:20.789372 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e8b76cf0-9ca8-4afd-9b59-59d9bc0e2f40 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1511 microversion: 2.1 time: 0.725799 Jul 20 04:37:20.801130 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1999/4224] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:20 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1511 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:20.841279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7321dec5-87f0-4577-9d14-960a060f0c83 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:20.844829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7321dec5-87f0-4577-9d14-960a060f0c83 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:20.845542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.compute.servers [None req-7321dec5-87f0-4577-9d14-960a060f0c83 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Removing options 'limit' from query {{(pid=127870) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:37:20.846686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7321dec5-87f0-4577-9d14-960a060f0c83 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:20.848126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7321dec5-87f0-4577-9d14-960a060f0c83 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.848864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7321dec5-87f0-4577-9d14-960a060f0c83 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.849850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7321dec5-87f0-4577-9d14-960a060f0c83 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.851066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7321dec5-87f0-4577-9d14-960a060f0c83 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.853024 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7321dec5-87f0-4577-9d14-960a060f0c83 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.015977 Jul 20 04:37:20.862403 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2000/4225] 10.222.0.17 () {58 vars in 1139 bytes} [Wed Jul 20 04:37:20 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:37:20.867455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-81dd7717-42a9-4bee-a2ff-22e714e208a6 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:20.868707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-81dd7717-42a9-4bee-a2ff-22e714e208a6 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:20.882675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81dd7717-42a9-4bee-a2ff-22e714e208a6 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.888863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81dd7717-42a9-4bee-a2ff-22e714e208a6 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.891621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81dd7717-42a9-4bee-a2ff-22e714e208a6 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.894264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81dd7717-42a9-4bee-a2ff-22e714e208a6 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:21.413815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-81dd7717-42a9-4bee-a2ff-22e714e208a6 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:21.439672 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-81dd7717-42a9-4bee-a2ff-22e714e208a6 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1511 microversion: 2.1 time: 0.575774 Jul 20 04:37:21.443766 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2001/4226] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:20 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1511 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:21.481928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-87c12f78-da06-4f4a-aa68-25eea8c0093b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:21.489862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-87c12f78-da06-4f4a-aa68-25eea8c0093b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:21.508541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87c12f78-da06-4f4a-aa68-25eea8c0093b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:21.509978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87c12f78-da06-4f4a-aa68-25eea8c0093b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:21.519682 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87c12f78-da06-4f4a-aa68-25eea8c0093b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:21.524956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87c12f78-da06-4f4a-aa68-25eea8c0093b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:21.682097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e6d7db1d-20a7-483f-a348-2fbff990c409 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:21.692062 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e6d7db1d-20a7-483f-a348-2fbff990c409 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 200 len: 1315 microversion: 2.1 time: 1.141519 Jul 20 04:37:21.698820 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2226/4227] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:20 2022] GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 1315 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:21.708189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1db38ff5-2836-4d79-bcb1-35d30fbdc077 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:21.710892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1db38ff5-2836-4d79-bcb1-35d30fbdc077 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 2c2adc32-835f-427a-89df-e95652a204a3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:21.726889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1db38ff5-2836-4d79-bcb1-35d30fbdc077 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:21.728725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1db38ff5-2836-4d79-bcb1-35d30fbdc077 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:21.735730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1db38ff5-2836-4d79-bcb1-35d30fbdc077 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:21.736581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1db38ff5-2836-4d79-bcb1-35d30fbdc077 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:21.999484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-87c12f78-da06-4f4a-aa68-25eea8c0093b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:22.012788 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-87c12f78-da06-4f4a-aa68-25eea8c0093b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:22.015132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-87c12f78-da06-4f4a-aa68-25eea8c0093b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:22.017535 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-87c12f78-da06-4f4a-aa68-25eea8c0093b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1738 microversion: 2.20 time: 0.570539 Jul 20 04:37:22.020881 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2002/4228] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:21 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1738 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:22.094095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1db38ff5-2836-4d79-bcb1-35d30fbdc077 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:22.112915 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1db38ff5-2836-4d79-bcb1-35d30fbdc077 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3" status: 200 len: 1511 microversion: 2.1 time: 0.412444 Jul 20 04:37:22.131521 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2227/4229] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:21 2022] GET /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3 => generated 1511 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:22.175472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-00f9b83a-f608-4b18-b48d-5b8f2a298208 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:22.176467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-00f9b83a-f608-4b18-b48d-5b8f2a298208 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:22.247127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00f9b83a-f608-4b18-b48d-5b8f2a298208 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:22.251754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00f9b83a-f608-4b18-b48d-5b8f2a298208 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:22.262200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00f9b83a-f608-4b18-b48d-5b8f2a298208 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:22.268983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00f9b83a-f608-4b18-b48d-5b8f2a298208 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:22.678856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-921e050a-5257-47d4-97e3-b273ca7c3b3a req-56a67179-357d-43b2-a8a9-2b5bd1014b06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dacbcd87-fd28-463e-9e12-a7bba0abc6e1", "tag": "05874080-7d7d-40e2-b20c-755898c73f17"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:22.702559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-921e050a-5257-47d4-97e3-b273ca7c3b3a req-56a67179-357d-43b2-a8a9-2b5bd1014b06 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:22.719174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-00f9b83a-f608-4b18-b48d-5b8f2a298208 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:22.733393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-921e050a-5257-47d4-97e3-b273ca7c3b3a req-56a67179-357d-43b2-a8a9-2b5bd1014b06 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:22.737892 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-00f9b83a-f608-4b18-b48d-5b8f2a298208 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1510 microversion: 2.1 time: 0.608578 Jul 20 04:37:22.740881 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2003/4230] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:22 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1510 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:22.750433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-72a51bae-4667-461e-b9a1-c5d45117afae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:22.751507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-72a51bae-4667-461e-b9a1-c5d45117afae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:22.763751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-72a51bae-4667-461e-b9a1-c5d45117afae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:22.764579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-72a51bae-4667-461e-b9a1-c5d45117afae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:22.765884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-72a51bae-4667-461e-b9a1-c5d45117afae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:22.766583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-72a51bae-4667-461e-b9a1-c5d45117afae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:22.821646 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-921e050a-5257-47d4-97e3-b273ca7c3b3a req-56a67179-357d-43b2-a8a9-2b5bd1014b06 service nova] Creating event network-changed:05874080-7d7d-40e2-b20c-755898c73f17 for instance dacbcd87-fd28-463e-9e12-a7bba0abc6e1 on n-h1-826526-5 Jul 20 04:37:22.853984 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-921e050a-5257-47d4-97e3-b273ca7c3b3a req-56a67179-357d-43b2-a8a9-2b5bd1014b06 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179184 Jul 20 04:37:22.857656 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2228/4231] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:37:22.880772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-70de8708-2922-4d87-9284-a131f760f1b5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:22.891158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-70de8708-2922-4d87-9284-a131f760f1b5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:22.893348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-70de8708-2922-4d87-9284-a131f760f1b5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:23.127948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-72a51bae-4667-461e-b9a1-c5d45117afae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:23.137133 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-72a51bae-4667-461e-b9a1-c5d45117afae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 200 len: 1315 microversion: 2.1 time: 0.393540 Jul 20 04:37:23.145842 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2004/4232] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:22 2022] GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:23.164107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d313e198-3348-48fd-bd2a-1a5df88b3cf1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:23.165228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d313e198-3348-48fd-bd2a-1a5df88b3cf1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:23.199227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d313e198-3348-48fd-bd2a-1a5df88b3cf1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:23.199704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d313e198-3348-48fd-bd2a-1a5df88b3cf1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:23.200516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d313e198-3348-48fd-bd2a-1a5df88b3cf1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:23.205836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d313e198-3348-48fd-bd2a-1a5df88b3cf1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:23.221033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:23.406678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70de8708-2922-4d87-9284-a131f760f1b5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:23.410561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70de8708-2922-4d87-9284-a131f760f1b5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:23.411808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70de8708-2922-4d87-9284-a131f760f1b5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:23.418135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70de8708-2922-4d87-9284-a131f760f1b5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:23.568454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d313e198-3348-48fd-bd2a-1a5df88b3cf1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:23.604947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d313e198-3348-48fd-bd2a-1a5df88b3cf1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:23.613353 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d313e198-3348-48fd-bd2a-1a5df88b3cf1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:23.620112 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d313e198-3348-48fd-bd2a-1a5df88b3cf1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1738 microversion: 2.20 time: 0.469575 Jul 20 04:37:23.632525 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2005/4233] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:23 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1738 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:23.786522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-70de8708-2922-4d87-9284-a131f760f1b5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:37:23.965267 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-70de8708-2922-4d87-9284-a131f760f1b5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 1.091954 Jul 20 04:37:23.967768 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2229/4234] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Jul 20 04:37:22 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:23.994214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c24ab1cd-6711-4ce8-a586-73c80137808c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:23.994504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a11fcc12-5656-4a2f-a468-ef744ad56e08 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:23.994984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a11fcc12-5656-4a2f-a468-ef744ad56e08 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:23.997511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c24ab1cd-6711-4ce8-a586-73c80137808c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:24.002258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:24.008552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a11fcc12-5656-4a2f-a468-ef744ad56e08 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:24.010041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a11fcc12-5656-4a2f-a468-ef744ad56e08 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:24.010041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a11fcc12-5656-4a2f-a468-ef744ad56e08 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:24.010499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a11fcc12-5656-4a2f-a468-ef744ad56e08 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:24.028591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c24ab1cd-6711-4ce8-a586-73c80137808c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:24.029902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c24ab1cd-6711-4ce8-a586-73c80137808c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:24.034161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c24ab1cd-6711-4ce8-a586-73c80137808c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:24.038556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c24ab1cd-6711-4ce8-a586-73c80137808c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:24.081537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:24.178520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-c24ab1cd-6711-4ce8-a586-73c80137808c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lazy-loading 'services' on Instance uuid 3feb0068-8615-4241-ae94-33f175a3d7f8 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:37:24.320530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a11fcc12-5656-4a2f-a468-ef744ad56e08 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:24.342260 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a11fcc12-5656-4a2f-a468-ef744ad56e08 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1511 microversion: 2.1 time: 0.351817 Jul 20 04:37:24.354412 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2006/4235] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:23 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1511 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:24.362168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-74d2cf69-0698-4caf-a8d7-e4f3350d787d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:24.362684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-74d2cf69-0698-4caf-a8d7-e4f3350d787d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:24.365514 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c24ab1cd-6711-4ce8-a586-73c80137808c tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8/os-volume_attachments/72d6a8e1-5953-406d-8082-ebd6970edd67" status: 202 len: 0 microversion: 2.1 time: 0.375375 Jul 20 04:37:24.366434 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2230/4236] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 04:37:23 2022] DELETE /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8/os-volume_attachments/72d6a8e1-5953-406d-8082-ebd6970edd67 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:24.379558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7f8719f0-79f4-4297-8e9e-a8f14382274f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:24.382848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7f8719f0-79f4-4297-8e9e-a8f14382274f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 2c2adc32-835f-427a-89df-e95652a204a3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:24.390208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74d2cf69-0698-4caf-a8d7-e4f3350d787d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:24.391173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74d2cf69-0698-4caf-a8d7-e4f3350d787d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:24.393653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74d2cf69-0698-4caf-a8d7-e4f3350d787d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:24.394349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74d2cf69-0698-4caf-a8d7-e4f3350d787d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:24.403632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f8719f0-79f4-4297-8e9e-a8f14382274f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:24.404554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f8719f0-79f4-4297-8e9e-a8f14382274f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:24.405759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f8719f0-79f4-4297-8e9e-a8f14382274f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:24.406378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f8719f0-79f4-4297-8e9e-a8f14382274f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:24.692986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=8 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:24.700828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-74d2cf69-0698-4caf-a8d7-e4f3350d787d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:24.710193 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-74d2cf69-0698-4caf-a8d7-e4f3350d787d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 200 len: 1315 microversion: 2.1 time: 0.355601 Jul 20 04:37:24.711200 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2007/4237] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:24 2022] GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:24.716159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c4a54f24-0dcf-4588-b415-53820db6b166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:24.716979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c4a54f24-0dcf-4588-b415-53820db6b166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:24.724350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4a54f24-0dcf-4588-b415-53820db6b166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:24.724810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4a54f24-0dcf-4588-b415-53820db6b166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:24.725860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4a54f24-0dcf-4588-b415-53820db6b166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:24.726506 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4a54f24-0dcf-4588-b415-53820db6b166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.134959 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7f8719f0-79f4-4297-8e9e-a8f14382274f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:25.144131 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7f8719f0-79f4-4297-8e9e-a8f14382274f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3" status: 200 len: 1511 microversion: 2.1 time: 0.776219 Jul 20 04:37:25.145406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c4a54f24-0dcf-4588-b415-53820db6b166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:25.146024 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2231/4238] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:24 2022] GET /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3 => generated 1511 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:25.160845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c4a54f24-0dcf-4588-b415-53820db6b166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:25.168977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c4a54f24-0dcf-4588-b415-53820db6b166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:25.170297 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c4a54f24-0dcf-4588-b415-53820db6b166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1738 microversion: 2.20 time: 0.458105 Jul 20 04:37:25.171348 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2008/4239] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:24 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1738 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:25.179048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dbe1bca7-0173-46de-aee0-ddfd6a677b46 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:25.181442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dbe1bca7-0173-46de-aee0-ddfd6a677b46 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:25.209582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbe1bca7-0173-46de-aee0-ddfd6a677b46 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.210052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbe1bca7-0173-46de-aee0-ddfd6a677b46 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.214800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbe1bca7-0173-46de-aee0-ddfd6a677b46 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.215293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbe1bca7-0173-46de-aee0-ddfd6a677b46 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.671017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dbe1bca7-0173-46de-aee0-ddfd6a677b46 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:25.685639 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dbe1bca7-0173-46de-aee0-ddfd6a677b46 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1510 microversion: 2.1 time: 0.526700 Jul 20 04:37:25.688309 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2232/4240] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:25 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1510 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:25.708610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2bb2a081-2ef9-49a8-8134-b09ad4a8cff7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:25.713958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2bb2a081-2ef9-49a8-8134-b09ad4a8cff7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:25.714851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2bb2a081-2ef9-49a8-8134-b09ad4a8cff7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:25.734313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f76ecaae-5ca4-4f1a-920a-bc3cf5ac955b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:25.735403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f76ecaae-5ca4-4f1a-920a-bc3cf5ac955b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:25.740455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bb2a081-2ef9-49a8-8134-b09ad4a8cff7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.750125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bb2a081-2ef9-49a8-8134-b09ad4a8cff7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.751156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bb2a081-2ef9-49a8-8134-b09ad4a8cff7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.753161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bb2a081-2ef9-49a8-8134-b09ad4a8cff7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.760700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f76ecaae-5ca4-4f1a-920a-bc3cf5ac955b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.763248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f76ecaae-5ca4-4f1a-920a-bc3cf5ac955b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.764354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f76ecaae-5ca4-4f1a-920a-bc3cf5ac955b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.765335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f76ecaae-5ca4-4f1a-920a-bc3cf5ac955b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.843206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-2bb2a081-2ef9-49a8-8134-b09ad4a8cff7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:37:25.939761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2bb2a081-2ef9-49a8-8134-b09ad4a8cff7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:25.960927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bb2a081-2ef9-49a8-8134-b09ad4a8cff7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.961385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bb2a081-2ef9-49a8-8134-b09ad4a8cff7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:26.281293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f76ecaae-5ca4-4f1a-920a-bc3cf5ac955b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:26.314206 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f76ecaae-5ca4-4f1a-920a-bc3cf5ac955b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 200 len: 1315 microversion: 2.1 time: 0.586213 Jul 20 04:37:26.331242 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2233/4241] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:25 2022] GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:26.331828 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2bb2a081-2ef9-49a8-8134-b09ad4a8cff7 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.630148 Jul 20 04:37:26.338185 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2009/4242] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:37:25 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:26.343856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-738ee714-fb20-4e97-bb45-237524b7bff1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:26.347158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-738ee714-fb20-4e97-bb45-237524b7bff1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:26.354827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-49fe4827-5bdb-4719-9e91-a2d2416451ad tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:26.356886 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-738ee714-fb20-4e97-bb45-237524b7bff1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:26.358012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-738ee714-fb20-4e97-bb45-237524b7bff1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:26.359328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-738ee714-fb20-4e97-bb45-237524b7bff1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:26.360201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-738ee714-fb20-4e97-bb45-237524b7bff1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:26.362489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-49fe4827-5bdb-4719-9e91-a2d2416451ad tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:26.363720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-49fe4827-5bdb-4719-9e91-a2d2416451ad tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:26.725090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49fe4827-5bdb-4719-9e91-a2d2416451ad tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:26.726523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49fe4827-5bdb-4719-9e91-a2d2416451ad tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:26.728697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49fe4827-5bdb-4719-9e91-a2d2416451ad tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:26.729724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49fe4827-5bdb-4719-9e91-a2d2416451ad tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:26.982424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-738ee714-fb20-4e97-bb45-237524b7bff1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:26.994075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-738ee714-fb20-4e97-bb45-237524b7bff1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:26.995709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-738ee714-fb20-4e97-bb45-237524b7bff1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:26.999695 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-738ee714-fb20-4e97-bb45-237524b7bff1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1738 microversion: 2.20 time: 0.665574 Jul 20 04:37:27.002825 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2234/4243] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:26 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1738 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:27.028436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-49fe4827-5bdb-4719-9e91-a2d2416451ad tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:37:27.195318 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-49fe4827-5bdb-4719-9e91-a2d2416451ad tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.844291 Jul 20 04:37:27.197211 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2010/4244] 10.222.0.17 () {58 vars in 1149 bytes} [Wed Jul 20 04:37:26 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:27.218815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-23cc9d9a-67fc-44fa-a6b0-b23ce5db4b2f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:27.233636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-23cc9d9a-67fc-44fa-a6b0-b23ce5db4b2f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:27.234711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-23cc9d9a-67fc-44fa-a6b0-b23ce5db4b2f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:27.241224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-23cc9d9a-67fc-44fa-a6b0-b23ce5db4b2f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.241950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-23cc9d9a-67fc-44fa-a6b0-b23ce5db4b2f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.244311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-23cc9d9a-67fc-44fa-a6b0-b23ce5db4b2f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.248074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-23cc9d9a-67fc-44fa-a6b0-b23ce5db4b2f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.344382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4b8c5067-0d2b-4a54-b52a-b40ff558ee51 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:27.346127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4b8c5067-0d2b-4a54-b52a-b40ff558ee51 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:27.365463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b8c5067-0d2b-4a54-b52a-b40ff558ee51 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.371738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b8c5067-0d2b-4a54-b52a-b40ff558ee51 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.376918 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b8c5067-0d2b-4a54-b52a-b40ff558ee51 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.380642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b8c5067-0d2b-4a54-b52a-b40ff558ee51 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.566024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-23cc9d9a-67fc-44fa-a6b0-b23ce5db4b2f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:37:27.767283 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4b8c5067-0d2b-4a54-b52a-b40ff558ee51 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:27.783876 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4b8c5067-0d2b-4a54-b52a-b40ff558ee51 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 200 len: 1315 microversion: 2.1 time: 0.448245 Jul 20 04:37:27.797519 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-23cc9d9a-67fc-44fa-a6b0-b23ce5db4b2f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.580027 Jul 20 04:37:27.799042 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2011/4245] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:27 2022] GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:27.800712 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2235/4246] 10.222.0.17 () {58 vars in 1211 bytes} [Wed Jul 20 04:37:27 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:27.831698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2cb727cb-60cf-4b8b-866e-c772e3b91523 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:27.840446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2cb727cb-60cf-4b8b-866e-c772e3b91523 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:27.864819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2cb727cb-60cf-4b8b-866e-c772e3b91523 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:27.894747 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cb727cb-60cf-4b8b-866e-c772e3b91523 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.895879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cb727cb-60cf-4b8b-866e-c772e3b91523 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.899627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cb727cb-60cf-4b8b-866e-c772e3b91523 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.912442 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cb727cb-60cf-4b8b-866e-c772e3b91523 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.019947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a2b8dd29-9dfe-4f54-be85-707af5c37a1f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:28.020626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a2b8dd29-9dfe-4f54-be85-707af5c37a1f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:28.030610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2b8dd29-9dfe-4f54-be85-707af5c37a1f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.031112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2b8dd29-9dfe-4f54-be85-707af5c37a1f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.032122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2b8dd29-9dfe-4f54-be85-707af5c37a1f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.032610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2b8dd29-9dfe-4f54-be85-707af5c37a1f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.224655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-2cb727cb-60cf-4b8b-866e-c772e3b91523 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:37:28.404014 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2cb727cb-60cf-4b8b-866e-c772e3b91523 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.589616 Jul 20 04:37:28.411005 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2012/4247] 10.222.0.17 () {58 vars in 1195 bytes} [Wed Jul 20 04:37:27 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:28.418961 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-68aadbc7-4e61-42b3-92a7-bf5c7a840c54 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:28.437829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-68aadbc7-4e61-42b3-92a7-bf5c7a840c54 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:28.439712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-68aadbc7-4e61-42b3-92a7-bf5c7a840c54 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'name': '-212067818', 'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:28.459179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68aadbc7-4e61-42b3-92a7-bf5c7a840c54 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.465965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68aadbc7-4e61-42b3-92a7-bf5c7a840c54 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.467296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68aadbc7-4e61-42b3-92a7-bf5c7a840c54 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.467933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68aadbc7-4e61-42b3-92a7-bf5c7a840c54 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.506376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a2b8dd29-9dfe-4f54-be85-707af5c37a1f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:28.522887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a2b8dd29-9dfe-4f54-be85-707af5c37a1f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:28.527235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a2b8dd29-9dfe-4f54-be85-707af5c37a1f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:28.529489 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a2b8dd29-9dfe-4f54-be85-707af5c37a1f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1738 microversion: 2.20 time: 0.514184 Jul 20 04:37:28.530875 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2236/4248] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:28 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1738 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:37:28.698249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-68aadbc7-4e61-42b3-92a7-bf5c7a840c54 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:37:28.806921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f9b8fe04-98fb-4e0f-992e-a96a1626381a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:28.809448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f9b8fe04-98fb-4e0f-992e-a96a1626381a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:28.832489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:28.849762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9b8fe04-98fb-4e0f-992e-a96a1626381a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.850903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9b8fe04-98fb-4e0f-992e-a96a1626381a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.852525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9b8fe04-98fb-4e0f-992e-a96a1626381a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.859245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9b8fe04-98fb-4e0f-992e-a96a1626381a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.863784 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-68aadbc7-4e61-42b3-92a7-bf5c7a840c54 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers?name=-212067818" status: 200 len: 345 microversion: 2.1 time: 0.450348 Jul 20 04:37:28.868028 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2013/4249] 10.222.0.17 () {58 vars in 1155 bytes} [Wed Jul 20 04:37:28 2022] GET /compute/v2.1/servers?name=-212067818 => generated 345 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:37:28.881706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5c3de00d-94a9-4744-b5e6-14ef9feb8e28 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:28.887164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5c3de00d-94a9-4744-b5e6-14ef9feb8e28 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:28.888146 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5c3de00d-94a9-4744-b5e6-14ef9feb8e28 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:28.894828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c3de00d-94a9-4744-b5e6-14ef9feb8e28 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.895591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c3de00d-94a9-4744-b5e6-14ef9feb8e28 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.897332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c3de00d-94a9-4744-b5e6-14ef9feb8e28 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.901938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c3de00d-94a9-4744-b5e6-14ef9feb8e28 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:29.106491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-5c3de00d-94a9-4744-b5e6-14ef9feb8e28 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:37:29.144173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f9b8fe04-98fb-4e0f-992e-a96a1626381a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:29.156226 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f9b8fe04-98fb-4e0f-992e-a96a1626381a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 200 len: 1315 microversion: 2.1 time: 0.355414 Jul 20 04:37:29.157662 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2237/4250] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:28 2022] GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:29.278849 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5c3de00d-94a9-4744-b5e6-14ef9feb8e28 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.401725 Jul 20 04:37:29.281712 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2014/4251] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Jul 20 04:37:28 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:29.292475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-000b0205-ca4e-4930-93f1-e8baae142e82 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:29.299680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-000b0205-ca4e-4930-93f1-e8baae142e82 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:29.301164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-000b0205-ca4e-4930-93f1-e8baae142e82 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-21206781', 'deleted': False, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:29.325440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-000b0205-ca4e-4930-93f1-e8baae142e82 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:29.326207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-000b0205-ca4e-4930-93f1-e8baae142e82 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:29.327490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-000b0205-ca4e-4930-93f1-e8baae142e82 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:29.330693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-000b0205-ca4e-4930-93f1-e8baae142e82 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:29.552162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-000b0205-ca4e-4930-93f1-e8baae142e82 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:37:29.556750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-db9bf0b5-aa75-4174-9037-52d4d4154304 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:29.557746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-db9bf0b5-aa75-4174-9037-52d4d4154304 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:29.573308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db9bf0b5-aa75-4174-9037-52d4d4154304 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:29.574168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db9bf0b5-aa75-4174-9037-52d4d4154304 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:29.575301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db9bf0b5-aa75-4174-9037-52d4d4154304 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:29.575962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db9bf0b5-aa75-4174-9037-52d4d4154304 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:29.664400 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-000b0205-ca4e-4930-93f1-e8baae142e82 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-21206781" status: 200 len: 345 microversion: 2.1 time: 0.376712 Jul 20 04:37:29.678341 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2238/4252] 10.222.0.17 () {58 vars in 1225 bytes} [Wed Jul 20 04:37:29 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-21206781 => generated 345 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:29.691367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1aa2f6e4-0286-4d25-84b6-cb6b29b31e30 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:29.694465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1aa2f6e4-0286-4d25-84b6-cb6b29b31e30 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:29.715624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1aa2f6e4-0286-4d25-84b6-cb6b29b31e30 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:29.720328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1aa2f6e4-0286-4d25-84b6-cb6b29b31e30 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:29.723816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1aa2f6e4-0286-4d25-84b6-cb6b29b31e30 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:29.727274 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1aa2f6e4-0286-4d25-84b6-cb6b29b31e30 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:29.816666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1aa2f6e4-0286-4d25-84b6-cb6b29b31e30 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:37:29.922972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-db9bf0b5-aa75-4174-9037-52d4d4154304 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:29.942563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-db9bf0b5-aa75-4174-9037-52d4d4154304 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:29.944223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-db9bf0b5-aa75-4174-9037-52d4d4154304 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:29.945480 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-db9bf0b5-aa75-4174-9037-52d4d4154304 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1738 microversion: 2.20 time: 0.396969 Jul 20 04:37:29.946060 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2015/4253] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:29 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1738 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:37:30.055663 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1aa2f6e4-0286-4d25-84b6-cb6b29b31e30 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 204 len: 0 microversion: 2.1 time: 0.365890 Jul 20 04:37:30.057631 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2239/4254] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:37:29 2022] DELETE /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:37:30.067285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-79a9e499-e6ed-4d71-b4c9-4ff60ff8e81e tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:30.068187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-79a9e499-e6ed-4d71-b4c9-4ff60ff8e81e tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:30.081451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79a9e499-e6ed-4d71-b4c9-4ff60ff8e81e tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.082933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79a9e499-e6ed-4d71-b4c9-4ff60ff8e81e tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:30.083975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79a9e499-e6ed-4d71-b4c9-4ff60ff8e81e tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.085001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79a9e499-e6ed-4d71-b4c9-4ff60ff8e81e tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:30.178366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9cb8ff25-f33d-40aa-80e9-8ec2607a0f6e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:30.179148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9cb8ff25-f33d-40aa-80e9-8ec2607a0f6e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:30.186293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9cb8ff25-f33d-40aa-80e9-8ec2607a0f6e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.187236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9cb8ff25-f33d-40aa-80e9-8ec2607a0f6e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:30.188410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9cb8ff25-f33d-40aa-80e9-8ec2607a0f6e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.189013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9cb8ff25-f33d-40aa-80e9-8ec2607a0f6e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:30.344394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-79a9e499-e6ed-4d71-b4c9-4ff60ff8e81e tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:30.363174 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-79a9e499-e6ed-4d71-b4c9-4ff60ff8e81e tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1516 microversion: 2.1 time: 0.299660 Jul 20 04:37:30.368065 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2016/4255] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:30 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1516 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:30.380799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9cb8ff25-f33d-40aa-80e9-8ec2607a0f6e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:30.411364 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9cb8ff25-f33d-40aa-80e9-8ec2607a0f6e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 200 len: 1315 microversion: 2.1 time: 0.238273 Jul 20 04:37:30.412532 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2240/4256] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:30 2022] GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:30.502204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-af79b471-9563-49b2-8cc4-3d7bd51fea42 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:30.502979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-af79b471-9563-49b2-8cc4-3d7bd51fea42 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:30.529339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af79b471-9563-49b2-8cc4-3d7bd51fea42 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.530362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af79b471-9563-49b2-8cc4-3d7bd51fea42 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:30.532946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af79b471-9563-49b2-8cc4-3d7bd51fea42 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.534699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af79b471-9563-49b2-8cc4-3d7bd51fea42 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:30.720754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-8148bd30-76d8-4007-bf37-d7533164db61 req-925a94e2-afc0-42c9-af74-4ac9a2d3c1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dacbcd87-fd28-463e-9e12-a7bba0abc6e1", "name": "network-vif-plugged", "status": "completed", "tag": "05874080-7d7d-40e2-b20c-755898c73f17"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:30.737936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8148bd30-76d8-4007-bf37-d7533164db61 req-925a94e2-afc0-42c9-af74-4ac9a2d3c1eb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.738398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8148bd30-76d8-4007-bf37-d7533164db61 req-925a94e2-afc0-42c9-af74-4ac9a2d3c1eb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:30.768454 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-8148bd30-76d8-4007-bf37-d7533164db61 req-925a94e2-afc0-42c9-af74-4ac9a2d3c1eb service nova] Creating event network-vif-plugged:05874080-7d7d-40e2-b20c-755898c73f17 for instance dacbcd87-fd28-463e-9e12-a7bba0abc6e1 on n-h1-826526-5 Jul 20 04:37:30.773831 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-8148bd30-76d8-4007-bf37-d7533164db61 req-925a94e2-afc0-42c9-af74-4ac9a2d3c1eb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060143 Jul 20 04:37:30.775605 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2241/4257] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:30.781007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-af79b471-9563-49b2-8cc4-3d7bd51fea42 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lazy-loading 'services' on Instance uuid 1b99493a-f245-4470-ae4f-a36b41b59989 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:37:30.917601 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-af79b471-9563-49b2-8cc4-3d7bd51fea42 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989/os-volume_attachments/84742c70-d6bf-4422-8bf1-956972245130" status: 202 len: 0 microversion: 2.1 time: 0.420333 Jul 20 04:37:30.919462 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2017/4258] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 04:37:30 2022] DELETE /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989/os-volume_attachments/84742c70-d6bf-4422-8bf1-956972245130 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:30.976545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-62c2f846-1eba-448c-bf16-796d2d1c86c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:30.978100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-62c2f846-1eba-448c-bf16-796d2d1c86c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:30.987187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62c2f846-1eba-448c-bf16-796d2d1c86c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.988196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62c2f846-1eba-448c-bf16-796d2d1c86c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:30.989643 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62c2f846-1eba-448c-bf16-796d2d1c86c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.990993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62c2f846-1eba-448c-bf16-796d2d1c86c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:31.305010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-62c2f846-1eba-448c-bf16-796d2d1c86c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:31.320092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-62c2f846-1eba-448c-bf16-796d2d1c86c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:31.322548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-62c2f846-1eba-448c-bf16-796d2d1c86c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:31.324138 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-62c2f846-1eba-448c-bf16-796d2d1c86c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1738 microversion: 2.20 time: 0.361519 Jul 20 04:37:31.325462 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2242/4259] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:30 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1738 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:31.405529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a27c8e05-b5d9-4e0f-8ee2-57415f16676f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:31.406764 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a27c8e05-b5d9-4e0f-8ee2-57415f16676f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:31.421455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a27c8e05-b5d9-4e0f-8ee2-57415f16676f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:31.422579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a27c8e05-b5d9-4e0f-8ee2-57415f16676f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:31.423846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a27c8e05-b5d9-4e0f-8ee2-57415f16676f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:31.425921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a27c8e05-b5d9-4e0f-8ee2-57415f16676f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:31.444751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fb9b1df0-6bfd-4713-93a0-84ff1572b17a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:31.445866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fb9b1df0-6bfd-4713-93a0-84ff1572b17a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:31.458374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb9b1df0-6bfd-4713-93a0-84ff1572b17a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:31.459808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb9b1df0-6bfd-4713-93a0-84ff1572b17a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:31.463620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb9b1df0-6bfd-4713-93a0-84ff1572b17a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:31.470107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb9b1df0-6bfd-4713-93a0-84ff1572b17a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:31.829191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a27c8e05-b5d9-4e0f-8ee2-57415f16676f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:31.843083 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a27c8e05-b5d9-4e0f-8ee2-57415f16676f tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1516 microversion: 2.1 time: 0.441094 Jul 20 04:37:31.846063 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2018/4260] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:31 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1516 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:31.921478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fb9b1df0-6bfd-4713-93a0-84ff1572b17a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:31.933563 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fb9b1df0-6bfd-4713-93a0-84ff1572b17a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 200 len: 1315 microversion: 2.1 time: 0.493973 Jul 20 04:37:31.934727 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2243/4261] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:31 2022] GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:32.352807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-60777abe-3b26-4177-bc67-f3fd07c61c14 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:32.353768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-60777abe-3b26-4177-bc67-f3fd07c61c14 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:32.360331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-60777abe-3b26-4177-bc67-f3fd07c61c14 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:32.360843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-60777abe-3b26-4177-bc67-f3fd07c61c14 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:32.361634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-60777abe-3b26-4177-bc67-f3fd07c61c14 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:32.362316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-60777abe-3b26-4177-bc67-f3fd07c61c14 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:32.378694 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:32.512036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-60777abe-3b26-4177-bc67-f3fd07c61c14 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:32.525046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-60777abe-3b26-4177-bc67-f3fd07c61c14 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:32.527157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-60777abe-3b26-4177-bc67-f3fd07c61c14 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:32.529380 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-60777abe-3b26-4177-bc67-f3fd07c61c14 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1738 microversion: 2.20 time: 0.180645 Jul 20 04:37:32.530827 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2019/4262] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:32 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:32.809175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-3354bd49-45e1-43eb-bcd2-96f38a10a147 req-356d4e89-1078-4469-b7bc-f16cade3ad58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd93ad5b-3aba-4a42-8b3d-4220e88bb810", "name": "network-vif-deleted", "tag": "d96d8269-9882-4f7a-9157-4229a2fbfb80"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:32.822420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3354bd49-45e1-43eb-bcd2-96f38a10a147 req-356d4e89-1078-4469-b7bc-f16cade3ad58 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:32.823347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3354bd49-45e1-43eb-bcd2-96f38a10a147 req-356d4e89-1078-4469-b7bc-f16cade3ad58 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:32.849244 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-3354bd49-45e1-43eb-bcd2-96f38a10a147 req-356d4e89-1078-4469-b7bc-f16cade3ad58 service nova] Creating event network-vif-deleted:d96d8269-9882-4f7a-9157-4229a2fbfb80 for instance bd93ad5b-3aba-4a42-8b3d-4220e88bb810 on n-h1-826526-5 Jul 20 04:37:32.858713 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-3354bd49-45e1-43eb-bcd2-96f38a10a147 req-356d4e89-1078-4469-b7bc-f16cade3ad58 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053042 Jul 20 04:37:32.859465 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2244/4263] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:32.870827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6c11e0cf-953b-4a9e-a803-a552e4bd3d52 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:32.872076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6c11e0cf-953b-4a9e-a803-a552e4bd3d52 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:32.884588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c11e0cf-953b-4a9e-a803-a552e4bd3d52 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:32.888468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c11e0cf-953b-4a9e-a803-a552e4bd3d52 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:32.891795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c11e0cf-953b-4a9e-a803-a552e4bd3d52 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:32.894112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c11e0cf-953b-4a9e-a803-a552e4bd3d52 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:32.954313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f6b3a1c1-79a5-4315-81ac-2baa213cedb0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:32.955023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f6b3a1c1-79a5-4315-81ac-2baa213cedb0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:32.971021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f6b3a1c1-79a5-4315-81ac-2baa213cedb0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:32.971479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f6b3a1c1-79a5-4315-81ac-2baa213cedb0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:32.972299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f6b3a1c1-79a5-4315-81ac-2baa213cedb0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:32.972738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f6b3a1c1-79a5-4315-81ac-2baa213cedb0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:33.016945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:33.034006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6c11e0cf-953b-4a9e-a803-a552e4bd3d52 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:33.055063 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6c11e0cf-953b-4a9e-a803-a552e4bd3d52 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 200 len: 1305 microversion: 2.1 time: 0.188132 Jul 20 04:37:33.056729 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2020/4264] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:32 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 1305 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:33.345227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1189bb29-f748-4060-ab4d-361cb742fcf2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:33.346155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1189bb29-f748-4060-ab4d-361cb742fcf2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:33.357298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1189bb29-f748-4060-ab4d-361cb742fcf2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:33.360746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1189bb29-f748-4060-ab4d-361cb742fcf2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:33.361727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1189bb29-f748-4060-ab4d-361cb742fcf2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:33.363959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1189bb29-f748-4060-ab4d-361cb742fcf2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:33.373207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f6b3a1c1-79a5-4315-81ac-2baa213cedb0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:33.384865 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f6b3a1c1-79a5-4315-81ac-2baa213cedb0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 200 len: 1503 microversion: 2.1 time: 0.434561 Jul 20 04:37:33.387077 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2245/4265] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:32 2022] GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 1503 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:33.404799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d0f50aac-8d20-454f-8b3d-efdd0429c645 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:33.407622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d0f50aac-8d20-454f-8b3d-efdd0429c645 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:33.415840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0f50aac-8d20-454f-8b3d-efdd0429c645 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:33.416613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0f50aac-8d20-454f-8b3d-efdd0429c645 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:33.418174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1189bb29-f748-4060-ab4d-361cb742fcf2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:37:33.418532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0f50aac-8d20-454f-8b3d-efdd0429c645 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:33.419324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0f50aac-8d20-454f-8b3d-efdd0429c645 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:33.470996 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d0f50aac-8d20-454f-8b3d-efdd0429c645 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action" status: 200 len: 14 microversion: 2.1 time: 0.071213 Jul 20 04:37:33.472093 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2246/4266] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:33 2022] POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:37:33.529363 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1189bb29-f748-4060-ab4d-361cb742fcf2 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 204 len: 0 microversion: 2.1 time: 0.187980 Jul 20 04:37:33.530165 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2021/4267] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:37:33 2022] DELETE /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:37:33.539337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a96b54d2-a896-4f91-b301-df9ebfb4b5de tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:33.540039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a96b54d2-a896-4f91-b301-df9ebfb4b5de tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:33.550260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a96b54d2-a896-4f91-b301-df9ebfb4b5de tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:33.551039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a96b54d2-a896-4f91-b301-df9ebfb4b5de tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:33.551828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a96b54d2-a896-4f91-b301-df9ebfb4b5de tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:33.552278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a96b54d2-a896-4f91-b301-df9ebfb4b5de tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:33.554054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a1b7e2fc-2f4c-4e2c-b762-2d4f334cf1fa tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:33.555402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a1b7e2fc-2f4c-4e2c-b762-2d4f334cf1fa tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:33.562880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1b7e2fc-2f4c-4e2c-b762-2d4f334cf1fa tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:33.563935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1b7e2fc-2f4c-4e2c-b762-2d4f334cf1fa tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:33.565230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1b7e2fc-2f4c-4e2c-b762-2d4f334cf1fa tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:33.566169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1b7e2fc-2f4c-4e2c-b762-2d4f334cf1fa tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:33.718389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a1b7e2fc-2f4c-4e2c-b762-2d4f334cf1fa tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:33.726782 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a1b7e2fc-2f4c-4e2c-b762-2d4f334cf1fa tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:33.729773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a1b7e2fc-2f4c-4e2c-b762-2d4f334cf1fa tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:33.729773 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a1b7e2fc-2f4c-4e2c-b762-2d4f334cf1fa tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1720 microversion: 2.20 time: 0.182988 Jul 20 04:37:33.737074 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2022/4268] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:33 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:33.737659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a96b54d2-a896-4f91-b301-df9ebfb4b5de tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:33.746928 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a96b54d2-a896-4f91-b301-df9ebfb4b5de tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1514 microversion: 2.1 time: 0.212150 Jul 20 04:37:33.747735 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2247/4269] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:33 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1514 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:34.079450 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-487db2e4-a514-4ab6-bd65-c1a59d5cab5a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:34.080177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-487db2e4-a514-4ab6-bd65-c1a59d5cab5a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: bd93ad5b-3aba-4a42-8b3d-4220e88bb810] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:34.090425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-487db2e4-a514-4ab6-bd65-c1a59d5cab5a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.090882 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-487db2e4-a514-4ab6-bd65-c1a59d5cab5a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.091633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-487db2e4-a514-4ab6-bd65-c1a59d5cab5a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.092110 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-487db2e4-a514-4ab6-bd65-c1a59d5cab5a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.106602 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-487db2e4-a514-4ab6-bd65-c1a59d5cab5a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] HTTP exception thrown: Instance bd93ad5b-3aba-4a42-8b3d-4220e88bb810 could not be found. Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-487db2e4-a514-4ab6-bd65-c1a59d5cab5a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Request method failure captured: Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 HTTP/1.1 Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14ZAHWmRz5lRn8u43CXd5Cdv6zk0TnExxIOkWRYUacP3J78ucl_OiWfdowOfR5lL-8f0MCnHYDuQdcaJfR7DX-WRsCXq7m3tmdcDCI-cpAc8BxhNj_a12qjXKWAqrlefROEeLFK-4LCS0j0XOvdCrJQpQCWDTQ_nVCUTl0Vg9XOfdFA Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 3946bd28f7c44d5eb9a550efb7b3ab50 Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ListServerFiltersTestJSON-476592840 Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3946bd28f7c44d5eb9a550efb7b3ab50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3946bd28f7c44d5eb9a550efb7b3ab50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3946bd28f7c44d5eb9a550efb7b3ab50", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3946bd28f7c44d5eb9a550efb7b3ab50"}]}] Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ListServerFiltersTestJSON-476592840 Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 3946bd28f7c44d5eb9a550efb7b3ab50 Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-476592840 Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ListServerFiltersTestJSON-476592840-project Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f3b497b40aed4f41a049781e5c0013d4 Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ListServerFiltersTestJSON-476592840-project Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance bd93ad5b-3aba-4a42-8b3d-4220e88bb810 could not be found. Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'bd93ad5b-3aba-4a42-8b3d-4220e88bb810'} Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd93ad5b-3aba-4a42-8b3d-4220e88bb810 could not be found. Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd93ad5b-3aba-4a42-8b3d-4220e88bb810 could not be found. Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:34.108317 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:37:34.117396 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:34.117396 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:34.117396 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:34.117396 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:34.117396 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:34.117396 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd93ad5b-3aba-4a42-8b3d-4220e88bb810 could not be found. Jul 20 04:37:34.117396 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:37:34.117396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-487db2e4-a514-4ab6-bd65-c1a59d5cab5a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Returning 404 to user: Instance bd93ad5b-3aba-4a42-8b3d-4220e88bb810 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:34.117396 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-487db2e4-a514-4ab6-bd65-c1a59d5cab5a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810" status: 404 len: 111 microversion: 2.1 time: 0.039828 Jul 20 04:37:34.117396 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2023/4270] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:34 2022] GET /compute/v2.1/servers/bd93ad5b-3aba-4a42-8b3d-4220e88bb810 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:37:34.119290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c724d9c9-1697-4925-be23-0b13811787f1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:34.119290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c724d9c9-1697-4925-be23-0b13811787f1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 2c2adc32-835f-427a-89df-e95652a204a3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:34.126506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c724d9c9-1697-4925-be23-0b13811787f1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.126957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c724d9c9-1697-4925-be23-0b13811787f1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.127719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c724d9c9-1697-4925-be23-0b13811787f1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.128152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c724d9c9-1697-4925-be23-0b13811787f1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.154354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c724d9c9-1697-4925-be23-0b13811787f1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 2c2adc32-835f-427a-89df-e95652a204a3] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:37:34.234119 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c724d9c9-1697-4925-be23-0b13811787f1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3" status: 204 len: 0 microversion: 2.1 time: 0.119103 Jul 20 04:37:34.234727 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2248/4271] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:37:34 2022] DELETE /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:37:34.242966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1338f49f-7269-4c9b-a5b7-b9dd2eb1490c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:34.243590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1338f49f-7269-4c9b-a5b7-b9dd2eb1490c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 2c2adc32-835f-427a-89df-e95652a204a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:34.250214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1338f49f-7269-4c9b-a5b7-b9dd2eb1490c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.250679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1338f49f-7269-4c9b-a5b7-b9dd2eb1490c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.251457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1338f49f-7269-4c9b-a5b7-b9dd2eb1490c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.251898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1338f49f-7269-4c9b-a5b7-b9dd2eb1490c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.402616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1338f49f-7269-4c9b-a5b7-b9dd2eb1490c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:34.411605 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1338f49f-7269-4c9b-a5b7-b9dd2eb1490c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3" status: 200 len: 1517 microversion: 2.1 time: 0.171702 Jul 20 04:37:34.412179 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2024/4272] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:34 2022] GET /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3 => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:34.554221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-becc905b-23c9-49df-b7d5-eb9c0cf41e97 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:34.555385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-becc905b-23c9-49df-b7d5-eb9c0cf41e97 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:34.562058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-becc905b-23c9-49df-b7d5-eb9c0cf41e97 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.562531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-becc905b-23c9-49df-b7d5-eb9c0cf41e97 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.563292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-becc905b-23c9-49df-b7d5-eb9c0cf41e97 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.563723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-becc905b-23c9-49df-b7d5-eb9c0cf41e97 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.617125 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-becc905b-23c9-49df-b7d5-eb9c0cf41e97 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action" status: 200 len: 14 microversion: 2.1 time: 0.137704 Jul 20 04:37:34.618006 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2249/4273] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:34 2022] POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:37:34.749149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9d444147-df56-42e7-919a-22be51c004f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:34.750259 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9d444147-df56-42e7-919a-22be51c004f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:34.765316 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1f7d53f1-7c90-43d4-afa0-e7342e281982 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:34.766386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1f7d53f1-7c90-43d4-afa0-e7342e281982 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:34.771726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d444147-df56-42e7-919a-22be51c004f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.772539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d444147-df56-42e7-919a-22be51c004f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.773356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d444147-df56-42e7-919a-22be51c004f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.775844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f7d53f1-7c90-43d4-afa0-e7342e281982 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.776531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d444147-df56-42e7-919a-22be51c004f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.786072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f7d53f1-7c90-43d4-afa0-e7342e281982 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.787151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f7d53f1-7c90-43d4-afa0-e7342e281982 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.788781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f7d53f1-7c90-43d4-afa0-e7342e281982 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.935611 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9d444147-df56-42e7-919a-22be51c004f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:34.944706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9d444147-df56-42e7-919a-22be51c004f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:34.946215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9d444147-df56-42e7-919a-22be51c004f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:34.947428 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9d444147-df56-42e7-919a-22be51c004f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1720 microversion: 2.20 time: 0.202583 Jul 20 04:37:34.947635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1f7d53f1-7c90-43d4-afa0-e7342e281982 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:34.948048 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2025/4274] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:34 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1720 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:34.956039 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1f7d53f1-7c90-43d4-afa0-e7342e281982 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1514 microversion: 2.1 time: 0.195360 Jul 20 04:37:34.957079 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2250/4275] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:34 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1514 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:35.428645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-52725813-aba7-4a7a-abc6-3b3678588ed5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:35.429351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-52725813-aba7-4a7a-abc6-3b3678588ed5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 2c2adc32-835f-427a-89df-e95652a204a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:35.437347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52725813-aba7-4a7a-abc6-3b3678588ed5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:35.437872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52725813-aba7-4a7a-abc6-3b3678588ed5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:35.438701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52725813-aba7-4a7a-abc6-3b3678588ed5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:35.439180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52725813-aba7-4a7a-abc6-3b3678588ed5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:35.584944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-52725813-aba7-4a7a-abc6-3b3678588ed5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:35.593106 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-52725813-aba7-4a7a-abc6-3b3678588ed5 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3" status: 200 len: 1517 microversion: 2.1 time: 0.168402 Jul 20 04:37:35.594074 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2026/4276] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:35 2022] GET /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3 => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:35.628866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c23d244f-8c2f-444e-b5cb-d3719ebfcec5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:35.629732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c23d244f-8c2f-444e-b5cb-d3719ebfcec5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:35.637700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c23d244f-8c2f-444e-b5cb-d3719ebfcec5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:35.638227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c23d244f-8c2f-444e-b5cb-d3719ebfcec5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:35.639002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c23d244f-8c2f-444e-b5cb-d3719ebfcec5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:35.639744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c23d244f-8c2f-444e-b5cb-d3719ebfcec5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:35.680821 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c23d244f-8c2f-444e-b5cb-d3719ebfcec5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action" status: 200 len: 14 microversion: 2.1 time: 0.056010 Jul 20 04:37:35.684051 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2251/4277] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:35 2022] POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:37:35.966203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3c536d37-0d51-4b2f-950a-1ebbbcdc56b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:35.966721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3c536d37-0d51-4b2f-950a-1ebbbcdc56b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:35.968787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:35.974436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c4b5606b-aad9-4b3e-823a-712f0b772e24 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:35.975140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c4b5606b-aad9-4b3e-823a-712f0b772e24 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:35.975339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c536d37-0d51-4b2f-950a-1ebbbcdc56b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:35.975784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c536d37-0d51-4b2f-950a-1ebbbcdc56b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:35.976587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c536d37-0d51-4b2f-950a-1ebbbcdc56b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:35.977021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c536d37-0d51-4b2f-950a-1ebbbcdc56b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:35.982389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4b5606b-aad9-4b3e-823a-712f0b772e24 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:35.982779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4b5606b-aad9-4b3e-823a-712f0b772e24 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:35.983558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4b5606b-aad9-4b3e-823a-712f0b772e24 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:35.984006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4b5606b-aad9-4b3e-823a-712f0b772e24 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:36.122202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3c536d37-0d51-4b2f-950a-1ebbbcdc56b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:36.131494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3c536d37-0d51-4b2f-950a-1ebbbcdc56b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:36.133804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3c536d37-0d51-4b2f-950a-1ebbbcdc56b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:36.134994 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3c536d37-0d51-4b2f-950a-1ebbbcdc56b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1720 microversion: 2.20 time: 0.173119 Jul 20 04:37:36.135566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c4b5606b-aad9-4b3e-823a-712f0b772e24 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:36.135747 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2027/4278] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:35 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:36.145720 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c4b5606b-aad9-4b3e-823a-712f0b772e24 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1514 microversion: 2.1 time: 0.175637 Jul 20 04:37:36.146265 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2252/4279] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:35 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:36.610781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bd527253-9f81-4cb2-9f75-c99f879f1b40 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:36.611364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bd527253-9f81-4cb2-9f75-c99f879f1b40 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 2c2adc32-835f-427a-89df-e95652a204a3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:36.620636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd527253-9f81-4cb2-9f75-c99f879f1b40 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:36.620636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd527253-9f81-4cb2-9f75-c99f879f1b40 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:36.621006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd527253-9f81-4cb2-9f75-c99f879f1b40 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:36.622672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd527253-9f81-4cb2-9f75-c99f879f1b40 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:36.691463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8f90d060-68e5-4aab-8a37-5e8197b891ba tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:36.692345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8f90d060-68e5-4aab-8a37-5e8197b891ba tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:36.702133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f90d060-68e5-4aab-8a37-5e8197b891ba tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:36.702755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f90d060-68e5-4aab-8a37-5e8197b891ba tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:36.703610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f90d060-68e5-4aab-8a37-5e8197b891ba tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:36.704115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f90d060-68e5-4aab-8a37-5e8197b891ba tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:36.753220 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8f90d060-68e5-4aab-8a37-5e8197b891ba tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action" status: 200 len: 14 microversion: 2.1 time: 0.065654 Jul 20 04:37:36.753948 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2253/4280] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:36 2022] POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:37:36.786019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bd527253-9f81-4cb2-9f75-c99f879f1b40 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:36.794063 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bd527253-9f81-4cb2-9f75-c99f879f1b40 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3" status: 200 len: 1517 microversion: 2.1 time: 0.187590 Jul 20 04:37:36.794652 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2028/4281] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:36 2022] GET /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3 => generated 1517 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:37.154078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-316cbdcc-5bc8-48a9-8bc1-91f84b32b488 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:37.154810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-316cbdcc-5bc8-48a9-8bc1-91f84b32b488 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:37.163988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1cb3b2b0-1d8c-448a-a336-b229afa23262 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:37.164575 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-316cbdcc-5bc8-48a9-8bc1-91f84b32b488 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:37.164712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1cb3b2b0-1d8c-448a-a336-b229afa23262 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:37.165024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-316cbdcc-5bc8-48a9-8bc1-91f84b32b488 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:37.165799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-316cbdcc-5bc8-48a9-8bc1-91f84b32b488 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:37.166235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-316cbdcc-5bc8-48a9-8bc1-91f84b32b488 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:37.190035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cb3b2b0-1d8c-448a-a336-b229afa23262 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:37.190494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cb3b2b0-1d8c-448a-a336-b229afa23262 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:37.191281 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cb3b2b0-1d8c-448a-a336-b229afa23262 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:37.191720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cb3b2b0-1d8c-448a-a336-b229afa23262 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:37.458488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-316cbdcc-5bc8-48a9-8bc1-91f84b32b488 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:37.475440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-316cbdcc-5bc8-48a9-8bc1-91f84b32b488 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:37.477259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-316cbdcc-5bc8-48a9-8bc1-91f84b32b488 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:37.483699 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-316cbdcc-5bc8-48a9-8bc1-91f84b32b488 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1720 microversion: 2.20 time: 0.334577 Jul 20 04:37:37.494466 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2254/4282] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:37 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1720 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:37.522939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1cb3b2b0-1d8c-448a-a336-b229afa23262 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:37.541784 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1cb3b2b0-1d8c-448a-a336-b229afa23262 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1514 microversion: 2.1 time: 0.381257 Jul 20 04:37:37.556440 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2029/4283] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:37 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1514 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:37.630181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-91bd2fbe-db2b-4bbc-9d42-00234d22e35b req-a51dfffc-c432-43e8-a434-ad26167212b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ebac50-3466-4fdc-8ca1-59b0001e2581", "name": "network-vif-unplugged", "status": "completed", "tag": "e0f13bf8-3ce6-42eb-a36c-5d668ff79e32"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:37.656194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-91bd2fbe-db2b-4bbc-9d42-00234d22e35b req-a51dfffc-c432-43e8-a434-ad26167212b3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:37.666227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-91bd2fbe-db2b-4bbc-9d42-00234d22e35b req-a51dfffc-c432-43e8-a434-ad26167212b3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:37.714800 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-91bd2fbe-db2b-4bbc-9d42-00234d22e35b req-a51dfffc-c432-43e8-a434-ad26167212b3 service nova] Creating event network-vif-unplugged:e0f13bf8-3ce6-42eb-a36c-5d668ff79e32 for instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 on n-h2-826526-5 Jul 20 04:37:37.728911 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-91bd2fbe-db2b-4bbc-9d42-00234d22e35b req-a51dfffc-c432-43e8-a434-ad26167212b3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117446 Jul 20 04:37:37.732169 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2255/4284] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:37.773095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-71e07a3a-2c82-4860-bd43-c76f8a607109 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:37.775035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-71e07a3a-2c82-4860-bd43-c76f8a607109 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:37.790383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71e07a3a-2c82-4860-bd43-c76f8a607109 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:37.794329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71e07a3a-2c82-4860-bd43-c76f8a607109 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:37.797914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71e07a3a-2c82-4860-bd43-c76f8a607109 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:37.801688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71e07a3a-2c82-4860-bd43-c76f8a607109 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:37.812494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-addcc154-7ea6-43bc-b823-e784318ca5dd tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:37.814314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-addcc154-7ea6-43bc-b823-e784318ca5dd tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 2c2adc32-835f-427a-89df-e95652a204a3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:37.829822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-addcc154-7ea6-43bc-b823-e784318ca5dd tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:37.832986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-addcc154-7ea6-43bc-b823-e784318ca5dd tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:37.836513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-addcc154-7ea6-43bc-b823-e784318ca5dd tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:37.837585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-addcc154-7ea6-43bc-b823-e784318ca5dd tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:37.902446 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-71e07a3a-2c82-4860-bd43-c76f8a607109 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action" status: 200 len: 14 microversion: 2.1 time: 0.141261 Jul 20 04:37:37.907179 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2030/4285] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:37 2022] POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:37:38.081207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-addcc154-7ea6-43bc-b823-e784318ca5dd tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:38.097586 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-addcc154-7ea6-43bc-b823-e784318ca5dd tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3" status: 200 len: 1517 microversion: 2.1 time: 0.289945 Jul 20 04:37:38.101511 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2256/4286] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:37 2022] GET /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3 => generated 1517 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:38.210510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-d203ccf3-dd1e-4ce2-9978-62b2ac0c6010 req-7f068e16-8206-45f8-8b89-1542afc7b60b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2adc32-835f-427a-89df-e95652a204a3", "name": "network-vif-deleted", "tag": "ce282bc6-b2bb-4a44-8a82-f1ce93047f6f"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:38.226588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d203ccf3-dd1e-4ce2-9978-62b2ac0c6010 req-7f068e16-8206-45f8-8b89-1542afc7b60b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.239260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d203ccf3-dd1e-4ce2-9978-62b2ac0c6010 req-7f068e16-8206-45f8-8b89-1542afc7b60b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.260235 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-d203ccf3-dd1e-4ce2-9978-62b2ac0c6010 req-7f068e16-8206-45f8-8b89-1542afc7b60b service nova] Creating event network-vif-deleted:ce282bc6-b2bb-4a44-8a82-f1ce93047f6f for instance 2c2adc32-835f-427a-89df-e95652a204a3 on n-h2-826526-5 Jul 20 04:37:38.266657 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-d203ccf3-dd1e-4ce2-9978-62b2ac0c6010 req-7f068e16-8206-45f8-8b89-1542afc7b60b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063694 Jul 20 04:37:38.267437 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2031/4287] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:38.311469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-9d170342-8db3-43fa-b04b-bc383469c202 req-91c51bcd-e026-4569-b36b-14f42171373f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3feb0068-8615-4241-ae94-33f175a3d7f8", "name": "network-vif-deleted", "tag": "7d2d2ee3-b619-4cf7-8f59-bc0abdfedab1"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:38.323360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9d170342-8db3-43fa-b04b-bc383469c202 req-91c51bcd-e026-4569-b36b-14f42171373f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.323814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9d170342-8db3-43fa-b04b-bc383469c202 req-91c51bcd-e026-4569-b36b-14f42171373f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.339849 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9d170342-8db3-43fa-b04b-bc383469c202 req-91c51bcd-e026-4569-b36b-14f42171373f service nova] Creating event network-vif-deleted:7d2d2ee3-b619-4cf7-8f59-bc0abdfedab1 for instance 3feb0068-8615-4241-ae94-33f175a3d7f8 on n-h2-826526-5 Jul 20 04:37:38.346008 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-9d170342-8db3-43fa-b04b-bc383469c202 req-91c51bcd-e026-4569-b36b-14f42171373f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043182 Jul 20 04:37:38.347323 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2257/4288] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:38.443811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-54e92d6e-c9cb-407c-8223-f32549bff8c8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:38.444551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-54e92d6e-c9cb-407c-8223-f32549bff8c8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:38.452001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54e92d6e-c9cb-407c-8223-f32549bff8c8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.452685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54e92d6e-c9cb-407c-8223-f32549bff8c8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.453795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54e92d6e-c9cb-407c-8223-f32549bff8c8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.454354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54e92d6e-c9cb-407c-8223-f32549bff8c8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.503010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-be67ddd3-4267-4bee-847a-365bed0e5c7d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:38.503975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-be67ddd3-4267-4bee-847a-365bed0e5c7d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:38.514076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be67ddd3-4267-4bee-847a-365bed0e5c7d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.515070 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be67ddd3-4267-4bee-847a-365bed0e5c7d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.516154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be67ddd3-4267-4bee-847a-365bed0e5c7d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.516841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be67ddd3-4267-4bee-847a-365bed0e5c7d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.749451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-be67ddd3-4267-4bee-847a-365bed0e5c7d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:38.751340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-54e92d6e-c9cb-407c-8223-f32549bff8c8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:38.766297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-54e92d6e-c9cb-407c-8223-f32549bff8c8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:38.767563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-be67ddd3-4267-4bee-847a-365bed0e5c7d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:38.768095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-54e92d6e-c9cb-407c-8223-f32549bff8c8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:38.769393 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-54e92d6e-c9cb-407c-8223-f32549bff8c8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 2956 microversion: 2.42 time: 0.330661 Jul 20 04:37:38.769758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-be67ddd3-4267-4bee-847a-365bed0e5c7d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:38.771111 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-be67ddd3-4267-4bee-847a-365bed0e5c7d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1663 microversion: 2.20 time: 0.272483 Jul 20 04:37:38.776355 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2258/4289] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:38 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1663 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:37:38.780777 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2032/4290] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:38 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 2956 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:38.789188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e49130a9-64f4-4364-be35-a4627529d49d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:38.789717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-174150c8-7e18-4c34-90d3-9920cd2249d3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:38.790220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-174150c8-7e18-4c34-90d3-9920cd2249d3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:38.791340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e49130a9-64f4-4364-be35-a4627529d49d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:38.797235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-174150c8-7e18-4c34-90d3-9920cd2249d3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.797738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-174150c8-7e18-4c34-90d3-9920cd2249d3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.798512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-174150c8-7e18-4c34-90d3-9920cd2249d3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.798938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-174150c8-7e18-4c34-90d3-9920cd2249d3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.799065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e49130a9-64f4-4364-be35-a4627529d49d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.799518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e49130a9-64f4-4364-be35-a4627529d49d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.800339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e49130a9-64f4-4364-be35-a4627529d49d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.800786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e49130a9-64f4-4364-be35-a4627529d49d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.836356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e49130a9-64f4-4364-be35-a4627529d49d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.836766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e49130a9-64f4-4364-be35-a4627529d49d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.837409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-e49130a9-64f4-4364-be35-a4627529d49d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lazy-loading 'fault' on Instance uuid 3feb0068-8615-4241-ae94-33f175a3d7f8 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:37:38.839422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-174150c8-7e18-4c34-90d3-9920cd2249d3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:37:38.898115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e49130a9-64f4-4364-be35-a4627529d49d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:38.907394 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e49130a9-64f4-4364-be35-a4627529d49d tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1308 microversion: 2.1 time: 0.133719 Jul 20 04:37:38.909787 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2259/4291] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:38 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1308 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:38.914661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2d5faccd-4744-4c29-b40f-dde3c068d6af tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:38.915393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2d5faccd-4744-4c29-b40f-dde3c068d6af tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:38.922029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d5faccd-4744-4c29-b40f-dde3c068d6af tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.922566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d5faccd-4744-4c29-b40f-dde3c068d6af tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.923418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d5faccd-4744-4c29-b40f-dde3c068d6af tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.923959 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d5faccd-4744-4c29-b40f-dde3c068d6af tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.942529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=10 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:38.974229 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-174150c8-7e18-4c34-90d3-9920cd2249d3 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989" status: 204 len: 0 microversion: 2.1 time: 0.190717 Jul 20 04:37:38.977566 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2033/4292] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:37:38 2022] DELETE /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:37:38.982887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-13cae174-edd9-4d70-b053-28c9bafa7e58 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70f2e351-1bc7-4294-8b32-e3a5745212bb"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:38.984621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-13cae174-edd9-4d70-b053-28c9bafa7e58 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:39.014335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13cae174-edd9-4d70-b053-28c9bafa7e58 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.014940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13cae174-edd9-4d70-b053-28c9bafa7e58 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.015903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13cae174-edd9-4d70-b053-28c9bafa7e58 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.016481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13cae174-edd9-4d70-b053-28c9bafa7e58 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.043925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:39.094914 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2d5faccd-4744-4c29-b40f-dde3c068d6af tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.183846 Jul 20 04:37:39.095624 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2260/4293] 10.222.0.17 () {60 vars in 1315 bytes} [Wed Jul 20 04:37:38 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869/os-interface => generated 1831 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:39.100863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-42017838-dc50-4b2b-b803-4082fc909228 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:39.102036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-42017838-dc50-4b2b-b803-4082fc909228 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:39.109851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42017838-dc50-4b2b-b803-4082fc909228 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.111055 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42017838-dc50-4b2b-b803-4082fc909228 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.111936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42017838-dc50-4b2b-b803-4082fc909228 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.112499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42017838-dc50-4b2b-b803-4082fc909228 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.156074 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-42017838-dc50-4b2b-b803-4082fc909228 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action" status: 200 len: 14 microversion: 2.1 time: 0.059015 Jul 20 04:37:39.159744 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2261/4294] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:39 2022] POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:37:39.162434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-37bb14d9-1921-41c2-930e-da7017417435 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:39.163159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-37bb14d9-1921-41c2-930e-da7017417435 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:39.170275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37bb14d9-1921-41c2-930e-da7017417435 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.170996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37bb14d9-1921-41c2-930e-da7017417435 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.172036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37bb14d9-1921-41c2-930e-da7017417435 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.172638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37bb14d9-1921-41c2-930e-da7017417435 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.336298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-37bb14d9-1921-41c2-930e-da7017417435 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f66821062041b8a6330b883de2754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f772f396147ea89da0f9f051d9fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:39.347518 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-37bb14d9-1921-41c2-930e-da7017417435 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989" status: 200 len: 1469 microversion: 2.1 time: 0.189150 Jul 20 04:37:39.347814 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-13cae174-edd9-4d70-b053-28c9bafa7e58 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "POST /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.370779 Jul 20 04:37:39.348195 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2262/4295] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:39 2022] GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 => generated 1469 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:39.352556 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2034/4296] 10.222.0.17 () {62 vars in 1363 bytes} [Wed Jul 20 04:37:38 2022] POST /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments => generated 188 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:37:39.357996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-922f9475-c6ba-4edf-9534-0bff4c727aac tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:39.358753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-922f9475-c6ba-4edf-9534-0bff4c727aac tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 2c2adc32-835f-427a-89df-e95652a204a3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:39.365628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-922f9475-c6ba-4edf-9534-0bff4c727aac tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.366124 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-922f9475-c6ba-4edf-9534-0bff4c727aac tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.366952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-922f9475-c6ba-4edf-9534-0bff4c727aac tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.367445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-922f9475-c6ba-4edf-9534-0bff4c727aac tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.381537 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-922f9475-c6ba-4edf-9534-0bff4c727aac tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] HTTP exception thrown: Instance 2c2adc32-835f-427a-89df-e95652a204a3 could not be found. Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-922f9475-c6ba-4edf-9534-0bff4c727aac tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Request method failure captured: Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3 HTTP/1.1 Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14ZAHWmRz5lRn8u43CXd5Cdv6zk0TnExxIOkWRYUacP3J78ucl_OiWfdowOfR5lL-8f0MCnHYDuQdcaJfR7DX-WRsCXq7m3tmdcDCI-cpAc8BxhNj_a12qjXKWAqrlefROEeLFK-4LCS0j0XOvdCrJQpQCWDTQ_nVCUTl0Vg9XOfdFA Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 3946bd28f7c44d5eb9a550efb7b3ab50 Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ListServerFiltersTestJSON-476592840 Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3946bd28f7c44d5eb9a550efb7b3ab50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3946bd28f7c44d5eb9a550efb7b3ab50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3946bd28f7c44d5eb9a550efb7b3ab50", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3946bd28f7c44d5eb9a550efb7b3ab50"}]}] Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ListServerFiltersTestJSON-476592840 Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 3946bd28f7c44d5eb9a550efb7b3ab50 Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-476592840 Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ListServerFiltersTestJSON-476592840-project Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f3b497b40aed4f41a049781e5c0013d4 Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ListServerFiltersTestJSON-476592840-project Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 2c2adc32-835f-427a-89df-e95652a204a3 could not be found. Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '2c2adc32-835f-427a-89df-e95652a204a3'} Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2adc32-835f-427a-89df-e95652a204a3 could not be found. Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2adc32-835f-427a-89df-e95652a204a3 could not be found. Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:39.383332 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:37:39.389974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:39.389974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:39.389974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:39.389974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:39.389974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:39.389974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2adc32-835f-427a-89df-e95652a204a3 could not be found. Jul 20 04:37:39.389974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:37:39.389974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-922f9475-c6ba-4edf-9534-0bff4c727aac tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Returning 404 to user: Instance 2c2adc32-835f-427a-89df-e95652a204a3 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:39.389974 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-922f9475-c6ba-4edf-9534-0bff4c727aac tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3" status: 404 len: 111 microversion: 2.1 time: 0.035889 Jul 20 04:37:39.389974 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2263/4297] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:39 2022] GET /compute/v2.1/servers/2c2adc32-835f-427a-89df-e95652a204a3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:37:39.394341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d4db2c7-647b-4851-bc0d-15cb4a49154a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:39.394845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d4db2c7-647b-4851-bc0d-15cb4a49154a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:39.403404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d4db2c7-647b-4851-bc0d-15cb4a49154a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.403868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d4db2c7-647b-4851-bc0d-15cb4a49154a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.404676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d4db2c7-647b-4851-bc0d-15cb4a49154a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.405218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d4db2c7-647b-4851-bc0d-15cb4a49154a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.439538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d4db2c7-647b-4851-bc0d-15cb4a49154a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:37:39.496618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ec82a586-3a9d-4176-953f-1631977e42ea tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:39.497334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ec82a586-3a9d-4176-953f-1631977e42ea tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:39.499831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=8 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:39.506639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec82a586-3a9d-4176-953f-1631977e42ea tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.507183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec82a586-3a9d-4176-953f-1631977e42ea tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.508000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec82a586-3a9d-4176-953f-1631977e42ea tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.508797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec82a586-3a9d-4176-953f-1631977e42ea tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.513494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:39.547089 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d4db2c7-647b-4851-bc0d-15cb4a49154a tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "DELETE /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 204 len: 0 microversion: 2.1 time: 0.155169 Jul 20 04:37:39.551152 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2035/4298] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:37:39 2022] DELETE /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:37:39.564329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8af873a8-a1d6-4964-af63-3299af12c8a1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:39.565425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8af873a8-a1d6-4964-af63-3299af12c8a1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:39.571592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8af873a8-a1d6-4964-af63-3299af12c8a1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.572092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8af873a8-a1d6-4964-af63-3299af12c8a1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.572862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8af873a8-a1d6-4964-af63-3299af12c8a1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.573297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8af873a8-a1d6-4964-af63-3299af12c8a1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.717340 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ec82a586-3a9d-4176-953f-1631977e42ea tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "POST /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/action" status: 202 len: 0 microversion: 2.20 time: 0.226381 Jul 20 04:37:39.721947 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2264/4299] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jul 20 04:37:39 2022] POST /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:37:39.729632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-82f32b83-17aa-422f-a672-78cf30d0c47f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:39.730120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-82f32b83-17aa-422f-a672-78cf30d0c47f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:39.737325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82f32b83-17aa-422f-a672-78cf30d0c47f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.737771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82f32b83-17aa-422f-a672-78cf30d0c47f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.738622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82f32b83-17aa-422f-a672-78cf30d0c47f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.739188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82f32b83-17aa-422f-a672-78cf30d0c47f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.768745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8af873a8-a1d6-4964-af63-3299af12c8a1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:39.777064 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8af873a8-a1d6-4964-af63-3299af12c8a1 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1517 microversion: 2.1 time: 0.224297 Jul 20 04:37:39.777647 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2036/4300] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:39 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1517 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:39.791479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-dad2e601-fe86-4a98-a4da-89817b10f6a4 req-a6444c0c-354d-4b02-9225-5e9d19a1428a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3feb0068-8615-4241-ae94-33f175a3d7f8", "name": "network-vif-unplugged", "status": "completed", "tag": "7d2d2ee3-b619-4cf7-8f59-bc0abdfedab1"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:39.800657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-dad2e601-fe86-4a98-a4da-89817b10f6a4 req-a6444c0c-354d-4b02-9225-5e9d19a1428a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.802041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-dad2e601-fe86-4a98-a4da-89817b10f6a4 req-a6444c0c-354d-4b02-9225-5e9d19a1428a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.819414 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-dad2e601-fe86-4a98-a4da-89817b10f6a4 req-a6444c0c-354d-4b02-9225-5e9d19a1428a service nova] Creating event network-vif-unplugged:7d2d2ee3-b619-4cf7-8f59-bc0abdfedab1 for instance 3feb0068-8615-4241-ae94-33f175a3d7f8 on n-h2-826526-5 Jul 20 04:37:39.826413 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-dad2e601-fe86-4a98-a4da-89817b10f6a4 req-a6444c0c-354d-4b02-9225-5e9d19a1428a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038489 Jul 20 04:37:39.827028 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2037/4301] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:39.921367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-82f32b83-17aa-422f-a672-78cf30d0c47f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:39.938840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5d878b51-69a3-4860-a6a7-bc7f3e731ff5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:39.939976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5d878b51-69a3-4860-a6a7-bc7f3e731ff5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:39.945146 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:39.945914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-82f32b83-17aa-422f-a672-78cf30d0c47f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:39.947881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-82f32b83-17aa-422f-a672-78cf30d0c47f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:39.949993 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-82f32b83-17aa-422f-a672-78cf30d0c47f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1749 microversion: 2.20 time: 0.226440 Jul 20 04:37:39.951934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5d878b51-69a3-4860-a6a7-bc7f3e731ff5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.952642 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2265/4302] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:39 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1749 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:39.953222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5d878b51-69a3-4860-a6a7-bc7f3e731ff5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.954072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5d878b51-69a3-4860-a6a7-bc7f3e731ff5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.954587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5d878b51-69a3-4860-a6a7-bc7f3e731ff5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.993643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5d878b51-69a3-4860-a6a7-bc7f3e731ff5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.994252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5d878b51-69a3-4860-a6a7-bc7f3e731ff5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.994865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-5d878b51-69a3-4860-a6a7-bc7f3e731ff5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lazy-loading 'fault' on Instance uuid 3feb0068-8615-4241-ae94-33f175a3d7f8 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:37:40.044041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5d878b51-69a3-4860-a6a7-bc7f3e731ff5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cd39643e804592be29c8bf6552f1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec608ff77894cd7b35ce5dbdffcd775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:40.053175 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5d878b51-69a3-4860-a6a7-bc7f3e731ff5 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 200 len: 1308 microversion: 2.1 time: 0.119051 Jul 20 04:37:40.054229 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2038/4303] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:39 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:40.169838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e653c493-2bfc-4f1f-a71a-5dce604ad432 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:40.171873 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e653c493-2bfc-4f1f-a71a-5dce604ad432 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:40.182166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e653c493-2bfc-4f1f-a71a-5dce604ad432 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:40.183244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e653c493-2bfc-4f1f-a71a-5dce604ad432 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:40.185167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e653c493-2bfc-4f1f-a71a-5dce604ad432 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:40.186046 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e653c493-2bfc-4f1f-a71a-5dce604ad432 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:40.365359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fe4b7b9a-3874-4ddc-8bd4-3ae4a0498e6d tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:40.365981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fe4b7b9a-3874-4ddc-8bd4-3ae4a0498e6d tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:40.373422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe4b7b9a-3874-4ddc-8bd4-3ae4a0498e6d tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:40.374219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe4b7b9a-3874-4ddc-8bd4-3ae4a0498e6d tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:40.375462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe4b7b9a-3874-4ddc-8bd4-3ae4a0498e6d tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:40.376151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe4b7b9a-3874-4ddc-8bd4-3ae4a0498e6d tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:40.538399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fe4b7b9a-3874-4ddc-8bd4-3ae4a0498e6d tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f66821062041b8a6330b883de2754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f772f396147ea89da0f9f051d9fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:40.548247 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fe4b7b9a-3874-4ddc-8bd4-3ae4a0498e6d tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989" status: 200 len: 1469 microversion: 2.1 time: 0.186749 Jul 20 04:37:40.549542 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2039/4304] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:40 2022] GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:40.794186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6c69bd94-a5b2-4a9a-a620-b0accd6bdf8b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:40.794800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6c69bd94-a5b2-4a9a-a620-b0accd6bdf8b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:40.802640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c69bd94-a5b2-4a9a-a620-b0accd6bdf8b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:40.803391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c69bd94-a5b2-4a9a-a620-b0accd6bdf8b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:40.804450 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c69bd94-a5b2-4a9a-a620-b0accd6bdf8b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:40.805084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c69bd94-a5b2-4a9a-a620-b0accd6bdf8b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:40.891083 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e653c493-2bfc-4f1f-a71a-5dce604ad432 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action" status: 200 len: 14 microversion: 2.1 time: 0.726778 Jul 20 04:37:40.894621 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2266/4305] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:40 2022] POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action => generated 14 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:37:40.982583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e706c42c-fbde-4082-8aef-74ea122d1243 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:40.983370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e706c42c-fbde-4082-8aef-74ea122d1243 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:40.996149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e706c42c-fbde-4082-8aef-74ea122d1243 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:40.996946 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e706c42c-fbde-4082-8aef-74ea122d1243 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:40.998425 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e706c42c-fbde-4082-8aef-74ea122d1243 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:40.998934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e706c42c-fbde-4082-8aef-74ea122d1243 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:41.018953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6c69bd94-a5b2-4a9a-a620-b0accd6bdf8b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:41.028255 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6c69bd94-a5b2-4a9a-a620-b0accd6bdf8b tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1517 microversion: 2.1 time: 0.237857 Jul 20 04:37:41.038811 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2040/4306] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:40 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1517 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:41.077588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf1aca31-207b-438b-b276-c24f52c3f826 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:41.079905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf1aca31-207b-438b-b276-c24f52c3f826 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] [instance: 3feb0068-8615-4241-ae94-33f175a3d7f8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:41.110467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf1aca31-207b-438b-b276-c24f52c3f826 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:41.111970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf1aca31-207b-438b-b276-c24f52c3f826 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:41.114424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf1aca31-207b-438b-b276-c24f52c3f826 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:41.116307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf1aca31-207b-438b-b276-c24f52c3f826 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:41.136683 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-bf1aca31-207b-438b-b276-c24f52c3f826 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] HTTP exception thrown: Instance 3feb0068-8615-4241-ae94-33f175a3d7f8 could not be found. Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf1aca31-207b-438b-b276-c24f52c3f826 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Request method failure captured: Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 HTTP/1.1 Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14Ub5vekHRS3Hfq4mTEVvhoHkv8cWNaG9M-paafXaeFyeqwnADXb9sncsdoJnnQu0Lgl6MbUPe3RAvBGn6oPHCzyDGNyP32bdxJdvf44034x78VRadDxGBz8vGc7Dtd6T2MDPGpXbswJxucDlbUV9C-IBGGs3Nlo0j4xYgLo2v_hra0 Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 9ec608ff77894cd7b35ce5dbdffcd775 Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1674289088 Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9ec608ff77894cd7b35ce5dbdffcd775"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9ec608ff77894cd7b35ce5dbdffcd775"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9ec608ff77894cd7b35ce5dbdffcd775", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9ec608ff77894cd7b35ce5dbdffcd775"}]}] Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-VolumesSnapshotTestJSON-1674289088 Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 9ec608ff77894cd7b35ce5dbdffcd775 Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1674289088 Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-VolumesSnapshotTestJSON-1674289088-project Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: d2cd39643e804592be29c8bf6552f1dc Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-VolumesSnapshotTestJSON-1674289088-project Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 3feb0068-8615-4241-ae94-33f175a3d7f8 could not be found. Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '3feb0068-8615-4241-ae94-33f175a3d7f8'} Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3feb0068-8615-4241-ae94-33f175a3d7f8 could not be found. Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3feb0068-8615-4241-ae94-33f175a3d7f8 could not be found. Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:41.139057 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:37:41.144823 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:41.144823 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:41.144823 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:41.144823 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:41.144823 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:41.144823 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3feb0068-8615-4241-ae94-33f175a3d7f8 could not be found. Jul 20 04:37:41.144823 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:37:41.147125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf1aca31-207b-438b-b276-c24f52c3f826 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] Returning 404 to user: Instance 3feb0068-8615-4241-ae94-33f175a3d7f8 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:41.148280 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf1aca31-207b-438b-b276-c24f52c3f826 tempest-VolumesSnapshotTestJSON-1674289088 tempest-VolumesSnapshotTestJSON-1674289088-project] 10.222.0.17 "GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8" status: 404 len: 111 microversion: 2.1 time: 0.081853 Jul 20 04:37:41.149682 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2041/4307] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:41 2022] GET /compute/v2.1/servers/3feb0068-8615-4241-ae94-33f175a3d7f8 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:37:41.178628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e706c42c-fbde-4082-8aef-74ea122d1243 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:41.178893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f98426ed-34ec-4714-b063-a792534161de req-ffedf96e-4c7d-4451-992c-c9f541928fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b99493a-f245-4470-ae4f-a36b41b59989", "name": "network-vif-deleted", "tag": "58b0b6a7-09ee-4dac-9463-8338167fe870"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:41.187837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e706c42c-fbde-4082-8aef-74ea122d1243 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:41.190331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e706c42c-fbde-4082-8aef-74ea122d1243 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:41.191557 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e706c42c-fbde-4082-8aef-74ea122d1243 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1751 microversion: 2.20 time: 0.219437 Jul 20 04:37:41.192471 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2267/4308] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:40 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1751 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:41.202812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f98426ed-34ec-4714-b063-a792534161de req-ffedf96e-4c7d-4451-992c-c9f541928fb0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:41.203335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f98426ed-34ec-4714-b063-a792534161de req-ffedf96e-4c7d-4451-992c-c9f541928fb0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:41.226239 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f98426ed-34ec-4714-b063-a792534161de req-ffedf96e-4c7d-4451-992c-c9f541928fb0 service nova] Creating event network-vif-deleted:58b0b6a7-09ee-4dac-9463-8338167fe870 for instance 1b99493a-f245-4470-ae4f-a36b41b59989 on n-h2-826526-5 Jul 20 04:37:41.242987 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f98426ed-34ec-4714-b063-a792534161de req-ffedf96e-4c7d-4451-992c-c9f541928fb0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080559 Jul 20 04:37:41.244388 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2042/4309] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:41.567444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-66ec53c4-81ba-43dc-b958-7a0eb365b966 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:41.568086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-66ec53c4-81ba-43dc-b958-7a0eb365b966 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:41.594208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66ec53c4-81ba-43dc-b958-7a0eb365b966 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:41.594675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66ec53c4-81ba-43dc-b958-7a0eb365b966 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:41.595476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66ec53c4-81ba-43dc-b958-7a0eb365b966 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:41.595918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66ec53c4-81ba-43dc-b958-7a0eb365b966 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:41.691201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66ec53c4-81ba-43dc-b958-7a0eb365b966 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:41.691944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66ec53c4-81ba-43dc-b958-7a0eb365b966 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:41.692454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-66ec53c4-81ba-43dc-b958-7a0eb365b966 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lazy-loading 'fault' on Instance uuid 1b99493a-f245-4470-ae4f-a36b41b59989 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:37:41.842843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-66ec53c4-81ba-43dc-b958-7a0eb365b966 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f66821062041b8a6330b883de2754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f772f396147ea89da0f9f051d9fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:41.855893 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-66ec53c4-81ba-43dc-b958-7a0eb365b966 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989" status: 200 len: 1303 microversion: 2.1 time: 0.292857 Jul 20 04:37:41.860055 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2268/4310] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:41 2022] GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 => generated 1303 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:41.908661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2c557fda-6793-4bc9-a6bf-70dcc0aaef0b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:41.909752 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2c557fda-6793-4bc9-a6bf-70dcc0aaef0b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:41.918812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c557fda-6793-4bc9-a6bf-70dcc0aaef0b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:41.919450 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c557fda-6793-4bc9-a6bf-70dcc0aaef0b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:41.920569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c557fda-6793-4bc9-a6bf-70dcc0aaef0b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:41.921282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c557fda-6793-4bc9-a6bf-70dcc0aaef0b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:41.977076 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2c557fda-6793-4bc9-a6bf-70dcc0aaef0b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action" status: 200 len: 14 microversion: 2.1 time: 0.075150 Jul 20 04:37:41.979212 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2043/4311] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:41 2022] POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:37:42.048197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4ed5e11d-35fd-4148-9185-36d8bcbb7192 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:42.049241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4ed5e11d-35fd-4148-9185-36d8bcbb7192 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:42.068364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ed5e11d-35fd-4148-9185-36d8bcbb7192 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:42.071631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ed5e11d-35fd-4148-9185-36d8bcbb7192 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:42.072714 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ed5e11d-35fd-4148-9185-36d8bcbb7192 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:42.074507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ed5e11d-35fd-4148-9185-36d8bcbb7192 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:42.200444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4ed5e11d-35fd-4148-9185-36d8bcbb7192 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b497b40aed4f41a049781e5c0013d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3946bd28f7c44d5eb9a550efb7b3ab50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:42.215770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3e98f5eb-68e1-4105-ba5e-fd3296773578 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:42.216778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3e98f5eb-68e1-4105-ba5e-fd3296773578 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:42.220876 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4ed5e11d-35fd-4148-9185-36d8bcbb7192 tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 200 len: 1475 microversion: 2.1 time: 0.175710 Jul 20 04:37:42.225100 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2269/4312] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:42 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 1475 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:42.235771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e98f5eb-68e1-4105-ba5e-fd3296773578 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:42.238221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e98f5eb-68e1-4105-ba5e-fd3296773578 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:42.240299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e98f5eb-68e1-4105-ba5e-fd3296773578 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:42.242551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e98f5eb-68e1-4105-ba5e-fd3296773578 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:42.441167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3e98f5eb-68e1-4105-ba5e-fd3296773578 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:42.451813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3e98f5eb-68e1-4105-ba5e-fd3296773578 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:42.453378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3e98f5eb-68e1-4105-ba5e-fd3296773578 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:42.454643 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3e98f5eb-68e1-4105-ba5e-fd3296773578 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1751 microversion: 2.20 time: 0.244000 Jul 20 04:37:42.455189 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2044/4313] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:42 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1751 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:37:42.884722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5eb730d7-c67c-47d2-890d-bb259cb48b48 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:42.886820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5eb730d7-c67c-47d2-890d-bb259cb48b48 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] [instance: 1b99493a-f245-4470-ae4f-a36b41b59989] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:42.898636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eb730d7-c67c-47d2-890d-bb259cb48b48 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:42.899356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eb730d7-c67c-47d2-890d-bb259cb48b48 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:42.900800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eb730d7-c67c-47d2-890d-bb259cb48b48 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:42.901511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eb730d7-c67c-47d2-890d-bb259cb48b48 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:42.921539 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-5eb730d7-c67c-47d2-890d-bb259cb48b48 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] HTTP exception thrown: Instance 1b99493a-f245-4470-ae4f-a36b41b59989 could not be found. Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5eb730d7-c67c-47d2-890d-bb259cb48b48 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Request method failure captured: Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 HTTP/1.1 Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14XEK5wg-V91U8KekddnDs_-4OXYk59B4eMAC8S1N1-U9Z0Da_yIDq0174pueNu2edM2Im00QDzNE2TXwqmyChMjYliXTbCLmwAB6OpotBEN9WpmUOiT8MRyn9B_obj3EOeGcxVWgqFy_JpB4jUW9U-wl_VFleS5jDmdxp8n3y1aRWU Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 315f772f396147ea89da0f9f051d9fee Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-VolumesBackupsTest-1554942251 Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/315f772f396147ea89da0f9f051d9fee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/315f772f396147ea89da0f9f051d9fee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_315f772f396147ea89da0f9f051d9fee", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/315f772f396147ea89da0f9f051d9fee"}]}] Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-VolumesBackupsTest-1554942251 Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 315f772f396147ea89da0f9f051d9fee Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-VolumesBackupsTest-1554942251 Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-VolumesBackupsTest-1554942251-project Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 43f66821062041b8a6330b883de2754f Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-VolumesBackupsTest-1554942251-project Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 1b99493a-f245-4470-ae4f-a36b41b59989 could not be found. Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '1b99493a-f245-4470-ae4f-a36b41b59989'} Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b99493a-f245-4470-ae4f-a36b41b59989 could not be found. Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b99493a-f245-4470-ae4f-a36b41b59989 could not be found. Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:42.923660 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:37:42.933245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:42.933245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:42.933245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:42.933245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:42.933245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:42.933245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b99493a-f245-4470-ae4f-a36b41b59989 could not be found. Jul 20 04:37:42.933245 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:37:42.933245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5eb730d7-c67c-47d2-890d-bb259cb48b48 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] Returning 404 to user: Instance 1b99493a-f245-4470-ae4f-a36b41b59989 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:42.933245 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5eb730d7-c67c-47d2-890d-bb259cb48b48 tempest-VolumesBackupsTest-1554942251 tempest-VolumesBackupsTest-1554942251-project] 10.222.0.17 "GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989" status: 404 len: 111 microversion: 2.1 time: 0.047634 Jul 20 04:37:42.933245 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2270/4314] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:42 2022] GET /compute/v2.1/servers/1b99493a-f245-4470-ae4f-a36b41b59989 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:37:42.991715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e83f9e53-bd85-4247-8b88-32549464074d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:42.992857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e83f9e53-bd85-4247-8b88-32549464074d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:43.010864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e83f9e53-bd85-4247-8b88-32549464074d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:43.011974 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e83f9e53-bd85-4247-8b88-32549464074d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:43.013711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e83f9e53-bd85-4247-8b88-32549464074d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:43.014602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e83f9e53-bd85-4247-8b88-32549464074d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:43.072511 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e83f9e53-bd85-4247-8b88-32549464074d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action" status: 200 len: 14 microversion: 2.1 time: 0.086174 Jul 20 04:37:43.073474 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2045/4315] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:42 2022] POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:37:43.242037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6d131092-8cd5-4b21-90f9-e134f0f3919c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:43.242654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6d131092-8cd5-4b21-90f9-e134f0f3919c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] [instance: 964438a8-b527-40c0-b62b-f21bc79d5f1a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:43.249395 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d131092-8cd5-4b21-90f9-e134f0f3919c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:43.249858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d131092-8cd5-4b21-90f9-e134f0f3919c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:43.250925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d131092-8cd5-4b21-90f9-e134f0f3919c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:43.251456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d131092-8cd5-4b21-90f9-e134f0f3919c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:43.271466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-453da96f-5d7a-4234-aa91-d76a6bec6cbb req-78e34dbc-f7d0-42a4-8741-6f9e45656b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964438a8-b527-40c0-b62b-f21bc79d5f1a", "name": "network-vif-deleted", "tag": "48c7f7ac-66da-445b-9bc0-c6f6dc93a1f6"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:43.276004 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-6d131092-8cd5-4b21-90f9-e134f0f3919c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] HTTP exception thrown: Instance 964438a8-b527-40c0-b62b-f21bc79d5f1a could not be found. Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6d131092-8cd5-4b21-90f9-e134f0f3919c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Request method failure captured: Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a HTTP/1.1 Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14ZAHWmRz5lRn8u43CXd5Cdv6zk0TnExxIOkWRYUacP3J78ucl_OiWfdowOfR5lL-8f0MCnHYDuQdcaJfR7DX-WRsCXq7m3tmdcDCI-cpAc8BxhNj_a12qjXKWAqrlefROEeLFK-4LCS0j0XOvdCrJQpQCWDTQ_nVCUTl0Vg9XOfdFA Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 3946bd28f7c44d5eb9a550efb7b3ab50 Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ListServerFiltersTestJSON-476592840 Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3946bd28f7c44d5eb9a550efb7b3ab50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3946bd28f7c44d5eb9a550efb7b3ab50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3946bd28f7c44d5eb9a550efb7b3ab50", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3946bd28f7c44d5eb9a550efb7b3ab50"}]}] Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ListServerFiltersTestJSON-476592840 Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 3946bd28f7c44d5eb9a550efb7b3ab50 Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-476592840 Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ListServerFiltersTestJSON-476592840-project Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f3b497b40aed4f41a049781e5c0013d4 Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ListServerFiltersTestJSON-476592840-project Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 964438a8-b527-40c0-b62b-f21bc79d5f1a could not be found. Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '964438a8-b527-40c0-b62b-f21bc79d5f1a'} Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 964438a8-b527-40c0-b62b-f21bc79d5f1a could not be found. Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 964438a8-b527-40c0-b62b-f21bc79d5f1a could not be found. Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:43.277960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:37:43.283109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:43.283109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:43.283109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:43.283109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:43.283109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:43.283109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 964438a8-b527-40c0-b62b-f21bc79d5f1a could not be found. Jul 20 04:37:43.283109 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:37:43.284728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6d131092-8cd5-4b21-90f9-e134f0f3919c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] Returning 404 to user: Instance 964438a8-b527-40c0-b62b-f21bc79d5f1a could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:43.285568 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6d131092-8cd5-4b21-90f9-e134f0f3919c tempest-ListServerFiltersTestJSON-476592840 tempest-ListServerFiltersTestJSON-476592840-project] 10.222.0.17 "GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a" status: 404 len: 111 microversion: 2.1 time: 0.047660 Jul 20 04:37:43.286630 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2271/4316] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:43 2022] GET /compute/v2.1/servers/964438a8-b527-40c0-b62b-f21bc79d5f1a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:37:43.311254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-453da96f-5d7a-4234-aa91-d76a6bec6cbb req-78e34dbc-f7d0-42a4-8741-6f9e45656b3d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:43.311996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-453da96f-5d7a-4234-aa91-d76a6bec6cbb req-78e34dbc-f7d0-42a4-8741-6f9e45656b3d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:43.324879 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-453da96f-5d7a-4234-aa91-d76a6bec6cbb req-78e34dbc-f7d0-42a4-8741-6f9e45656b3d service nova] Creating event network-vif-deleted:48c7f7ac-66da-445b-9bc0-c6f6dc93a1f6 for instance 964438a8-b527-40c0-b62b-f21bc79d5f1a on n-h1-826526-5 Jul 20 04:37:43.335859 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-453da96f-5d7a-4234-aa91-d76a6bec6cbb req-78e34dbc-f7d0-42a4-8741-6f9e45656b3d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067924 Jul 20 04:37:43.337027 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2046/4317] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:43.476116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ae90331a-f305-4c07-9c43-ebbdc63c569e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:43.477416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ae90331a-f305-4c07-9c43-ebbdc63c569e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:43.484982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae90331a-f305-4c07-9c43-ebbdc63c569e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:43.485705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae90331a-f305-4c07-9c43-ebbdc63c569e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:43.487171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae90331a-f305-4c07-9c43-ebbdc63c569e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:43.487860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae90331a-f305-4c07-9c43-ebbdc63c569e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:43.727485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ae90331a-f305-4c07-9c43-ebbdc63c569e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:43.738628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ae90331a-f305-4c07-9c43-ebbdc63c569e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:43.741332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ae90331a-f305-4c07-9c43-ebbdc63c569e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:43.743422 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ae90331a-f305-4c07-9c43-ebbdc63c569e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1751 microversion: 2.20 time: 0.271393 Jul 20 04:37:43.747605 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2272/4318] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:43 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1751 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:44.088795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-48b6c138-9a74-474e-a4c1-ff53543677a7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:44.090076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-48b6c138-9a74-474e-a4c1-ff53543677a7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:44.108598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b6c138-9a74-474e-a4c1-ff53543677a7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:44.109081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b6c138-9a74-474e-a4c1-ff53543677a7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:44.109872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b6c138-9a74-474e-a4c1-ff53543677a7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:44.110363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48b6c138-9a74-474e-a4c1-ff53543677a7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:44.250974 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-48b6c138-9a74-474e-a4c1-ff53543677a7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action" status: 200 len: 14 microversion: 2.1 time: 0.169251 Jul 20 04:37:44.252297 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2047/4319] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:44 2022] POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:37:44.767676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f91669d9-2650-482a-848a-16a714879152 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:44.770066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f91669d9-2650-482a-848a-16a714879152 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:44.791199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f91669d9-2650-482a-848a-16a714879152 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:44.792100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f91669d9-2650-482a-848a-16a714879152 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:44.794549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f91669d9-2650-482a-848a-16a714879152 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:44.797105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f91669d9-2650-482a-848a-16a714879152 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:45.077819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f91669d9-2650-482a-848a-16a714879152 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:45.096451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f91669d9-2650-482a-848a-16a714879152 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:45.100086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f91669d9-2650-482a-848a-16a714879152 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:45.101852 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f91669d9-2650-482a-848a-16a714879152 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1751 microversion: 2.20 time: 0.339548 Jul 20 04:37:45.103955 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2273/4320] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:44 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1751 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:45.263424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf2a2b9b-616e-40f1-80a2-f21ae933a209 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:45.265162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf2a2b9b-616e-40f1-80a2-f21ae933a209 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:45.273954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf2a2b9b-616e-40f1-80a2-f21ae933a209 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:45.274723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf2a2b9b-616e-40f1-80a2-f21ae933a209 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:45.275711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf2a2b9b-616e-40f1-80a2-f21ae933a209 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:45.276405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf2a2b9b-616e-40f1-80a2-f21ae933a209 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:45.329200 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf2a2b9b-616e-40f1-80a2-f21ae933a209 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action" status: 200 len: 14 microversion: 2.1 time: 0.070173 Jul 20 04:37:45.334574 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2048/4321] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:45 2022] POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:37:46.121683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8fbe6e97-453a-4fda-bb86-b376743069df tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:46.122300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8fbe6e97-453a-4fda-bb86-b376743069df tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:46.134587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fbe6e97-453a-4fda-bb86-b376743069df tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:46.135033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fbe6e97-453a-4fda-bb86-b376743069df tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:46.135806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fbe6e97-453a-4fda-bb86-b376743069df tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:46.136231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fbe6e97-453a-4fda-bb86-b376743069df tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:46.344126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4eb17229-5452-42b3-a3f5-0124e149dce3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:46.345567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8fbe6e97-453a-4fda-bb86-b376743069df tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:46.346003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4eb17229-5452-42b3-a3f5-0124e149dce3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:46.361311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4eb17229-5452-42b3-a3f5-0124e149dce3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:46.361762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4eb17229-5452-42b3-a3f5-0124e149dce3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:46.363295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4eb17229-5452-42b3-a3f5-0124e149dce3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:46.363733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4eb17229-5452-42b3-a3f5-0124e149dce3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:46.367924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8fbe6e97-453a-4fda-bb86-b376743069df tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:46.370522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8fbe6e97-453a-4fda-bb86-b376743069df tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:46.375490 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8fbe6e97-453a-4fda-bb86-b376743069df tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1751 microversion: 2.20 time: 0.258802 Jul 20 04:37:46.378655 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2274/4322] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:46 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1751 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:46.432718 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4eb17229-5452-42b3-a3f5-0124e149dce3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action" status: 200 len: 8208 microversion: 2.1 time: 0.093587 Jul 20 04:37:46.439209 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2049/4323] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:46 2022] POST /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1/action => generated 8208 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:46.443795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8149e039-3d96-4844-8ea1-b8909e70318a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:46.444463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8149e039-3d96-4844-8ea1-b8909e70318a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:46.454236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8149e039-3d96-4844-8ea1-b8909e70318a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:46.457011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8149e039-3d96-4844-8ea1-b8909e70318a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:46.458654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8149e039-3d96-4844-8ea1-b8909e70318a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:46.459275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8149e039-3d96-4844-8ea1-b8909e70318a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:46.711534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8149e039-3d96-4844-8ea1-b8909e70318a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:46.724447 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8149e039-3d96-4844-8ea1-b8909e70318a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.284792 Jul 20 04:37:46.726131 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2275/4324] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:46 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:46.750196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d75da63f-379a-47ab-a369-76b10b295ccc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:46.751269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d75da63f-379a-47ab-a369-76b10b295ccc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:46.762986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d75da63f-379a-47ab-a369-76b10b295ccc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:46.763693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d75da63f-379a-47ab-a369-76b10b295ccc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:46.764712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d75da63f-379a-47ab-a369-76b10b295ccc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:46.765444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d75da63f-379a-47ab-a369-76b10b295ccc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:46.797792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:47.094678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d75da63f-379a-47ab-a369-76b10b295ccc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:47.104726 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d75da63f-379a-47ab-a369-76b10b295ccc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.360797 Jul 20 04:37:47.112761 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2050/4325] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:46 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:47.121354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e76a2764-7f7f-4a7d-b15a-8f0925a98e6c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:47.122038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e76a2764-7f7f-4a7d-b15a-8f0925a98e6c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:47.134338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e76a2764-7f7f-4a7d-b15a-8f0925a98e6c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:47.134970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e76a2764-7f7f-4a7d-b15a-8f0925a98e6c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:47.135810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e76a2764-7f7f-4a7d-b15a-8f0925a98e6c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:47.138566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e76a2764-7f7f-4a7d-b15a-8f0925a98e6c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:47.400642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b83b5963-dd77-4c9e-9ab5-2f6450f0c5cc tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:47.402775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b83b5963-dd77-4c9e-9ab5-2f6450f0c5cc tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:47.422836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b83b5963-dd77-4c9e-9ab5-2f6450f0c5cc tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:47.426404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e76a2764-7f7f-4a7d-b15a-8f0925a98e6c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:47.429123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b83b5963-dd77-4c9e-9ab5-2f6450f0c5cc tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:47.435060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b83b5963-dd77-4c9e-9ab5-2f6450f0c5cc tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:47.440429 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e76a2764-7f7f-4a7d-b15a-8f0925a98e6c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.322520 Jul 20 04:37:47.441322 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2276/4326] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:47 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:47.461879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3aad676b-977e-49a1-bae5-9f366fea0b63 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:47.462721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3aad676b-977e-49a1-bae5-9f366fea0b63 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:47.463976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b83b5963-dd77-4c9e-9ab5-2f6450f0c5cc tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:47.479457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3aad676b-977e-49a1-bae5-9f366fea0b63 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:47.481559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3aad676b-977e-49a1-bae5-9f366fea0b63 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:47.484315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3aad676b-977e-49a1-bae5-9f366fea0b63 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:47.484998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3aad676b-977e-49a1-bae5-9f366fea0b63 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:47.883879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b83b5963-dd77-4c9e-9ab5-2f6450f0c5cc tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:47.897952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b83b5963-dd77-4c9e-9ab5-2f6450f0c5cc tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:47.899837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b83b5963-dd77-4c9e-9ab5-2f6450f0c5cc tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:47.902556 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b83b5963-dd77-4c9e-9ab5-2f6450f0c5cc tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1751 microversion: 2.20 time: 0.507740 Jul 20 04:37:47.904047 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2051/4327] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:47 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1751 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:37:47.927103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3aad676b-977e-49a1-bae5-9f366fea0b63 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:47.942237 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3aad676b-977e-49a1-bae5-9f366fea0b63 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.486186 Jul 20 04:37:47.944254 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2277/4328] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:47 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:47.964920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-869d1c03-022b-488d-9b55-cf387ea20cc2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:47.967555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-869d1c03-022b-488d-9b55-cf387ea20cc2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:47.984459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-869d1c03-022b-488d-9b55-cf387ea20cc2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:47.986671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-869d1c03-022b-488d-9b55-cf387ea20cc2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:47.988879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-869d1c03-022b-488d-9b55-cf387ea20cc2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:47.989983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-869d1c03-022b-488d-9b55-cf387ea20cc2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:48.152381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-869d1c03-022b-488d-9b55-cf387ea20cc2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Locking {{(pid=127870) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 20 04:37:48.323113 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-869d1c03-022b-488d-9b55-cf387ea20cc2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 202 len: 0 microversion: 2.1 time: 0.367368 Jul 20 04:37:48.326554 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2052/4329] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:47 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:48.332053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fa1cfc72-1de6-4f05-a82c-d8c0b180b81b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:48.333778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fa1cfc72-1de6-4f05-a82c-d8c0b180b81b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:48.339378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:48.350052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa1cfc72-1de6-4f05-a82c-d8c0b180b81b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:48.350917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa1cfc72-1de6-4f05-a82c-d8c0b180b81b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:48.351825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa1cfc72-1de6-4f05-a82c-d8c0b180b81b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:48.352418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa1cfc72-1de6-4f05-a82c-d8c0b180b81b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:48.688519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fa1cfc72-1de6-4f05-a82c-d8c0b180b81b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:48.700015 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fa1cfc72-1de6-4f05-a82c-d8c0b180b81b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.371692 Jul 20 04:37:48.701188 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2278/4330] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:48 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:48.725404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-70b5a037-4faa-4e4d-adf4-bc2a0ace920f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:48.733116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70b5a037-4faa-4e4d-adf4-bc2a0ace920f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:48.733516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70b5a037-4faa-4e4d-adf4-bc2a0ace920f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:48.765739 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-70b5a037-4faa-4e4d-adf4-bc2a0ace920f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] HTTP exception thrown: Instance f2db32d6-491e-4d61-81b0-571b1c7073ff is locked Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-70b5a037-4faa-4e4d-adf4-bc2a0ace920f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Request method failure captured: Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action HTTP/1.1 Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 15 Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14VixHJkebixphdIwpShDcg3JlaVhM2CoSLlprTWiwLn49pCahdWzlOL7MmtUDivVfw4m6kI4BuKlP27BpI0P2VGSTH9CmZ2MDFgZIfQUKwMAzgmxiYhzCfBZQgehacwrRr-TbEtnIcKT7h1-1gllEV5AaLRk0CzcCXpWksXa6-Jd-I Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: fcd6c40faa19476db37fa7897dea5840 Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerActionsTestJSON-1614718281 Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcd6c40faa19476db37fa7897dea5840"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fcd6c40faa19476db37fa7897dea5840"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fcd6c40faa19476db37fa7897dea5840", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcd6c40faa19476db37fa7897dea5840"}]}] Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerActionsTestJSON-1614718281 Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: fcd6c40faa19476db37fa7897dea5840 Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerActionsTestJSON-1614718281 Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerActionsTestJSON-1614718281-project Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f50ac97f2ef04752bd49148748e39eb8 Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerActionsTestJSON-1614718281-project Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: {"os-stop": {}} Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance f2db32d6-491e-4d61-81b0-571b1c7073ff is locked Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'f2db32d6-491e-4d61-81b0-571b1c7073ff', 'body': {'os-stop': {}}} Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance f2db32d6-491e-4d61-81b0-571b1c7073ff is locked Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance f2db32d6-491e-4d61-81b0-571b1c7073ff is locked Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2db32d6-491e-4d61-81b0-571b1c7073ff is locked Jul 20 04:37:48.767546 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:37:48.772695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-70b5a037-4faa-4e4d-adf4-bc2a0ace920f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Returning 409 to user: Instance f2db32d6-491e-4d61-81b0-571b1c7073ff is locked {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:48.773751 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-70b5a037-4faa-4e4d-adf4-bc2a0ace920f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 409 len: 107 microversion: 2.1 time: 0.060708 Jul 20 04:37:48.777999 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2053/4331] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:48 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 107 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:37:48.783715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e5f1b6d9-bc7d-495a-ae48-fbe14b09c898 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:48.784469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e5f1b6d9-bc7d-495a-ae48-fbe14b09c898 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:48.796702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5f1b6d9-bc7d-495a-ae48-fbe14b09c898 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:48.797535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5f1b6d9-bc7d-495a-ae48-fbe14b09c898 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:48.802065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5f1b6d9-bc7d-495a-ae48-fbe14b09c898 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:48.804896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5f1b6d9-bc7d-495a-ae48-fbe14b09c898 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:48.924715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c915fe70-4419-4c45-8869-b84c39f7c0f1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:48.926377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c915fe70-4419-4c45-8869-b84c39f7c0f1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:48.939264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c915fe70-4419-4c45-8869-b84c39f7c0f1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:48.940903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c915fe70-4419-4c45-8869-b84c39f7c0f1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:48.943170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c915fe70-4419-4c45-8869-b84c39f7c0f1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:48.956704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c915fe70-4419-4c45-8869-b84c39f7c0f1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:48.992190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e5f1b6d9-bc7d-495a-ae48-fbe14b09c898 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Unlocking {{(pid=127871) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 20 04:37:49.135360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:49.238878 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e5f1b6d9-bc7d-495a-ae48-fbe14b09c898 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 202 len: 0 microversion: 2.1 time: 0.459333 Jul 20 04:37:49.242638 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2279/4332] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:48 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:49.249864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3acfae16-65a7-44b8-8e33-0b9246909fb2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:49.273442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3acfae16-65a7-44b8-8e33-0b9246909fb2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:49.273951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3acfae16-65a7-44b8-8e33-0b9246909fb2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:49.326305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3acfae16-65a7-44b8-8e33-0b9246909fb2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Going to try to stop instance {{(pid=127871) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:37:49.416121 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3acfae16-65a7-44b8-8e33-0b9246909fb2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 202 len: 0 microversion: 2.1 time: 0.171443 Jul 20 04:37:49.416932 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2280/4333] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:49 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:49.444885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4e2f939e-6820-407a-8596-8fd7096a4e95 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:49.447054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4e2f939e-6820-407a-8596-8fd7096a4e95 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:49.447854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c915fe70-4419-4c45-8869-b84c39f7c0f1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:49.455403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e2f939e-6820-407a-8596-8fd7096a4e95 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:49.456368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e2f939e-6820-407a-8596-8fd7096a4e95 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:49.457443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e2f939e-6820-407a-8596-8fd7096a4e95 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:49.458058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e2f939e-6820-407a-8596-8fd7096a4e95 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:49.463588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c915fe70-4419-4c45-8869-b84c39f7c0f1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:49.465176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c915fe70-4419-4c45-8869-b84c39f7c0f1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:49.466386 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c915fe70-4419-4c45-8869-b84c39f7c0f1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1751 microversion: 2.20 time: 0.548072 Jul 20 04:37:49.487118 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2054/4334] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:48 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1751 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:49.943500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4e2f939e-6820-407a-8596-8fd7096a4e95 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:49.958817 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4e2f939e-6820-407a-8596-8fd7096a4e95 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1679 microversion: 2.1 time: 0.524927 Jul 20 04:37:49.959486 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2281/4335] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:49 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1679 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:50.493410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f29ff63f-f7c6-438a-be92-29b640f78444 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:50.508790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f29ff63f-f7c6-438a-be92-29b640f78444 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:50.541734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f29ff63f-f7c6-438a-be92-29b640f78444 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:50.542188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f29ff63f-f7c6-438a-be92-29b640f78444 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:50.548884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f29ff63f-f7c6-438a-be92-29b640f78444 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:50.550491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f29ff63f-f7c6-438a-be92-29b640f78444 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:50.977126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9c088b60-c51d-458c-9576-d46581b4aae8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:50.978131 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9c088b60-c51d-458c-9576-d46581b4aae8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:51.000438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c088b60-c51d-458c-9576-d46581b4aae8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:51.001212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c088b60-c51d-458c-9576-d46581b4aae8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:51.002387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c088b60-c51d-458c-9576-d46581b4aae8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:51.003056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c088b60-c51d-458c-9576-d46581b4aae8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:51.300033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9c088b60-c51d-458c-9576-d46581b4aae8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:51.335930 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9c088b60-c51d-458c-9576-d46581b4aae8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1679 microversion: 2.1 time: 0.363116 Jul 20 04:37:51.336561 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2282/4336] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:50 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1679 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:52.119087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f29ff63f-f7c6-438a-be92-29b640f78444 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:52.136891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f29ff63f-f7c6-438a-be92-29b640f78444 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:52.138526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f29ff63f-f7c6-438a-be92-29b640f78444 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:52.139743 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f29ff63f-f7c6-438a-be92-29b640f78444 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1751 microversion: 2.20 time: 1.650388 Jul 20 04:37:52.154084 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2055/4337] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:50 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1751 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:52.358818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0a5636a5-a9d9-4a58-800f-ac3837216778 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:52.359761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0a5636a5-a9d9-4a58-800f-ac3837216778 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:52.370011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a5636a5-a9d9-4a58-800f-ac3837216778 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:52.371115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a5636a5-a9d9-4a58-800f-ac3837216778 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:52.372997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a5636a5-a9d9-4a58-800f-ac3837216778 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:52.374186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a5636a5-a9d9-4a58-800f-ac3837216778 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:52.822240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0a5636a5-a9d9-4a58-800f-ac3837216778 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:52.832119 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0a5636a5-a9d9-4a58-800f-ac3837216778 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1679 microversion: 2.1 time: 0.480752 Jul 20 04:37:52.846687 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2283/4338] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:52 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1679 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:53.176388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ebb4b734-c70d-4d85-86c0-536590a950ce tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:53.177855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ebb4b734-c70d-4d85-86c0-536590a950ce tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:53.187333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ebb4b734-c70d-4d85-86c0-536590a950ce tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:53.201090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ebb4b734-c70d-4d85-86c0-536590a950ce tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:53.203683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ebb4b734-c70d-4d85-86c0-536590a950ce tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:53.209615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ebb4b734-c70d-4d85-86c0-536590a950ce tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:53.678917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ebb4b734-c70d-4d85-86c0-536590a950ce tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:53.688877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ebb4b734-c70d-4d85-86c0-536590a950ce tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:53.696663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ebb4b734-c70d-4d85-86c0-536590a950ce tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:53.700009 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ebb4b734-c70d-4d85-86c0-536590a950ce tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1751 microversion: 2.20 time: 0.528647 Jul 20 04:37:53.704617 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2056/4339] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:53 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1751 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:53.860451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d76452a3-621c-4d3a-9b60-15248914b4e3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:53.865181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d76452a3-621c-4d3a-9b60-15248914b4e3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:53.896804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d76452a3-621c-4d3a-9b60-15248914b4e3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:53.897948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d76452a3-621c-4d3a-9b60-15248914b4e3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:53.901750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d76452a3-621c-4d3a-9b60-15248914b4e3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:53.902941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d76452a3-621c-4d3a-9b60-15248914b4e3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:54.360083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d76452a3-621c-4d3a-9b60-15248914b4e3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:54.369576 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d76452a3-621c-4d3a-9b60-15248914b4e3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1679 microversion: 2.1 time: 0.520917 Jul 20 04:37:54.376555 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2284/4340] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:53 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1679 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:54.725154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2103a00b-a8fa-4700-b448-319ac8159649 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:54.726375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2103a00b-a8fa-4700-b448-319ac8159649 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:54.744646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2103a00b-a8fa-4700-b448-319ac8159649 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:54.746607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2103a00b-a8fa-4700-b448-319ac8159649 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:54.749606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2103a00b-a8fa-4700-b448-319ac8159649 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:54.752707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2103a00b-a8fa-4700-b448-319ac8159649 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:55.258880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2103a00b-a8fa-4700-b448-319ac8159649 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:55.269744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2103a00b-a8fa-4700-b448-319ac8159649 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:55.277061 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2103a00b-a8fa-4700-b448-319ac8159649 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:55.278715 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2103a00b-a8fa-4700-b448-319ac8159649 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1751 microversion: 2.20 time: 0.559172 Jul 20 04:37:55.281323 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2057/4341] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:54 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1751 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:55.391364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a8b00cdd-c71f-44b6-9a1d-384825768dec tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:55.397144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a8b00cdd-c71f-44b6-9a1d-384825768dec tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:55.453047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8b00cdd-c71f-44b6-9a1d-384825768dec tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:55.456951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8b00cdd-c71f-44b6-9a1d-384825768dec tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:55.463925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8b00cdd-c71f-44b6-9a1d-384825768dec tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:55.468368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8b00cdd-c71f-44b6-9a1d-384825768dec tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:56.306129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d55443cd-315a-4587-835e-a62f2ade224d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:56.309169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d55443cd-315a-4587-835e-a62f2ade224d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:56.339714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d55443cd-315a-4587-835e-a62f2ade224d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:56.343486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d55443cd-315a-4587-835e-a62f2ade224d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:56.344497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d55443cd-315a-4587-835e-a62f2ade224d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:56.345016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d55443cd-315a-4587-835e-a62f2ade224d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:56.349805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a8b00cdd-c71f-44b6-9a1d-384825768dec tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:56.378596 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a8b00cdd-c71f-44b6-9a1d-384825768dec tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1679 microversion: 2.1 time: 0.994550 Jul 20 04:37:56.392975 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2285/4342] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:55 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1679 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:57.353069 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d55443cd-315a-4587-835e-a62f2ade224d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:57.367101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d55443cd-315a-4587-835e-a62f2ade224d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:57.372915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d55443cd-315a-4587-835e-a62f2ade224d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:57.385743 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d55443cd-315a-4587-835e-a62f2ade224d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 1.081365 Jul 20 04:37:57.393099 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2058/4343] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:56 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:57.413689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4629b237-c33d-4c09-b211-48b168cb8250 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:57.421860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4629b237-c33d-4c09-b211-48b168cb8250 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:57.442764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4629b237-c33d-4c09-b211-48b168cb8250 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:57.451750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4629b237-c33d-4c09-b211-48b168cb8250 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:57.453719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4629b237-c33d-4c09-b211-48b168cb8250 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:57.463052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4629b237-c33d-4c09-b211-48b168cb8250 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:58.097098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4629b237-c33d-4c09-b211-48b168cb8250 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:58.112966 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4629b237-c33d-4c09-b211-48b168cb8250 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1679 microversion: 2.1 time: 0.707339 Jul 20 04:37:58.119093 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2286/4344] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:57 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1679 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:58.415831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-092f8100-c121-4c05-ba65-1d6c0c6aa069 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:58.417305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-092f8100-c121-4c05-ba65-1d6c0c6aa069 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:58.445088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-092f8100-c121-4c05-ba65-1d6c0c6aa069 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:58.449927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-092f8100-c121-4c05-ba65-1d6c0c6aa069 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:58.458073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-092f8100-c121-4c05-ba65-1d6c0c6aa069 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:58.464198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-092f8100-c121-4c05-ba65-1d6c0c6aa069 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:59.138532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-406b9ef1-c9a3-4d8c-afd3-99cdc776d3a4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:59.140030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-406b9ef1-c9a3-4d8c-afd3-99cdc776d3a4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:59.152841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-406b9ef1-c9a3-4d8c-afd3-99cdc776d3a4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:59.156300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-406b9ef1-c9a3-4d8c-afd3-99cdc776d3a4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:59.157785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-406b9ef1-c9a3-4d8c-afd3-99cdc776d3a4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:59.160644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-406b9ef1-c9a3-4d8c-afd3-99cdc776d3a4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:59.243107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-092f8100-c121-4c05-ba65-1d6c0c6aa069 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:59.271385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-092f8100-c121-4c05-ba65-1d6c0c6aa069 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:59.277261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-092f8100-c121-4c05-ba65-1d6c0c6aa069 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:59.294247 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-092f8100-c121-4c05-ba65-1d6c0c6aa069 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 0.876788 Jul 20 04:37:59.295578 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2059/4345] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:58 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:59.701208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-406b9ef1-c9a3-4d8c-afd3-99cdc776d3a4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:59.720192 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-406b9ef1-c9a3-4d8c-afd3-99cdc776d3a4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1679 microversion: 2.1 time: 0.584079 Jul 20 04:37:59.725996 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2287/4346] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:59 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1679 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:00.196768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-45f189ad-d032-433e-966f-93bc8738510c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1063579618", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "33dae6e9-c68b-4989-98c8-15d5e3578fd9"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:00.317159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f8e0c072-220f-480f-8306-9544ab526d19 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:00.318690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f8e0c072-220f-480f-8306-9544ab526d19 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:00.344997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8e0c072-220f-480f-8306-9544ab526d19 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:00.346803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8e0c072-220f-480f-8306-9544ab526d19 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:00.349562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8e0c072-220f-480f-8306-9544ab526d19 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:00.352837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8e0c072-220f-480f-8306-9544ab526d19 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:00.956948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f8e0c072-220f-480f-8306-9544ab526d19 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:00.975147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f8e0c072-220f-480f-8306-9544ab526d19 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:00.976840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f8e0c072-220f-480f-8306-9544ab526d19 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:00.978064 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f8e0c072-220f-480f-8306-9544ab526d19 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 0.666829 Jul 20 04:38:00.978643 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2288/4347] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:00 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:38:00.996231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d5375865-8c88-4ca6-8901-b3a199e2dfa8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:00.996798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d5375865-8c88-4ca6-8901-b3a199e2dfa8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:01.006863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5375865-8c88-4ca6-8901-b3a199e2dfa8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.007288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5375865-8c88-4ca6-8901-b3a199e2dfa8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:01.008116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5375865-8c88-4ca6-8901-b3a199e2dfa8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.008897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5375865-8c88-4ca6-8901-b3a199e2dfa8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:01.330086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d5375865-8c88-4ca6-8901-b3a199e2dfa8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:01.342414 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d5375865-8c88-4ca6-8901-b3a199e2dfa8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1656 microversion: 2.1 time: 0.360628 Jul 20 04:38:01.343353 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2289/4348] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:00 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1656 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:01.368059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c85f9643-55a6-4dde-9132-0ebc4f2850eb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:01.409468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c85f9643-55a6-4dde-9132-0ebc4f2850eb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.412302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c85f9643-55a6-4dde-9132-0ebc4f2850eb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:01.568128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c85f9643-55a6-4dde-9132-0ebc4f2850eb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Going to try to start instance {{(pid=127871) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:38:01.726665 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c85f9643-55a6-4dde-9132-0ebc4f2850eb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 202 len: 0 microversion: 2.1 time: 0.365059 Jul 20 04:38:01.728127 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2290/4349] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:01 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:38:01.747664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d1cd7071-c815-4311-9624-f189a33156db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:01.753417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d1cd7071-c815-4311-9624-f189a33156db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:01.795736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d1cd7071-c815-4311-9624-f189a33156db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.798222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d1cd7071-c815-4311-9624-f189a33156db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:01.801760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d1cd7071-c815-4311-9624-f189a33156db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.802754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d1cd7071-c815-4311-9624-f189a33156db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:02.362602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d1cd7071-c815-4311-9624-f189a33156db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:02.389310 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d1cd7071-c815-4311-9624-f189a33156db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1665 microversion: 2.1 time: 0.648291 Jul 20 04:38:02.390092 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2291/4350] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:01 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1665 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:02.417118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c40d53e0-11ea-4dff-b73f-1eb713ddbbca tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:02.426648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c40d53e0-11ea-4dff-b73f-1eb713ddbbca tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:02.461241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c40d53e0-11ea-4dff-b73f-1eb713ddbbca tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:02.465988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c40d53e0-11ea-4dff-b73f-1eb713ddbbca tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:02.467930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c40d53e0-11ea-4dff-b73f-1eb713ddbbca tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:02.475012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c40d53e0-11ea-4dff-b73f-1eb713ddbbca tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:03.090594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c40d53e0-11ea-4dff-b73f-1eb713ddbbca tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:03.104767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c40d53e0-11ea-4dff-b73f-1eb713ddbbca tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:03.106971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c40d53e0-11ea-4dff-b73f-1eb713ddbbca tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:03.108579 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c40d53e0-11ea-4dff-b73f-1eb713ddbbca tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 0.705780 Jul 20 04:38:03.109683 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2292/4351] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:02 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:03.408191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b9e10019-f85b-4dcb-a025-0d948bc4ab43 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:03.409585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b9e10019-f85b-4dcb-a025-0d948bc4ab43 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:03.429552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9e10019-f85b-4dcb-a025-0d948bc4ab43 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:03.429552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9e10019-f85b-4dcb-a025-0d948bc4ab43 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:03.438282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9e10019-f85b-4dcb-a025-0d948bc4ab43 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:03.439144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9e10019-f85b-4dcb-a025-0d948bc4ab43 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:03.478018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=93,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:03.966214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b9e10019-f85b-4dcb-a025-0d948bc4ab43 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:03.983235 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b9e10019-f85b-4dcb-a025-0d948bc4ab43 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1665 microversion: 2.1 time: 0.580081 Jul 20 04:38:03.985477 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2293/4352] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:03 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1665 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:04.128126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e000b0a6-a71f-4d07-a8c6-c69d21dd4472 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:04.128897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e000b0a6-a71f-4d07-a8c6-c69d21dd4472 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:04.157931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e000b0a6-a71f-4d07-a8c6-c69d21dd4472 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:04.160033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e000b0a6-a71f-4d07-a8c6-c69d21dd4472 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:04.163965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e000b0a6-a71f-4d07-a8c6-c69d21dd4472 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:04.164620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e000b0a6-a71f-4d07-a8c6-c69d21dd4472 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:05.196229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e000b0a6-a71f-4d07-a8c6-c69d21dd4472 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:05.215835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e000b0a6-a71f-4d07-a8c6-c69d21dd4472 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:05.217983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e000b0a6-a71f-4d07-a8c6-c69d21dd4472 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:05.219504 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e000b0a6-a71f-4d07-a8c6-c69d21dd4472 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 1.095413 Jul 20 04:38:05.246392 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2294/4353] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:04 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:38:05.253139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6eb7f885-065c-40b6-9457-27cbf7392156 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:05.257042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6eb7f885-065c-40b6-9457-27cbf7392156 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:05.272043 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6eb7f885-065c-40b6-9457-27cbf7392156 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:05.272774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6eb7f885-065c-40b6-9457-27cbf7392156 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:05.273740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6eb7f885-065c-40b6-9457-27cbf7392156 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:05.274323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6eb7f885-065c-40b6-9457-27cbf7392156 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.218494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6eb7f885-065c-40b6-9457-27cbf7392156 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:06.251209 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6eb7f885-065c-40b6-9457-27cbf7392156 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 1.003553 Jul 20 04:38:06.251813 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2295/4354] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:05 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:06.297496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6e46e8f1-910e-4872-84d1-024dc34fdfb9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:06.298180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6e46e8f1-910e-4872-84d1-024dc34fdfb9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:06.334751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e46e8f1-910e-4872-84d1-024dc34fdfb9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.335396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e46e8f1-910e-4872-84d1-024dc34fdfb9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.336410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e46e8f1-910e-4872-84d1-024dc34fdfb9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.337151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e46e8f1-910e-4872-84d1-024dc34fdfb9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.155045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6e46e8f1-910e-4872-84d1-024dc34fdfb9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:07.165734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6e46e8f1-910e-4872-84d1-024dc34fdfb9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:07.167225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6e46e8f1-910e-4872-84d1-024dc34fdfb9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:07.172583 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6e46e8f1-910e-4872-84d1-024dc34fdfb9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 0.884465 Jul 20 04:38:07.173176 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2296/4355] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:06 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:07.210777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1b4566bb-8f13-4d85-a8b5-aa7fc324f9d8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:07.211411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1b4566bb-8f13-4d85-a8b5-aa7fc324f9d8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:07.225216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1b4566bb-8f13-4d85-a8b5-aa7fc324f9d8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.225894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1b4566bb-8f13-4d85-a8b5-aa7fc324f9d8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.226473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1b4566bb-8f13-4d85-a8b5-aa7fc324f9d8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.226909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1b4566bb-8f13-4d85-a8b5-aa7fc324f9d8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.673172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1b4566bb-8f13-4d85-a8b5-aa7fc324f9d8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:07.682060 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1b4566bb-8f13-4d85-a8b5-aa7fc324f9d8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.498505 Jul 20 04:38:07.696108 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2297/4356] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:07 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:07.701743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b9e73a68-e805-4bdb-91fe-c9f11af2813e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:07.711513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b9e73a68-e805-4bdb-91fe-c9f11af2813e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:07.727808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9e73a68-e805-4bdb-91fe-c9f11af2813e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.730809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9e73a68-e805-4bdb-91fe-c9f11af2813e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.732583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9e73a68-e805-4bdb-91fe-c9f11af2813e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.735368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9e73a68-e805-4bdb-91fe-c9f11af2813e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.827729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b9e73a68-e805-4bdb-91fe-c9f11af2813e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Unlocking {{(pid=127871) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 20 04:38:07.962937 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b9e73a68-e805-4bdb-91fe-c9f11af2813e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 202 len: 0 microversion: 2.1 time: 0.264948 Jul 20 04:38:07.965414 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2298/4357] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:07 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:38:07.975586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-151bc674-c6c8-47cc-a979-f13a93808050 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:07.976156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-151bc674-c6c8-47cc-a979-f13a93808050 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:08.020158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-151bc674-c6c8-47cc-a979-f13a93808050 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:08.021171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-151bc674-c6c8-47cc-a979-f13a93808050 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:08.024242 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-151bc674-c6c8-47cc-a979-f13a93808050 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:08.025025 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-151bc674-c6c8-47cc-a979-f13a93808050 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:08.509745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-151bc674-c6c8-47cc-a979-f13a93808050 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:08.526961 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-151bc674-c6c8-47cc-a979-f13a93808050 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.556185 Jul 20 04:38:08.528158 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2299/4358] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:07 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:08.533883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c49cc8de-0722-481f-9292-2b6dbf3ff21f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:08.535750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c49cc8de-0722-481f-9292-2b6dbf3ff21f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:08.544332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c49cc8de-0722-481f-9292-2b6dbf3ff21f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:08.545902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c49cc8de-0722-481f-9292-2b6dbf3ff21f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:08.547272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c49cc8de-0722-481f-9292-2b6dbf3ff21f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:08.548169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c49cc8de-0722-481f-9292-2b6dbf3ff21f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:08.901432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c49cc8de-0722-481f-9292-2b6dbf3ff21f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:08.922210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c49cc8de-0722-481f-9292-2b6dbf3ff21f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:08.923815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c49cc8de-0722-481f-9292-2b6dbf3ff21f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:08.925176 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c49cc8de-0722-481f-9292-2b6dbf3ff21f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 0.395509 Jul 20 04:38:08.925890 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2300/4359] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:08 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:08.940140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7802d73a-c866-4fee-9aeb-8c55a856e4e5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:08.944439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7802d73a-c866-4fee-9aeb-8c55a856e4e5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:08.961682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7802d73a-c866-4fee-9aeb-8c55a856e4e5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:08.962192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7802d73a-c866-4fee-9aeb-8c55a856e4e5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:08.963049 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7802d73a-c866-4fee-9aeb-8c55a856e4e5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:08.963489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7802d73a-c866-4fee-9aeb-8c55a856e4e5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:09.249841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:09.333229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7802d73a-c866-4fee-9aeb-8c55a856e4e5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:09.346094 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7802d73a-c866-4fee-9aeb-8c55a856e4e5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.419005 Jul 20 04:38:09.351124 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2301/4360] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:08 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:09.366602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-825256c0-b502-48d4-9e28-5ba2527398db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:09.367839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-825256c0-b502-48d4-9e28-5ba2527398db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:09.376526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-825256c0-b502-48d4-9e28-5ba2527398db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:09.377406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-825256c0-b502-48d4-9e28-5ba2527398db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:09.378556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-825256c0-b502-48d4-9e28-5ba2527398db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:09.379685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-825256c0-b502-48d4-9e28-5ba2527398db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:09.590858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-825256c0-b502-48d4-9e28-5ba2527398db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:09.611067 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-825256c0-b502-48d4-9e28-5ba2527398db tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.249031 Jul 20 04:38:09.612232 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2302/4361] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:09 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:09.645370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d04102c1-43ba-439f-a8b4-88ee7c542c4b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:09.647615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d04102c1-43ba-439f-a8b4-88ee7c542c4b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:09.676293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d04102c1-43ba-439f-a8b4-88ee7c542c4b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:09.685819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d04102c1-43ba-439f-a8b4-88ee7c542c4b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:09.687567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d04102c1-43ba-439f-a8b4-88ee7c542c4b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:09.688795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d04102c1-43ba-439f-a8b4-88ee7c542c4b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:09.849694 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d04102c1-43ba-439f-a8b4-88ee7c542c4b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 202 len: 0 microversion: 2.1 time: 0.225152 Jul 20 04:38:09.854436 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2303/4362] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:09 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:38:09.860683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6283bdf2-d858-4756-98ce-985ae7258936 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:09.861559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6283bdf2-d858-4756-98ce-985ae7258936 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:09.871644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6283bdf2-d858-4756-98ce-985ae7258936 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:09.872255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6283bdf2-d858-4756-98ce-985ae7258936 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:09.873196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6283bdf2-d858-4756-98ce-985ae7258936 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:09.873766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6283bdf2-d858-4756-98ce-985ae7258936 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.243912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6283bdf2-d858-4756-98ce-985ae7258936 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:10.253189 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6283bdf2-d858-4756-98ce-985ae7258936 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1674 microversion: 2.1 time: 0.397385 Jul 20 04:38:10.254138 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2304/4363] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:09 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1674 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:10.264480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-145e1e53-3e3b-43c8-8647-7bb9bdb43166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:10.265115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-145e1e53-3e3b-43c8-8647-7bb9bdb43166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:10.272675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=47 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:10.285578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-145e1e53-3e3b-43c8-8647-7bb9bdb43166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:10.286241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-145e1e53-3e3b-43c8-8647-7bb9bdb43166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.290033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-145e1e53-3e3b-43c8-8647-7bb9bdb43166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:10.290743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-145e1e53-3e3b-43c8-8647-7bb9bdb43166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.643838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-145e1e53-3e3b-43c8-8647-7bb9bdb43166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:10.655455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-145e1e53-3e3b-43c8-8647-7bb9bdb43166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:10.657053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-145e1e53-3e3b-43c8-8647-7bb9bdb43166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:10.658234 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-145e1e53-3e3b-43c8-8647-7bb9bdb43166 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 0.402935 Jul 20 04:38:10.669197 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2305/4364] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:10 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:11.271238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c03791b6-1b11-4dc8-8281-8be97f647aa7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:11.272204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c03791b6-1b11-4dc8-8281-8be97f647aa7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:11.285522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c03791b6-1b11-4dc8-8281-8be97f647aa7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:11.286284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c03791b6-1b11-4dc8-8281-8be97f647aa7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:11.287268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c03791b6-1b11-4dc8-8281-8be97f647aa7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:11.287875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c03791b6-1b11-4dc8-8281-8be97f647aa7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:11.327818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:11.588610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c03791b6-1b11-4dc8-8281-8be97f647aa7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:11.606377 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c03791b6-1b11-4dc8-8281-8be97f647aa7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1654 microversion: 2.1 time: 0.338028 Jul 20 04:38:11.608874 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2306/4365] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:11 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1654 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:11.632281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e46d1b0c-64c8-43c9-a1db-93e6905ffcbd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:11.633770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e46d1b0c-64c8-43c9-a1db-93e6905ffcbd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:11.646470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e46d1b0c-64c8-43c9-a1db-93e6905ffcbd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:11.648920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e46d1b0c-64c8-43c9-a1db-93e6905ffcbd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:11.650676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e46d1b0c-64c8-43c9-a1db-93e6905ffcbd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:11.651548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e46d1b0c-64c8-43c9-a1db-93e6905ffcbd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:11.784149 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e46d1b0c-64c8-43c9-a1db-93e6905ffcbd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 202 len: 0 microversion: 2.1 time: 0.155915 Jul 20 04:38:11.790549 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2307/4366] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:11 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:38:11.806103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f9fa212f-44e1-4612-92a6-7f1457049987 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:11.807050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f9fa212f-44e1-4612-92a6-7f1457049987 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:11.818664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9fa212f-44e1-4612-92a6-7f1457049987 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:11.819149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9fa212f-44e1-4612-92a6-7f1457049987 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:11.819932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9fa212f-44e1-4612-92a6-7f1457049987 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:11.820389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9fa212f-44e1-4612-92a6-7f1457049987 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.184374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f9fa212f-44e1-4612-92a6-7f1457049987 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:12.194112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f9fa212f-44e1-4612-92a6-7f1457049987 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:12.198617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f9fa212f-44e1-4612-92a6-7f1457049987 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:12.200462 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f9fa212f-44e1-4612-92a6-7f1457049987 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 0.407797 Jul 20 04:38:12.201052 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2308/4367] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:11 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:12.217021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d251270b-16b9-4931-875f-dc25fa9ec4c2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:12.217021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d251270b-16b9-4931-875f-dc25fa9ec4c2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:12.217021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d251270b-16b9-4931-875f-dc25fa9ec4c2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:12.217021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d251270b-16b9-4931-875f-dc25fa9ec4c2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.217021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d251270b-16b9-4931-875f-dc25fa9ec4c2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:12.217021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d251270b-16b9-4931-875f-dc25fa9ec4c2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.456896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d251270b-16b9-4931-875f-dc25fa9ec4c2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:12.465518 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d251270b-16b9-4931-875f-dc25fa9ec4c2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.263403 Jul 20 04:38:12.466102 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2309/4368] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:12 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:12.482166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-45f189ad-d032-433e-966f-93bc8738510c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] validate_networks() for [('33dae6e9-c68b-4989-98c8-15d5e3578fd9', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:38:12.483038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a93d1bbb-546b-403c-8f50-de89cf8c09f2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:12.483823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a93d1bbb-546b-403c-8f50-de89cf8c09f2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:12.491225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a93d1bbb-546b-403c-8f50-de89cf8c09f2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:12.491676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a93d1bbb-546b-403c-8f50-de89cf8c09f2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.492730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a93d1bbb-546b-403c-8f50-de89cf8c09f2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:12.493166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a93d1bbb-546b-403c-8f50-de89cf8c09f2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.728077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a93d1bbb-546b-403c-8f50-de89cf8c09f2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:12.747329 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a93d1bbb-546b-403c-8f50-de89cf8c09f2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.268305 Jul 20 04:38:12.752718 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2310/4369] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:12 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:12.767352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-33dfdcb8-2a01-4a8b-9fd4-e3f9626d5764 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:12.769060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-33dfdcb8-2a01-4a8b-9fd4-e3f9626d5764 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:12.780431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33dfdcb8-2a01-4a8b-9fd4-e3f9626d5764 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:12.781152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33dfdcb8-2a01-4a8b-9fd4-e3f9626d5764 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.782038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33dfdcb8-2a01-4a8b-9fd4-e3f9626d5764 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:12.782815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33dfdcb8-2a01-4a8b-9fd4-e3f9626d5764 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.995412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-33dfdcb8-2a01-4a8b-9fd4-e3f9626d5764 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:13.005035 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-33dfdcb8-2a01-4a8b-9fd4-e3f9626d5764 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.241601 Jul 20 04:38:13.016147 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2311/4370] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:12 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:13.029381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-566fc79c-8ccb-4402-8e2a-05765f52f438 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:13.030024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-566fc79c-8ccb-4402-8e2a-05765f52f438 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:13.038494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-566fc79c-8ccb-4402-8e2a-05765f52f438 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.038949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-566fc79c-8ccb-4402-8e2a-05765f52f438 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.040330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-566fc79c-8ccb-4402-8e2a-05765f52f438 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.040660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-566fc79c-8ccb-4402-8e2a-05765f52f438 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.074753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-45f189ad-d032-433e-966f-93bc8738510c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:38:13.075177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-45f189ad-d032-433e-966f-93bc8738510c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:38:13.076445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-45f189ad-d032-433e-966f-93bc8738510c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:38:13.077766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-45f189ad-d032-433e-966f-93bc8738510c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:38:13.078159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-45f189ad-d032-433e-966f-93bc8738510c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:38:13.092075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45f189ad-d032-433e-966f-93bc8738510c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.093027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45f189ad-d032-433e-966f-93bc8738510c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.094458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45f189ad-d032-433e-966f-93bc8738510c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.095116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45f189ad-d032-433e-966f-93bc8738510c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.118563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-45f189ad-d032-433e-966f-93bc8738510c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Getting quotas for project 8d3886ed2d2f495bb2e91d2a2c9e2d7d. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:13.125768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-45f189ad-d032-433e-966f-93bc8738510c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Getting quotas for user 6661a348aa374d46a23c657ed93d1505 and project 8d3886ed2d2f495bb2e91d2a2c9e2d7d. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:13.142557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-45f189ad-d032-433e-966f-93bc8738510c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:38:13.145691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-45f189ad-d032-433e-966f-93bc8738510c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:38:13.225285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-566fc79c-8ccb-4402-8e2a-05765f52f438 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:13.235048 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-45f189ad-d032-433e-966f-93bc8738510c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.497566 Jul 20 04:38:13.236093 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-566fc79c-8ccb-4402-8e2a-05765f52f438 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.212593 Jul 20 04:38:13.249637 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2312/4371] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:13 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:13.250884 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2060/4372] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:37:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 13514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:38:13.251343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-999cfabe-9686-47cf-95ed-1477ab823a0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:13.252234 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-999cfabe-9686-47cf-95ed-1477ab823a0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:13.263589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f48ac6e0-e9c6-47a6-8b80-419f8082801c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:13.264303 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f48ac6e0-e9c6-47a6-8b80-419f8082801c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:13.265875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-999cfabe-9686-47cf-95ed-1477ab823a0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.266768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-999cfabe-9686-47cf-95ed-1477ab823a0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.274147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-999cfabe-9686-47cf-95ed-1477ab823a0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.274717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-999cfabe-9686-47cf-95ed-1477ab823a0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.393618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f48ac6e0-e9c6-47a6-8b80-419f8082801c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661a348aa374d46a23c657ed93d1505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3886ed2d2f495bb2e91d2a2c9e2d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:13.404224 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f48ac6e0-e9c6-47a6-8b80-419f8082801c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc" status: 200 len: 1217 microversion: 2.1 time: 0.145828 Jul 20 04:38:13.405305 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2061/4373] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:13 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:13.410742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a4de69c7-df85-4e58-83a1-b006b65054ce tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:13.417796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a4de69c7-df85-4e58-83a1-b006b65054ce tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:13.433569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4de69c7-df85-4e58-83a1-b006b65054ce tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.434530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4de69c7-df85-4e58-83a1-b006b65054ce tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.451127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4de69c7-df85-4e58-83a1-b006b65054ce tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.456249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4de69c7-df85-4e58-83a1-b006b65054ce tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.550497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-999cfabe-9686-47cf-95ed-1477ab823a0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:13.562005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-999cfabe-9686-47cf-95ed-1477ab823a0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:13.564531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-999cfabe-9686-47cf-95ed-1477ab823a0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:13.566183 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-999cfabe-9686-47cf-95ed-1477ab823a0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 0.326391 Jul 20 04:38:13.567580 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2313/4374] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:13 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:13.719838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a4de69c7-df85-4e58-83a1-b006b65054ce tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:13.730730 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a4de69c7-df85-4e58-83a1-b006b65054ce tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.323622 Jul 20 04:38:13.731562 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2062/4375] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:13 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:13.750862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4552214e-9079-45dc-bc7d-8fcceaded0b8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:13.753264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4552214e-9079-45dc-bc7d-8fcceaded0b8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:13.761120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4552214e-9079-45dc-bc7d-8fcceaded0b8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.761778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4552214e-9079-45dc-bc7d-8fcceaded0b8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.762759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4552214e-9079-45dc-bc7d-8fcceaded0b8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.763335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4552214e-9079-45dc-bc7d-8fcceaded0b8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.979967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4552214e-9079-45dc-bc7d-8fcceaded0b8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:13.990340 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4552214e-9079-45dc-bc7d-8fcceaded0b8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.245723 Jul 20 04:38:13.991177 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2314/4376] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:13 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:14.422405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aa44cc21-df4a-4cee-adb9-d6e999bd6de1 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:14.423168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aa44cc21-df4a-4cee-adb9-d6e999bd6de1 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:14.430784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa44cc21-df4a-4cee-adb9-d6e999bd6de1 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:14.431376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa44cc21-df4a-4cee-adb9-d6e999bd6de1 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:14.432243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa44cc21-df4a-4cee-adb9-d6e999bd6de1 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:14.432897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa44cc21-df4a-4cee-adb9-d6e999bd6de1 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:14.517750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aa44cc21-df4a-4cee-adb9-d6e999bd6de1 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661a348aa374d46a23c657ed93d1505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3886ed2d2f495bb2e91d2a2c9e2d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:14.528312 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aa44cc21-df4a-4cee-adb9-d6e999bd6de1 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc" status: 200 len: 1269 microversion: 2.1 time: 0.109772 Jul 20 04:38:14.529123 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2063/4377] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:14 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc => generated 1269 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:14.592461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-704387bc-bf95-4614-bcc8-f660f37c2409 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:14.593385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-704387bc-bf95-4614-bcc8-f660f37c2409 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:14.599752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-704387bc-bf95-4614-bcc8-f660f37c2409 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:14.600204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-704387bc-bf95-4614-bcc8-f660f37c2409 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:14.601029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-704387bc-bf95-4614-bcc8-f660f37c2409 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:14.601874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-704387bc-bf95-4614-bcc8-f660f37c2409 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:15.060136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-704387bc-bf95-4614-bcc8-f660f37c2409 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:15.086992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-704387bc-bf95-4614-bcc8-f660f37c2409 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:15.088793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-704387bc-bf95-4614-bcc8-f660f37c2409 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:15.090868 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-704387bc-bf95-4614-bcc8-f660f37c2409 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 0.503677 Jul 20 04:38:15.091793 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2315/4378] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:14 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:15.546622 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b009a869-da04-40b6-a325-b9a250879a0f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:15.548597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b009a869-da04-40b6-a325-b9a250879a0f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:15.558984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b009a869-da04-40b6-a325-b9a250879a0f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:15.559872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b009a869-da04-40b6-a325-b9a250879a0f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:15.563291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b009a869-da04-40b6-a325-b9a250879a0f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:15.564465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b009a869-da04-40b6-a325-b9a250879a0f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:15.650638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b009a869-da04-40b6-a325-b9a250879a0f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661a348aa374d46a23c657ed93d1505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3886ed2d2f495bb2e91d2a2c9e2d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:15.660062 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b009a869-da04-40b6-a325-b9a250879a0f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc" status: 200 len: 1275 microversion: 2.1 time: 0.118067 Jul 20 04:38:15.670316 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2064/4379] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:15 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc => generated 1275 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:16.110134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-40a56190-2333-48fb-a12a-3fc8e5263580 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:16.110699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-40a56190-2333-48fb-a12a-3fc8e5263580 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:16.145846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40a56190-2333-48fb-a12a-3fc8e5263580 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:16.146922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40a56190-2333-48fb-a12a-3fc8e5263580 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:16.148142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40a56190-2333-48fb-a12a-3fc8e5263580 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:16.148737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40a56190-2333-48fb-a12a-3fc8e5263580 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:16.486464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-40a56190-2333-48fb-a12a-3fc8e5263580 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:16.497670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-40a56190-2333-48fb-a12a-3fc8e5263580 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:16.499251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-40a56190-2333-48fb-a12a-3fc8e5263580 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:16.501729 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-40a56190-2333-48fb-a12a-3fc8e5263580 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 0.395314 Jul 20 04:38:16.504713 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2316/4380] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:16 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:16.677589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a77f237d-7c1d-43a0-8464-a07a5c26ea3d tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:16.678224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a77f237d-7c1d-43a0-8464-a07a5c26ea3d tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:16.692382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a77f237d-7c1d-43a0-8464-a07a5c26ea3d tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:16.692832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a77f237d-7c1d-43a0-8464-a07a5c26ea3d tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:16.697440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a77f237d-7c1d-43a0-8464-a07a5c26ea3d tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:16.698094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a77f237d-7c1d-43a0-8464-a07a5c26ea3d tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:16.970841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a77f237d-7c1d-43a0-8464-a07a5c26ea3d tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661a348aa374d46a23c657ed93d1505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3886ed2d2f495bb2e91d2a2c9e2d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:16.981441 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a77f237d-7c1d-43a0-8464-a07a5c26ea3d tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc" status: 200 len: 1317 microversion: 2.1 time: 0.307879 Jul 20 04:38:16.982605 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2065/4381] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:16 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:17.331551 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-cb215c60-e50d-45cf-807c-7e6ba013bf37 req-5279a078-5335-4f5b-85dd-6ddbf158cca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d59f204-11dd-4df1-8866-29ea574868fc", "tag": "c3f63bfb-369b-4a3f-876d-400690ba1e65"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:17.343891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-cb215c60-e50d-45cf-807c-7e6ba013bf37 req-5279a078-5335-4f5b-85dd-6ddbf158cca5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:17.344618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-cb215c60-e50d-45cf-807c-7e6ba013bf37 req-5279a078-5335-4f5b-85dd-6ddbf158cca5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:17.360073 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-cb215c60-e50d-45cf-807c-7e6ba013bf37 req-5279a078-5335-4f5b-85dd-6ddbf158cca5 service nova] Creating event network-changed:c3f63bfb-369b-4a3f-876d-400690ba1e65 for instance 5d59f204-11dd-4df1-8866-29ea574868fc on n-h2-826526-5 Jul 20 04:38:17.368774 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-cb215c60-e50d-45cf-807c-7e6ba013bf37 req-5279a078-5335-4f5b-85dd-6ddbf158cca5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189804 Jul 20 04:38:17.369640 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2317/4382] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:17.530331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-43e57583-f7db-494c-b2d8-8ec4c6e29327 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:17.544095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-43e57583-f7db-494c-b2d8-8ec4c6e29327 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:17.568900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43e57583-f7db-494c-b2d8-8ec4c6e29327 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:17.569656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43e57583-f7db-494c-b2d8-8ec4c6e29327 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:17.570691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43e57583-f7db-494c-b2d8-8ec4c6e29327 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:17.576678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43e57583-f7db-494c-b2d8-8ec4c6e29327 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:17.881054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-43e57583-f7db-494c-b2d8-8ec4c6e29327 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:17.902475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-43e57583-f7db-494c-b2d8-8ec4c6e29327 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:17.904402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-43e57583-f7db-494c-b2d8-8ec4c6e29327 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:17.906720 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-43e57583-f7db-494c-b2d8-8ec4c6e29327 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 0.384399 Jul 20 04:38:17.924204 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2066/4383] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:17 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:17.999017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9c40fe56-28cc-45e9-a431-0491b271d8e8 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:17.999641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9c40fe56-28cc-45e9-a431-0491b271d8e8 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:18.012212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c40fe56-28cc-45e9-a431-0491b271d8e8 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.012950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c40fe56-28cc-45e9-a431-0491b271d8e8 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.014100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c40fe56-28cc-45e9-a431-0491b271d8e8 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.014743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c40fe56-28cc-45e9-a431-0491b271d8e8 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.439189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9c40fe56-28cc-45e9-a431-0491b271d8e8 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661a348aa374d46a23c657ed93d1505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3886ed2d2f495bb2e91d2a2c9e2d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:18.460242 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9c40fe56-28cc-45e9-a431-0491b271d8e8 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc" status: 200 len: 1317 microversion: 2.1 time: 0.465609 Jul 20 04:38:18.461114 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2318/4384] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:17 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:18.927189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-823daced-5fde-48db-a610-30eed72076f9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:18.928902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-823daced-5fde-48db-a610-30eed72076f9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:18.940008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-823daced-5fde-48db-a610-30eed72076f9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.941580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-823daced-5fde-48db-a610-30eed72076f9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.942566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-823daced-5fde-48db-a610-30eed72076f9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.948948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-823daced-5fde-48db-a610-30eed72076f9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:19.155829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-823daced-5fde-48db-a610-30eed72076f9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:19.168410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-823daced-5fde-48db-a610-30eed72076f9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:19.172481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-823daced-5fde-48db-a610-30eed72076f9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:19.175228 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-823daced-5fde-48db-a610-30eed72076f9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 0.252675 Jul 20 04:38:19.176399 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2067/4385] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:18 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:19.483016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fcf1c6fb-1757-4a87-86f0-9b0b754aab18 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:19.483905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fcf1c6fb-1757-4a87-86f0-9b0b754aab18 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:19.492795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=82 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:19.500491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcf1c6fb-1757-4a87-86f0-9b0b754aab18 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:19.504278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcf1c6fb-1757-4a87-86f0-9b0b754aab18 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:19.505190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcf1c6fb-1757-4a87-86f0-9b0b754aab18 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:19.505728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcf1c6fb-1757-4a87-86f0-9b0b754aab18 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:19.719826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fcf1c6fb-1757-4a87-86f0-9b0b754aab18 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661a348aa374d46a23c657ed93d1505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3886ed2d2f495bb2e91d2a2c9e2d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:19.729273 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fcf1c6fb-1757-4a87-86f0-9b0b754aab18 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc" status: 200 len: 1317 microversion: 2.1 time: 0.255691 Jul 20 04:38:19.730412 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2319/4386] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:19 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:20.195464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-22f3c29d-e69c-4e62-9b98-890373c1ca5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:20.196687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-22f3c29d-e69c-4e62-9b98-890373c1ca5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:20.206536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22f3c29d-e69c-4e62-9b98-890373c1ca5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.207328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22f3c29d-e69c-4e62-9b98-890373c1ca5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.208330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22f3c29d-e69c-4e62-9b98-890373c1ca5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.209110 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22f3c29d-e69c-4e62-9b98-890373c1ca5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.440084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-22f3c29d-e69c-4e62-9b98-890373c1ca5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:20.449788 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-22f3c29d-e69c-4e62-9b98-890373c1ca5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:20.451951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-22f3c29d-e69c-4e62-9b98-890373c1ca5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:20.453350 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-22f3c29d-e69c-4e62-9b98-890373c1ca5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 0.262786 Jul 20 04:38:20.453965 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2068/4387] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:20 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:20.752722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-849ff705-692c-4f75-b9f9-b0464512bb9c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:20.754009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-849ff705-692c-4f75-b9f9-b0464512bb9c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:20.762444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-849ff705-692c-4f75-b9f9-b0464512bb9c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.763223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-849ff705-692c-4f75-b9f9-b0464512bb9c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.764323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-849ff705-692c-4f75-b9f9-b0464512bb9c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.765029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-849ff705-692c-4f75-b9f9-b0464512bb9c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:21.115997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-849ff705-692c-4f75-b9f9-b0464512bb9c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661a348aa374d46a23c657ed93d1505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3886ed2d2f495bb2e91d2a2c9e2d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:21.125061 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-849ff705-692c-4f75-b9f9-b0464512bb9c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc" status: 200 len: 1317 microversion: 2.1 time: 0.377030 Jul 20 04:38:21.127436 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2320/4388] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:20 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:21.472638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f1e76171-3aca-4135-8038-44088af6cab8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:21.474282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f1e76171-3aca-4135-8038-44088af6cab8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:21.482917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1e76171-3aca-4135-8038-44088af6cab8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:21.483802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1e76171-3aca-4135-8038-44088af6cab8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:21.484833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1e76171-3aca-4135-8038-44088af6cab8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:21.485483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1e76171-3aca-4135-8038-44088af6cab8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:21.818323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f1e76171-3aca-4135-8038-44088af6cab8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:21.828501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f1e76171-3aca-4135-8038-44088af6cab8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:21.834196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f1e76171-3aca-4135-8038-44088af6cab8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:21.837956 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f1e76171-3aca-4135-8038-44088af6cab8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 0.369595 Jul 20 04:38:21.863943 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2069/4389] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:21 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:22.144569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-646dbed3-ab61-4387-a2b9-1eb172b51b3f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:22.145564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-646dbed3-ab61-4387-a2b9-1eb172b51b3f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:22.158560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-646dbed3-ab61-4387-a2b9-1eb172b51b3f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.163707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-646dbed3-ab61-4387-a2b9-1eb172b51b3f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.164975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-646dbed3-ab61-4387-a2b9-1eb172b51b3f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.165798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-646dbed3-ab61-4387-a2b9-1eb172b51b3f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.417459 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-646dbed3-ab61-4387-a2b9-1eb172b51b3f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661a348aa374d46a23c657ed93d1505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3886ed2d2f495bb2e91d2a2c9e2d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:22.434602 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-646dbed3-ab61-4387-a2b9-1eb172b51b3f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc" status: 200 len: 1317 microversion: 2.1 time: 0.294243 Jul 20 04:38:22.435237 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2321/4390] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:22 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:22.860767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-193c7b52-631e-415a-af1f-777c165d9834 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:22.862342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-193c7b52-631e-415a-af1f-777c165d9834 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:22.870566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-193c7b52-631e-415a-af1f-777c165d9834 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.872084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-193c7b52-631e-415a-af1f-777c165d9834 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.873282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-193c7b52-631e-415a-af1f-777c165d9834 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.874089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-193c7b52-631e-415a-af1f-777c165d9834 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:23.046578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-193c7b52-631e-415a-af1f-777c165d9834 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:23.081898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-193c7b52-631e-415a-af1f-777c165d9834 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:23.083872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-193c7b52-631e-415a-af1f-777c165d9834 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:23.085146 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-193c7b52-631e-415a-af1f-777c165d9834 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 0.228699 Jul 20 04:38:23.093817 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2070/4391] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:22 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:23.468785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8c757a71-dd05-43d9-93a7-cef2d92bef1a tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:23.474089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8c757a71-dd05-43d9-93a7-cef2d92bef1a tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:23.492557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c757a71-dd05-43d9-93a7-cef2d92bef1a tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:23.493451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c757a71-dd05-43d9-93a7-cef2d92bef1a tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:23.494349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c757a71-dd05-43d9-93a7-cef2d92bef1a tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:23.494923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c757a71-dd05-43d9-93a7-cef2d92bef1a tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:23.655094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8c757a71-dd05-43d9-93a7-cef2d92bef1a tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661a348aa374d46a23c657ed93d1505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3886ed2d2f495bb2e91d2a2c9e2d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:23.658806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:23.664126 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8c757a71-dd05-43d9-93a7-cef2d92bef1a tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc" status: 200 len: 1317 microversion: 2.1 time: 0.214257 Jul 20 04:38:23.673479 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2322/4392] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:23 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:24.145532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-60bd9198-96c2-43bb-a8e9-98ef4cb2f108 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:24.146313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-60bd9198-96c2-43bb-a8e9-98ef4cb2f108 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:24.156211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:24.160020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:24.167236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-60bd9198-96c2-43bb-a8e9-98ef4cb2f108 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:24.171629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-60bd9198-96c2-43bb-a8e9-98ef4cb2f108 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:24.173090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-60bd9198-96c2-43bb-a8e9-98ef4cb2f108 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:24.173817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-60bd9198-96c2-43bb-a8e9-98ef4cb2f108 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:24.546051 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-60bd9198-96c2-43bb-a8e9-98ef4cb2f108 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:24.556850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-60bd9198-96c2-43bb-a8e9-98ef4cb2f108 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:24.558607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-60bd9198-96c2-43bb-a8e9-98ef4cb2f108 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:24.559950 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-60bd9198-96c2-43bb-a8e9-98ef4cb2f108 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 0.458552 Jul 20 04:38:24.561175 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2071/4393] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:24 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:24.598991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-2bd2d17e-8f51-46c7-925a-13e49b8e8fc2 req-7c7262d9-b183-4079-b5c2-85bfd1c1cfea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ebac50-3466-4fdc-8ca1-59b0001e2581", "name": "network-vif-plugged", "status": "completed", "tag": "e0f13bf8-3ce6-42eb-a36c-5d668ff79e32"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:24.623781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-2bd2d17e-8f51-46c7-925a-13e49b8e8fc2 req-7c7262d9-b183-4079-b5c2-85bfd1c1cfea service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:24.628373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-2bd2d17e-8f51-46c7-925a-13e49b8e8fc2 req-7c7262d9-b183-4079-b5c2-85bfd1c1cfea service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:24.653605 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-2bd2d17e-8f51-46c7-925a-13e49b8e8fc2 req-7c7262d9-b183-4079-b5c2-85bfd1c1cfea service nova] Creating event network-vif-plugged:e0f13bf8-3ce6-42eb-a36c-5d668ff79e32 for instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 on n-h2-826526-5 Jul 20 04:38:24.665744 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-2bd2d17e-8f51-46c7-925a-13e49b8e8fc2 req-7c7262d9-b183-4079-b5c2-85bfd1c1cfea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070325 Jul 20 04:38:24.666395 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2323/4394] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:24.681717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-096d13a8-1b91-4939-8247-56ee09d7942b tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:24.683049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-096d13a8-1b91-4939-8247-56ee09d7942b tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:24.702836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-096d13a8-1b91-4939-8247-56ee09d7942b tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:24.710495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-096d13a8-1b91-4939-8247-56ee09d7942b tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:24.716031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-096d13a8-1b91-4939-8247-56ee09d7942b tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:24.717491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-096d13a8-1b91-4939-8247-56ee09d7942b tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:24.975610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-096d13a8-1b91-4939-8247-56ee09d7942b tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661a348aa374d46a23c657ed93d1505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3886ed2d2f495bb2e91d2a2c9e2d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:24.985567 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-096d13a8-1b91-4939-8247-56ee09d7942b tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc" status: 200 len: 1317 microversion: 2.1 time: 0.306777 Jul 20 04:38:24.995326 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2072/4395] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:24 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:25.592872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-047de091-1737-4649-aa2e-a0d559572a04 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:25.597994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-047de091-1737-4649-aa2e-a0d559572a04 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:25.616917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-047de091-1737-4649-aa2e-a0d559572a04 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:25.618035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-047de091-1737-4649-aa2e-a0d559572a04 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:25.618967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-047de091-1737-4649-aa2e-a0d559572a04 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:25.619562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-047de091-1737-4649-aa2e-a0d559572a04 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:25.869900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-047de091-1737-4649-aa2e-a0d559572a04 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:25.875200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-047de091-1737-4649-aa2e-a0d559572a04 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:25.876980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-047de091-1737-4649-aa2e-a0d559572a04 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:25.878448 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-047de091-1737-4649-aa2e-a0d559572a04 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 0.302373 Jul 20 04:38:25.881465 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2324/4396] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:25 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:26.010296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b34db16c-fb2a-41d4-8c09-8c0834b53bf1 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:26.011573 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b34db16c-fb2a-41d4-8c09-8c0834b53bf1 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:26.019334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b34db16c-fb2a-41d4-8c09-8c0834b53bf1 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:26.020000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b34db16c-fb2a-41d4-8c09-8c0834b53bf1 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:26.021030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b34db16c-fb2a-41d4-8c09-8c0834b53bf1 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:26.022775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b34db16c-fb2a-41d4-8c09-8c0834b53bf1 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:26.274429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b34db16c-fb2a-41d4-8c09-8c0834b53bf1 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661a348aa374d46a23c657ed93d1505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3886ed2d2f495bb2e91d2a2c9e2d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:26.300092 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b34db16c-fb2a-41d4-8c09-8c0834b53bf1 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc" status: 200 len: 1317 microversion: 2.1 time: 0.300401 Jul 20 04:38:26.300822 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2073/4397] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:25 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:26.692703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-40080b92-4c38-4a58-97c4-1eb7824bda46 req-45b745d6-174e-4f25-85c6-e6369346e110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d59f204-11dd-4df1-8866-29ea574868fc", "name": "network-vif-plugged", "status": "completed", "tag": "c3f63bfb-369b-4a3f-876d-400690ba1e65"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:26.718645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-40080b92-4c38-4a58-97c4-1eb7824bda46 req-45b745d6-174e-4f25-85c6-e6369346e110 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:26.719227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-40080b92-4c38-4a58-97c4-1eb7824bda46 req-45b745d6-174e-4f25-85c6-e6369346e110 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:26.734559 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-40080b92-4c38-4a58-97c4-1eb7824bda46 req-45b745d6-174e-4f25-85c6-e6369346e110 service nova] Creating event network-vif-plugged:c3f63bfb-369b-4a3f-876d-400690ba1e65 for instance 5d59f204-11dd-4df1-8866-29ea574868fc on n-h2-826526-5 Jul 20 04:38:26.741350 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-40080b92-4c38-4a58-97c4-1eb7824bda46 req-45b745d6-174e-4f25-85c6-e6369346e110 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054250 Jul 20 04:38:26.747559 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2325/4398] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:26.899927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4d0b931e-18d1-430e-bd7a-8f5f55aa01c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:26.900741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4d0b931e-18d1-430e-bd7a-8f5f55aa01c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:26.908735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d0b931e-18d1-430e-bd7a-8f5f55aa01c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:26.909193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d0b931e-18d1-430e-bd7a-8f5f55aa01c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:26.909972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d0b931e-18d1-430e-bd7a-8f5f55aa01c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:26.910407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d0b931e-18d1-430e-bd7a-8f5f55aa01c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:27.098857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4d0b931e-18d1-430e-bd7a-8f5f55aa01c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:27.108284 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4d0b931e-18d1-430e-bd7a-8f5f55aa01c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:27.109812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4d0b931e-18d1-430e-bd7a-8f5f55aa01c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:27.111080 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4d0b931e-18d1-430e-bd7a-8f5f55aa01c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1807 microversion: 2.20 time: 0.215793 Jul 20 04:38:27.111676 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2074/4399] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:26 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:27.318864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9d2f2b8d-b15e-4b1a-8f29-cef466117d9d tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:27.319565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9d2f2b8d-b15e-4b1a-8f29-cef466117d9d tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:27.329489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d2f2b8d-b15e-4b1a-8f29-cef466117d9d tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:27.330103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d2f2b8d-b15e-4b1a-8f29-cef466117d9d tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:27.330956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d2f2b8d-b15e-4b1a-8f29-cef466117d9d tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:27.331388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d2f2b8d-b15e-4b1a-8f29-cef466117d9d tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:27.497054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9d2f2b8d-b15e-4b1a-8f29-cef466117d9d tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661a348aa374d46a23c657ed93d1505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3886ed2d2f495bb2e91d2a2c9e2d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:27.505679 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9d2f2b8d-b15e-4b1a-8f29-cef466117d9d tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc" status: 200 len: 1317 microversion: 2.1 time: 0.191112 Jul 20 04:38:27.506411 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2326/4400] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:27 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:28.129692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7d6a003a-78f1-460b-8e0e-726437b9996b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:28.130331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7d6a003a-78f1-460b-8e0e-726437b9996b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:28.144130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d6a003a-78f1-460b-8e0e-726437b9996b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:28.144797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d6a003a-78f1-460b-8e0e-726437b9996b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:28.145725 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d6a003a-78f1-460b-8e0e-726437b9996b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:28.146330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d6a003a-78f1-460b-8e0e-726437b9996b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:28.291537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7d6a003a-78f1-460b-8e0e-726437b9996b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:28.300797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7d6a003a-78f1-460b-8e0e-726437b9996b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:28.302885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7d6a003a-78f1-460b-8e0e-726437b9996b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:28.304140 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7d6a003a-78f1-460b-8e0e-726437b9996b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1794 microversion: 2.20 time: 0.178963 Jul 20 04:38:28.316731 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2075/4401] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:28 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1794 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:38:28.523577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-610fea33-90d0-42c9-97e1-1389b677aad0 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:28.525297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-610fea33-90d0-42c9-97e1-1389b677aad0 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:28.533871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-610fea33-90d0-42c9-97e1-1389b677aad0 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:28.534419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-610fea33-90d0-42c9-97e1-1389b677aad0 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:28.535484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-610fea33-90d0-42c9-97e1-1389b677aad0 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:28.535918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-610fea33-90d0-42c9-97e1-1389b677aad0 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:28.681208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-610fea33-90d0-42c9-97e1-1389b677aad0 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661a348aa374d46a23c657ed93d1505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3886ed2d2f495bb2e91d2a2c9e2d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:28.691399 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-610fea33-90d0-42c9-97e1-1389b677aad0 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc" status: 200 len: 1506 microversion: 2.1 time: 0.172119 Jul 20 04:38:28.692352 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2327/4402] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:28 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:28.710609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f83fefce-9cd6-46af-a64b-2e6542a5fed4 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:28.711101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f83fefce-9cd6-46af-a64b-2e6542a5fed4 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:28.717803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f83fefce-9cd6-46af-a64b-2e6542a5fed4 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:28.718255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f83fefce-9cd6-46af-a64b-2e6542a5fed4 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:28.719021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f83fefce-9cd6-46af-a64b-2e6542a5fed4 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:28.719458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f83fefce-9cd6-46af-a64b-2e6542a5fed4 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:28.745413 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f83fefce-9cd6-46af-a64b-2e6542a5fed4 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc/ips" status: 200 len: 109 microversion: 2.1 time: 0.038977 Jul 20 04:38:28.746495 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2076/4403] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 04:38:28 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc/ips => generated 109 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:28.761649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a6570ef6-d917-4196-8159-3c032400652c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:28.762085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a6570ef6-d917-4196-8159-3c032400652c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:28.769627 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a6570ef6-d917-4196-8159-3c032400652c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:28.770277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a6570ef6-d917-4196-8159-3c032400652c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:28.771211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a6570ef6-d917-4196-8159-3c032400652c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:28.771783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a6570ef6-d917-4196-8159-3c032400652c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:28.806684 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a6570ef6-d917-4196-8159-3c032400652c tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc/ips" status: 200 len: 109 microversion: 2.1 time: 0.041873 Jul 20 04:38:28.806684 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2328/4404] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 04:38:28 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc/ips => generated 109 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:28.809383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-495e2ed3-d0a3-429e-879e-c65405996aef tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:28.809881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-495e2ed3-d0a3-429e-879e-c65405996aef tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:28.817135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-495e2ed3-d0a3-429e-879e-c65405996aef tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:28.817598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-495e2ed3-d0a3-429e-879e-c65405996aef tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:28.818378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-495e2ed3-d0a3-429e-879e-c65405996aef tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:28.818984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-495e2ed3-d0a3-429e-879e-c65405996aef tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:28.847712 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-495e2ed3-d0a3-429e-879e-c65405996aef tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc/ips/tempest-ServerAddressesTestJSON-1201567045-network" status: 200 len: 94 microversion: 2.1 time: 0.042308 Jul 20 04:38:28.848730 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2077/4405] 10.222.0.17 () {58 vars in 1400 bytes} [Wed Jul 20 04:38:28 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc/ips/tempest-ServerAddressesTestJSON-1201567045-network => generated 94 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:38:28.861608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-90599023-293c-4360-b079-3caa1117b609 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:28.862101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-90599023-293c-4360-b079-3caa1117b609 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:28.873672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-90599023-293c-4360-b079-3caa1117b609 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:28.876020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-90599023-293c-4360-b079-3caa1117b609 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:28.877905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-90599023-293c-4360-b079-3caa1117b609 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:28.880054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-90599023-293c-4360-b079-3caa1117b609 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:28.923891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-90599023-293c-4360-b079-3caa1117b609 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:38:29.031490 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-90599023-293c-4360-b079-3caa1117b609 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc" status: 204 len: 0 microversion: 2.1 time: 0.172547 Jul 20 04:38:29.032098 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2329/4406] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:38:28 2022] DELETE /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:38:29.046875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3f03059a-88f2-47b4-bb76-e1c38aec769f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:29.047504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3f03059a-88f2-47b4-bb76-e1c38aec769f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:29.054598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f03059a-88f2-47b4-bb76-e1c38aec769f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:29.055064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f03059a-88f2-47b4-bb76-e1c38aec769f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:29.063032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f03059a-88f2-47b4-bb76-e1c38aec769f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:29.063603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f03059a-88f2-47b4-bb76-e1c38aec769f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:29.227992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3f03059a-88f2-47b4-bb76-e1c38aec769f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661a348aa374d46a23c657ed93d1505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3886ed2d2f495bb2e91d2a2c9e2d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:29.235832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:29.240000 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3f03059a-88f2-47b4-bb76-e1c38aec769f tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc" status: 200 len: 1512 microversion: 2.1 time: 0.202826 Jul 20 04:38:29.242296 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2078/4407] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:29 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc => generated 1512 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:30.267975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e1b5e353-1842-4d3e-ae1b-92ef90fbe0df tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:30.269202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e1b5e353-1842-4d3e-ae1b-92ef90fbe0df tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:30.279045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1b5e353-1842-4d3e-ae1b-92ef90fbe0df tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:30.279818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1b5e353-1842-4d3e-ae1b-92ef90fbe0df tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:30.280815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1b5e353-1842-4d3e-ae1b-92ef90fbe0df tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:30.281398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1b5e353-1842-4d3e-ae1b-92ef90fbe0df tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:30.540874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e1b5e353-1842-4d3e-ae1b-92ef90fbe0df tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661a348aa374d46a23c657ed93d1505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3886ed2d2f495bb2e91d2a2c9e2d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:30.553153 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e1b5e353-1842-4d3e-ae1b-92ef90fbe0df tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc" status: 200 len: 1512 microversion: 2.1 time: 0.297108 Jul 20 04:38:30.554956 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2330/4408] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:30 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc => generated 1512 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:31.147231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-6acea06b-7d44-43a3-8521-9a60b0184031 req-06f466ac-c095-4587-a9bd-4a28db26e183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d59f204-11dd-4df1-8866-29ea574868fc", "name": "network-vif-deleted", "tag": "c3f63bfb-369b-4a3f-876d-400690ba1e65"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:31.164708 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6acea06b-7d44-43a3-8521-9a60b0184031 req-06f466ac-c095-4587-a9bd-4a28db26e183 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:31.165375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6acea06b-7d44-43a3-8521-9a60b0184031 req-06f466ac-c095-4587-a9bd-4a28db26e183 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:31.180079 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-6acea06b-7d44-43a3-8521-9a60b0184031 req-06f466ac-c095-4587-a9bd-4a28db26e183 service nova] Creating event network-vif-deleted:c3f63bfb-369b-4a3f-876d-400690ba1e65 for instance 5d59f204-11dd-4df1-8866-29ea574868fc on n-h2-826526-5 Jul 20 04:38:31.188633 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-6acea06b-7d44-43a3-8521-9a60b0184031 req-06f466ac-c095-4587-a9bd-4a28db26e183 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048234 Jul 20 04:38:31.198466 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2079/4409] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:38:31.578278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6ebbd062-f25a-46a8-bce7-e58820e302af tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:31.579603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6ebbd062-f25a-46a8-bce7-e58820e302af tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:31.600600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ebbd062-f25a-46a8-bce7-e58820e302af tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:31.605848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ebbd062-f25a-46a8-bce7-e58820e302af tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:31.607038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ebbd062-f25a-46a8-bce7-e58820e302af tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:31.617763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ebbd062-f25a-46a8-bce7-e58820e302af tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:31.703859 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ebbd062-f25a-46a8-bce7-e58820e302af tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:31.704604 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ebbd062-f25a-46a8-bce7-e58820e302af tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:31.705249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-6ebbd062-f25a-46a8-bce7-e58820e302af tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lazy-loading 'fault' on Instance uuid 5d59f204-11dd-4df1-8866-29ea574868fc {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:38:31.754935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6ebbd062-f25a-46a8-bce7-e58820e302af tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661a348aa374d46a23c657ed93d1505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3886ed2d2f495bb2e91d2a2c9e2d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:31.767126 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6ebbd062-f25a-46a8-bce7-e58820e302af tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc" status: 200 len: 1307 microversion: 2.1 time: 0.197924 Jul 20 04:38:31.768401 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2331/4410] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:31 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc => generated 1307 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:32.787719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-51434e17-faf4-42b8-8d6e-8b9501df9d50 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:32.788483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-51434e17-faf4-42b8-8d6e-8b9501df9d50 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] [instance: 5d59f204-11dd-4df1-8866-29ea574868fc] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:32.797527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-51434e17-faf4-42b8-8d6e-8b9501df9d50 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:32.798078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-51434e17-faf4-42b8-8d6e-8b9501df9d50 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:32.798952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-51434e17-faf4-42b8-8d6e-8b9501df9d50 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:32.799625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-51434e17-faf4-42b8-8d6e-8b9501df9d50 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:32.817489 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-51434e17-faf4-42b8-8d6e-8b9501df9d50 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] HTTP exception thrown: Instance 5d59f204-11dd-4df1-8866-29ea574868fc could not be found. Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-51434e17-faf4-42b8-8d6e-8b9501df9d50 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Request method failure captured: Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc HTTP/1.1 Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14anNqpicFUbLVQmtuOZwoWO8kPE1MGhRs-BQh5h1VvKe-9VcEJFaOGKQvrmfALTt54qapNgWSXv3deIoFuKeCM-tXb7QxxZWowRZfwBPaeiDxakx-NsTp4ZmvulO4-SKzAFQof0PzHk8UxQXSBX1Puc5i5C1is0Rw3FElhxKuA6Buk Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 8d3886ed2d2f495bb2e91d2a2c9e2d7d Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerAddressesTestJSON-423775099 Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d3886ed2d2f495bb2e91d2a2c9e2d7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8d3886ed2d2f495bb2e91d2a2c9e2d7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8d3886ed2d2f495bb2e91d2a2c9e2d7d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d3886ed2d2f495bb2e91d2a2c9e2d7d"}]}] Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerAddressesTestJSON-423775099 Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 8d3886ed2d2f495bb2e91d2a2c9e2d7d Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerAddressesTestJSON-423775099 Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerAddressesTestJSON-423775099-project Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 6661a348aa374d46a23c657ed93d1505 Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerAddressesTestJSON-423775099-project Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 5d59f204-11dd-4df1-8866-29ea574868fc could not be found. Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '5d59f204-11dd-4df1-8866-29ea574868fc'} Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d59f204-11dd-4df1-8866-29ea574868fc could not be found. Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d59f204-11dd-4df1-8866-29ea574868fc could not be found. Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:32.819229 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:38:32.822522 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:32.822522 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:32.822522 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:32.822522 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:32.822522 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:32.822522 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d59f204-11dd-4df1-8866-29ea574868fc could not be found. Jul 20 04:38:32.822522 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:38:32.822522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-51434e17-faf4-42b8-8d6e-8b9501df9d50 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] Returning 404 to user: Instance 5d59f204-11dd-4df1-8866-29ea574868fc could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:32.822522 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-51434e17-faf4-42b8-8d6e-8b9501df9d50 tempest-ServerAddressesTestJSON-423775099 tempest-ServerAddressesTestJSON-423775099-project] 10.222.0.17 "GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc" status: 404 len: 111 microversion: 2.1 time: 0.040617 Jul 20 04:38:32.825615 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2080/4411] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:32 2022] GET /compute/v2.1/servers/5d59f204-11dd-4df1-8866-29ea574868fc => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:38:46.282419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:46.283962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:46.453913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-889b45bc-1ea2-490b-a413-1f50ce859bc9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:46.455690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-889b45bc-1ea2-490b-a413-1f50ce859bc9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:46.463470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:46.464379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:46.475711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-889b45bc-1ea2-490b-a413-1f50ce859bc9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:46.478788 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-889b45bc-1ea2-490b-a413-1f50ce859bc9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:46.481830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-889b45bc-1ea2-490b-a413-1f50ce859bc9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:46.482994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-889b45bc-1ea2-490b-a413-1f50ce859bc9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:46.545008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b0e49b74-a532-4747-8367-643be1fca716 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1758444062", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "86101e11-efae-46cc-8b8e-9e6e2e11c9d0"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:46.666366 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-889b45bc-1ea2-490b-a413-1f50ce859bc9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 202 len: 0 microversion: 2.1 time: 0.215466 Jul 20 04:38:46.667526 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2081/4412] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:46 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:38:46.684809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-b0e49b74-a532-4747-8367-643be1fca716 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] validate_networks() for [('86101e11-efae-46cc-8b8e-9e6e2e11c9d0', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:38:46.711272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-97aa8fb3-4048-40db-bf35-310bdc617305 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:46.712467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-97aa8fb3-4048-40db-bf35-310bdc617305 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:46.725002 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97aa8fb3-4048-40db-bf35-310bdc617305 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:46.725727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97aa8fb3-4048-40db-bf35-310bdc617305 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:46.726923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97aa8fb3-4048-40db-bf35-310bdc617305 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:46.727600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97aa8fb3-4048-40db-bf35-310bdc617305 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:46.986986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-97aa8fb3-4048-40db-bf35-310bdc617305 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:47.000635 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-97aa8fb3-4048-40db-bf35-310bdc617305 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1671 microversion: 2.1 time: 0.303388 Jul 20 04:38:47.016325 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2082/4413] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:46 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1671 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:48.024222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-01c74556-92bd-4946-821a-09e0c5616a89 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:48.025066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-01c74556-92bd-4946-821a-09e0c5616a89 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:48.049523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01c74556-92bd-4946-821a-09e0c5616a89 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:48.053158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01c74556-92bd-4946-821a-09e0c5616a89 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:48.056011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01c74556-92bd-4946-821a-09e0c5616a89 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:48.057656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01c74556-92bd-4946-821a-09e0c5616a89 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:48.110438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b0e49b74-a532-4747-8367-643be1fca716 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:38:48.110888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b0e49b74-a532-4747-8367-643be1fca716 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:38:48.111435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b0e49b74-a532-4747-8367-643be1fca716 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:38:48.111849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b0e49b74-a532-4747-8367-643be1fca716 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:38:48.112555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b0e49b74-a532-4747-8367-643be1fca716 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:38:48.131609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b0e49b74-a532-4747-8367-643be1fca716 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:48.132145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b0e49b74-a532-4747-8367-643be1fca716 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:48.133532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b0e49b74-a532-4747-8367-643be1fca716 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:48.134069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b0e49b74-a532-4747-8367-643be1fca716 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:48.176137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-b0e49b74-a532-4747-8367-643be1fca716 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Getting quotas for project c7f1f114b3bb4dfa867b8a263972d2cf. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:48.188244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-b0e49b74-a532-4747-8367-643be1fca716 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Getting quotas for user 4861bb0b7fcc41babe0dc65d3014df70 and project c7f1f114b3bb4dfa867b8a263972d2cf. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:48.208704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b0e49b74-a532-4747-8367-643be1fca716 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:38:48.211491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b0e49b74-a532-4747-8367-643be1fca716 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] [instance: 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:38:48.282322 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b0e49b74-a532-4747-8367-643be1fca716 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.010074 Jul 20 04:38:48.284384 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2332/4414] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:38:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:38:48.297267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0ecfb617-cca0-4b10-b6c1-e71b2a98a3fe tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:48.298302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0ecfb617-cca0-4b10-b6c1-e71b2a98a3fe tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] [instance: 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:48.480941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0ecfb617-cca0-4b10-b6c1-e71b2a98a3fe tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4861bb0b7fcc41babe0dc65d3014df70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f1f114b3bb4dfa867b8a263972d2cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:48.490004 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0ecfb617-cca0-4b10-b6c1-e71b2a98a3fe tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29" status: 200 len: 1225 microversion: 2.1 time: 0.197926 Jul 20 04:38:48.495953 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2333/4415] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:48 2022] GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 => generated 1225 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:48.538298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-01c74556-92bd-4946-821a-09e0c5616a89 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:48.552139 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-01c74556-92bd-4946-821a-09e0c5616a89 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1671 microversion: 2.1 time: 0.533068 Jul 20 04:38:48.564382 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2083/4416] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:48 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1671 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:49.515090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d01c4680-fdf4-44cc-ab4f-6ac0504b3f78 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:49.515658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d01c4680-fdf4-44cc-ab4f-6ac0504b3f78 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] [instance: 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:49.564760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d01c4680-fdf4-44cc-ab4f-6ac0504b3f78 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:49.565340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d01c4680-fdf4-44cc-ab4f-6ac0504b3f78 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:49.573344 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c09e7b44-0eac-4335-8bb5-0725dde5f8fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:49.573881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d01c4680-fdf4-44cc-ab4f-6ac0504b3f78 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:49.574124 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d01c4680-fdf4-44cc-ab4f-6ac0504b3f78 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:49.575559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c09e7b44-0eac-4335-8bb5-0725dde5f8fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:49.594922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c09e7b44-0eac-4335-8bb5-0725dde5f8fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:49.596331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c09e7b44-0eac-4335-8bb5-0725dde5f8fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:49.599544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c09e7b44-0eac-4335-8bb5-0725dde5f8fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:49.604170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c09e7b44-0eac-4335-8bb5-0725dde5f8fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:49.676688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d01c4680-fdf4-44cc-ab4f-6ac0504b3f78 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4861bb0b7fcc41babe0dc65d3014df70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f1f114b3bb4dfa867b8a263972d2cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:49.699261 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d01c4680-fdf4-44cc-ab4f-6ac0504b3f78 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29" status: 200 len: 1221 microversion: 2.1 time: 0.189234 Jul 20 04:38:49.702278 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2334/4417] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:49 2022] GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 => generated 1221 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:49.925857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c09e7b44-0eac-4335-8bb5-0725dde5f8fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:49.944874 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c09e7b44-0eac-4335-8bb5-0725dde5f8fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.376839 Jul 20 04:38:49.958947 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2084/4418] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:49 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:50.721861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1d0a8332-c97e-44fe-93a3-e1c72919385a tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:50.736173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1d0a8332-c97e-44fe-93a3-e1c72919385a tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] [instance: 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:50.760053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d0a8332-c97e-44fe-93a3-e1c72919385a tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:50.760831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d0a8332-c97e-44fe-93a3-e1c72919385a tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:50.761728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d0a8332-c97e-44fe-93a3-e1c72919385a tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:50.762393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d0a8332-c97e-44fe-93a3-e1c72919385a tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:50.914561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1d0a8332-c97e-44fe-93a3-e1c72919385a tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4861bb0b7fcc41babe0dc65d3014df70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f1f114b3bb4dfa867b8a263972d2cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:50.940669 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1d0a8332-c97e-44fe-93a3-e1c72919385a tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29" status: 200 len: 1283 microversion: 2.1 time: 0.222068 Jul 20 04:38:50.943172 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2335/4419] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:50 2022] GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 => generated 1283 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:51.957642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fe3e3217-8cdd-45a1-b59d-6803fc4c3c8f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:51.959174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fe3e3217-8cdd-45a1-b59d-6803fc4c3c8f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] [instance: 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:51.972962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe3e3217-8cdd-45a1-b59d-6803fc4c3c8f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:51.974584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe3e3217-8cdd-45a1-b59d-6803fc4c3c8f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:51.978475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe3e3217-8cdd-45a1-b59d-6803fc4c3c8f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:51.980726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe3e3217-8cdd-45a1-b59d-6803fc4c3c8f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:52.237477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fe3e3217-8cdd-45a1-b59d-6803fc4c3c8f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4861bb0b7fcc41babe0dc65d3014df70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f1f114b3bb4dfa867b8a263972d2cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:52.269720 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fe3e3217-8cdd-45a1-b59d-6803fc4c3c8f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29" status: 200 len: 1325 microversion: 2.1 time: 0.310873 Jul 20 04:38:52.270544 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2085/4420] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:51 2022] GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 => generated 1325 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:52.835558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-29613312-4c07-4969-9324-f02548ea9329 req-e8cfb15e-670d-4e12-a769-c403250ef314 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29", "tag": "2da298b5-425d-46ec-a8cb-84df6dfeddb8"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:52.867683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-29613312-4c07-4969-9324-f02548ea9329 req-e8cfb15e-670d-4e12-a769-c403250ef314 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:52.875449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-29613312-4c07-4969-9324-f02548ea9329 req-e8cfb15e-670d-4e12-a769-c403250ef314 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:52.911527 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-29613312-4c07-4969-9324-f02548ea9329 req-e8cfb15e-670d-4e12-a769-c403250ef314 service nova] Creating event network-changed:2da298b5-425d-46ec-a8cb-84df6dfeddb8 for instance 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 on n-h2-826526-5 Jul 20 04:38:52.938872 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-29613312-4c07-4969-9324-f02548ea9329 req-e8cfb15e-670d-4e12-a769-c403250ef314 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105283 Jul 20 04:38:52.940289 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2336/4421] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:53.292321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e6a4421b-de43-4f59-8452-ed35a5405f6d tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:53.293112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e6a4421b-de43-4f59-8452-ed35a5405f6d tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] [instance: 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:53.306647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6a4421b-de43-4f59-8452-ed35a5405f6d tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:53.307747 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6a4421b-de43-4f59-8452-ed35a5405f6d tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:53.311013 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6a4421b-de43-4f59-8452-ed35a5405f6d tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:53.311679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6a4421b-de43-4f59-8452-ed35a5405f6d tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:53.644848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e6a4421b-de43-4f59-8452-ed35a5405f6d tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4861bb0b7fcc41babe0dc65d3014df70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f1f114b3bb4dfa867b8a263972d2cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:53.653886 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e6a4421b-de43-4f59-8452-ed35a5405f6d tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29" status: 200 len: 1325 microversion: 2.1 time: 0.370585 Jul 20 04:38:53.654487 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2086/4422] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:53 2022] GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 => generated 1325 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:54.673774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d73a96e1-14a1-4152-b268-4d314fc4e8ff tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:54.674563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d73a96e1-14a1-4152-b268-4d314fc4e8ff tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] [instance: 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:54.685490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d73a96e1-14a1-4152-b268-4d314fc4e8ff tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:54.686173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d73a96e1-14a1-4152-b268-4d314fc4e8ff tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:54.687096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d73a96e1-14a1-4152-b268-4d314fc4e8ff tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:54.687672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d73a96e1-14a1-4152-b268-4d314fc4e8ff tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:54.949001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d73a96e1-14a1-4152-b268-4d314fc4e8ff tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4861bb0b7fcc41babe0dc65d3014df70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f1f114b3bb4dfa867b8a263972d2cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:54.957541 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d73a96e1-14a1-4152-b268-4d314fc4e8ff tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29" status: 200 len: 1325 microversion: 2.1 time: 0.290297 Jul 20 04:38:54.960298 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2337/4423] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:54 2022] GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 => generated 1325 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:55.978684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a0beb549-9d94-4f66-b011-735b7be23753 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:55.980408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a0beb549-9d94-4f66-b011-735b7be23753 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] [instance: 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:55.989042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0beb549-9d94-4f66-b011-735b7be23753 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:55.989733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0beb549-9d94-4f66-b011-735b7be23753 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:55.990874 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0beb549-9d94-4f66-b011-735b7be23753 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:55.991513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0beb549-9d94-4f66-b011-735b7be23753 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:56.197972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a0beb549-9d94-4f66-b011-735b7be23753 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4861bb0b7fcc41babe0dc65d3014df70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f1f114b3bb4dfa867b8a263972d2cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:56.210263 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a0beb549-9d94-4f66-b011-735b7be23753 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29" status: 200 len: 1325 microversion: 2.1 time: 0.237175 Jul 20 04:38:56.214051 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2087/4424] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:55 2022] GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 => generated 1325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:57.212738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-29c60317-2673-468b-9c04-00e7ae005ada tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:57.213229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-29c60317-2673-468b-9c04-00e7ae005ada tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:57.221627 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29c60317-2673-468b-9c04-00e7ae005ada tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.223829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29c60317-2673-468b-9c04-00e7ae005ada tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.226609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29c60317-2673-468b-9c04-00e7ae005ada tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.230118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aabf92dd-0d9d-4fab-81a5-dbaef183692f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:57.230764 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aabf92dd-0d9d-4fab-81a5-dbaef183692f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] [instance: 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:57.231415 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29c60317-2673-468b-9c04-00e7ae005ada tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.241195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aabf92dd-0d9d-4fab-81a5-dbaef183692f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.241650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aabf92dd-0d9d-4fab-81a5-dbaef183692f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.242529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aabf92dd-0d9d-4fab-81a5-dbaef183692f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.242865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aabf92dd-0d9d-4fab-81a5-dbaef183692f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.306502 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-29c60317-2673-468b-9c04-00e7ae005ada tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments/70f2e351-1bc7-4294-8b32-e3a5745212bb" status: 200 len: 194 microversion: 2.20 time: 0.097742 Jul 20 04:38:57.317352 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2338/4425] 10.222.0.17 () {60 vars in 1453 bytes} [Wed Jul 20 04:38:57 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments/70f2e351-1bc7-4294-8b32-e3a5745212bb => generated 194 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:38:57.440452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-33bfcbfa-9cd7-4f10-b198-5c8937aaf1e5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:57.441162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-33bfcbfa-9cd7-4f10-b198-5c8937aaf1e5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:57.448191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33bfcbfa-9cd7-4f10-b198-5c8937aaf1e5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.449010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33bfcbfa-9cd7-4f10-b198-5c8937aaf1e5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.449930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33bfcbfa-9cd7-4f10-b198-5c8937aaf1e5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.450612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33bfcbfa-9cd7-4f10-b198-5c8937aaf1e5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.585405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aabf92dd-0d9d-4fab-81a5-dbaef183692f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4861bb0b7fcc41babe0dc65d3014df70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f1f114b3bb4dfa867b8a263972d2cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:57.596131 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aabf92dd-0d9d-4fab-81a5-dbaef183692f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29" status: 200 len: 1325 microversion: 2.1 time: 0.370055 Jul 20 04:38:57.597262 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2088/4426] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:57 2022] GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 => generated 1325 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:57.629255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-33bfcbfa-9cd7-4f10-b198-5c8937aaf1e5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lazy-loading 'services' on Instance uuid 90ebac50-3466-4fdc-8ca1-59b0001e2581 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:38:57.713790 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-33bfcbfa-9cd7-4f10-b198-5c8937aaf1e5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "DELETE /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments/70f2e351-1bc7-4294-8b32-e3a5745212bb" status: 202 len: 0 microversion: 2.20 time: 0.276827 Jul 20 04:38:57.715748 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2339/4427] 10.222.0.17 () {60 vars in 1456 bytes} [Wed Jul 20 04:38:57 2022] DELETE /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments/70f2e351-1bc7-4294-8b32-e3a5745212bb => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:38:57.723244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8094b5e4-ef74-4424-bafa-3038b9163fb3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:57.724243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8094b5e4-ef74-4424-bafa-3038b9163fb3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:57.749093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8094b5e4-ef74-4424-bafa-3038b9163fb3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.750028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8094b5e4-ef74-4424-bafa-3038b9163fb3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.751712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8094b5e4-ef74-4424-bafa-3038b9163fb3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.752796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8094b5e4-ef74-4424-bafa-3038b9163fb3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.871525 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8094b5e4-ef74-4424-bafa-3038b9163fb3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.152097 Jul 20 04:38:57.872692 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2089/4428] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:38:57 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:38:58.145444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-f710dc28-ed1d-4d2f-aa8a-9156c2bfe7de req-b99fcd66-2504-474c-b956-65005bd73af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29", "name": "network-vif-plugged", "status": "completed", "tag": "2da298b5-425d-46ec-a8cb-84df6dfeddb8"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:58.149745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:58.164814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f710dc28-ed1d-4d2f-aa8a-9156c2bfe7de req-b99fcd66-2504-474c-b956-65005bd73af0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:58.165267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f710dc28-ed1d-4d2f-aa8a-9156c2bfe7de req-b99fcd66-2504-474c-b956-65005bd73af0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:58.196468 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-f710dc28-ed1d-4d2f-aa8a-9156c2bfe7de req-b99fcd66-2504-474c-b956-65005bd73af0 service nova] Creating event network-vif-plugged:2da298b5-425d-46ec-a8cb-84df6dfeddb8 for instance 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 on n-h2-826526-5 Jul 20 04:38:58.205967 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-f710dc28-ed1d-4d2f-aa8a-9156c2bfe7de req-b99fcd66-2504-474c-b956-65005bd73af0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068474 Jul 20 04:38:58.209429 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2340/4429] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:58.613064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e4357dd4-2084-4fa2-aba9-37394576dcb6 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:58.613833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e4357dd4-2084-4fa2-aba9-37394576dcb6 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] [instance: 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:58.631925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4357dd4-2084-4fa2-aba9-37394576dcb6 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:58.632418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4357dd4-2084-4fa2-aba9-37394576dcb6 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:58.633522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4357dd4-2084-4fa2-aba9-37394576dcb6 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:58.633964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4357dd4-2084-4fa2-aba9-37394576dcb6 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:58.804135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e4357dd4-2084-4fa2-aba9-37394576dcb6 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4861bb0b7fcc41babe0dc65d3014df70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f1f114b3bb4dfa867b8a263972d2cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:58.812926 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e4357dd4-2084-4fa2-aba9-37394576dcb6 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29" status: 200 len: 1325 microversion: 2.1 time: 0.203728 Jul 20 04:38:58.813824 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2090/4430] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:58 2022] GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 => generated 1325 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:58.885360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a17eb587-7a0c-4ea1-bece-1a761894b443 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:58.885772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a17eb587-7a0c-4ea1-bece-1a761894b443 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:58.897293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=8 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:58.899548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a17eb587-7a0c-4ea1-bece-1a761894b443 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:58.900188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a17eb587-7a0c-4ea1-bece-1a761894b443 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:58.901199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a17eb587-7a0c-4ea1-bece-1a761894b443 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:58.902092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a17eb587-7a0c-4ea1-bece-1a761894b443 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:58.936055 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a17eb587-7a0c-4ea1-bece-1a761894b443 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056647 Jul 20 04:38:58.936992 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2341/4431] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:38:58 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:38:59.831232 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-22bc8f0f-b650-4184-b47b-530983562419 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:59.832724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-22bc8f0f-b650-4184-b47b-530983562419 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] [instance: 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:59.843233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22bc8f0f-b650-4184-b47b-530983562419 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:59.844042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22bc8f0f-b650-4184-b47b-530983562419 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:59.845311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22bc8f0f-b650-4184-b47b-530983562419 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:59.846035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22bc8f0f-b650-4184-b47b-530983562419 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:59.950540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-babfc29c-1da4-40c5-b79e-ee5f85f32d79 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:59.953302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-babfc29c-1da4-40c5-b79e-ee5f85f32d79 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:59.962178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-babfc29c-1da4-40c5-b79e-ee5f85f32d79 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:59.962863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-babfc29c-1da4-40c5-b79e-ee5f85f32d79 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:59.964116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-babfc29c-1da4-40c5-b79e-ee5f85f32d79 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:59.964872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-babfc29c-1da4-40c5-b79e-ee5f85f32d79 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:00.003730 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-babfc29c-1da4-40c5-b79e-ee5f85f32d79 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059423 Jul 20 04:39:00.005944 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2342/4432] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:38:59 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:39:00.026901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-22bc8f0f-b650-4184-b47b-530983562419 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4861bb0b7fcc41babe0dc65d3014df70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f1f114b3bb4dfa867b8a263972d2cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:00.035727 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-22bc8f0f-b650-4184-b47b-530983562419 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29" status: 200 len: 1522 microversion: 2.1 time: 0.208826 Jul 20 04:39:00.036668 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2091/4433] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:59 2022] GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:00.062937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-706684fc-ab67-470c-b903-d2a69a4f53d5 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:00.063716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-706684fc-ab67-470c-b903-d2a69a4f53d5 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] [instance: 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:00.076027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-706684fc-ab67-470c-b903-d2a69a4f53d5 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:00.080655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-706684fc-ab67-470c-b903-d2a69a4f53d5 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:00.082185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-706684fc-ab67-470c-b903-d2a69a4f53d5 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:00.082812 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-706684fc-ab67-470c-b903-d2a69a4f53d5 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:00.117994 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-706684fc-ab67-470c-b903-d2a69a4f53d5 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] HTTP exception thrown: Instance is not a member of specified network Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-706684fc-ab67-470c-b903-d2a69a4f53d5 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Request method failure captured: Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29/ips/invalid HTTP/1.1 Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14bWxyAZAVfnmhsgdr2bXj1z54dhdofvfH29J8IvMmh4eHr7u9jSn0BoRfnAb8lo5UiZsWBZdZ_86AK6ZYWsP1EkXUudUujr8M_ZH0xTDiWJp4GyVxX37XLfWmC1Wy9deHxSTs3S-UYr76DtPX5mL2tajMXcrSD--zCPfoV5jUmkFIc Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: c7f1f114b3bb4dfa867b8a263972d2cf Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-402395854 Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7f1f114b3bb4dfa867b8a263972d2cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c7f1f114b3bb4dfa867b8a263972d2cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c7f1f114b3bb4dfa867b8a263972d2cf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7f1f114b3bb4dfa867b8a263972d2cf"}]}] Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-402395854 Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: c7f1f114b3bb4dfa867b8a263972d2cf Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-402395854 Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerAddressesNegativeTestJSON-402395854-project Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 4861bb0b7fcc41babe0dc65d3014df70 Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-402395854-project Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance is not a member of specified network Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'server_id': '9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29', 'id': 'invalid'} Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 20 04:39:00.125681 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:39:00.129429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-706684fc-ab67-470c-b903-d2a69a4f53d5 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Returning 404 to user: Instance is not a member of specified network {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:00.129429 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-706684fc-ab67-470c-b903-d2a69a4f53d5 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.077151 Jul 20 04:39:00.129429 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2343/4434] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:39:00 2022] GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29/ips/invalid => generated 91 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:39:00.139743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0777369b-4a9a-4dde-8f27-58ef522889ff tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:00.140582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0777369b-4a9a-4dde-8f27-58ef522889ff tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Failed to fetch instance by id 999 {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:39:00.141246 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-0777369b-4a9a-4dde-8f27-58ef522889ff tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] HTTP exception thrown: Instance 999 could not be found. Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0777369b-4a9a-4dde-8f27-58ef522889ff tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Request method failure captured: Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14bWxyAZAVfnmhsgdr2bXj1z54dhdofvfH29J8IvMmh4eHr7u9jSn0BoRfnAb8lo5UiZsWBZdZ_86AK6ZYWsP1EkXUudUujr8M_ZH0xTDiWJp4GyVxX37XLfWmC1Wy9deHxSTs3S-UYr76DtPX5mL2tajMXcrSD--zCPfoV5jUmkFIc Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c7f1f114b3bb4dfa867b8a263972d2cf Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-402395854 Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7f1f114b3bb4dfa867b8a263972d2cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c7f1f114b3bb4dfa867b8a263972d2cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c7f1f114b3bb4dfa867b8a263972d2cf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7f1f114b3bb4dfa867b8a263972d2cf"}]}] Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-402395854 Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c7f1f114b3bb4dfa867b8a263972d2cf Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-402395854 Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerAddressesNegativeTestJSON-402395854-project Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 4861bb0b7fcc41babe0dc65d3014df70 Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-402395854-project Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 999 could not be found. Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'server_id': '999'} Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 20 04:39:00.143137 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:39:00.148225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0777369b-4a9a-4dde-8f27-58ef522889ff tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Returning 404 to user: Instance 999 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:00.149279 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0777369b-4a9a-4dde-8f27-58ef522889ff tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] 10.222.0.17 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.013918 Jul 20 04:39:00.150028 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2092/4435] 10.222.0.17 () {58 vars in 1148 bytes} [Wed Jul 20 04:39:00 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:39:00.161001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-01a81b02-b41d-4f71-824e-c5980b993a08 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:00.161793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-01a81b02-b41d-4f71-824e-c5980b993a08 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] [instance: 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:00.171329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-01a81b02-b41d-4f71-824e-c5980b993a08 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:00.171993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-01a81b02-b41d-4f71-824e-c5980b993a08 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:00.173919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-01a81b02-b41d-4f71-824e-c5980b993a08 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:00.174688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-01a81b02-b41d-4f71-824e-c5980b993a08 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:00.215496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-01a81b02-b41d-4f71-824e-c5980b993a08 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] [instance: 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:39:00.330051 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-01a81b02-b41d-4f71-824e-c5980b993a08 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29" status: 204 len: 0 microversion: 2.1 time: 0.171310 Jul 20 04:39:00.332249 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2344/4436] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:39:00 2022] DELETE /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:39:00.340512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-da83ae7e-2cc8-48a5-9a90-13a1bceed40f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:00.341207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-da83ae7e-2cc8-48a5-9a90-13a1bceed40f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] [instance: 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:00.353014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da83ae7e-2cc8-48a5-9a90-13a1bceed40f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:00.353722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da83ae7e-2cc8-48a5-9a90-13a1bceed40f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:00.356244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da83ae7e-2cc8-48a5-9a90-13a1bceed40f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:00.357908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da83ae7e-2cc8-48a5-9a90-13a1bceed40f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:01.016085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-033cefce-feda-4829-a257-9c80c07a2598 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:01.017390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-033cefce-feda-4829-a257-9c80c07a2598 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:01.025684 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-033cefce-feda-4829-a257-9c80c07a2598 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:01.026917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-033cefce-feda-4829-a257-9c80c07a2598 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:01.027930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-033cefce-feda-4829-a257-9c80c07a2598 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:01.028634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-033cefce-feda-4829-a257-9c80c07a2598 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:01.063618 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-033cefce-feda-4829-a257-9c80c07a2598 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051950 Jul 20 04:39:01.068095 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2345/4437] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:39:01 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:39:01.076790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-da83ae7e-2cc8-48a5-9a90-13a1bceed40f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4861bb0b7fcc41babe0dc65d3014df70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f1f114b3bb4dfa867b8a263972d2cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:01.084708 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-da83ae7e-2cc8-48a5-9a90-13a1bceed40f tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29" status: 200 len: 1528 microversion: 2.1 time: 0.748456 Jul 20 04:39:01.085284 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2093/4438] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:00 2022] GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 => generated 1528 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:01.600569 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:39:01.600985 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 04:39:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:39:02.078319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8b943461-43d9-4211-af73-9710f53e85e7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:02.079709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8b943461-43d9-4211-af73-9710f53e85e7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:02.094167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b943461-43d9-4211-af73-9710f53e85e7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:02.095254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b943461-43d9-4211-af73-9710f53e85e7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:02.096398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b943461-43d9-4211-af73-9710f53e85e7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:02.097132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b943461-43d9-4211-af73-9710f53e85e7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:02.106064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2496cab9-89dd-4353-98fd-66bc0be99913 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:02.110223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2496cab9-89dd-4353-98fd-66bc0be99913 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] [instance: 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:02.128109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2496cab9-89dd-4353-98fd-66bc0be99913 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:02.135431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2496cab9-89dd-4353-98fd-66bc0be99913 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:02.136496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2496cab9-89dd-4353-98fd-66bc0be99913 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:02.142509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2496cab9-89dd-4353-98fd-66bc0be99913 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:02.181026 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8b943461-43d9-4211-af73-9710f53e85e7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.109057 Jul 20 04:39:02.185321 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2346/4439] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:39:02 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:39:02.511278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-ae2114fc-e11d-48a1-b8a4-8be9b53fed3c req-8f87d4e1-3a4f-46ef-8d96-9a927dfc2936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29", "name": "network-vif-deleted", "tag": "2da298b5-425d-46ec-a8cb-84df6dfeddb8"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:02.562192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ae2114fc-e11d-48a1-b8a4-8be9b53fed3c req-8f87d4e1-3a4f-46ef-8d96-9a927dfc2936 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:02.564721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ae2114fc-e11d-48a1-b8a4-8be9b53fed3c req-8f87d4e1-3a4f-46ef-8d96-9a927dfc2936 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:02.596488 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-ae2114fc-e11d-48a1-b8a4-8be9b53fed3c req-8f87d4e1-3a4f-46ef-8d96-9a927dfc2936 service nova] Creating event network-vif-deleted:2da298b5-425d-46ec-a8cb-84df6dfeddb8 for instance 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 on n-h2-826526-5 Jul 20 04:39:02.628748 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-ae2114fc-e11d-48a1-b8a4-8be9b53fed3c req-8f87d4e1-3a4f-46ef-8d96-9a927dfc2936 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133666 Jul 20 04:39:02.629567 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2347/4440] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:02.698468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2496cab9-89dd-4353-98fd-66bc0be99913 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4861bb0b7fcc41babe0dc65d3014df70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f1f114b3bb4dfa867b8a263972d2cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:02.732178 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2496cab9-89dd-4353-98fd-66bc0be99913 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29" status: 200 len: 1486 microversion: 2.1 time: 0.632848 Jul 20 04:39:02.740311 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2094/4441] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:02 2022] GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 => generated 1486 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:03.195613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-60c8a141-8f2a-47b1-9c63-49fc203b795b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:03.199826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-60c8a141-8f2a-47b1-9c63-49fc203b795b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:03.216291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60c8a141-8f2a-47b1-9c63-49fc203b795b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:03.223757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60c8a141-8f2a-47b1-9c63-49fc203b795b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:03.244143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60c8a141-8f2a-47b1-9c63-49fc203b795b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:03.247838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60c8a141-8f2a-47b1-9c63-49fc203b795b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:03.340186 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-60c8a141-8f2a-47b1-9c63-49fc203b795b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.150179 Jul 20 04:39:03.350078 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2348/4442] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:39:03 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:39:03.750851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0d933af2-7568-4b69-ada5-439a9eb83016 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:03.751486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0d933af2-7568-4b69-ada5-439a9eb83016 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] [instance: 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:03.777718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d933af2-7568-4b69-ada5-439a9eb83016 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:03.778640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d933af2-7568-4b69-ada5-439a9eb83016 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:03.779663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d933af2-7568-4b69-ada5-439a9eb83016 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:03.780578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d933af2-7568-4b69-ada5-439a9eb83016 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:03.808046 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-0d933af2-7568-4b69-ada5-439a9eb83016 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] HTTP exception thrown: Instance 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 could not be found. Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0d933af2-7568-4b69-ada5-439a9eb83016 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Request method failure captured: Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 HTTP/1.1 Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14bWxyAZAVfnmhsgdr2bXj1z54dhdofvfH29J8IvMmh4eHr7u9jSn0BoRfnAb8lo5UiZsWBZdZ_86AK6ZYWsP1EkXUudUujr8M_ZH0xTDiWJp4GyVxX37XLfWmC1Wy9deHxSTs3S-UYr76DtPX5mL2tajMXcrSD--zCPfoV5jUmkFIc Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c7f1f114b3bb4dfa867b8a263972d2cf Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-402395854 Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7f1f114b3bb4dfa867b8a263972d2cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c7f1f114b3bb4dfa867b8a263972d2cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c7f1f114b3bb4dfa867b8a263972d2cf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7f1f114b3bb4dfa867b8a263972d2cf"}]}] Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-402395854 Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c7f1f114b3bb4dfa867b8a263972d2cf Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-402395854 Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerAddressesNegativeTestJSON-402395854-project Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 4861bb0b7fcc41babe0dc65d3014df70 Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-402395854-project Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 could not be found. Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29'} Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 could not be found. Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 could not be found. Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:39:03.811984 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:03.817516 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:39:03.817516 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:03.817516 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:03.817516 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:03.817516 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:03.817516 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:03.817516 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 could not be found. Jul 20 04:39:03.817516 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:39:03.821494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0d933af2-7568-4b69-ada5-439a9eb83016 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] Returning 404 to user: Instance 9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:03.821494 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0d933af2-7568-4b69-ada5-439a9eb83016 tempest-ServerAddressesNegativeTestJSON-402395854 tempest-ServerAddressesNegativeTestJSON-402395854-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29" status: 404 len: 111 microversion: 2.1 time: 0.074356 Jul 20 04:39:03.821494 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2095/4443] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:03 2022] GET /compute/v2.1/servers/9ae1845a-0d81-4bbe-81a7-3fc5f15d7a29 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:04.356475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-64362e62-7d86-41b3-bc9c-be822ed630c1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:04.358602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-64362e62-7d86-41b3-bc9c-be822ed630c1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:04.377548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64362e62-7d86-41b3-bc9c-be822ed630c1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:04.380593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64362e62-7d86-41b3-bc9c-be822ed630c1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:04.382051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64362e62-7d86-41b3-bc9c-be822ed630c1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:04.383389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64362e62-7d86-41b3-bc9c-be822ed630c1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:04.471665 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-64362e62-7d86-41b3-bc9c-be822ed630c1 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.115403 Jul 20 04:39:04.472738 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2349/4444] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:39:04 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:39:05.487512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a1310fd0-e8bc-48a5-a7b6-5516f22baa66 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:05.489435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a1310fd0-e8bc-48a5-a7b6-5516f22baa66 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:05.518036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1310fd0-e8bc-48a5-a7b6-5516f22baa66 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:05.518538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1310fd0-e8bc-48a5-a7b6-5516f22baa66 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:05.525270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1310fd0-e8bc-48a5-a7b6-5516f22baa66 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:05.526114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1310fd0-e8bc-48a5-a7b6-5516f22baa66 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:05.687542 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a1310fd0-e8bc-48a5-a7b6-5516f22baa66 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.206638 Jul 20 04:39:05.687803 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2096/4445] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:39:05 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:39:06.701353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-22c82ea8-a934-43b6-9d92-51a76cf94e6a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:06.703023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-22c82ea8-a934-43b6-9d92-51a76cf94e6a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:06.721909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22c82ea8-a934-43b6-9d92-51a76cf94e6a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:06.725107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22c82ea8-a934-43b6-9d92-51a76cf94e6a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:06.726257 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22c82ea8-a934-43b6-9d92-51a76cf94e6a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:06.728748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22c82ea8-a934-43b6-9d92-51a76cf94e6a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:06.776484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:06.806661 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-22c82ea8-a934-43b6-9d92-51a76cf94e6a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.108126 Jul 20 04:39:06.808463 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2350/4446] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:39:06 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:06.941724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cb28b68b-c1de-40ac-906f-bb624e55b0e9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:06.942842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cb28b68b-c1de-40ac-906f-bb624e55b0e9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:06.958676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb28b68b-c1de-40ac-906f-bb624e55b0e9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:06.960638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb28b68b-c1de-40ac-906f-bb624e55b0e9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:06.963158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb28b68b-c1de-40ac-906f-bb624e55b0e9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:06.964702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb28b68b-c1de-40ac-906f-bb624e55b0e9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:07.066533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cb28b68b-c1de-40ac-906f-bb624e55b0e9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:39:07.112483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:07.310146 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cb28b68b-c1de-40ac-906f-bb624e55b0e9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "DELETE /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 204 len: 0 microversion: 2.20 time: 0.372571 Jul 20 04:39:07.311350 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2097/4447] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:39:06 2022] DELETE /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:39:07.320023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9d171284-d9b8-4407-a9a6-1b76635713b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:07.320871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9d171284-d9b8-4407-a9a6-1b76635713b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:07.336251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d171284-d9b8-4407-a9a6-1b76635713b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:07.337147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d171284-d9b8-4407-a9a6-1b76635713b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:07.338241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d171284-d9b8-4407-a9a6-1b76635713b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:07.338921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9d171284-d9b8-4407-a9a6-1b76635713b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:08.083449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9d171284-d9b8-4407-a9a6-1b76635713b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:08.093063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9d171284-d9b8-4407-a9a6-1b76635713b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:08.094502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9d171284-d9b8-4407-a9a6-1b76635713b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:08.095724 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9d171284-d9b8-4407-a9a6-1b76635713b5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1722 microversion: 2.20 time: 0.779998 Jul 20 04:39:08.104411 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2351/4448] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:07 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1722 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:09.123357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b95e0e53-9fd7-4266-87be-3743139e54d9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:09.124242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b95e0e53-9fd7-4266-87be-3743139e54d9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:09.139105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b95e0e53-9fd7-4266-87be-3743139e54d9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:09.141840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b95e0e53-9fd7-4266-87be-3743139e54d9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:09.142907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b95e0e53-9fd7-4266-87be-3743139e54d9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:09.144888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b95e0e53-9fd7-4266-87be-3743139e54d9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:10.017215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b95e0e53-9fd7-4266-87be-3743139e54d9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:10.041282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b95e0e53-9fd7-4266-87be-3743139e54d9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:10.042818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b95e0e53-9fd7-4266-87be-3743139e54d9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:10.044112 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b95e0e53-9fd7-4266-87be-3743139e54d9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1722 microversion: 2.20 time: 0.926898 Jul 20 04:39:10.044736 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2098/4449] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:09 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1722 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:10.998966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a776eec5-dcd1-4537-b0db-0a86ea1d6f36 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Action: 'create', calling method: .version_select at 0x7f06bd49c280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-90132137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY8mgXDqyxwzH15aeA25YuEpBIYvQhgKcDCQ2xBpaSNxOqylwcpMeinipiPLH5qu/5kbMniVqJyalFylesy1DHaISo5XEvLvw9w13mFp7RGRK3dLwJYuTR2bpgIuJJBuQ=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:11.020966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-a776eec5-dcd1-4537-b0db-0a86ea1d6f36 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Getting quotas for project c9b5d48d9c894a32b3f417820f43427e. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:39:11.039299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-a776eec5-dcd1-4537-b0db-0a86ea1d6f36 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Getting quotas for user 43a4b4fa5cc24463aa398fbc4e1404d4 and project c9b5d48d9c894a32b3f417820f43427e. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:39:11.064703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d766a8c8-c6d8-4553-9997-9ae6eb813a6c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:11.066091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d766a8c8-c6d8-4553-9997-9ae6eb813a6c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:11.084952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d766a8c8-c6d8-4553-9997-9ae6eb813a6c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:11.100760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d766a8c8-c6d8-4553-9997-9ae6eb813a6c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:11.102511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d766a8c8-c6d8-4553-9997-9ae6eb813a6c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:11.106627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d766a8c8-c6d8-4553-9997-9ae6eb813a6c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:11.134848 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a776eec5-dcd1-4537-b0db-0a86ea1d6f36 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.156164 Jul 20 04:39:11.140914 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2352/4450] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:39:10 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:11.275457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d766a8c8-c6d8-4553-9997-9ae6eb813a6c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:11.299758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d766a8c8-c6d8-4553-9997-9ae6eb813a6c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:11.305177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d766a8c8-c6d8-4553-9997-9ae6eb813a6c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:11.308094 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d766a8c8-c6d8-4553-9997-9ae6eb813a6c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1654 microversion: 2.20 time: 0.249098 Jul 20 04:39:11.326009 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2099/4451] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:11 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1654 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:12.348591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-be4fbf52-a55f-447f-950c-3bf2f54c4eb7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:12.349291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-be4fbf52-a55f-447f-950c-3bf2f54c4eb7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:12.383914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be4fbf52-a55f-447f-950c-3bf2f54c4eb7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:12.384496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be4fbf52-a55f-447f-950c-3bf2f54c4eb7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:12.389503 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be4fbf52-a55f-447f-950c-3bf2f54c4eb7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:12.393697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-be4fbf52-a55f-447f-950c-3bf2f54c4eb7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:13.652236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-be4fbf52-a55f-447f-950c-3bf2f54c4eb7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:13.670299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-be4fbf52-a55f-447f-950c-3bf2f54c4eb7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:13.673309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-be4fbf52-a55f-447f-950c-3bf2f54c4eb7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:13.677065 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-be4fbf52-a55f-447f-950c-3bf2f54c4eb7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1654 microversion: 2.20 time: 1.348572 Jul 20 04:39:13.679024 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2353/4452] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:12 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1654 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:14.140437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e0fa62c8-41c0-464e-8ee6-84ef7f131051 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1798899730", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "3a4aa27b-1256-42b2-a31c-ec1f0c3026f2"}], "key_name": "tempest-TestNetworkBasicOps-90132137", "security_groups": [{"name": "tempest-secgroup-smoke-390660600"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:14.369278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-71c0d16b-1603-4c10-8ddb-ec600bb9c3fe req-cba239fc-44df-45f2-82da-b1ccba32f456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ebac50-3466-4fdc-8ca1-59b0001e2581", "name": "network-vif-deleted", "tag": "e0f13bf8-3ce6-42eb-a36c-5d668ff79e32"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:14.388881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-71c0d16b-1603-4c10-8ddb-ec600bb9c3fe req-cba239fc-44df-45f2-82da-b1ccba32f456 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:14.390788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-71c0d16b-1603-4c10-8ddb-ec600bb9c3fe req-cba239fc-44df-45f2-82da-b1ccba32f456 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:14.424078 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-71c0d16b-1603-4c10-8ddb-ec600bb9c3fe req-cba239fc-44df-45f2-82da-b1ccba32f456 service nova] Creating event network-vif-deleted:e0f13bf8-3ce6-42eb-a36c-5d668ff79e32 for instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 on n-h2-826526-5 Jul 20 04:39:14.434851 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-71c0d16b-1603-4c10-8ddb-ec600bb9c3fe req-cba239fc-44df-45f2-82da-b1ccba32f456 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068677 Jul 20 04:39:14.436204 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2354/4453] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:14.534383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-e0fa62c8-41c0-464e-8ee6-84ef7f131051 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] validate_networks() for [('3a4aa27b-1256-42b2-a31c-ec1f0c3026f2', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:39:14.702504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4847b8b9-5d46-418d-9533-ecd6af9141cf tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:14.703213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4847b8b9-5d46-418d-9533-ecd6af9141cf tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:14.716742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4847b8b9-5d46-418d-9533-ecd6af9141cf tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:14.718469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4847b8b9-5d46-418d-9533-ecd6af9141cf tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:14.720798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4847b8b9-5d46-418d-9533-ecd6af9141cf tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:14.734358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4847b8b9-5d46-418d-9533-ecd6af9141cf tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:14.797425 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4847b8b9-5d46-418d-9533-ecd6af9141cf tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:14.799545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4847b8b9-5d46-418d-9533-ecd6af9141cf tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:14.801173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-4847b8b9-5d46-418d-9533-ecd6af9141cf tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lazy-loading 'fault' on Instance uuid 90ebac50-3466-4fdc-8ca1-59b0001e2581 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:39:14.914351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4847b8b9-5d46-418d-9533-ecd6af9141cf tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:14.924783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4847b8b9-5d46-418d-9533-ecd6af9141cf tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:14.927492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4847b8b9-5d46-418d-9533-ecd6af9141cf tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:14.928756 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4847b8b9-5d46-418d-9533-ecd6af9141cf tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 200 len: 1370 microversion: 2.20 time: 0.236083 Jul 20 04:39:14.936021 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2355/4454] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:14 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 1370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:15.917016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e0fa62c8-41c0-464e-8ee6-84ef7f131051 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:39:15.917754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e0fa62c8-41c0-464e-8ee6-84ef7f131051 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:39:15.918239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e0fa62c8-41c0-464e-8ee6-84ef7f131051 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:39:15.918735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e0fa62c8-41c0-464e-8ee6-84ef7f131051 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:39:15.919162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e0fa62c8-41c0-464e-8ee6-84ef7f131051 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:39:15.935796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0fa62c8-41c0-464e-8ee6-84ef7f131051 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:15.936388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0fa62c8-41c0-464e-8ee6-84ef7f131051 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:15.937315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0fa62c8-41c0-464e-8ee6-84ef7f131051 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:15.952542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-de966a18-c05e-42b5-b4f2-1de00406951a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:15.953166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-de966a18-c05e-42b5-b4f2-1de00406951a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:15.960563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0fa62c8-41c0-464e-8ee6-84ef7f131051 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:15.972073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de966a18-c05e-42b5-b4f2-1de00406951a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:15.973426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de966a18-c05e-42b5-b4f2-1de00406951a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:15.976474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de966a18-c05e-42b5-b4f2-1de00406951a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:15.979853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de966a18-c05e-42b5-b4f2-1de00406951a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:16.023862 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-de966a18-c05e-42b5-b4f2-1de00406951a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] HTTP exception thrown: Instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 could not be found. Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-de966a18-c05e-42b5-b4f2-1de00406951a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Request method failure captured: Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 HTTP/1.1 Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14YcfGQ2dJXFTmLgIeuKTnvXz4Xy1mrIR63S63g1Qamgwh7IpgwWfUbDj4orK8K5ndqbQxiI-SDRzmiQmPSDm6XtO9Ts2boSIp-d3er3jfI5B0uRDWJveWe21AmZmlRhbpzWdjRPlWd6uKkr6wIzWOZIbkOgEQHhpjqGMACN1GJjWiY Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: f84badb51e2d4e30bd5b50e2b1f8be56 Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1689134496 Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84badb51e2d4e30bd5b50e2b1f8be56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f84badb51e2d4e30bd5b50e2b1f8be56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f84badb51e2d4e30bd5b50e2b1f8be56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84badb51e2d4e30bd5b50e2b1f8be56"}]}] Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1689134496 Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: f84badb51e2d4e30bd5b50e2b1f8be56 Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1689134496 Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AttachVolumeShelveTestJSON-1689134496-project Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 45d83caaa8704fb0a6cd0d527870b33e Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1689134496-project Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 could not be found. Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '90ebac50-3466-4fdc-8ca1-59b0001e2581'} Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 could not be found. Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 could not be found. Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:39:16.027123 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:16.039075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:39:16.039075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:16.039075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:16.039075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:16.039075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:16.039075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:16.039075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 could not be found. Jul 20 04:39:16.039075 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:39:16.039075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-de966a18-c05e-42b5-b4f2-1de00406951a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Returning 404 to user: Instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:16.039075 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-de966a18-c05e-42b5-b4f2-1de00406951a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 404 len: 111 microversion: 2.20 time: 0.085289 Jul 20 04:39:16.040251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-e0fa62c8-41c0-464e-8ee6-84ef7f131051 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Getting quotas for project c9b5d48d9c894a32b3f417820f43427e. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:39:16.040428 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2356/4455] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:15 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:39:16.042382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d7b6e7e2-7ca1-4b47-bebc-ce9f5fff0f9a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '.version_select at 0x7f06bda3fe50>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:16.055340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-e0fa62c8-41c0-464e-8ee6-84ef7f131051 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Getting quotas for user 43a4b4fa5cc24463aa398fbc4e1404d4 and project c9b5d48d9c894a32b3f417820f43427e. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:39:16.086322 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d7b6e7e2-7ca1-4b47-bebc-ce9f5fff0f9a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-753052154" status: 204 len: 0 microversion: 2.20 time: 0.048125 Jul 20 04:39:16.087739 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2357/4456] 10.222.0.17 () {60 vars in 1258 bytes} [Wed Jul 20 04:39:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-753052154 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 04:39:16.093703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e0fa62c8-41c0-464e-8ee6-84ef7f131051 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:39:16.096039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e0fa62c8-41c0-464e-8ee6-84ef7f131051 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:39:16.163797 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e0fa62c8-41c0-464e-8ee6-84ef7f131051 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.028162 Jul 20 04:39:16.165251 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2100/4457] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:39:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 2030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:39:16.177115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1ec6b04b-b4fc-48f7-a1c6-c920aa4980f6 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:16.177791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1ec6b04b-b4fc-48f7-a1c6-c920aa4980f6 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:16.271036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1ec6b04b-b4fc-48f7-a1c6-c920aa4980f6 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:16.286400 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1ec6b04b-b4fc-48f7-a1c6-c920aa4980f6 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53" status: 200 len: 1247 microversion: 2.1 time: 0.110713 Jul 20 04:39:16.290658 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2358/4458] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:16 2022] GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53 => generated 1247 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:17.308852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5271277a-b95b-439f-90c9-cdfd54d75049 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:17.309845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5271277a-b95b-439f-90c9-cdfd54d75049 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:17.314886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:17.378221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5271277a-b95b-439f-90c9-cdfd54d75049 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:17.383251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5271277a-b95b-439f-90c9-cdfd54d75049 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:17.385466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5271277a-b95b-439f-90c9-cdfd54d75049 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:17.387261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5271277a-b95b-439f-90c9-cdfd54d75049 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:17.647336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5271277a-b95b-439f-90c9-cdfd54d75049 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:17.659128 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5271277a-b95b-439f-90c9-cdfd54d75049 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53" status: 200 len: 1243 microversion: 2.1 time: 0.355757 Jul 20 04:39:17.659742 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2101/4459] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:17 2022] GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53 => generated 1243 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:17.742464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e1f94511-43db-44c0-be6f-321144e5b141 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Action: 'create', calling method: .version_select at 0x7f06bd3ee670>, body: {"keypair": {"name": "tempest-keypair-385393742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyY9jmzgiihOlvdg9KjJ8uJuvtnSR5D/qLmispXAGfhHOMh5Gk5kxrUJMQ8kJOsSX8zNiWBko5dMrE0MDXrmudmQqFN1qF1o6UlOLLapBey8MPH1QaoA22Fupbm5OywMA=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:17.756777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:17.783662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-e1f94511-43db-44c0-be6f-321144e5b141 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Getting quotas for project f84badb51e2d4e30bd5b50e2b1f8be56. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:39:17.792113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-e1f94511-43db-44c0-be6f-321144e5b141 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Getting quotas for user 45d83caaa8704fb0a6cd0d527870b33e and project f84badb51e2d4e30bd5b50e2b1f8be56. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:39:17.829603 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e1f94511-43db-44c0-be6f-321144e5b141 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.100795 Jul 20 04:39:17.831037 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2359/4460] 10.222.0.17 () {62 vars in 1199 bytes} [Wed Jul 20 04:39:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 103 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:39:18.680172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-153bb4bd-d4ed-4cf4-92c0-12715f510da1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:18.682032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-153bb4bd-d4ed-4cf4-92c0-12715f510da1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:18.701692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153bb4bd-d4ed-4cf4-92c0-12715f510da1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:18.703070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153bb4bd-d4ed-4cf4-92c0-12715f510da1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:18.723992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153bb4bd-d4ed-4cf4-92c0-12715f510da1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:18.725394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153bb4bd-d4ed-4cf4-92c0-12715f510da1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:18.887840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-153bb4bd-d4ed-4cf4-92c0-12715f510da1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:18.906225 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-153bb4bd-d4ed-4cf4-92c0-12715f510da1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53" status: 200 len: 1305 microversion: 2.1 time: 0.232047 Jul 20 04:39:18.907678 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2102/4461] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:18 2022] GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53 => generated 1305 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:19.929412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-98f0a753-74f3-46e3-b1d6-edbb97a9d71c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:19.930214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-98f0a753-74f3-46e3-b1d6-edbb97a9d71c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:19.942236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98f0a753-74f3-46e3-b1d6-edbb97a9d71c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:19.950110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98f0a753-74f3-46e3-b1d6-edbb97a9d71c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:19.951326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98f0a753-74f3-46e3-b1d6-edbb97a9d71c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:19.954405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98f0a753-74f3-46e3-b1d6-edbb97a9d71c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:20.606136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-98f0a753-74f3-46e3-b1d6-edbb97a9d71c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:20.614392 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-98f0a753-74f3-46e3-b1d6-edbb97a9d71c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53" status: 200 len: 1372 microversion: 2.1 time: 0.689842 Jul 20 04:39:20.615613 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2360/4462] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:19 2022] GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53 => generated 1372 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:21.634970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dad88d65-ca22-476e-a0ce-8d733e150c73 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:21.635594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dad88d65-ca22-476e-a0ce-8d733e150c73 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:21.646774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dad88d65-ca22-476e-a0ce-8d733e150c73 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:21.670933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dad88d65-ca22-476e-a0ce-8d733e150c73 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:21.672102 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dad88d65-ca22-476e-a0ce-8d733e150c73 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:21.672992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dad88d65-ca22-476e-a0ce-8d733e150c73 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:21.795392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b1cdddf6-ece0-4c96-825c-48ad0ba07b90 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1865088958", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7cb0783-8099-436e-bf0c-ef0b452074e0"}], "security_groups": [{"name": "tempest-securitygroup--1074654898"}], "key_name": "tempest-keypair-385393742", "user_data": "}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:22.282276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-b1cdddf6-ece0-4c96-825c-48ad0ba07b90 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] validate_networks() for [('d7cb0783-8099-436e-bf0c-ef0b452074e0', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:39:22.532376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dad88d65-ca22-476e-a0ce-8d733e150c73 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:22.541246 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dad88d65-ca22-476e-a0ce-8d733e150c73 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53" status: 200 len: 1372 microversion: 2.1 time: 0.910297 Jul 20 04:39:22.541843 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2103/4463] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:21 2022] GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53 => generated 1372 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:22.558737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-bd4a1d99-d6dd-45d9-9bf1-1a986b257ffe req-775e6ef7-7cf8-42ea-9439-80aefd865082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c3c9d87-88a7-4dea-8b81-0e67d259dc53", "tag": "e65ca590-1dcb-4c7e-aca1-2e965482add0"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:22.590685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-bd4a1d99-d6dd-45d9-9bf1-1a986b257ffe req-775e6ef7-7cf8-42ea-9439-80aefd865082 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:22.591530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-bd4a1d99-d6dd-45d9-9bf1-1a986b257ffe req-775e6ef7-7cf8-42ea-9439-80aefd865082 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:22.633317 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-bd4a1d99-d6dd-45d9-9bf1-1a986b257ffe req-775e6ef7-7cf8-42ea-9439-80aefd865082 service nova] Creating event network-changed:e65ca590-1dcb-4c7e-aca1-2e965482add0 for instance 5c3c9d87-88a7-4dea-8b81-0e67d259dc53 on n-h2-826526-5 Jul 20 04:39:22.646556 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-bd4a1d99-d6dd-45d9-9bf1-1a986b257ffe req-775e6ef7-7cf8-42ea-9439-80aefd865082 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091592 Jul 20 04:39:22.647182 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2104/4464] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:22.661248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-87458579-c539-4fa8-bc83-e31136cc9a96 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:22.661955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-87458579-c539-4fa8-bc83-e31136cc9a96 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:22.682442 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87458579-c539-4fa8-bc83-e31136cc9a96 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:22.682902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87458579-c539-4fa8-bc83-e31136cc9a96 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:22.683693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87458579-c539-4fa8-bc83-e31136cc9a96 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:22.684180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87458579-c539-4fa8-bc83-e31136cc9a96 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.076107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-87458579-c539-4fa8-bc83-e31136cc9a96 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:23.080184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b1cdddf6-ece0-4c96-825c-48ad0ba07b90 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:39:23.081563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b1cdddf6-ece0-4c96-825c-48ad0ba07b90 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:39:23.082033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b1cdddf6-ece0-4c96-825c-48ad0ba07b90 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:39:23.082447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b1cdddf6-ece0-4c96-825c-48ad0ba07b90 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:39:23.082872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b1cdddf6-ece0-4c96-825c-48ad0ba07b90 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:39:23.096368 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-87458579-c539-4fa8-bc83-e31136cc9a96 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.439078 Jul 20 04:39:23.097244 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2105/4465] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:22 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:23.117193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-764d390e-f72e-42f7-90e1-bfb0c9f5e580 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:23.117850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-764d390e-f72e-42f7-90e1-bfb0c9f5e580 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:23.127191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-764d390e-f72e-42f7-90e1-bfb0c9f5e580 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.127656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-764d390e-f72e-42f7-90e1-bfb0c9f5e580 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.128808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-764d390e-f72e-42f7-90e1-bfb0c9f5e580 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.129672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-764d390e-f72e-42f7-90e1-bfb0c9f5e580 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.138104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b1cdddf6-ece0-4c96-825c-48ad0ba07b90 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.138561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b1cdddf6-ece0-4c96-825c-48ad0ba07b90 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.139368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b1cdddf6-ece0-4c96-825c-48ad0ba07b90 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.139808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b1cdddf6-ece0-4c96-825c-48ad0ba07b90 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.167921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-b1cdddf6-ece0-4c96-825c-48ad0ba07b90 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Getting quotas for project f84badb51e2d4e30bd5b50e2b1f8be56. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:39:23.174716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-b1cdddf6-ece0-4c96-825c-48ad0ba07b90 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Getting quotas for user 45d83caaa8704fb0a6cd0d527870b33e and project f84badb51e2d4e30bd5b50e2b1f8be56. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:39:23.191801 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b1cdddf6-ece0-4c96-825c-48ad0ba07b90 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:39:23.194151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b1cdddf6-ece0-4c96-825c-48ad0ba07b90 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:39:23.244179 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b1cdddf6-ece0-4c96-825c-48ad0ba07b90 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.454013 Jul 20 04:39:23.245726 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2361/4466] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 04:39:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1456 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:39:23.255090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-147d0380-e40d-430a-a3d3-a263d02c26bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:23.255949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-147d0380-e40d-430a-a3d3-a263d02c26bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:23.320189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-147d0380-e40d-430a-a3d3-a263d02c26bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:23.327145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-147d0380-e40d-430a-a3d3-a263d02c26bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:23.328918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-147d0380-e40d-430a-a3d3-a263d02c26bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:23.330270 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-147d0380-e40d-430a-a3d3-a263d02c26bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1281 microversion: 2.20 time: 0.079256 Jul 20 04:39:23.341450 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2362/4467] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:23 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1281 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:23.461118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-764d390e-f72e-42f7-90e1-bfb0c9f5e580 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:23.470948 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-764d390e-f72e-42f7-90e1-bfb0c9f5e580 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.358171 Jul 20 04:39:23.471564 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2106/4468] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:23 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:23.491476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ed2c4d89-b38f-4cab-80d0-63f4fd6e9394 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:23.492374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ed2c4d89-b38f-4cab-80d0-63f4fd6e9394 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:23.499510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ed2c4d89-b38f-4cab-80d0-63f4fd6e9394 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.499853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ed2c4d89-b38f-4cab-80d0-63f4fd6e9394 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.501019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ed2c4d89-b38f-4cab-80d0-63f4fd6e9394 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.501656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ed2c4d89-b38f-4cab-80d0-63f4fd6e9394 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.558853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c659dabe-b14a-497d-a6e7-55fb35d70599 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:23.559602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c659dabe-b14a-497d-a6e7-55fb35d70599 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:23.571929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c659dabe-b14a-497d-a6e7-55fb35d70599 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.572804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c659dabe-b14a-497d-a6e7-55fb35d70599 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.576598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c659dabe-b14a-497d-a6e7-55fb35d70599 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.578853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c659dabe-b14a-497d-a6e7-55fb35d70599 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.933336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c659dabe-b14a-497d-a6e7-55fb35d70599 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:23.954755 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c659dabe-b14a-497d-a6e7-55fb35d70599 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53" status: 200 len: 1372 microversion: 2.1 time: 0.391677 Jul 20 04:39:23.970080 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2107/4469] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:23 2022] GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53 => generated 1372 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:24.348903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed19303b-6877-422c-bda2-6e0f68952e84 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:24.349514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ed19303b-6877-422c-bda2-6e0f68952e84 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:24.357544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed19303b-6877-422c-bda2-6e0f68952e84 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:24.357980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed19303b-6877-422c-bda2-6e0f68952e84 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:24.358759 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed19303b-6877-422c-bda2-6e0f68952e84 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:24.359212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed19303b-6877-422c-bda2-6e0f68952e84 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:24.488937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ed19303b-6877-422c-bda2-6e0f68952e84 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:24.498540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ed19303b-6877-422c-bda2-6e0f68952e84 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:24.500122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ed19303b-6877-422c-bda2-6e0f68952e84 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:24.513572 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ed19303b-6877-422c-bda2-6e0f68952e84 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1333 microversion: 2.20 time: 0.168503 Jul 20 04:39:24.524923 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2108/4470] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:24 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1333 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:39:24.560906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ed2c4d89-b38f-4cab-80d0-63f4fd6e9394 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:24.570983 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ed2c4d89-b38f-4cab-80d0-63f4fd6e9394 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 1.083844 Jul 20 04:39:24.574184 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2363/4471] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:23 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:24.589793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3a0f7669-4dca-4201-84ce-8ce509478f05 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:24.591155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3a0f7669-4dca-4201-84ce-8ce509478f05 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:24.598022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a0f7669-4dca-4201-84ce-8ce509478f05 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:24.598679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a0f7669-4dca-4201-84ce-8ce509478f05 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:24.599587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a0f7669-4dca-4201-84ce-8ce509478f05 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:24.600160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a0f7669-4dca-4201-84ce-8ce509478f05 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:24.972880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3ed8771c-95e6-4fcf-8a16-314a4df54236 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:24.973624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3ed8771c-95e6-4fcf-8a16-314a4df54236 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:24.992312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ed8771c-95e6-4fcf-8a16-314a4df54236 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:24.992760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ed8771c-95e6-4fcf-8a16-314a4df54236 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:24.997777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ed8771c-95e6-4fcf-8a16-314a4df54236 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:24.998330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ed8771c-95e6-4fcf-8a16-314a4df54236 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:25.039939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3a0f7669-4dca-4201-84ce-8ce509478f05 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:25.052325 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3a0f7669-4dca-4201-84ce-8ce509478f05 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.467093 Jul 20 04:39:25.054263 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2109/4472] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:24 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:25.252921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-80439a30-4bc9-4eff-8a91-cfca84f1ae36 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1996679561", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "69228133-6b77-4fda-a084-e067c6109be5"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:25.351556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-80439a30-4bc9-4eff-8a91-cfca84f1ae36 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] validate_networks() for [('69228133-6b77-4fda-a084-e067c6109be5', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:39:25.565596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3ed8771c-95e6-4fcf-8a16-314a4df54236 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:25.577882 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3ed8771c-95e6-4fcf-8a16-314a4df54236 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53" status: 200 len: 1372 microversion: 2.1 time: 0.608374 Jul 20 04:39:25.578770 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2364/4473] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:24 2022] GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53 => generated 1372 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:25.594574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-259cd3ea-ae6d-45ac-80a4-994a59850e71 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:25.595613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-259cd3ea-ae6d-45ac-80a4-994a59850e71 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:25.610370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-259cd3ea-ae6d-45ac-80a4-994a59850e71 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:25.616962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-259cd3ea-ae6d-45ac-80a4-994a59850e71 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:25.618389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-259cd3ea-ae6d-45ac-80a4-994a59850e71 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:25.619070 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-259cd3ea-ae6d-45ac-80a4-994a59850e71 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:25.792484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-259cd3ea-ae6d-45ac-80a4-994a59850e71 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:25.805529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-259cd3ea-ae6d-45ac-80a4-994a59850e71 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:25.808108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-259cd3ea-ae6d-45ac-80a4-994a59850e71 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:25.810068 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-259cd3ea-ae6d-45ac-80a4-994a59850e71 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1339 microversion: 2.20 time: 0.227776 Jul 20 04:39:25.818238 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2365/4474] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:25 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1339 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:25.990016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-80439a30-4bc9-4eff-8a91-cfca84f1ae36 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:39:25.990462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-80439a30-4bc9-4eff-8a91-cfca84f1ae36 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:39:25.990938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-80439a30-4bc9-4eff-8a91-cfca84f1ae36 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:39:25.991355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-80439a30-4bc9-4eff-8a91-cfca84f1ae36 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:39:25.991750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-80439a30-4bc9-4eff-8a91-cfca84f1ae36 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:39:25.997690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:26.018906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80439a30-4bc9-4eff-8a91-cfca84f1ae36 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:26.021596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80439a30-4bc9-4eff-8a91-cfca84f1ae36 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:26.025396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80439a30-4bc9-4eff-8a91-cfca84f1ae36 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:26.026084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80439a30-4bc9-4eff-8a91-cfca84f1ae36 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:26.079940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-80439a30-4bc9-4eff-8a91-cfca84f1ae36 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Getting quotas for project fcd6c40faa19476db37fa7897dea5840. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:39:26.092696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-80439a30-4bc9-4eff-8a91-cfca84f1ae36 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Getting quotas for user f50ac97f2ef04752bd49148748e39eb8 and project fcd6c40faa19476db37fa7897dea5840. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:39:26.129198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-80439a30-4bc9-4eff-8a91-cfca84f1ae36 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:39:26.131939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-80439a30-4bc9-4eff-8a91-cfca84f1ae36 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:39:26.282169 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-80439a30-4bc9-4eff-8a91-cfca84f1ae36 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.030006 Jul 20 04:39:26.286426 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2110/4475] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:39:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:39:26.295861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-47e6fd40-1d9a-4cc7-967b-c95e13743096 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:26.296752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-47e6fd40-1d9a-4cc7-967b-c95e13743096 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:26.463617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-47e6fd40-1d9a-4cc7-967b-c95e13743096 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:26.472059 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-47e6fd40-1d9a-4cc7-967b-c95e13743096 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 200 len: 1215 microversion: 2.1 time: 0.181582 Jul 20 04:39:26.478287 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2366/4476] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:26 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 1215 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:26.595420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8e48f779-1a78-4b6d-8dd3-9e97e3f34550 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:26.595922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8e48f779-1a78-4b6d-8dd3-9e97e3f34550 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:26.606849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e48f779-1a78-4b6d-8dd3-9e97e3f34550 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:26.607539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e48f779-1a78-4b6d-8dd3-9e97e3f34550 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:26.608241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e48f779-1a78-4b6d-8dd3-9e97e3f34550 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:26.611405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e48f779-1a78-4b6d-8dd3-9e97e3f34550 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:26.837873 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ab942ba3-7aac-4aad-b0f7-d57944fdc11d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:26.839035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ab942ba3-7aac-4aad-b0f7-d57944fdc11d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:26.853783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab942ba3-7aac-4aad-b0f7-d57944fdc11d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:26.854550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab942ba3-7aac-4aad-b0f7-d57944fdc11d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:26.861877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab942ba3-7aac-4aad-b0f7-d57944fdc11d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:26.862346 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab942ba3-7aac-4aad-b0f7-d57944fdc11d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:27.158311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8e48f779-1a78-4b6d-8dd3-9e97e3f34550 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:27.173049 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8e48f779-1a78-4b6d-8dd3-9e97e3f34550 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53" status: 200 len: 1372 microversion: 2.1 time: 0.580964 Jul 20 04:39:27.190215 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2111/4477] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:26 2022] GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53 => generated 1372 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:27.190691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ab942ba3-7aac-4aad-b0f7-d57944fdc11d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:27.206924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ab942ba3-7aac-4aad-b0f7-d57944fdc11d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:27.212339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ab942ba3-7aac-4aad-b0f7-d57944fdc11d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:27.218539 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ab942ba3-7aac-4aad-b0f7-d57944fdc11d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1339 microversion: 2.20 time: 0.382192 Jul 20 04:39:27.235980 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2367/4478] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:26 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1339 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:27.498091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1387f37c-64a2-4fe7-b64d-1d3aa35616bd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:27.499285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1387f37c-64a2-4fe7-b64d-1d3aa35616bd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:27.518272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1387f37c-64a2-4fe7-b64d-1d3aa35616bd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:27.526237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1387f37c-64a2-4fe7-b64d-1d3aa35616bd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:27.528066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1387f37c-64a2-4fe7-b64d-1d3aa35616bd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:27.534897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1387f37c-64a2-4fe7-b64d-1d3aa35616bd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:27.653193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1387f37c-64a2-4fe7-b64d-1d3aa35616bd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:27.663197 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1387f37c-64a2-4fe7-b64d-1d3aa35616bd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 200 len: 1267 microversion: 2.1 time: 0.171210 Jul 20 04:39:27.664653 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2112/4479] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:27 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:28.205928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-67827305-729f-4040-a4ed-ae92c46fd89e tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:28.207295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-67827305-729f-4040-a4ed-ae92c46fd89e tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:28.227984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-67827305-729f-4040-a4ed-ae92c46fd89e tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:28.228545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-67827305-729f-4040-a4ed-ae92c46fd89e tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:28.229393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-67827305-729f-4040-a4ed-ae92c46fd89e tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:28.230075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-67827305-729f-4040-a4ed-ae92c46fd89e tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:28.249549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-37395f60-5390-494c-b91e-5e83e5f7d89b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:28.250747 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-37395f60-5390-494c-b91e-5e83e5f7d89b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:28.260801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37395f60-5390-494c-b91e-5e83e5f7d89b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:28.261693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37395f60-5390-494c-b91e-5e83e5f7d89b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:28.262991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37395f60-5390-494c-b91e-5e83e5f7d89b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:28.263648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37395f60-5390-494c-b91e-5e83e5f7d89b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:28.518759 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-37395f60-5390-494c-b91e-5e83e5f7d89b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:28.531644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-37395f60-5390-494c-b91e-5e83e5f7d89b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:28.533289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-37395f60-5390-494c-b91e-5e83e5f7d89b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:28.534522 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-37395f60-5390-494c-b91e-5e83e5f7d89b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1407 microversion: 2.20 time: 0.290566 Jul 20 04:39:28.536971 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2113/4480] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:28 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:28.548850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-552acceb-8764-4f40-8283-6a5924c86d1c req-0458089d-47b2-402d-ae2f-6c78abdc3f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c3c9d87-88a7-4dea-8b81-0e67d259dc53", "name": "network-vif-plugged", "status": "completed", "tag": "e65ca590-1dcb-4c7e-aca1-2e965482add0"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:28.571460 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-552acceb-8764-4f40-8283-6a5924c86d1c req-0458089d-47b2-402d-ae2f-6c78abdc3f04 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:28.572137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-552acceb-8764-4f40-8283-6a5924c86d1c req-0458089d-47b2-402d-ae2f-6c78abdc3f04 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:28.601078 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-552acceb-8764-4f40-8283-6a5924c86d1c req-0458089d-47b2-402d-ae2f-6c78abdc3f04 service nova] Creating event network-vif-plugged:e65ca590-1dcb-4c7e-aca1-2e965482add0 for instance 5c3c9d87-88a7-4dea-8b81-0e67d259dc53 on n-h2-826526-5 Jul 20 04:39:28.606990 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-552acceb-8764-4f40-8283-6a5924c86d1c req-0458089d-47b2-402d-ae2f-6c78abdc3f04 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065677 Jul 20 04:39:28.615456 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2114/4481] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:28.686116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-883dd18e-17f0-4605-9895-a730eaa521e3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:28.687137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-883dd18e-17f0-4605-9895-a730eaa521e3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:28.695376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-883dd18e-17f0-4605-9895-a730eaa521e3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:28.696125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-883dd18e-17f0-4605-9895-a730eaa521e3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:28.697108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-883dd18e-17f0-4605-9895-a730eaa521e3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:28.697725 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-883dd18e-17f0-4605-9895-a730eaa521e3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:28.809845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-883dd18e-17f0-4605-9895-a730eaa521e3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:28.819515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:28.823214 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-883dd18e-17f0-4605-9895-a730eaa521e3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 200 len: 1273 microversion: 2.1 time: 0.144281 Jul 20 04:39:28.833979 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2115/4482] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:28 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:29.435300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-67827305-729f-4040-a4ed-ae92c46fd89e tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:29.449239 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-67827305-729f-4040-a4ed-ae92c46fd89e tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53" status: 200 len: 1372 microversion: 2.1 time: 1.247199 Jul 20 04:39:29.449882 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2368/4483] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:28 2022] GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53 => generated 1372 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:29.553239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-00556f1a-0ee2-4767-ab46-2c595ed62be7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:29.553853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-00556f1a-0ee2-4767-ab46-2c595ed62be7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:29.577493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00556f1a-0ee2-4767-ab46-2c595ed62be7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:29.578140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00556f1a-0ee2-4767-ab46-2c595ed62be7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:29.580955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00556f1a-0ee2-4767-ab46-2c595ed62be7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:29.583496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00556f1a-0ee2-4767-ab46-2c595ed62be7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:29.841183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d8879b3d-3e80-4832-832d-1847631bfa10 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:29.841897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d8879b3d-3e80-4832-832d-1847631bfa10 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:29.852969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8879b3d-3e80-4832-832d-1847631bfa10 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:29.853433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8879b3d-3e80-4832-832d-1847631bfa10 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:29.854246 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8879b3d-3e80-4832-832d-1847631bfa10 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:29.854671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8879b3d-3e80-4832-832d-1847631bfa10 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:29.940451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-00556f1a-0ee2-4767-ab46-2c595ed62be7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:29.952730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-00556f1a-0ee2-4767-ab46-2c595ed62be7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:29.954307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-00556f1a-0ee2-4767-ab46-2c595ed62be7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:29.955831 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-00556f1a-0ee2-4767-ab46-2c595ed62be7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1407 microversion: 2.20 time: 0.406903 Jul 20 04:39:29.967309 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2116/4484] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:29 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1407 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:30.066415 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d8879b3d-3e80-4832-832d-1847631bfa10 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:30.075725 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d8879b3d-3e80-4832-832d-1847631bfa10 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 200 len: 1273 microversion: 2.1 time: 0.238510 Jul 20 04:39:30.077428 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2369/4485] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:29 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 1273 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:30.476889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f7da7c8f-819c-40e4-8397-37b6ecb0035e tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:30.478760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f7da7c8f-819c-40e4-8397-37b6ecb0035e tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:30.506953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f7da7c8f-819c-40e4-8397-37b6ecb0035e tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:30.510944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f7da7c8f-819c-40e4-8397-37b6ecb0035e tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:30.518415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f7da7c8f-819c-40e4-8397-37b6ecb0035e tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:30.518883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f7da7c8f-819c-40e4-8397-37b6ecb0035e tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:30.829510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-92873bdb-3f17-4358-bac3-bf0ca3762eda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-249292403", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:30.830122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f7da7c8f-819c-40e4-8397-37b6ecb0035e tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:30.839608 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f7da7c8f-819c-40e4-8397-37b6ecb0035e tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53" status: 200 len: 1544 microversion: 2.1 time: 0.375294 Jul 20 04:39:30.843808 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2117/4486] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:30 2022] GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53 => generated 1544 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:30.848824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-50d448fa-4b98-49b5-aaf5-cef626b2dbd9 req-17e90dcb-01cb-4d12-8fe7-47e04d8d8e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7e62d3-1b07-483d-9943-887c096d4350", "tag": "f03b37b1-bac2-405f-aeda-863d4b123005"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:30.873953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-50d448fa-4b98-49b5-aaf5-cef626b2dbd9 req-17e90dcb-01cb-4d12-8fe7-47e04d8d8e78 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:30.874734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-50d448fa-4b98-49b5-aaf5-cef626b2dbd9 req-17e90dcb-01cb-4d12-8fe7-47e04d8d8e78 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:30.889053 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-50d448fa-4b98-49b5-aaf5-cef626b2dbd9 req-17e90dcb-01cb-4d12-8fe7-47e04d8d8e78 service nova] Creating event network-changed:f03b37b1-bac2-405f-aeda-863d4b123005 for instance 7c7e62d3-1b07-483d-9943-887c096d4350 on n-h1-826526-5 Jul 20 04:39:30.894738 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-50d448fa-4b98-49b5-aaf5-cef626b2dbd9 req-17e90dcb-01cb-4d12-8fe7-47e04d8d8e78 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049393 Jul 20 04:39:30.895924 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2118/4487] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:30.905008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-62bb6bc3-d743-4c78-8d86-d4cd9d2767fc tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:30.906241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62bb6bc3-d743-4c78-8d86-d4cd9d2767fc tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:30.917345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62bb6bc3-d743-4c78-8d86-d4cd9d2767fc tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:30.918058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62bb6bc3-d743-4c78-8d86-d4cd9d2767fc tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:30.919091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62bb6bc3-d743-4c78-8d86-d4cd9d2767fc tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:30.919724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62bb6bc3-d743-4c78-8d86-d4cd9d2767fc tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:30.927126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-92873bdb-3f17-4358-bac3-bf0ca3762eda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] validate_networks() for [('ea1fc563-a125-4bf9-b7c2-b42347467257', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:39:31.190335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-62bb6bc3-d743-4c78-8d86-d4cd9d2767fc tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:31.200076 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-62bb6bc3-d743-4c78-8d86-d4cd9d2767fc tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53" status: 200 len: 1544 microversion: 2.1 time: 0.301281 Jul 20 04:39:31.203357 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2119/4488] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:30 2022] GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53 => generated 1544 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:31.213921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-81a9f54d-c4c2-4c11-a60e-e25a331123e0 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:31.228796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-81a9f54d-c4c2-4c11-a60e-e25a331123e0 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:31.250438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81a9f54d-c4c2-4c11-a60e-e25a331123e0 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:31.250908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81a9f54d-c4c2-4c11-a60e-e25a331123e0 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:31.254240 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81a9f54d-c4c2-4c11-a60e-e25a331123e0 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:31.254715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81a9f54d-c4c2-4c11-a60e-e25a331123e0 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:31.802711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-81a9f54d-c4c2-4c11-a60e-e25a331123e0 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:31.833188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-81a9f54d-c4c2-4c11-a60e-e25a331123e0 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:31.839286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-81a9f54d-c4c2-4c11-a60e-e25a331123e0 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:31.843815 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-81a9f54d-c4c2-4c11-a60e-e25a331123e0 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1407 microversion: 2.20 time: 0.638250 Jul 20 04:39:31.851209 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2120/4489] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:31 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1407 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:31.870388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4a9e2cec-66b6-48b5-a5af-2e59b44a8ea9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:31.872915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4a9e2cec-66b6-48b5-a5af-2e59b44a8ea9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:31.892820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a9e2cec-66b6-48b5-a5af-2e59b44a8ea9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:31.896019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a9e2cec-66b6-48b5-a5af-2e59b44a8ea9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:31.897371 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a9e2cec-66b6-48b5-a5af-2e59b44a8ea9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:31.897968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a9e2cec-66b6-48b5-a5af-2e59b44a8ea9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:32.551811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4a9e2cec-66b6-48b5-a5af-2e59b44a8ea9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:32.579253 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4a9e2cec-66b6-48b5-a5af-2e59b44a8ea9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 200 len: 1315 microversion: 2.1 time: 0.726192 Jul 20 04:39:32.580440 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2121/4490] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:31 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 1315 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:32.667209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-92873bdb-3f17-4358-bac3-bf0ca3762eda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:39:32.670325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-92873bdb-3f17-4358-bac3-bf0ca3762eda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:39:32.670982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-92873bdb-3f17-4358-bac3-bf0ca3762eda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:39:32.671544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-92873bdb-3f17-4358-bac3-bf0ca3762eda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:39:32.672131 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-92873bdb-3f17-4358-bac3-bf0ca3762eda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:39:32.686629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-92873bdb-3f17-4358-bac3-bf0ca3762eda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:32.690250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-92873bdb-3f17-4358-bac3-bf0ca3762eda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:32.692525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-92873bdb-3f17-4358-bac3-bf0ca3762eda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:32.693946 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-92873bdb-3f17-4358-bac3-bf0ca3762eda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:32.750524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-92873bdb-3f17-4358-bac3-bf0ca3762eda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Getting quotas for project 3e123ad99de64f50b9cd4373597c3a9e. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:39:32.777718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-92873bdb-3f17-4358-bac3-bf0ca3762eda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Getting quotas for user 8ea213e79bcf4aaea49446db5eb55271 and project 3e123ad99de64f50b9cd4373597c3a9e. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:39:32.807760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-92873bdb-3f17-4358-bac3-bf0ca3762eda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:39:32.811868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-92873bdb-3f17-4358-bac3-bf0ca3762eda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:39:32.868170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-42e9694c-ca6f-4622-955d-9cee4136ac68 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:32.870078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-42e9694c-ca6f-4622-955d-9cee4136ac68 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:32.890906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-42e9694c-ca6f-4622-955d-9cee4136ac68 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:32.905145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-42e9694c-ca6f-4622-955d-9cee4136ac68 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:32.906417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-42e9694c-ca6f-4622-955d-9cee4136ac68 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:32.907095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-42e9694c-ca6f-4622-955d-9cee4136ac68 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:32.921715 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-92873bdb-3f17-4358-bac3-bf0ca3762eda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.357828 Jul 20 04:39:32.923938 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2370/4491] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:39:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 2363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:39:32.939344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-de969fbe-74b2-43ee-bd69-38e70514a465 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:32.943057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-de969fbe-74b2-43ee-bd69-38e70514a465 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:33.073078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-de969fbe-74b2-43ee-bd69-38e70514a465 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:33.080997 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-de969fbe-74b2-43ee-bd69-38e70514a465 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1221 microversion: 2.1 time: 0.151928 Jul 20 04:39:33.112158 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2371/4492] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:32 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1221 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:33.213233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dc452775-c904-43d9-838d-4837f21c2df0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1107136311", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:33.320046 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-dc452775-c904-43d9-838d-4837f21c2df0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] validate_networks() for [('ea1fc563-a125-4bf9-b7c2-b42347467257', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:39:34.285468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-42e9694c-ca6f-4622-955d-9cee4136ac68 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:34.305167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-42e9694c-ca6f-4622-955d-9cee4136ac68 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:34.314248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-42e9694c-ca6f-4622-955d-9cee4136ac68 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:34.318299 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-42e9694c-ca6f-4622-955d-9cee4136ac68 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1407 microversion: 2.20 time: 1.454160 Jul 20 04:39:34.320637 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2122/4493] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:32 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1407 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:34.348323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-194c7259-77fa-43c8-97f1-389d205b4b9d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:34.354131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-194c7259-77fa-43c8-97f1-389d205b4b9d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:34.376979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-194c7259-77fa-43c8-97f1-389d205b4b9d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:34.382788 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-194c7259-77fa-43c8-97f1-389d205b4b9d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:34.384192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-194c7259-77fa-43c8-97f1-389d205b4b9d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:34.386256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-194c7259-77fa-43c8-97f1-389d205b4b9d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:35.362064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-dc452775-c904-43d9-838d-4837f21c2df0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:39:35.362549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-dc452775-c904-43d9-838d-4837f21c2df0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:39:35.363432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-dc452775-c904-43d9-838d-4837f21c2df0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:39:35.363842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-dc452775-c904-43d9-838d-4837f21c2df0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:39:35.364447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-dc452775-c904-43d9-838d-4837f21c2df0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:39:35.389846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc452775-c904-43d9-838d-4837f21c2df0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:35.392556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc452775-c904-43d9-838d-4837f21c2df0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:35.393513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc452775-c904-43d9-838d-4837f21c2df0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:35.393917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc452775-c904-43d9-838d-4837f21c2df0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:35.441083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-dc452775-c904-43d9-838d-4837f21c2df0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Getting quotas for project 3e123ad99de64f50b9cd4373597c3a9e. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:39:35.457944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-dc452775-c904-43d9-838d-4837f21c2df0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Getting quotas for user 8ea213e79bcf4aaea49446db5eb55271 and project 3e123ad99de64f50b9cd4373597c3a9e. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:39:35.485706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dc452775-c904-43d9-838d-4837f21c2df0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:39:35.491675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dc452775-c904-43d9-838d-4837f21c2df0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:39:35.541444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-194c7259-77fa-43c8-97f1-389d205b4b9d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:35.555829 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-194c7259-77fa-43c8-97f1-389d205b4b9d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 200 len: 1315 microversion: 2.1 time: 1.229455 Jul 20 04:39:35.556518 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2123/4494] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:34 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 1315 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:35.562084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-b179856c-f87a-4a45-939f-972e2c20163c req-e192ce22-1ed8-4996-af82-0f2a5f206730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc48e56-31bb-4f80-8f4f-4f79975d9fc9", "tag": "ddb1afcf-7726-4111-8880-0d1619ad0891"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:35.593420 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dc452775-c904-43d9-838d-4837f21c2df0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.384871 Jul 20 04:39:35.600835 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2372/4495] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:39:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 2392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:39:35.607401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c37cb62e-748d-4888-b1dc-0f16e1f1d95c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:35.608361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c37cb62e-748d-4888-b1dc-0f16e1f1d95c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:35.611614 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b179856c-f87a-4a45-939f-972e2c20163c req-e192ce22-1ed8-4996-af82-0f2a5f206730 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:35.612059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b179856c-f87a-4a45-939f-972e2c20163c req-e192ce22-1ed8-4996-af82-0f2a5f206730 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:35.641476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c37cb62e-748d-4888-b1dc-0f16e1f1d95c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:35.644735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c37cb62e-748d-4888-b1dc-0f16e1f1d95c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:35.645574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c37cb62e-748d-4888-b1dc-0f16e1f1d95c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:35.646011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c37cb62e-748d-4888-b1dc-0f16e1f1d95c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:35.649615 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-b179856c-f87a-4a45-939f-972e2c20163c req-e192ce22-1ed8-4996-af82-0f2a5f206730 service nova] Creating event network-changed:ddb1afcf-7726-4111-8880-0d1619ad0891 for instance 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 on n-h2-826526-5 Jul 20 04:39:35.661236 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-b179856c-f87a-4a45-939f-972e2c20163c req-e192ce22-1ed8-4996-af82-0f2a5f206730 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102649 Jul 20 04:39:35.661881 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2124/4496] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:35.668014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-99261f55-63a5-4533-9b8a-4a0b09715d36 req-a2c8568d-f550-4ebf-a2bd-44bab22dd2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7e62d3-1b07-483d-9943-887c096d4350", "name": "network-vif-plugged", "status": "completed", "tag": "f03b37b1-bac2-405f-aeda-863d4b123005"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:35.700443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-99261f55-63a5-4533-9b8a-4a0b09715d36 req-a2c8568d-f550-4ebf-a2bd-44bab22dd2a5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:35.701098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-99261f55-63a5-4533-9b8a-4a0b09715d36 req-a2c8568d-f550-4ebf-a2bd-44bab22dd2a5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:35.714626 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-99261f55-63a5-4533-9b8a-4a0b09715d36 req-a2c8568d-f550-4ebf-a2bd-44bab22dd2a5 service nova] Creating event network-vif-plugged:f03b37b1-bac2-405f-aeda-863d4b123005 for instance 7c7e62d3-1b07-483d-9943-887c096d4350 on n-h1-826526-5 Jul 20 04:39:35.719835 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-99261f55-63a5-4533-9b8a-4a0b09715d36 req-a2c8568d-f550-4ebf-a2bd-44bab22dd2a5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056502 Jul 20 04:39:35.720837 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2125/4497] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:35.726508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4b6cf898-42cd-44ca-9c23-a1b85fff3046 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:35.727447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4b6cf898-42cd-44ca-9c23-a1b85fff3046 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:35.872386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4b6cf898-42cd-44ca-9c23-a1b85fff3046 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:35.881256 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4b6cf898-42cd-44ca-9c23-a1b85fff3046 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1222 microversion: 2.1 time: 0.159076 Jul 20 04:39:35.881983 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2126/4498] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:35 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1222 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:36.575097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7e6abe83-e739-4b11-b866-07644e623539 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:36.575756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7e6abe83-e739-4b11-b866-07644e623539 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:36.583948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:36.597341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e6abe83-e739-4b11-b866-07644e623539 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:36.598024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e6abe83-e739-4b11-b866-07644e623539 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:36.598978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e6abe83-e739-4b11-b866-07644e623539 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:36.599451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e6abe83-e739-4b11-b866-07644e623539 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:36.864928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c37cb62e-748d-4888-b1dc-0f16e1f1d95c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:36.881368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c37cb62e-748d-4888-b1dc-0f16e1f1d95c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:36.909582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c37cb62e-748d-4888-b1dc-0f16e1f1d95c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:36.911973 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c37cb62e-748d-4888-b1dc-0f16e1f1d95c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1407 microversion: 2.20 time: 1.309680 Jul 20 04:39:36.925039 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2373/4499] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:35 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1407 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:36.930366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3fc38270-06fd-496c-bb4f-8fa753d504ce tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:36.932996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3fc38270-06fd-496c-bb4f-8fa753d504ce tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:36.948077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fc38270-06fd-496c-bb4f-8fa753d504ce tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:36.948565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fc38270-06fd-496c-bb4f-8fa753d504ce tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:36.950546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fc38270-06fd-496c-bb4f-8fa753d504ce tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:36.950994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fc38270-06fd-496c-bb4f-8fa753d504ce tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:37.078686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3fc38270-06fd-496c-bb4f-8fa753d504ce tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:37.096149 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3fc38270-06fd-496c-bb4f-8fa753d504ce tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1274 microversion: 2.1 time: 0.181125 Jul 20 04:39:37.111389 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2374/4500] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:36 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1274 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:37.179186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7e6abe83-e739-4b11-b866-07644e623539 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:37.191407 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7e6abe83-e739-4b11-b866-07644e623539 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 200 len: 1315 microversion: 2.1 time: 0.620162 Jul 20 04:39:37.196917 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2127/4501] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:36 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 1315 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:37.650219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-4dc9a56e-c506-4731-a5a2-83a0089d0abf req-b8c15620-29e2-4e12-95e7-346e9b345371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c3c9d87-88a7-4dea-8b81-0e67d259dc53", "tag": "e65ca590-1dcb-4c7e-aca1-2e965482add0"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:37.660645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4dc9a56e-c506-4731-a5a2-83a0089d0abf req-b8c15620-29e2-4e12-95e7-346e9b345371 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:37.661349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4dc9a56e-c506-4731-a5a2-83a0089d0abf req-b8c15620-29e2-4e12-95e7-346e9b345371 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:37.672007 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=89 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:37.674817 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-4dc9a56e-c506-4731-a5a2-83a0089d0abf req-b8c15620-29e2-4e12-95e7-346e9b345371 service nova] Creating event network-changed:e65ca590-1dcb-4c7e-aca1-2e965482add0 for instance 5c3c9d87-88a7-4dea-8b81-0e67d259dc53 on n-h2-826526-5 Jul 20 04:39:37.680670 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-4dc9a56e-c506-4731-a5a2-83a0089d0abf req-b8c15620-29e2-4e12-95e7-346e9b345371 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035338 Jul 20 04:39:37.681859 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2375/4502] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:37.933195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4599a57a-d060-4729-a120-578865b50720 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:37.934605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4599a57a-d060-4729-a120-578865b50720 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:37.963875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4599a57a-d060-4729-a120-578865b50720 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:37.968751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4599a57a-d060-4729-a120-578865b50720 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:37.971586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4599a57a-d060-4729-a120-578865b50720 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:37.983705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4599a57a-d060-4729-a120-578865b50720 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:38.117578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8de760a3-812a-4938-94de-581a4bba8230 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:38.118466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8de760a3-812a-4938-94de-581a4bba8230 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:38.137561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8de760a3-812a-4938-94de-581a4bba8230 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:38.139539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8de760a3-812a-4938-94de-581a4bba8230 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:38.141203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8de760a3-812a-4938-94de-581a4bba8230 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:38.143252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8de760a3-812a-4938-94de-581a4bba8230 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:38.381337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8de760a3-812a-4938-94de-581a4bba8230 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:38.392948 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8de760a3-812a-4938-94de-581a4bba8230 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1292 microversion: 2.1 time: 0.279777 Jul 20 04:39:38.394719 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2376/4503] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:38 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1292 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:38.405840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cc27fe00-675a-48a6-a6f6-2d74f62aa3d2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:38.406734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cc27fe00-675a-48a6-a6f6-2d74f62aa3d2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:38.423581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc27fe00-675a-48a6-a6f6-2d74f62aa3d2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:38.424359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc27fe00-675a-48a6-a6f6-2d74f62aa3d2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:38.425560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc27fe00-675a-48a6-a6f6-2d74f62aa3d2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:38.427071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc27fe00-675a-48a6-a6f6-2d74f62aa3d2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:38.910314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cc27fe00-675a-48a6-a6f6-2d74f62aa3d2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:38.924433 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cc27fe00-675a-48a6-a6f6-2d74f62aa3d2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 200 len: 1315 microversion: 2.1 time: 0.528404 Jul 20 04:39:38.929253 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2377/4504] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:38 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:39.042351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4599a57a-d060-4729-a120-578865b50720 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:39.061186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4599a57a-d060-4729-a120-578865b50720 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:39.064789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4599a57a-d060-4729-a120-578865b50720 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:39.066206 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4599a57a-d060-4729-a120-578865b50720 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1407 microversion: 2.20 time: 1.137208 Jul 20 04:39:39.066958 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2128/4505] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:37 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1407 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:39.410188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-690b0cc0-48d4-4eba-b55c-766ed2af8d02 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:39.411439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-690b0cc0-48d4-4eba-b55c-766ed2af8d02 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:39.449593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-690b0cc0-48d4-4eba-b55c-766ed2af8d02 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:39.453296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-690b0cc0-48d4-4eba-b55c-766ed2af8d02 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:39.456872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-690b0cc0-48d4-4eba-b55c-766ed2af8d02 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:39.465989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-690b0cc0-48d4-4eba-b55c-766ed2af8d02 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:39.572624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-690b0cc0-48d4-4eba-b55c-766ed2af8d02 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:39.589889 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-690b0cc0-48d4-4eba-b55c-766ed2af8d02 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1280 microversion: 2.1 time: 0.184013 Jul 20 04:39:39.599251 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2378/4506] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:39 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1280 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:39.946541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-35db594c-6d08-4964-ba5c-c629ce3fd51b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:39.947584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-35db594c-6d08-4964-ba5c-c629ce3fd51b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:39.955050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35db594c-6d08-4964-ba5c-c629ce3fd51b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:39.956889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35db594c-6d08-4964-ba5c-c629ce3fd51b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:39.958339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35db594c-6d08-4964-ba5c-c629ce3fd51b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:39.959158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35db594c-6d08-4964-ba5c-c629ce3fd51b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:40.009644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-f740fc1a-7c31-464a-9659-3fbf1736f85c req-ee52bd0d-99b8-40d1-9ec2-1dbd34e7856f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca2f9ea6-9cd9-416d-b210-2b1968e47ea9", "tag": "967471b4-4a23-438b-8616-9180c44b710e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:40.015722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:40.031030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f740fc1a-7c31-464a-9659-3fbf1736f85c req-ee52bd0d-99b8-40d1-9ec2-1dbd34e7856f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:40.031684 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f740fc1a-7c31-464a-9659-3fbf1736f85c req-ee52bd0d-99b8-40d1-9ec2-1dbd34e7856f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:40.046805 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-f740fc1a-7c31-464a-9659-3fbf1736f85c req-ee52bd0d-99b8-40d1-9ec2-1dbd34e7856f service nova] Creating event network-changed:967471b4-4a23-438b-8616-9180c44b710e for instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 on n-h1-826526-5 Jul 20 04:39:40.055674 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-f740fc1a-7c31-464a-9659-3fbf1736f85c req-ee52bd0d-99b8-40d1-9ec2-1dbd34e7856f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052748 Jul 20 04:39:40.061858 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2379/4507] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:40.086062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4ea20acf-d065-4578-8fbd-9feee205473a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:40.090128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4ea20acf-d065-4578-8fbd-9feee205473a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:40.101723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ea20acf-d065-4578-8fbd-9feee205473a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:40.102831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ea20acf-d065-4578-8fbd-9feee205473a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:40.105153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ea20acf-d065-4578-8fbd-9feee205473a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:40.107480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ea20acf-d065-4578-8fbd-9feee205473a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:40.446192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-35db594c-6d08-4964-ba5c-c629ce3fd51b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:40.457723 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-35db594c-6d08-4964-ba5c-c629ce3fd51b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 200 len: 1315 microversion: 2.1 time: 0.515269 Jul 20 04:39:40.473156 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2129/4508] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:39 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:40.489473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4ea20acf-d065-4578-8fbd-9feee205473a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:40.500220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4ea20acf-d065-4578-8fbd-9feee205473a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:40.501779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4ea20acf-d065-4578-8fbd-9feee205473a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:40.503285 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4ea20acf-d065-4578-8fbd-9feee205473a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1599 microversion: 2.20 time: 0.422289 Jul 20 04:39:40.508015 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2380/4509] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:40 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1599 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:39:40.535583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-59c7bd89-1168-4890-9483-a046932b64e5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:40.536085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-59c7bd89-1168-4890-9483-a046932b64e5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:40.550560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59c7bd89-1168-4890-9483-a046932b64e5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:40.551131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59c7bd89-1168-4890-9483-a046932b64e5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:40.555062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59c7bd89-1168-4890-9483-a046932b64e5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:40.557245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59c7bd89-1168-4890-9483-a046932b64e5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:40.607076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-949c68e3-7aec-4bda-bb67-94441a5ea7b2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:40.607693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-949c68e3-7aec-4bda-bb67-94441a5ea7b2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:40.638927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-949c68e3-7aec-4bda-bb67-94441a5ea7b2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:40.640511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-949c68e3-7aec-4bda-bb67-94441a5ea7b2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:40.641489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-949c68e3-7aec-4bda-bb67-94441a5ea7b2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:40.642071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-949c68e3-7aec-4bda-bb67-94441a5ea7b2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:40.843857 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-59c7bd89-1168-4890-9483-a046932b64e5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.313625 Jul 20 04:39:40.844729 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2130/4510] 10.222.0.17 () {60 vars in 1315 bytes} [Wed Jul 20 04:39:40 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350/os-interface => generated 285 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:39:40.985815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-949c68e3-7aec-4bda-bb67-94441a5ea7b2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:40.994656 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-949c68e3-7aec-4bda-bb67-94441a5ea7b2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1322 microversion: 2.1 time: 0.391394 Jul 20 04:39:40.995647 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2381/4511] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:40 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:41.481932 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e8469a27-5739-495d-a3c8-4f223bcd11b3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:41.482557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e8469a27-5739-495d-a3c8-4f223bcd11b3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:41.500048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8469a27-5739-495d-a3c8-4f223bcd11b3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:41.500534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8469a27-5739-495d-a3c8-4f223bcd11b3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:41.501502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8469a27-5739-495d-a3c8-4f223bcd11b3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:41.502085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8469a27-5739-495d-a3c8-4f223bcd11b3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:42.015396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2d0c3e49-5f35-4f32-9959-7a49dc1112e0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:42.016872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2d0c3e49-5f35-4f32-9959-7a49dc1112e0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:42.026048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d0c3e49-5f35-4f32-9959-7a49dc1112e0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:42.027158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d0c3e49-5f35-4f32-9959-7a49dc1112e0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:42.028180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d0c3e49-5f35-4f32-9959-7a49dc1112e0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:42.028985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d0c3e49-5f35-4f32-9959-7a49dc1112e0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:42.188078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e8469a27-5739-495d-a3c8-4f223bcd11b3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:42.209984 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e8469a27-5739-495d-a3c8-4f223bcd11b3 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 200 len: 1315 microversion: 2.1 time: 0.718834 Jul 20 04:39:42.210732 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2131/4512] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:41 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 1315 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:42.275121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2d0c3e49-5f35-4f32-9959-7a49dc1112e0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:42.291112 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2d0c3e49-5f35-4f32-9959-7a49dc1112e0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1322 microversion: 2.1 time: 0.283376 Jul 20 04:39:42.298226 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2382/4513] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:42 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:42.444434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-60adc364-4308-4bb7-845c-d1bf6c02f465 req-ae5d70d2-95d7-440b-b44c-d921d2351dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc48e56-31bb-4f80-8f4f-4f79975d9fc9", "name": "network-vif-plugged", "status": "completed", "tag": "ddb1afcf-7726-4111-8880-0d1619ad0891"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:42.457087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-60adc364-4308-4bb7-845c-d1bf6c02f465 req-ae5d70d2-95d7-440b-b44c-d921d2351dd1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:42.465320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-60adc364-4308-4bb7-845c-d1bf6c02f465 req-ae5d70d2-95d7-440b-b44c-d921d2351dd1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:42.494177 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-60adc364-4308-4bb7-845c-d1bf6c02f465 req-ae5d70d2-95d7-440b-b44c-d921d2351dd1 service nova] Creating event network-vif-plugged:ddb1afcf-7726-4111-8880-0d1619ad0891 for instance 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 on n-h2-826526-5 Jul 20 04:39:42.515601 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-60adc364-4308-4bb7-845c-d1bf6c02f465 req-ae5d70d2-95d7-440b-b44c-d921d2351dd1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074242 Jul 20 04:39:42.516715 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2132/4514] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:43.092443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-dd85052a-73a7-4c6d-beb0-a32a3a4ee7d9 req-68089cc5-38ba-439c-a2be-3e479e7c6b14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3975993-61a4-40e2-b5c6-19411a0511d1", "tag": "eea80dc9-92d0-43cd-bf9c-49d65af5ee95"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:43.115794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-dd85052a-73a7-4c6d-beb0-a32a3a4ee7d9 req-68089cc5-38ba-439c-a2be-3e479e7c6b14 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:43.121520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-dd85052a-73a7-4c6d-beb0-a32a3a4ee7d9 req-68089cc5-38ba-439c-a2be-3e479e7c6b14 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:43.145591 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-dd85052a-73a7-4c6d-beb0-a32a3a4ee7d9 req-68089cc5-38ba-439c-a2be-3e479e7c6b14 service nova] Creating event network-changed:eea80dc9-92d0-43cd-bf9c-49d65af5ee95 for instance e3975993-61a4-40e2-b5c6-19411a0511d1 on n-h2-826526-5 Jul 20 04:39:43.163186 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-dd85052a-73a7-4c6d-beb0-a32a3a4ee7d9 req-68089cc5-38ba-439c-a2be-3e479e7c6b14 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075075 Jul 20 04:39:43.164378 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2383/4515] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:43.232607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d547fb83-1f9b-4fe1-a9dc-155dad1827ed tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:43.248661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d547fb83-1f9b-4fe1-a9dc-155dad1827ed tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:43.272595 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d547fb83-1f9b-4fe1-a9dc-155dad1827ed tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:43.276411 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d547fb83-1f9b-4fe1-a9dc-155dad1827ed tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:43.277601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d547fb83-1f9b-4fe1-a9dc-155dad1827ed tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:43.281155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d547fb83-1f9b-4fe1-a9dc-155dad1827ed tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:43.315468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fa1da2e8-e115-4c1c-bad6-3581c088d72e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:43.316518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fa1da2e8-e115-4c1c-bad6-3581c088d72e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:43.328080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa1da2e8-e115-4c1c-bad6-3581c088d72e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:43.328863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa1da2e8-e115-4c1c-bad6-3581c088d72e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:43.335365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa1da2e8-e115-4c1c-bad6-3581c088d72e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:43.336046 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa1da2e8-e115-4c1c-bad6-3581c088d72e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:43.562649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fa1da2e8-e115-4c1c-bad6-3581c088d72e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:43.581194 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fa1da2e8-e115-4c1c-bad6-3581c088d72e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1322 microversion: 2.1 time: 0.270090 Jul 20 04:39:43.581797 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2384/4516] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:43 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:44.098102 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d547fb83-1f9b-4fe1-a9dc-155dad1827ed tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:44.107660 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d547fb83-1f9b-4fe1-a9dc-155dad1827ed tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 200 len: 1315 microversion: 2.1 time: 0.883825 Jul 20 04:39:44.118429 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2133/4517] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:43 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 1315 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:44.601174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-26d53da6-9f02-4f85-a731-d79edd9d73b8 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:44.601174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-26d53da6-9f02-4f85-a731-d79edd9d73b8 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:44.639904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26d53da6-9f02-4f85-a731-d79edd9d73b8 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:44.641767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26d53da6-9f02-4f85-a731-d79edd9d73b8 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:44.643564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26d53da6-9f02-4f85-a731-d79edd9d73b8 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:44.645843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26d53da6-9f02-4f85-a731-d79edd9d73b8 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:44.875141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-26d53da6-9f02-4f85-a731-d79edd9d73b8 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:44.889684 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-26d53da6-9f02-4f85-a731-d79edd9d73b8 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1322 microversion: 2.1 time: 0.296011 Jul 20 04:39:44.890303 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2385/4518] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:44 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:45.125316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fa80f2d1-4c16-45ab-b72a-7acd201cfa91 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:45.126664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fa80f2d1-4c16-45ab-b72a-7acd201cfa91 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:45.134711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fa80f2d1-4c16-45ab-b72a-7acd201cfa91 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:45.135484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fa80f2d1-4c16-45ab-b72a-7acd201cfa91 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:45.136606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fa80f2d1-4c16-45ab-b72a-7acd201cfa91 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:45.137174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fa80f2d1-4c16-45ab-b72a-7acd201cfa91 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:45.300436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-f3a78480-67cf-4e78-be12-06c42c806885 req-485e8c1d-46ef-456a-a21e-1e2992187aea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7e62d3-1b07-483d-9943-887c096d4350", "tag": "f03b37b1-bac2-405f-aeda-863d4b123005"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:45.314832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f3a78480-67cf-4e78-be12-06c42c806885 req-485e8c1d-46ef-456a-a21e-1e2992187aea service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:45.315338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f3a78480-67cf-4e78-be12-06c42c806885 req-485e8c1d-46ef-456a-a21e-1e2992187aea service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:45.347289 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-f3a78480-67cf-4e78-be12-06c42c806885 req-485e8c1d-46ef-456a-a21e-1e2992187aea service nova] Creating event network-changed:f03b37b1-bac2-405f-aeda-863d4b123005 for instance 7c7e62d3-1b07-483d-9943-887c096d4350 on n-h1-826526-5 Jul 20 04:39:45.360216 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-f3a78480-67cf-4e78-be12-06c42c806885 req-485e8c1d-46ef-456a-a21e-1e2992187aea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071797 Jul 20 04:39:45.360520 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2386/4519] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:45.370930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fa80f2d1-4c16-45ab-b72a-7acd201cfa91 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:45.407978 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fa80f2d1-4c16-45ab-b72a-7acd201cfa91 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 200 len: 1502 microversion: 2.1 time: 0.284792 Jul 20 04:39:45.409564 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2134/4520] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:45 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 1502 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:45.432306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-afe1a08e-cf46-43d0-929d-e8a35e12d996 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:45.436322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-afe1a08e-cf46-43d0-929d-e8a35e12d996 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:45.441223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:45.464511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afe1a08e-cf46-43d0-929d-e8a35e12d996 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:45.467548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afe1a08e-cf46-43d0-929d-e8a35e12d996 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:45.468764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afe1a08e-cf46-43d0-929d-e8a35e12d996 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:45.469471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afe1a08e-cf46-43d0-929d-e8a35e12d996 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:45.498021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=34 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:45.714790 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.network.security_group_api [None req-afe1a08e-cf46-43d0-929d-e8a35e12d996 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Removing security group fbcd89cc-2ee0-4c2b-8e89-db9eb668ee2c from port ddb1afcf-7726-4111-8880-0d1619ad0891 Jul 20 04:39:45.908680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a3497ea8-dc66-486b-82da-b35bcea26527 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:45.910026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a3497ea8-dc66-486b-82da-b35bcea26527 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:45.925189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=14 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:45.933339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a3497ea8-dc66-486b-82da-b35bcea26527 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:45.935312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a3497ea8-dc66-486b-82da-b35bcea26527 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:45.938856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a3497ea8-dc66-486b-82da-b35bcea26527 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:45.946307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a3497ea8-dc66-486b-82da-b35bcea26527 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:46.399440 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-afe1a08e-cf46-43d0-929d-e8a35e12d996 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9/action" status: 202 len: 0 microversion: 2.1 time: 0.977798 Jul 20 04:39:46.404689 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2387/4521] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:39:45 2022] POST /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9/action => generated 0 bytes in 984 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:39:46.411930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-d6c578dc-069e-4fb0-ae2a-4ec54ea77c71 req-ca951075-fac0-4449-933d-b877342d1c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2f9ea6-9cd9-416d-b210-2b1968e47ea9", "name": "network-vif-plugged", "status": "completed", "tag": "967471b4-4a23-438b-8616-9180c44b710e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:46.431958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d6c578dc-069e-4fb0-ae2a-4ec54ea77c71 req-ca951075-fac0-4449-933d-b877342d1c3e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:46.432817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d6c578dc-069e-4fb0-ae2a-4ec54ea77c71 req-ca951075-fac0-4449-933d-b877342d1c3e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:46.476438 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-d6c578dc-069e-4fb0-ae2a-4ec54ea77c71 req-ca951075-fac0-4449-933d-b877342d1c3e service nova] Creating event network-vif-plugged:967471b4-4a23-438b-8616-9180c44b710e for instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 on n-h1-826526-5 Jul 20 04:39:46.509162 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-d6c578dc-069e-4fb0-ae2a-4ec54ea77c71 req-ca951075-fac0-4449-933d-b877342d1c3e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084645 Jul 20 04:39:46.510937 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2388/4522] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:46.516229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a3497ea8-dc66-486b-82da-b35bcea26527 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:46.526709 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a3497ea8-dc66-486b-82da-b35bcea26527 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1322 microversion: 2.1 time: 0.624342 Jul 20 04:39:46.530832 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2135/4523] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:45 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1322 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:46.531490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3df52b53-dd9c-4d56-9c8b-6da60b18f6b7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:46.533307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3df52b53-dd9c-4d56-9c8b-6da60b18f6b7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:46.552865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3df52b53-dd9c-4d56-9c8b-6da60b18f6b7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:46.567531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3df52b53-dd9c-4d56-9c8b-6da60b18f6b7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:46.568596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3df52b53-dd9c-4d56-9c8b-6da60b18f6b7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:46.569112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3df52b53-dd9c-4d56-9c8b-6da60b18f6b7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:46.985336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3df52b53-dd9c-4d56-9c8b-6da60b18f6b7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:46.996732 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3df52b53-dd9c-4d56-9c8b-6da60b18f6b7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 200 len: 1460 microversion: 2.1 time: 0.483940 Jul 20 04:39:47.012768 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2389/4524] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:46 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 1460 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:47.029696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e373ffe2-3506-46f1-a1dd-1a4f1814958a req-c86431d4-2166-48d0-9e9d-bbdaa870b7dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc48e56-31bb-4f80-8f4f-4f79975d9fc9", "tag": "ddb1afcf-7726-4111-8880-0d1619ad0891"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:47.049048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e373ffe2-3506-46f1-a1dd-1a4f1814958a req-c86431d4-2166-48d0-9e9d-bbdaa870b7dd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.052497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e373ffe2-3506-46f1-a1dd-1a4f1814958a req-c86431d4-2166-48d0-9e9d-bbdaa870b7dd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.079600 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e373ffe2-3506-46f1-a1dd-1a4f1814958a req-c86431d4-2166-48d0-9e9d-bbdaa870b7dd service nova] Creating event network-changed:ddb1afcf-7726-4111-8880-0d1619ad0891 for instance 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 on n-h2-826526-5 Jul 20 04:39:47.085302 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e373ffe2-3506-46f1-a1dd-1a4f1814958a req-c86431d4-2166-48d0-9e9d-bbdaa870b7dd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070915 Jul 20 04:39:47.090072 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2390/4525] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:47.122344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e80bbd77-1348-4342-b8dc-e73c2518cfc2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:47.144895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e80bbd77-1348-4342-b8dc-e73c2518cfc2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:47.173806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e80bbd77-1348-4342-b8dc-e73c2518cfc2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.175066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e80bbd77-1348-4342-b8dc-e73c2518cfc2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.175996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e80bbd77-1348-4342-b8dc-e73c2518cfc2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.176620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e80bbd77-1348-4342-b8dc-e73c2518cfc2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.223761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-003f53a6-043b-45ac-926e-c722db7ba8d0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:47.224853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-003f53a6-043b-45ac-926e-c722db7ba8d0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:47.235873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-003f53a6-043b-45ac-926e-c722db7ba8d0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.238364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-003f53a6-043b-45ac-926e-c722db7ba8d0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.239426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-003f53a6-043b-45ac-926e-c722db7ba8d0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.240797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-003f53a6-043b-45ac-926e-c722db7ba8d0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.303297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:47.317504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-003f53a6-043b-45ac-926e-c722db7ba8d0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:39:47.488993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:47.496511 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-003f53a6-043b-45ac-926e-c722db7ba8d0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 204 len: 0 microversion: 2.42 time: 0.963180 Jul 20 04:39:47.498218 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2136/4526] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:39:46 2022] DELETE /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 0 bytes in 966 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:39:47.499843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e80bbd77-1348-4342-b8dc-e73c2518cfc2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:47.510160 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e80bbd77-1348-4342-b8dc-e73c2518cfc2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.418357 Jul 20 04:39:47.513185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-56411a14-e977-4bca-b41d-72a65e7d196e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:47.515122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-56411a14-e977-4bca-b41d-72a65e7d196e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:47.516165 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2391/4527] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:47 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:47.525402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56411a14-e977-4bca-b41d-72a65e7d196e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.525901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56411a14-e977-4bca-b41d-72a65e7d196e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.530704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56411a14-e977-4bca-b41d-72a65e7d196e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.530704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56411a14-e977-4bca-b41d-72a65e7d196e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.540468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0224bcb8-f8fc-4cfc-a737-9f75b8449597 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:47.541738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0224bcb8-f8fc-4cfc-a737-9f75b8449597 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:47.551412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0224bcb8-f8fc-4cfc-a737-9f75b8449597 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.551856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0224bcb8-f8fc-4cfc-a737-9f75b8449597 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.552877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0224bcb8-f8fc-4cfc-a737-9f75b8449597 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.558951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0224bcb8-f8fc-4cfc-a737-9f75b8449597 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.958551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-56411a14-e977-4bca-b41d-72a65e7d196e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:47.971629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-56411a14-e977-4bca-b41d-72a65e7d196e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:47.973162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-56411a14-e977-4bca-b41d-72a65e7d196e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:47.974458 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-56411a14-e977-4bca-b41d-72a65e7d196e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 2962 microversion: 2.42 time: 0.472134 Jul 20 04:39:47.975181 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2137/4528] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:47 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 2962 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:39:47.995272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7b76b015-bd09-494b-a269-bbd37ed52894 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:47.996424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7b76b015-bd09-494b-a269-bbd37ed52894 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:48.005844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b76b015-bd09-494b-a269-bbd37ed52894 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:48.006554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b76b015-bd09-494b-a269-bbd37ed52894 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:48.007661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b76b015-bd09-494b-a269-bbd37ed52894 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:48.008097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b76b015-bd09-494b-a269-bbd37ed52894 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:48.105730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0224bcb8-f8fc-4cfc-a737-9f75b8449597 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:48.119462 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0224bcb8-f8fc-4cfc-a737-9f75b8449597 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.587828 Jul 20 04:39:48.120765 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2392/4529] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:47 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:48.167265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6224d021-3fde-46f7-979e-b40a401dacb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:48.167265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6224d021-3fde-46f7-979e-b40a401dacb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:48.189228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6224d021-3fde-46f7-979e-b40a401dacb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:48.190040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6224d021-3fde-46f7-979e-b40a401dacb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:48.194224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6224d021-3fde-46f7-979e-b40a401dacb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:48.196661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6224d021-3fde-46f7-979e-b40a401dacb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:48.297081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7b76b015-bd09-494b-a269-bbd37ed52894 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:48.307355 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7b76b015-bd09-494b-a269-bbd37ed52894 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1322 microversion: 2.1 time: 0.326863 Jul 20 04:39:48.311230 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2138/4530] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:47 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:48.437977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6224d021-3fde-46f7-979e-b40a401dacb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:48.447859 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6224d021-3fde-46f7-979e-b40a401dacb1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.313906 Jul 20 04:39:48.460246 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2393/4531] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:48 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:48.466237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0a893c3e-203c-4133-a29b-3d97a13420b2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:48.467319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0a893c3e-203c-4133-a29b-3d97a13420b2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:48.478495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0a893c3e-203c-4133-a29b-3d97a13420b2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:48.478981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0a893c3e-203c-4133-a29b-3d97a13420b2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:48.479793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0a893c3e-203c-4133-a29b-3d97a13420b2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:48.480545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0a893c3e-203c-4133-a29b-3d97a13420b2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:48.658866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0a893c3e-203c-4133-a29b-3d97a13420b2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:48.671800 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0a893c3e-203c-4133-a29b-3d97a13420b2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.209625 Jul 20 04:39:48.672643 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2139/4532] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:48 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:48.699134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-9d4d9527-332e-4901-88cc-82e1720ff886 req-9809231f-b5ec-44ef-9f4d-59ad97ebf6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3975993-61a4-40e2-b5c6-19411a0511d1", "name": "network-vif-plugged", "status": "completed", "tag": "eea80dc9-92d0-43cd-bf9c-49d65af5ee95"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:48.710152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9d4d9527-332e-4901-88cc-82e1720ff886 req-9809231f-b5ec-44ef-9f4d-59ad97ebf6a6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:48.710829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9d4d9527-332e-4901-88cc-82e1720ff886 req-9809231f-b5ec-44ef-9f4d-59ad97ebf6a6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:48.727139 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9d4d9527-332e-4901-88cc-82e1720ff886 req-9809231f-b5ec-44ef-9f4d-59ad97ebf6a6 service nova] Creating event network-vif-plugged:eea80dc9-92d0-43cd-bf9c-49d65af5ee95 for instance e3975993-61a4-40e2-b5c6-19411a0511d1 on n-h2-826526-5 Jul 20 04:39:48.736820 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-9d4d9527-332e-4901-88cc-82e1720ff886 req-9809231f-b5ec-44ef-9f4d-59ad97ebf6a6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042002 Jul 20 04:39:48.738276 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2394/4533] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:48.852011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a8df226a-7610-4479-a2cb-65dd48fa3969 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-949456875", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "69228133-6b77-4fda-a084-e067c6109be5"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:48.915332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-a8df226a-7610-4479-a2cb-65dd48fa3969 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] validate_networks() for [('69228133-6b77-4fda-a084-e067c6109be5', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:39:48.997476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-aff5689a-796d-4b99-8fee-6086408cbee6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:48.997476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-aff5689a-796d-4b99-8fee-6086408cbee6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:49.007919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aff5689a-796d-4b99-8fee-6086408cbee6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:49.008393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aff5689a-796d-4b99-8fee-6086408cbee6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:49.009181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aff5689a-796d-4b99-8fee-6086408cbee6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:49.009619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aff5689a-796d-4b99-8fee-6086408cbee6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:49.261158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-aff5689a-796d-4b99-8fee-6086408cbee6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:49.271045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-aff5689a-796d-4b99-8fee-6086408cbee6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:49.273516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-aff5689a-796d-4b99-8fee-6086408cbee6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:49.274801 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-aff5689a-796d-4b99-8fee-6086408cbee6 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 2962 microversion: 2.42 time: 0.283445 Jul 20 04:39:49.275371 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2395/4534] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:48 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 2962 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:39:49.335650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-868a9183-bdf4-43b3-8591-f72b4a8655df tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:49.336531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-868a9183-bdf4-43b3-8591-f72b4a8655df tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:49.343226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-868a9183-bdf4-43b3-8591-f72b4a8655df tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:49.344421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-868a9183-bdf4-43b3-8591-f72b4a8655df tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:49.345568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-868a9183-bdf4-43b3-8591-f72b4a8655df tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:49.346159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-868a9183-bdf4-43b3-8591-f72b4a8655df tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:49.459402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a8df226a-7610-4479-a2cb-65dd48fa3969 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:39:49.459842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a8df226a-7610-4479-a2cb-65dd48fa3969 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:39:49.460362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a8df226a-7610-4479-a2cb-65dd48fa3969 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:39:49.460787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a8df226a-7610-4479-a2cb-65dd48fa3969 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:39:49.461181 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a8df226a-7610-4479-a2cb-65dd48fa3969 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:39:49.471264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8df226a-7610-4479-a2cb-65dd48fa3969 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:49.471994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8df226a-7610-4479-a2cb-65dd48fa3969 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:49.472940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8df226a-7610-4479-a2cb-65dd48fa3969 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:49.473487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8df226a-7610-4479-a2cb-65dd48fa3969 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:49.495263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-a8df226a-7610-4479-a2cb-65dd48fa3969 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Getting quotas for project fcd6c40faa19476db37fa7897dea5840. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:39:49.501910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-a8df226a-7610-4479-a2cb-65dd48fa3969 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Getting quotas for user f50ac97f2ef04752bd49148748e39eb8 and project fcd6c40faa19476db37fa7897dea5840. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:39:49.517762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a8df226a-7610-4479-a2cb-65dd48fa3969 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:39:49.518679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-868a9183-bdf4-43b3-8591-f72b4a8655df tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:49.520061 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a8df226a-7610-4479-a2cb-65dd48fa3969 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:39:49.522381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:49.530735 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-868a9183-bdf4-43b3-8591-f72b4a8655df tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1322 microversion: 2.1 time: 0.207062 Jul 20 04:39:49.540889 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2396/4535] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:49 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:49.576013 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a8df226a-7610-4479-a2cb-65dd48fa3969 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727760 Jul 20 04:39:49.576954 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2140/4536] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:39:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:39:49.587444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bc551cba-6752-4952-9ae7-77070878b3de tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:49.588095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bc551cba-6752-4952-9ae7-77070878b3de tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:49.668002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bc551cba-6752-4952-9ae7-77070878b3de tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:49.675724 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bc551cba-6752-4952-9ae7-77070878b3de tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1214 microversion: 2.1 time: 0.092242 Jul 20 04:39:49.676684 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2397/4537] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:49 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:50.294752 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e540d1fd-414f-4fd1-82b2-06a6501de4fc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:50.295942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e540d1fd-414f-4fd1-82b2-06a6501de4fc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:50.304805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e540d1fd-414f-4fd1-82b2-06a6501de4fc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:50.305257 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e540d1fd-414f-4fd1-82b2-06a6501de4fc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:50.306029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e540d1fd-414f-4fd1-82b2-06a6501de4fc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:50.306458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e540d1fd-414f-4fd1-82b2-06a6501de4fc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:50.529481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e540d1fd-414f-4fd1-82b2-06a6501de4fc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:50.545075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e540d1fd-414f-4fd1-82b2-06a6501de4fc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:50.548159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-adae36e2-400e-4e22-80f6-c60649bd45e3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:50.548799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-adae36e2-400e-4e22-80f6-c60649bd45e3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:50.549809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e540d1fd-414f-4fd1-82b2-06a6501de4fc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:50.551802 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e540d1fd-414f-4fd1-82b2-06a6501de4fc tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 2962 microversion: 2.42 time: 0.260772 Jul 20 04:39:50.553353 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2141/4538] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:50 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 2962 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:50.563998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adae36e2-400e-4e22-80f6-c60649bd45e3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:50.564493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adae36e2-400e-4e22-80f6-c60649bd45e3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:50.565285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adae36e2-400e-4e22-80f6-c60649bd45e3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:50.565939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adae36e2-400e-4e22-80f6-c60649bd45e3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:50.693304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-db1c5c2a-f98c-4505-afe2-e014d1bf76d1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:50.695795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-db1c5c2a-f98c-4505-afe2-e014d1bf76d1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:50.704236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db1c5c2a-f98c-4505-afe2-e014d1bf76d1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:50.706556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db1c5c2a-f98c-4505-afe2-e014d1bf76d1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:50.707857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db1c5c2a-f98c-4505-afe2-e014d1bf76d1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:50.708466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db1c5c2a-f98c-4505-afe2-e014d1bf76d1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:50.739669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-adae36e2-400e-4e22-80f6-c60649bd45e3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:50.750757 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-adae36e2-400e-4e22-80f6-c60649bd45e3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1517 microversion: 2.1 time: 0.207048 Jul 20 04:39:50.752214 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2398/4539] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:50 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1517 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:50.775170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b9eef237-ae5b-4e19-9e21-58af17bff228 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:50.777456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b9eef237-ae5b-4e19-9e21-58af17bff228 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:50.791485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9eef237-ae5b-4e19-9e21-58af17bff228 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:50.792286 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9eef237-ae5b-4e19-9e21-58af17bff228 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:50.795148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9eef237-ae5b-4e19-9e21-58af17bff228 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:50.795939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9eef237-ae5b-4e19-9e21-58af17bff228 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:50.810945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-db1c5c2a-f98c-4505-afe2-e014d1bf76d1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:50.821142 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-db1c5c2a-f98c-4505-afe2-e014d1bf76d1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1210 microversion: 2.1 time: 0.132497 Jul 20 04:39:50.822178 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2142/4540] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:50 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1210 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:50.845099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-b9eef237-ae5b-4e19-9e21-58af17bff228 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lazy-loading 'flavor' on Instance uuid e3975993-61a4-40e2-b5c6-19411a0511d1 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:39:50.952909 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b9eef237-ae5b-4e19-9e21-58af17bff228 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "POST /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1/action" status: 200 len: 32 microversion: 2.1 time: 0.188274 Jul 20 04:39:50.953738 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2399/4541] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:39:50 2022] POST /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:39:50.964671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-26eab512-d808-4d55-87e9-7881f7895170 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:50.964671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-26eab512-d808-4d55-87e9-7881f7895170 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:50.971659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26eab512-d808-4d55-87e9-7881f7895170 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:50.972805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26eab512-d808-4d55-87e9-7881f7895170 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:50.973694 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26eab512-d808-4d55-87e9-7881f7895170 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:50.974195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26eab512-d808-4d55-87e9-7881f7895170 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.224727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-26eab512-d808-4d55-87e9-7881f7895170 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:51.234636 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-26eab512-d808-4d55-87e9-7881f7895170 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 0.275621 Jul 20 04:39:51.238891 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2143/4542] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:50 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:51.325601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2daa4cb6-51a3-4727-a3b6-87c8c90c4746 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:51.325601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2daa4cb6-51a3-4727-a3b6-87c8c90c4746 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:51.335372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2daa4cb6-51a3-4727-a3b6-87c8c90c4746 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.335824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2daa4cb6-51a3-4727-a3b6-87c8c90c4746 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.337162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2daa4cb6-51a3-4727-a3b6-87c8c90c4746 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.337597 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2daa4cb6-51a3-4727-a3b6-87c8c90c4746 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.376956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2daa4cb6-51a3-4727-a3b6-87c8c90c4746 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:39:51.574501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2cfbfc94-7d70-48ca-b738-cdf5adfe1fed tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:51.575938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2cfbfc94-7d70-48ca-b738-cdf5adfe1fed tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:51.586836 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2daa4cb6-51a3-4727-a3b6-87c8c90c4746 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 204 len: 0 microversion: 2.1 time: 0.522305 Jul 20 04:39:51.590465 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2400/4543] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:39:51 2022] DELETE /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:39:51.596419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cfbfc94-7d70-48ca-b738-cdf5adfe1fed tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.596988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cfbfc94-7d70-48ca-b738-cdf5adfe1fed tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.597885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cfbfc94-7d70-48ca-b738-cdf5adfe1fed tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.599603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cfbfc94-7d70-48ca-b738-cdf5adfe1fed tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.610503 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8002f376-6e71-4748-b13d-51ca1e15e463 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:51.612715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8002f376-6e71-4748-b13d-51ca1e15e463 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:51.630628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8002f376-6e71-4748-b13d-51ca1e15e463 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.631761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8002f376-6e71-4748-b13d-51ca1e15e463 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.633441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8002f376-6e71-4748-b13d-51ca1e15e463 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.633880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8002f376-6e71-4748-b13d-51ca1e15e463 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.945540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8002f376-6e71-4748-b13d-51ca1e15e463 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:51.959765 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8002f376-6e71-4748-b13d-51ca1e15e463 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1732 microversion: 2.1 time: 0.361704 Jul 20 04:39:51.970161 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2401/4544] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:51 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1732 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:51.975778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dd4e1b5f-ad8b-4388-a0bb-441c40fe4fd5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:51.976778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dd4e1b5f-ad8b-4388-a0bb-441c40fe4fd5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:51.984457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd4e1b5f-ad8b-4388-a0bb-441c40fe4fd5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.985396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd4e1b5f-ad8b-4388-a0bb-441c40fe4fd5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.986387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd4e1b5f-ad8b-4388-a0bb-441c40fe4fd5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.987106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd4e1b5f-ad8b-4388-a0bb-441c40fe4fd5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:52.089077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2cfbfc94-7d70-48ca-b738-cdf5adfe1fed tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:52.106500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2cfbfc94-7d70-48ca-b738-cdf5adfe1fed tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:52.108023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2cfbfc94-7d70-48ca-b738-cdf5adfe1fed tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:52.109342 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2cfbfc94-7d70-48ca-b738-cdf5adfe1fed tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 2962 microversion: 2.42 time: 0.539957 Jul 20 04:39:52.109918 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2144/4545] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:51 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 2962 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:52.129761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dd4e1b5f-ad8b-4388-a0bb-441c40fe4fd5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:52.139988 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dd4e1b5f-ad8b-4388-a0bb-441c40fe4fd5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1272 microversion: 2.1 time: 0.170543 Jul 20 04:39:52.140695 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2402/4546] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:51 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:52.255305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-966ff55f-5cc9-4fd2-9c00-18444bd58382 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:52.256023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-966ff55f-5cc9-4fd2-9c00-18444bd58382 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:52.266410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-966ff55f-5cc9-4fd2-9c00-18444bd58382 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:52.272970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-966ff55f-5cc9-4fd2-9c00-18444bd58382 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:52.274035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-966ff55f-5cc9-4fd2-9c00-18444bd58382 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:52.274894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-966ff55f-5cc9-4fd2-9c00-18444bd58382 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:52.471037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-966ff55f-5cc9-4fd2-9c00-18444bd58382 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:52.501424 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-966ff55f-5cc9-4fd2-9c00-18444bd58382 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 0.249319 Jul 20 04:39:52.515145 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2145/4547] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:52 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:52.977934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c2e0f83c-18ec-4464-b57d-d0f81475c442 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:52.978540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c2e0f83c-18ec-4464-b57d-d0f81475c442 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:53.007492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2e0f83c-18ec-4464-b57d-d0f81475c442 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:53.008360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2e0f83c-18ec-4464-b57d-d0f81475c442 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:53.009351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2e0f83c-18ec-4464-b57d-d0f81475c442 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:53.016684 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2e0f83c-18ec-4464-b57d-d0f81475c442 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:53.138816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-996a93a8-83d7-46e4-ae36-ba37cd878ff4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:53.140471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-996a93a8-83d7-46e4-ae36-ba37cd878ff4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:53.171037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-996a93a8-83d7-46e4-ae36-ba37cd878ff4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:53.176779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-996a93a8-83d7-46e4-ae36-ba37cd878ff4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:53.177859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-996a93a8-83d7-46e4-ae36-ba37cd878ff4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:53.180740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-996a93a8-83d7-46e4-ae36-ba37cd878ff4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:53.327990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c2e0f83c-18ec-4464-b57d-d0f81475c442 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:53.342763 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c2e0f83c-18ec-4464-b57d-d0f81475c442 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1732 microversion: 2.1 time: 0.366239 Jul 20 04:39:53.344642 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2403/4548] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:52 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1732 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:53.361974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b3898fb3-7e4e-4d32-bec6-0145764d22f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:53.364187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b3898fb3-7e4e-4d32-bec6-0145764d22f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:53.398115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b3898fb3-7e4e-4d32-bec6-0145764d22f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:53.398560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b3898fb3-7e4e-4d32-bec6-0145764d22f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:53.406099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b3898fb3-7e4e-4d32-bec6-0145764d22f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:53.406607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b3898fb3-7e4e-4d32-bec6-0145764d22f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:54.766462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b3898fb3-7e4e-4d32-bec6-0145764d22f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:54.776943 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b3898fb3-7e4e-4d32-bec6-0145764d22f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1314 microversion: 2.1 time: 1.429556 Jul 20 04:39:54.778028 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2404/4549] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:53 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1314 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:54.785308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d868fa7d-bbb0-40a1-94a0-c38efad3cc7e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:54.785936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d868fa7d-bbb0-40a1-94a0-c38efad3cc7e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:54.794227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d868fa7d-bbb0-40a1-94a0-c38efad3cc7e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:54.794693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d868fa7d-bbb0-40a1-94a0-c38efad3cc7e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:54.795489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d868fa7d-bbb0-40a1-94a0-c38efad3cc7e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:54.795934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d868fa7d-bbb0-40a1-94a0-c38efad3cc7e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:54.879194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-996a93a8-83d7-46e4-ae36-ba37cd878ff4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:54.907920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-996a93a8-83d7-46e4-ae36-ba37cd878ff4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:54.913070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-996a93a8-83d7-46e4-ae36-ba37cd878ff4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:54.914466 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-996a93a8-83d7-46e4-ae36-ba37cd878ff4 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 2941 microversion: 2.42 time: 1.788998 Jul 20 04:39:54.915098 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2146/4550] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:53 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 2941 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:54.939019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-0fc0f422-ad4e-4b53-a3c1-48b167d92c70 req-a07c6b8f-17f5-49a5-a072-92641aba83ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "name": "network-vif-unplugged", "status": "completed", "tag": "b15665c3-c608-4291-ba03-0645e53bbcc0"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:54.962784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0fc0f422-ad4e-4b53-a3c1-48b167d92c70 req-a07c6b8f-17f5-49a5-a072-92641aba83ae service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:54.963233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0fc0f422-ad4e-4b53-a3c1-48b167d92c70 req-a07c6b8f-17f5-49a5-a072-92641aba83ae service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:55.025132 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-0fc0f422-ad4e-4b53-a3c1-48b167d92c70 req-a07c6b8f-17f5-49a5-a072-92641aba83ae service nova] Creating event network-vif-unplugged:b15665c3-c608-4291-ba03-0645e53bbcc0 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:39:55.035834 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-0fc0f422-ad4e-4b53-a3c1-48b167d92c70 req-a07c6b8f-17f5-49a5-a072-92641aba83ae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119397 Jul 20 04:39:55.038788 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2147/4551] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:55.054395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bad73894-495b-43a7-9099-3b134156d431 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:55.055294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bad73894-495b-43a7-9099-3b134156d431 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:55.084830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bad73894-495b-43a7-9099-3b134156d431 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:55.089009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bad73894-495b-43a7-9099-3b134156d431 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:55.090827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bad73894-495b-43a7-9099-3b134156d431 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:55.097711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bad73894-495b-43a7-9099-3b134156d431 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:55.477507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d868fa7d-bbb0-40a1-94a0-c38efad3cc7e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:55.497619 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d868fa7d-bbb0-40a1-94a0-c38efad3cc7e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 0.716084 Jul 20 04:39:55.498530 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2405/4552] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:54 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:55.636021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-60de61f6-28d3-4b01-ae1b-5d334d5dd61c req-8690d9af-668b-4b2e-a678-2fd8405b1e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99542ac6-6ecb-4e86-9645-9c2b5dbadf5c", "tag": "d41ade7e-d3ba-4a3c-bd8d-16200a60e5d8"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:55.657642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-60de61f6-28d3-4b01-ae1b-5d334d5dd61c req-8690d9af-668b-4b2e-a678-2fd8405b1e21 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:55.658085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-60de61f6-28d3-4b01-ae1b-5d334d5dd61c req-8690d9af-668b-4b2e-a678-2fd8405b1e21 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:55.692888 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-60de61f6-28d3-4b01-ae1b-5d334d5dd61c req-8690d9af-668b-4b2e-a678-2fd8405b1e21 service nova] Creating event network-changed:d41ade7e-d3ba-4a3c-bd8d-16200a60e5d8 for instance 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c on n-h1-826526-5 Jul 20 04:39:55.706230 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-60de61f6-28d3-4b01-ae1b-5d334d5dd61c req-8690d9af-668b-4b2e-a678-2fd8405b1e21 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075462 Jul 20 04:39:55.706783 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2406/4553] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:55.791899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bad73894-495b-43a7-9099-3b134156d431 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:55.794976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-abbf1031-c2dd-4f9f-a051-ce1c4a3305fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:55.795689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-abbf1031-c2dd-4f9f-a051-ce1c4a3305fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:55.800081 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bad73894-495b-43a7-9099-3b134156d431 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1732 microversion: 2.1 time: 0.760067 Jul 20 04:39:55.814290 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2148/4554] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:55 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1732 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:55.814496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abbf1031-c2dd-4f9f-a051-ce1c4a3305fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:55.814496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abbf1031-c2dd-4f9f-a051-ce1c4a3305fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:55.814496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abbf1031-c2dd-4f9f-a051-ce1c4a3305fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:55.814496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abbf1031-c2dd-4f9f-a051-ce1c4a3305fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:55.936892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c99dd0f5-c1fe-4458-9a0d-961eff265371 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:55.937519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c99dd0f5-c1fe-4458-9a0d-961eff265371 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:55.956638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c99dd0f5-c1fe-4458-9a0d-961eff265371 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:55.957207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c99dd0f5-c1fe-4458-9a0d-961eff265371 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:55.958224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c99dd0f5-c1fe-4458-9a0d-961eff265371 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:55.960426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c99dd0f5-c1fe-4458-9a0d-961eff265371 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:56.123628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-abbf1031-c2dd-4f9f-a051-ce1c4a3305fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:56.139352 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-abbf1031-c2dd-4f9f-a051-ce1c4a3305fd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1314 microversion: 2.1 time: 0.349216 Jul 20 04:39:56.140563 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2407/4555] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:55 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:56.339960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6273f752-fa26-4e12-8824-56ecfb35bce8 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:56.344024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6273f752-fa26-4e12-8824-56ecfb35bce8 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:56.361893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6273f752-fa26-4e12-8824-56ecfb35bce8 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:56.362510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6273f752-fa26-4e12-8824-56ecfb35bce8 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:56.363351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6273f752-fa26-4e12-8824-56ecfb35bce8 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:56.363789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6273f752-fa26-4e12-8824-56ecfb35bce8 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:56.459425 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6273f752-fa26-4e12-8824-56ecfb35bce8 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "POST /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53/action" status: 200 len: 24580 microversion: 2.1 time: 0.123523 Jul 20 04:39:56.460975 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2408/4556] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:39:56 2022] POST /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53/action => generated 24580 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:39:56.516774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0edc98a2-b578-4ade-92b3-b49a01fff843 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:56.520234 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0edc98a2-b578-4ade-92b3-b49a01fff843 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:56.531412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0edc98a2-b578-4ade-92b3-b49a01fff843 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:56.532996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0edc98a2-b578-4ade-92b3-b49a01fff843 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:56.536153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0edc98a2-b578-4ade-92b3-b49a01fff843 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:56.537457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0edc98a2-b578-4ade-92b3-b49a01fff843 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:56.876709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c99dd0f5-c1fe-4458-9a0d-961eff265371 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:56.893347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c99dd0f5-c1fe-4458-9a0d-961eff265371 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:56.895030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c99dd0f5-c1fe-4458-9a0d-961eff265371 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:56.896657 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c99dd0f5-c1fe-4458-9a0d-961eff265371 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 2920 microversion: 2.42 time: 0.963966 Jul 20 04:39:56.899459 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2149/4557] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:55 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 2920 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:39:56.908092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3f047631-b598-4621-b3f1-30d847b71694 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:56.910368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3f047631-b598-4621-b3f1-30d847b71694 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:56.924524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f047631-b598-4621-b3f1-30d847b71694 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:56.925260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f047631-b598-4621-b3f1-30d847b71694 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:56.928335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f047631-b598-4621-b3f1-30d847b71694 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:56.928942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f047631-b598-4621-b3f1-30d847b71694 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:57.107507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3f047631-b598-4621-b3f1-30d847b71694 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:57.116005 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3f047631-b598-4621-b3f1-30d847b71694 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1665 microversion: 2.1 time: 0.215348 Jul 20 04:39:57.118882 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2150/4558] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:56 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1665 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:57.131732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-5ad85c5e-3137-4ff6-853c-b4fc52bf1f34 req-ade5be63-e162-427d-9605-2650da68d16a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "name": "network-vif-unplugged", "status": "completed", "tag": "36e158ad-7ae1-4798-87f8-e0e9306b63a1"}, {"server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "name": "network-vif-unplugged", "status": "completed", "tag": "cf17085b-ec85-44f7-b1fe-988fc64af716"}, {"server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "name": "network-vif-unplugged", "status": "completed", "tag": "df96a5ee-70af-4221-9452-816a07265909"}, {"server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "name": "network-vif-unplugged", "status": "completed", "tag": "c4064929-4a6b-4ed2-b2fd-7b46e126bcec"}, {"server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "name": "network-vif-unplugged", "status": "completed", "tag": "e016c9d4-88ef-4886-8546-1f27d3e3dab0"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:57.156510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5ad85c5e-3137-4ff6-853c-b4fc52bf1f34 req-ade5be63-e162-427d-9605-2650da68d16a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:57.157242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5ad85c5e-3137-4ff6-853c-b4fc52bf1f34 req-ade5be63-e162-427d-9605-2650da68d16a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:57.189166 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-5ad85c5e-3137-4ff6-853c-b4fc52bf1f34 req-ade5be63-e162-427d-9605-2650da68d16a service nova] Creating event network-vif-unplugged:36e158ad-7ae1-4798-87f8-e0e9306b63a1 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:39:57.189682 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-5ad85c5e-3137-4ff6-853c-b4fc52bf1f34 req-ade5be63-e162-427d-9605-2650da68d16a service nova] Creating event network-vif-unplugged:cf17085b-ec85-44f7-b1fe-988fc64af716 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:39:57.190183 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-5ad85c5e-3137-4ff6-853c-b4fc52bf1f34 req-ade5be63-e162-427d-9605-2650da68d16a service nova] Creating event network-vif-unplugged:df96a5ee-70af-4221-9452-816a07265909 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:39:57.190802 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-5ad85c5e-3137-4ff6-853c-b4fc52bf1f34 req-ade5be63-e162-427d-9605-2650da68d16a service nova] Creating event network-vif-unplugged:c4064929-4a6b-4ed2-b2fd-7b46e126bcec for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:39:57.192657 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-5ad85c5e-3137-4ff6-853c-b4fc52bf1f34 req-ade5be63-e162-427d-9605-2650da68d16a service nova] Creating event network-vif-unplugged:e016c9d4-88ef-4886-8546-1f27d3e3dab0 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:39:57.212523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0edc98a2-b578-4ade-92b3-b49a01fff843 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:57.221664 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0edc98a2-b578-4ade-92b3-b49a01fff843 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 0.710346 Jul 20 04:39:57.222294 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2409/4559] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:56 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:57.232572 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-5ad85c5e-3137-4ff6-853c-b4fc52bf1f34 req-ade5be63-e162-427d-9605-2650da68d16a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.101358 Jul 20 04:39:57.232572 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2151/4560] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:57.236433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e66e1c55-3f9a-4425-bec3-ddea6660ad2f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:57.237061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e66e1c55-3f9a-4425-bec3-ddea6660ad2f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:57.267858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e66e1c55-3f9a-4425-bec3-ddea6660ad2f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:57.268351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e66e1c55-3f9a-4425-bec3-ddea6660ad2f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:57.269162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e66e1c55-3f9a-4425-bec3-ddea6660ad2f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:57.269610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e66e1c55-3f9a-4425-bec3-ddea6660ad2f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:57.408087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-7871675d-2134-41e4-92ea-5d1206b60a8d req-7195a6d4-dd1e-4656-92f4-28b31956df92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "name": "network-vif-deleted", "tag": "cf17085b-ec85-44f7-b1fe-988fc64af716"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:57.419954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7871675d-2134-41e4-92ea-5d1206b60a8d req-7195a6d4-dd1e-4656-92f4-28b31956df92 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:57.429099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7871675d-2134-41e4-92ea-5d1206b60a8d req-7195a6d4-dd1e-4656-92f4-28b31956df92 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:57.475478 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-7871675d-2134-41e4-92ea-5d1206b60a8d req-7195a6d4-dd1e-4656-92f4-28b31956df92 service nova] Creating event network-vif-deleted:cf17085b-ec85-44f7-b1fe-988fc64af716 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:39:57.482079 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-7871675d-2134-41e4-92ea-5d1206b60a8d req-7195a6d4-dd1e-4656-92f4-28b31956df92 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078789 Jul 20 04:39:57.483333 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2152/4561] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:39:57.593813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e66e1c55-3f9a-4425-bec3-ddea6660ad2f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:57.605914 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e66e1c55-3f9a-4425-bec3-ddea6660ad2f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1314 microversion: 2.1 time: 0.382334 Jul 20 04:39:57.607041 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2410/4562] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:57 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:57.726927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-a8041372-1ce0-4d38-a70c-d689dd3b65c5 req-a57dde35-2df7-44a9-902c-b7199b3e967b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5723a8e0-f05f-4500-b469-dfac24f274e5", "name": "network-vif-deleted", "tag": "c4b357f9-9159-4bdb-af37-462721b72996"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:57.741097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a8041372-1ce0-4d38-a70c-d689dd3b65c5 req-a57dde35-2df7-44a9-902c-b7199b3e967b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:57.741539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a8041372-1ce0-4d38-a70c-d689dd3b65c5 req-a57dde35-2df7-44a9-902c-b7199b3e967b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:57.767054 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-a8041372-1ce0-4d38-a70c-d689dd3b65c5 req-a57dde35-2df7-44a9-902c-b7199b3e967b service nova] Creating event network-vif-deleted:c4b357f9-9159-4bdb-af37-462721b72996 for instance 5723a8e0-f05f-4500-b469-dfac24f274e5 on n-h1-826526-5 Jul 20 04:39:57.772788 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-a8041372-1ce0-4d38-a70c-d689dd3b65c5 req-a57dde35-2df7-44a9-902c-b7199b3e967b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049812 Jul 20 04:39:57.777988 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2153/4563] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:57.918986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-55e96c9b-f06f-4a04-8ee1-b1508704b42a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:57.919934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-55e96c9b-f06f-4a04-8ee1-b1508704b42a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:57.931887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55e96c9b-f06f-4a04-8ee1-b1508704b42a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:57.932669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55e96c9b-f06f-4a04-8ee1-b1508704b42a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:57.934552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55e96c9b-f06f-4a04-8ee1-b1508704b42a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:57.936934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55e96c9b-f06f-4a04-8ee1-b1508704b42a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:58.154272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f99d8e7d-08c0-4e48-b17c-0e1da80457b2 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:58.155741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f99d8e7d-08c0-4e48-b17c-0e1da80457b2 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:58.166738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f99d8e7d-08c0-4e48-b17c-0e1da80457b2 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:58.168067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f99d8e7d-08c0-4e48-b17c-0e1da80457b2 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:58.169093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f99d8e7d-08c0-4e48-b17c-0e1da80457b2 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:58.169803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f99d8e7d-08c0-4e48-b17c-0e1da80457b2 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:58.238049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f99d8e7d-08c0-4e48-b17c-0e1da80457b2 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:58.239108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f99d8e7d-08c0-4e48-b17c-0e1da80457b2 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:58.241000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-f99d8e7d-08c0-4e48-b17c-0e1da80457b2 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lazy-loading 'fault' on Instance uuid 5723a8e0-f05f-4500-b469-dfac24f274e5 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:39:58.252238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:58.253175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-55e96c9b-f06f-4a04-8ee1-b1508704b42a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:58.255671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:58.266545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-55e96c9b-f06f-4a04-8ee1-b1508704b42a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:58.268064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-55e96c9b-f06f-4a04-8ee1-b1508704b42a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:58.269370 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-55e96c9b-f06f-4a04-8ee1-b1508704b42a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 2759 microversion: 2.42 time: 0.354427 Jul 20 04:39:58.269981 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2411/4564] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:57 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 2759 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:58.288318 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e73dd2fc-abd4-484d-9487-5906d683cce0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:58.289191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e73dd2fc-abd4-484d-9487-5906d683cce0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:58.310264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e73dd2fc-abd4-484d-9487-5906d683cce0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:58.310746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e73dd2fc-abd4-484d-9487-5906d683cce0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:58.317140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e73dd2fc-abd4-484d-9487-5906d683cce0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:58.318155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e73dd2fc-abd4-484d-9487-5906d683cce0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:58.319114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f99d8e7d-08c0-4e48-b17c-0e1da80457b2 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cd6c38a334a8690ad3f627d502e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c35e7aceb481ca2b168017a8e6e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:58.328063 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f99d8e7d-08c0-4e48-b17c-0e1da80457b2 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 200 len: 1389 microversion: 2.1 time: 0.196728 Jul 20 04:39:58.329142 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2154/4565] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:58 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 1389 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:58.633157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e73dd2fc-abd4-484d-9487-5906d683cce0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:58.635103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7d970b0e-986e-4b74-b060-1864a4092562 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:58.635732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7d970b0e-986e-4b74-b060-1864a4092562 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:58.651692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d970b0e-986e-4b74-b060-1864a4092562 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:58.652150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d970b0e-986e-4b74-b060-1864a4092562 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:58.652985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d970b0e-986e-4b74-b060-1864a4092562 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:58.660859 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e73dd2fc-abd4-484d-9487-5906d683cce0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 0.371073 Jul 20 04:39:58.661784 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2412/4566] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:58 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:58.663456 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d970b0e-986e-4b74-b060-1864a4092562 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:59.086793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7d970b0e-986e-4b74-b060-1864a4092562 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:59.097770 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7d970b0e-986e-4b74-b060-1864a4092562 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1314 microversion: 2.1 time: 0.467685 Jul 20 04:39:59.099348 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2155/4567] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:58 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:59.290703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2f206798-e42f-409b-b246-43545bdb58be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:59.291593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2f206798-e42f-409b-b246-43545bdb58be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:59.309545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f206798-e42f-409b-b246-43545bdb58be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:59.310398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f206798-e42f-409b-b246-43545bdb58be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:59.311313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f206798-e42f-409b-b246-43545bdb58be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:59.311975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f206798-e42f-409b-b246-43545bdb58be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:59.344672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4c555913-6b81-49e4-b989-d900e1358cd4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:59.345892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4c555913-6b81-49e4-b989-d900e1358cd4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:59.354002 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c555913-6b81-49e4-b989-d900e1358cd4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:59.358919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c555913-6b81-49e4-b989-d900e1358cd4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:59.360037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c555913-6b81-49e4-b989-d900e1358cd4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:59.360657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c555913-6b81-49e4-b989-d900e1358cd4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:59.424835 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-4c555913-6b81-49e4-b989-d900e1358cd4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] HTTP exception thrown: Instance 5723a8e0-f05f-4500-b469-dfac24f274e5 could not be found. Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4c555913-6b81-49e4-b989-d900e1358cd4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Request method failure captured: Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 HTTP/1.1 Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14Wx2cbNk4Tin85deGb3YtMV4oI8sGedN4ECUfqT_7BzGtS6vRRFNIS96bPw7WhDh7NcJ1rp8t6tRSTLCekoqeWy2GERqi2Lt2-nt_1IXHcwaKhKEIVlTRVujpsmrzqZdqFB6hLSNaj_Sr8HsSltcYvcfW-KwknB8gmMbQhOixiQmjs Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4e7c35e7aceb481ca2b168017a8e6e20 Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestServerBasicOps-51713258 Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e7c35e7aceb481ca2b168017a8e6e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4e7c35e7aceb481ca2b168017a8e6e20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4e7c35e7aceb481ca2b168017a8e6e20", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e7c35e7aceb481ca2b168017a8e6e20"}]}] Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestServerBasicOps-51713258 Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4e7c35e7aceb481ca2b168017a8e6e20 Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestServerBasicOps-51713258 Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestServerBasicOps-51713258-project Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 7e7cd6c38a334a8690ad3f627d502e63 Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestServerBasicOps-51713258-project Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 5723a8e0-f05f-4500-b469-dfac24f274e5 could not be found. Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '5723a8e0-f05f-4500-b469-dfac24f274e5'} Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5723a8e0-f05f-4500-b469-dfac24f274e5 could not be found. Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5723a8e0-f05f-4500-b469-dfac24f274e5 could not be found. Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.426739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:59.431212 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:59.431212 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:59.431212 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:59.431212 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:59.431212 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5723a8e0-f05f-4500-b469-dfac24f274e5 could not be found. Jul 20 04:39:59.431212 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.432551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4c555913-6b81-49e4-b989-d900e1358cd4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Returning 404 to user: Instance 5723a8e0-f05f-4500-b469-dfac24f274e5 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:59.433777 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4c555913-6b81-49e4-b989-d900e1358cd4 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 404 len: 111 microversion: 2.1 time: 0.093028 Jul 20 04:39:59.437814 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2156/4568] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:59 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:39:59.523441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-294d0e12-93f7-43a8-ba11-41d2a54d8083 req-00662bd5-9f0a-4985-85a2-e88ac693f92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "name": "network-vif-deleted", "tag": "e016c9d4-88ef-4886-8546-1f27d3e3dab0"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:59.544732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:59.554478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:59.578485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-294d0e12-93f7-43a8-ba11-41d2a54d8083 req-00662bd5-9f0a-4985-85a2-e88ac693f92c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:59.579196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-294d0e12-93f7-43a8-ba11-41d2a54d8083 req-00662bd5-9f0a-4985-85a2-e88ac693f92c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:59.606239 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-294d0e12-93f7-43a8-ba11-41d2a54d8083 req-00662bd5-9f0a-4985-85a2-e88ac693f92c service nova] Creating event network-vif-deleted:e016c9d4-88ef-4886-8546-1f27d3e3dab0 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:39:59.627596 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-294d0e12-93f7-43a8-ba11-41d2a54d8083 req-00662bd5-9f0a-4985-85a2-e88ac693f92c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118160 Jul 20 04:39:59.640518 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2157/4569] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:59.677999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:59.684030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e935bcd9-5869-4ebe-b96c-1cfe5d00d0e4 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:59.684994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e935bcd9-5869-4ebe-b96c-1cfe5d00d0e4 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:59.700175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2f206798-e42f-409b-b246-43545bdb58be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:59.716061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2f206798-e42f-409b-b246-43545bdb58be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:59.719541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e935bcd9-5869-4ebe-b96c-1cfe5d00d0e4 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:59.720014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e935bcd9-5869-4ebe-b96c-1cfe5d00d0e4 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:59.722204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2f206798-e42f-409b-b246-43545bdb58be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:59.726942 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2f206798-e42f-409b-b246-43545bdb58be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 2712 microversion: 2.42 time: 0.438408 Jul 20 04:39:59.727568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e935bcd9-5869-4ebe-b96c-1cfe5d00d0e4 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:59.729078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e935bcd9-5869-4ebe-b96c-1cfe5d00d0e4 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:59.741617 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2413/4570] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:59 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 2712 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:00.114996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e935bcd9-5869-4ebe-b96c-1cfe5d00d0e4 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:00.117669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f40932b9-93e3-4205-b6b0-9550bda6de47 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:00.121874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f40932b9-93e3-4205-b6b0-9550bda6de47 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:00.138318 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e935bcd9-5869-4ebe-b96c-1cfe5d00d0e4 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 0.460928 Jul 20 04:40:00.140059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f40932b9-93e3-4205-b6b0-9550bda6de47 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:00.141214 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2158/4571] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:59 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:00.141916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f40932b9-93e3-4205-b6b0-9550bda6de47 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:00.145504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f40932b9-93e3-4205-b6b0-9550bda6de47 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:00.146089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f40932b9-93e3-4205-b6b0-9550bda6de47 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:00.361543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f40932b9-93e3-4205-b6b0-9550bda6de47 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:00.371643 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f40932b9-93e3-4205-b6b0-9550bda6de47 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1314 microversion: 2.1 time: 0.260260 Jul 20 04:40:00.377023 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2414/4572] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:00 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:00.507679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0359cb7d-5d5d-41b3-8ca0-db9abbe29d65 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:00.508231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0359cb7d-5d5d-41b3-8ca0-db9abbe29d65 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:00.517167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0359cb7d-5d5d-41b3-8ca0-db9abbe29d65 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:00.517921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0359cb7d-5d5d-41b3-8ca0-db9abbe29d65 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:00.518970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0359cb7d-5d5d-41b3-8ca0-db9abbe29d65 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:00.520057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0359cb7d-5d5d-41b3-8ca0-db9abbe29d65 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:00.562359 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-0359cb7d-5d5d-41b3-8ca0-db9abbe29d65 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] HTTP exception thrown: Instance 5723a8e0-f05f-4500-b469-dfac24f274e5 could not be found. Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0359cb7d-5d5d-41b3-8ca0-db9abbe29d65 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Request method failure captured: Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 HTTP/1.1 Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14Wx2cbNk4Tin85deGb3YtMV4oI8sGedN4ECUfqT_7BzGtS6vRRFNIS96bPw7WhDh7NcJ1rp8t6tRSTLCekoqeWy2GERqi2Lt2-nt_1IXHcwaKhKEIVlTRVujpsmrzqZdqFB6hLSNaj_Sr8HsSltcYvcfW-KwknB8gmMbQhOixiQmjs Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4e7c35e7aceb481ca2b168017a8e6e20 Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestServerBasicOps-51713258 Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e7c35e7aceb481ca2b168017a8e6e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4e7c35e7aceb481ca2b168017a8e6e20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4e7c35e7aceb481ca2b168017a8e6e20", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e7c35e7aceb481ca2b168017a8e6e20"}]}] Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestServerBasicOps-51713258 Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4e7c35e7aceb481ca2b168017a8e6e20 Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestServerBasicOps-51713258 Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestServerBasicOps-51713258-project Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 7e7cd6c38a334a8690ad3f627d502e63 Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestServerBasicOps-51713258-project Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 5723a8e0-f05f-4500-b469-dfac24f274e5 could not be found. Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '5723a8e0-f05f-4500-b469-dfac24f274e5'} Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5723a8e0-f05f-4500-b469-dfac24f274e5 could not be found. Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:00.568127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5723a8e0-f05f-4500-b469-dfac24f274e5 could not be found. Jul 20 04:40:00.572095 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:00.572095 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:00.572095 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:00.572095 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:00.572095 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:00.572095 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:00.572095 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:00.572095 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:00.572095 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5723a8e0-f05f-4500-b469-dfac24f274e5 could not be found. Jul 20 04:40:00.572095 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:00.572095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0359cb7d-5d5d-41b3-8ca0-db9abbe29d65 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Returning 404 to user: Instance 5723a8e0-f05f-4500-b469-dfac24f274e5 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:00.572095 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0359cb7d-5d5d-41b3-8ca0-db9abbe29d65 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 404 len: 111 microversion: 2.1 time: 0.066508 Jul 20 04:40:00.578193 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2159/4573] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:40:00 2022] DELETE /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:40:00.580178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7581fc04-1276-4ed8-8e4c-ac916b10b69a tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:00.580830 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7581fc04-1276-4ed8-8e4c-ac916b10b69a tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] [instance: 5723a8e0-f05f-4500-b469-dfac24f274e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:00.591172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7581fc04-1276-4ed8-8e4c-ac916b10b69a tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:00.592273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7581fc04-1276-4ed8-8e4c-ac916b10b69a tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:00.595018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7581fc04-1276-4ed8-8e4c-ac916b10b69a tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:00.595681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7581fc04-1276-4ed8-8e4c-ac916b10b69a tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:00.637273 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-7581fc04-1276-4ed8-8e4c-ac916b10b69a tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] HTTP exception thrown: Instance 5723a8e0-f05f-4500-b469-dfac24f274e5 could not be found. Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7581fc04-1276-4ed8-8e4c-ac916b10b69a tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Request method failure captured: Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 HTTP/1.1 Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14Wx2cbNk4Tin85deGb3YtMV4oI8sGedN4ECUfqT_7BzGtS6vRRFNIS96bPw7WhDh7NcJ1rp8t6tRSTLCekoqeWy2GERqi2Lt2-nt_1IXHcwaKhKEIVlTRVujpsmrzqZdqFB6hLSNaj_Sr8HsSltcYvcfW-KwknB8gmMbQhOixiQmjs Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4e7c35e7aceb481ca2b168017a8e6e20 Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestServerBasicOps-51713258 Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e7c35e7aceb481ca2b168017a8e6e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4e7c35e7aceb481ca2b168017a8e6e20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4e7c35e7aceb481ca2b168017a8e6e20", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e7c35e7aceb481ca2b168017a8e6e20"}]}] Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestServerBasicOps-51713258 Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4e7c35e7aceb481ca2b168017a8e6e20 Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestServerBasicOps-51713258 Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestServerBasicOps-51713258-project Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 7e7cd6c38a334a8690ad3f627d502e63 Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestServerBasicOps-51713258-project Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 5723a8e0-f05f-4500-b469-dfac24f274e5 could not be found. Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '5723a8e0-f05f-4500-b469-dfac24f274e5'} Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5723a8e0-f05f-4500-b469-dfac24f274e5 could not be found. Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5723a8e0-f05f-4500-b469-dfac24f274e5 could not be found. Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:40:00.640095 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:00.643529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:00.643529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:00.643529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:00.643529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:00.643529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5723a8e0-f05f-4500-b469-dfac24f274e5 could not be found. Jul 20 04:40:00.643529 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:40:00.645423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7581fc04-1276-4ed8-8e4c-ac916b10b69a tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Returning 404 to user: Instance 5723a8e0-f05f-4500-b469-dfac24f274e5 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:00.646687 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7581fc04-1276-4ed8-8e4c-ac916b10b69a tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5" status: 404 len: 111 microversion: 2.1 time: 0.071552 Jul 20 04:40:00.647822 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2415/4574] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:00 2022] GET /compute/v2.1/servers/5723a8e0-f05f-4500-b469-dfac24f274e5 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:40:00.747478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9e4e2b32-8bea-47e9-8cc3-6768ce54ae1e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:00.748986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9e4e2b32-8bea-47e9-8cc3-6768ce54ae1e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:00.765183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e4e2b32-8bea-47e9-8cc3-6768ce54ae1e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:00.765914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e4e2b32-8bea-47e9-8cc3-6768ce54ae1e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:00.766933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e4e2b32-8bea-47e9-8cc3-6768ce54ae1e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:00.769082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e4e2b32-8bea-47e9-8cc3-6768ce54ae1e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:01.007711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d6bf9f98-3423-483a-93ec-9a2decb8dc77 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] Calling method '.version_select at 0x7f06c73b24c0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:01.030958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9e4e2b32-8bea-47e9-8cc3-6768ce54ae1e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:01.048753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9e4e2b32-8bea-47e9-8cc3-6768ce54ae1e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:01.048978 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d6bf9f98-3423-483a-93ec-9a2decb8dc77 tempest-TestServerBasicOps-51713258 tempest-TestServerBasicOps-51713258-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1348993298" status: 202 len: 0 microversion: 2.1 time: 0.045477 Jul 20 04:40:01.049764 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2416/4575] 10.222.0.17 () {58 vars in 1253 bytes} [Wed Jul 20 04:40:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1348993298 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:40:01.059064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9e4e2b32-8bea-47e9-8cc3-6768ce54ae1e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:01.061349 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9e4e2b32-8bea-47e9-8cc3-6768ce54ae1e tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 2552 microversion: 2.42 time: 0.318257 Jul 20 04:40:01.062897 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2160/4576] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:00 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 2552 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:01.158693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-236d067e-cde7-4906-9aaa-770d77826b7a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:01.159695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-236d067e-cde7-4906-9aaa-770d77826b7a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:01.172175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-236d067e-cde7-4906-9aaa-770d77826b7a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:01.173090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-236d067e-cde7-4906-9aaa-770d77826b7a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:01.174158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-236d067e-cde7-4906-9aaa-770d77826b7a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:01.175490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-236d067e-cde7-4906-9aaa-770d77826b7a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:01.394474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b57927e2-ff2c-4811-ba31-e5eb515d562e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:01.395374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b57927e2-ff2c-4811-ba31-e5eb515d562e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:01.415013 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b57927e2-ff2c-4811-ba31-e5eb515d562e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:01.415013 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b57927e2-ff2c-4811-ba31-e5eb515d562e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:01.415515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b57927e2-ff2c-4811-ba31-e5eb515d562e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:01.417897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b57927e2-ff2c-4811-ba31-e5eb515d562e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:02.034123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-236d067e-cde7-4906-9aaa-770d77826b7a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:02.042546 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-236d067e-cde7-4906-9aaa-770d77826b7a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 0.889097 Jul 20 04:40:02.046914 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2417/4577] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:01 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:02.058443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-92dc663d-233a-4bbb-936a-3d7f48e1dd6b req-91e948b6-a2f1-473c-bb55-1fd7b1548aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "name": "network-vif-deleted", "tag": "b15665c3-c608-4291-ba03-0645e53bbcc0"}, {"server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "name": "network-vif-deleted", "tag": "36e158ad-7ae1-4798-87f8-e0e9306b63a1"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:02.072420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b57927e2-ff2c-4811-ba31-e5eb515d562e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:02.078904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-92dc663d-233a-4bbb-936a-3d7f48e1dd6b req-91e948b6-a2f1-473c-bb55-1fd7b1548aa9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:02.079360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-92dc663d-233a-4bbb-936a-3d7f48e1dd6b req-91e948b6-a2f1-473c-bb55-1fd7b1548aa9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:02.081919 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b57927e2-ff2c-4811-ba31-e5eb515d562e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1314 microversion: 2.1 time: 0.691979 Jul 20 04:40:02.094058 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2161/4578] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:01 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:02.111062 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-92dc663d-233a-4bbb-936a-3d7f48e1dd6b req-91e948b6-a2f1-473c-bb55-1fd7b1548aa9 service nova] Creating event network-vif-deleted:b15665c3-c608-4291-ba03-0645e53bbcc0 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:40:02.111378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-3a33a6ee-2829-409b-9bd5-227ec4e73001 req-d82dcfa4-099e-47dc-8f97-40ed7e930394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99542ac6-6ecb-4e86-9645-9c2b5dbadf5c", "name": "network-vif-plugged", "status": "completed", "tag": "d41ade7e-d3ba-4a3c-bd8d-16200a60e5d8"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:02.111565 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-92dc663d-233a-4bbb-936a-3d7f48e1dd6b req-91e948b6-a2f1-473c-bb55-1fd7b1548aa9 service nova] Creating event network-vif-deleted:36e158ad-7ae1-4798-87f8-e0e9306b63a1 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:40:02.123890 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-92dc663d-233a-4bbb-936a-3d7f48e1dd6b req-91e948b6-a2f1-473c-bb55-1fd7b1548aa9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075646 Jul 20 04:40:02.126418 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2418/4579] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:02.144686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1b1e5d9e-5d47-49d6-8b11-27b0e072b562 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:02.149759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1b1e5d9e-5d47-49d6-8b11-27b0e072b562 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:02.161453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-3a33a6ee-2829-409b-9bd5-227ec4e73001 req-d82dcfa4-099e-47dc-8f97-40ed7e930394 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:02.162457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-3a33a6ee-2829-409b-9bd5-227ec4e73001 req-d82dcfa4-099e-47dc-8f97-40ed7e930394 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:02.168371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1b1e5d9e-5d47-49d6-8b11-27b0e072b562 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:02.169013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1b1e5d9e-5d47-49d6-8b11-27b0e072b562 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:02.169688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1b1e5d9e-5d47-49d6-8b11-27b0e072b562 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:02.170288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1b1e5d9e-5d47-49d6-8b11-27b0e072b562 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:02.181902 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-3a33a6ee-2829-409b-9bd5-227ec4e73001 req-d82dcfa4-099e-47dc-8f97-40ed7e930394 service nova] Creating event network-vif-plugged:d41ade7e-d3ba-4a3c-bd8d-16200a60e5d8 for instance 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c on n-h1-826526-5 Jul 20 04:40:02.200956 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-3a33a6ee-2829-409b-9bd5-227ec4e73001 req-d82dcfa4-099e-47dc-8f97-40ed7e930394 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095741 Jul 20 04:40:02.202118 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2162/4580] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:02.393191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1b1e5d9e-5d47-49d6-8b11-27b0e072b562 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:02.410881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1b1e5d9e-5d47-49d6-8b11-27b0e072b562 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:02.416559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1b1e5d9e-5d47-49d6-8b11-27b0e072b562 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:02.421903 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1b1e5d9e-5d47-49d6-8b11-27b0e072b562 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 2144 microversion: 2.42 time: 0.291757 Jul 20 04:40:02.422681 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2419/4581] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:02 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 2144 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:03.065749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1ba34086-73c0-42d9-bdae-f90494605b85 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:03.066630 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1ba34086-73c0-42d9-bdae-f90494605b85 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:03.075454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ba34086-73c0-42d9-bdae-f90494605b85 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.076071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ba34086-73c0-42d9-bdae-f90494605b85 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.077108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ba34086-73c0-42d9-bdae-f90494605b85 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.077856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ba34086-73c0-42d9-bdae-f90494605b85 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.111006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-641b90c5-c924-46e4-8e83-bbaf5951364d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:03.112200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-641b90c5-c924-46e4-8e83-bbaf5951364d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:03.119902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-641b90c5-c924-46e4-8e83-bbaf5951364d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.120656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-641b90c5-c924-46e4-8e83-bbaf5951364d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.121672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-641b90c5-c924-46e4-8e83-bbaf5951364d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.122368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-641b90c5-c924-46e4-8e83-bbaf5951364d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.325788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-641b90c5-c924-46e4-8e83-bbaf5951364d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:03.337838 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-641b90c5-c924-46e4-8e83-bbaf5951364d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1314 microversion: 2.1 time: 0.230312 Jul 20 04:40:03.339526 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2420/4582] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:03 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:03.417934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1ba34086-73c0-42d9-bdae-f90494605b85 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:03.430331 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1ba34086-73c0-42d9-bdae-f90494605b85 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 0.374819 Jul 20 04:40:03.448930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-adb74e2c-c11c-4355-a141-9463d5cfbc03 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:03.449503 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-adb74e2c-c11c-4355-a141-9463d5cfbc03 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:03.454382 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2163/4583] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:03 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:03.462614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adb74e2c-c11c-4355-a141-9463d5cfbc03 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.464236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adb74e2c-c11c-4355-a141-9463d5cfbc03 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.465317 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adb74e2c-c11c-4355-a141-9463d5cfbc03 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.465905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adb74e2c-c11c-4355-a141-9463d5cfbc03 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.567332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-adb74e2c-c11c-4355-a141-9463d5cfbc03 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:03.577885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-adb74e2c-c11c-4355-a141-9463d5cfbc03 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:03.579778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-adb74e2c-c11c-4355-a141-9463d5cfbc03 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:03.580621 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-adb74e2c-c11c-4355-a141-9463d5cfbc03 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.136468 Jul 20 04:40:03.581564 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2421/4584] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:03 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:04.253585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-43081aa8-f4d9-430c-8ba0-7d8cfa9429c3 req-1df3cd6d-0b68-4ec8-9a46-6b5a429db0bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1acb3e-cd4c-47c9-893f-30d20e98b869", "name": "network-vif-deleted", "tag": "df96a5ee-70af-4221-9452-816a07265909"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:04.266263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-43081aa8-f4d9-430c-8ba0-7d8cfa9429c3 req-1df3cd6d-0b68-4ec8-9a46-6b5a429db0bc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:04.266953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-43081aa8-f4d9-430c-8ba0-7d8cfa9429c3 req-1df3cd6d-0b68-4ec8-9a46-6b5a429db0bc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:04.281200 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-43081aa8-f4d9-430c-8ba0-7d8cfa9429c3 req-1df3cd6d-0b68-4ec8-9a46-6b5a429db0bc service nova] Creating event network-vif-deleted:df96a5ee-70af-4221-9452-816a07265909 for instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 on n-h1-826526-5 Jul 20 04:40:04.287682 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-43081aa8-f4d9-430c-8ba0-7d8cfa9429c3 req-1df3cd6d-0b68-4ec8-9a46-6b5a429db0bc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038472 Jul 20 04:40:04.288392 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2164/4585] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:04.355389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-30ec64ad-ceee-4773-adf9-78ba8e791fc8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:04.356114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-30ec64ad-ceee-4773-adf9-78ba8e791fc8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:04.376478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30ec64ad-ceee-4773-adf9-78ba8e791fc8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:04.377586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30ec64ad-ceee-4773-adf9-78ba8e791fc8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:04.378614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30ec64ad-ceee-4773-adf9-78ba8e791fc8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:04.379251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30ec64ad-ceee-4773-adf9-78ba8e791fc8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:04.451468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-12326351-d518-4f12-bd6a-da8294516a82 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:04.452683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-12326351-d518-4f12-bd6a-da8294516a82 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:04.464232 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12326351-d518-4f12-bd6a-da8294516a82 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:04.465013 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12326351-d518-4f12-bd6a-da8294516a82 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:04.466340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12326351-d518-4f12-bd6a-da8294516a82 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:04.469460 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12326351-d518-4f12-bd6a-da8294516a82 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:04.596630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-30ec64ad-ceee-4773-adf9-78ba8e791fc8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:04.609840 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-30ec64ad-ceee-4773-adf9-78ba8e791fc8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1502 microversion: 2.1 time: 0.258450 Jul 20 04:40:04.620308 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2422/4586] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:04 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1502 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:04.620308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9c75a13c-4096-4001-8832-22fc0ffc6425 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:04.620308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9c75a13c-4096-4001-8832-22fc0ffc6425 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:04.624890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c75a13c-4096-4001-8832-22fc0ffc6425 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:04.627080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c75a13c-4096-4001-8832-22fc0ffc6425 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:04.627997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c75a13c-4096-4001-8832-22fc0ffc6425 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:04.628925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c75a13c-4096-4001-8832-22fc0ffc6425 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:04.818261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-12326351-d518-4f12-bd6a-da8294516a82 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:04.834618 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-12326351-d518-4f12-bd6a-da8294516a82 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 0.387620 Jul 20 04:40:04.835799 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2165/4587] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:04 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:04.845230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fd3657fe-03db-4ca0-92ff-e5d3097a5dee tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:04.846036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fd3657fe-03db-4ca0-92ff-e5d3097a5dee tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:04.862897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd3657fe-03db-4ca0-92ff-e5d3097a5dee tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:04.864729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd3657fe-03db-4ca0-92ff-e5d3097a5dee tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:04.868105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd3657fe-03db-4ca0-92ff-e5d3097a5dee tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:04.869033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd3657fe-03db-4ca0-92ff-e5d3097a5dee tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:04.881547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9c75a13c-4096-4001-8832-22fc0ffc6425 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:04.898045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9c75a13c-4096-4001-8832-22fc0ffc6425 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:04.910115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9c75a13c-4096-4001-8832-22fc0ffc6425 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:04.911596 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9c75a13c-4096-4001-8832-22fc0ffc6425 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.299490 Jul 20 04:40:04.923286 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2423/4588] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:04 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:05.071602 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fd3657fe-03db-4ca0-92ff-e5d3097a5dee tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c/action" status: 202 len: 0 microversion: 2.1 time: 0.232541 Jul 20 04:40:05.073076 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2166/4589] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:04 2022] POST /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:40:05.080908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f51c5ac2-864e-4e51-870f-034047146beb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:05.081576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f51c5ac2-864e-4e51-870f-034047146beb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:05.083599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:05.103076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f51c5ac2-864e-4e51-870f-034047146beb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:05.104605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f51c5ac2-864e-4e51-870f-034047146beb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:05.105441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f51c5ac2-864e-4e51-870f-034047146beb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:05.105888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f51c5ac2-864e-4e51-870f-034047146beb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:05.343129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f51c5ac2-864e-4e51-870f-034047146beb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:05.355359 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f51c5ac2-864e-4e51-870f-034047146beb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1507 microversion: 2.1 time: 0.276749 Jul 20 04:40:05.357390 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2424/4590] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:05 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1507 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:05.862064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1c648208-c512-4826-b96a-b7590f3fbadc tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:05.862861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1c648208-c512-4826-b96a-b7590f3fbadc tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:05.879060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c648208-c512-4826-b96a-b7590f3fbadc tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:05.879793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c648208-c512-4826-b96a-b7590f3fbadc tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:05.881564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c648208-c512-4826-b96a-b7590f3fbadc tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:05.882858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c648208-c512-4826-b96a-b7590f3fbadc tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:05.941283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-23bf8bf3-6a77-4509-a340-de871772302b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:05.942305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-23bf8bf3-6a77-4509-a340-de871772302b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:05.954572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-23bf8bf3-6a77-4509-a340-de871772302b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:05.955533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-23bf8bf3-6a77-4509-a340-de871772302b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:05.957209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-23bf8bf3-6a77-4509-a340-de871772302b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:05.975676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-23bf8bf3-6a77-4509-a340-de871772302b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:06.136056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-23bf8bf3-6a77-4509-a340-de871772302b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:06.150385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-23bf8bf3-6a77-4509-a340-de871772302b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:06.159565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-23bf8bf3-6a77-4509-a340-de871772302b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:06.161232 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-23bf8bf3-6a77-4509-a340-de871772302b tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.224356 Jul 20 04:40:06.164605 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2425/4591] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:05 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:06.193721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1c648208-c512-4826-b96a-b7590f3fbadc tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:06.229705 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1c648208-c512-4826-b96a-b7590f3fbadc tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 0.379271 Jul 20 04:40:06.230843 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2167/4592] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:05 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:06.376467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d250d318-516c-443c-a0e7-4f8f0c730d60 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:06.377247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d250d318-516c-443c-a0e7-4f8f0c730d60 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:06.392838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d250d318-516c-443c-a0e7-4f8f0c730d60 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:06.393379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d250d318-516c-443c-a0e7-4f8f0c730d60 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:06.394273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d250d318-516c-443c-a0e7-4f8f0c730d60 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:06.397539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d250d318-516c-443c-a0e7-4f8f0c730d60 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:06.689385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d250d318-516c-443c-a0e7-4f8f0c730d60 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:06.717737 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d250d318-516c-443c-a0e7-4f8f0c730d60 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1487 microversion: 2.1 time: 0.347962 Jul 20 04:40:06.720596 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2426/4593] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:06 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1487 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:06.749872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e6a3ff79-1f29-44ae-a8d9-63ab9445854d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:06.752192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e6a3ff79-1f29-44ae-a8d9-63ab9445854d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:06.761828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6a3ff79-1f29-44ae-a8d9-63ab9445854d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:06.763572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6a3ff79-1f29-44ae-a8d9-63ab9445854d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:06.764851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6a3ff79-1f29-44ae-a8d9-63ab9445854d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:06.766159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6a3ff79-1f29-44ae-a8d9-63ab9445854d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:06.823409 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-e6a3ff79-1f29-44ae-a8d9-63ab9445854d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lazy-loading 'flavor' on Instance uuid 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:40:07.186542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-22f038c7-4acb-4b08-a96e-25c67f4d5401 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:07.187367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-22f038c7-4acb-4b08-a96e-25c67f4d5401 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:07.197297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22f038c7-4acb-4b08-a96e-25c67f4d5401 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:07.197699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22f038c7-4acb-4b08-a96e-25c67f4d5401 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:07.198770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22f038c7-4acb-4b08-a96e-25c67f4d5401 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:07.199521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22f038c7-4acb-4b08-a96e-25c67f4d5401 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:07.383488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-22f038c7-4acb-4b08-a96e-25c67f4d5401 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:07.421440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-22f038c7-4acb-4b08-a96e-25c67f4d5401 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:07.424014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-22f038c7-4acb-4b08-a96e-25c67f4d5401 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:07.427047 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-22f038c7-4acb-4b08-a96e-25c67f4d5401 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.248055 Jul 20 04:40:07.441049 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2427/4594] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:07 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:07.454944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-12604a99-7cd0-4932-8d6f-fd53ded6623f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:07.456207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-12604a99-7cd0-4932-8d6f-fd53ded6623f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:07.477325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-12604a99-7cd0-4932-8d6f-fd53ded6623f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:07.478987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-12604a99-7cd0-4932-8d6f-fd53ded6623f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:07.483097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-12604a99-7cd0-4932-8d6f-fd53ded6623f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:07.484728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-12604a99-7cd0-4932-8d6f-fd53ded6623f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:07.562097 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e6a3ff79-1f29-44ae-a8d9-63ab9445854d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c/action" status: 202 len: 0 microversion: 2.1 time: 0.827445 Jul 20 04:40:07.563119 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2168/4595] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:06 2022] POST /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c/action => generated 0 bytes in 830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:40:07.574244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-28514687-a820-4e16-b506-9db42c5f199b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:07.575975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-28514687-a820-4e16-b506-9db42c5f199b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:07.609480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28514687-a820-4e16-b506-9db42c5f199b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:07.613792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28514687-a820-4e16-b506-9db42c5f199b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:07.614835 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28514687-a820-4e16-b506-9db42c5f199b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:07.615384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28514687-a820-4e16-b506-9db42c5f199b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:07.849538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-12604a99-7cd0-4932-8d6f-fd53ded6623f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:07.858594 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-12604a99-7cd0-4932-8d6f-fd53ded6623f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 0.414822 Jul 20 04:40:07.859521 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2428/4596] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:07 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:07.900147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-28514687-a820-4e16-b506-9db42c5f199b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:07.912545 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-28514687-a820-4e16-b506-9db42c5f199b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1493 microversion: 2.1 time: 0.342629 Jul 20 04:40:07.924666 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2169/4597] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:07 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1493 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:08.449088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-40016991-ed7d-4717-953c-0d6994743012 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:08.450425 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-40016991-ed7d-4717-953c-0d6994743012 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:08.459552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40016991-ed7d-4717-953c-0d6994743012 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:08.460409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40016991-ed7d-4717-953c-0d6994743012 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:08.461431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40016991-ed7d-4717-953c-0d6994743012 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:08.462077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40016991-ed7d-4717-953c-0d6994743012 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:08.692931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-40016991-ed7d-4717-953c-0d6994743012 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:08.705603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-40016991-ed7d-4717-953c-0d6994743012 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:08.707444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-40016991-ed7d-4717-953c-0d6994743012 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:08.708922 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-40016991-ed7d-4717-953c-0d6994743012 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.265604 Jul 20 04:40:08.710207 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2429/4598] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:08 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:08.876859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d72e35a3-90c2-4d48-9770-0bd275db90db tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:08.877528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d72e35a3-90c2-4d48-9770-0bd275db90db tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:08.885674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d72e35a3-90c2-4d48-9770-0bd275db90db tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:08.886473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d72e35a3-90c2-4d48-9770-0bd275db90db tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:08.887369 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d72e35a3-90c2-4d48-9770-0bd275db90db tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:08.887817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d72e35a3-90c2-4d48-9770-0bd275db90db tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:08.932937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dcc14bf8-4e9c-4f21-b827-2b93800c2c31 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:08.940588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dcc14bf8-4e9c-4f21-b827-2b93800c2c31 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:08.958529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcc14bf8-4e9c-4f21-b827-2b93800c2c31 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:08.959053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcc14bf8-4e9c-4f21-b827-2b93800c2c31 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:08.959881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcc14bf8-4e9c-4f21-b827-2b93800c2c31 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:08.960410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcc14bf8-4e9c-4f21-b827-2b93800c2c31 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:09.152091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d72e35a3-90c2-4d48-9770-0bd275db90db tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:09.162688 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d72e35a3-90c2-4d48-9770-0bd275db90db tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 0.290977 Jul 20 04:40:09.164670 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2170/4599] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:08 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:09.275715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dcc14bf8-4e9c-4f21-b827-2b93800c2c31 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:09.278055 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:09.284923 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dcc14bf8-4e9c-4f21-b827-2b93800c2c31 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1514 microversion: 2.1 time: 0.357053 Jul 20 04:40:09.285854 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2430/4600] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:08 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1514 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:09.732571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7cbccdc8-19bb-4897-958b-279c49853272 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:09.734045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7cbccdc8-19bb-4897-958b-279c49853272 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:09.748295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7cbccdc8-19bb-4897-958b-279c49853272 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:09.759778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7cbccdc8-19bb-4897-958b-279c49853272 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:09.761347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7cbccdc8-19bb-4897-958b-279c49853272 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:09.762404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7cbccdc8-19bb-4897-958b-279c49853272 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:09.812305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:09.909881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7cbccdc8-19bb-4897-958b-279c49853272 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:09.920395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7cbccdc8-19bb-4897-958b-279c49853272 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:09.926540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7cbccdc8-19bb-4897-958b-279c49853272 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:09.931998 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7cbccdc8-19bb-4897-958b-279c49853272 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.205179 Jul 20 04:40:09.934559 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2171/4601] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:09 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:10.180517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2df8aaa9-f6f4-4616-b630-ef36652cb9e8 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:10.181802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2df8aaa9-f6f4-4616-b630-ef36652cb9e8 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:10.201889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2df8aaa9-f6f4-4616-b630-ef36652cb9e8 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.202351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2df8aaa9-f6f4-4616-b630-ef36652cb9e8 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:10.203135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2df8aaa9-f6f4-4616-b630-ef36652cb9e8 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.203579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2df8aaa9-f6f4-4616-b630-ef36652cb9e8 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:10.304662 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aa16232f-2524-4687-a54f-7f17412f16ec tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:10.305528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aa16232f-2524-4687-a54f-7f17412f16ec tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:10.329520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa16232f-2524-4687-a54f-7f17412f16ec tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.329930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa16232f-2524-4687-a54f-7f17412f16ec tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:10.330829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa16232f-2524-4687-a54f-7f17412f16ec tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.331270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa16232f-2524-4687-a54f-7f17412f16ec tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:10.573172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2df8aaa9-f6f4-4616-b630-ef36652cb9e8 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:10.599361 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2df8aaa9-f6f4-4616-b630-ef36652cb9e8 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 0.422827 Jul 20 04:40:10.605521 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2431/4602] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:10 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:10.723265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aa16232f-2524-4687-a54f-7f17412f16ec tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:10.733520 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aa16232f-2524-4687-a54f-7f17412f16ec tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1509 microversion: 2.1 time: 0.432699 Jul 20 04:40:10.745935 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2172/4603] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:10 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1509 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:10.954096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9ff12dcc-19d2-4a85-b8bf-ea754ddb62f1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:10.955303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9ff12dcc-19d2-4a85-b8bf-ea754ddb62f1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:10.966221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ff12dcc-19d2-4a85-b8bf-ea754ddb62f1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.972988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ff12dcc-19d2-4a85-b8bf-ea754ddb62f1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:10.974731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ff12dcc-19d2-4a85-b8bf-ea754ddb62f1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.975918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ff12dcc-19d2-4a85-b8bf-ea754ddb62f1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:11.347060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9ff12dcc-19d2-4a85-b8bf-ea754ddb62f1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:11.359944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9ff12dcc-19d2-4a85-b8bf-ea754ddb62f1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:11.363286 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9ff12dcc-19d2-4a85-b8bf-ea754ddb62f1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:11.365462 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9ff12dcc-19d2-4a85-b8bf-ea754ddb62f1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.416773 Jul 20 04:40:11.366661 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2432/4604] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:10 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:11.626235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c15b8aba-5ce7-47e2-af17-16c337947126 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:11.628549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c15b8aba-5ce7-47e2-af17-16c337947126 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:11.656020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c15b8aba-5ce7-47e2-af17-16c337947126 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:11.656884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c15b8aba-5ce7-47e2-af17-16c337947126 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:11.658528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c15b8aba-5ce7-47e2-af17-16c337947126 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:11.659323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c15b8aba-5ce7-47e2-af17-16c337947126 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:11.755167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d7c658c4-52d1-4d66-83c4-bd3fc1e074f0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:11.756076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d7c658c4-52d1-4d66-83c4-bd3fc1e074f0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:11.768812 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7c658c4-52d1-4d66-83c4-bd3fc1e074f0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:11.773607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7c658c4-52d1-4d66-83c4-bd3fc1e074f0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:11.775044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7c658c4-52d1-4d66-83c4-bd3fc1e074f0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:11.775653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7c658c4-52d1-4d66-83c4-bd3fc1e074f0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:12.202538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c15b8aba-5ce7-47e2-af17-16c337947126 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:12.211600 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c15b8aba-5ce7-47e2-af17-16c337947126 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 0.592230 Jul 20 04:40:12.213364 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2173/4605] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:11 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:12.219198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-fcb869b9-5e2c-45c7-a0c4-99cf2ed792e7 req-84044f11-a46c-4e3e-8354-7045385b5f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99542ac6-6ecb-4e86-9645-9c2b5dbadf5c", "name": "network-vif-plugged", "status": "completed", "tag": "d41ade7e-d3ba-4a3c-bd8d-16200a60e5d8"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:12.229743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-fcb869b9-5e2c-45c7-a0c4-99cf2ed792e7 req-84044f11-a46c-4e3e-8354-7045385b5f2c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:12.230750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-fcb869b9-5e2c-45c7-a0c4-99cf2ed792e7 req-84044f11-a46c-4e3e-8354-7045385b5f2c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:12.252229 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-fcb869b9-5e2c-45c7-a0c4-99cf2ed792e7 req-84044f11-a46c-4e3e-8354-7045385b5f2c service nova] Creating event network-vif-plugged:d41ade7e-d3ba-4a3c-bd8d-16200a60e5d8 for instance 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c on n-h1-826526-5 Jul 20 04:40:12.259698 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-fcb869b9-5e2c-45c7-a0c4-99cf2ed792e7 req-84044f11-a46c-4e3e-8354-7045385b5f2c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044571 Jul 20 04:40:12.260575 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2174/4606] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:12.313753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d7c658c4-52d1-4d66-83c4-bd3fc1e074f0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:12.323536 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d7c658c4-52d1-4d66-83c4-bd3fc1e074f0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1509 microversion: 2.1 time: 0.574222 Jul 20 04:40:12.340116 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2433/4607] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:11 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1509 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:12.387995 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fdce2e88-0b86-48a4-88a1-af42b5c75cd2 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:12.388842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fdce2e88-0b86-48a4-88a1-af42b5c75cd2 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:12.404119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fdce2e88-0b86-48a4-88a1-af42b5c75cd2 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:12.404618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fdce2e88-0b86-48a4-88a1-af42b5c75cd2 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:12.406394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fdce2e88-0b86-48a4-88a1-af42b5c75cd2 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:12.409512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fdce2e88-0b86-48a4-88a1-af42b5c75cd2 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:12.566663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fdce2e88-0b86-48a4-88a1-af42b5c75cd2 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:12.605784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fdce2e88-0b86-48a4-88a1-af42b5c75cd2 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:12.607619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fdce2e88-0b86-48a4-88a1-af42b5c75cd2 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:12.609199 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fdce2e88-0b86-48a4-88a1-af42b5c75cd2 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.226664 Jul 20 04:40:12.613022 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2175/4608] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:12 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:13.230176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7feabcf4-ee7b-484c-a53f-aed15aed93a1 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:13.230804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7feabcf4-ee7b-484c-a53f-aed15aed93a1 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:13.243865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7feabcf4-ee7b-484c-a53f-aed15aed93a1 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:13.246557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7feabcf4-ee7b-484c-a53f-aed15aed93a1 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:13.249968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7feabcf4-ee7b-484c-a53f-aed15aed93a1 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:13.251084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7feabcf4-ee7b-484c-a53f-aed15aed93a1 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:13.280302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4240084c-16b1-4f88-a754-8f2e62ea4310 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Action: 'create', calling method: .version_select at 0x7f06bde0adc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1680861584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBa2kGFI3TgHc54S/bhE6wq5ANtKQtUp6PGxm4Y98YCebLQpn/3t+p/GefZdJTkupaqpnKdBC+Q35s3oum41Deb8CUthPiFcSEPZ9xspDA0gP5KiPfxzE5YCudH5/2sbsQ=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:13.312745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:13.342387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-4240084c-16b1-4f88-a754-8f2e62ea4310 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Getting quotas for project c9b5d48d9c894a32b3f417820f43427e. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:40:13.362634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-4240084c-16b1-4f88-a754-8f2e62ea4310 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Getting quotas for user 43a4b4fa5cc24463aa398fbc4e1404d4 and project c9b5d48d9c894a32b3f417820f43427e. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:40:13.417048 n-d-826526-5 devstack@n-api.service[127870]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4240084c-16b1-4f88-a754-8f2e62ea4310 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [1ddb70cf-107b-4290-bf60-70f0682d1625] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 04:40:13.791121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7feabcf4-ee7b-484c-a53f-aed15aed93a1 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:13.837287 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7feabcf4-ee7b-484c-a53f-aed15aed93a1 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 0.611243 Jul 20 04:40:13.843406 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2434/4609] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:13 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:13.866844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-31f14d6c-7f65-433c-8741-4ba365213703 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:13.868226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-31f14d6c-7f65-433c-8741-4ba365213703 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:13.880521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31f14d6c-7f65-433c-8741-4ba365213703 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:13.881181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31f14d6c-7f65-433c-8741-4ba365213703 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:13.882640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31f14d6c-7f65-433c-8741-4ba365213703 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:13.883212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31f14d6c-7f65-433c-8741-4ba365213703 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:14.184901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-31f14d6c-7f65-433c-8741-4ba365213703 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:14.202434 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-31f14d6c-7f65-433c-8741-4ba365213703 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1509 microversion: 2.1 time: 0.356169 Jul 20 04:40:14.203470 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2435/4610] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:13 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1509 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:14.211772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e7f9f7f2-e653-4c20-9daa-ccbdf9f1f188 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:14.220016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e7f9f7f2-e653-4c20-9daa-ccbdf9f1f188 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:14.240217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e7f9f7f2-e653-4c20-9daa-ccbdf9f1f188 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:14.241521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e7f9f7f2-e653-4c20-9daa-ccbdf9f1f188 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:14.245871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e7f9f7f2-e653-4c20-9daa-ccbdf9f1f188 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:14.246836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e7f9f7f2-e653-4c20-9daa-ccbdf9f1f188 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:14.367594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e7f9f7f2-e653-4c20-9daa-ccbdf9f1f188 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:14.378419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e7f9f7f2-e653-4c20-9daa-ccbdf9f1f188 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:14.380738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e7f9f7f2-e653-4c20-9daa-ccbdf9f1f188 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:14.387975 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e7f9f7f2-e653-4c20-9daa-ccbdf9f1f188 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.178600 Jul 20 04:40:14.389152 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2436/4611] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:14 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:14.426382 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [None req-4240084c-16b1-4f88-a754-8f2e62ea4310 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [1ddb70cf-107b-4290-bf60-70f0682d1625] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 42372. Jul 20 04:40:14.458604 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4240084c-16b1-4f88-a754-8f2e62ea4310 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.180855 Jul 20 04:40:14.466813 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2176/4612] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:40:13 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:14.856753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-59943d28-c0cf-4500-bd19-aa96fbfe138e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:14.857392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-59943d28-c0cf-4500-bd19-aa96fbfe138e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:14.872480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59943d28-c0cf-4500-bd19-aa96fbfe138e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:14.875008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59943d28-c0cf-4500-bd19-aa96fbfe138e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:14.875857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59943d28-c0cf-4500-bd19-aa96fbfe138e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:14.876306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59943d28-c0cf-4500-bd19-aa96fbfe138e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:15.219932 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eb65be02-0ebb-4795-bf6f-03de8921b6a1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:15.223391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eb65be02-0ebb-4795-bf6f-03de8921b6a1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:15.239488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb65be02-0ebb-4795-bf6f-03de8921b6a1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:15.242059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb65be02-0ebb-4795-bf6f-03de8921b6a1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:15.249745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb65be02-0ebb-4795-bf6f-03de8921b6a1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:15.253993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb65be02-0ebb-4795-bf6f-03de8921b6a1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:15.324360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-59943d28-c0cf-4500-bd19-aa96fbfe138e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:15.333103 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-59943d28-c0cf-4500-bd19-aa96fbfe138e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 0.480743 Jul 20 04:40:15.333691 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2437/4613] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:14 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:15.414735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a68178e9-a064-4e0a-a34d-f0f99d96b3f8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:15.415347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a68178e9-a064-4e0a-a34d-f0f99d96b3f8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:15.430189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a68178e9-a064-4e0a-a34d-f0f99d96b3f8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:15.430641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a68178e9-a064-4e0a-a34d-f0f99d96b3f8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:15.435523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a68178e9-a064-4e0a-a34d-f0f99d96b3f8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:15.436454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a68178e9-a064-4e0a-a34d-f0f99d96b3f8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:15.588162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a68178e9-a064-4e0a-a34d-f0f99d96b3f8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:15.630745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a68178e9-a064-4e0a-a34d-f0f99d96b3f8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:15.653580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a68178e9-a064-4e0a-a34d-f0f99d96b3f8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:15.655007 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a68178e9-a064-4e0a-a34d-f0f99d96b3f8 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.245437 Jul 20 04:40:15.661553 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2438/4614] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:15 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:16.285886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eb65be02-0ebb-4795-bf6f-03de8921b6a1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:16.298411 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eb65be02-0ebb-4795-bf6f-03de8921b6a1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1509 microversion: 2.1 time: 1.082619 Jul 20 04:40:16.312892 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2177/4615] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:15 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1509 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:16.350548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a0cc87cc-750f-402e-89fc-2db2d62d2338 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:16.351173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a0cc87cc-750f-402e-89fc-2db2d62d2338 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:16.385526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0cc87cc-750f-402e-89fc-2db2d62d2338 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:16.386270 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0cc87cc-750f-402e-89fc-2db2d62d2338 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:16.387136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0cc87cc-750f-402e-89fc-2db2d62d2338 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:16.387587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0cc87cc-750f-402e-89fc-2db2d62d2338 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:16.673726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9cceb266-9ea1-470e-b799-bfbde1597455 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:16.674626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9cceb266-9ea1-470e-b799-bfbde1597455 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:16.697468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cceb266-9ea1-470e-b799-bfbde1597455 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:16.703496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cceb266-9ea1-470e-b799-bfbde1597455 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:16.704509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cceb266-9ea1-470e-b799-bfbde1597455 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:16.704957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cceb266-9ea1-470e-b799-bfbde1597455 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:16.986520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a0cc87cc-750f-402e-89fc-2db2d62d2338 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:16.996449 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a0cc87cc-750f-402e-89fc-2db2d62d2338 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 0.649744 Jul 20 04:40:17.000637 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2439/4616] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:16 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:17.023912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9cceb266-9ea1-470e-b799-bfbde1597455 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:17.039638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9cceb266-9ea1-470e-b799-bfbde1597455 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:17.045947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9cceb266-9ea1-470e-b799-bfbde1597455 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:17.049952 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9cceb266-9ea1-470e-b799-bfbde1597455 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.379861 Jul 20 04:40:17.053200 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2178/4617] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:16 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:40:17.320322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ad15bd96-b9d8-456a-84af-f73f441100bf tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:17.321061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ad15bd96-b9d8-456a-84af-f73f441100bf tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:17.355006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad15bd96-b9d8-456a-84af-f73f441100bf tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.359817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad15bd96-b9d8-456a-84af-f73f441100bf tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.365264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad15bd96-b9d8-456a-84af-f73f441100bf tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.368694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad15bd96-b9d8-456a-84af-f73f441100bf tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.879582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-15f92d19-fc68-467b-a869-98540ce1f3da tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:17.881020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-15f92d19-fc68-467b-a869-98540ce1f3da tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:17.898827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-15f92d19-fc68-467b-a869-98540ce1f3da tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.904528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-15f92d19-fc68-467b-a869-98540ce1f3da tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.905938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-15f92d19-fc68-467b-a869-98540ce1f3da tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.906492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-15f92d19-fc68-467b-a869-98540ce1f3da tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:18.006481 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-15f92d19-fc68-467b-a869-98540ce1f3da tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350/ips" status: 200 len: 152 microversion: 2.20 time: 0.120966 Jul 20 04:40:18.011379 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2179/4618] 10.222.0.17 () {60 vars in 1288 bytes} [Wed Jul 20 04:40:17 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350/ips => generated 152 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:40:18.039941 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b0cf1394-6ea3-4c33-b72a-3aed512628b0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:18.058787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b0cf1394-6ea3-4c33-b72a-3aed512628b0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:18.106404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0cf1394-6ea3-4c33-b72a-3aed512628b0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:18.106870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0cf1394-6ea3-4c33-b72a-3aed512628b0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:18.107655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0cf1394-6ea3-4c33-b72a-3aed512628b0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:18.112899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0cf1394-6ea3-4c33-b72a-3aed512628b0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:18.256223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ad15bd96-b9d8-456a-84af-f73f441100bf tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:18.271554 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ad15bd96-b9d8-456a-84af-f73f441100bf tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1509 microversion: 2.1 time: 0.955781 Jul 20 04:40:18.272862 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2440/4619] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:17 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1509 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:18.279935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f4783374-35f5-4a9c-a0ca-62d2a4907cb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:18.280971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f4783374-35f5-4a9c-a0ca-62d2a4907cb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:18.290339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4783374-35f5-4a9c-a0ca-62d2a4907cb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:18.292556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4783374-35f5-4a9c-a0ca-62d2a4907cb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:18.295133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4783374-35f5-4a9c-a0ca-62d2a4907cb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:18.296309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4783374-35f5-4a9c-a0ca-62d2a4907cb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:18.421678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f4783374-35f5-4a9c-a0ca-62d2a4907cb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:18.435892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f4783374-35f5-4a9c-a0ca-62d2a4907cb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:18.440458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f4783374-35f5-4a9c-a0ca-62d2a4907cb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:18.443942 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f4783374-35f5-4a9c-a0ca-62d2a4907cb0 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.169850 Jul 20 04:40:18.449225 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2441/4620] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:18 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:18.455409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-33e66a44-2610-4e26-b618-c162a778db46 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-88264403", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "48640f96-e6a9-42eb-ba86-32bcdbb5214f"}], "key_name": "tempest-TestNetworkBasicOps-1680861584", "security_groups": [{"name": "tempest-secgroup-smoke-255398925"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:18.771152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b0cf1394-6ea3-4c33-b72a-3aed512628b0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:18.780110 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b0cf1394-6ea3-4c33-b72a-3aed512628b0 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 0.754730 Jul 20 04:40:18.785814 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2180/4621] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:18 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:18.833623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-33e66a44-2610-4e26-b618-c162a778db46 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] validate_networks() for [('48640f96-e6a9-42eb-ba86-32bcdbb5214f', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:40:19.301464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-def1341f-75ed-436a-9f66-92eb94c025e5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:19.302192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-def1341f-75ed-436a-9f66-92eb94c025e5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:19.322092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-def1341f-75ed-436a-9f66-92eb94c025e5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:19.324729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-def1341f-75ed-436a-9f66-92eb94c025e5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:19.325862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-def1341f-75ed-436a-9f66-92eb94c025e5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:19.332857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-def1341f-75ed-436a-9f66-92eb94c025e5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.172206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-33e66a44-2610-4e26-b618-c162a778db46 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:40:20.173316 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-33e66a44-2610-4e26-b618-c162a778db46 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:40:20.174258 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-33e66a44-2610-4e26-b618-c162a778db46 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:40:20.174855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-33e66a44-2610-4e26-b618-c162a778db46 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:40:20.175445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-33e66a44-2610-4e26-b618-c162a778db46 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:40:20.192782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33e66a44-2610-4e26-b618-c162a778db46 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.193513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33e66a44-2610-4e26-b618-c162a778db46 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.194805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33e66a44-2610-4e26-b618-c162a778db46 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.195454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33e66a44-2610-4e26-b618-c162a778db46 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.224006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-33e66a44-2610-4e26-b618-c162a778db46 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Getting quotas for project c9b5d48d9c894a32b3f417820f43427e. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:40:20.231752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-33e66a44-2610-4e26-b618-c162a778db46 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Getting quotas for user 43a4b4fa5cc24463aa398fbc4e1404d4 and project c9b5d48d9c894a32b3f417820f43427e. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:40:20.309486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-33e66a44-2610-4e26-b618-c162a778db46 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:40:20.312233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-33e66a44-2610-4e26-b618-c162a778db46 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:40:20.316812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-def1341f-75ed-436a-9f66-92eb94c025e5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:20.329192 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-def1341f-75ed-436a-9f66-92eb94c025e5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1509 microversion: 2.1 time: 1.031903 Jul 20 04:40:20.333560 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2181/4622] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:19 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1509 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:20.348074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bd3959ad-51a9-4214-80da-387d7bec14be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:20.354384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bd3959ad-51a9-4214-80da-387d7bec14be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:20.371439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd3959ad-51a9-4214-80da-387d7bec14be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.374355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd3959ad-51a9-4214-80da-387d7bec14be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.377413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd3959ad-51a9-4214-80da-387d7bec14be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.378125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd3959ad-51a9-4214-80da-387d7bec14be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.418226 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-33e66a44-2610-4e26-b618-c162a778db46 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.965933 Jul 20 04:40:20.428594 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2442/4623] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:40:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:40:20.448925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8ce6cdfc-5c9b-4f7a-b27c-8a9b43e4ee04 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:20.451427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8ce6cdfc-5c9b-4f7a-b27c-8a9b43e4ee04 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:20.477655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8ce6cdfc-5c9b-4f7a-b27c-8a9b43e4ee04 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.481107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8ce6cdfc-5c9b-4f7a-b27c-8a9b43e4ee04 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.499994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8ce6cdfc-5c9b-4f7a-b27c-8a9b43e4ee04 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.503289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8ce6cdfc-5c9b-4f7a-b27c-8a9b43e4ee04 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:21.053668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bd3959ad-51a9-4214-80da-387d7bec14be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:21.083263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bd3959ad-51a9-4214-80da-387d7bec14be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:21.088696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bd3959ad-51a9-4214-80da-387d7bec14be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:21.098385 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bd3959ad-51a9-4214-80da-387d7bec14be tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.757313 Jul 20 04:40:21.100979 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2182/4624] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:20 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:21.116359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-29863449-7205-48a8-955a-d0bf8bd6f5e1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:21.118321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-29863449-7205-48a8-955a-d0bf8bd6f5e1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:21.284922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-29863449-7205-48a8-955a-d0bf8bd6f5e1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:21.299066 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-29863449-7205-48a8-955a-d0bf8bd6f5e1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 200 len: 1247 microversion: 2.1 time: 0.191155 Jul 20 04:40:21.299935 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2183/4625] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:21 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 1247 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:21.357251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d2166b9f-3022-4355-8f5f-fdf85a455854 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:21.358634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d2166b9f-3022-4355-8f5f-fdf85a455854 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:21.378311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2166b9f-3022-4355-8f5f-fdf85a455854 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:21.379994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2166b9f-3022-4355-8f5f-fdf85a455854 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:21.383358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2166b9f-3022-4355-8f5f-fdf85a455854 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:21.389819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2166b9f-3022-4355-8f5f-fdf85a455854 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:21.425287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8ce6cdfc-5c9b-4f7a-b27c-8a9b43e4ee04 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:21.460275 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8ce6cdfc-5c9b-4f7a-b27c-8a9b43e4ee04 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1523 microversion: 2.1 time: 1.029776 Jul 20 04:40:21.464015 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2443/4626] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:20 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1523 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:21.679681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d2166b9f-3022-4355-8f5f-fdf85a455854 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:21.691503 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d2166b9f-3022-4355-8f5f-fdf85a455854 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1509 microversion: 2.1 time: 0.348171 Jul 20 04:40:21.692446 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2184/4627] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:21 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1509 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:22.119422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-81ee487e-0913-403e-b167-ffe757981b9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:22.120467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-81ee487e-0913-403e-b167-ffe757981b9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:22.137211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81ee487e-0913-403e-b167-ffe757981b9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:22.141698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81ee487e-0913-403e-b167-ffe757981b9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:22.143579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81ee487e-0913-403e-b167-ffe757981b9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:22.144871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81ee487e-0913-403e-b167-ffe757981b9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:22.323076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7a1c721e-173b-4402-a1b8-c72c00d889f7 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:22.323707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7a1c721e-173b-4402-a1b8-c72c00d889f7 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:22.336359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-81ee487e-0913-403e-b167-ffe757981b9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:22.343342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a1c721e-173b-4402-a1b8-c72c00d889f7 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:22.344141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a1c721e-173b-4402-a1b8-c72c00d889f7 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:22.356848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a1c721e-173b-4402-a1b8-c72c00d889f7 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:22.357356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a1c721e-173b-4402-a1b8-c72c00d889f7 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:22.360326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-81ee487e-0913-403e-b167-ffe757981b9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:22.382298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-81ee487e-0913-403e-b167-ffe757981b9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:22.387861 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-81ee487e-0913-403e-b167-ffe757981b9c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.272525 Jul 20 04:40:22.398463 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2444/4628] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:22 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:22.502734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c1f719b3-97c9-46ef-9e22-25184e05f860 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:22.510558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c1f719b3-97c9-46ef-9e22-25184e05f860 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:22.541547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1f719b3-97c9-46ef-9e22-25184e05f860 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:22.543535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1f719b3-97c9-46ef-9e22-25184e05f860 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:22.546465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1f719b3-97c9-46ef-9e22-25184e05f860 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:22.547614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1f719b3-97c9-46ef-9e22-25184e05f860 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:22.959055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7a1c721e-173b-4402-a1b8-c72c00d889f7 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:22.971946 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7a1c721e-173b-4402-a1b8-c72c00d889f7 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 200 len: 1307 microversion: 2.1 time: 0.654700 Jul 20 04:40:22.973538 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2185/4629] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:22 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 1307 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:22.984090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c1f719b3-97c9-46ef-9e22-25184e05f860 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:22.993059 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c1f719b3-97c9-46ef-9e22-25184e05f860 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1503 microversion: 2.1 time: 0.515432 Jul 20 04:40:22.998316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e4a6da0b-2111-41eb-9fca-ab529cd1624d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:22.998956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e4a6da0b-2111-41eb-9fca-ab529cd1624d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:22.999077 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2445/4630] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:22 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1503 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:23.004296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-66fc17e6-7844-4664-9f4d-52b0789503bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:23.011703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4a6da0b-2111-41eb-9fca-ab529cd1624d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:23.014038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4a6da0b-2111-41eb-9fca-ab529cd1624d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:23.018032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4a6da0b-2111-41eb-9fca-ab529cd1624d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:23.020732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-66fc17e6-7844-4664-9f4d-52b0789503bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:23.021996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4a6da0b-2111-41eb-9fca-ab529cd1624d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:23.038609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66fc17e6-7844-4664-9f4d-52b0789503bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:23.039068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66fc17e6-7844-4664-9f4d-52b0789503bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:23.039871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66fc17e6-7844-4664-9f4d-52b0789503bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:23.040337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66fc17e6-7844-4664-9f4d-52b0789503bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:23.080621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-66fc17e6-7844-4664-9f4d-52b0789503bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lazy-loading 'flavor' on Instance uuid 7c7e62d3-1b07-483d-9943-887c096d4350 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:40:23.328579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:23.438194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e4a6da0b-2111-41eb-9fca-ab529cd1624d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:23.454866 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e4a6da0b-2111-41eb-9fca-ab529cd1624d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1509 microversion: 2.1 time: 0.473480 Jul 20 04:40:23.455859 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2186/4631] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:22 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1509 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:23.468210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2bcce3c1-1902-4d57-9aaf-091939bbdbb5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:23.476748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2bcce3c1-1902-4d57-9aaf-091939bbdbb5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:23.492946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bcce3c1-1902-4d57-9aaf-091939bbdbb5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:23.493398 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bcce3c1-1902-4d57-9aaf-091939bbdbb5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:23.494201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bcce3c1-1902-4d57-9aaf-091939bbdbb5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:23.494720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bcce3c1-1902-4d57-9aaf-091939bbdbb5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:23.858404 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-66fc17e6-7844-4664-9f4d-52b0789503bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "POST /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350/action" status: 202 len: 0 microversion: 2.20 time: 0.857809 Jul 20 04:40:23.861481 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2446/4632] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jul 20 04:40:22 2022] POST /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350/action => generated 0 bytes in 862 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:40:23.869792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c62b6112-507a-4d9c-a6eb-aff344c24b05 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:23.870890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c62b6112-507a-4d9c-a6eb-aff344c24b05 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:23.884465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c62b6112-507a-4d9c-a6eb-aff344c24b05 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:23.888403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c62b6112-507a-4d9c-a6eb-aff344c24b05 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:23.889879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c62b6112-507a-4d9c-a6eb-aff344c24b05 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:23.890472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c62b6112-507a-4d9c-a6eb-aff344c24b05 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:24.043956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c62b6112-507a-4d9c-a6eb-aff344c24b05 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:24.061845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c62b6112-507a-4d9c-a6eb-aff344c24b05 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:24.068647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c62b6112-507a-4d9c-a6eb-aff344c24b05 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:24.070334 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c62b6112-507a-4d9c-a6eb-aff344c24b05 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.207308 Jul 20 04:40:24.083761 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2447/4633] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:23 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:24.098263 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-57b979f7-e866-4a49-b297-5eacfe79fdc8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:24.098263 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-57b979f7-e866-4a49-b297-5eacfe79fdc8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:24.115230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57b979f7-e866-4a49-b297-5eacfe79fdc8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.115825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57b979f7-e866-4a49-b297-5eacfe79fdc8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:24.117010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57b979f7-e866-4a49-b297-5eacfe79fdc8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.117566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57b979f7-e866-4a49-b297-5eacfe79fdc8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:24.348675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2bcce3c1-1902-4d57-9aaf-091939bbdbb5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:24.369675 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2bcce3c1-1902-4d57-9aaf-091939bbdbb5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1516 microversion: 2.1 time: 0.912467 Jul 20 04:40:24.370287 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2187/4634] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:23 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1516 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:24.388749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-33e85a19-7ea6-488a-b99d-52e7aef42665 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:24.389481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-33e85a19-7ea6-488a-b99d-52e7aef42665 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:24.406491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-57b979f7-e866-4a49-b297-5eacfe79fdc8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:24.414985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33e85a19-7ea6-488a-b99d-52e7aef42665 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.417661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33e85a19-7ea6-488a-b99d-52e7aef42665 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:24.418660 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33e85a19-7ea6-488a-b99d-52e7aef42665 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.420750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-57b979f7-e866-4a49-b297-5eacfe79fdc8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:24.421081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33e85a19-7ea6-488a-b99d-52e7aef42665 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:24.422606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-57b979f7-e866-4a49-b297-5eacfe79fdc8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:24.424142 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-57b979f7-e866-4a49-b297-5eacfe79fdc8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1724 microversion: 2.20 time: 0.337871 Jul 20 04:40:24.424915 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2448/4635] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:24 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:24.443359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-17c261e8-20a2-4917-9a5a-38edea0ab484 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:24.453474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-17c261e8-20a2-4917-9a5a-38edea0ab484 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 45b5879b-b46a-4253-8d67-4f3b4e65b224] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:24.459608 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-17c261e8-20a2-4917-9a5a-38edea0ab484 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] HTTP exception thrown: Instance 45b5879b-b46a-4253-8d67-4f3b4e65b224 could not be found. Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-17c261e8-20a2-4917-9a5a-38edea0ab484 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Request method failure captured: Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/45b5879b-b46a-4253-8d67-4f3b4e65b224/action HTTP/1.1 Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 14 Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14cCAXHTn9-xjP9-j6Y5H3QclpCYHsqBLpRpQihoTalzGkb0NJB3tQRrqwgEU6RYcb1rSLMpRe6OHLIl_vuXQ5sxjCNslRe7DUQ3JshdANU3fqjJB1ce8j9t6r_FeEMPekMuZI1SQ7JdDTpAgLs_ZRs_OCOFW6Xgy06EebnWW58puJk Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 3e123ad99de64f50b9cd4373597c3a9e Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3e123ad99de64f50b9cd4373597c3a9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3e123ad99de64f50b9cd4373597c3a9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3e123ad99de64f50b9cd4373597c3a9e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3e123ad99de64f50b9cd4373597c3a9e"}]}] Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 3e123ad99de64f50b9cd4373597c3a9e Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerRescueNegativeTestJSON-810656662-project Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 8ea213e79bcf4aaea49446db5eb55271 Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerRescueNegativeTestJSON-810656662-project Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: {"rescue": {}} Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 45b5879b-b46a-4253-8d67-4f3b4e65b224 could not be found. Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '45b5879b-b46a-4253-8d67-4f3b4e65b224', 'body': {'rescue': {}}} Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45b5879b-b46a-4253-8d67-4f3b4e65b224 could not be found. Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45b5879b-b46a-4253-8d67-4f3b4e65b224 could not be found. Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:40:24.478230 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:24.487323 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:24.487323 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:24.487323 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:24.487323 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:24.487323 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45b5879b-b46a-4253-8d67-4f3b4e65b224 could not be found. Jul 20 04:40:24.487323 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:40:24.487323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-17c261e8-20a2-4917-9a5a-38edea0ab484 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Returning 404 to user: Instance 45b5879b-b46a-4253-8d67-4f3b4e65b224 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:24.487323 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-17c261e8-20a2-4917-9a5a-38edea0ab484 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "POST /compute/v2.1/servers/45b5879b-b46a-4253-8d67-4f3b4e65b224/action" status: 404 len: 111 microversion: 2.1 time: 0.050978 Jul 20 04:40:24.487323 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2449/4636] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:24 2022] POST /compute/v2.1/servers/45b5879b-b46a-4253-8d67-4f3b4e65b224/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:40:24.489473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-187bfdc3-7ac0-4088-97d9-c319e36df680 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:24.494986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-187bfdc3-7ac0-4088-97d9-c319e36df680 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:24.515138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-187bfdc3-7ac0-4088-97d9-c319e36df680 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.517206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-187bfdc3-7ac0-4088-97d9-c319e36df680 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:24.518659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-187bfdc3-7ac0-4088-97d9-c319e36df680 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.519027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-187bfdc3-7ac0-4088-97d9-c319e36df680 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:24.768493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-33e85a19-7ea6-488a-b99d-52e7aef42665 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:24.777245 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-33e85a19-7ea6-488a-b99d-52e7aef42665 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 200 len: 1305 microversion: 2.1 time: 0.392536 Jul 20 04:40:24.795584 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2188/4637] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:24 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 1305 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:24.807288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-beaa3d25-be7a-4ddb-a441-007a849f165e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:24.813792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-beaa3d25-be7a-4ddb-a441-007a849f165e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:24.836705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-beaa3d25-be7a-4ddb-a441-007a849f165e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.837477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-beaa3d25-be7a-4ddb-a441-007a849f165e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:24.838522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-beaa3d25-be7a-4ddb-a441-007a849f165e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.841195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-beaa3d25-be7a-4ddb-a441-007a849f165e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:25.097163 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-beaa3d25-be7a-4ddb-a441-007a849f165e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "POST /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9/action" status: 202 len: 0 microversion: 2.1 time: 0.299726 Jul 20 04:40:25.106165 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2189/4638] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:24 2022] POST /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:40:25.128336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2d6973bc-6c1f-4f72-9982-e50c3a4f59b1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:25.134584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2d6973bc-6c1f-4f72-9982-e50c3a4f59b1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:25.153576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d6973bc-6c1f-4f72-9982-e50c3a4f59b1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:25.153576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d6973bc-6c1f-4f72-9982-e50c3a4f59b1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:25.156377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d6973bc-6c1f-4f72-9982-e50c3a4f59b1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:25.156646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d6973bc-6c1f-4f72-9982-e50c3a4f59b1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:25.219092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:25.550714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2d6973bc-6c1f-4f72-9982-e50c3a4f59b1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:25.580380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2d6973bc-6c1f-4f72-9982-e50c3a4f59b1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:25.581924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2d6973bc-6c1f-4f72-9982-e50c3a4f59b1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:25.583176 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2d6973bc-6c1f-4f72-9982-e50c3a4f59b1 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.476728 Jul 20 04:40:25.586815 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2190/4639] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:25 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:25.618717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-da12b368-8e2c-4f7e-8bda-b657cb440eac tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:25.619881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-da12b368-8e2c-4f7e-8bda-b657cb440eac tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:25.650965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da12b368-8e2c-4f7e-8bda-b657cb440eac tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:25.651664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da12b368-8e2c-4f7e-8bda-b657cb440eac tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:25.652533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da12b368-8e2c-4f7e-8bda-b657cb440eac tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:25.652972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da12b368-8e2c-4f7e-8bda-b657cb440eac tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:26.231409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-187bfdc3-7ac0-4088-97d9-c319e36df680 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:26.243312 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-187bfdc3-7ac0-4088-97d9-c319e36df680 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1509 microversion: 2.1 time: 1.759446 Jul 20 04:40:26.245217 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2450/4640] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:24 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1509 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:26.260793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6b45c542-7d0d-4365-aac1-b0bde8bc9946 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:26.262087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6b45c542-7d0d-4365-aac1-b0bde8bc9946 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:26.279193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6b45c542-7d0d-4365-aac1-b0bde8bc9946 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:26.279853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6b45c542-7d0d-4365-aac1-b0bde8bc9946 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:26.283455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6b45c542-7d0d-4365-aac1-b0bde8bc9946 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:26.284171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6b45c542-7d0d-4365-aac1-b0bde8bc9946 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:26.370726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-da12b368-8e2c-4f7e-8bda-b657cb440eac tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:26.380775 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-da12b368-8e2c-4f7e-8bda-b657cb440eac tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1501 microversion: 2.1 time: 0.790698 Jul 20 04:40:26.382112 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2191/4641] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:25 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1501 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:26.409182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2418b8a2-09f5-4ed4-b4c1-393440f45dfe tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:26.411052 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2418b8a2-09f5-4ed4-b4c1-393440f45dfe tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:26.427075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2418b8a2-09f5-4ed4-b4c1-393440f45dfe tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:26.429019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2418b8a2-09f5-4ed4-b4c1-393440f45dfe tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:26.430030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2418b8a2-09f5-4ed4-b4c1-393440f45dfe tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:26.431655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2418b8a2-09f5-4ed4-b4c1-393440f45dfe tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:26.804776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6b45c542-7d0d-4365-aac1-b0bde8bc9946 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:26.815725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6b45c542-7d0d-4365-aac1-b0bde8bc9946 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:26.817553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6b45c542-7d0d-4365-aac1-b0bde8bc9946 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:26.821393 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6b45c542-7d0d-4365-aac1-b0bde8bc9946 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1724 microversion: 2.20 time: 0.574772 Jul 20 04:40:26.824645 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2451/4642] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:26 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1724 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:26.835478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5e08ce8a-e8ac-4a96-bd99-08aa79228515 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:26.836860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5e08ce8a-e8ac-4a96-bd99-08aa79228515 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:26.852131 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e08ce8a-e8ac-4a96-bd99-08aa79228515 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:26.853543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e08ce8a-e8ac-4a96-bd99-08aa79228515 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:26.860559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e08ce8a-e8ac-4a96-bd99-08aa79228515 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:26.861403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e08ce8a-e8ac-4a96-bd99-08aa79228515 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:26.909985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-5e08ce8a-e8ac-4a96-bd99-08aa79228515 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lazy-loading 'flavor' on Instance uuid ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:40:26.942229 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-5e08ce8a-e8ac-4a96-bd99-08aa79228515 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] HTTP exception thrown: Cannot 'rescue' instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 while it is in vm_state paused Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5e08ce8a-e8ac-4a96-bd99-08aa79228515 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Request method failure captured: Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9/action HTTP/1.1 Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 14 Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14cCAXHTn9-xjP9-j6Y5H3QclpCYHsqBLpRpQihoTalzGkb0NJB3tQRrqwgEU6RYcb1rSLMpRe6OHLIl_vuXQ5sxjCNslRe7DUQ3JshdANU3fqjJB1ce8j9t6r_FeEMPekMuZI1SQ7JdDTpAgLs_ZRs_OCOFW6Xgy06EebnWW58puJk Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 3e123ad99de64f50b9cd4373597c3a9e Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3e123ad99de64f50b9cd4373597c3a9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3e123ad99de64f50b9cd4373597c3a9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3e123ad99de64f50b9cd4373597c3a9e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3e123ad99de64f50b9cd4373597c3a9e"}]}] Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 3e123ad99de64f50b9cd4373597c3a9e Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerRescueNegativeTestJSON-810656662-project Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 8ea213e79bcf4aaea49446db5eb55271 Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerRescueNegativeTestJSON-810656662-project Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: {"rescue": {}} Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: exception: Cannot 'rescue' instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 while it is in vm_state paused Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'ca2f9ea6-9cd9-416d-b210-2b1968e47ea9', 'body': {'rescue': {}}} Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 in vm_state paused. Cannot rescue while the instance is in this state. Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 while it is in vm_state paused Jul 20 04:40:26.945949 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:40:26.949871 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:26.949871 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:40:26.949871 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:26.949871 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:26.949871 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:26.949871 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:26.949871 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:26.949871 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 while it is in vm_state paused Jul 20 04:40:26.949871 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:40:26.952942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5e08ce8a-e8ac-4a96-bd99-08aa79228515 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Returning 409 to user: Cannot 'rescue' instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 while it is in vm_state paused {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:26.953994 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5e08ce8a-e8ac-4a96-bd99-08aa79228515 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "POST /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9/action" status: 409 len: 144 microversion: 2.1 time: 0.128164 Jul 20 04:40:26.972361 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2452/4643] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:26 2022] POST /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9/action => generated 144 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:40:26.978467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ef63627a-ec0c-4a64-b78c-7d1569d991aa tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:26.980662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ef63627a-ec0c-4a64-b78c-7d1569d991aa tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:26.998646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef63627a-ec0c-4a64-b78c-7d1569d991aa tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.000411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef63627a-ec0c-4a64-b78c-7d1569d991aa tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.001451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef63627a-ec0c-4a64-b78c-7d1569d991aa tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.002105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef63627a-ec0c-4a64-b78c-7d1569d991aa tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.211011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ef63627a-ec0c-4a64-b78c-7d1569d991aa tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:27.248609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ef63627a-ec0c-4a64-b78c-7d1569d991aa tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:27.261463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ef63627a-ec0c-4a64-b78c-7d1569d991aa tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:27.268244 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ef63627a-ec0c-4a64-b78c-7d1569d991aa tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.292963 Jul 20 04:40:27.281007 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2453/4644] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:26 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:27.286603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9ba8df87-6ee8-40cd-bff7-6bdadbcf59af tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:27.287387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9ba8df87-6ee8-40cd-bff7-6bdadbcf59af tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:27.299675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ba8df87-6ee8-40cd-bff7-6bdadbcf59af tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.300604 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ba8df87-6ee8-40cd-bff7-6bdadbcf59af tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.302102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ba8df87-6ee8-40cd-bff7-6bdadbcf59af tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.302874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ba8df87-6ee8-40cd-bff7-6bdadbcf59af tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.439730 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9ba8df87-6ee8-40cd-bff7-6bdadbcf59af tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "POST /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9/action" status: 202 len: 0 microversion: 2.1 time: 0.156388 Jul 20 04:40:27.445356 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2454/4645] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:27 2022] POST /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:40:27.451691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0a120f8b-e956-4df6-9fdd-d42c56745ece tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:27.454803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0a120f8b-e956-4df6-9fdd-d42c56745ece tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:27.492981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a120f8b-e956-4df6-9fdd-d42c56745ece tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.494537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a120f8b-e956-4df6-9fdd-d42c56745ece tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.495422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a120f8b-e956-4df6-9fdd-d42c56745ece tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.495879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a120f8b-e956-4df6-9fdd-d42c56745ece tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.538583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2418b8a2-09f5-4ed4-b4c1-393440f45dfe tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:27.565178 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2418b8a2-09f5-4ed4-b4c1-393440f45dfe tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 200 len: 1372 microversion: 2.1 time: 1.181621 Jul 20 04:40:27.570078 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2192/4646] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:26 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 1372 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:28.129864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f4198785-3e00-4070-a12d-9869ce255c30 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'create', calling method: .version_select at 0x7f06bde5fca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1236622447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4MgvQbO96staiifOAvVxpxJVZ5XiL1ltUCfbGK0kLV8ySRTvcp6RpBASVVyv/q+lamruqxN7tPIwFnfIw4FF+MrP/q2Tl/bNMyGsbH1HagXoI1+g9E+J9NSgqEV7c8ng=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:28.183844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-f4198785-3e00-4070-a12d-9869ce255c30 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Getting quotas for project a678d19d82d248958a3d7df804ccfa95. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:40:28.242842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-f4198785-3e00-4070-a12d-9869ce255c30 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Getting quotas for user cffe347e0a094346afd74f178a0fde5d and project a678d19d82d248958a3d7df804ccfa95. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:40:28.309667 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f4198785-3e00-4070-a12d-9869ce255c30 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.736169 Jul 20 04:40:28.315794 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2193/4647] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:40:27 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:28.330627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-70e75c06-5ed3-451b-b1f5-1f70a2d3deb3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:28.342967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-70e75c06-5ed3-451b-b1f5-1f70a2d3deb3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:28.357765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70e75c06-5ed3-451b-b1f5-1f70a2d3deb3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:28.358954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70e75c06-5ed3-451b-b1f5-1f70a2d3deb3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:28.360477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70e75c06-5ed3-451b-b1f5-1f70a2d3deb3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:28.361283 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70e75c06-5ed3-451b-b1f5-1f70a2d3deb3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:28.595462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0a120f8b-e956-4df6-9fdd-d42c56745ece tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:28.613351 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0a120f8b-e956-4df6-9fdd-d42c56745ece tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1509 microversion: 2.1 time: 1.166250 Jul 20 04:40:28.615030 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2455/4648] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:27 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1509 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:28.628854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7ba1f48b-dbff-4d12-b100-5584a501710c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:28.629703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7ba1f48b-dbff-4d12-b100-5584a501710c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:28.652860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ba1f48b-dbff-4d12-b100-5584a501710c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:28.653802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ba1f48b-dbff-4d12-b100-5584a501710c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:28.655312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ba1f48b-dbff-4d12-b100-5584a501710c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:28.657205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ba1f48b-dbff-4d12-b100-5584a501710c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:28.856679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-70e75c06-5ed3-451b-b1f5-1f70a2d3deb3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:28.886248 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-70e75c06-5ed3-451b-b1f5-1f70a2d3deb3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1508 microversion: 2.1 time: 0.568760 Jul 20 04:40:28.889060 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2194/4649] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:28 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1508 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:28.900016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-504b522d-ba1f-4b89-bbc5-c59f09fab91b req-42233aca-b022-410f-a50d-1885a12ac212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99", "tag": "3f833ad4-3bc9-46b1-8894-6763e4cd4d05"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:28.926667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-504b522d-ba1f-4b89-bbc5-c59f09fab91b req-42233aca-b022-410f-a50d-1885a12ac212 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:28.930928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-504b522d-ba1f-4b89-bbc5-c59f09fab91b req-42233aca-b022-410f-a50d-1885a12ac212 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:28.955479 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-504b522d-ba1f-4b89-bbc5-c59f09fab91b req-42233aca-b022-410f-a50d-1885a12ac212 service nova] Creating event network-changed:3f833ad4-3bc9-46b1-8894-6763e4cd4d05 for instance 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 on n-h1-826526-5 Jul 20 04:40:28.971100 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-504b522d-ba1f-4b89-bbc5-c59f09fab91b req-42233aca-b022-410f-a50d-1885a12ac212 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077641 Jul 20 04:40:28.974048 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2195/4650] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:28.981811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3a8a2c70-06c1-46ce-96ba-ed05eb69283c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:28.990740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3a8a2c70-06c1-46ce-96ba-ed05eb69283c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:29.007461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a8a2c70-06c1-46ce-96ba-ed05eb69283c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:29.012424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a8a2c70-06c1-46ce-96ba-ed05eb69283c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:29.013661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a8a2c70-06c1-46ce-96ba-ed05eb69283c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:29.014385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3a8a2c70-06c1-46ce-96ba-ed05eb69283c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:29.063505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7ba1f48b-dbff-4d12-b100-5584a501710c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:29.082251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7ba1f48b-dbff-4d12-b100-5584a501710c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:29.084108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7ba1f48b-dbff-4d12-b100-5584a501710c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:29.085475 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7ba1f48b-dbff-4d12-b100-5584a501710c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1724 microversion: 2.20 time: 0.468986 Jul 20 04:40:29.096492 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2456/4651] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:28 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1724 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:29.104844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cd83a97c-193e-4360-b41e-dcb88ceb5b5c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:29.105944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cd83a97c-193e-4360-b41e-dcb88ceb5b5c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:29.113009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd83a97c-193e-4360-b41e-dcb88ceb5b5c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:29.113729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd83a97c-193e-4360-b41e-dcb88ceb5b5c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:29.114800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd83a97c-193e-4360-b41e-dcb88ceb5b5c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:29.115397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd83a97c-193e-4360-b41e-dcb88ceb5b5c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:29.215224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3a8a2c70-06c1-46ce-96ba-ed05eb69283c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:29.238399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3a8a2c70-06c1-46ce-96ba-ed05eb69283c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:29.240686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3a8a2c70-06c1-46ce-96ba-ed05eb69283c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:29.242350 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3a8a2c70-06c1-46ce-96ba-ed05eb69283c tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.265792 Jul 20 04:40:29.252698 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2196/4652] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:28 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:29.561467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cd83a97c-193e-4360-b41e-dcb88ceb5b5c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:29.581021 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cd83a97c-193e-4360-b41e-dcb88ceb5b5c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 200 len: 1372 microversion: 2.1 time: 0.483038 Jul 20 04:40:29.585122 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2457/4653] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:29 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 1372 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:29.631180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-79b06718-71b1-4964-89ce-f9446f7b1870 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:29.632129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-79b06718-71b1-4964-89ce-f9446f7b1870 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:29.654304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79b06718-71b1-4964-89ce-f9446f7b1870 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:29.654777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79b06718-71b1-4964-89ce-f9446f7b1870 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:29.655594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79b06718-71b1-4964-89ce-f9446f7b1870 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:29.656216 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79b06718-71b1-4964-89ce-f9446f7b1870 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:29.895271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-79b06718-71b1-4964-89ce-f9446f7b1870 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:29.906759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-11e83d65-50b2-4e31-84df-07ec6a896d83 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:29.908775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-11e83d65-50b2-4e31-84df-07ec6a896d83 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:29.909804 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-79b06718-71b1-4964-89ce-f9446f7b1870 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1509 microversion: 2.1 time: 0.282187 Jul 20 04:40:29.920739 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2197/4654] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:29 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1509 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:29.930262 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11e83d65-50b2-4e31-84df-07ec6a896d83 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:29.932856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11e83d65-50b2-4e31-84df-07ec6a896d83 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:29.933823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11e83d65-50b2-4e31-84df-07ec6a896d83 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:29.941060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11e83d65-50b2-4e31-84df-07ec6a896d83 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.106847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f522e615-ab80-4dc4-8725-da77d079c5e9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:30.107514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f522e615-ab80-4dc4-8725-da77d079c5e9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:30.137547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f522e615-ab80-4dc4-8725-da77d079c5e9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.141630 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f522e615-ab80-4dc4-8725-da77d079c5e9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.143922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f522e615-ab80-4dc4-8725-da77d079c5e9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.144680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f522e615-ab80-4dc4-8725-da77d079c5e9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.209768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:30.247050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:30.353638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-11e83d65-50b2-4e31-84df-07ec6a896d83 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:30.364132 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-11e83d65-50b2-4e31-84df-07ec6a896d83 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1508 microversion: 2.1 time: 0.462219 Jul 20 04:40:30.366770 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2458/4655] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:29 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1508 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:30.376459 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e4c5d712-eafe-4fc3-9a6f-2cbae5e192df tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:30.383048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e4c5d712-eafe-4fc3-9a6f-2cbae5e192df tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:30.404757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4c5d712-eafe-4fc3-9a6f-2cbae5e192df tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.405155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4c5d712-eafe-4fc3-9a6f-2cbae5e192df tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.405961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4c5d712-eafe-4fc3-9a6f-2cbae5e192df tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.408306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4c5d712-eafe-4fc3-9a6f-2cbae5e192df tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.530772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f522e615-ab80-4dc4-8725-da77d079c5e9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:30.545720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f522e615-ab80-4dc4-8725-da77d079c5e9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:30.549466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f522e615-ab80-4dc4-8725-da77d079c5e9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:30.550986 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f522e615-ab80-4dc4-8725-da77d079c5e9 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1724 microversion: 2.20 time: 0.451679 Jul 20 04:40:30.563686 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2198/4656] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:30 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1724 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:30.602826 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8a8d5ef5-b49c-4881-8a90-ff104bfb20e0 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:30.604895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8a8d5ef5-b49c-4881-8a90-ff104bfb20e0 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:30.640576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a8d5ef5-b49c-4881-8a90-ff104bfb20e0 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.642328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a8d5ef5-b49c-4881-8a90-ff104bfb20e0 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.649858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a8d5ef5-b49c-4881-8a90-ff104bfb20e0 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.650820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e4c5d712-eafe-4fc3-9a6f-2cbae5e192df tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:30.652359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a8d5ef5-b49c-4881-8a90-ff104bfb20e0 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.679267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e4c5d712-eafe-4fc3-9a6f-2cbae5e192df tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:30.685598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e4c5d712-eafe-4fc3-9a6f-2cbae5e192df tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:30.687129 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e4c5d712-eafe-4fc3-9a6f-2cbae5e192df tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.319141 Jul 20 04:40:30.692646 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2459/4657] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:30 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:30.926969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-71dd02c9-9c18-459b-b66e-8af8770d0ec5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:30.927916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-71dd02c9-9c18-459b-b66e-8af8770d0ec5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:30.941378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71dd02c9-9c18-459b-b66e-8af8770d0ec5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.945585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71dd02c9-9c18-459b-b66e-8af8770d0ec5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.948598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71dd02c9-9c18-459b-b66e-8af8770d0ec5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.949138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71dd02c9-9c18-459b-b66e-8af8770d0ec5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:31.241276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8a8d5ef5-b49c-4881-8a90-ff104bfb20e0 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:31.254073 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8a8d5ef5-b49c-4881-8a90-ff104bfb20e0 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 200 len: 1372 microversion: 2.1 time: 0.656931 Jul 20 04:40:31.263817 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2199/4658] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:30 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 1372 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:31.384304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d187818b-f762-490e-8264-19a6ce1be163 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:31.385010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d187818b-f762-490e-8264-19a6ce1be163 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:31.402049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d187818b-f762-490e-8264-19a6ce1be163 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:31.402521 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d187818b-f762-490e-8264-19a6ce1be163 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:31.405313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d187818b-f762-490e-8264-19a6ce1be163 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:31.408496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d187818b-f762-490e-8264-19a6ce1be163 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:31.448495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-71dd02c9-9c18-459b-b66e-8af8770d0ec5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:31.463395 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-71dd02c9-9c18-459b-b66e-8af8770d0ec5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1509 microversion: 2.1 time: 0.539828 Jul 20 04:40:31.478157 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2460/4659] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:30 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1509 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:31.570407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e95532de-6e1e-4b54-a609-c4cf6f128e4f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:31.571026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e95532de-6e1e-4b54-a609-c4cf6f128e4f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:31.581229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e95532de-6e1e-4b54-a609-c4cf6f128e4f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:31.588906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e95532de-6e1e-4b54-a609-c4cf6f128e4f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:31.591569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e95532de-6e1e-4b54-a609-c4cf6f128e4f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:31.593605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e95532de-6e1e-4b54-a609-c4cf6f128e4f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:31.851171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d187818b-f762-490e-8264-19a6ce1be163 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:31.874776 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d187818b-f762-490e-8264-19a6ce1be163 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1508 microversion: 2.1 time: 0.496610 Jul 20 04:40:31.875991 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2200/4660] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:31 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1508 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:31.882207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-104d0d9b-1d5a-4c52-81d9-021075d76750 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:31.898020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-104d0d9b-1d5a-4c52-81d9-021075d76750 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:31.926507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-104d0d9b-1d5a-4c52-81d9-021075d76750 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:31.929981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-104d0d9b-1d5a-4c52-81d9-021075d76750 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:31.942192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-104d0d9b-1d5a-4c52-81d9-021075d76750 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:31.943110 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-104d0d9b-1d5a-4c52-81d9-021075d76750 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:32.176341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-104d0d9b-1d5a-4c52-81d9-021075d76750 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:32.186161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-104d0d9b-1d5a-4c52-81d9-021075d76750 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:32.211282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-104d0d9b-1d5a-4c52-81d9-021075d76750 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:32.219615 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-104d0d9b-1d5a-4c52-81d9-021075d76750 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.339199 Jul 20 04:40:32.225618 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2201/4661] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:31 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:32.274860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-05b49d94-0f3a-48d8-bb7a-06568467ddcb tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:32.284997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-05b49d94-0f3a-48d8-bb7a-06568467ddcb tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:32.316729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-05b49d94-0f3a-48d8-bb7a-06568467ddcb tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:32.329564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-05b49d94-0f3a-48d8-bb7a-06568467ddcb tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:32.336717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-05b49d94-0f3a-48d8-bb7a-06568467ddcb tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:32.341069 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-05b49d94-0f3a-48d8-bb7a-06568467ddcb tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:32.634126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e95532de-6e1e-4b54-a609-c4cf6f128e4f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:32.687975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e95532de-6e1e-4b54-a609-c4cf6f128e4f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:32.697490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e95532de-6e1e-4b54-a609-c4cf6f128e4f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:32.705880 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e95532de-6e1e-4b54-a609-c4cf6f128e4f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1724 microversion: 2.20 time: 1.133011 Jul 20 04:40:32.707545 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2461/4662] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:31 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1724 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:40:32.728796 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dfa670aa-8ff8-4d01-89d6-4bfc30fc82a0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:32.732451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dfa670aa-8ff8-4d01-89d6-4bfc30fc82a0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:32.768590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dfa670aa-8ff8-4d01-89d6-4bfc30fc82a0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:32.770245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dfa670aa-8ff8-4d01-89d6-4bfc30fc82a0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:32.777223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dfa670aa-8ff8-4d01-89d6-4bfc30fc82a0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:32.778201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dfa670aa-8ff8-4d01-89d6-4bfc30fc82a0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.237402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dfa670aa-8ff8-4d01-89d6-4bfc30fc82a0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:33.239880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:33.279881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-05b49d94-0f3a-48d8-bb7a-06568467ddcb tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:33.298720 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-05b49d94-0f3a-48d8-bb7a-06568467ddcb tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 200 len: 1372 microversion: 2.1 time: 1.030633 Jul 20 04:40:33.312251 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2202/4663] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:32 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 1372 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:33.313969 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dfa670aa-8ff8-4d01-89d6-4bfc30fc82a0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1509 microversion: 2.1 time: 0.599982 Jul 20 04:40:33.327865 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2462/4664] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:32 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1509 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:33.338428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0f554037-1df7-44bc-98c6-829a6a157061 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:33.340092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0f554037-1df7-44bc-98c6-829a6a157061 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:33.346414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-52e786c7-d4ef-4592-88ba-c29f2535099a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:33.351636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f554037-1df7-44bc-98c6-829a6a157061 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.352099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f554037-1df7-44bc-98c6-829a6a157061 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.353088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f554037-1df7-44bc-98c6-829a6a157061 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.353636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f554037-1df7-44bc-98c6-829a6a157061 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.367226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-52e786c7-d4ef-4592-88ba-c29f2535099a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:33.419977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52e786c7-d4ef-4592-88ba-c29f2535099a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.425250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52e786c7-d4ef-4592-88ba-c29f2535099a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.428916 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52e786c7-d4ef-4592-88ba-c29f2535099a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.438157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52e786c7-d4ef-4592-88ba-c29f2535099a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.556870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0f554037-1df7-44bc-98c6-829a6a157061 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:33.574332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0f554037-1df7-44bc-98c6-829a6a157061 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:33.578996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0f554037-1df7-44bc-98c6-829a6a157061 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:33.582528 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0f554037-1df7-44bc-98c6-829a6a157061 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.264675 Jul 20 04:40:33.583131 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2463/4665] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:33 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:33.737355 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1943f38f-d8f0-447b-b7d0-d67d16917096 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:33.738647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1943f38f-d8f0-447b-b7d0-d67d16917096 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:33.753222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1943f38f-d8f0-447b-b7d0-d67d16917096 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.758009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1943f38f-d8f0-447b-b7d0-d67d16917096 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.759084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1943f38f-d8f0-447b-b7d0-d67d16917096 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.765652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1943f38f-d8f0-447b-b7d0-d67d16917096 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:34.380385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-52e786c7-d4ef-4592-88ba-c29f2535099a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:34.394135 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-52e786c7-d4ef-4592-88ba-c29f2535099a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1516 microversion: 2.1 time: 1.079858 Jul 20 04:40:34.400379 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2203/4666] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:33 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1516 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:34.406238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-305f42fe-816e-4ba5-98d1-794450443120 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:34.409655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-305f42fe-816e-4ba5-98d1-794450443120 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:34.445004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-305f42fe-816e-4ba5-98d1-794450443120 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:34.445486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-305f42fe-816e-4ba5-98d1-794450443120 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:34.448514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-305f42fe-816e-4ba5-98d1-794450443120 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:34.450326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-305f42fe-816e-4ba5-98d1-794450443120 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:35.189237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-305f42fe-816e-4ba5-98d1-794450443120 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:35.200754 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-305f42fe-816e-4ba5-98d1-794450443120 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 200 len: 1372 microversion: 2.1 time: 0.798344 Jul 20 04:40:35.216649 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2204/4667] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:34 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 1372 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:35.233873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fee52f18-c9e4-4022-add8-0073640eada1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:35.240359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fee52f18-c9e4-4022-add8-0073640eada1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:35.270539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fee52f18-c9e4-4022-add8-0073640eada1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:35.279186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fee52f18-c9e4-4022-add8-0073640eada1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:35.280336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fee52f18-c9e4-4022-add8-0073640eada1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:35.287076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fee52f18-c9e4-4022-add8-0073640eada1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:35.750773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fee52f18-c9e4-4022-add8-0073640eada1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:35.759344 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fee52f18-c9e4-4022-add8-0073640eada1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1509 microversion: 2.1 time: 0.541257 Jul 20 04:40:35.760009 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2205/4668] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:35 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1509 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:35.783617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-31eb4173-fc17-4e5e-8185-1da5a337c3ea tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:35.784252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-31eb4173-fc17-4e5e-8185-1da5a337c3ea tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:35.807195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31eb4173-fc17-4e5e-8185-1da5a337c3ea tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:35.815601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31eb4173-fc17-4e5e-8185-1da5a337c3ea tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:35.818881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31eb4173-fc17-4e5e-8185-1da5a337c3ea tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:35.819360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31eb4173-fc17-4e5e-8185-1da5a337c3ea tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:35.984157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1943f38f-d8f0-447b-b7d0-d67d16917096 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:35.999112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1943f38f-d8f0-447b-b7d0-d67d16917096 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:36.007354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1943f38f-d8f0-447b-b7d0-d67d16917096 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:36.013749 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1943f38f-d8f0-447b-b7d0-d67d16917096 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1724 microversion: 2.20 time: 2.280719 Jul 20 04:40:36.028032 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2464/4669] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:33 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1724 bytes in 2296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:40:36.067590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-31eb4173-fc17-4e5e-8185-1da5a337c3ea tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:36.091633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-31eb4173-fc17-4e5e-8185-1da5a337c3ea tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:36.093525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-31eb4173-fc17-4e5e-8185-1da5a337c3ea tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:36.094788 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-31eb4173-fc17-4e5e-8185-1da5a337c3ea tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.333821 Jul 20 04:40:36.100618 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2206/4670] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:35 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:36.223416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a2be4760-4ac0-4f2d-8342-2fec69cfdfa8 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:36.224145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a2be4760-4ac0-4f2d-8342-2fec69cfdfa8 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:36.243633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:36.251107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2be4760-4ac0-4f2d-8342-2fec69cfdfa8 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:36.253597 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2be4760-4ac0-4f2d-8342-2fec69cfdfa8 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:36.254479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2be4760-4ac0-4f2d-8342-2fec69cfdfa8 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:36.275063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2be4760-4ac0-4f2d-8342-2fec69cfdfa8 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:36.780251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e2c392eb-d6f2-4aec-a07b-4adada0daf87 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:36.780251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e2c392eb-d6f2-4aec-a07b-4adada0daf87 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:36.797848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a2be4760-4ac0-4f2d-8342-2fec69cfdfa8 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:36.801566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2c392eb-d6f2-4aec-a07b-4adada0daf87 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:36.802007 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a2be4760-4ac0-4f2d-8342-2fec69cfdfa8 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 200 len: 1372 microversion: 2.1 time: 0.583747 Jul 20 04:40:36.802734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2c392eb-d6f2-4aec-a07b-4adada0daf87 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:36.803522 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2465/4671] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:36 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 1372 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:36.804802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2c392eb-d6f2-4aec-a07b-4adada0daf87 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:36.805421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2c392eb-d6f2-4aec-a07b-4adada0daf87 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.038569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4db565a7-88ff-48af-85b1-c3f70719a1c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:37.047600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4db565a7-88ff-48af-85b1-c3f70719a1c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:37.066299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4db565a7-88ff-48af-85b1-c3f70719a1c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.068783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4db565a7-88ff-48af-85b1-c3f70719a1c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.072391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4db565a7-88ff-48af-85b1-c3f70719a1c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.074796 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4db565a7-88ff-48af-85b1-c3f70719a1c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.180280 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e2c392eb-d6f2-4aec-a07b-4adada0daf87 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:37.215143 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e2c392eb-d6f2-4aec-a07b-4adada0daf87 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1509 microversion: 2.1 time: 0.441361 Jul 20 04:40:37.215795 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2207/4672] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:36 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1509 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:37.229687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-458c32b5-ec7d-4e28-9ad3-f4bef7c3f489 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:37.235489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-458c32b5-ec7d-4e28-9ad3-f4bef7c3f489 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:37.244326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-458c32b5-ec7d-4e28-9ad3-f4bef7c3f489 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.245090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-458c32b5-ec7d-4e28-9ad3-f4bef7c3f489 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.246354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-458c32b5-ec7d-4e28-9ad3-f4bef7c3f489 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.247016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-458c32b5-ec7d-4e28-9ad3-f4bef7c3f489 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.277196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:37.357260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-458c32b5-ec7d-4e28-9ad3-f4bef7c3f489 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:37.373443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-458c32b5-ec7d-4e28-9ad3-f4bef7c3f489 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:37.375166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-458c32b5-ec7d-4e28-9ad3-f4bef7c3f489 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:37.376464 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-458c32b5-ec7d-4e28-9ad3-f4bef7c3f489 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.154262 Jul 20 04:40:37.377058 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2208/4673] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:37 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:37.535386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9a89f960-a05d-42ae-bb1c-6677f0389183 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:37.537387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9a89f960-a05d-42ae-bb1c-6677f0389183 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:37.555912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a89f960-a05d-42ae-bb1c-6677f0389183 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.559956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a89f960-a05d-42ae-bb1c-6677f0389183 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.561994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a89f960-a05d-42ae-bb1c-6677f0389183 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.563576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a89f960-a05d-42ae-bb1c-6677f0389183 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.586263 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4db565a7-88ff-48af-85b1-c3f70719a1c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:37.595540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4db565a7-88ff-48af-85b1-c3f70719a1c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:37.605773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4db565a7-88ff-48af-85b1-c3f70719a1c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:37.612474 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4db565a7-88ff-48af-85b1-c3f70719a1c7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1724 microversion: 2.20 time: 0.583784 Jul 20 04:40:37.630150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-9a89f960-a05d-42ae-bb1c-6677f0389183 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lazy-loading 'flavor' on Instance uuid ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:40:37.638407 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2466/4674] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:37 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1724 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:37.812916 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9a89f960-a05d-42ae-bb1c-6677f0389183 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "POST /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9/action" status: 200 len: 32 microversion: 2.1 time: 0.284294 Jul 20 04:40:37.820509 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9596a611-d7b6-4e73-afb8-b629f3422998 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:37.821455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9596a611-d7b6-4e73-afb8-b629f3422998 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:37.832497 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2209/4675] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:37 2022] POST /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9/action => generated 32 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:40:37.840424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9596a611-d7b6-4e73-afb8-b629f3422998 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.840728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9596a611-d7b6-4e73-afb8-b629f3422998 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.841926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9596a611-d7b6-4e73-afb8-b629f3422998 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.842541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9596a611-d7b6-4e73-afb8-b629f3422998 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.852298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ab5706a1-c976-4113-9afc-4bdda3070a95 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:37.853098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ab5706a1-c976-4113-9afc-4bdda3070a95 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:37.870070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab5706a1-c976-4113-9afc-4bdda3070a95 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.875195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab5706a1-c976-4113-9afc-4bdda3070a95 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.876372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab5706a1-c976-4113-9afc-4bdda3070a95 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.876878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab5706a1-c976-4113-9afc-4bdda3070a95 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:38.263727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=10 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:38.360703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9596a611-d7b6-4e73-afb8-b629f3422998 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:38.382954 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9596a611-d7b6-4e73-afb8-b629f3422998 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 200 len: 1372 microversion: 2.1 time: 0.566624 Jul 20 04:40:38.383814 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2467/4676] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:37 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 1372 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:38.404411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-536dc7fb-be44-4668-94cf-8d7483a0e2ed tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:38.405605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-536dc7fb-be44-4668-94cf-8d7483a0e2ed tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:38.416207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-536dc7fb-be44-4668-94cf-8d7483a0e2ed tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:38.421041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-536dc7fb-be44-4668-94cf-8d7483a0e2ed tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:38.422278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-536dc7fb-be44-4668-94cf-8d7483a0e2ed tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:38.423357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-536dc7fb-be44-4668-94cf-8d7483a0e2ed tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:38.960172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ab5706a1-c976-4113-9afc-4bdda3070a95 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:38.970616 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ab5706a1-c976-4113-9afc-4bdda3070a95 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1522 microversion: 2.1 time: 1.133221 Jul 20 04:40:38.980145 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2210/4677] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:37 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1522 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:38.985687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9afb0502-65c6-477a-a7e0-3e913119e094 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:38.986322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9afb0502-65c6-477a-a7e0-3e913119e094 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:39.000510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9afb0502-65c6-477a-a7e0-3e913119e094 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.000971 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9afb0502-65c6-477a-a7e0-3e913119e094 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.001766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9afb0502-65c6-477a-a7e0-3e913119e094 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.002210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9afb0502-65c6-477a-a7e0-3e913119e094 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.016067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-536dc7fb-be44-4668-94cf-8d7483a0e2ed tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:39.027929 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-536dc7fb-be44-4668-94cf-8d7483a0e2ed tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1509 microversion: 2.1 time: 0.641967 Jul 20 04:40:39.030836 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2468/4678] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:38 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1509 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:39.048194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-66470b3c-7808-4807-8c60-7376e37313d6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:39.049071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-66470b3c-7808-4807-8c60-7376e37313d6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:39.057480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66470b3c-7808-4807-8c60-7376e37313d6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.058230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66470b3c-7808-4807-8c60-7376e37313d6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.059297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66470b3c-7808-4807-8c60-7376e37313d6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.059885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66470b3c-7808-4807-8c60-7376e37313d6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.250244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9afb0502-65c6-477a-a7e0-3e913119e094 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:39.262965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9afb0502-65c6-477a-a7e0-3e913119e094 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:39.275590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9afb0502-65c6-477a-a7e0-3e913119e094 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9c9a24493b4f2299dffb11b8addc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4689a1d17c764689be54e7506f1ab82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:39.277026 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9afb0502-65c6-477a-a7e0-3e913119e094 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 200 len: 1605 microversion: 2.42 time: 0.303463 Jul 20 04:40:39.277646 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2211/4679] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:38 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 1605 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:39.403472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-164fd36f-6b44-4493-ae5f-e67f1b8dc374 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:39.404109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-164fd36f-6b44-4493-ae5f-e67f1b8dc374 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:39.417524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-164fd36f-6b44-4493-ae5f-e67f1b8dc374 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.417984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-164fd36f-6b44-4493-ae5f-e67f1b8dc374 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.418777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-164fd36f-6b44-4493-ae5f-e67f1b8dc374 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.419216 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-164fd36f-6b44-4493-ae5f-e67f1b8dc374 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.539000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-66470b3c-7808-4807-8c60-7376e37313d6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:39.557174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-66470b3c-7808-4807-8c60-7376e37313d6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:39.564597 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-66470b3c-7808-4807-8c60-7376e37313d6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:39.567281 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-66470b3c-7808-4807-8c60-7376e37313d6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1724 microversion: 2.20 time: 0.534714 Jul 20 04:40:39.568110 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2469/4680] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:39 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1724 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:39.851969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-164fd36f-6b44-4493-ae5f-e67f1b8dc374 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:39.866188 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-164fd36f-6b44-4493-ae5f-e67f1b8dc374 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 200 len: 1372 microversion: 2.1 time: 0.464972 Jul 20 04:40:39.867842 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2212/4681] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:39 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 1372 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:39.987784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-eb77e087-17f1-465c-a453-165adb2082e9 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:39.989904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-eb77e087-17f1-465c-a453-165adb2082e9 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:40.003805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb77e087-17f1-465c-a453-165adb2082e9 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.009974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb77e087-17f1-465c-a453-165adb2082e9 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.011075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb77e087-17f1-465c-a453-165adb2082e9 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.011676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb77e087-17f1-465c-a453-165adb2082e9 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.047295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d376d6ee-f209-4391-840e-2f8cdce3527f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:40.048562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d376d6ee-f209-4391-840e-2f8cdce3527f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:40.063979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d376d6ee-f209-4391-840e-2f8cdce3527f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.073060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d376d6ee-f209-4391-840e-2f8cdce3527f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.074367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d376d6ee-f209-4391-840e-2f8cdce3527f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.074963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d376d6ee-f209-4391-840e-2f8cdce3527f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.388009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d376d6ee-f209-4391-840e-2f8cdce3527f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:40.404920 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d376d6ee-f209-4391-840e-2f8cdce3527f tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1506 microversion: 2.1 time: 0.361598 Jul 20 04:40:40.405523 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2213/4682] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:40 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:40.410396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-81cc4adf-1877-40ed-b9f6-aa2f1841f7f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:40.411253 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-81cc4adf-1877-40ed-b9f6-aa2f1841f7f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:40.423844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81cc4adf-1877-40ed-b9f6-aa2f1841f7f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.425094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81cc4adf-1877-40ed-b9f6-aa2f1841f7f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.437730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81cc4adf-1877-40ed-b9f6-aa2f1841f7f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.438349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81cc4adf-1877-40ed-b9f6-aa2f1841f7f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.460609 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-81cc4adf-1877-40ed-b9f6-aa2f1841f7f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] HTTP exception thrown: Instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 could not be found. Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-81cc4adf-1877-40ed-b9f6-aa2f1841f7f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Request method failure captured: Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 HTTP/1.1 Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14Vw2uvclx2O0SqFT7tFRJbgprLsib1l1JsithoH4MgVfA-1DTVaGIjyCBgimECTzIUQub5Vjp_sZ26wMlyxUvy_lL8-Oj2J9eQXak36Q81v61gkOOD23yY7-weLOpnNsAWUc6WZh2EFsAZ7hxVfK_mNkYh8e1u6SI9jGudXTSKIEIo Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.42 Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4689a1d17c764689be54e7506f1ab82f Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1008208137 Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4689a1d17c764689be54e7506f1ab82f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4689a1d17c764689be54e7506f1ab82f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4689a1d17c764689be54e7506f1ab82f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4689a1d17c764689be54e7506f1ab82f"}]}] Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1008208137 Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4689a1d17c764689be54e7506f1ab82f Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1008208137 Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TaggedBootDevicesTest_v242-1008208137-project Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 9d9c9a24493b4f2299dffb11b8addc4d Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1008208137-project Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 could not be found. Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'cc1acb3e-cd4c-47c9-893f-30d20e98b869'} Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 could not be found. Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 could not be found. Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:40.462894 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:40.467539 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:40.467539 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:40.467539 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:40.467539 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:40.467539 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:40.467539 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:40.467539 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 could not be found. Jul 20 04:40:40.467539 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:40.473161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-81cc4adf-1877-40ed-b9f6-aa2f1841f7f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Returning 404 to user: Instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:40.474354 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-81cc4adf-1877-40ed-b9f6-aa2f1841f7f3 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 404 len: 111 microversion: 2.42 time: 0.067661 Jul 20 04:40:40.476410 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2214/4683] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:40 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:40:40.483459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f4593eb7-02c0-4d79-9021-1504acc61a5a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '.version_select at 0x7f06be0de0d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:40.510865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-eb77e087-17f1-465c-a453-165adb2082e9 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:40.514802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:40.524393 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f4593eb7-02c0-4d79-9021-1504acc61a5a tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488040510" status: 204 len: 0 microversion: 2.42 time: 0.044459 Jul 20 04:40:40.526734 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2215/4684] 10.222.0.17 () {60 vars in 1261 bytes} [Wed Jul 20 04:40:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488040510 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:40:40.542488 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-eb77e087-17f1-465c-a453-165adb2082e9 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1522 microversion: 2.1 time: 0.555789 Jul 20 04:40:40.552801 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2470/4685] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:39 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1522 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:40.586827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-56a5d272-2120-4ed4-8015-ca8b08d66907 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:40.587459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-56a5d272-2120-4ed4-8015-ca8b08d66907 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:40.603931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56a5d272-2120-4ed4-8015-ca8b08d66907 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.604412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56a5d272-2120-4ed4-8015-ca8b08d66907 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.605218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56a5d272-2120-4ed4-8015-ca8b08d66907 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.605649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56a5d272-2120-4ed4-8015-ca8b08d66907 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.887196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-59c89e1e-365d-42ff-8f7c-d3f10e3409b1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:40.888423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-59c89e1e-365d-42ff-8f7c-d3f10e3409b1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:40.904926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59c89e1e-365d-42ff-8f7c-d3f10e3409b1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.905387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59c89e1e-365d-42ff-8f7c-d3f10e3409b1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.906199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59c89e1e-365d-42ff-8f7c-d3f10e3409b1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.906642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59c89e1e-365d-42ff-8f7c-d3f10e3409b1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:41.061245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-56a5d272-2120-4ed4-8015-ca8b08d66907 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:41.074697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-56a5d272-2120-4ed4-8015-ca8b08d66907 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:41.081554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-56a5d272-2120-4ed4-8015-ca8b08d66907 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:41.082766 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-56a5d272-2120-4ed4-8015-ca8b08d66907 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1745 microversion: 2.20 time: 0.501091 Jul 20 04:40:41.107853 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2216/4686] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:40 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1745 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:41.377732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-1cec4149-4916-4d8d-bfa6-d38b9b775bfe req-8165ef68-726b-44f7-a661-bb62c96ad9ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99", "name": "network-vif-plugged", "status": "completed", "tag": "3f833ad4-3bc9-46b1-8894-6763e4cd4d05"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:41.396542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-1cec4149-4916-4d8d-bfa6-d38b9b775bfe req-8165ef68-726b-44f7-a661-bb62c96ad9ce service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:41.396991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-1cec4149-4916-4d8d-bfa6-d38b9b775bfe req-8165ef68-726b-44f7-a661-bb62c96ad9ce service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:41.437415 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-1cec4149-4916-4d8d-bfa6-d38b9b775bfe req-8165ef68-726b-44f7-a661-bb62c96ad9ce service nova] Creating event network-vif-plugged:3f833ad4-3bc9-46b1-8894-6763e4cd4d05 for instance 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 on n-h1-826526-5 Jul 20 04:40:41.457274 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-1cec4149-4916-4d8d-bfa6-d38b9b775bfe req-8165ef68-726b-44f7-a661-bb62c96ad9ce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.339043 Jul 20 04:40:41.460633 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2217/4687] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:41.484841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4a45ef26-af96-44e9-8836-560ada18e05e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:41.485749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4a45ef26-af96-44e9-8836-560ada18e05e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:41.502960 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a45ef26-af96-44e9-8836-560ada18e05e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:41.503445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a45ef26-af96-44e9-8836-560ada18e05e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:41.504249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a45ef26-af96-44e9-8836-560ada18e05e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:41.506983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a45ef26-af96-44e9-8836-560ada18e05e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:41.542992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-59c89e1e-365d-42ff-8f7c-d3f10e3409b1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:41.574585 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-59c89e1e-365d-42ff-8f7c-d3f10e3409b1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 200 len: 1372 microversion: 2.1 time: 0.691793 Jul 20 04:40:41.579060 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2471/4688] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:40 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 1372 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:41.594822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5880b0c6-5230-4ac0-9f58-687180b125ba tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:41.595679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5880b0c6-5230-4ac0-9f58-687180b125ba tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:41.616519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5880b0c6-5230-4ac0-9f58-687180b125ba tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:41.618826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5880b0c6-5230-4ac0-9f58-687180b125ba tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:41.620247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5880b0c6-5230-4ac0-9f58-687180b125ba tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:41.624005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5880b0c6-5230-4ac0-9f58-687180b125ba tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:42.269523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5880b0c6-5230-4ac0-9f58-687180b125ba tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:42.282042 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5880b0c6-5230-4ac0-9f58-687180b125ba tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1522 microversion: 2.1 time: 0.701750 Jul 20 04:40:42.291624 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2472/4689] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:41 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1522 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:42.632083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9a576249-deff-4793-b911-d5d91b962188 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:42.632834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9a576249-deff-4793-b911-d5d91b962188 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:42.640237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a576249-deff-4793-b911-d5d91b962188 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:42.640723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a576249-deff-4793-b911-d5d91b962188 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:42.641526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a576249-deff-4793-b911-d5d91b962188 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:42.641981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a576249-deff-4793-b911-d5d91b962188 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:42.657498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4a45ef26-af96-44e9-8836-560ada18e05e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:42.666332 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4a45ef26-af96-44e9-8836-560ada18e05e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1506 microversion: 2.1 time: 1.203659 Jul 20 04:40:42.667681 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2218/4690] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:41 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1506 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:42.674765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-71cad52f-aeca-4860-ba6d-5fa853ab2185 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:42.675785 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-71cad52f-aeca-4860-ba6d-5fa853ab2185 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:42.683105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71cad52f-aeca-4860-ba6d-5fa853ab2185 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:42.684869 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71cad52f-aeca-4860-ba6d-5fa853ab2185 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:42.686017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71cad52f-aeca-4860-ba6d-5fa853ab2185 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:42.686790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71cad52f-aeca-4860-ba6d-5fa853ab2185 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:42.916805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-71cad52f-aeca-4860-ba6d-5fa853ab2185 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:42.928476 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-71cad52f-aeca-4860-ba6d-5fa853ab2185 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 200 len: 1372 microversion: 2.1 time: 0.258928 Jul 20 04:40:42.929511 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2219/4691] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:42 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 1372 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:43.312750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-776a3c13-a059-4a28-8bfd-50e1cde7dc69 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:43.314175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-776a3c13-a059-4a28-8bfd-50e1cde7dc69 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:43.324577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-776a3c13-a059-4a28-8bfd-50e1cde7dc69 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:43.325046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-776a3c13-a059-4a28-8bfd-50e1cde7dc69 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:43.326294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-776a3c13-a059-4a28-8bfd-50e1cde7dc69 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:43.327292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-776a3c13-a059-4a28-8bfd-50e1cde7dc69 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:43.589893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-776a3c13-a059-4a28-8bfd-50e1cde7dc69 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:43.603463 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-776a3c13-a059-4a28-8bfd-50e1cde7dc69 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1522 microversion: 2.1 time: 0.306697 Jul 20 04:40:43.604584 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2220/4692] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:43 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:43.611234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-188fc4d7-f702-489c-be2e-8a44be149f33 req-8c0c003f-d929-4dc3-9d15-e384dced0ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99542ac6-6ecb-4e86-9645-9c2b5dbadf5c", "name": "network-vif-unplugged", "status": "completed", "tag": "d41ade7e-d3ba-4a3c-bd8d-16200a60e5d8"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:43.620924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-188fc4d7-f702-489c-be2e-8a44be149f33 req-8c0c003f-d929-4dc3-9d15-e384dced0ef3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:43.621744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-188fc4d7-f702-489c-be2e-8a44be149f33 req-8c0c003f-d929-4dc3-9d15-e384dced0ef3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:43.639720 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-188fc4d7-f702-489c-be2e-8a44be149f33 req-8c0c003f-d929-4dc3-9d15-e384dced0ef3 service nova] Creating event network-vif-unplugged:d41ade7e-d3ba-4a3c-bd8d-16200a60e5d8 for instance 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c on n-h1-826526-5 Jul 20 04:40:43.648711 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-188fc4d7-f702-489c-be2e-8a44be149f33 req-8c0c003f-d929-4dc3-9d15-e384dced0ef3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041464 Jul 20 04:40:43.651104 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2221/4693] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:43.687205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-81d6e69c-0b16-440c-9390-961bd221bf76 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:43.688854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-81d6e69c-0b16-440c-9390-961bd221bf76 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:43.699387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81d6e69c-0b16-440c-9390-961bd221bf76 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:43.700773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81d6e69c-0b16-440c-9390-961bd221bf76 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:43.702995 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81d6e69c-0b16-440c-9390-961bd221bf76 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:43.703705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81d6e69c-0b16-440c-9390-961bd221bf76 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:43.766876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9a576249-deff-4793-b911-d5d91b962188 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:43.792873 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9a576249-deff-4793-b911-d5d91b962188 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:43.797518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9a576249-deff-4793-b911-d5d91b962188 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:43.801928 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9a576249-deff-4793-b911-d5d91b962188 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1745 microversion: 2.20 time: 1.515671 Jul 20 04:40:43.803057 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2473/4694] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:42 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1745 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:43.946540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6d7641bc-6901-416a-a47e-bca0f66a28e9 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:43.947733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6d7641bc-6901-416a-a47e-bca0f66a28e9 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:43.958846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d7641bc-6901-416a-a47e-bca0f66a28e9 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:43.962496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d7641bc-6901-416a-a47e-bca0f66a28e9 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:43.967563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d7641bc-6901-416a-a47e-bca0f66a28e9 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:43.971818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d7641bc-6901-416a-a47e-bca0f66a28e9 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:43.999150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-81d6e69c-0b16-440c-9390-961bd221bf76 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:44.008031 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-81d6e69c-0b16-440c-9390-961bd221bf76 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 200 len: 1509 microversion: 2.1 time: 0.328610 Jul 20 04:40:44.008675 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2222/4695] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:43 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:44.025260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d627c567-3037-4a99-a1a8-394379e8ef4c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:44.027722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d627c567-3037-4a99-a1a8-394379e8ef4c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:44.041304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d627c567-3037-4a99-a1a8-394379e8ef4c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:44.046133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d627c567-3037-4a99-a1a8-394379e8ef4c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:44.047462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d627c567-3037-4a99-a1a8-394379e8ef4c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:44.048433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d627c567-3037-4a99-a1a8-394379e8ef4c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:44.442187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d627c567-3037-4a99-a1a8-394379e8ef4c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:44.471707 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d627c567-3037-4a99-a1a8-394379e8ef4c tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.451082 Jul 20 04:40:44.478175 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2223/4696] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:44 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:44.503184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d27d96f8-7c60-4938-ae0e-aa2262a13e2a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:44.503788 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d27d96f8-7c60-4938-ae0e-aa2262a13e2a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:44.512782 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d27d96f8-7c60-4938-ae0e-aa2262a13e2a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:44.513970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d27d96f8-7c60-4938-ae0e-aa2262a13e2a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:44.516141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d27d96f8-7c60-4938-ae0e-aa2262a13e2a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:44.516851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d27d96f8-7c60-4938-ae0e-aa2262a13e2a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.062771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6d7641bc-6901-416a-a47e-bca0f66a28e9 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:45.081236 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6d7641bc-6901-416a-a47e-bca0f66a28e9 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 200 len: 1372 microversion: 2.1 time: 1.138504 Jul 20 04:40:45.095845 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2474/4697] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:43 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 1372 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:45.108611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3370d0dc-b9de-477c-adae-5c30d6f4c3dc tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:45.122798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3370d0dc-b9de-477c-adae-5c30d6f4c3dc tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:45.143154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3370d0dc-b9de-477c-adae-5c30d6f4c3dc tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.145309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3370d0dc-b9de-477c-adae-5c30d6f4c3dc tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.146175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d27d96f8-7c60-4938-ae0e-aa2262a13e2a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:45.147589 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3370d0dc-b9de-477c-adae-5c30d6f4c3dc tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.155868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3370d0dc-b9de-477c-adae-5c30d6f4c3dc tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.178044 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d27d96f8-7c60-4938-ae0e-aa2262a13e2a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.672828 Jul 20 04:40:45.195682 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2224/4698] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:44 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:45.204768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cfba2854-18b1-4e21-a8d2-3fe7486fa5f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:45.208217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cfba2854-18b1-4e21-a8d2-3fe7486fa5f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:45.227349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cfba2854-18b1-4e21-a8d2-3fe7486fa5f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.231386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cfba2854-18b1-4e21-a8d2-3fe7486fa5f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.237981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cfba2854-18b1-4e21-a8d2-3fe7486fa5f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.242127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cfba2854-18b1-4e21-a8d2-3fe7486fa5f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.526010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3370d0dc-b9de-477c-adae-5c30d6f4c3dc tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:45.538584 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3370d0dc-b9de-477c-adae-5c30d6f4c3dc tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1522 microversion: 2.1 time: 0.441263 Jul 20 04:40:45.550024 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2475/4699] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:45 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:45.574712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-77d7e258-af6f-4c8a-a3d0-9f809e1d3f18 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:45.575755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-77d7e258-af6f-4c8a-a3d0-9f809e1d3f18 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:45.597324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-77d7e258-af6f-4c8a-a3d0-9f809e1d3f18 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.598034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-77d7e258-af6f-4c8a-a3d0-9f809e1d3f18 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.599075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-77d7e258-af6f-4c8a-a3d0-9f809e1d3f18 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.601331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-77d7e258-af6f-4c8a-a3d0-9f809e1d3f18 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.910632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-77d7e258-af6f-4c8a-a3d0-9f809e1d3f18 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:45.922161 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-77d7e258-af6f-4c8a-a3d0-9f809e1d3f18 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.357720 Jul 20 04:40:45.927151 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2476/4700] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:45 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:45.944166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c378d151-3f07-4769-8adf-3d504dfb6914 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:45.944928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c378d151-3f07-4769-8adf-3d504dfb6914 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:45.969310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c378d151-3f07-4769-8adf-3d504dfb6914 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.970118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c378d151-3f07-4769-8adf-3d504dfb6914 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.973014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c378d151-3f07-4769-8adf-3d504dfb6914 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.973829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c378d151-3f07-4769-8adf-3d504dfb6914 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:46.481521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c378d151-3f07-4769-8adf-3d504dfb6914 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:46.504129 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c378d151-3f07-4769-8adf-3d504dfb6914 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.566878 Jul 20 04:40:46.505216 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2477/4701] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:45 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:46.521668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-c0c6bdfd-a23a-49d0-8d05-a6dc46eb4b72 req-0e38b165-7293-4a74-9990-b75c59b6b1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7e62d3-1b07-483d-9943-887c096d4350", "name": "network-vif-plugged", "status": "completed", "tag": "f03b37b1-bac2-405f-aeda-863d4b123005"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:46.547526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c0c6bdfd-a23a-49d0-8d05-a6dc46eb4b72 req-0e38b165-7293-4a74-9990-b75c59b6b1e2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:46.551184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c0c6bdfd-a23a-49d0-8d05-a6dc46eb4b72 req-0e38b165-7293-4a74-9990-b75c59b6b1e2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:46.586357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cfba2854-18b1-4e21-a8d2-3fe7486fa5f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:46.600696 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-c0c6bdfd-a23a-49d0-8d05-a6dc46eb4b72 req-0e38b165-7293-4a74-9990-b75c59b6b1e2 service nova] Creating event network-vif-plugged:f03b37b1-bac2-405f-aeda-863d4b123005 for instance 7c7e62d3-1b07-483d-9943-887c096d4350 on n-h1-826526-5 Jul 20 04:40:46.601916 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cfba2854-18b1-4e21-a8d2-3fe7486fa5f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:46.610643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cfba2854-18b1-4e21-a8d2-3fe7486fa5f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:46.614846 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cfba2854-18b1-4e21-a8d2-3fe7486fa5f3 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1740 microversion: 2.20 time: 1.416501 Jul 20 04:40:46.629766 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2225/4702] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:45 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1740 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:46.643619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9cbb1b47-05a0-443f-a96f-63a4dcf7339a tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:46.648006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9cbb1b47-05a0-443f-a96f-63a4dcf7339a tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:46.665618 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-c0c6bdfd-a23a-49d0-8d05-a6dc46eb4b72 req-0e38b165-7293-4a74-9990-b75c59b6b1e2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155866 Jul 20 04:40:46.671358 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2478/4703] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:46.673394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cbb1b47-05a0-443f-a96f-63a4dcf7339a tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:46.674148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cbb1b47-05a0-443f-a96f-63a4dcf7339a tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:46.675933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cbb1b47-05a0-443f-a96f-63a4dcf7339a tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:46.678021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cbb1b47-05a0-443f-a96f-63a4dcf7339a tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:46.688937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-750bbfc6-b3fb-4d9f-ba35-c58a1d46330e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:46.707879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-750bbfc6-b3fb-4d9f-ba35-c58a1d46330e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:46.712840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-750bbfc6-b3fb-4d9f-ba35-c58a1d46330e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:46.748803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:46.761899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-750bbfc6-b3fb-4d9f-ba35-c58a1d46330e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Going to try to stop instance {{(pid=127871) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:40:46.830180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:46.869996 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-750bbfc6-b3fb-4d9f-ba35-c58a1d46330e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 202 len: 0 microversion: 2.1 time: 0.191160 Jul 20 04:40:46.871407 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2479/4704] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:46 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:40:46.879489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9e9318b2-4443-4b3c-94c8-8b8cebd2d254 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:46.880421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9e9318b2-4443-4b3c-94c8-8b8cebd2d254 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:46.889908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e9318b2-4443-4b3c-94c8-8b8cebd2d254 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:46.890945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e9318b2-4443-4b3c-94c8-8b8cebd2d254 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:46.892493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e9318b2-4443-4b3c-94c8-8b8cebd2d254 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:46.893543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e9318b2-4443-4b3c-94c8-8b8cebd2d254 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:47.867345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9e9318b2-4443-4b3c-94c8-8b8cebd2d254 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:47.879118 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9e9318b2-4443-4b3c-94c8-8b8cebd2d254 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1522 microversion: 2.1 time: 1.002972 Jul 20 04:40:47.882631 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2480/4705] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:46 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1522 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:47.928041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0dfd968a-e55f-41c2-b0ce-c46b33f4c906 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:47.931838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0dfd968a-e55f-41c2-b0ce-c46b33f4c906 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:47.969137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0dfd968a-e55f-41c2-b0ce-c46b33f4c906 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:47.970510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0dfd968a-e55f-41c2-b0ce-c46b33f4c906 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:47.973234 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0dfd968a-e55f-41c2-b0ce-c46b33f4c906 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:47.975718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0dfd968a-e55f-41c2-b0ce-c46b33f4c906 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:48.187455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9cbb1b47-05a0-443f-a96f-63a4dcf7339a tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:48.232779 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9cbb1b47-05a0-443f-a96f-63a4dcf7339a tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 200 len: 1545 microversion: 2.1 time: 1.572385 Jul 20 04:40:48.236438 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2226/4706] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:46 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 1545 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:48.270406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d906c981-c91e-45b4-8ab4-91c6e1e764ef tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:48.270593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d906c981-c91e-45b4-8ab4-91c6e1e764ef tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:48.307289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d906c981-c91e-45b4-8ab4-91c6e1e764ef tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:48.308863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d906c981-c91e-45b4-8ab4-91c6e1e764ef tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:48.327197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d906c981-c91e-45b4-8ab4-91c6e1e764ef tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:48.328550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d906c981-c91e-45b4-8ab4-91c6e1e764ef tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:48.866090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0dfd968a-e55f-41c2-b0ce-c46b33f4c906 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:48.876545 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0dfd968a-e55f-41c2-b0ce-c46b33f4c906 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1679 microversion: 2.1 time: 0.976390 Jul 20 04:40:48.903448 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2481/4707] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:47 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1679 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:48.942145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d906c981-c91e-45b4-8ab4-91c6e1e764ef tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:48.944187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-775d1242-d786-403a-b151-833e1393e76c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:48.955149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-775d1242-d786-403a-b151-833e1393e76c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:48.969007 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-775d1242-d786-403a-b151-833e1393e76c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:48.969471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-775d1242-d786-403a-b151-833e1393e76c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:48.970330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-775d1242-d786-403a-b151-833e1393e76c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:48.977373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-775d1242-d786-403a-b151-833e1393e76c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:48.994596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d906c981-c91e-45b4-8ab4-91c6e1e764ef tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:48.998887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d906c981-c91e-45b4-8ab4-91c6e1e764ef tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:49.000563 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d906c981-c91e-45b4-8ab4-91c6e1e764ef tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1740 microversion: 2.20 time: 0.738235 Jul 20 04:40:49.013095 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2227/4708] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:48 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1740 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:49.028984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3b56cdaf-cc18-4563-ae02-e7ccd021915e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:49.034197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3b56cdaf-cc18-4563-ae02-e7ccd021915e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:49.055263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b56cdaf-cc18-4563-ae02-e7ccd021915e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.056748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b56cdaf-cc18-4563-ae02-e7ccd021915e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.057970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b56cdaf-cc18-4563-ae02-e7ccd021915e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.060494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b56cdaf-cc18-4563-ae02-e7ccd021915e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:50.299254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3b56cdaf-cc18-4563-ae02-e7ccd021915e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:50.325599 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3b56cdaf-cc18-4563-ae02-e7ccd021915e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1522 microversion: 2.1 time: 1.308944 Jul 20 04:40:50.329795 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2228/4709] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:49 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1522 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:50.341190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-49cba77d-a52a-4458-87e0-a145f0d8338a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:50.350612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-49cba77d-a52a-4458-87e0-a145f0d8338a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:50.481518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49cba77d-a52a-4458-87e0-a145f0d8338a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:50.481518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49cba77d-a52a-4458-87e0-a145f0d8338a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:50.481518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49cba77d-a52a-4458-87e0-a145f0d8338a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:50.481518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49cba77d-a52a-4458-87e0-a145f0d8338a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:50.671769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-775d1242-d786-403a-b151-833e1393e76c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:50.691860 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-775d1242-d786-403a-b151-833e1393e76c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 200 len: 1545 microversion: 2.1 time: 1.787084 Jul 20 04:40:50.697104 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2482/4710] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:48 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 1545 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:50.703948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-195fdcd6-8872-4924-a4b3-0861e060c2c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:50.717296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-195fdcd6-8872-4924-a4b3-0861e060c2c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:50.747116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-195fdcd6-8872-4924-a4b3-0861e060c2c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:50.748014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-195fdcd6-8872-4924-a4b3-0861e060c2c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:50.749141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-195fdcd6-8872-4924-a4b3-0861e060c2c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:50.749727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-195fdcd6-8872-4924-a4b3-0861e060c2c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:51.075862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-49cba77d-a52a-4458-87e0-a145f0d8338a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:51.085943 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-49cba77d-a52a-4458-87e0-a145f0d8338a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1679 microversion: 2.1 time: 0.753491 Jul 20 04:40:51.102711 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2229/4711] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:50 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1679 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:51.348078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-656d86fa-47e7-463f-acb3-9a539ac49eec tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:51.348900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-656d86fa-47e7-463f-acb3-9a539ac49eec tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:51.356709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-656d86fa-47e7-463f-acb3-9a539ac49eec tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:51.360154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-656d86fa-47e7-463f-acb3-9a539ac49eec tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:51.361617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-656d86fa-47e7-463f-acb3-9a539ac49eec tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:51.364761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-656d86fa-47e7-463f-acb3-9a539ac49eec tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:52.555190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-195fdcd6-8872-4924-a4b3-0861e060c2c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:52.572622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-195fdcd6-8872-4924-a4b3-0861e060c2c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:52.578567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-195fdcd6-8872-4924-a4b3-0861e060c2c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:52.581577 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-195fdcd6-8872-4924-a4b3-0861e060c2c4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1740 microversion: 2.20 time: 1.883631 Jul 20 04:40:52.591769 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2483/4712] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:50 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1740 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:52.620814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-753e2e46-a079-4117-b695-09320f783b4d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:52.641818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-753e2e46-a079-4117-b695-09320f783b4d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:52.665431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-753e2e46-a079-4117-b695-09320f783b4d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:52.666733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-753e2e46-a079-4117-b695-09320f783b4d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:52.669059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-753e2e46-a079-4117-b695-09320f783b4d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:52.671403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-753e2e46-a079-4117-b695-09320f783b4d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:52.700662 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-656d86fa-47e7-463f-acb3-9a539ac49eec tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:52.708631 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-656d86fa-47e7-463f-acb3-9a539ac49eec tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1522 microversion: 2.1 time: 1.364467 Jul 20 04:40:52.724668 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2230/4713] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:51 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1522 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:52.881086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-92dc0dbd-076c-4198-bf31-ee4c29bde1e2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1781611777", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "ce8588a8-909f-427c-8787-8e1ca031786d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1236622447", "security_groups": [{"name": "tempest-secgroup-smoke-458593858"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:53.222756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-92dc0dbd-076c-4198-bf31-ee4c29bde1e2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] validate_networks() for [('ce8588a8-909f-427c-8787-8e1ca031786d', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:40:53.745745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-753e2e46-a079-4117-b695-09320f783b4d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:53.760520 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-753e2e46-a079-4117-b695-09320f783b4d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1679 microversion: 2.1 time: 1.163202 Jul 20 04:40:53.763693 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2484/4714] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:52 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1679 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:53.783712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-efa1f0ea-f4a1-4893-9b49-26cf7372e615 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:53.784963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-efa1f0ea-f4a1-4893-9b49-26cf7372e615 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:53.798239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-efa1f0ea-f4a1-4893-9b49-26cf7372e615 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:53.800829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-efa1f0ea-f4a1-4893-9b49-26cf7372e615 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:53.801947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-efa1f0ea-f4a1-4893-9b49-26cf7372e615 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:53.804208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-efa1f0ea-f4a1-4893-9b49-26cf7372e615 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.365197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-92dc0dbd-076c-4198-bf31-ee4c29bde1e2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:40:54.366205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-92dc0dbd-076c-4198-bf31-ee4c29bde1e2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:40:54.366849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-92dc0dbd-076c-4198-bf31-ee4c29bde1e2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:40:54.367426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-92dc0dbd-076c-4198-bf31-ee4c29bde1e2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:40:54.368021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-92dc0dbd-076c-4198-bf31-ee4c29bde1e2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:40:54.387023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92dc0dbd-076c-4198-bf31-ee4c29bde1e2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.392678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92dc0dbd-076c-4198-bf31-ee4c29bde1e2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.398645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92dc0dbd-076c-4198-bf31-ee4c29bde1e2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.399464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92dc0dbd-076c-4198-bf31-ee4c29bde1e2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.440235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-efa1f0ea-f4a1-4893-9b49-26cf7372e615 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:54.455500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-efa1f0ea-f4a1-4893-9b49-26cf7372e615 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:54.460247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-efa1f0ea-f4a1-4893-9b49-26cf7372e615 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:54.461691 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-efa1f0ea-f4a1-4893-9b49-26cf7372e615 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1740 microversion: 2.20 time: 0.696626 Jul 20 04:40:54.475628 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2485/4715] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:53 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1740 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:54.481331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-57432f05-d7c8-4efc-8f14-0a7d1bd862ed tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:54.482307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-57432f05-d7c8-4efc-8f14-0a7d1bd862ed tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:54.484028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-92dc0dbd-076c-4198-bf31-ee4c29bde1e2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Getting quotas for project a678d19d82d248958a3d7df804ccfa95. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:40:54.489710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57432f05-d7c8-4efc-8f14-0a7d1bd862ed tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.490523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57432f05-d7c8-4efc-8f14-0a7d1bd862ed tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.491524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57432f05-d7c8-4efc-8f14-0a7d1bd862ed tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.492177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-57432f05-d7c8-4efc-8f14-0a7d1bd862ed tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.507468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-92dc0dbd-076c-4198-bf31-ee4c29bde1e2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Getting quotas for user cffe347e0a094346afd74f178a0fde5d and project a678d19d82d248958a3d7df804ccfa95. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:40:54.543394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-92dc0dbd-076c-4198-bf31-ee4c29bde1e2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:40:54.551069 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-92dc0dbd-076c-4198-bf31-ee4c29bde1e2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:40:54.703047 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-92dc0dbd-076c-4198-bf31-ee4c29bde1e2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.825765 Jul 20 04:40:54.703732 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2231/4716] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:40:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:40:54.729866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d9d4214c-9fe9-4526-a55e-90b90de9f424 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:54.730394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d9d4214c-9fe9-4526-a55e-90b90de9f424 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:54.760679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9d4214c-9fe9-4526-a55e-90b90de9f424 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.761677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9d4214c-9fe9-4526-a55e-90b90de9f424 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.762799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9d4214c-9fe9-4526-a55e-90b90de9f424 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.763497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9d4214c-9fe9-4526-a55e-90b90de9f424 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.793282 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-d9d4214c-9fe9-4526-a55e-90b90de9f424 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] HTTP exception thrown: Instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 could not be found. Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d9d4214c-9fe9-4526-a55e-90b90de9f424 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Request method failure captured: Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 HTTP/1.1 Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14Vw2uvclx2O0SqFT7tFRJbgprLsib1l1JsithoH4MgVfA-1DTVaGIjyCBgimECTzIUQub5Vjp_sZ26wMlyxUvy_lL8-Oj2J9eQXak36Q81v61gkOOD23yY7-weLOpnNsAWUc6WZh2EFsAZ7hxVfK_mNkYh8e1u6SI9jGudXTSKIEIo Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.42 Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4689a1d17c764689be54e7506f1ab82f Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1008208137 Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4689a1d17c764689be54e7506f1ab82f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4689a1d17c764689be54e7506f1ab82f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4689a1d17c764689be54e7506f1ab82f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4689a1d17c764689be54e7506f1ab82f"}]}] Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1008208137 Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4689a1d17c764689be54e7506f1ab82f Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1008208137 Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TaggedBootDevicesTest_v242-1008208137-project Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 9d9c9a24493b4f2299dffb11b8addc4d Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1008208137-project Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 could not be found. Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'cc1acb3e-cd4c-47c9-893f-30d20e98b869'} Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 could not be found. Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:54.798312 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:54.802298 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 could not be found. Jul 20 04:40:54.802298 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:54.802298 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:54.802298 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:54.802298 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:54.802298 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:54.802298 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:54.802298 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:54.802298 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:54.802298 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 could not be found. Jul 20 04:40:54.802298 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:54.813224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d9d4214c-9fe9-4526-a55e-90b90de9f424 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Returning 404 to user: Instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:54.814546 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d9d4214c-9fe9-4526-a55e-90b90de9f424 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 404 len: 111 microversion: 2.42 time: 0.109860 Jul 20 04:40:54.815949 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2232/4717] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:40:54 2022] DELETE /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:40:54.827120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1a72022b-4f31-45ca-9112-a395de795edb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:54.828169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1a72022b-4f31-45ca-9112-a395de795edb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:55.228546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-57432f05-d7c8-4efc-8f14-0a7d1bd862ed tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:55.251820 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-57432f05-d7c8-4efc-8f14-0a7d1bd862ed tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1502 microversion: 2.1 time: 0.774477 Jul 20 04:40:55.260941 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2486/4718] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:54 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1502 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:55.286530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d2686665-a71e-4034-a334-104a743937c0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:55.287190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d2686665-a71e-4034-a334-104a743937c0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:55.314277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2686665-a71e-4034-a334-104a743937c0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.325138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2686665-a71e-4034-a334-104a743937c0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.330395 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2686665-a71e-4034-a334-104a743937c0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.333996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2686665-a71e-4034-a334-104a743937c0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.431907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1a72022b-4f31-45ca-9112-a395de795edb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:55.451201 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1a72022b-4f31-45ca-9112-a395de795edb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1267 microversion: 2.1 time: 0.633754 Jul 20 04:40:55.472772 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2233/4719] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:54 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1267 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:55.504891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f5c6feb3-717a-4722-971b-39ca26451930 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:55.507550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f5c6feb3-717a-4722-971b-39ca26451930 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] [instance: cc1acb3e-cd4c-47c9-893f-30d20e98b869] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:55.567818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5c6feb3-717a-4722-971b-39ca26451930 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.573714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5c6feb3-717a-4722-971b-39ca26451930 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.574866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5c6feb3-717a-4722-971b-39ca26451930 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.575534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5c6feb3-717a-4722-971b-39ca26451930 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.642339 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-f5c6feb3-717a-4722-971b-39ca26451930 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] HTTP exception thrown: Instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 could not be found. Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f5c6feb3-717a-4722-971b-39ca26451930 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Request method failure captured: Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 HTTP/1.1 Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14Vw2uvclx2O0SqFT7tFRJbgprLsib1l1JsithoH4MgVfA-1DTVaGIjyCBgimECTzIUQub5Vjp_sZ26wMlyxUvy_lL8-Oj2J9eQXak36Q81v61gkOOD23yY7-weLOpnNsAWUc6WZh2EFsAZ7hxVfK_mNkYh8e1u6SI9jGudXTSKIEIo Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.42 Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4689a1d17c764689be54e7506f1ab82f Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1008208137 Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4689a1d17c764689be54e7506f1ab82f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4689a1d17c764689be54e7506f1ab82f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4689a1d17c764689be54e7506f1ab82f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4689a1d17c764689be54e7506f1ab82f"}]}] Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1008208137 Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4689a1d17c764689be54e7506f1ab82f Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1008208137 Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TaggedBootDevicesTest_v242-1008208137-project Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 9d9c9a24493b4f2299dffb11b8addc4d Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1008208137-project Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 could not be found. Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'cc1acb3e-cd4c-47c9-893f-30d20e98b869'} Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 could not be found. Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 could not be found. Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:55.644564 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:55.650673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:55.650673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:55.650673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:55.650673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:55.650673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:55.650673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:55.650673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 could not be found. Jul 20 04:40:55.650673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:55.654359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f5c6feb3-717a-4722-971b-39ca26451930 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] Returning 404 to user: Instance cc1acb3e-cd4c-47c9-893f-30d20e98b869 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:55.667271 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f5c6feb3-717a-4722-971b-39ca26451930 tempest-TaggedBootDevicesTest_v242-1008208137 tempest-TaggedBootDevicesTest_v242-1008208137-project] 10.222.0.17 "GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869" status: 404 len: 111 microversion: 2.42 time: 0.200650 Jul 20 04:40:55.668731 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2234/4720] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:55 2022] GET /compute/v2.1/servers/cc1acb3e-cd4c-47c9-893f-30d20e98b869 => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:40:55.675149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f280f84c-9fee-4aec-ac8e-0df4fd4853aa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8846b17b-6f21-4516-bd03-87f42d94f0ea"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:55.691313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f280f84c-9fee-4aec-ac8e-0df4fd4853aa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:55.708073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f280f84c-9fee-4aec-ac8e-0df4fd4853aa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.713439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f280f84c-9fee-4aec-ac8e-0df4fd4853aa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.715047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f280f84c-9fee-4aec-ac8e-0df4fd4853aa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.715745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f280f84c-9fee-4aec-ac8e-0df4fd4853aa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.835072 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-f280f84c-9fee-4aec-ac8e-0df4fd4853aa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] HTTP exception thrown: Cannot 'attach_volume' instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 while it is in vm_state rescued Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f280f84c-9fee-4aec-ac8e-0df4fd4853aa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Request method failure captured: Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9/os-volume_attachments HTTP/1.1 Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 74 Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14cCAXHTn9-xjP9-j6Y5H3QclpCYHsqBLpRpQihoTalzGkb0NJB3tQRrqwgEU6RYcb1rSLMpRe6OHLIl_vuXQ5sxjCNslRe7DUQ3JshdANU3fqjJB1ce8j9t6r_FeEMPekMuZI1SQ7JdDTpAgLs_ZRs_OCOFW6Xgy06EebnWW58puJk Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 3e123ad99de64f50b9cd4373597c3a9e Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3e123ad99de64f50b9cd4373597c3a9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3e123ad99de64f50b9cd4373597c3a9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3e123ad99de64f50b9cd4373597c3a9e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3e123ad99de64f50b9cd4373597c3a9e"}]}] Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 3e123ad99de64f50b9cd4373597c3a9e Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerRescueNegativeTestJSON-810656662-project Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 8ea213e79bcf4aaea49446db5eb55271 Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-810656662-project Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: {"volumeAttachment": {"volumeId": "8846b17b-6f21-4516-bd03-87f42d94f0ea"}} Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: exception: Cannot 'attach_volume' instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 while it is in vm_state rescued Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'server_id': 'ca2f9ea6-9cd9-416d-b210-2b1968e47ea9', 'body': {'volumeAttachment': {'volumeId': '8846b17b-6f21-4516-bd03-87f42d94f0ea'}}} Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 20 04:40:55.846125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:40:55.850015 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:40:55.850015 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:40:55.850015 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 while it is in vm_state rescued Jul 20 04:40:55.850015 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:55.850015 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:55.850015 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:55.850015 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:55.850015 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:55.850015 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:55.850015 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:55.850015 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:55.850015 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 while it is in vm_state rescued Jul 20 04:40:55.850015 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:40:55.864077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f280f84c-9fee-4aec-ac8e-0df4fd4853aa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Returning 409 to user: Cannot 'attach_volume' instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 while it is in vm_state rescued {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:55.865485 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f280f84c-9fee-4aec-ac8e-0df4fd4853aa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "POST /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.195294 Jul 20 04:40:55.882340 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2235/4721] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 04:40:55 2022] POST /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9/os-volume_attachments => generated 152 bytes in 212 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:40:55.896412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7f2c9f1e-f903-4813-9afd-612a777de884 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:55.907447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7f2c9f1e-f903-4813-9afd-612a777de884 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:55.946177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f2c9f1e-f903-4813-9afd-612a777de884 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.952579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f2c9f1e-f903-4813-9afd-612a777de884 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.957972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f2c9f1e-f903-4813-9afd-612a777de884 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.959628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f2c9f1e-f903-4813-9afd-612a777de884 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:56.085812 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d2686665-a71e-4034-a334-104a743937c0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:56.105599 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d2686665-a71e-4034-a334-104a743937c0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1679 microversion: 2.1 time: 0.831970 Jul 20 04:40:56.108576 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2487/4722] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:55 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1679 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:56.128994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d338ed54-40ee-460b-8164-c5593ba0782c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:56.129849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d338ed54-40ee-460b-8164-c5593ba0782c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:56.149652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d338ed54-40ee-460b-8164-c5593ba0782c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:56.150939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d338ed54-40ee-460b-8164-c5593ba0782c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:56.152159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d338ed54-40ee-460b-8164-c5593ba0782c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:56.154454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d338ed54-40ee-460b-8164-c5593ba0782c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:56.461339 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d338ed54-40ee-460b-8164-c5593ba0782c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "POST /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9/action" status: 202 len: 0 microversion: 2.1 time: 0.346514 Jul 20 04:40:56.469726 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2488/4723] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:56 2022] POST /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:40:56.494378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a9cc7875-0926-4eb3-b19d-8c02e597f925 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:56.495173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a9cc7875-0926-4eb3-b19d-8c02e597f925 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:56.518605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9cc7875-0926-4eb3-b19d-8c02e597f925 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:56.524806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9cc7875-0926-4eb3-b19d-8c02e597f925 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:56.530709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9cc7875-0926-4eb3-b19d-8c02e597f925 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:56.532738 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9cc7875-0926-4eb3-b19d-8c02e597f925 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:56.593040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7f2c9f1e-f903-4813-9afd-612a777de884 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:56.615870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7f2c9f1e-f903-4813-9afd-612a777de884 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:56.633136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7f2c9f1e-f903-4813-9afd-612a777de884 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:56.641528 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7f2c9f1e-f903-4813-9afd-612a777de884 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1740 microversion: 2.20 time: 0.757803 Jul 20 04:40:56.645239 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2236/4724] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:55 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1740 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:56.690754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-11029334-0d6d-4d8f-8113-2d896e2238ca tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:56.692915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-11029334-0d6d-4d8f-8113-2d896e2238ca tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:56.722233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11029334-0d6d-4d8f-8113-2d896e2238ca tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:56.724876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11029334-0d6d-4d8f-8113-2d896e2238ca tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:56.730503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11029334-0d6d-4d8f-8113-2d896e2238ca tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:56.732922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11029334-0d6d-4d8f-8113-2d896e2238ca tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:57.665163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-11029334-0d6d-4d8f-8113-2d896e2238ca tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:57.684675 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-11029334-0d6d-4d8f-8113-2d896e2238ca tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1319 microversion: 2.1 time: 1.031402 Jul 20 04:40:57.685687 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2237/4725] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:56 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1319 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:57.711557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-28783e9b-0d4c-4f0f-a7dc-b646600e7ed5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:57.713270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-28783e9b-0d4c-4f0f-a7dc-b646600e7ed5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:57.751208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28783e9b-0d4c-4f0f-a7dc-b646600e7ed5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:57.759245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28783e9b-0d4c-4f0f-a7dc-b646600e7ed5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:57.762212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28783e9b-0d4c-4f0f-a7dc-b646600e7ed5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:57.768512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28783e9b-0d4c-4f0f-a7dc-b646600e7ed5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.012326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a9cc7875-0926-4eb3-b19d-8c02e597f925 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:58.026606 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a9cc7875-0926-4eb3-b19d-8c02e597f925 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1510 microversion: 2.1 time: 1.553932 Jul 20 04:40:58.033573 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2489/4726] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:56 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1510 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:58.047413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1924e173-d2d1-4b1c-8786-2bbd242a3fb2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:58.048447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1924e173-d2d1-4b1c-8786-2bbd242a3fb2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:58.060340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1924e173-d2d1-4b1c-8786-2bbd242a3fb2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:58.066861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1924e173-d2d1-4b1c-8786-2bbd242a3fb2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.084880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1924e173-d2d1-4b1c-8786-2bbd242a3fb2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:58.087031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1924e173-d2d1-4b1c-8786-2bbd242a3fb2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.789783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-28783e9b-0d4c-4f0f-a7dc-b646600e7ed5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:58.841453 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-28783e9b-0d4c-4f0f-a7dc-b646600e7ed5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1656 microversion: 2.1 time: 1.154402 Jul 20 04:40:58.843565 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2238/4727] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:57 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1656 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:58.869346 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5a1d64fc-4170-4f2b-84b0-e79ec573a996 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:58.877544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5a1d64fc-4170-4f2b-84b0-e79ec573a996 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:58.919429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a1d64fc-4170-4f2b-84b0-e79ec573a996 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:58.930684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a1d64fc-4170-4f2b-84b0-e79ec573a996 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.937350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a1d64fc-4170-4f2b-84b0-e79ec573a996 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:58.946394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a1d64fc-4170-4f2b-84b0-e79ec573a996 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:59.320523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1924e173-d2d1-4b1c-8786-2bbd242a3fb2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:59.335967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1924e173-d2d1-4b1c-8786-2bbd242a3fb2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:59.347126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1924e173-d2d1-4b1c-8786-2bbd242a3fb2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:59.371426 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1924e173-d2d1-4b1c-8786-2bbd242a3fb2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1740 microversion: 2.20 time: 1.328198 Jul 20 04:40:59.372728 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2490/4728] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:58 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1740 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:59.380251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5f90e0eb-2a34-4ae3-b8a0-6b23d098f2f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:59.430137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f90e0eb-2a34-4ae3-b8a0-6b23d098f2f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:59.430548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f90e0eb-2a34-4ae3-b8a0-6b23d098f2f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:59.560712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5f90e0eb-2a34-4ae3-b8a0-6b23d098f2f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Going to try to start instance {{(pid=127871) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:40:59.669996 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5f90e0eb-2a34-4ae3-b8a0-6b23d098f2f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 202 len: 0 microversion: 2.1 time: 0.295068 Jul 20 04:40:59.672093 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2491/4729] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:59 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:40:59.683623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5a1d64fc-4170-4f2b-84b0-e79ec573a996 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:59.725138 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5a1d64fc-4170-4f2b-84b0-e79ec573a996 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1325 microversion: 2.1 time: 0.870304 Jul 20 04:40:59.725772 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2239/4730] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:58 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1325 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:59.747495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dec41eab-eaa1-4041-b607-29310827e5e3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:59.748206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dec41eab-eaa1-4041-b607-29310827e5e3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:59.773348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6035e067-8b66-4bd4-b98f-c92941d2d83b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:59.790362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dec41eab-eaa1-4041-b607-29310827e5e3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:59.790857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dec41eab-eaa1-4041-b607-29310827e5e3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:59.791265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6035e067-8b66-4bd4-b98f-c92941d2d83b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:59.797384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dec41eab-eaa1-4041-b607-29310827e5e3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:59.797384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dec41eab-eaa1-4041-b607-29310827e5e3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:59.851188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6035e067-8b66-4bd4-b98f-c92941d2d83b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:59.854592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6035e067-8b66-4bd4-b98f-c92941d2d83b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:59.858668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6035e067-8b66-4bd4-b98f-c92941d2d83b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:59.862843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6035e067-8b66-4bd4-b98f-c92941d2d83b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:00.781368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dec41eab-eaa1-4041-b607-29310827e5e3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:00.793565 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dec41eab-eaa1-4041-b607-29310827e5e3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1510 microversion: 2.1 time: 1.115522 Jul 20 04:41:00.795335 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2492/4731] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:59 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1510 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:00.812310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-46585b2b-e5e6-45f2-a794-cc763f8a1d0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:00.817194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-46585b2b-e5e6-45f2-a794-cc763f8a1d0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:00.857480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46585b2b-e5e6-45f2-a794-cc763f8a1d0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:00.858267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46585b2b-e5e6-45f2-a794-cc763f8a1d0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:00.864472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46585b2b-e5e6-45f2-a794-cc763f8a1d0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:00.865181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46585b2b-e5e6-45f2-a794-cc763f8a1d0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:01.095347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6035e067-8b66-4bd4-b98f-c92941d2d83b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:01.125497 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6035e067-8b66-4bd4-b98f-c92941d2d83b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1665 microversion: 2.1 time: 1.373750 Jul 20 04:41:01.132392 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2240/4732] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:59 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1665 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:01.161610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bd4b3da7-28d8-4b01-9888-1f65bccd7f51 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:01.167632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bd4b3da7-28d8-4b01-9888-1f65bccd7f51 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:01.191461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd4b3da7-28d8-4b01-9888-1f65bccd7f51 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:01.194076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd4b3da7-28d8-4b01-9888-1f65bccd7f51 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:01.198469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd4b3da7-28d8-4b01-9888-1f65bccd7f51 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:01.200669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd4b3da7-28d8-4b01-9888-1f65bccd7f51 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:01.650956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bd4b3da7-28d8-4b01-9888-1f65bccd7f51 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:01.700701 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bd4b3da7-28d8-4b01-9888-1f65bccd7f51 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1325 microversion: 2.1 time: 0.560192 Jul 20 04:41:01.706001 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2241/4733] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:01 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1325 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:01.830706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5ea92a0d-06f4-4b07-b632-46d5d6b757fb tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:01.844699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5ea92a0d-06f4-4b07-b632-46d5d6b757fb tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:01.873489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ea92a0d-06f4-4b07-b632-46d5d6b757fb tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:01.874260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ea92a0d-06f4-4b07-b632-46d5d6b757fb tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:01.875242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ea92a0d-06f4-4b07-b632-46d5d6b757fb tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:01.875951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ea92a0d-06f4-4b07-b632-46d5d6b757fb tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.477899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5ea92a0d-06f4-4b07-b632-46d5d6b757fb tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:02.502881 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5ea92a0d-06f4-4b07-b632-46d5d6b757fb tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1510 microversion: 2.1 time: 0.691190 Jul 20 04:41:02.523608 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2242/4734] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:01 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1510 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:02.533883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0ee429d0-21a7-489c-aba6-9661d19e79cc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:02.535683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0ee429d0-21a7-489c-aba6-9661d19e79cc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:02.542997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ee429d0-21a7-489c-aba6-9661d19e79cc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.543832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ee429d0-21a7-489c-aba6-9661d19e79cc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.545106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ee429d0-21a7-489c-aba6-9661d19e79cc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.545705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ee429d0-21a7-489c-aba6-9661d19e79cc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.816765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0ee429d0-21a7-489c-aba6-9661d19e79cc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:02.832067 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0ee429d0-21a7-489c-aba6-9661d19e79cc tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1665 microversion: 2.1 time: 0.305108 Jul 20 04:41:02.835757 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2243/4735] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:02 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1665 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:02.842320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3df63751-7cb7-4a28-b59f-9485fd6a0401 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:02.846505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3df63751-7cb7-4a28-b59f-9485fd6a0401 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:02.885126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3df63751-7cb7-4a28-b59f-9485fd6a0401 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.886519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3df63751-7cb7-4a28-b59f-9485fd6a0401 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.888935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3df63751-7cb7-4a28-b59f-9485fd6a0401 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.889702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3df63751-7cb7-4a28-b59f-9485fd6a0401 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.103977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3df63751-7cb7-4a28-b59f-9485fd6a0401 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:03.136582 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3df63751-7cb7-4a28-b59f-9485fd6a0401 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1325 microversion: 2.1 time: 0.296864 Jul 20 04:41:03.141479 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2244/4736] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:02 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1325 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:03.462279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-46585b2b-e5e6-45f2-a794-cc763f8a1d0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:03.488608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:03.498114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-46585b2b-e5e6-45f2-a794-cc763f8a1d0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:03.506552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-46585b2b-e5e6-45f2-a794-cc763f8a1d0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:03.509743 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-46585b2b-e5e6-45f2-a794-cc763f8a1d0f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1740 microversion: 2.20 time: 2.713401 Jul 20 04:41:03.512615 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2493/4737] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:00 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1740 bytes in 2716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:03.530257 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7e36e7e0-79f5-4033-84db-2c703a7557f6 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:03.531629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7e36e7e0-79f5-4033-84db-2c703a7557f6 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:03.540479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e36e7e0-79f5-4033-84db-2c703a7557f6 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.540938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e36e7e0-79f5-4033-84db-2c703a7557f6 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.545876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e36e7e0-79f5-4033-84db-2c703a7557f6 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.546338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e36e7e0-79f5-4033-84db-2c703a7557f6 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.859354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ae5aa351-66d9-4722-98f0-f72b6e39b7da tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:03.860452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ae5aa351-66d9-4722-98f0-f72b6e39b7da tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:03.965303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae5aa351-66d9-4722-98f0-f72b6e39b7da tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.965765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae5aa351-66d9-4722-98f0-f72b6e39b7da tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.966562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae5aa351-66d9-4722-98f0-f72b6e39b7da tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.966996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae5aa351-66d9-4722-98f0-f72b6e39b7da tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:04.058916 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7e36e7e0-79f5-4033-84db-2c703a7557f6 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:04.071746 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7e36e7e0-79f5-4033-84db-2c703a7557f6 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1510 microversion: 2.1 time: 0.545434 Jul 20 04:41:04.073028 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2245/4738] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:03 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1510 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:04.155766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a779bd59-4e0f-47b9-8ea0-64f41ed85740 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:04.156938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a779bd59-4e0f-47b9-8ea0-64f41ed85740 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:04.164906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a779bd59-4e0f-47b9-8ea0-64f41ed85740 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:04.174710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a779bd59-4e0f-47b9-8ea0-64f41ed85740 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:04.175737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a779bd59-4e0f-47b9-8ea0-64f41ed85740 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:04.177321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a779bd59-4e0f-47b9-8ea0-64f41ed85740 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:04.258225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:04.450525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:04.635289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a779bd59-4e0f-47b9-8ea0-64f41ed85740 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:04.644196 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a779bd59-4e0f-47b9-8ea0-64f41ed85740 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1392 microversion: 2.1 time: 0.493622 Jul 20 04:41:04.649009 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2246/4739] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:04 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1392 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:04.673727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-52ec76a9-c55d-458e-b33c-e921dbdd422f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:04.674614 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-52ec76a9-c55d-458e-b33c-e921dbdd422f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:04.695541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52ec76a9-c55d-458e-b33c-e921dbdd422f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:04.696003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52ec76a9-c55d-458e-b33c-e921dbdd422f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:04.698017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52ec76a9-c55d-458e-b33c-e921dbdd422f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:04.699693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52ec76a9-c55d-458e-b33c-e921dbdd422f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:05.131591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-52ec76a9-c55d-458e-b33c-e921dbdd422f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:05.146625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-52ec76a9-c55d-458e-b33c-e921dbdd422f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:05.155348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-52ec76a9-c55d-458e-b33c-e921dbdd422f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:05.156825 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-52ec76a9-c55d-458e-b33c-e921dbdd422f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1740 microversion: 2.20 time: 0.505977 Jul 20 04:41:05.170345 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2247/4740] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:04 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1740 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:05.175231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c87a8e11-df08-41ad-b314-1d622514f0ad tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:05.179492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c87a8e11-df08-41ad-b314-1d622514f0ad tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:05.192549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c87a8e11-df08-41ad-b314-1d622514f0ad tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:05.193019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c87a8e11-df08-41ad-b314-1d622514f0ad tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:05.194427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ae5aa351-66d9-4722-98f0-f72b6e39b7da tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:05.202405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c87a8e11-df08-41ad-b314-1d622514f0ad tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:05.202613 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ae5aa351-66d9-4722-98f0-f72b6e39b7da tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 1.355815 Jul 20 04:41:05.202865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c87a8e11-df08-41ad-b314-1d622514f0ad tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:05.203175 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2494/4741] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:03 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:05.230860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-398fdc10-3e70-42f5-b814-f2a53eb795ae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:05.231483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-398fdc10-3e70-42f5-b814-f2a53eb795ae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:05.297723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-398fdc10-3e70-42f5-b814-f2a53eb795ae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:05.298251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-398fdc10-3e70-42f5-b814-f2a53eb795ae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:05.299095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-398fdc10-3e70-42f5-b814-f2a53eb795ae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:05.299536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-398fdc10-3e70-42f5-b814-f2a53eb795ae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:05.451139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:05.703507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c87a8e11-df08-41ad-b314-1d622514f0ad tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:05.714268 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c87a8e11-df08-41ad-b314-1d622514f0ad tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1510 microversion: 2.1 time: 0.549922 Jul 20 04:41:05.724636 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2248/4742] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:05 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1510 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:05.730333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-93604731-e3be-47d5-aa05-268e3294e77f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:05.736779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-93604731-e3be-47d5-aa05-268e3294e77f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:05.755437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93604731-e3be-47d5-aa05-268e3294e77f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:05.758405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93604731-e3be-47d5-aa05-268e3294e77f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:05.760385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93604731-e3be-47d5-aa05-268e3294e77f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:05.761566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93604731-e3be-47d5-aa05-268e3294e77f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:06.139484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-93604731-e3be-47d5-aa05-268e3294e77f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:06.155351 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-93604731-e3be-47d5-aa05-268e3294e77f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1392 microversion: 2.1 time: 0.429227 Jul 20 04:41:06.157054 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2249/4743] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:05 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1392 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:06.177864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dbce7f25-ec93-4cea-a29a-66f719e87697 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:06.180875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dbce7f25-ec93-4cea-a29a-66f719e87697 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:06.194684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbce7f25-ec93-4cea-a29a-66f719e87697 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:06.196365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbce7f25-ec93-4cea-a29a-66f719e87697 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:06.222361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbce7f25-ec93-4cea-a29a-66f719e87697 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:06.223412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbce7f25-ec93-4cea-a29a-66f719e87697 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:06.504716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-398fdc10-3e70-42f5-b814-f2a53eb795ae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:06.542103 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-398fdc10-3e70-42f5-b814-f2a53eb795ae tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 1.315516 Jul 20 04:41:06.554099 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2495/4744] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:05 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:06.587489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-afc10f01-87ab-48b0-bde7-3b65a41efa1e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:06.599677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-afc10f01-87ab-48b0-bde7-3b65a41efa1e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:06.649597 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=62 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:06.654097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afc10f01-87ab-48b0-bde7-3b65a41efa1e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:06.670975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afc10f01-87ab-48b0-bde7-3b65a41efa1e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:06.673030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afc10f01-87ab-48b0-bde7-3b65a41efa1e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:06.685292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afc10f01-87ab-48b0-bde7-3b65a41efa1e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:07.028688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dbce7f25-ec93-4cea-a29a-66f719e87697 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:07.054042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dbce7f25-ec93-4cea-a29a-66f719e87697 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:07.055994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dbce7f25-ec93-4cea-a29a-66f719e87697 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:07.057752 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dbce7f25-ec93-4cea-a29a-66f719e87697 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1740 microversion: 2.20 time: 0.884092 Jul 20 04:41:07.083233 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2250/4745] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:06 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1740 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:07.097542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-34c9479e-4c52-4fa9-91d7-e41af2e72851 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:07.098608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-34c9479e-4c52-4fa9-91d7-e41af2e72851 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:07.110654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-34c9479e-4c52-4fa9-91d7-e41af2e72851 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:07.112945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-34c9479e-4c52-4fa9-91d7-e41af2e72851 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:07.118081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-34c9479e-4c52-4fa9-91d7-e41af2e72851 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:07.118734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-34c9479e-4c52-4fa9-91d7-e41af2e72851 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:08.254987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-afc10f01-87ab-48b0-bde7-3b65a41efa1e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:08.265099 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-afc10f01-87ab-48b0-bde7-3b65a41efa1e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 1.689499 Jul 20 04:41:08.275524 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2496/4746] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:06 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:08.283278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4298e39a-5936-4024-b624-121249bb83c8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:08.284169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4298e39a-5936-4024-b624-121249bb83c8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:08.292134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4298e39a-5936-4024-b624-121249bb83c8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:08.292885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4298e39a-5936-4024-b624-121249bb83c8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:08.294490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4298e39a-5936-4024-b624-121249bb83c8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:08.295102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4298e39a-5936-4024-b624-121249bb83c8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:09.195749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-34c9479e-4c52-4fa9-91d7-e41af2e72851 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:09.207708 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-34c9479e-4c52-4fa9-91d7-e41af2e72851 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1516 microversion: 2.1 time: 2.118397 Jul 20 04:41:09.218216 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2251/4747] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:07 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1516 bytes in 2130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:09.270669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8becb09b-57f2-4f46-bcb1-b35bede8d802 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1212636393", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "55489188-a83a-4195-8d09-b860e082dea2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7f25ae6d-be40-4c15-969a-9d88fe94c163"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:09.338662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4298e39a-5936-4024-b624-121249bb83c8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:09.354651 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4298e39a-5936-4024-b624-121249bb83c8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1392 microversion: 2.1 time: 1.076593 Jul 20 04:41:09.391373 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2497/4748] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:08 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1392 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:09.409667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c5594ed7-be54-44ee-b84f-ae2c7613feff tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:09.410301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c5594ed7-be54-44ee-b84f-ae2c7613feff tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:09.446217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5594ed7-be54-44ee-b84f-ae2c7613feff tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:09.446678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5594ed7-be54-44ee-b84f-ae2c7613feff tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:09.447484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5594ed7-be54-44ee-b84f-ae2c7613feff tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:09.447926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5594ed7-be54-44ee-b84f-ae2c7613feff tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:09.621919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-8becb09b-57f2-4f46-bcb1-b35bede8d802 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] validate_networks() for [('7f25ae6d-be40-4c15-969a-9d88fe94c163', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:41:10.399039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c5594ed7-be54-44ee-b84f-ae2c7613feff tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:10.413054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c5594ed7-be54-44ee-b84f-ae2c7613feff tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:10.416576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c5594ed7-be54-44ee-b84f-ae2c7613feff tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:10.421727 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c5594ed7-be54-44ee-b84f-ae2c7613feff tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1740 microversion: 2.20 time: 1.029135 Jul 20 04:41:10.422894 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2498/4749] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:09 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1740 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:10.430740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-81ef40e6-33ba-4191-a1f5-c29e1006bfc5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:10.436393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-81ef40e6-33ba-4191-a1f5-c29e1006bfc5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:10.447583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81ef40e6-33ba-4191-a1f5-c29e1006bfc5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:10.450915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81ef40e6-33ba-4191-a1f5-c29e1006bfc5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:10.455271 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81ef40e6-33ba-4191-a1f5-c29e1006bfc5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:10.455938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81ef40e6-33ba-4191-a1f5-c29e1006bfc5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:11.118693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-81ef40e6-33ba-4191-a1f5-c29e1006bfc5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:11.136125 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-81ef40e6-33ba-4191-a1f5-c29e1006bfc5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.704195 Jul 20 04:41:11.137767 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2499/4750] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:10 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:11.157686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e8950a49-c0f7-4ab1-8db4-0879b0eebbfc req-874448ad-44eb-4604-ab0d-eff50c1c4c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ed5f8e-9305-42db-8723-6fba63245605", "tag": "dd8fb1a0-4673-4433-af0e-9ceaff8681f5"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:11.199461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e8950a49-c0f7-4ab1-8db4-0879b0eebbfc req-874448ad-44eb-4604-ab0d-eff50c1c4c0e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:11.203552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e8950a49-c0f7-4ab1-8db4-0879b0eebbfc req-874448ad-44eb-4604-ab0d-eff50c1c4c0e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:11.229147 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e8950a49-c0f7-4ab1-8db4-0879b0eebbfc req-874448ad-44eb-4604-ab0d-eff50c1c4c0e service nova] Creating event network-changed:dd8fb1a0-4673-4433-af0e-9ceaff8681f5 for instance 90ed5f8e-9305-42db-8723-6fba63245605 on n-h2-826526-5 Jul 20 04:41:11.229838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8becb09b-57f2-4f46-bcb1-b35bede8d802 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:41:11.230290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8becb09b-57f2-4f46-bcb1-b35bede8d802 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:41:11.230739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8becb09b-57f2-4f46-bcb1-b35bede8d802 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:41:11.231158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8becb09b-57f2-4f46-bcb1-b35bede8d802 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:41:11.231574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8becb09b-57f2-4f46-bcb1-b35bede8d802 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:41:11.236185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:11.242113 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e8950a49-c0f7-4ab1-8db4-0879b0eebbfc req-874448ad-44eb-4604-ab0d-eff50c1c4c0e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098285 Jul 20 04:41:11.248853 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2500/4751] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:11.258890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6414f0ac-da4d-4d26-8d02-1095595617c0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:11.260104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6414f0ac-da4d-4d26-8d02-1095595617c0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:11.277443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6414f0ac-da4d-4d26-8d02-1095595617c0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:11.278731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6414f0ac-da4d-4d26-8d02-1095595617c0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:11.279935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6414f0ac-da4d-4d26-8d02-1095595617c0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:11.282147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6414f0ac-da4d-4d26-8d02-1095595617c0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:11.282651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8becb09b-57f2-4f46-bcb1-b35bede8d802 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:11.283122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8becb09b-57f2-4f46-bcb1-b35bede8d802 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:11.283933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8becb09b-57f2-4f46-bcb1-b35bede8d802 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:11.302093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8becb09b-57f2-4f46-bcb1-b35bede8d802 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:11.388568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8becb09b-57f2-4f46-bcb1-b35bede8d802 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Getting quotas for project b889ad56221143f0a54450c81ba738a7. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:41:11.397013 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8becb09b-57f2-4f46-bcb1-b35bede8d802 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Getting quotas for user bc760e8f522640fc9190460719f5dcc2 and project b889ad56221143f0a54450c81ba738a7. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:41:11.537022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8becb09b-57f2-4f46-bcb1-b35bede8d802 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:41:11.540602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8becb09b-57f2-4f46-bcb1-b35bede8d802 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='55489188-a83a-4195-8d09-b860e082dea2',volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:41:11.723963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6414f0ac-da4d-4d26-8d02-1095595617c0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:11.751871 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6414f0ac-da4d-4d26-8d02-1095595617c0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1392 microversion: 2.1 time: 0.497286 Jul 20 04:41:11.753929 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2501/4752] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:11 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1392 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:11.763547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dd45d8f8-eccd-4a67-ba6f-5302209239c4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:11.773704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dd45d8f8-eccd-4a67-ba6f-5302209239c4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:11.781220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd45d8f8-eccd-4a67-ba6f-5302209239c4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:11.785600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd45d8f8-eccd-4a67-ba6f-5302209239c4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:11.786787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd45d8f8-eccd-4a67-ba6f-5302209239c4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:11.787442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dd45d8f8-eccd-4a67-ba6f-5302209239c4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:11.974281 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8becb09b-57f2-4f46-bcb1-b35bede8d802 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.751342 Jul 20 04:41:11.980148 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2252/4753] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:41:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:41:12.023021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5a3b9153-a2d5-4839-94cc-ba5207ffe0f7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:12.024699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5a3b9153-a2d5-4839-94cc-ba5207ffe0f7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:12.050099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a3b9153-a2d5-4839-94cc-ba5207ffe0f7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:12.062529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a3b9153-a2d5-4839-94cc-ba5207ffe0f7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:12.063959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a3b9153-a2d5-4839-94cc-ba5207ffe0f7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:12.065104 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a3b9153-a2d5-4839-94cc-ba5207ffe0f7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:12.253310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dd45d8f8-eccd-4a67-ba6f-5302209239c4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:12.269175 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dd45d8f8-eccd-4a67-ba6f-5302209239c4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.513837 Jul 20 04:41:12.282607 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2502/4754] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:11 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:12.313991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8aa2319e-45fa-4586-b202-3c34af483f2d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:12.316458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8aa2319e-45fa-4586-b202-3c34af483f2d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:12.544095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8aa2319e-45fa-4586-b202-3c34af483f2d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:12.558386 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8aa2319e-45fa-4586-b202-3c34af483f2d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1057 microversion: 2.1 time: 0.265106 Jul 20 04:41:12.573542 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2503/4755] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:12 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1057 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:12.589203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7da348b3-4d3e-489b-a16f-a4362358a9e8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:12.590021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7da348b3-4d3e-489b-a16f-a4362358a9e8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:12.601819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7da348b3-4d3e-489b-a16f-a4362358a9e8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:12.604866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7da348b3-4d3e-489b-a16f-a4362358a9e8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:12.605931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7da348b3-4d3e-489b-a16f-a4362358a9e8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:12.606525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7da348b3-4d3e-489b-a16f-a4362358a9e8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:12.648717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-7da348b3-4d3e-489b-a16f-a4362358a9e8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lazy-loading 'flavor' on Instance uuid f2db32d6-491e-4d61-81b0-571b1c7073ff {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:41:12.663372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5a3b9153-a2d5-4839-94cc-ba5207ffe0f7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:12.685226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5a3b9153-a2d5-4839-94cc-ba5207ffe0f7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:12.699245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5a3b9153-a2d5-4839-94cc-ba5207ffe0f7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:12.702644 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5a3b9153-a2d5-4839-94cc-ba5207ffe0f7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1740 microversion: 2.20 time: 0.717659 Jul 20 04:41:12.708185 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2253/4756] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:11 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1740 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:12.784366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-01487e9e-3bd2-4ead-a187-000c1370dd01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:12.784997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-01487e9e-3bd2-4ead-a187-000c1370dd01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:12.821204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01487e9e-3bd2-4ead-a187-000c1370dd01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:12.821204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01487e9e-3bd2-4ead-a187-000c1370dd01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:12.821204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01487e9e-3bd2-4ead-a187-000c1370dd01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:12.821204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01487e9e-3bd2-4ead-a187-000c1370dd01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:12.884625 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7da348b3-4d3e-489b-a16f-a4362358a9e8 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 202 len: 0 microversion: 2.1 time: 0.299082 Jul 20 04:41:12.888252 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2504/4757] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:41:12 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:41:12.905316 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ff86eebb-0eb6-4bd6-b29e-3392e1bcfec2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:12.908531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ff86eebb-0eb6-4bd6-b29e-3392e1bcfec2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:12.934483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff86eebb-0eb6-4bd6-b29e-3392e1bcfec2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:12.935272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff86eebb-0eb6-4bd6-b29e-3392e1bcfec2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:12.938288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff86eebb-0eb6-4bd6-b29e-3392e1bcfec2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:12.938951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff86eebb-0eb6-4bd6-b29e-3392e1bcfec2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:13.347241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-01487e9e-3bd2-4ead-a187-000c1370dd01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:13.382700 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-01487e9e-3bd2-4ead-a187-000c1370dd01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1392 microversion: 2.1 time: 0.606768 Jul 20 04:41:13.396150 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2254/4758] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:12 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1392 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:13.590943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fab25722-475e-4711-a793-3f85b34c1149 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:13.594404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fab25722-475e-4711-a793-3f85b34c1149 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:13.629426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fab25722-475e-4711-a793-3f85b34c1149 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:13.632839 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fab25722-475e-4711-a793-3f85b34c1149 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:13.635603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fab25722-475e-4711-a793-3f85b34c1149 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:13.637433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fab25722-475e-4711-a793-3f85b34c1149 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:13.728941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ff86eebb-0eb6-4bd6-b29e-3392e1bcfec2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:13.749425 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ff86eebb-0eb6-4bd6-b29e-3392e1bcfec2 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1677 microversion: 2.1 time: 0.850032 Jul 20 04:41:13.753084 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2505/4759] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:12 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1677 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:13.818538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e56da509-7e8f-4e18-aac6-3bdfa8092888 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Action: 'create', calling method: .version_select at 0x7f06bdee6d30>, body: {"keypair": {"name": "tempest-keypair-1055539102", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEusYyF+3wbSJKk+NFNiBg8xtOmvyL64PB6FYkSB6E1ccDqAPgZ3kQQyIBFbXGYfE+lTOrDS9JK7AqKAavtiXly/vXYk7y/MEUSujDxHXDDRERo4r+O7OwEybGfS7jsewg=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:13.911350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fab25722-475e-4711-a793-3f85b34c1149 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:13.940843 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fab25722-475e-4711-a793-3f85b34c1149 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1107 microversion: 2.1 time: 0.350371 Jul 20 04:41:13.956071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-e56da509-7e8f-4e18-aac6-3bdfa8092888 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Getting quotas for project 3e123ad99de64f50b9cd4373597c3a9e. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:41:14.009817 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2255/4760] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:13 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1107 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:14.013729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-e56da509-7e8f-4e18-aac6-3bdfa8092888 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Getting quotas for user 8ea213e79bcf4aaea49446db5eb55271 and project 3e123ad99de64f50b9cd4373597c3a9e. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:41:14.028980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-96327e66-bd46-4de8-acc0-fc8f2fe0aa31 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:14.030414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-96327e66-bd46-4de8-acc0-fc8f2fe0aa31 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:14.052601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96327e66-bd46-4de8-acc0-fc8f2fe0aa31 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:14.053587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96327e66-bd46-4de8-acc0-fc8f2fe0aa31 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:14.055542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96327e66-bd46-4de8-acc0-fc8f2fe0aa31 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:14.061180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96327e66-bd46-4de8-acc0-fc8f2fe0aa31 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:14.168283 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e56da509-7e8f-4e18-aac6-3bdfa8092888 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.362323 Jul 20 04:41:14.168942 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2506/4761] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:41:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:14.406183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5015234a-d37f-4787-b4f5-9766eba7c335 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:14.406968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5015234a-d37f-4787-b4f5-9766eba7c335 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:14.418566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5015234a-d37f-4787-b4f5-9766eba7c335 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:14.426670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5015234a-d37f-4787-b4f5-9766eba7c335 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:14.427950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5015234a-d37f-4787-b4f5-9766eba7c335 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:14.428662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5015234a-d37f-4787-b4f5-9766eba7c335 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:14.783011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-96327e66-bd46-4de8-acc0-fc8f2fe0aa31 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:14.824238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-96327e66-bd46-4de8-acc0-fc8f2fe0aa31 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:14.840923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-96327e66-bd46-4de8-acc0-fc8f2fe0aa31 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:14.843865 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-96327e66-bd46-4de8-acc0-fc8f2fe0aa31 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1740 microversion: 2.20 time: 0.831257 Jul 20 04:41:14.844499 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2256/4762] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:14 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1740 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:14.879860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-123ea430-c3dd-4212-bd5f-d412425c8e97 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:14.880647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-123ea430-c3dd-4212-bd5f-d412425c8e97 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:14.906597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-123ea430-c3dd-4212-bd5f-d412425c8e97 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:14.909568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-123ea430-c3dd-4212-bd5f-d412425c8e97 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:14.910865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-123ea430-c3dd-4212-bd5f-d412425c8e97 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:14.911589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-123ea430-c3dd-4212-bd5f-d412425c8e97 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:15.214044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5015234a-d37f-4787-b4f5-9766eba7c335 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:15.226472 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5015234a-d37f-4787-b4f5-9766eba7c335 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1392 microversion: 2.1 time: 0.829307 Jul 20 04:41:15.252548 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2507/4763] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:14 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1392 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:15.266722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1d447019-b70c-430a-a744-c811eb9693ab tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:15.267515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1d447019-b70c-430a-a744-c811eb9693ab tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:15.286737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d447019-b70c-430a-a744-c811eb9693ab tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:15.295322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d447019-b70c-430a-a744-c811eb9693ab tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:15.296608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d447019-b70c-430a-a744-c811eb9693ab tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:15.305867 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d447019-b70c-430a-a744-c811eb9693ab tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:15.374131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-123ea430-c3dd-4212-bd5f-d412425c8e97 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:15.392871 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-123ea430-c3dd-4212-bd5f-d412425c8e97 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1660 microversion: 2.1 time: 0.527643 Jul 20 04:41:15.395019 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2257/4764] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:14 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1660 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:15.420600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-faee7588-76cf-441f-9083-5e7827ceb9da tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:15.423503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-faee7588-76cf-441f-9083-5e7827ceb9da tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:15.442727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-faee7588-76cf-441f-9083-5e7827ceb9da tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:15.448412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-faee7588-76cf-441f-9083-5e7827ceb9da tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:15.450160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-faee7588-76cf-441f-9083-5e7827ceb9da tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:15.456929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-faee7588-76cf-441f-9083-5e7827ceb9da tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:15.481160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1d447019-b70c-430a-a744-c811eb9693ab tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:15.495050 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1d447019-b70c-430a-a744-c811eb9693ab tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1173 microversion: 2.1 time: 0.242818 Jul 20 04:41:15.498470 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2508/4765] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:15 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1173 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:15.693809 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-faee7588-76cf-441f-9083-5e7827ceb9da tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action" status: 202 len: 0 microversion: 2.1 time: 0.287469 Jul 20 04:41:15.697634 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2258/4766] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:41:15 2022] POST /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:41:15.703964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f360aeeb-c411-4ebd-807d-d68cff2d04dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:15.704736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f360aeeb-c411-4ebd-807d-d68cff2d04dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:15.721369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f360aeeb-c411-4ebd-807d-d68cff2d04dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:15.722387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f360aeeb-c411-4ebd-807d-d68cff2d04dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:15.724323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f360aeeb-c411-4ebd-807d-d68cff2d04dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:15.724831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f360aeeb-c411-4ebd-807d-d68cff2d04dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:15.871672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9dba01a9-7ceb-4b8f-ba1d-3d325fc947a8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:15.872748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9dba01a9-7ceb-4b8f-ba1d-3d325fc947a8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:15.896761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9dba01a9-7ceb-4b8f-ba1d-3d325fc947a8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:15.901855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9dba01a9-7ceb-4b8f-ba1d-3d325fc947a8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:15.906308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9dba01a9-7ceb-4b8f-ba1d-3d325fc947a8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:15.911634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9dba01a9-7ceb-4b8f-ba1d-3d325fc947a8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:16.645368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9dba01a9-7ceb-4b8f-ba1d-3d325fc947a8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:16.662573 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9dba01a9-7ceb-4b8f-ba1d-3d325fc947a8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:16.672136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9dba01a9-7ceb-4b8f-ba1d-3d325fc947a8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:16.677429 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9dba01a9-7ceb-4b8f-ba1d-3d325fc947a8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1740 microversion: 2.20 time: 0.811161 Jul 20 04:41:16.681910 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2259/4767] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:15 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1740 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:16.704217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aa81edd9-11d6-44aa-9040-edb47cf799d8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:16.704871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aa81edd9-11d6-44aa-9040-edb47cf799d8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:16.721929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa81edd9-11d6-44aa-9040-edb47cf799d8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:16.730297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa81edd9-11d6-44aa-9040-edb47cf799d8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:16.731385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa81edd9-11d6-44aa-9040-edb47cf799d8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:16.732574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa81edd9-11d6-44aa-9040-edb47cf799d8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:16.965921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f360aeeb-c411-4ebd-807d-d68cff2d04dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:16.982876 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f360aeeb-c411-4ebd-807d-d68cff2d04dd tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1666 microversion: 2.1 time: 1.281080 Jul 20 04:41:16.983941 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2509/4768] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:15 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1666 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:17.016092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0373cfcb-4150-4b17-8ec8-cdd1144ebaa0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:17.022599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0373cfcb-4150-4b17-8ec8-cdd1144ebaa0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:17.037511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0373cfcb-4150-4b17-8ec8-cdd1144ebaa0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.041857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0373cfcb-4150-4b17-8ec8-cdd1144ebaa0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.043045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0373cfcb-4150-4b17-8ec8-cdd1144ebaa0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.044628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0373cfcb-4150-4b17-8ec8-cdd1144ebaa0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.859165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aa81edd9-11d6-44aa-9040-edb47cf799d8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:17.876603 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aa81edd9-11d6-44aa-9040-edb47cf799d8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1392 microversion: 2.1 time: 1.183173 Jul 20 04:41:17.877005 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2260/4769] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:16 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1392 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:17.884967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-79351536-d026-43dd-93dc-9797a392a58b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:17.885591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-79351536-d026-43dd-93dc-9797a392a58b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:17.920297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79351536-d026-43dd-93dc-9797a392a58b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.922336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79351536-d026-43dd-93dc-9797a392a58b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.923400 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79351536-d026-43dd-93dc-9797a392a58b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.923840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79351536-d026-43dd-93dc-9797a392a58b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:18.164478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0373cfcb-4150-4b17-8ec8-cdd1144ebaa0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:18.205755 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0373cfcb-4150-4b17-8ec8-cdd1144ebaa0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1173 microversion: 2.1 time: 1.211218 Jul 20 04:41:18.207025 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2510/4770] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:16 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1173 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:18.258317 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0b993bc7-164f-47e8-8e33-4200f930e859 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:18.259810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0b993bc7-164f-47e8-8e33-4200f930e859 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:18.279830 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b993bc7-164f-47e8-8e33-4200f930e859 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:18.281106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b993bc7-164f-47e8-8e33-4200f930e859 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:18.282427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b993bc7-164f-47e8-8e33-4200f930e859 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:18.283154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b993bc7-164f-47e8-8e33-4200f930e859 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:18.315998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:18.633982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-79351536-d026-43dd-93dc-9797a392a58b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:18.670982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-79351536-d026-43dd-93dc-9797a392a58b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:18.673237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-79351536-d026-43dd-93dc-9797a392a58b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:18.674681 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-79351536-d026-43dd-93dc-9797a392a58b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1722 microversion: 2.20 time: 0.796671 Jul 20 04:41:18.680621 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2261/4771] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:17 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1722 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:18.894299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a77dff1a-99d2-4774-bc71-87f1e87cb6f4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:18.895713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a77dff1a-99d2-4774-bc71-87f1e87cb6f4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:18.905211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a77dff1a-99d2-4774-bc71-87f1e87cb6f4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:18.906057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a77dff1a-99d2-4774-bc71-87f1e87cb6f4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:18.907103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a77dff1a-99d2-4774-bc71-87f1e87cb6f4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:18.907786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a77dff1a-99d2-4774-bc71-87f1e87cb6f4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:18.937082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:18.980616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0b993bc7-164f-47e8-8e33-4200f930e859 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:19.006363 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0b993bc7-164f-47e8-8e33-4200f930e859 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1666 microversion: 2.1 time: 0.796077 Jul 20 04:41:19.006997 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2511/4772] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:18 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1666 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:19.224539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d35ddd11-7cfe-4ae5-8bf0-77f39abf5b4d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:19.225876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d35ddd11-7cfe-4ae5-8bf0-77f39abf5b4d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:19.246458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d35ddd11-7cfe-4ae5-8bf0-77f39abf5b4d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:19.249657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d35ddd11-7cfe-4ae5-8bf0-77f39abf5b4d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:19.252296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d35ddd11-7cfe-4ae5-8bf0-77f39abf5b4d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:19.253089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d35ddd11-7cfe-4ae5-8bf0-77f39abf5b4d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:19.946457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a77dff1a-99d2-4774-bc71-87f1e87cb6f4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:19.955309 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a77dff1a-99d2-4774-bc71-87f1e87cb6f4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1392 microversion: 2.1 time: 1.065198 Jul 20 04:41:19.965605 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2262/4773] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:18 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1392 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:19.971270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f04214fb-ddd7-4dc8-865c-f3cbcffab76a req-419b0601-a1ba-4570-ba03-77af70b0a293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ed5f8e-9305-42db-8723-6fba63245605", "name": "network-vif-plugged", "status": "completed", "tag": "dd8fb1a0-4673-4433-af0e-9ceaff8681f5"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:19.989121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f04214fb-ddd7-4dc8-865c-f3cbcffab76a req-419b0601-a1ba-4570-ba03-77af70b0a293 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:20.001365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f04214fb-ddd7-4dc8-865c-f3cbcffab76a req-419b0601-a1ba-4570-ba03-77af70b0a293 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:20.034327 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f04214fb-ddd7-4dc8-865c-f3cbcffab76a req-419b0601-a1ba-4570-ba03-77af70b0a293 service nova] Creating event network-vif-plugged:dd8fb1a0-4673-4433-af0e-9ceaff8681f5 for instance 90ed5f8e-9305-42db-8723-6fba63245605 on n-h2-826526-5 Jul 20 04:41:20.050030 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f04214fb-ddd7-4dc8-865c-f3cbcffab76a req-419b0601-a1ba-4570-ba03-77af70b0a293 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082875 Jul 20 04:41:20.052421 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2263/4774] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:20.083136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-41a44cdc-e70b-442f-9067-9da9d9f4e340 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:20.083850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-41a44cdc-e70b-442f-9067-9da9d9f4e340 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:20.103168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41a44cdc-e70b-442f-9067-9da9d9f4e340 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:20.103617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41a44cdc-e70b-442f-9067-9da9d9f4e340 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:20.115697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41a44cdc-e70b-442f-9067-9da9d9f4e340 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:20.125117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41a44cdc-e70b-442f-9067-9da9d9f4e340 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:20.177946 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d35ddd11-7cfe-4ae5-8bf0-77f39abf5b4d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:20.187324 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d35ddd11-7cfe-4ae5-8bf0-77f39abf5b4d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1215 microversion: 2.1 time: 0.967498 Jul 20 04:41:20.210522 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2512/4775] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:19 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1215 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:20.224963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-eb2e3d15-959f-4700-8335-9cb93d948af0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:20.233273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-eb2e3d15-959f-4700-8335-9cb93d948af0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:20.258690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb2e3d15-959f-4700-8335-9cb93d948af0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:20.259312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb2e3d15-959f-4700-8335-9cb93d948af0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:20.260304 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb2e3d15-959f-4700-8335-9cb93d948af0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:20.260915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb2e3d15-959f-4700-8335-9cb93d948af0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:20.897249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-eb2e3d15-959f-4700-8335-9cb93d948af0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:20.912642 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-eb2e3d15-959f-4700-8335-9cb93d948af0 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1666 microversion: 2.1 time: 0.701078 Jul 20 04:41:20.914973 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2513/4776] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:20 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1666 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:20.987420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2c07a0a2-5df8-4d05-bf26-3ea8c844bc18 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:20.990202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2c07a0a2-5df8-4d05-bf26-3ea8c844bc18 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:21.004918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c07a0a2-5df8-4d05-bf26-3ea8c844bc18 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:21.006871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c07a0a2-5df8-4d05-bf26-3ea8c844bc18 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:21.008954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c07a0a2-5df8-4d05-bf26-3ea8c844bc18 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:21.019707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c07a0a2-5df8-4d05-bf26-3ea8c844bc18 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:21.341207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:21.407524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:21.533198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2c07a0a2-5df8-4d05-bf26-3ea8c844bc18 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:21.545957 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2c07a0a2-5df8-4d05-bf26-3ea8c844bc18 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1392 microversion: 2.1 time: 0.567042 Jul 20 04:41:21.546574 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2514/4777] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:20 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1392 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:21.551505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-76407da1-a138-4954-8732-2934e275ed7b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:21.557530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-76407da1-a138-4954-8732-2934e275ed7b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:21.576467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76407da1-a138-4954-8732-2934e275ed7b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:21.577179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76407da1-a138-4954-8732-2934e275ed7b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:21.578813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76407da1-a138-4954-8732-2934e275ed7b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:21.579424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-76407da1-a138-4954-8732-2934e275ed7b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:22.173235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-76407da1-a138-4954-8732-2934e275ed7b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:22.189742 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-76407da1-a138-4954-8732-2934e275ed7b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1215 microversion: 2.1 time: 0.641730 Jul 20 04:41:22.193247 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2515/4778] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:21 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1215 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:22.208562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-8c1645ac-e633-45d6-ac90-163bdb15db7b req-771c2c75-050e-4751-9c16-6c5fd858c47b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27761b08-de0f-4d8a-aeee-289edee644b1", "tag": "7f2ff15a-f890-4618-8bf3-bf7c42afe26e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:22.234610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-41a44cdc-e70b-442f-9067-9da9d9f4e340 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:22.252545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-41a44cdc-e70b-442f-9067-9da9d9f4e340 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:22.258138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-41a44cdc-e70b-442f-9067-9da9d9f4e340 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:22.264305 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-41a44cdc-e70b-442f-9067-9da9d9f4e340 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1722 microversion: 2.20 time: 2.207776 Jul 20 04:41:22.265265 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2264/4779] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:20 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1722 bytes in 2212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:22.272923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8c1645ac-e633-45d6-ac90-163bdb15db7b req-771c2c75-050e-4751-9c16-6c5fd858c47b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:22.275328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5fbe6025-7a60-4e64-99b4-d3da460c636e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:22.276564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8c1645ac-e633-45d6-ac90-163bdb15db7b req-771c2c75-050e-4751-9c16-6c5fd858c47b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:22.292082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5fbe6025-7a60-4e64-99b4-d3da460c636e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:22.308309 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-8c1645ac-e633-45d6-ac90-163bdb15db7b req-771c2c75-050e-4751-9c16-6c5fd858c47b service nova] Creating event network-changed:7f2ff15a-f890-4618-8bf3-bf7c42afe26e for instance 27761b08-de0f-4d8a-aeee-289edee644b1 on n-h2-826526-5 Jul 20 04:41:22.323063 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-8c1645ac-e633-45d6-ac90-163bdb15db7b req-771c2c75-050e-4751-9c16-6c5fd858c47b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127156 Jul 20 04:41:22.323522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fbe6025-7a60-4e64-99b4-d3da460c636e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:22.324274 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2516/4780] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:22.324436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fbe6025-7a60-4e64-99b4-d3da460c636e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:22.326084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fbe6025-7a60-4e64-99b4-d3da460c636e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:22.327790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fbe6025-7a60-4e64-99b4-d3da460c636e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:22.330165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-532ff4da-f8f6-4a77-bb41-320ed7a57fe8 req-a742e9ad-e848-4639-802a-8d7c672c64d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7e62d3-1b07-483d-9943-887c096d4350", "name": "network-vif-unplugged", "status": "completed", "tag": "f03b37b1-bac2-405f-aeda-863d4b123005"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:22.349312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-532ff4da-f8f6-4a77-bb41-320ed7a57fe8 req-a742e9ad-e848-4639-802a-8d7c672c64d4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:22.353595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-532ff4da-f8f6-4a77-bb41-320ed7a57fe8 req-a742e9ad-e848-4639-802a-8d7c672c64d4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:22.374618 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-532ff4da-f8f6-4a77-bb41-320ed7a57fe8 req-a742e9ad-e848-4639-802a-8d7c672c64d4 service nova] Creating event network-vif-unplugged:f03b37b1-bac2-405f-aeda-863d4b123005 for instance 7c7e62d3-1b07-483d-9943-887c096d4350 on n-h1-826526-5 Jul 20 04:41:22.386752 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-532ff4da-f8f6-4a77-bb41-320ed7a57fe8 req-a742e9ad-e848-4639-802a-8d7c672c64d4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060862 Jul 20 04:41:22.388185 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2517/4781] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:22.564719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-439547f7-738f-42bc-922d-ada7bb8bdcfe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:22.565491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-439547f7-738f-42bc-922d-ada7bb8bdcfe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:22.580326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-439547f7-738f-42bc-922d-ada7bb8bdcfe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:22.580763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-439547f7-738f-42bc-922d-ada7bb8bdcfe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:22.581549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-439547f7-738f-42bc-922d-ada7bb8bdcfe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:22.581984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-439547f7-738f-42bc-922d-ada7bb8bdcfe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:22.716098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5fbe6025-7a60-4e64-99b4-d3da460c636e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:22.733126 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5fbe6025-7a60-4e64-99b4-d3da460c636e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.460046 Jul 20 04:41:22.736130 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2265/4782] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:22 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:22.748132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8e15e09f-d506-4c69-8feb-962a18f1b47d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-875516653", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea1fc563-a125-4bf9-b7c2-b42347467257"}], "security_groups": [{"name": "tempest-securitygroup--1293350659"}], "key_name": "tempest-keypair-1055539102", "user_data": "}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:22.955688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-439547f7-738f-42bc-922d-ada7bb8bdcfe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:22.967495 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-439547f7-738f-42bc-922d-ada7bb8bdcfe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1392 microversion: 2.1 time: 0.408089 Jul 20 04:41:22.968864 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2518/4783] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:22 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1392 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:22.983730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b672a9fc-ff27-44ea-89fb-a31b6f26eb17 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:22.985404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b672a9fc-ff27-44ea-89fb-a31b6f26eb17 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:22.996057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b672a9fc-ff27-44ea-89fb-a31b6f26eb17 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:22.997314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b672a9fc-ff27-44ea-89fb-a31b6f26eb17 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:22.998918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b672a9fc-ff27-44ea-89fb-a31b6f26eb17 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:22.999983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b672a9fc-ff27-44ea-89fb-a31b6f26eb17 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:23.097969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-8e15e09f-d506-4c69-8feb-962a18f1b47d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] validate_networks() for [('ea1fc563-a125-4bf9-b7c2-b42347467257', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:41:23.419260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b672a9fc-ff27-44ea-89fb-a31b6f26eb17 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:23.430571 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b672a9fc-ff27-44ea-89fb-a31b6f26eb17 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1669 microversion: 2.1 time: 0.452300 Jul 20 04:41:23.433283 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2519/4784] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:22 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1669 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:23.454185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d43e1612-b1a9-4466-821a-3c676e90e2e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:23.455163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d43e1612-b1a9-4466-821a-3c676e90e2e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:23.463436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d43e1612-b1a9-4466-821a-3c676e90e2e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:23.464470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d43e1612-b1a9-4466-821a-3c676e90e2e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:23.465561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d43e1612-b1a9-4466-821a-3c676e90e2e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:23.466244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d43e1612-b1a9-4466-821a-3c676e90e2e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:24.102725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:24.420487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8e15e09f-d506-4c69-8feb-962a18f1b47d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:41:24.421084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8e15e09f-d506-4c69-8feb-962a18f1b47d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:41:24.421518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8e15e09f-d506-4c69-8feb-962a18f1b47d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:41:24.421985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8e15e09f-d506-4c69-8feb-962a18f1b47d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:41:24.423310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8e15e09f-d506-4c69-8feb-962a18f1b47d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:41:24.443218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e15e09f-d506-4c69-8feb-962a18f1b47d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:24.443885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e15e09f-d506-4c69-8feb-962a18f1b47d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:24.444919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e15e09f-d506-4c69-8feb-962a18f1b47d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:24.445572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e15e09f-d506-4c69-8feb-962a18f1b47d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:24.485219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d43e1612-b1a9-4466-821a-3c676e90e2e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:24.491423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8e15e09f-d506-4c69-8feb-962a18f1b47d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Getting quotas for project 3e123ad99de64f50b9cd4373597c3a9e. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:41:24.498322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8e15e09f-d506-4c69-8feb-962a18f1b47d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Getting quotas for user 8ea213e79bcf4aaea49446db5eb55271 and project 3e123ad99de64f50b9cd4373597c3a9e. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:41:24.498503 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d43e1612-b1a9-4466-821a-3c676e90e2e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1215 microversion: 2.1 time: 1.047367 Jul 20 04:41:24.499434 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2520/4785] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:23 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1215 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:24.512751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e6a2ed62-55b2-4139-85cb-43f58e8b3c1e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:24.516963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e6a2ed62-55b2-4139-85cb-43f58e8b3c1e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:24.527433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8e15e09f-d506-4c69-8feb-962a18f1b47d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:41:24.533125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6a2ed62-55b2-4139-85cb-43f58e8b3c1e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:24.533730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6a2ed62-55b2-4139-85cb-43f58e8b3c1e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:24.534034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8e15e09f-d506-4c69-8feb-962a18f1b47d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:41:24.534574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6a2ed62-55b2-4139-85cb-43f58e8b3c1e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:24.535015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6a2ed62-55b2-4139-85cb-43f58e8b3c1e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:24.637250 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8e15e09f-d506-4c69-8feb-962a18f1b47d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.893837 Jul 20 04:41:24.638329 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2266/4786] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:41:22 2022] POST /compute/v2.1/servers => generated 409 bytes in 1901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:41:24.653850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fd2b4d48-a86e-4569-ae58-761033579451 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:24.654610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fd2b4d48-a86e-4569-ae58-761033579451 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:24.669490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd2b4d48-a86e-4569-ae58-761033579451 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:24.670314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd2b4d48-a86e-4569-ae58-761033579451 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:24.671479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd2b4d48-a86e-4569-ae58-761033579451 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:24.673918 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd2b4d48-a86e-4569-ae58-761033579451 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:24.732666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fd2b4d48-a86e-4569-ae58-761033579451 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:24.741802 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.compute.api [None req-fd2b4d48-a86e-4569-ae58-761033579451 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Working on deleting snapshot dab4d1c5-1e91-4294-a052-1fff394e3983 from shelved instance... Jul 20 04:41:25.724625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fd2b4d48-a86e-4569-ae58-761033579451 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Doing local delete in cell fbf41b76-8148-4f7f-88f5-d6fd988c2859(cell1) {{(pid=127870) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 20 04:41:25.726095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd2b4d48-a86e-4569-ae58-761033579451 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:25.726897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd2b4d48-a86e-4569-ae58-761033579451 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:25.727662 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.compute.api [None req-fd2b4d48-a86e-4569-ae58-761033579451 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 20 04:41:25.732154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-fd2b4d48-a86e-4569-ae58-761033579451 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] deallocate_for_instance() {{(pid=127870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 20 04:41:25.843022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e6a2ed62-55b2-4139-85cb-43f58e8b3c1e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:25.858734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e6a2ed62-55b2-4139-85cb-43f58e8b3c1e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:25.864542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e6a2ed62-55b2-4139-85cb-43f58e8b3c1e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:25.866122 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e6a2ed62-55b2-4139-85cb-43f58e8b3c1e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1665 microversion: 2.20 time: 1.363348 Jul 20 04:41:25.866718 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2521/4787] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:24 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1665 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:25.891560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8871a6c7-ce18-46f8-9e37-bb13e966df98 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:25.896810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8871a6c7-ce18-46f8-9e37-bb13e966df98 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:25.920796 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8871a6c7-ce18-46f8-9e37-bb13e966df98 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:25.921402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8871a6c7-ce18-46f8-9e37-bb13e966df98 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:25.922268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8871a6c7-ce18-46f8-9e37-bb13e966df98 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:25.922718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8871a6c7-ce18-46f8-9e37-bb13e966df98 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:26.521809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-fd2b4d48-a86e-4569-ae58-761033579451 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Updating instance_info_cache with network_info: [] {{(pid=127870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:41:26.925629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8871a6c7-ce18-46f8-9e37-bb13e966df98 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:26.934406 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8871a6c7-ce18-46f8-9e37-bb13e966df98 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1564 microversion: 2.1 time: 1.060973 Jul 20 04:41:26.946325 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2522/4788] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:25 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1564 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:26.950382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b97cb6e9-0791-4dd2-b209-030d4528daaa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:26.951004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b97cb6e9-0791-4dd2-b209-030d4528daaa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:26.968054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b97cb6e9-0791-4dd2-b209-030d4528daaa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:26.968640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b97cb6e9-0791-4dd2-b209-030d4528daaa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:26.969547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b97cb6e9-0791-4dd2-b209-030d4528daaa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:26.969989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b97cb6e9-0791-4dd2-b209-030d4528daaa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:27.049983 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fd2b4d48-a86e-4569-ae58-761033579451 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "DELETE /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 204 len: 0 microversion: 2.1 time: 2.410038 Jul 20 04:41:27.052854 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2267/4789] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:24 2022] DELETE /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 0 bytes in 2414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:27.058564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-00b5a85f-ea46-4349-a059-f2910cc5e383 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:27.059463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-00b5a85f-ea46-4349-a059-f2910cc5e383 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:27.070740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00b5a85f-ea46-4349-a059-f2910cc5e383 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:27.072652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00b5a85f-ea46-4349-a059-f2910cc5e383 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:27.074354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00b5a85f-ea46-4349-a059-f2910cc5e383 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:27.075008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00b5a85f-ea46-4349-a059-f2910cc5e383 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:27.111536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-00b5a85f-ea46-4349-a059-f2910cc5e383 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:27.130892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b97cb6e9-0791-4dd2-b209-030d4528daaa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:27.139846 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b97cb6e9-0791-4dd2-b209-030d4528daaa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1303 microversion: 2.1 time: 0.193845 Jul 20 04:41:27.150943 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2523/4790] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:26 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1303 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:27.155975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5a81e4ed-b499-43b2-adb1-082aef38ff67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:27.163227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5a81e4ed-b499-43b2-adb1-082aef38ff67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:27.175148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a81e4ed-b499-43b2-adb1-082aef38ff67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:27.182214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a81e4ed-b499-43b2-adb1-082aef38ff67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:27.183176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a81e4ed-b499-43b2-adb1-082aef38ff67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:27.184938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a81e4ed-b499-43b2-adb1-082aef38ff67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:27.273087 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-00b5a85f-ea46-4349-a059-f2910cc5e383 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "DELETE /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 204 len: 0 microversion: 2.1 time: 0.218357 Jul 20 04:41:27.276528 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2268/4791] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:27 2022] DELETE /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:27.293193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94414dde-739d-4a6b-99b7-9939a1cbd765 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5577d205-6fa3-4b22-b03c-e9f008142f74"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:27.295173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-94414dde-739d-4a6b-99b7-9939a1cbd765 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:27.304182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94414dde-739d-4a6b-99b7-9939a1cbd765 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:27.304999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94414dde-739d-4a6b-99b7-9939a1cbd765 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:27.305960 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94414dde-739d-4a6b-99b7-9939a1cbd765 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:27.306704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94414dde-739d-4a6b-99b7-9939a1cbd765 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:27.631416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5a81e4ed-b499-43b2-adb1-082aef38ff67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:27.649361 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5a81e4ed-b499-43b2-adb1-082aef38ff67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1215 microversion: 2.1 time: 0.497221 Jul 20 04:41:27.650606 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2524/4792] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:27 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1215 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:27.774151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-f443dba5-a7f5-41c3-bb77-6aaf397fbed7 req-704c0cd4-a139-4d16-a994-53887a63d0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99542ac6-6ecb-4e86-9645-9c2b5dbadf5c", "name": "network-vif-deleted", "tag": "d41ade7e-d3ba-4a3c-bd8d-16200a60e5d8"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:27.790730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f443dba5-a7f5-41c3-bb77-6aaf397fbed7 req-704c0cd4-a139-4d16-a994-53887a63d0c6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:27.791182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f443dba5-a7f5-41c3-bb77-6aaf397fbed7 req-704c0cd4-a139-4d16-a994-53887a63d0c6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:27.816974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.compute.server_external_events [req-f443dba5-a7f5-41c3-bb77-6aaf397fbed7 req-704c0cd4-a139-4d16-a994-53887a63d0c6 service nova] Unable to find a host for instance 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c. Dropping event network-vif-deleted {{(pid=127871) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 04:41:27.818905 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-f443dba5-a7f5-41c3-bb77-6aaf397fbed7 req-704c0cd4-a139-4d16-a994-53887a63d0c6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.167050 Jul 20 04:41:27.819819 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2525/4793] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 168 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 04:41:27.824653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b4946962-0c2c-4903-b46c-ee2e9a68b952 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:27.837138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b4946962-0c2c-4903-b46c-ee2e9a68b952 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:27.843679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4946962-0c2c-4903-b46c-ee2e9a68b952 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:27.844134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4946962-0c2c-4903-b46c-ee2e9a68b952 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:27.844951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4946962-0c2c-4903-b46c-ee2e9a68b952 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:27.845382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4946962-0c2c-4903-b46c-ee2e9a68b952 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:27.878353 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=21,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:27.900515 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-94414dde-739d-4a6b-99b7-9939a1cbd765 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "POST /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.617323 Jul 20 04:41:27.901766 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2269/4794] 10.222.0.17 () {62 vars in 1363 bytes} [Wed Jul 20 04:41:27 2022] POST /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350/os-volume_attachments => generated 188 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:41:27.916086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d1990dce-6d28-4f8d-8faf-4545a544083d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:27.917250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d1990dce-6d28-4f8d-8faf-4545a544083d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:27.929039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1990dce-6d28-4f8d-8faf-4545a544083d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:27.930044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1990dce-6d28-4f8d-8faf-4545a544083d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:27.931239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1990dce-6d28-4f8d-8faf-4545a544083d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:27.932163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1990dce-6d28-4f8d-8faf-4545a544083d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:27.952679 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-d1990dce-6d28-4f8d-8faf-4545a544083d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] HTTP exception thrown: Instance 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c could not be found. Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d1990dce-6d28-4f8d-8faf-4545a544083d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Request method failure captured: Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c HTTP/1.1 Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14VixHJkebixphdIwpShDcg3JlaVhM2CoSLlprTWiwLn49pCahdWzlOL7MmtUDivVfw4m6kI4BuKlP27BpI0P2VGSTH9CmZ2MDFgZIfQUKwMAzgmxiYhzCfBZQgehacwrRr-TbEtnIcKT7h1-1gllEV5AaLRk0CzcCXpWksXa6-Jd-I Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: fcd6c40faa19476db37fa7897dea5840 Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerActionsTestJSON-1614718281 Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcd6c40faa19476db37fa7897dea5840"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fcd6c40faa19476db37fa7897dea5840"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fcd6c40faa19476db37fa7897dea5840", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcd6c40faa19476db37fa7897dea5840"}]}] Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerActionsTestJSON-1614718281 Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: fcd6c40faa19476db37fa7897dea5840 Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerActionsTestJSON-1614718281 Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerActionsTestJSON-1614718281-project Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f50ac97f2ef04752bd49148748e39eb8 Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerActionsTestJSON-1614718281-project Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c could not be found. Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '99542ac6-6ecb-4e86-9645-9c2b5dbadf5c'} Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c could not be found. Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c could not be found. Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:27.954471 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:27.961089 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:27.961089 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:27.961089 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:27.961089 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:27.961089 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:27.961089 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c could not be found. Jul 20 04:41:27.961089 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:27.961089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d1990dce-6d28-4f8d-8faf-4545a544083d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Returning 404 to user: Instance 99542ac6-6ecb-4e86-9645-9c2b5dbadf5c could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:27.961089 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d1990dce-6d28-4f8d-8faf-4545a544083d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c" status: 404 len: 111 microversion: 2.1 time: 0.052107 Jul 20 04:41:27.961089 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2270/4795] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:27 2022] GET /compute/v2.1/servers/99542ac6-6ecb-4e86-9645-9c2b5dbadf5c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:27.965356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f69a2fad-bff1-4788-95c2-f31be19786a7 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:27.965972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f69a2fad-bff1-4788-95c2-f31be19786a7 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:27.974370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f69a2fad-bff1-4788-95c2-f31be19786a7 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:27.975130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f69a2fad-bff1-4788-95c2-f31be19786a7 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:27.976150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f69a2fad-bff1-4788-95c2-f31be19786a7 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:27.976644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f69a2fad-bff1-4788-95c2-f31be19786a7 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:28.205177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f69a2fad-bff1-4788-95c2-f31be19786a7 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:28.215854 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f69a2fad-bff1-4788-95c2-f31be19786a7 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 200 len: 1551 microversion: 2.1 time: 0.254645 Jul 20 04:41:28.216837 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2271/4796] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:27 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 1551 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:28.221998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b4946962-0c2c-4903-b46c-ee2e9a68b952 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:28.232228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f50e72c2-d1a5-405d-8623-550bfb476741 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:28.239581 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b4946962-0c2c-4903-b46c-ee2e9a68b952 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1564 microversion: 2.1 time: 0.410345 Jul 20 04:41:28.240323 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2526/4797] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:27 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1564 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:28.245060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f50e72c2-d1a5-405d-8623-550bfb476741 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:28.246893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fd6e336f-8d57-418a-ba6f-9a6244a0ddb6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:28.250289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fd6e336f-8d57-418a-ba6f-9a6244a0ddb6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:28.252313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f50e72c2-d1a5-405d-8623-550bfb476741 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:28.252767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f50e72c2-d1a5-405d-8623-550bfb476741 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:28.253564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f50e72c2-d1a5-405d-8623-550bfb476741 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:28.253999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f50e72c2-d1a5-405d-8623-550bfb476741 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:28.263219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd6e336f-8d57-418a-ba6f-9a6244a0ddb6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:28.264140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd6e336f-8d57-418a-ba6f-9a6244a0ddb6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:28.265601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd6e336f-8d57-418a-ba6f-9a6244a0ddb6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:28.266502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd6e336f-8d57-418a-ba6f-9a6244a0ddb6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:28.317077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f50e72c2-d1a5-405d-8623-550bfb476741 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:28.428446 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f50e72c2-d1a5-405d-8623-550bfb476741 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 204 len: 0 microversion: 2.1 time: 0.201984 Jul 20 04:41:28.432979 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2272/4798] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:28 2022] DELETE /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:28.440719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-908d2428-e2fc-49be-bbc4-e4777359ad12 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:28.441566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-908d2428-e2fc-49be-bbc4-e4777359ad12 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:28.449148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-908d2428-e2fc-49be-bbc4-e4777359ad12 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:28.449735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-908d2428-e2fc-49be-bbc4-e4777359ad12 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:28.450695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-908d2428-e2fc-49be-bbc4-e4777359ad12 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:28.451084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-908d2428-e2fc-49be-bbc4-e4777359ad12 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:28.605756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-908d2428-e2fc-49be-bbc4-e4777359ad12 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:28.616365 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-908d2428-e2fc-49be-bbc4-e4777359ad12 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1303 microversion: 2.1 time: 0.181344 Jul 20 04:41:28.618031 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2273/4799] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:28 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1303 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:28.625972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-79770ac4-d421-4760-9b4a-b1e0656bfca4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:28.627988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-79770ac4-d421-4760-9b4a-b1e0656bfca4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:28.654141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79770ac4-d421-4760-9b4a-b1e0656bfca4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:28.654919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79770ac4-d421-4760-9b4a-b1e0656bfca4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:28.656038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79770ac4-d421-4760-9b4a-b1e0656bfca4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:28.656861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79770ac4-d421-4760-9b4a-b1e0656bfca4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:28.690261 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:28.696975 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fd6e336f-8d57-418a-ba6f-9a6244a0ddb6 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350/os-volume_attachments/5577d205-6fa3-4b22-b03c-e9f008142f74" status: 202 len: 0 microversion: 2.20 time: 0.454595 Jul 20 04:41:28.697863 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2527/4800] 10.222.0.17 () {60 vars in 1456 bytes} [Wed Jul 20 04:41:28 2022] DELETE /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350/os-volume_attachments/5577d205-6fa3-4b22-b03c-e9f008142f74 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:28.719366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f35a378a-c5a2-479e-b282-051464e12f3e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:28.720376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f35a378a-c5a2-479e-b282-051464e12f3e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:28.729166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f35a378a-c5a2-479e-b282-051464e12f3e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:28.730641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f35a378a-c5a2-479e-b282-051464e12f3e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:28.734565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f35a378a-c5a2-479e-b282-051464e12f3e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:28.735832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f35a378a-c5a2-479e-b282-051464e12f3e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:28.885455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-79770ac4-d421-4760-9b4a-b1e0656bfca4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:28.903737 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-79770ac4-d421-4760-9b4a-b1e0656bfca4 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 200 len: 1466 microversion: 2.1 time: 0.281301 Jul 20 04:41:28.915631 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2274/4801] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:28 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 1466 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:28.917327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-06ea5268-0c6f-41ce-84fa-193173b4641b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:28.918072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-06ea5268-0c6f-41ce-84fa-193173b4641b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:28.950352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06ea5268-0c6f-41ce-84fa-193173b4641b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:28.951431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06ea5268-0c6f-41ce-84fa-193173b4641b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:28.952427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06ea5268-0c6f-41ce-84fa-193173b4641b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:28.952979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06ea5268-0c6f-41ce-84fa-193173b4641b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:29.120898 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-06ea5268-0c6f-41ce-84fa-193173b4641b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "POST /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350/action" status: 202 len: 0 microversion: 2.20 time: 0.211125 Jul 20 04:41:29.127025 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2275/4802] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jul 20 04:41:28 2022] POST /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:29.135524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-92f453bc-9c4e-4396-9535-dda4ef351e2b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:29.136681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-92f453bc-9c4e-4396-9535-dda4ef351e2b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:29.146024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92f453bc-9c4e-4396-9535-dda4ef351e2b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:29.146362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92f453bc-9c4e-4396-9535-dda4ef351e2b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:29.148907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92f453bc-9c4e-4396-9535-dda4ef351e2b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:29.148907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92f453bc-9c4e-4396-9535-dda4ef351e2b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:29.187629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f35a378a-c5a2-479e-b282-051464e12f3e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:29.204832 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f35a378a-c5a2-479e-b282-051464e12f3e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1203 microversion: 2.1 time: 0.502982 Jul 20 04:41:29.205830 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2528/4803] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:28 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1203 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:29.238501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-16eb9a43-89d7-4ca6-a0dd-bd236f5815b4 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:29.240174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-16eb9a43-89d7-4ca6-a0dd-bd236f5815b4 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:29.264882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-16eb9a43-89d7-4ca6-a0dd-bd236f5815b4 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:29.266020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-16eb9a43-89d7-4ca6-a0dd-bd236f5815b4 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:29.267125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-16eb9a43-89d7-4ca6-a0dd-bd236f5815b4 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:29.268134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-16eb9a43-89d7-4ca6-a0dd-bd236f5815b4 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:29.586892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-16eb9a43-89d7-4ca6-a0dd-bd236f5815b4 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:29.595636 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-16eb9a43-89d7-4ca6-a0dd-bd236f5815b4 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 200 len: 1484 microversion: 2.1 time: 0.364010 Jul 20 04:41:29.596899 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2529/4804] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:29 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 1484 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:29.650397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5011abe5-9aff-412b-9e6d-099b004299f1 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:29.652847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5011abe5-9aff-412b-9e6d-099b004299f1 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:29.654959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-92f453bc-9c4e-4396-9535-dda4ef351e2b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:29.668190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-92f453bc-9c4e-4396-9535-dda4ef351e2b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:29.669726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-92f453bc-9c4e-4396-9535-dda4ef351e2b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:29.676286 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-92f453bc-9c4e-4396-9535-dda4ef351e2b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1673 microversion: 2.20 time: 0.547802 Jul 20 04:41:29.687694 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2276/4805] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:29 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1673 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:29.688100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5011abe5-9aff-412b-9e6d-099b004299f1 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:29.688603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5011abe5-9aff-412b-9e6d-099b004299f1 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:29.689495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5011abe5-9aff-412b-9e6d-099b004299f1 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:29.691455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5011abe5-9aff-412b-9e6d-099b004299f1 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:29.844025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-825dd9e5-00d2-44e4-a262-8e1136ebd9ed req-b59e13dc-4d33-4e18-a1b4-054a33b01111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99", "name": "network-vif-deleted", "tag": "3f833ad4-3bc9-46b1-8894-6763e4cd4d05"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:29.848106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:29.870524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-825dd9e5-00d2-44e4-a262-8e1136ebd9ed req-b59e13dc-4d33-4e18-a1b4-054a33b01111 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:29.871108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-825dd9e5-00d2-44e4-a262-8e1136ebd9ed req-b59e13dc-4d33-4e18-a1b4-054a33b01111 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:29.902944 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-825dd9e5-00d2-44e4-a262-8e1136ebd9ed req-b59e13dc-4d33-4e18-a1b4-054a33b01111 service nova] Creating event network-vif-deleted:3f833ad4-3bc9-46b1-8894-6763e4cd4d05 for instance 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 on n-h1-826526-5 Jul 20 04:41:29.911062 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-825dd9e5-00d2-44e4-a262-8e1136ebd9ed req-b59e13dc-4d33-4e18-a1b4-054a33b01111 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071074 Jul 20 04:41:29.912444 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2277/4806] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:29.936692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-057f67f9-4617-4709-ad8f-6eea22047420 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:29.941767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-057f67f9-4617-4709-ad8f-6eea22047420 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:29.953502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-057f67f9-4617-4709-ad8f-6eea22047420 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:29.954841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-057f67f9-4617-4709-ad8f-6eea22047420 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:29.955820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-057f67f9-4617-4709-ad8f-6eea22047420 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:29.956408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-057f67f9-4617-4709-ad8f-6eea22047420 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:30.135074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-057f67f9-4617-4709-ad8f-6eea22047420 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:30.150223 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-057f67f9-4617-4709-ad8f-6eea22047420 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 200 len: 1466 microversion: 2.1 time: 0.229545 Jul 20 04:41:30.152843 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2278/4807] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:29 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 1466 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:30.225227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2cacc057-4cb0-4f11-9dbe-e2be8e5d3e83 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:30.225915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2cacc057-4cb0-4f11-9dbe-e2be8e5d3e83 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:30.238370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cacc057-4cb0-4f11-9dbe-e2be8e5d3e83 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:30.240517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cacc057-4cb0-4f11-9dbe-e2be8e5d3e83 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:30.244363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cacc057-4cb0-4f11-9dbe-e2be8e5d3e83 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:30.244943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cacc057-4cb0-4f11-9dbe-e2be8e5d3e83 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:30.502312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2cacc057-4cb0-4f11-9dbe-e2be8e5d3e83 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:30.515248 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2cacc057-4cb0-4f11-9dbe-e2be8e5d3e83 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1203 microversion: 2.1 time: 0.295772 Jul 20 04:41:30.530594 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2279/4808] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:30 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1203 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:30.616882 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-16cbd502-c0ee-462f-8bee-4ba995f70d6c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:30.617803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-16cbd502-c0ee-462f-8bee-4ba995f70d6c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:30.625414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16cbd502-c0ee-462f-8bee-4ba995f70d6c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:30.626324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16cbd502-c0ee-462f-8bee-4ba995f70d6c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:30.627307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16cbd502-c0ee-462f-8bee-4ba995f70d6c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:30.627777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16cbd502-c0ee-462f-8bee-4ba995f70d6c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:30.647932 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-16cbd502-c0ee-462f-8bee-4ba995f70d6c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] HTTP exception thrown: Instance 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 could not be found. Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-16cbd502-c0ee-462f-8bee-4ba995f70d6c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Request method failure captured: Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 HTTP/1.1 Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14biZ-lKuc8od4z-gDs7ibcjbpjbY-pO84cjRlWJrDLcgLsU69sxA2H3n6BaTvHZ67KSZSohA3lrrioyOsX40joFp6Jhnf9K_l3pzm_UYtlKZByQxgI-c8JWg1t0HjkzxL-aco80Bfx_lPnqGnEDDmiLhrNA4N-0tlVLIZEURaqN2lI Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c9b5d48d9c894a32b3f417820f43427e Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestNetworkBasicOps-225432984 Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9b5d48d9c894a32b3f417820f43427e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c9b5d48d9c894a32b3f417820f43427e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c9b5d48d9c894a32b3f417820f43427e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9b5d48d9c894a32b3f417820f43427e"}]}] Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestNetworkBasicOps-225432984 Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c9b5d48d9c894a32b3f417820f43427e Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestNetworkBasicOps-225432984 Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestNetworkBasicOps-225432984-project Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 43a4b4fa5cc24463aa398fbc4e1404d4 Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestNetworkBasicOps-225432984-project Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 could not be found. Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99'} Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 could not be found. Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 could not be found. Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:30.649415 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:30.659291 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:30.659291 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:30.659291 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:30.659291 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:30.659291 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:30.659291 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 could not be found. Jul 20 04:41:30.659291 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:30.659291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-16cbd502-c0ee-462f-8bee-4ba995f70d6c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Returning 404 to user: Instance 85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:30.659291 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-16cbd502-c0ee-462f-8bee-4ba995f70d6c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99" status: 404 len: 111 microversion: 2.1 time: 0.040875 Jul 20 04:41:30.664787 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2280/4809] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:30 2022] GET /compute/v2.1/servers/85e445dd-ef1c-4e94-a5d8-bfdb2b8d4e99 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:30.696978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aac14591-29fc-4634-8044-c40378db767a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:30.697858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aac14591-29fc-4634-8044-c40378db767a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:30.712514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aac14591-29fc-4634-8044-c40378db767a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:30.713333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aac14591-29fc-4634-8044-c40378db767a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:30.714331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aac14591-29fc-4634-8044-c40378db767a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:30.715122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aac14591-29fc-4634-8044-c40378db767a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:30.994344 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aac14591-29fc-4634-8044-c40378db767a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:31.012613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aac14591-29fc-4634-8044-c40378db767a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:31.015077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aac14591-29fc-4634-8044-c40378db767a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:31.018658 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aac14591-29fc-4634-8044-c40378db767a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1675 microversion: 2.20 time: 0.325283 Jul 20 04:41:31.019308 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2281/4810] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:30 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1675 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:31.039522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-682ddbc3-e816-4eba-b95b-6aa45d218ca3 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '.version_select at 0x7f06bcde5310>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:31.075343 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-682ddbc3-e816-4eba-b95b-6aa45d218ca3 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1680861584" status: 202 len: 0 microversion: 2.1 time: 0.040436 Jul 20 04:41:31.079864 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2282/4811] 10.222.0.17 () {58 vars in 1256 bytes} [Wed Jul 20 04:41:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1680861584 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:41:31.132401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5011abe5-9aff-412b-9e6d-099b004299f1 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:31.146668 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5011abe5-9aff-412b-9e6d-099b004299f1 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1371 microversion: 2.1 time: 1.506385 Jul 20 04:41:31.147361 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2530/4812] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:29 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1371 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:31.170302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-54d7101f-4e88-4c0a-a3a5-6f57af95067b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:31.171005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-54d7101f-4e88-4c0a-a3a5-6f57af95067b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:31.177311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54d7101f-4e88-4c0a-a3a5-6f57af95067b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:31.178026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54d7101f-4e88-4c0a-a3a5-6f57af95067b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:31.179271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54d7101f-4e88-4c0a-a3a5-6f57af95067b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:31.179947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54d7101f-4e88-4c0a-a3a5-6f57af95067b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:31.385064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-54d7101f-4e88-4c0a-a3a5-6f57af95067b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:31.400530 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-54d7101f-4e88-4c0a-a3a5-6f57af95067b tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 200 len: 1466 microversion: 2.1 time: 0.233269 Jul 20 04:41:31.402363 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2283/4813] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:31 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 1466 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:31.541439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6999f894-2c4b-4646-9abb-8a69b70b6317 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:31.542067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6999f894-2c4b-4646-9abb-8a69b70b6317 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:31.555730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6999f894-2c4b-4646-9abb-8a69b70b6317 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:31.556191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6999f894-2c4b-4646-9abb-8a69b70b6317 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:31.557044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6999f894-2c4b-4646-9abb-8a69b70b6317 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:31.557486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6999f894-2c4b-4646-9abb-8a69b70b6317 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:31.929311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6999f894-2c4b-4646-9abb-8a69b70b6317 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:31.947901 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6999f894-2c4b-4646-9abb-8a69b70b6317 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1203 microversion: 2.1 time: 0.410595 Jul 20 04:41:31.953096 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2531/4814] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:31 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1203 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:32.039198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d911551a-1514-4228-b975-76421966f25a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:32.041073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d911551a-1514-4228-b975-76421966f25a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:32.057959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d911551a-1514-4228-b975-76421966f25a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.058801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d911551a-1514-4228-b975-76421966f25a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:32.059905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d911551a-1514-4228-b975-76421966f25a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.066249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d911551a-1514-4228-b975-76421966f25a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:32.166971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f771aa7b-8edd-4a2b-b36f-11968b20c909 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:32.167724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f771aa7b-8edd-4a2b-b36f-11968b20c909 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:32.174376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f771aa7b-8edd-4a2b-b36f-11968b20c909 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.175167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f771aa7b-8edd-4a2b-b36f-11968b20c909 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:32.177151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f771aa7b-8edd-4a2b-b36f-11968b20c909 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.177795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f771aa7b-8edd-4a2b-b36f-11968b20c909 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:32.574333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d911551a-1514-4228-b975-76421966f25a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:32.588900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d911551a-1514-4228-b975-76421966f25a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:32.590439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d911551a-1514-4228-b975-76421966f25a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:32.591690 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d911551a-1514-4228-b975-76421966f25a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1731 microversion: 2.20 time: 0.557728 Jul 20 04:41:32.596286 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2284/4815] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:32 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1731 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:32.606794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f9ba6bc6-ac42-465e-a03a-1d67f60d2627 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:32.607856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f9ba6bc6-ac42-465e-a03a-1d67f60d2627 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:32.633975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9ba6bc6-ac42-465e-a03a-1d67f60d2627 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.634723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9ba6bc6-ac42-465e-a03a-1d67f60d2627 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:32.636487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9ba6bc6-ac42-465e-a03a-1d67f60d2627 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.637109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9ba6bc6-ac42-465e-a03a-1d67f60d2627 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:32.810380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f9ba6bc6-ac42-465e-a03a-1d67f60d2627 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:32.830433 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f9ba6bc6-ac42-465e-a03a-1d67f60d2627 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 200 len: 1466 microversion: 2.1 time: 0.223990 Jul 20 04:41:32.834026 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2285/4816] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:32 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 1466 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:32.838870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-6fd0779d-3eef-40b0-bda1-a5ce3b93f0aa req-6d23e329-026a-4b31-9ce2-da8e386bf93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc48e56-31bb-4f80-8f4f-4f79975d9fc9", "name": "network-vif-deleted", "tag": "ddb1afcf-7726-4111-8880-0d1619ad0891"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:32.868006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6fd0779d-3eef-40b0-bda1-a5ce3b93f0aa req-6d23e329-026a-4b31-9ce2-da8e386bf93b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.868752 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6fd0779d-3eef-40b0-bda1-a5ce3b93f0aa req-6d23e329-026a-4b31-9ce2-da8e386bf93b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:32.891559 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-6fd0779d-3eef-40b0-bda1-a5ce3b93f0aa req-6d23e329-026a-4b31-9ce2-da8e386bf93b service nova] Creating event network-vif-deleted:ddb1afcf-7726-4111-8880-0d1619ad0891 for instance 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 on n-h2-826526-5 Jul 20 04:41:32.899876 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-6fd0779d-3eef-40b0-bda1-a5ce3b93f0aa req-6d23e329-026a-4b31-9ce2-da8e386bf93b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064554 Jul 20 04:41:32.901131 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2286/4817] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:32.970644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2b539261-879a-43ab-9ab9-faebf66d567b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:32.971116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2b539261-879a-43ab-9ab9-faebf66d567b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:32.989057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b539261-879a-43ab-9ab9-faebf66d567b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.989510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b539261-879a-43ab-9ab9-faebf66d567b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:32.990370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b539261-879a-43ab-9ab9-faebf66d567b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.990769 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b539261-879a-43ab-9ab9-faebf66d567b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:33.030768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:33.148908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f771aa7b-8edd-4a2b-b36f-11968b20c909 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:33.189329 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f771aa7b-8edd-4a2b-b36f-11968b20c909 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1371 microversion: 2.1 time: 0.998410 Jul 20 04:41:33.191624 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2532/4818] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:32 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1371 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:33.361500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2b539261-879a-43ab-9ab9-faebf66d567b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:33.373731 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2b539261-879a-43ab-9ab9-faebf66d567b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1203 microversion: 2.1 time: 0.407704 Jul 20 04:41:33.375902 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2287/4819] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:32 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1203 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:33.640586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1f6c25af-8da1-4b67-9e51-e597f9be2c3b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:33.641666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1f6c25af-8da1-4b67-9e51-e597f9be2c3b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:33.688151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f6c25af-8da1-4b67-9e51-e597f9be2c3b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:33.688809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f6c25af-8da1-4b67-9e51-e597f9be2c3b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:33.689891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f6c25af-8da1-4b67-9e51-e597f9be2c3b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:33.690635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f6c25af-8da1-4b67-9e51-e597f9be2c3b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:33.852894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-865d664a-1f21-4dd0-8da4-3459a73d8815 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:33.853509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-865d664a-1f21-4dd0-8da4-3459a73d8815 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:33.863516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-865d664a-1f21-4dd0-8da4-3459a73d8815 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:33.863970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-865d664a-1f21-4dd0-8da4-3459a73d8815 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:33.864882 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-865d664a-1f21-4dd0-8da4-3459a73d8815 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:33.865322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-865d664a-1f21-4dd0-8da4-3459a73d8815 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:33.911306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-865d664a-1f21-4dd0-8da4-3459a73d8815 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:33.911989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-865d664a-1f21-4dd0-8da4-3459a73d8815 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:33.913208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-865d664a-1f21-4dd0-8da4-3459a73d8815 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lazy-loading 'fault' on Instance uuid 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:41:34.020171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-865d664a-1f21-4dd0-8da4-3459a73d8815 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:34.035969 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-865d664a-1f21-4dd0-8da4-3459a73d8815 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 200 len: 1305 microversion: 2.1 time: 0.187654 Jul 20 04:41:34.038358 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2288/4820] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:33 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 1305 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:34.210494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-720ddcb7-f9e5-498c-a565-79e0a2ca3f8b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:34.211219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-720ddcb7-f9e5-498c-a565-79e0a2ca3f8b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:34.220532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-720ddcb7-f9e5-498c-a565-79e0a2ca3f8b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:34.225492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-720ddcb7-f9e5-498c-a565-79e0a2ca3f8b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:34.226667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-720ddcb7-f9e5-498c-a565-79e0a2ca3f8b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:34.228819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-720ddcb7-f9e5-498c-a565-79e0a2ca3f8b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:34.408410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1f6c25af-8da1-4b67-9e51-e597f9be2c3b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:34.431916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1f6c25af-8da1-4b67-9e51-e597f9be2c3b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:34.435102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1f6c25af-8da1-4b67-9e51-e597f9be2c3b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:34.446350 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1f6c25af-8da1-4b67-9e51-e597f9be2c3b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1731 microversion: 2.20 time: 0.837519 Jul 20 04:41:34.447021 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2533/4821] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:33 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1731 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:34.452715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b75b0109-9341-4be7-b8fd-4e1d1a912a12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:34.457018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b75b0109-9341-4be7-b8fd-4e1d1a912a12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:34.471165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:34.478728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b75b0109-9341-4be7-b8fd-4e1d1a912a12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:34.480789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b75b0109-9341-4be7-b8fd-4e1d1a912a12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:34.481868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b75b0109-9341-4be7-b8fd-4e1d1a912a12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:34.485000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b75b0109-9341-4be7-b8fd-4e1d1a912a12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:34.518554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:34.679925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-720ddcb7-f9e5-498c-a565-79e0a2ca3f8b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:34.690583 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-720ddcb7-f9e5-498c-a565-79e0a2ca3f8b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1371 microversion: 2.1 time: 0.484548 Jul 20 04:41:34.704328 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2289/4822] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:34 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1371 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:35.057164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c0b90e8a-0b28-4245-adc1-665a63040764 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:35.059159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c0b90e8a-0b28-4245-adc1-665a63040764 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:35.075352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0b90e8a-0b28-4245-adc1-665a63040764 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:35.086726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0b90e8a-0b28-4245-adc1-665a63040764 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:35.096537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0b90e8a-0b28-4245-adc1-665a63040764 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:35.098391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0b90e8a-0b28-4245-adc1-665a63040764 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:35.152238 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-c0b90e8a-0b28-4245-adc1-665a63040764 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] HTTP exception thrown: Instance 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 could not be found. Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c0b90e8a-0b28-4245-adc1-665a63040764 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Request method failure captured: Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 HTTP/1.1 Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14VixHJkebixphdIwpShDcg3JlaVhM2CoSLlprTWiwLn49pCahdWzlOL7MmtUDivVfw4m6kI4BuKlP27BpI0P2VGSTH9CmZ2MDFgZIfQUKwMAzgmxiYhzCfBZQgehacwrRr-TbEtnIcKT7h1-1gllEV5AaLRk0CzcCXpWksXa6-Jd-I Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: fcd6c40faa19476db37fa7897dea5840 Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerActionsTestJSON-1614718281 Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcd6c40faa19476db37fa7897dea5840"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fcd6c40faa19476db37fa7897dea5840"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fcd6c40faa19476db37fa7897dea5840", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcd6c40faa19476db37fa7897dea5840"}]}] Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerActionsTestJSON-1614718281 Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: fcd6c40faa19476db37fa7897dea5840 Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerActionsTestJSON-1614718281 Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerActionsTestJSON-1614718281-project Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f50ac97f2ef04752bd49148748e39eb8 Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerActionsTestJSON-1614718281-project Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 could not be found. Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '1bc48e56-31bb-4f80-8f4f-4f79975d9fc9'} Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 could not be found. Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 could not be found. Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:35.154491 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:35.158643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:35.158643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:35.158643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:35.158643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:35.158643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:35.158643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 could not be found. Jul 20 04:41:35.158643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:35.169475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c0b90e8a-0b28-4245-adc1-665a63040764 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Returning 404 to user: Instance 1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:35.170645 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c0b90e8a-0b28-4245-adc1-665a63040764 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9" status: 404 len: 111 microversion: 2.1 time: 0.118004 Jul 20 04:41:35.180690 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2290/4823] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:35 2022] GET /compute/v2.1/servers/1bc48e56-31bb-4f80-8f4f-4f79975d9fc9 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:41:35.186179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ef4a9cde-320f-4999-aa2a-005b4008fd1e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:35.202735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ef4a9cde-320f-4999-aa2a-005b4008fd1e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:35.225860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef4a9cde-320f-4999-aa2a-005b4008fd1e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:35.231336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef4a9cde-320f-4999-aa2a-005b4008fd1e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:35.235383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef4a9cde-320f-4999-aa2a-005b4008fd1e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:35.236313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef4a9cde-320f-4999-aa2a-005b4008fd1e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:35.329381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ef4a9cde-320f-4999-aa2a-005b4008fd1e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:35.635830 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ef4a9cde-320f-4999-aa2a-005b4008fd1e tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 204 len: 0 microversion: 2.1 time: 0.451543 Jul 20 04:41:35.637984 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2291/4824] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:35 2022] DELETE /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:35.650758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-5d4d5b71-e43f-4917-8743-26e6f1e319eb req-5abd0be1-6279-421b-8fd8-9ee48f9a6d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "085f0971-9269-4d32-8eeb-17e7bf8143c2", "tag": "52337d8b-3bd5-408a-b197-2f38bf1e0818"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:35.675741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5d4d5b71-e43f-4917-8743-26e6f1e319eb req-5abd0be1-6279-421b-8fd8-9ee48f9a6d64 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:35.676440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5d4d5b71-e43f-4917-8743-26e6f1e319eb req-5abd0be1-6279-421b-8fd8-9ee48f9a6d64 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:35.710356 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-5d4d5b71-e43f-4917-8743-26e6f1e319eb req-5abd0be1-6279-421b-8fd8-9ee48f9a6d64 service nova] Creating event network-changed:52337d8b-3bd5-408a-b197-2f38bf1e0818 for instance 085f0971-9269-4d32-8eeb-17e7bf8143c2 on n-h1-826526-5 Jul 20 04:41:35.724354 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-5d4d5b71-e43f-4917-8743-26e6f1e319eb req-5abd0be1-6279-421b-8fd8-9ee48f9a6d64 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082712 Jul 20 04:41:35.725547 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2292/4825] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:35.731838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b9e31222-d813-4c6f-b667-895d6fd663e8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:35.745491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b9e31222-d813-4c6f-b667-895d6fd663e8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:35.753377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9e31222-d813-4c6f-b667-895d6fd663e8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:35.754722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9e31222-d813-4c6f-b667-895d6fd663e8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:35.755681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9e31222-d813-4c6f-b667-895d6fd663e8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:35.756650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9e31222-d813-4c6f-b667-895d6fd663e8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:36.218111 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b9e31222-d813-4c6f-b667-895d6fd663e8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:36.233824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b9e31222-d813-4c6f-b667-895d6fd663e8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:36.236199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b9e31222-d813-4c6f-b667-895d6fd663e8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:36.237744 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b9e31222-d813-4c6f-b667-895d6fd663e8 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1731 microversion: 2.20 time: 0.510693 Jul 20 04:41:36.243289 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2293/4826] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:35 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1731 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:36.248915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fe6ad065-09b4-451c-be22-ca87730466be tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:36.258591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fe6ad065-09b4-451c-be22-ca87730466be tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:36.265479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe6ad065-09b4-451c-be22-ca87730466be tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:36.268762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe6ad065-09b4-451c-be22-ca87730466be tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:36.269796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe6ad065-09b4-451c-be22-ca87730466be tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:36.270424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe6ad065-09b4-451c-be22-ca87730466be tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:36.638863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b75b0109-9341-4be7-b8fd-4e1d1a912a12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:36.647449 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b75b0109-9341-4be7-b8fd-4e1d1a912a12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1203 microversion: 2.1 time: 2.199222 Jul 20 04:41:36.648512 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2534/4827] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:34 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1203 bytes in 2201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:36.661005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-464531fb-be5a-4d57-928e-464d875f2077 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:36.661637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-464531fb-be5a-4d57-928e-464d875f2077 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:36.668576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-464531fb-be5a-4d57-928e-464d875f2077 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:36.669315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-464531fb-be5a-4d57-928e-464d875f2077 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:36.670109 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-464531fb-be5a-4d57-928e-464d875f2077 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:36.670553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-464531fb-be5a-4d57-928e-464d875f2077 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:36.726006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fe6ad065-09b4-451c-be22-ca87730466be tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:36.752151 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fe6ad065-09b4-451c-be22-ca87730466be tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 200 len: 1509 microversion: 2.1 time: 0.507031 Jul 20 04:41:36.753185 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2294/4828] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:36 2022] GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 1509 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:37.262077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-65af29c9-a4d0-4f40-947e-a949a93627d4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:37.264185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-65af29c9-a4d0-4f40-947e-a949a93627d4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:37.292170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65af29c9-a4d0-4f40-947e-a949a93627d4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:37.293148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65af29c9-a4d0-4f40-947e-a949a93627d4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:37.294328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65af29c9-a4d0-4f40-947e-a949a93627d4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:37.294979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65af29c9-a4d0-4f40-947e-a949a93627d4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:37.340247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-464531fb-be5a-4d57-928e-464d875f2077 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:37.352750 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-464531fb-be5a-4d57-928e-464d875f2077 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1371 microversion: 2.1 time: 0.702323 Jul 20 04:41:37.357028 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2535/4829] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:36 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1371 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:37.374236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-f246fc15-df35-4ca6-84d1-8d3a13d46fde req-5719b68e-0e67-4b14-a1a9-b90171f125a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27761b08-de0f-4d8a-aeee-289edee644b1", "name": "network-vif-plugged", "status": "completed", "tag": "7f2ff15a-f890-4618-8bf3-bf7c42afe26e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:37.396243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:37.400379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f246fc15-df35-4ca6-84d1-8d3a13d46fde req-5719b68e-0e67-4b14-a1a9-b90171f125a8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:37.404763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f246fc15-df35-4ca6-84d1-8d3a13d46fde req-5719b68e-0e67-4b14-a1a9-b90171f125a8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:37.436387 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-f246fc15-df35-4ca6-84d1-8d3a13d46fde req-5719b68e-0e67-4b14-a1a9-b90171f125a8 service nova] Creating event network-vif-plugged:7f2ff15a-f890-4618-8bf3-bf7c42afe26e for instance 27761b08-de0f-4d8a-aeee-289edee644b1 on n-h2-826526-5 Jul 20 04:41:37.446794 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-f246fc15-df35-4ca6-84d1-8d3a13d46fde req-5719b68e-0e67-4b14-a1a9-b90171f125a8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077961 Jul 20 04:41:37.448105 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2536/4830] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:37.672644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e217746e-6e90-4e7a-a039-efd494ea612c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:37.674494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e217746e-6e90-4e7a-a039-efd494ea612c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:37.717085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e217746e-6e90-4e7a-a039-efd494ea612c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:37.718502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e217746e-6e90-4e7a-a039-efd494ea612c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:37.726234 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e217746e-6e90-4e7a-a039-efd494ea612c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:37.728882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e217746e-6e90-4e7a-a039-efd494ea612c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:38.531770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e217746e-6e90-4e7a-a039-efd494ea612c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:38.551046 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e217746e-6e90-4e7a-a039-efd494ea612c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1203 microversion: 2.1 time: 0.883850 Jul 20 04:41:38.562165 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2537/4831] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:37 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1203 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:38.577235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-816d8de4-7c1f-4eb9-9c47-c98f44e1a9f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:38.578249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-816d8de4-7c1f-4eb9-9c47-c98f44e1a9f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:38.587049 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-816d8de4-7c1f-4eb9-9c47-c98f44e1a9f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:38.587785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-816d8de4-7c1f-4eb9-9c47-c98f44e1a9f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:38.588858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-816d8de4-7c1f-4eb9-9c47-c98f44e1a9f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:38.589533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-816d8de4-7c1f-4eb9-9c47-c98f44e1a9f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:38.899630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-816d8de4-7c1f-4eb9-9c47-c98f44e1a9f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:38.910139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-65af29c9-a4d0-4f40-947e-a949a93627d4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:38.918078 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-816d8de4-7c1f-4eb9-9c47-c98f44e1a9f1 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 200 len: 1509 microversion: 2.1 time: 0.354258 Jul 20 04:41:38.922152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-65af29c9-a4d0-4f40-947e-a949a93627d4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:38.925066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-65af29c9-a4d0-4f40-947e-a949a93627d4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:38.926983 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-65af29c9-a4d0-4f40-947e-a949a93627d4 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1731 microversion: 2.20 time: 1.671372 Jul 20 04:41:38.928016 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2295/4832] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:37 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1731 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:41:38.930594 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2538/4833] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:38 2022] GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 1509 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:38.933280 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0ea0cd46-407c-4e84-87b8-67972199be98 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:38.934471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0ea0cd46-407c-4e84-87b8-67972199be98 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:38.936837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2776fbd9-7129-4885-ac5c-65628815c146 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:38.937715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2776fbd9-7129-4885-ac5c-65628815c146 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:38.943176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ea0cd46-407c-4e84-87b8-67972199be98 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:38.943658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ea0cd46-407c-4e84-87b8-67972199be98 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:38.945228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ea0cd46-407c-4e84-87b8-67972199be98 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:38.946024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ea0cd46-407c-4e84-87b8-67972199be98 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:38.948603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2776fbd9-7129-4885-ac5c-65628815c146 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:38.950089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2776fbd9-7129-4885-ac5c-65628815c146 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:38.951895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2776fbd9-7129-4885-ac5c-65628815c146 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:38.955634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2776fbd9-7129-4885-ac5c-65628815c146 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:39.169241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2776fbd9-7129-4885-ac5c-65628815c146 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:39.179462 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2776fbd9-7129-4885-ac5c-65628815c146 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1564 microversion: 2.1 time: 0.247237 Jul 20 04:41:39.197492 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2539/4834] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:38 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1564 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:39.202822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-16146d86-c586-476b-99c7-68bd4db50536 req-16723910-a6bf-4fab-b8e2-5cf4a662d765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ed5f8e-9305-42db-8723-6fba63245605", "tag": "dd8fb1a0-4673-4433-af0e-9ceaff8681f5"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:39.226927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-16146d86-c586-476b-99c7-68bd4db50536 req-16723910-a6bf-4fab-b8e2-5cf4a662d765 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:39.233887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-16146d86-c586-476b-99c7-68bd4db50536 req-16723910-a6bf-4fab-b8e2-5cf4a662d765 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:39.260004 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-16146d86-c586-476b-99c7-68bd4db50536 req-16723910-a6bf-4fab-b8e2-5cf4a662d765 service nova] Creating event network-changed:dd8fb1a0-4673-4433-af0e-9ceaff8681f5 for instance 90ed5f8e-9305-42db-8723-6fba63245605 on n-h2-826526-5 Jul 20 04:41:39.277905 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-16146d86-c586-476b-99c7-68bd4db50536 req-16723910-a6bf-4fab-b8e2-5cf4a662d765 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078417 Jul 20 04:41:39.279120 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2540/4835] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:39.362019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0ea0cd46-407c-4e84-87b8-67972199be98 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:39.371326 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0ea0cd46-407c-4e84-87b8-67972199be98 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1371 microversion: 2.1 time: 0.442036 Jul 20 04:41:39.373484 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2296/4836] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:38 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1371 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:39.584922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4391e408-5562-4e89-9e98-166c1f3dac35 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:39.586117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4391e408-5562-4e89-9e98-166c1f3dac35 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:39.601004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4391e408-5562-4e89-9e98-166c1f3dac35 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:39.601802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4391e408-5562-4e89-9e98-166c1f3dac35 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:39.602766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4391e408-5562-4e89-9e98-166c1f3dac35 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:39.603734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4391e408-5562-4e89-9e98-166c1f3dac35 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:39.648873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-440decbf-29d5-4e4e-ac23-8cd3d983ca1b tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:39.649676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-440decbf-29d5-4e4e-ac23-8cd3d983ca1b tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:39.663665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-440decbf-29d5-4e4e-ac23-8cd3d983ca1b tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:39.671324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-440decbf-29d5-4e4e-ac23-8cd3d983ca1b tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:39.674681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-440decbf-29d5-4e4e-ac23-8cd3d983ca1b tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:39.676820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-440decbf-29d5-4e4e-ac23-8cd3d983ca1b tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:39.769617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-440decbf-29d5-4e4e-ac23-8cd3d983ca1b tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:39.967798 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-440decbf-29d5-4e4e-ac23-8cd3d983ca1b tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53" status: 204 len: 0 microversion: 2.1 time: 0.323154 Jul 20 04:41:39.976737 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2297/4837] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:39 2022] DELETE /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:39.989282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-958fb2cb-4c6b-4098-a178-8015a9eab66d req-04e3b997-aac6-48bd-b6ae-a1bb9853b08c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c3c9d87-88a7-4dea-8b81-0e67d259dc53", "tag": "e65ca590-1dcb-4c7e-aca1-2e965482add0"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:40.011634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-958fb2cb-4c6b-4098-a178-8015a9eab66d req-04e3b997-aac6-48bd-b6ae-a1bb9853b08c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:40.018074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-958fb2cb-4c6b-4098-a178-8015a9eab66d req-04e3b997-aac6-48bd-b6ae-a1bb9853b08c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:40.056683 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-958fb2cb-4c6b-4098-a178-8015a9eab66d req-04e3b997-aac6-48bd-b6ae-a1bb9853b08c service nova] Creating event network-changed:e65ca590-1dcb-4c7e-aca1-2e965482add0 for instance 5c3c9d87-88a7-4dea-8b81-0e67d259dc53 on n-h2-826526-5 Jul 20 04:41:40.080968 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-958fb2cb-4c6b-4098-a178-8015a9eab66d req-04e3b997-aac6-48bd-b6ae-a1bb9853b08c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101789 Jul 20 04:41:40.081603 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2298/4838] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:40.096085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5b58c522-d37a-428b-bd5d-6225215fc343 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:40.098874 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5b58c522-d37a-428b-bd5d-6225215fc343 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:40.131323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b58c522-d37a-428b-bd5d-6225215fc343 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:40.131323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b58c522-d37a-428b-bd5d-6225215fc343 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:40.131323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b58c522-d37a-428b-bd5d-6225215fc343 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:40.135987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b58c522-d37a-428b-bd5d-6225215fc343 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:40.646352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4391e408-5562-4e89-9e98-166c1f3dac35 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:40.659727 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4391e408-5562-4e89-9e98-166c1f3dac35 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1203 microversion: 2.1 time: 1.083920 Jul 20 04:41:40.669919 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2541/4839] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:39 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1203 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:40.676967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7774822a-36d8-45b1-a46a-2896df5f7333 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:40.682583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7774822a-36d8-45b1-a46a-2896df5f7333 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:40.700554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7774822a-36d8-45b1-a46a-2896df5f7333 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:40.701022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7774822a-36d8-45b1-a46a-2896df5f7333 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:40.701861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7774822a-36d8-45b1-a46a-2896df5f7333 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:40.702329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7774822a-36d8-45b1-a46a-2896df5f7333 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:40.899108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5b58c522-d37a-428b-bd5d-6225215fc343 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:40.914084 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5b58c522-d37a-428b-bd5d-6225215fc343 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 200 len: 1509 microversion: 2.1 time: 0.830741 Jul 20 04:41:40.915506 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2299/4840] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:40 2022] GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 1509 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:40.927637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1f1dd65d-2c06-4ab6-a380-923540336eaa tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:40.928636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1f1dd65d-2c06-4ab6-a380-923540336eaa tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:40.948067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f1dd65d-2c06-4ab6-a380-923540336eaa tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:40.948841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f1dd65d-2c06-4ab6-a380-923540336eaa tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:40.949825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f1dd65d-2c06-4ab6-a380-923540336eaa tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:40.950415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f1dd65d-2c06-4ab6-a380-923540336eaa tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:41.580577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1f1dd65d-2c06-4ab6-a380-923540336eaa tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:41.591449 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1f1dd65d-2c06-4ab6-a380-923540336eaa tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53" status: 200 len: 1669 microversion: 2.1 time: 0.674685 Jul 20 04:41:41.592922 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2300/4841] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:40 2022] GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53 => generated 1669 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:41.616039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e07c929c-ff60-41c1-a5d0-03c87455d2bf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:41.617338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e07c929c-ff60-41c1-a5d0-03c87455d2bf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:41.641996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e07c929c-ff60-41c1-a5d0-03c87455d2bf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:41.649142 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e07c929c-ff60-41c1-a5d0-03c87455d2bf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:41.652917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e07c929c-ff60-41c1-a5d0-03c87455d2bf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:41.654167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e07c929c-ff60-41c1-a5d0-03c87455d2bf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:42.188308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7774822a-36d8-45b1-a46a-2896df5f7333 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:42.199765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7774822a-36d8-45b1-a46a-2896df5f7333 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:42.208614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7774822a-36d8-45b1-a46a-2896df5f7333 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:42.210285 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7774822a-36d8-45b1-a46a-2896df5f7333 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1731 microversion: 2.20 time: 1.547278 Jul 20 04:41:42.213847 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2542/4842] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:40 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1731 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:42.226222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-876f5f21-cafc-48fa-8102-a0603f6f24c8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:42.232480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-876f5f21-cafc-48fa-8102-a0603f6f24c8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:42.250703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-876f5f21-cafc-48fa-8102-a0603f6f24c8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:42.252467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-876f5f21-cafc-48fa-8102-a0603f6f24c8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:42.254172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-876f5f21-cafc-48fa-8102-a0603f6f24c8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:42.260993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-876f5f21-cafc-48fa-8102-a0603f6f24c8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:42.460691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e07c929c-ff60-41c1-a5d0-03c87455d2bf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:42.485997 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e07c929c-ff60-41c1-a5d0-03c87455d2bf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1371 microversion: 2.1 time: 0.882674 Jul 20 04:41:42.489620 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2301/4843] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:41 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1371 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:42.508762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a747ba2b-4715-4768-b9bd-c8efa889432d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:42.509922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a747ba2b-4715-4768-b9bd-c8efa889432d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:42.528949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a747ba2b-4715-4768-b9bd-c8efa889432d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:42.529661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a747ba2b-4715-4768-b9bd-c8efa889432d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:42.534975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a747ba2b-4715-4768-b9bd-c8efa889432d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:42.535915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a747ba2b-4715-4768-b9bd-c8efa889432d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:42.606899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:42.958926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a747ba2b-4715-4768-b9bd-c8efa889432d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:42.986238 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a747ba2b-4715-4768-b9bd-c8efa889432d tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 200 len: 1467 microversion: 2.1 time: 0.494452 Jul 20 04:41:42.998768 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2302/4844] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:42 2022] GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 1467 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:43.009617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8af73718-458c-43d1-a6a1-f24c4c78931f tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:43.011019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8af73718-458c-43d1-a6a1-f24c4c78931f tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:43.041110 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8af73718-458c-43d1-a6a1-f24c4c78931f tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:43.041959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8af73718-458c-43d1-a6a1-f24c4c78931f tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:43.042996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8af73718-458c-43d1-a6a1-f24c4c78931f tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:43.043678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8af73718-458c-43d1-a6a1-f24c4c78931f tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:43.724253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-876f5f21-cafc-48fa-8102-a0603f6f24c8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:43.797748 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-876f5f21-cafc-48fa-8102-a0603f6f24c8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1389 microversion: 2.1 time: 1.579200 Jul 20 04:41:43.816692 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2543/4845] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:42 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1389 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:43.836727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d0decdaa-2703-4362-befc-4a91c849882b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:43.837361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d0decdaa-2703-4362-befc-4a91c849882b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:43.863745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0decdaa-2703-4362-befc-4a91c849882b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:43.867516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0decdaa-2703-4362-befc-4a91c849882b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:43.874975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0decdaa-2703-4362-befc-4a91c849882b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:43.888588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0decdaa-2703-4362-befc-4a91c849882b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:44.015460 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8af73718-458c-43d1-a6a1-f24c4c78931f tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:44.028101 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8af73718-458c-43d1-a6a1-f24c4c78931f tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53" status: 200 len: 1669 microversion: 2.1 time: 1.026121 Jul 20 04:41:44.031319 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2303/4846] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:42 2022] GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53 => generated 1669 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:44.036721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dda60e97-4ef3-4bc4-a23d-2646149f4a4b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:44.037661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dda60e97-4ef3-4bc4-a23d-2646149f4a4b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:44.047463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dda60e97-4ef3-4bc4-a23d-2646149f4a4b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:44.048582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dda60e97-4ef3-4bc4-a23d-2646149f4a4b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:44.049927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dda60e97-4ef3-4bc4-a23d-2646149f4a4b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:44.051548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dda60e97-4ef3-4bc4-a23d-2646149f4a4b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:44.319424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d0decdaa-2703-4362-befc-4a91c849882b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:44.336850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d0decdaa-2703-4362-befc-4a91c849882b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:44.338178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d0decdaa-2703-4362-befc-4a91c849882b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:44.342541 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d0decdaa-2703-4362-befc-4a91c849882b tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1731 microversion: 2.20 time: 0.522665 Jul 20 04:41:44.347925 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2544/4847] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:43 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1731 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:44.354034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-daf199bf-3d87-429e-912b-9b163b0ed649 req-c22a6113-0cb9-4c20-a728-84fb394eb5df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dacbcd87-fd28-463e-9e12-a7bba0abc6e1", "name": "network-vif-deleted", "tag": "05874080-7d7d-40e2-b20c-755898c73f17"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:44.377650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-daf199bf-3d87-429e-912b-9b163b0ed649 req-c22a6113-0cb9-4c20-a728-84fb394eb5df service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:44.378170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-daf199bf-3d87-429e-912b-9b163b0ed649 req-c22a6113-0cb9-4c20-a728-84fb394eb5df service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:44.411472 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-daf199bf-3d87-429e-912b-9b163b0ed649 req-c22a6113-0cb9-4c20-a728-84fb394eb5df service nova] Creating event network-vif-deleted:05874080-7d7d-40e2-b20c-755898c73f17 for instance dacbcd87-fd28-463e-9e12-a7bba0abc6e1 on n-h1-826526-5 Jul 20 04:41:44.434120 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-daf199bf-3d87-429e-912b-9b163b0ed649 req-c22a6113-0cb9-4c20-a728-84fb394eb5df service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082907 Jul 20 04:41:44.435629 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2545/4848] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:44.501168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-248a2431-cd16-47b7-9ec6-0c53d7ffdf9a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:44.508096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-248a2431-cd16-47b7-9ec6-0c53d7ffdf9a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:44.554824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-248a2431-cd16-47b7-9ec6-0c53d7ffdf9a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:44.555533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-248a2431-cd16-47b7-9ec6-0c53d7ffdf9a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:44.582881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-248a2431-cd16-47b7-9ec6-0c53d7ffdf9a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:44.589333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-248a2431-cd16-47b7-9ec6-0c53d7ffdf9a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:44.637720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=98 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:44.853340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dda60e97-4ef3-4bc4-a23d-2646149f4a4b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:44.898251 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dda60e97-4ef3-4bc4-a23d-2646149f4a4b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1371 microversion: 2.1 time: 0.860793 Jul 20 04:41:44.904642 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2304/4849] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:44 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1371 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:44.920924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-54e579fe-10b9-418b-b66b-31a9db1e51f7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:44.922503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-54e579fe-10b9-418b-b66b-31a9db1e51f7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: dacbcd87-fd28-463e-9e12-a7bba0abc6e1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:44.966982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54e579fe-10b9-418b-b66b-31a9db1e51f7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:44.972395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54e579fe-10b9-418b-b66b-31a9db1e51f7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:44.982012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54e579fe-10b9-418b-b66b-31a9db1e51f7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:44.997395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54e579fe-10b9-418b-b66b-31a9db1e51f7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:45.093229 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-54e579fe-10b9-418b-b66b-31a9db1e51f7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] HTTP exception thrown: Instance dacbcd87-fd28-463e-9e12-a7bba0abc6e1 could not be found. Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-54e579fe-10b9-418b-b66b-31a9db1e51f7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Request method failure captured: Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 HTTP/1.1 Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14VixHJkebixphdIwpShDcg3JlaVhM2CoSLlprTWiwLn49pCahdWzlOL7MmtUDivVfw4m6kI4BuKlP27BpI0P2VGSTH9CmZ2MDFgZIfQUKwMAzgmxiYhzCfBZQgehacwrRr-TbEtnIcKT7h1-1gllEV5AaLRk0CzcCXpWksXa6-Jd-I Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: fcd6c40faa19476db37fa7897dea5840 Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerActionsTestJSON-1614718281 Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcd6c40faa19476db37fa7897dea5840"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fcd6c40faa19476db37fa7897dea5840"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fcd6c40faa19476db37fa7897dea5840", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcd6c40faa19476db37fa7897dea5840"}]}] Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerActionsTestJSON-1614718281 Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: fcd6c40faa19476db37fa7897dea5840 Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerActionsTestJSON-1614718281 Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerActionsTestJSON-1614718281-project Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f50ac97f2ef04752bd49148748e39eb8 Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerActionsTestJSON-1614718281-project Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance dacbcd87-fd28-463e-9e12-a7bba0abc6e1 could not be found. Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'dacbcd87-fd28-463e-9e12-a7bba0abc6e1'} Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dacbcd87-fd28-463e-9e12-a7bba0abc6e1 could not be found. Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dacbcd87-fd28-463e-9e12-a7bba0abc6e1 could not be found. Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:45.102977 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:45.110390 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:45.110390 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:45.110390 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:45.110390 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:45.110390 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:45.110390 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dacbcd87-fd28-463e-9e12-a7bba0abc6e1 could not be found. Jul 20 04:41:45.110390 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:45.114943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-54e579fe-10b9-418b-b66b-31a9db1e51f7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Returning 404 to user: Instance dacbcd87-fd28-463e-9e12-a7bba0abc6e1 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:45.124880 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-54e579fe-10b9-418b-b66b-31a9db1e51f7 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1" status: 404 len: 111 microversion: 2.1 time: 0.218114 Jul 20 04:41:45.126772 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2305/4850] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:44 2022] GET /compute/v2.1/servers/dacbcd87-fd28-463e-9e12-a7bba0abc6e1 => generated 111 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:45.148307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-2ebd1fce-2005-4bdb-ab99-72a11dfbe626 req-9fbdc192-6ef3-4f38-b3ba-adfb9bf04980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c3c9d87-88a7-4dea-8b81-0e67d259dc53", "name": "network-vif-deleted", "tag": "e65ca590-1dcb-4c7e-aca1-2e965482add0"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:45.167647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-248a2431-cd16-47b7-9ec6-0c53d7ffdf9a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:45.176609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2ebd1fce-2005-4bdb-ab99-72a11dfbe626 req-9fbdc192-6ef3-4f38-b3ba-adfb9bf04980 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:45.177917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2ebd1fce-2005-4bdb-ab99-72a11dfbe626 req-9fbdc192-6ef3-4f38-b3ba-adfb9bf04980 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:45.179530 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-248a2431-cd16-47b7-9ec6-0c53d7ffdf9a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1389 microversion: 2.1 time: 0.741688 Jul 20 04:41:45.186262 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2546/4851] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:44 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1389 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:45.191803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-fb22b8c1-afdd-49e0-96e2-9e37879da3cf req-ee5417d7-c019-4f49-ad58-ffccd75ebdcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "085f0971-9269-4d32-8eeb-17e7bf8143c2", "name": "network-vif-plugged", "status": "completed", "tag": "52337d8b-3bd5-408a-b197-2f38bf1e0818"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:45.206114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-fb22b8c1-afdd-49e0-96e2-9e37879da3cf req-ee5417d7-c019-4f49-ad58-ffccd75ebdcf service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:45.206855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-fb22b8c1-afdd-49e0-96e2-9e37879da3cf req-ee5417d7-c019-4f49-ad58-ffccd75ebdcf service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:45.216476 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-2ebd1fce-2005-4bdb-ab99-72a11dfbe626 req-9fbdc192-6ef3-4f38-b3ba-adfb9bf04980 service nova] Creating event network-vif-deleted:e65ca590-1dcb-4c7e-aca1-2e965482add0 for instance 5c3c9d87-88a7-4dea-8b81-0e67d259dc53 on n-h2-826526-5 Jul 20 04:41:45.233275 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-2ebd1fce-2005-4bdb-ab99-72a11dfbe626 req-9fbdc192-6ef3-4f38-b3ba-adfb9bf04980 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104191 Jul 20 04:41:45.240948 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2306/4852] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:45.248252 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-fb22b8c1-afdd-49e0-96e2-9e37879da3cf req-ee5417d7-c019-4f49-ad58-ffccd75ebdcf service nova] Creating event network-vif-plugged:52337d8b-3bd5-408a-b197-2f38bf1e0818 for instance 085f0971-9269-4d32-8eeb-17e7bf8143c2 on n-h1-826526-5 Jul 20 04:41:45.256060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1cf37e26-8626-4238-ab04-4251fa1d37f2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:45.256878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1cf37e26-8626-4238-ab04-4251fa1d37f2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:45.263790 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-fb22b8c1-afdd-49e0-96e2-9e37879da3cf req-ee5417d7-c019-4f49-ad58-ffccd75ebdcf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075760 Jul 20 04:41:45.272517 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2547/4853] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:45.281091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fff43fed-3cab-43a9-bbf6-922a20f3c73a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:45.283634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fff43fed-3cab-43a9-bbf6-922a20f3c73a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:45.294704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fff43fed-3cab-43a9-bbf6-922a20f3c73a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:45.296766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fff43fed-3cab-43a9-bbf6-922a20f3c73a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:45.297389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cf37e26-8626-4238-ab04-4251fa1d37f2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:45.298313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fff43fed-3cab-43a9-bbf6-922a20f3c73a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:45.298515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cf37e26-8626-4238-ab04-4251fa1d37f2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:45.299221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fff43fed-3cab-43a9-bbf6-922a20f3c73a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:45.300087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cf37e26-8626-4238-ab04-4251fa1d37f2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:45.301062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cf37e26-8626-4238-ab04-4251fa1d37f2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:45.338433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fff43fed-3cab-43a9-bbf6-922a20f3c73a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:45.408572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cf37e26-8626-4238-ab04-4251fa1d37f2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:45.409801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cf37e26-8626-4238-ab04-4251fa1d37f2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:45.411456 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-1cf37e26-8626-4238-ab04-4251fa1d37f2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lazy-loading 'fault' on Instance uuid 5c3c9d87-88a7-4dea-8b81-0e67d259dc53 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:41:45.520499 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fff43fed-3cab-43a9-bbf6-922a20f3c73a tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "DELETE /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 204 len: 0 microversion: 2.1 time: 0.239985 Jul 20 04:41:45.524418 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2548/4854] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:45 2022] DELETE /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:45.542389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0a2307d7-b5c8-4c70-9e2e-c7eddb46ee00 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:45.543220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0a2307d7-b5c8-4c70-9e2e-c7eddb46ee00 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:45.557239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a2307d7-b5c8-4c70-9e2e-c7eddb46ee00 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:45.557736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a2307d7-b5c8-4c70-9e2e-c7eddb46ee00 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:45.558665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a2307d7-b5c8-4c70-9e2e-c7eddb46ee00 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:45.559161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a2307d7-b5c8-4c70-9e2e-c7eddb46ee00 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:45.819950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0a2307d7-b5c8-4c70-9e2e-c7eddb46ee00 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:45.829977 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0a2307d7-b5c8-4c70-9e2e-c7eddb46ee00 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1389 microversion: 2.1 time: 0.302356 Jul 20 04:41:45.830571 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2549/4855] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:45 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1389 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:45.864472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-840669a8-a8d9-4c30-b9fe-365570ace150 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:45.865300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-840669a8-a8d9-4c30-b9fe-365570ace150 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:45.878978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-840669a8-a8d9-4c30-b9fe-365570ace150 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:45.880448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-840669a8-a8d9-4c30-b9fe-365570ace150 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:45.882055 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-840669a8-a8d9-4c30-b9fe-365570ace150 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:45.882876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-840669a8-a8d9-4c30-b9fe-365570ace150 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:45.942434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1cf37e26-8626-4238-ab04-4251fa1d37f2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:45.966611 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1cf37e26-8626-4238-ab04-4251fa1d37f2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53" status: 200 len: 1337 microversion: 2.1 time: 0.721213 Jul 20 04:41:45.968887 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2307/4856] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:45 2022] GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53 => generated 1337 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:45.977808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-76f4cba0-4cea-4258-8b48-c979a97c0487 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:45.979332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-76f4cba0-4cea-4258-8b48-c979a97c0487 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:45.991847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76f4cba0-4cea-4258-8b48-c979a97c0487 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:45.992806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76f4cba0-4cea-4258-8b48-c979a97c0487 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:45.996209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76f4cba0-4cea-4258-8b48-c979a97c0487 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:45.997063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76f4cba0-4cea-4258-8b48-c979a97c0487 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:46.207103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-840669a8-a8d9-4c30-b9fe-365570ace150 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:46.223239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-840669a8-a8d9-4c30-b9fe-365570ace150 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:46.232958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-840669a8-a8d9-4c30-b9fe-365570ace150 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:46.239637 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-840669a8-a8d9-4c30-b9fe-365570ace150 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1731 microversion: 2.20 time: 0.398904 Jul 20 04:41:46.240745 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2550/4857] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:45 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1731 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:46.246340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c12bdde7-3893-479b-b3c5-f08124b806e9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:46.246846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c12bdde7-3893-479b-b3c5-f08124b806e9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:46.265231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c12bdde7-3893-479b-b3c5-f08124b806e9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:46.270102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c12bdde7-3893-479b-b3c5-f08124b806e9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:46.272685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c12bdde7-3893-479b-b3c5-f08124b806e9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:46.273224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c12bdde7-3893-479b-b3c5-f08124b806e9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:46.338475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c12bdde7-3893-479b-b3c5-f08124b806e9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:46.346180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-76f4cba0-4cea-4258-8b48-c979a97c0487 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:46.367242 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-76f4cba0-4cea-4258-8b48-c979a97c0487 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1495 microversion: 2.1 time: 0.397020 Jul 20 04:41:46.377604 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2308/4858] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:45 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1495 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:46.386519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dc442e4b-4c3c-48c9-afb4-e534bf5d494c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:46.387466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dc442e4b-4c3c-48c9-afb4-e534bf5d494c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:46.394761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc442e4b-4c3c-48c9-afb4-e534bf5d494c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:46.395615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc442e4b-4c3c-48c9-afb4-e534bf5d494c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:46.396706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc442e4b-4c3c-48c9-afb4-e534bf5d494c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:46.397615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc442e4b-4c3c-48c9-afb4-e534bf5d494c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:46.571087 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c12bdde7-3893-479b-b3c5-f08124b806e9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 204 len: 0 microversion: 2.1 time: 0.328624 Jul 20 04:41:46.576230 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2551/4859] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:46 2022] DELETE /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:46.584499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4f49c6f6-95ba-415f-b3dc-6092fe4f3a12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:46.585481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4f49c6f6-95ba-415f-b3dc-6092fe4f3a12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:46.615565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f49c6f6-95ba-415f-b3dc-6092fe4f3a12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:46.615565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f49c6f6-95ba-415f-b3dc-6092fe4f3a12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:46.615565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f49c6f6-95ba-415f-b3dc-6092fe4f3a12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:46.615565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f49c6f6-95ba-415f-b3dc-6092fe4f3a12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:47.208814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dc442e4b-4c3c-48c9-afb4-e534bf5d494c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:47.220951 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dc442e4b-4c3c-48c9-afb4-e534bf5d494c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1371 microversion: 2.1 time: 0.841352 Jul 20 04:41:47.222012 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2309/4860] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:46 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1371 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:47.232120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bb8aaa77-a38f-49dc-9465-844ded170130 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:47.239229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bb8aaa77-a38f-49dc-9465-844ded170130 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 5c3c9d87-88a7-4dea-8b81-0e67d259dc53] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:47.260391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb8aaa77-a38f-49dc-9465-844ded170130 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:47.260870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb8aaa77-a38f-49dc-9465-844ded170130 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:47.261686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb8aaa77-a38f-49dc-9465-844ded170130 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:47.262137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb8aaa77-a38f-49dc-9465-844ded170130 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:47.326635 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-bb8aaa77-a38f-49dc-9465-844ded170130 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] HTTP exception thrown: Instance 5c3c9d87-88a7-4dea-8b81-0e67d259dc53 could not be found. Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bb8aaa77-a38f-49dc-9465-844ded170130 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Request method failure captured: Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53 HTTP/1.1 Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14biZ-lKuc8od4z-gDs7ibcjbpjbY-pO84cjRlWJrDLcgLsU69sxA2H3n6BaTvHZ67KSZSohA3lrrioyOsX40joFp6Jhnf9K_l3pzm_UYtlKZByQxgI-c8JWg1t0HjkzxL-aco80Bfx_lPnqGnEDDmiLhrNA4N-0tlVLIZEURaqN2lI Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c9b5d48d9c894a32b3f417820f43427e Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestNetworkBasicOps-225432984 Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9b5d48d9c894a32b3f417820f43427e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c9b5d48d9c894a32b3f417820f43427e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c9b5d48d9c894a32b3f417820f43427e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9b5d48d9c894a32b3f417820f43427e"}]}] Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestNetworkBasicOps-225432984 Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c9b5d48d9c894a32b3f417820f43427e Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestNetworkBasicOps-225432984 Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestNetworkBasicOps-225432984-project Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 43a4b4fa5cc24463aa398fbc4e1404d4 Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestNetworkBasicOps-225432984-project Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 5c3c9d87-88a7-4dea-8b81-0e67d259dc53 could not be found. Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '5c3c9d87-88a7-4dea-8b81-0e67d259dc53'} Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c3c9d87-88a7-4dea-8b81-0e67d259dc53 could not be found. Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c3c9d87-88a7-4dea-8b81-0e67d259dc53 could not be found. Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:47.328405 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:47.332637 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:47.332637 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:47.332637 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:47.332637 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:47.332637 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:47.332637 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c3c9d87-88a7-4dea-8b81-0e67d259dc53 could not be found. Jul 20 04:41:47.332637 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:41:47.332637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bb8aaa77-a38f-49dc-9465-844ded170130 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Returning 404 to user: Instance 5c3c9d87-88a7-4dea-8b81-0e67d259dc53 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:47.332637 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bb8aaa77-a38f-49dc-9465-844ded170130 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53" status: 404 len: 111 microversion: 2.1 time: 0.106601 Jul 20 04:41:47.332637 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2310/4861] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:47 2022] GET /compute/v2.1/servers/5c3c9d87-88a7-4dea-8b81-0e67d259dc53 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:47.343153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a2b3452c-238a-452a-b1a0-0e97747daf5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:47.351997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a2b3452c-238a-452a-b1a0-0e97747daf5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:47.359341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2b3452c-238a-452a-b1a0-0e97747daf5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:47.363681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2b3452c-238a-452a-b1a0-0e97747daf5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:47.364874 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2b3452c-238a-452a-b1a0-0e97747daf5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:47.366059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2b3452c-238a-452a-b1a0-0e97747daf5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:47.489197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4f49c6f6-95ba-415f-b3dc-6092fe4f3a12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:47.499285 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4f49c6f6-95ba-415f-b3dc-6092fe4f3a12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1395 microversion: 2.1 time: 0.921431 Jul 20 04:41:47.514680 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2552/4862] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:46 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1395 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:47.518394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2173d7a2-1586-42b4-9bc9-180ebbf7fd85 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:47.519472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2173d7a2-1586-42b4-9bc9-180ebbf7fd85 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:47.538764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2173d7a2-1586-42b4-9bc9-180ebbf7fd85 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:47.539408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2173d7a2-1586-42b4-9bc9-180ebbf7fd85 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:47.540491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2173d7a2-1586-42b4-9bc9-180ebbf7fd85 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:47.541078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2173d7a2-1586-42b4-9bc9-180ebbf7fd85 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:47.805435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a2b3452c-238a-452a-b1a0-0e97747daf5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:47.821563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a2b3452c-238a-452a-b1a0-0e97747daf5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:47.821563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a2b3452c-238a-452a-b1a0-0e97747daf5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:47.828199 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a2b3452c-238a-452a-b1a0-0e97747daf5d tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1731 microversion: 2.20 time: 0.496704 Jul 20 04:41:47.846263 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2311/4863] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:47 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1731 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:48.206934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-4a505ebf-1170-4a4d-9310-f0de15f498ab req-5d3d0da3-5ca0-4484-bbda-44f667b95918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a59f2d-88a3-408a-a465-f86f983a11be", "name": "network-vif-deleted", "tag": "c57b06f0-d23a-409f-9a66-3993cae11b08"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:48.228477 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2173d7a2-1586-42b4-9bc9-180ebbf7fd85 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:48.241034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4a505ebf-1170-4a4d-9310-f0de15f498ab req-5d3d0da3-5ca0-4484-bbda-44f667b95918 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:48.241547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4a505ebf-1170-4a4d-9310-f0de15f498ab req-5d3d0da3-5ca0-4484-bbda-44f667b95918 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:48.247415 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2173d7a2-1586-42b4-9bc9-180ebbf7fd85 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 200 len: 1495 microversion: 2.1 time: 0.731487 Jul 20 04:41:48.256141 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2553/4864] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:47 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 1495 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:48.270008 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-4a505ebf-1170-4a4d-9310-f0de15f498ab req-5d3d0da3-5ca0-4484-bbda-44f667b95918 service nova] Creating event network-vif-deleted:c57b06f0-d23a-409f-9a66-3993cae11b08 for instance 57a59f2d-88a3-408a-a465-f86f983a11be on n-h2-826526-5 Jul 20 04:41:48.272804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-933e939a-92c6-4af1-9f94-25d1c1b88f86 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:48.277790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-933e939a-92c6-4af1-9f94-25d1c1b88f86 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:48.283356 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-4a505ebf-1170-4a4d-9310-f0de15f498ab req-5d3d0da3-5ca0-4484-bbda-44f667b95918 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089762 Jul 20 04:41:48.286686 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2312/4865] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:48.311173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e684ffd5-a23b-4852-a76b-e6b8b10cdba2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '.version_select at 0x7f06bcde5f70>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:48.312660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-933e939a-92c6-4af1-9f94-25d1c1b88f86 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:48.317337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-933e939a-92c6-4af1-9f94-25d1c1b88f86 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:48.328729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-933e939a-92c6-4af1-9f94-25d1c1b88f86 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:48.330244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-933e939a-92c6-4af1-9f94-25d1c1b88f86 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:48.366056 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e684ffd5-a23b-4852-a76b-e6b8b10cdba2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-90132137" status: 202 len: 0 microversion: 2.1 time: 0.069580 Jul 20 04:41:48.369152 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2313/4866] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 04:41:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-90132137 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:41:48.531308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-544dde3b-a13d-49ee-8c9d-15d239db4e71 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:48.532525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-544dde3b-a13d-49ee-8c9d-15d239db4e71 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:48.550862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-544dde3b-a13d-49ee-8c9d-15d239db4e71 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:48.551255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-544dde3b-a13d-49ee-8c9d-15d239db4e71 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:48.551996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-544dde3b-a13d-49ee-8c9d-15d239db4e71 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:48.558126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-544dde3b-a13d-49ee-8c9d-15d239db4e71 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:48.981612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-933e939a-92c6-4af1-9f94-25d1c1b88f86 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:48.993772 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-933e939a-92c6-4af1-9f94-25d1c1b88f86 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1565 microversion: 2.1 time: 0.736079 Jul 20 04:41:48.995160 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2554/4867] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:48 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1565 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:49.000969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c18138d3-7a5c-4cd2-87f6-0cd993788f88 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:49.001871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c18138d3-7a5c-4cd2-87f6-0cd993788f88 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:49.010836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c18138d3-7a5c-4cd2-87f6-0cd993788f88 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:49.011646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c18138d3-7a5c-4cd2-87f6-0cd993788f88 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:49.012729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c18138d3-7a5c-4cd2-87f6-0cd993788f88 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:49.013402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c18138d3-7a5c-4cd2-87f6-0cd993788f88 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:49.191575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-544dde3b-a13d-49ee-8c9d-15d239db4e71 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:49.205812 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-544dde3b-a13d-49ee-8c9d-15d239db4e71 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1395 microversion: 2.1 time: 0.678673 Jul 20 04:41:49.209633 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2314/4868] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:48 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1395 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:49.218695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f63ba2b1-d8fc-425c-adbc-b9de264b5f01 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:49.229415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f63ba2b1-d8fc-425c-adbc-b9de264b5f01 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:49.247039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f63ba2b1-d8fc-425c-adbc-b9de264b5f01 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:49.247385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f63ba2b1-d8fc-425c-adbc-b9de264b5f01 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:49.248418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f63ba2b1-d8fc-425c-adbc-b9de264b5f01 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:49.249026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f63ba2b1-d8fc-425c-adbc-b9de264b5f01 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:49.438776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c18138d3-7a5c-4cd2-87f6-0cd993788f88 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:49.446666 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f63ba2b1-d8fc-425c-adbc-b9de264b5f01 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.235653 Jul 20 04:41:49.448441 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2315/4869] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:41:49 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-interface => generated 284 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:49.453331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f7d414ac-b657-4961-aa6a-f2b54e7e230e req-19aa15f7-7ed1-42b8-a7ce-f14bbfe0dfce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27761b08-de0f-4d8a-aeee-289edee644b1", "name": "network-vif-unplugged", "status": "completed", "tag": "7f2ff15a-f890-4618-8bf3-bf7c42afe26e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:49.468766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c18138d3-7a5c-4cd2-87f6-0cd993788f88 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:49.474344 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f7d414ac-b657-4961-aa6a-f2b54e7e230e req-19aa15f7-7ed1-42b8-a7ce-f14bbfe0dfce service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:49.474792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f7d414ac-b657-4961-aa6a-f2b54e7e230e req-19aa15f7-7ed1-42b8-a7ce-f14bbfe0dfce service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:49.475337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c18138d3-7a5c-4cd2-87f6-0cd993788f88 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:49.478781 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c18138d3-7a5c-4cd2-87f6-0cd993788f88 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1731 microversion: 2.20 time: 0.481995 Jul 20 04:41:49.481286 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2555/4870] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:48 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1731 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:49.495486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-27f3d727-4c3f-4a6b-be6e-6c159c5a0661 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:49.511968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-27f3d727-4c3f-4a6b-be6e-6c159c5a0661 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: 57a59f2d-88a3-408a-a465-f86f983a11be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:49.547034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27f3d727-4c3f-4a6b-be6e-6c159c5a0661 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:49.549573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27f3d727-4c3f-4a6b-be6e-6c159c5a0661 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:49.560726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27f3d727-4c3f-4a6b-be6e-6c159c5a0661 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:49.561232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27f3d727-4c3f-4a6b-be6e-6c159c5a0661 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:49.563116 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f7d414ac-b657-4961-aa6a-f2b54e7e230e req-19aa15f7-7ed1-42b8-a7ce-f14bbfe0dfce service nova] Creating event network-vif-unplugged:7f2ff15a-f890-4618-8bf3-bf7c42afe26e for instance 27761b08-de0f-4d8a-aeee-289edee644b1 on n-h2-826526-5 Jul 20 04:41:49.584105 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f7d414ac-b657-4961-aa6a-f2b54e7e230e req-19aa15f7-7ed1-42b8-a7ce-f14bbfe0dfce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134177 Jul 20 04:41:49.587789 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2316/4871] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:49.606261 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-27f3d727-4c3f-4a6b-be6e-6c159c5a0661 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] HTTP exception thrown: Instance 57a59f2d-88a3-408a-a465-f86f983a11be could not be found. Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-27f3d727-4c3f-4a6b-be6e-6c159c5a0661 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Request method failure captured: Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be HTTP/1.1 Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14VixHJkebixphdIwpShDcg3JlaVhM2CoSLlprTWiwLn49pCahdWzlOL7MmtUDivVfw4m6kI4BuKlP27BpI0P2VGSTH9CmZ2MDFgZIfQUKwMAzgmxiYhzCfBZQgehacwrRr-TbEtnIcKT7h1-1gllEV5AaLRk0CzcCXpWksXa6-Jd-I Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: fcd6c40faa19476db37fa7897dea5840 Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerActionsTestJSON-1614718281 Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcd6c40faa19476db37fa7897dea5840"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fcd6c40faa19476db37fa7897dea5840"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fcd6c40faa19476db37fa7897dea5840", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcd6c40faa19476db37fa7897dea5840"}]}] Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerActionsTestJSON-1614718281 Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: fcd6c40faa19476db37fa7897dea5840 Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerActionsTestJSON-1614718281 Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerActionsTestJSON-1614718281-project Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f50ac97f2ef04752bd49148748e39eb8 Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerActionsTestJSON-1614718281-project Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 57a59f2d-88a3-408a-a465-f86f983a11be could not be found. Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '57a59f2d-88a3-408a-a465-f86f983a11be'} Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57a59f2d-88a3-408a-a465-f86f983a11be could not be found. Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57a59f2d-88a3-408a-a465-f86f983a11be could not be found. Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:49.617713 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:41:49.621926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:49.621926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:49.621926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:49.621926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:49.621926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:49.621926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57a59f2d-88a3-408a-a465-f86f983a11be could not be found. Jul 20 04:41:49.621926 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:41:49.649897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-27f3d727-4c3f-4a6b-be6e-6c159c5a0661 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Returning 404 to user: Instance 57a59f2d-88a3-408a-a465-f86f983a11be could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:49.652937 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-27f3d727-4c3f-4a6b-be6e-6c159c5a0661 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be" status: 404 len: 111 microversion: 2.1 time: 0.170234 Jul 20 04:41:49.659829 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2556/4872] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:49 2022] GET /compute/v2.1/servers/57a59f2d-88a3-408a-a465-f86f983a11be => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:49.670268 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fdfa9fcc-1b2f-4fe7-ad43-5331798597ef tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:49.671055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fdfa9fcc-1b2f-4fe7-ad43-5331798597ef tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:49.673837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:49.687405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fdfa9fcc-1b2f-4fe7-ad43-5331798597ef tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:49.688092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fdfa9fcc-1b2f-4fe7-ad43-5331798597ef tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:49.689104 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fdfa9fcc-1b2f-4fe7-ad43-5331798597ef tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:49.689737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fdfa9fcc-1b2f-4fe7-ad43-5331798597ef tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:49.734903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fdfa9fcc-1b2f-4fe7-ad43-5331798597ef tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:49.950856 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fdfa9fcc-1b2f-4fe7-ad43-5331798597ef tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 204 len: 0 microversion: 2.1 time: 0.284395 Jul 20 04:41:49.961751 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2317/4873] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:49 2022] DELETE /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:49.974882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cfb9ab38-df65-4511-8d1a-75d70b62c4c9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:49.980056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cfb9ab38-df65-4511-8d1a-75d70b62c4c9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:50.021275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cfb9ab38-df65-4511-8d1a-75d70b62c4c9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:50.031276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cfb9ab38-df65-4511-8d1a-75d70b62c4c9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:50.038576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cfb9ab38-df65-4511-8d1a-75d70b62c4c9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:50.039068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cfb9ab38-df65-4511-8d1a-75d70b62c4c9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:50.169856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-6f01d836-8d1e-4b55-9620-8af2bfa4b67e req-a1104e7c-179c-4cf9-95b5-4df872f037c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27761b08-de0f-4d8a-aeee-289edee644b1", "name": "network-vif-deleted", "tag": "7f2ff15a-f890-4618-8bf3-bf7c42afe26e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:50.191528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6f01d836-8d1e-4b55-9620-8af2bfa4b67e req-a1104e7c-179c-4cf9-95b5-4df872f037c3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:50.192755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6f01d836-8d1e-4b55-9620-8af2bfa4b67e req-a1104e7c-179c-4cf9-95b5-4df872f037c3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:50.213582 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-6f01d836-8d1e-4b55-9620-8af2bfa4b67e req-a1104e7c-179c-4cf9-95b5-4df872f037c3 service nova] Creating event network-vif-deleted:7f2ff15a-f890-4618-8bf3-bf7c42afe26e for instance 27761b08-de0f-4d8a-aeee-289edee644b1 on n-h2-826526-5 Jul 20 04:41:50.247567 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-6f01d836-8d1e-4b55-9620-8af2bfa4b67e req-a1104e7c-179c-4cf9-95b5-4df872f037c3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096326 Jul 20 04:41:50.257199 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2318/4874] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:50.287960 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e6d44ac1-570b-4df2-a393-4fcf5ba4dbb1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:50.287960 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e6d44ac1-570b-4df2-a393-4fcf5ba4dbb1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:50.289896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6d44ac1-570b-4df2-a393-4fcf5ba4dbb1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:50.290631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6d44ac1-570b-4df2-a393-4fcf5ba4dbb1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:50.295848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6d44ac1-570b-4df2-a393-4fcf5ba4dbb1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:50.298072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6d44ac1-570b-4df2-a393-4fcf5ba4dbb1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:50.452244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e6d44ac1-570b-4df2-a393-4fcf5ba4dbb1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:50.468156 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e6d44ac1-570b-4df2-a393-4fcf5ba4dbb1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1188 microversion: 2.1 time: 0.209042 Jul 20 04:41:50.470688 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2319/4875] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:50 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1188 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:50.479752 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-63b2bb06-bfd8-4d13-b4b1-ed1daf91e213 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:50.481186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-63b2bb06-bfd8-4d13-b4b1-ed1daf91e213 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:50.490208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63b2bb06-bfd8-4d13-b4b1-ed1daf91e213 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:50.490957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63b2bb06-bfd8-4d13-b4b1-ed1daf91e213 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:50.501117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63b2bb06-bfd8-4d13-b4b1-ed1daf91e213 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:50.502568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63b2bb06-bfd8-4d13-b4b1-ed1daf91e213 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:50.584780 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-63b2bb06-bfd8-4d13-b4b1-ed1daf91e213 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605/action" status: 200 len: 24554 microversion: 2.1 time: 0.111423 Jul 20 04:41:50.587785 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2320/4876] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:41:50 2022] POST /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605/action => generated 24554 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:41:50.601617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bff32d57-ab76-4443-895b-30ee3f3a5071 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:50.605063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bff32d57-ab76-4443-895b-30ee3f3a5071 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:50.629101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bff32d57-ab76-4443-895b-30ee3f3a5071 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:50.630090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bff32d57-ab76-4443-895b-30ee3f3a5071 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:50.634205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bff32d57-ab76-4443-895b-30ee3f3a5071 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:50.637661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bff32d57-ab76-4443-895b-30ee3f3a5071 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:50.931293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cfb9ab38-df65-4511-8d1a-75d70b62c4c9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:50.946402 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cfb9ab38-df65-4511-8d1a-75d70b62c4c9 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1675 microversion: 2.1 time: 0.981615 Jul 20 04:41:50.951087 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2557/4877] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:49 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1675 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:51.029255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bff32d57-ab76-4443-895b-30ee3f3a5071 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:51.049557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bff32d57-ab76-4443-895b-30ee3f3a5071 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:51.052782 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bff32d57-ab76-4443-895b-30ee3f3a5071 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:51.054332 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bff32d57-ab76-4443-895b-30ee3f3a5071 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1731 microversion: 2.20 time: 0.464836 Jul 20 04:41:51.064791 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2321/4878] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:50 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1731 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:51.494222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-139d26c5-ab85-4a30-8934-d53265e61f18 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:51.494972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-139d26c5-ab85-4a30-8934-d53265e61f18 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:51.520889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-139d26c5-ab85-4a30-8934-d53265e61f18 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:51.521530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-139d26c5-ab85-4a30-8934-d53265e61f18 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:51.522484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-139d26c5-ab85-4a30-8934-d53265e61f18 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:51.532870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-139d26c5-ab85-4a30-8934-d53265e61f18 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:51.686022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-139d26c5-ab85-4a30-8934-d53265e61f18 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:51.718572 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-139d26c5-ab85-4a30-8934-d53265e61f18 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1188 microversion: 2.1 time: 0.234495 Jul 20 04:41:51.722831 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2558/4879] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:51 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1188 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:51.969433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8c4f0bd4-7fe2-4a73-90ca-35078e5a40b5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:51.973467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8c4f0bd4-7fe2-4a73-90ca-35078e5a40b5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:52.000295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c4f0bd4-7fe2-4a73-90ca-35078e5a40b5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:52.008857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c4f0bd4-7fe2-4a73-90ca-35078e5a40b5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:52.009900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c4f0bd4-7fe2-4a73-90ca-35078e5a40b5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:52.010455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c4f0bd4-7fe2-4a73-90ca-35078e5a40b5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:52.085945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ad4cf94a-b713-4437-a7f9-31e037447e44 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:52.086816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ad4cf94a-b713-4437-a7f9-31e037447e44 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:52.103552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad4cf94a-b713-4437-a7f9-31e037447e44 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:52.108965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad4cf94a-b713-4437-a7f9-31e037447e44 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:52.110911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad4cf94a-b713-4437-a7f9-31e037447e44 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:52.111520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad4cf94a-b713-4437-a7f9-31e037447e44 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:52.324593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8c4f0bd4-7fe2-4a73-90ca-35078e5a40b5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:52.329738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:52.337125 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8c4f0bd4-7fe2-4a73-90ca-35078e5a40b5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1675 microversion: 2.1 time: 0.373672 Jul 20 04:41:52.347637 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2322/4880] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:51 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1675 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:52.739913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-136b85bf-5058-4da9-91cc-5c584f89a84d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:52.740736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-136b85bf-5058-4da9-91cc-5c584f89a84d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:52.751481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-136b85bf-5058-4da9-91cc-5c584f89a84d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:52.752366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-136b85bf-5058-4da9-91cc-5c584f89a84d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:52.753796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-136b85bf-5058-4da9-91cc-5c584f89a84d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:52.754633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-136b85bf-5058-4da9-91cc-5c584f89a84d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:52.852138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-136b85bf-5058-4da9-91cc-5c584f89a84d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:52.865422 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-136b85bf-5058-4da9-91cc-5c584f89a84d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1188 microversion: 2.1 time: 0.129954 Jul 20 04:41:52.867272 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2323/4881] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:52 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1188 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:53.305726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ad4cf94a-b713-4437-a7f9-31e037447e44 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:53.329973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ad4cf94a-b713-4437-a7f9-31e037447e44 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:53.334530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ad4cf94a-b713-4437-a7f9-31e037447e44 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:53.340046 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ad4cf94a-b713-4437-a7f9-31e037447e44 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1731 microversion: 2.20 time: 1.260073 Jul 20 04:41:53.344108 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2559/4882] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:52 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1731 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:53.354548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6c961886-b13e-4280-aadb-b1ff619ee1cb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:53.358244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6c961886-b13e-4280-aadb-b1ff619ee1cb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:53.379135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c961886-b13e-4280-aadb-b1ff619ee1cb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:53.380589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c961886-b13e-4280-aadb-b1ff619ee1cb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:53.382933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c961886-b13e-4280-aadb-b1ff619ee1cb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:53.385403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c961886-b13e-4280-aadb-b1ff619ee1cb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:53.606424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6c961886-b13e-4280-aadb-b1ff619ee1cb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:53.618688 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6c961886-b13e-4280-aadb-b1ff619ee1cb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1608 microversion: 2.1 time: 0.268274 Jul 20 04:41:53.630556 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2324/4883] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:53 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1608 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:53.883926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2489a77b-b8a8-439f-8c0e-36c477348f8f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:53.884637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2489a77b-b8a8-439f-8c0e-36c477348f8f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:53.901890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2489a77b-b8a8-439f-8c0e-36c477348f8f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:53.902357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2489a77b-b8a8-439f-8c0e-36c477348f8f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:53.905359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2489a77b-b8a8-439f-8c0e-36c477348f8f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:53.905816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2489a77b-b8a8-439f-8c0e-36c477348f8f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:54.081646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-d023f649-e525-44d1-961e-ac2edfa82ad5 req-ffad5f1a-bb48-449f-8ae8-c121033b7069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "085f0971-9269-4d32-8eeb-17e7bf8143c2", "tag": "52337d8b-3bd5-408a-b197-2f38bf1e0818"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:54.109058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d023f649-e525-44d1-961e-ac2edfa82ad5 req-ffad5f1a-bb48-449f-8ae8-c121033b7069 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:54.109514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d023f649-e525-44d1-961e-ac2edfa82ad5 req-ffad5f1a-bb48-449f-8ae8-c121033b7069 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:54.141345 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-d023f649-e525-44d1-961e-ac2edfa82ad5 req-ffad5f1a-bb48-449f-8ae8-c121033b7069 service nova] Creating event network-changed:52337d8b-3bd5-408a-b197-2f38bf1e0818 for instance 085f0971-9269-4d32-8eeb-17e7bf8143c2 on n-h1-826526-5 Jul 20 04:41:54.172624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2489a77b-b8a8-439f-8c0e-36c477348f8f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:54.174874 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-d023f649-e525-44d1-961e-ac2edfa82ad5 req-ffad5f1a-bb48-449f-8ae8-c121033b7069 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100001 Jul 20 04:41:54.177163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:54.178438 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2325/4884] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:54.230664 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2489a77b-b8a8-439f-8c0e-36c477348f8f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1188 microversion: 2.1 time: 0.348734 Jul 20 04:41:54.244080 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2560/4885] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:53 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1188 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:54.342833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-20dba982-f513-4f38-93b2-6a8d6e33dddc req-47ad2989-7594-4986-b43c-6b908e2404c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2db32d6-491e-4d61-81b0-571b1c7073ff", "name": "network-vif-deleted", "tag": "44e02028-8e3e-412c-b0ec-8a5e5b769d7c"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:54.367119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-20dba982-f513-4f38-93b2-6a8d6e33dddc req-47ad2989-7594-4986-b43c-6b908e2404c4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:54.369088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-20dba982-f513-4f38-93b2-6a8d6e33dddc req-47ad2989-7594-4986-b43c-6b908e2404c4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:54.389958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-39b68d8e-b9b8-4a67-82a7-9a3f5ed52f9f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:54.392940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-39b68d8e-b9b8-4a67-82a7-9a3f5ed52f9f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:54.409946 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-20dba982-f513-4f38-93b2-6a8d6e33dddc req-47ad2989-7594-4986-b43c-6b908e2404c4 service nova] Creating event network-vif-deleted:44e02028-8e3e-412c-b0ec-8a5e5b769d7c for instance f2db32d6-491e-4d61-81b0-571b1c7073ff on n-h1-826526-5 Jul 20 04:41:54.420440 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-20dba982-f513-4f38-93b2-6a8d6e33dddc req-47ad2989-7594-4986-b43c-6b908e2404c4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081569 Jul 20 04:41:54.423584 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2326/4886] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:54.429173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39b68d8e-b9b8-4a67-82a7-9a3f5ed52f9f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:54.429797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39b68d8e-b9b8-4a67-82a7-9a3f5ed52f9f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:54.430649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39b68d8e-b9b8-4a67-82a7-9a3f5ed52f9f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:54.431089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39b68d8e-b9b8-4a67-82a7-9a3f5ed52f9f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:54.637707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3345caa2-7af9-4926-b487-6b98a552d3d5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:54.638451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3345caa2-7af9-4926-b487-6b98a552d3d5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:54.655096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3345caa2-7af9-4926-b487-6b98a552d3d5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:54.655924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3345caa2-7af9-4926-b487-6b98a552d3d5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:54.656938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3345caa2-7af9-4926-b487-6b98a552d3d5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:54.657562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3345caa2-7af9-4926-b487-6b98a552d3d5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:54.726566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3345caa2-7af9-4926-b487-6b98a552d3d5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:54.727813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3345caa2-7af9-4926-b487-6b98a552d3d5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:54.728649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-3345caa2-7af9-4926-b487-6b98a552d3d5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lazy-loading 'fault' on Instance uuid f2db32d6-491e-4d61-81b0-571b1c7073ff {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:41:54.816578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3345caa2-7af9-4926-b487-6b98a552d3d5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50ac97f2ef04752bd49148748e39eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd6c40faa19476db37fa7897dea5840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:54.828848 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3345caa2-7af9-4926-b487-6b98a552d3d5 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 200 len: 1328 microversion: 2.1 time: 0.195542 Jul 20 04:41:54.839771 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2327/4887] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:54 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 1328 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:55.241923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-39b68d8e-b9b8-4a67-82a7-9a3f5ed52f9f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:55.248067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-efb7455f-75ae-4a7e-8149-5a3cf61ddb6a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:55.249692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-efb7455f-75ae-4a7e-8149-5a3cf61ddb6a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:55.255155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-39b68d8e-b9b8-4a67-82a7-9a3f5ed52f9f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:55.257125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-39b68d8e-b9b8-4a67-82a7-9a3f5ed52f9f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:55.268712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-efb7455f-75ae-4a7e-8149-5a3cf61ddb6a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:55.269173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-efb7455f-75ae-4a7e-8149-5a3cf61ddb6a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:55.269976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-efb7455f-75ae-4a7e-8149-5a3cf61ddb6a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:55.270118 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-39b68d8e-b9b8-4a67-82a7-9a3f5ed52f9f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1731 microversion: 2.20 time: 0.911174 Jul 20 04:41:55.281471 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2561/4888] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:54 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1731 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:55.286183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-efb7455f-75ae-4a7e-8149-5a3cf61ddb6a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:55.502254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-efb7455f-75ae-4a7e-8149-5a3cf61ddb6a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:55.523080 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-efb7455f-75ae-4a7e-8149-5a3cf61ddb6a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1188 microversion: 2.1 time: 0.278836 Jul 20 04:41:55.529391 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2328/4889] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:55 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1188 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:55.850123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-66e69db2-40ce-4547-8bc1-0c933455fb42 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:55.851445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-66e69db2-40ce-4547-8bc1-0c933455fb42 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] [instance: f2db32d6-491e-4d61-81b0-571b1c7073ff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:55.863497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66e69db2-40ce-4547-8bc1-0c933455fb42 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:55.864381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66e69db2-40ce-4547-8bc1-0c933455fb42 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:55.867221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66e69db2-40ce-4547-8bc1-0c933455fb42 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:55.868673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66e69db2-40ce-4547-8bc1-0c933455fb42 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:55.907350 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-66e69db2-40ce-4547-8bc1-0c933455fb42 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] HTTP exception thrown: Instance f2db32d6-491e-4d61-81b0-571b1c7073ff could not be found. Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-66e69db2-40ce-4547-8bc1-0c933455fb42 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Request method failure captured: Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff HTTP/1.1 Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14VixHJkebixphdIwpShDcg3JlaVhM2CoSLlprTWiwLn49pCahdWzlOL7MmtUDivVfw4m6kI4BuKlP27BpI0P2VGSTH9CmZ2MDFgZIfQUKwMAzgmxiYhzCfBZQgehacwrRr-TbEtnIcKT7h1-1gllEV5AaLRk0CzcCXpWksXa6-Jd-I Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: fcd6c40faa19476db37fa7897dea5840 Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerActionsTestJSON-1614718281 Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcd6c40faa19476db37fa7897dea5840"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fcd6c40faa19476db37fa7897dea5840"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fcd6c40faa19476db37fa7897dea5840", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcd6c40faa19476db37fa7897dea5840"}]}] Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerActionsTestJSON-1614718281 Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: fcd6c40faa19476db37fa7897dea5840 Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerActionsTestJSON-1614718281 Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerActionsTestJSON-1614718281-project Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: f50ac97f2ef04752bd49148748e39eb8 Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerActionsTestJSON-1614718281-project Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance f2db32d6-491e-4d61-81b0-571b1c7073ff could not be found. Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'f2db32d6-491e-4d61-81b0-571b1c7073ff'} Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2db32d6-491e-4d61-81b0-571b1c7073ff could not be found. Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2db32d6-491e-4d61-81b0-571b1c7073ff could not be found. Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:55.909709 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:41:55.913628 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:55.913628 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:55.913628 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:55.913628 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:55.913628 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:55.913628 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2db32d6-491e-4d61-81b0-571b1c7073ff could not be found. Jul 20 04:41:55.913628 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:41:55.915618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-66e69db2-40ce-4547-8bc1-0c933455fb42 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Returning 404 to user: Instance f2db32d6-491e-4d61-81b0-571b1c7073ff could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:55.916734 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-66e69db2-40ce-4547-8bc1-0c933455fb42 tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff" status: 404 len: 111 microversion: 2.1 time: 0.072646 Jul 20 04:41:55.917989 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2562/4890] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:55 2022] GET /compute/v2.1/servers/f2db32d6-491e-4d61-81b0-571b1c7073ff => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:55.927796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5f75b4c9-d3f4-48b8-baf3-b3efb3bb99cb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] Calling method '.version_select at 0x7f06c7459790>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:55.992354 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5f75b4c9-d3f4-48b8-baf3-b3efb3bb99cb tempest-ServerActionsTestJSON-1614718281 tempest-ServerActionsTestJSON-1614718281-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-999992406" status: 202 len: 0 microversion: 2.1 time: 0.069273 Jul 20 04:41:55.993713 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2329/4891] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jul 20 04:41:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-999992406 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:41:56.292134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f50bceef-5356-45fc-8c2e-d440236c47d5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:56.293037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f50bceef-5356-45fc-8c2e-d440236c47d5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:56.305628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f50bceef-5356-45fc-8c2e-d440236c47d5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:56.313332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f50bceef-5356-45fc-8c2e-d440236c47d5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:56.315867 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f50bceef-5356-45fc-8c2e-d440236c47d5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:56.318170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f50bceef-5356-45fc-8c2e-d440236c47d5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:56.545777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3e8058af-f670-4514-912d-1dc67fc58a76 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:56.546563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3e8058af-f670-4514-912d-1dc67fc58a76 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:56.554285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e8058af-f670-4514-912d-1dc67fc58a76 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:56.564585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e8058af-f670-4514-912d-1dc67fc58a76 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:56.565617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e8058af-f670-4514-912d-1dc67fc58a76 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:56.566179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e8058af-f670-4514-912d-1dc67fc58a76 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:56.895417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3e8058af-f670-4514-912d-1dc67fc58a76 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:56.900893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f50bceef-5356-45fc-8c2e-d440236c47d5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:56.921932 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3e8058af-f670-4514-912d-1dc67fc58a76 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1188 microversion: 2.1 time: 0.380281 Jul 20 04:41:56.926224 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2330/4892] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:56 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1188 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:56.937622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f50bceef-5356-45fc-8c2e-d440236c47d5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:56.946099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f50bceef-5356-45fc-8c2e-d440236c47d5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:56.953925 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f50bceef-5356-45fc-8c2e-d440236c47d5 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1731 microversion: 2.20 time: 0.665779 Jul 20 04:41:56.961967 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2563/4893] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:56 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1731 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:56.981846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e84d4f62-9718-4e9a-aee2-0d6a4c55d84a tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:56.982648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e84d4f62-9718-4e9a-aee2-0d6a4c55d84a tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:56.993172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e84d4f62-9718-4e9a-aee2-0d6a4c55d84a tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:57.004492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e84d4f62-9718-4e9a-aee2-0d6a4c55d84a tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:57.010750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e84d4f62-9718-4e9a-aee2-0d6a4c55d84a tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:57.012167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e84d4f62-9718-4e9a-aee2-0d6a4c55d84a tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:57.942875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6f135d65-2567-4e80-9846-8196dccb6c5a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:57.943616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6f135d65-2567-4e80-9846-8196dccb6c5a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:57.960019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f135d65-2567-4e80-9846-8196dccb6c5a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:57.960019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f135d65-2567-4e80-9846-8196dccb6c5a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:57.963850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f135d65-2567-4e80-9846-8196dccb6c5a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:57.964465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f135d65-2567-4e80-9846-8196dccb6c5a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:58.121755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6f135d65-2567-4e80-9846-8196dccb6c5a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:58.130137 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6f135d65-2567-4e80-9846-8196dccb6c5a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 200 len: 1188 microversion: 2.1 time: 0.191253 Jul 20 04:41:58.131046 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2564/4894] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:57 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 1188 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:58.141119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c18c17c1-399b-4882-9046-5e6a2df7c784 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:58.141742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c18c17c1-399b-4882-9046-5e6a2df7c784 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:58.162580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c18c17c1-399b-4882-9046-5e6a2df7c784 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:58.162912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c18c17c1-399b-4882-9046-5e6a2df7c784 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:58.163821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c18c17c1-399b-4882-9046-5e6a2df7c784 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:58.164253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c18c17c1-399b-4882-9046-5e6a2df7c784 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:58.184203 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e84d4f62-9718-4e9a-aee2-0d6a4c55d84a tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1833 microversion: 2.1 time: 1.206061 Jul 20 04:41:58.185708 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2331/4895] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:56 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1833 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:58.209414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-97a924d9-7cd6-4655-a061-d891d8e6cff2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:58.212081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-97a924d9-7cd6-4655-a061-d891d8e6cff2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:58.220366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97a924d9-7cd6-4655-a061-d891d8e6cff2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:58.222053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97a924d9-7cd6-4655-a061-d891d8e6cff2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:58.224117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97a924d9-7cd6-4655-a061-d891d8e6cff2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:58.225000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97a924d9-7cd6-4655-a061-d891d8e6cff2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:58.670145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c18c17c1-399b-4882-9046-5e6a2df7c784 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:58.690148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c18c17c1-399b-4882-9046-5e6a2df7c784 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:58.691843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c18c17c1-399b-4882-9046-5e6a2df7c784 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:58.693399 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c18c17c1-399b-4882-9046-5e6a2df7c784 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1731 microversion: 2.20 time: 0.561413 Jul 20 04:41:58.704395 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2565/4896] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:58 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1731 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:58.918362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-97a924d9-7cd6-4655-a061-d891d8e6cff2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:58.934177 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-97a924d9-7cd6-4655-a061-d891d8e6cff2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1682 microversion: 2.1 time: 0.735999 Jul 20 04:41:58.958639 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2332/4897] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:58 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1682 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:59.152947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-49e1d04d-b6d5-4286-8e62-b69af64a710c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:59.154248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-49e1d04d-b6d5-4286-8e62-b69af64a710c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 27761b08-de0f-4d8a-aeee-289edee644b1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:59.184362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-49e1d04d-b6d5-4286-8e62-b69af64a710c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:59.185236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-49e1d04d-b6d5-4286-8e62-b69af64a710c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:59.186370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-49e1d04d-b6d5-4286-8e62-b69af64a710c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:59.187205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-49e1d04d-b6d5-4286-8e62-b69af64a710c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:59.187733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ae36665a-bb1a-4cd4-b212-33749b336227 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:59.188755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ae36665a-bb1a-4cd4-b212-33749b336227 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:59.197693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae36665a-bb1a-4cd4-b212-33749b336227 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:59.198068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae36665a-bb1a-4cd4-b212-33749b336227 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:59.198868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae36665a-bb1a-4cd4-b212-33749b336227 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:59.204610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae36665a-bb1a-4cd4-b212-33749b336227 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:59.209980 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-49e1d04d-b6d5-4286-8e62-b69af64a710c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] HTTP exception thrown: Instance 27761b08-de0f-4d8a-aeee-289edee644b1 could not be found. Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-49e1d04d-b6d5-4286-8e62-b69af64a710c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Request method failure captured: Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 HTTP/1.1 Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14dGzvYcPg3NF43f6ZRAI_AjtsB7nnPabtQnWEyYg-EXw30wVgvbZX3EBgp2DuSsT-UZ385yph2nVbWQKDH20kvx2xMXBhHcpx3bIjpA8OEQ9j_bQ2MqW2hbHHtIFQtSaphPYv0KfZxRo98jYdMcipaN9CmzRsyzwLTotDNtaeBR3wc Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b889ad56221143f0a54450c81ba738a7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}] Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: bc760e8f522640fc9190460719f5dcc2 Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 27761b08-de0f-4d8a-aeee-289edee644b1 could not be found. Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '27761b08-de0f-4d8a-aeee-289edee644b1'} Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27761b08-de0f-4d8a-aeee-289edee644b1 could not be found. Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27761b08-de0f-4d8a-aeee-289edee644b1 could not be found. Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:59.215499 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:41:59.221114 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:59.221114 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:59.221114 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:59.221114 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:59.221114 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:59.221114 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27761b08-de0f-4d8a-aeee-289edee644b1 could not be found. Jul 20 04:41:59.221114 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:41:59.223491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-49e1d04d-b6d5-4286-8e62-b69af64a710c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Returning 404 to user: Instance 27761b08-de0f-4d8a-aeee-289edee644b1 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:59.226077 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-49e1d04d-b6d5-4286-8e62-b69af64a710c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1" status: 404 len: 111 microversion: 2.1 time: 0.079253 Jul 20 04:41:59.227261 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2566/4898] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:59 2022] GET /compute/v2.1/servers/27761b08-de0f-4d8a-aeee-289edee644b1 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:59.296361 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ae36665a-bb1a-4cd4-b212-33749b336227 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605/action" status: 200 len: 32625 microversion: 2.1 time: 0.112368 Jul 20 04:41:59.303036 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2333/4899] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:41:59 2022] POST /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605/action => generated 32625 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:41:59.528623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d8c1a1ac-964f-4db8-8943-b4ff4ce0337f tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:59.529232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d8c1a1ac-964f-4db8-8943-b4ff4ce0337f tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:59.572940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8c1a1ac-964f-4db8-8943-b4ff4ce0337f tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:59.573387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8c1a1ac-964f-4db8-8943-b4ff4ce0337f tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:59.574192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8c1a1ac-964f-4db8-8943-b4ff4ce0337f tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:59.576122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8c1a1ac-964f-4db8-8943-b4ff4ce0337f tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:59.717441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7534c122-194a-4d5c-9f67-9574b1fe0561 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:59.718406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7534c122-194a-4d5c-9f67-9574b1fe0561 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:59.728760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7534c122-194a-4d5c-9f67-9574b1fe0561 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:59.729628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7534c122-194a-4d5c-9f67-9574b1fe0561 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:59.730686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7534c122-194a-4d5c-9f67-9574b1fe0561 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:59.731680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7534c122-194a-4d5c-9f67-9574b1fe0561 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:59.760732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d8c1a1ac-964f-4db8-8943-b4ff4ce0337f tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'fef75f32cae6446b8e8ed70c9e616d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59855864129494fb59a5ef14dd9db1f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:59.761340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d8c1a1ac-964f-4db8-8943-b4ff4ce0337f tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] flavor_id is None. Assuming migration. {{(pid=127871) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 04:41:59.761785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d8c1a1ac-964f-4db8-8943-b4ff4ce0337f tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127871) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:42:00.137942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7534c122-194a-4d5c-9f67-9574b1fe0561 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:00.146832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7534c122-194a-4d5c-9f67-9574b1fe0561 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:00.148670 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7534c122-194a-4d5c-9f67-9574b1fe0561 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:00.150400 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7534c122-194a-4d5c-9f67-9574b1fe0561 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1731 microversion: 2.20 time: 0.437972 Jul 20 04:42:00.151697 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2334/4900] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:59 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1731 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:00.196146 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d8c1a1ac-964f-4db8-8943-b4ff4ce0337f tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605/action" status: 202 len: 0 microversion: 2.1 time: 0.678862 Jul 20 04:42:00.200988 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2567/4901] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:41:59 2022] POST /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:42:00.206994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0bef7895-5714-42b7-8484-c5a52f158622 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:00.207539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0bef7895-5714-42b7-8484-c5a52f158622 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:00.214542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0bef7895-5714-42b7-8484-c5a52f158622 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:00.215529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0bef7895-5714-42b7-8484-c5a52f158622 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:00.216574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0bef7895-5714-42b7-8484-c5a52f158622 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:00.217202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0bef7895-5714-42b7-8484-c5a52f158622 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:00.642302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0bef7895-5714-42b7-8484-c5a52f158622 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:00.654885 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0bef7895-5714-42b7-8484-c5a52f158622 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1691 microversion: 2.1 time: 0.452955 Jul 20 04:42:00.655507 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2335/4902] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:00 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1691 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:00.925036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-764724a6-ffab-4592-9f06-290f8609942d req-f5743067-31e0-4db6-a085-032f99072d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7e62d3-1b07-483d-9943-887c096d4350", "name": "network-vif-plugged", "status": "completed", "tag": "f03b37b1-bac2-405f-aeda-863d4b123005"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:00.947264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-764724a6-ffab-4592-9f06-290f8609942d req-f5743067-31e0-4db6-a085-032f99072d91 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:00.952089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-764724a6-ffab-4592-9f06-290f8609942d req-f5743067-31e0-4db6-a085-032f99072d91 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:00.978815 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-764724a6-ffab-4592-9f06-290f8609942d req-f5743067-31e0-4db6-a085-032f99072d91 service nova] Creating event network-vif-plugged:f03b37b1-bac2-405f-aeda-863d4b123005 for instance 7c7e62d3-1b07-483d-9943-887c096d4350 on n-h1-826526-5 Jul 20 04:42:00.985081 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-764724a6-ffab-4592-9f06-290f8609942d req-f5743067-31e0-4db6-a085-032f99072d91 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064463 Jul 20 04:42:00.986294 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2568/4903] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:42:01.173522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8ab9dc7f-09d3-4829-9c11-fdd9b80b4673 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:01.174146 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8ab9dc7f-09d3-4829-9c11-fdd9b80b4673 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:01.190123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8ab9dc7f-09d3-4829-9c11-fdd9b80b4673 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:01.190601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8ab9dc7f-09d3-4829-9c11-fdd9b80b4673 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:01.191429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8ab9dc7f-09d3-4829-9c11-fdd9b80b4673 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:01.191879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8ab9dc7f-09d3-4829-9c11-fdd9b80b4673 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:01.674643 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f0406240-2b87-4376-9023-e1494bf8c59b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:01.678357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f0406240-2b87-4376-9023-e1494bf8c59b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:01.694859 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0406240-2b87-4376-9023-e1494bf8c59b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:01.701355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8ab9dc7f-09d3-4829-9c11-fdd9b80b4673 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:01.704245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0406240-2b87-4376-9023-e1494bf8c59b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:01.707610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0406240-2b87-4376-9023-e1494bf8c59b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:01.711565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0406240-2b87-4376-9023-e1494bf8c59b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:01.713360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8ab9dc7f-09d3-4829-9c11-fdd9b80b4673 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:01.722777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8ab9dc7f-09d3-4829-9c11-fdd9b80b4673 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:01.724329 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8ab9dc7f-09d3-4829-9c11-fdd9b80b4673 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1731 microversion: 2.20 time: 0.554851 Jul 20 04:42:01.736325 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2336/4904] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:01 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1731 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:02.286378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f0406240-2b87-4376-9023-e1494bf8c59b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:02.322714 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f0406240-2b87-4376-9023-e1494bf8c59b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1691 microversion: 2.1 time: 0.651171 Jul 20 04:42:02.324221 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2569/4905] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:01 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1691 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:02.743420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-46f89359-cb3b-4a53-91c8-1f7f760944a2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:02.744052 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-46f89359-cb3b-4a53-91c8-1f7f760944a2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:02.763984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46f89359-cb3b-4a53-91c8-1f7f760944a2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:02.764492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46f89359-cb3b-4a53-91c8-1f7f760944a2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:02.765320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46f89359-cb3b-4a53-91c8-1f7f760944a2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:02.765767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46f89359-cb3b-4a53-91c8-1f7f760944a2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:03.127580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-46f89359-cb3b-4a53-91c8-1f7f760944a2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:03.138249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-46f89359-cb3b-4a53-91c8-1f7f760944a2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:03.139777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-46f89359-cb3b-4a53-91c8-1f7f760944a2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:03.154283 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-46f89359-cb3b-4a53-91c8-1f7f760944a2 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1731 microversion: 2.20 time: 0.402492 Jul 20 04:42:03.163009 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2337/4906] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:02 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1731 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:03.343279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e3796d8e-8b0c-4c2b-ad79-915f01c31e13 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:03.344193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e3796d8e-8b0c-4c2b-ad79-915f01c31e13 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:03.372944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3796d8e-8b0c-4c2b-ad79-915f01c31e13 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:03.373785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3796d8e-8b0c-4c2b-ad79-915f01c31e13 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:03.375140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3796d8e-8b0c-4c2b-ad79-915f01c31e13 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:03.375851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3796d8e-8b0c-4c2b-ad79-915f01c31e13 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:04.175591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-154ffb14-152e-4407-a5e5-913e94bd8454 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:04.179075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-154ffb14-152e-4407-a5e5-913e94bd8454 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:04.196123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-154ffb14-152e-4407-a5e5-913e94bd8454 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:04.200933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-154ffb14-152e-4407-a5e5-913e94bd8454 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:04.201800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-154ffb14-152e-4407-a5e5-913e94bd8454 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:04.202249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-154ffb14-152e-4407-a5e5-913e94bd8454 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:04.386951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e3796d8e-8b0c-4c2b-ad79-915f01c31e13 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:04.399045 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e3796d8e-8b0c-4c2b-ad79-915f01c31e13 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1691 microversion: 2.1 time: 1.061278 Jul 20 04:42:04.401860 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2570/4907] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:03 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1691 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:05.062916 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-154ffb14-152e-4407-a5e5-913e94bd8454 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:05.072553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-154ffb14-152e-4407-a5e5-913e94bd8454 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:05.088208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-154ffb14-152e-4407-a5e5-913e94bd8454 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:05.097142 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-154ffb14-152e-4407-a5e5-913e94bd8454 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1731 microversion: 2.20 time: 0.925905 Jul 20 04:42:05.102083 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2338/4908] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:04 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1731 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:42:05.421479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5d241cfb-82c0-4c42-9361-1be43808d7b0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:05.422760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5d241cfb-82c0-4c42-9361-1be43808d7b0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:05.444869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d241cfb-82c0-4c42-9361-1be43808d7b0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:05.444869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d241cfb-82c0-4c42-9361-1be43808d7b0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:05.444869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d241cfb-82c0-4c42-9361-1be43808d7b0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:05.444869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d241cfb-82c0-4c42-9361-1be43808d7b0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:06.119826 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4e43168a-e39a-45c1-b6c6-c736d8e5b40a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:06.120632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4e43168a-e39a-45c1-b6c6-c736d8e5b40a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:06.134933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e43168a-e39a-45c1-b6c6-c736d8e5b40a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:06.135786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e43168a-e39a-45c1-b6c6-c736d8e5b40a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:06.156971 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e43168a-e39a-45c1-b6c6-c736d8e5b40a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:06.157490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e43168a-e39a-45c1-b6c6-c736d8e5b40a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:06.911366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4e43168a-e39a-45c1-b6c6-c736d8e5b40a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:06.915961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5d241cfb-82c0-4c42-9361-1be43808d7b0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:06.924239 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5d241cfb-82c0-4c42-9361-1be43808d7b0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1691 microversion: 2.1 time: 1.508849 Jul 20 04:42:06.928664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4e43168a-e39a-45c1-b6c6-c736d8e5b40a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:06.935495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4e43168a-e39a-45c1-b6c6-c736d8e5b40a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:06.942883 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4e43168a-e39a-45c1-b6c6-c736d8e5b40a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1718 microversion: 2.20 time: 0.826341 Jul 20 04:42:06.947232 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2339/4910] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:06 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1718 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:06.947446 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2571/4910] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:05 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1691 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:07.958630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c4dc9c4d-664e-4202-af1d-357e27064a1f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:07.959259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c4dc9c4d-664e-4202-af1d-357e27064a1f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:07.975376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:07.999458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4dc9c4d-664e-4202-af1d-357e27064a1f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:08.004078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4dc9c4d-664e-4202-af1d-357e27064a1f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:08.007399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4dc9c4d-664e-4202-af1d-357e27064a1f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:08.008161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4dc9c4d-664e-4202-af1d-357e27064a1f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:08.322443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c4dc9c4d-664e-4202-af1d-357e27064a1f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:08.331107 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c4dc9c4d-664e-4202-af1d-357e27064a1f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1696 microversion: 2.1 time: 0.391171 Jul 20 04:42:08.331785 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2572/4911] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:07 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1696 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:09.350719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b1d1a341-d5fa-45fe-9741-fd157fec3481 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:09.352175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b1d1a341-d5fa-45fe-9741-fd157fec3481 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:09.367180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1d1a341-d5fa-45fe-9741-fd157fec3481 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:09.372522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1d1a341-d5fa-45fe-9741-fd157fec3481 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:09.374118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1d1a341-d5fa-45fe-9741-fd157fec3481 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:09.378001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1d1a341-d5fa-45fe-9741-fd157fec3481 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:10.939957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b1d1a341-d5fa-45fe-9741-fd157fec3481 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:10.956907 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b1d1a341-d5fa-45fe-9741-fd157fec3481 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1696 microversion: 2.1 time: 1.602667 Jul 20 04:42:10.963319 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2340/4912] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:09 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1696 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:11.989141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ee12ded0-10d3-4ed5-9a38-9eab9ec1a426 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:11.990857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ee12ded0-10d3-4ed5-9a38-9eab9ec1a426 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:12.028868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee12ded0-10d3-4ed5-9a38-9eab9ec1a426 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:12.035712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee12ded0-10d3-4ed5-9a38-9eab9ec1a426 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:12.040237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee12ded0-10d3-4ed5-9a38-9eab9ec1a426 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:12.041414 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee12ded0-10d3-4ed5-9a38-9eab9ec1a426 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:12.406920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ee12ded0-10d3-4ed5-9a38-9eab9ec1a426 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:12.424346 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ee12ded0-10d3-4ed5-9a38-9eab9ec1a426 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1696 microversion: 2.1 time: 0.453519 Jul 20 04:42:12.425560 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2573/4913] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:11 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1696 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:13.447262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8906cdef-60e1-493f-b531-64084c7fe03e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:13.447894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8906cdef-60e1-493f-b531-64084c7fe03e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:13.500129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8906cdef-60e1-493f-b531-64084c7fe03e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:13.502965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8906cdef-60e1-493f-b531-64084c7fe03e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:13.505037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8906cdef-60e1-493f-b531-64084c7fe03e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:13.507860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8906cdef-60e1-493f-b531-64084c7fe03e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:14.025654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8906cdef-60e1-493f-b531-64084c7fe03e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:14.032690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:14.038527 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8906cdef-60e1-493f-b531-64084c7fe03e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1696 microversion: 2.1 time: 0.597511 Jul 20 04:42:14.043745 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2341/4914] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:13 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1696 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:15.063895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-49c3fc7b-41a1-4bff-bd8e-d43825ea73d4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:15.065656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-49c3fc7b-41a1-4bff-bd8e-d43825ea73d4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:15.109782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-49c3fc7b-41a1-4bff-bd8e-d43825ea73d4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:15.113379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-49c3fc7b-41a1-4bff-bd8e-d43825ea73d4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:15.115375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-49c3fc7b-41a1-4bff-bd8e-d43825ea73d4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:15.126395 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-49c3fc7b-41a1-4bff-bd8e-d43825ea73d4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:15.788890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-49c3fc7b-41a1-4bff-bd8e-d43825ea73d4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:15.806840 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-49c3fc7b-41a1-4bff-bd8e-d43825ea73d4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1696 microversion: 2.1 time: 0.749071 Jul 20 04:42:15.818362 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2574/4915] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:15 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1696 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:16.806534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a32025ba-0440-4118-ae86-802dfab69f21 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1255722493", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "74637077-d0a9-4590-b4c3-611177f1dfda"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:16.832016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6383f64d-35b5-4302-909f-b95aa9ddd1f7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:16.832773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6383f64d-35b5-4302-909f-b95aa9ddd1f7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:16.840386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6383f64d-35b5-4302-909f-b95aa9ddd1f7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:16.841159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6383f64d-35b5-4302-909f-b95aa9ddd1f7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:16.851382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6383f64d-35b5-4302-909f-b95aa9ddd1f7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:16.853353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6383f64d-35b5-4302-909f-b95aa9ddd1f7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:16.903349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-a32025ba-0440-4118-ae86-802dfab69f21 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] validate_networks() for [('74637077-d0a9-4590-b4c3-611177f1dfda', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:42:17.191974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6383f64d-35b5-4302-909f-b95aa9ddd1f7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:17.207485 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6383f64d-35b5-4302-909f-b95aa9ddd1f7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1696 microversion: 2.1 time: 0.383220 Jul 20 04:42:17.216388 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2575/4916] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:16 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1696 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:17.388336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7dfc1f2f-f00a-4dc6-98be-05d10d909dc6 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Action: 'create', calling method: .version_select at 0x7f06be3eb280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-151124949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3iCBq0KaJMjenQwkHptHdAwH7ELIGUkUV2tEQlP0Mtq8uWvfPf623tVMxAwft5evJg31/Hn1L2xUUoq6Ljbe8BuuMLPIik7HhC7uiWwYUaPP9eDztWvlWtzsXuOzC4sQ=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:17.439493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-7dfc1f2f-f00a-4dc6-98be-05d10d909dc6 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Getting quotas for project c9b5d48d9c894a32b3f417820f43427e. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:42:17.464419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-7dfc1f2f-f00a-4dc6-98be-05d10d909dc6 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Getting quotas for user 43a4b4fa5cc24463aa398fbc4e1404d4 and project c9b5d48d9c894a32b3f417820f43427e. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:42:17.528553 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7dfc1f2f-f00a-4dc6-98be-05d10d909dc6 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.145662 Jul 20 04:42:17.536944 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2576/4917] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:42:17 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:18.237460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-274b3bda-9e56-4db7-8454-5df5e3875148 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:18.240079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-274b3bda-9e56-4db7-8454-5df5e3875148 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:18.288184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-274b3bda-9e56-4db7-8454-5df5e3875148 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:18.289647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-274b3bda-9e56-4db7-8454-5df5e3875148 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:18.295567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-274b3bda-9e56-4db7-8454-5df5e3875148 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:18.296565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-274b3bda-9e56-4db7-8454-5df5e3875148 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:18.847089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-274b3bda-9e56-4db7-8454-5df5e3875148 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:18.870508 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-274b3bda-9e56-4db7-8454-5df5e3875148 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1696 microversion: 2.1 time: 0.639858 Jul 20 04:42:18.876386 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2577/4918] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:18 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1696 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:18.882283 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a32025ba-0440-4118-ae86-802dfab69f21 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:42:18.883605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a32025ba-0440-4118-ae86-802dfab69f21 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:42:18.884292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a32025ba-0440-4118-ae86-802dfab69f21 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:42:18.884940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a32025ba-0440-4118-ae86-802dfab69f21 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:42:18.885617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a32025ba-0440-4118-ae86-802dfab69f21 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:42:18.914745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a32025ba-0440-4118-ae86-802dfab69f21 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:18.917215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a32025ba-0440-4118-ae86-802dfab69f21 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:18.921124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a32025ba-0440-4118-ae86-802dfab69f21 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:18.925021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a32025ba-0440-4118-ae86-802dfab69f21 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:19.016168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-a32025ba-0440-4118-ae86-802dfab69f21 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Getting quotas for project c445f8434bd0407c8ea69b8aeed234be. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:42:19.030753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-a32025ba-0440-4118-ae86-802dfab69f21 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Getting quotas for user 336e0b9a90f94c0d9337fe6e8a1727f1 and project c445f8434bd0407c8ea69b8aeed234be. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:42:19.070407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a32025ba-0440-4118-ae86-802dfab69f21 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:42:19.074056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a32025ba-0440-4118-ae86-802dfab69f21 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:42:19.219052 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a32025ba-0440-4118-ae86-802dfab69f21 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.715040 Jul 20 04:42:19.235141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ef3d88a8-faf9-4891-b6f3-413ad2d89b4b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:19.235821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ef3d88a8-faf9-4891-b6f3-413ad2d89b4b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:19.247092 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2342/4919] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:42:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:42:19.839135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ef3d88a8-faf9-4891-b6f3-413ad2d89b4b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:19.848307 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ef3d88a8-faf9-4891-b6f3-413ad2d89b4b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1218 microversion: 2.1 time: 0.621678 Jul 20 04:42:19.862654 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2578/4920] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:19 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1218 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:19.891663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ad22ebe3-31f6-4661-ba2a-87e5d46b6ef1 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:19.892124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ad22ebe3-31f6-4661-ba2a-87e5d46b6ef1 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:19.906142 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:19.908047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad22ebe3-31f6-4661-ba2a-87e5d46b6ef1 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:19.916741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad22ebe3-31f6-4661-ba2a-87e5d46b6ef1 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:19.917724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad22ebe3-31f6-4661-ba2a-87e5d46b6ef1 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:19.918245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad22ebe3-31f6-4661-ba2a-87e5d46b6ef1 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:20.552960 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ad22ebe3-31f6-4661-ba2a-87e5d46b6ef1 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:20.581236 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ad22ebe3-31f6-4661-ba2a-87e5d46b6ef1 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1696 microversion: 2.1 time: 0.694012 Jul 20 04:42:20.589519 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2343/4921] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:19 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1696 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:20.877886 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ad41ac60-ebae-4c67-8707-5fb8e8750589 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:20.878766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ad41ac60-ebae-4c67-8707-5fb8e8750589 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:20.925070 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad41ac60-ebae-4c67-8707-5fb8e8750589 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:20.927387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad41ac60-ebae-4c67-8707-5fb8e8750589 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:20.937665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad41ac60-ebae-4c67-8707-5fb8e8750589 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:20.940548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad41ac60-ebae-4c67-8707-5fb8e8750589 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:21.410731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ad41ac60-ebae-4c67-8707-5fb8e8750589 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:21.421297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:21.432149 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ad41ac60-ebae-4c67-8707-5fb8e8750589 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1222 microversion: 2.1 time: 0.559262 Jul 20 04:42:21.445395 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2579/4922] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:20 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1222 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:21.606563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b56ab0a4-ee29-498e-b778-cbd2acd38d56 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:21.607487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b56ab0a4-ee29-498e-b778-cbd2acd38d56 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:21.625675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b56ab0a4-ee29-498e-b778-cbd2acd38d56 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:21.627959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b56ab0a4-ee29-498e-b778-cbd2acd38d56 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:21.632391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b56ab0a4-ee29-498e-b778-cbd2acd38d56 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:21.633073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b56ab0a4-ee29-498e-b778-cbd2acd38d56 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:22.462995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-419a4bfe-519a-408c-9ea2-c4144741601e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:22.464454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-419a4bfe-519a-408c-9ea2-c4144741601e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:22.486427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-419a4bfe-519a-408c-9ea2-c4144741601e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:22.487269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-419a4bfe-519a-408c-9ea2-c4144741601e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:22.488381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-419a4bfe-519a-408c-9ea2-c4144741601e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:22.491417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-419a4bfe-519a-408c-9ea2-c4144741601e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:23.327900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-419a4bfe-519a-408c-9ea2-c4144741601e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:23.337596 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-419a4bfe-519a-408c-9ea2-c4144741601e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1288 microversion: 2.1 time: 0.879046 Jul 20 04:42:23.341641 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2580/4923] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:22 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1288 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:23.542368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b56ab0a4-ee29-498e-b778-cbd2acd38d56 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:23.550099 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b56ab0a4-ee29-498e-b778-cbd2acd38d56 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1695 microversion: 2.1 time: 1.947663 Jul 20 04:42:23.550693 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2344/4924] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:21 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1695 bytes in 1949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:23.637583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-4d472cbe-a491-425b-b751-2c2729576776 req-f5b9ab8b-b202-4168-bb9d-03662c4d6b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ed5f8e-9305-42db-8723-6fba63245605", "name": "network-vif-unplugged", "status": "completed", "tag": "dd8fb1a0-4673-4433-af0e-9ceaff8681f5"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:23.653760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4d472cbe-a491-425b-b751-2c2729576776 req-f5b9ab8b-b202-4168-bb9d-03662c4d6b1f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:23.655019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4d472cbe-a491-425b-b751-2c2729576776 req-f5b9ab8b-b202-4168-bb9d-03662c4d6b1f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:23.693913 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-4d472cbe-a491-425b-b751-2c2729576776 req-f5b9ab8b-b202-4168-bb9d-03662c4d6b1f service nova] Creating event network-vif-unplugged:dd8fb1a0-4673-4433-af0e-9ceaff8681f5 for instance 90ed5f8e-9305-42db-8723-6fba63245605 on n-h1-826526-5 Jul 20 04:42:23.706486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-4d472cbe-a491-425b-b751-2c2729576776 req-f5b9ab8b-b202-4168-bb9d-03662c4d6b1f service nova] Instance 90ed5f8e-9305-42db-8723-6fba63245605 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:42:23.751838 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-4d472cbe-a491-425b-b751-2c2729576776 req-f5b9ab8b-b202-4168-bb9d-03662c4d6b1f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102804 Jul 20 04:42:23.753122 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2581/4925] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:24.358917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-913cc331-2726-405e-a08a-1b7750ac28f1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:24.359552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-913cc331-2726-405e-a08a-1b7750ac28f1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:24.380591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-913cc331-2726-405e-a08a-1b7750ac28f1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:24.381154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-913cc331-2726-405e-a08a-1b7750ac28f1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:24.382028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-913cc331-2726-405e-a08a-1b7750ac28f1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:24.382479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-913cc331-2726-405e-a08a-1b7750ac28f1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:24.571792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-beb26fea-68ff-4c64-aedb-a9e9ea8c2d01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:24.573678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-beb26fea-68ff-4c64-aedb-a9e9ea8c2d01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:24.594601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-beb26fea-68ff-4c64-aedb-a9e9ea8c2d01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:24.595052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-beb26fea-68ff-4c64-aedb-a9e9ea8c2d01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:24.597721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-beb26fea-68ff-4c64-aedb-a9e9ea8c2d01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:24.598373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-beb26fea-68ff-4c64-aedb-a9e9ea8c2d01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:24.735261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-913cc331-2726-405e-a08a-1b7750ac28f1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:24.749970 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-913cc331-2726-405e-a08a-1b7750ac28f1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1276 microversion: 2.1 time: 0.394755 Jul 20 04:42:24.750635 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2345/4926] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:24 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1276 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:24.993549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7fd1def9-86f2-4db9-95aa-a1db5f1a5d5d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-178718508", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "24376b3b-ef91-4d5b-98d4-78196baa81f1"}], "key_name": "tempest-TestNetworkBasicOps-151124949", "security_groups": [{"name": "tempest-secgroup-smoke-1726458789"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:25.227298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-beb26fea-68ff-4c64-aedb-a9e9ea8c2d01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:25.238630 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-beb26fea-68ff-4c64-aedb-a9e9ea8c2d01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1695 microversion: 2.1 time: 0.671107 Jul 20 04:42:25.239212 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2582/4927] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:24 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1695 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:25.619035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-7fd1def9-86f2-4db9-95aa-a1db5f1a5d5d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] validate_networks() for [('24376b3b-ef91-4d5b-98d4-78196baa81f1', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:42:25.775021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-047e3770-2ce6-4d1d-9ba5-0e13be0a84ca tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:25.777029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-047e3770-2ce6-4d1d-9ba5-0e13be0a84ca tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:25.798679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-047e3770-2ce6-4d1d-9ba5-0e13be0a84ca tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:25.799419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-047e3770-2ce6-4d1d-9ba5-0e13be0a84ca tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:25.800430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-047e3770-2ce6-4d1d-9ba5-0e13be0a84ca tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:25.801024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-047e3770-2ce6-4d1d-9ba5-0e13be0a84ca tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:26.118883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-047e3770-2ce6-4d1d-9ba5-0e13be0a84ca tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:26.145773 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-047e3770-2ce6-4d1d-9ba5-0e13be0a84ca tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1318 microversion: 2.1 time: 0.380897 Jul 20 04:42:26.147444 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2583/4928] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:25 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:26.155821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-375a429f-67cc-496d-8bcb-823746ed7dca req-dbade970-606f-4b8c-8a6f-fa8ab10ec125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ed5f8e-9305-42db-8723-6fba63245605", "tag": "dd8fb1a0-4673-4433-af0e-9ceaff8681f5"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:26.186580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-375a429f-67cc-496d-8bcb-823746ed7dca req-dbade970-606f-4b8c-8a6f-fa8ab10ec125 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:26.187683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-375a429f-67cc-496d-8bcb-823746ed7dca req-dbade970-606f-4b8c-8a6f-fa8ab10ec125 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:26.220077 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-375a429f-67cc-496d-8bcb-823746ed7dca req-dbade970-606f-4b8c-8a6f-fa8ab10ec125 service nova] Creating event network-changed:dd8fb1a0-4673-4433-af0e-9ceaff8681f5 for instance 90ed5f8e-9305-42db-8723-6fba63245605 on n-h1-826526-5 Jul 20 04:42:26.247707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-375a429f-67cc-496d-8bcb-823746ed7dca req-dbade970-606f-4b8c-8a6f-fa8ab10ec125 service nova] Instance 90ed5f8e-9305-42db-8723-6fba63245605 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:42:26.273383 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-375a429f-67cc-496d-8bcb-823746ed7dca req-dbade970-606f-4b8c-8a6f-fa8ab10ec125 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124403 Jul 20 04:42:26.274742 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2584/4929] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:26.294473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-71bd0614-fffa-4e8a-a79e-9d924d96907e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:26.296032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-71bd0614-fffa-4e8a-a79e-9d924d96907e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:26.308203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71bd0614-fffa-4e8a-a79e-9d924d96907e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:26.310011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71bd0614-fffa-4e8a-a79e-9d924d96907e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:26.317656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71bd0614-fffa-4e8a-a79e-9d924d96907e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:26.320958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71bd0614-fffa-4e8a-a79e-9d924d96907e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:26.773997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-71bd0614-fffa-4e8a-a79e-9d924d96907e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:26.790663 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-71bd0614-fffa-4e8a-a79e-9d924d96907e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1693 microversion: 2.1 time: 0.507599 Jul 20 04:42:26.793324 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2585/4930] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:26 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1693 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:27.152290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-da57a528-807f-4569-90f1-6d8357c28a87 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a55ea126-06ab-4140-ae38-1c5c5a29411c"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:27.157330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-da57a528-807f-4569-90f1-6d8357c28a87 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:27.174305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da57a528-807f-4569-90f1-6d8357c28a87 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:27.177586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da57a528-807f-4569-90f1-6d8357c28a87 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:27.179431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da57a528-807f-4569-90f1-6d8357c28a87 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:27.180788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da57a528-807f-4569-90f1-6d8357c28a87 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:27.996966 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-da57a528-807f-4569-90f1-6d8357c28a87 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "POST /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.848392 Jul 20 04:42:27.997663 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2586/4931] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 04:42:27 2022] POST /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments => generated 194 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:42:28.015021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-873d216b-e322-4a00-b42e-ad3c3c1f4e67 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:28.016086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-873d216b-e322-4a00-b42e-ad3c3c1f4e67 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:28.034355 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-873d216b-e322-4a00-b42e-ad3c3c1f4e67 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:28.037598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-873d216b-e322-4a00-b42e-ad3c3c1f4e67 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:28.038776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-873d216b-e322-4a00-b42e-ad3c3c1f4e67 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:28.043607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-873d216b-e322-4a00-b42e-ad3c3c1f4e67 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:28.453546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-7fd1def9-86f2-4db9-95aa-a1db5f1a5d5d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:42:28.454190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-7fd1def9-86f2-4db9-95aa-a1db5f1a5d5d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:42:28.454787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-7fd1def9-86f2-4db9-95aa-a1db5f1a5d5d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:42:28.455817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-7fd1def9-86f2-4db9-95aa-a1db5f1a5d5d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:42:28.456802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-7fd1def9-86f2-4db9-95aa-a1db5f1a5d5d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:42:28.471720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fd1def9-86f2-4db9-95aa-a1db5f1a5d5d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:28.472122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fd1def9-86f2-4db9-95aa-a1db5f1a5d5d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:28.473295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fd1def9-86f2-4db9-95aa-a1db5f1a5d5d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:28.473930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fd1def9-86f2-4db9-95aa-a1db5f1a5d5d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:28.500785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-873d216b-e322-4a00-b42e-ad3c3c1f4e67 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:28.513067 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-873d216b-e322-4a00-b42e-ad3c3c1f4e67 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1318 microversion: 2.1 time: 0.514144 Jul 20 04:42:28.526325 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2587/4932] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:27 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:28.539203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1158969c-a4a1-449f-a4e2-deb2b85976b7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:28.548852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1158969c-a4a1-449f-a4e2-deb2b85976b7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:28.574430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1158969c-a4a1-449f-a4e2-deb2b85976b7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:28.575129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1158969c-a4a1-449f-a4e2-deb2b85976b7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:28.583952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1158969c-a4a1-449f-a4e2-deb2b85976b7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:28.585136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1158969c-a4a1-449f-a4e2-deb2b85976b7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:28.590895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-7fd1def9-86f2-4db9-95aa-a1db5f1a5d5d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Getting quotas for project c9b5d48d9c894a32b3f417820f43427e. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:42:28.610183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-7fd1def9-86f2-4db9-95aa-a1db5f1a5d5d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Getting quotas for user 43a4b4fa5cc24463aa398fbc4e1404d4 and project c9b5d48d9c894a32b3f417820f43427e. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:42:28.680613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7fd1def9-86f2-4db9-95aa-a1db5f1a5d5d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:42:28.692381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7fd1def9-86f2-4db9-95aa-a1db5f1a5d5d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:42:28.864119 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7fd1def9-86f2-4db9-95aa-a1db5f1a5d5d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.877308 Jul 20 04:42:28.873950 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2346/4933] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:42:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 3888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:42:28.906452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-48e3c720-8bc8-49f4-8c1f-3874c0374339 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:28.907083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-48e3c720-8bc8-49f4-8c1f-3874c0374339 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:29.282144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1158969c-a4a1-449f-a4e2-deb2b85976b7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:29.293613 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1158969c-a4a1-449f-a4e2-deb2b85976b7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1690 microversion: 2.1 time: 0.763607 Jul 20 04:42:29.295696 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2588/4934] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:28 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1690 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:29.318969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dc613ced-2050-41e5-a3eb-87b88a3e97a7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:29.322539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dc613ced-2050-41e5-a3eb-87b88a3e97a7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:29.344821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc613ced-2050-41e5-a3eb-87b88a3e97a7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.348761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc613ced-2050-41e5-a3eb-87b88a3e97a7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.350985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc613ced-2050-41e5-a3eb-87b88a3e97a7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.351750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc613ced-2050-41e5-a3eb-87b88a3e97a7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.512458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-48e3c720-8bc8-49f4-8c1f-3874c0374339 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:29.529077 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-48e3c720-8bc8-49f4-8c1f-3874c0374339 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 200 len: 1247 microversion: 2.1 time: 0.653872 Jul 20 04:42:29.531263 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2347/4935] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:28 2022] GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 1247 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:29.546799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a31fbee8-3248-4bd4-aeb1-0fc98ed2d7ca tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:29.557864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a31fbee8-3248-4bd4-aeb1-0fc98ed2d7ca tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:29.576025 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dc613ced-2050-41e5-a3eb-87b88a3e97a7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605/action" status: 204 len: 0 microversion: 2.1 time: 0.266580 Jul 20 04:42:29.577771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a31fbee8-3248-4bd4-aeb1-0fc98ed2d7ca tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.583296 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2589/4936] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:42:29 2022] POST /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605/action => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:42:29.594564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a31fbee8-3248-4bd4-aeb1-0fc98ed2d7ca tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.595453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a31fbee8-3248-4bd4-aeb1-0fc98ed2d7ca tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.595904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a31fbee8-3248-4bd4-aeb1-0fc98ed2d7ca tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.639715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f1094bb6-c924-4cf3-8ded-7c8c64432ef7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:29.641981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f1094bb6-c924-4cf3-8ded-7c8c64432ef7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:29.674357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1094bb6-c924-4cf3-8ded-7c8c64432ef7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.680444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1094bb6-c924-4cf3-8ded-7c8c64432ef7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.681834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1094bb6-c924-4cf3-8ded-7c8c64432ef7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.682497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1094bb6-c924-4cf3-8ded-7c8c64432ef7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.844617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:30.141040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f1094bb6-c924-4cf3-8ded-7c8c64432ef7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:30.152979 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f1094bb6-c924-4cf3-8ded-7c8c64432ef7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1690 microversion: 2.1 time: 0.564137 Jul 20 04:42:30.163278 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2590/4937] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:29 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1690 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:30.199727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a31fbee8-3248-4bd4-aeb1-0fc98ed2d7ca tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:30.209333 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a31fbee8-3248-4bd4-aeb1-0fc98ed2d7ca tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1318 microversion: 2.1 time: 0.668646 Jul 20 04:42:30.209927 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2348/4938] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:29 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:30.547663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-14e0f154-0895-4b8f-99bc-728b1baf4619 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:30.548303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-14e0f154-0895-4b8f-99bc-728b1baf4619 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:30.549601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-d012aa5a-cbaa-453e-99a8-4f0e18d59e7e req-a1d64b80-4ef0-4c4b-b6d2-63d217b92654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29abf8ce-3972-49b8-aeb8-8219f13fe72c", "tag": "1b7244c0-c701-4206-8504-7d91a71ca612"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:30.574561 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d012aa5a-cbaa-453e-99a8-4f0e18d59e7e req-a1d64b80-4ef0-4c4b-b6d2-63d217b92654 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:30.580245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d012aa5a-cbaa-453e-99a8-4f0e18d59e7e req-a1d64b80-4ef0-4c4b-b6d2-63d217b92654 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:30.596747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14e0f154-0895-4b8f-99bc-728b1baf4619 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:30.598619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14e0f154-0895-4b8f-99bc-728b1baf4619 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:30.600938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14e0f154-0895-4b8f-99bc-728b1baf4619 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:30.604379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14e0f154-0895-4b8f-99bc-728b1baf4619 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:30.634787 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-d012aa5a-cbaa-453e-99a8-4f0e18d59e7e req-a1d64b80-4ef0-4c4b-b6d2-63d217b92654 service nova] Creating event network-changed:1b7244c0-c701-4206-8504-7d91a71ca612 for instance 29abf8ce-3972-49b8-aeb8-8219f13fe72c on n-h2-826526-5 Jul 20 04:42:30.654001 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-d012aa5a-cbaa-453e-99a8-4f0e18d59e7e req-a1d64b80-4ef0-4c4b-b6d2-63d217b92654 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105603 Jul 20 04:42:30.664219 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2349/4939] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 20 04:42:30.949984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-14e0f154-0895-4b8f-99bc-728b1baf4619 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:30.971880 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-14e0f154-0895-4b8f-99bc-728b1baf4619 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 200 len: 1243 microversion: 2.1 time: 0.424183 Jul 20 04:42:30.972933 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2591/4940] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:30 2022] GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 1243 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:31.182278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e83af6a8-2065-471f-82db-91cee8155053 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:31.182278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e83af6a8-2065-471f-82db-91cee8155053 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:31.200081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e83af6a8-2065-471f-82db-91cee8155053 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:31.204902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e83af6a8-2065-471f-82db-91cee8155053 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:31.206341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e83af6a8-2065-471f-82db-91cee8155053 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:31.209099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e83af6a8-2065-471f-82db-91cee8155053 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:31.227530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8a299823-999d-4d0b-afce-61405774d74b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:31.228456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8a299823-999d-4d0b-afce-61405774d74b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:31.253935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a299823-999d-4d0b-afce-61405774d74b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:31.261114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a299823-999d-4d0b-afce-61405774d74b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:31.262504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a299823-999d-4d0b-afce-61405774d74b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:31.263211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a299823-999d-4d0b-afce-61405774d74b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:31.851874 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e83af6a8-2065-471f-82db-91cee8155053 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:31.866272 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e83af6a8-2065-471f-82db-91cee8155053 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1690 microversion: 2.1 time: 0.689634 Jul 20 04:42:31.866889 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2350/4941] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:31 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1690 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:32.016944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-64365b3a-ff79-4208-9b8b-59a7fd6886de tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-542171465", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:32.144436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-64365b3a-ff79-4208-9b8b-59a7fd6886de tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] validate_networks() for [('52aa8d93-b932-48b5-803a-a7df3918df29', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:42:32.535171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8a299823-999d-4d0b-afce-61405774d74b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:32.545593 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8a299823-999d-4d0b-afce-61405774d74b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1318 microversion: 2.1 time: 1.322117 Jul 20 04:42:32.559052 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2592/4942] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:31 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1318 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:32.565401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d6c78ad9-bfe7-44cd-8632-18e254af4ff1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:32.568094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d6c78ad9-bfe7-44cd-8632-18e254af4ff1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:32.606651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6c78ad9-bfe7-44cd-8632-18e254af4ff1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:32.619682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6c78ad9-bfe7-44cd-8632-18e254af4ff1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:32.621230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6c78ad9-bfe7-44cd-8632-18e254af4ff1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:32.621853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6c78ad9-bfe7-44cd-8632-18e254af4ff1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:32.860985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d6c78ad9-bfe7-44cd-8632-18e254af4ff1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:32.890478 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d6c78ad9-bfe7-44cd-8632-18e254af4ff1 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 200 len: 1305 microversion: 2.1 time: 0.324842 Jul 20 04:42:32.893422 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2593/4943] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:32 2022] GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 1305 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:32.915862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-02299d46-3570-4ebd-8438-3fdacb37f920 req-cbb8bebb-423b-466c-ae0d-6eef629da03f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ed5f8e-9305-42db-8723-6fba63245605", "name": "network-vif-plugged", "status": "completed", "tag": "dd8fb1a0-4673-4433-af0e-9ceaff8681f5"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:32.942137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-02299d46-3570-4ebd-8438-3fdacb37f920 req-cbb8bebb-423b-466c-ae0d-6eef629da03f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:32.944050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-02299d46-3570-4ebd-8438-3fdacb37f920 req-cbb8bebb-423b-466c-ae0d-6eef629da03f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:32.963784 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-02299d46-3570-4ebd-8438-3fdacb37f920 req-cbb8bebb-423b-466c-ae0d-6eef629da03f service nova] Creating event network-vif-plugged:dd8fb1a0-4673-4433-af0e-9ceaff8681f5 for instance 90ed5f8e-9305-42db-8723-6fba63245605 on n-h1-826526-5 Jul 20 04:42:32.970632 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-02299d46-3570-4ebd-8438-3fdacb37f920 req-cbb8bebb-423b-466c-ae0d-6eef629da03f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075413 Jul 20 04:42:32.976677 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2594/4944] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:32.985243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a4fadfa5-6656-43ab-9e07-d29756bf374b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:32.990518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a4fadfa5-6656-43ab-9e07-d29756bf374b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:32.999665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a4fadfa5-6656-43ab-9e07-d29756bf374b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:33.000484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a4fadfa5-6656-43ab-9e07-d29756bf374b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:33.001498 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a4fadfa5-6656-43ab-9e07-d29756bf374b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:33.002150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a4fadfa5-6656-43ab-9e07-d29756bf374b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:33.050184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:33.766550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a4fadfa5-6656-43ab-9e07-d29756bf374b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:33.781055 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a4fadfa5-6656-43ab-9e07-d29756bf374b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1682 microversion: 2.1 time: 0.802545 Jul 20 04:42:33.782687 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2595/4945] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:32 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1682 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:33.790296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-41011f3d-8352-4137-a700-e780674eeca3 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:33.799070 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-41011f3d-8352-4137-a700-e780674eeca3 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:33.819238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41011f3d-8352-4137-a700-e780674eeca3 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:33.819971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41011f3d-8352-4137-a700-e780674eeca3 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:33.821472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41011f3d-8352-4137-a700-e780674eeca3 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:33.822073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41011f3d-8352-4137-a700-e780674eeca3 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:34.083896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-64365b3a-ff79-4208-9b8b-59a7fd6886de tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:42:34.088692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-64365b3a-ff79-4208-9b8b-59a7fd6886de tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:42:34.089423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-64365b3a-ff79-4208-9b8b-59a7fd6886de tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:42:34.090018 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-64365b3a-ff79-4208-9b8b-59a7fd6886de tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:42:34.090592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-64365b3a-ff79-4208-9b8b-59a7fd6886de tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:42:34.129897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64365b3a-ff79-4208-9b8b-59a7fd6886de tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:34.131014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64365b3a-ff79-4208-9b8b-59a7fd6886de tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:34.133673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64365b3a-ff79-4208-9b8b-59a7fd6886de tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:34.135272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64365b3a-ff79-4208-9b8b-59a7fd6886de tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:34.193385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-64365b3a-ff79-4208-9b8b-59a7fd6886de tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Getting quotas for project ee6be1978ab0464c9e912fb14bfab189. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:42:34.208770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-64365b3a-ff79-4208-9b8b-59a7fd6886de tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Getting quotas for user 6aba264ea8864915a86850678f3043c6 and project ee6be1978ab0464c9e912fb14bfab189. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:42:34.239916 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-64365b3a-ff79-4208-9b8b-59a7fd6886de tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:42:34.242458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-64365b3a-ff79-4208-9b8b-59a7fd6886de tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:42:34.348975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-41011f3d-8352-4137-a700-e780674eeca3 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:34.355755 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-64365b3a-ff79-4208-9b8b-59a7fd6886de tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.471330 Jul 20 04:42:34.363102 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-41011f3d-8352-4137-a700-e780674eeca3 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1318 microversion: 2.1 time: 0.578384 Jul 20 04:42:34.367606 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2351/4946] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:42:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 2482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:42:34.376603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-205a6548-1db8-454e-a818-c32ad6c3b31d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:34.377907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-205a6548-1db8-454e-a818-c32ad6c3b31d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:34.379294 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2596/4947] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:33 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:34.399289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f7d135de-e89a-4045-9ce0-1b82d9619050 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:34.402170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f7d135de-e89a-4045-9ce0-1b82d9619050 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:34.411202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-205a6548-1db8-454e-a818-c32ad6c3b31d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:34.415639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-205a6548-1db8-454e-a818-c32ad6c3b31d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:34.419949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-205a6548-1db8-454e-a818-c32ad6c3b31d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:34.420686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-205a6548-1db8-454e-a818-c32ad6c3b31d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:34.607240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f7d135de-e89a-4045-9ce0-1b82d9619050 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:34.644512 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f7d135de-e89a-4045-9ce0-1b82d9619050 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1222 microversion: 2.1 time: 0.258142 Jul 20 04:42:34.646170 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2597/4948] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:34 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1222 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:34.834457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-205a6548-1db8-454e-a818-c32ad6c3b31d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:34.854352 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-205a6548-1db8-454e-a818-c32ad6c3b31d tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 200 len: 1373 microversion: 2.1 time: 0.484256 Jul 20 04:42:34.855165 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2352/4949] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:34 2022] GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 1373 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:35.399278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d5f84cfc-3722-4b54-800a-4b12c08b38f7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:35.412607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d5f84cfc-3722-4b54-800a-4b12c08b38f7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:35.472985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5f84cfc-3722-4b54-800a-4b12c08b38f7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:35.473379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5f84cfc-3722-4b54-800a-4b12c08b38f7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:35.474278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5f84cfc-3722-4b54-800a-4b12c08b38f7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:35.501332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5f84cfc-3722-4b54-800a-4b12c08b38f7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:35.663181 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3f918a92-accc-4916-9b6c-08f17d616b94 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:35.663806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3f918a92-accc-4916-9b6c-08f17d616b94 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:35.701582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f918a92-accc-4916-9b6c-08f17d616b94 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:35.702070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f918a92-accc-4916-9b6c-08f17d616b94 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:35.702905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f918a92-accc-4916-9b6c-08f17d616b94 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:35.703333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f918a92-accc-4916-9b6c-08f17d616b94 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:35.951992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3f918a92-accc-4916-9b6c-08f17d616b94 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:35.965100 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3f918a92-accc-4916-9b6c-08f17d616b94 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1226 microversion: 2.1 time: 0.305787 Jul 20 04:42:35.966353 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2353/4950] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:35 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1226 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:35.973727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a79446a1-3831-45ce-81c8-08e509a3cbd9 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:35.974841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a79446a1-3831-45ce-81c8-08e509a3cbd9 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:35.984836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d5f84cfc-3722-4b54-800a-4b12c08b38f7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:35.986906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a79446a1-3831-45ce-81c8-08e509a3cbd9 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:35.988154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a79446a1-3831-45ce-81c8-08e509a3cbd9 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:35.990565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a79446a1-3831-45ce-81c8-08e509a3cbd9 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:35.991220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a79446a1-3831-45ce-81c8-08e509a3cbd9 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:35.996622 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d5f84cfc-3722-4b54-800a-4b12c08b38f7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1318 microversion: 2.1 time: 0.613518 Jul 20 04:42:35.999200 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2598/4951] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:35 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1318 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:36.421608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a79446a1-3831-45ce-81c8-08e509a3cbd9 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:36.448789 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a79446a1-3831-45ce-81c8-08e509a3cbd9 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 200 len: 1373 microversion: 2.1 time: 0.481033 Jul 20 04:42:36.459563 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2354/4952] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:35 2022] GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 1373 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:36.983668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0d435214-7bb7-4fd7-99df-c5698fa14aec tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:36.984758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0d435214-7bb7-4fd7-99df-c5698fa14aec tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:37.000931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d435214-7bb7-4fd7-99df-c5698fa14aec tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.009215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d435214-7bb7-4fd7-99df-c5698fa14aec tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.010308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d435214-7bb7-4fd7-99df-c5698fa14aec tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.010432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f2b2ee90-2b66-4ef8-9bdd-1009b8d893fb req-16d3c874-fc49-43ab-a419-329c35e019e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53648916-fa3f-406d-9cd0-f1c51355bc16", "tag": "2d6d6a29-25b7-45d4-adbe-e75ce1a89f13"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:37.014077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d435214-7bb7-4fd7-99df-c5698fa14aec tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.043341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f2b2ee90-2b66-4ef8-9bdd-1009b8d893fb req-16d3c874-fc49-43ab-a419-329c35e019e5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.043794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f2b2ee90-2b66-4ef8-9bdd-1009b8d893fb req-16d3c874-fc49-43ab-a419-329c35e019e5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.103618 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f2b2ee90-2b66-4ef8-9bdd-1009b8d893fb req-16d3c874-fc49-43ab-a419-329c35e019e5 service nova] Creating event network-changed:2d6d6a29-25b7-45d4-adbe-e75ce1a89f13 for instance 53648916-fa3f-406d-9cd0-f1c51355bc16 on n-h1-826526-5 Jul 20 04:42:37.134692 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f2b2ee90-2b66-4ef8-9bdd-1009b8d893fb req-16d3c874-fc49-43ab-a419-329c35e019e5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129261 Jul 20 04:42:37.139093 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2355/4953] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:42:37.154720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ab7e39ea-d51a-4eb8-abd6-82071b40f41d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:37.155438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ab7e39ea-d51a-4eb8-abd6-82071b40f41d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:37.188944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab7e39ea-d51a-4eb8-abd6-82071b40f41d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.189420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab7e39ea-d51a-4eb8-abd6-82071b40f41d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.190407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab7e39ea-d51a-4eb8-abd6-82071b40f41d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.190858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab7e39ea-d51a-4eb8-abd6-82071b40f41d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.211084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0d435214-7bb7-4fd7-99df-c5698fa14aec tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:37.226976 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0d435214-7bb7-4fd7-99df-c5698fa14aec tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1292 microversion: 2.1 time: 0.248304 Jul 20 04:42:37.241095 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2599/4954] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:36 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1292 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:37.493837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f4bad47f-0ef8-41c4-aee5-54baca8b44bf tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:37.495049 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f4bad47f-0ef8-41c4-aee5-54baca8b44bf tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:37.517288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4bad47f-0ef8-41c4-aee5-54baca8b44bf tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.518273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4bad47f-0ef8-41c4-aee5-54baca8b44bf tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.520791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4bad47f-0ef8-41c4-aee5-54baca8b44bf tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.535425 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4bad47f-0ef8-41c4-aee5-54baca8b44bf tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.676317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ab7e39ea-d51a-4eb8-abd6-82071b40f41d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:37.688535 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ab7e39ea-d51a-4eb8-abd6-82071b40f41d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1318 microversion: 2.1 time: 0.547991 Jul 20 04:42:37.704742 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2356/4955] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:37 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1318 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:38.080374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f4bad47f-0ef8-41c4-aee5-54baca8b44bf tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:38.089072 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f4bad47f-0ef8-41c4-aee5-54baca8b44bf tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 200 len: 1373 microversion: 2.1 time: 0.616654 Jul 20 04:42:38.090373 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2600/4956] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:37 2022] GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 1373 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:38.249780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-92c621fe-1b0f-47e3-baa7-354c1d67a3da tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:38.250399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-92c621fe-1b0f-47e3-baa7-354c1d67a3da tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:38.262019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92c621fe-1b0f-47e3-baa7-354c1d67a3da tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:38.262746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92c621fe-1b0f-47e3-baa7-354c1d67a3da tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:38.264455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92c621fe-1b0f-47e3-baa7-354c1d67a3da tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:38.265057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92c621fe-1b0f-47e3-baa7-354c1d67a3da tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:38.491964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-92c621fe-1b0f-47e3-baa7-354c1d67a3da tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:38.506264 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-92c621fe-1b0f-47e3-baa7-354c1d67a3da tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1280 microversion: 2.1 time: 0.262744 Jul 20 04:42:38.507847 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2357/4957] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:38 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1280 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:38.710213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2b03a535-b9e1-4a09-85f7-f6e2baaa291d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:38.710867 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2b03a535-b9e1-4a09-85f7-f6e2baaa291d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:38.722864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:38.734216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b03a535-b9e1-4a09-85f7-f6e2baaa291d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:38.735375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b03a535-b9e1-4a09-85f7-f6e2baaa291d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:38.737179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b03a535-b9e1-4a09-85f7-f6e2baaa291d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:38.740827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b03a535-b9e1-4a09-85f7-f6e2baaa291d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:39.085466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2b03a535-b9e1-4a09-85f7-f6e2baaa291d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:39.098139 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2b03a535-b9e1-4a09-85f7-f6e2baaa291d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1318 microversion: 2.1 time: 0.391856 Jul 20 04:42:39.098854 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2601/4958] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:38 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:39.110934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bd237273-0146-4c66-a4a1-56a81b6f5ea0 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:39.110934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bd237273-0146-4c66-a4a1-56a81b6f5ea0 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:39.118570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd237273-0146-4c66-a4a1-56a81b6f5ea0 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:39.119989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd237273-0146-4c66-a4a1-56a81b6f5ea0 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:39.121204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd237273-0146-4c66-a4a1-56a81b6f5ea0 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:39.131254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd237273-0146-4c66-a4a1-56a81b6f5ea0 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:39.435527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e0502841-b400-4d91-90a3-ca59bb2517b0 req-f36873bf-df19-48c5-a373-77616d0e4922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29abf8ce-3972-49b8-aeb8-8219f13fe72c", "name": "network-vif-plugged", "status": "completed", "tag": "1b7244c0-c701-4206-8504-7d91a71ca612"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:39.467539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e0502841-b400-4d91-90a3-ca59bb2517b0 req-f36873bf-df19-48c5-a373-77616d0e4922 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:39.470815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e0502841-b400-4d91-90a3-ca59bb2517b0 req-f36873bf-df19-48c5-a373-77616d0e4922 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:39.502269 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e0502841-b400-4d91-90a3-ca59bb2517b0 req-f36873bf-df19-48c5-a373-77616d0e4922 service nova] Creating event network-vif-plugged:1b7244c0-c701-4206-8504-7d91a71ca612 for instance 29abf8ce-3972-49b8-aeb8-8219f13fe72c on n-h2-826526-5 Jul 20 04:42:39.512935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bd237273-0146-4c66-a4a1-56a81b6f5ea0 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:39.514966 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e0502841-b400-4d91-90a3-ca59bb2517b0 req-f36873bf-df19-48c5-a373-77616d0e4922 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089423 Jul 20 04:42:39.516809 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2602/4959] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:39.531317 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7a22e2eb-3723-4aca-b869-c5cb2c8d49f5 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:39.534877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7a22e2eb-3723-4aca-b869-c5cb2c8d49f5 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:39.540372 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bd237273-0146-4c66-a4a1-56a81b6f5ea0 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 200 len: 1373 microversion: 2.1 time: 0.437690 Jul 20 04:42:39.541707 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2358/4960] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:39 2022] GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 1373 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:39.556328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a22e2eb-3723-4aca-b869-c5cb2c8d49f5 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:39.559301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a22e2eb-3723-4aca-b869-c5cb2c8d49f5 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:39.575249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a22e2eb-3723-4aca-b869-c5cb2c8d49f5 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:39.575711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a22e2eb-3723-4aca-b869-c5cb2c8d49f5 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.032568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7a22e2eb-3723-4aca-b869-c5cb2c8d49f5 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:40.067436 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7a22e2eb-3723-4aca-b869-c5cb2c8d49f5 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1322 microversion: 2.1 time: 0.548222 Jul 20 04:42:40.074924 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2603/4961] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:39 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1322 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:40.123603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-32ec505c-8fa6-416a-8b61-d35dd34fc5c4 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:40.123944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-32ec505c-8fa6-416a-8b61-d35dd34fc5c4 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:40.138381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32ec505c-8fa6-416a-8b61-d35dd34fc5c4 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.140558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32ec505c-8fa6-416a-8b61-d35dd34fc5c4 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.145344 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32ec505c-8fa6-416a-8b61-d35dd34fc5c4 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.146107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32ec505c-8fa6-416a-8b61-d35dd34fc5c4 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.217823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d97d409c-fabd-475f-bd76-4b45ad0e2360 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:40.219055 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d97d409c-fabd-475f-bd76-4b45ad0e2360 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:40.233147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d97d409c-fabd-475f-bd76-4b45ad0e2360 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.236958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d97d409c-fabd-475f-bd76-4b45ad0e2360 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.240647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d97d409c-fabd-475f-bd76-4b45ad0e2360 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.241325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d97d409c-fabd-475f-bd76-4b45ad0e2360 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.312560 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d97d409c-fabd-475f-bd76-4b45ad0e2360 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.099211 Jul 20 04:42:40.313750 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2604/4962] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 04:42:40 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:40.424485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bf7bcef6-b17d-46a2-aa6b-4809ceb03d2e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:40.425108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bf7bcef6-b17d-46a2-aa6b-4809ceb03d2e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:40.436574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf7bcef6-b17d-46a2-aa6b-4809ceb03d2e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.437127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf7bcef6-b17d-46a2-aa6b-4809ceb03d2e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.438165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf7bcef6-b17d-46a2-aa6b-4809ceb03d2e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.438799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf7bcef6-b17d-46a2-aa6b-4809ceb03d2e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.509328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bf7bcef6-b17d-46a2-aa6b-4809ceb03d2e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:42:40.693901 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bf7bcef6-b17d-46a2-aa6b-4809ceb03d2e tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 204 len: 0 microversion: 2.20 time: 0.273448 Jul 20 04:42:40.694900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-32ec505c-8fa6-416a-8b61-d35dd34fc5c4 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:40.696587 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2605/4963] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:42:40 2022] DELETE /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 04:42:40.702476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e25f5caf-da8d-4cf1-97d6-2fcf24ef1107 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:40.703503 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e25f5caf-da8d-4cf1-97d6-2fcf24ef1107 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:40.707513 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-32ec505c-8fa6-416a-8b61-d35dd34fc5c4 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1318 microversion: 2.1 time: 0.589345 Jul 20 04:42:40.708127 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2359/4964] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:40 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1318 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:40.711813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e25f5caf-da8d-4cf1-97d6-2fcf24ef1107 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.712547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e25f5caf-da8d-4cf1-97d6-2fcf24ef1107 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.714165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e25f5caf-da8d-4cf1-97d6-2fcf24ef1107 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.714834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e25f5caf-da8d-4cf1-97d6-2fcf24ef1107 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.728127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7b4f047a-fa2d-49ac-903e-9e7df39234bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:40.728810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7b4f047a-fa2d-49ac-903e-9e7df39234bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:40.749215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b4f047a-fa2d-49ac-903e-9e7df39234bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.749978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b4f047a-fa2d-49ac-903e-9e7df39234bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.751728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b4f047a-fa2d-49ac-903e-9e7df39234bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.752767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b4f047a-fa2d-49ac-903e-9e7df39234bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.993750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e25f5caf-da8d-4cf1-97d6-2fcf24ef1107 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:41.030728 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e25f5caf-da8d-4cf1-97d6-2fcf24ef1107 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 200 len: 1373 microversion: 2.1 time: 0.332572 Jul 20 04:42:41.034011 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2606/4965] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:40 2022] GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 1373 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:41.043884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-ce7425d0-2c4a-4740-ab74-a9a0884b6c90 req-3f58fd34-242f-465a-bcd0-92ef23535bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783", "tag": "6a873c5d-6855-410c-9be1-c768a125054e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:41.055068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ce7425d0-2c4a-4740-ab74-a9a0884b6c90 req-3f58fd34-242f-465a-bcd0-92ef23535bf6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:41.056913 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ce7425d0-2c4a-4740-ab74-a9a0884b6c90 req-3f58fd34-242f-465a-bcd0-92ef23535bf6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:41.072710 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-ce7425d0-2c4a-4740-ab74-a9a0884b6c90 req-3f58fd34-242f-465a-bcd0-92ef23535bf6 service nova] Creating event network-changed:6a873c5d-6855-410c-9be1-c768a125054e for instance cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 on n-h2-826526-5 Jul 20 04:42:41.080146 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-ce7425d0-2c4a-4740-ab74-a9a0884b6c90 req-3f58fd34-242f-465a-bcd0-92ef23535bf6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043318 Jul 20 04:42:41.081567 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2607/4966] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:41.112168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-07fea808-f424-494a-aaff-a898c848da98 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:41.112910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-07fea808-f424-494a-aaff-a898c848da98 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:41.130491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7b4f047a-fa2d-49ac-903e-9e7df39234bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:41.138125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07fea808-f424-494a-aaff-a898c848da98 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:41.139888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07fea808-f424-494a-aaff-a898c848da98 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:41.139888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07fea808-f424-494a-aaff-a898c848da98 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:41.139888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07fea808-f424-494a-aaff-a898c848da98 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:41.146898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7b4f047a-fa2d-49ac-903e-9e7df39234bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:41.151640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7b4f047a-fa2d-49ac-903e-9e7df39234bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:41.153639 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7b4f047a-fa2d-49ac-903e-9e7df39234bd tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1724 microversion: 2.20 time: 0.444354 Jul 20 04:42:41.159433 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2360/4967] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:40 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1724 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:41.409853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-07fea808-f424-494a-aaff-a898c848da98 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:41.420380 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-07fea808-f424-494a-aaff-a898c848da98 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1322 microversion: 2.1 time: 0.328632 Jul 20 04:42:41.430586 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2608/4968] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:41 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:41.724922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-301389f3-c8c2-4d7c-9181-dac68b74ff1e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:41.725486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-301389f3-c8c2-4d7c-9181-dac68b74ff1e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:41.733492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-301389f3-c8c2-4d7c-9181-dac68b74ff1e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:41.734211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-301389f3-c8c2-4d7c-9181-dac68b74ff1e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:41.734999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-301389f3-c8c2-4d7c-9181-dac68b74ff1e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:41.735674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-301389f3-c8c2-4d7c-9181-dac68b74ff1e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:41.923368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-301389f3-c8c2-4d7c-9181-dac68b74ff1e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:41.936336 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-301389f3-c8c2-4d7c-9181-dac68b74ff1e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1507 microversion: 2.1 time: 0.215929 Jul 20 04:42:41.937254 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2361/4969] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:41 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1507 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:41.954266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-69d12da9-c215-4fb9-bb0d-077564965725 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:41.955175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-69d12da9-c215-4fb9-bb0d-077564965725 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:41.962632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69d12da9-c215-4fb9-bb0d-077564965725 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:41.963343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69d12da9-c215-4fb9-bb0d-077564965725 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:41.964287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69d12da9-c215-4fb9-bb0d-077564965725 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:41.964873 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69d12da9-c215-4fb9-bb0d-077564965725 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:42.057356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-44ee58bb-b537-4075-8d4b-996f9d5d005c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:42.061112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-44ee58bb-b537-4075-8d4b-996f9d5d005c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:42.075309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44ee58bb-b537-4075-8d4b-996f9d5d005c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:42.076086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44ee58bb-b537-4075-8d4b-996f9d5d005c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:42.077467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44ee58bb-b537-4075-8d4b-996f9d5d005c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:42.078211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44ee58bb-b537-4075-8d4b-996f9d5d005c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:42.156301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-69d12da9-c215-4fb9-bb0d-077564965725 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:42.166128 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-69d12da9-c215-4fb9-bb0d-077564965725 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1507 microversion: 2.1 time: 0.215721 Jul 20 04:42:42.167650 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2609/4970] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:41 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1507 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:42.185752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9defc975-c04e-4457-8b95-6721c0527d30 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:42.186399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9defc975-c04e-4457-8b95-6721c0527d30 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:42.197722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9defc975-c04e-4457-8b95-6721c0527d30 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:42.198179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9defc975-c04e-4457-8b95-6721c0527d30 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:42.203202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9defc975-c04e-4457-8b95-6721c0527d30 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:42.203202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9defc975-c04e-4457-8b95-6721c0527d30 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:42.363672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-44ee58bb-b537-4075-8d4b-996f9d5d005c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:42.368406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:42.388367 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-44ee58bb-b537-4075-8d4b-996f9d5d005c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 200 len: 1373 microversion: 2.1 time: 0.327411 Jul 20 04:42:42.389078 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2362/4971] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:42 2022] GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 1373 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:42.394256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5b1fe32c-4cb1-4689-bf8f-899b4761fe49 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:42.410137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5b1fe32c-4cb1-4689-bf8f-899b4761fe49 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:42.424125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b1fe32c-4cb1-4689-bf8f-899b4761fe49 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:42.424885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b1fe32c-4cb1-4689-bf8f-899b4761fe49 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:42.425986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b1fe32c-4cb1-4689-bf8f-899b4761fe49 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:42.429465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b1fe32c-4cb1-4689-bf8f-899b4761fe49 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:42.611520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9defc975-c04e-4457-8b95-6721c0527d30 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:42.669508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9defc975-c04e-4457-8b95-6721c0527d30 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:42.671265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9defc975-c04e-4457-8b95-6721c0527d30 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:42.677253 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9defc975-c04e-4457-8b95-6721c0527d30 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1724 microversion: 2.20 time: 0.507472 Jul 20 04:42:42.700658 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2610/4972] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:42 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1724 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:42.710928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5b1fe32c-4cb1-4689-bf8f-899b4761fe49 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:42:42.714406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4b44af38-cf21-47f5-8dd3-002e526193b9 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:42.715427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4b44af38-cf21-47f5-8dd3-002e526193b9 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:42.716303 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5b1fe32c-4cb1-4689-bf8f-899b4761fe49 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:42:42.721619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5b1fe32c-4cb1-4689-bf8f-899b4761fe49 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:42:42.722580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5b1fe32c-4cb1-4689-bf8f-899b4761fe49 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:42:42.723637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-5b1fe32c-4cb1-4689-bf8f-899b4761fe49 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:42:42.734660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b44af38-cf21-47f5-8dd3-002e526193b9 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:42.740012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b44af38-cf21-47f5-8dd3-002e526193b9 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:42.743175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b44af38-cf21-47f5-8dd3-002e526193b9 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:42.744352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b44af38-cf21-47f5-8dd3-002e526193b9 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:42.862098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5b1fe32c-4cb1-4689-bf8f-899b4761fe49 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:42.871871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b1fe32c-4cb1-4689-bf8f-899b4761fe49 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:42.872856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b1fe32c-4cb1-4689-bf8f-899b4761fe49 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:42.875467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b1fe32c-4cb1-4689-bf8f-899b4761fe49 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:42.876299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b1fe32c-4cb1-4689-bf8f-899b4761fe49 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:42.938828 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5b1fe32c-4cb1-4689-bf8f-899b4761fe49 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "POST /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c/action" status: 202 len: 1109 microversion: 2.1 time: 0.547858 Jul 20 04:42:42.940616 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2363/4973] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:42:42 2022] POST /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c/action => generated 1109 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 04:42:42.966295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-814f1661-6ea9-4b97-9134-058a76d322ab tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:42.967587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-814f1661-6ea9-4b97-9134-058a76d322ab tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:42.984928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-814f1661-6ea9-4b97-9134-058a76d322ab tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:42.986131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-814f1661-6ea9-4b97-9134-058a76d322ab tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:42.987541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-814f1661-6ea9-4b97-9134-058a76d322ab tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:42.988448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-814f1661-6ea9-4b97-9134-058a76d322ab tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:43.763445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-814f1661-6ea9-4b97-9134-058a76d322ab tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:43.790632 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-814f1661-6ea9-4b97-9134-058a76d322ab tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1514 microversion: 2.1 time: 0.836929 Jul 20 04:42:43.800792 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2364/4974] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:42 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1514 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:43.806006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5868b2dc-4af3-49c0-a678-7d523a780089 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:43.807408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5868b2dc-4af3-49c0-a678-7d523a780089 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:43.815210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5868b2dc-4af3-49c0-a678-7d523a780089 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:43.815973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5868b2dc-4af3-49c0-a678-7d523a780089 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:43.821475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5868b2dc-4af3-49c0-a678-7d523a780089 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:43.822206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5868b2dc-4af3-49c0-a678-7d523a780089 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:43.912148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4b44af38-cf21-47f5-8dd3-002e526193b9 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:43.925203 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4b44af38-cf21-47f5-8dd3-002e526193b9 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1322 microversion: 2.1 time: 1.216983 Jul 20 04:42:43.926067 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2611/4975] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:42 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1322 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:43.940536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e8835768-2aee-49c2-a2be-ada990f1915f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:43.941550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e8835768-2aee-49c2-a2be-ada990f1915f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:43.949180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8835768-2aee-49c2-a2be-ada990f1915f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:43.949923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8835768-2aee-49c2-a2be-ada990f1915f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:43.950970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8835768-2aee-49c2-a2be-ada990f1915f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:43.951776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8835768-2aee-49c2-a2be-ada990f1915f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:44.056248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5868b2dc-4af3-49c0-a678-7d523a780089 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:44.075302 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5868b2dc-4af3-49c0-a678-7d523a780089 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 200 len: 1373 microversion: 2.1 time: 0.272192 Jul 20 04:42:44.086022 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2365/4976] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:43 2022] GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 1373 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:44.136007 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e8835768-2aee-49c2-a2be-ada990f1915f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:44.139186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:44.154249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e8835768-2aee-49c2-a2be-ada990f1915f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:44.155810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e8835768-2aee-49c2-a2be-ada990f1915f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:44.157073 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e8835768-2aee-49c2-a2be-ada990f1915f tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1656 microversion: 2.20 time: 0.230017 Jul 20 04:42:44.168830 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2612/4977] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:43 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1656 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:44.768823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-23fd5e68-3f99-4308-88b8-39a59d6d1630 req-b732ee61-9327-4024-833d-e0ce8545eb20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7e62d3-1b07-483d-9943-887c096d4350", "name": "network-vif-deleted", "tag": "f03b37b1-bac2-405f-aeda-863d4b123005"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:44.793964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:44.795911 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=20 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:44.810288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-94fc0707-a2b0-4d8b-9d93-923ccadf5ea6 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:44.811048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-94fc0707-a2b0-4d8b-9d93-923ccadf5ea6 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:44.824324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-23fd5e68-3f99-4308-88b8-39a59d6d1630 req-b732ee61-9327-4024-833d-e0ce8545eb20 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:44.826511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-23fd5e68-3f99-4308-88b8-39a59d6d1630 req-b732ee61-9327-4024-833d-e0ce8545eb20 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:44.833381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:44.849704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-94fc0707-a2b0-4d8b-9d93-923ccadf5ea6 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:44.850409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-94fc0707-a2b0-4d8b-9d93-923ccadf5ea6 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:44.858002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-94fc0707-a2b0-4d8b-9d93-923ccadf5ea6 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:44.858754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-94fc0707-a2b0-4d8b-9d93-923ccadf5ea6 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:44.865852 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-23fd5e68-3f99-4308-88b8-39a59d6d1630 req-b732ee61-9327-4024-833d-e0ce8545eb20 service nova] Creating event network-vif-deleted:f03b37b1-bac2-405f-aeda-863d4b123005 for instance 7c7e62d3-1b07-483d-9943-887c096d4350 on n-h1-826526-5 Jul 20 04:42:44.872915 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-23fd5e68-3f99-4308-88b8-39a59d6d1630 req-b732ee61-9327-4024-833d-e0ce8545eb20 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118040 Jul 20 04:42:44.874704 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2366/4978] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:44.947054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c9ac5360-259c-4f36-8172-0338562e6ded tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:44.948503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c9ac5360-259c-4f36-8172-0338562e6ded tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:44.970424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9ac5360-259c-4f36-8172-0338562e6ded tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:44.971347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9ac5360-259c-4f36-8172-0338562e6ded tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:44.972490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9ac5360-259c-4f36-8172-0338562e6ded tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:44.973615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9ac5360-259c-4f36-8172-0338562e6ded tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:45.142197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-94fc0707-a2b0-4d8b-9d93-923ccadf5ea6 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:45.159633 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-94fc0707-a2b0-4d8b-9d93-923ccadf5ea6 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1514 microversion: 2.1 time: 0.353952 Jul 20 04:42:45.164785 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2613/4979] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:44 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1514 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:45.171563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c81ea6c3-9fc6-4da4-8152-cc6784fb1083 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:45.172514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c81ea6c3-9fc6-4da4-8152-cc6784fb1083 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:45.180416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c81ea6c3-9fc6-4da4-8152-cc6784fb1083 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:45.181169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c81ea6c3-9fc6-4da4-8152-cc6784fb1083 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:45.182113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c81ea6c3-9fc6-4da4-8152-cc6784fb1083 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:45.182712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c81ea6c3-9fc6-4da4-8152-cc6784fb1083 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:45.209669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c9ac5360-259c-4f36-8172-0338562e6ded tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:45.229894 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c9ac5360-259c-4f36-8172-0338562e6ded tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1322 microversion: 2.1 time: 0.289802 Jul 20 04:42:45.240727 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2367/4980] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:44 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:45.247083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d2388fdd-a2fb-4b5f-8d52-f46fdbbff536 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:45.248062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d2388fdd-a2fb-4b5f-8d52-f46fdbbff536 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:45.255632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2388fdd-a2fb-4b5f-8d52-f46fdbbff536 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:45.256460 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2388fdd-a2fb-4b5f-8d52-f46fdbbff536 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:45.259077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2388fdd-a2fb-4b5f-8d52-f46fdbbff536 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:45.259945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2388fdd-a2fb-4b5f-8d52-f46fdbbff536 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:45.305809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2388fdd-a2fb-4b5f-8d52-f46fdbbff536 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:45.307277 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2388fdd-a2fb-4b5f-8d52-f46fdbbff536 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:45.307883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-d2388fdd-a2fb-4b5f-8d52-f46fdbbff536 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lazy-loading 'fault' on Instance uuid 7c7e62d3-1b07-483d-9943-887c096d4350 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:42:45.399663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d2388fdd-a2fb-4b5f-8d52-f46fdbbff536 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:45.426503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d2388fdd-a2fb-4b5f-8d52-f46fdbbff536 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:45.434078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d2388fdd-a2fb-4b5f-8d52-f46fdbbff536 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45d83caaa8704fb0a6cd0d527870b33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84badb51e2d4e30bd5b50e2b1f8be56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:45.436745 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d2388fdd-a2fb-4b5f-8d52-f46fdbbff536 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 200 len: 1371 microversion: 2.20 time: 0.193035 Jul 20 04:42:45.437376 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2368/4981] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:45 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:45.529449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c81ea6c3-9fc6-4da4-8152-cc6784fb1083 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:45.561351 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c81ea6c3-9fc6-4da4-8152-cc6784fb1083 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 200 len: 1373 microversion: 2.1 time: 0.394825 Jul 20 04:42:45.572006 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2614/4982] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:45 2022] GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 1373 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:46.185236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-669889fc-fcd0-4f0d-a707-9d5bc1586c54 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:46.196837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-669889fc-fcd0-4f0d-a707-9d5bc1586c54 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:46.210100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-669889fc-fcd0-4f0d-a707-9d5bc1586c54 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:46.211420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-669889fc-fcd0-4f0d-a707-9d5bc1586c54 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:46.212544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-669889fc-fcd0-4f0d-a707-9d5bc1586c54 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:46.213225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-669889fc-fcd0-4f0d-a707-9d5bc1586c54 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:46.263088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6feae801-cebe-41bb-8c6d-50d92f492948 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:46.264367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6feae801-cebe-41bb-8c6d-50d92f492948 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:46.312349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6feae801-cebe-41bb-8c6d-50d92f492948 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:46.312938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6feae801-cebe-41bb-8c6d-50d92f492948 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:46.313815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6feae801-cebe-41bb-8c6d-50d92f492948 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:46.314263 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6feae801-cebe-41bb-8c6d-50d92f492948 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:46.519913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-669889fc-fcd0-4f0d-a707-9d5bc1586c54 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:46.533157 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-669889fc-fcd0-4f0d-a707-9d5bc1586c54 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1514 microversion: 2.1 time: 0.357459 Jul 20 04:42:46.534370 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2369/4983] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:46 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1514 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:46.541768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-96ddbdf2-565a-46aa-93d0-979f9642720a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:46.542475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-96ddbdf2-565a-46aa-93d0-979f9642720a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:46.551543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96ddbdf2-565a-46aa-93d0-979f9642720a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:46.552287 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96ddbdf2-565a-46aa-93d0-979f9642720a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:46.553679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96ddbdf2-565a-46aa-93d0-979f9642720a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:46.554364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96ddbdf2-565a-46aa-93d0-979f9642720a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:46.585982 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-96ddbdf2-565a-46aa-93d0-979f9642720a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] HTTP exception thrown: Instance 7c7e62d3-1b07-483d-9943-887c096d4350 could not be found. Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-96ddbdf2-565a-46aa-93d0-979f9642720a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Request method failure captured: Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 HTTP/1.1 Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14YcfGQ2dJXFTmLgIeuKTnvXz4Xy1mrIR63S63g1Qamgwh7IpgwWfUbDj4orK8K5ndqbQxiI-SDRzmiQmPSDm6XtO9Ts2boSIp-d3er3jfI5B0uRDWJveWe21AmZmlRhbpzWdjRPlWd6uKkr6wIzWOZIbkOgEQHhpjqGMACN1GJjWiY Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: f84badb51e2d4e30bd5b50e2b1f8be56 Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1689134496 Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84badb51e2d4e30bd5b50e2b1f8be56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f84badb51e2d4e30bd5b50e2b1f8be56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f84badb51e2d4e30bd5b50e2b1f8be56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84badb51e2d4e30bd5b50e2b1f8be56"}]}] Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1689134496 Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: f84badb51e2d4e30bd5b50e2b1f8be56 Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1689134496 Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AttachVolumeShelveTestJSON-1689134496-project Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 45d83caaa8704fb0a6cd0d527870b33e Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1689134496-project Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 7c7e62d3-1b07-483d-9943-887c096d4350 could not be found. Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '7c7e62d3-1b07-483d-9943-887c096d4350'} Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7e62d3-1b07-483d-9943-887c096d4350 could not be found. Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7e62d3-1b07-483d-9943-887c096d4350 could not be found. Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:42:46.589036 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:46.593937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:42:46.593937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:46.593937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:46.593937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:46.593937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:46.593937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:46.593937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7e62d3-1b07-483d-9943-887c096d4350 could not be found. Jul 20 04:42:46.593937 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:42:46.593937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-96ddbdf2-565a-46aa-93d0-979f9642720a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Returning 404 to user: Instance 7c7e62d3-1b07-483d-9943-887c096d4350 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:46.593937 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-96ddbdf2-565a-46aa-93d0-979f9642720a tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 404 len: 111 microversion: 2.20 time: 0.055138 Jul 20 04:42:46.595764 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2370/4984] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:46 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:42:46.600093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d8ba389c-9358-47cc-8ed3-79cdf924254a tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:46.600744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d8ba389c-9358-47cc-8ed3-79cdf924254a tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:46.608228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8ba389c-9358-47cc-8ed3-79cdf924254a tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:46.608737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8ba389c-9358-47cc-8ed3-79cdf924254a tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:46.609593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8ba389c-9358-47cc-8ed3-79cdf924254a tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:46.610062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8ba389c-9358-47cc-8ed3-79cdf924254a tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:46.675242 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6feae801-cebe-41bb-8c6d-50d92f492948 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:46.695229 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6feae801-cebe-41bb-8c6d-50d92f492948 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1322 microversion: 2.1 time: 0.449983 Jul 20 04:42:46.716496 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2615/4985] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:46 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1322 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:46.741879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6406b4c0-2df7-4e4a-abc1-2f2f49b81cf7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '.version_select at 0x7f06bd3198b0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:46.794252 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6406b4c0-2df7-4e4a-abc1-2f2f49b81cf7 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-385393742" status: 204 len: 0 microversion: 2.20 time: 0.066261 Jul 20 04:42:46.802206 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2616/4986] 10.222.0.17 () {60 vars in 1258 bytes} [Wed Jul 20 04:42:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-385393742 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:42:46.814529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e679acc5-509c-4ca5-9938-9658652a8ded req-dda5c477-e49b-4188-8950-719d22ef25f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53648916-fa3f-406d-9cd0-f1c51355bc16", "name": "network-vif-plugged", "status": "completed", "tag": "2d6d6a29-25b7-45d4-adbe-e75ce1a89f13"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:46.825676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e679acc5-509c-4ca5-9938-9658652a8ded req-dda5c477-e49b-4188-8950-719d22ef25f9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:46.826500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e679acc5-509c-4ca5-9938-9658652a8ded req-dda5c477-e49b-4188-8950-719d22ef25f9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:46.876241 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e679acc5-509c-4ca5-9938-9658652a8ded req-dda5c477-e49b-4188-8950-719d22ef25f9 service nova] Creating event network-vif-plugged:2d6d6a29-25b7-45d4-adbe-e75ce1a89f13 for instance 53648916-fa3f-406d-9cd0-f1c51355bc16 on n-h1-826526-5 Jul 20 04:42:46.883918 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e679acc5-509c-4ca5-9938-9658652a8ded req-dda5c477-e49b-4188-8950-719d22ef25f9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079011 Jul 20 04:42:46.885345 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2617/4987] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:46.936004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d8ba389c-9358-47cc-8ed3-79cdf924254a tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:46.954438 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d8ba389c-9358-47cc-8ed3-79cdf924254a tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 200 len: 1373 microversion: 2.1 time: 0.357872 Jul 20 04:42:46.956501 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2371/4988] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:46 2022] GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 1373 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:47.555263 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-35055398-6cd6-484e-a6ac-48092a1a1716 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:47.573534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35055398-6cd6-484e-a6ac-48092a1a1716 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:47.593556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35055398-6cd6-484e-a6ac-48092a1a1716 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:47.594016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35055398-6cd6-484e-a6ac-48092a1a1716 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:47.595096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35055398-6cd6-484e-a6ac-48092a1a1716 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:47.599560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35055398-6cd6-484e-a6ac-48092a1a1716 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:47.742471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a36e699c-21f5-4e1c-99b6-6548398d25c4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:47.745677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a36e699c-21f5-4e1c-99b6-6548398d25c4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:47.774759 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a36e699c-21f5-4e1c-99b6-6548398d25c4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:47.778260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a36e699c-21f5-4e1c-99b6-6548398d25c4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:47.781421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a36e699c-21f5-4e1c-99b6-6548398d25c4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:47.782998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a36e699c-21f5-4e1c-99b6-6548398d25c4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:48.084416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-35055398-6cd6-484e-a6ac-48092a1a1716 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:48.101849 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-35055398-6cd6-484e-a6ac-48092a1a1716 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1514 microversion: 2.1 time: 0.553180 Jul 20 04:42:48.102484 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2618/4989] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:47 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1514 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:48.129133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ed1818d4-e811-45dc-9204-22ceffc561ec tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:48.133430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ed1818d4-e811-45dc-9204-22ceffc561ec tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:48.147618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ed1818d4-e811-45dc-9204-22ceffc561ec tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:48.148444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ed1818d4-e811-45dc-9204-22ceffc561ec tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:48.149831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ed1818d4-e811-45dc-9204-22ceffc561ec tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:48.150530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ed1818d4-e811-45dc-9204-22ceffc561ec tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:48.155489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a36e699c-21f5-4e1c-99b6-6548398d25c4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:48.166163 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a36e699c-21f5-4e1c-99b6-6548398d25c4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1322 microversion: 2.1 time: 0.440439 Jul 20 04:42:48.178688 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2372/4990] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:47 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1322 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:48.187407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-091bc9fb-02f5-4dec-9b17-2e460382aaa7 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:48.189736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-091bc9fb-02f5-4dec-9b17-2e460382aaa7 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:48.203079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-091bc9fb-02f5-4dec-9b17-2e460382aaa7 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:48.204154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-091bc9fb-02f5-4dec-9b17-2e460382aaa7 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:48.205855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-091bc9fb-02f5-4dec-9b17-2e460382aaa7 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:48.206871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-091bc9fb-02f5-4dec-9b17-2e460382aaa7 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:48.261355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-091bc9fb-02f5-4dec-9b17-2e460382aaa7 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lazy-loading 'flavor' on Instance uuid 085f0971-9269-4d32-8eeb-17e7bf8143c2 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:42:48.470266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ed1818d4-e811-45dc-9204-22ceffc561ec tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:48.485955 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ed1818d4-e811-45dc-9204-22ceffc561ec tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 200 len: 1373 microversion: 2.1 time: 0.365870 Jul 20 04:42:48.487212 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2619/4991] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:48 2022] GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 1373 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:48.491536 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-091bc9fb-02f5-4dec-9b17-2e460382aaa7 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "POST /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/action" status: 200 len: 32 microversion: 2.1 time: 0.310463 Jul 20 04:42:48.493078 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2373/4992] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:42:48 2022] POST /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/action => generated 32 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:42:48.504466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ef8b3a21-5c03-407c-bf70-0b0b2d79ca1e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:48.506066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ef8b3a21-5c03-407c-bf70-0b0b2d79ca1e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:48.514904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef8b3a21-5c03-407c-bf70-0b0b2d79ca1e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:48.515627 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef8b3a21-5c03-407c-bf70-0b0b2d79ca1e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:48.517593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef8b3a21-5c03-407c-bf70-0b0b2d79ca1e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:48.518921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef8b3a21-5c03-407c-bf70-0b0b2d79ca1e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:48.819492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ef8b3a21-5c03-407c-bf70-0b0b2d79ca1e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:48.843070 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ef8b3a21-5c03-407c-bf70-0b0b2d79ca1e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 0.343984 Jul 20 04:42:48.852326 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2620/4993] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:48 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:48.908432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-4e820145-5d88-499b-aa58-48c49f325790 req-cdc269a4-f112-497f-ba4c-4ba95dd0be10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783", "name": "network-vif-plugged", "status": "completed", "tag": "6a873c5d-6855-410c-9be1-c768a125054e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:48.920928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:48.930219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4e820145-5d88-499b-aa58-48c49f325790 req-cdc269a4-f112-497f-ba4c-4ba95dd0be10 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:48.931012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4e820145-5d88-499b-aa58-48c49f325790 req-cdc269a4-f112-497f-ba4c-4ba95dd0be10 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:48.963550 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-4e820145-5d88-499b-aa58-48c49f325790 req-cdc269a4-f112-497f-ba4c-4ba95dd0be10 service nova] Creating event network-vif-plugged:6a873c5d-6855-410c-9be1-c768a125054e for instance cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 on n-h2-826526-5 Jul 20 04:42:48.970114 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-4e820145-5d88-499b-aa58-48c49f325790 req-cdc269a4-f112-497f-ba4c-4ba95dd0be10 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070058 Jul 20 04:42:48.970792 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2374/4994] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:49.129111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e79da9ae-10ad-4e78-934e-12cf6bc7378d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:49.132225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e79da9ae-10ad-4e78-934e-12cf6bc7378d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:49.175429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e79da9ae-10ad-4e78-934e-12cf6bc7378d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:49.180629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e79da9ae-10ad-4e78-934e-12cf6bc7378d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:49.187175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ef44010a-49a2-4680-8418-6cf890b2c143 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:49.190905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ef44010a-49a2-4680-8418-6cf890b2c143 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:49.217443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e79da9ae-10ad-4e78-934e-12cf6bc7378d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:49.223369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e79da9ae-10ad-4e78-934e-12cf6bc7378d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:49.233121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef44010a-49a2-4680-8418-6cf890b2c143 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:49.249292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef44010a-49a2-4680-8418-6cf890b2c143 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:49.250205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef44010a-49a2-4680-8418-6cf890b2c143 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:49.250649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef44010a-49a2-4680-8418-6cf890b2c143 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:49.507865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ef44010a-49a2-4680-8418-6cf890b2c143 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:49.518389 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ef44010a-49a2-4680-8418-6cf890b2c143 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1322 microversion: 2.1 time: 0.335946 Jul 20 04:42:49.519513 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2375/4995] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:49 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:49.524950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e79da9ae-10ad-4e78-934e-12cf6bc7378d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:49.541141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1cfd1a9b-5935-4cf1-91d1-5fcd2dd9e345 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-175320341", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f1879a0a-d688-42b3-a635-3e6853fc343c", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7f25ae6d-be40-4c15-969a-9d88fe94c163"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:49.541729 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e79da9ae-10ad-4e78-934e-12cf6bc7378d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1514 microversion: 2.1 time: 0.424598 Jul 20 04:42:49.544479 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2621/4996] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:49 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1514 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:49.567567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0885028d-fe98-45c1-9ca0-e6256c94d37c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:49.569068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0885028d-fe98-45c1-9ca0-e6256c94d37c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:49.576306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0885028d-fe98-45c1-9ca0-e6256c94d37c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:49.576997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0885028d-fe98-45c1-9ca0-e6256c94d37c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:49.577967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0885028d-fe98-45c1-9ca0-e6256c94d37c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:49.578829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0885028d-fe98-45c1-9ca0-e6256c94d37c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:49.679296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-1cfd1a9b-5935-4cf1-91d1-5fcd2dd9e345 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] validate_networks() for [('7f25ae6d-be40-4c15-969a-9d88fe94c163', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:42:49.886921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0885028d-fe98-45c1-9ca0-e6256c94d37c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:49.897504 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0885028d-fe98-45c1-9ca0-e6256c94d37c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 200 len: 1544 microversion: 2.1 time: 0.350413 Jul 20 04:42:49.898389 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2622/4997] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:49 2022] GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 1544 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:49.905035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9f5aff12-3211-4fcf-9a38-0c7db600386d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:49.905927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9f5aff12-3211-4fcf-9a38-0c7db600386d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:49.917404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f5aff12-3211-4fcf-9a38-0c7db600386d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:49.918235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f5aff12-3211-4fcf-9a38-0c7db600386d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:49.919233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f5aff12-3211-4fcf-9a38-0c7db600386d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:49.923312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f5aff12-3211-4fcf-9a38-0c7db600386d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:50.103987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9f5aff12-3211-4fcf-9a38-0c7db600386d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:50.121723 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9f5aff12-3211-4fcf-9a38-0c7db600386d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 0.221844 Jul 20 04:42:50.122355 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2623/4998] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:49 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:50.128397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d7592e52-08e5-4c26-bfc9-ea759308000c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:50.129378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d7592e52-08e5-4c26-bfc9-ea759308000c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:50.139108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7592e52-08e5-4c26-bfc9-ea759308000c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:50.139576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7592e52-08e5-4c26-bfc9-ea759308000c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:50.140421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7592e52-08e5-4c26-bfc9-ea759308000c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:50.140858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7592e52-08e5-4c26-bfc9-ea759308000c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:50.257300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1cfd1a9b-5935-4cf1-91d1-5fcd2dd9e345 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:42:50.257833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1cfd1a9b-5935-4cf1-91d1-5fcd2dd9e345 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:42:50.258428 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1cfd1a9b-5935-4cf1-91d1-5fcd2dd9e345 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:42:50.259296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1cfd1a9b-5935-4cf1-91d1-5fcd2dd9e345 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:42:50.259999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1cfd1a9b-5935-4cf1-91d1-5fcd2dd9e345 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:42:50.277268 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cfd1a9b-5935-4cf1-91d1-5fcd2dd9e345 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:50.278119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cfd1a9b-5935-4cf1-91d1-5fcd2dd9e345 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:50.279207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cfd1a9b-5935-4cf1-91d1-5fcd2dd9e345 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:50.279898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cfd1a9b-5935-4cf1-91d1-5fcd2dd9e345 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:50.305301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-1cfd1a9b-5935-4cf1-91d1-5fcd2dd9e345 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Getting quotas for project b889ad56221143f0a54450c81ba738a7. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:42:50.312944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-1cfd1a9b-5935-4cf1-91d1-5fcd2dd9e345 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Getting quotas for user bc760e8f522640fc9190460719f5dcc2 and project b889ad56221143f0a54450c81ba738a7. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:42:50.321382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d7592e52-08e5-4c26-bfc9-ea759308000c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:50.332653 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d7592e52-08e5-4c26-bfc9-ea759308000c tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 200 len: 1544 microversion: 2.1 time: 0.208938 Jul 20 04:42:50.334144 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2624/4999] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:50 2022] GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 1544 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:50.362517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1cfd1a9b-5935-4cf1-91d1-5fcd2dd9e345 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:42:50.365839 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1cfd1a9b-5935-4cf1-91d1-5fcd2dd9e345 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f1879a0a-d688-42b3-a635-3e6853fc343c',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:42:50.495399 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1cfd1a9b-5935-4cf1-91d1-5fcd2dd9e345 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974563 Jul 20 04:42:50.496579 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2376/5000] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:42:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:42:50.511484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cf98fd95-3d9f-4369-92bf-813093b4a3fe tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:50.527193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cf98fd95-3d9f-4369-92bf-813093b4a3fe tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:50.546557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a7915717-0244-43df-aa3a-57c592aed5ad tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:50.547707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a7915717-0244-43df-aa3a-57c592aed5ad tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:50.564066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7915717-0244-43df-aa3a-57c592aed5ad tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:50.573981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7915717-0244-43df-aa3a-57c592aed5ad tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:50.574949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7915717-0244-43df-aa3a-57c592aed5ad tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:50.576300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7915717-0244-43df-aa3a-57c592aed5ad tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:50.689862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cf98fd95-3d9f-4369-92bf-813093b4a3fe tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:50.711766 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cf98fd95-3d9f-4369-92bf-813093b4a3fe tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1056 microversion: 2.1 time: 0.206889 Jul 20 04:42:50.725523 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2625/5001] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:50 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1056 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:50.737099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-61784664-d3cb-4531-a0f2-eb23f06b6629 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:50.739282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-61784664-d3cb-4531-a0f2-eb23f06b6629 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:50.757618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61784664-d3cb-4531-a0f2-eb23f06b6629 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:50.761712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61784664-d3cb-4531-a0f2-eb23f06b6629 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:50.764872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61784664-d3cb-4531-a0f2-eb23f06b6629 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:50.767097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61784664-d3cb-4531-a0f2-eb23f06b6629 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:51.083476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-61784664-d3cb-4531-a0f2-eb23f06b6629 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:51.108234 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-61784664-d3cb-4531-a0f2-eb23f06b6629 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1514 microversion: 2.1 time: 0.381072 Jul 20 04:42:51.109760 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2626/5002] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:50 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1514 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:51.157853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bc15a9d7-9595-4145-8de7-ecaf525c6ec5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:51.161555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bc15a9d7-9595-4145-8de7-ecaf525c6ec5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:51.180444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc15a9d7-9595-4145-8de7-ecaf525c6ec5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:51.181746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc15a9d7-9595-4145-8de7-ecaf525c6ec5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:51.183591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc15a9d7-9595-4145-8de7-ecaf525c6ec5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:51.184892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc15a9d7-9595-4145-8de7-ecaf525c6ec5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:51.266995 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a7915717-0244-43df-aa3a-57c592aed5ad tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:51.272843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:51.283821 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a7915717-0244-43df-aa3a-57c592aed5ad tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1516 microversion: 2.1 time: 0.750821 Jul 20 04:42:51.289662 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2377/5003] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:50 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1516 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:51.307695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-19664d9e-9c8d-4847-b0cd-78440bc9d62c tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:51.310084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-19664d9e-9c8d-4847-b0cd-78440bc9d62c tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:51.336665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19664d9e-9c8d-4847-b0cd-78440bc9d62c tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:51.337152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19664d9e-9c8d-4847-b0cd-78440bc9d62c tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:51.342076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19664d9e-9c8d-4847-b0cd-78440bc9d62c tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:51.342596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19664d9e-9c8d-4847-b0cd-78440bc9d62c tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:51.384582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-19664d9e-9c8d-4847-b0cd-78440bc9d62c tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lazy-loading 'flavor' on Instance uuid cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:42:51.506452 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-19664d9e-9c8d-4847-b0cd-78440bc9d62c tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "POST /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783/action" status: 200 len: 32 microversion: 2.1 time: 0.203778 Jul 20 04:42:51.510827 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2378/5004] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:42:51 2022] POST /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:42:51.523940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e7288675-1951-4f82-b6ff-36fddb0b72eb tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:51.535504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e7288675-1951-4f82-b6ff-36fddb0b72eb tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:51.540720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bc15a9d7-9595-4145-8de7-ecaf525c6ec5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:51.557527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7288675-1951-4f82-b6ff-36fddb0b72eb tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:51.558061 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7288675-1951-4f82-b6ff-36fddb0b72eb tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:51.559315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7288675-1951-4f82-b6ff-36fddb0b72eb tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:51.560053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7288675-1951-4f82-b6ff-36fddb0b72eb tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:51.568485 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bc15a9d7-9595-4145-8de7-ecaf525c6ec5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 0.429828 Jul 20 04:42:51.575258 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2627/5005] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:51 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:51.730763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cb64b920-5b68-4293-b384-e924274b3461 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:51.731475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cb64b920-5b68-4293-b384-e924274b3461 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:51.745161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb64b920-5b68-4293-b384-e924274b3461 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:51.746025 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb64b920-5b68-4293-b384-e924274b3461 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:51.747093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb64b920-5b68-4293-b384-e924274b3461 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:51.747735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb64b920-5b68-4293-b384-e924274b3461 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:51.894720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cb64b920-5b68-4293-b384-e924274b3461 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:51.905991 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cb64b920-5b68-4293-b384-e924274b3461 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1108 microversion: 2.1 time: 0.179519 Jul 20 04:42:51.907766 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2628/5006] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:51 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1108 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:51.913452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4b2672dc-04a1-4c75-b86c-31e2edac6bfe tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:51.914549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4b2672dc-04a1-4c75-b86c-31e2edac6bfe tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:51.921972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b2672dc-04a1-4c75-b86c-31e2edac6bfe tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:51.922828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b2672dc-04a1-4c75-b86c-31e2edac6bfe tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:51.923815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b2672dc-04a1-4c75-b86c-31e2edac6bfe tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:51.924492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b2672dc-04a1-4c75-b86c-31e2edac6bfe tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:51.941360 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-4b2672dc-04a1-4c75-b86c-31e2edac6bfe tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] HTTP exception thrown: Instance 7c7e62d3-1b07-483d-9943-887c096d4350 could not be found. Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4b2672dc-04a1-4c75-b86c-31e2edac6bfe tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Request method failure captured: Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 HTTP/1.1 Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14YcfGQ2dJXFTmLgIeuKTnvXz4Xy1mrIR63S63g1Qamgwh7IpgwWfUbDj4orK8K5ndqbQxiI-SDRzmiQmPSDm6XtO9Ts2boSIp-d3er3jfI5B0uRDWJveWe21AmZmlRhbpzWdjRPlWd6uKkr6wIzWOZIbkOgEQHhpjqGMACN1GJjWiY Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: f84badb51e2d4e30bd5b50e2b1f8be56 Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1689134496 Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84badb51e2d4e30bd5b50e2b1f8be56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f84badb51e2d4e30bd5b50e2b1f8be56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f84badb51e2d4e30bd5b50e2b1f8be56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84badb51e2d4e30bd5b50e2b1f8be56"}]}] Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1689134496 Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: f84badb51e2d4e30bd5b50e2b1f8be56 Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1689134496 Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AttachVolumeShelveTestJSON-1689134496-project Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 45d83caaa8704fb0a6cd0d527870b33e Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1689134496-project Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 7c7e62d3-1b07-483d-9943-887c096d4350 could not be found. Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '7c7e62d3-1b07-483d-9943-887c096d4350'} Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7e62d3-1b07-483d-9943-887c096d4350 could not be found. Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:51.943698 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:51.947922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7e62d3-1b07-483d-9943-887c096d4350 could not be found. Jul 20 04:42:51.947922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:51.947922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:51.947922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:51.947922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:51.947922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:51.947922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:51.947922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:51.947922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:51.947922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7e62d3-1b07-483d-9943-887c096d4350 could not be found. Jul 20 04:42:51.947922 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:51.952782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4b2672dc-04a1-4c75-b86c-31e2edac6bfe tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Returning 404 to user: Instance 7c7e62d3-1b07-483d-9943-887c096d4350 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:51.953993 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4b2672dc-04a1-4c75-b86c-31e2edac6bfe tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 404 len: 111 microversion: 2.20 time: 0.045032 Jul 20 04:42:51.954792 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2629/5007] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:42:51 2022] DELETE /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:42:51.963990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-302cd303-c511-411b-835f-0a1962f096ac tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:51.965120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-302cd303-c511-411b-835f-0a1962f096ac tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 7c7e62d3-1b07-483d-9943-887c096d4350] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:51.972989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-302cd303-c511-411b-835f-0a1962f096ac tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:51.973813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-302cd303-c511-411b-835f-0a1962f096ac tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:51.974810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-302cd303-c511-411b-835f-0a1962f096ac tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:51.975482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-302cd303-c511-411b-835f-0a1962f096ac tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:52.005282 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-302cd303-c511-411b-835f-0a1962f096ac tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] HTTP exception thrown: Instance 7c7e62d3-1b07-483d-9943-887c096d4350 could not be found. Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-302cd303-c511-411b-835f-0a1962f096ac tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Request method failure captured: Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 HTTP/1.1 Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14YcfGQ2dJXFTmLgIeuKTnvXz4Xy1mrIR63S63g1Qamgwh7IpgwWfUbDj4orK8K5ndqbQxiI-SDRzmiQmPSDm6XtO9Ts2boSIp-d3er3jfI5B0uRDWJveWe21AmZmlRhbpzWdjRPlWd6uKkr6wIzWOZIbkOgEQHhpjqGMACN1GJjWiY Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: f84badb51e2d4e30bd5b50e2b1f8be56 Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1689134496 Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84badb51e2d4e30bd5b50e2b1f8be56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f84badb51e2d4e30bd5b50e2b1f8be56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f84badb51e2d4e30bd5b50e2b1f8be56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84badb51e2d4e30bd5b50e2b1f8be56"}]}] Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1689134496 Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: f84badb51e2d4e30bd5b50e2b1f8be56 Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1689134496 Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AttachVolumeShelveTestJSON-1689134496-project Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 45d83caaa8704fb0a6cd0d527870b33e Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1689134496-project Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 7c7e62d3-1b07-483d-9943-887c096d4350 could not be found. Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '7c7e62d3-1b07-483d-9943-887c096d4350'} Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7e62d3-1b07-483d-9943-887c096d4350 could not be found. Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7e62d3-1b07-483d-9943-887c096d4350 could not be found. Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:52.007613 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:52.012088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:52.012088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:52.012088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:52.012088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:52.012088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:52.012088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:52.012088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7e62d3-1b07-483d-9943-887c096d4350 could not be found. Jul 20 04:42:52.012088 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:52.012598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e7288675-1951-4f82-b6ff-36fddb0b72eb tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:52.020671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-302cd303-c511-411b-835f-0a1962f096ac tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Returning 404 to user: Instance 7c7e62d3-1b07-483d-9943-887c096d4350 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:52.020671 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-302cd303-c511-411b-835f-0a1962f096ac tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350" status: 404 len: 111 microversion: 2.20 time: 0.061150 Jul 20 04:42:52.030307 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e7288675-1951-4f82-b6ff-36fddb0b72eb tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.510535 Jul 20 04:42:52.031363 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2630/5008] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:51 2022] GET /compute/v2.1/servers/7c7e62d3-1b07-483d-9943-887c096d4350 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:42:52.036989 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2379/5009] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:51 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:52.128492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6739f1e4-a834-4cb4-a85d-323e15b15ae5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:52.129242 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6739f1e4-a834-4cb4-a85d-323e15b15ae5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:52.140920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6739f1e4-a834-4cb4-a85d-323e15b15ae5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:52.150319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6739f1e4-a834-4cb4-a85d-323e15b15ae5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:52.156866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6739f1e4-a834-4cb4-a85d-323e15b15ae5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:52.158839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6739f1e4-a834-4cb4-a85d-323e15b15ae5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:52.609663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-13faa400-4881-4ffb-a49f-c351149c1681 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:52.627742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-13faa400-4881-4ffb-a49f-c351149c1681 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:52.654448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13faa400-4881-4ffb-a49f-c351149c1681 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:52.654910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13faa400-4881-4ffb-a49f-c351149c1681 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:52.655712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13faa400-4881-4ffb-a49f-c351149c1681 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:52.656157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13faa400-4881-4ffb-a49f-c351149c1681 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:52.926523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6739f1e4-a834-4cb4-a85d-323e15b15ae5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:52.973878 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6739f1e4-a834-4cb4-a85d-323e15b15ae5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1514 microversion: 2.1 time: 0.851365 Jul 20 04:42:52.974487 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2631/5010] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:52 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1514 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:53.006240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f5b13aa6-c73c-42e5-b49d-e2b719d4c5ff tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:53.006876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f5b13aa6-c73c-42e5-b49d-e2b719d4c5ff tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:53.023420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f5b13aa6-c73c-42e5-b49d-e2b719d4c5ff tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:53.025302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f5b13aa6-c73c-42e5-b49d-e2b719d4c5ff tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:53.026710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f5b13aa6-c73c-42e5-b49d-e2b719d4c5ff tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:53.028456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f5b13aa6-c73c-42e5-b49d-e2b719d4c5ff tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:53.203571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-13faa400-4881-4ffb-a49f-c351149c1681 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:53.242634 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-13faa400-4881-4ffb-a49f-c351149c1681 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 0.659847 Jul 20 04:42:53.243525 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2380/5011] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:52 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:53.266589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8e09a57b-0cdd-45cd-9db9-6d0d8451d639 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:53.267515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8e09a57b-0cdd-45cd-9db9-6d0d8451d639 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:53.269102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f5b13aa6-c73c-42e5-b49d-e2b719d4c5ff tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:53.279148 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f5b13aa6-c73c-42e5-b49d-e2b719d4c5ff tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1126 microversion: 2.1 time: 0.303456 Jul 20 04:42:53.285010 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2632/5012] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:52 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1126 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:53.294370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e09a57b-0cdd-45cd-9db9-6d0d8451d639 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:53.294370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e09a57b-0cdd-45cd-9db9-6d0d8451d639 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:53.294370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e09a57b-0cdd-45cd-9db9-6d0d8451d639 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:53.294370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e09a57b-0cdd-45cd-9db9-6d0d8451d639 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:53.996255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-61d91d83-fa45-4b1f-9f87-8ca7cfc4d821 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:53.997089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-61d91d83-fa45-4b1f-9f87-8ca7cfc4d821 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:54.022854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61d91d83-fa45-4b1f-9f87-8ca7cfc4d821 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:54.024757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61d91d83-fa45-4b1f-9f87-8ca7cfc4d821 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:54.027754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61d91d83-fa45-4b1f-9f87-8ca7cfc4d821 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:54.029397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61d91d83-fa45-4b1f-9f87-8ca7cfc4d821 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:54.088526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8e09a57b-0cdd-45cd-9db9-6d0d8451d639 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:54.108011 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8e09a57b-0cdd-45cd-9db9-6d0d8451d639 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.863196 Jul 20 04:42:54.108755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:54.109383 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2381/5013] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:53 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:54.202047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-11437e2b-11ed-4705-acb6-3d249951d3d4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:54.203080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-11437e2b-11ed-4705-acb6-3d249951d3d4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:54.218040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11437e2b-11ed-4705-acb6-3d249951d3d4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:54.218497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11437e2b-11ed-4705-acb6-3d249951d3d4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:54.219330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11437e2b-11ed-4705-acb6-3d249951d3d4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:54.219778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11437e2b-11ed-4705-acb6-3d249951d3d4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:54.319046 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-11437e2b-11ed-4705-acb6-3d249951d3d4 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605/action" status: 200 len: 24502 microversion: 2.1 time: 0.121233 Jul 20 04:42:54.319747 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2382/5014] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:42:54 2022] POST /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605/action => generated 24502 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:42:54.326425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-374f8e14-ab9f-4a72-a7ec-6c43c75eef12 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:54.332467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-374f8e14-ab9f-4a72-a7ec-6c43c75eef12 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:54.365506 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-374f8e14-ab9f-4a72-a7ec-6c43c75eef12 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:54.366007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-374f8e14-ab9f-4a72-a7ec-6c43c75eef12 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:54.366818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-374f8e14-ab9f-4a72-a7ec-6c43c75eef12 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:54.367257 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-374f8e14-ab9f-4a72-a7ec-6c43c75eef12 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:54.787833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-61d91d83-fa45-4b1f-9f87-8ca7cfc4d821 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:54.800311 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-61d91d83-fa45-4b1f-9f87-8ca7cfc4d821 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1514 microversion: 2.1 time: 0.812718 Jul 20 04:42:54.802082 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2633/5015] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:53 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1514 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:54.808298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d652d6ba-93b5-466b-97df-fae47daafd67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:54.809368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d652d6ba-93b5-466b-97df-fae47daafd67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:54.818302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d652d6ba-93b5-466b-97df-fae47daafd67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:54.822067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d652d6ba-93b5-466b-97df-fae47daafd67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:54.829112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d652d6ba-93b5-466b-97df-fae47daafd67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:54.829841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d652d6ba-93b5-466b-97df-fae47daafd67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:55.278082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-374f8e14-ab9f-4a72-a7ec-6c43c75eef12 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:55.288298 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-374f8e14-ab9f-4a72-a7ec-6c43c75eef12 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 0.966756 Jul 20 04:42:55.302793 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2383/5016] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:54 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:55.316396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b6e34dbd-eddf-4794-bb68-df5d79496deb tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:55.328464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b6e34dbd-eddf-4794-bb68-df5d79496deb tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:55.350175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6e34dbd-eddf-4794-bb68-df5d79496deb tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:55.350918 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6e34dbd-eddf-4794-bb68-df5d79496deb tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:55.351908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6e34dbd-eddf-4794-bb68-df5d79496deb tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:55.352801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6e34dbd-eddf-4794-bb68-df5d79496deb tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:55.643480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d652d6ba-93b5-466b-97df-fae47daafd67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:55.656594 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d652d6ba-93b5-466b-97df-fae47daafd67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1168 microversion: 2.1 time: 0.852648 Jul 20 04:42:55.659753 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2634/5017] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:54 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1168 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:55.818123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-da643a8b-94fd-4879-ae18-4db707843d14 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:55.818833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-da643a8b-94fd-4879-ae18-4db707843d14 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:55.833556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da643a8b-94fd-4879-ae18-4db707843d14 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:55.834127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da643a8b-94fd-4879-ae18-4db707843d14 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:55.836610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da643a8b-94fd-4879-ae18-4db707843d14 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:55.838286 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da643a8b-94fd-4879-ae18-4db707843d14 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:55.906210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b6e34dbd-eddf-4794-bb68-df5d79496deb tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:55.940747 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b6e34dbd-eddf-4794-bb68-df5d79496deb tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.636218 Jul 20 04:42:55.946965 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2384/5018] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:55 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:56.097517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-42d78b36-65d0-4fdd-b128-da13e73a97bd req-b206f9e4-663a-4966-95ab-28ac66884af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53648916-fa3f-406d-9cd0-f1c51355bc16", "tag": "2d6d6a29-25b7-45d4-adbe-e75ce1a89f13"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:56.114949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-42d78b36-65d0-4fdd-b128-da13e73a97bd req-b206f9e4-663a-4966-95ab-28ac66884af9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:56.123221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-42d78b36-65d0-4fdd-b128-da13e73a97bd req-b206f9e4-663a-4966-95ab-28ac66884af9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:56.153867 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-42d78b36-65d0-4fdd-b128-da13e73a97bd req-b206f9e4-663a-4966-95ab-28ac66884af9 service nova] Creating event network-changed:2d6d6a29-25b7-45d4-adbe-e75ce1a89f13 for instance 53648916-fa3f-406d-9cd0-f1c51355bc16 on n-h1-826526-5 Jul 20 04:42:56.168770 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-42d78b36-65d0-4fdd-b128-da13e73a97bd req-b206f9e4-663a-4966-95ab-28ac66884af9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080038 Jul 20 04:42:56.169738 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2385/5019] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 20 04:42:56.198671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-da643a8b-94fd-4879-ae18-4db707843d14 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:56.206840 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-da643a8b-94fd-4879-ae18-4db707843d14 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1514 microversion: 2.1 time: 0.393000 Jul 20 04:42:56.209188 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2635/5020] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:55 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1514 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:56.311239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-307c606b-2df5-469a-a655-21079a2daa64 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:56.311957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-307c606b-2df5-469a-a655-21079a2daa64 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:56.331151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-307c606b-2df5-469a-a655-21079a2daa64 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:56.331972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-307c606b-2df5-469a-a655-21079a2daa64 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:56.332419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-307c606b-2df5-469a-a655-21079a2daa64 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:56.332927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-307c606b-2df5-469a-a655-21079a2daa64 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:56.649957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-a39e2720-cef8-415e-a40d-18ab0e39e6c2 req-be407b23-12d9-481d-9985-0c22bbb64f09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6263382d-2580-486c-8731-c1bea0bfaab3", "tag": "c6007430-04b3-4a93-93c5-61c6e07b0953"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:56.662268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a39e2720-cef8-415e-a40d-18ab0e39e6c2 req-be407b23-12d9-481d-9985-0c22bbb64f09 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:56.662719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a39e2720-cef8-415e-a40d-18ab0e39e6c2 req-be407b23-12d9-481d-9985-0c22bbb64f09 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:56.731058 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-a39e2720-cef8-415e-a40d-18ab0e39e6c2 req-be407b23-12d9-481d-9985-0c22bbb64f09 service nova] Creating event network-changed:c6007430-04b3-4a93-93c5-61c6e07b0953 for instance 6263382d-2580-486c-8731-c1bea0bfaab3 on n-h1-826526-5 Jul 20 04:42:56.750262 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-a39e2720-cef8-415e-a40d-18ab0e39e6c2 req-be407b23-12d9-481d-9985-0c22bbb64f09 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107458 Jul 20 04:42:56.761020 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2636/5021] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 20 04:42:56.770859 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-00313910-dd07-4dec-9c4d-62fff8524aa2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:56.771574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-00313910-dd07-4dec-9c4d-62fff8524aa2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:56.794562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00313910-dd07-4dec-9c4d-62fff8524aa2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:56.795029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00313910-dd07-4dec-9c4d-62fff8524aa2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:56.795861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00313910-dd07-4dec-9c4d-62fff8524aa2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:56.800888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00313910-dd07-4dec-9c4d-62fff8524aa2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:56.953855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-307c606b-2df5-469a-a655-21079a2daa64 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:56.977384 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-307c606b-2df5-469a-a655-21079a2daa64 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 0.670232 Jul 20 04:42:56.982845 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2386/5022] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:56 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:56.990339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2186e14e-33c6-44f7-939e-498c45ae3490 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:56.991364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2186e14e-33c6-44f7-939e-498c45ae3490 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:57.000676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2186e14e-33c6-44f7-939e-498c45ae3490 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:57.001292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2186e14e-33c6-44f7-939e-498c45ae3490 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:57.002072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2186e14e-33c6-44f7-939e-498c45ae3490 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:57.002552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2186e14e-33c6-44f7-939e-498c45ae3490 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:57.300891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2186e14e-33c6-44f7-939e-498c45ae3490 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:57.314055 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2186e14e-33c6-44f7-939e-498c45ae3490 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.328708 Jul 20 04:42:57.316691 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2387/5023] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:56 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:57.323923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94d41b4d-1f7f-4810-9156-da0431bd5c60 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:57.332040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-94d41b4d-1f7f-4810-9156-da0431bd5c60 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:57.357771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94d41b4d-1f7f-4810-9156-da0431bd5c60 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:57.359114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94d41b4d-1f7f-4810-9156-da0431bd5c60 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:57.360220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94d41b4d-1f7f-4810-9156-da0431bd5c60 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:57.360900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94d41b4d-1f7f-4810-9156-da0431bd5c60 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:57.461021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-00313910-dd07-4dec-9c4d-62fff8524aa2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:57.489365 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-00313910-dd07-4dec-9c4d-62fff8524aa2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1168 microversion: 2.1 time: 0.723360 Jul 20 04:42:57.491623 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2637/5024] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:56 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1168 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:57.765696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d3e376f-3586-4ce8-ad2f-da5184e51f9c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:57.768632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4d3e376f-3586-4ce8-ad2f-da5184e51f9c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:57.791298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d3e376f-3586-4ce8-ad2f-da5184e51f9c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:57.791881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d3e376f-3586-4ce8-ad2f-da5184e51f9c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:57.794527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d3e376f-3586-4ce8-ad2f-da5184e51f9c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:57.796966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d3e376f-3586-4ce8-ad2f-da5184e51f9c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:57.845964 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-4d3e376f-3586-4ce8-ad2f-da5184e51f9c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] HTTP exception thrown: Instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 could not be found. Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d3e376f-3586-4ce8-ad2f-da5184e51f9c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Request method failure captured: Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 HTTP/1.1 Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14YcfGQ2dJXFTmLgIeuKTnvXz4Xy1mrIR63S63g1Qamgwh7IpgwWfUbDj4orK8K5ndqbQxiI-SDRzmiQmPSDm6XtO9Ts2boSIp-d3er3jfI5B0uRDWJveWe21AmZmlRhbpzWdjRPlWd6uKkr6wIzWOZIbkOgEQHhpjqGMACN1GJjWiY Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: f84badb51e2d4e30bd5b50e2b1f8be56 Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1689134496 Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84badb51e2d4e30bd5b50e2b1f8be56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f84badb51e2d4e30bd5b50e2b1f8be56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f84badb51e2d4e30bd5b50e2b1f8be56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84badb51e2d4e30bd5b50e2b1f8be56"}]}] Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1689134496 Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: f84badb51e2d4e30bd5b50e2b1f8be56 Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1689134496 Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AttachVolumeShelveTestJSON-1689134496-project Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 45d83caaa8704fb0a6cd0d527870b33e Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1689134496-project Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 could not be found. Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '90ebac50-3466-4fdc-8ca1-59b0001e2581'} Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 could not be found. Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:57.854279 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:57.858493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 could not be found. Jul 20 04:42:57.858493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:57.858493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:57.858493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:57.858493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:57.858493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:57.858493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:57.858493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:57.858493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:57.858493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 could not be found. Jul 20 04:42:57.858493 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:57.865547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d3e376f-3586-4ce8-ad2f-da5184e51f9c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Returning 404 to user: Instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:57.866724 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4d3e376f-3586-4ce8-ad2f-da5184e51f9c tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "DELETE /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 404 len: 111 microversion: 2.20 time: 0.111787 Jul 20 04:42:57.873923 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2638/5025] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:42:57 2022] DELETE /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:42:57.886530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-94d41b4d-1f7f-4810-9156-da0431bd5c60 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:57.890522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ced97671-19bf-413d-bdfc-a912c86c1328 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:57.894523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ced97671-19bf-413d-bdfc-a912c86c1328 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] [instance: 90ebac50-3466-4fdc-8ca1-59b0001e2581] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:57.899155 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-94d41b4d-1f7f-4810-9156-da0431bd5c60 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1514 microversion: 2.1 time: 0.581005 Jul 20 04:42:57.899768 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2388/5026] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:57 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1514 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:57.907656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ced97671-19bf-413d-bdfc-a912c86c1328 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:57.908160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ced97671-19bf-413d-bdfc-a912c86c1328 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:57.909129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ced97671-19bf-413d-bdfc-a912c86c1328 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:57.909882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ced97671-19bf-413d-bdfc-a912c86c1328 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:57.952852 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-ced97671-19bf-413d-bdfc-a912c86c1328 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] HTTP exception thrown: Instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 could not be found. Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ced97671-19bf-413d-bdfc-a912c86c1328 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Request method failure captured: Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 HTTP/1.1 Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14YcfGQ2dJXFTmLgIeuKTnvXz4Xy1mrIR63S63g1Qamgwh7IpgwWfUbDj4orK8K5ndqbQxiI-SDRzmiQmPSDm6XtO9Ts2boSIp-d3er3jfI5B0uRDWJveWe21AmZmlRhbpzWdjRPlWd6uKkr6wIzWOZIbkOgEQHhpjqGMACN1GJjWiY Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: f84badb51e2d4e30bd5b50e2b1f8be56 Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1689134496 Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84badb51e2d4e30bd5b50e2b1f8be56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f84badb51e2d4e30bd5b50e2b1f8be56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f84badb51e2d4e30bd5b50e2b1f8be56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84badb51e2d4e30bd5b50e2b1f8be56"}]}] Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1689134496 Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: f84badb51e2d4e30bd5b50e2b1f8be56 Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1689134496 Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AttachVolumeShelveTestJSON-1689134496-project Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 45d83caaa8704fb0a6cd0d527870b33e Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1689134496-project Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 could not be found. Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '90ebac50-3466-4fdc-8ca1-59b0001e2581'} Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 could not be found. Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 could not be found. Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:57.954630 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:57.958652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:57.958652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:57.958652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:57.958652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:57.958652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:57.958652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:57.958652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 could not be found. Jul 20 04:42:57.958652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:42:57.960984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ced97671-19bf-413d-bdfc-a912c86c1328 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] Returning 404 to user: Instance 90ebac50-3466-4fdc-8ca1-59b0001e2581 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:57.962057 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ced97671-19bf-413d-bdfc-a912c86c1328 tempest-AttachVolumeShelveTestJSON-1689134496 tempest-AttachVolumeShelveTestJSON-1689134496-project] 10.222.0.17 "GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581" status: 404 len: 111 microversion: 2.20 time: 0.084012 Jul 20 04:42:57.963124 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2639/5027] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:57 2022] GET /compute/v2.1/servers/90ebac50-3466-4fdc-8ca1-59b0001e2581 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:42:57.999640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fbc4618a-9c92-431c-b528-5ce0b68b9818 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:58.000524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fbc4618a-9c92-431c-b528-5ce0b68b9818 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:58.008582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fbc4618a-9c92-431c-b528-5ce0b68b9818 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:58.009606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fbc4618a-9c92-431c-b528-5ce0b68b9818 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:58.010951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fbc4618a-9c92-431c-b528-5ce0b68b9818 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:58.014235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fbc4618a-9c92-431c-b528-5ce0b68b9818 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:58.333542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-88ff48bf-6892-43d4-9825-371e346474cc tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:58.334277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-88ff48bf-6892-43d4-9825-371e346474cc tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:58.346436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88ff48bf-6892-43d4-9825-371e346474cc tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:58.347404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88ff48bf-6892-43d4-9825-371e346474cc tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:58.354622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88ff48bf-6892-43d4-9825-371e346474cc tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:58.357506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88ff48bf-6892-43d4-9825-371e346474cc tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:58.674374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fbc4618a-9c92-431c-b528-5ce0b68b9818 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:58.690270 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fbc4618a-9c92-431c-b528-5ce0b68b9818 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 0.694454 Jul 20 04:42:58.692240 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2389/5028] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:57 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:58.700712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-14b78a31-f22b-4265-a262-6e594c627bf9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:58.701674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-14b78a31-f22b-4265-a262-6e594c627bf9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:58.711347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14b78a31-f22b-4265-a262-6e594c627bf9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:58.712135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14b78a31-f22b-4265-a262-6e594c627bf9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:58.713166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14b78a31-f22b-4265-a262-6e594c627bf9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:58.713836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14b78a31-f22b-4265-a262-6e594c627bf9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:58.939871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-88ff48bf-6892-43d4-9825-371e346474cc tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:58.956462 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-88ff48bf-6892-43d4-9825-371e346474cc tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.626890 Jul 20 04:42:58.960721 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2640/5029] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:58 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:58.968508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2f1bd7bd-3fe6-4dd0-bb7f-5cc9b6d65bea tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:58.969827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2f1bd7bd-3fe6-4dd0-bb7f-5cc9b6d65bea tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:58.977300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f1bd7bd-3fe6-4dd0-bb7f-5cc9b6d65bea tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:58.978093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f1bd7bd-3fe6-4dd0-bb7f-5cc9b6d65bea tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:58.979789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f1bd7bd-3fe6-4dd0-bb7f-5cc9b6d65bea tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:58.980713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f1bd7bd-3fe6-4dd0-bb7f-5cc9b6d65bea tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:59.082574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-14b78a31-f22b-4265-a262-6e594c627bf9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:59.092547 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-14b78a31-f22b-4265-a262-6e594c627bf9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1168 microversion: 2.1 time: 0.398866 Jul 20 04:42:59.098338 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2390/5030] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:58 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1168 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:59.127569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2f1bd7bd-3fe6-4dd0-bb7f-5cc9b6d65bea tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:59.137320 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2f1bd7bd-3fe6-4dd0-bb7f-5cc9b6d65bea tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1514 microversion: 2.1 time: 0.175143 Jul 20 04:42:59.146808 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2641/5031] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:58 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:59.716614 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eb37c0c6-d049-47f9-b240-5ca9f210837b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:59.717269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eb37c0c6-d049-47f9-b240-5ca9f210837b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:59.738185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb37c0c6-d049-47f9-b240-5ca9f210837b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:59.740164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb37c0c6-d049-47f9-b240-5ca9f210837b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:59.741866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb37c0c6-d049-47f9-b240-5ca9f210837b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:59.743857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb37c0c6-d049-47f9-b240-5ca9f210837b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:59.977342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d84ef74-1c29-4b12-8f4d-4fd145ce3120 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:59.978700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4d84ef74-1c29-4b12-8f4d-4fd145ce3120 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:59.994703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d84ef74-1c29-4b12-8f4d-4fd145ce3120 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:59.996712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d84ef74-1c29-4b12-8f4d-4fd145ce3120 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:59.996712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d84ef74-1c29-4b12-8f4d-4fd145ce3120 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:59.996712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d84ef74-1c29-4b12-8f4d-4fd145ce3120 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:00.253259 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eb37c0c6-d049-47f9-b240-5ca9f210837b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:00.266231 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eb37c0c6-d049-47f9-b240-5ca9f210837b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 0.558714 Jul 20 04:43:00.271395 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2391/5032] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:59 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:00.281654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b5c5e1f5-cdad-4413-9408-4b578e753b4f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:00.283272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b5c5e1f5-cdad-4413-9408-4b578e753b4f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:00.295325 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b5c5e1f5-cdad-4413-9408-4b578e753b4f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:00.295803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b5c5e1f5-cdad-4413-9408-4b578e753b4f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:00.299023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b5c5e1f5-cdad-4413-9408-4b578e753b4f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:00.299513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b5c5e1f5-cdad-4413-9408-4b578e753b4f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:00.300392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:00.330401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4d84ef74-1c29-4b12-8f4d-4fd145ce3120 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:00.340624 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4d84ef74-1c29-4b12-8f4d-4fd145ce3120 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.367736 Jul 20 04:43:00.352246 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2642/5033] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:59 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:00.355525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:00.358531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f825822a-0176-4670-a9d9-fc4b0d39a32c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:00.359451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f825822a-0176-4670-a9d9-fc4b0d39a32c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:00.367744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f825822a-0176-4670-a9d9-fc4b0d39a32c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:00.368968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f825822a-0176-4670-a9d9-fc4b0d39a32c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:00.370651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f825822a-0176-4670-a9d9-fc4b0d39a32c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:00.382393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f825822a-0176-4670-a9d9-fc4b0d39a32c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:00.607530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f825822a-0176-4670-a9d9-fc4b0d39a32c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:00.625590 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f825822a-0176-4670-a9d9-fc4b0d39a32c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1514 microversion: 2.1 time: 0.271280 Jul 20 04:43:00.626760 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2643/5034] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:00 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1514 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:00.638015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-109d5c59-e002-4db9-8ea7-fa925d45dac7 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:00.644385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-109d5c59-e002-4db9-8ea7-fa925d45dac7 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:00.660175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-109d5c59-e002-4db9-8ea7-fa925d45dac7 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:00.661924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-109d5c59-e002-4db9-8ea7-fa925d45dac7 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:00.663600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-109d5c59-e002-4db9-8ea7-fa925d45dac7 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:00.664762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-109d5c59-e002-4db9-8ea7-fa925d45dac7 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:00.711272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:00.791800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b5c5e1f5-cdad-4413-9408-4b578e753b4f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:00.807993 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b5c5e1f5-cdad-4413-9408-4b578e753b4f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1168 microversion: 2.1 time: 0.532072 Jul 20 04:43:00.818253 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2392/5035] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:00 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1168 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:00.960322 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-109d5c59-e002-4db9-8ea7-fa925d45dac7 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1833 microversion: 2.1 time: 0.331752 Jul 20 04:43:00.961259 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2644/5036] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:00 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1833 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:01.292574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eccd4734-fa13-4645-a6ff-1b3397fbb159 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:01.301574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eccd4734-fa13-4645-a6ff-1b3397fbb159 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:01.335983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eccd4734-fa13-4645-a6ff-1b3397fbb159 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:01.337086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eccd4734-fa13-4645-a6ff-1b3397fbb159 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:01.349610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eccd4734-fa13-4645-a6ff-1b3397fbb159 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:01.350619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eccd4734-fa13-4645-a6ff-1b3397fbb159 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:01.370433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d8f1a04f-2ae1-40b3-bb45-b95d2b7f532c tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:01.371531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d8f1a04f-2ae1-40b3-bb45-b95d2b7f532c tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:01.404915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:01.407110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8f1a04f-2ae1-40b3-bb45-b95d2b7f532c tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:01.408222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8f1a04f-2ae1-40b3-bb45-b95d2b7f532c tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:01.409815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8f1a04f-2ae1-40b3-bb45-b95d2b7f532c tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:01.411030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8f1a04f-2ae1-40b3-bb45-b95d2b7f532c tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:01.876040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d8f1a04f-2ae1-40b3-bb45-b95d2b7f532c tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:01.892688 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d8f1a04f-2ae1-40b3-bb45-b95d2b7f532c tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.536647 Jul 20 04:43:01.902777 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2645/5037] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:01 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:01.907984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-af6317b9-946f-425f-b413-de5ebc25e8cd tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:01.908817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-af6317b9-946f-425f-b413-de5ebc25e8cd tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:01.914970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:01.917174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af6317b9-946f-425f-b413-de5ebc25e8cd tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:01.917901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af6317b9-946f-425f-b413-de5ebc25e8cd tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:01.918843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af6317b9-946f-425f-b413-de5ebc25e8cd tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:01.919442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af6317b9-946f-425f-b413-de5ebc25e8cd tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:02.225308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-af6317b9-946f-425f-b413-de5ebc25e8cd tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:02.250440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eccd4734-fa13-4645-a6ff-1b3397fbb159 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:02.253506 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-af6317b9-946f-425f-b413-de5ebc25e8cd tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1514 microversion: 2.1 time: 0.348881 Jul 20 04:43:02.260455 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2646/5038] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:01 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1514 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:02.269367 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eccd4734-fa13-4645-a6ff-1b3397fbb159 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 0.988349 Jul 20 04:43:02.273412 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2393/5039] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:01 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:02.278922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-622128fd-3be0-4587-9f4f-13ac5d963a46 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:02.286527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-622128fd-3be0-4587-9f4f-13ac5d963a46 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:02.320825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-622128fd-3be0-4587-9f4f-13ac5d963a46 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:02.321809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-622128fd-3be0-4587-9f4f-13ac5d963a46 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:02.327445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-622128fd-3be0-4587-9f4f-13ac5d963a46 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:02.329642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-622128fd-3be0-4587-9f4f-13ac5d963a46 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:02.778014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-622128fd-3be0-4587-9f4f-13ac5d963a46 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:02.796388 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-622128fd-3be0-4587-9f4f-13ac5d963a46 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1168 microversion: 2.1 time: 0.532484 Jul 20 04:43:02.800136 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2647/5040] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:02 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1168 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:02.910253 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2887e4ea-d006-4672-90fb-d107484c6f43 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:02.911774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2887e4ea-d006-4672-90fb-d107484c6f43 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:02.927598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2887e4ea-d006-4672-90fb-d107484c6f43 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:02.928050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2887e4ea-d006-4672-90fb-d107484c6f43 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:02.928898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2887e4ea-d006-4672-90fb-d107484c6f43 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:02.929358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2887e4ea-d006-4672-90fb-d107484c6f43 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:03.255314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2887e4ea-d006-4672-90fb-d107484c6f43 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:03.265595 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2887e4ea-d006-4672-90fb-d107484c6f43 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.359176 Jul 20 04:43:03.266214 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2394/5041] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:02 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:03.278314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-52d27282-6d5c-4bd1-a1ae-4caf68ae9302 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:03.279248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-52d27282-6d5c-4bd1-a1ae-4caf68ae9302 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:03.306469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-46815f05-6a27-47d1-ae39-16e5b7da80aa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:03.307142 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-46815f05-6a27-47d1-ae39-16e5b7da80aa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:03.311542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52d27282-6d5c-4bd1-a1ae-4caf68ae9302 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:03.312215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52d27282-6d5c-4bd1-a1ae-4caf68ae9302 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:03.312798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52d27282-6d5c-4bd1-a1ae-4caf68ae9302 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:03.313245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-52d27282-6d5c-4bd1-a1ae-4caf68ae9302 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:03.337105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46815f05-6a27-47d1-ae39-16e5b7da80aa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:03.337909 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46815f05-6a27-47d1-ae39-16e5b7da80aa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:03.341755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46815f05-6a27-47d1-ae39-16e5b7da80aa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:03.342518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46815f05-6a27-47d1-ae39-16e5b7da80aa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:03.780814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-52d27282-6d5c-4bd1-a1ae-4caf68ae9302 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:03.794550 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-52d27282-6d5c-4bd1-a1ae-4caf68ae9302 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1514 microversion: 2.1 time: 0.522454 Jul 20 04:43:03.800342 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2648/5042] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:03 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1514 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:03.815419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b4004df1-6c81-456e-aec7-e0b74b4634e7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:03.816494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b4004df1-6c81-456e-aec7-e0b74b4634e7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:03.824283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4004df1-6c81-456e-aec7-e0b74b4634e7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:03.825132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4004df1-6c81-456e-aec7-e0b74b4634e7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:03.826065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4004df1-6c81-456e-aec7-e0b74b4634e7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:03.826725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4004df1-6c81-456e-aec7-e0b74b4634e7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:03.860983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b4004df1-6c81-456e-aec7-e0b74b4634e7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:43:03.897320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-46815f05-6a27-47d1-ae39-16e5b7da80aa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:03.912773 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-46815f05-6a27-47d1-ae39-16e5b7da80aa tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 0.622454 Jul 20 04:43:03.918805 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2395/5043] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:03 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:03.926578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-8585e580-24b1-47f3-9f9d-ee7f8b00eee9 req-2b702ea2-1c99-4a0e-98f4-69d25ce9e4ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ed5f8e-9305-42db-8723-6fba63245605", "tag": "dd8fb1a0-4673-4433-af0e-9ceaff8681f5"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:03.947846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8585e580-24b1-47f3-9f9d-ee7f8b00eee9 req-2b702ea2-1c99-4a0e-98f4-69d25ce9e4ad service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:03.949555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8585e580-24b1-47f3-9f9d-ee7f8b00eee9 req-2b702ea2-1c99-4a0e-98f4-69d25ce9e4ad service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:04.005599 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-8585e580-24b1-47f3-9f9d-ee7f8b00eee9 req-2b702ea2-1c99-4a0e-98f4-69d25ce9e4ad service nova] Creating event network-changed:dd8fb1a0-4673-4433-af0e-9ceaff8681f5 for instance 90ed5f8e-9305-42db-8723-6fba63245605 on n-h1-826526-5 Jul 20 04:43:04.043935 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-8585e580-24b1-47f3-9f9d-ee7f8b00eee9 req-2b702ea2-1c99-4a0e-98f4-69d25ce9e4ad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103462 Jul 20 04:43:04.050318 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2396/5044] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:04.080697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fb6cfe67-98b8-418c-b039-cb4c7a6b6dbb tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:04.085309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fb6cfe67-98b8-418c-b039-cb4c7a6b6dbb tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:04.100418 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b4004df1-6c81-456e-aec7-e0b74b4634e7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "DELETE /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 204 len: 0 microversion: 2.1 time: 0.297453 Jul 20 04:43:04.101943 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2649/5045] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:43:03 2022] DELETE /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:43:04.103827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb6cfe67-98b8-418c-b039-cb4c7a6b6dbb tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:04.104532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb6cfe67-98b8-418c-b039-cb4c7a6b6dbb tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:04.111161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb6cfe67-98b8-418c-b039-cb4c7a6b6dbb tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:04.114151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb6cfe67-98b8-418c-b039-cb4c7a6b6dbb tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:04.120043 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-06b79d7d-db40-47f9-a8b7-5026883ab531 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:04.123640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-06b79d7d-db40-47f9-a8b7-5026883ab531 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:04.142326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06b79d7d-db40-47f9-a8b7-5026883ab531 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:04.144473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06b79d7d-db40-47f9-a8b7-5026883ab531 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:04.145768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06b79d7d-db40-47f9-a8b7-5026883ab531 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:04.148324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06b79d7d-db40-47f9-a8b7-5026883ab531 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:04.197541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:04.515307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fb6cfe67-98b8-418c-b039-cb4c7a6b6dbb tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:04.527376 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fb6cfe67-98b8-418c-b039-cb4c7a6b6dbb tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1168 microversion: 2.1 time: 0.465946 Jul 20 04:43:04.537916 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2397/5046] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:04 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1168 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:04.543998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ce3d9f73-7ec9-418a-8286-1347e5317d5b tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:04.544696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ce3d9f73-7ec9-418a-8286-1347e5317d5b tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:04.554434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce3d9f73-7ec9-418a-8286-1347e5317d5b tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:04.554796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce3d9f73-7ec9-418a-8286-1347e5317d5b tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:04.555581 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce3d9f73-7ec9-418a-8286-1347e5317d5b tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:04.556043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce3d9f73-7ec9-418a-8286-1347e5317d5b tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:04.653038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-06b79d7d-db40-47f9-a8b7-5026883ab531 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:04.666591 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-06b79d7d-db40-47f9-a8b7-5026883ab531 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1688 microversion: 2.1 time: 0.558962 Jul 20 04:43:04.680760 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2650/5047] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:04 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1688 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:04.816635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-50f5087d-2454-4498-bba8-0e4adeba950d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:04.822260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-50f5087d-2454-4498-bba8-0e4adeba950d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:04.829530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-50f5087d-2454-4498-bba8-0e4adeba950d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:04.842289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-50f5087d-2454-4498-bba8-0e4adeba950d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:04.843513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-50f5087d-2454-4498-bba8-0e4adeba950d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:04.844348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-50f5087d-2454-4498-bba8-0e4adeba950d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:04.959447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ce3d9f73-7ec9-418a-8286-1347e5317d5b tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:04.992242 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ce3d9f73-7ec9-418a-8286-1347e5317d5b tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.452298 Jul 20 04:43:04.994162 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2398/5048] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:04 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:05.012683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dbbb017f-9f61-43df-b83f-794dc8332419 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:05.014106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dbbb017f-9f61-43df-b83f-794dc8332419 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:05.057468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbbb017f-9f61-43df-b83f-794dc8332419 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:05.064367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbbb017f-9f61-43df-b83f-794dc8332419 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:05.068005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbbb017f-9f61-43df-b83f-794dc8332419 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:05.072514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbbb017f-9f61-43df-b83f-794dc8332419 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:06.062964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dbbb017f-9f61-43df-b83f-794dc8332419 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:06.113922 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dbbb017f-9f61-43df-b83f-794dc8332419 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 1.117575 Jul 20 04:43:06.122219 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2399/5049] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:04 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:06.149727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bc075671-d353-472a-8020-0f5f3f86fd99 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:06.154119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bc075671-d353-472a-8020-0f5f3f86fd99 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:06.181372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc075671-d353-472a-8020-0f5f3f86fd99 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:06.186005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc075671-d353-472a-8020-0f5f3f86fd99 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:06.191650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc075671-d353-472a-8020-0f5f3f86fd99 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:06.194955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc075671-d353-472a-8020-0f5f3f86fd99 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:06.567409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-50f5087d-2454-4498-bba8-0e4adeba950d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:06.576764 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-50f5087d-2454-4498-bba8-0e4adeba950d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1514 microversion: 2.1 time: 1.767569 Jul 20 04:43:06.588149 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2651/5050] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:04 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1514 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:06.607937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a69736e2-74b1-47d2-a6b6-1c0c46253b0b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:06.612069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a69736e2-74b1-47d2-a6b6-1c0c46253b0b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:06.638065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a69736e2-74b1-47d2-a6b6-1c0c46253b0b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:06.638722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a69736e2-74b1-47d2-a6b6-1c0c46253b0b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:06.640226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a69736e2-74b1-47d2-a6b6-1c0c46253b0b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:06.641527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a69736e2-74b1-47d2-a6b6-1c0c46253b0b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:06.673566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bc075671-d353-472a-8020-0f5f3f86fd99 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:06.682899 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bc075671-d353-472a-8020-0f5f3f86fd99 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1168 microversion: 2.1 time: 0.558965 Jul 20 04:43:06.684901 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2400/5051] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:06 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1168 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:06.710340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bde590d0-7d84-40d6-8784-b56e2199bf3f tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:06.711123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bde590d0-7d84-40d6-8784-b56e2199bf3f tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:06.759000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bde590d0-7d84-40d6-8784-b56e2199bf3f tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:06.759472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bde590d0-7d84-40d6-8784-b56e2199bf3f tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:06.760299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bde590d0-7d84-40d6-8784-b56e2199bf3f tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:06.760758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bde590d0-7d84-40d6-8784-b56e2199bf3f tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:07.099842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bde590d0-7d84-40d6-8784-b56e2199bf3f tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:07.120708 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bde590d0-7d84-40d6-8784-b56e2199bf3f tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.433717 Jul 20 04:43:07.123231 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2401/5052] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:06 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:07.139207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d9ad9264-d385-4a77-95bb-ab439db2d707 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:07.141165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d9ad9264-d385-4a77-95bb-ab439db2d707 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:07.161565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9ad9264-d385-4a77-95bb-ab439db2d707 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:07.162514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9ad9264-d385-4a77-95bb-ab439db2d707 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:07.163884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9ad9264-d385-4a77-95bb-ab439db2d707 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:07.164686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9ad9264-d385-4a77-95bb-ab439db2d707 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:07.489206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a69736e2-74b1-47d2-a6b6-1c0c46253b0b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:07.501792 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a69736e2-74b1-47d2-a6b6-1c0c46253b0b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 200 len: 1688 microversion: 2.1 time: 0.912439 Jul 20 04:43:07.514117 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2652/5053] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:06 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 1688 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:07.525951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d9ad9264-d385-4a77-95bb-ab439db2d707 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:07.548134 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d9ad9264-d385-4a77-95bb-ab439db2d707 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 0.416413 Jul 20 04:43:07.550105 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2402/5054] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:07 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:07.605831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-69fab298-f339-4ed8-86c1-145ab0dc4d86 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:07.608715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-69fab298-f339-4ed8-86c1-145ab0dc4d86 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:07.631877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-48775253-5101-4840-8c86-c85fbb99bad5 req-e524ea47-6d15-438e-a516-f6b6113dbd80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ed5f8e-9305-42db-8723-6fba63245605", "name": "network-vif-deleted", "tag": "dd8fb1a0-4673-4433-af0e-9ceaff8681f5"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:07.642783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-48775253-5101-4840-8c86-c85fbb99bad5 req-e524ea47-6d15-438e-a516-f6b6113dbd80 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:07.643871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-48775253-5101-4840-8c86-c85fbb99bad5 req-e524ea47-6d15-438e-a516-f6b6113dbd80 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:07.650004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69fab298-f339-4ed8-86c1-145ab0dc4d86 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:07.653108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69fab298-f339-4ed8-86c1-145ab0dc4d86 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:07.654224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69fab298-f339-4ed8-86c1-145ab0dc4d86 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:07.654946 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69fab298-f339-4ed8-86c1-145ab0dc4d86 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:07.658061 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-48775253-5101-4840-8c86-c85fbb99bad5 req-e524ea47-6d15-438e-a516-f6b6113dbd80 service nova] Creating event network-vif-deleted:dd8fb1a0-4673-4433-af0e-9ceaff8681f5 for instance 90ed5f8e-9305-42db-8723-6fba63245605 on n-h1-826526-5 Jul 20 04:43:07.665191 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-48775253-5101-4840-8c86-c85fbb99bad5 req-e524ea47-6d15-438e-a516-f6b6113dbd80 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039352 Jul 20 04:43:07.669983 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2403/5055] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:43:07.707466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e160b279-ab73-4f56-b4bb-4ce3153910ed tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:07.712421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e160b279-ab73-4f56-b4bb-4ce3153910ed tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:07.732965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e160b279-ab73-4f56-b4bb-4ce3153910ed tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:07.733445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e160b279-ab73-4f56-b4bb-4ce3153910ed tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:07.734300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e160b279-ab73-4f56-b4bb-4ce3153910ed tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:07.740348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e160b279-ab73-4f56-b4bb-4ce3153910ed tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:08.143790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-69fab298-f339-4ed8-86c1-145ab0dc4d86 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:08.172321 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-69fab298-f339-4ed8-86c1-145ab0dc4d86 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1514 microversion: 2.1 time: 0.572358 Jul 20 04:43:08.174121 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2653/5056] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:07 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1514 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:08.190986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d8ba5238-2c56-4a0f-8034-c9f88f5bc583 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:08.194017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d8ba5238-2c56-4a0f-8034-c9f88f5bc583 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:08.244188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8ba5238-2c56-4a0f-8034-c9f88f5bc583 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:08.248577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8ba5238-2c56-4a0f-8034-c9f88f5bc583 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:08.252612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8ba5238-2c56-4a0f-8034-c9f88f5bc583 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:08.259366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8ba5238-2c56-4a0f-8034-c9f88f5bc583 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:08.281516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e160b279-ab73-4f56-b4bb-4ce3153910ed tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:08.317776 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e160b279-ab73-4f56-b4bb-4ce3153910ed tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1168 microversion: 2.1 time: 0.619430 Jul 20 04:43:08.328325 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2404/5057] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:07 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1168 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:08.536855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f494e2fd-55f4-4739-be41-89b61186bcad tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:08.538084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f494e2fd-55f4-4739-be41-89b61186bcad tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 90ed5f8e-9305-42db-8723-6fba63245605] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:08.549776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f494e2fd-55f4-4739-be41-89b61186bcad tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:08.550875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f494e2fd-55f4-4739-be41-89b61186bcad tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:08.552140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f494e2fd-55f4-4739-be41-89b61186bcad tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:08.553111 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f494e2fd-55f4-4739-be41-89b61186bcad tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:08.556799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d8ba5238-2c56-4a0f-8034-c9f88f5bc583 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:08.570215 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d8ba5238-2c56-4a0f-8034-c9f88f5bc583 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.394565 Jul 20 04:43:08.571778 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-f494e2fd-55f4-4739-be41-89b61186bcad tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] HTTP exception thrown: Instance 90ed5f8e-9305-42db-8723-6fba63245605 could not be found. Jul 20 04:43:08.572723 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2654/5058] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:08 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f494e2fd-55f4-4739-be41-89b61186bcad tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Request method failure captured: Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 HTTP/1.1 Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14c5OmC7e7piHc62Oprmt58gJ43Ds2Gqro50k_jodCbcdTngwgD8D9bbOTQvC3Ba8WRVQD5lFU65LIKPn-I3EI2C2ZihLQJYKiEb4d5a-fdETDJHV4IJmro-RJ_S60NX-1yKHowzAlku6MRitdI9SUmpfigUaUfx-6x70eCIR240NVE Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: a678d19d82d248958a3d7df804ccfa95 Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-574298032 Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a678d19d82d248958a3d7df804ccfa95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a678d19d82d248958a3d7df804ccfa95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a678d19d82d248958a3d7df804ccfa95", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a678d19d82d248958a3d7df804ccfa95"}]}] Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestNetworkAdvancedServerOps-574298032 Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: a678d19d82d248958a3d7df804ccfa95 Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-574298032 Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestNetworkAdvancedServerOps-574298032-project Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: cffe347e0a094346afd74f178a0fde5d Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestNetworkAdvancedServerOps-574298032-project Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 90ed5f8e-9305-42db-8723-6fba63245605 could not be found. Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '90ed5f8e-9305-42db-8723-6fba63245605'} Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ed5f8e-9305-42db-8723-6fba63245605 could not be found. Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ed5f8e-9305-42db-8723-6fba63245605 could not be found. Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:08.582888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:43:08.587101 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:08.587101 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:08.587101 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:08.587101 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:43:08.587101 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:43:08.587101 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ed5f8e-9305-42db-8723-6fba63245605 could not be found. Jul 20 04:43:08.587101 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:43:08.589825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f494e2fd-55f4-4739-be41-89b61186bcad tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Returning 404 to user: Instance 90ed5f8e-9305-42db-8723-6fba63245605 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:43:08.591319 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f494e2fd-55f4-4739-be41-89b61186bcad tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605" status: 404 len: 111 microversion: 2.1 time: 0.071137 Jul 20 04:43:08.592384 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2405/5059] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:08 2022] GET /compute/v2.1/servers/90ed5f8e-9305-42db-8723-6fba63245605 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:43:08.636414 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7cb762cb-1b6c-4d70-8fe0-dbf0619ebb60 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:08.637167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7cb762cb-1b6c-4d70-8fe0-dbf0619ebb60 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:08.644156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7cb762cb-1b6c-4d70-8fe0-dbf0619ebb60 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:08.644642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7cb762cb-1b6c-4d70-8fe0-dbf0619ebb60 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:08.650148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7cb762cb-1b6c-4d70-8fe0-dbf0619ebb60 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:08.650616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7cb762cb-1b6c-4d70-8fe0-dbf0619ebb60 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:08.921935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7cb762cb-1b6c-4d70-8fe0-dbf0619ebb60 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:08.941979 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7cb762cb-1b6c-4d70-8fe0-dbf0619ebb60 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 0.337741 Jul 20 04:43:08.942648 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2655/5060] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:08 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:09.191987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1a02ebf2-241a-4bfa-a3db-f6c4dc259100 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:09.192642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1a02ebf2-241a-4bfa-a3db-f6c4dc259100 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:09.205300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1a02ebf2-241a-4bfa-a3db-f6c4dc259100 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:09.206420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1a02ebf2-241a-4bfa-a3db-f6c4dc259100 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:09.208053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1a02ebf2-241a-4bfa-a3db-f6c4dc259100 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:09.208846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1a02ebf2-241a-4bfa-a3db-f6c4dc259100 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:09.335281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c9870e47-6724-4c10-bb33-91a341424b2b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:09.336248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c9870e47-6724-4c10-bb33-91a341424b2b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:09.346288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9870e47-6724-4c10-bb33-91a341424b2b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:09.349136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9870e47-6724-4c10-bb33-91a341424b2b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:09.351564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9870e47-6724-4c10-bb33-91a341424b2b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:09.352289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9870e47-6724-4c10-bb33-91a341424b2b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:09.463912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1a02ebf2-241a-4bfa-a3db-f6c4dc259100 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:09.474966 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1a02ebf2-241a-4bfa-a3db-f6c4dc259100 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1514 microversion: 2.1 time: 0.286792 Jul 20 04:43:09.476401 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2406/5061] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:09 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1514 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:09.590935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-66cfa2c2-3675-44d1-b534-3d7deef115b4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:09.591628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-66cfa2c2-3675-44d1-b534-3d7deef115b4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:09.602822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66cfa2c2-3675-44d1-b534-3d7deef115b4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:09.603606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66cfa2c2-3675-44d1-b534-3d7deef115b4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:09.604447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66cfa2c2-3675-44d1-b534-3d7deef115b4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:09.604885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66cfa2c2-3675-44d1-b534-3d7deef115b4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:09.715150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c9870e47-6724-4c10-bb33-91a341424b2b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:09.726216 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c9870e47-6724-4c10-bb33-91a341424b2b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1168 microversion: 2.1 time: 0.395211 Jul 20 04:43:09.736133 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2656/5062] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:09 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1168 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:09.920251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-66cfa2c2-3675-44d1-b534-3d7deef115b4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:09.931701 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-66cfa2c2-3675-44d1-b534-3d7deef115b4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.346048 Jul 20 04:43:09.944061 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2407/5063] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:09 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:09.961936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1d3ea264-62fc-48e7-bb93-203551071987 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:09.962884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1d3ea264-62fc-48e7-bb93-203551071987 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:09.982566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d3ea264-62fc-48e7-bb93-203551071987 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:09.984141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d3ea264-62fc-48e7-bb93-203551071987 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:09.987953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d3ea264-62fc-48e7-bb93-203551071987 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:09.989144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d3ea264-62fc-48e7-bb93-203551071987 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:10.233223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1d3ea264-62fc-48e7-bb93-203551071987 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:10.243234 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1d3ea264-62fc-48e7-bb93-203551071987 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 0.287527 Jul 20 04:43:10.249035 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2657/5064] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:09 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:10.493462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7a4f9531-b473-4557-9127-e64d2ec61443 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:10.494796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7a4f9531-b473-4557-9127-e64d2ec61443 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:10.511046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a4f9531-b473-4557-9127-e64d2ec61443 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:10.511836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a4f9531-b473-4557-9127-e64d2ec61443 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:10.512863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a4f9531-b473-4557-9127-e64d2ec61443 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:10.515376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a4f9531-b473-4557-9127-e64d2ec61443 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:10.740217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7a4f9531-b473-4557-9127-e64d2ec61443 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:10.747289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0fe097d5-12b2-47f2-8e47-bc3f788bb210 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:10.747901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0fe097d5-12b2-47f2-8e47-bc3f788bb210 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:10.763139 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7a4f9531-b473-4557-9127-e64d2ec61443 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1520 microversion: 2.1 time: 0.274158 Jul 20 04:43:10.763746 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2408/5065] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:10 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:10.776633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0fe097d5-12b2-47f2-8e47-bc3f788bb210 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:10.777082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0fe097d5-12b2-47f2-8e47-bc3f788bb210 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:10.777868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0fe097d5-12b2-47f2-8e47-bc3f788bb210 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:10.781132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0fe097d5-12b2-47f2-8e47-bc3f788bb210 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:10.954111 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c4c05eaa-a2fd-4d82-af71-ba8e542623a6 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:10.956528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c4c05eaa-a2fd-4d82-af71-ba8e542623a6 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:10.966123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4c05eaa-a2fd-4d82-af71-ba8e542623a6 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:10.966970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4c05eaa-a2fd-4d82-af71-ba8e542623a6 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:10.967929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4c05eaa-a2fd-4d82-af71-ba8e542623a6 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:10.968476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4c05eaa-a2fd-4d82-af71-ba8e542623a6 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:11.263031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c4c05eaa-a2fd-4d82-af71-ba8e542623a6 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:11.282232 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c4c05eaa-a2fd-4d82-af71-ba8e542623a6 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.334549 Jul 20 04:43:11.297428 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2409/5066] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:10 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:11.310216 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7ccd3989-cc8b-4c50-bb5d-2bdf99f7f0c2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:11.313033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7ccd3989-cc8b-4c50-bb5d-2bdf99f7f0c2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:11.328046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ccd3989-cc8b-4c50-bb5d-2bdf99f7f0c2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:11.328859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ccd3989-cc8b-4c50-bb5d-2bdf99f7f0c2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:11.329915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ccd3989-cc8b-4c50-bb5d-2bdf99f7f0c2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:11.330560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ccd3989-cc8b-4c50-bb5d-2bdf99f7f0c2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:11.403904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0fe097d5-12b2-47f2-8e47-bc3f788bb210 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:11.428799 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0fe097d5-12b2-47f2-8e47-bc3f788bb210 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1168 microversion: 2.1 time: 0.685127 Jul 20 04:43:11.429710 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2658/5067] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:10 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1168 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:11.665107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7ccd3989-cc8b-4c50-bb5d-2bdf99f7f0c2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:11.680893 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7ccd3989-cc8b-4c50-bb5d-2bdf99f7f0c2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 0.381656 Jul 20 04:43:11.685568 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2410/5068] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:11 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:11.782357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-98a9f162-e3e1-4eb0-ad66-dd0d3cc283a5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:11.788538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-98a9f162-e3e1-4eb0-ad66-dd0d3cc283a5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:11.801258 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98a9f162-e3e1-4eb0-ad66-dd0d3cc283a5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:11.802027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98a9f162-e3e1-4eb0-ad66-dd0d3cc283a5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:11.803150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98a9f162-e3e1-4eb0-ad66-dd0d3cc283a5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:11.803960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98a9f162-e3e1-4eb0-ad66-dd0d3cc283a5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:12.130815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-98a9f162-e3e1-4eb0-ad66-dd0d3cc283a5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:12.150984 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-98a9f162-e3e1-4eb0-ad66-dd0d3cc283a5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1520 microversion: 2.1 time: 0.373622 Jul 20 04:43:12.165268 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2659/5069] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:11 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1520 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:12.301985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8be3bbb1-a512-421a-b9be-2727c323b4d4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:12.302603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8be3bbb1-a512-421a-b9be-2727c323b4d4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:12.309237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8be3bbb1-a512-421a-b9be-2727c323b4d4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:12.310062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8be3bbb1-a512-421a-b9be-2727c323b4d4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:12.311147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8be3bbb1-a512-421a-b9be-2727c323b4d4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:12.311808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8be3bbb1-a512-421a-b9be-2727c323b4d4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:12.461118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-673177ef-18f2-4499-99f8-6ca32e5bcbd6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:12.461746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-673177ef-18f2-4499-99f8-6ca32e5bcbd6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:12.479804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-673177ef-18f2-4499-99f8-6ca32e5bcbd6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:12.481009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-673177ef-18f2-4499-99f8-6ca32e5bcbd6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:12.482840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-673177ef-18f2-4499-99f8-6ca32e5bcbd6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:12.486129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-673177ef-18f2-4499-99f8-6ca32e5bcbd6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:12.588642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8be3bbb1-a512-421a-b9be-2727c323b4d4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:12.599042 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8be3bbb1-a512-421a-b9be-2727c323b4d4 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.301009 Jul 20 04:43:12.602881 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2411/5070] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:12 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:12.703637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-35f8a432-f580-402c-9010-fc149c9e048c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:12.704557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-35f8a432-f580-402c-9010-fc149c9e048c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:12.717582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35f8a432-f580-402c-9010-fc149c9e048c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:12.718161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35f8a432-f580-402c-9010-fc149c9e048c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:12.719115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35f8a432-f580-402c-9010-fc149c9e048c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:12.719561 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35f8a432-f580-402c-9010-fc149c9e048c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:12.734581 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:12.821459 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-673177ef-18f2-4499-99f8-6ca32e5bcbd6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:12.835475 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-673177ef-18f2-4499-99f8-6ca32e5bcbd6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1168 microversion: 2.1 time: 0.392246 Jul 20 04:43:12.846296 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2660/5071] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:12 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1168 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:13.007591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-35f8a432-f580-402c-9010-fc149c9e048c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:13.021361 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-35f8a432-f580-402c-9010-fc149c9e048c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 0.319018 Jul 20 04:43:13.022780 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2412/5072] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:12 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:13.170850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3347dc11-1e41-40dd-8ca5-e2232b56cd43 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:13.172410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3347dc11-1e41-40dd-8ca5-e2232b56cd43 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:13.204486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3347dc11-1e41-40dd-8ca5-e2232b56cd43 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:13.204978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3347dc11-1e41-40dd-8ca5-e2232b56cd43 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:13.205816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3347dc11-1e41-40dd-8ca5-e2232b56cd43 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:13.211872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3347dc11-1e41-40dd-8ca5-e2232b56cd43 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:13.583778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3347dc11-1e41-40dd-8ca5-e2232b56cd43 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:13.598068 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3347dc11-1e41-40dd-8ca5-e2232b56cd43 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1520 microversion: 2.1 time: 0.430710 Jul 20 04:43:13.599502 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2661/5073] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:13 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1520 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:13.623838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4d7e07eb-88ae-4a5f-ba8e-50ea6d409662 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:13.624915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4d7e07eb-88ae-4a5f-ba8e-50ea6d409662 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:13.636006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d7e07eb-88ae-4a5f-ba8e-50ea6d409662 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:13.637841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d7e07eb-88ae-4a5f-ba8e-50ea6d409662 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:13.639255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d7e07eb-88ae-4a5f-ba8e-50ea6d409662 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:13.639951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d7e07eb-88ae-4a5f-ba8e-50ea6d409662 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:13.782029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-6082aa02-2ab6-4245-b968-8ca2f5c1388e req-c52f4381-492d-4913-9ac7-d8289258f562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29abf8ce-3972-49b8-aeb8-8219f13fe72c", "name": "network-vif-plugged", "status": "completed", "tag": "1b7244c0-c701-4206-8504-7d91a71ca612"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:13.794332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-6082aa02-2ab6-4245-b968-8ca2f5c1388e req-c52f4381-492d-4913-9ac7-d8289258f562 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:13.800365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-6082aa02-2ab6-4245-b968-8ca2f5c1388e req-c52f4381-492d-4913-9ac7-d8289258f562 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:13.830828 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-6082aa02-2ab6-4245-b968-8ca2f5c1388e req-c52f4381-492d-4913-9ac7-d8289258f562 service nova] Creating event network-vif-plugged:1b7244c0-c701-4206-8504-7d91a71ca612 for instance 29abf8ce-3972-49b8-aeb8-8219f13fe72c on n-h2-826526-5 Jul 20 04:43:13.844016 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-6082aa02-2ab6-4245-b968-8ca2f5c1388e req-c52f4381-492d-4913-9ac7-d8289258f562 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065577 Jul 20 04:43:13.849305 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2662/5074] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:13.865429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c7f7bec2-3b64-4b42-891b-61bbf5d063d1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:13.866174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c7f7bec2-3b64-4b42-891b-61bbf5d063d1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:13.893354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7f7bec2-3b64-4b42-891b-61bbf5d063d1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:13.898102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7f7bec2-3b64-4b42-891b-61bbf5d063d1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:13.900346 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7f7bec2-3b64-4b42-891b-61bbf5d063d1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:13.901493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7f7bec2-3b64-4b42-891b-61bbf5d063d1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:14.199946 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c7f7bec2-3b64-4b42-891b-61bbf5d063d1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:14.213536 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c7f7bec2-3b64-4b42-891b-61bbf5d063d1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1168 microversion: 2.1 time: 0.362197 Jul 20 04:43:14.214606 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2663/5075] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:13 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1168 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:14.227750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e768fec9-6319-425b-9f87-6be1cfbf65be tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:14.230327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e768fec9-6319-425b-9f87-6be1cfbf65be tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:14.242789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4d7e07eb-88ae-4a5f-ba8e-50ea6d409662 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:14.247808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e768fec9-6319-425b-9f87-6be1cfbf65be tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:14.249613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e768fec9-6319-425b-9f87-6be1cfbf65be tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:14.253605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e768fec9-6319-425b-9f87-6be1cfbf65be tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:14.254603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e768fec9-6319-425b-9f87-6be1cfbf65be tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:14.257772 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4d7e07eb-88ae-4a5f-ba8e-50ea6d409662 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.640818 Jul 20 04:43:14.259919 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2413/5076] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:13 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:14.549226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e768fec9-6319-425b-9f87-6be1cfbf65be tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:14.571864 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e768fec9-6319-425b-9f87-6be1cfbf65be tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 0.352124 Jul 20 04:43:14.579343 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2664/5077] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:14 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:14.618855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6849163d-f607-4af4-a438-edd918ee19fb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:14.619746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6849163d-f607-4af4-a438-edd918ee19fb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:14.628851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6849163d-f607-4af4-a438-edd918ee19fb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:14.630012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6849163d-f607-4af4-a438-edd918ee19fb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:14.632773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6849163d-f607-4af4-a438-edd918ee19fb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:14.633784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6849163d-f607-4af4-a438-edd918ee19fb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:15.005850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6849163d-f607-4af4-a438-edd918ee19fb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:15.022237 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6849163d-f607-4af4-a438-edd918ee19fb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1520 microversion: 2.1 time: 0.409109 Jul 20 04:43:15.034532 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2414/5078] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:14 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1520 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:15.235413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3baa55b1-f5e5-4b1d-8146-66496776d852 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:15.236640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3baa55b1-f5e5-4b1d-8146-66496776d852 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:15.245356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9db444b0-29ba-4a72-b512-5529f18be794 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '.version_select at 0x7f06bd537820>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:15.259113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3baa55b1-f5e5-4b1d-8146-66496776d852 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:15.259586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3baa55b1-f5e5-4b1d-8146-66496776d852 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:15.261763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3baa55b1-f5e5-4b1d-8146-66496776d852 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:15.264543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3baa55b1-f5e5-4b1d-8146-66496776d852 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:15.314019 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9db444b0-29ba-4a72-b512-5529f18be794 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1236622447" status: 202 len: 0 microversion: 2.1 time: 0.078914 Jul 20 04:43:15.317933 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2415/5079] 10.222.0.17 () {58 vars in 1283 bytes} [Wed Jul 20 04:43:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1236622447 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:43:15.350999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ab248971-12a9-4360-8a3a-2d0ce7fa6392 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:15.351621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ab248971-12a9-4360-8a3a-2d0ce7fa6392 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:15.381136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:15.386618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab248971-12a9-4360-8a3a-2d0ce7fa6392 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:15.390587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab248971-12a9-4360-8a3a-2d0ce7fa6392 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:15.394691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab248971-12a9-4360-8a3a-2d0ce7fa6392 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:15.396470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab248971-12a9-4360-8a3a-2d0ce7fa6392 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:15.452632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3baa55b1-f5e5-4b1d-8146-66496776d852 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:15.462626 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3baa55b1-f5e5-4b1d-8146-66496776d852 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1168 microversion: 2.1 time: 0.234698 Jul 20 04:43:15.474523 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2665/5080] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:15 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1168 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:15.480818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0719fbf3-b736-4dcd-b0dc-557936d0dc2d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'create', calling method: .version_select at 0x7f06be72fc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-467804541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1JHTGPnvjqvAMJv+r2wpvaqe4iHhnFGUdA6us7jZC4+9af7gqX91DZxK/ICFIGCJd/JzKLzTDLP3GdOBR3IiCX6szvSFr5bg3jw5HXhGU6LOw6EHi6jrBSFcBJ7jLoNw=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:15.499066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-0719fbf3-b736-4dcd-b0dc-557936d0dc2d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Getting quotas for project a678d19d82d248958a3d7df804ccfa95. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:43:15.505887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-0719fbf3-b736-4dcd-b0dc-557936d0dc2d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Getting quotas for user cffe347e0a094346afd74f178a0fde5d and project a678d19d82d248958a3d7df804ccfa95. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:43:15.537331 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0719fbf3-b736-4dcd-b0dc-557936d0dc2d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.060777 Jul 20 04:43:15.553261 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2666/5081] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:43:15 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:15.599366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-005abf04-95f6-482b-9ad1-57da5b35595b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:15.600057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-005abf04-95f6-482b-9ad1-57da5b35595b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:15.616807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-005abf04-95f6-482b-9ad1-57da5b35595b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:15.616807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-005abf04-95f6-482b-9ad1-57da5b35595b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:15.617365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-005abf04-95f6-482b-9ad1-57da5b35595b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:15.617978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-005abf04-95f6-482b-9ad1-57da5b35595b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:15.732101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ab248971-12a9-4360-8a3a-2d0ce7fa6392 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:15.740802 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ab248971-12a9-4360-8a3a-2d0ce7fa6392 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.421190 Jul 20 04:43:15.741429 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2416/5082] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:15 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:15.861017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-005abf04-95f6-482b-9ad1-57da5b35595b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:15.870871 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-005abf04-95f6-482b-9ad1-57da5b35595b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 0.277539 Jul 20 04:43:15.872071 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2667/5083] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:15 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:16.049003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6f09d2cf-b4fe-42a3-ba5e-0e622673b2fb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:16.050912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6f09d2cf-b4fe-42a3-ba5e-0e622673b2fb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:16.051212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-480d557a-12e1-4125-8072-3900122712e5 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:16.053107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-480d557a-12e1-4125-8072-3900122712e5 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:16.067880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f09d2cf-b4fe-42a3-ba5e-0e622673b2fb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:16.070685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-480d557a-12e1-4125-8072-3900122712e5 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:16.071543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f09d2cf-b4fe-42a3-ba5e-0e622673b2fb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:16.072819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f09d2cf-b4fe-42a3-ba5e-0e622673b2fb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:16.078187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f09d2cf-b4fe-42a3-ba5e-0e622673b2fb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:16.080739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-480d557a-12e1-4125-8072-3900122712e5 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:16.082366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-480d557a-12e1-4125-8072-3900122712e5 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:16.086428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-480d557a-12e1-4125-8072-3900122712e5 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:16.213721 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-480d557a-12e1-4125-8072-3900122712e5 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "POST /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16/action" status: 200 len: 24570 microversion: 2.1 time: 0.172455 Jul 20 04:43:16.215475 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2668/5084] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:43:16 2022] POST /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16/action => generated 24570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:43:16.321760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6f09d2cf-b4fe-42a3-ba5e-0e622673b2fb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:16.334147 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6f09d2cf-b4fe-42a3-ba5e-0e622673b2fb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1505 microversion: 2.1 time: 0.297689 Jul 20 04:43:16.335401 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2417/5085] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:16 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:16.355583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b779aae4-80ce-4341-aee7-5cdfa88fba64 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:16.358558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b779aae4-80ce-4341-aee7-5cdfa88fba64 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:16.369488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b779aae4-80ce-4341-aee7-5cdfa88fba64 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:16.370437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b779aae4-80ce-4341-aee7-5cdfa88fba64 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:16.371341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b779aae4-80ce-4341-aee7-5cdfa88fba64 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:16.371909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b779aae4-80ce-4341-aee7-5cdfa88fba64 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:16.377956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:16.481106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ae8512f3-7061-48d4-bfbb-42eff7bb0f9d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:16.481747 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ae8512f3-7061-48d4-bfbb-42eff7bb0f9d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:16.495931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae8512f3-7061-48d4-bfbb-42eff7bb0f9d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:16.497769 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae8512f3-7061-48d4-bfbb-42eff7bb0f9d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:16.502364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae8512f3-7061-48d4-bfbb-42eff7bb0f9d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:16.506325 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae8512f3-7061-48d4-bfbb-42eff7bb0f9d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:16.571064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b779aae4-80ce-4341-aee7-5cdfa88fba64 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:16.583577 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b779aae4-80ce-4341-aee7-5cdfa88fba64 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 200 len: 1505 microversion: 2.1 time: 0.233477 Jul 20 04:43:16.584640 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2669/5086] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:16 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 1505 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:16.603021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dad9068e-3d86-40a0-8bc3-ad72c2d4b83c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:16.603791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dad9068e-3d86-40a0-8bc3-ad72c2d4b83c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:16.630463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dad9068e-3d86-40a0-8bc3-ad72c2d4b83c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:16.631166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dad9068e-3d86-40a0-8bc3-ad72c2d4b83c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:16.632019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dad9068e-3d86-40a0-8bc3-ad72c2d4b83c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:16.632494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dad9068e-3d86-40a0-8bc3-ad72c2d4b83c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:16.665846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dad9068e-3d86-40a0-8bc3-ad72c2d4b83c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:43:16.770865 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dad9068e-3d86-40a0-8bc3-ad72c2d4b83c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "DELETE /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 204 len: 0 microversion: 2.1 time: 0.170828 Jul 20 04:43:16.773164 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2670/5087] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:43:16 2022] DELETE /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:43:16.799028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2e523cd3-92cd-42ef-bf86-81b8cf0fc252 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:16.801062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2e523cd3-92cd-42ef-bf86-81b8cf0fc252 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:16.810832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e523cd3-92cd-42ef-bf86-81b8cf0fc252 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:16.811660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e523cd3-92cd-42ef-bf86-81b8cf0fc252 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:16.812689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e523cd3-92cd-42ef-bf86-81b8cf0fc252 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:16.813300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e523cd3-92cd-42ef-bf86-81b8cf0fc252 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:16.994290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2e523cd3-92cd-42ef-bf86-81b8cf0fc252 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:17.005504 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2e523cd3-92cd-42ef-bf86-81b8cf0fc252 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.230680 Jul 20 04:43:17.006671 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2671/5088] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:16 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:17.012820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f2f831b0-8ed0-461a-85c4-d09e59f3c6cf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:17.013701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f2f831b0-8ed0-461a-85c4-d09e59f3c6cf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:17.021889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2f831b0-8ed0-461a-85c4-d09e59f3c6cf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:17.022752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2f831b0-8ed0-461a-85c4-d09e59f3c6cf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:17.023858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2f831b0-8ed0-461a-85c4-d09e59f3c6cf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:17.025203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2f831b0-8ed0-461a-85c4-d09e59f3c6cf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:17.232775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f2f831b0-8ed0-461a-85c4-d09e59f3c6cf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:17.242973 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f2f831b0-8ed0-461a-85c4-d09e59f3c6cf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1735 microversion: 2.1 time: 0.234329 Jul 20 04:43:17.244110 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2672/5089] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:17 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:17.256384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f98d5129-68dc-4865-b76d-4a8d794bd765 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-217653556", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "74637077-d0a9-4590-b4c3-611177f1dfda"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:17.325824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-f98d5129-68dc-4865-b76d-4a8d794bd765 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] validate_networks() for [('74637077-d0a9-4590-b4c3-611177f1dfda', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:43:17.515805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ae8512f3-7061-48d4-bfbb-42eff7bb0f9d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:17.532041 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ae8512f3-7061-48d4-bfbb-42eff7bb0f9d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1168 microversion: 2.1 time: 1.055568 Jul 20 04:43:17.540796 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2418/5090] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:16 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1168 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:18.025189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-36099ea8-7c9a-41db-b870-1030f17dfd68 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:18.026433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-36099ea8-7c9a-41db-b870-1030f17dfd68 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:18.045959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36099ea8-7c9a-41db-b870-1030f17dfd68 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:18.046436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36099ea8-7c9a-41db-b870-1030f17dfd68 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:18.050576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36099ea8-7c9a-41db-b870-1030f17dfd68 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:18.051414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36099ea8-7c9a-41db-b870-1030f17dfd68 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:18.162820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f98d5129-68dc-4865-b76d-4a8d794bd765 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:43:18.163918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f98d5129-68dc-4865-b76d-4a8d794bd765 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:43:18.164430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f98d5129-68dc-4865-b76d-4a8d794bd765 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:43:18.165063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f98d5129-68dc-4865-b76d-4a8d794bd765 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:43:18.165662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f98d5129-68dc-4865-b76d-4a8d794bd765 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:43:18.176894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f98d5129-68dc-4865-b76d-4a8d794bd765 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:18.177751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f98d5129-68dc-4865-b76d-4a8d794bd765 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:18.178983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f98d5129-68dc-4865-b76d-4a8d794bd765 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:18.179763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f98d5129-68dc-4865-b76d-4a8d794bd765 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:18.205896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-f98d5129-68dc-4865-b76d-4a8d794bd765 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Getting quotas for project c445f8434bd0407c8ea69b8aeed234be. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:43:18.234570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-f98d5129-68dc-4865-b76d-4a8d794bd765 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Getting quotas for user 336e0b9a90f94c0d9337fe6e8a1727f1 and project c445f8434bd0407c8ea69b8aeed234be. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:43:18.266026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f98d5129-68dc-4865-b76d-4a8d794bd765 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:43:18.269384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f98d5129-68dc-4865-b76d-4a8d794bd765 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:43:18.324128 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f98d5129-68dc-4865-b76d-4a8d794bd765 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.078121 Jul 20 04:43:18.325800 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2673/5091] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:43:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:43:18.340423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0a76429a-cb00-449c-b70a-31aa68dacb9f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:18.343146 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0a76429a-cb00-449c-b70a-31aa68dacb9f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:18.361281 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-36099ea8-7c9a-41db-b870-1030f17dfd68 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:18.365406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a76429a-cb00-449c-b70a-31aa68dacb9f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:18.366238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a76429a-cb00-449c-b70a-31aa68dacb9f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:18.368557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a76429a-cb00-449c-b70a-31aa68dacb9f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:18.371178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a76429a-cb00-449c-b70a-31aa68dacb9f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:18.383297 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-36099ea8-7c9a-41db-b870-1030f17dfd68 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.363739 Jul 20 04:43:18.398965 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2419/5092] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:18 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:18.417813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6044a3e4-509c-41ab-9b4a-f2aca40fae42 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:18.418839 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6044a3e4-509c-41ab-9b4a-f2aca40fae42 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:18.549919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6044a3e4-509c-41ab-9b4a-f2aca40fae42 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:18.568781 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6044a3e4-509c-41ab-9b4a-f2aca40fae42 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1217 microversion: 2.1 time: 0.165488 Jul 20 04:43:18.578832 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2420/5093] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:18 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:18.578832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-75249ed9-2b14-4429-a6ae-45cf6d0f06c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:18.578832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-75249ed9-2b14-4429-a6ae-45cf6d0f06c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:18.582194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75249ed9-2b14-4429-a6ae-45cf6d0f06c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:18.582418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75249ed9-2b14-4429-a6ae-45cf6d0f06c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:18.584333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75249ed9-2b14-4429-a6ae-45cf6d0f06c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:18.584961 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75249ed9-2b14-4429-a6ae-45cf6d0f06c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:18.715960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0a76429a-cb00-449c-b70a-31aa68dacb9f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:18.732220 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0a76429a-cb00-449c-b70a-31aa68dacb9f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1715 microversion: 2.1 time: 0.404895 Jul 20 04:43:18.732970 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2674/5094] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:18 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1715 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:18.986624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4e494702-19f1-4f67-9dd1-a4aec860bd1c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:18.987364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4e494702-19f1-4f67-9dd1-a4aec860bd1c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:19.010760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e494702-19f1-4f67-9dd1-a4aec860bd1c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:19.012713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e494702-19f1-4f67-9dd1-a4aec860bd1c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:19.015018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e494702-19f1-4f67-9dd1-a4aec860bd1c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:19.020027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e494702-19f1-4f67-9dd1-a4aec860bd1c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:19.193719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-75249ed9-2b14-4429-a6ae-45cf6d0f06c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:19.225098 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-75249ed9-2b14-4429-a6ae-45cf6d0f06c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1168 microversion: 2.1 time: 0.653949 Jul 20 04:43:19.227865 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2421/5095] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:18 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1168 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:19.295726 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-4e494702-19f1-4f67-9dd1-a4aec860bd1c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] HTTP exception thrown: Cannot 'detach_volume' instance 085f0971-9269-4d32-8eeb-17e7bf8143c2 while it is in vm_state rescued Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4e494702-19f1-4f67-9dd1-a4aec860bd1c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Request method failure captured: Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments/a55ea126-06ab-4140-ae38-1c5c5a29411c HTTP/1.1 Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14cCAXHTn9-xjP9-j6Y5H3QclpCYHsqBLpRpQihoTalzGkb0NJB3tQRrqwgEU6RYcb1rSLMpRe6OHLIl_vuXQ5sxjCNslRe7DUQ3JshdANU3fqjJB1ce8j9t6r_FeEMPekMuZI1SQ7JdDTpAgLs_ZRs_OCOFW6Xgy06EebnWW58puJk Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 3e123ad99de64f50b9cd4373597c3a9e Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3e123ad99de64f50b9cd4373597c3a9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3e123ad99de64f50b9cd4373597c3a9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3e123ad99de64f50b9cd4373597c3a9e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3e123ad99de64f50b9cd4373597c3a9e"}]}] Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 3e123ad99de64f50b9cd4373597c3a9e Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerRescueNegativeTestJSON-810656662-project Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 8ea213e79bcf4aaea49446db5eb55271 Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerRescueNegativeTestJSON-810656662-project Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: exception: Cannot 'detach_volume' instance 085f0971-9269-4d32-8eeb-17e7bf8143c2 while it is in vm_state rescued Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'server_id': '085f0971-9269-4d32-8eeb-17e7bf8143c2', 'id': 'a55ea126-06ab-4140-ae38-1c5c5a29411c'} Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 085f0971-9269-4d32-8eeb-17e7bf8143c2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 085f0971-9269-4d32-8eeb-17e7bf8143c2 while it is in vm_state rescued Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:43:19.300107 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:19.304879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:19.304879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:19.304879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:43:19.304879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:43:19.304879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 085f0971-9269-4d32-8eeb-17e7bf8143c2 while it is in vm_state rescued Jul 20 04:43:19.304879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:43:19.304879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4e494702-19f1-4f67-9dd1-a4aec860bd1c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Returning 409 to user: Cannot 'detach_volume' instance 085f0971-9269-4d32-8eeb-17e7bf8143c2 while it is in vm_state rescued {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:43:19.306024 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4e494702-19f1-4f67-9dd1-a4aec860bd1c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "DELETE /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments/a55ea126-06ab-4140-ae38-1c5c5a29411c" status: 409 len: 152 microversion: 2.1 time: 0.322609 Jul 20 04:43:19.308419 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2675/5096] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 04:43:18 2022] DELETE /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments/a55ea126-06ab-4140-ae38-1c5c5a29411c => generated 152 bytes in 327 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:43:19.320069 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e4061e64-d166-4483-8185-8b11c4933404 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:19.320772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e4061e64-d166-4483-8185-8b11c4933404 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:19.330515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4061e64-d166-4483-8185-8b11c4933404 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:19.338913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4061e64-d166-4483-8185-8b11c4933404 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:19.338913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4061e64-d166-4483-8185-8b11c4933404 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:19.338913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4061e64-d166-4483-8185-8b11c4933404 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:19.415036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-df77c251-1f34-47cc-9873-d18a955080ea tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:19.416220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-df77c251-1f34-47cc-9873-d18a955080ea tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:19.437522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df77c251-1f34-47cc-9873-d18a955080ea tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:19.440875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df77c251-1f34-47cc-9873-d18a955080ea tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:19.442994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df77c251-1f34-47cc-9873-d18a955080ea tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:19.447095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df77c251-1f34-47cc-9873-d18a955080ea tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:19.513391 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e4061e64-d166-4483-8185-8b11c4933404 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "POST /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/action" status: 202 len: 0 microversion: 2.1 time: 0.197937 Jul 20 04:43:19.525135 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2422/5097] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:43:19 2022] POST /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:43:19.533712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4a90d2d3-863d-46fc-b186-e03be36f64ea tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:19.534753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4a90d2d3-863d-46fc-b186-e03be36f64ea tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:19.546461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a90d2d3-863d-46fc-b186-e03be36f64ea tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:19.547302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a90d2d3-863d-46fc-b186-e03be36f64ea tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:19.548414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a90d2d3-863d-46fc-b186-e03be36f64ea tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:19.551911 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a90d2d3-863d-46fc-b186-e03be36f64ea tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:19.848353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-df77c251-1f34-47cc-9873-d18a955080ea tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:19.867204 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-df77c251-1f34-47cc-9873-d18a955080ea tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1522 microversion: 2.1 time: 0.455811 Jul 20 04:43:19.868410 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2676/5098] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:19 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:19.882889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c98891e4-2467-4530-89ff-d0d7daf73d68 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:19.884632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c98891e4-2467-4530-89ff-d0d7daf73d68 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:19.895133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c98891e4-2467-4530-89ff-d0d7daf73d68 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:19.895583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c98891e4-2467-4530-89ff-d0d7daf73d68 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:19.896455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c98891e4-2467-4530-89ff-d0d7daf73d68 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:19.896896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c98891e4-2467-4530-89ff-d0d7daf73d68 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:20.073694 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4a90d2d3-863d-46fc-b186-e03be36f64ea tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:20.076611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c98891e4-2467-4530-89ff-d0d7daf73d68 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:20.082145 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4a90d2d3-863d-46fc-b186-e03be36f64ea tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1723 microversion: 2.1 time: 0.552504 Jul 20 04:43:20.089871 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2423/5099] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:19 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1723 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:20.096575 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c98891e4-2467-4530-89ff-d0d7daf73d68 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1269 microversion: 2.1 time: 0.226637 Jul 20 04:43:20.097237 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2677/5100] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:19 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1269 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:20.140981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-a6be0cca-4272-4f2d-9693-d6add3e79450 req-35af0ada-2c32-4834-a500-1189aca67208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29abf8ce-3972-49b8-aeb8-8219f13fe72c", "name": "network-vif-deleted", "tag": "1b7244c0-c701-4206-8504-7d91a71ca612"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:20.157503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a6be0cca-4272-4f2d-9693-d6add3e79450 req-35af0ada-2c32-4834-a500-1189aca67208 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:20.158253 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a6be0cca-4272-4f2d-9693-d6add3e79450 req-35af0ada-2c32-4834-a500-1189aca67208 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:20.183669 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-a6be0cca-4272-4f2d-9693-d6add3e79450 req-35af0ada-2c32-4834-a500-1189aca67208 service nova] Creating event network-vif-deleted:1b7244c0-c701-4206-8504-7d91a71ca612 for instance 29abf8ce-3972-49b8-aeb8-8219f13fe72c on n-h2-826526-5 Jul 20 04:43:20.201002 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-a6be0cca-4272-4f2d-9693-d6add3e79450 req-35af0ada-2c32-4834-a500-1189aca67208 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063679 Jul 20 04:43:20.202139 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2424/5101] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:43:20.245276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3c792325-e864-4a7e-b509-b8c97565ebba tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:20.246592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3c792325-e864-4a7e-b509-b8c97565ebba tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:20.259385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:20.265777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c792325-e864-4a7e-b509-b8c97565ebba tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:20.268153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c792325-e864-4a7e-b509-b8c97565ebba tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:20.271394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c792325-e864-4a7e-b509-b8c97565ebba tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:20.275348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c792325-e864-4a7e-b509-b8c97565ebba tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:20.636982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3c792325-e864-4a7e-b509-b8c97565ebba tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:20.650342 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3c792325-e864-4a7e-b509-b8c97565ebba tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1214 microversion: 2.1 time: 0.405540 Jul 20 04:43:20.651176 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2678/5102] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:20 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1214 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:20.889707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3c920db3-bf31-418a-9819-4fdcc7fc8e2b tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:20.891490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3c920db3-bf31-418a-9819-4fdcc7fc8e2b tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:20.905023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c920db3-bf31-418a-9819-4fdcc7fc8e2b tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:20.905568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c920db3-bf31-418a-9819-4fdcc7fc8e2b tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:20.906360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c920db3-bf31-418a-9819-4fdcc7fc8e2b tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:20.906797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c920db3-bf31-418a-9819-4fdcc7fc8e2b tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:21.106640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a9f002d3-7da6-421f-b418-6b96813c1ab9 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:21.107261 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a9f002d3-7da6-421f-b418-6b96813c1ab9 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:21.116168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9f002d3-7da6-421f-b418-6b96813c1ab9 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:21.116651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9f002d3-7da6-421f-b418-6b96813c1ab9 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:21.117446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9f002d3-7da6-421f-b418-6b96813c1ab9 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:21.117887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9f002d3-7da6-421f-b418-6b96813c1ab9 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:21.435056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a9f002d3-7da6-421f-b418-6b96813c1ab9 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:21.453366 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a9f002d3-7da6-421f-b418-6b96813c1ab9 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1723 microversion: 2.1 time: 0.350592 Jul 20 04:43:21.454587 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2679/5103] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:21 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1723 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:21.460103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f62cf97c-1dc9-48a1-8cd6-bad664f867ed tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:21.461089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f62cf97c-1dc9-48a1-8cd6-bad664f867ed tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:21.467598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f62cf97c-1dc9-48a1-8cd6-bad664f867ed tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:21.468386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f62cf97c-1dc9-48a1-8cd6-bad664f867ed tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:21.469487 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f62cf97c-1dc9-48a1-8cd6-bad664f867ed tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:21.470152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f62cf97c-1dc9-48a1-8cd6-bad664f867ed tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:21.512462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3c920db3-bf31-418a-9819-4fdcc7fc8e2b tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:21.523837 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3c920db3-bf31-418a-9819-4fdcc7fc8e2b tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1502 microversion: 2.1 time: 0.641802 Jul 20 04:43:21.536299 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2425/5104] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:20 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1502 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:21.541862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bff5a77a-65fe-4288-8263-8d183746f125 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Action: 'create', calling method: .version_select at 0x7f06bd26f700>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1031176498", "description": "tempest-description-565112748"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:21.557183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f62cf97c-1dc9-48a1-8cd6-bad664f867ed tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:21.566198 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f62cf97c-1dc9-48a1-8cd6-bad664f867ed tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1275 microversion: 2.1 time: 0.110030 Jul 20 04:43:21.566847 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2680/5105] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:21 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1275 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:21.668455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f4b2a570-ff6a-4522-a4a1-9ecf40d1858d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:21.670737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f4b2a570-ff6a-4522-a4a1-9ecf40d1858d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:21.687161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4b2a570-ff6a-4522-a4a1-9ecf40d1858d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:21.688559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4b2a570-ff6a-4522-a4a1-9ecf40d1858d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:21.689751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4b2a570-ff6a-4522-a4a1-9ecf40d1858d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:21.690603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4b2a570-ff6a-4522-a4a1-9ecf40d1858d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:21.918482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f4b2a570-ff6a-4522-a4a1-9ecf40d1858d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:21.929538 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f4b2a570-ff6a-4522-a4a1-9ecf40d1858d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1202 microversion: 2.1 time: 0.266122 Jul 20 04:43:21.930063 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2681/5106] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:21 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1202 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:22.234294 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bff5a77a-65fe-4288-8263-8d183746f125 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.696332 Jul 20 04:43:22.235033 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2426/5107] 10.222.0.17 () {60 vars in 1179 bytes} [Wed Jul 20 04:43:21 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:43:22.247123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-249f3452-4934-44aa-bc18-da41de9de947 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1031176498"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:22.247462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-249f3452-4934-44aa-bc18-da41de9de947 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:22.258798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-249f3452-4934-44aa-bc18-da41de9de947 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:22.259482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-249f3452-4934-44aa-bc18-da41de9de947 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:22.260481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-249f3452-4934-44aa-bc18-da41de9de947 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:22.265733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-249f3452-4934-44aa-bc18-da41de9de947 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:22.444019 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.network.security_group_api [None req-249f3452-4934-44aa-bc18-da41de9de947 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Adding security group c6dfb0ae-cae6-4caf-88cd-0f815f518c08 to port 6a873c5d-6855-410c-9be1-c768a125054e Jul 20 04:43:22.475814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-80bf1b2b-4f07-4c93-8b23-e64cc1f0a400 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:22.476926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-80bf1b2b-4f07-4c93-8b23-e64cc1f0a400 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:22.493208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80bf1b2b-4f07-4c93-8b23-e64cc1f0a400 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:22.493812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80bf1b2b-4f07-4c93-8b23-e64cc1f0a400 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:22.494744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80bf1b2b-4f07-4c93-8b23-e64cc1f0a400 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:22.495737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80bf1b2b-4f07-4c93-8b23-e64cc1f0a400 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:23.064802 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-249f3452-4934-44aa-bc18-da41de9de947 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "POST /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783/action" status: 202 len: 0 microversion: 2.1 time: 0.821980 Jul 20 04:43:23.070362 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2682/5108] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:43:22 2022] POST /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783/action => generated 0 bytes in 828 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:43:23.089798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e5d5c2c1-a3f0-4ec8-940c-8a40729f82ce tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:23.095353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e5d5c2c1-a3f0-4ec8-940c-8a40729f82ce tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:23.125942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5d5c2c1-a3f0-4ec8-940c-8a40729f82ce tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:23.129035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5d5c2c1-a3f0-4ec8-940c-8a40729f82ce tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:23.133172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5d5c2c1-a3f0-4ec8-940c-8a40729f82ce tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:23.137919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5d5c2c1-a3f0-4ec8-940c-8a40729f82ce tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:23.432982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e5d5c2c1-a3f0-4ec8-940c-8a40729f82ce tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:23.444628 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e5d5c2c1-a3f0-4ec8-940c-8a40729f82ce tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1317 microversion: 2.1 time: 0.372723 Jul 20 04:43:23.445822 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2683/5109] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:23 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:23.452942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fd3db692-0380-4489-a2fb-e17f0293f042 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:23.453870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fd3db692-0380-4489-a2fb-e17f0293f042 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:23.462091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd3db692-0380-4489-a2fb-e17f0293f042 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:23.463503 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd3db692-0380-4489-a2fb-e17f0293f042 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:23.464819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd3db692-0380-4489-a2fb-e17f0293f042 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:23.466269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd3db692-0380-4489-a2fb-e17f0293f042 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:23.710328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fd3db692-0380-4489-a2fb-e17f0293f042 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:23.719791 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fd3db692-0380-4489-a2fb-e17f0293f042 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1202 microversion: 2.1 time: 0.272594 Jul 20 04:43:23.721055 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2684/5110] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:23 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1202 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:23.739189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6e742dbc-394a-4731-9469-dc302e410ba3 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1031176498"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:23.739925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6e742dbc-394a-4731-9469-dc302e410ba3 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:23.749627 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e742dbc-394a-4731-9469-dc302e410ba3 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:23.750977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e742dbc-394a-4731-9469-dc302e410ba3 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:23.752456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e742dbc-394a-4731-9469-dc302e410ba3 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:23.753611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e742dbc-394a-4731-9469-dc302e410ba3 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:23.759327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:23.774776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-80bf1b2b-4f07-4c93-8b23-e64cc1f0a400 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:23.789235 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-80bf1b2b-4f07-4c93-8b23-e64cc1f0a400 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1723 microversion: 2.1 time: 1.315803 Jul 20 04:43:23.790164 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2427/5111] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:22 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1723 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:23.950892 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.network.security_group_api [None req-6e742dbc-394a-4731-9469-dc302e410ba3 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Removing security group c6dfb0ae-cae6-4caf-88cd-0f815f518c08 from port 6a873c5d-6855-410c-9be1-c768a125054e Jul 20 04:43:24.075189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-8264e5e3-9057-40f4-8d48-a8d87fa7b9be req-9013d890-12b0-4285-904e-752e564d2641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783", "tag": "6a873c5d-6855-410c-9be1-c768a125054e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:24.091225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8264e5e3-9057-40f4-8d48-a8d87fa7b9be req-9013d890-12b0-4285-904e-752e564d2641 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:24.091983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8264e5e3-9057-40f4-8d48-a8d87fa7b9be req-9013d890-12b0-4285-904e-752e564d2641 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:24.104846 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-8264e5e3-9057-40f4-8d48-a8d87fa7b9be req-9013d890-12b0-4285-904e-752e564d2641 service nova] Creating event network-changed:6a873c5d-6855-410c-9be1-c768a125054e for instance cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 on n-h2-826526-5 Jul 20 04:43:24.111649 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-8264e5e3-9057-40f4-8d48-a8d87fa7b9be req-9013d890-12b0-4285-904e-752e564d2641 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317092 Jul 20 04:43:24.112919 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2428/5112] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:24.475484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94701338-2eef-4c8f-91bf-991f2312041c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:24.477288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-94701338-2eef-4c8f-91bf-991f2312041c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:24.499452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94701338-2eef-4c8f-91bf-991f2312041c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:24.506861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94701338-2eef-4c8f-91bf-991f2312041c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:24.511645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94701338-2eef-4c8f-91bf-991f2312041c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:24.512286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94701338-2eef-4c8f-91bf-991f2312041c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:24.843471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-94701338-2eef-4c8f-91bf-991f2312041c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:24.854310 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-94701338-2eef-4c8f-91bf-991f2312041c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1317 microversion: 2.1 time: 0.392672 Jul 20 04:43:24.857399 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2429/5113] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:24 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:24.867627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-62bebaf4-87b5-43fa-9116-7f1d75af224b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:24.872231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62bebaf4-87b5-43fa-9116-7f1d75af224b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:24.884075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62bebaf4-87b5-43fa-9116-7f1d75af224b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:24.884897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62bebaf4-87b5-43fa-9116-7f1d75af224b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:24.885877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62bebaf4-87b5-43fa-9116-7f1d75af224b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:24.886476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62bebaf4-87b5-43fa-9116-7f1d75af224b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:25.139456 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-62bebaf4-87b5-43fa-9116-7f1d75af224b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:25.154190 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-62bebaf4-87b5-43fa-9116-7f1d75af224b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1202 microversion: 2.1 time: 0.294325 Jul 20 04:43:25.157222 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2430/5114] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:24 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1202 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:25.168696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-54eb86d4-b739-4def-8c51-efc0e84451ec tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:25.171709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-54eb86d4-b739-4def-8c51-efc0e84451ec tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:25.187285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54eb86d4-b739-4def-8c51-efc0e84451ec tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:25.188412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54eb86d4-b739-4def-8c51-efc0e84451ec tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:25.190365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54eb86d4-b739-4def-8c51-efc0e84451ec tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:25.193199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54eb86d4-b739-4def-8c51-efc0e84451ec tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:25.703631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-54eb86d4-b739-4def-8c51-efc0e84451ec tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:25.714916 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-54eb86d4-b739-4def-8c51-efc0e84451ec tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1729 microversion: 2.1 time: 0.555007 Jul 20 04:43:25.728103 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2431/5115] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:25 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1729 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:25.744519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-6a6b9ae8-2b23-45a2-a4d7-798899b3173b req-0c954ee0-14a6-42c0-9ce9-8e6f591c614a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc44474d-f1ac-43fd-bc65-8ff2790a9f48", "tag": "8c0d9620-c702-4453-a7d5-6e83ca9964b9"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:25.786699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6a6b9ae8-2b23-45a2-a4d7-798899b3173b req-0c954ee0-14a6-42c0-9ce9-8e6f591c614a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:25.789057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6a6b9ae8-2b23-45a2-a4d7-798899b3173b req-0c954ee0-14a6-42c0-9ce9-8e6f591c614a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:25.820106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:25.826683 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-6a6b9ae8-2b23-45a2-a4d7-798899b3173b req-0c954ee0-14a6-42c0-9ce9-8e6f591c614a service nova] Creating event network-changed:8c0d9620-c702-4453-a7d5-6e83ca9964b9 for instance dc44474d-f1ac-43fd-bc65-8ff2790a9f48 on n-h2-826526-5 Jul 20 04:43:25.836159 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-6a6b9ae8-2b23-45a2-a4d7-798899b3173b req-0c954ee0-14a6-42c0-9ce9-8e6f591c614a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106183 Jul 20 04:43:25.839900 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2432/5116] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:25.848864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-33e6ada6-5e1a-4fcc-bf14-67f77cfbf745 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:25.851187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-33e6ada6-5e1a-4fcc-bf14-67f77cfbf745 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:25.870895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33e6ada6-5e1a-4fcc-bf14-67f77cfbf745 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:25.872628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33e6ada6-5e1a-4fcc-bf14-67f77cfbf745 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:25.874795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33e6ada6-5e1a-4fcc-bf14-67f77cfbf745 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:25.877331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33e6ada6-5e1a-4fcc-bf14-67f77cfbf745 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:26.176908 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6e742dbc-394a-4731-9469-dc302e410ba3 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "POST /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783/action" status: 202 len: 0 microversion: 2.1 time: 2.454546 Jul 20 04:43:26.178764 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2685/5117] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:43:23 2022] POST /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783/action => generated 0 bytes in 2457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:43:26.192528 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1c97a6f0-2598-4144-9598-aa3d6aa38bc1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:26.195522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1c97a6f0-2598-4144-9598-aa3d6aa38bc1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:26.213366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c97a6f0-2598-4144-9598-aa3d6aa38bc1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:26.218421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c97a6f0-2598-4144-9598-aa3d6aa38bc1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:26.219592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c97a6f0-2598-4144-9598-aa3d6aa38bc1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:26.219899 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-33e6ada6-5e1a-4fcc-bf14-67f77cfbf745 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.378232 Jul 20 04:43:26.221568 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2433/5118] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:43:25 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-interface => generated 284 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:26.223249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c97a6f0-2598-4144-9598-aa3d6aa38bc1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:26.230742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-684d3c93-8834-42fa-ab2c-13661aba6a65 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:26.247128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-684d3c93-8834-42fa-ab2c-13661aba6a65 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:26.272103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-684d3c93-8834-42fa-ab2c-13661aba6a65 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:26.273003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-684d3c93-8834-42fa-ab2c-13661aba6a65 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:26.274577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-684d3c93-8834-42fa-ab2c-13661aba6a65 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:26.276816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-684d3c93-8834-42fa-ab2c-13661aba6a65 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:26.775792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1c97a6f0-2598-4144-9598-aa3d6aa38bc1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:26.791375 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1c97a6f0-2598-4144-9598-aa3d6aa38bc1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1317 microversion: 2.1 time: 0.605942 Jul 20 04:43:26.793977 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2686/5119] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:26 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1317 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:26.813416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7b23924a-4adf-4beb-b4d0-c3a5421b5d14 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Action: 'create', calling method: .version_select at 0x7f06bd2dc8b0>, body: {"pool": null} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:27.112726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-684d3c93-8834-42fa-ab2c-13661aba6a65 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:27.125995 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-684d3c93-8834-42fa-ab2c-13661aba6a65 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1202 microversion: 2.1 time: 0.902743 Jul 20 04:43:27.126932 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2434/5120] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:26 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1202 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:27.136322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-ee866775-b4af-4f9a-b6c4-c2d39d496126 req-059bee5e-03da-4117-a873-467e7f4e357c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783", "tag": "6a873c5d-6855-410c-9be1-c768a125054e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:27.150511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ee866775-b4af-4f9a-b6c4-c2d39d496126 req-059bee5e-03da-4117-a873-467e7f4e357c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:27.151901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ee866775-b4af-4f9a-b6c4-c2d39d496126 req-059bee5e-03da-4117-a873-467e7f4e357c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:27.169818 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-ee866775-b4af-4f9a-b6c4-c2d39d496126 req-059bee5e-03da-4117-a873-467e7f4e357c service nova] Creating event network-changed:6a873c5d-6855-410c-9be1-c768a125054e for instance cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 on n-h2-826526-5 Jul 20 04:43:27.177010 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-ee866775-b4af-4f9a-b6c4-c2d39d496126 req-059bee5e-03da-4117-a873-467e7f4e357c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048561 Jul 20 04:43:27.178863 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2435/5121] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:27.417390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3b5e4615-3d45-4baa-8d38-6c01d19993a2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:27.418427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3b5e4615-3d45-4baa-8d38-6c01d19993a2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:27.426439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b5e4615-3d45-4baa-8d38-6c01d19993a2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:27.427177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b5e4615-3d45-4baa-8d38-6c01d19993a2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:27.428140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b5e4615-3d45-4baa-8d38-6c01d19993a2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:27.428843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b5e4615-3d45-4baa-8d38-6c01d19993a2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:27.486052 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3b5e4615-3d45-4baa-8d38-6c01d19993a2 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "POST /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16/action" status: 200 len: 32638 microversion: 2.1 time: 0.072772 Jul 20 04:43:27.489922 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2436/5122] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:43:27 2022] POST /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16/action => generated 32638 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:43:27.815755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6b7849fd-3c31-4bbb-9360-6c7360aee841 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:27.816521 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6b7849fd-3c31-4bbb-9360-6c7360aee841 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:27.830746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b7849fd-3c31-4bbb-9360-6c7360aee841 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:27.831201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b7849fd-3c31-4bbb-9360-6c7360aee841 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:27.832040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b7849fd-3c31-4bbb-9360-6c7360aee841 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:27.835988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b7849fd-3c31-4bbb-9360-6c7360aee841 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:28.190865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:28.259503 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=10 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:28.555963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:29.199688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6b7849fd-3c31-4bbb-9360-6c7360aee841 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:29.219734 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6b7849fd-3c31-4bbb-9360-6c7360aee841 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1317 microversion: 2.1 time: 1.409018 Jul 20 04:43:29.237396 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2437/5123] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:27 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1317 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:29.249097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6194e4b9-a526-49ed-a866-6b098c8b1d2c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:29.253160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6194e4b9-a526-49ed-a866-6b098c8b1d2c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:29.270921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6194e4b9-a526-49ed-a866-6b098c8b1d2c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:29.272253 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6194e4b9-a526-49ed-a866-6b098c8b1d2c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:29.273265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6194e4b9-a526-49ed-a866-6b098c8b1d2c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:29.274767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6194e4b9-a526-49ed-a866-6b098c8b1d2c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:30.108441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6194e4b9-a526-49ed-a866-6b098c8b1d2c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:30.122266 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6194e4b9-a526-49ed-a866-6b098c8b1d2c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1202 microversion: 2.1 time: 0.879259 Jul 20 04:43:30.125265 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2438/5124] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:29 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1202 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:30.221203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e259796c-5a51-48e6-940e-5bf874178dfd req-0bb1e8d7-859c-476f-9e46-57bf67242b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "085f0971-9269-4d32-8eeb-17e7bf8143c2", "tag": "52337d8b-3bd5-408a-b197-2f38bf1e0818"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:30.246872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e259796c-5a51-48e6-940e-5bf874178dfd req-0bb1e8d7-859c-476f-9e46-57bf67242b31 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:30.250080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e259796c-5a51-48e6-940e-5bf874178dfd req-0bb1e8d7-859c-476f-9e46-57bf67242b31 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:30.326111 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e259796c-5a51-48e6-940e-5bf874178dfd req-0bb1e8d7-859c-476f-9e46-57bf67242b31 service nova] Creating event network-changed:52337d8b-3bd5-408a-b197-2f38bf1e0818 for instance 085f0971-9269-4d32-8eeb-17e7bf8143c2 on n-h1-826526-5 Jul 20 04:43:30.345298 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e259796c-5a51-48e6-940e-5bf874178dfd req-0bb1e8d7-859c-476f-9e46-57bf67242b31 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128430 Jul 20 04:43:30.348536 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2439/5125] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:43:30.374225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fb9905bd-0f44-48b7-a1e9-0db93ea37f6b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:30.377219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fb9905bd-0f44-48b7-a1e9-0db93ea37f6b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:30.393935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb9905bd-0f44-48b7-a1e9-0db93ea37f6b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:30.396679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb9905bd-0f44-48b7-a1e9-0db93ea37f6b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:30.398358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb9905bd-0f44-48b7-a1e9-0db93ea37f6b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:30.404978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb9905bd-0f44-48b7-a1e9-0db93ea37f6b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:31.206539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fb9905bd-0f44-48b7-a1e9-0db93ea37f6b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:31.217477 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fb9905bd-0f44-48b7-a1e9-0db93ea37f6b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1317 microversion: 2.1 time: 0.860490 Jul 20 04:43:31.221110 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2440/5126] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:30 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1317 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:31.234227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d14a513d-576b-4dba-8640-03c60261c08b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:31.237123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d14a513d-576b-4dba-8640-03c60261c08b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:31.250370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d14a513d-576b-4dba-8640-03c60261c08b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:31.251226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d14a513d-576b-4dba-8640-03c60261c08b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:31.252728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d14a513d-576b-4dba-8640-03c60261c08b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:31.257527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d14a513d-576b-4dba-8640-03c60261c08b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:32.085670 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d14a513d-576b-4dba-8640-03c60261c08b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:32.108498 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d14a513d-576b-4dba-8640-03c60261c08b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1202 microversion: 2.1 time: 0.877713 Jul 20 04:43:32.109028 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2441/5127] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:31 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1202 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:32.113572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-46e39882-d57a-48cb-9ddf-de6e54d9d358 req-51e921c9-86b2-4dc2-aa4d-5b1803438149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6263382d-2580-486c-8731-c1bea0bfaab3", "name": "network-vif-plugged", "status": "completed", "tag": "c6007430-04b3-4a93-93c5-61c6e07b0953"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:32.136189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-46e39882-d57a-48cb-9ddf-de6e54d9d358 req-51e921c9-86b2-4dc2-aa4d-5b1803438149 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:32.139554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-46e39882-d57a-48cb-9ddf-de6e54d9d358 req-51e921c9-86b2-4dc2-aa4d-5b1803438149 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:32.172883 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-46e39882-d57a-48cb-9ddf-de6e54d9d358 req-51e921c9-86b2-4dc2-aa4d-5b1803438149 service nova] Creating event network-vif-plugged:c6007430-04b3-4a93-93c5-61c6e07b0953 for instance 6263382d-2580-486c-8731-c1bea0bfaab3 on n-h1-826526-5 Jul 20 04:43:32.187438 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-46e39882-d57a-48cb-9ddf-de6e54d9d358 req-51e921c9-86b2-4dc2-aa4d-5b1803438149 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076762 Jul 20 04:43:32.190099 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2442/5128] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:32.242330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0bddc6d3-2e95-41d3-a27b-40c1add4fd69 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:32.243512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0bddc6d3-2e95-41d3-a27b-40c1add4fd69 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:32.267239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0bddc6d3-2e95-41d3-a27b-40c1add4fd69 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:32.267859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0bddc6d3-2e95-41d3-a27b-40c1add4fd69 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:32.268829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0bddc6d3-2e95-41d3-a27b-40c1add4fd69 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:32.270678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0bddc6d3-2e95-41d3-a27b-40c1add4fd69 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:32.535170 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7b23924a-4adf-4beb-b4d0-c3a5421b5d14 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.738711 Jul 20 04:43:32.536776 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2687/5129] 10.222.0.17 () {60 vars in 1169 bytes} [Wed Jul 20 04:43:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:32.544580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-5dbbb0f0-39ce-441e-8042-1bbc410e4038 req-1250c8ac-dab7-42be-805b-2e21d1284710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "085f0971-9269-4d32-8eeb-17e7bf8143c2", "tag": "52337d8b-3bd5-408a-b197-2f38bf1e0818"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:32.572965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5dbbb0f0-39ce-441e-8042-1bbc410e4038 req-1250c8ac-dab7-42be-805b-2e21d1284710 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:32.573619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5dbbb0f0-39ce-441e-8042-1bbc410e4038 req-1250c8ac-dab7-42be-805b-2e21d1284710 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:32.594168 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-5dbbb0f0-39ce-441e-8042-1bbc410e4038 req-1250c8ac-dab7-42be-805b-2e21d1284710 service nova] Creating event network-changed:52337d8b-3bd5-408a-b197-2f38bf1e0818 for instance 085f0971-9269-4d32-8eeb-17e7bf8143c2 on n-h1-826526-5 Jul 20 04:43:32.600740 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-5dbbb0f0-39ce-441e-8042-1bbc410e4038 req-1250c8ac-dab7-42be-805b-2e21d1284710 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062510 Jul 20 04:43:32.602178 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2688/5130] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:32.609603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ebeb4354-7607-47ad-aa05-438ed7017938 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.150"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:32.611022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ebeb4354-7607-47ad-aa05-438ed7017938 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:32.618807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebeb4354-7607-47ad-aa05-438ed7017938 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:32.619495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebeb4354-7607-47ad-aa05-438ed7017938 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:32.620550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebeb4354-7607-47ad-aa05-438ed7017938 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:32.621141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebeb4354-7607-47ad-aa05-438ed7017938 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:32.662633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebeb4354-7607-47ad-aa05-438ed7017938 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Acquired lock "refresh_cache-cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" {{(pid=127871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:43:32.807698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0bddc6d3-2e95-41d3-a27b-40c1add4fd69 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:32.836429 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0bddc6d3-2e95-41d3-a27b-40c1add4fd69 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1317 microversion: 2.1 time: 0.599792 Jul 20 04:43:32.842980 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2443/5131] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:32 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1317 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:32.905713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-822e87a8-9054-4274-8f4d-192e6929be18 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:32.906504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-822e87a8-9054-4274-8f4d-192e6929be18 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:32.922375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-822e87a8-9054-4274-8f4d-192e6929be18 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:32.922822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-822e87a8-9054-4274-8f4d-192e6929be18 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:32.924664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-822e87a8-9054-4274-8f4d-192e6929be18 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:32.925558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-822e87a8-9054-4274-8f4d-192e6929be18 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:32.983621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-822e87a8-9054-4274-8f4d-192e6929be18 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:43:33.132563 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-822e87a8-9054-4274-8f4d-192e6929be18 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "DELETE /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 204 len: 0 microversion: 2.1 time: 0.287807 Jul 20 04:43:33.133593 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2444/5132] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:43:32 2022] DELETE /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:43:33.152829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-4a3dbae9-0046-4d4b-8245-24d0d9058b08 req-b772485b-fce4-434b-9d20-44b90a02a514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53648916-fa3f-406d-9cd0-f1c51355bc16", "tag": "2d6d6a29-25b7-45d4-adbe-e75ce1a89f13"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:33.178871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4a3dbae9-0046-4d4b-8245-24d0d9058b08 req-b772485b-fce4-434b-9d20-44b90a02a514 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:33.179421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4a3dbae9-0046-4d4b-8245-24d0d9058b08 req-b772485b-fce4-434b-9d20-44b90a02a514 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:33.212491 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-4a3dbae9-0046-4d4b-8245-24d0d9058b08 req-b772485b-fce4-434b-9d20-44b90a02a514 service nova] Creating event network-changed:2d6d6a29-25b7-45d4-adbe-e75ce1a89f13 for instance 53648916-fa3f-406d-9cd0-f1c51355bc16 on n-h1-826526-5 Jul 20 04:43:33.239019 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-4a3dbae9-0046-4d4b-8245-24d0d9058b08 req-b772485b-fce4-434b-9d20-44b90a02a514 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087112 Jul 20 04:43:33.239019 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2445/5133] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:33.253447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9828f9c1-c2dd-48f0-b65f-3045ea14a707 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:33.254196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9828f9c1-c2dd-48f0-b65f-3045ea14a707 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:33.304073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9828f9c1-c2dd-48f0-b65f-3045ea14a707 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:33.306214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9828f9c1-c2dd-48f0-b65f-3045ea14a707 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:33.307433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9828f9c1-c2dd-48f0-b65f-3045ea14a707 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:33.309387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9828f9c1-c2dd-48f0-b65f-3045ea14a707 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:33.816535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9828f9c1-c2dd-48f0-b65f-3045ea14a707 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:33.826914 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9828f9c1-c2dd-48f0-b65f-3045ea14a707 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1202 microversion: 2.1 time: 0.577796 Jul 20 04:43:33.827768 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2446/5134] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:33 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1202 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:33.834421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ecffded5-097e-413d-b613-49012ee14d0f tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:33.835290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ecffded5-097e-413d-b613-49012ee14d0f tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:33.843812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ecffded5-097e-413d-b613-49012ee14d0f tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:33.845030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ecffded5-097e-413d-b613-49012ee14d0f tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:33.846107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ecffded5-097e-413d-b613-49012ee14d0f tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:33.846733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ecffded5-097e-413d-b613-49012ee14d0f tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:35.014047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ecffded5-097e-413d-b613-49012ee14d0f tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:35.030396 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ecffded5-097e-413d-b613-49012ee14d0f tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 200 len: 1669 microversion: 2.1 time: 1.200466 Jul 20 04:43:35.031418 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2447/5135] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:33 2022] GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 1669 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:35.070967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-75bc5c8e-ee6a-4c5d-ab3e-2cf266d80166 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:35.086568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-75bc5c8e-ee6a-4c5d-ab3e-2cf266d80166 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:35.108611 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75bc5c8e-ee6a-4c5d-ab3e-2cf266d80166 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:35.110519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75bc5c8e-ee6a-4c5d-ab3e-2cf266d80166 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:35.111501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75bc5c8e-ee6a-4c5d-ab3e-2cf266d80166 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:35.112615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75bc5c8e-ee6a-4c5d-ab3e-2cf266d80166 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:36.044752 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-75bc5c8e-ee6a-4c5d-ab3e-2cf266d80166 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:36.054551 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-75bc5c8e-ee6a-4c5d-ab3e-2cf266d80166 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1317 microversion: 2.1 time: 1.021888 Jul 20 04:43:36.061075 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2448/5136] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:35 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1317 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:36.073009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9e1ea08c-3a9e-415f-90f5-8529bf63e6a3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:36.073847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9e1ea08c-3a9e-415f-90f5-8529bf63e6a3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:36.084413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e1ea08c-3a9e-415f-90f5-8529bf63e6a3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:36.084872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e1ea08c-3a9e-415f-90f5-8529bf63e6a3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:36.085671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e1ea08c-3a9e-415f-90f5-8529bf63e6a3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:36.086221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e1ea08c-3a9e-415f-90f5-8529bf63e6a3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:36.472060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-ebeb4354-7607-47ad-aa05-438ed7017938 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Building network info cache for instance {{(pid=127871) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:43:36.722727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9e1ea08c-3a9e-415f-90f5-8529bf63e6a3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:36.735440 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9e1ea08c-3a9e-415f-90f5-8529bf63e6a3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1388 microversion: 2.1 time: 0.672895 Jul 20 04:43:36.747228 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2449/5137] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:36 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1388 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:36.765973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e231bdbc-e8f5-4cef-9120-bc11d826003c req-f269ca1f-8f61-41ad-ad44-9e033fd09867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc44474d-f1ac-43fd-bc65-8ff2790a9f48", "name": "network-vif-plugged", "status": "completed", "tag": "8c0d9620-c702-4453-a7d5-6e83ca9964b9"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:36.816148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e231bdbc-e8f5-4cef-9120-bc11d826003c req-f269ca1f-8f61-41ad-ad44-9e033fd09867 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:36.816717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e231bdbc-e8f5-4cef-9120-bc11d826003c req-f269ca1f-8f61-41ad-ad44-9e033fd09867 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:36.859441 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e231bdbc-e8f5-4cef-9120-bc11d826003c req-f269ca1f-8f61-41ad-ad44-9e033fd09867 service nova] Creating event network-vif-plugged:8c0d9620-c702-4453-a7d5-6e83ca9964b9 for instance dc44474d-f1ac-43fd-bc65-8ff2790a9f48 on n-h2-826526-5 Jul 20 04:43:36.880153 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e231bdbc-e8f5-4cef-9120-bc11d826003c req-f269ca1f-8f61-41ad-ad44-9e033fd09867 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126075 Jul 20 04:43:36.881220 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2450/5138] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:36.886803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2a534000-70fe-4e33-a7c7-363da9fbf661 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:36.887524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2a534000-70fe-4e33-a7c7-363da9fbf661 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:36.905126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a534000-70fe-4e33-a7c7-363da9fbf661 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:36.907667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a534000-70fe-4e33-a7c7-363da9fbf661 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:36.908835 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a534000-70fe-4e33-a7c7-363da9fbf661 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:36.911235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a534000-70fe-4e33-a7c7-363da9fbf661 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:37.516620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-ebeb4354-7607-47ad-aa05-438ed7017938 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Updating instance_info_cache with network_info: [{"id": "6a873c5d-6855-410c-9be1-c768a125054e", "address": "fa:16:3e:54:91:32", "network": {"id": "52aa8d93-b932-48b5-803a-a7df3918df29", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-11673373-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ee6be1978ab0464c9e912fb14bfab189", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6a873c5d-68", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127871) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:43:37.539760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebeb4354-7607-47ad-aa05-438ed7017938 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Releasing lock "refresh_cache-cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" {{(pid=127871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:43:37.541139 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ebeb4354-7607-47ad-aa05-438ed7017938 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "POST /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783/action" status: 202 len: 0 microversion: 2.1 time: 4.937582 Jul 20 04:43:37.546969 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2689/5139] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:43:32 2022] POST /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783/action => generated 0 bytes in 4944 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:43:37.558898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e2c4d2ec-911b-4092-8f21-13f2d17ca728 req-78a7c002-a60f-4620-b584-a13e202a9d23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783", "tag": "6a873c5d-6855-410c-9be1-c768a125054e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:37.579983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e2c4d2ec-911b-4092-8f21-13f2d17ca728 req-78a7c002-a60f-4620-b584-a13e202a9d23 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:37.582650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e2c4d2ec-911b-4092-8f21-13f2d17ca728 req-78a7c002-a60f-4620-b584-a13e202a9d23 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:37.644725 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e2c4d2ec-911b-4092-8f21-13f2d17ca728 req-78a7c002-a60f-4620-b584-a13e202a9d23 service nova] Creating event network-changed:6a873c5d-6855-410c-9be1-c768a125054e for instance cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 on n-h2-826526-5 Jul 20 04:43:37.675214 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e2c4d2ec-911b-4092-8f21-13f2d17ca728 req-78a7c002-a60f-4620-b584-a13e202a9d23 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124110 Jul 20 04:43:37.675923 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2690/5140] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:37.690010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e0180a2b-e6ef-4199-9cfd-4d642417fadf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:37.690957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e0180a2b-e6ef-4199-9cfd-4d642417fadf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:37.709603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0180a2b-e6ef-4199-9cfd-4d642417fadf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:37.710107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0180a2b-e6ef-4199-9cfd-4d642417fadf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:37.716566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0180a2b-e6ef-4199-9cfd-4d642417fadf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:37.717779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e0180a2b-e6ef-4199-9cfd-4d642417fadf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:37.780635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2a534000-70fe-4e33-a7c7-363da9fbf661 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a4b4fa5cc24463aa398fbc4e1404d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5d48d9c894a32b3f417820f43427e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:37.787913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:37.799878 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2a534000-70fe-4e33-a7c7-363da9fbf661 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 200 len: 1669 microversion: 2.1 time: 0.917120 Jul 20 04:43:37.801643 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2451/5141] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:36 2022] GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 1669 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:37.816828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-65a7cb3d-1dbb-41ba-a494-bad161606c9d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:37.817824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-65a7cb3d-1dbb-41ba-a494-bad161606c9d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:37.842513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65a7cb3d-1dbb-41ba-a494-bad161606c9d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:37.843233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65a7cb3d-1dbb-41ba-a494-bad161606c9d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:37.846476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65a7cb3d-1dbb-41ba-a494-bad161606c9d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:37.847295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65a7cb3d-1dbb-41ba-a494-bad161606c9d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:38.211872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e0180a2b-e6ef-4199-9cfd-4d642417fadf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:38.225155 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e0180a2b-e6ef-4199-9cfd-4d642417fadf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1388 microversion: 2.1 time: 0.547860 Jul 20 04:43:38.227828 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2691/5142] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:37 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1388 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:38.235075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3e6a2e59-c1aa-4fd9-9b46-e15ef3ed1dde tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.150"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:38.454183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-65a7cb3d-1dbb-41ba-a494-bad161606c9d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:38.487687 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-65a7cb3d-1dbb-41ba-a494-bad161606c9d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1317 microversion: 2.1 time: 0.684370 Jul 20 04:43:38.497423 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2452/5143] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:37 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1317 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:38.533078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-0a77cc2c-52f1-4c89-8c7f-a2aa32d5bf8d req-1f86fc3e-8dbb-458f-ba0a-d2d730ccaa5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53648916-fa3f-406d-9cd0-f1c51355bc16", "name": "network-vif-deleted", "tag": "2d6d6a29-25b7-45d4-adbe-e75ce1a89f13"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:38.541617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0a77cc2c-52f1-4c89-8c7f-a2aa32d5bf8d req-1f86fc3e-8dbb-458f-ba0a-d2d730ccaa5f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:38.542070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0a77cc2c-52f1-4c89-8c7f-a2aa32d5bf8d req-1f86fc3e-8dbb-458f-ba0a-d2d730ccaa5f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:38.562164 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-0a77cc2c-52f1-4c89-8c7f-a2aa32d5bf8d req-1f86fc3e-8dbb-458f-ba0a-d2d730ccaa5f service nova] Creating event network-vif-deleted:2d6d6a29-25b7-45d4-adbe-e75ce1a89f13 for instance 53648916-fa3f-406d-9cd0-f1c51355bc16 on n-h1-826526-5 Jul 20 04:43:38.582187 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-0a77cc2c-52f1-4c89-8c7f-a2aa32d5bf8d req-1f86fc3e-8dbb-458f-ba0a-d2d730ccaa5f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072981 Jul 20 04:43:38.582814 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2453/5144] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:38.595122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ff3da1a1-97a8-4a2d-a6b8-53ea971ee830 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:38.597613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ff3da1a1-97a8-4a2d-a6b8-53ea971ee830 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:38.657509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff3da1a1-97a8-4a2d-a6b8-53ea971ee830 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:38.658271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff3da1a1-97a8-4a2d-a6b8-53ea971ee830 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:38.659276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff3da1a1-97a8-4a2d-a6b8-53ea971ee830 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:38.660104 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff3da1a1-97a8-4a2d-a6b8-53ea971ee830 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:38.997443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3e6a2e59-c1aa-4fd9-9b46-e15ef3ed1dde tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:39.006476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e6a2e59-c1aa-4fd9-9b46-e15ef3ed1dde tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:39.006926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e6a2e59-c1aa-4fd9-9b46-e15ef3ed1dde tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:39.009720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e6a2e59-c1aa-4fd9-9b46-e15ef3ed1dde tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:39.010167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e6a2e59-c1aa-4fd9-9b46-e15ef3ed1dde tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:39.032520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ff3da1a1-97a8-4a2d-a6b8-53ea971ee830 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:39.044731 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ff3da1a1-97a8-4a2d-a6b8-53ea971ee830 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1388 microversion: 2.1 time: 0.456539 Jul 20 04:43:39.045331 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2454/5145] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:38 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1388 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:39.079092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0220727e-4157-49f2-925a-76f948361d5e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1773887209", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "8f9125ca-fd6c-4b4e-ae9f-074897a46875"}], "key_name": "tempest-TestNetworkAdvancedServerOps-467804541", "security_groups": [{"name": "tempest-secgroup-smoke-1961696727"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:39.407342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-0220727e-4157-49f2-925a-76f948361d5e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] validate_networks() for [('8f9125ca-fd6c-4b4e-ae9f-074897a46875', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:43:39.985665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0220727e-4157-49f2-925a-76f948361d5e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:43:39.986206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0220727e-4157-49f2-925a-76f948361d5e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:43:39.986885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0220727e-4157-49f2-925a-76f948361d5e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:43:39.987622 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0220727e-4157-49f2-925a-76f948361d5e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:43:39.988206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0220727e-4157-49f2-925a-76f948361d5e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:43:40.013379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0220727e-4157-49f2-925a-76f948361d5e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:40.029407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0220727e-4157-49f2-925a-76f948361d5e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:40.031263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0220727e-4157-49f2-925a-76f948361d5e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:40.031742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0220727e-4157-49f2-925a-76f948361d5e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:40.062138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e6a2e59-c1aa-4fd9-9b46-e15ef3ed1dde tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Acquired lock "refresh_cache-cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" {{(pid=127871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:43:40.097645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-0220727e-4157-49f2-925a-76f948361d5e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Getting quotas for project a678d19d82d248958a3d7df804ccfa95. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:43:40.107966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-0220727e-4157-49f2-925a-76f948361d5e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Getting quotas for user cffe347e0a094346afd74f178a0fde5d and project a678d19d82d248958a3d7df804ccfa95. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:43:40.130330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0220727e-4157-49f2-925a-76f948361d5e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:43:40.132712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0220727e-4157-49f2-925a-76f948361d5e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:43:40.177550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:40.223094 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0220727e-4157-49f2-925a-76f948361d5e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.166359 Jul 20 04:43:40.233276 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2455/5146] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:43:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:43:40.251370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a35b4a72-ef6f-46e9-b14b-a80f290650a5 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:40.254680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a35b4a72-ef6f-46e9-b14b-a80f290650a5 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] [instance: 53648916-fa3f-406d-9cd0-f1c51355bc16] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:40.275333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a35b4a72-ef6f-46e9-b14b-a80f290650a5 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:40.276486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a35b4a72-ef6f-46e9-b14b-a80f290650a5 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:40.278320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a35b4a72-ef6f-46e9-b14b-a80f290650a5 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:40.278935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a35b4a72-ef6f-46e9-b14b-a80f290650a5 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:40.302006 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-a35b4a72-ef6f-46e9-b14b-a80f290650a5 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] HTTP exception thrown: Instance 53648916-fa3f-406d-9cd0-f1c51355bc16 could not be found. Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a35b4a72-ef6f-46e9-b14b-a80f290650a5 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Request method failure captured: Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 HTTP/1.1 Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14biZ-lKuc8od4z-gDs7ibcjbpjbY-pO84cjRlWJrDLcgLsU69sxA2H3n6BaTvHZ67KSZSohA3lrrioyOsX40joFp6Jhnf9K_l3pzm_UYtlKZByQxgI-c8JWg1t0HjkzxL-aco80Bfx_lPnqGnEDDmiLhrNA4N-0tlVLIZEURaqN2lI Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c9b5d48d9c894a32b3f417820f43427e Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestNetworkBasicOps-225432984 Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9b5d48d9c894a32b3f417820f43427e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c9b5d48d9c894a32b3f417820f43427e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c9b5d48d9c894a32b3f417820f43427e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9b5d48d9c894a32b3f417820f43427e"}]}] Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestNetworkBasicOps-225432984 Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c9b5d48d9c894a32b3f417820f43427e Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestNetworkBasicOps-225432984 Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestNetworkBasicOps-225432984-project Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 43a4b4fa5cc24463aa398fbc4e1404d4 Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestNetworkBasicOps-225432984-project Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 53648916-fa3f-406d-9cd0-f1c51355bc16 could not be found. Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '53648916-fa3f-406d-9cd0-f1c51355bc16'} Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53648916-fa3f-406d-9cd0-f1c51355bc16 could not be found. Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53648916-fa3f-406d-9cd0-f1c51355bc16 could not be found. Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:40.304091 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:43:40.309888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:40.309888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:40.309888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:40.309888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:43:40.309888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:43:40.309888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53648916-fa3f-406d-9cd0-f1c51355bc16 could not be found. Jul 20 04:43:40.309888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:43:40.309888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a35b4a72-ef6f-46e9-b14b-a80f290650a5 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Returning 404 to user: Instance 53648916-fa3f-406d-9cd0-f1c51355bc16 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:43:40.311196 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a35b4a72-ef6f-46e9-b14b-a80f290650a5 tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16" status: 404 len: 111 microversion: 2.1 time: 0.074669 Jul 20 04:43:40.311401 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2456/5147] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:40 2022] GET /compute/v2.1/servers/53648916-fa3f-406d-9cd0-f1c51355bc16 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:43:40.332304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2346507f-2918-4b6e-92f1-bf1b098126a9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:40.332822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2346507f-2918-4b6e-92f1-bf1b098126a9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:40.346547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2346507f-2918-4b6e-92f1-bf1b098126a9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:40.347069 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2346507f-2918-4b6e-92f1-bf1b098126a9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:40.347862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2346507f-2918-4b6e-92f1-bf1b098126a9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:40.348330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2346507f-2918-4b6e-92f1-bf1b098126a9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:40.449499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2346507f-2918-4b6e-92f1-bf1b098126a9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:43:40.694963 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2346507f-2918-4b6e-92f1-bf1b098126a9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 204 len: 0 microversion: 2.1 time: 0.382009 Jul 20 04:43:40.704014 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2457/5148] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:43:40 2022] DELETE /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:43:40.709544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-28430deb-bab3-4e2b-9e14-02528a82672f tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:40.710271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-28430deb-bab3-4e2b-9e14-02528a82672f tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:40.729198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28430deb-bab3-4e2b-9e14-02528a82672f tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:40.729647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28430deb-bab3-4e2b-9e14-02528a82672f tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:40.730698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28430deb-bab3-4e2b-9e14-02528a82672f tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:40.731292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28430deb-bab3-4e2b-9e14-02528a82672f tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:41.079554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-28430deb-bab3-4e2b-9e14-02528a82672f tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:41.088531 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-28430deb-bab3-4e2b-9e14-02528a82672f tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1507 microversion: 2.1 time: 0.383167 Jul 20 04:43:41.094130 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2458/5149] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:40 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:41.100531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cbe77fc8-2bb7-4088-9a0f-55e1458e0269 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:41.100531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cbe77fc8-2bb7-4088-9a0f-55e1458e0269 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:41.146073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cbe77fc8-2bb7-4088-9a0f-55e1458e0269 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:41.146744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cbe77fc8-2bb7-4088-9a0f-55e1458e0269 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:41.149358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cbe77fc8-2bb7-4088-9a0f-55e1458e0269 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:41.151047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cbe77fc8-2bb7-4088-9a0f-55e1458e0269 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:41.302137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cbe77fc8-2bb7-4088-9a0f-55e1458e0269 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:41.311595 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cbe77fc8-2bb7-4088-9a0f-55e1458e0269 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1270 microversion: 2.1 time: 0.214348 Jul 20 04:43:41.312413 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2459/5150] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:41 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1270 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:41.335491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c8385afe-12ae-4719-97ee-660cc7bf89fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:41.336203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c8385afe-12ae-4719-97ee-660cc7bf89fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:41.381272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8385afe-12ae-4719-97ee-660cc7bf89fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:41.383322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8385afe-12ae-4719-97ee-660cc7bf89fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:41.386733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8385afe-12ae-4719-97ee-660cc7bf89fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:41.391224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8385afe-12ae-4719-97ee-660cc7bf89fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:41.637102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-3e6a2e59-c1aa-4fd9-9b46-e15ef3ed1dde tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Building network info cache for instance {{(pid=127871) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:43:42.020200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c8385afe-12ae-4719-97ee-660cc7bf89fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:42.033568 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c8385afe-12ae-4719-97ee-660cc7bf89fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1394 microversion: 2.1 time: 0.711895 Jul 20 04:43:42.034424 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2460/5151] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:41 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1394 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:42.039340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5f29340f-327e-41ca-8a7b-b9c3e1b91d4e tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] Calling method '.version_select at 0x7f06be2ec0d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:42.103365 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5f29340f-327e-41ca-8a7b-b9c3e1b91d4e tempest-TestNetworkBasicOps-225432984 tempest-TestNetworkBasicOps-225432984-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-151124949" status: 202 len: 0 microversion: 2.1 time: 0.067617 Jul 20 04:43:42.109414 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2461/5152] 10.222.0.17 () {58 vars in 1253 bytes} [Wed Jul 20 04:43:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-151124949 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:43:42.118174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9335bd73-e4fe-46dc-8034-8fd3ce1237d7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:42.129687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9335bd73-e4fe-46dc-8034-8fd3ce1237d7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:42.176171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9335bd73-e4fe-46dc-8034-8fd3ce1237d7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:42.177672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9335bd73-e4fe-46dc-8034-8fd3ce1237d7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:42.179557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9335bd73-e4fe-46dc-8034-8fd3ce1237d7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:42.184533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9335bd73-e4fe-46dc-8034-8fd3ce1237d7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:43.151049 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-3e6a2e59-c1aa-4fd9-9b46-e15ef3ed1dde tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Updating instance_info_cache with network_info: [{"id": "6a873c5d-6855-410c-9be1-c768a125054e", "address": "fa:16:3e:54:91:32", "network": {"id": "52aa8d93-b932-48b5-803a-a7df3918df29", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-11673373-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ee6be1978ab0464c9e912fb14bfab189", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6a873c5d-68", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127871) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:43:43.189543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e6a2e59-c1aa-4fd9-9b46-e15ef3ed1dde tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Releasing lock "refresh_cache-cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" {{(pid=127871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:43:43.190568 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3e6a2e59-c1aa-4fd9-9b46-e15ef3ed1dde tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "POST /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783/action" status: 202 len: 0 microversion: 2.1 time: 4.961571 Jul 20 04:43:43.191272 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2692/5153] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:43:38 2022] POST /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783/action => generated 0 bytes in 4963 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:43:43.197511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-589d2a42-9f5a-4e64-b297-0d8100688375 req-071a11f4-3a13-43d7-bc7b-e4dd96340d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783", "tag": "6a873c5d-6855-410c-9be1-c768a125054e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:43.209132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-589d2a42-9f5a-4e64-b297-0d8100688375 req-071a11f4-3a13-43d7-bc7b-e4dd96340d22 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:43.209830 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-589d2a42-9f5a-4e64-b297-0d8100688375 req-071a11f4-3a13-43d7-bc7b-e4dd96340d22 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:43.228859 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-589d2a42-9f5a-4e64-b297-0d8100688375 req-071a11f4-3a13-43d7-bc7b-e4dd96340d22 service nova] Creating event network-changed:6a873c5d-6855-410c-9be1-c768a125054e for instance cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 on n-h2-826526-5 Jul 20 04:43:43.237008 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-589d2a42-9f5a-4e64-b297-0d8100688375 req-071a11f4-3a13-43d7-bc7b-e4dd96340d22 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043181 Jul 20 04:43:43.238402 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2693/5154] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:43.245340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-58700c0c-5990-4fba-a115-b842e9c2b11b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:43.246352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-58700c0c-5990-4fba-a115-b842e9c2b11b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:43.258812 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58700c0c-5990-4fba-a115-b842e9c2b11b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:43.259930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58700c0c-5990-4fba-a115-b842e9c2b11b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:43.261079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58700c0c-5990-4fba-a115-b842e9c2b11b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:43.261784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58700c0c-5990-4fba-a115-b842e9c2b11b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:43.441189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-58700c0c-5990-4fba-a115-b842e9c2b11b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:43.444927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9335bd73-e4fe-46dc-8034-8fd3ce1237d7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:43.457125 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-58700c0c-5990-4fba-a115-b842e9c2b11b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1324 microversion: 2.1 time: 0.215669 Jul 20 04:43:43.459541 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9335bd73-e4fe-46dc-8034-8fd3ce1237d7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1507 microversion: 2.1 time: 1.345020 Jul 20 04:43:43.464472 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2462/5155] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:42 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1507 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:43.467052 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2694/5156] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:43 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1324 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:43.482960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f7398797-0838-4351-b8b5-d718dd89ee19 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '.version_select at 0x7f06bd2255e0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:43.498348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6edc1a9b-a34e-4f65-929f-e0dc394e1d20 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:43.498942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6edc1a9b-a34e-4f65-929f-e0dc394e1d20 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:43.527568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6edc1a9b-a34e-4f65-929f-e0dc394e1d20 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:43.528074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6edc1a9b-a34e-4f65-929f-e0dc394e1d20 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:43.528897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6edc1a9b-a34e-4f65-929f-e0dc394e1d20 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:43.531055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6edc1a9b-a34e-4f65-929f-e0dc394e1d20 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.452099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6edc1a9b-a34e-4f65-929f-e0dc394e1d20 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:44.462000 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6edc1a9b-a34e-4f65-929f-e0dc394e1d20 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1394 microversion: 2.1 time: 0.995984 Jul 20 04:43:44.465539 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2463/5157] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:43 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1394 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:44.473758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b51677d6-c0d1-4311-9de2-d9cb6336cc1e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:44.477109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b51677d6-c0d1-4311-9de2-d9cb6336cc1e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:44.486577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b51677d6-c0d1-4311-9de2-d9cb6336cc1e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.487518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b51677d6-c0d1-4311-9de2-d9cb6336cc1e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.489145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b51677d6-c0d1-4311-9de2-d9cb6336cc1e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.489967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b51677d6-c0d1-4311-9de2-d9cb6336cc1e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.618595 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b51677d6-c0d1-4311-9de2-d9cb6336cc1e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "PUT /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1079 microversion: 2.1 time: 0.150746 Jul 20 04:43:44.628676 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2464/5158] 10.222.0.17 () {60 vars in 1255 bytes} [Wed Jul 20 04:43:44 2022] PUT /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1079 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:44.642260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7318612d-5874-46ce-b60e-bbafafcad2c5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:44.643409 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7318612d-5874-46ce-b60e-bbafafcad2c5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:44.663053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7318612d-5874-46ce-b60e-bbafafcad2c5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.667092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7318612d-5874-46ce-b60e-bbafafcad2c5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.668331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7318612d-5874-46ce-b60e-bbafafcad2c5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.670408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7318612d-5874-46ce-b60e-bbafafcad2c5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:45.434714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7318612d-5874-46ce-b60e-bbafafcad2c5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:45.444696 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7318612d-5874-46ce-b60e-bbafafcad2c5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1392 microversion: 2.1 time: 0.812372 Jul 20 04:43:45.446732 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2465/5159] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:44 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1392 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:45.456050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-adfd8969-6619-484d-992b-10294772a5b9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:45.457389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-adfd8969-6619-484d-992b-10294772a5b9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:45.483868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-adfd8969-6619-484d-992b-10294772a5b9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:45.485100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-adfd8969-6619-484d-992b-10294772a5b9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:45.486128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-adfd8969-6619-484d-992b-10294772a5b9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:45.487065 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-adfd8969-6619-484d-992b-10294772a5b9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:45.931721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-adfd8969-6619-484d-992b-10294772a5b9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:45.940915 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-adfd8969-6619-484d-992b-10294772a5b9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1505 microversion: 2.1 time: 0.491778 Jul 20 04:43:45.941801 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2466/5160] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:45 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1505 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:45.959136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9c18dcad-3225-4bd4-929f-e00ca7390bc9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:45.960084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9c18dcad-3225-4bd4-929f-e00ca7390bc9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:45.969664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c18dcad-3225-4bd4-929f-e00ca7390bc9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:45.970290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c18dcad-3225-4bd4-929f-e00ca7390bc9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:45.971297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c18dcad-3225-4bd4-929f-e00ca7390bc9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:45.971979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c18dcad-3225-4bd4-929f-e00ca7390bc9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:46.074785 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9c18dcad-3225-4bd4-929f-e00ca7390bc9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:46.088346 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9c18dcad-3225-4bd4-929f-e00ca7390bc9 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1187 microversion: 2.1 time: 0.133266 Jul 20 04:43:46.089698 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2467/5161] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:45 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1187 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:46.103953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-1671a8b8-cbef-420e-bfb7-5ff8366f3f2d req-fe37e1f4-be67-40bd-b0e2-57e050add4ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6263382d-2580-486c-8731-c1bea0bfaab3", "name": "network-vif-deleted", "tag": "c6007430-04b3-4a93-93c5-61c6e07b0953"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:46.129537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-1671a8b8-cbef-420e-bfb7-5ff8366f3f2d req-fe37e1f4-be67-40bd-b0e2-57e050add4ac service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:46.130680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-1671a8b8-cbef-420e-bfb7-5ff8366f3f2d req-fe37e1f4-be67-40bd-b0e2-57e050add4ac service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:46.160707 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-1671a8b8-cbef-420e-bfb7-5ff8366f3f2d req-fe37e1f4-be67-40bd-b0e2-57e050add4ac service nova] Creating event network-vif-deleted:c6007430-04b3-4a93-93c5-61c6e07b0953 for instance 6263382d-2580-486c-8731-c1bea0bfaab3 on n-h1-826526-5 Jul 20 04:43:46.166322 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-1671a8b8-cbef-420e-bfb7-5ff8366f3f2d req-fe37e1f4-be67-40bd-b0e2-57e050add4ac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075162 Jul 20 04:43:46.166944 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2468/5162] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:46.182291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-17e193e0-99a2-4cd1-9074-747749e28708 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:46.184130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-17e193e0-99a2-4cd1-9074-747749e28708 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:46.202869 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17e193e0-99a2-4cd1-9074-747749e28708 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:46.203596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17e193e0-99a2-4cd1-9074-747749e28708 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:46.205676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17e193e0-99a2-4cd1-9074-747749e28708 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:46.208073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17e193e0-99a2-4cd1-9074-747749e28708 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:46.792106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-17e193e0-99a2-4cd1-9074-747749e28708 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:46.806127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:46.811124 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-17e193e0-99a2-4cd1-9074-747749e28708 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1505 microversion: 2.1 time: 0.642685 Jul 20 04:43:46.814825 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2469/5163] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:46 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1505 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:46.833300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3c500f0c-80e9-4193-a458-0d6878eefdbe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:46.834380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3c500f0c-80e9-4193-a458-0d6878eefdbe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:46.843800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c500f0c-80e9-4193-a458-0d6878eefdbe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:46.844615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c500f0c-80e9-4193-a458-0d6878eefdbe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:46.846032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c500f0c-80e9-4193-a458-0d6878eefdbe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:46.846784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c500f0c-80e9-4193-a458-0d6878eefdbe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.059576 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f7398797-0838-4351-b8b5-d718dd89ee19 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/f0460ea3-5c42-4d62-bc71-3aebb7419c57" status: 202 len: 0 microversion: 2.1 time: 3.590443 Jul 20 04:43:47.062798 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2695/5164] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:43:43 2022] DELETE /compute/v2.1/os-floating-ips/f0460ea3-5c42-4d62-bc71-3aebb7419c57 => generated 0 bytes in 3595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:43:47.077501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1e5b3040-d02b-42a4-ba71-72cd79af00b5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:47.093440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1e5b3040-d02b-42a4-ba71-72cd79af00b5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:47.114942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e5b3040-d02b-42a4-ba71-72cd79af00b5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.115341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e5b3040-d02b-42a4-ba71-72cd79af00b5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.116475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e5b3040-d02b-42a4-ba71-72cd79af00b5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.118002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e5b3040-d02b-42a4-ba71-72cd79af00b5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.246919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-1e5b3040-d02b-42a4-ba71-72cd79af00b5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:43:47.247372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-1e5b3040-d02b-42a4-ba71-72cd79af00b5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:43:47.247894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-1e5b3040-d02b-42a4-ba71-72cd79af00b5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:43:47.248463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-1e5b3040-d02b-42a4-ba71-72cd79af00b5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:43:47.248892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-1e5b3040-d02b-42a4-ba71-72cd79af00b5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:43:47.391427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1e5b3040-d02b-42a4-ba71-72cd79af00b5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:47.399751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e5b3040-d02b-42a4-ba71-72cd79af00b5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.401976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e5b3040-d02b-42a4-ba71-72cd79af00b5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.403513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e5b3040-d02b-42a4-ba71-72cd79af00b5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.405026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e5b3040-d02b-42a4-ba71-72cd79af00b5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.449342 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1e5b3040-d02b-42a4-ba71-72cd79af00b5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "POST /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48/action" status: 202 len: 1111 microversion: 2.1 time: 0.384846 Jul 20 04:43:47.451852 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2696/5165] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:43:47 2022] POST /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48/action => generated 1111 bytes in 388 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 04:43:47.460394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-3f889019-2b61-4f46-8c10-08177d8faa12 req-a5856906-3c65-43b0-9629-80fe67e76333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69b8042-1e5c-4ea4-9c05-3623cb12ad85", "tag": "250e1005-0706-457b-aa98-bde024a78797"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:47.488035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3f889019-2b61-4f46-8c10-08177d8faa12 req-a5856906-3c65-43b0-9629-80fe67e76333 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.489154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3f889019-2b61-4f46-8c10-08177d8faa12 req-a5856906-3c65-43b0-9629-80fe67e76333 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.580248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3c500f0c-80e9-4193-a458-0d6878eefdbe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:47.594237 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3c500f0c-80e9-4193-a458-0d6878eefdbe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1392 microversion: 2.1 time: 0.764927 Jul 20 04:43:47.594744 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-3f889019-2b61-4f46-8c10-08177d8faa12 req-a5856906-3c65-43b0-9629-80fe67e76333 service nova] Creating event network-changed:250e1005-0706-457b-aa98-bde024a78797 for instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 on n-h2-826526-5 Jul 20 04:43:47.599504 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2470/5166] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:46 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1392 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:47.603628 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-3f889019-2b61-4f46-8c10-08177d8faa12 req-a5856906-3c65-43b0-9629-80fe67e76333 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148541 Jul 20 04:43:47.604716 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2697/5167] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:47.613100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f62fa7c9-8169-4bdb-9507-35b5f7277ba3 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '.version_select at 0x7f06bd5188b0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:47.616380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-529dd46e-bf94-46c7-8d7d-9c44bc9a52a6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:47.618125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-529dd46e-bf94-46c7-8d7d-9c44bc9a52a6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:47.628423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-529dd46e-bf94-46c7-8d7d-9c44bc9a52a6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.629793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-529dd46e-bf94-46c7-8d7d-9c44bc9a52a6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.632012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-529dd46e-bf94-46c7-8d7d-9c44bc9a52a6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.634302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-529dd46e-bf94-46c7-8d7d-9c44bc9a52a6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.820060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-529dd46e-bf94-46c7-8d7d-9c44bc9a52a6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:47.829285 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-529dd46e-bf94-46c7-8d7d-9c44bc9a52a6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1187 microversion: 2.1 time: 0.222369 Jul 20 04:43:47.834074 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2698/5168] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:47 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1187 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:47.844358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-655e201b-c411-451e-913a-678bc30d621a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:47.848702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-655e201b-c411-451e-913a-678bc30d621a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:47.869382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-655e201b-c411-451e-913a-678bc30d621a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.869842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-655e201b-c411-451e-913a-678bc30d621a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.870643 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-655e201b-c411-451e-913a-678bc30d621a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.871193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-655e201b-c411-451e-913a-678bc30d621a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.244173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-655e201b-c411-451e-913a-678bc30d621a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:48.269455 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-655e201b-c411-451e-913a-678bc30d621a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1516 microversion: 2.1 time: 0.430666 Jul 20 04:43:48.277647 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2699/5169] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:47 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1516 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:48.336941 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f62fa7c9-8169-4bdb-9507-35b5f7277ba3 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/c6dfb0ae-cae6-4caf-88cd-0f815f518c08" status: 202 len: 0 microversion: 2.1 time: 0.733231 Jul 20 04:43:48.340417 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2471/5170] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jul 20 04:43:47 2022] DELETE /compute/v2.1/os-security-groups/c6dfb0ae-cae6-4caf-88cd-0f815f518c08 => generated 0 bytes in 738 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:43:48.350315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-04553e51-faf1-450d-b252-ebcb2db17bd7 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:48.350957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-04553e51-faf1-450d-b252-ebcb2db17bd7 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:48.389186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-04553e51-faf1-450d-b252-ebcb2db17bd7 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.390822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-04553e51-faf1-450d-b252-ebcb2db17bd7 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.393083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-04553e51-faf1-450d-b252-ebcb2db17bd7 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.394377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-04553e51-faf1-450d-b252-ebcb2db17bd7 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.449853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-04553e51-faf1-450d-b252-ebcb2db17bd7 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:43:48.590604 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-04553e51-faf1-450d-b252-ebcb2db17bd7 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 204 len: 0 microversion: 2.1 time: 0.247933 Jul 20 04:43:48.592577 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2700/5171] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:43:48 2022] DELETE /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:43:48.610121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4591650a-8d67-47c4-9f30-2140298c3221 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:48.610755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4591650a-8d67-47c4-9f30-2140298c3221 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:48.621152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4591650a-8d67-47c4-9f30-2140298c3221 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.653238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4591650a-8d67-47c4-9f30-2140298c3221 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.654143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4591650a-8d67-47c4-9f30-2140298c3221 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.654603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4591650a-8d67-47c4-9f30-2140298c3221 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.663035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5826d101-4326-4628-b51a-bee6456c7cfa tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:48.663947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5826d101-4326-4628-b51a-bee6456c7cfa tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:48.681669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5826d101-4326-4628-b51a-bee6456c7cfa tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.682133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5826d101-4326-4628-b51a-bee6456c7cfa tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.682929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5826d101-4326-4628-b51a-bee6456c7cfa tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.683369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5826d101-4326-4628-b51a-bee6456c7cfa tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.721910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=4,nova_cell1:RELEASE=2,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:49.018174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4591650a-8d67-47c4-9f30-2140298c3221 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:49.050900 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4591650a-8d67-47c4-9f30-2140298c3221 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1508 microversion: 2.1 time: 0.445554 Jul 20 04:43:49.062866 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2472/5172] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:48 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1508 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:49.077250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-17dad1e9-9620-4953-9659-d0d498b1feb8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:49.077889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-17dad1e9-9620-4953-9659-d0d498b1feb8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:49.096228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17dad1e9-9620-4953-9659-d0d498b1feb8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:49.096866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17dad1e9-9620-4953-9659-d0d498b1feb8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:49.097746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17dad1e9-9620-4953-9659-d0d498b1feb8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:49.098171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17dad1e9-9620-4953-9659-d0d498b1feb8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:49.247568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-17dad1e9-9620-4953-9659-d0d498b1feb8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:49.264157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5826d101-4326-4628-b51a-bee6456c7cfa tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:49.285134 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5826d101-4326-4628-b51a-bee6456c7cfa tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1392 microversion: 2.1 time: 0.666198 Jul 20 04:43:49.286231 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-17dad1e9-9620-4953-9659-d0d498b1feb8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1187 microversion: 2.1 time: 0.227452 Jul 20 04:43:49.288954 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2473/5173] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:49 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1187 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:49.303546 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2701/5174] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:48 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1392 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:49.311266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ba65e41b-eee1-445a-9d31-5769f7deacc0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:49.314848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ba65e41b-eee1-445a-9d31-5769f7deacc0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:49.322094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba65e41b-eee1-445a-9d31-5769f7deacc0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:49.323226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba65e41b-eee1-445a-9d31-5769f7deacc0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:49.324278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba65e41b-eee1-445a-9d31-5769f7deacc0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:49.325082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba65e41b-eee1-445a-9d31-5769f7deacc0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:49.750113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ba65e41b-eee1-445a-9d31-5769f7deacc0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:49.759217 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ba65e41b-eee1-445a-9d31-5769f7deacc0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1516 microversion: 2.1 time: 0.453928 Jul 20 04:43:49.760147 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2702/5175] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:49 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1516 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:50.069607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:50.088329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e542adc4-efbb-4863-9f0b-0d87a4637f96 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:50.090297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e542adc4-efbb-4863-9f0b-0d87a4637f96 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:50.105916 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e542adc4-efbb-4863-9f0b-0d87a4637f96 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.106687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e542adc4-efbb-4863-9f0b-0d87a4637f96 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.107680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e542adc4-efbb-4863-9f0b-0d87a4637f96 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.115596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e542adc4-efbb-4863-9f0b-0d87a4637f96 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.123739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:50.306299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5568d07a-0239-44d4-9eac-e4558b6a2c70 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:50.306931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5568d07a-0239-44d4-9eac-e4558b6a2c70 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:50.327891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5568d07a-0239-44d4-9eac-e4558b6a2c70 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.328723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5568d07a-0239-44d4-9eac-e4558b6a2c70 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.329871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5568d07a-0239-44d4-9eac-e4558b6a2c70 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.330519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5568d07a-0239-44d4-9eac-e4558b6a2c70 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.454477 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5568d07a-0239-44d4-9eac-e4558b6a2c70 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:50.470793 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5568d07a-0239-44d4-9eac-e4558b6a2c70 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1187 microversion: 2.1 time: 0.166684 Jul 20 04:43:50.471526 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2703/5176] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:50 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1187 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:50.487893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f61f2e7e-7f9b-4c6d-b6dc-c658af9ab5ad tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:50.488565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f61f2e7e-7f9b-4c6d-b6dc-c658af9ab5ad tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:50.490545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:50.501078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f61f2e7e-7f9b-4c6d-b6dc-c658af9ab5ad tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.502987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f61f2e7e-7f9b-4c6d-b6dc-c658af9ab5ad tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.504780 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f61f2e7e-7f9b-4c6d-b6dc-c658af9ab5ad tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.505445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f61f2e7e-7f9b-4c6d-b6dc-c658af9ab5ad tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.758097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e542adc4-efbb-4863-9f0b-0d87a4637f96 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:50.775618 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e542adc4-efbb-4863-9f0b-0d87a4637f96 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1508 microversion: 2.1 time: 0.707963 Jul 20 04:43:50.788987 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2474/5177] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:50 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1508 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:50.794048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-90cbb939-a53f-4c25-afad-cce73e2e7882 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:50.805971 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-90cbb939-a53f-4c25-afad-cce73e2e7882 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:50.821723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90cbb939-a53f-4c25-afad-cce73e2e7882 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.823059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90cbb939-a53f-4c25-afad-cce73e2e7882 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.829049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90cbb939-a53f-4c25-afad-cce73e2e7882 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.831001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90cbb939-a53f-4c25-afad-cce73e2e7882 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.897131 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f61f2e7e-7f9b-4c6d-b6dc-c658af9ab5ad tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:50.944580 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f61f2e7e-7f9b-4c6d-b6dc-c658af9ab5ad tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1392 microversion: 2.1 time: 0.463761 Jul 20 04:43:50.949195 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2704/5178] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:50 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1392 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:51.096392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-90cbb939-a53f-4c25-afad-cce73e2e7882 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:51.107757 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-90cbb939-a53f-4c25-afad-cce73e2e7882 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1516 microversion: 2.1 time: 0.317256 Jul 20 04:43:51.108936 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2475/5179] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:50 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1516 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:51.487010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ba7c2c6e-f1ea-40dd-ae9c-f3612b2a29c6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:51.487940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ba7c2c6e-f1ea-40dd-ae9c-f3612b2a29c6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:51.502867 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba7c2c6e-f1ea-40dd-ae9c-f3612b2a29c6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:51.504136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba7c2c6e-f1ea-40dd-ae9c-f3612b2a29c6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:51.505338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba7c2c6e-f1ea-40dd-ae9c-f3612b2a29c6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:51.505781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba7c2c6e-f1ea-40dd-ae9c-f3612b2a29c6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:51.725628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ba7c2c6e-f1ea-40dd-ae9c-f3612b2a29c6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:51.749669 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ba7c2c6e-f1ea-40dd-ae9c-f3612b2a29c6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1187 microversion: 2.1 time: 0.262535 Jul 20 04:43:51.755792 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2705/5180] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:51 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1187 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:51.804246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-685a12d1-9279-4ee6-84b6-effae70a4e44 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:51.804974 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-685a12d1-9279-4ee6-84b6-effae70a4e44 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:51.816523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-685a12d1-9279-4ee6-84b6-effae70a4e44 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:51.820990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-685a12d1-9279-4ee6-84b6-effae70a4e44 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:51.824117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-685a12d1-9279-4ee6-84b6-effae70a4e44 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:51.825785 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-685a12d1-9279-4ee6-84b6-effae70a4e44 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:51.967548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-caae426a-2c89-43a7-b12b-c7a87d889b10 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:51.968180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-caae426a-2c89-43a7-b12b-c7a87d889b10 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:51.976150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-caae426a-2c89-43a7-b12b-c7a87d889b10 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:51.984441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-caae426a-2c89-43a7-b12b-c7a87d889b10 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:51.985450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-caae426a-2c89-43a7-b12b-c7a87d889b10 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:51.985793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-caae426a-2c89-43a7-b12b-c7a87d889b10 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:52.273990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-caae426a-2c89-43a7-b12b-c7a87d889b10 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:52.289357 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-caae426a-2c89-43a7-b12b-c7a87d889b10 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1392 microversion: 2.1 time: 0.326483 Jul 20 04:43:52.290231 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2706/5181] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:51 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1392 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:52.294971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6ce27aa0-326c-4409-9ec0-e33b5aaaad6a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:52.295585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6ce27aa0-326c-4409-9ec0-e33b5aaaad6a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:52.313172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ce27aa0-326c-4409-9ec0-e33b5aaaad6a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:52.313662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ce27aa0-326c-4409-9ec0-e33b5aaaad6a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:52.314373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ce27aa0-326c-4409-9ec0-e33b5aaaad6a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:52.314885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ce27aa0-326c-4409-9ec0-e33b5aaaad6a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:52.549363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-685a12d1-9279-4ee6-84b6-effae70a4e44 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aba264ea8864915a86850678f3043c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6be1978ab0464c9e912fb14bfab189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:52.564612 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-685a12d1-9279-4ee6-84b6-effae70a4e44 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 200 len: 1508 microversion: 2.1 time: 0.763453 Jul 20 04:43:52.567169 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2476/5182] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:51 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 1508 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:52.607252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6ce27aa0-326c-4409-9ec0-e33b5aaaad6a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:52.622308 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6ce27aa0-326c-4409-9ec0-e33b5aaaad6a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1516 microversion: 2.1 time: 0.330925 Jul 20 04:43:52.622909 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2707/5183] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:52 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1516 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:52.716129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-19102309-d092-4706-8a74-1b6331a7d44f req-0e4718a4-acda-4fb7-a765-239cb5fdbe8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783", "name": "network-vif-deleted", "tag": "6a873c5d-6855-410c-9be1-c768a125054e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:52.729401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-19102309-d092-4706-8a74-1b6331a7d44f req-0e4718a4-acda-4fb7-a765-239cb5fdbe8a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:52.730269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-19102309-d092-4706-8a74-1b6331a7d44f req-0e4718a4-acda-4fb7-a765-239cb5fdbe8a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:52.747642 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-19102309-d092-4706-8a74-1b6331a7d44f req-0e4718a4-acda-4fb7-a765-239cb5fdbe8a service nova] Creating event network-vif-deleted:6a873c5d-6855-410c-9be1-c768a125054e for instance cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 on n-h2-826526-5 Jul 20 04:43:52.756546 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-19102309-d092-4706-8a74-1b6331a7d44f req-0e4718a4-acda-4fb7-a765-239cb5fdbe8a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044097 Jul 20 04:43:52.757608 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2477/5184] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:52.777727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1f1e9de7-cb21-430b-a642-f124586b0fcd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:52.782090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1f1e9de7-cb21-430b-a642-f124586b0fcd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:52.798620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f1e9de7-cb21-430b-a642-f124586b0fcd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:52.800645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f1e9de7-cb21-430b-a642-f124586b0fcd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:52.803509 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f1e9de7-cb21-430b-a642-f124586b0fcd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:52.804219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f1e9de7-cb21-430b-a642-f124586b0fcd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:52.921804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1f1e9de7-cb21-430b-a642-f124586b0fcd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:52.930899 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1f1e9de7-cb21-430b-a642-f124586b0fcd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 200 len: 1187 microversion: 2.1 time: 0.159764 Jul 20 04:43:52.940504 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2708/5185] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:52 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 1187 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:53.307592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b771601b-f12b-4473-8acf-c860200283be tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:53.308410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b771601b-f12b-4473-8acf-c860200283be tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:53.326012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b771601b-f12b-4473-8acf-c860200283be tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:53.329479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b771601b-f12b-4473-8acf-c860200283be tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:53.331858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b771601b-f12b-4473-8acf-c860200283be tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:53.332957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b771601b-f12b-4473-8acf-c860200283be tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:53.583408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e26ebb2e-f2f1-43d9-ac41-dc87e0370579 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:53.584032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e26ebb2e-f2f1-43d9-ac41-dc87e0370579 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] [instance: cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:53.612810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e26ebb2e-f2f1-43d9-ac41-dc87e0370579 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:53.614626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e26ebb2e-f2f1-43d9-ac41-dc87e0370579 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:53.618485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e26ebb2e-f2f1-43d9-ac41-dc87e0370579 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:53.619107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e26ebb2e-f2f1-43d9-ac41-dc87e0370579 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:53.624371 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b771601b-f12b-4473-8acf-c860200283be tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:53.648393 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b771601b-f12b-4473-8acf-c860200283be tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1392 microversion: 2.1 time: 0.345050 Jul 20 04:43:53.649479 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2478/5186] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:53 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1392 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:53.655004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-78ac103f-df2d-4a02-bfae-b54d34338996 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:53.655703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-78ac103f-df2d-4a02-bfae-b54d34338996 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:53.678276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78ac103f-df2d-4a02-bfae-b54d34338996 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:53.681013 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78ac103f-df2d-4a02-bfae-b54d34338996 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:53.681873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78ac103f-df2d-4a02-bfae-b54d34338996 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:53.682832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78ac103f-df2d-4a02-bfae-b54d34338996 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:53.688041 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-e26ebb2e-f2f1-43d9-ac41-dc87e0370579 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] HTTP exception thrown: Instance cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 could not be found. Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e26ebb2e-f2f1-43d9-ac41-dc87e0370579 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Request method failure captured: Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 HTTP/1.1 Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14e3fAC9Xeg8kZlDgCX401cOXvqFj2U84o6j2aJkoStaRscqwh6CD8R6WjJuxtukh9afLaqms9zLNt1GuGtv75fMOfLZMz65LvBlNZ-rC7si0fTRazBBceA0ua1vBDt4wzNMggGB5XHBPUyjkQ1H1OGIoUk10yBQ4frczBLZz2KFA6s Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: ee6be1978ab0464c9e912fb14bfab189 Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1547291014 Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ee6be1978ab0464c9e912fb14bfab189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ee6be1978ab0464c9e912fb14bfab189"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ee6be1978ab0464c9e912fb14bfab189", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ee6be1978ab0464c9e912fb14bfab189"}]}] Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1547291014 Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: ee6be1978ab0464c9e912fb14bfab189 Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1547291014 Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerRescueTestJSONUnderV235-1547291014-project Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 6aba264ea8864915a86850678f3043c6 Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1547291014-project Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 could not be found. Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783'} Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 could not be found. Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 could not be found. Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:43:53.690633 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:53.694963 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:43:53.694963 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:53.694963 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:53.694963 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:53.694963 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:43:53.694963 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:43:53.694963 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 could not be found. Jul 20 04:43:53.694963 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:43:53.699043 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e26ebb2e-f2f1-43d9-ac41-dc87e0370579 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] Returning 404 to user: Instance cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:43:53.700248 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e26ebb2e-f2f1-43d9-ac41-dc87e0370579 tempest-ServerRescueTestJSONUnderV235-1547291014 tempest-ServerRescueTestJSONUnderV235-1547291014-project] 10.222.0.17 "GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783" status: 404 len: 111 microversion: 2.1 time: 0.121063 Jul 20 04:43:53.705506 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2709/5187] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:53 2022] GET /compute/v2.1/servers/cdc6c0df-8509-4c92-b0ad-ac8e4dbe3783 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:43:53.726212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-d73ca243-39d7-46c8-96a4-7ea12fb1d949 req-8fd88949-faef-4668-9c3d-915bcbef12e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69b8042-1e5c-4ea4-9c05-3623cb12ad85", "name": "network-vif-plugged", "status": "completed", "tag": "250e1005-0706-457b-aa98-bde024a78797"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:53.762858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d73ca243-39d7-46c8-96a4-7ea12fb1d949 req-8fd88949-faef-4668-9c3d-915bcbef12e4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:53.766503 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d73ca243-39d7-46c8-96a4-7ea12fb1d949 req-8fd88949-faef-4668-9c3d-915bcbef12e4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:53.796665 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-d73ca243-39d7-46c8-96a4-7ea12fb1d949 req-8fd88949-faef-4668-9c3d-915bcbef12e4 service nova] Creating event network-vif-plugged:250e1005-0706-457b-aa98-bde024a78797 for instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 on n-h2-826526-5 Jul 20 04:43:53.814171 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-d73ca243-39d7-46c8-96a4-7ea12fb1d949 req-8fd88949-faef-4668-9c3d-915bcbef12e4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098583 Jul 20 04:43:53.848556 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2710/5188] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:53.955205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4279f2d8-7a85-4ad2-9334-9459b0f3e9cf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:53.957071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4279f2d8-7a85-4ad2-9334-9459b0f3e9cf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:53.978862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4279f2d8-7a85-4ad2-9334-9459b0f3e9cf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:53.980766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4279f2d8-7a85-4ad2-9334-9459b0f3e9cf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:53.983809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4279f2d8-7a85-4ad2-9334-9459b0f3e9cf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:53.984982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4279f2d8-7a85-4ad2-9334-9459b0f3e9cf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:54.017774 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-4279f2d8-7a85-4ad2-9334-9459b0f3e9cf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] HTTP exception thrown: Instance 6263382d-2580-486c-8731-c1bea0bfaab3 could not be found. Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4279f2d8-7a85-4ad2-9334-9459b0f3e9cf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Request method failure captured: Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 HTTP/1.1 Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14dGzvYcPg3NF43f6ZRAI_AjtsB7nnPabtQnWEyYg-EXw30wVgvbZX3EBgp2DuSsT-UZ385yph2nVbWQKDH20kvx2xMXBhHcpx3bIjpA8OEQ9j_bQ2MqW2hbHHtIFQtSaphPYv0KfZxRo98jYdMcipaN9CmzRsyzwLTotDNtaeBR3wc Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b889ad56221143f0a54450c81ba738a7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}] Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: bc760e8f522640fc9190460719f5dcc2 Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 6263382d-2580-486c-8731-c1bea0bfaab3 could not be found. Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '6263382d-2580-486c-8731-c1bea0bfaab3'} Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6263382d-2580-486c-8731-c1bea0bfaab3 could not be found. Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6263382d-2580-486c-8731-c1bea0bfaab3 could not be found. Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:54.033583 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:43:54.039417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:54.039417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:54.039417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:54.039417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:43:54.039417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:43:54.039417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6263382d-2580-486c-8731-c1bea0bfaab3 could not be found. Jul 20 04:43:54.039417 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:43:54.042953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4279f2d8-7a85-4ad2-9334-9459b0f3e9cf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Returning 404 to user: Instance 6263382d-2580-486c-8731-c1bea0bfaab3 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:43:54.045112 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4279f2d8-7a85-4ad2-9334-9459b0f3e9cf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 404 len: 111 microversion: 2.1 time: 0.098814 Jul 20 04:43:54.048549 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2711/5189] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:53 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:43:54.166931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-78ac103f-df2d-4a02-bfae-b54d34338996 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:54.175374 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-78ac103f-df2d-4a02-bfae-b54d34338996 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1516 microversion: 2.1 time: 0.524683 Jul 20 04:43:54.179433 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2479/5190] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:53 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1516 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:54.665418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c97872ea-303f-4c8c-8ee7-a9f32ef94bfb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:54.667004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c97872ea-303f-4c8c-8ee7-a9f32ef94bfb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:54.679986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c97872ea-303f-4c8c-8ee7-a9f32ef94bfb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:54.682769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c97872ea-303f-4c8c-8ee7-a9f32ef94bfb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:54.683868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c97872ea-303f-4c8c-8ee7-a9f32ef94bfb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:54.686647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c97872ea-303f-4c8c-8ee7-a9f32ef94bfb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:55.192613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f75208a6-8c5d-4638-903a-6020c29cf8e1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:55.193755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f75208a6-8c5d-4638-903a-6020c29cf8e1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:55.209937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f75208a6-8c5d-4638-903a-6020c29cf8e1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:55.210399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f75208a6-8c5d-4638-903a-6020c29cf8e1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:55.211201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f75208a6-8c5d-4638-903a-6020c29cf8e1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:55.211645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f75208a6-8c5d-4638-903a-6020c29cf8e1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:55.515010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f75208a6-8c5d-4638-903a-6020c29cf8e1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:55.528677 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f75208a6-8c5d-4638-903a-6020c29cf8e1 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1516 microversion: 2.1 time: 0.338312 Jul 20 04:43:55.539872 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2480/5191] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:55 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1516 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:55.546230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8b94fa15-954f-4216-b595-ea82d1015177 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:55.547838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8b94fa15-954f-4216-b595-ea82d1015177 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:55.557848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b94fa15-954f-4216-b595-ea82d1015177 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:55.558499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b94fa15-954f-4216-b595-ea82d1015177 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:55.560423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b94fa15-954f-4216-b595-ea82d1015177 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:55.563522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b94fa15-954f-4216-b595-ea82d1015177 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:55.600934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c97872ea-303f-4c8c-8ee7-a9f32ef94bfb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:55.623984 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c97872ea-303f-4c8c-8ee7-a9f32ef94bfb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1392 microversion: 2.1 time: 0.962285 Jul 20 04:43:55.647974 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2712/5192] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:54 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1392 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:55.716160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-8b94fa15-954f-4216-b595-ea82d1015177 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lazy-loading 'services' on Instance uuid 085f0971-9269-4d32-8eeb-17e7bf8143c2 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:43:55.830853 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8b94fa15-954f-4216-b595-ea82d1015177 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "DELETE /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments/a55ea126-06ab-4140-ae38-1c5c5a29411c" status: 202 len: 0 microversion: 2.1 time: 0.288335 Jul 20 04:43:55.831522 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2481/5193] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 04:43:55 2022] DELETE /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments/a55ea126-06ab-4140-ae38-1c5c5a29411c => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:43:55.841912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0195db15-572f-4ad0-9d44-bc54483a8332 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:55.842849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0195db15-572f-4ad0-9d44-bc54483a8332 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:55.851740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0195db15-572f-4ad0-9d44-bc54483a8332 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:55.852425 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0195db15-572f-4ad0-9d44-bc54483a8332 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:55.853948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0195db15-572f-4ad0-9d44-bc54483a8332 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:55.854855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0195db15-572f-4ad0-9d44-bc54483a8332 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:55.945624 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0195db15-572f-4ad0-9d44-bc54483a8332 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107925 Jul 20 04:43:55.949820 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2713/5194] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:43:55 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:56.549191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0f034c78-ada1-423d-910f-73d2cfcebb23 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:56.550258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0f034c78-ada1-423d-910f-73d2cfcebb23 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:56.564158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f034c78-ada1-423d-910f-73d2cfcebb23 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:56.564158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f034c78-ada1-423d-910f-73d2cfcebb23 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:56.564158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f034c78-ada1-423d-910f-73d2cfcebb23 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:56.564158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f034c78-ada1-423d-910f-73d2cfcebb23 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:56.646571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-df738284-1979-4b2e-b607-28a4d0f693f5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:56.647128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-df738284-1979-4b2e-b607-28a4d0f693f5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:56.654386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df738284-1979-4b2e-b607-28a4d0f693f5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:56.660240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df738284-1979-4b2e-b607-28a4d0f693f5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:56.662891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df738284-1979-4b2e-b607-28a4d0f693f5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:56.663748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df738284-1979-4b2e-b607-28a4d0f693f5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:56.839401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0f034c78-ada1-423d-910f-73d2cfcebb23 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:56.849812 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0f034c78-ada1-423d-910f-73d2cfcebb23 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1516 microversion: 2.1 time: 0.307424 Jul 20 04:43:56.852733 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2482/5195] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:56 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1516 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:56.960200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-96dec729-a8d2-469b-ad1e-1f2f5eea5761 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:56.962398 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-96dec729-a8d2-469b-ad1e-1f2f5eea5761 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:56.981467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96dec729-a8d2-469b-ad1e-1f2f5eea5761 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:56.981932 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96dec729-a8d2-469b-ad1e-1f2f5eea5761 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:56.982724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96dec729-a8d2-469b-ad1e-1f2f5eea5761 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:56.983160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96dec729-a8d2-469b-ad1e-1f2f5eea5761 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:56.986696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-df738284-1979-4b2e-b607-28a4d0f693f5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:57.008932 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-df738284-1979-4b2e-b607-28a4d0f693f5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1564 microversion: 2.1 time: 0.358042 Jul 20 04:43:57.010199 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2714/5196] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:56 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1564 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:57.030992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d9ab5a2c-4bf5-4401-9aa4-92ef2e300467 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:57.031616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d9ab5a2c-4bf5-4401-9aa4-92ef2e300467 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:57.044142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d9ab5a2c-4bf5-4401-9aa4-92ef2e300467 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:57.044618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d9ab5a2c-4bf5-4401-9aa4-92ef2e300467 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:57.045403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d9ab5a2c-4bf5-4401-9aa4-92ef2e300467 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:57.045841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d9ab5a2c-4bf5-4401-9aa4-92ef2e300467 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:57.081938 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-96dec729-a8d2-469b-ad1e-1f2f5eea5761 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126536 Jul 20 04:43:57.083966 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2483/5197] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:43:56 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:43:57.764010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d9ab5a2c-4bf5-4401-9aa4-92ef2e300467 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:57.789651 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d9ab5a2c-4bf5-4401-9aa4-92ef2e300467 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1564 microversion: 2.1 time: 0.764408 Jul 20 04:43:57.792781 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2715/5198] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:57 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1564 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:57.871330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-78d9d274-848b-4121-aa13-68d4b96016f9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:57.877245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-78d9d274-848b-4121-aa13-68d4b96016f9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:57.890809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78d9d274-848b-4121-aa13-68d4b96016f9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:57.891607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78d9d274-848b-4121-aa13-68d4b96016f9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:57.893796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78d9d274-848b-4121-aa13-68d4b96016f9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:57.896644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78d9d274-848b-4121-aa13-68d4b96016f9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:58.093866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5b696e22-cd78-4acf-8308-fd4b13ecee82 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:58.094838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5b696e22-cd78-4acf-8308-fd4b13ecee82 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:58.107637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b696e22-cd78-4acf-8308-fd4b13ecee82 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:58.108079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b696e22-cd78-4acf-8308-fd4b13ecee82 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:58.114085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b696e22-cd78-4acf-8308-fd4b13ecee82 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:58.114837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b696e22-cd78-4acf-8308-fd4b13ecee82 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:58.203151 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5b696e22-cd78-4acf-8308-fd4b13ecee82 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111578 Jul 20 04:43:58.203765 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2716/5199] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:43:58 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:43:58.286729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-78d9d274-848b-4121-aa13-68d4b96016f9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:58.297615 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-78d9d274-848b-4121-aa13-68d4b96016f9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1516 microversion: 2.1 time: 0.431106 Jul 20 04:43:58.303520 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2484/5200] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:57 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1516 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:59.218149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ffcf8ea7-5732-4044-a868-a441c812cbc2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:59.228659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ffcf8ea7-5732-4044-a868-a441c812cbc2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:59.239571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffcf8ea7-5732-4044-a868-a441c812cbc2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:59.240249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffcf8ea7-5732-4044-a868-a441c812cbc2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:59.248306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffcf8ea7-5732-4044-a868-a441c812cbc2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:59.250229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffcf8ea7-5732-4044-a868-a441c812cbc2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:59.326199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bb4d77ab-5f69-425f-bb70-b596ad1af23c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:59.327242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bb4d77ab-5f69-425f-bb70-b596ad1af23c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:59.331418 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ffcf8ea7-5732-4044-a868-a441c812cbc2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108514 Jul 20 04:43:59.337269 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2717/5201] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:43:59 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:43:59.348656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb4d77ab-5f69-425f-bb70-b596ad1af23c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:59.350405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb4d77ab-5f69-425f-bb70-b596ad1af23c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:59.356586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb4d77ab-5f69-425f-bb70-b596ad1af23c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:59.357369 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb4d77ab-5f69-425f-bb70-b596ad1af23c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:00.018476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bb4d77ab-5f69-425f-bb70-b596ad1af23c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:00.030090 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bb4d77ab-5f69-425f-bb70-b596ad1af23c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1516 microversion: 2.1 time: 0.713864 Jul 20 04:44:00.041551 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2485/5202] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:59 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1516 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:00.343759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c6f807da-10b3-42d0-81ca-4fab81feba04 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:00.344945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c6f807da-10b3-42d0-81ca-4fab81feba04 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:00.367110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6f807da-10b3-42d0-81ca-4fab81feba04 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:00.367574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6f807da-10b3-42d0-81ca-4fab81feba04 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:00.368434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6f807da-10b3-42d0-81ca-4fab81feba04 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:00.378399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6f807da-10b3-42d0-81ca-4fab81feba04 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:00.501265 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c6f807da-10b3-42d0-81ca-4fab81feba04 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161861 Jul 20 04:44:00.501887 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2718/5203] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:00 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:00.825564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-36cb26ff-663b-4611-8072-80397cced137 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:00.826267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-36cb26ff-663b-4611-8072-80397cced137 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:00.849349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36cb26ff-663b-4611-8072-80397cced137 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:00.851081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36cb26ff-663b-4611-8072-80397cced137 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:00.857201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36cb26ff-663b-4611-8072-80397cced137 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:00.862571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36cb26ff-663b-4611-8072-80397cced137 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:00.905764 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-36cb26ff-663b-4611-8072-80397cced137 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] HTTP exception thrown: Instance 6263382d-2580-486c-8731-c1bea0bfaab3 could not be found. Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-36cb26ff-663b-4611-8072-80397cced137 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Request method failure captured: Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 HTTP/1.1 Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14dGzvYcPg3NF43f6ZRAI_AjtsB7nnPabtQnWEyYg-EXw30wVgvbZX3EBgp2DuSsT-UZ385yph2nVbWQKDH20kvx2xMXBhHcpx3bIjpA8OEQ9j_bQ2MqW2hbHHtIFQtSaphPYv0KfZxRo98jYdMcipaN9CmzRsyzwLTotDNtaeBR3wc Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b889ad56221143f0a54450c81ba738a7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}] Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: bc760e8f522640fc9190460719f5dcc2 Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 6263382d-2580-486c-8731-c1bea0bfaab3 could not be found. Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '6263382d-2580-486c-8731-c1bea0bfaab3'} Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6263382d-2580-486c-8731-c1bea0bfaab3 could not be found. Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:00.911797 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:00.917224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6263382d-2580-486c-8731-c1bea0bfaab3 could not be found. Jul 20 04:44:00.917224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:00.917224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:00.917224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:00.917224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:00.917224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:00.917224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:00.917224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:00.917224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:00.917224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6263382d-2580-486c-8731-c1bea0bfaab3 could not be found. Jul 20 04:44:00.917224 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:00.924207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-36cb26ff-663b-4611-8072-80397cced137 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Returning 404 to user: Instance 6263382d-2580-486c-8731-c1bea0bfaab3 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:00.927537 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-36cb26ff-663b-4611-8072-80397cced137 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 404 len: 111 microversion: 2.1 time: 0.106978 Jul 20 04:44:00.929289 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2486/5204] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:00 2022] DELETE /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:00.937728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a2b73c72-c201-47d0-bffb-d0d3a67c33c7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:00.938353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a2b73c72-c201-47d0-bffb-d0d3a67c33c7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 6263382d-2580-486c-8731-c1bea0bfaab3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:00.952095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2b73c72-c201-47d0-bffb-d0d3a67c33c7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:00.952561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2b73c72-c201-47d0-bffb-d0d3a67c33c7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:00.953359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2b73c72-c201-47d0-bffb-d0d3a67c33c7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:00.953794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2b73c72-c201-47d0-bffb-d0d3a67c33c7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:00.985377 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-a2b73c72-c201-47d0-bffb-d0d3a67c33c7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] HTTP exception thrown: Instance 6263382d-2580-486c-8731-c1bea0bfaab3 could not be found. Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a2b73c72-c201-47d0-bffb-d0d3a67c33c7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Request method failure captured: Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 HTTP/1.1 Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14dGzvYcPg3NF43f6ZRAI_AjtsB7nnPabtQnWEyYg-EXw30wVgvbZX3EBgp2DuSsT-UZ385yph2nVbWQKDH20kvx2xMXBhHcpx3bIjpA8OEQ9j_bQ2MqW2hbHHtIFQtSaphPYv0KfZxRo98jYdMcipaN9CmzRsyzwLTotDNtaeBR3wc Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b889ad56221143f0a54450c81ba738a7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}] Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: bc760e8f522640fc9190460719f5dcc2 Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 6263382d-2580-486c-8731-c1bea0bfaab3 could not be found. Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '6263382d-2580-486c-8731-c1bea0bfaab3'} Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6263382d-2580-486c-8731-c1bea0bfaab3 could not be found. Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6263382d-2580-486c-8731-c1bea0bfaab3 could not be found. Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:00.987032 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:44:00.995372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:00.995372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:00.995372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:00.995372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:00.995372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:00.995372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6263382d-2580-486c-8731-c1bea0bfaab3 could not be found. Jul 20 04:44:00.995372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:44:00.995372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a2b73c72-c201-47d0-bffb-d0d3a67c33c7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Returning 404 to user: Instance 6263382d-2580-486c-8731-c1bea0bfaab3 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:00.995372 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a2b73c72-c201-47d0-bffb-d0d3a67c33c7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3" status: 404 len: 111 microversion: 2.1 time: 0.054740 Jul 20 04:44:00.996819 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2719/5205] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:00 2022] GET /compute/v2.1/servers/6263382d-2580-486c-8731-c1bea0bfaab3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:01.049485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-61a44047-f0e5-4763-ab64-759061acaec0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:01.050121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-61a44047-f0e5-4763-ab64-759061acaec0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:01.058786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61a44047-f0e5-4763-ab64-759061acaec0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:01.059236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61a44047-f0e5-4763-ab64-759061acaec0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:01.060028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61a44047-f0e5-4763-ab64-759061acaec0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:01.060499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61a44047-f0e5-4763-ab64-759061acaec0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:01.292610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-61a44047-f0e5-4763-ab64-759061acaec0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:01.301730 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-61a44047-f0e5-4763-ab64-759061acaec0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1516 microversion: 2.1 time: 0.256299 Jul 20 04:44:01.304200 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2487/5206] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:01 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1516 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:01.513821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7f808611-21b2-41c3-bfb6-d49524946a2e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:01.515441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7f808611-21b2-41c3-bfb6-d49524946a2e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:01.528008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f808611-21b2-41c3-bfb6-d49524946a2e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:01.534303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f808611-21b2-41c3-bfb6-d49524946a2e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:01.535462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f808611-21b2-41c3-bfb6-d49524946a2e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:01.536069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f808611-21b2-41c3-bfb6-d49524946a2e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:01.596390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:01.602144 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7f808611-21b2-41c3-bfb6-d49524946a2e tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092660 Jul 20 04:44:01.608600 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2720/5207] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:01 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:02.323246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-520b97e9-1610-435d-960f-7cfb31636e5d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:02.324897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-520b97e9-1610-435d-960f-7cfb31636e5d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:02.343080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-520b97e9-1610-435d-960f-7cfb31636e5d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:02.345332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-520b97e9-1610-435d-960f-7cfb31636e5d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:02.346649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-520b97e9-1610-435d-960f-7cfb31636e5d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:02.348451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-520b97e9-1610-435d-960f-7cfb31636e5d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:02.411601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a38a3590-a4c5-443f-8985-a79e2dfb7313 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:02.412709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a38a3590-a4c5-443f-8985-a79e2dfb7313 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:02.415345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:02.427584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a38a3590-a4c5-443f-8985-a79e2dfb7313 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:02.440921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a38a3590-a4c5-443f-8985-a79e2dfb7313 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:02.442282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a38a3590-a4c5-443f-8985-a79e2dfb7313 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:02.442899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a38a3590-a4c5-443f-8985-a79e2dfb7313 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:02.796588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a38a3590-a4c5-443f-8985-a79e2dfb7313 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:02.819602 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a38a3590-a4c5-443f-8985-a79e2dfb7313 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1564 microversion: 2.1 time: 0.409286 Jul 20 04:44:02.821435 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2721/5208] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:02 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1564 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:02.837292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-69da7a5f-2be0-4f6e-bbba-cf64c52951e4 req-c422f8cb-efcc-4b18-a9f2-6f9c4b013def service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69b8042-1e5c-4ea4-9c05-3623cb12ad85", "tag": "250e1005-0706-457b-aa98-bde024a78797"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:02.865424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-69da7a5f-2be0-4f6e-bbba-cf64c52951e4 req-c422f8cb-efcc-4b18-a9f2-6f9c4b013def service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:02.865885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-69da7a5f-2be0-4f6e-bbba-cf64c52951e4 req-c422f8cb-efcc-4b18-a9f2-6f9c4b013def service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:02.913247 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-69da7a5f-2be0-4f6e-bbba-cf64c52951e4 req-c422f8cb-efcc-4b18-a9f2-6f9c4b013def service nova] Creating event network-changed:250e1005-0706-457b-aa98-bde024a78797 for instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 on n-h2-826526-5 Jul 20 04:44:02.930478 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-69da7a5f-2be0-4f6e-bbba-cf64c52951e4 req-c422f8cb-efcc-4b18-a9f2-6f9c4b013def service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105550 Jul 20 04:44:02.933396 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2722/5209] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:02.947500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ac2b9b4f-f04b-4812-bb3d-bdd05683700d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:02.951526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ac2b9b4f-f04b-4812-bb3d-bdd05683700d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:02.973476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac2b9b4f-f04b-4812-bb3d-bdd05683700d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:02.974988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac2b9b4f-f04b-4812-bb3d-bdd05683700d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:02.976040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac2b9b4f-f04b-4812-bb3d-bdd05683700d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:02.977780 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac2b9b4f-f04b-4812-bb3d-bdd05683700d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:03.061535 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ac2b9b4f-f04b-4812-bb3d-bdd05683700d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125172 Jul 20 04:44:03.063993 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2723/5210] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:02 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:03.552356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-520b97e9-1610-435d-960f-7cfb31636e5d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:03.563736 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-520b97e9-1610-435d-960f-7cfb31636e5d tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1516 microversion: 2.1 time: 1.246252 Jul 20 04:44:03.564827 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2488/5211] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:02 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1516 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:04.075259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-00815028-af7e-4a9c-9186-73a21f7774af tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:04.076222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-00815028-af7e-4a9c-9186-73a21f7774af tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:04.090028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00815028-af7e-4a9c-9186-73a21f7774af tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:04.091121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00815028-af7e-4a9c-9186-73a21f7774af tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:04.092000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00815028-af7e-4a9c-9186-73a21f7774af tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:04.092484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00815028-af7e-4a9c-9186-73a21f7774af tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:04.161487 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-00815028-af7e-4a9c-9186-73a21f7774af tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090423 Jul 20 04:44:04.173533 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2724/5212] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:04 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:04.521633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-27df39cc-08f6-41a7-a421-1370b787aca9 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-860441386", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": "none"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:04.582509 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f1d0ca7f-e0b3-4910-a9bb-f113c636f08f tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:04.583514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f1d0ca7f-e0b3-4910-a9bb-f113c636f08f tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:04.602487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-27df39cc-08f6-41a7-a421-1370b787aca9 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:44:04.602914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-27df39cc-08f6-41a7-a421-1370b787aca9 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:44:04.604790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-27df39cc-08f6-41a7-a421-1370b787aca9 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:44:04.607082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1d0ca7f-e0b3-4910-a9bb-f113c636f08f tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:04.607802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-27df39cc-08f6-41a7-a421-1370b787aca9 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:44:04.629420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-27df39cc-08f6-41a7-a421-1370b787aca9 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:44:04.636733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1d0ca7f-e0b3-4910-a9bb-f113c636f08f tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:04.641660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1d0ca7f-e0b3-4910-a9bb-f113c636f08f tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:04.642453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1d0ca7f-e0b3-4910-a9bb-f113c636f08f tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:04.658475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27df39cc-08f6-41a7-a421-1370b787aca9 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:04.662049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27df39cc-08f6-41a7-a421-1370b787aca9 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:04.663060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27df39cc-08f6-41a7-a421-1370b787aca9 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:04.672274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27df39cc-08f6-41a7-a421-1370b787aca9 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:04.714352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-27df39cc-08f6-41a7-a421-1370b787aca9 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Getting quotas for project 3ac56eb8b1744137812d331efae19fd5. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:44:04.728254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-27df39cc-08f6-41a7-a421-1370b787aca9 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Getting quotas for user 8f0b46eabea04d27b7ad3024111116b0 and project 3ac56eb8b1744137812d331efae19fd5. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:44:04.760927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-27df39cc-08f6-41a7-a421-1370b787aca9 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:44:04.766745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-27df39cc-08f6-41a7-a421-1370b787aca9 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 4c91a209-b178-45b1-b459-ff6716e7f400] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:44:04.898600 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-27df39cc-08f6-41a7-a421-1370b787aca9 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.733898 Jul 20 04:44:04.910358 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2489/5213] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 04:44:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:44:04.923197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8d3ca5dd-2b2c-487f-9ddf-0bdefbca6832 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:04.925051 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8d3ca5dd-2b2c-487f-9ddf-0bdefbca6832 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 4c91a209-b178-45b1-b459-ff6716e7f400] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:04.947830 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f1d0ca7f-e0b3-4910-a9bb-f113c636f08f tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:04.987952 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f1d0ca7f-e0b3-4910-a9bb-f113c636f08f tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1522 microversion: 2.1 time: 0.407904 Jul 20 04:44:05.012394 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2725/5214] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:04 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:05.109721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8d3ca5dd-2b2c-487f-9ddf-0bdefbca6832 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:05.137933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8d3ca5dd-2b2c-487f-9ddf-0bdefbca6832 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:05.150261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8d3ca5dd-2b2c-487f-9ddf-0bdefbca6832 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:05.155217 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8d3ca5dd-2b2c-487f-9ddf-0bdefbca6832 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/4c91a209-b178-45b1-b459-ff6716e7f400" status: 200 len: 1277 microversion: 2.47 time: 0.241324 Jul 20 04:44:05.162389 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2490/5215] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:04 2022] GET /compute/v2.1/servers/4c91a209-b178-45b1-b459-ff6716e7f400 => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:05.184843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7f289ea3-b3e8-4eb6-afa4-7c584fdee741 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:05.186430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7f289ea3-b3e8-4eb6-afa4-7c584fdee741 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:05.222020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f289ea3-b3e8-4eb6-afa4-7c584fdee741 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:05.225038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f289ea3-b3e8-4eb6-afa4-7c584fdee741 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:05.228224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f289ea3-b3e8-4eb6-afa4-7c584fdee741 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:05.230785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f289ea3-b3e8-4eb6-afa4-7c584fdee741 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:05.351631 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7f289ea3-b3e8-4eb6-afa4-7c584fdee741 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169975 Jul 20 04:44:05.364983 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2726/5216] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:05 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:05.486314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-04de04a2-dc6f-4a8f-8181-cc83f2558804 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1743359486", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": "none"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:05.576559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-04de04a2-dc6f-4a8f-8181-cc83f2558804 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:44:05.577345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-04de04a2-dc6f-4a8f-8181-cc83f2558804 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:44:05.581636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-04de04a2-dc6f-4a8f-8181-cc83f2558804 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:44:05.582161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-04de04a2-dc6f-4a8f-8181-cc83f2558804 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:44:05.582721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-04de04a2-dc6f-4a8f-8181-cc83f2558804 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:44:05.612805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-04de04a2-dc6f-4a8f-8181-cc83f2558804 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:05.613394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-04de04a2-dc6f-4a8f-8181-cc83f2558804 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:05.619995 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-04de04a2-dc6f-4a8f-8181-cc83f2558804 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:05.620628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-04de04a2-dc6f-4a8f-8181-cc83f2558804 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:05.669310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-04de04a2-dc6f-4a8f-8181-cc83f2558804 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Getting quotas for project 3ac56eb8b1744137812d331efae19fd5. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:44:05.675484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:05.686356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-04de04a2-dc6f-4a8f-8181-cc83f2558804 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Getting quotas for user 8f0b46eabea04d27b7ad3024111116b0 and project 3ac56eb8b1744137812d331efae19fd5. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:44:05.725652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-04de04a2-dc6f-4a8f-8181-cc83f2558804 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:44:05.728443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-04de04a2-dc6f-4a8f-8181-cc83f2558804 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:44:05.786607 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-04de04a2-dc6f-4a8f-8181-cc83f2558804 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.304762 Jul 20 04:44:05.787920 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2491/5217] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 04:44:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 307 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 20 04:44:05.799889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1d57e68c-d84d-4a75-9296-28256377acff tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:05.802037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1d57e68c-d84d-4a75-9296-28256377acff tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:05.937396 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1d57e68c-d84d-4a75-9296-28256377acff tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "PUT /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 992 microversion: 2.47 time: 0.143368 Jul 20 04:44:05.938562 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2727/5218] 10.222.0.17 () {62 vars in 1296 bytes} [Wed Jul 20 04:44:05 2022] PUT /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 992 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:44:05.962530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c34a1761-592f-4150-93d3-d7fa8853920e tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:05.963154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c34a1761-592f-4150-93d3-d7fa8853920e tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:06.015127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-87481337-a7af-4e5b-abc8-da614b6b96ac tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:06.015954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-87481337-a7af-4e5b-abc8-da614b6b96ac tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:06.034602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-87481337-a7af-4e5b-abc8-da614b6b96ac tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:06.035265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-87481337-a7af-4e5b-abc8-da614b6b96ac tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:06.040677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-87481337-a7af-4e5b-abc8-da614b6b96ac tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:06.041219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-87481337-a7af-4e5b-abc8-da614b6b96ac tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:06.128070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c34a1761-592f-4150-93d3-d7fa8853920e tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:06.142563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c34a1761-592f-4150-93d3-d7fa8853920e tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:06.146025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c34a1761-592f-4150-93d3-d7fa8853920e tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:06.148228 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c34a1761-592f-4150-93d3-d7fa8853920e tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1278 microversion: 2.47 time: 0.189998 Jul 20 04:44:06.150185 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2492/5219] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:05 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1278 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:44:06.347636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-87481337-a7af-4e5b-abc8-da614b6b96ac tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:06.363884 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-87481337-a7af-4e5b-abc8-da614b6b96ac tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1522 microversion: 2.1 time: 0.352918 Jul 20 04:44:06.371201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-292e86cc-c0fb-4ce4-8ee3-4a1e3689c01c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:06.372475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-292e86cc-c0fb-4ce4-8ee3-4a1e3689c01c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:06.376591 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2728/5220] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:06 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:06.382678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-292e86cc-c0fb-4ce4-8ee3-4a1e3689c01c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:06.383601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-292e86cc-c0fb-4ce4-8ee3-4a1e3689c01c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:06.385023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-292e86cc-c0fb-4ce4-8ee3-4a1e3689c01c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:06.385923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-292e86cc-c0fb-4ce4-8ee3-4a1e3689c01c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:06.427014 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-292e86cc-c0fb-4ce4-8ee3-4a1e3689c01c tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060223 Jul 20 04:44:06.428214 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2493/5221] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:06 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:44:07.170551 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7f67a12c-b4cc-4806-b030-31376f226cce tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:07.171421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7f67a12c-b4cc-4806-b030-31376f226cce tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:07.186413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f67a12c-b4cc-4806-b030-31376f226cce tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:07.186849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f67a12c-b4cc-4806-b030-31376f226cce tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:07.187902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f67a12c-b4cc-4806-b030-31376f226cce tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:07.188372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f67a12c-b4cc-4806-b030-31376f226cce tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:07.396079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-77ec4498-4a5a-4da3-9c1a-8f0556a9d304 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:07.397318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-77ec4498-4a5a-4da3-9c1a-8f0556a9d304 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:07.404952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-77ec4498-4a5a-4da3-9c1a-8f0556a9d304 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:07.405277 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-77ec4498-4a5a-4da3-9c1a-8f0556a9d304 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:07.406063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-77ec4498-4a5a-4da3-9c1a-8f0556a9d304 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:07.406695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-77ec4498-4a5a-4da3-9c1a-8f0556a9d304 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:07.520285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7f67a12c-b4cc-4806-b030-31376f226cce tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:07.533071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7f67a12c-b4cc-4806-b030-31376f226cce tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:07.535140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7f67a12c-b4cc-4806-b030-31376f226cce tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:07.540100 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7f67a12c-b4cc-4806-b030-31376f226cce tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1330 microversion: 2.47 time: 0.374391 Jul 20 04:44:07.540928 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2729/5222] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:07 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1330 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:07.552657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-daeb43a1-ddf8-43e1-81b9-8ac8c40b2a13 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:07.553998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-daeb43a1-ddf8-43e1-81b9-8ac8c40b2a13 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:07.571065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-daeb43a1-ddf8-43e1-81b9-8ac8c40b2a13 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:07.571778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-daeb43a1-ddf8-43e1-81b9-8ac8c40b2a13 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:07.572759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-daeb43a1-ddf8-43e1-81b9-8ac8c40b2a13 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:07.573368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-daeb43a1-ddf8-43e1-81b9-8ac8c40b2a13 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:07.638969 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-daeb43a1-ddf8-43e1-81b9-8ac8c40b2a13 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096121 Jul 20 04:44:07.639584 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2730/5223] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:07 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:07.655214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-77ec4498-4a5a-4da3-9c1a-8f0556a9d304 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:07.663886 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-77ec4498-4a5a-4da3-9c1a-8f0556a9d304 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1522 microversion: 2.1 time: 0.271732 Jul 20 04:44:07.664510 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2494/5224] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:07 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:07.827807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-59964fa3-b534-43fe-ae72-27de402e82c5 req-b3f185da-d70e-481b-a545-b9aaabe658b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc44474d-f1ac-43fd-bc65-8ff2790a9f48", "name": "network-vif-unplugged", "status": "completed", "tag": "8c0d9620-c702-4453-a7d5-6e83ca9964b9"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:07.847321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-59964fa3-b534-43fe-ae72-27de402e82c5 req-b3f185da-d70e-481b-a545-b9aaabe658b4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:07.848808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-59964fa3-b534-43fe-ae72-27de402e82c5 req-b3f185da-d70e-481b-a545-b9aaabe658b4 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:07.879840 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-59964fa3-b534-43fe-ae72-27de402e82c5 req-b3f185da-d70e-481b-a545-b9aaabe658b4 service nova] Creating event network-vif-unplugged:8c0d9620-c702-4453-a7d5-6e83ca9964b9 for instance dc44474d-f1ac-43fd-bc65-8ff2790a9f48 on n-h2-826526-5 Jul 20 04:44:07.890082 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-59964fa3-b534-43fe-ae72-27de402e82c5 req-b3f185da-d70e-481b-a545-b9aaabe658b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065868 Jul 20 04:44:07.890721 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2731/5225] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:08.568954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5a4ffdaf-8d75-4a7a-a210-6965abc7a98f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:08.570849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5a4ffdaf-8d75-4a7a-a210-6965abc7a98f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:08.588440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a4ffdaf-8d75-4a7a-a210-6965abc7a98f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.590661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a4ffdaf-8d75-4a7a-a210-6965abc7a98f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.592814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a4ffdaf-8d75-4a7a-a210-6965abc7a98f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.594708 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a4ffdaf-8d75-4a7a-a210-6965abc7a98f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.652555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8fbba298-2e73-4544-ab1c-dee47490aadf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:08.653588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8fbba298-2e73-4544-ab1c-dee47490aadf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:08.675681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fbba298-2e73-4544-ab1c-dee47490aadf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.676130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fbba298-2e73-4544-ab1c-dee47490aadf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.676949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fbba298-2e73-4544-ab1c-dee47490aadf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.677573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fbba298-2e73-4544-ab1c-dee47490aadf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.740913 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8fbba298-2e73-4544-ab1c-dee47490aadf tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093357 Jul 20 04:44:08.752676 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2732/5226] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:08 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:44:08.760210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-48868ca7-f29b-49bd-b420-f12c0736f396 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:08.761133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-48868ca7-f29b-49bd-b420-f12c0736f396 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:08.776375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48868ca7-f29b-49bd-b420-f12c0736f396 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.777035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5a4ffdaf-8d75-4a7a-a210-6965abc7a98f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:08.779908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48868ca7-f29b-49bd-b420-f12c0736f396 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.780838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48868ca7-f29b-49bd-b420-f12c0736f396 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.781256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48868ca7-f29b-49bd-b420-f12c0736f396 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.789838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5a4ffdaf-8d75-4a7a-a210-6965abc7a98f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:08.793739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5a4ffdaf-8d75-4a7a-a210-6965abc7a98f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:08.797610 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5a4ffdaf-8d75-4a7a-a210-6965abc7a98f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1348 microversion: 2.47 time: 0.232005 Jul 20 04:44:08.800049 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2495/5227] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:08 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1348 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:08.853796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8f1b043d-f363-46a8-9789-aea60e93e987 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:08.856137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8f1b043d-f363-46a8-9789-aea60e93e987 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:08.870231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f1b043d-f363-46a8-9789-aea60e93e987 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.870678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f1b043d-f363-46a8-9789-aea60e93e987 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.871820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f1b043d-f363-46a8-9789-aea60e93e987 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.879916 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f1b043d-f363-46a8-9789-aea60e93e987 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.915456 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-8f1b043d-f363-46a8-9789-aea60e93e987 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] HTTP exception thrown: Cannot 'reboot' instance e3975993-61a4-40e2-b5c6-19411a0511d1 while it is in vm_state rescued Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8f1b043d-f363-46a8-9789-aea60e93e987 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Request method failure captured: Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1/action HTTP/1.1 Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 28 Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14cCAXHTn9-xjP9-j6Y5H3QclpCYHsqBLpRpQihoTalzGkb0NJB3tQRrqwgEU6RYcb1rSLMpRe6OHLIl_vuXQ5sxjCNslRe7DUQ3JshdANU3fqjJB1ce8j9t6r_FeEMPekMuZI1SQ7JdDTpAgLs_ZRs_OCOFW6Xgy06EebnWW58puJk Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 3e123ad99de64f50b9cd4373597c3a9e Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3e123ad99de64f50b9cd4373597c3a9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3e123ad99de64f50b9cd4373597c3a9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3e123ad99de64f50b9cd4373597c3a9e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3e123ad99de64f50b9cd4373597c3a9e"}]}] Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 3e123ad99de64f50b9cd4373597c3a9e Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerRescueNegativeTestJSON-810656662-project Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 8ea213e79bcf4aaea49446db5eb55271 Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-810656662-project Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: {"reboot": {"type": "HARD"}} Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: exception: Cannot 'reboot' instance e3975993-61a4-40e2-b5c6-19411a0511d1 while it is in vm_state rescued Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'e3975993-61a4-40e2-b5c6-19411a0511d1', 'body': {'reboot': {'type': 'HARD'}}} Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e3975993-61a4-40e2-b5c6-19411a0511d1 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:44:08.917289 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:44:08.922055 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance e3975993-61a4-40e2-b5c6-19411a0511d1 while it is in vm_state rescued Jul 20 04:44:08.922055 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:08.922055 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:08.922055 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:08.922055 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:08.922055 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:08.922055 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:08.922055 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:08.922055 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:08.922055 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance e3975993-61a4-40e2-b5c6-19411a0511d1 while it is in vm_state rescued Jul 20 04:44:08.922055 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:08.923014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8f1b043d-f363-46a8-9789-aea60e93e987 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Returning 409 to user: Cannot 'reboot' instance e3975993-61a4-40e2-b5c6-19411a0511d1 while it is in vm_state rescued {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:08.923540 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8f1b043d-f363-46a8-9789-aea60e93e987 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "POST /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1/action" status: 409 len: 145 microversion: 2.1 time: 0.075162 Jul 20 04:44:08.924363 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2496/5228] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:08 2022] POST /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1/action => generated 145 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:44:08.946147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d1d10577-564a-4d95-b88f-18bef932e818 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:08.947703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d1d10577-564a-4d95-b88f-18bef932e818 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:08.962229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1d10577-564a-4d95-b88f-18bef932e818 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.964931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1d10577-564a-4d95-b88f-18bef932e818 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.969550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1d10577-564a-4d95-b88f-18bef932e818 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.970067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1d10577-564a-4d95-b88f-18bef932e818 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:09.023069 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-d1d10577-564a-4d95-b88f-18bef932e818 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] HTTP exception thrown: Cannot 'rebuild' instance e3975993-61a4-40e2-b5c6-19411a0511d1 while it is in vm_state rescued Jul 20 04:44:09.027164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-48868ca7-f29b-49bd-b420-f12c0736f396 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d1d10577-564a-4d95-b88f-18bef932e818 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Request method failure captured: Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1/action HTTP/1.1 Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 65 Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14cCAXHTn9-xjP9-j6Y5H3QclpCYHsqBLpRpQihoTalzGkb0NJB3tQRrqwgEU6RYcb1rSLMpRe6OHLIl_vuXQ5sxjCNslRe7DUQ3JshdANU3fqjJB1ce8j9t6r_FeEMPekMuZI1SQ7JdDTpAgLs_ZRs_OCOFW6Xgy06EebnWW58puJk Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 3e123ad99de64f50b9cd4373597c3a9e Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3e123ad99de64f50b9cd4373597c3a9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3e123ad99de64f50b9cd4373597c3a9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3e123ad99de64f50b9cd4373597c3a9e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3e123ad99de64f50b9cd4373597c3a9e"}]}] Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 3e123ad99de64f50b9cd4373597c3a9e Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerRescueNegativeTestJSON-810656662-project Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 8ea213e79bcf4aaea49446db5eb55271 Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-810656662-project Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: {"rebuild": {"imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b"}} Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: exception: Cannot 'rebuild' instance e3975993-61a4-40e2-b5c6-19411a0511d1 while it is in vm_state rescued Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'e3975993-61a4-40e2-b5c6-19411a0511d1', 'body': {'rebuild': {'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b'}}} Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e3975993-61a4-40e2-b5c6-19411a0511d1 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:09.031685 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance e3975993-61a4-40e2-b5c6-19411a0511d1 while it is in vm_state rescued Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance e3975993-61a4-40e2-b5c6-19411a0511d1 while it is in vm_state rescued Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d1d10577-564a-4d95-b88f-18bef932e818 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Returning 409 to user: Cannot 'rebuild' instance e3975993-61a4-40e2-b5c6-19411a0511d1 while it is in vm_state rescued {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:09.036950 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d1d10577-564a-4d95-b88f-18bef932e818 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "POST /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1/action" status: 409 len: 146 microversion: 2.1 time: 0.099676 Jul 20 04:44:09.039862 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-48868ca7-f29b-49bd-b420-f12c0736f396 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1522 microversion: 2.1 time: 0.285975 Jul 20 04:44:09.040429 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2497/5229] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:08 2022] POST /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1/action => generated 146 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:44:09.049583 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2733/5230] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:08 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:09.052160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-13b9735d-420d-49b3-ad3c-60cd4687ffda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:09.070037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-13b9735d-420d-49b3-ad3c-60cd4687ffda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:09.088160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13b9735d-420d-49b3-ad3c-60cd4687ffda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:09.095582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13b9735d-420d-49b3-ad3c-60cd4687ffda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:09.096440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13b9735d-420d-49b3-ad3c-60cd4687ffda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:09.097006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13b9735d-420d-49b3-ad3c-60cd4687ffda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:09.153732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-13b9735d-420d-49b3-ad3c-60cd4687ffda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:44:09.296211 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-13b9735d-420d-49b3-ad3c-60cd4687ffda tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "DELETE /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 204 len: 0 microversion: 2.1 time: 0.252850 Jul 20 04:44:09.300838 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2734/5231] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:09 2022] DELETE /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:44:09.309045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3c2f7263-1bdd-4181-9a29-0ce40b6444b3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:09.311242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3c2f7263-1bdd-4181-9a29-0ce40b6444b3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:09.320859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c2f7263-1bdd-4181-9a29-0ce40b6444b3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:09.321616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c2f7263-1bdd-4181-9a29-0ce40b6444b3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:09.322520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c2f7263-1bdd-4181-9a29-0ce40b6444b3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:09.323215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c2f7263-1bdd-4181-9a29-0ce40b6444b3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:09.643521 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3c2f7263-1bdd-4181-9a29-0ce40b6444b3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:09.657788 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3c2f7263-1bdd-4181-9a29-0ce40b6444b3 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1689 microversion: 2.1 time: 0.355362 Jul 20 04:44:09.658875 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2498/5232] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:09 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1689 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:09.820753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-abe4783c-a79e-4fc6-8633-40cc9dcba77a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:09.821479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-abe4783c-a79e-4fc6-8633-40cc9dcba77a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:09.838478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abe4783c-a79e-4fc6-8633-40cc9dcba77a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:09.840816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abe4783c-a79e-4fc6-8633-40cc9dcba77a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:09.841985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abe4783c-a79e-4fc6-8633-40cc9dcba77a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:09.842683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abe4783c-a79e-4fc6-8633-40cc9dcba77a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:09.949710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-fca7623f-c95a-4dd0-9634-bcdda2350cf3 req-d449a818-06de-43b3-ba5c-ef464302f4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc44474d-f1ac-43fd-bc65-8ff2790a9f48", "name": "network-vif-plugged", "status": "completed", "tag": "8c0d9620-c702-4453-a7d5-6e83ca9964b9"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:09.960618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-abe4783c-a79e-4fc6-8633-40cc9dcba77a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:09.962171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-fca7623f-c95a-4dd0-9634-bcdda2350cf3 req-d449a818-06de-43b3-ba5c-ef464302f4c7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:09.963936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-fca7623f-c95a-4dd0-9634-bcdda2350cf3 req-d449a818-06de-43b3-ba5c-ef464302f4c7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:09.978739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-abe4783c-a79e-4fc6-8633-40cc9dcba77a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:09.982502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-abe4783c-a79e-4fc6-8633-40cc9dcba77a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:09.984592 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-abe4783c-a79e-4fc6-8633-40cc9dcba77a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1336 microversion: 2.47 time: 0.168470 Jul 20 04:44:09.989485 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2735/5233] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:09 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1336 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:10.016486 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-fca7623f-c95a-4dd0-9634-bcdda2350cf3 req-d449a818-06de-43b3-ba5c-ef464302f4c7 service nova] Creating event network-vif-plugged:8c0d9620-c702-4453-a7d5-6e83ca9964b9 for instance dc44474d-f1ac-43fd-bc65-8ff2790a9f48 on n-h2-826526-5 Jul 20 04:44:10.032837 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-fca7623f-c95a-4dd0-9634-bcdda2350cf3 req-d449a818-06de-43b3-ba5c-ef464302f4c7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084883 Jul 20 04:44:10.036676 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2499/5234] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:44:10.073798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c3106de5-33cc-4b3c-bb9d-35dd5e469903 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:10.074673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c3106de5-33cc-4b3c-bb9d-35dd5e469903 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:10.097396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3106de5-33cc-4b3c-bb9d-35dd5e469903 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:10.099430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3106de5-33cc-4b3c-bb9d-35dd5e469903 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:10.101478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3106de5-33cc-4b3c-bb9d-35dd5e469903 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:10.111803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3106de5-33cc-4b3c-bb9d-35dd5e469903 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:10.459206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c3106de5-33cc-4b3c-bb9d-35dd5e469903 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:10.469990 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c3106de5-33cc-4b3c-bb9d-35dd5e469903 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1522 microversion: 2.1 time: 0.408764 Jul 20 04:44:10.471665 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2736/5235] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:10 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:10.677753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-39340f76-9de5-409d-ab34-ab128f101135 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:10.679040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-39340f76-9de5-409d-ab34-ab128f101135 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:10.694487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39340f76-9de5-409d-ab34-ab128f101135 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:10.697262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39340f76-9de5-409d-ab34-ab128f101135 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:10.702705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39340f76-9de5-409d-ab34-ab128f101135 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:10.704997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39340f76-9de5-409d-ab34-ab128f101135 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:10.908979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-39340f76-9de5-409d-ab34-ab128f101135 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:10.917382 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-39340f76-9de5-409d-ab34-ab128f101135 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1689 microversion: 2.1 time: 0.245968 Jul 20 04:44:10.918328 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2500/5236] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:10 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1689 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:11.007406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bc6d57f1-cf4e-4c2b-8701-28b7f2cf9b91 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:11.008638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bc6d57f1-cf4e-4c2b-8701-28b7f2cf9b91 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:11.016347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc6d57f1-cf4e-4c2b-8701-28b7f2cf9b91 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:11.017045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc6d57f1-cf4e-4c2b-8701-28b7f2cf9b91 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:11.018390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc6d57f1-cf4e-4c2b-8701-28b7f2cf9b91 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:11.019094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc6d57f1-cf4e-4c2b-8701-28b7f2cf9b91 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:11.108400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bc6d57f1-cf4e-4c2b-8701-28b7f2cf9b91 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:11.124237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bc6d57f1-cf4e-4c2b-8701-28b7f2cf9b91 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:11.126276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bc6d57f1-cf4e-4c2b-8701-28b7f2cf9b91 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:11.127527 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bc6d57f1-cf4e-4c2b-8701-28b7f2cf9b91 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1336 microversion: 2.47 time: 0.124959 Jul 20 04:44:11.128106 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2737/5237] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:11 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1336 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:11.491159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2c0699a9-5722-4a84-88e5-24151da75d0e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:11.492226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2c0699a9-5722-4a84-88e5-24151da75d0e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:11.506007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c0699a9-5722-4a84-88e5-24151da75d0e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:11.507080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c0699a9-5722-4a84-88e5-24151da75d0e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:11.509282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c0699a9-5722-4a84-88e5-24151da75d0e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:11.511249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c0699a9-5722-4a84-88e5-24151da75d0e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:11.756425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2c0699a9-5722-4a84-88e5-24151da75d0e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:11.769649 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2c0699a9-5722-4a84-88e5-24151da75d0e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1522 microversion: 2.1 time: 0.282042 Jul 20 04:44:11.770254 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2501/5238] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:11 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:11.942527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7e10420c-7d17-406c-a097-f0a35b6a7a09 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:11.943143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7e10420c-7d17-406c-a097-f0a35b6a7a09 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:11.949691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7e10420c-7d17-406c-a097-f0a35b6a7a09 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:11.950250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7e10420c-7d17-406c-a097-f0a35b6a7a09 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:11.950978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7e10420c-7d17-406c-a097-f0a35b6a7a09 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:11.951669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7e10420c-7d17-406c-a097-f0a35b6a7a09 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:11.954859 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:12.134986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7e10420c-7d17-406c-a097-f0a35b6a7a09 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:12.146632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3c980705-f5cb-48b3-b6d0-602b6f5726bf tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:12.147257 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3c980705-f5cb-48b3-b6d0-602b6f5726bf tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:12.151172 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7e10420c-7d17-406c-a097-f0a35b6a7a09 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1689 microversion: 2.1 time: 0.212459 Jul 20 04:44:12.153733 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2738/5239] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:11 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1689 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:12.157447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c980705-f5cb-48b3-b6d0-602b6f5726bf tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:12.158412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c980705-f5cb-48b3-b6d0-602b6f5726bf tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:12.159475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c980705-f5cb-48b3-b6d0-602b6f5726bf tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:12.160243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c980705-f5cb-48b3-b6d0-602b6f5726bf tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:12.233636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3c980705-f5cb-48b3-b6d0-602b6f5726bf tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:12.244951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3c980705-f5cb-48b3-b6d0-602b6f5726bf tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:12.246862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3c980705-f5cb-48b3-b6d0-602b6f5726bf tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:12.249767 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3c980705-f5cb-48b3-b6d0-602b6f5726bf tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1336 microversion: 2.47 time: 0.107379 Jul 20 04:44:12.251510 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2502/5240] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:12 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1336 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:44:12.787372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d6f159d2-d36c-4fc2-b67d-9bdc4bc96065 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:12.788191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d6f159d2-d36c-4fc2-b67d-9bdc4bc96065 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:12.795683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6f159d2-d36c-4fc2-b67d-9bdc4bc96065 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:12.796466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6f159d2-d36c-4fc2-b67d-9bdc4bc96065 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:12.797460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6f159d2-d36c-4fc2-b67d-9bdc4bc96065 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:12.798342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d6f159d2-d36c-4fc2-b67d-9bdc4bc96065 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.052794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d6f159d2-d36c-4fc2-b67d-9bdc4bc96065 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:13.071472 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d6f159d2-d36c-4fc2-b67d-9bdc4bc96065 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1507 microversion: 2.1 time: 0.288292 Jul 20 04:44:13.077493 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2739/5241] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:12 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1507 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:13.092731 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4ede4373-43c2-44ef-a36e-381708a660d4 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:13.093261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4ede4373-43c2-44ef-a36e-381708a660d4 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:13.107279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ede4373-43c2-44ef-a36e-381708a660d4 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.109004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ede4373-43c2-44ef-a36e-381708a660d4 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.110612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ede4373-43c2-44ef-a36e-381708a660d4 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.111132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ede4373-43c2-44ef-a36e-381708a660d4 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.172798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-448b68fa-5535-4058-bb54-038c2495e6ac tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:13.176826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-448b68fa-5535-4058-bb54-038c2495e6ac tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:13.187699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-448b68fa-5535-4058-bb54-038c2495e6ac tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.189262 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-448b68fa-5535-4058-bb54-038c2495e6ac tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.190468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-448b68fa-5535-4058-bb54-038c2495e6ac tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.191170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-448b68fa-5535-4058-bb54-038c2495e6ac tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.401743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4ede4373-43c2-44ef-a36e-381708a660d4 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:13.411479 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4ede4373-43c2-44ef-a36e-381708a660d4 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 200 len: 1507 microversion: 2.1 time: 0.322712 Jul 20 04:44:13.412017 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2503/5242] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:13 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 1507 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:13.435978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-448b68fa-5535-4058-bb54-038c2495e6ac tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:13.438078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-64a5a06d-aff2-407e-a2c2-bd78de33f700 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:13.438982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-64a5a06d-aff2-407e-a2c2-bd78de33f700 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:13.452842 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-448b68fa-5535-4058-bb54-038c2495e6ac tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1689 microversion: 2.1 time: 0.283114 Jul 20 04:44:13.453778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64a5a06d-aff2-407e-a2c2-bd78de33f700 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.454233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64a5a06d-aff2-407e-a2c2-bd78de33f700 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.455018 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64a5a06d-aff2-407e-a2c2-bd78de33f700 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.455174 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2740/5243] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:13 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1689 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:13.458532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64a5a06d-aff2-407e-a2c2-bd78de33f700 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.477175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-55c75231-ccec-4fc5-8af6-ee6519826ffc tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:13.481878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-55c75231-ccec-4fc5-8af6-ee6519826ffc tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:13.500368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55c75231-ccec-4fc5-8af6-ee6519826ffc tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.500980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55c75231-ccec-4fc5-8af6-ee6519826ffc tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.507830 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55c75231-ccec-4fc5-8af6-ee6519826ffc tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.508600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55c75231-ccec-4fc5-8af6-ee6519826ffc tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.547485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-55c75231-ccec-4fc5-8af6-ee6519826ffc tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:44:13.631384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-64a5a06d-aff2-407e-a2c2-bd78de33f700 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:13.644584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-64a5a06d-aff2-407e-a2c2-bd78de33f700 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:13.646212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-64a5a06d-aff2-407e-a2c2-bd78de33f700 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:13.660837 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-64a5a06d-aff2-407e-a2c2-bd78de33f700 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1336 microversion: 2.47 time: 0.229127 Jul 20 04:44:13.664527 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2504/5244] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:13 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1336 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:13.775010 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-55c75231-ccec-4fc5-8af6-ee6519826ffc tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 204 len: 0 microversion: 2.1 time: 0.318341 Jul 20 04:44:13.786586 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2741/5245] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:13 2022] DELETE /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:44:14.106407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0394c1e7-72d6-4c63-afd8-270bce264e29 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-449569728", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "74637077-d0a9-4590-b4c3-611177f1dfda"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:14.189183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-0394c1e7-72d6-4c63-afd8-270bce264e29 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] validate_networks() for [('74637077-d0a9-4590-b4c3-611177f1dfda', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:44:14.476556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f4bce901-db40-4ee0-b7d7-a51389e689a5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:14.477838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f4bce901-db40-4ee0-b7d7-a51389e689a5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:14.496870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4bce901-db40-4ee0-b7d7-a51389e689a5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:14.498469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4bce901-db40-4ee0-b7d7-a51389e689a5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:14.500160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4bce901-db40-4ee0-b7d7-a51389e689a5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:14.502633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f4bce901-db40-4ee0-b7d7-a51389e689a5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:14.864914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f4bce901-db40-4ee0-b7d7-a51389e689a5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:14.880206 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f4bce901-db40-4ee0-b7d7-a51389e689a5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1689 microversion: 2.1 time: 0.408715 Jul 20 04:44:14.880846 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2742/5246] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:14 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1689 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:14.892356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-83ecb0d9-6a64-43ac-bf9a-6e661f8513a2 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:14.893047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-83ecb0d9-6a64-43ac-bf9a-6e661f8513a2 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:14.901889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83ecb0d9-6a64-43ac-bf9a-6e661f8513a2 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:14.904899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83ecb0d9-6a64-43ac-bf9a-6e661f8513a2 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:14.905721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83ecb0d9-6a64-43ac-bf9a-6e661f8513a2 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:14.906225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83ecb0d9-6a64-43ac-bf9a-6e661f8513a2 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:15.012997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-83ecb0d9-6a64-43ac-bf9a-6e661f8513a2 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:15.034143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-83ecb0d9-6a64-43ac-bf9a-6e661f8513a2 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:15.037941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-83ecb0d9-6a64-43ac-bf9a-6e661f8513a2 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:15.039781 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-83ecb0d9-6a64-43ac-bf9a-6e661f8513a2 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1357 microversion: 2.47 time: 0.157995 Jul 20 04:44:15.040367 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2743/5247] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:14 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:15.060033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-58205c9c-2eb6-490c-bc5a-09e8b4fedbdc tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:15.061490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-58205c9c-2eb6-490c-bc5a-09e8b4fedbdc tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:15.071809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58205c9c-2eb6-490c-bc5a-09e8b4fedbdc tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:15.072880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58205c9c-2eb6-490c-bc5a-09e8b4fedbdc tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:15.075190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58205c9c-2eb6-490c-bc5a-09e8b4fedbdc tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:15.075845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58205c9c-2eb6-490c-bc5a-09e8b4fedbdc tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:15.273869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:15.284529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-58205c9c-2eb6-490c-bc5a-09e8b4fedbdc tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:44:15.285155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-58205c9c-2eb6-490c-bc5a-09e8b4fedbdc tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:44:15.286291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-58205c9c-2eb6-490c-bc5a-09e8b4fedbdc tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:44:15.287750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-58205c9c-2eb6-490c-bc5a-09e8b4fedbdc tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:44:15.288603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-58205c9c-2eb6-490c-bc5a-09e8b4fedbdc tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:44:15.406753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-58205c9c-2eb6-490c-bc5a-09e8b4fedbdc tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:15.434224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58205c9c-2eb6-490c-bc5a-09e8b4fedbdc tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:15.434683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58205c9c-2eb6-490c-bc5a-09e8b4fedbdc tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:15.438901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58205c9c-2eb6-490c-bc5a-09e8b4fedbdc tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:15.439433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-58205c9c-2eb6-490c-bc5a-09e8b4fedbdc tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:15.569215 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-58205c9c-2eb6-490c-bc5a-09e8b4fedbdc tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "POST /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208/action" status: 202 len: 1079 microversion: 2.47 time: 0.511361 Jul 20 04:44:15.582183 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2744/5248] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jul 20 04:44:15 2022] POST /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208/action => generated 1079 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 04:44:15.601183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-81ae7e0a-93a9-418a-b8e7-430356b8b51f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:15.602697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-81ae7e0a-93a9-418a-b8e7-430356b8b51f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:15.613048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81ae7e0a-93a9-418a-b8e7-430356b8b51f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:15.614233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81ae7e0a-93a9-418a-b8e7-430356b8b51f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:15.615729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81ae7e0a-93a9-418a-b8e7-430356b8b51f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:15.616519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81ae7e0a-93a9-418a-b8e7-430356b8b51f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:15.629953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:15.791716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-81ae7e0a-93a9-418a-b8e7-430356b8b51f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:15.803473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-81ae7e0a-93a9-418a-b8e7-430356b8b51f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:15.820154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-81ae7e0a-93a9-418a-b8e7-430356b8b51f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:15.823328 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-81ae7e0a-93a9-418a-b8e7-430356b8b51f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.229409 Jul 20 04:44:15.824515 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2745/5249] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:15 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:44:15.899404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0903451c-4cb0-4c88-9cd6-3b649d83a457 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:15.900597 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0903451c-4cb0-4c88-9cd6-3b649d83a457 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:15.913716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0903451c-4cb0-4c88-9cd6-3b649d83a457 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:15.915416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0903451c-4cb0-4c88-9cd6-3b649d83a457 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:15.917184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0903451c-4cb0-4c88-9cd6-3b649d83a457 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:15.918880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0903451c-4cb0-4c88-9cd6-3b649d83a457 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:16.052014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0903451c-4cb0-4c88-9cd6-3b649d83a457 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:16.061538 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0903451c-4cb0-4c88-9cd6-3b649d83a457 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1621 microversion: 2.1 time: 0.166557 Jul 20 04:44:16.062420 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2746/5250] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:15 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1621 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:16.135447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=16 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:16.324041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0394c1e7-72d6-4c63-afd8-270bce264e29 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:44:16.324657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0394c1e7-72d6-4c63-afd8-270bce264e29 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:44:16.325394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0394c1e7-72d6-4c63-afd8-270bce264e29 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:44:16.325847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0394c1e7-72d6-4c63-afd8-270bce264e29 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:44:16.326294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0394c1e7-72d6-4c63-afd8-270bce264e29 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:44:16.339507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0394c1e7-72d6-4c63-afd8-270bce264e29 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:16.346126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0394c1e7-72d6-4c63-afd8-270bce264e29 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:16.349681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0394c1e7-72d6-4c63-afd8-270bce264e29 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:16.350457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0394c1e7-72d6-4c63-afd8-270bce264e29 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:16.385655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-83405d68-4b74-45c6-aa91-6950a2ae1ac9 req-bc8895d0-5759-4597-b212-dddf6a8137e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "085f0971-9269-4d32-8eeb-17e7bf8143c2", "name": "network-vif-deleted", "tag": "52337d8b-3bd5-408a-b197-2f38bf1e0818"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:16.401309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-83405d68-4b74-45c6-aa91-6950a2ae1ac9 req-bc8895d0-5759-4597-b212-dddf6a8137e3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:16.401757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-83405d68-4b74-45c6-aa91-6950a2ae1ac9 req-bc8895d0-5759-4597-b212-dddf6a8137e3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:16.424040 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-83405d68-4b74-45c6-aa91-6950a2ae1ac9 req-bc8895d0-5759-4597-b212-dddf6a8137e3 service nova] Creating event network-vif-deleted:52337d8b-3bd5-408a-b197-2f38bf1e0818 for instance 085f0971-9269-4d32-8eeb-17e7bf8143c2 on n-h1-826526-5 Jul 20 04:44:16.429867 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-83405d68-4b74-45c6-aa91-6950a2ae1ac9 req-bc8895d0-5759-4597-b212-dddf6a8137e3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047593 Jul 20 04:44:16.431141 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2747/5251] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:44:16.450455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-0394c1e7-72d6-4c63-afd8-270bce264e29 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Getting quotas for project c445f8434bd0407c8ea69b8aeed234be. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:44:16.467575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-0394c1e7-72d6-4c63-afd8-270bce264e29 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Getting quotas for user 336e0b9a90f94c0d9337fe6e8a1727f1 and project c445f8434bd0407c8ea69b8aeed234be. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:44:16.502758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0394c1e7-72d6-4c63-afd8-270bce264e29 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:44:16.509322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0394c1e7-72d6-4c63-afd8-270bce264e29 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:44:16.652572 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0394c1e7-72d6-4c63-afd8-270bce264e29 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.550882 Jul 20 04:44:16.653264 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2505/5252] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:44:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:44:16.665739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fdc1fa8a-cbd5-4dbd-a889-f2a9aa2d7348 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:16.666458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fdc1fa8a-cbd5-4dbd-a889-f2a9aa2d7348 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:16.776639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fdc1fa8a-cbd5-4dbd-a889-f2a9aa2d7348 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:16.786732 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fdc1fa8a-cbd5-4dbd-a889-f2a9aa2d7348 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1217 microversion: 2.1 time: 0.124851 Jul 20 04:44:16.789567 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2748/5253] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:16 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1217 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:16.842094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-caf35a66-19f6-44ce-86e4-f51fe84e8293 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:16.842714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-caf35a66-19f6-44ce-86e4-f51fe84e8293 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:16.854875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-caf35a66-19f6-44ce-86e4-f51fe84e8293 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:16.859137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-caf35a66-19f6-44ce-86e4-f51fe84e8293 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:16.862808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-caf35a66-19f6-44ce-86e4-f51fe84e8293 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:16.864073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-caf35a66-19f6-44ce-86e4-f51fe84e8293 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:17.058942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-caf35a66-19f6-44ce-86e4-f51fe84e8293 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:17.081386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2255e531-0473-46d0-9cca-f3e67b3a3dcd tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:17.081645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-caf35a66-19f6-44ce-86e4-f51fe84e8293 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:17.082949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2255e531-0473-46d0-9cca-f3e67b3a3dcd tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:17.095867 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-caf35a66-19f6-44ce-86e4-f51fe84e8293 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:17.098898 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-caf35a66-19f6-44ce-86e4-f51fe84e8293 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.260618 Jul 20 04:44:17.104844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2255e531-0473-46d0-9cca-f3e67b3a3dcd tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:17.107074 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2506/5254] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:16 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:17.108020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2255e531-0473-46d0-9cca-f3e67b3a3dcd tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:17.109078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2255e531-0473-46d0-9cca-f3e67b3a3dcd tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:17.109716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2255e531-0473-46d0-9cca-f3e67b3a3dcd tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:17.246742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2255e531-0473-46d0-9cca-f3e67b3a3dcd tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:17.247201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2255e531-0473-46d0-9cca-f3e67b3a3dcd tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:17.250562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-2255e531-0473-46d0-9cca-f3e67b3a3dcd tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lazy-loading 'fault' on Instance uuid 085f0971-9269-4d32-8eeb-17e7bf8143c2 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:44:17.411716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2255e531-0473-46d0-9cca-f3e67b3a3dcd tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:17.420164 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2255e531-0473-46d0-9cca-f3e67b3a3dcd tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 200 len: 1335 microversion: 2.1 time: 0.343438 Jul 20 04:44:17.420804 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2749/5255] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:17 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 1335 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:17.809185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0a168901-7dc9-4cb5-aee3-8f950787b89c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:17.810408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0a168901-7dc9-4cb5-aee3-8f950787b89c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:17.894010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0a168901-7dc9-4cb5-aee3-8f950787b89c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:17.902857 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0a168901-7dc9-4cb5-aee3-8f950787b89c tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1217 microversion: 2.1 time: 0.099204 Jul 20 04:44:17.903698 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2507/5256] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:17 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:18.125429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-28e32e9e-3797-41ae-ba73-51e65b885d12 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:18.126060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-28e32e9e-3797-41ae-ba73-51e65b885d12 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:18.137839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28e32e9e-3797-41ae-ba73-51e65b885d12 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.142827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28e32e9e-3797-41ae-ba73-51e65b885d12 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.142827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28e32e9e-3797-41ae-ba73-51e65b885d12 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.142827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28e32e9e-3797-41ae-ba73-51e65b885d12 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.237661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-28e32e9e-3797-41ae-ba73-51e65b885d12 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:18.250911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-28e32e9e-3797-41ae-ba73-51e65b885d12 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:18.252686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-28e32e9e-3797-41ae-ba73-51e65b885d12 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:18.254835 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-28e32e9e-3797-41ae-ba73-51e65b885d12 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.134317 Jul 20 04:44:18.256708 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2750/5257] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:18 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:18.448301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2e764abf-4b71-4bcc-b498-322ce6155054 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:18.449355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2e764abf-4b71-4bcc-b498-322ce6155054 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: 085f0971-9269-4d32-8eeb-17e7bf8143c2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:18.485754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e764abf-4b71-4bcc-b498-322ce6155054 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.487053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e764abf-4b71-4bcc-b498-322ce6155054 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.491290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e764abf-4b71-4bcc-b498-322ce6155054 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.498213 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e764abf-4b71-4bcc-b498-322ce6155054 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.542861 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-2e764abf-4b71-4bcc-b498-322ce6155054 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] HTTP exception thrown: Instance 085f0971-9269-4d32-8eeb-17e7bf8143c2 could not be found. Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2e764abf-4b71-4bcc-b498-322ce6155054 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Request method failure captured: Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 HTTP/1.1 Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14cCAXHTn9-xjP9-j6Y5H3QclpCYHsqBLpRpQihoTalzGkb0NJB3tQRrqwgEU6RYcb1rSLMpRe6OHLIl_vuXQ5sxjCNslRe7DUQ3JshdANU3fqjJB1ce8j9t6r_FeEMPekMuZI1SQ7JdDTpAgLs_ZRs_OCOFW6Xgy06EebnWW58puJk Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 3e123ad99de64f50b9cd4373597c3a9e Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3e123ad99de64f50b9cd4373597c3a9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3e123ad99de64f50b9cd4373597c3a9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3e123ad99de64f50b9cd4373597c3a9e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3e123ad99de64f50b9cd4373597c3a9e"}]}] Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 3e123ad99de64f50b9cd4373597c3a9e Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerRescueNegativeTestJSON-810656662-project Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 8ea213e79bcf4aaea49446db5eb55271 Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-810656662-project Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 085f0971-9269-4d32-8eeb-17e7bf8143c2 could not be found. Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '085f0971-9269-4d32-8eeb-17e7bf8143c2'} Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 085f0971-9269-4d32-8eeb-17e7bf8143c2 could not be found. Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 085f0971-9269-4d32-8eeb-17e7bf8143c2 could not be found. Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:18.564859 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:18.569597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:18.569597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:18.569597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:18.569597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:18.569597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:18.569597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 085f0971-9269-4d32-8eeb-17e7bf8143c2 could not be found. Jul 20 04:44:18.569597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:18.574629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2e764abf-4b71-4bcc-b498-322ce6155054 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Returning 404 to user: Instance 085f0971-9269-4d32-8eeb-17e7bf8143c2 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:18.575962 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2e764abf-4b71-4bcc-b498-322ce6155054 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2" status: 404 len: 111 microversion: 2.1 time: 0.143062 Jul 20 04:44:18.578525 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2508/5258] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:18 2022] GET /compute/v2.1/servers/085f0971-9269-4d32-8eeb-17e7bf8143c2 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:18.585881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-66ee518b-0385-4bde-85f2-de1ada1410e2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '.version_select at 0x7f06bdd3aee0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:18.612302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-4a501f33-d21d-4c5f-8784-0070c043263d req-6d2dc2ff-9ad5-411d-b05c-3bf9120d3669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc44474d-f1ac-43fd-bc65-8ff2790a9f48", "name": "network-vif-deleted", "tag": "8c0d9620-c702-4453-a7d5-6e83ca9964b9"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:18.641150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4a501f33-d21d-4c5f-8784-0070c043263d req-6d2dc2ff-9ad5-411d-b05c-3bf9120d3669 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.641687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4a501f33-d21d-4c5f-8784-0070c043263d req-6d2dc2ff-9ad5-411d-b05c-3bf9120d3669 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.649855 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-66ee518b-0385-4bde-85f2-de1ada1410e2 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055539102" status: 202 len: 0 microversion: 2.1 time: 0.063018 Jul 20 04:44:18.661588 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-4a501f33-d21d-4c5f-8784-0070c043263d req-6d2dc2ff-9ad5-411d-b05c-3bf9120d3669 service nova] Creating event network-vif-deleted:8c0d9620-c702-4453-a7d5-6e83ca9964b9 for instance dc44474d-f1ac-43fd-bc65-8ff2790a9f48 on n-h2-826526-5 Jul 20 04:44:18.665952 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2751/5259] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jul 20 04:44:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055539102 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:44:18.676133 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-4a501f33-d21d-4c5f-8784-0070c043263d req-6d2dc2ff-9ad5-411d-b05c-3bf9120d3669 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067936 Jul 20 04:44:18.677553 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2509/5260] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:18.922510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3fef75c2-5e06-4580-a653-02b15e8b62fe tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:18.923205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3fef75c2-5e06-4580-a653-02b15e8b62fe tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:18.939295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fef75c2-5e06-4580-a653-02b15e8b62fe tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.942068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fef75c2-5e06-4580-a653-02b15e8b62fe tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.943285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fef75c2-5e06-4580-a653-02b15e8b62fe tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.943789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3fef75c2-5e06-4580-a653-02b15e8b62fe tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:19.086220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3fef75c2-5e06-4580-a653-02b15e8b62fe tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:19.099688 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3fef75c2-5e06-4580-a653-02b15e8b62fe tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1275 microversion: 2.1 time: 0.179691 Jul 20 04:44:19.101108 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2752/5261] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:18 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1275 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:19.280136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3e09da27-5216-4bdb-ae3a-b07f1c7fd0af tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:19.281468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3e09da27-5216-4bdb-ae3a-b07f1c7fd0af tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:19.311302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e09da27-5216-4bdb-ae3a-b07f1c7fd0af tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:19.312500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e09da27-5216-4bdb-ae3a-b07f1c7fd0af tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:19.314222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e09da27-5216-4bdb-ae3a-b07f1c7fd0af tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:19.317176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e09da27-5216-4bdb-ae3a-b07f1c7fd0af tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:19.509236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3e09da27-5216-4bdb-ae3a-b07f1c7fd0af tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:19.525190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3e09da27-5216-4bdb-ae3a-b07f1c7fd0af tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:19.527005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3e09da27-5216-4bdb-ae3a-b07f1c7fd0af tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:19.528410 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3e09da27-5216-4bdb-ae3a-b07f1c7fd0af tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.257903 Jul 20 04:44:19.551026 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2510/5262] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:19 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:20.130365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6986b290-e736-4d36-a0ce-09df7593ced9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:20.135848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6986b290-e736-4d36-a0ce-09df7593ced9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:20.146946 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6986b290-e736-4d36-a0ce-09df7593ced9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:20.147876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6986b290-e736-4d36-a0ce-09df7593ced9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:20.149285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6986b290-e736-4d36-a0ce-09df7593ced9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:20.149834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6986b290-e736-4d36-a0ce-09df7593ced9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:20.169572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:20.427582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6986b290-e736-4d36-a0ce-09df7593ced9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:20.438623 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6986b290-e736-4d36-a0ce-09df7593ced9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1317 microversion: 2.1 time: 0.315389 Jul 20 04:44:20.447482 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2753/5263] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:20 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:20.547324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-228fa497-67a5-4191-9bbf-d01a8950b7e3 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:20.548049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-228fa497-67a5-4191-9bbf-d01a8950b7e3 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:20.567976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-228fa497-67a5-4191-9bbf-d01a8950b7e3 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:20.568455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-228fa497-67a5-4191-9bbf-d01a8950b7e3 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:20.571536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-228fa497-67a5-4191-9bbf-d01a8950b7e3 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:20.577212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-228fa497-67a5-4191-9bbf-d01a8950b7e3 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:20.798715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-228fa497-67a5-4191-9bbf-d01a8950b7e3 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:20.809116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-228fa497-67a5-4191-9bbf-d01a8950b7e3 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:20.816869 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-228fa497-67a5-4191-9bbf-d01a8950b7e3 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:20.821825 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-228fa497-67a5-4191-9bbf-d01a8950b7e3 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.276680 Jul 20 04:44:20.822991 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2511/5264] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:20 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:21.465947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-49da9f00-083d-46cd-a3d6-d4942d05aca5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:21.467220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-49da9f00-083d-46cd-a3d6-d4942d05aca5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:21.482671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-49da9f00-083d-46cd-a3d6-d4942d05aca5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:21.483118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-49da9f00-083d-46cd-a3d6-d4942d05aca5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:21.483901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-49da9f00-083d-46cd-a3d6-d4942d05aca5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:21.487465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-270e7f09-32f0-49d3-96b4-4ab62f02030d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:21.489197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-270e7f09-32f0-49d3-96b4-4ab62f02030d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:21.490358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-49da9f00-083d-46cd-a3d6-d4942d05aca5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:21.500638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-270e7f09-32f0-49d3-96b4-4ab62f02030d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:21.501123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-270e7f09-32f0-49d3-96b4-4ab62f02030d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:21.502004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-270e7f09-32f0-49d3-96b4-4ab62f02030d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:21.509008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-270e7f09-32f0-49d3-96b4-4ab62f02030d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:21.565199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:21.673550 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-270e7f09-32f0-49d3-96b4-4ab62f02030d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85/action" status: 200 len: 24548 microversion: 2.1 time: 0.191600 Jul 20 04:44:21.674472 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2512/5265] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:21 2022] POST /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85/action => generated 24548 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:44:21.807802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-8933878d-2fdd-40d5-a9d9-b79caa7224a6 req-43fb6ee9-9de3-4c94-8509-322b89cf6640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf712a65-ec39-4a79-bbac-6383fb43df17", "tag": "9010fd11-7367-492b-9434-2ddf200a12d5"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:21.842932 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8933878d-2fdd-40d5-a9d9-b79caa7224a6 req-43fb6ee9-9de3-4c94-8509-322b89cf6640 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:21.843279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8933878d-2fdd-40d5-a9d9-b79caa7224a6 req-43fb6ee9-9de3-4c94-8509-322b89cf6640 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:21.911378 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-8933878d-2fdd-40d5-a9d9-b79caa7224a6 req-43fb6ee9-9de3-4c94-8509-322b89cf6640 service nova] Creating event network-changed:9010fd11-7367-492b-9434-2ddf200a12d5 for instance cf712a65-ec39-4a79-bbac-6383fb43df17 on n-h2-826526-5 Jul 20 04:44:21.938062 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-8933878d-2fdd-40d5-a9d9-b79caa7224a6 req-43fb6ee9-9de3-4c94-8509-322b89cf6640 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132456 Jul 20 04:44:21.939267 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2513/5266] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:21.952177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5d4a4c98-5df0-43ff-8880-df5ad2405a29 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:21.953197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5d4a4c98-5df0-43ff-8880-df5ad2405a29 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:21.953504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-49da9f00-083d-46cd-a3d6-d4942d05aca5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:21.966756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5d4a4c98-5df0-43ff-8880-df5ad2405a29 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:21.967894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5d4a4c98-5df0-43ff-8880-df5ad2405a29 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:21.969439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5d4a4c98-5df0-43ff-8880-df5ad2405a29 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:21.970084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5d4a4c98-5df0-43ff-8880-df5ad2405a29 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:21.971647 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-49da9f00-083d-46cd-a3d6-d4942d05aca5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1317 microversion: 2.1 time: 0.509192 Jul 20 04:44:21.973840 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2754/5267] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:21 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1317 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:22.283872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5d4a4c98-5df0-43ff-8880-df5ad2405a29 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:22.296973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5d4a4c98-5df0-43ff-8880-df5ad2405a29 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:22.302184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5d4a4c98-5df0-43ff-8880-df5ad2405a29 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:22.307294 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5d4a4c98-5df0-43ff-8880-df5ad2405a29 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.363412 Jul 20 04:44:22.310311 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2514/5268] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:21 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:22.992798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-94954f1e-db58-4e23-8af3-b477accf3fb7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:22.994418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-94954f1e-db58-4e23-8af3-b477accf3fb7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:23.005321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-94954f1e-db58-4e23-8af3-b477accf3fb7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:23.005883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-94954f1e-db58-4e23-8af3-b477accf3fb7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:23.007513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-94954f1e-db58-4e23-8af3-b477accf3fb7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:23.009257 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-94954f1e-db58-4e23-8af3-b477accf3fb7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:23.254348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-94954f1e-db58-4e23-8af3-b477accf3fb7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:23.267114 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-94954f1e-db58-4e23-8af3-b477accf3fb7 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1317 microversion: 2.1 time: 0.279395 Jul 20 04:44:23.267999 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2755/5269] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:22 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:23.329383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-46a5a003-445b-49a0-9ee6-46c0a2358a36 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:23.330094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-46a5a003-445b-49a0-9ee6-46c0a2358a36 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:23.348579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46a5a003-445b-49a0-9ee6-46c0a2358a36 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:23.349359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46a5a003-445b-49a0-9ee6-46c0a2358a36 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:23.351119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46a5a003-445b-49a0-9ee6-46c0a2358a36 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:23.352698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46a5a003-445b-49a0-9ee6-46c0a2358a36 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:23.456747 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-46a5a003-445b-49a0-9ee6-46c0a2358a36 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:23.472477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-46a5a003-445b-49a0-9ee6-46c0a2358a36 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:23.476175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-46a5a003-445b-49a0-9ee6-46c0a2358a36 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:23.478048 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-46a5a003-445b-49a0-9ee6-46c0a2358a36 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.153065 Jul 20 04:44:23.490683 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2515/5270] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:23 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:24.284839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5cc21c81-34e0-4e04-9e4d-7fc38541dcdd tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:24.285512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5cc21c81-34e0-4e04-9e4d-7fc38541dcdd tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:24.294370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5cc21c81-34e0-4e04-9e4d-7fc38541dcdd tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:24.295143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5cc21c81-34e0-4e04-9e4d-7fc38541dcdd tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:24.298249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5cc21c81-34e0-4e04-9e4d-7fc38541dcdd tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:24.299422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5cc21c81-34e0-4e04-9e4d-7fc38541dcdd tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:24.498217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a297cc0c-22b9-4580-97e6-95bbe7ac9fca tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:24.498856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a297cc0c-22b9-4580-97e6-95bbe7ac9fca tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:24.513618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a297cc0c-22b9-4580-97e6-95bbe7ac9fca tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:24.514076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a297cc0c-22b9-4580-97e6-95bbe7ac9fca tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:24.514905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a297cc0c-22b9-4580-97e6-95bbe7ac9fca tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:24.515352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a297cc0c-22b9-4580-97e6-95bbe7ac9fca tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:24.683215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a297cc0c-22b9-4580-97e6-95bbe7ac9fca tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:24.705645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a297cc0c-22b9-4580-97e6-95bbe7ac9fca tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:24.706117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5cc21c81-34e0-4e04-9e4d-7fc38541dcdd tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:24.707172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a297cc0c-22b9-4580-97e6-95bbe7ac9fca tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:24.715336 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5cc21c81-34e0-4e04-9e4d-7fc38541dcdd tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1317 microversion: 2.1 time: 0.434598 Jul 20 04:44:24.728897 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a297cc0c-22b9-4580-97e6-95bbe7ac9fca tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.214368 Jul 20 04:44:24.728897 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2516/5271] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:24 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:44:24.733268 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2756/5272] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:24 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:25.739530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0b658353-019f-4899-bfb8-1934bd67fdf9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:25.740337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0b658353-019f-4899-bfb8-1934bd67fdf9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:25.742451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e85e1429-0cf7-4a9c-a3c6-87b5b2913053 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:25.743641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e85e1429-0cf7-4a9c-a3c6-87b5b2913053 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:25.753583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b658353-019f-4899-bfb8-1934bd67fdf9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:25.756065 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b658353-019f-4899-bfb8-1934bd67fdf9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:25.757586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b658353-019f-4899-bfb8-1934bd67fdf9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:25.758416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b658353-019f-4899-bfb8-1934bd67fdf9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:25.762867 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e85e1429-0cf7-4a9c-a3c6-87b5b2913053 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:25.768968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e85e1429-0cf7-4a9c-a3c6-87b5b2913053 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:25.776762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e85e1429-0cf7-4a9c-a3c6-87b5b2913053 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:25.777359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e85e1429-0cf7-4a9c-a3c6-87b5b2913053 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:26.016436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e85e1429-0cf7-4a9c-a3c6-87b5b2913053 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:26.031909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e85e1429-0cf7-4a9c-a3c6-87b5b2913053 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:26.037864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e85e1429-0cf7-4a9c-a3c6-87b5b2913053 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:26.040417 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e85e1429-0cf7-4a9c-a3c6-87b5b2913053 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.304960 Jul 20 04:44:26.044704 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2757/5273] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:25 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:26.110327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0b658353-019f-4899-bfb8-1934bd67fdf9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:26.144139 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0b658353-019f-4899-bfb8-1934bd67fdf9 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1317 microversion: 2.1 time: 0.413427 Jul 20 04:44:26.147945 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2517/5274] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:25 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:27.065313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f3aec5a2-d821-47db-9c6f-f819b811d129 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:27.066229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f3aec5a2-d821-47db-9c6f-f819b811d129 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:27.070221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:27.085572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3aec5a2-d821-47db-9c6f-f819b811d129 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:27.089298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3aec5a2-d821-47db-9c6f-f819b811d129 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:27.090535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3aec5a2-d821-47db-9c6f-f819b811d129 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:27.091215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3aec5a2-d821-47db-9c6f-f819b811d129 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:27.171128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9bdcbcf6-1015-4fe7-b05f-89b577465669 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:27.179520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f3aec5a2-d821-47db-9c6f-f819b811d129 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:27.180120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9bdcbcf6-1015-4fe7-b05f-89b577465669 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:27.183909 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:27.189068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f3aec5a2-d821-47db-9c6f-f819b811d129 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:27.193533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f3aec5a2-d821-47db-9c6f-f819b811d129 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:27.195709 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f3aec5a2-d821-47db-9c6f-f819b811d129 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.136602 Jul 20 04:44:27.198807 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2758/5275] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:27 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:27.216081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9bdcbcf6-1015-4fe7-b05f-89b577465669 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:27.216876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9bdcbcf6-1015-4fe7-b05f-89b577465669 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:27.219012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9bdcbcf6-1015-4fe7-b05f-89b577465669 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:27.220759 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9bdcbcf6-1015-4fe7-b05f-89b577465669 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:27.425470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9bdcbcf6-1015-4fe7-b05f-89b577465669 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:27.433617 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9bdcbcf6-1015-4fe7-b05f-89b577465669 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1317 microversion: 2.1 time: 0.266412 Jul 20 04:44:27.446765 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2518/5276] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:27 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:27.994460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-00d22d3e-1da1-4c4c-9347-1520a64b6a09 req-4a14d60d-1f15-4414-9636-54b6a4cec8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf712a65-ec39-4a79-bbac-6383fb43df17", "name": "network-vif-plugged", "status": "completed", "tag": "9010fd11-7367-492b-9434-2ddf200a12d5"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:28.008774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-00d22d3e-1da1-4c4c-9347-1520a64b6a09 req-4a14d60d-1f15-4414-9636-54b6a4cec8f0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:28.011903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-00d22d3e-1da1-4c4c-9347-1520a64b6a09 req-4a14d60d-1f15-4414-9636-54b6a4cec8f0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:28.041180 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-00d22d3e-1da1-4c4c-9347-1520a64b6a09 req-4a14d60d-1f15-4414-9636-54b6a4cec8f0 service nova] Creating event network-vif-plugged:9010fd11-7367-492b-9434-2ddf200a12d5 for instance cf712a65-ec39-4a79-bbac-6383fb43df17 on n-h2-826526-5 Jul 20 04:44:28.046981 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-00d22d3e-1da1-4c4c-9347-1520a64b6a09 req-4a14d60d-1f15-4414-9636-54b6a4cec8f0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056809 Jul 20 04:44:28.048162 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2759/5277] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:28.216642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e5e93487-0bef-442b-ad5e-8bea7be22c43 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:28.217828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e5e93487-0bef-442b-ad5e-8bea7be22c43 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:28.225374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:28.234239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5e93487-0bef-442b-ad5e-8bea7be22c43 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:28.234688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5e93487-0bef-442b-ad5e-8bea7be22c43 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:28.235484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5e93487-0bef-442b-ad5e-8bea7be22c43 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:28.235966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5e93487-0bef-442b-ad5e-8bea7be22c43 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:28.333215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e5e93487-0bef-442b-ad5e-8bea7be22c43 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:28.354491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e5e93487-0bef-442b-ad5e-8bea7be22c43 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:28.365423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e5e93487-0bef-442b-ad5e-8bea7be22c43 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:28.369906 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e5e93487-0bef-442b-ad5e-8bea7be22c43 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.157311 Jul 20 04:44:28.375532 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2519/5278] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:28 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:28.458136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4ef356c4-1002-48bd-900b-f1e8cbe89e1a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:28.459552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4ef356c4-1002-48bd-900b-f1e8cbe89e1a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:28.469951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ef356c4-1002-48bd-900b-f1e8cbe89e1a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:28.470742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ef356c4-1002-48bd-900b-f1e8cbe89e1a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:28.471697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ef356c4-1002-48bd-900b-f1e8cbe89e1a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:28.472312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ef356c4-1002-48bd-900b-f1e8cbe89e1a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:28.649618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4ef356c4-1002-48bd-900b-f1e8cbe89e1a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:28.683638 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4ef356c4-1002-48bd-900b-f1e8cbe89e1a tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1317 microversion: 2.1 time: 0.236501 Jul 20 04:44:28.685979 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2760/5279] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:28 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:29.394949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-29b0e37f-1a93-4bbb-b1b4-bb904ac6cb3f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:29.395614 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-29b0e37f-1a93-4bbb-b1b4-bb904ac6cb3f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:29.410354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29b0e37f-1a93-4bbb-b1b4-bb904ac6cb3f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:29.414065 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29b0e37f-1a93-4bbb-b1b4-bb904ac6cb3f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:29.416389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29b0e37f-1a93-4bbb-b1b4-bb904ac6cb3f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:29.417601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29b0e37f-1a93-4bbb-b1b4-bb904ac6cb3f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:29.458925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ce395ac0-f19a-4625-bb73-b9771e786018 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:29.459435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ce395ac0-f19a-4625-bb73-b9771e786018 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:29.493128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce395ac0-f19a-4625-bb73-b9771e786018 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:29.493661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce395ac0-f19a-4625-bb73-b9771e786018 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:29.500516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce395ac0-f19a-4625-bb73-b9771e786018 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:29.501106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce395ac0-f19a-4625-bb73-b9771e786018 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:29.583387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-29b0e37f-1a93-4bbb-b1b4-bb904ac6cb3f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:29.607737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-29b0e37f-1a93-4bbb-b1b4-bb904ac6cb3f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:29.610931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-29b0e37f-1a93-4bbb-b1b4-bb904ac6cb3f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:29.612586 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-29b0e37f-1a93-4bbb-b1b4-bb904ac6cb3f tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.222549 Jul 20 04:44:29.613929 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2520/5280] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:29 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:29.657330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ce395ac0-f19a-4625-bb73-b9771e786018 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:44:29.715880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf5dab95-45f6-4b6c-acbb-8d909bc64317 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:29.718473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf5dab95-45f6-4b6c-acbb-8d909bc64317 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:29.741727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf5dab95-45f6-4b6c-acbb-8d909bc64317 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:29.742542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf5dab95-45f6-4b6c-acbb-8d909bc64317 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:29.743579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf5dab95-45f6-4b6c-acbb-8d909bc64317 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:29.744392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf5dab95-45f6-4b6c-acbb-8d909bc64317 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:29.886766 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ce395ac0-f19a-4625-bb73-b9771e786018 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 204 len: 0 microversion: 2.1 time: 0.431757 Jul 20 04:44:29.889020 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2761/5281] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:29 2022] DELETE /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:44:29.903998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ea1c91ab-c83c-4bc4-a0c3-1a7647c8891b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:29.907024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ea1c91ab-c83c-4bc4-a0c3-1a7647c8891b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:29.927526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea1c91ab-c83c-4bc4-a0c3-1a7647c8891b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:29.928345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea1c91ab-c83c-4bc4-a0c3-1a7647c8891b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:29.929323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea1c91ab-c83c-4bc4-a0c3-1a7647c8891b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:29.930214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea1c91ab-c83c-4bc4-a0c3-1a7647c8891b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:30.004961 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bf5dab95-45f6-4b6c-acbb-8d909bc64317 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:30.016896 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf5dab95-45f6-4b6c-acbb-8d909bc64317 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1506 microversion: 2.1 time: 0.313730 Jul 20 04:44:30.032962 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2521/5282] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:29 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:30.039176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dc8f8dea-8abd-47a3-8126-f7e37a071ecb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:30.040733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dc8f8dea-8abd-47a3-8126-f7e37a071ecb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:30.048758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc8f8dea-8abd-47a3-8126-f7e37a071ecb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:30.049491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc8f8dea-8abd-47a3-8126-f7e37a071ecb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:30.050638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc8f8dea-8abd-47a3-8126-f7e37a071ecb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:30.051293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc8f8dea-8abd-47a3-8126-f7e37a071ecb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:30.134138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ea1c91ab-c83c-4bc4-a0c3-1a7647c8891b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:30.146045 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ea1c91ab-c83c-4bc4-a0c3-1a7647c8891b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1509 microversion: 2.1 time: 0.252279 Jul 20 04:44:30.152343 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2762/5283] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:29 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:30.299329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dc8f8dea-8abd-47a3-8126-f7e37a071ecb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:30.323485 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dc8f8dea-8abd-47a3-8126-f7e37a071ecb tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1506 microversion: 2.1 time: 0.288379 Jul 20 04:44:30.328932 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2522/5284] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:30 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:30.356960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2eb68b39-f162-46d1-a669-e13918829466 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:30.362038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2eb68b39-f162-46d1-a669-e13918829466 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:30.385802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2eb68b39-f162-46d1-a669-e13918829466 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:30.386277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2eb68b39-f162-46d1-a669-e13918829466 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:30.390523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2eb68b39-f162-46d1-a669-e13918829466 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:30.393537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2eb68b39-f162-46d1-a669-e13918829466 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:30.538058 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2eb68b39-f162-46d1-a669-e13918829466 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "PUT /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1078 microversion: 2.1 time: 0.187748 Jul 20 04:44:30.539683 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2763/5285] 10.222.0.17 () {60 vars in 1255 bytes} [Wed Jul 20 04:44:30 2022] PUT /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1078 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:30.561242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b8c05162-228d-40ca-9b3e-85bb6446c7ad tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:30.563288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b8c05162-228d-40ca-9b3e-85bb6446c7ad tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:30.572125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b8c05162-228d-40ca-9b3e-85bb6446c7ad tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:30.572469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b8c05162-228d-40ca-9b3e-85bb6446c7ad tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:30.573759 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b8c05162-228d-40ca-9b3e-85bb6446c7ad tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:30.574438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b8c05162-228d-40ca-9b3e-85bb6446c7ad tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:30.634923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dc85b2fc-ef66-4f37-acde-c25861fb4b5c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:30.635172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dc85b2fc-ef66-4f37-acde-c25861fb4b5c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:30.652505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc85b2fc-ef66-4f37-acde-c25861fb4b5c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:30.659506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc85b2fc-ef66-4f37-acde-c25861fb4b5c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:30.660502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc85b2fc-ef66-4f37-acde-c25861fb4b5c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:30.662373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc85b2fc-ef66-4f37-acde-c25861fb4b5c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:30.891527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dc85b2fc-ef66-4f37-acde-c25861fb4b5c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:30.909129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dc85b2fc-ef66-4f37-acde-c25861fb4b5c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:30.910848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dc85b2fc-ef66-4f37-acde-c25861fb4b5c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:30.912041 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dc85b2fc-ef66-4f37-acde-c25861fb4b5c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.282586 Jul 20 04:44:30.912651 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2764/5286] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:30 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:44:30.968948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b8c05162-228d-40ca-9b3e-85bb6446c7ad tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:30.985916 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b8c05162-228d-40ca-9b3e-85bb6446c7ad tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1504 microversion: 2.1 time: 0.428308 Jul 20 04:44:30.996604 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2523/5287] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:30 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1504 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:31.001469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5dc252d9-cde9-417e-a89e-39a71deb17c5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:31.002435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5dc252d9-cde9-417e-a89e-39a71deb17c5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:31.016832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dc252d9-cde9-417e-a89e-39a71deb17c5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.018940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dc252d9-cde9-417e-a89e-39a71deb17c5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.021140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dc252d9-cde9-417e-a89e-39a71deb17c5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.023633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dc252d9-cde9-417e-a89e-39a71deb17c5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.341218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5dc252d9-cde9-417e-a89e-39a71deb17c5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:31.362543 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5dc252d9-cde9-417e-a89e-39a71deb17c5 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1504 microversion: 2.1 time: 0.353177 Jul 20 04:44:31.363216 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2765/5288] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:30 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1504 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:31.382406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-553526a4-4f6a-4081-b87b-e3423eac97a0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:31.390590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-553526a4-4f6a-4081-b87b-e3423eac97a0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:31.399765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-553526a4-4f6a-4081-b87b-e3423eac97a0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.400597 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-553526a4-4f6a-4081-b87b-e3423eac97a0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.402314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-553526a4-4f6a-4081-b87b-e3423eac97a0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.403389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-553526a4-4f6a-4081-b87b-e3423eac97a0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.503021 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-553526a4-4f6a-4081-b87b-e3423eac97a0 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "PUT /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1080 microversion: 2.1 time: 0.126234 Jul 20 04:44:31.504752 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2766/5289] 10.222.0.17 () {60 vars in 1255 bytes} [Wed Jul 20 04:44:31 2022] PUT /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1080 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:31.529987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b69b6696-3548-4596-941d-f3333fb8f616 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:31.533036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b69b6696-3548-4596-941d-f3333fb8f616 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:31.560077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b69b6696-3548-4596-941d-f3333fb8f616 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.560077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b69b6696-3548-4596-941d-f3333fb8f616 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.560077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b69b6696-3548-4596-941d-f3333fb8f616 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.560077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b69b6696-3548-4596-941d-f3333fb8f616 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.822980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b69b6696-3548-4596-941d-f3333fb8f616 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:31.828450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:31.847275 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b69b6696-3548-4596-941d-f3333fb8f616 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1506 microversion: 2.1 time: 0.328783 Jul 20 04:44:31.849205 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2767/5290] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:31 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:31.871268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9e121fc0-7cd5-4a88-b671-4cb35962e935 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:31.873626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9e121fc0-7cd5-4a88-b671-4cb35962e935 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:31.883344 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aa5fe29c-9867-4203-9af0-b79ed6f9ca6b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:31.884626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aa5fe29c-9867-4203-9af0-b79ed6f9ca6b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:31.892592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e121fc0-7cd5-4a88-b671-4cb35962e935 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.893184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e121fc0-7cd5-4a88-b671-4cb35962e935 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.894083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e121fc0-7cd5-4a88-b671-4cb35962e935 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.894625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e121fc0-7cd5-4a88-b671-4cb35962e935 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.909871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa5fe29c-9867-4203-9af0-b79ed6f9ca6b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.910640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa5fe29c-9867-4203-9af0-b79ed6f9ca6b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.911963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa5fe29c-9867-4203-9af0-b79ed6f9ca6b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.917207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa5fe29c-9867-4203-9af0-b79ed6f9ca6b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:32.099215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9e121fc0-7cd5-4a88-b671-4cb35962e935 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:32.111389 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9e121fc0-7cd5-4a88-b671-4cb35962e935 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1506 microversion: 2.1 time: 0.250020 Jul 20 04:44:32.112627 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2768/5291] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:31 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:32.117922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4f771dcb-9886-4d07-8a1e-c7e799db4455 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:32.118857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4f771dcb-9886-4d07-8a1e-c7e799db4455 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:32.125688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f771dcb-9886-4d07-8a1e-c7e799db4455 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:32.126573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f771dcb-9886-4d07-8a1e-c7e799db4455 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:32.127763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f771dcb-9886-4d07-8a1e-c7e799db4455 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:32.128586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f771dcb-9886-4d07-8a1e-c7e799db4455 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:32.215603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4f771dcb-9886-4d07-8a1e-c7e799db4455 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:32.225933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4f771dcb-9886-4d07-8a1e-c7e799db4455 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:32.227615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4f771dcb-9886-4d07-8a1e-c7e799db4455 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:32.228871 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4f771dcb-9886-4d07-8a1e-c7e799db4455 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.115026 Jul 20 04:44:32.229637 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2769/5292] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:32 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:32.234713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b8565ee4-c040-4b72-9c73-c750372fbb0e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:32.235238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b8565ee4-c040-4b72-9c73-c750372fbb0e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:32.243213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8565ee4-c040-4b72-9c73-c750372fbb0e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:32.244542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8565ee4-c040-4b72-9c73-c750372fbb0e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:32.246517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8565ee4-c040-4b72-9c73-c750372fbb0e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:32.246988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b8565ee4-c040-4b72-9c73-c750372fbb0e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:32.287482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b8565ee4-c040-4b72-9c73-c750372fbb0e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:44:32.498973 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b8565ee4-c040-4b72-9c73-c750372fbb0e tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 204 len: 0 microversion: 2.1 time: 0.267755 Jul 20 04:44:32.500090 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2770/5293] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:32 2022] DELETE /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:44:32.519712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d43d4e76-2c39-4c24-9f7c-af7566c74907 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:32.523768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d43d4e76-2c39-4c24-9f7c-af7566c74907 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:32.532161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d43d4e76-2c39-4c24-9f7c-af7566c74907 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:32.532785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d43d4e76-2c39-4c24-9f7c-af7566c74907 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:32.533808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d43d4e76-2c39-4c24-9f7c-af7566c74907 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:32.534517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d43d4e76-2c39-4c24-9f7c-af7566c74907 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:32.572982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d43d4e76-2c39-4c24-9f7c-af7566c74907 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:44:32.681193 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.compute.api [None req-d43d4e76-2c39-4c24-9f7c-af7566c74907 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Instance is already in deleting state, ignoring this request Jul 20 04:44:32.687790 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d43d4e76-2c39-4c24-9f7c-af7566c74907 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 204 len: 0 microversion: 2.1 time: 0.174265 Jul 20 04:44:32.690106 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2771/5294] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:32 2022] DELETE /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:44:32.703253 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aa5fe29c-9867-4203-9af0-b79ed6f9ca6b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:32.704569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9ff76fb8-e210-4d57-8ac4-213159ab2f48 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:32.705225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9ff76fb8-e210-4d57-8ac4-213159ab2f48 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:32.715466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ff76fb8-e210-4d57-8ac4-213159ab2f48 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:32.716297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ff76fb8-e210-4d57-8ac4-213159ab2f48 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:32.717190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ff76fb8-e210-4d57-8ac4-213159ab2f48 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:32.717814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ff76fb8-e210-4d57-8ac4-213159ab2f48 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:32.731300 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aa5fe29c-9867-4203-9af0-b79ed6f9ca6b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1509 microversion: 2.1 time: 1.561651 Jul 20 04:44:32.734293 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2524/5295] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:31 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1509 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:32.749763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-46521842-4969-4eec-afd9-a61ae63faae3 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:32.754609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-46521842-4969-4eec-afd9-a61ae63faae3 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:32.770357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46521842-4969-4eec-afd9-a61ae63faae3 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:32.771080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46521842-4969-4eec-afd9-a61ae63faae3 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:32.772027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46521842-4969-4eec-afd9-a61ae63faae3 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:32.772786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46521842-4969-4eec-afd9-a61ae63faae3 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:32.909831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9ff76fb8-e210-4d57-8ac4-213159ab2f48 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:32.921151 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9ff76fb8-e210-4d57-8ac4-213159ab2f48 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1512 microversion: 2.1 time: 0.225947 Jul 20 04:44:32.930676 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2772/5296] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:32 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1512 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:33.144488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-7e4af9b9-98dd-4941-9bd5-82b9a845c280 req-dd1826e8-ecae-4566-ae04-05aca1f938d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3975993-61a4-40e2-b5c6-19411a0511d1", "name": "network-vif-deleted", "tag": "eea80dc9-92d0-43cd-bf9c-49d65af5ee95"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:33.159230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7e4af9b9-98dd-4941-9bd5-82b9a845c280 req-dd1826e8-ecae-4566-ae04-05aca1f938d6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.159672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7e4af9b9-98dd-4941-9bd5-82b9a845c280 req-dd1826e8-ecae-4566-ae04-05aca1f938d6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.186253 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-7e4af9b9-98dd-4941-9bd5-82b9a845c280 req-dd1826e8-ecae-4566-ae04-05aca1f938d6 service nova] Creating event network-vif-deleted:eea80dc9-92d0-43cd-bf9c-49d65af5ee95 for instance e3975993-61a4-40e2-b5c6-19411a0511d1 on n-h2-826526-5 Jul 20 04:44:33.193210 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-46521842-4969-4eec-afd9-a61ae63faae3 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1833 microversion: 2.1 time: 0.454176 Jul 20 04:44:33.194555 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2525/5297] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:32 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1833 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:33.210298 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-7e4af9b9-98dd-4941-9bd5-82b9a845c280 req-dd1826e8-ecae-4566-ae04-05aca1f938d6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071149 Jul 20 04:44:33.212425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c996a7e4-aa83-4fac-9f5e-bc80ad5ecbc2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:33.213059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c996a7e4-aa83-4fac-9f5e-bc80ad5ecbc2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:33.219965 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2773/5298] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:33.227235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c996a7e4-aa83-4fac-9f5e-bc80ad5ecbc2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.228049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c996a7e4-aa83-4fac-9f5e-bc80ad5ecbc2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.229278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c996a7e4-aa83-4fac-9f5e-bc80ad5ecbc2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.230050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c996a7e4-aa83-4fac-9f5e-bc80ad5ecbc2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.265705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ec450821-5d85-4dc3-bf4a-15b75bd50999 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:33.266437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ec450821-5d85-4dc3-bf4a-15b75bd50999 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:33.273497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec450821-5d85-4dc3-bf4a-15b75bd50999 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.273969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec450821-5d85-4dc3-bf4a-15b75bd50999 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.274748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec450821-5d85-4dc3-bf4a-15b75bd50999 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.275181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec450821-5d85-4dc3-bf4a-15b75bd50999 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.433907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ec450821-5d85-4dc3-bf4a-15b75bd50999 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:33.446111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ec450821-5d85-4dc3-bf4a-15b75bd50999 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:33.447616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ec450821-5d85-4dc3-bf4a-15b75bd50999 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:33.454043 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ec450821-5d85-4dc3-bf4a-15b75bd50999 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.188036 Jul 20 04:44:33.455059 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2774/5299] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:33 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:44:33.522994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c996a7e4-aa83-4fac-9f5e-bc80ad5ecbc2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:33.535462 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c996a7e4-aa83-4fac-9f5e-bc80ad5ecbc2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1682 microversion: 2.1 time: 0.327305 Jul 20 04:44:33.538569 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2526/5300] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:33 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1682 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:33.716074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ab56165f-b03e-4d61-bcab-7ec393c84177 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:33.720711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ab56165f-b03e-4d61-bcab-7ec393c84177 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:33.737826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab56165f-b03e-4d61-bcab-7ec393c84177 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.739027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab56165f-b03e-4d61-bcab-7ec393c84177 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.740046 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab56165f-b03e-4d61-bcab-7ec393c84177 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.741291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab56165f-b03e-4d61-bcab-7ec393c84177 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.755525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-76df5794-e5ea-434d-9f88-493eee63b484 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:33.756544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-76df5794-e5ea-434d-9f88-493eee63b484 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:33.766997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76df5794-e5ea-434d-9f88-493eee63b484 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.767892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76df5794-e5ea-434d-9f88-493eee63b484 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.770121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76df5794-e5ea-434d-9f88-493eee63b484 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.773357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76df5794-e5ea-434d-9f88-493eee63b484 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.877553 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ab56165f-b03e-4d61-bcab-7ec393c84177 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85/action" status: 200 len: 32619 microversion: 2.1 time: 0.171510 Jul 20 04:44:33.881229 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2775/5301] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:33 2022] POST /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85/action => generated 32619 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:44:33.881668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:33.885734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76df5794-e5ea-434d-9f88-493eee63b484 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.890040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76df5794-e5ea-434d-9f88-493eee63b484 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.891464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-76df5794-e5ea-434d-9f88-493eee63b484 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lazy-loading 'fault' on Instance uuid e3975993-61a4-40e2-b5c6-19411a0511d1 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:44:33.943433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5afda721-5e22-452a-9754-93afb90b6938 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:33.945963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5afda721-5e22-452a-9754-93afb90b6938 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:33.976965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5afda721-5e22-452a-9754-93afb90b6938 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.979849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5afda721-5e22-452a-9754-93afb90b6938 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.988083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5afda721-5e22-452a-9754-93afb90b6938 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.989359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5afda721-5e22-452a-9754-93afb90b6938 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:34.073124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-76df5794-e5ea-434d-9f88-493eee63b484 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:34.098709 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-76df5794-e5ea-434d-9f88-493eee63b484 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 200 len: 1312 microversion: 2.1 time: 0.346969 Jul 20 04:44:34.100213 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2527/5302] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:33 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 1312 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:34.117385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a930f78c-c7bb-40a7-a44e-a2aeaa628430 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:34.123026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a930f78c-c7bb-40a7-a44e-a2aeaa628430 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:34.150540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a930f78c-c7bb-40a7-a44e-a2aeaa628430 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:34.151338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a930f78c-c7bb-40a7-a44e-a2aeaa628430 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:34.152969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a930f78c-c7bb-40a7-a44e-a2aeaa628430 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:34.153905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a930f78c-c7bb-40a7-a44e-a2aeaa628430 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:34.257305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a930f78c-c7bb-40a7-a44e-a2aeaa628430 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'fef75f32cae6446b8e8ed70c9e616d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59855864129494fb59a5ef14dd9db1f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:34.259220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a930f78c-c7bb-40a7-a44e-a2aeaa628430 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] flavor_id is None. Assuming migration. {{(pid=127870) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 04:44:34.260360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a930f78c-c7bb-40a7-a44e-a2aeaa628430 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127870) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:44:34.429992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5afda721-5e22-452a-9754-93afb90b6938 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:34.451116 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5afda721-5e22-452a-9754-93afb90b6938 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1512 microversion: 2.1 time: 0.514283 Jul 20 04:44:34.461139 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2776/5303] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:33 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1512 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:34.476927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2d40be0e-cf86-4b2b-adf1-f7995c2ec809 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:34.478661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2d40be0e-cf86-4b2b-adf1-f7995c2ec809 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:34.490102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d40be0e-cf86-4b2b-adf1-f7995c2ec809 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:34.490558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d40be0e-cf86-4b2b-adf1-f7995c2ec809 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:34.491357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d40be0e-cf86-4b2b-adf1-f7995c2ec809 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:34.491887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d40be0e-cf86-4b2b-adf1-f7995c2ec809 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:34.682978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2d40be0e-cf86-4b2b-adf1-f7995c2ec809 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:34.699761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2d40be0e-cf86-4b2b-adf1-f7995c2ec809 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:34.703208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2d40be0e-cf86-4b2b-adf1-f7995c2ec809 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:34.704573 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2d40be0e-cf86-4b2b-adf1-f7995c2ec809 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.233097 Jul 20 04:44:34.712542 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2777/5304] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:34 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:34.739807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:34.808947 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a930f78c-c7bb-40a7-a44e-a2aeaa628430 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85/action" status: 202 len: 0 microversion: 2.1 time: 0.706260 Jul 20 04:44:34.809872 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2528/5305] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:34 2022] POST /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85/action => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:44:34.820390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-13b43098-2edc-4c3b-a6b4-21d05787c4f5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:34.822199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-13b43098-2edc-4c3b-a6b4-21d05787c4f5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:34.842539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13b43098-2edc-4c3b-a6b4-21d05787c4f5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:34.843008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13b43098-2edc-4c3b-a6b4-21d05787c4f5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:34.856460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13b43098-2edc-4c3b-a6b4-21d05787c4f5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:34.857289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13b43098-2edc-4c3b-a6b4-21d05787c4f5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.118037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cadaa323-5702-4723-bb45-aab3e702884d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:35.118664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cadaa323-5702-4723-bb45-aab3e702884d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: e3975993-61a4-40e2-b5c6-19411a0511d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:35.139330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cadaa323-5702-4723-bb45-aab3e702884d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.139800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cadaa323-5702-4723-bb45-aab3e702884d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.140635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cadaa323-5702-4723-bb45-aab3e702884d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.141081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cadaa323-5702-4723-bb45-aab3e702884d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.173844 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-cadaa323-5702-4723-bb45-aab3e702884d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] HTTP exception thrown: Instance e3975993-61a4-40e2-b5c6-19411a0511d1 could not be found. Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cadaa323-5702-4723-bb45-aab3e702884d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Request method failure captured: Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 HTTP/1.1 Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14cCAXHTn9-xjP9-j6Y5H3QclpCYHsqBLpRpQihoTalzGkb0NJB3tQRrqwgEU6RYcb1rSLMpRe6OHLIl_vuXQ5sxjCNslRe7DUQ3JshdANU3fqjJB1ce8j9t6r_FeEMPekMuZI1SQ7JdDTpAgLs_ZRs_OCOFW6Xgy06EebnWW58puJk Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 3e123ad99de64f50b9cd4373597c3a9e Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3e123ad99de64f50b9cd4373597c3a9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3e123ad99de64f50b9cd4373597c3a9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3e123ad99de64f50b9cd4373597c3a9e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3e123ad99de64f50b9cd4373597c3a9e"}]}] Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 3e123ad99de64f50b9cd4373597c3a9e Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerRescueNegativeTestJSON-810656662-project Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 8ea213e79bcf4aaea49446db5eb55271 Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-810656662-project Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance e3975993-61a4-40e2-b5c6-19411a0511d1 could not be found. Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'e3975993-61a4-40e2-b5c6-19411a0511d1'} Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3975993-61a4-40e2-b5c6-19411a0511d1 could not be found. Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3975993-61a4-40e2-b5c6-19411a0511d1 could not be found. Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:35.174282 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:35.179588 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:35.179588 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:35.179588 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:35.179588 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:35.179588 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:35.179588 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3975993-61a4-40e2-b5c6-19411a0511d1 could not be found. Jul 20 04:44:35.179588 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:35.185600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cadaa323-5702-4723-bb45-aab3e702884d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Returning 404 to user: Instance e3975993-61a4-40e2-b5c6-19411a0511d1 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:35.197396 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cadaa323-5702-4723-bb45-aab3e702884d tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1" status: 404 len: 111 microversion: 2.1 time: 0.084117 Jul 20 04:44:35.198569 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2529/5306] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:35 2022] GET /compute/v2.1/servers/e3975993-61a4-40e2-b5c6-19411a0511d1 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:35.206491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9fe23e85-b36d-4166-b74b-225d57af6f6a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:35.212300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9fe23e85-b36d-4166-b74b-225d57af6f6a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:35.227294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9fe23e85-b36d-4166-b74b-225d57af6f6a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.228129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9fe23e85-b36d-4166-b74b-225d57af6f6a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.229141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9fe23e85-b36d-4166-b74b-225d57af6f6a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.229659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9fe23e85-b36d-4166-b74b-225d57af6f6a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.238286 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-13b43098-2edc-4c3b-a6b4-21d05787c4f5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:35.257013 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-13b43098-2edc-4c3b-a6b4-21d05787c4f5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1691 microversion: 2.1 time: 0.436133 Jul 20 04:44:35.257013 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2778/5307] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:34 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1691 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:35.279373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9fe23e85-b36d-4166-b74b-225d57af6f6a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:44:35.281708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-a091e91d-747c-406c-9fad-1ab738a1cafb req-4abe0ccd-e934-4df3-a6b1-10ce51b5317d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf712a65-ec39-4a79-bbac-6383fb43df17", "name": "network-vif-deleted", "tag": "9010fd11-7367-492b-9434-2ddf200a12d5"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:35.291039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a091e91d-747c-406c-9fad-1ab738a1cafb req-4abe0ccd-e934-4df3-a6b1-10ce51b5317d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.292791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a091e91d-747c-406c-9fad-1ab738a1cafb req-4abe0ccd-e934-4df3-a6b1-10ce51b5317d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.313374 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-a091e91d-747c-406c-9fad-1ab738a1cafb req-4abe0ccd-e934-4df3-a6b1-10ce51b5317d service nova] Creating event network-vif-deleted:9010fd11-7367-492b-9434-2ddf200a12d5 for instance cf712a65-ec39-4a79-bbac-6383fb43df17 on n-h2-826526-5 Jul 20 04:44:35.319704 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-a091e91d-747c-406c-9fad-1ab738a1cafb req-4abe0ccd-e934-4df3-a6b1-10ce51b5317d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065685 Jul 20 04:44:35.321458 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2779/5308] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:35.395634 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9fe23e85-b36d-4166-b74b-225d57af6f6a tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 204 len: 0 microversion: 2.1 time: 0.192328 Jul 20 04:44:35.397389 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2530/5309] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:35 2022] DELETE /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:44:35.406470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3a7bded9-ed48-4889-a4eb-54b260f5f31f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:35.408024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3a7bded9-ed48-4889-a4eb-54b260f5f31f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:35.418435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a7bded9-ed48-4889-a4eb-54b260f5f31f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.418956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a7bded9-ed48-4889-a4eb-54b260f5f31f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.419748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a7bded9-ed48-4889-a4eb-54b260f5f31f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.420574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a7bded9-ed48-4889-a4eb-54b260f5f31f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.469324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3b1921e9-9c64-4adb-9b8b-7e5402eb162b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:35.470128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3b1921e9-9c64-4adb-9b8b-7e5402eb162b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:35.480787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b1921e9-9c64-4adb-9b8b-7e5402eb162b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.481121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b1921e9-9c64-4adb-9b8b-7e5402eb162b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.482679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b1921e9-9c64-4adb-9b8b-7e5402eb162b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.483290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b1921e9-9c64-4adb-9b8b-7e5402eb162b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.584725 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b1921e9-9c64-4adb-9b8b-7e5402eb162b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.585192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b1921e9-9c64-4adb-9b8b-7e5402eb162b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.587990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-3b1921e9-9c64-4adb-9b8b-7e5402eb162b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lazy-loading 'fault' on Instance uuid cf712a65-ec39-4a79-bbac-6383fb43df17 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:44:35.701274 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3a7bded9-ed48-4889-a4eb-54b260f5f31f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:35.710653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3b1921e9-9c64-4adb-9b8b-7e5402eb162b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e0b9a90f94c0d9337fe6e8a1727f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c445f8434bd0407c8ea69b8aeed234be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:35.720149 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3a7bded9-ed48-4889-a4eb-54b260f5f31f tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1522 microversion: 2.1 time: 0.318339 Jul 20 04:44:35.730593 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2780/5310] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:35 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:35.731207 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3b1921e9-9c64-4adb-9b8b-7e5402eb162b tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 200 len: 1307 microversion: 2.1 time: 0.257007 Jul 20 04:44:35.731207 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2531/5311] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:35 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 1307 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:35.734379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1fdfe21e-6773-4214-b083-1e8a42686b1a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:35.735120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1fdfe21e-6773-4214-b083-1e8a42686b1a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:35.755539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1fdfe21e-6773-4214-b083-1e8a42686b1a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.756541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1fdfe21e-6773-4214-b083-1e8a42686b1a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.757682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1fdfe21e-6773-4214-b083-1e8a42686b1a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.758470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1fdfe21e-6773-4214-b083-1e8a42686b1a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.920038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1fdfe21e-6773-4214-b083-1e8a42686b1a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:35.942718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1fdfe21e-6773-4214-b083-1e8a42686b1a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:35.944556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1fdfe21e-6773-4214-b083-1e8a42686b1a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:35.947438 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1fdfe21e-6773-4214-b083-1e8a42686b1a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.223317 Jul 20 04:44:35.948032 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2781/5312] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:35 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:36.270061 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-39c4841c-b503-49c0-b9e7-2138df690330 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:36.270688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-39c4841c-b503-49c0-b9e7-2138df690330 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:36.283051 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39c4841c-b503-49c0-b9e7-2138df690330 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.283745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39c4841c-b503-49c0-b9e7-2138df690330 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.285193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39c4841c-b503-49c0-b9e7-2138df690330 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.285625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39c4841c-b503-49c0-b9e7-2138df690330 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.495418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-39c4841c-b503-49c0-b9e7-2138df690330 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:36.507404 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-39c4841c-b503-49c0-b9e7-2138df690330 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1691 microversion: 2.1 time: 0.241617 Jul 20 04:44:36.508408 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2532/5313] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:36 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1691 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:36.740898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-63594f74-c502-4aa0-be69-1c59c9094804 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:36.741929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-63594f74-c502-4aa0-be69-1c59c9094804 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:36.751484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b6167a7f-d3f7-48fc-8b0e-114bede72221 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:36.752960 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b6167a7f-d3f7-48fc-8b0e-114bede72221 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: cf712a65-ec39-4a79-bbac-6383fb43df17] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:36.755437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63594f74-c502-4aa0-be69-1c59c9094804 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.755984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63594f74-c502-4aa0-be69-1c59c9094804 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.758539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63594f74-c502-4aa0-be69-1c59c9094804 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.759070 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63594f74-c502-4aa0-be69-1c59c9094804 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.762735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6167a7f-d3f7-48fc-8b0e-114bede72221 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.763421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6167a7f-d3f7-48fc-8b0e-114bede72221 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.764480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6167a7f-d3f7-48fc-8b0e-114bede72221 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.765074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6167a7f-d3f7-48fc-8b0e-114bede72221 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.783440 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-b6167a7f-d3f7-48fc-8b0e-114bede72221 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] HTTP exception thrown: Instance cf712a65-ec39-4a79-bbac-6383fb43df17 could not be found. Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b6167a7f-d3f7-48fc-8b0e-114bede72221 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Request method failure captured: Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 HTTP/1.1 Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14eogm_U9-ciPUik9x6KL9BU69Y7lf4K-zB92ZuY5GvLGJsaWYo-MdFipyzmU__he-sjpiKFkAd9zWBTiP-zZGjmIQpzziQC9ltO_E75gyMBHttHgVZJH2URfOpmJXoP1h20Ju5Lh7FCE_TreGiHXSI65NY2ncPRkyeHQaiuyAkhwBg Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c445f8434bd0407c8ea69b8aeed234be Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1901564501 Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c445f8434bd0407c8ea69b8aeed234be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c445f8434bd0407c8ea69b8aeed234be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c445f8434bd0407c8ea69b8aeed234be", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c445f8434bd0407c8ea69b8aeed234be"}]}] Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerDiskConfigTestJSON-1901564501 Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c445f8434bd0407c8ea69b8aeed234be Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1901564501 Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerDiskConfigTestJSON-1901564501-project Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 336e0b9a90f94c0d9337fe6e8a1727f1 Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerDiskConfigTestJSON-1901564501-project Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance cf712a65-ec39-4a79-bbac-6383fb43df17 could not be found. Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'cf712a65-ec39-4a79-bbac-6383fb43df17'} Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf712a65-ec39-4a79-bbac-6383fb43df17 could not be found. Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf712a65-ec39-4a79-bbac-6383fb43df17 could not be found. Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:36.786184 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.791527 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:36.791527 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:36.791527 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:36.791527 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:36.791527 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:36.791527 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf712a65-ec39-4a79-bbac-6383fb43df17 could not be found. Jul 20 04:44:36.791527 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.791527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b6167a7f-d3f7-48fc-8b0e-114bede72221 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Returning 404 to user: Instance cf712a65-ec39-4a79-bbac-6383fb43df17 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:36.794716 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b6167a7f-d3f7-48fc-8b0e-114bede72221 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17" status: 404 len: 111 microversion: 2.1 time: 0.045123 Jul 20 04:44:36.800664 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2533/5314] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:36 2022] GET /compute/v2.1/servers/cf712a65-ec39-4a79-bbac-6383fb43df17 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:36.808677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4f40f6f5-b788-401e-8f23-92565ba7b394 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:36.809391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4f40f6f5-b788-401e-8f23-92565ba7b394 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:36.818209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f40f6f5-b788-401e-8f23-92565ba7b394 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.818842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f40f6f5-b788-401e-8f23-92565ba7b394 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.819984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f40f6f5-b788-401e-8f23-92565ba7b394 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.820740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f40f6f5-b788-401e-8f23-92565ba7b394 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.840460 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-4f40f6f5-b788-401e-8f23-92565ba7b394 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] HTTP exception thrown: Instance dc44474d-f1ac-43fd-bc65-8ff2790a9f48 could not be found. Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4f40f6f5-b788-401e-8f23-92565ba7b394 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Request method failure captured: Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 HTTP/1.1 Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14eogm_U9-ciPUik9x6KL9BU69Y7lf4K-zB92ZuY5GvLGJsaWYo-MdFipyzmU__he-sjpiKFkAd9zWBTiP-zZGjmIQpzziQC9ltO_E75gyMBHttHgVZJH2URfOpmJXoP1h20Ju5Lh7FCE_TreGiHXSI65NY2ncPRkyeHQaiuyAkhwBg Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c445f8434bd0407c8ea69b8aeed234be Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1901564501 Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c445f8434bd0407c8ea69b8aeed234be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c445f8434bd0407c8ea69b8aeed234be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c445f8434bd0407c8ea69b8aeed234be", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c445f8434bd0407c8ea69b8aeed234be"}]}] Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerDiskConfigTestJSON-1901564501 Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c445f8434bd0407c8ea69b8aeed234be Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1901564501 Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerDiskConfigTestJSON-1901564501-project Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 336e0b9a90f94c0d9337fe6e8a1727f1 Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerDiskConfigTestJSON-1901564501-project Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance dc44474d-f1ac-43fd-bc65-8ff2790a9f48 could not be found. Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'dc44474d-f1ac-43fd-bc65-8ff2790a9f48'} Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc44474d-f1ac-43fd-bc65-8ff2790a9f48 could not be found. Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:36.842495 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:36.847849 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc44474d-f1ac-43fd-bc65-8ff2790a9f48 could not be found. Jul 20 04:44:36.847849 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.847849 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:36.847849 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.847849 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:36.847849 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:36.847849 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:36.847849 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:36.847849 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:36.847849 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc44474d-f1ac-43fd-bc65-8ff2790a9f48 could not be found. Jul 20 04:44:36.847849 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.851212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4f40f6f5-b788-401e-8f23-92565ba7b394 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Returning 404 to user: Instance dc44474d-f1ac-43fd-bc65-8ff2790a9f48 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:36.852330 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4f40f6f5-b788-401e-8f23-92565ba7b394 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 404 len: 111 microversion: 2.1 time: 0.049820 Jul 20 04:44:36.856468 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2534/5315] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:36 2022] DELETE /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:36.863474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-76ff9ea3-8db5-408b-826c-fc0a60cab593 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:36.865012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-76ff9ea3-8db5-408b-826c-fc0a60cab593 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: dc44474d-f1ac-43fd-bc65-8ff2790a9f48] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:36.875210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76ff9ea3-8db5-408b-826c-fc0a60cab593 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.875896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76ff9ea3-8db5-408b-826c-fc0a60cab593 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.877202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76ff9ea3-8db5-408b-826c-fc0a60cab593 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.877856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76ff9ea3-8db5-408b-826c-fc0a60cab593 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.898460 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-76ff9ea3-8db5-408b-826c-fc0a60cab593 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] HTTP exception thrown: Instance dc44474d-f1ac-43fd-bc65-8ff2790a9f48 could not be found. Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-76ff9ea3-8db5-408b-826c-fc0a60cab593 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Request method failure captured: Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 HTTP/1.1 Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14eogm_U9-ciPUik9x6KL9BU69Y7lf4K-zB92ZuY5GvLGJsaWYo-MdFipyzmU__he-sjpiKFkAd9zWBTiP-zZGjmIQpzziQC9ltO_E75gyMBHttHgVZJH2URfOpmJXoP1h20Ju5Lh7FCE_TreGiHXSI65NY2ncPRkyeHQaiuyAkhwBg Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c445f8434bd0407c8ea69b8aeed234be Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1901564501 Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c445f8434bd0407c8ea69b8aeed234be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c445f8434bd0407c8ea69b8aeed234be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c445f8434bd0407c8ea69b8aeed234be", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c445f8434bd0407c8ea69b8aeed234be"}]}] Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerDiskConfigTestJSON-1901564501 Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c445f8434bd0407c8ea69b8aeed234be Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1901564501 Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerDiskConfigTestJSON-1901564501-project Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 336e0b9a90f94c0d9337fe6e8a1727f1 Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerDiskConfigTestJSON-1901564501-project Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance dc44474d-f1ac-43fd-bc65-8ff2790a9f48 could not be found. Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'dc44474d-f1ac-43fd-bc65-8ff2790a9f48'} Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc44474d-f1ac-43fd-bc65-8ff2790a9f48 could not be found. Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc44474d-f1ac-43fd-bc65-8ff2790a9f48 could not be found. Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:36.903324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.908215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:36.908215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:36.908215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:36.908215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:36.908215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:36.908215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc44474d-f1ac-43fd-bc65-8ff2790a9f48 could not be found. Jul 20 04:44:36.908215 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.916564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-76ff9ea3-8db5-408b-826c-fc0a60cab593 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Returning 404 to user: Instance dc44474d-f1ac-43fd-bc65-8ff2790a9f48 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:36.917776 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-76ff9ea3-8db5-408b-826c-fc0a60cab593 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48" status: 404 len: 111 microversion: 2.1 time: 0.059910 Jul 20 04:44:36.922068 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2535/5316] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:36 2022] GET /compute/v2.1/servers/dc44474d-f1ac-43fd-bc65-8ff2790a9f48 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:36.945869 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8cbf31e0-7736-4ad6-899c-33bd57da2226 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:36.952104 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8cbf31e0-7736-4ad6-899c-33bd57da2226 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:36.960703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8cbf31e0-7736-4ad6-899c-33bd57da2226 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.961911 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8cbf31e0-7736-4ad6-899c-33bd57da2226 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.962887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8cbf31e0-7736-4ad6-899c-33bd57da2226 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.963532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8cbf31e0-7736-4ad6-899c-33bd57da2226 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.982688 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-8cbf31e0-7736-4ad6-899c-33bd57da2226 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] HTTP exception thrown: Instance 29abf8ce-3972-49b8-aeb8-8219f13fe72c could not be found. Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8cbf31e0-7736-4ad6-899c-33bd57da2226 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Request method failure captured: Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c HTTP/1.1 Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14eogm_U9-ciPUik9x6KL9BU69Y7lf4K-zB92ZuY5GvLGJsaWYo-MdFipyzmU__he-sjpiKFkAd9zWBTiP-zZGjmIQpzziQC9ltO_E75gyMBHttHgVZJH2URfOpmJXoP1h20Ju5Lh7FCE_TreGiHXSI65NY2ncPRkyeHQaiuyAkhwBg Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c445f8434bd0407c8ea69b8aeed234be Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1901564501 Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c445f8434bd0407c8ea69b8aeed234be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c445f8434bd0407c8ea69b8aeed234be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c445f8434bd0407c8ea69b8aeed234be", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c445f8434bd0407c8ea69b8aeed234be"}]}] Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerDiskConfigTestJSON-1901564501 Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c445f8434bd0407c8ea69b8aeed234be Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1901564501 Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerDiskConfigTestJSON-1901564501-project Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 336e0b9a90f94c0d9337fe6e8a1727f1 Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerDiskConfigTestJSON-1901564501-project Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 29abf8ce-3972-49b8-aeb8-8219f13fe72c could not be found. Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '29abf8ce-3972-49b8-aeb8-8219f13fe72c'} Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29abf8ce-3972-49b8-aeb8-8219f13fe72c could not be found. Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:36.984733 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:36.989968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29abf8ce-3972-49b8-aeb8-8219f13fe72c could not be found. Jul 20 04:44:36.989968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.989968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:36.989968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.989968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:36.989968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:36.989968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:36.989968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:36.989968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:36.989968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29abf8ce-3972-49b8-aeb8-8219f13fe72c could not be found. Jul 20 04:44:36.989968 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.992503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8cbf31e0-7736-4ad6-899c-33bd57da2226 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Returning 404 to user: Instance 29abf8ce-3972-49b8-aeb8-8219f13fe72c could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:36.993578 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8cbf31e0-7736-4ad6-899c-33bd57da2226 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "DELETE /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 404 len: 111 microversion: 2.1 time: 0.061844 Jul 20 04:44:36.994469 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2536/5317] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:36 2022] DELETE /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:36.999550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-62948445-c107-4e19-80ed-e7383010ab80 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:37.000587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62948445-c107-4e19-80ed-e7383010ab80 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:37.008348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62948445-c107-4e19-80ed-e7383010ab80 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:37.009089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62948445-c107-4e19-80ed-e7383010ab80 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:37.010198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62948445-c107-4e19-80ed-e7383010ab80 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:37.010879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62948445-c107-4e19-80ed-e7383010ab80 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:37.041664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-63594f74-c502-4aa0-be69-1c59c9094804 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:37.062415 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-63594f74-c502-4aa0-be69-1c59c9094804 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1522 microversion: 2.1 time: 0.315775 Jul 20 04:44:37.067331 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2782/5318] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:36 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:37.076385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-29eaf86b-8615-412d-999a-bb6607421554 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:37.078309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-29eaf86b-8615-412d-999a-bb6607421554 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] [instance: 29abf8ce-3972-49b8-aeb8-8219f13fe72c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:37.087041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29eaf86b-8615-412d-999a-bb6607421554 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:37.087931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29eaf86b-8615-412d-999a-bb6607421554 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:37.089047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29eaf86b-8615-412d-999a-bb6607421554 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:37.089740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29eaf86b-8615-412d-999a-bb6607421554 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:37.096001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:37.109310 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-29eaf86b-8615-412d-999a-bb6607421554 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] HTTP exception thrown: Instance 29abf8ce-3972-49b8-aeb8-8219f13fe72c could not be found. Jul 20 04:44:37.111095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-62948445-c107-4e19-80ed-e7383010ab80 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-29eaf86b-8615-412d-999a-bb6607421554 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Request method failure captured: Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c HTTP/1.1 Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14eogm_U9-ciPUik9x6KL9BU69Y7lf4K-zB92ZuY5GvLGJsaWYo-MdFipyzmU__he-sjpiKFkAd9zWBTiP-zZGjmIQpzziQC9ltO_E75gyMBHttHgVZJH2URfOpmJXoP1h20Ju5Lh7FCE_TreGiHXSI65NY2ncPRkyeHQaiuyAkhwBg Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: c445f8434bd0407c8ea69b8aeed234be Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1901564501 Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c445f8434bd0407c8ea69b8aeed234be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c445f8434bd0407c8ea69b8aeed234be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c445f8434bd0407c8ea69b8aeed234be", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c445f8434bd0407c8ea69b8aeed234be"}]}] Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerDiskConfigTestJSON-1901564501 Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: c445f8434bd0407c8ea69b8aeed234be Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1901564501 Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerDiskConfigTestJSON-1901564501-project Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 336e0b9a90f94c0d9337fe6e8a1727f1 Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerDiskConfigTestJSON-1901564501-project Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 29abf8ce-3972-49b8-aeb8-8219f13fe72c could not be found. Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '29abf8ce-3972-49b8-aeb8-8219f13fe72c'} Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29abf8ce-3972-49b8-aeb8-8219f13fe72c could not be found. Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29abf8ce-3972-49b8-aeb8-8219f13fe72c could not be found. Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:37.112139 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:44:37.116773 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:37.116773 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:37.116773 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:37.116773 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:37.116773 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:37.116773 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29abf8ce-3972-49b8-aeb8-8219f13fe72c could not be found. Jul 20 04:44:37.116773 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:44:37.118056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-29eaf86b-8615-412d-999a-bb6607421554 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] Returning 404 to user: Instance 29abf8ce-3972-49b8-aeb8-8219f13fe72c could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:37.118969 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-29eaf86b-8615-412d-999a-bb6607421554 tempest-ServerDiskConfigTestJSON-1901564501 tempest-ServerDiskConfigTestJSON-1901564501-project] 10.222.0.17 "GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c" status: 404 len: 111 microversion: 2.1 time: 0.050420 Jul 20 04:44:37.119603 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2783/5319] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:37 2022] GET /compute/v2.1/servers/29abf8ce-3972-49b8-aeb8-8219f13fe72c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:37.138936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-62948445-c107-4e19-80ed-e7383010ab80 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:37.141615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-62948445-c107-4e19-80ed-e7383010ab80 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:37.142933 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-62948445-c107-4e19-80ed-e7383010ab80 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.147343 Jul 20 04:44:37.143744 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2537/5320] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:36 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:37.525172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bd03ca73-f388-4932-8cb4-f756d4a1610d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:37.526095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bd03ca73-f388-4932-8cb4-f756d4a1610d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:37.528538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:37.534248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd03ca73-f388-4932-8cb4-f756d4a1610d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:37.534985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd03ca73-f388-4932-8cb4-f756d4a1610d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:37.536031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd03ca73-f388-4932-8cb4-f756d4a1610d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:37.536776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd03ca73-f388-4932-8cb4-f756d4a1610d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:37.807020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bd03ca73-f388-4932-8cb4-f756d4a1610d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:37.818828 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bd03ca73-f388-4932-8cb4-f756d4a1610d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1691 microversion: 2.1 time: 0.296227 Jul 20 04:44:37.819874 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2784/5321] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:37 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1691 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:38.084581 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4a401bcb-cebe-4fca-afbe-8967fc864544 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:38.085993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4a401bcb-cebe-4fca-afbe-8967fc864544 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:38.094433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a401bcb-cebe-4fca-afbe-8967fc864544 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:38.095588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a401bcb-cebe-4fca-afbe-8967fc864544 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:38.096877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a401bcb-cebe-4fca-afbe-8967fc864544 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:38.097594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a401bcb-cebe-4fca-afbe-8967fc864544 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:38.164398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-82e45e15-4848-449a-ab5c-f9053fedf352 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:38.166167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-82e45e15-4848-449a-ab5c-f9053fedf352 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:38.179188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82e45e15-4848-449a-ab5c-f9053fedf352 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:38.181436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82e45e15-4848-449a-ab5c-f9053fedf352 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:38.182080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82e45e15-4848-449a-ab5c-f9053fedf352 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:38.189550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82e45e15-4848-449a-ab5c-f9053fedf352 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:38.295357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4a401bcb-cebe-4fca-afbe-8967fc864544 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:38.309930 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4a401bcb-cebe-4fca-afbe-8967fc864544 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1522 microversion: 2.1 time: 0.230227 Jul 20 04:44:38.311791 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2538/5322] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:38 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:38.352699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-82e45e15-4848-449a-ab5c-f9053fedf352 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:38.363646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-82e45e15-4848-449a-ab5c-f9053fedf352 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:38.365364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-82e45e15-4848-449a-ab5c-f9053fedf352 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:38.367081 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-82e45e15-4848-449a-ab5c-f9053fedf352 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.207193 Jul 20 04:44:38.375805 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2785/5323] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:38 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:44:38.840553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7fd24b38-873f-4a64-92bf-55b299741f93 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:38.841605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7fd24b38-873f-4a64-92bf-55b299741f93 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:38.855882 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fd24b38-873f-4a64-92bf-55b299741f93 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:38.857260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fd24b38-873f-4a64-92bf-55b299741f93 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:38.860570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fd24b38-873f-4a64-92bf-55b299741f93 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:38.862040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fd24b38-873f-4a64-92bf-55b299741f93 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:39.168227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7fd24b38-873f-4a64-92bf-55b299741f93 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:39.178354 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7fd24b38-873f-4a64-92bf-55b299741f93 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1691 microversion: 2.1 time: 0.343149 Jul 20 04:44:39.183347 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2539/5324] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:38 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1691 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:39.327505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-787cc5d4-b953-4d23-b61e-6db3ab23792b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:39.328515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-787cc5d4-b953-4d23-b61e-6db3ab23792b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:39.341545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-787cc5d4-b953-4d23-b61e-6db3ab23792b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:39.343305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-787cc5d4-b953-4d23-b61e-6db3ab23792b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:39.344687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-787cc5d4-b953-4d23-b61e-6db3ab23792b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:39.345396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-787cc5d4-b953-4d23-b61e-6db3ab23792b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:39.386122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-97da2436-a1bd-463e-8c44-20215afd0d8e tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:39.386740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-97da2436-a1bd-463e-8c44-20215afd0d8e tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:39.396039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97da2436-a1bd-463e-8c44-20215afd0d8e tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:39.396511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97da2436-a1bd-463e-8c44-20215afd0d8e tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:39.397295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97da2436-a1bd-463e-8c44-20215afd0d8e tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:39.397721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-97da2436-a1bd-463e-8c44-20215afd0d8e tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:39.518392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-97da2436-a1bd-463e-8c44-20215afd0d8e tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:39.529429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-97da2436-a1bd-463e-8c44-20215afd0d8e tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:39.531511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-97da2436-a1bd-463e-8c44-20215afd0d8e tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:39.532908 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-97da2436-a1bd-463e-8c44-20215afd0d8e tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.150944 Jul 20 04:44:39.548051 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2540/5325] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:39 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:39.650869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-787cc5d4-b953-4d23-b61e-6db3ab23792b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:39.663528 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-787cc5d4-b953-4d23-b61e-6db3ab23792b tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1522 microversion: 2.1 time: 0.338694 Jul 20 04:44:39.675184 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2786/5326] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:39 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:40.200039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-91ae90cd-f809-4980-84b6-a5ab4e12023e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:40.200823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-91ae90cd-f809-4980-84b6-a5ab4e12023e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:40.216150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91ae90cd-f809-4980-84b6-a5ab4e12023e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:40.216665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91ae90cd-f809-4980-84b6-a5ab4e12023e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:40.217484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91ae90cd-f809-4980-84b6-a5ab4e12023e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:40.217923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91ae90cd-f809-4980-84b6-a5ab4e12023e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:40.562776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e3436d35-76d6-4f42-8153-d787b5c552fb tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:40.564542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e3436d35-76d6-4f42-8153-d787b5c552fb tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:40.584047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3436d35-76d6-4f42-8153-d787b5c552fb tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:40.586529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3436d35-76d6-4f42-8153-d787b5c552fb tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:40.589668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3436d35-76d6-4f42-8153-d787b5c552fb tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:40.590294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3436d35-76d6-4f42-8153-d787b5c552fb tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:40.743626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-91ae90cd-f809-4980-84b6-a5ab4e12023e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:40.755548 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-91ae90cd-f809-4980-84b6-a5ab4e12023e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1691 microversion: 2.1 time: 0.560020 Jul 20 04:44:40.765895 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2541/5327] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:40 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1691 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:40.771546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0ca83829-a334-43e7-8a61-774475a55ef5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:40.772537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0ca83829-a334-43e7-8a61-774475a55ef5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:40.780569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ca83829-a334-43e7-8a61-774475a55ef5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:40.781304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ca83829-a334-43e7-8a61-774475a55ef5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:40.782376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ca83829-a334-43e7-8a61-774475a55ef5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:40.783310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ca83829-a334-43e7-8a61-774475a55ef5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:40.797760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e3436d35-76d6-4f42-8153-d787b5c552fb tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:40.825570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e3436d35-76d6-4f42-8153-d787b5c552fb tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:40.832513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e3436d35-76d6-4f42-8153-d787b5c552fb tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:40.837080 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e3436d35-76d6-4f42-8153-d787b5c552fb tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.285930 Jul 20 04:44:40.851153 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2787/5328] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:40 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:40.944915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8d3f828e-8ea1-4c68-abbe-5e76d020b6ac tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1116921121", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ba3d4ae7-75c2-4420-9343-0f582ca648be", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7f25ae6d-be40-4c15-969a-9d88fe94c163"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:41.033453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-8d3f828e-8ea1-4c68-abbe-5e76d020b6ac tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] validate_networks() for [('7f25ae6d-be40-4c15-969a-9d88fe94c163', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:44:41.224093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0ca83829-a334-43e7-8a61-774475a55ef5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea213e79bcf4aaea49446db5eb55271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e123ad99de64f50b9cd4373597c3a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:41.244824 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0ca83829-a334-43e7-8a61-774475a55ef5 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 200 len: 1522 microversion: 2.1 time: 0.477240 Jul 20 04:44:41.246728 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2542/5329] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:40 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:41.318989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-114ac1a6-9482-4d91-a36c-6a7242e63b4f req-f4d9fa4d-a363-48a4-abd6-b5dc08de4c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2f9ea6-9cd9-416d-b210-2b1968e47ea9", "name": "network-vif-deleted", "tag": "967471b4-4a23-438b-8616-9180c44b710e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:41.352299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-114ac1a6-9482-4d91-a36c-6a7242e63b4f req-f4d9fa4d-a363-48a4-abd6-b5dc08de4c1e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:41.355284 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-114ac1a6-9482-4d91-a36c-6a7242e63b4f req-f4d9fa4d-a363-48a4-abd6-b5dc08de4c1e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:41.391325 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-114ac1a6-9482-4d91-a36c-6a7242e63b4f req-f4d9fa4d-a363-48a4-abd6-b5dc08de4c1e service nova] Creating event network-vif-deleted:967471b4-4a23-438b-8616-9180c44b710e for instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 on n-h1-826526-5 Jul 20 04:44:41.404543 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-114ac1a6-9482-4d91-a36c-6a7242e63b4f req-f4d9fa4d-a363-48a4-abd6-b5dc08de4c1e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107033 Jul 20 04:44:41.408569 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2543/5330] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:41.789081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-98157e5f-8375-499f-a547-2d7b294c2f09 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:41.794252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-98157e5f-8375-499f-a547-2d7b294c2f09 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:41.819220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98157e5f-8375-499f-a547-2d7b294c2f09 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:41.819679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98157e5f-8375-499f-a547-2d7b294c2f09 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:41.820527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98157e5f-8375-499f-a547-2d7b294c2f09 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:41.820996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98157e5f-8375-499f-a547-2d7b294c2f09 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:42.164691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-98157e5f-8375-499f-a547-2d7b294c2f09 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:42.179535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8d3f828e-8ea1-4c68-abbe-5e76d020b6ac tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:44:42.179999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8d3f828e-8ea1-4c68-abbe-5e76d020b6ac tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:44:42.180423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8d3f828e-8ea1-4c68-abbe-5e76d020b6ac tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:44:42.180844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8d3f828e-8ea1-4c68-abbe-5e76d020b6ac tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:44:42.181399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8d3f828e-8ea1-4c68-abbe-5e76d020b6ac tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:44:42.185144 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-98157e5f-8375-499f-a547-2d7b294c2f09 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1696 microversion: 2.1 time: 0.414813 Jul 20 04:44:42.188306 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2544/5331] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:41 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1696 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:42.200514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d3f828e-8ea1-4c68-abbe-5e76d020b6ac tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:42.200970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d3f828e-8ea1-4c68-abbe-5e76d020b6ac tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:42.201805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d3f828e-8ea1-4c68-abbe-5e76d020b6ac tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:42.202663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d6be280-864e-4b8f-a775-bfc6ffd6e758 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:42.203385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d6be280-864e-4b8f-a775-bfc6ffd6e758 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:42.206971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d3f828e-8ea1-4c68-abbe-5e76d020b6ac tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:42.216153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d6be280-864e-4b8f-a775-bfc6ffd6e758 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:42.221908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d6be280-864e-4b8f-a775-bfc6ffd6e758 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:42.222857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d6be280-864e-4b8f-a775-bfc6ffd6e758 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:42.223300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d6be280-864e-4b8f-a775-bfc6ffd6e758 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:42.235699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-8d3f828e-8ea1-4c68-abbe-5e76d020b6ac tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Getting quotas for project b889ad56221143f0a54450c81ba738a7. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:44:42.246579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-8d3f828e-8ea1-4c68-abbe-5e76d020b6ac tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Getting quotas for user bc760e8f522640fc9190460719f5dcc2 and project b889ad56221143f0a54450c81ba738a7. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:44:42.361618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d6be280-864e-4b8f-a775-bfc6ffd6e758 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:42.368239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8d3f828e-8ea1-4c68-abbe-5e76d020b6ac tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:44:42.370530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8d3f828e-8ea1-4c68-abbe-5e76d020b6ac tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ba3d4ae7-75c2-4420-9343-0f582ca648be',volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:44:42.386484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d6be280-864e-4b8f-a775-bfc6ffd6e758 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:42.388011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d6be280-864e-4b8f-a775-bfc6ffd6e758 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:42.392370 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d6be280-864e-4b8f-a775-bfc6ffd6e758 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.199475 Jul 20 04:44:42.395843 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2545/5332] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:42 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:42.417538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2036f9be-d856-469d-80a4-aef3c2b778d7 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:42.418199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2036f9be-d856-469d-80a4-aef3c2b778d7 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] [instance: ca2f9ea6-9cd9-416d-b210-2b1968e47ea9] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:42.434782 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2036f9be-d856-469d-80a4-aef3c2b778d7 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:42.435267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2036f9be-d856-469d-80a4-aef3c2b778d7 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:42.436076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2036f9be-d856-469d-80a4-aef3c2b778d7 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:42.436554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2036f9be-d856-469d-80a4-aef3c2b778d7 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:42.468874 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-2036f9be-d856-469d-80a4-aef3c2b778d7 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] HTTP exception thrown: Instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 could not be found. Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2036f9be-d856-469d-80a4-aef3c2b778d7 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Request method failure captured: Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 HTTP/1.1 Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14cCAXHTn9-xjP9-j6Y5H3QclpCYHsqBLpRpQihoTalzGkb0NJB3tQRrqwgEU6RYcb1rSLMpRe6OHLIl_vuXQ5sxjCNslRe7DUQ3JshdANU3fqjJB1ce8j9t6r_FeEMPekMuZI1SQ7JdDTpAgLs_ZRs_OCOFW6Xgy06EebnWW58puJk Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 3e123ad99de64f50b9cd4373597c3a9e Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3e123ad99de64f50b9cd4373597c3a9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3e123ad99de64f50b9cd4373597c3a9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3e123ad99de64f50b9cd4373597c3a9e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3e123ad99de64f50b9cd4373597c3a9e"}]}] Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 3e123ad99de64f50b9cd4373597c3a9e Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-810656662 Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerRescueNegativeTestJSON-810656662-project Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 8ea213e79bcf4aaea49446db5eb55271 Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-810656662-project Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 could not be found. Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'ca2f9ea6-9cd9-416d-b210-2b1968e47ea9'} Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 could not be found. Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 could not be found. Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:42.470678 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:42.484944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:42.484944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:42.484944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:42.484944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:42.484944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:42.484944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 could not be found. Jul 20 04:44:42.484944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:42.484944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2036f9be-d856-469d-80a4-aef3c2b778d7 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] Returning 404 to user: Instance ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:42.484944 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2036f9be-d856-469d-80a4-aef3c2b778d7 tempest-ServerRescueNegativeTestJSON-810656662 tempest-ServerRescueNegativeTestJSON-810656662-project] 10.222.0.17 "GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9" status: 404 len: 111 microversion: 2.1 time: 0.070487 Jul 20 04:44:42.484944 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2546/5333] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:42 2022] GET /compute/v2.1/servers/ca2f9ea6-9cd9-416d-b210-2b1968e47ea9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:42.665632 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8d3f828e-8ea1-4c68-abbe-5e76d020b6ac tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.724809 Jul 20 04:44:42.666948 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2788/5334] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:44:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:44:42.677445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7a0911cd-8065-40c3-9af2-d54b66d6f35a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:42.678530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7a0911cd-8065-40c3-9af2-d54b66d6f35a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:42.770065 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7a0911cd-8065-40c3-9af2-d54b66d6f35a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:42.781283 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7a0911cd-8065-40c3-9af2-d54b66d6f35a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1071 microversion: 2.1 time: 0.108223 Jul 20 04:44:42.783905 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2547/5335] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:42 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1071 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:43.208966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b3513cc3-4c74-446d-b2f8-abd6fc7ad080 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:43.210957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b3513cc3-4c74-446d-b2f8-abd6fc7ad080 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:43.227817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b3513cc3-4c74-446d-b2f8-abd6fc7ad080 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:43.229789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b3513cc3-4c74-446d-b2f8-abd6fc7ad080 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:43.232098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b3513cc3-4c74-446d-b2f8-abd6fc7ad080 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:43.233701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b3513cc3-4c74-446d-b2f8-abd6fc7ad080 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:43.424317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3553ae74-2c35-4390-bb45-0432c61e6aa5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:43.424939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3553ae74-2c35-4390-bb45-0432c61e6aa5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:43.443808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3553ae74-2c35-4390-bb45-0432c61e6aa5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:43.444724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3553ae74-2c35-4390-bb45-0432c61e6aa5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:43.445530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3553ae74-2c35-4390-bb45-0432c61e6aa5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:43.445970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3553ae74-2c35-4390-bb45-0432c61e6aa5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:43.519472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:43.559649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b3513cc3-4c74-446d-b2f8-abd6fc7ad080 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:43.575395 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b3513cc3-4c74-446d-b2f8-abd6fc7ad080 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1696 microversion: 2.1 time: 0.373182 Jul 20 04:44:43.576022 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2789/5336] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:43 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1696 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:43.803520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3553ae74-2c35-4390-bb45-0432c61e6aa5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:43.809109 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-98d29173-a794-4258-ab27-00d406e03096 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:43.809809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-98d29173-a794-4258-ab27-00d406e03096 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:43.827541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98d29173-a794-4258-ab27-00d406e03096 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:43.828019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98d29173-a794-4258-ab27-00d406e03096 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:43.829042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3553ae74-2c35-4390-bb45-0432c61e6aa5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:43.829192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98d29173-a794-4258-ab27-00d406e03096 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:43.829538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98d29173-a794-4258-ab27-00d406e03096 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:43.830670 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3553ae74-2c35-4390-bb45-0432c61e6aa5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:43.832343 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3553ae74-2c35-4390-bb45-0432c61e6aa5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.419130 Jul 20 04:44:43.835784 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2548/5337] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:43 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:44:44.009297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-98d29173-a794-4258-ab27-00d406e03096 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:44.020413 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-98d29173-a794-4258-ab27-00d406e03096 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1169 microversion: 2.1 time: 0.217937 Jul 20 04:44:44.031901 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2790/5338] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:43 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1169 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:44.597177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f8eed26d-b0f6-44f8-9811-b0d5cbbe275e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:44.597733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f8eed26d-b0f6-44f8-9811-b0d5cbbe275e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:44.633942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8eed26d-b0f6-44f8-9811-b0d5cbbe275e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:44.633942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8eed26d-b0f6-44f8-9811-b0d5cbbe275e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:44.634669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8eed26d-b0f6-44f8-9811-b0d5cbbe275e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:44.635578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8eed26d-b0f6-44f8-9811-b0d5cbbe275e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:44.854419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-16028e42-d968-4cfe-8707-0856d569e99c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:44.855030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-16028e42-d968-4cfe-8707-0856d569e99c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:44.866664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-16028e42-d968-4cfe-8707-0856d569e99c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:44.869398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-16028e42-d968-4cfe-8707-0856d569e99c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:44.871948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-16028e42-d968-4cfe-8707-0856d569e99c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:44.874030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-16028e42-d968-4cfe-8707-0856d569e99c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:45.099022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-16028e42-d968-4cfe-8707-0856d569e99c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:45.137785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-16028e42-d968-4cfe-8707-0856d569e99c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:45.142534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-16028e42-d968-4cfe-8707-0856d569e99c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:45.145963 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-16028e42-d968-4cfe-8707-0856d569e99c tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1366 microversion: 2.47 time: 0.295445 Jul 20 04:44:45.163209 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2791/5339] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:44 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:44:45.181557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3850497f-6930-426e-9fbd-850db0abd19a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:45.186071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3850497f-6930-426e-9fbd-850db0abd19a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:45.214268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3850497f-6930-426e-9fbd-850db0abd19a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:45.214739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3850497f-6930-426e-9fbd-850db0abd19a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:45.215543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3850497f-6930-426e-9fbd-850db0abd19a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:45.215978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3850497f-6930-426e-9fbd-850db0abd19a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:45.293731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3850497f-6930-426e-9fbd-850db0abd19a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:45.303925 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3850497f-6930-426e-9fbd-850db0abd19a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1187 microversion: 2.1 time: 0.139055 Jul 20 04:44:45.305262 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2792/5340] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:45 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1187 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:45.383714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f8eed26d-b0f6-44f8-9811-b0d5cbbe275e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:45.410290 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f8eed26d-b0f6-44f8-9811-b0d5cbbe275e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1696 microversion: 2.1 time: 0.819472 Jul 20 04:44:45.425273 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2549/5341] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:44 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1696 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:46.167279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5ee4c99b-75d3-46a3-9fd0-2511c80d6e62 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:46.168011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5ee4c99b-75d3-46a3-9fd0-2511c80d6e62 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:46.186367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ee4c99b-75d3-46a3-9fd0-2511c80d6e62 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:46.186814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ee4c99b-75d3-46a3-9fd0-2511c80d6e62 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:46.191982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ee4c99b-75d3-46a3-9fd0-2511c80d6e62 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:46.192472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ee4c99b-75d3-46a3-9fd0-2511c80d6e62 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:46.322269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9a08bfb4-4fa5-4a4d-bfec-b5f4aacd9aca tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:46.322882 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9a08bfb4-4fa5-4a4d-bfec-b5f4aacd9aca tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:46.334032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a08bfb4-4fa5-4a4d-bfec-b5f4aacd9aca tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:46.334469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a08bfb4-4fa5-4a4d-bfec-b5f4aacd9aca tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:46.349429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a08bfb4-4fa5-4a4d-bfec-b5f4aacd9aca tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:46.349885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a08bfb4-4fa5-4a4d-bfec-b5f4aacd9aca tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:46.483860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5ee4c99b-75d3-46a3-9fd0-2511c80d6e62 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:46.500801 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5ee4c99b-75d3-46a3-9fd0-2511c80d6e62 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:46.502998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5ee4c99b-75d3-46a3-9fd0-2511c80d6e62 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:46.514386 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5ee4c99b-75d3-46a3-9fd0-2511c80d6e62 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1372 microversion: 2.47 time: 0.351444 Jul 20 04:44:46.521528 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2793/5342] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:46 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1372 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:46.527492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d96807be-2461-452a-9dac-46ed6747fda6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:46.528117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d96807be-2461-452a-9dac-46ed6747fda6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:46.549623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d96807be-2461-452a-9dac-46ed6747fda6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:46.550446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d96807be-2461-452a-9dac-46ed6747fda6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:46.552880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d96807be-2461-452a-9dac-46ed6747fda6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:46.554970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d96807be-2461-452a-9dac-46ed6747fda6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:46.912162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d96807be-2461-452a-9dac-46ed6747fda6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:46.926992 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d96807be-2461-452a-9dac-46ed6747fda6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1696 microversion: 2.1 time: 0.404317 Jul 20 04:44:46.928999 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2794/5343] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:46 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1696 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:47.303744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9a08bfb4-4fa5-4a4d-bfec-b5f4aacd9aca tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:47.315045 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9a08bfb4-4fa5-4a4d-bfec-b5f4aacd9aca tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1229 microversion: 2.1 time: 0.995405 Jul 20 04:44:47.317229 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2550/5344] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:46 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1229 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:47.543362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5270b648-3493-4b8c-99bf-46cf329c5ad5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:47.543873 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5270b648-3493-4b8c-99bf-46cf329c5ad5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:47.556391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5270b648-3493-4b8c-99bf-46cf329c5ad5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:47.557553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5270b648-3493-4b8c-99bf-46cf329c5ad5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:47.558659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5270b648-3493-4b8c-99bf-46cf329c5ad5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:47.559303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5270b648-3493-4b8c-99bf-46cf329c5ad5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:47.691121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5270b648-3493-4b8c-99bf-46cf329c5ad5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:47.705415 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5270b648-3493-4b8c-99bf-46cf329c5ad5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:47.707188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5270b648-3493-4b8c-99bf-46cf329c5ad5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:47.708606 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5270b648-3493-4b8c-99bf-46cf329c5ad5 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1357 microversion: 2.47 time: 0.169446 Jul 20 04:44:47.717711 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2795/5345] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:47 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:47.729560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6f374ed2-6057-4262-87e2-d125f9e7ae74 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:47.737818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6f374ed2-6057-4262-87e2-d125f9e7ae74 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:47.739653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6f374ed2-6057-4262-87e2-d125f9e7ae74 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Searching by: {'deleted': False, 'project_id': '3ac56eb8b1744137812d331efae19fd5'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:44:47.748015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f374ed2-6057-4262-87e2-d125f9e7ae74 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:47.748673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f374ed2-6057-4262-87e2-d125f9e7ae74 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:47.749693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f374ed2-6057-4262-87e2-d125f9e7ae74 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:47.750300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f374ed2-6057-4262-87e2-d125f9e7ae74 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:47.954125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-27937be2-0af2-439d-a9b5-2f5992408f5c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:47.954824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-27937be2-0af2-439d-a9b5-2f5992408f5c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:47.968701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27937be2-0af2-439d-a9b5-2f5992408f5c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:47.972491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27937be2-0af2-439d-a9b5-2f5992408f5c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:47.974013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27937be2-0af2-439d-a9b5-2f5992408f5c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:47.974623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27937be2-0af2-439d-a9b5-2f5992408f5c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:47.996850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-6f374ed2-6057-4262-87e2-d125f9e7ae74 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:44:48.192957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6f374ed2-6057-4262-87e2-d125f9e7ae74 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:48.207230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f374ed2-6057-4262-87e2-d125f9e7ae74 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:48.207991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f374ed2-6057-4262-87e2-d125f9e7ae74 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:48.241344 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6f374ed2-6057-4262-87e2-d125f9e7ae74 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:48.243042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6f374ed2-6057-4262-87e2-d125f9e7ae74 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:48.461669 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6f374ed2-6057-4262-87e2-d125f9e7ae74 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.736138 Jul 20 04:44:48.462288 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2551/5346] 10.222.0.17 () {60 vars in 1186 bytes} [Wed Jul 20 04:44:47 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:48.475500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a715a0f3-0e90-4962-87b3-e48de8edf8c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:48.475500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a715a0f3-0e90-4962-87b3-e48de8edf8c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:48.491492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a715a0f3-0e90-4962-87b3-e48de8edf8c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:48.491949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a715a0f3-0e90-4962-87b3-e48de8edf8c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:48.492773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a715a0f3-0e90-4962-87b3-e48de8edf8c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:48.501938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a715a0f3-0e90-4962-87b3-e48de8edf8c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:48.572220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-27937be2-0af2-439d-a9b5-2f5992408f5c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:48.585918 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-27937be2-0af2-439d-a9b5-2f5992408f5c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1696 microversion: 2.1 time: 0.635982 Jul 20 04:44:48.593222 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2796/5347] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:47 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1696 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:48.598770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1e417717-ad9d-4a63-8119-559cd55917c2 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:48.599272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1e417717-ad9d-4a63-8119-559cd55917c2 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:48.618754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e417717-ad9d-4a63-8119-559cd55917c2 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:48.624531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e417717-ad9d-4a63-8119-559cd55917c2 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:48.625488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e417717-ad9d-4a63-8119-559cd55917c2 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:48.631057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e417717-ad9d-4a63-8119-559cd55917c2 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:48.699793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1e417717-ad9d-4a63-8119-559cd55917c2 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:44:48.899054 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1e417717-ad9d-4a63-8119-559cd55917c2 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "DELETE /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 204 len: 0 microversion: 2.47 time: 0.304284 Jul 20 04:44:48.913108 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2797/5348] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:44:48 2022] DELETE /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:44:48.927698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ae7df83a-49a8-443c-82b4-caffced050f1 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:48.928864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ae7df83a-49a8-443c-82b4-caffced050f1 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:48.945252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae7df83a-49a8-443c-82b4-caffced050f1 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:48.945957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae7df83a-49a8-443c-82b4-caffced050f1 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:48.946997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae7df83a-49a8-443c-82b4-caffced050f1 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:48.948325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae7df83a-49a8-443c-82b4-caffced050f1 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:49.184093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ae7df83a-49a8-443c-82b4-caffced050f1 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:49.201922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ae7df83a-49a8-443c-82b4-caffced050f1 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:49.205827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ae7df83a-49a8-443c-82b4-caffced050f1 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:49.208033 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ae7df83a-49a8-443c-82b4-caffced050f1 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1363 microversion: 2.47 time: 0.289695 Jul 20 04:44:49.211659 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2798/5349] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:48 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:44:49.270235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a715a0f3-0e90-4962-87b3-e48de8edf8c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:49.289337 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a715a0f3-0e90-4962-87b3-e48de8edf8c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1229 microversion: 2.1 time: 0.825896 Jul 20 04:44:49.292817 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2552/5350] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:48 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1229 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:49.621486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ac527eb6-5392-44c8-83ca-ae3808419ef9 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:49.622869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ac527eb6-5392-44c8-83ca-ae3808419ef9 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:49.646538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac527eb6-5392-44c8-83ca-ae3808419ef9 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:49.648485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac527eb6-5392-44c8-83ca-ae3808419ef9 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:49.653415 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac527eb6-5392-44c8-83ca-ae3808419ef9 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:49.655910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac527eb6-5392-44c8-83ca-ae3808419ef9 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:49.703019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:49.859610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-025faee5-e569-402e-996b-68f03b8ef859 req-8a96c7c8-2ca0-4597-b2e8-66fa804bd342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7fed1e7-12d5-4f39-9c2a-65e4dd681aff", "tag": "cbe618b3-cf79-40f4-8209-0fcfe0234ec0"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:49.885304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-025faee5-e569-402e-996b-68f03b8ef859 req-8a96c7c8-2ca0-4597-b2e8-66fa804bd342 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:49.885751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-025faee5-e569-402e-996b-68f03b8ef859 req-8a96c7c8-2ca0-4597-b2e8-66fa804bd342 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:49.955209 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-025faee5-e569-402e-996b-68f03b8ef859 req-8a96c7c8-2ca0-4597-b2e8-66fa804bd342 service nova] Creating event network-changed:cbe618b3-cf79-40f4-8209-0fcfe0234ec0 for instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff on n-h2-826526-5 Jul 20 04:44:49.982321 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-025faee5-e569-402e-996b-68f03b8ef859 req-8a96c7c8-2ca0-4597-b2e8-66fa804bd342 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126020 Jul 20 04:44:49.982321 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2553/5351] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:44:50.231838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-51d12897-b0cd-4250-ae68-74050fc73304 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:50.232699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-51d12897-b0cd-4250-ae68-74050fc73304 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:50.250356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-51d12897-b0cd-4250-ae68-74050fc73304 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:50.251347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-51d12897-b0cd-4250-ae68-74050fc73304 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:50.252165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-51d12897-b0cd-4250-ae68-74050fc73304 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:50.252904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-51d12897-b0cd-4250-ae68-74050fc73304 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:50.272144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ac527eb6-5392-44c8-83ca-ae3808419ef9 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:50.320584 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ac527eb6-5392-44c8-83ca-ae3808419ef9 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1696 microversion: 2.1 time: 0.709241 Jul 20 04:44:50.326941 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2799/5352] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:49 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1696 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:50.351192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8b224cec-adf6-4e67-b319-f773cce65a78 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:50.352074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8b224cec-adf6-4e67-b319-f773cce65a78 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:50.372202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b224cec-adf6-4e67-b319-f773cce65a78 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:50.375846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b224cec-adf6-4e67-b319-f773cce65a78 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:50.376948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b224cec-adf6-4e67-b319-f773cce65a78 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:50.377612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b224cec-adf6-4e67-b319-f773cce65a78 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:50.948334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8b224cec-adf6-4e67-b319-f773cce65a78 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:50.963308 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8b224cec-adf6-4e67-b319-f773cce65a78 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1229 microversion: 2.1 time: 0.634806 Jul 20 04:44:50.965176 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2800/5353] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:50 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1229 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:51.157241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-51d12897-b0cd-4250-ae68-74050fc73304 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:51.188697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-51d12897-b0cd-4250-ae68-74050fc73304 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:51.206829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-51d12897-b0cd-4250-ae68-74050fc73304 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:51.208530 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-51d12897-b0cd-4250-ae68-74050fc73304 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 200 len: 1363 microversion: 2.47 time: 0.982224 Jul 20 04:44:51.244369 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2554/5354] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:50 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 1363 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:51.343876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bc2a50d6-d665-4295-86e1-eef0cf02c8d7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:51.344948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bc2a50d6-d665-4295-86e1-eef0cf02c8d7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:51.358313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc2a50d6-d665-4295-86e1-eef0cf02c8d7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:51.358803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc2a50d6-d665-4295-86e1-eef0cf02c8d7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:51.365051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc2a50d6-d665-4295-86e1-eef0cf02c8d7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:51.366032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc2a50d6-d665-4295-86e1-eef0cf02c8d7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:51.986336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-08056c7a-9134-478a-b436-296b9d96dfa8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:51.987935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-08056c7a-9134-478a-b436-296b9d96dfa8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:52.026147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08056c7a-9134-478a-b436-296b9d96dfa8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:52.029182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08056c7a-9134-478a-b436-296b9d96dfa8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:52.036517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08056c7a-9134-478a-b436-296b9d96dfa8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:52.039006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08056c7a-9134-478a-b436-296b9d96dfa8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:52.221300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:52.257071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:52.554618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bc2a50d6-d665-4295-86e1-eef0cf02c8d7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:52.575812 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bc2a50d6-d665-4295-86e1-eef0cf02c8d7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1696 microversion: 2.1 time: 1.227942 Jul 20 04:44:52.577276 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2801/5355] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:51 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1696 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:52.585397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ef5f6582-1090-4076-b709-5eb3bf3cac18 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:52.587164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ef5f6582-1090-4076-b709-5eb3bf3cac18 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 602bed25-b5e1-4f3f-9e17-316f84f5c208] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:52.608789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef5f6582-1090-4076-b709-5eb3bf3cac18 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:52.616034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef5f6582-1090-4076-b709-5eb3bf3cac18 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:52.618891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef5f6582-1090-4076-b709-5eb3bf3cac18 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:52.620649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef5f6582-1090-4076-b709-5eb3bf3cac18 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:52.650276 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-ef5f6582-1090-4076-b709-5eb3bf3cac18 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] HTTP exception thrown: Instance 602bed25-b5e1-4f3f-9e17-316f84f5c208 could not be found. Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ef5f6582-1090-4076-b709-5eb3bf3cac18 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Request method failure captured: Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 HTTP/1.1 Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14gTdl6qpTX0e07CdkdEkD0cBZOyU9MgvVIHCknt3PPLGCkd5e1Dm80PBqjMFbuNARq8sc5YnBQqEgIm_BH74TTv0GhpSiz3JUt57kFYtAWiGMDtkTAx3qU9DjkuYKEXkTJGjxpPXmkPqLc_HTnC1DiZhb6ZAa8b4X4-2_qZr0F72d4 Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-Openstack-Nova-Api-Version: 2.47 Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 3ac56eb8b1744137812d331efae19fd5 Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerShowV247Test-773706953 Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3ac56eb8b1744137812d331efae19fd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3ac56eb8b1744137812d331efae19fd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3ac56eb8b1744137812d331efae19fd5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3ac56eb8b1744137812d331efae19fd5"}]}] Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerShowV247Test-773706953 Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 3ac56eb8b1744137812d331efae19fd5 Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerShowV247Test-773706953 Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerShowV247Test-773706953-project Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 8f0b46eabea04d27b7ad3024111116b0 Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerShowV247Test-773706953-project Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 602bed25-b5e1-4f3f-9e17-316f84f5c208 could not be found. Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '602bed25-b5e1-4f3f-9e17-316f84f5c208'} Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 602bed25-b5e1-4f3f-9e17-316f84f5c208 could not be found. Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 602bed25-b5e1-4f3f-9e17-316f84f5c208 could not be found. Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:52.653105 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:44:52.659042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:52.659042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:52.659042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:52.659042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:52.659042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:52.659042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 602bed25-b5e1-4f3f-9e17-316f84f5c208 could not be found. Jul 20 04:44:52.659042 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:44:52.659042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ef5f6582-1090-4076-b709-5eb3bf3cac18 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Returning 404 to user: Instance 602bed25-b5e1-4f3f-9e17-316f84f5c208 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:52.660339 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ef5f6582-1090-4076-b709-5eb3bf3cac18 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208" status: 404 len: 111 microversion: 2.47 time: 0.081157 Jul 20 04:44:52.660904 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2802/5356] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:52 2022] GET /compute/v2.1/servers/602bed25-b5e1-4f3f-9e17-316f84f5c208 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:44:52.678668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f3cf952b-7d57-4a94-9624-2fae788ab9f3 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:52.682747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f3cf952b-7d57-4a94-9624-2fae788ab9f3 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 4c91a209-b178-45b1-b459-ff6716e7f400] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:52.709950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3cf952b-7d57-4a94-9624-2fae788ab9f3 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:52.710409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3cf952b-7d57-4a94-9624-2fae788ab9f3 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:52.719718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3cf952b-7d57-4a94-9624-2fae788ab9f3 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:52.720472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3cf952b-7d57-4a94-9624-2fae788ab9f3 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:52.801768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f3cf952b-7d57-4a94-9624-2fae788ab9f3 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 4c91a209-b178-45b1-b459-ff6716e7f400] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:44:52.806928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-08056c7a-9134-478a-b436-296b9d96dfa8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:52.817298 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-08056c7a-9134-478a-b436-296b9d96dfa8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1229 microversion: 2.1 time: 0.839125 Jul 20 04:44:52.817912 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2555/5357] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:51 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1229 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:53.009198 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f3cf952b-7d57-4a94-9624-2fae788ab9f3 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4c91a209-b178-45b1-b459-ff6716e7f400" status: 204 len: 0 microversion: 2.47 time: 0.340876 Jul 20 04:44:53.010996 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2803/5358] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:44:52 2022] DELETE /compute/v2.1/servers/4c91a209-b178-45b1-b459-ff6716e7f400 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:44:53.019912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b2eb183c-b7c3-4836-9438-7514e494298a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:53.020864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b2eb183c-b7c3-4836-9438-7514e494298a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 4c91a209-b178-45b1-b459-ff6716e7f400] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:53.030105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2eb183c-b7c3-4836-9438-7514e494298a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:53.030863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2eb183c-b7c3-4836-9438-7514e494298a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:53.031974 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2eb183c-b7c3-4836-9438-7514e494298a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:53.033612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2eb183c-b7c3-4836-9438-7514e494298a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:53.286250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b2eb183c-b7c3-4836-9438-7514e494298a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:53.313507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b2eb183c-b7c3-4836-9438-7514e494298a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:53.317218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b2eb183c-b7c3-4836-9438-7514e494298a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:53.322440 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b2eb183c-b7c3-4836-9438-7514e494298a tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/4c91a209-b178-45b1-b459-ff6716e7f400" status: 200 len: 1362 microversion: 2.47 time: 0.305036 Jul 20 04:44:53.325196 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2556/5359] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:53 2022] GET /compute/v2.1/servers/4c91a209-b178-45b1-b459-ff6716e7f400 => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:53.595478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1166f275-e254-4b7b-8f2c-14dc57102fdb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:53.596745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1166f275-e254-4b7b-8f2c-14dc57102fdb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:53.610565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1166f275-e254-4b7b-8f2c-14dc57102fdb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:53.616547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1166f275-e254-4b7b-8f2c-14dc57102fdb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:53.619683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1166f275-e254-4b7b-8f2c-14dc57102fdb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:53.620253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1166f275-e254-4b7b-8f2c-14dc57102fdb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:53.836028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-77bb9ac6-6a5a-41fb-8c87-0e90bc973632 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:53.836685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-77bb9ac6-6a5a-41fb-8c87-0e90bc973632 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:53.850392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-77bb9ac6-6a5a-41fb-8c87-0e90bc973632 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:53.861252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-77bb9ac6-6a5a-41fb-8c87-0e90bc973632 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:53.861252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-77bb9ac6-6a5a-41fb-8c87-0e90bc973632 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:53.861566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-77bb9ac6-6a5a-41fb-8c87-0e90bc973632 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:54.092287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1166f275-e254-4b7b-8f2c-14dc57102fdb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:54.111561 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1166f275-e254-4b7b-8f2c-14dc57102fdb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1696 microversion: 2.1 time: 0.518487 Jul 20 04:44:54.118186 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2804/5360] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:53 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1696 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:54.347269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f0c05cd8-5e0d-4b84-b18e-f109aec41a95 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:54.347862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f0c05cd8-5e0d-4b84-b18e-f109aec41a95 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 4c91a209-b178-45b1-b459-ff6716e7f400] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:54.364375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0c05cd8-5e0d-4b84-b18e-f109aec41a95 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:54.365059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0c05cd8-5e0d-4b84-b18e-f109aec41a95 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:54.366082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0c05cd8-5e0d-4b84-b18e-f109aec41a95 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:54.366679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0c05cd8-5e0d-4b84-b18e-f109aec41a95 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:54.642329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-77bb9ac6-6a5a-41fb-8c87-0e90bc973632 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:54.653693 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-77bb9ac6-6a5a-41fb-8c87-0e90bc973632 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1229 microversion: 2.1 time: 0.819584 Jul 20 04:44:54.657321 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2557/5361] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:53 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1229 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:55.135877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-134b609d-0f04-44aa-ac81-181c6b263c30 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:55.136698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-134b609d-0f04-44aa-ac81-181c6b263c30 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:55.159694 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-134b609d-0f04-44aa-ac81-181c6b263c30 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:55.160627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-134b609d-0f04-44aa-ac81-181c6b263c30 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:55.161656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-134b609d-0f04-44aa-ac81-181c6b263c30 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:55.162286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-134b609d-0f04-44aa-ac81-181c6b263c30 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:55.170082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f0c05cd8-5e0d-4b84-b18e-f109aec41a95 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:55.186990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f0c05cd8-5e0d-4b84-b18e-f109aec41a95 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:55.203722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f0c05cd8-5e0d-4b84-b18e-f109aec41a95 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0b46eabea04d27b7ad3024111116b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac56eb8b1744137812d331efae19fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:55.212768 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f0c05cd8-5e0d-4b84-b18e-f109aec41a95 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/4c91a209-b178-45b1-b459-ff6716e7f400" status: 200 len: 1362 microversion: 2.47 time: 0.866977 Jul 20 04:44:55.216044 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2805/5362] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:54 2022] GET /compute/v2.1/servers/4c91a209-b178-45b1-b459-ff6716e7f400 => generated 1362 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:55.673817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-71bf8e5d-5afc-4be8-876b-0c97e4c9b734 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:55.675200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-71bf8e5d-5afc-4be8-876b-0c97e4c9b734 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:55.686770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71bf8e5d-5afc-4be8-876b-0c97e4c9b734 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:55.698900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71bf8e5d-5afc-4be8-876b-0c97e4c9b734 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:55.700070 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71bf8e5d-5afc-4be8-876b-0c97e4c9b734 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:55.701315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71bf8e5d-5afc-4be8-876b-0c97e4c9b734 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:56.178333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-134b609d-0f04-44aa-ac81-181c6b263c30 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:56.190864 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-134b609d-0f04-44aa-ac81-181c6b263c30 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1695 microversion: 2.1 time: 1.058913 Jul 20 04:44:56.191877 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2558/5363] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:55 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1695 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:56.239673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d5ac0794-b950-4a37-807c-5494609b39e4 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:56.240734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d5ac0794-b950-4a37-807c-5494609b39e4 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] [instance: 4c91a209-b178-45b1-b459-ff6716e7f400] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:56.283199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5ac0794-b950-4a37-807c-5494609b39e4 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:56.284089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5ac0794-b950-4a37-807c-5494609b39e4 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:56.285425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5ac0794-b950-4a37-807c-5494609b39e4 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:56.286059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5ac0794-b950-4a37-807c-5494609b39e4 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:56.323957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-71bf8e5d-5afc-4be8-876b-0c97e4c9b734 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:56.336811 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-71bf8e5d-5afc-4be8-876b-0c97e4c9b734 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1229 microversion: 2.1 time: 0.666883 Jul 20 04:44:56.339480 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2806/5364] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:55 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1229 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:56.389926 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-d5ac0794-b950-4a37-807c-5494609b39e4 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] HTTP exception thrown: Instance 4c91a209-b178-45b1-b459-ff6716e7f400 could not be found. Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d5ac0794-b950-4a37-807c-5494609b39e4 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Request method failure captured: Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/4c91a209-b178-45b1-b459-ff6716e7f400 HTTP/1.1 Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14gTdl6qpTX0e07CdkdEkD0cBZOyU9MgvVIHCknt3PPLGCkd5e1Dm80PBqjMFbuNARq8sc5YnBQqEgIm_BH74TTv0GhpSiz3JUt57kFYtAWiGMDtkTAx3qU9DjkuYKEXkTJGjxpPXmkPqLc_HTnC1DiZhb6ZAa8b4X4-2_qZr0F72d4 Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.47 Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 3ac56eb8b1744137812d331efae19fd5 Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerShowV247Test-773706953 Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3ac56eb8b1744137812d331efae19fd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3ac56eb8b1744137812d331efae19fd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3ac56eb8b1744137812d331efae19fd5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3ac56eb8b1744137812d331efae19fd5"}]}] Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerShowV247Test-773706953 Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 3ac56eb8b1744137812d331efae19fd5 Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerShowV247Test-773706953 Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerShowV247Test-773706953-project Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 8f0b46eabea04d27b7ad3024111116b0 Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerShowV247Test-773706953-project Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 4c91a209-b178-45b1-b459-ff6716e7f400 could not be found. Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '4c91a209-b178-45b1-b459-ff6716e7f400'} Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c91a209-b178-45b1-b459-ff6716e7f400 could not be found. Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c91a209-b178-45b1-b459-ff6716e7f400 could not be found. Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:56.391751 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:56.397122 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:56.397122 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:56.397122 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:56.397122 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:56.397122 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:56.397122 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c91a209-b178-45b1-b459-ff6716e7f400 could not be found. Jul 20 04:44:56.397122 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:44:56.404008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d5ac0794-b950-4a37-807c-5494609b39e4 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] Returning 404 to user: Instance 4c91a209-b178-45b1-b459-ff6716e7f400 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:56.405289 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d5ac0794-b950-4a37-807c-5494609b39e4 tempest-ServerShowV247Test-773706953 tempest-ServerShowV247Test-773706953-project] 10.222.0.17 "GET /compute/v2.1/servers/4c91a209-b178-45b1-b459-ff6716e7f400" status: 404 len: 111 microversion: 2.47 time: 0.174780 Jul 20 04:44:56.405902 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2559/5365] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:56 2022] GET /compute/v2.1/servers/4c91a209-b178-45b1-b459-ff6716e7f400 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:44:57.249902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d5226f65-46c5-486b-b296-6d635573a3cd tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:57.250556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d5226f65-46c5-486b-b296-6d635573a3cd tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:57.286021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5226f65-46c5-486b-b296-6d635573a3cd tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.286763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5226f65-46c5-486b-b296-6d635573a3cd tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.288298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5226f65-46c5-486b-b296-6d635573a3cd tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.313059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5226f65-46c5-486b-b296-6d635573a3cd tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.881767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:58.026426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d5226f65-46c5-486b-b296-6d635573a3cd tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:58.039768 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d5226f65-46c5-486b-b296-6d635573a3cd tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1695 microversion: 2.1 time: 0.833451 Jul 20 04:44:58.045932 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2560/5366] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:57 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1695 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:58.060766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-16360851-5b6d-4c62-b8cf-b1f42b3c3c54 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:58.067112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-16360851-5b6d-4c62-b8cf-b1f42b3c3c54 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:58.087554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16360851-5b6d-4c62-b8cf-b1f42b3c3c54 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:58.089391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16360851-5b6d-4c62-b8cf-b1f42b3c3c54 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:58.090505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16360851-5b6d-4c62-b8cf-b1f42b3c3c54 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:58.091993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16360851-5b6d-4c62-b8cf-b1f42b3c3c54 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:58.099056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b4fecf17-e348-4fa6-a078-ce3c3b082585 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-191063631", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": "none"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:58.190306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:58.218316 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b4fecf17-e348-4fa6-a078-ce3c3b082585 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:44:58.219139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b4fecf17-e348-4fa6-a078-ce3c3b082585 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:44:58.219812 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b4fecf17-e348-4fa6-a078-ce3c3b082585 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:44:58.220750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b4fecf17-e348-4fa6-a078-ce3c3b082585 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:44:58.221371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-b4fecf17-e348-4fa6-a078-ce3c3b082585 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:44:58.243423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4fecf17-e348-4fa6-a078-ce3c3b082585 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:58.249077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4fecf17-e348-4fa6-a078-ce3c3b082585 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:58.250407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4fecf17-e348-4fa6-a078-ce3c3b082585 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:58.251210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4fecf17-e348-4fa6-a078-ce3c3b082585 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:58.307405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-b4fecf17-e348-4fa6-a078-ce3c3b082585 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Getting quotas for project c1cc471d4c4e4a66a5745b74db41c9b5. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:44:58.330203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-b4fecf17-e348-4fa6-a078-ce3c3b082585 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Getting quotas for user c90b8b96fdd1409bb9876dabb3989663 and project c1cc471d4c4e4a66a5745b74db41c9b5. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:44:58.377105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b4fecf17-e348-4fa6-a078-ce3c3b082585 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:44:58.382253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b4fecf17-e348-4fa6-a078-ce3c3b082585 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:44:58.487114 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b4fecf17-e348-4fa6-a078-ce3c3b082585 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.422964 Jul 20 04:44:58.488405 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2807/5367] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 04:44:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1429 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:44:58.498444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-cb92d69f-0571-44ad-a2c1-c58ffd407623 req-2cfc3f60-028b-4f1d-9ee8-a105e31e09ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69b8042-1e5c-4ea4-9c05-3623cb12ad85", "name": "network-vif-unplugged", "status": "completed", "tag": "250e1005-0706-457b-aa98-bde024a78797"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:58.518138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-cb92d69f-0571-44ad-a2c1-c58ffd407623 req-2cfc3f60-028b-4f1d-9ee8-a105e31e09ef service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:58.518497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-cb92d69f-0571-44ad-a2c1-c58ffd407623 req-2cfc3f60-028b-4f1d-9ee8-a105e31e09ef service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:58.587617 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-cb92d69f-0571-44ad-a2c1-c58ffd407623 req-2cfc3f60-028b-4f1d-9ee8-a105e31e09ef service nova] Creating event network-vif-unplugged:250e1005-0706-457b-aa98-bde024a78797 for instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 on n-h1-826526-5 Jul 20 04:44:58.607342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-cb92d69f-0571-44ad-a2c1-c58ffd407623 req-2cfc3f60-028b-4f1d-9ee8-a105e31e09ef service nova] Instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:44:58.644575 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-cb92d69f-0571-44ad-a2c1-c58ffd407623 req-2cfc3f60-028b-4f1d-9ee8-a105e31e09ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154408 Jul 20 04:44:58.649097 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2808/5368] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:58.662300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3bdb41b6-94dc-44f5-b992-8dbbc48ba9bc tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:58.663836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3bdb41b6-94dc-44f5-b992-8dbbc48ba9bc tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:58.814451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3bdb41b6-94dc-44f5-b992-8dbbc48ba9bc tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:58.822526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3bdb41b6-94dc-44f5-b992-8dbbc48ba9bc tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:58.824072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3bdb41b6-94dc-44f5-b992-8dbbc48ba9bc tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:58.825298 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3bdb41b6-94dc-44f5-b992-8dbbc48ba9bc tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1277 microversion: 2.54 time: 0.174945 Jul 20 04:44:58.825888 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2809/5369] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:58 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:58.950099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-16360851-5b6d-4c62-b8cf-b1f42b3c3c54 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:58.960720 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-16360851-5b6d-4c62-b8cf-b1f42b3c3c54 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1217 microversion: 2.1 time: 0.913502 Jul 20 04:44:58.961521 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2561/5370] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:58 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1217 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:59.062065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e574630d-fa11-4cac-ba08-31cb4fa8269a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:59.062682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e574630d-fa11-4cac-ba08-31cb4fa8269a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:59.069987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e574630d-fa11-4cac-ba08-31cb4fa8269a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:59.070445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e574630d-fa11-4cac-ba08-31cb4fa8269a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:59.071257 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e574630d-fa11-4cac-ba08-31cb4fa8269a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:59.071695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e574630d-fa11-4cac-ba08-31cb4fa8269a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:59.572016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e574630d-fa11-4cac-ba08-31cb4fa8269a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:59.584468 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e574630d-fa11-4cac-ba08-31cb4fa8269a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1695 microversion: 2.1 time: 0.526175 Jul 20 04:44:59.608492 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2810/5371] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:59 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1695 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:59.847795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b4363065-a639-4d33-82f1-468a381e476b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:59.848456 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b4363065-a639-4d33-82f1-468a381e476b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:59.870593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b4363065-a639-4d33-82f1-468a381e476b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:59.873319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b4363065-a639-4d33-82f1-468a381e476b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:59.877261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b4363065-a639-4d33-82f1-468a381e476b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:59.884716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b4363065-a639-4d33-82f1-468a381e476b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:59.980306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1cfe5a6c-f496-49ac-b83e-53fbf02d0c5d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:59.981057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1cfe5a6c-f496-49ac-b83e-53fbf02d0c5d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:59.995299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1cfe5a6c-f496-49ac-b83e-53fbf02d0c5d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:59.996980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1cfe5a6c-f496-49ac-b83e-53fbf02d0c5d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:00.000898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1cfe5a6c-f496-49ac-b83e-53fbf02d0c5d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:00.001686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1cfe5a6c-f496-49ac-b83e-53fbf02d0c5d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:00.108724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b4363065-a639-4d33-82f1-468a381e476b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:00.154984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b4363065-a639-4d33-82f1-468a381e476b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:00.161159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b4363065-a639-4d33-82f1-468a381e476b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:00.167228 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b4363065-a639-4d33-82f1-468a381e476b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1273 microversion: 2.54 time: 0.323811 Jul 20 04:45:00.169268 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2562/5372] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:59 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1273 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:00.622843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b237d8eb-40be-47d4-a810-58eba150492b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:00.624164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b237d8eb-40be-47d4-a810-58eba150492b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:00.642795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b237d8eb-40be-47d4-a810-58eba150492b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:00.643615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b237d8eb-40be-47d4-a810-58eba150492b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:00.644750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b237d8eb-40be-47d4-a810-58eba150492b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:00.645786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b237d8eb-40be-47d4-a810-58eba150492b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:00.774961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1cfe5a6c-f496-49ac-b83e-53fbf02d0c5d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:00.789123 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1cfe5a6c-f496-49ac-b83e-53fbf02d0c5d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1217 microversion: 2.1 time: 0.813531 Jul 20 04:45:00.790406 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2811/5373] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:59 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1217 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:00.795367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-ab18689d-d9c5-4b74-baec-e1dfb4ef7656 req-8a0075df-21cd-41ae-a1fc-4c01db9ee0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69b8042-1e5c-4ea4-9c05-3623cb12ad85", "tag": "250e1005-0706-457b-aa98-bde024a78797"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:00.819827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ab18689d-d9c5-4b74-baec-e1dfb4ef7656 req-8a0075df-21cd-41ae-a1fc-4c01db9ee0a8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:00.820428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ab18689d-d9c5-4b74-baec-e1dfb4ef7656 req-8a0075df-21cd-41ae-a1fc-4c01db9ee0a8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:00.845557 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-ab18689d-d9c5-4b74-baec-e1dfb4ef7656 req-8a0075df-21cd-41ae-a1fc-4c01db9ee0a8 service nova] Creating event network-changed:250e1005-0706-457b-aa98-bde024a78797 for instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 on n-h1-826526-5 Jul 20 04:45:00.856934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-ab18689d-d9c5-4b74-baec-e1dfb4ef7656 req-8a0075df-21cd-41ae-a1fc-4c01db9ee0a8 service nova] Instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:45:00.891652 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-ab18689d-d9c5-4b74-baec-e1dfb4ef7656 req-8a0075df-21cd-41ae-a1fc-4c01db9ee0a8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098963 Jul 20 04:45:00.895013 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2812/5374] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:01.077317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b237d8eb-40be-47d4-a810-58eba150492b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:01.093170 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b237d8eb-40be-47d4-a810-58eba150492b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1695 microversion: 2.1 time: 0.484550 Jul 20 04:45:01.103357 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2563/5375] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:00 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1695 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:01.188431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b0c9cf1f-ab52-49c9-b65b-033b7a34e938 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:01.189141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b0c9cf1f-ab52-49c9-b65b-033b7a34e938 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:01.192916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:01.217708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b0c9cf1f-ab52-49c9-b65b-033b7a34e938 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:01.222797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b0c9cf1f-ab52-49c9-b65b-033b7a34e938 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:01.229544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b0c9cf1f-ab52-49c9-b65b-033b7a34e938 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:01.238576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b0c9cf1f-ab52-49c9-b65b-033b7a34e938 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:01.898773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-09f22e98-b7b0-4979-8ddd-bc043d3a17b2 tempest-QuotasTestJSON-253219563 tempest-QuotasTestJSON-253219563-project] Calling method '.version_select at 0x7f06bcc56790>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:01.927682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b0c9cf1f-ab52-49c9-b65b-033b7a34e938 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:01.939345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b0c9cf1f-ab52-49c9-b65b-033b7a34e938 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:01.940905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b0c9cf1f-ab52-49c9-b65b-033b7a34e938 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:01.942116 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b0c9cf1f-ab52-49c9-b65b-033b7a34e938 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1335 microversion: 2.54 time: 0.758525 Jul 20 04:45:01.956021 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2813/5376] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:01 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1335 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:01.973120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3bc2ae31-942a-4f0c-a53e-03d7a1783b70 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:01.975351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3bc2ae31-942a-4f0c-a53e-03d7a1783b70 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:02.007101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3bc2ae31-942a-4f0c-a53e-03d7a1783b70 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:02.007551 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3bc2ae31-942a-4f0c-a53e-03d7a1783b70 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:02.008379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3bc2ae31-942a-4f0c-a53e-03d7a1783b70 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:02.008823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3bc2ae31-942a-4f0c-a53e-03d7a1783b70 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:02.575670 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-09f22e98-b7b0-4979-8ddd-bc043d3a17b2 tempest-QuotasTestJSON-253219563 tempest-QuotasTestJSON-253219563-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/8af32f4d504f43748643f05d910eb348/defaults" status: 200 len: 371 microversion: 2.1 time: 1.260244 Jul 20 04:45:02.586802 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2564/5377] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 04:45:01 2022] GET /compute/v2.1/os-quota-sets/8af32f4d504f43748643f05d910eb348/defaults => generated 371 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:02.604370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-87f013c4-bb0b-49a5-809c-097ce34dca81 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:02.604956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-87f013c4-bb0b-49a5-809c-097ce34dca81 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:02.647509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87f013c4-bb0b-49a5-809c-097ce34dca81 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:02.649256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87f013c4-bb0b-49a5-809c-097ce34dca81 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:02.653138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87f013c4-bb0b-49a5-809c-097ce34dca81 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:02.653598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87f013c4-bb0b-49a5-809c-097ce34dca81 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:02.886309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3bc2ae31-942a-4f0c-a53e-03d7a1783b70 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:02.907118 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3bc2ae31-942a-4f0c-a53e-03d7a1783b70 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1217 microversion: 2.1 time: 0.949324 Jul 20 04:45:02.910104 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2814/5378] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:01 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1217 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:02.926954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ec98d282-8aa2-41d9-b7ba-a98157036862 tempest-QuotasTestJSON-253219563 tempest-QuotasTestJSON-253219563-project] Calling method '.version_select at 0x7f06bccb0e50>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:03.250818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-87f013c4-bb0b-49a5-809c-097ce34dca81 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:03.289297 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-87f013c4-bb0b-49a5-809c-097ce34dca81 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1695 microversion: 2.1 time: 0.698643 Jul 20 04:45:03.293945 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2565/5379] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:02 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1695 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:03.307934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6d0b4f6c-138b-4c5e-a776-675b3910c4cb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:03.309001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6d0b4f6c-138b-4c5e-a776-675b3910c4cb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:03.316118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d0b4f6c-138b-4c5e-a776-675b3910c4cb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:03.316878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d0b4f6c-138b-4c5e-a776-675b3910c4cb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:03.320548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d0b4f6c-138b-4c5e-a776-675b3910c4cb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:03.321358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d0b4f6c-138b-4c5e-a776-675b3910c4cb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:03.454874 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ec98d282-8aa2-41d9-b7ba-a98157036862 tempest-QuotasTestJSON-253219563 tempest-QuotasTestJSON-253219563-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/8af32f4d504f43748643f05d910eb348" status: 200 len: 371 microversion: 2.1 time: 0.539293 Jul 20 04:45:03.457829 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2815/5380] 10.222.0.17 () {58 vars in 1241 bytes} [Wed Jul 20 04:45:02 2022] GET /compute/v2.1/os-quota-sets/8af32f4d504f43748643f05d910eb348 => generated 371 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:03.541773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6d0b4f6c-138b-4c5e-a776-675b3910c4cb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:03.546278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:03.559528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6d0b4f6c-138b-4c5e-a776-675b3910c4cb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:03.562209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6d0b4f6c-138b-4c5e-a776-675b3910c4cb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:03.564300 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6d0b4f6c-138b-4c5e-a776-675b3910c4cb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1356 microversion: 2.54 time: 0.268771 Jul 20 04:45:03.582749 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2566/5381] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:03 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1356 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:03.599134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-983a94d0-4ddb-42fe-a449-e7491a606d91 tempest-QuotasTestJSON-253219563 tempest-QuotasTestJSON-253219563-project] Calling method '.version_select at 0x7f06bdb45430>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:03.823881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3b6fe908-1f5d-4ce4-8169-3beb5cf49a97 tempest-ServerGroup264TestJSON-1140222461 tempest-ServerGroup264TestJSON-1140222461-project] Action: 'create', calling method: .version_select at 0x7f06bccbd820>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:03.887170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-3b6fe908-1f5d-4ce4-8169-3beb5cf49a97 tempest-ServerGroup264TestJSON-1140222461 tempest-ServerGroup264TestJSON-1140222461-project] Getting quotas for project ef6a6069523f4d09b5f1f931e154b43c. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:45:03.897059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-3b6fe908-1f5d-4ce4-8169-3beb5cf49a97 tempest-ServerGroup264TestJSON-1140222461 tempest-ServerGroup264TestJSON-1140222461-project] Getting quotas for user 8cc7e8745e674904ac456bfe8d2aee84 and project ef6a6069523f4d09b5f1f931e154b43c. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:45:03.990735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-3b6fe908-1f5d-4ce4-8169-3beb5cf49a97 tempest-ServerGroup264TestJSON-1140222461 tempest-ServerGroup264TestJSON-1140222461-project] Getting quotas for project ef6a6069523f4d09b5f1f931e154b43c. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:45:04.006262 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-3b6fe908-1f5d-4ce4-8169-3beb5cf49a97 tempest-ServerGroup264TestJSON-1140222461 tempest-ServerGroup264TestJSON-1140222461-project] Getting quotas for user 8cc7e8745e674904ac456bfe8d2aee84 and project ef6a6069523f4d09b5f1f931e154b43c. Resources: {'server_groups'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:45:04.028813 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3b6fe908-1f5d-4ce4-8169-3beb5cf49a97 tempest-ServerGroup264TestJSON-1140222461 tempest-ServerGroup264TestJSON-1140222461-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.569471 Jul 20 04:45:04.029774 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2816/5382] 10.222.0.17 () {62 vars in 1213 bytes} [Wed Jul 20 04:45:03 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:45:04.036489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bf6c6801-c8d5-4fed-8d48-246bdb8e5aca tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Action: 'create', calling method: .version_select at 0x7f06bccbd670>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-526004902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/VbmnJ34gcPkx1b2o4FK75RulFHAlVbvkZO0sKlu8xcX2BKDw0M+QnYTMZmAM9QC6L/J6koe39RJMC02GR0A4lZUz8OJKX6ARBoPTuT0fMZXOwCwL5Q0LkgQRsxGPA/w=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:04.058099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-bf6c6801-c8d5-4fed-8d48-246bdb8e5aca tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Getting quotas for project c1cc471d4c4e4a66a5745b74db41c9b5. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:45:04.064950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-bf6c6801-c8d5-4fed-8d48-246bdb8e5aca tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Getting quotas for user c90b8b96fdd1409bb9876dabb3989663 and project c1cc471d4c4e4a66a5745b74db41c9b5. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:45:04.107789 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bf6c6801-c8d5-4fed-8d48-246bdb8e5aca tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.075504 Jul 20 04:45:04.108749 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2817/5383] 10.222.0.17 () {62 vars in 1199 bytes} [Wed Jul 20 04:45:04 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:45:04.115045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8c973c4d-aeaf-43c6-87fd-868f56087fb0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:04.115681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8c973c4d-aeaf-43c6-87fd-868f56087fb0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:04.123092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c973c4d-aeaf-43c6-87fd-868f56087fb0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:04.123548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c973c4d-aeaf-43c6-87fd-868f56087fb0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:04.124362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c973c4d-aeaf-43c6-87fd-868f56087fb0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:04.124804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c973c4d-aeaf-43c6-87fd-868f56087fb0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:04.324841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:04.331691 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-983a94d0-4ddb-42fe-a449-e7491a606d91 tempest-QuotasTestJSON-253219563 tempest-QuotasTestJSON-253219563-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/8af32f4d504f43748643f05d910eb348/defaults" status: 200 len: 371 microversion: 2.1 time: 0.746414 Jul 20 04:45:04.333423 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2567/5384] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 04:45:03 2022] GET /compute/v2.1/os-quota-sets/8af32f4d504f43748643f05d910eb348/defaults => generated 371 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:04.350181 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e341aee1-2270-40d9-baab-d26aecb1a61b tempest-ServerGroup264TestJSON-1140222461 tempest-ServerGroup264TestJSON-1140222461-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:04.352828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8c973c4d-aeaf-43c6-87fd-868f56087fb0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:04.369136 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8c973c4d-aeaf-43c6-87fd-868f56087fb0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1217 microversion: 2.1 time: 0.257520 Jul 20 04:45:04.369479 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e341aee1-2270-40d9-baab-d26aecb1a61b tempest-ServerGroup264TestJSON-1140222461 tempest-ServerGroup264TestJSON-1140222461-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.033296 Jul 20 04:45:04.377246 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2818/5385] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:04 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1217 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:04.379201 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2568/5386] 10.222.0.17 () {60 vars in 1192 bytes} [Wed Jul 20 04:45:04 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:45:04.384501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dc426f19-21f3-4295-9928-392914388212 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-526004902", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:04.388789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dc426f19-21f3-4295-9928-392914388212 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:04.395752 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2c6fb0ee-4726-41f2-9fd2-878d5f757b2c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:04.398818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2c6fb0ee-4726-41f2-9fd2-878d5f757b2c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:04.414838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c6fb0ee-4726-41f2-9fd2-878d5f757b2c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:04.415315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c6fb0ee-4726-41f2-9fd2-878d5f757b2c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:04.416306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c6fb0ee-4726-41f2-9fd2-878d5f757b2c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:04.417866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc426f19-21f3-4295-9928-392914388212 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:04.418358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c6fb0ee-4726-41f2-9fd2-878d5f757b2c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:04.419362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc426f19-21f3-4295-9928-392914388212 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:04.422892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc426f19-21f3-4295-9928-392914388212 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:04.427896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc426f19-21f3-4295-9928-392914388212 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:04.678005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-dc426f19-21f3-4295-9928-392914388212 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:45:04.678657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-dc426f19-21f3-4295-9928-392914388212 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:45:04.678920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-dc426f19-21f3-4295-9928-392914388212 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:45:04.679340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-dc426f19-21f3-4295-9928-392914388212 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:45:04.679764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-dc426f19-21f3-4295-9928-392914388212 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:45:04.802819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:04.899853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dc426f19-21f3-4295-9928-392914388212 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:04.915292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2c6fb0ee-4726-41f2-9fd2-878d5f757b2c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:04.929781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc426f19-21f3-4295-9928-392914388212 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:04.930369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc426f19-21f3-4295-9928-392914388212 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:04.930620 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2c6fb0ee-4726-41f2-9fd2-878d5f757b2c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1693 microversion: 2.1 time: 0.548465 Jul 20 04:45:04.931517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc426f19-21f3-4295-9928-392914388212 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:04.934614 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2569/5387] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:04 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1693 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:04.935929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc426f19-21f3-4295-9928-392914388212 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:04.953391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f3b5bb46-8500-46a5-86ee-92512fe917d6 tempest-QuotasTestJSON-253219563 tempest-QuotasTestJSON-253219563-project] Calling method '.version_select at 0x7f06bcd1f0d0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:05.061788 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dc426f19-21f3-4295-9928-392914388212 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "POST /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d/action" status: 202 len: 1138 microversion: 2.54 time: 0.688138 Jul 20 04:45:05.065111 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2819/5388] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Jul 20 04:45:04 2022] POST /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d/action => generated 1138 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 04:45:05.079757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-db70e73b-9778-4b49-b8fc-15392c1e5c96 tempest-ServerGroup264TestJSON-1140222461 tempest-ServerGroup264TestJSON-1140222461-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:05.109008 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-db70e73b-9778-4b49-b8fc-15392c1e5c96 tempest-ServerGroup264TestJSON-1140222461 tempest-ServerGroup264TestJSON-1140222461-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/177c8776-49b5-4897-9eff-c64e83ec83eb" status: 200 len: 235 microversion: 2.64 time: 0.034709 Jul 20 04:45:05.112816 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2820/5389] 10.222.0.17 () {60 vars in 1303 bytes} [Wed Jul 20 04:45:05 2022] GET /compute/v2.1/os-server-groups/177c8776-49b5-4897-9eff-c64e83ec83eb => generated 235 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:45:05.127404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4cb377f5-d762-4aae-b6a0-8df87a48fa81 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:05.136675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4cb377f5-d762-4aae-b6a0-8df87a48fa81 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:05.157629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4cb377f5-d762-4aae-b6a0-8df87a48fa81 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:05.164651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4cb377f5-d762-4aae-b6a0-8df87a48fa81 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:05.165530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4cb377f5-d762-4aae-b6a0-8df87a48fa81 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:05.166127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4cb377f5-d762-4aae-b6a0-8df87a48fa81 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:05.369281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4cb377f5-d762-4aae-b6a0-8df87a48fa81 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:05.390003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4cb377f5-d762-4aae-b6a0-8df87a48fa81 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:05.393315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4cb377f5-d762-4aae-b6a0-8df87a48fa81 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:05.395426 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4cb377f5-d762-4aae-b6a0-8df87a48fa81 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1407 microversion: 2.54 time: 0.281230 Jul 20 04:45:05.397494 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2821/5390] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:05 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:05.414313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b51fac76-3bc1-48f5-8109-3aeb0a7af6e7 tempest-ServerGroup264TestJSON-1140222461 tempest-ServerGroup264TestJSON-1140222461-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:05.497722 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f3b5bb46-8500-46a5-86ee-92512fe917d6 tempest-QuotasTestJSON-253219563 tempest-QuotasTestJSON-253219563-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/8af32f4d504f43748643f05d910eb348" status: 200 len: 371 microversion: 2.1 time: 0.558532 Jul 20 04:45:05.498331 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2570/5391] 10.222.0.17 () {58 vars in 1241 bytes} [Wed Jul 20 04:45:04 2022] GET /compute/v2.1/os-quota-sets/8af32f4d504f43748643f05d910eb348 => generated 371 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:05.517225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fd38f70f-b132-4e82-a9bf-62bba3a4d2c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:05.520515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fd38f70f-b132-4e82-a9bf-62bba3a4d2c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:05.532109 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b51fac76-3bc1-48f5-8109-3aeb0a7af6e7 tempest-ServerGroup264TestJSON-1140222461 tempest-ServerGroup264TestJSON-1140222461-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/177c8776-49b5-4897-9eff-c64e83ec83eb" status: 204 len: 0 microversion: 2.64 time: 0.129820 Jul 20 04:45:05.534270 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2822/5392] 10.222.0.17 () {60 vars in 1306 bytes} [Wed Jul 20 04:45:05 2022] DELETE /compute/v2.1/os-server-groups/177c8776-49b5-4897-9eff-c64e83ec83eb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:45:05.546567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd38f70f-b132-4e82-a9bf-62bba3a4d2c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:05.547885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd38f70f-b132-4e82-a9bf-62bba3a4d2c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:05.550800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd38f70f-b132-4e82-a9bf-62bba3a4d2c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:05.552395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd38f70f-b132-4e82-a9bf-62bba3a4d2c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:05.555536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e0ad5bfd-70b1-4870-86d7-6b33223bf69b tempest-QuotasTestJSON-253219563 tempest-QuotasTestJSON-253219563-project] Calling method '.version_select at 0x7f06bcca08b0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:05.881173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fd38f70f-b132-4e82-a9bf-62bba3a4d2c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:05.891644 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fd38f70f-b132-4e82-a9bf-62bba3a4d2c3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1217 microversion: 2.1 time: 0.381886 Jul 20 04:45:05.892518 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2571/5393] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:05 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1217 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:05.899430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-612649c5-ea23-479e-a8de-9a064811eea4 tempest-ServerGroup264TestJSON-1140222461 tempest-ServerGroup264TestJSON-1140222461-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:05.916719 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-612649c5-ea23-479e-a8de-9a064811eea4 tempest-ServerGroup264TestJSON-1140222461 tempest-ServerGroup264TestJSON-1140222461-project] HTTP exception thrown: Instance group 177c8776-49b5-4897-9eff-c64e83ec83eb could not be found. Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-612649c5-ea23-479e-a8de-9a064811eea4 tempest-ServerGroup264TestJSON-1140222461 tempest-ServerGroup264TestJSON-1140222461-project] Request method failure captured: Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/os-server-groups/177c8776-49b5-4897-9eff-c64e83ec83eb HTTP/1.1 Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14hOE0nUjy_hHlI0ac2prxx4p0X8N3y6NYcXcGJTs1L79G0RySHPdvoHiJGQM2yYUi4AnuqmtYE3puqRVXd8tmpuhcW9WKaUqJULUG7kKTE8oM4Z-FFnBv3ivJfjJqC2J3a19T1H3eB5eJcUR2D-ArbTeoLAwy6bIuQyY09qte2TdUU Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.64 Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: ef6a6069523f4d09b5f1f931e154b43c Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerGroup264TestJSON-1140222461 Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef6a6069523f4d09b5f1f931e154b43c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ef6a6069523f4d09b5f1f931e154b43c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ef6a6069523f4d09b5f1f931e154b43c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef6a6069523f4d09b5f1f931e154b43c"}]}] Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerGroup264TestJSON-1140222461 Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: ef6a6069523f4d09b5f1f931e154b43c Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1140222461 Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerGroup264TestJSON-1140222461-project Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 8cc7e8745e674904ac456bfe8d2aee84 Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerGroup264TestJSON-1140222461-project Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance group 177c8776-49b5-4897-9eff-c64e83ec83eb could not be found. Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '177c8776-49b5-4897-9eff-c64e83ec83eb'} Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 177c8776-49b5-4897-9eff-c64e83ec83eb could not be found. Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 177c8776-49b5-4897-9eff-c64e83ec83eb could not be found. Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:45:05.918787 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:05.923682 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:45:05.923682 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:45:05.923682 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:45:05.923682 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:45:05.923682 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 177c8776-49b5-4897-9eff-c64e83ec83eb could not be found. Jul 20 04:45:05.923682 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:45:05.929219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-612649c5-ea23-479e-a8de-9a064811eea4 tempest-ServerGroup264TestJSON-1140222461 tempest-ServerGroup264TestJSON-1140222461-project] Returning 404 to user: Instance group 177c8776-49b5-4897-9eff-c64e83ec83eb could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:45:05.930431 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-612649c5-ea23-479e-a8de-9a064811eea4 tempest-ServerGroup264TestJSON-1140222461 tempest-ServerGroup264TestJSON-1140222461-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/177c8776-49b5-4897-9eff-c64e83ec83eb" status: 404 len: 117 microversion: 2.64 time: 0.034850 Jul 20 04:45:05.931209 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2572/5394] 10.222.0.17 () {60 vars in 1306 bytes} [Wed Jul 20 04:45:05 2022] DELETE /compute/v2.1/os-server-groups/177c8776-49b5-4897-9eff-c64e83ec83eb => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:45:05.951557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9c99537c-b79c-4af6-b7b1-0c449a9bed31 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:05.952557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9c99537c-b79c-4af6-b7b1-0c449a9bed31 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:05.960716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c99537c-b79c-4af6-b7b1-0c449a9bed31 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:05.961553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c99537c-b79c-4af6-b7b1-0c449a9bed31 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:05.962750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c99537c-b79c-4af6-b7b1-0c449a9bed31 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:05.963491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c99537c-b79c-4af6-b7b1-0c449a9bed31 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:06.184553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9c99537c-b79c-4af6-b7b1-0c449a9bed31 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:06.198529 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9c99537c-b79c-4af6-b7b1-0c449a9bed31 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1690 microversion: 2.1 time: 0.250852 Jul 20 04:45:06.199951 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2573/5395] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:05 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1690 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:06.225332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-144c0326-49d0-49ae-a375-f6d491b163fd tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:06.226618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-144c0326-49d0-49ae-a375-f6d491b163fd tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:06.236890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-144c0326-49d0-49ae-a375-f6d491b163fd tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:06.243000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-144c0326-49d0-49ae-a375-f6d491b163fd tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:06.244234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-144c0326-49d0-49ae-a375-f6d491b163fd tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:06.245145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-144c0326-49d0-49ae-a375-f6d491b163fd tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:06.351958 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e0ad5bfd-70b1-4870-86d7-6b33223bf69b tempest-QuotasTestJSON-253219563 tempest-QuotasTestJSON-253219563-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/8af32f4d504f43748643f05d910eb348?user_id=0d437bf057304081b6208ba6d1c0d856" status: 200 len: 371 microversion: 2.1 time: 0.815668 Jul 20 04:45:06.364993 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2823/5396] 10.222.0.17 () {58 vars in 1322 bytes} [Wed Jul 20 04:45:05 2022] GET /compute/v2.1/os-quota-sets/8af32f4d504f43748643f05d910eb348?user_id=0d437bf057304081b6208ba6d1c0d856 => generated 371 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:06.433562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3c88df96-a59d-419a-bb7e-cec54036ea8e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:06.434713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3c88df96-a59d-419a-bb7e-cec54036ea8e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:06.450169 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-144c0326-49d0-49ae-a375-f6d491b163fd tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85/action" status: 202 len: 0 microversion: 2.1 time: 0.225439 Jul 20 04:45:06.451911 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2574/5397] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:45:06 2022] POST /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:45:06.495156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-699dd466-b2dd-4756-8c21-f4809104e60d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:06.496436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c88df96-a59d-419a-bb7e-cec54036ea8e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:06.497417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-699dd466-b2dd-4756-8c21-f4809104e60d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:06.497834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c88df96-a59d-419a-bb7e-cec54036ea8e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:06.500360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c88df96-a59d-419a-bb7e-cec54036ea8e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:06.501025 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c88df96-a59d-419a-bb7e-cec54036ea8e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:06.517134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-699dd466-b2dd-4756-8c21-f4809104e60d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:06.518420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-699dd466-b2dd-4756-8c21-f4809104e60d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:06.522502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-699dd466-b2dd-4756-8c21-f4809104e60d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:06.523220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-699dd466-b2dd-4756-8c21-f4809104e60d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:07.048357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3c88df96-a59d-419a-bb7e-cec54036ea8e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:07.058176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-699dd466-b2dd-4756-8c21-f4809104e60d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:07.060640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3c88df96-a59d-419a-bb7e-cec54036ea8e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:07.067236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3c88df96-a59d-419a-bb7e-cec54036ea8e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:07.069711 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3c88df96-a59d-419a-bb7e-cec54036ea8e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1407 microversion: 2.54 time: 0.655268 Jul 20 04:45:07.070953 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-699dd466-b2dd-4756-8c21-f4809104e60d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1689 microversion: 2.1 time: 0.608310 Jul 20 04:45:07.082167 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2575/5398] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:06 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1689 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:07.084013 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2824/5399] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:06 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1407 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:45:07.084235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-871a57df-8872-4d13-9231-d9aa953b501b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:07.084891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-871a57df-8872-4d13-9231-d9aa953b501b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:07.102005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-871a57df-8872-4d13-9231-d9aa953b501b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:07.102462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-871a57df-8872-4d13-9231-d9aa953b501b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:07.103269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-871a57df-8872-4d13-9231-d9aa953b501b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:07.103765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-871a57df-8872-4d13-9231-d9aa953b501b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:07.605338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-871a57df-8872-4d13-9231-d9aa953b501b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:07.644886 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-871a57df-8872-4d13-9231-d9aa953b501b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1217 microversion: 2.1 time: 0.564740 Jul 20 04:45:07.646124 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2576/5400] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:07 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1217 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:08.090953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4c65af2c-53bf-432e-a6bc-d971824b5ba4 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:08.092487 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4c65af2c-53bf-432e-a6bc-d971824b5ba4 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:08.095953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-30d182db-ca8f-416b-a707-1db0fda75f2b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:08.096662 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-30d182db-ca8f-416b-a707-1db0fda75f2b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:08.100108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c65af2c-53bf-432e-a6bc-d971824b5ba4 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:08.100991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c65af2c-53bf-432e-a6bc-d971824b5ba4 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:08.102033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c65af2c-53bf-432e-a6bc-d971824b5ba4 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:08.102686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c65af2c-53bf-432e-a6bc-d971824b5ba4 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:08.112078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30d182db-ca8f-416b-a707-1db0fda75f2b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:08.112685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30d182db-ca8f-416b-a707-1db0fda75f2b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:08.113543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30d182db-ca8f-416b-a707-1db0fda75f2b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:08.113986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30d182db-ca8f-416b-a707-1db0fda75f2b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:08.275698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:08.301610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4c65af2c-53bf-432e-a6bc-d971824b5ba4 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:08.334341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4c65af2c-53bf-432e-a6bc-d971824b5ba4 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:08.335088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4c65af2c-53bf-432e-a6bc-d971824b5ba4 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:08.336427 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4c65af2c-53bf-432e-a6bc-d971824b5ba4 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1407 microversion: 2.54 time: 0.250417 Jul 20 04:45:08.352919 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2825/5401] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:08 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:08.676369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-96fd8c3f-3270-46de-933c-588a4c20a0be tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:08.677685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-96fd8c3f-3270-46de-933c-588a4c20a0be tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:08.690434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96fd8c3f-3270-46de-933c-588a4c20a0be tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:08.691227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96fd8c3f-3270-46de-933c-588a4c20a0be tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:08.693445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96fd8c3f-3270-46de-933c-588a4c20a0be tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:08.693445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96fd8c3f-3270-46de-933c-588a4c20a0be tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:08.712809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-30d182db-ca8f-416b-a707-1db0fda75f2b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:08.727320 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-30d182db-ca8f-416b-a707-1db0fda75f2b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1689 microversion: 2.1 time: 0.636092 Jul 20 04:45:08.728349 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2577/5402] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:08 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1689 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:08.855046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-46ea2556-7633-4bcc-b03c-5a54f522b1b7 req-85cb8d19-1c24-4a36-940a-cebdacba71e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7fed1e7-12d5-4f39-9c2a-65e4dd681aff", "name": "network-vif-plugged", "status": "completed", "tag": "cbe618b3-cf79-40f4-8209-0fcfe0234ec0"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:08.875168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-46ea2556-7633-4bcc-b03c-5a54f522b1b7 req-85cb8d19-1c24-4a36-940a-cebdacba71e1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:08.875849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-46ea2556-7633-4bcc-b03c-5a54f522b1b7 req-85cb8d19-1c24-4a36-940a-cebdacba71e1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:08.905547 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-46ea2556-7633-4bcc-b03c-5a54f522b1b7 req-85cb8d19-1c24-4a36-940a-cebdacba71e1 service nova] Creating event network-vif-plugged:cbe618b3-cf79-40f4-8209-0fcfe0234ec0 for instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff on n-h2-826526-5 Jul 20 04:45:08.923675 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-46ea2556-7633-4bcc-b03c-5a54f522b1b7 req-85cb8d19-1c24-4a36-940a-cebdacba71e1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073104 Jul 20 04:45:08.924670 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2578/5403] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:09.344701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-96fd8c3f-3270-46de-933c-588a4c20a0be tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:09.367637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-440b889e-7416-4cc6-b2fe-3fbb9c6046ea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:09.372593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-440b889e-7416-4cc6-b2fe-3fbb9c6046ea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:09.372892 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-96fd8c3f-3270-46de-933c-588a4c20a0be tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1217 microversion: 2.1 time: 0.709673 Jul 20 04:45:09.397809 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2826/5404] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:08 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1217 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:09.400645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-440b889e-7416-4cc6-b2fe-3fbb9c6046ea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:09.421820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-440b889e-7416-4cc6-b2fe-3fbb9c6046ea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:09.424657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-440b889e-7416-4cc6-b2fe-3fbb9c6046ea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:09.425146 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-440b889e-7416-4cc6-b2fe-3fbb9c6046ea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:09.756451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-31014236-10f9-498d-9b64-c3684a5b0959 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:09.758497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-31014236-10f9-498d-9b64-c3684a5b0959 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:09.781063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31014236-10f9-498d-9b64-c3684a5b0959 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:09.783618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31014236-10f9-498d-9b64-c3684a5b0959 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:09.787809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31014236-10f9-498d-9b64-c3684a5b0959 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:09.788289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-31014236-10f9-498d-9b64-c3684a5b0959 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:10.038557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-440b889e-7416-4cc6-b2fe-3fbb9c6046ea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:10.077324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-440b889e-7416-4cc6-b2fe-3fbb9c6046ea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:10.086996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-440b889e-7416-4cc6-b2fe-3fbb9c6046ea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:10.088761 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-440b889e-7416-4cc6-b2fe-3fbb9c6046ea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1407 microversion: 2.54 time: 0.731330 Jul 20 04:45:10.100296 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2579/5405] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:09 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1407 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:10.259713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-31014236-10f9-498d-9b64-c3684a5b0959 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:10.268294 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-31014236-10f9-498d-9b64-c3684a5b0959 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1689 microversion: 2.1 time: 0.523846 Jul 20 04:45:10.270996 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2827/5406] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:09 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1689 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:10.393368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-80787d9b-fbef-4b73-83dd-7d337f61aab3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:10.393994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-80787d9b-fbef-4b73-83dd-7d337f61aab3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:10.407553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80787d9b-fbef-4b73-83dd-7d337f61aab3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:10.408367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80787d9b-fbef-4b73-83dd-7d337f61aab3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:10.409533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80787d9b-fbef-4b73-83dd-7d337f61aab3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:10.411165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80787d9b-fbef-4b73-83dd-7d337f61aab3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:10.783776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-80787d9b-fbef-4b73-83dd-7d337f61aab3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:10.795376 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-80787d9b-fbef-4b73-83dd-7d337f61aab3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1217 microversion: 2.1 time: 0.405603 Jul 20 04:45:10.805111 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2580/5407] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:10 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1217 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:10.956782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-f6055332-f90d-4fe0-8752-b4cff8946a37 req-80436d88-26fd-44dd-ae90-0df4e0306125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69b8042-1e5c-4ea4-9c05-3623cb12ad85", "name": "network-vif-plugged", "status": "completed", "tag": "250e1005-0706-457b-aa98-bde024a78797"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:11.014000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f6055332-f90d-4fe0-8752-b4cff8946a37 req-80436d88-26fd-44dd-ae90-0df4e0306125 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:11.030932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f6055332-f90d-4fe0-8752-b4cff8946a37 req-80436d88-26fd-44dd-ae90-0df4e0306125 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:11.113793 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-f6055332-f90d-4fe0-8752-b4cff8946a37 req-80436d88-26fd-44dd-ae90-0df4e0306125 service nova] Creating event network-vif-plugged:250e1005-0706-457b-aa98-bde024a78797 for instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 on n-h1-826526-5 Jul 20 04:45:11.140880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2bc3ae42-7ccb-446f-83b0-66f7c8263dea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:11.167479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2bc3ae42-7ccb-446f-83b0-66f7c8263dea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:11.179935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-f6055332-f90d-4fe0-8752-b4cff8946a37 req-80436d88-26fd-44dd-ae90-0df4e0306125 service nova] Instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:45:11.211683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bc3ae42-7ccb-446f-83b0-66f7c8263dea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:11.213234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bc3ae42-7ccb-446f-83b0-66f7c8263dea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:11.221741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bc3ae42-7ccb-446f-83b0-66f7c8263dea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:11.224538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2bc3ae42-7ccb-446f-83b0-66f7c8263dea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:11.278442 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-f6055332-f90d-4fe0-8752-b4cff8946a37 req-80436d88-26fd-44dd-ae90-0df4e0306125 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.323659 Jul 20 04:45:11.282401 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2828/5408] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:11.312103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-68b3055e-7089-4967-a835-8d7ad924558b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:11.317780 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-68b3055e-7089-4967-a835-8d7ad924558b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:11.353127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68b3055e-7089-4967-a835-8d7ad924558b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:11.355539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68b3055e-7089-4967-a835-8d7ad924558b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:11.359125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68b3055e-7089-4967-a835-8d7ad924558b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:11.364739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68b3055e-7089-4967-a835-8d7ad924558b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:11.940128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-68b3055e-7089-4967-a835-8d7ad924558b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:11.966734 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-68b3055e-7089-4967-a835-8d7ad924558b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1689 microversion: 2.1 time: 0.676962 Jul 20 04:45:11.969154 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2829/5409] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:11 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1689 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:11.985681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c1abbde-847a-4c7e-8195-bf906d0370a4 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:11.990154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0c1abbde-847a-4c7e-8195-bf906d0370a4 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:12.010750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c1abbde-847a-4c7e-8195-bf906d0370a4 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:12.011205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c1abbde-847a-4c7e-8195-bf906d0370a4 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:12.012572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c1abbde-847a-4c7e-8195-bf906d0370a4 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:12.012993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c1abbde-847a-4c7e-8195-bf906d0370a4 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:12.142433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2bc3ae42-7ccb-446f-83b0-66f7c8263dea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:12.155233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2bc3ae42-7ccb-446f-83b0-66f7c8263dea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:12.156863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2bc3ae42-7ccb-446f-83b0-66f7c8263dea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:12.158084 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2bc3ae42-7ccb-446f-83b0-66f7c8263dea tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1407 microversion: 2.54 time: 1.027653 Jul 20 04:45:12.173229 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2581/5410] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:11 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1407 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:12.593195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0c1abbde-847a-4c7e-8195-bf906d0370a4 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:12.642843 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0c1abbde-847a-4c7e-8195-bf906d0370a4 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1404 microversion: 2.1 time: 0.644084 Jul 20 04:45:12.651075 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2830/5411] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:11 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1404 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:12.677922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bb0975f2-cc7d-4558-882f-c3a4cbedb943 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:12.678541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bb0975f2-cc7d-4558-882f-c3a4cbedb943 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:12.703699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb0975f2-cc7d-4558-882f-c3a4cbedb943 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:12.704869 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb0975f2-cc7d-4558-882f-c3a4cbedb943 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:12.707656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb0975f2-cc7d-4558-882f-c3a4cbedb943 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:12.708742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb0975f2-cc7d-4558-882f-c3a4cbedb943 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:13.004645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e3aa5260-e7e6-46ec-8f45-ccb71f1b1341 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:13.007931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e3aa5260-e7e6-46ec-8f45-ccb71f1b1341 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:13.034851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3aa5260-e7e6-46ec-8f45-ccb71f1b1341 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:13.036134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3aa5260-e7e6-46ec-8f45-ccb71f1b1341 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:13.037685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3aa5260-e7e6-46ec-8f45-ccb71f1b1341 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:13.038513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3aa5260-e7e6-46ec-8f45-ccb71f1b1341 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:13.341516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bb0975f2-cc7d-4558-882f-c3a4cbedb943 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:13.362630 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bb0975f2-cc7d-4558-882f-c3a4cbedb943 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1404 microversion: 2.1 time: 0.689074 Jul 20 04:45:13.364000 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2582/5412] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:12 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1404 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:13.376805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0d4312f4-fcf1-4c3f-ba12-e5a95cc8fd43 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:13.382409 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0d4312f4-fcf1-4c3f-ba12-e5a95cc8fd43 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:13.404320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d4312f4-fcf1-4c3f-ba12-e5a95cc8fd43 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:13.405528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d4312f4-fcf1-4c3f-ba12-e5a95cc8fd43 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:13.406639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d4312f4-fcf1-4c3f-ba12-e5a95cc8fd43 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:13.407264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d4312f4-fcf1-4c3f-ba12-e5a95cc8fd43 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:13.594391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0d4312f4-fcf1-4c3f-ba12-e5a95cc8fd43 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:13.603830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0d4312f4-fcf1-4c3f-ba12-e5a95cc8fd43 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:13.605964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0d4312f4-fcf1-4c3f-ba12-e5a95cc8fd43 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:13.607440 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0d4312f4-fcf1-4c3f-ba12-e5a95cc8fd43 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1407 microversion: 2.54 time: 0.241932 Jul 20 04:45:13.608303 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2583/5413] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:13 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:13.622956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-43b44d7f-98d3-4b5c-ad38-5d72bfad2b11 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-864263867"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:13.624031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-43b44d7f-98d3-4b5c-ad38-5d72bfad2b11 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:13.632779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43b44d7f-98d3-4b5c-ad38-5d72bfad2b11 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:13.633222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43b44d7f-98d3-4b5c-ad38-5d72bfad2b11 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:13.634015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43b44d7f-98d3-4b5c-ad38-5d72bfad2b11 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:13.634452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43b44d7f-98d3-4b5c-ad38-5d72bfad2b11 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:13.849799 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.compute.api [None req-43b44d7f-98d3-4b5c-ad38-5d72bfad2b11 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Attempting to quiesce instance before volume snapshot. Jul 20 04:45:13.945315 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.compute.api [None req-43b44d7f-98d3-4b5c-ad38-5d72bfad2b11 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 20 04:45:14.119961 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-43b44d7f-98d3-4b5c-ad38-5d72bfad2b11 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Creating snapshot from volume ba3d4ae7-75c2-4420-9343-0f582ca648be. {{(pid=127870) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 20 04:45:14.196548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e3aa5260-e7e6-46ec-8f45-ccb71f1b1341 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:14.211205 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e3aa5260-e7e6-46ec-8f45-ccb71f1b1341 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1689 microversion: 2.1 time: 1.227169 Jul 20 04:45:14.216517 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2831/5414] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:12 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1689 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:14.243293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-d776b521-a61a-4ab4-a8f6-c5250eb523c7 req-180620f4-cab9-4c4d-b646-07410f75b9cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69b8042-1e5c-4ea4-9c05-3623cb12ad85", "name": "network-vif-unplugged", "status": "completed", "tag": "250e1005-0706-457b-aa98-bde024a78797"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:14.283972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d776b521-a61a-4ab4-a8f6-c5250eb523c7 req-180620f4-cab9-4c4d-b646-07410f75b9cf service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:14.289529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d776b521-a61a-4ab4-a8f6-c5250eb523c7 req-180620f4-cab9-4c4d-b646-07410f75b9cf service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:14.334566 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-d776b521-a61a-4ab4-a8f6-c5250eb523c7 req-180620f4-cab9-4c4d-b646-07410f75b9cf service nova] Creating event network-vif-unplugged:250e1005-0706-457b-aa98-bde024a78797 for instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 on n-h2-826526-5 Jul 20 04:45:14.350256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-d776b521-a61a-4ab4-a8f6-c5250eb523c7 req-180620f4-cab9-4c4d-b646-07410f75b9cf service nova] Instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:45:14.374171 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-d776b521-a61a-4ab4-a8f6-c5250eb523c7 req-180620f4-cab9-4c4d-b646-07410f75b9cf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155172 Jul 20 04:45:14.376625 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2832/5415] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:14.541802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:14.628849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-23f34f14-11c9-49a5-847d-d0a87cae1b50 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:14.629941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-23f34f14-11c9-49a5-847d-d0a87cae1b50 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:14.662905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-23f34f14-11c9-49a5-847d-d0a87cae1b50 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:14.664014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-23f34f14-11c9-49a5-847d-d0a87cae1b50 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:14.667183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-23f34f14-11c9-49a5-847d-d0a87cae1b50 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:14.667927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-23f34f14-11c9-49a5-847d-d0a87cae1b50 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:14.892644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-23f34f14-11c9-49a5-847d-d0a87cae1b50 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:14.904514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-23f34f14-11c9-49a5-847d-d0a87cae1b50 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:14.906175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-23f34f14-11c9-49a5-847d-d0a87cae1b50 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:14.907429 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-23f34f14-11c9-49a5-847d-d0a87cae1b50 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1407 microversion: 2.54 time: 0.284671 Jul 20 04:45:14.922812 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2833/5416] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:14 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:45:15.232444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fc49845e-00c1-498b-bace-d62f55a18ece tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:15.234097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fc49845e-00c1-498b-bace-d62f55a18ece tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:15.247904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fc49845e-00c1-498b-bace-d62f55a18ece tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:15.250555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fc49845e-00c1-498b-bace-d62f55a18ece tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:15.251693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fc49845e-00c1-498b-bace-d62f55a18ece tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:15.253415 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fc49845e-00c1-498b-bace-d62f55a18ece tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:15.461038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:16.061881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fc49845e-00c1-498b-bace-d62f55a18ece tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:16.078512 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fc49845e-00c1-498b-bace-d62f55a18ece tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1689 microversion: 2.1 time: 0.849140 Jul 20 04:45:16.100152 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2834/5417] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:15 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1689 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:16.117028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a9e1ae69-8dd8-449a-bd3a-1b05fa562727 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:16.121196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a9e1ae69-8dd8-449a-bd3a-1b05fa562727 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:16.149253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9e1ae69-8dd8-449a-bd3a-1b05fa562727 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:16.151261 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9e1ae69-8dd8-449a-bd3a-1b05fa562727 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:16.154503 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9e1ae69-8dd8-449a-bd3a-1b05fa562727 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:16.158818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9e1ae69-8dd8-449a-bd3a-1b05fa562727 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:16.269030 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-43b44d7f-98d3-4b5c-ad38-5d72bfad2b11 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "POST /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff/action" status: 202 len: 0 microversion: 2.1 time: 2.659334 Jul 20 04:45:16.270026 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2584/5418] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:45:13 2022] POST /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff/action => generated 0 bytes in 2661 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:45:16.338312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=26 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:16.402878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-28e9527b-c7ab-42b4-8b8c-bbdb8784da62 req-55488730-313d-46bd-8c83-ab9f5535883d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69b8042-1e5c-4ea4-9c05-3623cb12ad85", "tag": "250e1005-0706-457b-aa98-bde024a78797"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:16.412723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-28e9527b-c7ab-42b4-8b8c-bbdb8784da62 req-55488730-313d-46bd-8c83-ab9f5535883d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:16.413480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-28e9527b-c7ab-42b4-8b8c-bbdb8784da62 req-55488730-313d-46bd-8c83-ab9f5535883d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:16.434942 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-28e9527b-c7ab-42b4-8b8c-bbdb8784da62 req-55488730-313d-46bd-8c83-ab9f5535883d service nova] Creating event network-changed:250e1005-0706-457b-aa98-bde024a78797 for instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 on n-h2-826526-5 Jul 20 04:45:16.443933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [req-28e9527b-c7ab-42b4-8b8c-bbdb8784da62 req-55488730-313d-46bd-8c83-ab9f5535883d service nova] Instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:45:16.457978 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-28e9527b-c7ab-42b4-8b8c-bbdb8784da62 req-55488730-313d-46bd-8c83-ab9f5535883d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059114 Jul 20 04:45:16.459262 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2585/5419] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:45:16.517838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a9e1ae69-8dd8-449a-bd3a-1b05fa562727 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:16.530303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a9e1ae69-8dd8-449a-bd3a-1b05fa562727 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:16.535272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a9e1ae69-8dd8-449a-bd3a-1b05fa562727 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:16.537614 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a9e1ae69-8dd8-449a-bd3a-1b05fa562727 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1407 microversion: 2.54 time: 0.436094 Jul 20 04:45:16.541003 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2835/5420] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:16 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1407 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:17.116664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-03b212c4-31fa-48e0-8035-eb0828053111 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:17.125209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-03b212c4-31fa-48e0-8035-eb0828053111 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:17.139165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03b212c4-31fa-48e0-8035-eb0828053111 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:17.140072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03b212c4-31fa-48e0-8035-eb0828053111 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:17.141392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03b212c4-31fa-48e0-8035-eb0828053111 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:17.146547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-03b212c4-31fa-48e0-8035-eb0828053111 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:17.561776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fefa83ca-07b0-49db-a669-d1727acabfbb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:17.566630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fefa83ca-07b0-49db-a669-d1727acabfbb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:17.577529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:17.587167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fefa83ca-07b0-49db-a669-d1727acabfbb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:17.589513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fefa83ca-07b0-49db-a669-d1727acabfbb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:17.591363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fefa83ca-07b0-49db-a669-d1727acabfbb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:17.593821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fefa83ca-07b0-49db-a669-d1727acabfbb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:17.829787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fefa83ca-07b0-49db-a669-d1727acabfbb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:17.847867 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fefa83ca-07b0-49db-a669-d1727acabfbb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:17.854715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fefa83ca-07b0-49db-a669-d1727acabfbb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:17.863025 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fefa83ca-07b0-49db-a669-d1727acabfbb tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1407 microversion: 2.54 time: 0.303687 Jul 20 04:45:17.882676 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2836/5421] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:17 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:18.178129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-03b212c4-31fa-48e0-8035-eb0828053111 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:18.216692 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-03b212c4-31fa-48e0-8035-eb0828053111 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1689 microversion: 2.1 time: 1.120261 Jul 20 04:45:18.243629 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2586/5422] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:17 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1689 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:18.711548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-085f6518-7f66-4ec5-90e1-47ed8ad626a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1821409804", "imageRef": "281d8600-289c-48c0-a8ce-f0384278d07f", "flavorRef": "452", "networks": [{"uuid": "7f25ae6d-be40-4c15-969a-9d88fe94c163"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:18.845472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-085f6518-7f66-4ec5-90e1-47ed8ad626a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] validate_networks() for [('7f25ae6d-be40-4c15-969a-9d88fe94c163', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:45:18.893188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0f2bd432-fd2f-4735-80ca-60b5a75b615f tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:18.894064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0f2bd432-fd2f-4735-80ca-60b5a75b615f tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:18.921370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f2bd432-fd2f-4735-80ca-60b5a75b615f tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:18.923254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f2bd432-fd2f-4735-80ca-60b5a75b615f tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:18.925962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f2bd432-fd2f-4735-80ca-60b5a75b615f tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:18.926771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f2bd432-fd2f-4735-80ca-60b5a75b615f tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:19.155868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0f2bd432-fd2f-4735-80ca-60b5a75b615f tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:19.173914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0f2bd432-fd2f-4735-80ca-60b5a75b615f tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:19.177492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0f2bd432-fd2f-4735-80ca-60b5a75b615f tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:19.190082 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0f2bd432-fd2f-4735-80ca-60b5a75b615f tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1407 microversion: 2.54 time: 0.293365 Jul 20 04:45:19.192303 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2587/5423] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:18 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:19.246825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a2a3e813-f6d9-4248-ad2e-538b72881878 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:19.247916 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a2a3e813-f6d9-4248-ad2e-538b72881878 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:19.261724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2a3e813-f6d9-4248-ad2e-538b72881878 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:19.265046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2a3e813-f6d9-4248-ad2e-538b72881878 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:19.266188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2a3e813-f6d9-4248-ad2e-538b72881878 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:19.268188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2a3e813-f6d9-4248-ad2e-538b72881878 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:20.129615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a2a3e813-f6d9-4248-ad2e-538b72881878 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:20.203462 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a2a3e813-f6d9-4248-ad2e-538b72881878 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1689 microversion: 2.1 time: 0.964154 Jul 20 04:45:20.225899 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2588/5424] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:19 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1689 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:20.252391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-df4198ef-a46e-42bf-b3f4-0ee1a2740fb9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:20.261188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-df4198ef-a46e-42bf-b3f4-0ee1a2740fb9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:20.280303 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df4198ef-a46e-42bf-b3f4-0ee1a2740fb9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:20.281223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df4198ef-a46e-42bf-b3f4-0ee1a2740fb9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:20.282791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df4198ef-a46e-42bf-b3f4-0ee1a2740fb9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:20.283446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df4198ef-a46e-42bf-b3f4-0ee1a2740fb9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:20.525558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-df4198ef-a46e-42bf-b3f4-0ee1a2740fb9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:20.547243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-df4198ef-a46e-42bf-b3f4-0ee1a2740fb9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:20.561686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-df4198ef-a46e-42bf-b3f4-0ee1a2740fb9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:20.565116 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-df4198ef-a46e-42bf-b3f4-0ee1a2740fb9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1407 microversion: 2.54 time: 0.337100 Jul 20 04:45:20.567110 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2589/5425] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:20 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:21.254554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d824a7f7-a642-4533-96b9-ec90117a68b0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:21.257903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d824a7f7-a642-4533-96b9-ec90117a68b0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:21.288853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-085f6518-7f66-4ec5-90e1-47ed8ad626a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:45:21.290327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-085f6518-7f66-4ec5-90e1-47ed8ad626a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:45:21.297033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-085f6518-7f66-4ec5-90e1-47ed8ad626a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:45:21.299676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-085f6518-7f66-4ec5-90e1-47ed8ad626a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:45:21.301816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-085f6518-7f66-4ec5-90e1-47ed8ad626a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:45:21.315393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d824a7f7-a642-4533-96b9-ec90117a68b0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:21.320376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d824a7f7-a642-4533-96b9-ec90117a68b0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:21.323834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d824a7f7-a642-4533-96b9-ec90117a68b0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:21.324809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d824a7f7-a642-4533-96b9-ec90117a68b0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:21.331897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-085f6518-7f66-4ec5-90e1-47ed8ad626a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:21.335422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-085f6518-7f66-4ec5-90e1-47ed8ad626a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:21.336527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-085f6518-7f66-4ec5-90e1-47ed8ad626a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:21.338307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-085f6518-7f66-4ec5-90e1-47ed8ad626a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:21.426718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-085f6518-7f66-4ec5-90e1-47ed8ad626a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Getting quotas for project b889ad56221143f0a54450c81ba738a7. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:45:21.451762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-085f6518-7f66-4ec5-90e1-47ed8ad626a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Getting quotas for user bc760e8f522640fc9190460719f5dcc2 and project b889ad56221143f0a54450c81ba738a7. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:45:21.517249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-085f6518-7f66-4ec5-90e1-47ed8ad626a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:45:21.522347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-085f6518-7f66-4ec5-90e1-47ed8ad626a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d435bff2-3fca-4dbb-a49f-7874b957b5e8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:45:21.815579 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-085f6518-7f66-4ec5-90e1-47ed8ad626a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.114557 Jul 20 04:45:21.827735 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2837/5426] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:45:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:45:21.847262 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-89176ee7-6602-43ec-9044-f2f662350631 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:21.853744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-89176ee7-6602-43ec-9044-f2f662350631 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:21.878282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89176ee7-6602-43ec-9044-f2f662350631 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:21.879156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89176ee7-6602-43ec-9044-f2f662350631 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:21.881745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89176ee7-6602-43ec-9044-f2f662350631 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:21.883626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89176ee7-6602-43ec-9044-f2f662350631 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:21.950204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d824a7f7-a642-4533-96b9-ec90117a68b0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:21.982319 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d824a7f7-a642-4533-96b9-ec90117a68b0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1682 microversion: 2.1 time: 0.739138 Jul 20 04:45:21.984842 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2590/5427] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:21 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1682 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:22.006289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-795f1745-97c0-40d6-86c1-22be5721e8ce tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:22.008283 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-795f1745-97c0-40d6-86c1-22be5721e8ce tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:22.061363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-89176ee7-6602-43ec-9044-f2f662350631 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:22.070624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-89176ee7-6602-43ec-9044-f2f662350631 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:22.075453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-89176ee7-6602-43ec-9044-f2f662350631 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:22.083211 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-89176ee7-6602-43ec-9044-f2f662350631 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1407 microversion: 2.54 time: 0.254303 Jul 20 04:45:22.097014 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2838/5428] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:21 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:22.485315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-795f1745-97c0-40d6-86c1-22be5721e8ce tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:22.499316 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-795f1745-97c0-40d6-86c1-22be5721e8ce tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1230 microversion: 2.1 time: 0.507133 Jul 20 04:45:22.510415 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2591/5429] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:21 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1230 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:23.112879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6557e86c-49f3-41a4-9883-ef76770dcc2e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:23.114584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6557e86c-49f3-41a4-9883-ef76770dcc2e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:23.132743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6557e86c-49f3-41a4-9883-ef76770dcc2e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:23.138464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6557e86c-49f3-41a4-9883-ef76770dcc2e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:23.139619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6557e86c-49f3-41a4-9883-ef76770dcc2e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:23.144157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6557e86c-49f3-41a4-9883-ef76770dcc2e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:23.197358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:23.522758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ba4fdb8b-6771-422a-9f7f-ea4c7fb85849 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:23.523655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ba4fdb8b-6771-422a-9f7f-ea4c7fb85849 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:23.543705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba4fdb8b-6771-422a-9f7f-ea4c7fb85849 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:23.545177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba4fdb8b-6771-422a-9f7f-ea4c7fb85849 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:23.546711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba4fdb8b-6771-422a-9f7f-ea4c7fb85849 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:23.547529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba4fdb8b-6771-422a-9f7f-ea4c7fb85849 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:23.651071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6557e86c-49f3-41a4-9883-ef76770dcc2e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:23.668582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6557e86c-49f3-41a4-9883-ef76770dcc2e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:23.673519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6557e86c-49f3-41a4-9883-ef76770dcc2e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:23.678286 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6557e86c-49f3-41a4-9883-ef76770dcc2e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1407 microversion: 2.54 time: 0.573410 Jul 20 04:45:23.692654 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2839/5430] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:23 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1407 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:45:23.767854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ba4fdb8b-6771-422a-9f7f-ea4c7fb85849 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:23.781781 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ba4fdb8b-6771-422a-9f7f-ea4c7fb85849 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1282 microversion: 2.1 time: 0.267749 Jul 20 04:45:23.782455 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2592/5431] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:23 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1282 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:24.704108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f0beb2f5-7b1a-4e2d-8f5b-b92365e9af56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:24.705769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f0beb2f5-7b1a-4e2d-8f5b-b92365e9af56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:24.733938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0beb2f5-7b1a-4e2d-8f5b-b92365e9af56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:24.738300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0beb2f5-7b1a-4e2d-8f5b-b92365e9af56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:24.739665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0beb2f5-7b1a-4e2d-8f5b-b92365e9af56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:24.741219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0beb2f5-7b1a-4e2d-8f5b-b92365e9af56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:24.807023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6ae7bc67-0ec8-48d0-8c3d-2fe50747cb2d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:24.808392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6ae7bc67-0ec8-48d0-8c3d-2fe50747cb2d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:24.826678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6ae7bc67-0ec8-48d0-8c3d-2fe50747cb2d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:24.827529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6ae7bc67-0ec8-48d0-8c3d-2fe50747cb2d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:24.829791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6ae7bc67-0ec8-48d0-8c3d-2fe50747cb2d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:24.833584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6ae7bc67-0ec8-48d0-8c3d-2fe50747cb2d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:24.902122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f0beb2f5-7b1a-4e2d-8f5b-b92365e9af56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:24.916590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f0beb2f5-7b1a-4e2d-8f5b-b92365e9af56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:24.936605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f0beb2f5-7b1a-4e2d-8f5b-b92365e9af56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:24.938261 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f0beb2f5-7b1a-4e2d-8f5b-b92365e9af56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1407 microversion: 2.54 time: 0.242367 Jul 20 04:45:24.941069 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2840/5432] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:24 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:25.164305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6ae7bc67-0ec8-48d0-8c3d-2fe50747cb2d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:25.183804 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6ae7bc67-0ec8-48d0-8c3d-2fe50747cb2d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1300 microversion: 2.1 time: 0.382957 Jul 20 04:45:25.198001 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2593/5433] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:24 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1300 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:25.965311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3afb4dd6-0c01-424c-9478-5b39ea25e26a tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:25.972128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3afb4dd6-0c01-424c-9478-5b39ea25e26a tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:25.997675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3afb4dd6-0c01-424c-9478-5b39ea25e26a tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:26.002863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3afb4dd6-0c01-424c-9478-5b39ea25e26a tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:26.014339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3afb4dd6-0c01-424c-9478-5b39ea25e26a tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:26.017113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3afb4dd6-0c01-424c-9478-5b39ea25e26a tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:26.211460 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e9e973e5-4138-4a2e-b6a6-0a0047b432d3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:26.215277 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e9e973e5-4138-4a2e-b6a6-0a0047b432d3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:26.240468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9e973e5-4138-4a2e-b6a6-0a0047b432d3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:26.245230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9e973e5-4138-4a2e-b6a6-0a0047b432d3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:26.253540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9e973e5-4138-4a2e-b6a6-0a0047b432d3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:26.256049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9e973e5-4138-4a2e-b6a6-0a0047b432d3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:26.443352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3afb4dd6-0c01-424c-9478-5b39ea25e26a tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:26.483594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3afb4dd6-0c01-424c-9478-5b39ea25e26a tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:26.485120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3afb4dd6-0c01-424c-9478-5b39ea25e26a tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:26.489402 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3afb4dd6-0c01-424c-9478-5b39ea25e26a tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1407 microversion: 2.54 time: 0.533321 Jul 20 04:45:26.503236 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2841/5434] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:25 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1407 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:26.754956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e9e973e5-4138-4a2e-b6a6-0a0047b432d3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:26.787005 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e9e973e5-4138-4a2e-b6a6-0a0047b432d3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1300 microversion: 2.1 time: 0.586390 Jul 20 04:45:26.799470 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2594/5435] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:26 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1300 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:27.520601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-efaca9ba-7c37-4e75-a908-568985762930 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:27.523787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-efaca9ba-7c37-4e75-a908-568985762930 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:27.571955 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-efaca9ba-7c37-4e75-a908-568985762930 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:27.574276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-efaca9ba-7c37-4e75-a908-568985762930 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:27.575161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-efaca9ba-7c37-4e75-a908-568985762930 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:27.575608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-efaca9ba-7c37-4e75-a908-568985762930 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:27.810875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f95ec124-6457-41b9-858f-800a5ef99084 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:27.814709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f95ec124-6457-41b9-858f-800a5ef99084 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:27.872757 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f95ec124-6457-41b9-858f-800a5ef99084 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:27.875818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f95ec124-6457-41b9-858f-800a5ef99084 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:27.878375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f95ec124-6457-41b9-858f-800a5ef99084 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:27.882286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f95ec124-6457-41b9-858f-800a5ef99084 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:28.121682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-efaca9ba-7c37-4e75-a908-568985762930 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:28.143753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-efaca9ba-7c37-4e75-a908-568985762930 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:28.151023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-efaca9ba-7c37-4e75-a908-568985762930 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:28.159705 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-efaca9ba-7c37-4e75-a908-568985762930 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1407 microversion: 2.54 time: 0.647708 Jul 20 04:45:28.172611 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2842/5436] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:27 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1407 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:28.982426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f95ec124-6457-41b9-858f-800a5ef99084 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:29.004539 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f95ec124-6457-41b9-858f-800a5ef99084 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1342 microversion: 2.1 time: 1.198139 Jul 20 04:45:29.018408 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2595/5437] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:27 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1342 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:29.180794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-afbe0922-afb3-44b5-936b-60ee0374bfc9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:29.182112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-afbe0922-afb3-44b5-936b-60ee0374bfc9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:29.214922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afbe0922-afb3-44b5-936b-60ee0374bfc9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:29.215527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afbe0922-afb3-44b5-936b-60ee0374bfc9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:29.216427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afbe0922-afb3-44b5-936b-60ee0374bfc9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:29.216966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-afbe0922-afb3-44b5-936b-60ee0374bfc9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:29.563939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-afbe0922-afb3-44b5-936b-60ee0374bfc9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:29.578961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-afbe0922-afb3-44b5-936b-60ee0374bfc9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:29.582534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-afbe0922-afb3-44b5-936b-60ee0374bfc9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:29.589585 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-afbe0922-afb3-44b5-936b-60ee0374bfc9 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1407 microversion: 2.54 time: 0.413489 Jul 20 04:45:29.590393 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2843/5438] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:29 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:30.022767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2a697fb5-a6d9-48ea-9d62-d0333489a17c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:30.024218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2a697fb5-a6d9-48ea-9d62-d0333489a17c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:30.050273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a697fb5-a6d9-48ea-9d62-d0333489a17c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:30.051938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a697fb5-a6d9-48ea-9d62-d0333489a17c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:30.057012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a697fb5-a6d9-48ea-9d62-d0333489a17c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:30.059289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a697fb5-a6d9-48ea-9d62-d0333489a17c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:30.200192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-20e9e26d-9e6c-40bd-afa0-b845e0814818 req-405b06cb-8877-4033-93e5-9f3c0c40e14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69b8042-1e5c-4ea4-9c05-3623cb12ad85", "name": "network-vif-plugged", "status": "completed", "tag": "250e1005-0706-457b-aa98-bde024a78797"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:30.227999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-20e9e26d-9e6c-40bd-afa0-b845e0814818 req-405b06cb-8877-4033-93e5-9f3c0c40e14f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:30.228915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-20e9e26d-9e6c-40bd-afa0-b845e0814818 req-405b06cb-8877-4033-93e5-9f3c0c40e14f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:30.280419 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-20e9e26d-9e6c-40bd-afa0-b845e0814818 req-405b06cb-8877-4033-93e5-9f3c0c40e14f service nova] Creating event network-vif-plugged:250e1005-0706-457b-aa98-bde024a78797 for instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 on n-h2-826526-5 Jul 20 04:45:30.302499 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-20e9e26d-9e6c-40bd-afa0-b845e0814818 req-405b06cb-8877-4033-93e5-9f3c0c40e14f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106176 Jul 20 04:45:30.304557 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2844/5439] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:45:30.632098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-701ed4bf-9458-4cc4-9c77-058d427aa4cf tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:30.633668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-701ed4bf-9458-4cc4-9c77-058d427aa4cf tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:30.651462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-701ed4bf-9458-4cc4-9c77-058d427aa4cf tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:30.658364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-701ed4bf-9458-4cc4-9c77-058d427aa4cf tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:30.659532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-701ed4bf-9458-4cc4-9c77-058d427aa4cf tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:30.660238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-701ed4bf-9458-4cc4-9c77-058d427aa4cf tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:30.927357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2a697fb5-a6d9-48ea-9d62-d0333489a17c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:30.947448 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2a697fb5-a6d9-48ea-9d62-d0333489a17c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1342 microversion: 2.1 time: 0.928938 Jul 20 04:45:30.966270 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2596/5440] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:30 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1342 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:30.985705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-4540557a-dce6-4332-9395-a70866c4ff7c req-8c411868-4049-4b80-96b8-b256a54747ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7252429e-bc8c-4074-bf46-54b6a7cecbf5", "tag": "164f2fc3-122f-4406-8e11-8f0e32836720"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:31.025155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4540557a-dce6-4332-9395-a70866c4ff7c req-8c411868-4049-4b80-96b8-b256a54747ec service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:31.025756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4540557a-dce6-4332-9395-a70866c4ff7c req-8c411868-4049-4b80-96b8-b256a54747ec service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:31.075359 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-4540557a-dce6-4332-9395-a70866c4ff7c req-8c411868-4049-4b80-96b8-b256a54747ec service nova] Creating event network-changed:164f2fc3-122f-4406-8e11-8f0e32836720 for instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 on n-h1-826526-5 Jul 20 04:45:31.089595 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-4540557a-dce6-4332-9395-a70866c4ff7c req-8c411868-4049-4b80-96b8-b256a54747ec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116924 Jul 20 04:45:31.094665 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2597/5441] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:31.141937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-701ed4bf-9458-4cc4-9c77-058d427aa4cf tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:31.200082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-701ed4bf-9458-4cc4-9c77-058d427aa4cf tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:31.207418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-701ed4bf-9458-4cc4-9c77-058d427aa4cf tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:31.210391 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-701ed4bf-9458-4cc4-9c77-058d427aa4cf tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1407 microversion: 2.54 time: 0.590610 Jul 20 04:45:31.223863 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2845/5442] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:30 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1407 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:31.965723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-029d8886-1627-434f-8558-e3d9f0e33b13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:31.966798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-029d8886-1627-434f-8558-e3d9f0e33b13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:31.987044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:31.994290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:31.996778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-029d8886-1627-434f-8558-e3d9f0e33b13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:32.007006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-029d8886-1627-434f-8558-e3d9f0e33b13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:32.011489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-029d8886-1627-434f-8558-e3d9f0e33b13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:32.020643 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-029d8886-1627-434f-8558-e3d9f0e33b13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:32.330396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f551b84c-53e0-4768-b66f-2a8d4c802d4d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Action: 'create', calling method: .version_select at 0x7f06bdb459d0>, body: {"keypair": {"name": "tempest-keypair-1318803767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxSHZw1qY9NQppV8grL7ix60YIhhXoGzdnseBSDzAzNXKSmfDk9BY+utlIg+/eQ+uB/qc74QfGKSloRxJ8HEmOEjExDWivMKXgYHtQDePIsHfMpXDH1+CWyZHL4aqP+dQ=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:32.394167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-f551b84c-53e0-4768-b66f-2a8d4c802d4d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Getting quotas for project bf61df9cc1e340469412fe282057f903. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:45:32.413036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-f551b84c-53e0-4768-b66f-2a8d4c802d4d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Getting quotas for user 4a8bade1b5244107b43bdf34c9663dc7 and project bf61df9cc1e340469412fe282057f903. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:45:32.516237 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f551b84c-53e0-4768-b66f-2a8d4c802d4d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.796727 Jul 20 04:45:32.519652 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2598/5443] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:45:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:32.536642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-812e82e0-5568-4a3e-ab74-352582ac31c5 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:32.540207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-812e82e0-5568-4a3e-ab74-352582ac31c5 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:32.558287 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-812e82e0-5568-4a3e-ab74-352582ac31c5 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:32.560157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-812e82e0-5568-4a3e-ab74-352582ac31c5 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:32.563581 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-812e82e0-5568-4a3e-ab74-352582ac31c5 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:32.563900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-812e82e0-5568-4a3e-ab74-352582ac31c5 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:32.778163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-029d8886-1627-434f-8558-e3d9f0e33b13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:32.797988 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-029d8886-1627-434f-8558-e3d9f0e33b13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1342 microversion: 2.1 time: 0.836401 Jul 20 04:45:32.812046 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2846/5444] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:31 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1342 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:33.025825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-812e82e0-5568-4a3e-ab74-352582ac31c5 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:33.044341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-812e82e0-5568-4a3e-ab74-352582ac31c5 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:33.049471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-812e82e0-5568-4a3e-ab74-352582ac31c5 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:33.054201 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-812e82e0-5568-4a3e-ab74-352582ac31c5 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1413 microversion: 2.54 time: 0.533207 Jul 20 04:45:33.068691 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2599/5445] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:32 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1413 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:33.832331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1e419b59-e9f2-4e98-8750-f055584995b3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:33.833239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1e419b59-e9f2-4e98-8750-f055584995b3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:33.857270 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e419b59-e9f2-4e98-8750-f055584995b3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:33.867559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e419b59-e9f2-4e98-8750-f055584995b3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:33.879019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e419b59-e9f2-4e98-8750-f055584995b3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:33.883626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e419b59-e9f2-4e98-8750-f055584995b3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:34.083952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aa9b8a88-a49e-4a91-b11c-d8db78a5288d tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:34.089511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aa9b8a88-a49e-4a91-b11c-d8db78a5288d tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:34.118424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa9b8a88-a49e-4a91-b11c-d8db78a5288d tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:34.119183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa9b8a88-a49e-4a91-b11c-d8db78a5288d tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:34.120579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa9b8a88-a49e-4a91-b11c-d8db78a5288d tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:34.121230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa9b8a88-a49e-4a91-b11c-d8db78a5288d tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:34.763414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aa9b8a88-a49e-4a91-b11c-d8db78a5288d tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:34.780762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aa9b8a88-a49e-4a91-b11c-d8db78a5288d tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:34.787044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aa9b8a88-a49e-4a91-b11c-d8db78a5288d tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:34.795683 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aa9b8a88-a49e-4a91-b11c-d8db78a5288d tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1413 microversion: 2.54 time: 0.715816 Jul 20 04:45:34.796761 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2600/5446] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:34 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1413 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:45:34.818057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1e419b59-e9f2-4e98-8750-f055584995b3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:34.861558 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1e419b59-e9f2-4e98-8750-f055584995b3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1342 microversion: 2.1 time: 1.033695 Jul 20 04:45:34.865634 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2847/5447] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:33 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1342 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:35.826793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ac2ed266-4307-4dbb-9bb5-865a91fdfc26 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:35.827837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ac2ed266-4307-4dbb-9bb5-865a91fdfc26 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:35.842213 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:35.852829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac2ed266-4307-4dbb-9bb5-865a91fdfc26 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:35.853967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac2ed266-4307-4dbb-9bb5-865a91fdfc26 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:35.855877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac2ed266-4307-4dbb-9bb5-865a91fdfc26 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:35.857399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac2ed266-4307-4dbb-9bb5-865a91fdfc26 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:35.890523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6a6fe7e0-c346-4462-a3d4-d8b44ab6e68b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:35.891289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6a6fe7e0-c346-4462-a3d4-d8b44ab6e68b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:35.912744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a6fe7e0-c346-4462-a3d4-d8b44ab6e68b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:35.913792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a6fe7e0-c346-4462-a3d4-d8b44ab6e68b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:35.914327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a6fe7e0-c346-4462-a3d4-d8b44ab6e68b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:35.914775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a6fe7e0-c346-4462-a3d4-d8b44ab6e68b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:36.062192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ac2ed266-4307-4dbb-9bb5-865a91fdfc26 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:36.102532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ac2ed266-4307-4dbb-9bb5-865a91fdfc26 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:36.105983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ac2ed266-4307-4dbb-9bb5-865a91fdfc26 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:36.116178 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ac2ed266-4307-4dbb-9bb5-865a91fdfc26 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1398 microversion: 2.54 time: 0.291882 Jul 20 04:45:36.118125 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2601/5448] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:35 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1398 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:36.191406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5f4fc286-c2bf-4b9f-8e31-cccef3dbf38b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '.version_select at 0x7f06bcd29820>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:36.247257 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5f4fc286-c2bf-4b9f-8e31-cccef3dbf38b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-526004902" status: 204 len: 0 microversion: 2.54 time: 0.084605 Jul 20 04:45:36.248208 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2602/5449] 10.222.0.17 () {60 vars in 1315 bytes} [Wed Jul 20 04:45:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-526004902 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:45:36.281649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3ca27d45-fb27-42d9-94df-a8862290a439 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:36.287373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3ca27d45-fb27-42d9-94df-a8862290a439 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:36.305636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ca27d45-fb27-42d9-94df-a8862290a439 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:36.306822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ca27d45-fb27-42d9-94df-a8862290a439 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:36.307897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ca27d45-fb27-42d9-94df-a8862290a439 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:36.308929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ca27d45-fb27-42d9-94df-a8862290a439 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:36.372115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3ca27d45-fb27-42d9-94df-a8862290a439 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:45:36.432838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:36.578293 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3ca27d45-fb27-42d9-94df-a8862290a439 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 204 len: 0 microversion: 2.54 time: 0.300349 Jul 20 04:45:36.587119 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2603/5450] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 04:45:36 2022] DELETE /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:45:36.609733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2ff216cf-048e-424e-b9fb-eae7d9a57173 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:36.610877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2ff216cf-048e-424e-b9fb-eae7d9a57173 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:36.632888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ff216cf-048e-424e-b9fb-eae7d9a57173 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:36.634235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ff216cf-048e-424e-b9fb-eae7d9a57173 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:36.635378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ff216cf-048e-424e-b9fb-eae7d9a57173 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:36.636004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ff216cf-048e-424e-b9fb-eae7d9a57173 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:36.981265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2ff216cf-048e-424e-b9fb-eae7d9a57173 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:37.001306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2ff216cf-048e-424e-b9fb-eae7d9a57173 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:37.003474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2ff216cf-048e-424e-b9fb-eae7d9a57173 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:37.005851 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2ff216cf-048e-424e-b9fb-eae7d9a57173 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1404 microversion: 2.54 time: 0.416604 Jul 20 04:45:37.016082 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2604/5451] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:36 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:37.711268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6a6fe7e0-c346-4462-a3d4-d8b44ab6e68b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:37.745300 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6a6fe7e0-c346-4462-a3d4-d8b44ab6e68b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1342 microversion: 2.1 time: 1.858483 Jul 20 04:45:37.762495 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2848/5452] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:35 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1342 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:38.042700 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dbf06a4b-54a7-4342-a118-13e7a530cc56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:38.045327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dbf06a4b-54a7-4342-a118-13e7a530cc56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:38.060887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbf06a4b-54a7-4342-a118-13e7a530cc56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:38.063178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbf06a4b-54a7-4342-a118-13e7a530cc56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:38.065616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbf06a4b-54a7-4342-a118-13e7a530cc56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:38.066862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbf06a4b-54a7-4342-a118-13e7a530cc56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:38.222977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dbf06a4b-54a7-4342-a118-13e7a530cc56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:38.274157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dbf06a4b-54a7-4342-a118-13e7a530cc56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:38.292839 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dbf06a4b-54a7-4342-a118-13e7a530cc56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:38.301886 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dbf06a4b-54a7-4342-a118-13e7a530cc56 tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1404 microversion: 2.54 time: 0.259704 Jul 20 04:45:38.307109 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2605/5453] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:38 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1404 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:38.775979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1c502be3-6a4b-43bb-b067-5201a2f95597 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:38.776652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1c502be3-6a4b-43bb-b067-5201a2f95597 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:38.786697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c502be3-6a4b-43bb-b067-5201a2f95597 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:38.787158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c502be3-6a4b-43bb-b067-5201a2f95597 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:38.787971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c502be3-6a4b-43bb-b067-5201a2f95597 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:38.788460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c502be3-6a4b-43bb-b067-5201a2f95597 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:39.320148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1c502be3-6a4b-43bb-b067-5201a2f95597 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:39.328325 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cdbca6fb-9cfd-4e78-bdfb-f7f221a8d70b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:39.329293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cdbca6fb-9cfd-4e78-bdfb-f7f221a8d70b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:39.340106 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1c502be3-6a4b-43bb-b067-5201a2f95597 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1342 microversion: 2.1 time: 0.568577 Jul 20 04:45:39.344010 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2849/5454] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:38 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1342 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:39.368732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdbca6fb-9cfd-4e78-bdfb-f7f221a8d70b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:39.381825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdbca6fb-9cfd-4e78-bdfb-f7f221a8d70b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:39.383079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdbca6fb-9cfd-4e78-bdfb-f7f221a8d70b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:39.385220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdbca6fb-9cfd-4e78-bdfb-f7f221a8d70b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:39.475470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdbca6fb-9cfd-4e78-bdfb-f7f221a8d70b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:39.476096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdbca6fb-9cfd-4e78-bdfb-f7f221a8d70b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:39.476716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-cdbca6fb-9cfd-4e78-bdfb-f7f221a8d70b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lazy-loading 'fault' on Instance uuid dae4d27c-0823-4c57-9fd2-31588062d10d {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:45:39.865094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cdbca6fb-9cfd-4e78-bdfb-f7f221a8d70b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:39.883281 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cdbca6fb-9cfd-4e78-bdfb-f7f221a8d70b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:39.885010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cdbca6fb-9cfd-4e78-bdfb-f7f221a8d70b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90b8b96fdd1409bb9876dabb3989663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc471d4c4e4a66a5745b74db41c9b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:39.886561 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cdbca6fb-9cfd-4e78-bdfb-f7f221a8d70b tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 200 len: 1409 microversion: 2.54 time: 0.562604 Jul 20 04:45:39.887171 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2606/5455] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:39 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 1409 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:45:40.359262 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-61e4449c-b1c8-49c7-abad-b509acec73b5 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:40.360565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-61e4449c-b1c8-49c7-abad-b509acec73b5 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:40.400446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61e4449c-b1c8-49c7-abad-b509acec73b5 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:40.405147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61e4449c-b1c8-49c7-abad-b509acec73b5 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:40.409361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61e4449c-b1c8-49c7-abad-b509acec73b5 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:40.419684 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-61e4449c-b1c8-49c7-abad-b509acec73b5 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:40.919447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fa0ac7fc-5bab-48c0-b410-30d232231e7e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:40.920403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fa0ac7fc-5bab-48c0-b410-30d232231e7e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] [instance: dae4d27c-0823-4c57-9fd2-31588062d10d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:40.942644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fa0ac7fc-5bab-48c0-b410-30d232231e7e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:40.943347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fa0ac7fc-5bab-48c0-b410-30d232231e7e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:40.945168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fa0ac7fc-5bab-48c0-b410-30d232231e7e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:40.945168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fa0ac7fc-5bab-48c0-b410-30d232231e7e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:41.001071 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-fa0ac7fc-5bab-48c0-b410-30d232231e7e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] HTTP exception thrown: Instance dae4d27c-0823-4c57-9fd2-31588062d10d could not be found. Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fa0ac7fc-5bab-48c0-b410-30d232231e7e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Request method failure captured: Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d HTTP/1.1 Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14hI3iWJ9RWzeAhKZKcFKKmRBWb-3elRzXFQ85SG2RvXdnqZWwHRClJv01igshWFd9xjZ1cO0RqmM4cCBMQRTaLuhfVnWDodllT_vt4Z2hcP_Z9HK7AHL0peciSuCECBgxWZ-zPd7vSCsKQlOiY1furSiGkrwR-4htcqsTGmAdjxE3I Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.54 Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c1cc471d4c4e4a66a5745b74db41c9b5 Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerShowV254Test-779613016 Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c1cc471d4c4e4a66a5745b74db41c9b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c1cc471d4c4e4a66a5745b74db41c9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c1cc471d4c4e4a66a5745b74db41c9b5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c1cc471d4c4e4a66a5745b74db41c9b5"}]}] Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerShowV254Test-779613016 Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c1cc471d4c4e4a66a5745b74db41c9b5 Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerShowV254Test-779613016 Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerShowV254Test-779613016-project Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: c90b8b96fdd1409bb9876dabb3989663 Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerShowV254Test-779613016-project Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance dae4d27c-0823-4c57-9fd2-31588062d10d could not be found. Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'dae4d27c-0823-4c57-9fd2-31588062d10d'} Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dae4d27c-0823-4c57-9fd2-31588062d10d could not be found. Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dae4d27c-0823-4c57-9fd2-31588062d10d could not be found. Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:45:41.003503 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:45:41.008549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:41.008549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:45:41.008549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:45:41.008549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:45:41.008549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:45:41.008549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dae4d27c-0823-4c57-9fd2-31588062d10d could not be found. Jul 20 04:45:41.008549 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:45:41.019707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fa0ac7fc-5bab-48c0-b410-30d232231e7e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] Returning 404 to user: Instance dae4d27c-0823-4c57-9fd2-31588062d10d could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:45:41.021476 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fa0ac7fc-5bab-48c0-b410-30d232231e7e tempest-ServerShowV254Test-779613016 tempest-ServerShowV254Test-779613016-project] 10.222.0.17 "GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d" status: 404 len: 111 microversion: 2.54 time: 0.107990 Jul 20 04:45:41.027440 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2607/5456] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:40 2022] GET /compute/v2.1/servers/dae4d27c-0823-4c57-9fd2-31588062d10d => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:45:41.465335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-61e4449c-b1c8-49c7-abad-b509acec73b5 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:41.491241 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-61e4449c-b1c8-49c7-abad-b509acec73b5 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1342 microversion: 2.1 time: 1.136637 Jul 20 04:45:41.494905 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2850/5457] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:40 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1342 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:42.352707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-71640b5b-9e59-4c11-aae7-5e98a520525f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2025522788", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0f3a866-bb27-4dc7-bcc2-280a4ea073e4"}], "security_groups": [{"name": "tempest-securitygroup--2048056538"}], "key_name": "tempest-keypair-1318803767", "user_data": "}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:42.461997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:42.512223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-af0a2f18-c213-4960-a3e8-55b89d43e335 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:42.514009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-af0a2f18-c213-4960-a3e8-55b89d43e335 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:42.526776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af0a2f18-c213-4960-a3e8-55b89d43e335 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:42.527670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af0a2f18-c213-4960-a3e8-55b89d43e335 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:42.529194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af0a2f18-c213-4960-a3e8-55b89d43e335 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:42.530598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af0a2f18-c213-4960-a3e8-55b89d43e335 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:43.377439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-71640b5b-9e59-4c11-aae7-5e98a520525f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] validate_networks() for [('a0f3a866-bb27-4dc7-bcc2-280a4ea073e4', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:45:43.808296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-af0a2f18-c213-4960-a3e8-55b89d43e335 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:43.825795 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-af0a2f18-c213-4960-a3e8-55b89d43e335 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1342 microversion: 2.1 time: 1.317090 Jul 20 04:45:43.827573 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2851/5458] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:42 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1342 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:44.742469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-71640b5b-9e59-4c11-aae7-5e98a520525f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:45:44.743226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-71640b5b-9e59-4c11-aae7-5e98a520525f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:45:44.744339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-71640b5b-9e59-4c11-aae7-5e98a520525f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:45:44.744812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-71640b5b-9e59-4c11-aae7-5e98a520525f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:45:44.745362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-71640b5b-9e59-4c11-aae7-5e98a520525f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:45:44.763683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71640b5b-9e59-4c11-aae7-5e98a520525f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:44.764450 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71640b5b-9e59-4c11-aae7-5e98a520525f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:44.769553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71640b5b-9e59-4c11-aae7-5e98a520525f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:44.770263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71640b5b-9e59-4c11-aae7-5e98a520525f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:44.834179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-71640b5b-9e59-4c11-aae7-5e98a520525f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Getting quotas for project bf61df9cc1e340469412fe282057f903. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:45:44.861817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-71640b5b-9e59-4c11-aae7-5e98a520525f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Getting quotas for user 4a8bade1b5244107b43bdf34c9663dc7 and project bf61df9cc1e340469412fe282057f903. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:45:44.873267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8f6c05d3-f87e-47a8-914a-694fa48cfe10 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1509155129", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "3d22ba6e-7662-4637-bb0f-d3084b1def5c"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:44.954726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-71640b5b-9e59-4c11-aae7-5e98a520525f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:45:44.961786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-71640b5b-9e59-4c11-aae7-5e98a520525f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:45:45.025184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-8f6c05d3-f87e-47a8-914a-694fa48cfe10 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] validate_networks() for [('3d22ba6e-7662-4637-bb0f-d3084b1def5c', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:45:45.129214 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-71640b5b-9e59-4c11-aae7-5e98a520525f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.779601 Jul 20 04:45:45.131570 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2608/5459] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:45:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 2784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:45:45.147567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c5e7339a-9030-4b32-82a4-5b3ed9c67534 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:45.151920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c5e7339a-9030-4b32-82a4-5b3ed9c67534 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:45.179852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5e7339a-9030-4b32-82a4-5b3ed9c67534 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:45.181798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5e7339a-9030-4b32-82a4-5b3ed9c67534 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:45.203777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5e7339a-9030-4b32-82a4-5b3ed9c67534 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:45.207244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5e7339a-9030-4b32-82a4-5b3ed9c67534 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:46.340435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8f6c05d3-f87e-47a8-914a-694fa48cfe10 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:45:46.341909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8f6c05d3-f87e-47a8-914a-694fa48cfe10 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:45:46.342841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8f6c05d3-f87e-47a8-914a-694fa48cfe10 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:45:46.344568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8f6c05d3-f87e-47a8-914a-694fa48cfe10 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:45:46.345167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8f6c05d3-f87e-47a8-914a-694fa48cfe10 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:45:46.370642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f6c05d3-f87e-47a8-914a-694fa48cfe10 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:46.371669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f6c05d3-f87e-47a8-914a-694fa48cfe10 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:46.373721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f6c05d3-f87e-47a8-914a-694fa48cfe10 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:46.375625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f6c05d3-f87e-47a8-914a-694fa48cfe10 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:46.445512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-8f6c05d3-f87e-47a8-914a-694fa48cfe10 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Getting quotas for project fc751c3978da4e05b6d7aab178723ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:45:46.460202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-8f6c05d3-f87e-47a8-914a-694fa48cfe10 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Getting quotas for user a5e17b2cb6654e4584b62ac8d08833f2 and project fc751c3978da4e05b6d7aab178723ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:45:46.498513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8f6c05d3-f87e-47a8-914a-694fa48cfe10 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:45:46.504905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8f6c05d3-f87e-47a8-914a-694fa48cfe10 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:45:46.600473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c5e7339a-9030-4b32-82a4-5b3ed9c67534 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:46.635975 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c5e7339a-9030-4b32-82a4-5b3ed9c67534 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1342 microversion: 2.1 time: 1.502273 Jul 20 04:45:46.637180 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2609/5460] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:45 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1342 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:46.644253 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-67ec68d2-cf52-4869-897e-318ef0ae78b3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:46.647990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-67ec68d2-cf52-4869-897e-318ef0ae78b3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:46.653729 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8f6c05d3-f87e-47a8-914a-694fa48cfe10 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.983744 Jul 20 04:45:46.657107 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2852/5461] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:45:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:45:46.692503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-67ec68d2-cf52-4869-897e-318ef0ae78b3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:46.693256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-67ec68d2-cf52-4869-897e-318ef0ae78b3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:46.694278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-67ec68d2-cf52-4869-897e-318ef0ae78b3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:46.694828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-67ec68d2-cf52-4869-897e-318ef0ae78b3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:47.145962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-67ec68d2-cf52-4869-897e-318ef0ae78b3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:47.161788 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-67ec68d2-cf52-4869-897e-318ef0ae78b3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1234 microversion: 2.1 time: 0.522766 Jul 20 04:45:47.181186 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2610/5462] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:46 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1234 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:47.196702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-45b7d308-3445-4a6b-b1aa-c6658a6a3a05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:47.197403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-45b7d308-3445-4a6b-b1aa-c6658a6a3a05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:47.438206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-45b7d308-3445-4a6b-b1aa-c6658a6a3a05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:47.481100 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-45b7d308-3445-4a6b-b1aa-c6658a6a3a05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab" status: 200 len: 1193 microversion: 2.1 time: 0.290497 Jul 20 04:45:47.492552 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2611/5463] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:47 2022] GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab => generated 1193 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:47.655783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c341a284-1c8a-434d-b54f-ccddfdd7f0b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:47.657515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c341a284-1c8a-434d-b54f-ccddfdd7f0b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:47.677377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c341a284-1c8a-434d-b54f-ccddfdd7f0b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:47.685641 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c341a284-1c8a-434d-b54f-ccddfdd7f0b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:47.695798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c341a284-1c8a-434d-b54f-ccddfdd7f0b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:47.698906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c341a284-1c8a-434d-b54f-ccddfdd7f0b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:47.750373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a43ea107-f959-446d-bf2e-3ee84764591c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:47.752499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a43ea107-f959-446d-bf2e-3ee84764591c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:47.779071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:47.786819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a43ea107-f959-446d-bf2e-3ee84764591c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:47.796312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a43ea107-f959-446d-bf2e-3ee84764591c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:47.804763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a43ea107-f959-446d-bf2e-3ee84764591c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:47.805475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a43ea107-f959-446d-bf2e-3ee84764591c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:47.968122 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a43ea107-f959-446d-bf2e-3ee84764591c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85/action" status: 200 len: 63161 microversion: 2.1 time: 1.307131 Jul 20 04:45:47.974063 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2853/5464] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:45:46 2022] POST /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85/action => generated 63161 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:45:48.204912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a0d99772-80f4-4107-bfe6-2cab7e603e49 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:48.205927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a0d99772-80f4-4107-bfe6-2cab7e603e49 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:48.237008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0d99772-80f4-4107-bfe6-2cab7e603e49 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:48.239181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0d99772-80f4-4107-bfe6-2cab7e603e49 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:48.241288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0d99772-80f4-4107-bfe6-2cab7e603e49 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:48.244384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0d99772-80f4-4107-bfe6-2cab7e603e49 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:48.471664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a0d99772-80f4-4107-bfe6-2cab7e603e49 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:48.496120 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a0d99772-80f4-4107-bfe6-2cab7e603e49 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1296 microversion: 2.1 time: 0.295676 Jul 20 04:45:48.498394 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2854/5465] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:48 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1296 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:48.522247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5a7c3ec0-3a78-4934-b865-0098865b7e8d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:48.523389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5a7c3ec0-3a78-4934-b865-0098865b7e8d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:48.541572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a7c3ec0-3a78-4934-b865-0098865b7e8d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:48.543632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a7c3ec0-3a78-4934-b865-0098865b7e8d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:48.546277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a7c3ec0-3a78-4934-b865-0098865b7e8d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:48.547307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a7c3ec0-3a78-4934-b865-0098865b7e8d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:48.727149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c341a284-1c8a-434d-b54f-ccddfdd7f0b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:48.820128 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c341a284-1c8a-434d-b54f-ccddfdd7f0b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1342 microversion: 2.1 time: 1.165143 Jul 20 04:45:48.834297 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2612/5466] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:47 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1342 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:48.857973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5a7c3ec0-3a78-4934-b865-0098865b7e8d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:48.884601 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5a7c3ec0-3a78-4934-b865-0098865b7e8d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab" status: 200 len: 1197 microversion: 2.1 time: 0.366940 Jul 20 04:45:48.886740 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2855/5467] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:48 2022] GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab => generated 1197 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:49.526860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e6c0d80a-6d5f-40ae-bbc6-086e65f21268 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:49.527787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e6c0d80a-6d5f-40ae-bbc6-086e65f21268 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:49.541268 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6c0d80a-6d5f-40ae-bbc6-086e65f21268 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:49.551004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6c0d80a-6d5f-40ae-bbc6-086e65f21268 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:49.557717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6c0d80a-6d5f-40ae-bbc6-086e65f21268 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:49.558741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6c0d80a-6d5f-40ae-bbc6-086e65f21268 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:49.856939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5bb09b4f-b725-4743-87f5-bcddec252820 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:49.857746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5bb09b4f-b725-4743-87f5-bcddec252820 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:49.899123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5bb09b4f-b725-4743-87f5-bcddec252820 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:49.910035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5bb09b4f-b725-4743-87f5-bcddec252820 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:49.911561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5bb09b4f-b725-4743-87f5-bcddec252820 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:49.920814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5bb09b4f-b725-4743-87f5-bcddec252820 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:50.414705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5bb09b4f-b725-4743-87f5-bcddec252820 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:50.436995 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5bb09b4f-b725-4743-87f5-bcddec252820 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1342 microversion: 2.1 time: 0.585605 Jul 20 04:45:50.448292 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2856/5468] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:49 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1342 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:50.452574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4cf2909a-a344-4274-91ee-2ede53d9a94e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:50.454682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4cf2909a-a344-4274-91ee-2ede53d9a94e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:50.470518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4cf2909a-a344-4274-91ee-2ede53d9a94e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:50.472760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4cf2909a-a344-4274-91ee-2ede53d9a94e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:50.473919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4cf2909a-a344-4274-91ee-2ede53d9a94e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:50.475470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4cf2909a-a344-4274-91ee-2ede53d9a94e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:50.517568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:50.641106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4cf2909a-a344-4274-91ee-2ede53d9a94e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:50.655198 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4cf2909a-a344-4274-91ee-2ede53d9a94e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab" status: 200 len: 1251 microversion: 2.1 time: 0.212848 Jul 20 04:45:50.656313 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2857/5469] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:50 2022] GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab => generated 1251 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:50.745097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e6c0d80a-6d5f-40ae-bbc6-086e65f21268 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:50.765511 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e6c0d80a-6d5f-40ae-bbc6-086e65f21268 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1296 microversion: 2.1 time: 1.242893 Jul 20 04:45:50.766239 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2613/5470] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:49 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1296 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:51.467932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d2e9c6c8-a873-429e-858a-66a5a49c900c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:51.468538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d2e9c6c8-a873-429e-858a-66a5a49c900c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:51.483058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2e9c6c8-a873-429e-858a-66a5a49c900c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:51.483591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2e9c6c8-a873-429e-858a-66a5a49c900c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:51.493817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2e9c6c8-a873-429e-858a-66a5a49c900c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:51.496200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d2e9c6c8-a873-429e-858a-66a5a49c900c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:51.730402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-82028a9b-d75a-4db0-b8c0-d2ecf2e93674 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:51.739394 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:45:51.739394 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:45:51.743726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82028a9b-d75a-4db0-b8c0-d2ecf2e93674 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:51.744951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82028a9b-d75a-4db0-b8c0-d2ecf2e93674 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:51.747991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82028a9b-d75a-4db0-b8c0-d2ecf2e93674 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:51.750817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82028a9b-d75a-4db0-b8c0-d2ecf2e93674 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:51.848196 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-82028a9b-d75a-4db0-b8c0-d2ecf2e93674 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.277594 Jul 20 04:45:51.849581 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2614/5471] 10.222.0.17 () {58 vars in 1184 bytes} [Wed Jul 20 04:45:51 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:45:51.866013 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-48bb1c8b-9d5a-4425-b80b-c0b286340610 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:51.867157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-48bb1c8b-9d5a-4425-b80b-c0b286340610 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:51.888371 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48bb1c8b-9d5a-4425-b80b-c0b286340610 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:51.889135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48bb1c8b-9d5a-4425-b80b-c0b286340610 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:51.890230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48bb1c8b-9d5a-4425-b80b-c0b286340610 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:51.890796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48bb1c8b-9d5a-4425-b80b-c0b286340610 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:51.960563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d2e9c6c8-a873-429e-858a-66a5a49c900c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:51.970315 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d2e9c6c8-a873-429e-858a-66a5a49c900c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1342 microversion: 2.1 time: 0.506704 Jul 20 04:45:51.970814 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2858/5472] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:51 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1342 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:52.006006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-13231ef0-af8f-4d58-9029-e10dd8c44af8 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:52.008631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-13231ef0-af8f-4d58-9029-e10dd8c44af8 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:52.030545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13231ef0-af8f-4d58-9029-e10dd8c44af8 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:52.030991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13231ef0-af8f-4d58-9029-e10dd8c44af8 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:52.039296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13231ef0-af8f-4d58-9029-e10dd8c44af8 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:52.039816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13231ef0-af8f-4d58-9029-e10dd8c44af8 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:52.056603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-48bb1c8b-9d5a-4425-b80b-c0b286340610 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:52.068869 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-48bb1c8b-9d5a-4425-b80b-c0b286340610 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab" status: 200 len: 1251 microversion: 2.1 time: 0.217727 Jul 20 04:45:52.069454 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2615/5473] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:51 2022] GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab => generated 1251 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:52.108136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0e71d210-64de-413a-b3e1-7f55e8472e3c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-659959047", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "availability_zone": "nova:n-h1-826526-5", "networks": [{"uuid": "c2f9d408-ee5a-4fc3-9aae-6fce21c7d955"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:52.208042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-0e71d210-64de-413a-b3e1-7f55e8472e3c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] validate_networks() for [('c2f9d408-ee5a-4fc3-9aae-6fce21c7d955', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:45:53.279390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-13231ef0-af8f-4d58-9029-e10dd8c44af8 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:53.307506 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-13231ef0-af8f-4d58-9029-e10dd8c44af8 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1364 microversion: 2.1 time: 1.316486 Jul 20 04:45:53.326398 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2859/5474] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:51 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1364 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:53.345504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8914ea44-486e-47e0-ba2a-4719874e830a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:53.346815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8914ea44-486e-47e0-ba2a-4719874e830a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:53.365840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8914ea44-486e-47e0-ba2a-4719874e830a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:53.366698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8914ea44-486e-47e0-ba2a-4719874e830a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:53.369200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8914ea44-486e-47e0-ba2a-4719874e830a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:53.370279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8914ea44-486e-47e0-ba2a-4719874e830a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:54.148488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8914ea44-486e-47e0-ba2a-4719874e830a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:54.180775 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8914ea44-486e-47e0-ba2a-4719874e830a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1342 microversion: 2.1 time: 0.846600 Jul 20 04:45:54.182393 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2860/5475] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:53 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1342 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:54.196366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2897240f-faa9-473c-9152-b1decfa1c6a3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:54.213696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2897240f-faa9-473c-9152-b1decfa1c6a3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:54.247584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2897240f-faa9-473c-9152-b1decfa1c6a3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:54.261479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2897240f-faa9-473c-9152-b1decfa1c6a3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:54.262984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2897240f-faa9-473c-9152-b1decfa1c6a3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:54.264128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2897240f-faa9-473c-9152-b1decfa1c6a3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:55.089116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2897240f-faa9-473c-9152-b1decfa1c6a3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:55.106464 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2897240f-faa9-473c-9152-b1decfa1c6a3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab" status: 200 len: 1293 microversion: 2.1 time: 0.918895 Jul 20 04:45:55.110053 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2861/5476] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:54 2022] GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab => generated 1293 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:55.132307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-10732cc7-31fb-40ea-8197-2fb79a6ebad0 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:55.134201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-10732cc7-31fb-40ea-8197-2fb79a6ebad0 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:55.154883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-10732cc7-31fb-40ea-8197-2fb79a6ebad0 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:55.164020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-10732cc7-31fb-40ea-8197-2fb79a6ebad0 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:55.165315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-10732cc7-31fb-40ea-8197-2fb79a6ebad0 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:55.165932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-10732cc7-31fb-40ea-8197-2fb79a6ebad0 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:55.446557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0e71d210-64de-413a-b3e1-7f55e8472e3c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:45:55.447700 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0e71d210-64de-413a-b3e1-7f55e8472e3c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:45:55.449224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0e71d210-64de-413a-b3e1-7f55e8472e3c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:45:55.449940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0e71d210-64de-413a-b3e1-7f55e8472e3c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:45:55.450736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0e71d210-64de-413a-b3e1-7f55e8472e3c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:45:55.469529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e71d210-64de-413a-b3e1-7f55e8472e3c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:55.473256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e71d210-64de-413a-b3e1-7f55e8472e3c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:55.475131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e71d210-64de-413a-b3e1-7f55e8472e3c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:55.477004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e71d210-64de-413a-b3e1-7f55e8472e3c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:55.541784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-0e71d210-64de-413a-b3e1-7f55e8472e3c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Getting quotas for project 2dfab96c00554ef4a35d4822e0d24481. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:45:55.557945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-0e71d210-64de-413a-b3e1-7f55e8472e3c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Getting quotas for user a7f0c106d01f4843aadc182d8a9559f2 and project 2dfab96c00554ef4a35d4822e0d24481. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:45:55.602161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0e71d210-64de-413a-b3e1-7f55e8472e3c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:45:55.604594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0e71d210-64de-413a-b3e1-7f55e8472e3c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:45:55.780921 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0e71d210-64de-413a-b3e1-7f55e8472e3c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.676472 Jul 20 04:45:55.786387 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2616/5477] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:45:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:45:55.934480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-10732cc7-31fb-40ea-8197-2fb79a6ebad0 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:55.945784 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-10732cc7-31fb-40ea-8197-2fb79a6ebad0 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1364 microversion: 2.1 time: 0.834125 Jul 20 04:45:55.950856 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2862/5478] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:55 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1364 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:55.967813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5fbbdace-48f3-4d9a-9754-de31babf58e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:55.979658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5fbbdace-48f3-4d9a-9754-de31babf58e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:56.029345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5fbbdace-48f3-4d9a-9754-de31babf58e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:56.041224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5fbbdace-48f3-4d9a-9754-de31babf58e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:56.043038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5fbbdace-48f3-4d9a-9754-de31babf58e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:56.045605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5fbbdace-48f3-4d9a-9754-de31babf58e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:56.427249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:56.471709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1bf756c6-21cf-4dd1-8386-1633ff95e95b tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:56.484035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1bf756c6-21cf-4dd1-8386-1633ff95e95b tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:56.487747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:56.507683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bf756c6-21cf-4dd1-8386-1633ff95e95b tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:56.508491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bf756c6-21cf-4dd1-8386-1633ff95e95b tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:56.509742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bf756c6-21cf-4dd1-8386-1633ff95e95b tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:56.510203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bf756c6-21cf-4dd1-8386-1633ff95e95b tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:57.901173 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1bf756c6-21cf-4dd1-8386-1633ff95e95b tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1833 microversion: 2.1 time: 2.112481 Jul 20 04:45:57.902869 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2617/5479] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:55 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1833 bytes in 2116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:57.930086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5fbbdace-48f3-4d9a-9754-de31babf58e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:57.943407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1cf9484f-29c9-4e74-b0eb-d58fb6db3a72 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:57.945285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1cf9484f-29c9-4e74-b0eb-d58fb6db3a72 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:57.960451 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5fbbdace-48f3-4d9a-9754-de31babf58e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1342 microversion: 2.1 time: 2.006060 Jul 20 04:45:57.979459 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2863/5480] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:55 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1342 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:58.010175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cf9484f-29c9-4e74-b0eb-d58fb6db3a72 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:58.016386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cf9484f-29c9-4e74-b0eb-d58fb6db3a72 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:58.021515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8a0915c5-9cc3-40f4-9eb7-e0d032c03407 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:58.024302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cf9484f-29c9-4e74-b0eb-d58fb6db3a72 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:58.025880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8a0915c5-9cc3-40f4-9eb7-e0d032c03407 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:58.027021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1cf9484f-29c9-4e74-b0eb-d58fb6db3a72 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:58.073593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a0915c5-9cc3-40f4-9eb7-e0d032c03407 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:58.079026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a0915c5-9cc3-40f4-9eb7-e0d032c03407 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:58.082507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a0915c5-9cc3-40f4-9eb7-e0d032c03407 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:58.082968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a0915c5-9cc3-40f4-9eb7-e0d032c03407 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:58.602978 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1cf9484f-29c9-4e74-b0eb-d58fb6db3a72 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1415 microversion: 2.1 time: 0.698301 Jul 20 04:45:58.603749 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2618/5481] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:57 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1415 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:58.614578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fda42359-b624-4000-8c7d-13d7d19f3d9d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:58.624673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fda42359-b624-4000-8c7d-13d7d19f3d9d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:58.686068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fda42359-b624-4000-8c7d-13d7d19f3d9d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:58.687146 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fda42359-b624-4000-8c7d-13d7d19f3d9d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:58.689791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fda42359-b624-4000-8c7d-13d7d19f3d9d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:58.692863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fda42359-b624-4000-8c7d-13d7d19f3d9d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:59.429276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8a0915c5-9cc3-40f4-9eb7-e0d032c03407 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:59.446658 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8a0915c5-9cc3-40f4-9eb7-e0d032c03407 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab" status: 200 len: 1293 microversion: 2.1 time: 1.458976 Jul 20 04:45:59.447576 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2864/5482] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:57 2022] GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab => generated 1293 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:59.455495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-5674ebc8-5661-4f16-a7ee-251d32adf189 req-ebdd85c2-229f-493c-99e1-91664b113d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3333b1e8-7653-4bc2-a218-7a8521a338cf", "tag": "f0786273-0f1f-49de-86fb-2b745295ba8b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:59.470370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5674ebc8-5661-4f16-a7ee-251d32adf189 req-ebdd85c2-229f-493c-99e1-91664b113d02 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:59.471663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5674ebc8-5661-4f16-a7ee-251d32adf189 req-ebdd85c2-229f-493c-99e1-91664b113d02 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:59.511565 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-5674ebc8-5661-4f16-a7ee-251d32adf189 req-ebdd85c2-229f-493c-99e1-91664b113d02 service nova] Creating event network-changed:f0786273-0f1f-49de-86fb-2b745295ba8b for instance 3333b1e8-7653-4bc2-a218-7a8521a338cf on n-h2-826526-5 Jul 20 04:45:59.521252 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-5674ebc8-5661-4f16-a7ee-251d32adf189 req-ebdd85c2-229f-493c-99e1-91664b113d02 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071161 Jul 20 04:45:59.522637 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2865/5483] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:59.548106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-82fa74da-7d7d-43cc-9c9a-17c783a8c5e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:59.549515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-82fa74da-7d7d-43cc-9c9a-17c783a8c5e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:59.563047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82fa74da-7d7d-43cc-9c9a-17c783a8c5e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:59.563972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82fa74da-7d7d-43cc-9c9a-17c783a8c5e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:59.565522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82fa74da-7d7d-43cc-9c9a-17c783a8c5e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:59.566432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82fa74da-7d7d-43cc-9c9a-17c783a8c5e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:59.961634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fda42359-b624-4000-8c7d-13d7d19f3d9d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:59.980650 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fda42359-b624-4000-8c7d-13d7d19f3d9d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1364 microversion: 2.1 time: 1.373558 Jul 20 04:45:59.994923 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2619/5484] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:58 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1364 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:00.002789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cade8c1e-a494-4b36-b843-35d4335bc198 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:00.004547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cade8c1e-a494-4b36-b843-35d4335bc198 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:00.014367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cade8c1e-a494-4b36-b843-35d4335bc198 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:00.015731 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cade8c1e-a494-4b36-b843-35d4335bc198 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:00.017335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cade8c1e-a494-4b36-b843-35d4335bc198 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:00.018171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cade8c1e-a494-4b36-b843-35d4335bc198 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:00.176613 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cade8c1e-a494-4b36-b843-35d4335bc198 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1421 microversion: 2.1 time: 0.179631 Jul 20 04:46:00.177545 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2620/5485] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:59 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1421 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:00.467657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e55e7fb3-6a53-4252-ab35-22fd26c088a2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:00.468635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e55e7fb3-6a53-4252-ab35-22fd26c088a2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:00.478489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e55e7fb3-6a53-4252-ab35-22fd26c088a2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:00.479316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e55e7fb3-6a53-4252-ab35-22fd26c088a2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:00.480309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e55e7fb3-6a53-4252-ab35-22fd26c088a2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:00.481163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e55e7fb3-6a53-4252-ab35-22fd26c088a2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:00.500778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-82fa74da-7d7d-43cc-9c9a-17c783a8c5e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:00.509718 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-82fa74da-7d7d-43cc-9c9a-17c783a8c5e3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1376 microversion: 2.1 time: 0.982536 Jul 20 04:46:00.514236 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2866/5486] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:59 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1376 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:00.929020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e55e7fb3-6a53-4252-ab35-22fd26c088a2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:00.940587 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e55e7fb3-6a53-4252-ab35-22fd26c088a2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab" status: 200 len: 1293 microversion: 2.1 time: 0.479122 Jul 20 04:46:00.942465 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2621/5487] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:00 2022] GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab => generated 1293 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:01.003320 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f420ba13-b72b-4ee2-8516-784065565153 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:01.005045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f420ba13-b72b-4ee2-8516-784065565153 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:01.016216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f420ba13-b72b-4ee2-8516-784065565153 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:01.017708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f420ba13-b72b-4ee2-8516-784065565153 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:01.019308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f420ba13-b72b-4ee2-8516-784065565153 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:01.020248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f420ba13-b72b-4ee2-8516-784065565153 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:01.194190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3aef5088-581b-42ac-aadc-78542938bf81 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:01.195642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3aef5088-581b-42ac-aadc-78542938bf81 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:01.207567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3aef5088-581b-42ac-aadc-78542938bf81 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:01.208696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3aef5088-581b-42ac-aadc-78542938bf81 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:01.209774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3aef5088-581b-42ac-aadc-78542938bf81 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:01.210743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3aef5088-581b-42ac-aadc-78542938bf81 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:01.461024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f420ba13-b72b-4ee2-8516-784065565153 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:01.471904 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f420ba13-b72b-4ee2-8516-784065565153 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1364 microversion: 2.1 time: 0.474797 Jul 20 04:46:01.488136 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2867/5488] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:00 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1364 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:01.531898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dcc382e3-8e4c-494d-a235-d541e718de8d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:01.532681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dcc382e3-8e4c-494d-a235-d541e718de8d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:01.542682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcc382e3-8e4c-494d-a235-d541e718de8d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:01.543324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcc382e3-8e4c-494d-a235-d541e718de8d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:01.544581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcc382e3-8e4c-494d-a235-d541e718de8d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:01.545522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcc382e3-8e4c-494d-a235-d541e718de8d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:01.837207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dcc382e3-8e4c-494d-a235-d541e718de8d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:01.851615 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dcc382e3-8e4c-494d-a235-d541e718de8d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1376 microversion: 2.1 time: 0.324260 Jul 20 04:46:01.864109 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2868/5489] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:01 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1376 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:01.869168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dcf7d649-74c2-468f-bf43-0b559aa82322 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:01.869912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dcf7d649-74c2-468f-bf43-0b559aa82322 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:01.877212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcf7d649-74c2-468f-bf43-0b559aa82322 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:01.878919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcf7d649-74c2-468f-bf43-0b559aa82322 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:01.880005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcf7d649-74c2-468f-bf43-0b559aa82322 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:01.881051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcf7d649-74c2-468f-bf43-0b559aa82322 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:01.913389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dcf7d649-74c2-468f-bf43-0b559aa82322 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:46:01.978106 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3aef5088-581b-42ac-aadc-78542938bf81 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1463 microversion: 2.1 time: 0.787802 Jul 20 04:46:01.992912 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2622/5490] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:01 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1463 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:02.001420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-ad049006-7076-422c-83f7-d3cd7458153e req-7bf15660-1f98-4404-a0c7-50f38f881b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69b8042-1e5c-4ea4-9c05-3623cb12ad85", "tag": "250e1005-0706-457b-aa98-bde024a78797"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:02.012909 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ad049006-7076-422c-83f7-d3cd7458153e req-7bf15660-1f98-4404-a0c7-50f38f881b3e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:02.014012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ad049006-7076-422c-83f7-d3cd7458153e req-7bf15660-1f98-4404-a0c7-50f38f881b3e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:02.037467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:02.043753 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-ad049006-7076-422c-83f7-d3cd7458153e req-7bf15660-1f98-4404-a0c7-50f38f881b3e service nova] Creating event network-changed:250e1005-0706-457b-aa98-bde024a78797 for instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 on n-h2-826526-5 Jul 20 04:46:02.058261 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-ad049006-7076-422c-83f7-d3cd7458153e req-7bf15660-1f98-4404-a0c7-50f38f881b3e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063262 Jul 20 04:46:02.062555 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dcf7d649-74c2-468f-bf43-0b559aa82322 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 204 len: 0 microversion: 2.1 time: 0.196797 Jul 20 04:46:02.063049 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2869/5492] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:46:01 2022] DELETE /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:46:02.063400 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2623/5492] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:02.071009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-815dd87e-6ac1-4928-9fac-503b4b9d1b4b req-e21f20c9-8cc6-4356-8766-364a0fc74d2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dae3d96c-7588-4c6e-b197-7190865618ab", "tag": "7d93cd36-4317-44e6-a3cc-d2a5a9b8f2ae"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:02.075338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-00b40872-565f-4d11-ba41-9de8bc97e8cf tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:02.080120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-00b40872-565f-4d11-ba41-9de8bc97e8cf tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:02.089958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00b40872-565f-4d11-ba41-9de8bc97e8cf tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:02.093537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-815dd87e-6ac1-4928-9fac-503b4b9d1b4b req-e21f20c9-8cc6-4356-8766-364a0fc74d2e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:02.094511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00b40872-565f-4d11-ba41-9de8bc97e8cf tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:02.095351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00b40872-565f-4d11-ba41-9de8bc97e8cf tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:02.095798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00b40872-565f-4d11-ba41-9de8bc97e8cf tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:02.101737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-815dd87e-6ac1-4928-9fac-503b4b9d1b4b req-e21f20c9-8cc6-4356-8766-364a0fc74d2e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:02.127149 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-815dd87e-6ac1-4928-9fac-503b4b9d1b4b req-e21f20c9-8cc6-4356-8766-364a0fc74d2e service nova] Creating event network-changed:7d93cd36-4317-44e6-a3cc-d2a5a9b8f2ae for instance dae3d96c-7588-4c6e-b197-7190865618ab on n-h1-826526-5 Jul 20 04:46:02.140114 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-815dd87e-6ac1-4928-9fac-503b4b9d1b4b req-e21f20c9-8cc6-4356-8766-364a0fc74d2e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074857 Jul 20 04:46:02.144021 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2624/5493] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:02.155561 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-07edffca-a78a-4a8f-9373-065da0efda6c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:02.156304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-07edffca-a78a-4a8f-9373-065da0efda6c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:02.164398 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07edffca-a78a-4a8f-9373-065da0efda6c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:02.165123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07edffca-a78a-4a8f-9373-065da0efda6c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:02.166246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07edffca-a78a-4a8f-9373-065da0efda6c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:02.166957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07edffca-a78a-4a8f-9373-065da0efda6c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:02.317011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-00b40872-565f-4d11-ba41-9de8bc97e8cf tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:02.327293 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-00b40872-565f-4d11-ba41-9de8bc97e8cf tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab" status: 200 len: 1293 microversion: 2.1 time: 0.259516 Jul 20 04:46:02.337706 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2870/5494] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:02 2022] GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab => generated 1293 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:02.500395 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bab80b1f-1cd4-42d9-b330-b4008ed90024 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:02.501806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bab80b1f-1cd4-42d9-b330-b4008ed90024 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:02.516322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bab80b1f-1cd4-42d9-b330-b4008ed90024 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:02.517043 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bab80b1f-1cd4-42d9-b330-b4008ed90024 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:02.517918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bab80b1f-1cd4-42d9-b330-b4008ed90024 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:02.518451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bab80b1f-1cd4-42d9-b330-b4008ed90024 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:02.645055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-07edffca-a78a-4a8f-9373-065da0efda6c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:02.656964 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-07edffca-a78a-4a8f-9373-065da0efda6c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1688 microversion: 2.1 time: 0.509031 Jul 20 04:46:02.657581 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2625/5495] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:02 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1688 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:02.731524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bab80b1f-1cd4-42d9-b330-b4008ed90024 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:02.744255 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bab80b1f-1cd4-42d9-b330-b4008ed90024 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1364 microversion: 2.1 time: 0.251271 Jul 20 04:46:02.755110 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2871/5496] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:02 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1364 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:02.872523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a41eb10f-b88f-4d33-933f-5f83d4c9ec4f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:02.876311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a41eb10f-b88f-4d33-933f-5f83d4c9ec4f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:02.886631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a41eb10f-b88f-4d33-933f-5f83d4c9ec4f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:02.887098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a41eb10f-b88f-4d33-933f-5f83d4c9ec4f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:02.887884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a41eb10f-b88f-4d33-933f-5f83d4c9ec4f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:02.888548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a41eb10f-b88f-4d33-933f-5f83d4c9ec4f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:03.007298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5965c3c7-df7d-4c4d-9b73-84185a3687ad tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:03.007948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5965c3c7-df7d-4c4d-9b73-84185a3687ad tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:03.026964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5965c3c7-df7d-4c4d-9b73-84185a3687ad tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:03.027974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5965c3c7-df7d-4c4d-9b73-84185a3687ad tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:03.028999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5965c3c7-df7d-4c4d-9b73-84185a3687ad tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:03.030217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5965c3c7-df7d-4c4d-9b73-84185a3687ad tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:03.349276 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5965c3c7-df7d-4c4d-9b73-84185a3687ad tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1463 microversion: 2.1 time: 0.345764 Jul 20 04:46:03.354878 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2872/5497] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:03 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1463 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:03.364349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-26a96976-cdf7-47eb-b92b-b226cc19fc36 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:03.365264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-26a96976-cdf7-47eb-b92b-b226cc19fc36 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:03.378788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26a96976-cdf7-47eb-b92b-b226cc19fc36 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:03.379982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26a96976-cdf7-47eb-b92b-b226cc19fc36 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:03.381540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26a96976-cdf7-47eb-b92b-b226cc19fc36 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:03.382194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26a96976-cdf7-47eb-b92b-b226cc19fc36 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:03.386254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:03.838796 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-26a96976-cdf7-47eb-b92b-b226cc19fc36 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:03.860583 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-26a96976-cdf7-47eb-b92b-b226cc19fc36 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab" status: 200 len: 1293 microversion: 2.1 time: 0.504019 Jul 20 04:46:03.861692 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2873/5498] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:03 2022] GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab => generated 1293 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:03.869084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4e9f6943-b94b-4bd6-9166-199ecd1673d8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:03.869696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4e9f6943-b94b-4bd6-9166-199ecd1673d8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:03.880786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e9f6943-b94b-4bd6-9166-199ecd1673d8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:03.881708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e9f6943-b94b-4bd6-9166-199ecd1673d8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:03.885084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e9f6943-b94b-4bd6-9166-199ecd1673d8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:03.886260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e9f6943-b94b-4bd6-9166-199ecd1673d8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:04.502151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a41eb10f-b88f-4d33-933f-5f83d4c9ec4f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:04.515172 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a41eb10f-b88f-4d33-933f-5f83d4c9ec4f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1376 microversion: 2.1 time: 1.647546 Jul 20 04:46:04.534946 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2626/5499] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:02 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1376 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:04.546816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-57171493-21e0-4e4f-8170-1b2f2afa41d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:04.548606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-57171493-21e0-4e4f-8170-1b2f2afa41d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:04.565454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57171493-21e0-4e4f-8170-1b2f2afa41d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:04.568870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57171493-21e0-4e4f-8170-1b2f2afa41d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:04.570596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57171493-21e0-4e4f-8170-1b2f2afa41d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:04.571245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57171493-21e0-4e4f-8170-1b2f2afa41d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:04.606558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4e9f6943-b94b-4bd6-9166-199ecd1673d8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:04.639117 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4e9f6943-b94b-4bd6-9166-199ecd1673d8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 200 len: 1688 microversion: 2.1 time: 0.776052 Jul 20 04:46:04.643660 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2874/5500] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:03 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 1688 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:04.658996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7823f29a-7a25-4549-be8e-7047aee55177 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:04.660101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7823f29a-7a25-4549-be8e-7047aee55177 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:04.677522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7823f29a-7a25-4549-be8e-7047aee55177 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:04.678212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7823f29a-7a25-4549-be8e-7047aee55177 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:04.679191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7823f29a-7a25-4549-be8e-7047aee55177 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:04.682389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7823f29a-7a25-4549-be8e-7047aee55177 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:04.954426 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7823f29a-7a25-4549-be8e-7047aee55177 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1463 microversion: 2.1 time: 0.299412 Jul 20 04:46:04.955109 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2875/5501] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:04 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1463 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:04.966840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-bb9df070-59ed-4d0d-bbac-8e8f4a7cd52b req-d4185f7c-ac07-428d-9863-9ff0c73e4a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69b8042-1e5c-4ea4-9c05-3623cb12ad85", "name": "network-vif-deleted", "tag": "250e1005-0706-457b-aa98-bde024a78797"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:04.978905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bb9df070-59ed-4d0d-bbac-8e8f4a7cd52b req-d4185f7c-ac07-428d-9863-9ff0c73e4a10 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:04.979755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bb9df070-59ed-4d0d-bbac-8e8f4a7cd52b req-d4185f7c-ac07-428d-9863-9ff0c73e4a10 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:05.000975 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-bb9df070-59ed-4d0d-bbac-8e8f4a7cd52b req-d4185f7c-ac07-428d-9863-9ff0c73e4a10 service nova] Creating event network-vif-deleted:250e1005-0706-457b-aa98-bde024a78797 for instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 on n-h2-826526-5 Jul 20 04:46:05.009067 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-bb9df070-59ed-4d0d-bbac-8e8f4a7cd52b req-d4185f7c-ac07-428d-9863-9ff0c73e4a10 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052484 Jul 20 04:46:05.009612 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2876/5502] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:05.020879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cbcff672-2b1e-4dc5-8093-8e46bd8f8c12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:05.021595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cbcff672-2b1e-4dc5-8093-8e46bd8f8c12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:05.042528 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cbcff672-2b1e-4dc5-8093-8e46bd8f8c12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:05.043042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cbcff672-2b1e-4dc5-8093-8e46bd8f8c12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:05.043968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cbcff672-2b1e-4dc5-8093-8e46bd8f8c12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:05.047884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cbcff672-2b1e-4dc5-8093-8e46bd8f8c12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:05.366592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cbcff672-2b1e-4dc5-8093-8e46bd8f8c12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:05.377157 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cbcff672-2b1e-4dc5-8093-8e46bd8f8c12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab" status: 200 len: 1293 microversion: 2.1 time: 0.366253 Jul 20 04:46:05.378559 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2877/5503] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:05 2022] GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab => generated 1293 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:05.507919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:05.546921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2c612355-33d5-495d-be65-b895ad8bbb94 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:05.550223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2c612355-33d5-495d-be65-b895ad8bbb94 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:05.563200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c612355-33d5-495d-be65-b895ad8bbb94 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:05.564011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c612355-33d5-495d-be65-b895ad8bbb94 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:05.565072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c612355-33d5-495d-be65-b895ad8bbb94 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:05.565714 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c612355-33d5-495d-be65-b895ad8bbb94 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:05.583571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=14 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:05.656034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-57171493-21e0-4e4f-8170-1b2f2afa41d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:05.665247 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-57171493-21e0-4e4f-8170-1b2f2afa41d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1364 microversion: 2.1 time: 1.128360 Jul 20 04:46:05.669305 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2627/5504] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:04 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1364 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:05.681365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3ec4443d-2eca-4fcf-8b5b-393be229ae72 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:05.684584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3ec4443d-2eca-4fcf-8b5b-393be229ae72 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: d69b8042-1e5c-4ea4-9c05-3623cb12ad85] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:05.691196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:05.704244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ec4443d-2eca-4fcf-8b5b-393be229ae72 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:05.707882 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ec4443d-2eca-4fcf-8b5b-393be229ae72 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:05.709064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ec4443d-2eca-4fcf-8b5b-393be229ae72 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:05.709800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ec4443d-2eca-4fcf-8b5b-393be229ae72 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:05.750869 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-3ec4443d-2eca-4fcf-8b5b-393be229ae72 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] HTTP exception thrown: Instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 could not be found. Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3ec4443d-2eca-4fcf-8b5b-393be229ae72 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Request method failure captured: Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 HTTP/1.1 Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14c5OmC7e7piHc62Oprmt58gJ43Ds2Gqro50k_jodCbcdTngwgD8D9bbOTQvC3Ba8WRVQD5lFU65LIKPn-I3EI2C2ZihLQJYKiEb4d5a-fdETDJHV4IJmro-RJ_S60NX-1yKHowzAlku6MRitdI9SUmpfigUaUfx-6x70eCIR240NVE Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: a678d19d82d248958a3d7df804ccfa95 Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-574298032 Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a678d19d82d248958a3d7df804ccfa95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a678d19d82d248958a3d7df804ccfa95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a678d19d82d248958a3d7df804ccfa95", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a678d19d82d248958a3d7df804ccfa95"}]}] Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestNetworkAdvancedServerOps-574298032 Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: a678d19d82d248958a3d7df804ccfa95 Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-574298032 Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestNetworkAdvancedServerOps-574298032-project Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: cffe347e0a094346afd74f178a0fde5d Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestNetworkAdvancedServerOps-574298032-project Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 could not be found. Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'd69b8042-1e5c-4ea4-9c05-3623cb12ad85'} Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 could not be found. Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 could not be found. Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:05.760443 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:05.772756 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:05.772756 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:05.772756 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:05.772756 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:05.772756 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:05.772756 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 could not be found. Jul 20 04:46:05.772756 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:05.775716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3ec4443d-2eca-4fcf-8b5b-393be229ae72 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Returning 404 to user: Instance d69b8042-1e5c-4ea4-9c05-3623cb12ad85 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:05.777447 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3ec4443d-2eca-4fcf-8b5b-393be229ae72 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85" status: 404 len: 111 microversion: 2.1 time: 0.106363 Jul 20 04:46:05.782073 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2628/5505] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:05 2022] GET /compute/v2.1/servers/d69b8042-1e5c-4ea4-9c05-3623cb12ad85 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:46:05.945882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2c612355-33d5-495d-be65-b895ad8bbb94 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:05.971790 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2c612355-33d5-495d-be65-b895ad8bbb94 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1376 microversion: 2.1 time: 0.431796 Jul 20 04:46:05.973949 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2878/5506] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:05 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1376 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:05.985406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3e5c3f07-091e-496b-8892-2d48d9ca4359 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:05.986116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3e5c3f07-091e-496b-8892-2d48d9ca4359 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:06.025781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e5c3f07-091e-496b-8892-2d48d9ca4359 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:06.026390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e5c3f07-091e-496b-8892-2d48d9ca4359 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:06.028517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e5c3f07-091e-496b-8892-2d48d9ca4359 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:06.031595 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e5c3f07-091e-496b-8892-2d48d9ca4359 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:06.071420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-8a057818-d6e0-460a-a3db-35c6fc9c41ec req-a18dd44e-444e-4ac1-8609-9587967c246d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87276588-6735-44b3-a99e-0ea3277b8985", "tag": "c7b0323b-e024-4e23-8f51-b67a51cea504"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:06.090084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8a057818-d6e0-460a-a3db-35c6fc9c41ec req-a18dd44e-444e-4ac1-8609-9587967c246d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:06.090867 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8a057818-d6e0-460a-a3db-35c6fc9c41ec req-a18dd44e-444e-4ac1-8609-9587967c246d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:06.119785 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-8a057818-d6e0-460a-a3db-35c6fc9c41ec req-a18dd44e-444e-4ac1-8609-9587967c246d service nova] Creating event network-changed:c7b0323b-e024-4e23-8f51-b67a51cea504 for instance 87276588-6735-44b3-a99e-0ea3277b8985 on n-h1-826526-5 Jul 20 04:46:06.142026 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-8a057818-d6e0-460a-a3db-35c6fc9c41ec req-a18dd44e-444e-4ac1-8609-9587967c246d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074643 Jul 20 04:46:06.143708 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2879/5507] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:06.396323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f9a73880-c29a-430e-85d0-d01c51f46388 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:06.397521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f9a73880-c29a-430e-85d0-d01c51f46388 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:06.411900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9a73880-c29a-430e-85d0-d01c51f46388 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:06.412390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9a73880-c29a-430e-85d0-d01c51f46388 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:06.413182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9a73880-c29a-430e-85d0-d01c51f46388 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:06.413624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f9a73880-c29a-430e-85d0-d01c51f46388 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:06.631063 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3e5c3f07-091e-496b-8892-2d48d9ca4359 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1463 microversion: 2.1 time: 0.662745 Jul 20 04:46:06.642160 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2629/5508] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:05 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1463 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:06.714964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-feb0bc19-a43d-4688-aafc-b41a09883679 req-9665b5bd-18d8-477e-9d7b-27116e876daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dae3d96c-7588-4c6e-b197-7190865618ab", "name": "network-vif-plugged", "status": "completed", "tag": "7d93cd36-4317-44e6-a3cc-d2a5a9b8f2ae"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:06.724765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-feb0bc19-a43d-4688-aafc-b41a09883679 req-9665b5bd-18d8-477e-9d7b-27116e876daa service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:06.725525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-feb0bc19-a43d-4688-aafc-b41a09883679 req-9665b5bd-18d8-477e-9d7b-27116e876daa service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:06.750169 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-feb0bc19-a43d-4688-aafc-b41a09883679 req-9665b5bd-18d8-477e-9d7b-27116e876daa service nova] Creating event network-vif-plugged:7d93cd36-4317-44e6-a3cc-d2a5a9b8f2ae for instance dae3d96c-7588-4c6e-b197-7190865618ab on n-h1-826526-5 Jul 20 04:46:06.757045 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-feb0bc19-a43d-4688-aafc-b41a09883679 req-9665b5bd-18d8-477e-9d7b-27116e876daa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112564 Jul 20 04:46:06.758432 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2630/5509] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:06.764760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d35da511-469b-4560-8f42-ead3d356b355 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:06.765756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d35da511-469b-4560-8f42-ead3d356b355 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:06.775252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d35da511-469b-4560-8f42-ead3d356b355 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:06.776616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d35da511-469b-4560-8f42-ead3d356b355 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:06.777864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d35da511-469b-4560-8f42-ead3d356b355 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:06.778717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d35da511-469b-4560-8f42-ead3d356b355 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:06.827811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f9a73880-c29a-430e-85d0-d01c51f46388 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:06.837222 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f9a73880-c29a-430e-85d0-d01c51f46388 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab" status: 200 len: 1293 microversion: 2.1 time: 0.445429 Jul 20 04:46:06.838555 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2880/5510] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:06 2022] GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab => generated 1293 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:06.992367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b12b4670-7107-452a-afcb-11fc20af99a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:06.993403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b12b4670-7107-452a-afcb-11fc20af99a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:06.999878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b12b4670-7107-452a-afcb-11fc20af99a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:07.005250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b12b4670-7107-452a-afcb-11fc20af99a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:07.006389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b12b4670-7107-452a-afcb-11fc20af99a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:07.007040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b12b4670-7107-452a-afcb-11fc20af99a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:07.252253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b12b4670-7107-452a-afcb-11fc20af99a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:07.264755 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b12b4670-7107-452a-afcb-11fc20af99a7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1376 microversion: 2.1 time: 0.276280 Jul 20 04:46:07.265983 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2881/5511] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:06 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1376 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:07.653165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d35da511-469b-4560-8f42-ead3d356b355 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:07.660937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-29f151c8-1ca9-49e3-9c0a-5bdd3e16f3e5 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:07.662069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-29f151c8-1ca9-49e3-9c0a-5bdd3e16f3e5 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:07.674825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29f151c8-1ca9-49e3-9c0a-5bdd3e16f3e5 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:07.675269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29f151c8-1ca9-49e3-9c0a-5bdd3e16f3e5 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:07.676069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29f151c8-1ca9-49e3-9c0a-5bdd3e16f3e5 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:07.676534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29f151c8-1ca9-49e3-9c0a-5bdd3e16f3e5 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:07.683737 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d35da511-469b-4560-8f42-ead3d356b355 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1364 microversion: 2.1 time: 0.923797 Jul 20 04:46:07.684358 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2631/5512] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:06 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1364 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:07.857081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7ebdb4bd-2e86-4211-9e51-7b2a81335e25 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:07.858084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7ebdb4bd-2e86-4211-9e51-7b2a81335e25 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:07.873840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ebdb4bd-2e86-4211-9e51-7b2a81335e25 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:07.878696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ebdb4bd-2e86-4211-9e51-7b2a81335e25 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:07.879717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ebdb4bd-2e86-4211-9e51-7b2a81335e25 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:07.880498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ebdb4bd-2e86-4211-9e51-7b2a81335e25 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:08.044435 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-29f151c8-1ca9-49e3-9c0a-5bdd3e16f3e5 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1463 microversion: 2.1 time: 0.395167 Jul 20 04:46:08.046139 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2882/5513] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:07 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1463 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:08.262539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7ebdb4bd-2e86-4211-9e51-7b2a81335e25 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:08.272015 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7ebdb4bd-2e86-4211-9e51-7b2a81335e25 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab" status: 200 len: 1293 microversion: 2.1 time: 0.420956 Jul 20 04:46:08.288599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-30f9da6f-390a-4648-b6e1-5455d979100d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:08.289691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-30f9da6f-390a-4648-b6e1-5455d979100d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:08.293609 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2632/5514] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:07 2022] GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab => generated 1293 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:08.298123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30f9da6f-390a-4648-b6e1-5455d979100d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:08.298793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30f9da6f-390a-4648-b6e1-5455d979100d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:08.299784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30f9da6f-390a-4648-b6e1-5455d979100d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:08.300463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30f9da6f-390a-4648-b6e1-5455d979100d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:08.553006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-30f9da6f-390a-4648-b6e1-5455d979100d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:08.570394 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-30f9da6f-390a-4648-b6e1-5455d979100d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1376 microversion: 2.1 time: 0.285923 Jul 20 04:46:08.572786 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2883/5515] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:08 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1376 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:08.705637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f9a6ec5d-b86a-4eeb-b2f7-52f9280f287d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:08.706919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f9a6ec5d-b86a-4eeb-b2f7-52f9280f287d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:08.713799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9a6ec5d-b86a-4eeb-b2f7-52f9280f287d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:08.714611 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9a6ec5d-b86a-4eeb-b2f7-52f9280f287d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:08.715556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9a6ec5d-b86a-4eeb-b2f7-52f9280f287d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:08.716192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9a6ec5d-b86a-4eeb-b2f7-52f9280f287d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:08.791166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-aed5baba-157d-4eaf-bfdf-29b3536f32cf req-f87ab882-6483-4857-83a9-2b572a13ebf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3333b1e8-7653-4bc2-a218-7a8521a338cf", "name": "network-vif-plugged", "status": "completed", "tag": "f0786273-0f1f-49de-86fb-2b745295ba8b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:08.805373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-aed5baba-157d-4eaf-bfdf-29b3536f32cf req-f87ab882-6483-4857-83a9-2b572a13ebf6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:08.806120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-aed5baba-157d-4eaf-bfdf-29b3536f32cf req-f87ab882-6483-4857-83a9-2b572a13ebf6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:08.819593 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-aed5baba-157d-4eaf-bfdf-29b3536f32cf req-f87ab882-6483-4857-83a9-2b572a13ebf6 service nova] Creating event network-vif-plugged:f0786273-0f1f-49de-86fb-2b745295ba8b for instance 3333b1e8-7653-4bc2-a218-7a8521a338cf on n-h2-826526-5 Jul 20 04:46:08.826246 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-aed5baba-157d-4eaf-bfdf-29b3536f32cf req-f87ab882-6483-4857-83a9-2b572a13ebf6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038828 Jul 20 04:46:08.827479 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2884/5516] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:09.033809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f9a6ec5d-b86a-4eeb-b2f7-52f9280f287d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:09.046292 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f9a6ec5d-b86a-4eeb-b2f7-52f9280f287d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1364 microversion: 2.1 time: 0.344519 Jul 20 04:46:09.047332 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2633/5517] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:08 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1364 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:09.064880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cfb47c5e-3211-46f8-913d-5336ffd35021 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:09.065595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cfb47c5e-3211-46f8-913d-5336ffd35021 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:09.075768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cfb47c5e-3211-46f8-913d-5336ffd35021 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:09.076269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cfb47c5e-3211-46f8-913d-5336ffd35021 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:09.077072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cfb47c5e-3211-46f8-913d-5336ffd35021 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:09.077515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cfb47c5e-3211-46f8-913d-5336ffd35021 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:09.290198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eef72bdb-d7fa-4ba7-86c8-44222f92cdd0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:09.291059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eef72bdb-d7fa-4ba7-86c8-44222f92cdd0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:09.304416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eef72bdb-d7fa-4ba7-86c8-44222f92cdd0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:09.304886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eef72bdb-d7fa-4ba7-86c8-44222f92cdd0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:09.307663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eef72bdb-d7fa-4ba7-86c8-44222f92cdd0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:09.309080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eef72bdb-d7fa-4ba7-86c8-44222f92cdd0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:09.642392 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cfb47c5e-3211-46f8-913d-5336ffd35021 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1463 microversion: 2.1 time: 0.581880 Jul 20 04:46:09.643601 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2885/5518] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:09 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1463 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:09.726006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2e5c7eb6-bb2a-4c3a-b5b8-a3651d77424b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1185075211", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:09.797497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eef72bdb-d7fa-4ba7-86c8-44222f92cdd0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:09.812488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-2e5c7eb6-bb2a-4c3a-b5b8-a3651d77424b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] validate_networks() for [('251a4e63-1968-40ea-8261-3caafe352db6', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:46:09.822283 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eef72bdb-d7fa-4ba7-86c8-44222f92cdd0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab" status: 200 len: 1293 microversion: 2.1 time: 0.535175 Jul 20 04:46:09.823150 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2634/5519] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:09 2022] GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab => generated 1293 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:09.828348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9c77830f-899c-45a0-973e-1e0483f68eb2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:09.829248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9c77830f-899c-45a0-973e-1e0483f68eb2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:09.836457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c77830f-899c-45a0-973e-1e0483f68eb2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:09.836931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c77830f-899c-45a0-973e-1e0483f68eb2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:09.837872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c77830f-899c-45a0-973e-1e0483f68eb2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:09.838328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c77830f-899c-45a0-973e-1e0483f68eb2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:10.088803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9c77830f-899c-45a0-973e-1e0483f68eb2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:10.101825 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9c77830f-899c-45a0-973e-1e0483f68eb2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1376 microversion: 2.1 time: 0.274495 Jul 20 04:46:10.105198 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2635/5520] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:09 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1376 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:10.137533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3141e45e-68fa-4b26-8ad8-4a11b14eea51 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:10.141544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3141e45e-68fa-4b26-8ad8-4a11b14eea51 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:10.154337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3141e45e-68fa-4b26-8ad8-4a11b14eea51 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:10.155101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3141e45e-68fa-4b26-8ad8-4a11b14eea51 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:10.156122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3141e45e-68fa-4b26-8ad8-4a11b14eea51 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:10.156813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3141e45e-68fa-4b26-8ad8-4a11b14eea51 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:10.714574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2e5c7eb6-bb2a-4c3a-b5b8-a3651d77424b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:46:10.715114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2e5c7eb6-bb2a-4c3a-b5b8-a3651d77424b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:46:10.715453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2e5c7eb6-bb2a-4c3a-b5b8-a3651d77424b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:46:10.716404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2e5c7eb6-bb2a-4c3a-b5b8-a3651d77424b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:46:10.717171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2e5c7eb6-bb2a-4c3a-b5b8-a3651d77424b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:46:10.755586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e5c7eb6-bb2a-4c3a-b5b8-a3651d77424b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:10.757004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e5c7eb6-bb2a-4c3a-b5b8-a3651d77424b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:10.759078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e5c7eb6-bb2a-4c3a-b5b8-a3651d77424b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:10.763594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e5c7eb6-bb2a-4c3a-b5b8-a3651d77424b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:10.825154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-2e5c7eb6-bb2a-4c3a-b5b8-a3651d77424b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Getting quotas for project 4c3cfeac44614a9888245f21ca0f3811. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:46:10.842593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-2e5c7eb6-bb2a-4c3a-b5b8-a3651d77424b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Getting quotas for user dd6f3db734dc4e0197653b83e0eb746a and project 4c3cfeac44614a9888245f21ca0f3811. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:46:10.886543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2e5c7eb6-bb2a-4c3a-b5b8-a3651d77424b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:46:10.891300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2e5c7eb6-bb2a-4c3a-b5b8-a3651d77424b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:46:11.034623 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2e5c7eb6-bb2a-4c3a-b5b8-a3651d77424b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.389802 Jul 20 04:46:11.038146 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2886/5521] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:46:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:46:11.066542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2e3a32ec-7362-4511-9865-0dc46a14432e tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:11.067217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2e3a32ec-7362-4511-9865-0dc46a14432e tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:11.103158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e3a32ec-7362-4511-9865-0dc46a14432e tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:11.107781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e3a32ec-7362-4511-9865-0dc46a14432e tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:11.108685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e3a32ec-7362-4511-9865-0dc46a14432e tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:11.109356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e3a32ec-7362-4511-9865-0dc46a14432e tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:11.528020 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2e3a32ec-7362-4511-9865-0dc46a14432e tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1463 microversion: 2.1 time: 0.487157 Jul 20 04:46:11.532307 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2887/5522] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:11 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1463 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:11.542397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ea230a78-5b35-4600-b405-e634d0edbde4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:11.544088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ea230a78-5b35-4600-b405-e634d0edbde4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:11.561780 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea230a78-5b35-4600-b405-e634d0edbde4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:11.564645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea230a78-5b35-4600-b405-e634d0edbde4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:11.570047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea230a78-5b35-4600-b405-e634d0edbde4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:11.572188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea230a78-5b35-4600-b405-e634d0edbde4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:11.702643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3141e45e-68fa-4b26-8ad8-4a11b14eea51 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:11.718008 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3141e45e-68fa-4b26-8ad8-4a11b14eea51 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1364 microversion: 2.1 time: 1.609457 Jul 20 04:46:11.721819 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2636/5523] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:10 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1364 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:11.735604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-60c36a97-89d9-4bdd-9fc9-13a12520b070 req-3f90959a-f595-4afc-851e-d677b17af29e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7252429e-bc8c-4074-bf46-54b6a7cecbf5", "name": "network-vif-plugged", "status": "completed", "tag": "164f2fc3-122f-4406-8e11-8f0e32836720"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:11.758004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-60c36a97-89d9-4bdd-9fc9-13a12520b070 req-3f90959a-f595-4afc-851e-d677b17af29e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:11.759411 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-60c36a97-89d9-4bdd-9fc9-13a12520b070 req-3f90959a-f595-4afc-851e-d677b17af29e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:11.791432 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-60c36a97-89d9-4bdd-9fc9-13a12520b070 req-3f90959a-f595-4afc-851e-d677b17af29e service nova] Creating event network-vif-plugged:164f2fc3-122f-4406-8e11-8f0e32836720 for instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 on n-h1-826526-5 Jul 20 04:46:11.805593 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-60c36a97-89d9-4bdd-9fc9-13a12520b070 req-3f90959a-f595-4afc-851e-d677b17af29e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080367 Jul 20 04:46:11.806839 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2637/5524] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:11.813494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d6d8fea3-de39-4a4c-bbe6-44058f25f974 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:11.815345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d6d8fea3-de39-4a4c-bbe6-44058f25f974 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:12.059894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d6d8fea3-de39-4a4c-bbe6-44058f25f974 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:12.067939 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d6d8fea3-de39-4a4c-bbe6-44058f25f974 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1217 microversion: 2.1 time: 0.258852 Jul 20 04:46:12.081984 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2638/5525] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:11 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1217 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:12.094952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e48cfe5a-dd8e-4b2a-9662-6e2c4c7861e5 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:12.097183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e48cfe5a-dd8e-4b2a-9662-6e2c4c7861e5 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:12.114277 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e48cfe5a-dd8e-4b2a-9662-6e2c4c7861e5 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:12.115936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e48cfe5a-dd8e-4b2a-9662-6e2c4c7861e5 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:12.117028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e48cfe5a-dd8e-4b2a-9662-6e2c4c7861e5 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:12.119333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e48cfe5a-dd8e-4b2a-9662-6e2c4c7861e5 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:12.307074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ea230a78-5b35-4600-b405-e634d0edbde4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:12.317611 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ea230a78-5b35-4600-b405-e634d0edbde4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab" status: 200 len: 1474 microversion: 2.1 time: 0.783464 Jul 20 04:46:12.329991 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2888/5526] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:11 2022] GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab => generated 1474 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:12.517323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3377d3e8-f7de-4d61-ad2e-b84f96f39f12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-872577294", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:12.594138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-3377d3e8-f7de-4d61-ad2e-b84f96f39f12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] validate_networks() for [('3d22ba6e-7662-4637-bb0f-d3084b1def5c', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:46:12.737304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e48cfe5a-dd8e-4b2a-9662-6e2c4c7861e5 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:12.746466 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e48cfe5a-dd8e-4b2a-9662-6e2c4c7861e5 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1376 microversion: 2.1 time: 0.662827 Jul 20 04:46:12.753521 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2639/5527] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:12 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1376 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:12.762254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8eafe32c-f3de-40e6-b805-e9000c2df762 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:12.769274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8eafe32c-f3de-40e6-b805-e9000c2df762 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:12.781837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8eafe32c-f3de-40e6-b805-e9000c2df762 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:12.785179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8eafe32c-f3de-40e6-b805-e9000c2df762 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:12.789313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8eafe32c-f3de-40e6-b805-e9000c2df762 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:12.791403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8eafe32c-f3de-40e6-b805-e9000c2df762 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:13.325722 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8eafe32c-f3de-40e6-b805-e9000c2df762 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1463 microversion: 2.1 time: 0.570727 Jul 20 04:46:13.337967 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2640/5528] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:12 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1463 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:13.352172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a7ffd735-fab3-4e9b-a1c0-84e255688d6f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:13.353227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a7ffd735-fab3-4e9b-a1c0-84e255688d6f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:13.363414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7ffd735-fab3-4e9b-a1c0-84e255688d6f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:13.364213 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7ffd735-fab3-4e9b-a1c0-84e255688d6f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:13.365260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7ffd735-fab3-4e9b-a1c0-84e255688d6f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:13.365920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7ffd735-fab3-4e9b-a1c0-84e255688d6f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:13.907411 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a7ffd735-fab3-4e9b-a1c0-84e255688d6f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:13.921916 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a7ffd735-fab3-4e9b-a1c0-84e255688d6f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1547 microversion: 2.1 time: 0.582666 Jul 20 04:46:13.925420 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2641/5529] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:13 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1547 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:13.939066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1bfe31bb-2b1b-4f5e-bddc-f2f196fc4a35 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:13.943790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1bfe31bb-2b1b-4f5e-bddc-f2f196fc4a35 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:13.962340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bfe31bb-2b1b-4f5e-bddc-f2f196fc4a35 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:13.964913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bfe31bb-2b1b-4f5e-bddc-f2f196fc4a35 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:13.967607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-3377d3e8-f7de-4d61-ad2e-b84f96f39f12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:46:13.968715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-3377d3e8-f7de-4d61-ad2e-b84f96f39f12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:46:13.969413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-3377d3e8-f7de-4d61-ad2e-b84f96f39f12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:46:13.970045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-3377d3e8-f7de-4d61-ad2e-b84f96f39f12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:46:13.970821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-3377d3e8-f7de-4d61-ad2e-b84f96f39f12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:46:13.971323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bfe31bb-2b1b-4f5e-bddc-f2f196fc4a35 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:13.972949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bfe31bb-2b1b-4f5e-bddc-f2f196fc4a35 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:13.986026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3377d3e8-f7de-4d61-ad2e-b84f96f39f12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:13.990797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3377d3e8-f7de-4d61-ad2e-b84f96f39f12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:13.991952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3377d3e8-f7de-4d61-ad2e-b84f96f39f12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:13.992664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3377d3e8-f7de-4d61-ad2e-b84f96f39f12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:14.013950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-3377d3e8-f7de-4d61-ad2e-b84f96f39f12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Getting quotas for project fc751c3978da4e05b6d7aab178723ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:46:14.019938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-3377d3e8-f7de-4d61-ad2e-b84f96f39f12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Getting quotas for user a5e17b2cb6654e4584b62ac8d08833f2 and project fc751c3978da4e05b6d7aab178723ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:46:14.024487 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:14.041785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3377d3e8-f7de-4d61-ad2e-b84f96f39f12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:46:14.046024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3377d3e8-f7de-4d61-ad2e-b84f96f39f12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: cf1c7826-cc0b-4418-9231-b00aa703b6d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:46:14.113271 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3377d3e8-f7de-4d61-ad2e-b84f96f39f12 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.601753 Jul 20 04:46:14.115279 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2889/5530] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:46:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:46:14.125172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9e1eb85e-75ba-4e3f-a5e9-b613e975670e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:14.126943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9e1eb85e-75ba-4e3f-a5e9-b613e975670e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:14.145153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e1eb85e-75ba-4e3f-a5e9-b613e975670e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:14.146532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e1eb85e-75ba-4e3f-a5e9-b613e975670e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:14.149547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e1eb85e-75ba-4e3f-a5e9-b613e975670e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:14.150465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e1eb85e-75ba-4e3f-a5e9-b613e975670e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:14.437550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1bfe31bb-2b1b-4f5e-bddc-f2f196fc4a35 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:14.460717 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1bfe31bb-2b1b-4f5e-bddc-f2f196fc4a35 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1275 microversion: 2.1 time: 0.532804 Jul 20 04:46:14.469604 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2642/5531] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:13 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1275 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:14.485294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a89a258e-ed2f-40fa-a6e6-d1ed2acf265b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:14.487381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a89a258e-ed2f-40fa-a6e6-d1ed2acf265b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:14.499043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a89a258e-ed2f-40fa-a6e6-d1ed2acf265b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:14.499731 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a89a258e-ed2f-40fa-a6e6-d1ed2acf265b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:14.500809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a89a258e-ed2f-40fa-a6e6-d1ed2acf265b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:14.501566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a89a258e-ed2f-40fa-a6e6-d1ed2acf265b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:14.510075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9e1eb85e-75ba-4e3f-a5e9-b613e975670e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:14.528011 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9e1eb85e-75ba-4e3f-a5e9-b613e975670e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1563 microversion: 2.1 time: 0.405950 Jul 20 04:46:14.529247 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2890/5532] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:14 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1563 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:14.541825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c2fa94b0-2371-4fe4-bce5-f2f126c4a517 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:14.544110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c2fa94b0-2371-4fe4-bce5-f2f126c4a517 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: cf1c7826-cc0b-4418-9231-b00aa703b6d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:14.584116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c2fa94b0-2371-4fe4-bce5-f2f126c4a517 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: cf1c7826-cc0b-4418-9231-b00aa703b6d1] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:46:14.875446 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a89a258e-ed2f-40fa-a6e6-d1ed2acf265b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.403283 Jul 20 04:46:14.882495 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2643/5533] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:46:14 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf/os-interface => generated 284 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:14.891868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8c4cd7dd-aab0-4c25-a07d-3be223daf3e4 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:14.895084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8c4cd7dd-aab0-4c25-a07d-3be223daf3e4 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:14.943568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c4cd7dd-aab0-4c25-a07d-3be223daf3e4 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:14.944638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c4cd7dd-aab0-4c25-a07d-3be223daf3e4 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:14.953689 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c4cd7dd-aab0-4c25-a07d-3be223daf3e4 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:14.955413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c4cd7dd-aab0-4c25-a07d-3be223daf3e4 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:15.040535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:15.125069 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.scheduler.client.report [None req-c2fa94b0-2371-4fe4-bce5-f2f126c4a517 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Deleted allocations for instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 Jul 20 04:46:15.133452 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.compute.api [None req-c2fa94b0-2371-4fe4-bce5-f2f126c4a517 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: cf1c7826-cc0b-4418-9231-b00aa703b6d1] Instance Mapping does not exist while attempting local delete cleanup. Jul 20 04:46:15.134742 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c2fa94b0-2371-4fe4-bce5-f2f126c4a517 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cf1c7826-cc0b-4418-9231-b00aa703b6d1" status: 204 len: 0 microversion: 2.1 time: 0.604244 Jul 20 04:46:15.137575 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2891/5534] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:46:14 2022] DELETE /compute/v2.1/servers/cf1c7826-cc0b-4418-9231-b00aa703b6d1 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:46:15.159122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e7e27dba-6cdd-4fa4-ba72-06c8bc47b12e req-6611da99-5665-44a3-9a3d-d2721c69487c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87276588-6735-44b3-a99e-0ea3277b8985", "name": "network-vif-plugged", "status": "completed", "tag": "c7b0323b-e024-4e23-8f51-b67a51cea504"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:15.174181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e7e27dba-6cdd-4fa4-ba72-06c8bc47b12e req-6611da99-5665-44a3-9a3d-d2721c69487c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:15.174888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e7e27dba-6cdd-4fa4-ba72-06c8bc47b12e req-6611da99-5665-44a3-9a3d-d2721c69487c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:15.190625 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e7e27dba-6cdd-4fa4-ba72-06c8bc47b12e req-6611da99-5665-44a3-9a3d-d2721c69487c service nova] Creating event network-vif-plugged:c7b0323b-e024-4e23-8f51-b67a51cea504 for instance 87276588-6735-44b3-a99e-0ea3277b8985 on n-h1-826526-5 Jul 20 04:46:15.202609 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e7e27dba-6cdd-4fa4-ba72-06c8bc47b12e req-6611da99-5665-44a3-9a3d-d2721c69487c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062073 Jul 20 04:46:15.203935 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2892/5535] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:15.211987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b748b5da-1a1a-4578-82dc-e29dd91f2651 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:15.213197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b748b5da-1a1a-4578-82dc-e29dd91f2651 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:15.222133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b748b5da-1a1a-4578-82dc-e29dd91f2651 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:15.222896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b748b5da-1a1a-4578-82dc-e29dd91f2651 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:15.223946 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b748b5da-1a1a-4578-82dc-e29dd91f2651 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:15.224634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b748b5da-1a1a-4578-82dc-e29dd91f2651 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:15.763034 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8c4cd7dd-aab0-4c25-a07d-3be223daf3e4 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1463 microversion: 2.1 time: 0.878584 Jul 20 04:46:15.764611 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2644/5536] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:14 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1463 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:15.780458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cc9a96eb-8bc4-4bad-967d-5ce959fbb759 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:15.781107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cc9a96eb-8bc4-4bad-967d-5ce959fbb759 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: cf1c7826-cc0b-4418-9231-b00aa703b6d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:15.800672 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-cc9a96eb-8bc4-4bad-967d-5ce959fbb759 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 could not be found. Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cc9a96eb-8bc4-4bad-967d-5ce959fbb759 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/cf1c7826-cc0b-4418-9231-b00aa703b6d1 HTTP/1.1 Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 could not be found. Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'cf1c7826-cc0b-4418-9231-b00aa703b6d1'} Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 could not be found. Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 could not be found. Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:15.803799 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:15.813403 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:15.813403 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:15.813403 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 could not be found. Jul 20 04:46:15.813403 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:15.813403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cc9a96eb-8bc4-4bad-967d-5ce959fbb759 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:15.813403 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cc9a96eb-8bc4-4bad-967d-5ce959fbb759 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/cf1c7826-cc0b-4418-9231-b00aa703b6d1" status: 404 len: 111 microversion: 2.1 time: 0.039170 Jul 20 04:46:15.818336 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2645/5537] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:15 2022] GET /compute/v2.1/servers/cf1c7826-cc0b-4418-9231-b00aa703b6d1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:46:15.822172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c7215bdd-d72b-4ac0-ae6e-7ece6faf9945 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:15.822808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c7215bdd-d72b-4ac0-ae6e-7ece6faf9945 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:15.832760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7215bdd-d72b-4ac0-ae6e-7ece6faf9945 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:15.833625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7215bdd-d72b-4ac0-ae6e-7ece6faf9945 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:15.835011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7215bdd-d72b-4ac0-ae6e-7ece6faf9945 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:15.835920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7215bdd-d72b-4ac0-ae6e-7ece6faf9945 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:15.863259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b748b5da-1a1a-4578-82dc-e29dd91f2651 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:15.884750 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b748b5da-1a1a-4578-82dc-e29dd91f2651 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1563 microversion: 2.1 time: 0.679082 Jul 20 04:46:15.886142 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2893/5538] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:15 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1563 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:15.891464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f997ad76-ca53-473a-b1a1-4dfb4200ad79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-188926804", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "3d22ba6e-7662-4637-bb0f-d3084b1def5c"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:16.013403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-f997ad76-ca53-473a-b1a1-4dfb4200ad79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] validate_networks() for [('3d22ba6e-7662-4637-bb0f-d3084b1def5c', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:46:16.080348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c7215bdd-d72b-4ac0-ae6e-7ece6faf9945 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:16.089463 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c7215bdd-d72b-4ac0-ae6e-7ece6faf9945 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1317 microversion: 2.1 time: 0.271501 Jul 20 04:46:16.090347 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2646/5539] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:15 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:16.095318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-be02c902-4c3b-47f4-bcbf-5f19553c1f13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:16.096361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-be02c902-4c3b-47f4-bcbf-5f19553c1f13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:16.102879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be02c902-4c3b-47f4-bcbf-5f19553c1f13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:16.103530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be02c902-4c3b-47f4-bcbf-5f19553c1f13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:16.104127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be02c902-4c3b-47f4-bcbf-5f19553c1f13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:16.104878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be02c902-4c3b-47f4-bcbf-5f19553c1f13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:16.135796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-be02c902-4c3b-47f4-bcbf-5f19553c1f13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:46:16.248817 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-be02c902-4c3b-47f4-bcbf-5f19553c1f13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 204 len: 0 microversion: 2.1 time: 0.155669 Jul 20 04:46:16.250245 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2647/5540] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:46:16 2022] DELETE /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:46:16.262342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a570c509-e149-4cf3-92ca-1fcd70b18b33 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:16.263890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a570c509-e149-4cf3-92ca-1fcd70b18b33 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:16.270630 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a570c509-e149-4cf3-92ca-1fcd70b18b33 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:16.271095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a570c509-e149-4cf3-92ca-1fcd70b18b33 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:16.271888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a570c509-e149-4cf3-92ca-1fcd70b18b33 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:16.272355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a570c509-e149-4cf3-92ca-1fcd70b18b33 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:16.466446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a570c509-e149-4cf3-92ca-1fcd70b18b33 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:16.483547 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a570c509-e149-4cf3-92ca-1fcd70b18b33 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1569 microversion: 2.1 time: 0.225280 Jul 20 04:46:16.485492 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2648/5541] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:16 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:16.788168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-16020710-0004-4cb9-a7d7-a1256260bb17 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:16.789544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-16020710-0004-4cb9-a7d7-a1256260bb17 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:16.799186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16020710-0004-4cb9-a7d7-a1256260bb17 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:16.799861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16020710-0004-4cb9-a7d7-a1256260bb17 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:16.801247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16020710-0004-4cb9-a7d7-a1256260bb17 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:16.802301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16020710-0004-4cb9-a7d7-a1256260bb17 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:16.982211 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-16020710-0004-4cb9-a7d7-a1256260bb17 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1463 microversion: 2.1 time: 0.202075 Jul 20 04:46:16.984091 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2649/5542] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:16 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1463 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:17.108236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-267ac968-ae9d-4780-9121-ea560bd5e562 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:17.109392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-267ac968-ae9d-4780-9121-ea560bd5e562 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:17.117542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-267ac968-ae9d-4780-9121-ea560bd5e562 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:17.118200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-267ac968-ae9d-4780-9121-ea560bd5e562 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:17.119298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-267ac968-ae9d-4780-9121-ea560bd5e562 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:17.119816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-267ac968-ae9d-4780-9121-ea560bd5e562 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:17.350176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-267ac968-ae9d-4780-9121-ea560bd5e562 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:17.358717 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-267ac968-ae9d-4780-9121-ea560bd5e562 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1317 microversion: 2.1 time: 0.254761 Jul 20 04:46:17.359314 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2650/5543] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:17 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:17.504115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-551aea98-cf12-4161-913b-99e2c1bb200c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:17.505117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-551aea98-cf12-4161-913b-99e2c1bb200c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:17.514193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-551aea98-cf12-4161-913b-99e2c1bb200c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:17.514999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-551aea98-cf12-4161-913b-99e2c1bb200c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:17.519190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-551aea98-cf12-4161-913b-99e2c1bb200c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:17.521819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-551aea98-cf12-4161-913b-99e2c1bb200c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:17.750824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-551aea98-cf12-4161-913b-99e2c1bb200c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:17.764847 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-551aea98-cf12-4161-913b-99e2c1bb200c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1569 microversion: 2.1 time: 0.266116 Jul 20 04:46:17.774422 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2651/5544] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:17 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1569 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:17.946329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f997ad76-ca53-473a-b1a1-4dfb4200ad79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:46:17.947625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f997ad76-ca53-473a-b1a1-4dfb4200ad79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:46:17.948108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f997ad76-ca53-473a-b1a1-4dfb4200ad79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:46:17.948872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f997ad76-ca53-473a-b1a1-4dfb4200ad79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:46:17.949254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f997ad76-ca53-473a-b1a1-4dfb4200ad79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:46:17.977586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f997ad76-ca53-473a-b1a1-4dfb4200ad79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:17.978510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f997ad76-ca53-473a-b1a1-4dfb4200ad79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:17.979475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f997ad76-ca53-473a-b1a1-4dfb4200ad79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:17.979951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f997ad76-ca53-473a-b1a1-4dfb4200ad79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:18.006178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-f997ad76-ca53-473a-b1a1-4dfb4200ad79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Getting quotas for project fc751c3978da4e05b6d7aab178723ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:46:18.013433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-f997ad76-ca53-473a-b1a1-4dfb4200ad79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Getting quotas for user a5e17b2cb6654e4584b62ac8d08833f2 and project fc751c3978da4e05b6d7aab178723ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:46:18.020083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-75a69d00-ff41-488f-844c-753eebe3bff6 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:18.021366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-75a69d00-ff41-488f-844c-753eebe3bff6 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:18.034175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75a69d00-ff41-488f-844c-753eebe3bff6 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:18.035087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75a69d00-ff41-488f-844c-753eebe3bff6 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:18.036072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75a69d00-ff41-488f-844c-753eebe3bff6 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:18.042501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75a69d00-ff41-488f-844c-753eebe3bff6 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:18.055331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f997ad76-ca53-473a-b1a1-4dfb4200ad79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:46:18.059653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f997ad76-ca53-473a-b1a1-4dfb4200ad79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:46:18.148540 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f997ad76-ca53-473a-b1a1-4dfb4200ad79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.256664 Jul 20 04:46:18.151462 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2894/5545] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:46:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:46:18.163062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dbde53de-a68f-4068-b67f-f77b0dd25361 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:18.164106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dbde53de-a68f-4068-b67f-f77b0dd25361 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:18.463465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dbde53de-a68f-4068-b67f-f77b0dd25361 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:18.484443 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dbde53de-a68f-4068-b67f-f77b0dd25361 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 200 len: 1220 microversion: 2.1 time: 0.326175 Jul 20 04:46:18.485080 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2895/5546] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:18 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 1220 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:18.494547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3da9f87e-9cf3-43d0-b85f-30100e24250e tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:18.495749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3da9f87e-9cf3-43d0-b85f-30100e24250e tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:18.504583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3da9f87e-9cf3-43d0-b85f-30100e24250e tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:18.505287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3da9f87e-9cf3-43d0-b85f-30100e24250e tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:18.506276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3da9f87e-9cf3-43d0-b85f-30100e24250e tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:18.508323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3da9f87e-9cf3-43d0-b85f-30100e24250e tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:18.527460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:18.567326 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-75a69d00-ff41-488f-844c-753eebe3bff6 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1648 microversion: 2.1 time: 0.559501 Jul 20 04:46:18.569270 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2652/5547] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:18 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1648 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:18.590407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d67ddddd-801c-414c-b5ca-d537edb0005a tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:18.591468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d67ddddd-801c-414c-b5ca-d537edb0005a tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:18.601964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d67ddddd-801c-414c-b5ca-d537edb0005a tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:18.609159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d67ddddd-801c-414c-b5ca-d537edb0005a tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:18.612657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d67ddddd-801c-414c-b5ca-d537edb0005a tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:18.614716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d67ddddd-801c-414c-b5ca-d537edb0005a tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:19.068505 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d67ddddd-801c-414c-b5ca-d537edb0005a tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1648 microversion: 2.1 time: 0.481918 Jul 20 04:46:19.069100 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2653/5548] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:18 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1648 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:19.079748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eeefdbbb-5627-45bf-b470-862cb3d25751 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:19.086256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eeefdbbb-5627-45bf-b470-862cb3d25751 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:19.100137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eeefdbbb-5627-45bf-b470-862cb3d25751 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:19.101002 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eeefdbbb-5627-45bf-b470-862cb3d25751 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:19.102009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eeefdbbb-5627-45bf-b470-862cb3d25751 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:19.102673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eeefdbbb-5627-45bf-b470-862cb3d25751 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:19.265101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3da9f87e-9cf3-43d0-b85f-30100e24250e tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:19.274199 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3da9f87e-9cf3-43d0-b85f-30100e24250e tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1317 microversion: 2.1 time: 0.786528 Jul 20 04:46:19.274808 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2896/5549] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:18 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1317 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:19.291660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-883e7a45-1017-445e-baa9-3f83bce154f9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:19.292400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-883e7a45-1017-445e-baa9-3f83bce154f9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:19.309640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-883e7a45-1017-445e-baa9-3f83bce154f9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:19.310587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-883e7a45-1017-445e-baa9-3f83bce154f9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:19.311938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-883e7a45-1017-445e-baa9-3f83bce154f9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:19.312540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-883e7a45-1017-445e-baa9-3f83bce154f9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:19.564227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eeefdbbb-5627-45bf-b470-862cb3d25751 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:19.583176 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eeefdbbb-5627-45bf-b470-862cb3d25751 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1569 microversion: 2.1 time: 0.502857 Jul 20 04:46:19.585672 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2654/5550] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:19 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1569 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:19.611380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-bb2b4393-d564-4316-8882-1ac3ff69ee07 req-176b85de-f689-47e3-9c1a-f043f13ef3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3333b1e8-7653-4bc2-a218-7a8521a338cf", "tag": "f0786273-0f1f-49de-86fb-2b745295ba8b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:19.641323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-bb2b4393-d564-4316-8882-1ac3ff69ee07 req-176b85de-f689-47e3-9c1a-f043f13ef3c9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:19.642557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-bb2b4393-d564-4316-8882-1ac3ff69ee07 req-176b85de-f689-47e3-9c1a-f043f13ef3c9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:19.674816 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-bb2b4393-d564-4316-8882-1ac3ff69ee07 req-176b85de-f689-47e3-9c1a-f043f13ef3c9 service nova] Creating event network-changed:f0786273-0f1f-49de-86fb-2b745295ba8b for instance 3333b1e8-7653-4bc2-a218-7a8521a338cf on n-h2-826526-5 Jul 20 04:46:19.686049 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-bb2b4393-d564-4316-8882-1ac3ff69ee07 req-176b85de-f689-47e3-9c1a-f043f13ef3c9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096485 Jul 20 04:46:19.689726 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2655/5551] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:19.706152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-6872ea83-e3b1-4433-b2c1-5e061c234b32 req-0b8ca8c2-148c-4010-a925-506f6c49b366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7252429e-bc8c-4074-bf46-54b6a7cecbf5", "name": "network-vif-deleted", "tag": "164f2fc3-122f-4406-8e11-8f0e32836720"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:19.733348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6872ea83-e3b1-4433-b2c1-5e061c234b32 req-0b8ca8c2-148c-4010-a925-506f6c49b366 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:19.734495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6872ea83-e3b1-4433-b2c1-5e061c234b32 req-0b8ca8c2-148c-4010-a925-506f6c49b366 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:19.763378 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-6872ea83-e3b1-4433-b2c1-5e061c234b32 req-0b8ca8c2-148c-4010-a925-506f6c49b366 service nova] Creating event network-vif-deleted:164f2fc3-122f-4406-8e11-8f0e32836720 for instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 on n-h1-826526-5 Jul 20 04:46:19.778183 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-6872ea83-e3b1-4433-b2c1-5e061c234b32 req-0b8ca8c2-148c-4010-a925-506f6c49b366 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085379 Jul 20 04:46:19.782115 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2656/5552] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:19.791536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a58125cf-0239-47b1-b906-bbdb07f48886 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:19.797695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a58125cf-0239-47b1-b906-bbdb07f48886 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:19.812239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a58125cf-0239-47b1-b906-bbdb07f48886 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:19.816863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a58125cf-0239-47b1-b906-bbdb07f48886 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:19.818577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a58125cf-0239-47b1-b906-bbdb07f48886 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:19.820514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a58125cf-0239-47b1-b906-bbdb07f48886 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:20.086173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a58125cf-0239-47b1-b906-bbdb07f48886 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:20.101587 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a58125cf-0239-47b1-b906-bbdb07f48886 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 200 len: 1280 microversion: 2.1 time: 0.316665 Jul 20 04:46:20.105218 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2657/5553] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:19 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 1280 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:20.293103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4cb14a1d-81f7-4684-a912-58e5e0c0992f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:20.295987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4cb14a1d-81f7-4684-a912-58e5e0c0992f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:20.343732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cb14a1d-81f7-4684-a912-58e5e0c0992f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:20.344196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cb14a1d-81f7-4684-a912-58e5e0c0992f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:20.345029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cb14a1d-81f7-4684-a912-58e5e0c0992f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:20.345476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cb14a1d-81f7-4684-a912-58e5e0c0992f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:20.996675 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-883e7a45-1017-445e-baa9-3f83bce154f9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1648 microversion: 2.1 time: 1.708590 Jul 20 04:46:21.009055 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2897/5554] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:19 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1648 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:21.014777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-abcf5252-b0fb-42bd-ac3a-6ec02cc6f723 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:21.015741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-abcf5252-b0fb-42bd-ac3a-6ec02cc6f723 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:21.033184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4cb14a1d-81f7-4684-a912-58e5e0c0992f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:21.035548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abcf5252-b0fb-42bd-ac3a-6ec02cc6f723 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:21.036298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abcf5252-b0fb-42bd-ac3a-6ec02cc6f723 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:21.038361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abcf5252-b0fb-42bd-ac3a-6ec02cc6f723 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:21.039273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abcf5252-b0fb-42bd-ac3a-6ec02cc6f723 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:21.053574 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4cb14a1d-81f7-4684-a912-58e5e0c0992f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1317 microversion: 2.1 time: 0.761353 Jul 20 04:46:21.056378 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2658/5555] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:20 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1317 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:21.078610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7186034d-9802-420e-8b48-b00b7542e41f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '.version_select at 0x7f06bcd294c0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:21.118867 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7186034d-9802-420e-8b48-b00b7542e41f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-467804541" status: 202 len: 0 microversion: 2.1 time: 0.046693 Jul 20 04:46:21.119475 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2659/5556] 10.222.0.17 () {58 vars in 1280 bytes} [Wed Jul 20 04:46:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-467804541 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:46:21.133396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4cd580d7-781a-408a-b5de-1fb00cd9a7d5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:21.134106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4cd580d7-781a-408a-b5de-1fb00cd9a7d5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:21.151070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cd580d7-781a-408a-b5de-1fb00cd9a7d5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:21.151626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cd580d7-781a-408a-b5de-1fb00cd9a7d5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:21.152834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cd580d7-781a-408a-b5de-1fb00cd9a7d5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:21.153285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cd580d7-781a-408a-b5de-1fb00cd9a7d5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:21.367848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-abcf5252-b0fb-42bd-ac3a-6ec02cc6f723 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:21.384034 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-abcf5252-b0fb-42bd-ac3a-6ec02cc6f723 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1361 microversion: 2.1 time: 0.373173 Jul 20 04:46:21.387444 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2898/5557] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:21 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1361 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:21.404149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9aa8b339-60f3-42d6-86fc-503aaebbe22c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'create', calling method: .version_select at 0x7f06bcc69d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1009459422", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzr1PMxVNOZdLQs0MgOUqLqVAnlItCKk0TGTc0KYaw4f3XvOsaWVZYoZmIYIIhUvDnS9y9wtnUNE9JBMbVvk8VAh0WnvF/xsxMdqeOQytl/I0bvbEvQqrZ3dgthLvYVRw=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:21.460798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-9aa8b339-60f3-42d6-86fc-503aaebbe22c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Getting quotas for project a678d19d82d248958a3d7df804ccfa95. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:46:21.487983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-9aa8b339-60f3-42d6-86fc-503aaebbe22c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Getting quotas for user cffe347e0a094346afd74f178a0fde5d and project a678d19d82d248958a3d7df804ccfa95. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:46:21.546730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4cd580d7-781a-408a-b5de-1fb00cd9a7d5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:21.559220 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4cd580d7-781a-408a-b5de-1fb00cd9a7d5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 200 len: 1278 microversion: 2.1 time: 0.431779 Jul 20 04:46:21.570855 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2660/5558] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:21 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 1278 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:21.574348 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9aa8b339-60f3-42d6-86fc-503aaebbe22c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.185204 Jul 20 04:46:21.575315 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2899/5559] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:46:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:21.578455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-62b0993f-bc34-4206-a7c8-8f3ea5772029 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2025398658", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "availability_zone": "nova:n-h2-826526-5", "networks": [{"uuid": "c2f9d408-ee5a-4fc3-9aae-6fce21c7d955"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:21.684391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-62b0993f-bc34-4206-a7c8-8f3ea5772029 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] validate_networks() for [('c2f9d408-ee5a-4fc3-9aae-6fce21c7d955', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:46:21.730628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-eb48b415-389f-4dd6-988f-526b624580af req-6711fde8-32ba-46bf-b137-5791a4eeb413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d530bf9-a3da-4006-9120-3bc00e8266e3", "tag": "7d6173a0-c778-42ab-8c13-3f45b04a097d"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:21.754013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-eb48b415-389f-4dd6-988f-526b624580af req-6711fde8-32ba-46bf-b137-5791a4eeb413 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:21.754472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-eb48b415-389f-4dd6-988f-526b624580af req-6711fde8-32ba-46bf-b137-5791a4eeb413 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:21.792089 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-eb48b415-389f-4dd6-988f-526b624580af req-6711fde8-32ba-46bf-b137-5791a4eeb413 service nova] Creating event network-changed:7d6173a0-c778-42ab-8c13-3f45b04a097d for instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 on n-h2-826526-5 Jul 20 04:46:21.807732 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-eb48b415-389f-4dd6-988f-526b624580af req-6711fde8-32ba-46bf-b137-5791a4eeb413 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081474 Jul 20 04:46:21.810979 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2900/5560] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:22.067702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:22.081496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6e3afc8f-96f0-42a0-af27-b155befcbd8f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:22.084773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6e3afc8f-96f0-42a0-af27-b155befcbd8f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:22.104149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e3afc8f-96f0-42a0-af27-b155befcbd8f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:22.106144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e3afc8f-96f0-42a0-af27-b155befcbd8f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:22.107587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e3afc8f-96f0-42a0-af27-b155befcbd8f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:22.111085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e3afc8f-96f0-42a0-af27-b155befcbd8f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:23.132717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6e3afc8f-96f0-42a0-af27-b155befcbd8f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:23.149464 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6e3afc8f-96f0-42a0-af27-b155befcbd8f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1317 microversion: 2.1 time: 1.073076 Jul 20 04:46:23.150216 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2901/5561] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:22 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1317 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:23.159687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5cdbd020-34d3-4dce-b605-b055e7236bc1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:23.160343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5cdbd020-34d3-4dce-b605-b055e7236bc1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:23.176413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5cdbd020-34d3-4dce-b605-b055e7236bc1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:23.177478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5cdbd020-34d3-4dce-b605-b055e7236bc1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:23.178581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5cdbd020-34d3-4dce-b605-b055e7236bc1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:23.179294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5cdbd020-34d3-4dce-b605-b055e7236bc1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:23.218416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-62b0993f-bc34-4206-a7c8-8f3ea5772029 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:46:23.219663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-62b0993f-bc34-4206-a7c8-8f3ea5772029 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:46:23.220779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-62b0993f-bc34-4206-a7c8-8f3ea5772029 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:46:23.221852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-62b0993f-bc34-4206-a7c8-8f3ea5772029 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:46:23.222814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-62b0993f-bc34-4206-a7c8-8f3ea5772029 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:46:23.253061 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62b0993f-bc34-4206-a7c8-8f3ea5772029 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:23.256537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62b0993f-bc34-4206-a7c8-8f3ea5772029 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:23.259268 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62b0993f-bc34-4206-a7c8-8f3ea5772029 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:23.267391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62b0993f-bc34-4206-a7c8-8f3ea5772029 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:23.305595 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-62b0993f-bc34-4206-a7c8-8f3ea5772029 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Getting quotas for project 2dfab96c00554ef4a35d4822e0d24481. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:46:23.322107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-62b0993f-bc34-4206-a7c8-8f3ea5772029 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Getting quotas for user a7f0c106d01f4843aadc182d8a9559f2 and project 2dfab96c00554ef4a35d4822e0d24481. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:46:23.358218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5cdbd020-34d3-4dce-b605-b055e7236bc1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:23.366825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62b0993f-bc34-4206-a7c8-8f3ea5772029 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:46:23.373112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62b0993f-bc34-4206-a7c8-8f3ea5772029 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:46:23.373817 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5cdbd020-34d3-4dce-b605-b055e7236bc1 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1361 microversion: 2.1 time: 0.220154 Jul 20 04:46:23.389122 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2902/5562] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:23 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:23.401902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0fc76fc2-ed1c-400e-97fe-bf3f8d09bedb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:23.405655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0fc76fc2-ed1c-400e-97fe-bf3f8d09bedb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:23.427465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0fc76fc2-ed1c-400e-97fe-bf3f8d09bedb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:23.428136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0fc76fc2-ed1c-400e-97fe-bf3f8d09bedb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:23.431645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0fc76fc2-ed1c-400e-97fe-bf3f8d09bedb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:23.432392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0fc76fc2-ed1c-400e-97fe-bf3f8d09bedb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:23.463516 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-62b0993f-bc34-4206-a7c8-8f3ea5772029 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.890148 Jul 20 04:46:23.464863 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2661/5563] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:46:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:46:23.483250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6300bd4e-7d2c-43e1-ab1e-b701d771f402 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:23.486526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6300bd4e-7d2c-43e1-ab1e-b701d771f402 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:23.646677 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6300bd4e-7d2c-43e1-ab1e-b701d771f402 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1329 microversion: 2.1 time: 0.169547 Jul 20 04:46:23.648419 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2662/5564] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:23 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1329 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:24.010458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0fc76fc2-ed1c-400e-97fe-bf3f8d09bedb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:24.019324 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0fc76fc2-ed1c-400e-97fe-bf3f8d09bedb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 200 len: 1320 microversion: 2.1 time: 0.628657 Jul 20 04:46:24.027356 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2903/5565] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:23 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 1320 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:24.167939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5e4c8b09-747b-42aa-bc38-89834a1bf13d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:24.168988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5e4c8b09-747b-42aa-bc38-89834a1bf13d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:24.187386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e4c8b09-747b-42aa-bc38-89834a1bf13d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:24.190269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e4c8b09-747b-42aa-bc38-89834a1bf13d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:24.191639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e4c8b09-747b-42aa-bc38-89834a1bf13d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:24.194799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e4c8b09-747b-42aa-bc38-89834a1bf13d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:24.395562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ee635e07-ea64-41b1-9579-2e2a43681633 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:24.396834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ee635e07-ea64-41b1-9579-2e2a43681633 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:24.411685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee635e07-ea64-41b1-9579-2e2a43681633 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:24.412137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee635e07-ea64-41b1-9579-2e2a43681633 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:24.412992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee635e07-ea64-41b1-9579-2e2a43681633 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:24.413430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee635e07-ea64-41b1-9579-2e2a43681633 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:24.615105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5e4c8b09-747b-42aa-bc38-89834a1bf13d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:24.646186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ee635e07-ea64-41b1-9579-2e2a43681633 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:24.655277 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ee635e07-ea64-41b1-9579-2e2a43681633 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1361 microversion: 2.1 time: 0.263756 Jul 20 04:46:24.656540 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2904/5566] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:24 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1361 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:24.673375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8c7b2fb6-a19f-4d3d-a6c7-cc848305b371 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:24.674279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8c7b2fb6-a19f-4d3d-a6c7-cc848305b371 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:24.679052 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5e4c8b09-747b-42aa-bc38-89834a1bf13d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1317 microversion: 2.1 time: 0.512760 Jul 20 04:46:24.681638 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2663/5567] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:24 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:24.690730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c7b2fb6-a19f-4d3d-a6c7-cc848305b371 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:24.692595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c7b2fb6-a19f-4d3d-a6c7-cc848305b371 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:24.693811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c7b2fb6-a19f-4d3d-a6c7-cc848305b371 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:24.694702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c7b2fb6-a19f-4d3d-a6c7-cc848305b371 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:24.829767 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8c7b2fb6-a19f-4d3d-a6c7-cc848305b371 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1416 microversion: 2.1 time: 0.160220 Jul 20 04:46:24.831483 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2905/5568] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:24 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1416 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:24.961794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e5d8ecb4-521e-486c-a52d-d4cdc6f67881 req-caed1483-654d-4b5d-837f-7e18fde5fb74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b80de7c-33fd-4d2b-a3c5-c73c607c5e43", "tag": "d5ee51a5-cce4-4202-835d-55709cc6380d"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:24.987563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:25.012450 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e5d8ecb4-521e-486c-a52d-d4cdc6f67881 req-caed1483-654d-4b5d-837f-7e18fde5fb74 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.014856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e5d8ecb4-521e-486c-a52d-d4cdc6f67881 req-caed1483-654d-4b5d-837f-7e18fde5fb74 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.043178 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e5d8ecb4-521e-486c-a52d-d4cdc6f67881 req-caed1483-654d-4b5d-837f-7e18fde5fb74 service nova] Creating event network-changed:d5ee51a5-cce4-4202-835d-55709cc6380d for instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 on n-h2-826526-5 Jul 20 04:46:25.048467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ffe7b7d6-ca73-45b5-bb8f-95431a06b3c2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:25.049430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ffe7b7d6-ca73-45b5-bb8f-95431a06b3c2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:25.063576 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e5d8ecb4-521e-486c-a52d-d4cdc6f67881 req-caed1483-654d-4b5d-837f-7e18fde5fb74 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112526 Jul 20 04:46:25.065083 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2664/5569] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:25.099731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffe7b7d6-ca73-45b5-bb8f-95431a06b3c2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.107847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffe7b7d6-ca73-45b5-bb8f-95431a06b3c2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.110581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffe7b7d6-ca73-45b5-bb8f-95431a06b3c2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.111170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffe7b7d6-ca73-45b5-bb8f-95431a06b3c2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.593452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ffe7b7d6-ca73-45b5-bb8f-95431a06b3c2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:25.612214 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ffe7b7d6-ca73-45b5-bb8f-95431a06b3c2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 200 len: 1320 microversion: 2.1 time: 0.570877 Jul 20 04:46:25.629106 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2906/5570] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:25 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 1320 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:25.675679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7e4c748a-247f-451f-9d17-4a4bf8ddde66 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:25.676525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7e4c748a-247f-451f-9d17-4a4bf8ddde66 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:25.685858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e4c748a-247f-451f-9d17-4a4bf8ddde66 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.686675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e4c748a-247f-451f-9d17-4a4bf8ddde66 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.687124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e4c748a-247f-451f-9d17-4a4bf8ddde66 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.687581 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e4c748a-247f-451f-9d17-4a4bf8ddde66 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.695207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:25.704717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-135e1586-9608-46bd-a0b2-27a9108ea80f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:25.705608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-135e1586-9608-46bd-a0b2-27a9108ea80f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:25.712539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-135e1586-9608-46bd-a0b2-27a9108ea80f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.713298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-135e1586-9608-46bd-a0b2-27a9108ea80f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.714340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-135e1586-9608-46bd-a0b2-27a9108ea80f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.714940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-135e1586-9608-46bd-a0b2-27a9108ea80f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.802244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7e4c748a-247f-451f-9d17-4a4bf8ddde66 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:25.822734 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7e4c748a-247f-451f-9d17-4a4bf8ddde66 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1361 microversion: 2.1 time: 0.152722 Jul 20 04:46:25.824134 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2665/5571] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:25 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:25.855657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1acb10bc-cabc-4d6d-97bf-6ff1c5af637d tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:25.856686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1acb10bc-cabc-4d6d-97bf-6ff1c5af637d tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:25.874098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1acb10bc-cabc-4d6d-97bf-6ff1c5af637d tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.874951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1acb10bc-cabc-4d6d-97bf-6ff1c5af637d tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.875776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1acb10bc-cabc-4d6d-97bf-6ff1c5af637d tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.876232 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1acb10bc-cabc-4d6d-97bf-6ff1c5af637d tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:26.055905 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1acb10bc-cabc-4d6d-97bf-6ff1c5af637d tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1422 microversion: 2.1 time: 0.204647 Jul 20 04:46:26.068336 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2666/5572] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:25 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1422 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:26.183292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-135e1586-9608-46bd-a0b2-27a9108ea80f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:26.196309 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-135e1586-9608-46bd-a0b2-27a9108ea80f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1317 microversion: 2.1 time: 0.493574 Jul 20 04:46:26.198072 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2907/5573] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:25 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:26.633854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-35aca258-ef17-4b08-8473-09f46bfa5f05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:26.634705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-35aca258-ef17-4b08-8473-09f46bfa5f05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:26.650176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35aca258-ef17-4b08-8473-09f46bfa5f05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:26.650956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35aca258-ef17-4b08-8473-09f46bfa5f05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:26.652047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35aca258-ef17-4b08-8473-09f46bfa5f05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:26.653503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35aca258-ef17-4b08-8473-09f46bfa5f05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:26.849791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8a213b0d-f1a6-45ff-b6e8-aeb890f463a8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:26.851968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8a213b0d-f1a6-45ff-b6e8-aeb890f463a8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:26.866807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a213b0d-f1a6-45ff-b6e8-aeb890f463a8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:26.868040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a213b0d-f1a6-45ff-b6e8-aeb890f463a8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:26.874850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a213b0d-f1a6-45ff-b6e8-aeb890f463a8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:26.875147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a213b0d-f1a6-45ff-b6e8-aeb890f463a8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:26.969662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8a213b0d-f1a6-45ff-b6e8-aeb890f463a8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:26.986492 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8a213b0d-f1a6-45ff-b6e8-aeb890f463a8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1361 microversion: 2.1 time: 0.146800 Jul 20 04:46:26.998257 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2908/5574] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:26 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:27.092861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-db7bb73b-fbb8-496e-97c5-85c859e5f12c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:27.093785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-db7bb73b-fbb8-496e-97c5-85c859e5f12c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:27.106293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db7bb73b-fbb8-496e-97c5-85c859e5f12c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:27.110948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db7bb73b-fbb8-496e-97c5-85c859e5f12c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:27.112931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db7bb73b-fbb8-496e-97c5-85c859e5f12c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:27.116220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db7bb73b-fbb8-496e-97c5-85c859e5f12c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:27.395227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-35aca258-ef17-4b08-8473-09f46bfa5f05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:27.412175 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-35aca258-ef17-4b08-8473-09f46bfa5f05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 200 len: 1320 microversion: 2.1 time: 0.781541 Jul 20 04:46:27.413468 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2667/5575] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:26 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 1320 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:27.420335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c2ad0144-fa36-4a2c-9f0f-9e6e60143f70 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:27.429511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c2ad0144-fa36-4a2c-9f0f-9e6e60143f70 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:27.460623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c2ad0144-fa36-4a2c-9f0f-9e6e60143f70 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:27.461661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c2ad0144-fa36-4a2c-9f0f-9e6e60143f70 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:27.463735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c2ad0144-fa36-4a2c-9f0f-9e6e60143f70 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:27.464489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c2ad0144-fa36-4a2c-9f0f-9e6e60143f70 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:27.500679 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-db7bb73b-fbb8-496e-97c5-85c859e5f12c tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1464 microversion: 2.1 time: 0.418818 Jul 20 04:46:27.503207 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2909/5576] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:27 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1464 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:28.004941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a1ac0dc2-c993-44c6-a005-c4d9e1bd127d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:28.006431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a1ac0dc2-c993-44c6-a005-c4d9e1bd127d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:28.011102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:28.024848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1ac0dc2-c993-44c6-a005-c4d9e1bd127d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:28.027822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1ac0dc2-c993-44c6-a005-c4d9e1bd127d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:28.029037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1ac0dc2-c993-44c6-a005-c4d9e1bd127d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:28.031622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1ac0dc2-c993-44c6-a005-c4d9e1bd127d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:28.125279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1ac0dc2-c993-44c6-a005-c4d9e1bd127d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:28.126550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1ac0dc2-c993-44c6-a005-c4d9e1bd127d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:28.127965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-a1ac0dc2-c993-44c6-a005-c4d9e1bd127d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lazy-loading 'fault' on Instance uuid 7252429e-bc8c-4074-bf46-54b6a7cecbf5 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:46:28.210009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c2ad0144-fa36-4a2c-9f0f-9e6e60143f70 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:28.240404 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c2ad0144-fa36-4a2c-9f0f-9e6e60143f70 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1317 microversion: 2.1 time: 0.823761 Jul 20 04:46:28.241153 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2668/5577] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:27 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1317 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:28.263506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a1ac0dc2-c993-44c6-a005-c4d9e1bd127d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:28.281572 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a1ac0dc2-c993-44c6-a005-c4d9e1bd127d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 200 len: 1366 microversion: 2.1 time: 0.280884 Jul 20 04:46:28.282634 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2910/5578] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:27 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:28.434790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-591c3782-9c7f-4394-aec7-6abb7ad8f941 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:28.435693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-591c3782-9c7f-4394-aec7-6abb7ad8f941 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:28.457284 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-591c3782-9c7f-4394-aec7-6abb7ad8f941 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:28.458117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-591c3782-9c7f-4394-aec7-6abb7ad8f941 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:28.459549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-591c3782-9c7f-4394-aec7-6abb7ad8f941 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:28.460384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-591c3782-9c7f-4394-aec7-6abb7ad8f941 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:28.527556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7985fc8a-5f8d-486f-9470-d64552d4c0b3 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:28.528178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7985fc8a-5f8d-486f-9470-d64552d4c0b3 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:28.538212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7985fc8a-5f8d-486f-9470-d64552d4c0b3 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:28.538662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7985fc8a-5f8d-486f-9470-d64552d4c0b3 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:28.539445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7985fc8a-5f8d-486f-9470-d64552d4c0b3 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:28.546283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7985fc8a-5f8d-486f-9470-d64552d4c0b3 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:28.988022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-591c3782-9c7f-4394-aec7-6abb7ad8f941 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:29.006340 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-591c3782-9c7f-4394-aec7-6abb7ad8f941 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 200 len: 1320 microversion: 2.1 time: 0.578192 Jul 20 04:46:29.010170 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2669/5579] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:28 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 1320 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:29.024706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f74e2fb1-9805-464f-b38c-5df28151ef01 req-2894252b-e4ec-4d08-8f63-eeb77b7d05ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d530bf9-a3da-4006-9120-3bc00e8266e3", "name": "network-vif-plugged", "status": "completed", "tag": "7d6173a0-c778-42ab-8c13-3f45b04a097d"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:29.049077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f74e2fb1-9805-464f-b38c-5df28151ef01 req-2894252b-e4ec-4d08-8f63-eeb77b7d05ac service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:29.049540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f74e2fb1-9805-464f-b38c-5df28151ef01 req-2894252b-e4ec-4d08-8f63-eeb77b7d05ac service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:29.071242 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f74e2fb1-9805-464f-b38c-5df28151ef01 req-2894252b-e4ec-4d08-8f63-eeb77b7d05ac service nova] Creating event network-vif-plugged:7d6173a0-c778-42ab-8c13-3f45b04a097d for instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 on n-h2-826526-5 Jul 20 04:46:29.092487 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f74e2fb1-9805-464f-b38c-5df28151ef01 req-2894252b-e4ec-4d08-8f63-eeb77b7d05ac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079272 Jul 20 04:46:29.093896 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2670/5580] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:29.263666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3241e01b-287f-4466-98e6-5262ff57c158 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:29.264739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3241e01b-287f-4466-98e6-5262ff57c158 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:29.272819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3241e01b-287f-4466-98e6-5262ff57c158 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:29.273825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3241e01b-287f-4466-98e6-5262ff57c158 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:29.274811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3241e01b-287f-4466-98e6-5262ff57c158 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:29.275459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3241e01b-287f-4466-98e6-5262ff57c158 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:29.397417 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7985fc8a-5f8d-486f-9470-d64552d4c0b3 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1464 microversion: 2.1 time: 0.874396 Jul 20 04:46:29.398440 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2911/5581] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:28 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1464 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:29.412081 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5a349bc8-87fa-43c4-bed3-35d821ad48d2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:29.419467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5a349bc8-87fa-43c4-bed3-35d821ad48d2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:29.437405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a349bc8-87fa-43c4-bed3-35d821ad48d2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:29.438144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a349bc8-87fa-43c4-bed3-35d821ad48d2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:29.439117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a349bc8-87fa-43c4-bed3-35d821ad48d2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:29.439717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5a349bc8-87fa-43c4-bed3-35d821ad48d2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:29.483441 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-5a349bc8-87fa-43c4-bed3-35d821ad48d2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] HTTP exception thrown: Instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 could not be found. Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5a349bc8-87fa-43c4-bed3-35d821ad48d2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Request method failure captured: Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 HTTP/1.1 Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14dGzvYcPg3NF43f6ZRAI_AjtsB7nnPabtQnWEyYg-EXw30wVgvbZX3EBgp2DuSsT-UZ385yph2nVbWQKDH20kvx2xMXBhHcpx3bIjpA8OEQ9j_bQ2MqW2hbHHtIFQtSaphPYv0KfZxRo98jYdMcipaN9CmzRsyzwLTotDNtaeBR3wc Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b889ad56221143f0a54450c81ba738a7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}] Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: bc760e8f522640fc9190460719f5dcc2 Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 could not be found. Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '7252429e-bc8c-4074-bf46-54b6a7cecbf5'} Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 could not be found. Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 could not be found. Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:29.485252 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:29.494894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:29.494894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:29.494894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:29.494894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:29.494894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:29.494894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 could not be found. Jul 20 04:46:29.494894 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:29.494894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5a349bc8-87fa-43c4-bed3-35d821ad48d2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Returning 404 to user: Instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:29.494894 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5a349bc8-87fa-43c4-bed3-35d821ad48d2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 404 len: 111 microversion: 2.1 time: 0.087836 Jul 20 04:46:29.494894 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2912/5582] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:29 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:46:29.823779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3241e01b-287f-4466-98e6-5262ff57c158 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:29.852876 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3241e01b-287f-4466-98e6-5262ff57c158 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1317 microversion: 2.1 time: 0.597705 Jul 20 04:46:29.859808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-6d90b834-3387-4f0b-b48e-ba919866b7b8 req-48bb8b43-90d3-4ee5-9fbc-dd634f293463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b608901-4714-4796-bdad-e66e00bebf52", "tag": "fa7e6e85-ff4a-4e82-98f0-b74f2477391b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:29.866579 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2671/5583] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:29 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1317 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:29.874504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-6d90b834-3387-4f0b-b48e-ba919866b7b8 req-48bb8b43-90d3-4ee5-9fbc-dd634f293463 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:29.875142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-6d90b834-3387-4f0b-b48e-ba919866b7b8 req-48bb8b43-90d3-4ee5-9fbc-dd634f293463 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:29.907687 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-6d90b834-3387-4f0b-b48e-ba919866b7b8 req-48bb8b43-90d3-4ee5-9fbc-dd634f293463 service nova] Creating event network-changed:fa7e6e85-ff4a-4e82-98f0-b74f2477391b for instance 6b608901-4714-4796-bdad-e66e00bebf52 on n-h2-826526-5 Jul 20 04:46:29.931701 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-6d90b834-3387-4f0b-b48e-ba919866b7b8 req-48bb8b43-90d3-4ee5-9fbc-dd634f293463 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060149 Jul 20 04:46:29.936402 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2913/5584] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:30.026034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e79de88d-a986-4526-b908-a15c7fb00462 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:30.026745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e79de88d-a986-4526-b908-a15c7fb00462 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:30.048994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e79de88d-a986-4526-b908-a15c7fb00462 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:30.049867 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e79de88d-a986-4526-b908-a15c7fb00462 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:30.051203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e79de88d-a986-4526-b908-a15c7fb00462 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:30.053955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e79de88d-a986-4526-b908-a15c7fb00462 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:30.413842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e79de88d-a986-4526-b908-a15c7fb00462 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:30.418024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7f0eb566-af6d-4a89-8e1b-0ff2c0cd74eb tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:30.420059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7f0eb566-af6d-4a89-8e1b-0ff2c0cd74eb tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:30.424988 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e79de88d-a986-4526-b908-a15c7fb00462 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 200 len: 1320 microversion: 2.1 time: 0.403573 Jul 20 04:46:30.427351 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2672/5585] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:30 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 1320 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:30.434028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f0eb566-af6d-4a89-8e1b-0ff2c0cd74eb tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:30.436172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f0eb566-af6d-4a89-8e1b-0ff2c0cd74eb tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:30.440134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f0eb566-af6d-4a89-8e1b-0ff2c0cd74eb tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:30.440730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f0eb566-af6d-4a89-8e1b-0ff2c0cd74eb tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:30.879527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eaeb7ac9-3857-447d-a6b0-cbb87652f546 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:30.883945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eaeb7ac9-3857-447d-a6b0-cbb87652f546 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:30.915601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eaeb7ac9-3857-447d-a6b0-cbb87652f546 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:30.916851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eaeb7ac9-3857-447d-a6b0-cbb87652f546 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:30.925617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eaeb7ac9-3857-447d-a6b0-cbb87652f546 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:30.927777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eaeb7ac9-3857-447d-a6b0-cbb87652f546 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:31.006460 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7f0eb566-af6d-4a89-8e1b-0ff2c0cd74eb tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1464 microversion: 2.1 time: 0.589445 Jul 20 04:46:31.021232 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2914/5586] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:30 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1464 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:31.451469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f94a97c4-e15f-417a-a1e6-ca63ea090793 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:31.453192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f94a97c4-e15f-417a-a1e6-ca63ea090793 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:31.484623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f94a97c4-e15f-417a-a1e6-ca63ea090793 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:31.488463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f94a97c4-e15f-417a-a1e6-ca63ea090793 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:31.490135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f94a97c4-e15f-417a-a1e6-ca63ea090793 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:31.491090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f94a97c4-e15f-417a-a1e6-ca63ea090793 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:31.513761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eaeb7ac9-3857-447d-a6b0-cbb87652f546 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:31.527429 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eaeb7ac9-3857-447d-a6b0-cbb87652f546 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.658081 Jul 20 04:46:31.532483 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2673/5587] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:30 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:31.548449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=26 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:31.833959 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f94a97c4-e15f-417a-a1e6-ca63ea090793 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:31.841282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:31.855494 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f94a97c4-e15f-417a-a1e6-ca63ea090793 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 200 len: 1320 microversion: 2.1 time: 0.410981 Jul 20 04:46:31.856094 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2915/5588] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:31 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 1320 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:31.893446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d453f6b-b93d-473b-a252-c7d03b64742c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2070996249", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:31.989052 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-1d453f6b-b93d-473b-a252-c7d03b64742c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] validate_networks() for [('251a4e63-1968-40ea-8261-3caafe352db6', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:46:32.029864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-92d03853-36dd-4b19-80b6-3f490fe7c9af tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:32.030713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-92d03853-36dd-4b19-80b6-3f490fe7c9af tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:32.040934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-92d03853-36dd-4b19-80b6-3f490fe7c9af tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:32.042760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-92d03853-36dd-4b19-80b6-3f490fe7c9af tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:32.046693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-92d03853-36dd-4b19-80b6-3f490fe7c9af tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:32.047330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-92d03853-36dd-4b19-80b6-3f490fe7c9af tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:32.448948 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-92d03853-36dd-4b19-80b6-3f490fe7c9af tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1464 microversion: 2.1 time: 0.423700 Jul 20 04:46:32.449727 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2916/5589] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:32 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1464 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:32.875936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-863bbea0-a7be-4056-9c1f-f6e0ecda6e17 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:32.876718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-863bbea0-a7be-4056-9c1f-f6e0ecda6e17 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:32.880157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:32.893269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-863bbea0-a7be-4056-9c1f-f6e0ecda6e17 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:32.893730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-863bbea0-a7be-4056-9c1f-f6e0ecda6e17 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:32.908631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-863bbea0-a7be-4056-9c1f-f6e0ecda6e17 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:32.909231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-863bbea0-a7be-4056-9c1f-f6e0ecda6e17 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.286710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:33.310247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1d453f6b-b93d-473b-a252-c7d03b64742c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:46:33.310683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1d453f6b-b93d-473b-a252-c7d03b64742c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:46:33.311171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1d453f6b-b93d-473b-a252-c7d03b64742c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:46:33.311589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1d453f6b-b93d-473b-a252-c7d03b64742c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:46:33.312010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1d453f6b-b93d-473b-a252-c7d03b64742c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:46:33.331516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d453f6b-b93d-473b-a252-c7d03b64742c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.331981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d453f6b-b93d-473b-a252-c7d03b64742c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.337640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d453f6b-b93d-473b-a252-c7d03b64742c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.338377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d453f6b-b93d-473b-a252-c7d03b64742c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.380723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-1d453f6b-b93d-473b-a252-c7d03b64742c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Getting quotas for project 4c3cfeac44614a9888245f21ca0f3811. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:46:33.395045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-1d453f6b-b93d-473b-a252-c7d03b64742c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Getting quotas for user dd6f3db734dc4e0197653b83e0eb746a and project 4c3cfeac44614a9888245f21ca0f3811. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:46:33.429772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d453f6b-b93d-473b-a252-c7d03b64742c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:46:33.432348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d453f6b-b93d-473b-a252-c7d03b64742c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:46:33.536330 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d453f6b-b93d-473b-a252-c7d03b64742c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.648600 Jul 20 04:46:33.541900 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2674/5590] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:46:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:46:33.560599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-512a8be4-a9a6-4246-9b7c-dc1d07d9c66d tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:33.561549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-512a8be4-a9a6-4246-9b7c-dc1d07d9c66d tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:33.572494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-512a8be4-a9a6-4246-9b7c-dc1d07d9c66d tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.573192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-512a8be4-a9a6-4246-9b7c-dc1d07d9c66d tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.574257 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-512a8be4-a9a6-4246-9b7c-dc1d07d9c66d tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.574890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-512a8be4-a9a6-4246-9b7c-dc1d07d9c66d tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.649124 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-863bbea0-a7be-4056-9c1f-f6e0ecda6e17 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:33.661411 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-863bbea0-a7be-4056-9c1f-f6e0ecda6e17 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 200 len: 1320 microversion: 2.1 time: 0.790197 Jul 20 04:46:33.668331 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2917/5591] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:32 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 1320 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:33.676485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6ecf0fbe-2f27-4317-8fa1-e894de5da11d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:33.678242 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6ecf0fbe-2f27-4317-8fa1-e894de5da11d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:33.809119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6ecf0fbe-2f27-4317-8fa1-e894de5da11d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:33.842030 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6ecf0fbe-2f27-4317-8fa1-e894de5da11d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 200 len: 1217 microversion: 2.1 time: 0.169653 Jul 20 04:46:33.842969 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2918/5592] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:33 2022] GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:33.962527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-9db310b1-17d8-497c-a44a-d35fff1bd0d6 req-ef9f521a-8185-4abb-9bdb-7e8a1909c196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b80de7c-33fd-4d2b-a3c5-c73c607c5e43", "name": "network-vif-plugged", "status": "completed", "tag": "d5ee51a5-cce4-4202-835d-55709cc6380d"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:33.980381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9db310b1-17d8-497c-a44a-d35fff1bd0d6 req-ef9f521a-8185-4abb-9bdb-7e8a1909c196 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.994104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9db310b1-17d8-497c-a44a-d35fff1bd0d6 req-ef9f521a-8185-4abb-9bdb-7e8a1909c196 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:34.029175 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9db310b1-17d8-497c-a44a-d35fff1bd0d6 req-ef9f521a-8185-4abb-9bdb-7e8a1909c196 service nova] Creating event network-vif-plugged:d5ee51a5-cce4-4202-835d-55709cc6380d for instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 on n-h2-826526-5 Jul 20 04:46:34.045617 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-9db310b1-17d8-497c-a44a-d35fff1bd0d6 req-ef9f521a-8185-4abb-9bdb-7e8a1909c196 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089766 Jul 20 04:46:34.048022 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2919/5593] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:46:34.225515 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-512a8be4-a9a6-4246-9b7c-dc1d07d9c66d tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1464 microversion: 2.1 time: 0.681757 Jul 20 04:46:34.229734 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2675/5594] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:33 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1464 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:34.686989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4750cf75-14f7-479b-89ce-4db8f8762c05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:34.689072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4750cf75-14f7-479b-89ce-4db8f8762c05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:34.752685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4750cf75-14f7-479b-89ce-4db8f8762c05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:34.763628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4750cf75-14f7-479b-89ce-4db8f8762c05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:34.773055 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4750cf75-14f7-479b-89ce-4db8f8762c05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:34.778338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4750cf75-14f7-479b-89ce-4db8f8762c05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:34.866337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-912ef401-7754-44b1-96c0-292472a2a3f3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:34.869443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-912ef401-7754-44b1-96c0-292472a2a3f3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:34.886193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-912ef401-7754-44b1-96c0-292472a2a3f3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:34.888452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-912ef401-7754-44b1-96c0-292472a2a3f3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:34.890469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-912ef401-7754-44b1-96c0-292472a2a3f3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:34.891230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-912ef401-7754-44b1-96c0-292472a2a3f3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:35.283604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-912ef401-7754-44b1-96c0-292472a2a3f3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:35.301221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4750cf75-14f7-479b-89ce-4db8f8762c05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:35.304456 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-912ef401-7754-44b1-96c0-292472a2a3f3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 200 len: 1213 microversion: 2.1 time: 0.446936 Jul 20 04:46:35.307188 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2676/5595] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:34 2022] GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 1213 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:35.320445 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4750cf75-14f7-479b-89ce-4db8f8762c05 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 200 len: 1320 microversion: 2.1 time: 0.635946 Jul 20 04:46:35.325537 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2920/5596] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:34 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 1320 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:35.335575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4bc55f8b-c938-4f90-af05-7b3696e257b9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:35.336638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4bc55f8b-c938-4f90-af05-7b3696e257b9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:35.350954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4bc55f8b-c938-4f90-af05-7b3696e257b9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:35.354337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4bc55f8b-c938-4f90-af05-7b3696e257b9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:35.357211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4bc55f8b-c938-4f90-af05-7b3696e257b9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:35.364696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4bc55f8b-c938-4f90-af05-7b3696e257b9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:35.946008 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4bc55f8b-c938-4f90-af05-7b3696e257b9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1464 microversion: 2.1 time: 0.634886 Jul 20 04:46:35.947732 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2677/5597] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:35 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1464 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:36.325199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a5e8810e-5d6e-4749-8a6c-919c4f5f721b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:36.327224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a5e8810e-5d6e-4749-8a6c-919c4f5f721b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:36.344001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-727e4f2e-4af3-4892-811c-b50500559b70 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:36.344982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-727e4f2e-4af3-4892-811c-b50500559b70 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:36.357741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5e8810e-5d6e-4749-8a6c-919c4f5f721b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:36.359948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5e8810e-5d6e-4749-8a6c-919c4f5f721b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:36.361560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5e8810e-5d6e-4749-8a6c-919c4f5f721b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:36.365095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5e8810e-5d6e-4749-8a6c-919c4f5f721b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:36.386463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-727e4f2e-4af3-4892-811c-b50500559b70 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:36.386951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-727e4f2e-4af3-4892-811c-b50500559b70 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:36.389469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-727e4f2e-4af3-4892-811c-b50500559b70 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:36.390174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-727e4f2e-4af3-4892-811c-b50500559b70 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:37.036462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-727e4f2e-4af3-4892-811c-b50500559b70 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:37.069767 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-727e4f2e-4af3-4892-811c-b50500559b70 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 200 len: 1501 microversion: 2.1 time: 0.734487 Jul 20 04:46:37.083089 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2678/5598] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:36 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 1501 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:37.123518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c80cfd2b-247b-49fb-a0e1-ba879b5699e9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:37.124401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c80cfd2b-247b-49fb-a0e1-ba879b5699e9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:37.156802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c80cfd2b-247b-49fb-a0e1-ba879b5699e9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:37.157817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c80cfd2b-247b-49fb-a0e1-ba879b5699e9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:37.158857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c80cfd2b-247b-49fb-a0e1-ba879b5699e9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:37.159485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c80cfd2b-247b-49fb-a0e1-ba879b5699e9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:37.168993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a5e8810e-5d6e-4749-8a6c-919c4f5f721b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:37.181207 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a5e8810e-5d6e-4749-8a6c-919c4f5f721b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 200 len: 1275 microversion: 2.1 time: 0.860654 Jul 20 04:46:37.184656 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2921/5599] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:36 2022] GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 1275 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:37.195378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4c35091b-6cd4-4a34-b97c-895c33efe31d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:37.201320 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4c35091b-6cd4-4a34-b97c-895c33efe31d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:37.219937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c35091b-6cd4-4a34-b97c-895c33efe31d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:37.220995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c35091b-6cd4-4a34-b97c-895c33efe31d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:37.223675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c35091b-6cd4-4a34-b97c-895c33efe31d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:37.224918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4c35091b-6cd4-4a34-b97c-895c33efe31d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:37.600047 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c80cfd2b-247b-49fb-a0e1-ba879b5699e9 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1464 microversion: 2.1 time: 0.515262 Jul 20 04:46:37.601878 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2679/5600] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:37 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1464 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:37.954865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4c35091b-6cd4-4a34-b97c-895c33efe31d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:37.964615 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4c35091b-6cd4-4a34-b97c-895c33efe31d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 200 len: 1501 microversion: 2.1 time: 0.778622 Jul 20 04:46:37.968342 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2922/5601] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:37 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 1501 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:37.987032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c89bddcd-e38a-492a-8a93-bb3204020e7e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:37.988526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c89bddcd-e38a-492a-8a93-bb3204020e7e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:38.005285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c89bddcd-e38a-492a-8a93-bb3204020e7e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.005677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c89bddcd-e38a-492a-8a93-bb3204020e7e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.011352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c89bddcd-e38a-492a-8a93-bb3204020e7e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.014017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c89bddcd-e38a-492a-8a93-bb3204020e7e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.079636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c89bddcd-e38a-492a-8a93-bb3204020e7e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:46:38.202039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9384f832-7c6e-4d53-8281-2a5d228e9613 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:38.203382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9384f832-7c6e-4d53-8281-2a5d228e9613 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:38.228477 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9384f832-7c6e-4d53-8281-2a5d228e9613 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.229249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9384f832-7c6e-4d53-8281-2a5d228e9613 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.233441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9384f832-7c6e-4d53-8281-2a5d228e9613 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.236647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9384f832-7c6e-4d53-8281-2a5d228e9613 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.344728 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c89bddcd-e38a-492a-8a93-bb3204020e7e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 204 len: 0 microversion: 2.1 time: 0.362610 Jul 20 04:46:38.347464 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2680/5602] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:46:37 2022] DELETE /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:46:38.360563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ca89a916-71a7-4457-af87-fdef41fc8102 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:38.362550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ca89a916-71a7-4457-af87-fdef41fc8102 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:38.379341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca89a916-71a7-4457-af87-fdef41fc8102 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.380416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca89a916-71a7-4457-af87-fdef41fc8102 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.381459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca89a916-71a7-4457-af87-fdef41fc8102 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.382048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca89a916-71a7-4457-af87-fdef41fc8102 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.410823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:38.715950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9384f832-7c6e-4d53-8281-2a5d228e9613 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:38.726014 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9384f832-7c6e-4d53-8281-2a5d228e9613 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 200 len: 1317 microversion: 2.1 time: 0.530035 Jul 20 04:46:38.727146 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2923/5603] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:38 2022] GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:38.737181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c1c3d6dc-1966-4731-902b-22280a48be7a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:38.738018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c1c3d6dc-1966-4731-902b-22280a48be7a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:38.738247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ca89a916-71a7-4457-af87-fdef41fc8102 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:38.747412 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ca89a916-71a7-4457-af87-fdef41fc8102 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 200 len: 1507 microversion: 2.1 time: 0.394639 Jul 20 04:46:38.759169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1c3d6dc-1966-4731-902b-22280a48be7a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.761646 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2681/5604] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:38 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 1507 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:38.767419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ad38ed4b-4bd6-4a25-9044-c43270c88476 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:38.768047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ad38ed4b-4bd6-4a25-9044-c43270c88476 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:38.771226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1c3d6dc-1966-4731-902b-22280a48be7a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.772409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1c3d6dc-1966-4731-902b-22280a48be7a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.775947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1c3d6dc-1966-4731-902b-22280a48be7a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.781602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad38ed4b-4bd6-4a25-9044-c43270c88476 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.782391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad38ed4b-4bd6-4a25-9044-c43270c88476 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.783377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad38ed4b-4bd6-4a25-9044-c43270c88476 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.784068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad38ed4b-4bd6-4a25-9044-c43270c88476 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.859403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c1c3d6dc-1966-4731-902b-22280a48be7a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:46:39.031372 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c1c3d6dc-1966-4731-902b-22280a48be7a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 204 len: 0 microversion: 2.1 time: 0.302479 Jul 20 04:46:39.032558 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2924/5605] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:46:38 2022] DELETE /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:46:39.059481 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ad38ed4b-4bd6-4a25-9044-c43270c88476 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1464 microversion: 2.1 time: 0.295791 Jul 20 04:46:39.062897 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2682/5606] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:38 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1464 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:39.070541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fd1304ff-d580-46fd-9f8e-43bef5861490 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:39.071184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fd1304ff-d580-46fd-9f8e-43bef5861490 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:39.087977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd1304ff-d580-46fd-9f8e-43bef5861490 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:39.089292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd1304ff-d580-46fd-9f8e-43bef5861490 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:39.090306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd1304ff-d580-46fd-9f8e-43bef5861490 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:39.091048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd1304ff-d580-46fd-9f8e-43bef5861490 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:39.292884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-719e646d-116d-4134-816c-29d9fc14524c req-4b97d938-78d8-421e-9b6f-c7858ea9d5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52498332-97f4-4f2c-8f6a-5803b2c641b3", "tag": "df7eccce-ba78-48b2-bd95-245614ee75bc"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:39.304770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-719e646d-116d-4134-816c-29d9fc14524c req-4b97d938-78d8-421e-9b6f-c7858ea9d5d8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:39.305542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-719e646d-116d-4134-816c-29d9fc14524c req-4b97d938-78d8-421e-9b6f-c7858ea9d5d8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:39.321404 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-719e646d-116d-4134-816c-29d9fc14524c req-4b97d938-78d8-421e-9b6f-c7858ea9d5d8 service nova] Creating event network-changed:df7eccce-ba78-48b2-bd95-245614ee75bc for instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 on n-h1-826526-5 Jul 20 04:46:39.329523 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-719e646d-116d-4134-816c-29d9fc14524c req-4b97d938-78d8-421e-9b6f-c7858ea9d5d8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.294964 Jul 20 04:46:39.330920 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2925/5607] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:39.394651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fd1304ff-d580-46fd-9f8e-43bef5861490 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:39.404056 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fd1304ff-d580-46fd-9f8e-43bef5861490 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1410 microversion: 2.1 time: 0.338428 Jul 20 04:46:39.404939 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2683/5608] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:39 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1410 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:39.640374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-870a3440-70f4-4b02-aaa9-5ac87a978c37 req-41c2c249-b921-4f41-858e-f100dfc1cda7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b608901-4714-4796-bdad-e66e00bebf52", "name": "network-vif-plugged", "status": "completed", "tag": "fa7e6e85-ff4a-4e82-98f0-b74f2477391b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:39.662839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-870a3440-70f4-4b02-aaa9-5ac87a978c37 req-41c2c249-b921-4f41-858e-f100dfc1cda7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:39.663296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-870a3440-70f4-4b02-aaa9-5ac87a978c37 req-41c2c249-b921-4f41-858e-f100dfc1cda7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:39.678020 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-870a3440-70f4-4b02-aaa9-5ac87a978c37 req-41c2c249-b921-4f41-858e-f100dfc1cda7 service nova] Creating event network-vif-plugged:fa7e6e85-ff4a-4e82-98f0-b74f2477391b for instance 6b608901-4714-4796-bdad-e66e00bebf52 on n-h2-826526-5 Jul 20 04:46:39.687081 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-870a3440-70f4-4b02-aaa9-5ac87a978c37 req-41c2c249-b921-4f41-858e-f100dfc1cda7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056466 Jul 20 04:46:39.688031 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2926/5609] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:39.746469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b424b4df-1736-4071-a6d0-c9f4e1c6e021 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:39.748293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b424b4df-1736-4071-a6d0-c9f4e1c6e021 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:39.756098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b424b4df-1736-4071-a6d0-c9f4e1c6e021 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:39.757121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b424b4df-1736-4071-a6d0-c9f4e1c6e021 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:39.759027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b424b4df-1736-4071-a6d0-c9f4e1c6e021 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:39.762570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b424b4df-1736-4071-a6d0-c9f4e1c6e021 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:39.783534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5800716e-d259-45bb-b620-5f52bb9f2e56 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:39.785042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5800716e-d259-45bb-b620-5f52bb9f2e56 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:39.801558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5800716e-d259-45bb-b620-5f52bb9f2e56 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:39.804088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5800716e-d259-45bb-b620-5f52bb9f2e56 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:39.807819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5800716e-d259-45bb-b620-5f52bb9f2e56 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:39.808327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5800716e-d259-45bb-b620-5f52bb9f2e56 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:40.003386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b424b4df-1736-4071-a6d0-c9f4e1c6e021 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:40.015996 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b424b4df-1736-4071-a6d0-c9f4e1c6e021 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 200 len: 1317 microversion: 2.1 time: 0.275101 Jul 20 04:46:40.030778 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2684/5610] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:39 2022] GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:40.083485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-66f606f4-12ca-4bab-8c2e-710427eea373 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:40.084611 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-66f606f4-12ca-4bab-8c2e-710427eea373 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:40.093712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66f606f4-12ca-4bab-8c2e-710427eea373 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:40.095164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66f606f4-12ca-4bab-8c2e-710427eea373 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:40.096352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66f606f4-12ca-4bab-8c2e-710427eea373 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:40.097125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66f606f4-12ca-4bab-8c2e-710427eea373 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:40.206860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5800716e-d259-45bb-b620-5f52bb9f2e56 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:40.222814 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5800716e-d259-45bb-b620-5f52bb9f2e56 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 200 len: 1507 microversion: 2.1 time: 0.445935 Jul 20 04:46:40.223467 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2927/5611] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:39 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 1507 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:40.306358 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-66f606f4-12ca-4bab-8c2e-710427eea373 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1464 microversion: 2.1 time: 0.230262 Jul 20 04:46:40.322508 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2685/5612] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:40 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1464 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:40.342575 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2e1d33c0-81e9-4d5e-83c7-99aab0ef1896 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-601988379", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "9387f2a5-8566-4e33-b978-442d318cbac9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1009459422", "security_groups": [{"name": "tempest-secgroup-smoke-437594348"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:40.421883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf2bc214-9695-40a0-b83b-183fe6aa1abe tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:40.422888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cf2bc214-9695-40a0-b83b-183fe6aa1abe tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:40.431432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf2bc214-9695-40a0-b83b-183fe6aa1abe tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:40.433297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf2bc214-9695-40a0-b83b-183fe6aa1abe tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:40.434755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf2bc214-9695-40a0-b83b-183fe6aa1abe tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:40.435430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf2bc214-9695-40a0-b83b-183fe6aa1abe tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:40.667805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-2e1d33c0-81e9-4d5e-83c7-99aab0ef1896 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] validate_networks() for [('9387f2a5-8566-4e33-b978-442d318cbac9', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:46:40.800828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cf2bc214-9695-40a0-b83b-183fe6aa1abe tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:40.820527 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cf2bc214-9695-40a0-b83b-183fe6aa1abe tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1410 microversion: 2.1 time: 0.402473 Jul 20 04:46:40.822875 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2686/5613] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:40 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1410 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:41.042071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-40d29c4d-49f6-4f9b-aeb6-30a2a82f6e1d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:41.043147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-40d29c4d-49f6-4f9b-aeb6-30a2a82f6e1d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:41.059298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40d29c4d-49f6-4f9b-aeb6-30a2a82f6e1d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:41.060198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40d29c4d-49f6-4f9b-aeb6-30a2a82f6e1d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:41.061987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40d29c4d-49f6-4f9b-aeb6-30a2a82f6e1d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:41.062748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40d29c4d-49f6-4f9b-aeb6-30a2a82f6e1d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:41.444563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-40d29c4d-49f6-4f9b-aeb6-30a2a82f6e1d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:41.454474 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-40d29c4d-49f6-4f9b-aeb6-30a2a82f6e1d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 200 len: 1317 microversion: 2.1 time: 0.419936 Jul 20 04:46:41.455809 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2687/5614] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:41 2022] GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:41.461050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8efa1258-2ad2-4de7-a1ea-65da85d4dd2f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:41.461997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8efa1258-2ad2-4de7-a1ea-65da85d4dd2f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:41.476845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8efa1258-2ad2-4de7-a1ea-65da85d4dd2f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:41.477650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8efa1258-2ad2-4de7-a1ea-65da85d4dd2f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:41.478707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8efa1258-2ad2-4de7-a1ea-65da85d4dd2f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:41.479348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8efa1258-2ad2-4de7-a1ea-65da85d4dd2f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:41.880603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8efa1258-2ad2-4de7-a1ea-65da85d4dd2f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:41.892101 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8efa1258-2ad2-4de7-a1ea-65da85d4dd2f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 200 len: 1507 microversion: 2.1 time: 0.434915 Jul 20 04:46:41.893734 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2688/5615] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:41 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 1507 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:41.900186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-30b62cad-c5e1-4c2e-9ab1-b7cf6a6929cc tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:41.900979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-30b62cad-c5e1-4c2e-9ab1-b7cf6a6929cc tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:41.923263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30b62cad-c5e1-4c2e-9ab1-b7cf6a6929cc tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:41.926883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30b62cad-c5e1-4c2e-9ab1-b7cf6a6929cc tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:41.934775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30b62cad-c5e1-4c2e-9ab1-b7cf6a6929cc tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:41.935567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30b62cad-c5e1-4c2e-9ab1-b7cf6a6929cc tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.171413 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-30b62cad-c5e1-4c2e-9ab1-b7cf6a6929cc tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1464 microversion: 2.1 time: 0.275803 Jul 20 04:46:42.177502 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2689/5616] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:41 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1464 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:42.183591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f7f7a9ae-1c74-4f6f-b298-cb231109092c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:42.185301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f7f7a9ae-1c74-4f6f-b298-cb231109092c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:42.209255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f7f7a9ae-1c74-4f6f-b298-cb231109092c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.213169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f7f7a9ae-1c74-4f6f-b298-cb231109092c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.215813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f7f7a9ae-1c74-4f6f-b298-cb231109092c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.216363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f7f7a9ae-1c74-4f6f-b298-cb231109092c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.424023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f7f7a9ae-1c74-4f6f-b298-cb231109092c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:42.437129 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f7f7a9ae-1c74-4f6f-b298-cb231109092c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1368 microversion: 2.1 time: 0.258421 Jul 20 04:46:42.443351 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2690/5617] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:42 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:42.459707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e198599a-065a-40ee-9b79-0c39d65e9bdd req-5db7b2f2-fb26-4891-afdf-60b796d5449d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7fed1e7-12d5-4f39-9c2a-65e4dd681aff", "name": "network-vif-deleted", "tag": "cbe618b3-cf79-40f4-8209-0fcfe0234ec0"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:42.487039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e198599a-065a-40ee-9b79-0c39d65e9bdd req-5db7b2f2-fb26-4891-afdf-60b796d5449d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.487303 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e198599a-065a-40ee-9b79-0c39d65e9bdd req-5db7b2f2-fb26-4891-afdf-60b796d5449d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.527560 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e198599a-065a-40ee-9b79-0c39d65e9bdd req-5db7b2f2-fb26-4891-afdf-60b796d5449d service nova] Creating event network-vif-deleted:cbe618b3-cf79-40f4-8209-0fcfe0234ec0 for instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff on n-h2-826526-5 Jul 20 04:46:42.554720 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e198599a-065a-40ee-9b79-0c39d65e9bdd req-5db7b2f2-fb26-4891-afdf-60b796d5449d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099663 Jul 20 04:46:42.561471 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2691/5618] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:42.568638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5bf9c3b5-b22d-4c92-b35e-7cceecb3e1cb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:42.569694 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5bf9c3b5-b22d-4c92-b35e-7cceecb3e1cb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:42.594572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5bf9c3b5-b22d-4c92-b35e-7cceecb3e1cb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.595034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5bf9c3b5-b22d-4c92-b35e-7cceecb3e1cb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.595866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5bf9c3b5-b22d-4c92-b35e-7cceecb3e1cb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.596365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5bf9c3b5-b22d-4c92-b35e-7cceecb3e1cb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.817573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2e1d33c0-81e9-4d5e-83c7-99aab0ef1896 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:46:42.819448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2e1d33c0-81e9-4d5e-83c7-99aab0ef1896 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:46:42.820938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2e1d33c0-81e9-4d5e-83c7-99aab0ef1896 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:46:42.821579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2e1d33c0-81e9-4d5e-83c7-99aab0ef1896 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:46:42.822236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2e1d33c0-81e9-4d5e-83c7-99aab0ef1896 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:46:42.872408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e1d33c0-81e9-4d5e-83c7-99aab0ef1896 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.891813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e1d33c0-81e9-4d5e-83c7-99aab0ef1896 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.898281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e1d33c0-81e9-4d5e-83c7-99aab0ef1896 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.899846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e1d33c0-81e9-4d5e-83c7-99aab0ef1896 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.016805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-2e1d33c0-81e9-4d5e-83c7-99aab0ef1896 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Getting quotas for project a678d19d82d248958a3d7df804ccfa95. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:46:43.029692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-2e1d33c0-81e9-4d5e-83c7-99aab0ef1896 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Getting quotas for user cffe347e0a094346afd74f178a0fde5d and project a678d19d82d248958a3d7df804ccfa95. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:46:43.069113 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5bf9c3b5-b22d-4c92-b35e-7cceecb3e1cb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:43.090510 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5bf9c3b5-b22d-4c92-b35e-7cceecb3e1cb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 200 len: 1317 microversion: 2.1 time: 0.526770 Jul 20 04:46:43.092142 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2692/5619] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:42 2022] GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:43.097435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-90fbf8b4-86fa-4715-8e5e-c079320695e0 req-acb65364-9def-426b-81b5-ab79d241bae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b80de7c-33fd-4d2b-a3c5-c73c607c5e43", "name": "network-vif-deleted", "tag": "d5ee51a5-cce4-4202-835d-55709cc6380d"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:43.101276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2e1d33c0-81e9-4d5e-83c7-99aab0ef1896 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:46:43.104989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2e1d33c0-81e9-4d5e-83c7-99aab0ef1896 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:46:43.119819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-90fbf8b4-86fa-4715-8e5e-c079320695e0 req-acb65364-9def-426b-81b5-ab79d241bae8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.120320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-90fbf8b4-86fa-4715-8e5e-c079320695e0 req-acb65364-9def-426b-81b5-ab79d241bae8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.163965 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-90fbf8b4-86fa-4715-8e5e-c079320695e0 req-acb65364-9def-426b-81b5-ab79d241bae8 service nova] Creating event network-vif-deleted:d5ee51a5-cce4-4202-835d-55709cc6380d for instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 on n-h2-826526-5 Jul 20 04:46:43.192296 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-90fbf8b4-86fa-4715-8e5e-c079320695e0 req-acb65364-9def-426b-81b5-ab79d241bae8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098008 Jul 20 04:46:43.194209 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2693/5620] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:43.206971 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6b735380-a364-4fc0-b688-f859319d8081 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:43.217787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6b735380-a364-4fc0-b688-f859319d8081 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:43.237585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b735380-a364-4fc0-b688-f859319d8081 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.240073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b735380-a364-4fc0-b688-f859319d8081 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.251848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b735380-a364-4fc0-b688-f859319d8081 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.253027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b735380-a364-4fc0-b688-f859319d8081 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.277251 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2e1d33c0-81e9-4d5e-83c7-99aab0ef1896 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.939415 Jul 20 04:46:43.284956 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2928/5621] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:46:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 2948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:46:43.308189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-68b3ef46-9950-4e9e-b6fd-d8785e8f75ca tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:43.309273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-68b3ef46-9950-4e9e-b6fd-d8785e8f75ca tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:43.320580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68b3ef46-9950-4e9e-b6fd-d8785e8f75ca tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.321390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68b3ef46-9950-4e9e-b6fd-d8785e8f75ca tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.322393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68b3ef46-9950-4e9e-b6fd-d8785e8f75ca tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.323063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68b3ef46-9950-4e9e-b6fd-d8785e8f75ca tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.339406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b735380-a364-4fc0-b688-f859319d8081 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.339886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b735380-a364-4fc0-b688-f859319d8081 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.340755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-6b735380-a364-4fc0-b688-f859319d8081 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lazy-loading 'fault' on Instance uuid 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:46:43.359297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:43.419521 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=14 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:43.474343 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6b735380-a364-4fc0-b688-f859319d8081 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:43.487013 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6b735380-a364-4fc0-b688-f859319d8081 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 200 len: 1310 microversion: 2.1 time: 0.290800 Jul 20 04:46:43.487842 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2694/5622] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:43 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 1310 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:43.503414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a0cd1b3b-d4c7-412d-8c72-d561707c3804 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:43.504534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a0cd1b3b-d4c7-412d-8c72-d561707c3804 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:43.571149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a0cd1b3b-d4c7-412d-8c72-d561707c3804 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:43.579435 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a0cd1b3b-d4c7-412d-8c72-d561707c3804 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1266 microversion: 2.1 time: 0.080122 Jul 20 04:46:43.589198 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2695/5623] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:43 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:43.589198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-35970817-4de8-4cc4-99f2-affa04d599fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:43.589198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-35970817-4de8-4cc4-99f2-affa04d599fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:43.594733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35970817-4de8-4cc4-99f2-affa04d599fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.595223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35970817-4de8-4cc4-99f2-affa04d599fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.596044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35970817-4de8-4cc4-99f2-affa04d599fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.596534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35970817-4de8-4cc4-99f2-affa04d599fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.691576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-35970817-4de8-4cc4-99f2-affa04d599fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:43.735298 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-35970817-4de8-4cc4-99f2-affa04d599fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1202 microversion: 2.1 time: 0.151139 Jul 20 04:46:43.748507 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2696/5624] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:43 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:44.022809 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-68b3ef46-9950-4e9e-b6fd-d8785e8f75ca tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1649 microversion: 2.1 time: 0.733433 Jul 20 04:46:44.025539 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2929/5625] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:43 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1649 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:44.043821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-18d814f7-223b-4a6e-b53f-f22d052a1d37 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:44.045475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-18d814f7-223b-4a6e-b53f-f22d052a1d37 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:44.055810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18d814f7-223b-4a6e-b53f-f22d052a1d37 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.058077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18d814f7-223b-4a6e-b53f-f22d052a1d37 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.058897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18d814f7-223b-4a6e-b53f-f22d052a1d37 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.059407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18d814f7-223b-4a6e-b53f-f22d052a1d37 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.110754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4ce2dc67-16e0-423a-980e-e10f0491354b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:44.111409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4ce2dc67-16e0-423a-980e-e10f0491354b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:44.123921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ce2dc67-16e0-423a-980e-e10f0491354b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.124420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ce2dc67-16e0-423a-980e-e10f0491354b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.127965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ce2dc67-16e0-423a-980e-e10f0491354b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.128485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ce2dc67-16e0-423a-980e-e10f0491354b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.292029 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-18d814f7-223b-4a6e-b53f-f22d052a1d37 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1649 microversion: 2.1 time: 0.251963 Jul 20 04:46:44.293215 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2697/5626] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:44 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1649 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:44.311204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f649861a-9410-409f-ac84-1ad9f746a7ee tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:44.313096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f649861a-9410-409f-ac84-1ad9f746a7ee tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:44.334240 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f649861a-9410-409f-ac84-1ad9f746a7ee tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.334969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f649861a-9410-409f-ac84-1ad9f746a7ee tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.337044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f649861a-9410-409f-ac84-1ad9f746a7ee tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.337750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f649861a-9410-409f-ac84-1ad9f746a7ee tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.533875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4ce2dc67-16e0-423a-980e-e10f0491354b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:44.542728 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4ce2dc67-16e0-423a-980e-e10f0491354b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 200 len: 1317 microversion: 2.1 time: 0.436468 Jul 20 04:46:44.551196 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2930/5627] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:44 2022] GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 1317 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:44.556906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-640fb4ee-5b20-48dd-9d9a-7362a4f68c94 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:44.557743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-640fb4ee-5b20-48dd-9d9a-7362a4f68c94 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:44.568208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-640fb4ee-5b20-48dd-9d9a-7362a4f68c94 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.572919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-640fb4ee-5b20-48dd-9d9a-7362a4f68c94 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.575140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-640fb4ee-5b20-48dd-9d9a-7362a4f68c94 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.577495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-640fb4ee-5b20-48dd-9d9a-7362a4f68c94 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.622983 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f649861a-9410-409f-ac84-1ad9f746a7ee tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1649 microversion: 2.1 time: 0.316597 Jul 20 04:46:44.631490 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2698/5628] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:44 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1649 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:44.634707 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-640fb4ee-5b20-48dd-9d9a-7362a4f68c94 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 could not be found. Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-640fb4ee-5b20-48dd-9d9a-7362a4f68c94 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 HTTP/1.1 Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 could not be found. Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '3b80de7c-33fd-4d2b-a3c5-c73c607c5e43'} Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 could not be found. Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 could not be found. Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:44.637481 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:44.650597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:44.650597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:44.650597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:44.650597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:44.650597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 could not be found. Jul 20 04:46:44.650597 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:44.650597 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-640fb4ee-5b20-48dd-9d9a-7362a4f68c94 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:44.650597 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-640fb4ee-5b20-48dd-9d9a-7362a4f68c94 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 404 len: 111 microversion: 2.1 time: 0.086322 Jul 20 04:46:44.650597 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2931/5629] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:44 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:46:44.651962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ae48551e-76e6-4be5-8401-a336c3b39750 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:44.651962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ae48551e-76e6-4be5-8401-a336c3b39750 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:44.667968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bf1c5770-e335-43fc-bf00-543131b33aa4 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:44.677254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bf1c5770-e335-43fc-bf00-543131b33aa4 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:44.678503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae48551e-76e6-4be5-8401-a336c3b39750 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.679151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae48551e-76e6-4be5-8401-a336c3b39750 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.681523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae48551e-76e6-4be5-8401-a336c3b39750 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.685058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae48551e-76e6-4be5-8401-a336c3b39750 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.707221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf1c5770-e335-43fc-bf00-543131b33aa4 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.708375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf1c5770-e335-43fc-bf00-543131b33aa4 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.709549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf1c5770-e335-43fc-bf00-543131b33aa4 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.710573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf1c5770-e335-43fc-bf00-543131b33aa4 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.778815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bf1c5770-e335-43fc-bf00-543131b33aa4 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:46:44.851505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ae48551e-76e6-4be5-8401-a336c3b39750 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:44.878312 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ae48551e-76e6-4be5-8401-a336c3b39750 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1262 microversion: 2.1 time: 0.242368 Jul 20 04:46:44.881145 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2699/5630] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:44 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1262 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:44.893485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-585adb0f-0162-45be-8c3c-36c78fd30359 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Action: 'create', calling method: .version_select at 0x7f06bcbcf670>, body: {"keypair": {"name": "tempest-key-868612073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxEWpgS6t0UJP2se9kXIa4qRtGF1YYbfz9NwDMlXjXU+HUzwQviXD56je5iI+PTjo2vo0WL9fGv1+BvbW8GXJZSsfmlN6L+FjHSIiC7uwby/nhdYE3mAyMYhzgo3+Tjlg=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:44.941564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-585adb0f-0162-45be-8c3c-36c78fd30359 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Getting quotas for project fc751c3978da4e05b6d7aab178723ae5. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:46:44.949203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:44.958287 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-585adb0f-0162-45be-8c3c-36c78fd30359 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Getting quotas for user a5e17b2cb6654e4584b62ac8d08833f2 and project fc751c3978da4e05b6d7aab178723ae5. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:46:45.036603 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-585adb0f-0162-45be-8c3c-36c78fd30359 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.152575 Jul 20 04:46:45.037469 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2700/5631] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:46:44 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:45.040465 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bf1c5770-e335-43fc-bf00-543131b33aa4 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "DELETE /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 204 len: 0 microversion: 2.1 time: 0.399339 Jul 20 04:46:45.042119 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2932/5632] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:46:44 2022] DELETE /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:46:45.054076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a8f6dd8a-32de-42e1-8d8e-4b9d6f1a9b7b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:45.056931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a8f6dd8a-32de-42e1-8d8e-4b9d6f1a9b7b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:45.059725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-784637bb-8c57-4fcf-9d33-645781325de6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '.version_select at 0x7f06bcc69940>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:45.065177 n-d-826526-5 devstack@n-api.service[127871]: WARNING oslo_db.sqlalchemy.utils [None req-784637bb-8c57-4fcf-9d33-645781325de6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:46:45.072763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8f6dd8a-32de-42e1-8d8e-4b9d6f1a9b7b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:45.073851 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-784637bb-8c57-4fcf-9d33-645781325de6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.025690 Jul 20 04:46:45.076191 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2933/5633] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:46:45 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:45.076667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8f6dd8a-32de-42e1-8d8e-4b9d6f1a9b7b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:45.077634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8f6dd8a-32de-42e1-8d8e-4b9d6f1a9b7b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:45.078106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8f6dd8a-32de-42e1-8d8e-4b9d6f1a9b7b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:45.083535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f0b513eb-ff04-4fd5-b100-e726e3261ef1 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:45.084799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f0b513eb-ff04-4fd5-b100-e726e3261ef1 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:45.131739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0b513eb-ff04-4fd5-b100-e726e3261ef1 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:45.132235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0b513eb-ff04-4fd5-b100-e726e3261ef1 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:45.138172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0b513eb-ff04-4fd5-b100-e726e3261ef1 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:45.140614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0b513eb-ff04-4fd5-b100-e726e3261ef1 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:45.180723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:45.547689 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f0b513eb-ff04-4fd5-b100-e726e3261ef1 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1655 microversion: 2.1 time: 0.468087 Jul 20 04:46:45.552075 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2934/5634] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:45 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1655 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:45.568447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-19e13554-2eb6-4c15-b592-964f8c2b905f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:45.568975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-19e13554-2eb6-4c15-b592-964f8c2b905f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:45.593534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19e13554-2eb6-4c15-b592-964f8c2b905f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:45.593899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19e13554-2eb6-4c15-b592-964f8c2b905f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:45.594886 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19e13554-2eb6-4c15-b592-964f8c2b905f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:45.596244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19e13554-2eb6-4c15-b592-964f8c2b905f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:45.668806 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-19e13554-2eb6-4c15-b592-964f8c2b905f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf/ips" status: 200 len: 142 microversion: 2.1 time: 0.113290 Jul 20 04:46:45.676582 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2935/5635] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 04:46:45 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf/ips => generated 142 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:45.687322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-32c4ac4b-6035-4451-ab1c-dc00f31742e5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1970075897", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "key_name": "tempest-key-868612073", "networks": [{"uuid": "3d22ba6e-7662-4637-bb0f-d3084b1def5c"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:45.792112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-32c4ac4b-6035-4451-ab1c-dc00f31742e5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] validate_networks() for [('3d22ba6e-7662-4637-bb0f-d3084b1def5c', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:46:45.833997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:45.942205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a8f6dd8a-32de-42e1-8d8e-4b9d6f1a9b7b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:45.972915 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a8f6dd8a-32de-42e1-8d8e-4b9d6f1a9b7b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1202 microversion: 2.1 time: 0.930853 Jul 20 04:46:45.982857 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2701/5636] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:45 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1202 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:45.987494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-40173209-dc32-4253-9ee0-e10c722ede47 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:45.990692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-40173209-dc32-4253-9ee0-e10c722ede47 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:46.021714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40173209-dc32-4253-9ee0-e10c722ede47 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:46.023415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40173209-dc32-4253-9ee0-e10c722ede47 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:46.026755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40173209-dc32-4253-9ee0-e10c722ede47 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:46.027577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40173209-dc32-4253-9ee0-e10c722ede47 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:46.521358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-32c4ac4b-6035-4451-ab1c-dc00f31742e5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:46:46.522063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-32c4ac4b-6035-4451-ab1c-dc00f31742e5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:46:46.522324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-32c4ac4b-6035-4451-ab1c-dc00f31742e5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:46:46.523078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-32c4ac4b-6035-4451-ab1c-dc00f31742e5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:46:46.523498 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-32c4ac4b-6035-4451-ab1c-dc00f31742e5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:46:46.535893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32c4ac4b-6035-4451-ab1c-dc00f31742e5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:46.536535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32c4ac4b-6035-4451-ab1c-dc00f31742e5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:46.537366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32c4ac4b-6035-4451-ab1c-dc00f31742e5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:46.537809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32c4ac4b-6035-4451-ab1c-dc00f31742e5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:46.563468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-32c4ac4b-6035-4451-ab1c-dc00f31742e5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Getting quotas for project fc751c3978da4e05b6d7aab178723ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:46:46.573211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-32c4ac4b-6035-4451-ab1c-dc00f31742e5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Getting quotas for user a5e17b2cb6654e4584b62ac8d08833f2 and project fc751c3978da4e05b6d7aab178723ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:46:46.599186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-32c4ac4b-6035-4451-ab1c-dc00f31742e5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:46:46.601711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-32c4ac4b-6035-4451-ab1c-dc00f31742e5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:46:46.655973 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-32c4ac4b-6035-4451-ab1c-dc00f31742e5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.982291 Jul 20 04:46:46.656690 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2936/5637] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:46:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:46:46.662094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f712e33c-c210-47c8-bdea-21fa6d32c986 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:46.662725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f712e33c-c210-47c8-bdea-21fa6d32c986 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:46.671564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f712e33c-c210-47c8-bdea-21fa6d32c986 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:46.672029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f712e33c-c210-47c8-bdea-21fa6d32c986 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:46.673220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f712e33c-c210-47c8-bdea-21fa6d32c986 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:46.673677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f712e33c-c210-47c8-bdea-21fa6d32c986 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:46.762261 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f712e33c-c210-47c8-bdea-21fa6d32c986 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:46.775609 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f712e33c-c210-47c8-bdea-21fa6d32c986 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1324 microversion: 2.1 time: 0.115194 Jul 20 04:46:46.777079 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2937/5638] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:46 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1324 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:46.792029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f936add2-9e32-4a0c-b35e-3bcf6ad60581 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:46.806338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f936add2-9e32-4a0c-b35e-3bcf6ad60581 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:46.823777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f936add2-9e32-4a0c-b35e-3bcf6ad60581 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:46.824255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f936add2-9e32-4a0c-b35e-3bcf6ad60581 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:46.826160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f936add2-9e32-4a0c-b35e-3bcf6ad60581 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:46.826594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f936add2-9e32-4a0c-b35e-3bcf6ad60581 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:47.091140 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f936add2-9e32-4a0c-b35e-3bcf6ad60581 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1655 microversion: 2.1 time: 0.311761 Jul 20 04:46:47.103929 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2938/5639] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:46 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1655 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:47.110282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-444bad71-dfa7-497d-9941-ed717d99734e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:47.111083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-444bad71-dfa7-497d-9941-ed717d99734e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:47.219898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-444bad71-dfa7-497d-9941-ed717d99734e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:47.231326 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-444bad71-dfa7-497d-9941-ed717d99734e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307" status: 200 len: 1228 microversion: 2.1 time: 0.125490 Jul 20 04:46:47.232466 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2939/5640] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:47 2022] GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 => generated 1228 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:47.246342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-40173209-dc32-4253-9ee0-e10c722ede47 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:47.258900 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-40173209-dc32-4253-9ee0-e10c722ede47 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 200 len: 1317 microversion: 2.1 time: 1.283620 Jul 20 04:46:47.259508 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2702/5641] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:45 2022] GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 1317 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:47.263932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-956a562b-c8ca-4fae-aefe-c8fb767ba080 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:47.264832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-956a562b-c8ca-4fae-aefe-c8fb767ba080 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:47.272947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-956a562b-c8ca-4fae-aefe-c8fb767ba080 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:47.274196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-956a562b-c8ca-4fae-aefe-c8fb767ba080 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:47.275243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-956a562b-c8ca-4fae-aefe-c8fb767ba080 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:47.275866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-956a562b-c8ca-4fae-aefe-c8fb767ba080 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:47.388558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-956a562b-c8ca-4fae-aefe-c8fb767ba080 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:47.397806 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-956a562b-c8ca-4fae-aefe-c8fb767ba080 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1202 microversion: 2.1 time: 0.146060 Jul 20 04:46:47.399348 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2940/5642] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:47 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1202 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:47.795888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-22075ffb-3669-442d-afd4-7e47364db8cf tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:47.797559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-22075ffb-3669-442d-afd4-7e47364db8cf tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:47.812103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22075ffb-3669-442d-afd4-7e47364db8cf tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:47.814421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22075ffb-3669-442d-afd4-7e47364db8cf tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:47.815487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22075ffb-3669-442d-afd4-7e47364db8cf tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:47.816107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22075ffb-3669-442d-afd4-7e47364db8cf tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:48.043950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-22075ffb-3669-442d-afd4-7e47364db8cf tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:48.061134 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-22075ffb-3669-442d-afd4-7e47364db8cf tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1324 microversion: 2.1 time: 0.269129 Jul 20 04:46:48.065011 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2703/5643] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:47 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1324 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:48.116332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9ee8c58b-92a4-4ec2-accd-83a0af0198c5 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:48.117045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9ee8c58b-92a4-4ec2-accd-83a0af0198c5 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:48.144025 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ee8c58b-92a4-4ec2-accd-83a0af0198c5 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:48.146716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ee8c58b-92a4-4ec2-accd-83a0af0198c5 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:48.149734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ee8c58b-92a4-4ec2-accd-83a0af0198c5 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:48.150202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ee8c58b-92a4-4ec2-accd-83a0af0198c5 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:48.254283 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6a0c80d5-1be5-4011-8d9f-1d5eaf4c6523 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:48.254937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6a0c80d5-1be5-4011-8d9f-1d5eaf4c6523 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:48.269424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a0c80d5-1be5-4011-8d9f-1d5eaf4c6523 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:48.287918 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a0c80d5-1be5-4011-8d9f-1d5eaf4c6523 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:48.290939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a0c80d5-1be5-4011-8d9f-1d5eaf4c6523 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:48.291426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a0c80d5-1be5-4011-8d9f-1d5eaf4c6523 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:48.630836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6a0c80d5-1be5-4011-8d9f-1d5eaf4c6523 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:48.646401 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9ee8c58b-92a4-4ec2-accd-83a0af0198c5 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 200 len: 1613 microversion: 2.1 time: 0.540720 Jul 20 04:46:48.648180 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6a0c80d5-1be5-4011-8d9f-1d5eaf4c6523 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307" status: 200 len: 1298 microversion: 2.1 time: 0.395470 Jul 20 04:46:48.649479 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2704/5644] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:48 2022] GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 => generated 1298 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:48.661617 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2941/5645] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:48 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 1613 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:48.664454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e0863fff-1e9e-4ee4-b5f8-bf7eb6951363 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:48.665106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e0863fff-1e9e-4ee4-b5f8-bf7eb6951363 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:48.696444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0863fff-1e9e-4ee4-b5f8-bf7eb6951363 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:48.699026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0863fff-1e9e-4ee4-b5f8-bf7eb6951363 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:48.702996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1ed5cff6-4c5f-4fc7-955b-598eab8385bf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:48.707748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0863fff-1e9e-4ee4-b5f8-bf7eb6951363 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:48.709282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1ed5cff6-4c5f-4fc7-955b-598eab8385bf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:48.710494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0863fff-1e9e-4ee4-b5f8-bf7eb6951363 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:48.760815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ed5cff6-4c5f-4fc7-955b-598eab8385bf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:48.761889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ed5cff6-4c5f-4fc7-955b-598eab8385bf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:48.769207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ed5cff6-4c5f-4fc7-955b-598eab8385bf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:48.769740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ed5cff6-4c5f-4fc7-955b-598eab8385bf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:49.065128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1ed5cff6-4c5f-4fc7-955b-598eab8385bf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:49.076983 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1ed5cff6-4c5f-4fc7-955b-598eab8385bf tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1202 microversion: 2.1 time: 0.421749 Jul 20 04:46:49.081452 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2942/5646] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:48 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1202 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:49.120993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-d85bb4e2-09cd-4779-992f-0b8a606f181b req-6919caf7-5163-4efb-9c2b-94956dfba631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b608901-4714-4796-bdad-e66e00bebf52", "name": "network-vif-deleted", "tag": "fa7e6e85-ff4a-4e82-98f0-b74f2477391b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:49.133332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:49.151633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d85bb4e2-09cd-4779-992f-0b8a606f181b req-6919caf7-5163-4efb-9c2b-94956dfba631 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:49.152100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d85bb4e2-09cd-4779-992f-0b8a606f181b req-6919caf7-5163-4efb-9c2b-94956dfba631 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:49.191918 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-d85bb4e2-09cd-4779-992f-0b8a606f181b req-6919caf7-5163-4efb-9c2b-94956dfba631 service nova] Creating event network-vif-deleted:fa7e6e85-ff4a-4e82-98f0-b74f2477391b for instance 6b608901-4714-4796-bdad-e66e00bebf52 on n-h2-826526-5 Jul 20 04:46:49.210217 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-d85bb4e2-09cd-4779-992f-0b8a606f181b req-6919caf7-5163-4efb-9c2b-94956dfba631 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117491 Jul 20 04:46:49.217672 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2943/5647] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:49.241353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-62bb5f64-052c-4024-a4b3-5ec6bfa18af1 req-75bda9d5-bbf7-4e40-b5df-6e36c6d847e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52498332-97f4-4f2c-8f6a-5803b2c641b3", "name": "network-vif-plugged", "status": "completed", "tag": "df7eccce-ba78-48b2-bd95-245614ee75bc"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:49.265704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-62bb5f64-052c-4024-a4b3-5ec6bfa18af1 req-75bda9d5-bbf7-4e40-b5df-6e36c6d847e2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:49.282506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-62bb5f64-052c-4024-a4b3-5ec6bfa18af1 req-75bda9d5-bbf7-4e40-b5df-6e36c6d847e2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:49.322840 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-62bb5f64-052c-4024-a4b3-5ec6bfa18af1 req-75bda9d5-bbf7-4e40-b5df-6e36c6d847e2 service nova] Creating event network-vif-plugged:df7eccce-ba78-48b2-bd95-245614ee75bc for instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 on n-h1-826526-5 Jul 20 04:46:49.331774 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-62bb5f64-052c-4024-a4b3-5ec6bfa18af1 req-75bda9d5-bbf7-4e40-b5df-6e36c6d847e2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111978 Jul 20 04:46:49.333257 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2944/5648] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:49.337871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e0863fff-1e9e-4ee4-b5f8-bf7eb6951363 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:49.348794 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e0863fff-1e9e-4ee4-b5f8-bf7eb6951363 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 200 len: 1317 microversion: 2.1 time: 0.697033 Jul 20 04:46:49.356920 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2705/5649] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:48 2022] GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 1317 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:49.389784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-013a4be9-321e-42ff-851c-3d6125c07dda tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:49.390865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-013a4be9-321e-42ff-851c-3d6125c07dda tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:49.425456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-013a4be9-321e-42ff-851c-3d6125c07dda tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:49.426747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-013a4be9-321e-42ff-851c-3d6125c07dda tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:49.432989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-013a4be9-321e-42ff-851c-3d6125c07dda tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:49.436298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-013a4be9-321e-42ff-851c-3d6125c07dda tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:49.669163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0d9dfd07-ee6e-4b5d-b233-9bb4baf363d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:49.669803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0d9dfd07-ee6e-4b5d-b233-9bb4baf363d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:49.681004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d9dfd07-ee6e-4b5d-b233-9bb4baf363d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:49.681800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d9dfd07-ee6e-4b5d-b233-9bb4baf363d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:49.682948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d9dfd07-ee6e-4b5d-b233-9bb4baf363d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:49.689124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d9dfd07-ee6e-4b5d-b233-9bb4baf363d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:49.855506 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0d9dfd07-ee6e-4b5d-b233-9bb4baf363d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:49.893838 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0d9dfd07-ee6e-4b5d-b233-9bb4baf363d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307" status: 200 len: 1286 microversion: 2.1 time: 0.228503 Jul 20 04:46:49.906472 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2706/5650] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:49 2022] GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 => generated 1286 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:49.917947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94386295-2559-4df5-aae0-5954d80a12d1 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:49.918648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-94386295-2559-4df5-aae0-5954d80a12d1 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 6b608901-4714-4796-bdad-e66e00bebf52] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:49.935837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94386295-2559-4df5-aae0-5954d80a12d1 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:49.936433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94386295-2559-4df5-aae0-5954d80a12d1 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:49.937277 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94386295-2559-4df5-aae0-5954d80a12d1 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:49.937810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94386295-2559-4df5-aae0-5954d80a12d1 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:49.982351 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-94386295-2559-4df5-aae0-5954d80a12d1 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] HTTP exception thrown: Instance 6b608901-4714-4796-bdad-e66e00bebf52 could not be found. Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94386295-2559-4df5-aae0-5954d80a12d1 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Request method failure captured: Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 HTTP/1.1 Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14h_xvR5D6J2hwcmeZZxdDe1Xf_pt1P_zEtTuJgcqVwV3FU__Fm2kPri1kCWEf4eFT7bMN9V6qibAKqOftWwUmhgMTFOPqbdR3iz9Q8ou1FhVb-sjEln6JpczR5UoDW9YouuXJJNlsAu42k6rNSkC0unYj801Z3id0tpr0Ujq0yJl40 Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 2dfab96c00554ef4a35d4822e0d24481 Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestServerMultinode-1808244016 Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member,admin Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member,admin Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2dfab96c00554ef4a35d4822e0d24481"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2dfab96c00554ef4a35d4822e0d24481"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2dfab96c00554ef4a35d4822e0d24481", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2dfab96c00554ef4a35d4822e0d24481"}]}] Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestServerMultinode-1808244016 Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 2dfab96c00554ef4a35d4822e0d24481 Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestServerMultinode-1808244016 Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestServerMultinode-1808244016-project-admin Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a7f0c106d01f4843aadc182d8a9559f2 Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestServerMultinode-1808244016-project-admin Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 6b608901-4714-4796-bdad-e66e00bebf52 could not be found. Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '6b608901-4714-4796-bdad-e66e00bebf52'} Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b608901-4714-4796-bdad-e66e00bebf52 could not be found. Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b608901-4714-4796-bdad-e66e00bebf52 could not be found. Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:49.984076 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:49.992584 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:49.992584 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:49.992584 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:49.992584 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:49.992584 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:49.992584 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b608901-4714-4796-bdad-e66e00bebf52 could not be found. Jul 20 04:46:49.992584 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:49.992584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94386295-2559-4df5-aae0-5954d80a12d1 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Returning 404 to user: Instance 6b608901-4714-4796-bdad-e66e00bebf52 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:49.992584 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-94386295-2559-4df5-aae0-5954d80a12d1 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52" status: 404 len: 111 microversion: 2.1 time: 0.080139 Jul 20 04:46:49.992584 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2707/5651] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:49 2022] GET /compute/v2.1/servers/6b608901-4714-4796-bdad-e66e00bebf52 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:46:50.007279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d599005b-f0a0-4269-a234-a5d9f32ac4b3 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:50.007806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d599005b-f0a0-4269-a234-a5d9f32ac4b3 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:50.041153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d599005b-f0a0-4269-a234-a5d9f32ac4b3 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:50.041638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d599005b-f0a0-4269-a234-a5d9f32ac4b3 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:50.042519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d599005b-f0a0-4269-a234-a5d9f32ac4b3 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:50.042995 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d599005b-f0a0-4269-a234-a5d9f32ac4b3 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:50.077094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d599005b-f0a0-4269-a234-a5d9f32ac4b3 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:46:50.245055 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d599005b-f0a0-4269-a234-a5d9f32ac4b3 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "DELETE /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 204 len: 0 microversion: 2.1 time: 0.246562 Jul 20 04:46:50.248696 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2708/5652] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:46:49 2022] DELETE /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:46:50.267148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-59b91aad-ac0f-42c9-bd63-2fc5d5a7e675 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:50.268144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-59b91aad-ac0f-42c9-bd63-2fc5d5a7e675 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:50.276780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59b91aad-ac0f-42c9-bd63-2fc5d5a7e675 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:50.277640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59b91aad-ac0f-42c9-bd63-2fc5d5a7e675 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:50.279049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59b91aad-ac0f-42c9-bd63-2fc5d5a7e675 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:50.283954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59b91aad-ac0f-42c9-bd63-2fc5d5a7e675 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:50.401200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-59b91aad-ac0f-42c9-bd63-2fc5d5a7e675 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:50.412153 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-59b91aad-ac0f-42c9-bd63-2fc5d5a7e675 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1202 microversion: 2.1 time: 0.159925 Jul 20 04:46:50.413046 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2709/5653] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:50 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1202 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:50.430725 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-200f8fff-eb9b-4d3e-9f12-4bab9eed5420 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:50.431969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-200f8fff-eb9b-4d3e-9f12-4bab9eed5420 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:50.441780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-200f8fff-eb9b-4d3e-9f12-4bab9eed5420 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:50.443062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-200f8fff-eb9b-4d3e-9f12-4bab9eed5420 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:50.446403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-200f8fff-eb9b-4d3e-9f12-4bab9eed5420 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:50.447510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-200f8fff-eb9b-4d3e-9f12-4bab9eed5420 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:50.639826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-013a4be9-321e-42ff-851c-3d6125c07dda tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:50.657068 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-013a4be9-321e-42ff-851c-3d6125c07dda tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1391 microversion: 2.1 time: 1.322137 Jul 20 04:46:50.657954 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2945/5654] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:49 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1391 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:50.671439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a82ace77-472d-4e85-8969-4dab3b9e8b2a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:50.672445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a82ace77-472d-4e85-8969-4dab3b9e8b2a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:50.686275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a82ace77-472d-4e85-8969-4dab3b9e8b2a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:50.686894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a82ace77-472d-4e85-8969-4dab3b9e8b2a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:50.688036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a82ace77-472d-4e85-8969-4dab3b9e8b2a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:50.688726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a82ace77-472d-4e85-8969-4dab3b9e8b2a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:50.952098 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-200f8fff-eb9b-4d3e-9f12-4bab9eed5420 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1654 microversion: 2.1 time: 0.526177 Jul 20 04:46:50.953083 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2710/5655] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:50 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1654 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:50.969507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-10e991b0-25a1-408c-83cb-3011ee54990c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "887c2435-2034-4a92-ab6a-f398d11c6214"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:50.972079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-10e991b0-25a1-408c-83cb-3011ee54990c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:50.994686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10e991b0-25a1-408c-83cb-3011ee54990c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:50.995658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10e991b0-25a1-408c-83cb-3011ee54990c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:50.997053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10e991b0-25a1-408c-83cb-3011ee54990c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:50.997639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10e991b0-25a1-408c-83cb-3011ee54990c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:51.252625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a82ace77-472d-4e85-8969-4dab3b9e8b2a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:51.269294 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a82ace77-472d-4e85-8969-4dab3b9e8b2a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 200 len: 1317 microversion: 2.1 time: 0.610054 Jul 20 04:46:51.281037 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2946/5656] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:50 2022] GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 1317 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:51.283670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7fa83310-df2a-494a-8d7c-66cbd5a2b265 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:51.284510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7fa83310-df2a-494a-8d7c-66cbd5a2b265 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:51.302488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fa83310-df2a-494a-8d7c-66cbd5a2b265 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:51.306301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fa83310-df2a-494a-8d7c-66cbd5a2b265 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:51.307455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fa83310-df2a-494a-8d7c-66cbd5a2b265 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:51.311490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fa83310-df2a-494a-8d7c-66cbd5a2b265 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:51.507774 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-10e991b0-25a1-408c-83cb-3011ee54990c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "POST /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.552366 Jul 20 04:46:51.515612 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2711/5657] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 04:46:50 2022] POST /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf/os-volume_attachments => generated 194 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:51.532592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-318607a4-f708-47a5-a770-79b22c5f5589 req-f3fa1f48-072a-4b4d-bf46-4d0540ca6f4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9cbd595-7323-4d8a-b0d1-da8952f04529", "tag": "4fe14c15-fa2a-465e-8d12-695d6280d0e2"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:51.553338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-318607a4-f708-47a5-a770-79b22c5f5589 req-f3fa1f48-072a-4b4d-bf46-4d0540ca6f4c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:51.554008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-318607a4-f708-47a5-a770-79b22c5f5589 req-f3fa1f48-072a-4b4d-bf46-4d0540ca6f4c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:51.568552 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-318607a4-f708-47a5-a770-79b22c5f5589 req-f3fa1f48-072a-4b4d-bf46-4d0540ca6f4c service nova] Creating event network-changed:4fe14c15-fa2a-465e-8d12-695d6280d0e2 for instance f9cbd595-7323-4d8a-b0d1-da8952f04529 on n-h1-826526-5 Jul 20 04:46:51.575328 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-318607a4-f708-47a5-a770-79b22c5f5589 req-f3fa1f48-072a-4b4d-bf46-4d0540ca6f4c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056845 Jul 20 04:46:51.577443 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2712/5658] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:51.585463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ba9f8abd-fc31-4870-99b8-a89f0e198481 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:51.586576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ba9f8abd-fc31-4870-99b8-a89f0e198481 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:51.594591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba9f8abd-fc31-4870-99b8-a89f0e198481 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:51.595367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba9f8abd-fc31-4870-99b8-a89f0e198481 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:51.596629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba9f8abd-fc31-4870-99b8-a89f0e198481 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:51.597361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba9f8abd-fc31-4870-99b8-a89f0e198481 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:51.668340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba9f8abd-fc31-4870-99b8-a89f0e198481 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:51.669030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba9f8abd-fc31-4870-99b8-a89f0e198481 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:51.669789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-ba9f8abd-fc31-4870-99b8-a89f0e198481 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lazy-loading 'fault' on Instance uuid a7fed1e7-12d5-4f39-9c2a-65e4dd681aff {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:46:51.706543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7fa83310-df2a-494a-8d7c-66cbd5a2b265 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:51.726179 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7fa83310-df2a-494a-8d7c-66cbd5a2b265 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307" status: 200 len: 1328 microversion: 2.1 time: 0.452209 Jul 20 04:46:51.729805 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2947/5659] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:51 2022] GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 => generated 1328 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:51.736192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-aad4f185-ed21-44ce-83d5-68171fbd52f7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:51.737607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-aad4f185-ed21-44ce-83d5-68171fbd52f7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:51.747909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aad4f185-ed21-44ce-83d5-68171fbd52f7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:51.748729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aad4f185-ed21-44ce-83d5-68171fbd52f7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:51.752347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aad4f185-ed21-44ce-83d5-68171fbd52f7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:51.753096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aad4f185-ed21-44ce-83d5-68171fbd52f7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:51.839789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ba9f8abd-fc31-4870-99b8-a89f0e198481 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:51.862910 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ba9f8abd-fc31-4870-99b8-a89f0e198481 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 200 len: 1207 microversion: 2.1 time: 0.283785 Jul 20 04:46:51.863522 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2713/5660] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:51 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 1207 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:51.972134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4ff48a59-04e3-4ee6-ae17-89004c0ab146 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:51.976468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4ff48a59-04e3-4ee6-ae17-89004c0ab146 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:51.992834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ff48a59-04e3-4ee6-ae17-89004c0ab146 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:51.993825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ff48a59-04e3-4ee6-ae17-89004c0ab146 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:51.994657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ff48a59-04e3-4ee6-ae17-89004c0ab146 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:51.995155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ff48a59-04e3-4ee6-ae17-89004c0ab146 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:52.191476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-aad4f185-ed21-44ce-83d5-68171fbd52f7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:52.204135 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-aad4f185-ed21-44ce-83d5-68171fbd52f7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1391 microversion: 2.1 time: 0.472550 Jul 20 04:46:52.213849 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2948/5661] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:51 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1391 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:52.287860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-90bf4549-fbb8-4c2a-a7dc-5ed61d638b77 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:52.288960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-90bf4549-fbb8-4c2a-a7dc-5ed61d638b77 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:52.305327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-90bf4549-fbb8-4c2a-a7dc-5ed61d638b77 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:52.305957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-90bf4549-fbb8-4c2a-a7dc-5ed61d638b77 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:52.306992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-90bf4549-fbb8-4c2a-a7dc-5ed61d638b77 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:52.307618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-90bf4549-fbb8-4c2a-a7dc-5ed61d638b77 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:53.009845 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4ff48a59-04e3-4ee6-ae17-89004c0ab146 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1654 microversion: 2.1 time: 1.043720 Jul 20 04:46:53.025560 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2714/5662] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:51 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1654 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:53.040976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fced3d1c-56dd-4c08-870a-e2cb95bbe398 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:53.043965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fced3d1c-56dd-4c08-870a-e2cb95bbe398 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:53.062161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fced3d1c-56dd-4c08-870a-e2cb95bbe398 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:53.063989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fced3d1c-56dd-4c08-870a-e2cb95bbe398 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:53.067166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fced3d1c-56dd-4c08-870a-e2cb95bbe398 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:53.068065 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fced3d1c-56dd-4c08-870a-e2cb95bbe398 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:53.244689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-90bf4549-fbb8-4c2a-a7dc-5ed61d638b77 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:53.253496 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-90bf4549-fbb8-4c2a-a7dc-5ed61d638b77 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 200 len: 1505 microversion: 2.1 time: 0.969572 Jul 20 04:46:53.258100 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2949/5663] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:52 2022] GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 1505 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:53.267354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1ca0e6ae-5010-4b97-b7ef-6ffa2c47b81d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:53.273282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1ca0e6ae-5010-4b97-b7ef-6ffa2c47b81d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:53.294537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ca0e6ae-5010-4b97-b7ef-6ffa2c47b81d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:53.294949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ca0e6ae-5010-4b97-b7ef-6ffa2c47b81d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:53.296061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ca0e6ae-5010-4b97-b7ef-6ffa2c47b81d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:53.304600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ca0e6ae-5010-4b97-b7ef-6ffa2c47b81d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:53.336672 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-1ca0e6ae-5010-4b97-b7ef-6ffa2c47b81d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] HTTP exception thrown: Instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff could not be found. Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1ca0e6ae-5010-4b97-b7ef-6ffa2c47b81d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Request method failure captured: Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff HTTP/1.1 Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14dGzvYcPg3NF43f6ZRAI_AjtsB7nnPabtQnWEyYg-EXw30wVgvbZX3EBgp2DuSsT-UZ385yph2nVbWQKDH20kvx2xMXBhHcpx3bIjpA8OEQ9j_bQ2MqW2hbHHtIFQtSaphPYv0KfZxRo98jYdMcipaN9CmzRsyzwLTotDNtaeBR3wc Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b889ad56221143f0a54450c81ba738a7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}] Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: bc760e8f522640fc9190460719f5dcc2 Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff could not be found. Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'a7fed1e7-12d5-4f39-9c2a-65e4dd681aff'} Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff could not be found. Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff could not be found. Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:53.342224 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:53.347610 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:53.347610 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:53.347610 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:53.347610 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:53.347610 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:53.347610 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff could not be found. Jul 20 04:46:53.347610 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:53.347610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1ca0e6ae-5010-4b97-b7ef-6ffa2c47b81d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Returning 404 to user: Instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:53.357602 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1ca0e6ae-5010-4b97-b7ef-6ffa2c47b81d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 404 len: 111 microversion: 2.1 time: 0.098027 Jul 20 04:46:53.362429 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2950/5664] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:53 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:46:53.369003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-fdbbb963-239d-42a0-b79e-419649b3c98c req-4881bfb3-fd70-43ec-962a-d984fa4ed2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f97abf1-25eb-4320-9fec-849f74260307", "tag": "a7322cee-f5a4-4357-9059-eddc203b80a2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:53.378110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-fdbbb963-239d-42a0-b79e-419649b3c98c req-4881bfb3-fd70-43ec-962a-d984fa4ed2b8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:53.379017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-fdbbb963-239d-42a0-b79e-419649b3c98c req-4881bfb3-fd70-43ec-962a-d984fa4ed2b8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:53.395250 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-fdbbb963-239d-42a0-b79e-419649b3c98c req-4881bfb3-fd70-43ec-962a-d984fa4ed2b8 service nova] Creating event network-changed:a7322cee-f5a4-4357-9059-eddc203b80a2 for instance 9f97abf1-25eb-4320-9fec-849f74260307 on n-h2-826526-5 Jul 20 04:46:53.405279 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-fdbbb963-239d-42a0-b79e-419649b3c98c req-4881bfb3-fd70-43ec-962a-d984fa4ed2b8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041274 Jul 20 04:46:53.407148 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2951/5665] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:53.414621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d18f0b8c-b02d-47eb-ba16-eaca03a94856 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:53.417508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d18f0b8c-b02d-47eb-ba16-eaca03a94856 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:53.439233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d18f0b8c-b02d-47eb-ba16-eaca03a94856 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:53.440211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d18f0b8c-b02d-47eb-ba16-eaca03a94856 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:53.444993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d18f0b8c-b02d-47eb-ba16-eaca03a94856 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:53.445682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d18f0b8c-b02d-47eb-ba16-eaca03a94856 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:53.833700 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fced3d1c-56dd-4c08-870a-e2cb95bbe398 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:53.838270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:53.842993 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fced3d1c-56dd-4c08-870a-e2cb95bbe398 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307" status: 200 len: 1328 microversion: 2.1 time: 0.812881 Jul 20 04:46:53.853653 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2715/5666] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:53 2022] GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 => generated 1328 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:53.861505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3795733f-9af9-49d1-827a-c8ad330dd79e tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:53.862309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3795733f-9af9-49d1-827a-c8ad330dd79e tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:53.870049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3795733f-9af9-49d1-827a-c8ad330dd79e tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:53.870732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3795733f-9af9-49d1-827a-c8ad330dd79e tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:53.871816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3795733f-9af9-49d1-827a-c8ad330dd79e tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:53.872515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3795733f-9af9-49d1-827a-c8ad330dd79e tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:53.890721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d18f0b8c-b02d-47eb-ba16-eaca03a94856 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:53.906884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3795733f-9af9-49d1-827a-c8ad330dd79e tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:46:53.935531 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d18f0b8c-b02d-47eb-ba16-eaca03a94856 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1391 microversion: 2.1 time: 0.523701 Jul 20 04:46:53.940700 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2952/5667] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:53 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1391 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:53.967226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-fc403d93-a206-469a-a0d5-5ab7e1bee379 req-c95b54f5-69c7-44c9-a17a-b93486275307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87276588-6735-44b3-a99e-0ea3277b8985", "name": "network-vif-deleted", "tag": "c7b0323b-e024-4e23-8f51-b67a51cea504"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:54.009325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-fc403d93-a206-469a-a0d5-5ab7e1bee379 req-c95b54f5-69c7-44c9-a17a-b93486275307 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:54.011440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-fc403d93-a206-469a-a0d5-5ab7e1bee379 req-c95b54f5-69c7-44c9-a17a-b93486275307 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:54.058631 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-fc403d93-a206-469a-a0d5-5ab7e1bee379 req-c95b54f5-69c7-44c9-a17a-b93486275307 service nova] Creating event network-vif-deleted:c7b0323b-e024-4e23-8f51-b67a51cea504 for instance 87276588-6735-44b3-a99e-0ea3277b8985 on n-h1-826526-5 Jul 20 04:46:54.072632 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-fc403d93-a206-469a-a0d5-5ab7e1bee379 req-c95b54f5-69c7-44c9-a17a-b93486275307 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123557 Jul 20 04:46:54.074413 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2953/5668] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:54.098307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4714865d-128a-4f0c-ba0c-f80d76c3586a tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:54.099213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4714865d-128a-4f0c-ba0c-f80d76c3586a tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:54.123897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4714865d-128a-4f0c-ba0c-f80d76c3586a tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:54.124956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4714865d-128a-4f0c-ba0c-f80d76c3586a tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:54.126064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4714865d-128a-4f0c-ba0c-f80d76c3586a tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:54.128395 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4714865d-128a-4f0c-ba0c-f80d76c3586a tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:54.147692 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3795733f-9af9-49d1-827a-c8ad330dd79e tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "DELETE /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 204 len: 0 microversion: 2.1 time: 0.292315 Jul 20 04:46:54.151937 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2716/5669] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:46:53 2022] DELETE /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:46:54.162308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a226332d-8288-41c8-a37f-904f74e12e15 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:54.167004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a226332d-8288-41c8-a37f-904f74e12e15 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:54.178618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a226332d-8288-41c8-a37f-904f74e12e15 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:54.184835 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a226332d-8288-41c8-a37f-904f74e12e15 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:54.186060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a226332d-8288-41c8-a37f-904f74e12e15 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:54.186534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a226332d-8288-41c8-a37f-904f74e12e15 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:54.195946 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4714865d-128a-4f0c-ba0c-f80d76c3586a tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:54.198203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4714865d-128a-4f0c-ba0c-f80d76c3586a tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:54.198930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-4714865d-128a-4f0c-ba0c-f80d76c3586a tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lazy-loading 'fault' on Instance uuid 87276588-6735-44b3-a99e-0ea3277b8985 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:46:54.294752 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4714865d-128a-4f0c-ba0c-f80d76c3586a tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1453 microversion: 2.1 time: 0.216807 Jul 20 04:46:54.295364 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2954/5670] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:54 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1453 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:54.450413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a226332d-8288-41c8-a37f-904f74e12e15 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:54.460037 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a226332d-8288-41c8-a37f-904f74e12e15 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 200 len: 1511 microversion: 2.1 time: 0.306625 Jul 20 04:46:54.470942 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2717/5671] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:54 2022] GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 1511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:54.859818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1f597bba-c6ef-4fbd-8d21-b7233a16bd52 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:54.860790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1f597bba-c6ef-4fbd-8d21-b7233a16bd52 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:54.871305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f597bba-c6ef-4fbd-8d21-b7233a16bd52 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:54.874753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f597bba-c6ef-4fbd-8d21-b7233a16bd52 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:54.877525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f597bba-c6ef-4fbd-8d21-b7233a16bd52 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:54.881392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f597bba-c6ef-4fbd-8d21-b7233a16bd52 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:54.959365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2044882d-0b98-464e-b43f-ad537fd5812a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:54.960015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2044882d-0b98-464e-b43f-ad537fd5812a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:54.969100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2044882d-0b98-464e-b43f-ad537fd5812a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:54.969952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2044882d-0b98-464e-b43f-ad537fd5812a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:54.970353 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2044882d-0b98-464e-b43f-ad537fd5812a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:54.971040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2044882d-0b98-464e-b43f-ad537fd5812a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:54.997877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:55.235586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1f597bba-c6ef-4fbd-8d21-b7233a16bd52 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:55.252696 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1f597bba-c6ef-4fbd-8d21-b7233a16bd52 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307" status: 200 len: 1328 microversion: 2.1 time: 0.395694 Jul 20 04:46:55.253455 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2955/5672] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:54 2022] GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 => generated 1328 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:55.313512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f8dfb6c6-c7f5-4296-b103-f0f36d90c921 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:55.314969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f8dfb6c6-c7f5-4296-b103-f0f36d90c921 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:55.332734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8dfb6c6-c7f5-4296-b103-f0f36d90c921 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:55.337294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8dfb6c6-c7f5-4296-b103-f0f36d90c921 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:55.349763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8dfb6c6-c7f5-4296-b103-f0f36d90c921 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:55.350842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8dfb6c6-c7f5-4296-b103-f0f36d90c921 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:55.382462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:55.417415 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8dfb6c6-c7f5-4296-b103-f0f36d90c921 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:55.417876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8dfb6c6-c7f5-4296-b103-f0f36d90c921 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:55.418378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-f8dfb6c6-c7f5-4296-b103-f0f36d90c921 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lazy-loading 'fault' on Instance uuid 87276588-6735-44b3-a99e-0ea3277b8985 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:46:55.490305 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f8dfb6c6-c7f5-4296-b103-f0f36d90c921 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 200 len: 1453 microversion: 2.1 time: 0.179022 Jul 20 04:46:55.504305 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2956/5673] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:55 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 1453 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:55.510002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-400311ac-4d67-4fc1-af9d-923734f1b88b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:55.510646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-400311ac-4d67-4fc1-af9d-923734f1b88b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:55.519125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-400311ac-4d67-4fc1-af9d-923734f1b88b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:55.519591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-400311ac-4d67-4fc1-af9d-923734f1b88b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:55.520514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-400311ac-4d67-4fc1-af9d-923734f1b88b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:55.520967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-400311ac-4d67-4fc1-af9d-923734f1b88b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:55.587526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2044882d-0b98-464e-b43f-ad537fd5812a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:55.597946 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2044882d-0b98-464e-b43f-ad537fd5812a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1391 microversion: 2.1 time: 0.642754 Jul 20 04:46:55.609113 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2718/5674] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:54 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1391 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:55.959087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-400311ac-4d67-4fc1-af9d-923734f1b88b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:55.973912 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-400311ac-4d67-4fc1-af9d-923734f1b88b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 200 len: 1511 microversion: 2.1 time: 0.467002 Jul 20 04:46:55.975346 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2957/5675] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:55 2022] GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 1511 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:56.271414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-00bdcd6a-64a2-4e6e-b00c-c8000af7663b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:56.272521 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-00bdcd6a-64a2-4e6e-b00c-c8000af7663b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:56.281605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00bdcd6a-64a2-4e6e-b00c-c8000af7663b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:56.282614 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00bdcd6a-64a2-4e6e-b00c-c8000af7663b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:56.283743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00bdcd6a-64a2-4e6e-b00c-c8000af7663b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:56.284482 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00bdcd6a-64a2-4e6e-b00c-c8000af7663b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:56.522276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-032d8298-196b-454c-b7e9-14c6e01c3223 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:56.524093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-032d8298-196b-454c-b7e9-14c6e01c3223 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] [instance: 87276588-6735-44b3-a99e-0ea3277b8985] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:56.541576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-032d8298-196b-454c-b7e9-14c6e01c3223 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:56.543255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-032d8298-196b-454c-b7e9-14c6e01c3223 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:56.545854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-032d8298-196b-454c-b7e9-14c6e01c3223 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:56.546621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-032d8298-196b-454c-b7e9-14c6e01c3223 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:56.547365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:56.573516 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-032d8298-196b-454c-b7e9-14c6e01c3223 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] HTTP exception thrown: Instance 87276588-6735-44b3-a99e-0ea3277b8985 could not be found. Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-032d8298-196b-454c-b7e9-14c6e01c3223 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Request method failure captured: Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 HTTP/1.1 Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14h_xvR5D6J2hwcmeZZxdDe1Xf_pt1P_zEtTuJgcqVwV3FU__Fm2kPri1kCWEf4eFT7bMN9V6qibAKqOftWwUmhgMTFOPqbdR3iz9Q8ou1FhVb-sjEln6JpczR5UoDW9YouuXJJNlsAu42k6rNSkC0unYj801Z3id0tpr0Ujq0yJl40 Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 2dfab96c00554ef4a35d4822e0d24481 Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestServerMultinode-1808244016 Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2dfab96c00554ef4a35d4822e0d24481"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2dfab96c00554ef4a35d4822e0d24481"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2dfab96c00554ef4a35d4822e0d24481", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2dfab96c00554ef4a35d4822e0d24481"}]}] Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestServerMultinode-1808244016 Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 2dfab96c00554ef4a35d4822e0d24481 Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestServerMultinode-1808244016 Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestServerMultinode-1808244016-project-admin Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a7f0c106d01f4843aadc182d8a9559f2 Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestServerMultinode-1808244016-project-admin Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 87276588-6735-44b3-a99e-0ea3277b8985 could not be found. Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '87276588-6735-44b3-a99e-0ea3277b8985'} Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87276588-6735-44b3-a99e-0ea3277b8985 could not be found. Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87276588-6735-44b3-a99e-0ea3277b8985 could not be found. Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:56.576605 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:56.585324 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:56.585324 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:56.585324 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:56.585324 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:56.585324 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:56.585324 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87276588-6735-44b3-a99e-0ea3277b8985 could not be found. Jul 20 04:46:56.585324 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:56.585324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-032d8298-196b-454c-b7e9-14c6e01c3223 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] Returning 404 to user: Instance 87276588-6735-44b3-a99e-0ea3277b8985 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:56.585324 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-032d8298-196b-454c-b7e9-14c6e01c3223 tempest-TestServerMultinode-1808244016 tempest-TestServerMultinode-1808244016-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985" status: 404 len: 111 microversion: 2.1 time: 0.063028 Jul 20 04:46:56.585324 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2958/5676] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:56 2022] GET /compute/v2.1/servers/87276588-6735-44b3-a99e-0ea3277b8985 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:46:56.641837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b5be2ddd-53e8-45e0-979d-b744e33fe11f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:56.642949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b5be2ddd-53e8-45e0-979d-b744e33fe11f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:56.653052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5be2ddd-53e8-45e0-979d-b744e33fe11f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:56.653909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5be2ddd-53e8-45e0-979d-b744e33fe11f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:56.655595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5be2ddd-53e8-45e0-979d-b744e33fe11f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:56.656292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5be2ddd-53e8-45e0-979d-b744e33fe11f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:56.746447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-00bdcd6a-64a2-4e6e-b00c-c8000af7663b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:56.766090 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-00bdcd6a-64a2-4e6e-b00c-c8000af7663b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307" status: 200 len: 1328 microversion: 2.1 time: 0.497054 Jul 20 04:46:56.773728 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2719/5677] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:56 2022] GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 => generated 1328 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:56.787892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-50544d6a-feaa-4c5e-8a85-561119713d90 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:56.788450 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-50544d6a-feaa-4c5e-8a85-561119713d90 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:56.808355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50544d6a-feaa-4c5e-8a85-561119713d90 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:56.809183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50544d6a-feaa-4c5e-8a85-561119713d90 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:56.810258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50544d6a-feaa-4c5e-8a85-561119713d90 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:56.810883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50544d6a-feaa-4c5e-8a85-561119713d90 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:56.836859 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-50544d6a-feaa-4c5e-8a85-561119713d90 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] HTTP exception thrown: Instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 could not be found. Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-50544d6a-feaa-4c5e-8a85-561119713d90 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Request method failure captured: Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 HTTP/1.1 Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14dGzvYcPg3NF43f6ZRAI_AjtsB7nnPabtQnWEyYg-EXw30wVgvbZX3EBgp2DuSsT-UZ385yph2nVbWQKDH20kvx2xMXBhHcpx3bIjpA8OEQ9j_bQ2MqW2hbHHtIFQtSaphPYv0KfZxRo98jYdMcipaN9CmzRsyzwLTotDNtaeBR3wc Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b889ad56221143f0a54450c81ba738a7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}] Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: bc760e8f522640fc9190460719f5dcc2 Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 could not be found. Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '7252429e-bc8c-4074-bf46-54b6a7cecbf5'} Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 could not be found. Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:56.850628 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:56.855888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 could not be found. Jul 20 04:46:56.855888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:56.855888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:56.855888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:56.855888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:56.855888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:56.855888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:56.855888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:56.855888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:56.855888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 could not be found. Jul 20 04:46:56.855888 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:56.855888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-50544d6a-feaa-4c5e-8a85-561119713d90 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Returning 404 to user: Instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:56.855888 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-50544d6a-feaa-4c5e-8a85-561119713d90 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 404 len: 111 microversion: 2.1 time: 0.077668 Jul 20 04:46:56.855888 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2720/5678] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:46:56 2022] DELETE /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:46:56.867217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e306460d-68db-48df-9efa-160bb2c6f45c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:56.867868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e306460d-68db-48df-9efa-160bb2c6f45c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 7252429e-bc8c-4074-bf46-54b6a7cecbf5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:56.884727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e306460d-68db-48df-9efa-160bb2c6f45c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:56.886076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e306460d-68db-48df-9efa-160bb2c6f45c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:56.890679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e306460d-68db-48df-9efa-160bb2c6f45c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:56.891277 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e306460d-68db-48df-9efa-160bb2c6f45c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:56.923866 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-e306460d-68db-48df-9efa-160bb2c6f45c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] HTTP exception thrown: Instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 could not be found. Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e306460d-68db-48df-9efa-160bb2c6f45c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Request method failure captured: Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 HTTP/1.1 Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14dGzvYcPg3NF43f6ZRAI_AjtsB7nnPabtQnWEyYg-EXw30wVgvbZX3EBgp2DuSsT-UZ385yph2nVbWQKDH20kvx2xMXBhHcpx3bIjpA8OEQ9j_bQ2MqW2hbHHtIFQtSaphPYv0KfZxRo98jYdMcipaN9CmzRsyzwLTotDNtaeBR3wc Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b889ad56221143f0a54450c81ba738a7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}] Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: bc760e8f522640fc9190460719f5dcc2 Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 could not be found. Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '7252429e-bc8c-4074-bf46-54b6a7cecbf5'} Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 could not be found. Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 could not be found. Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:56.926796 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:56.932032 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:56.932032 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:56.932032 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:56.932032 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:56.932032 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:56.932032 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 could not be found. Jul 20 04:46:56.932032 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:46:56.933372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e306460d-68db-48df-9efa-160bb2c6f45c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Returning 404 to user: Instance 7252429e-bc8c-4074-bf46-54b6a7cecbf5 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:56.935946 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e306460d-68db-48df-9efa-160bb2c6f45c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5" status: 404 len: 111 microversion: 2.1 time: 0.073198 Jul 20 04:46:56.941529 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2721/5679] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:56 2022] GET /compute/v2.1/servers/7252429e-bc8c-4074-bf46-54b6a7cecbf5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:46:56.992532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2cdc1735-131c-49fe-9f4d-9dc10bb38172 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:56.993700 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2cdc1735-131c-49fe-9f4d-9dc10bb38172 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:57.008016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cdc1735-131c-49fe-9f4d-9dc10bb38172 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:57.009339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cdc1735-131c-49fe-9f4d-9dc10bb38172 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:57.010727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cdc1735-131c-49fe-9f4d-9dc10bb38172 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:57.011705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cdc1735-131c-49fe-9f4d-9dc10bb38172 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:57.044112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b5be2ddd-53e8-45e0-979d-b744e33fe11f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:57.053714 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b5be2ddd-53e8-45e0-979d-b744e33fe11f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1391 microversion: 2.1 time: 0.416159 Jul 20 04:46:57.058342 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2959/5680] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:56 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1391 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:57.410403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2cdc1735-131c-49fe-9f4d-9dc10bb38172 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:57.430094 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2cdc1735-131c-49fe-9f4d-9dc10bb38172 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 200 len: 1469 microversion: 2.1 time: 0.442007 Jul 20 04:46:57.436486 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2722/5681] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:56 2022] GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 1469 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:57.627427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-70290338-66e5-41d7-a7c2-9269411b95b6 req-88712535-bc0c-4e13-9eb3-4ae7c8739f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52498332-97f4-4f2c-8f6a-5803b2c641b3", "name": "network-vif-deleted", "tag": "df7eccce-ba78-48b2-bd95-245614ee75bc"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:57.639763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=16 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:57.645866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-70290338-66e5-41d7-a7c2-9269411b95b6 req-88712535-bc0c-4e13-9eb3-4ae7c8739f20 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:57.646761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-70290338-66e5-41d7-a7c2-9269411b95b6 req-88712535-bc0c-4e13-9eb3-4ae7c8739f20 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:57.673712 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-70290338-66e5-41d7-a7c2-9269411b95b6 req-88712535-bc0c-4e13-9eb3-4ae7c8739f20 service nova] Creating event network-vif-deleted:df7eccce-ba78-48b2-bd95-245614ee75bc for instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 on n-h1-826526-5 Jul 20 04:46:57.690009 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-70290338-66e5-41d7-a7c2-9269411b95b6 req-88712535-bc0c-4e13-9eb3-4ae7c8739f20 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067686 Jul 20 04:46:57.691181 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2960/5682] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:57.699590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-4d2af2c5-4da7-4874-958d-77bce4f0ed69 req-152bdb10-14e0-4d38-8579-22fb961297bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f97abf1-25eb-4320-9fec-849f74260307", "name": "network-vif-plugged", "status": "completed", "tag": "a7322cee-f5a4-4357-9059-eddc203b80a2"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:57.718120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4d2af2c5-4da7-4874-958d-77bce4f0ed69 req-152bdb10-14e0-4d38-8579-22fb961297bd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:57.720949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4d2af2c5-4da7-4874-958d-77bce4f0ed69 req-152bdb10-14e0-4d38-8579-22fb961297bd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:57.745341 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-4d2af2c5-4da7-4874-958d-77bce4f0ed69 req-152bdb10-14e0-4d38-8579-22fb961297bd service nova] Creating event network-vif-plugged:a7322cee-f5a4-4357-9059-eddc203b80a2 for instance 9f97abf1-25eb-4320-9fec-849f74260307 on n-h2-826526-5 Jul 20 04:46:57.752596 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-4d2af2c5-4da7-4874-958d-77bce4f0ed69 req-152bdb10-14e0-4d38-8579-22fb961297bd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058202 Jul 20 04:46:57.754319 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2723/5683] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:57.793480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2d403511-ec12-48ba-bb47-04038bc29279 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:57.794354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2d403511-ec12-48ba-bb47-04038bc29279 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:57.808405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d403511-ec12-48ba-bb47-04038bc29279 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:57.814828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d403511-ec12-48ba-bb47-04038bc29279 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:57.816921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d403511-ec12-48ba-bb47-04038bc29279 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:57.818088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d403511-ec12-48ba-bb47-04038bc29279 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:58.075170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d94c2943-3da4-4f6c-9af2-f71458d6390a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:58.076379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d94c2943-3da4-4f6c-9af2-f71458d6390a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:58.094503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d94c2943-3da4-4f6c-9af2-f71458d6390a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:58.095432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d94c2943-3da4-4f6c-9af2-f71458d6390a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:58.096302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d94c2943-3da4-4f6c-9af2-f71458d6390a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:58.097436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d94c2943-3da4-4f6c-9af2-f71458d6390a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:58.201865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2d403511-ec12-48ba-bb47-04038bc29279 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:58.213837 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2d403511-ec12-48ba-bb47-04038bc29279 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307" status: 200 len: 1328 microversion: 2.1 time: 0.427330 Jul 20 04:46:58.215561 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2961/5684] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:57 2022] GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 => generated 1328 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:58.232316 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8a481490-2ef8-4b87-9ffe-f4761d242188 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:58.233264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8a481490-2ef8-4b87-9ffe-f4761d242188 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:58.248161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a481490-2ef8-4b87-9ffe-f4761d242188 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:58.248967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a481490-2ef8-4b87-9ffe-f4761d242188 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:58.249965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a481490-2ef8-4b87-9ffe-f4761d242188 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:58.250589 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8a481490-2ef8-4b87-9ffe-f4761d242188 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:58.281595 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-8a481490-2ef8-4b87-9ffe-f4761d242188 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] HTTP exception thrown: Instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff could not be found. Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8a481490-2ef8-4b87-9ffe-f4761d242188 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Request method failure captured: Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff HTTP/1.1 Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14dGzvYcPg3NF43f6ZRAI_AjtsB7nnPabtQnWEyYg-EXw30wVgvbZX3EBgp2DuSsT-UZ385yph2nVbWQKDH20kvx2xMXBhHcpx3bIjpA8OEQ9j_bQ2MqW2hbHHtIFQtSaphPYv0KfZxRo98jYdMcipaN9CmzRsyzwLTotDNtaeBR3wc Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b889ad56221143f0a54450c81ba738a7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}] Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: bc760e8f522640fc9190460719f5dcc2 Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff could not be found. Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'a7fed1e7-12d5-4f39-9c2a-65e4dd681aff'} Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff could not be found. Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:58.286426 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:58.292242 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff could not be found. Jul 20 04:46:58.292242 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.292242 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:58.292242 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.292242 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:58.292242 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:58.292242 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:58.292242 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:58.292242 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:58.292242 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff could not be found. Jul 20 04:46:58.292242 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.292242 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8a481490-2ef8-4b87-9ffe-f4761d242188 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Returning 404 to user: Instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:58.292242 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8a481490-2ef8-4b87-9ffe-f4761d242188 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 404 len: 111 microversion: 2.1 time: 0.071346 Jul 20 04:46:58.292242 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2962/5685] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:46:58 2022] DELETE /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:46:58.313389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-031081e0-7a68-4402-8d95-20ec7d7b1cb4 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:58.315945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-031081e0-7a68-4402-8d95-20ec7d7b1cb4 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: a7fed1e7-12d5-4f39-9c2a-65e4dd681aff] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:58.327356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-031081e0-7a68-4402-8d95-20ec7d7b1cb4 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:58.331042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-031081e0-7a68-4402-8d95-20ec7d7b1cb4 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:58.332065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-031081e0-7a68-4402-8d95-20ec7d7b1cb4 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:58.332763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-031081e0-7a68-4402-8d95-20ec7d7b1cb4 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:58.353826 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-031081e0-7a68-4402-8d95-20ec7d7b1cb4 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] HTTP exception thrown: Instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff could not be found. Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-031081e0-7a68-4402-8d95-20ec7d7b1cb4 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Request method failure captured: Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff HTTP/1.1 Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14dGzvYcPg3NF43f6ZRAI_AjtsB7nnPabtQnWEyYg-EXw30wVgvbZX3EBgp2DuSsT-UZ385yph2nVbWQKDH20kvx2xMXBhHcpx3bIjpA8OEQ9j_bQ2MqW2hbHHtIFQtSaphPYv0KfZxRo98jYdMcipaN9CmzRsyzwLTotDNtaeBR3wc Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b889ad56221143f0a54450c81ba738a7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}] Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: bc760e8f522640fc9190460719f5dcc2 Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff could not be found. Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'a7fed1e7-12d5-4f39-9c2a-65e4dd681aff'} Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff could not be found. Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff could not be found. Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:58.355621 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.366787 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:58.366787 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:58.366787 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:58.366787 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:58.366787 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:58.366787 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff could not be found. Jul 20 04:46:58.366787 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.366787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-031081e0-7a68-4402-8d95-20ec7d7b1cb4 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Returning 404 to user: Instance a7fed1e7-12d5-4f39-9c2a-65e4dd681aff could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:58.366787 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-031081e0-7a68-4402-8d95-20ec7d7b1cb4 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff" status: 404 len: 111 microversion: 2.1 time: 0.063034 Jul 20 04:46:58.366787 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2963/5686] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:58 2022] GET /compute/v2.1/servers/a7fed1e7-12d5-4f39-9c2a-65e4dd681aff => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:46:58.470788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-14afc75a-f2cd-45c1-b31c-e7f210d3b983 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:58.471801 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-14afc75a-f2cd-45c1-b31c-e7f210d3b983 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:58.479444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14afc75a-f2cd-45c1-b31c-e7f210d3b983 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:58.480161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14afc75a-f2cd-45c1-b31c-e7f210d3b983 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:58.481303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14afc75a-f2cd-45c1-b31c-e7f210d3b983 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:58.481917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14afc75a-f2cd-45c1-b31c-e7f210d3b983 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:58.511964 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-14afc75a-f2cd-45c1-b31c-e7f210d3b983 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-14afc75a-f2cd-45c1-b31c-e7f210d3b983 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 HTTP/1.1 Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '52498332-97f4-4f2c-8f6a-5803b2c641b3'} Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:58.514646 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.520706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:58.520706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:58.520706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:58.520706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:58.520706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:58.520706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:46:58.520706 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.522715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-14afc75a-f2cd-45c1-b31c-e7f210d3b983 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:58.523804 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-14afc75a-f2cd-45c1-b31c-e7f210d3b983 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 404 len: 111 microversion: 2.1 time: 0.068541 Jul 20 04:46:58.524951 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2964/5687] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:58 2022] GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:46:58.530997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-130c886e-4ef8-40c9-9df4-4940366950be tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Action: 'create', calling method: .version_select at 0x7f06bd36d310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1993339905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYbEt47W8lJfKaYj4xLxFc9Aa/IhKvmSeuH/jBCgtMyfr4qAqhExQCDmXVBsJO5es3F39qJG/ZHAPIV75pDO4F9IJ0f0rS88IAJGyJ8MO0nDnUQ7LYHCafmyLo8tN8D/Q=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:58.533240 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d94c2943-3da4-4f6c-9af2-f71458d6390a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:58.541761 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d94c2943-3da4-4f6c-9af2-f71458d6390a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1391 microversion: 2.1 time: 0.471751 Jul 20 04:46:58.545475 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2724/5688] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:58 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1391 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:58.549568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-130c886e-4ef8-40c9-9df4-4940366950be tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Getting quotas for project b889ad56221143f0a54450c81ba738a7. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:46:58.556091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-130c886e-4ef8-40c9-9df4-4940366950be tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Getting quotas for user bc760e8f522640fc9190460719f5dcc2 and project b889ad56221143f0a54450c81ba738a7. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:46:58.562339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-399755b7-894b-4e54-863f-6e6533c0c07b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:58.565298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-399755b7-894b-4e54-863f-6e6533c0c07b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:58.581795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-399755b7-894b-4e54-863f-6e6533c0c07b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:58.582384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-399755b7-894b-4e54-863f-6e6533c0c07b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:58.583299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-399755b7-894b-4e54-863f-6e6533c0c07b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:58.583828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-399755b7-894b-4e54-863f-6e6533c0c07b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:58.586282 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-130c886e-4ef8-40c9-9df4-4940366950be tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.059907 Jul 20 04:46:58.587650 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2965/5689] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:46:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:58.913161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-399755b7-894b-4e54-863f-6e6533c0c07b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:58.926819 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-399755b7-894b-4e54-863f-6e6533c0c07b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.368888 Jul 20 04:46:58.930052 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2725/5690] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:58 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:59.182296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-628ae6ce-8246-4703-990b-37e7144a88d2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-628ae6ce-8246-4703-990b-37e7144a88d2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 163 Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: {"server": {"name": 12345, "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'networks': [{'uuid': '251a4e63-1968-40ea-8261-3caafe352db6'}]}}} Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 12345 Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:46:59.186796 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:46:59.195094 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:46:59.195094 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 20 04:46:59.195094 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:59.195094 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:59.195094 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:59.195094 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:59.195094 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:59.195094 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:59.195094 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:46:59.195094 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:46:59.195094 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 20 04:46:59.195094 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:46:59.199405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-628ae6ce-8246-4703-990b-37e7144a88d2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:59.201434 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-628ae6ce-8246-4703-990b-37e7144a88d2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.024228 Jul 20 04:46:59.203102 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2966/5691] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:46:59 2022] POST /compute/v2.1/servers => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:46:59.211823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0dc826d5-5188-4e9f-853e-812fb33ea4f8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:59.212508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0dc826d5-5188-4e9f-853e-812fb33ea4f8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:59.220367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0dc826d5-5188-4e9f-853e-812fb33ea4f8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:59.221431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0dc826d5-5188-4e9f-853e-812fb33ea4f8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:59.222536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0dc826d5-5188-4e9f-853e-812fb33ea4f8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:59.223240 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0dc826d5-5188-4e9f-853e-812fb33ea4f8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:59.241752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-39a90920-5e5e-4b95-b7bf-9e0e22a96f5a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:59.242786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-39a90920-5e5e-4b95-b7bf-9e0e22a96f5a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:59.277458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39a90920-5e5e-4b95-b7bf-9e0e22a96f5a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:59.277928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39a90920-5e5e-4b95-b7bf-9e0e22a96f5a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:59.278746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39a90920-5e5e-4b95-b7bf-9e0e22a96f5a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:59.279174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39a90920-5e5e-4b95-b7bf-9e0e22a96f5a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:59.546082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-39a90920-5e5e-4b95-b7bf-9e0e22a96f5a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:59.562142 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-39a90920-5e5e-4b95-b7bf-9e0e22a96f5a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307" status: 200 len: 1328 microversion: 2.1 time: 0.333211 Jul 20 04:46:59.562748 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2967/5692] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:59 2022] GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 => generated 1328 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:59.567692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6242febc-5c48-4283-b032-4dfe2388af9d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:59.568355 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6242febc-5c48-4283-b032-4dfe2388af9d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:59.577015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6242febc-5c48-4283-b032-4dfe2388af9d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:59.577742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6242febc-5c48-4283-b032-4dfe2388af9d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:59.578688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6242febc-5c48-4283-b032-4dfe2388af9d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:59.579567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6242febc-5c48-4283-b032-4dfe2388af9d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:59.724437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0dc826d5-5188-4e9f-853e-812fb33ea4f8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:59.745095 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0dc826d5-5188-4e9f-853e-812fb33ea4f8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.536243 Jul 20 04:46:59.747170 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2726/5693] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:59 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:59.771841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-80269cac-d3ec-40d7-80a9-f8ac919e3d4b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:59.773378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-80269cac-d3ec-40d7-80a9-f8ac919e3d4b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:59.783909 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80269cac-d3ec-40d7-80a9-f8ac919e3d4b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:59.784638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80269cac-d3ec-40d7-80a9-f8ac919e3d4b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:59.785701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80269cac-d3ec-40d7-80a9-f8ac919e3d4b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:59.786319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80269cac-d3ec-40d7-80a9-f8ac919e3d4b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:59.918953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6242febc-5c48-4283-b032-4dfe2388af9d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:59.950421 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6242febc-5c48-4283-b032-4dfe2388af9d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1391 microversion: 2.1 time: 0.386194 Jul 20 04:46:59.961504 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2968/5694] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:59 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1391 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:00.162770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-80269cac-d3ec-40d7-80a9-f8ac919e3d4b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:00.181894 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-80269cac-d3ec-40d7-80a9-f8ac919e3d4b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.415701 Jul 20 04:47:00.184004 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2727/5695] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:59 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:00.582936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b24a9850-40f6-4eca-9bbc-bdedfef47e45 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:00.584780 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b24a9850-40f6-4eca-9bbc-bdedfef47e45 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:00.605103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b24a9850-40f6-4eca-9bbc-bdedfef47e45 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:00.613882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b24a9850-40f6-4eca-9bbc-bdedfef47e45 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:00.622365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b24a9850-40f6-4eca-9bbc-bdedfef47e45 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:00.623676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b24a9850-40f6-4eca-9bbc-bdedfef47e45 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:00.988772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9b007048-46f6-4c71-abb0-f74505cd24d7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:00.990302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9b007048-46f6-4c71-abb0-f74505cd24d7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:01.019756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9b007048-46f6-4c71-abb0-f74505cd24d7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:01.019966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9b007048-46f6-4c71-abb0-f74505cd24d7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:01.020882 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9b007048-46f6-4c71-abb0-f74505cd24d7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:01.022755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9b007048-46f6-4c71-abb0-f74505cd24d7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:01.091647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b24a9850-40f6-4eca-9bbc-bdedfef47e45 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:01.104425 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b24a9850-40f6-4eca-9bbc-bdedfef47e45 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307" status: 200 len: 1510 microversion: 2.1 time: 0.529194 Jul 20 04:47:01.106007 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2969/5696] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:00 2022] GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 => generated 1510 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:01.123164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-32ef1954-36cb-4cf7-aedf-f3a36f8370fa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:01.129076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-32ef1954-36cb-4cf7-aedf-f3a36f8370fa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:01.137775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32ef1954-36cb-4cf7-aedf-f3a36f8370fa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:01.142851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32ef1954-36cb-4cf7-aedf-f3a36f8370fa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:01.145725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32ef1954-36cb-4cf7-aedf-f3a36f8370fa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:01.146310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32ef1954-36cb-4cf7-aedf-f3a36f8370fa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:01.324438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9b007048-46f6-4c71-abb0-f74505cd24d7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:01.333163 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9b007048-46f6-4c71-abb0-f74505cd24d7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1391 microversion: 2.1 time: 0.352621 Jul 20 04:47:01.338351 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2728/5697] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:00 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1391 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:01.698795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-32ef1954-36cb-4cf7-aedf-f3a36f8370fa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:01.717521 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-32ef1954-36cb-4cf7-aedf-f3a36f8370fa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307" status: 200 len: 1510 microversion: 2.1 time: 0.599624 Jul 20 04:47:01.732197 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2970/5698] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:01 2022] GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 => generated 1510 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:01.737662 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ce524226-ac94-486c-bf56-26ecb3252f3c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:01.738372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ce524226-ac94-486c-bf56-26ecb3252f3c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:01.758392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce524226-ac94-486c-bf56-26ecb3252f3c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:01.758871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce524226-ac94-486c-bf56-26ecb3252f3c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:01.761930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce524226-ac94-486c-bf56-26ecb3252f3c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:01.765538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce524226-ac94-486c-bf56-26ecb3252f3c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:01.827180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ce524226-ac94-486c-bf56-26ecb3252f3c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:47:02.033930 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ce524226-ac94-486c-bf56-26ecb3252f3c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307" status: 204 len: 0 microversion: 2.1 time: 0.300815 Jul 20 04:47:02.034678 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2729/5699] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:47:01 2022] DELETE /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:47:02.044479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-68edd394-39ea-4394-8a58-fcb013ea3c66 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:02.045750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-68edd394-39ea-4394-8a58-fcb013ea3c66 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:02.060040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68edd394-39ea-4394-8a58-fcb013ea3c66 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:02.069381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68edd394-39ea-4394-8a58-fcb013ea3c66 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:02.070726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68edd394-39ea-4394-8a58-fcb013ea3c66 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:02.071525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68edd394-39ea-4394-8a58-fcb013ea3c66 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:02.355984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-00d815b1-e5f7-4427-ad72-fe1f84819b01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:02.360683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-00d815b1-e5f7-4427-ad72-fe1f84819b01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:02.372779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00d815b1-e5f7-4427-ad72-fe1f84819b01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:02.374473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00d815b1-e5f7-4427-ad72-fe1f84819b01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:02.377019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00d815b1-e5f7-4427-ad72-fe1f84819b01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:02.378076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00d815b1-e5f7-4427-ad72-fe1f84819b01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:02.414100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-68edd394-39ea-4394-8a58-fcb013ea3c66 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:02.424931 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-68edd394-39ea-4394-8a58-fcb013ea3c66 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307" status: 200 len: 1516 microversion: 2.1 time: 0.385160 Jul 20 04:47:02.426616 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2971/5700] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:02 2022] GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 => generated 1516 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:02.527689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-050c3e9e-6bfa-41ee-9e3a-65d75cacc1cb req-f0333ea0-540a-4df2-840b-fefec9b53d2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9cbd595-7323-4d8a-b0d1-da8952f04529", "name": "network-vif-plugged", "status": "completed", "tag": "4fe14c15-fa2a-465e-8d12-695d6280d0e2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:02.551792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-050c3e9e-6bfa-41ee-9e3a-65d75cacc1cb req-f0333ea0-540a-4df2-840b-fefec9b53d2b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:02.554649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-050c3e9e-6bfa-41ee-9e3a-65d75cacc1cb req-f0333ea0-540a-4df2-840b-fefec9b53d2b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:02.571978 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-050c3e9e-6bfa-41ee-9e3a-65d75cacc1cb req-f0333ea0-540a-4df2-840b-fefec9b53d2b service nova] Creating event network-vif-plugged:4fe14c15-fa2a-465e-8d12-695d6280d0e2 for instance f9cbd595-7323-4d8a-b0d1-da8952f04529 on n-h1-826526-5 Jul 20 04:47:02.579166 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-050c3e9e-6bfa-41ee-9e3a-65d75cacc1cb req-f0333ea0-540a-4df2-840b-fefec9b53d2b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061339 Jul 20 04:47:02.595675 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2972/5701] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:02.895686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-00d815b1-e5f7-4427-ad72-fe1f84819b01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:02.918912 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-00d815b1-e5f7-4427-ad72-fe1f84819b01 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1391 microversion: 2.1 time: 0.569197 Jul 20 04:47:02.932299 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2730/5702] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:02 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1391 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:03.167581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ff5582d1-51ee-4ce4-a5d4-3977f3b5b7fe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1438498324", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "0f9716c4-e1bc-4f5f-bc46-d600581f7f67", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:03.288017 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-ff5582d1-51ee-4ce4-a5d4-3977f3b5b7fe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Block Device 0f9716c4-e1bc-4f5f-bc46-d600581f7f67 is not bootable. Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ff5582d1-51ee-4ce4-a5d4-3977f3b5b7fe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 358 Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1438498324", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "0f9716c4-e1bc-4f5f-bc46-d600581f7f67", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: exception: Block Device 0f9716c4-e1bc-4f5f-bc46-d600581f7f67 is not bootable. Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1438498324', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '0f9716c4-e1bc-4f5f-bc46-d600581f7f67'}], 'networks': [{'uuid': '251a4e63-1968-40ea-8261-3caafe352db6'}]}}} Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 0f9716c4-e1bc-4f5f-bc46-d600581f7f67 is not bootable. Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:03.298080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:03.302999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:03.302999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:03.302999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:03.302999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:47:03.302999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 04:47:03.302999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:47:03.302999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 0f9716c4-e1bc-4f5f-bc46-d600581f7f67 is not bootable. Jul 20 04:47:03.302999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:03.302999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:03.302999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:03.302999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:03.302999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:03.302999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:03.302999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:03.302999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:03.302999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 0f9716c4-e1bc-4f5f-bc46-d600581f7f67 is not bootable. Jul 20 04:47:03.302999 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:03.311762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ff5582d1-51ee-4ce4-a5d4-3977f3b5b7fe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 400 to user: Block Device 0f9716c4-e1bc-4f5f-bc46-d600581f7f67 is not bootable. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:03.313408 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ff5582d1-51ee-4ce4-a5d4-3977f3b5b7fe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.151675 Jul 20 04:47:03.314816 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2973/5703] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:03 2022] POST /compute/v2.1/servers => generated 110 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:47:03.325032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c6723dc0-0568-4219-803f-1d33d946124a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:03.325673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c6723dc0-0568-4219-803f-1d33d946124a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:03.332331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6723dc0-0568-4219-803f-1d33d946124a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:03.332797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6723dc0-0568-4219-803f-1d33d946124a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:03.333668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6723dc0-0568-4219-803f-1d33d946124a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:03.334200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6723dc0-0568-4219-803f-1d33d946124a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:03.340231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:03.445480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e1badc93-d34a-49bd-8434-46c70d304c3f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:03.447032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e1badc93-d34a-49bd-8434-46c70d304c3f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:03.458679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1badc93-d34a-49bd-8434-46c70d304c3f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:03.460036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1badc93-d34a-49bd-8434-46c70d304c3f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:03.462157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1badc93-d34a-49bd-8434-46c70d304c3f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:03.463325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1badc93-d34a-49bd-8434-46c70d304c3f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:03.786994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c6723dc0-0568-4219-803f-1d33d946124a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:03.804997 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c6723dc0-0568-4219-803f-1d33d946124a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.485854 Jul 20 04:47:03.806516 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2731/5704] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:03 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:03.825842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-940cb5cc-f113-47ba-a837-3f5c49093498 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:03.826819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-940cb5cc-f113-47ba-a837-3f5c49093498 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:03.851931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e1badc93-d34a-49bd-8434-46c70d304c3f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:03.852794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-940cb5cc-f113-47ba-a837-3f5c49093498 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:03.854220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-940cb5cc-f113-47ba-a837-3f5c49093498 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:03.858337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-940cb5cc-f113-47ba-a837-3f5c49093498 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:03.858448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-940cb5cc-f113-47ba-a837-3f5c49093498 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:03.863755 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e1badc93-d34a-49bd-8434-46c70d304c3f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307" status: 200 len: 1516 microversion: 2.1 time: 0.425161 Jul 20 04:47:03.865762 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2974/5705] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:03 2022] GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 => generated 1516 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:03.945048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c54761d-2b7b-43ca-afe6-25e6bda98015 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:03.945667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0c54761d-2b7b-43ca-afe6-25e6bda98015 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:03.956289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c54761d-2b7b-43ca-afe6-25e6bda98015 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:03.956752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c54761d-2b7b-43ca-afe6-25e6bda98015 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:03.957545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c54761d-2b7b-43ca-afe6-25e6bda98015 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:03.957979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c54761d-2b7b-43ca-afe6-25e6bda98015 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:04.410161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0c54761d-2b7b-43ca-afe6-25e6bda98015 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:04.418682 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0c54761d-2b7b-43ca-afe6-25e6bda98015 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1391 microversion: 2.1 time: 0.478173 Jul 20 04:47:04.419378 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2975/5706] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:03 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1391 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:04.459815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-940cb5cc-f113-47ba-a837-3f5c49093498 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:04.503021 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-940cb5cc-f113-47ba-a837-3f5c49093498 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.665451 Jul 20 04:47:04.504966 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2732/5707] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:03 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:04.671603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-eaaabdc9-b1ae-47da-9903-2ff777079cbf req-eaa7cea5-96d5-4801-92d7-4c9c18b50356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f97abf1-25eb-4320-9fec-849f74260307", "name": "network-vif-deleted", "tag": "a7322cee-f5a4-4357-9059-eddc203b80a2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:04.708920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-eaaabdc9-b1ae-47da-9903-2ff777079cbf req-eaa7cea5-96d5-4801-92d7-4c9c18b50356 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:04.709379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-eaaabdc9-b1ae-47da-9903-2ff777079cbf req-eaa7cea5-96d5-4801-92d7-4c9c18b50356 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:04.753949 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-eaaabdc9-b1ae-47da-9903-2ff777079cbf req-eaa7cea5-96d5-4801-92d7-4c9c18b50356 service nova] Creating event network-vif-deleted:a7322cee-f5a4-4357-9059-eddc203b80a2 for instance 9f97abf1-25eb-4320-9fec-849f74260307 on n-h2-826526-5 Jul 20 04:47:04.767917 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-eaaabdc9-b1ae-47da-9903-2ff777079cbf req-eaa7cea5-96d5-4801-92d7-4c9c18b50356 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103070 Jul 20 04:47:04.774039 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2976/5708] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:04.900716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-819f87a7-4956-4e24-9beb-0a27a00d31a3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:04.901754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-819f87a7-4956-4e24-9beb-0a27a00d31a3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:04.939116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-819f87a7-4956-4e24-9beb-0a27a00d31a3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:04.943821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-819f87a7-4956-4e24-9beb-0a27a00d31a3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:04.953754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-819f87a7-4956-4e24-9beb-0a27a00d31a3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:04.961813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-819f87a7-4956-4e24-9beb-0a27a00d31a3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:05.345624 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-819f87a7-4956-4e24-9beb-0a27a00d31a3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:05.354521 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-819f87a7-4956-4e24-9beb-0a27a00d31a3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307" status: 200 len: 1313 microversion: 2.1 time: 0.461330 Jul 20 04:47:05.369806 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2733/5709] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:04 2022] GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 => generated 1313 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:05.437132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cc2a67fc-99e2-4c70-9e95-8c9db2102702 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:05.437890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cc2a67fc-99e2-4c70-9e95-8c9db2102702 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:05.456640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc2a67fc-99e2-4c70-9e95-8c9db2102702 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:05.457091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc2a67fc-99e2-4c70-9e95-8c9db2102702 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:05.457879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc2a67fc-99e2-4c70-9e95-8c9db2102702 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:05.458318 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc2a67fc-99e2-4c70-9e95-8c9db2102702 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:05.729405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cc2a67fc-99e2-4c70-9e95-8c9db2102702 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:05.743491 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cc2a67fc-99e2-4c70-9e95-8c9db2102702 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1563 microversion: 2.1 time: 0.311225 Jul 20 04:47:05.763622 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2977/5710] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:05 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1563 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:05.767303 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7aae05f3-7fd9-4a5f-8a69-4741921ff60b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:05.767948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7aae05f3-7fd9-4a5f-8a69-4741921ff60b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:05.779467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7aae05f3-7fd9-4a5f-8a69-4741921ff60b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:05.779946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7aae05f3-7fd9-4a5f-8a69-4741921ff60b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:05.780832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7aae05f3-7fd9-4a5f-8a69-4741921ff60b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:05.781304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7aae05f3-7fd9-4a5f-8a69-4741921ff60b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:06.339569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-23235d64-1931-435b-b3b2-66f4d1e9a103 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:06.347355 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-23235d64-1931-435b-b3b2-66f4d1e9a103 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:06.348381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-23235d64-1931-435b-b3b2-66f4d1e9a103 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:06.375968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-23235d64-1931-435b-b3b2-66f4d1e9a103 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Going to try to stop instance {{(pid=127871) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:47:06.451781 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-23235d64-1931-435b-b3b2-66f4d1e9a103 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "POST /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf/action" status: 202 len: 0 microversion: 2.1 time: 0.115879 Jul 20 04:47:06.460664 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2978/5711] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:06 2022] POST /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:47:06.474045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2eda252f-0c2f-40e6-91eb-305d0cb9813a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:06.475645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2eda252f-0c2f-40e6-91eb-305d0cb9813a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:06.490985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2eda252f-0c2f-40e6-91eb-305d0cb9813a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:06.492891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2eda252f-0c2f-40e6-91eb-305d0cb9813a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:06.496137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2eda252f-0c2f-40e6-91eb-305d0cb9813a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:06.497336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2eda252f-0c2f-40e6-91eb-305d0cb9813a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:06.512575 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:06.553190 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-2eda252f-0c2f-40e6-91eb-305d0cb9813a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance 9f97abf1-25eb-4320-9fec-849f74260307 could not be found. Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2eda252f-0c2f-40e6-91eb-305d0cb9813a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 HTTP/1.1 Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 9f97abf1-25eb-4320-9fec-849f74260307 could not be found. Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '9f97abf1-25eb-4320-9fec-849f74260307'} Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f97abf1-25eb-4320-9fec-849f74260307 could not be found. Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f97abf1-25eb-4320-9fec-849f74260307 could not be found. Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:06.558686 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:06.563879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:06.563879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:06.563879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:06.563879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:06.563879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f97abf1-25eb-4320-9fec-849f74260307 could not be found. Jul 20 04:47:06.563879 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:06.563879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2eda252f-0c2f-40e6-91eb-305d0cb9813a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance 9f97abf1-25eb-4320-9fec-849f74260307 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:06.563879 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2eda252f-0c2f-40e6-91eb-305d0cb9813a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307" status: 404 len: 111 microversion: 2.1 time: 0.098908 Jul 20 04:47:06.563879 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2979/5712] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:06 2022] GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:06.570805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c6278a58-218e-46f4-a173-a622acb73fa1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:06.571491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c6278a58-218e-46f4-a173-a622acb73fa1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:06.580543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6278a58-218e-46f4-a173-a622acb73fa1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:06.581157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6278a58-218e-46f4-a173-a622acb73fa1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:06.581972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6278a58-218e-46f4-a173-a622acb73fa1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:06.582409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6278a58-218e-46f4-a173-a622acb73fa1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:06.835979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c6278a58-218e-46f4-a173-a622acb73fa1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:06.847667 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c6278a58-218e-46f4-a173-a622acb73fa1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1721 microversion: 2.1 time: 0.283127 Jul 20 04:47:06.848281 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2980/5713] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:06 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1721 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:06.869297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-16e86817-00b7-403c-b11b-2b1e4efa331a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '.version_select at 0x7f06bd3a54c0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:06.872675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7aae05f3-7fd9-4a5f-8a69-4741921ff60b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:06.886804 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7aae05f3-7fd9-4a5f-8a69-4741921ff60b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1563 microversion: 2.1 time: 1.123394 Jul 20 04:47:06.901146 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2734/5714] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:05 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1563 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:06.901732 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-16e86817-00b7-403c-b11b-2b1e4efa331a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-key-868612073" status: 202 len: 0 microversion: 2.1 time: 0.045364 Jul 20 04:47:06.902519 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2981/5715] 10.222.0.17 () {58 vars in 1205 bytes} [Wed Jul 20 04:47:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-868612073 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:47:07.087943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fbb46b8c-ff67-45d3-b39e-6c0439ae942a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-957825597", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "3d22ba6e-7662-4637-bb0f-d3084b1def5c"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:07.216023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-fbb46b8c-ff67-45d3-b39e-6c0439ae942a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] validate_networks() for [('3d22ba6e-7662-4637-bb0f-d3084b1def5c', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:47:07.624297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4a0680de-6271-443d-947b-59f558b2482c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1119406810", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "destination_type": "local"}, {"source_type": "volume", "uuid": "ab6b1d2d-d652-486f-9fc1-9149421efdc9", "destination_type": "invalid"}], "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4a0680de-6271-443d-947b-59f558b2482c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 495 Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1119406810", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "destination_type": "local"}, {"source_type": "volume", "uuid": "ab6b1d2d-d652-486f-9fc1-9149421efdc9", "destination_type": "invalid"}], "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1119406810', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'ab6b1d2d-d652-486f-9fc1-9149421efdc9', 'destination_type': 'invalid'}], 'networks': [{'uuid': '251a4e63-1968-40ea-8261-3caafe352db6'}]}}} Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:07.635280 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4a0680de-6271-443d-947b-59f558b2482c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:07.639595 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4a0680de-6271-443d-947b-59f558b2482c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.017764 Jul 20 04:47:07.642594 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2982/5716] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:07 2022] POST /compute/v2.1/servers => generated 155 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:47:07.652191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-affcbb14-313d-4879-b708-bc331708d5dd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:07.652856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-affcbb14-313d-4879-b708-bc331708d5dd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:07.659333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-affcbb14-313d-4879-b708-bc331708d5dd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:07.659784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-affcbb14-313d-4879-b708-bc331708d5dd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:07.660807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-affcbb14-313d-4879-b708-bc331708d5dd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:07.661440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-affcbb14-313d-4879-b708-bc331708d5dd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:07.932970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-fbb46b8c-ff67-45d3-b39e-6c0439ae942a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:47:07.934100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-fbb46b8c-ff67-45d3-b39e-6c0439ae942a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:47:07.935690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-fbb46b8c-ff67-45d3-b39e-6c0439ae942a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:47:07.936235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-fbb46b8c-ff67-45d3-b39e-6c0439ae942a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:47:07.936827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-fbb46b8c-ff67-45d3-b39e-6c0439ae942a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:47:07.960207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fbb46b8c-ff67-45d3-b39e-6c0439ae942a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:07.962784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fbb46b8c-ff67-45d3-b39e-6c0439ae942a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:07.965059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fbb46b8c-ff67-45d3-b39e-6c0439ae942a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:07.966648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fbb46b8c-ff67-45d3-b39e-6c0439ae942a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:08.022177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:08.054318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-fbb46b8c-ff67-45d3-b39e-6c0439ae942a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Getting quotas for project fc751c3978da4e05b6d7aab178723ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:47:08.080876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-fbb46b8c-ff67-45d3-b39e-6c0439ae942a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Getting quotas for user a5e17b2cb6654e4584b62ac8d08833f2 and project fc751c3978da4e05b6d7aab178723ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:47:08.091311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-affcbb14-313d-4879-b708-bc331708d5dd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:08.114165 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-affcbb14-313d-4879-b708-bc331708d5dd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.470329 Jul 20 04:47:08.115942 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2983/5717] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:07 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:08.117938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fbb46b8c-ff67-45d3-b39e-6c0439ae942a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:47:08.121518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fbb46b8c-ff67-45d3-b39e-6c0439ae942a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:47:08.125803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-00af0a6a-91a8-4369-b25a-22da26656d87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:08.136959 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-00af0a6a-91a8-4369-b25a-22da26656d87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:08.158323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00af0a6a-91a8-4369-b25a-22da26656d87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:08.181722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00af0a6a-91a8-4369-b25a-22da26656d87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:08.183702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00af0a6a-91a8-4369-b25a-22da26656d87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:08.184309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00af0a6a-91a8-4369-b25a-22da26656d87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:08.266527 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fbb46b8c-ff67-45d3-b39e-6c0439ae942a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.182511 Jul 20 04:47:08.268352 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2735/5718] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:47:08.298075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c9a35a5a-934e-415a-a7dd-3c235cc9fab3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:08.299875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c9a35a5a-934e-415a-a7dd-3c235cc9fab3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:08.311399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9a35a5a-934e-415a-a7dd-3c235cc9fab3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:08.315798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9a35a5a-934e-415a-a7dd-3c235cc9fab3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:08.320192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9a35a5a-934e-415a-a7dd-3c235cc9fab3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:08.324092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c9a35a5a-934e-415a-a7dd-3c235cc9fab3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:08.567320 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:08.803462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c9a35a5a-934e-415a-a7dd-3c235cc9fab3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:08.813336 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c9a35a5a-934e-415a-a7dd-3c235cc9fab3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.542375 Jul 20 04:47:08.813940 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2736/5719] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:08 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:08.829840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ccfd2f31-6710-4b32-8aea-177e7670a412 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:08.830781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ccfd2f31-6710-4b32-8aea-177e7670a412 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:08.839469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-00af0a6a-91a8-4369-b25a-22da26656d87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:08.853353 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-00af0a6a-91a8-4369-b25a-22da26656d87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1721 microversion: 2.1 time: 0.735176 Jul 20 04:47:08.855829 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2984/5720] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:08 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1721 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:08.916950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ccfd2f31-6710-4b32-8aea-177e7670a412 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:08.917736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-34a89abd-a40e-480c-a9d1-392e7cb7fe6a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1741952228", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-34a89abd-a40e-480c-a9d1-392e7cb7fe6a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 492 Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1741952228", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1741952228', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '251a4e63-1968-40ea-8261-3caafe352db6'}]}}} Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 20 04:47:08.920622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:08.925006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-34a89abd-a40e-480c-a9d1-392e7cb7fe6a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:08.927200 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-34a89abd-a40e-480c-a9d1-392e7cb7fe6a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.014487 Jul 20 04:47:08.927200 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2985/5721] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:08 2022] POST /compute/v2.1/servers => generated 624 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:47:08.942684 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ccfd2f31-6710-4b32-8aea-177e7670a412 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 200 len: 1208 microversion: 2.1 time: 0.118624 Jul 20 04:47:08.944116 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2737/5722] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:08 2022] GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 1208 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:08.954658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-17fee5e8-9a94-4bce-924c-a2aeec4190be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:08.955599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-17fee5e8-9a94-4bce-924c-a2aeec4190be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:08.975190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17fee5e8-9a94-4bce-924c-a2aeec4190be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:08.975805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17fee5e8-9a94-4bce-924c-a2aeec4190be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:08.977718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17fee5e8-9a94-4bce-924c-a2aeec4190be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:08.979255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17fee5e8-9a94-4bce-924c-a2aeec4190be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:09.461311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-17fee5e8-9a94-4bce-924c-a2aeec4190be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:09.476992 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-17fee5e8-9a94-4bce-924c-a2aeec4190be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.543448 Jul 20 04:47:09.482796 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2986/5723] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:08 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:09.500302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf82bcba-8267-4cde-aab0-8f2375cad2b3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:09.501451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf82bcba-8267-4cde-aab0-8f2375cad2b3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:09.508961 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf82bcba-8267-4cde-aab0-8f2375cad2b3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:09.509818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf82bcba-8267-4cde-aab0-8f2375cad2b3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:09.511500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf82bcba-8267-4cde-aab0-8f2375cad2b3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:09.512179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf82bcba-8267-4cde-aab0-8f2375cad2b3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:09.806527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bf82bcba-8267-4cde-aab0-8f2375cad2b3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:09.850426 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf82bcba-8267-4cde-aab0-8f2375cad2b3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.353970 Jul 20 04:47:09.853441 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2738/5724] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:09 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:09.882907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-83744d47-03ff-4df8-b440-ddff1a88488d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:09.883512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-83744d47-03ff-4df8-b440-ddff1a88488d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:09.895376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83744d47-03ff-4df8-b440-ddff1a88488d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:09.897072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83744d47-03ff-4df8-b440-ddff1a88488d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:09.898695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83744d47-03ff-4df8-b440-ddff1a88488d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:09.899947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83744d47-03ff-4df8-b440-ddff1a88488d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:09.937451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8878deab-6a20-4698-bb27-c45b1bb01888 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8878deab-6a20-4698-bb27-c45b1bb01888 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 416 Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'networks': [{'uuid': '251a4e63-1968-40ea-8261-3caafe352db6'}]}}} Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:09.944014 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:47:09.953088 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:09.960909 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8878deab-6a20-4698-bb27-c45b1bb01888 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:09.962842 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8878deab-6a20-4698-bb27-c45b1bb01888 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.039664 Jul 20 04:47:09.964648 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2739/5725] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:09 2022] POST /compute/v2.1/servers => generated 619 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:47:09.975147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-507b9b1b-983e-4dfd-8fca-de3eb503567a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:09.977010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-507b9b1b-983e-4dfd-8fca-de3eb503567a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:10.003856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-507b9b1b-983e-4dfd-8fca-de3eb503567a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:10.005091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-507b9b1b-983e-4dfd-8fca-de3eb503567a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:10.006786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-507b9b1b-983e-4dfd-8fca-de3eb503567a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:10.008538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-507b9b1b-983e-4dfd-8fca-de3eb503567a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:10.171951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-507b9b1b-983e-4dfd-8fca-de3eb503567a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:10.184633 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-507b9b1b-983e-4dfd-8fca-de3eb503567a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 200 len: 1268 microversion: 2.1 time: 0.216820 Jul 20 04:47:10.185284 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2740/5726] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:09 2022] GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 1268 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:10.202617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2b1117ea-8db6-4e4e-995e-70214cf234e0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:10.203608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2b1117ea-8db6-4e4e-995e-70214cf234e0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:10.219050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b1117ea-8db6-4e4e-995e-70214cf234e0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:10.222049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b1117ea-8db6-4e4e-995e-70214cf234e0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:10.224146 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b1117ea-8db6-4e4e-995e-70214cf234e0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:10.227715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b1117ea-8db6-4e4e-995e-70214cf234e0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:10.566945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2b1117ea-8db6-4e4e-995e-70214cf234e0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:10.583042 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2b1117ea-8db6-4e4e-995e-70214cf234e0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.385947 Jul 20 04:47:10.584817 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2741/5727] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:10 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:10.611001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e7446c20-8f9c-495f-9af8-5061d0bcfbd6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:10.613732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e7446c20-8f9c-495f-9af8-5061d0bcfbd6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:10.634362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7446c20-8f9c-495f-9af8-5061d0bcfbd6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:10.637838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7446c20-8f9c-495f-9af8-5061d0bcfbd6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:10.642721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7446c20-8f9c-495f-9af8-5061d0bcfbd6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:10.644979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7446c20-8f9c-495f-9af8-5061d0bcfbd6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:10.851182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-83744d47-03ff-4df8-b440-ddff1a88488d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:10.872213 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-83744d47-03ff-4df8-b440-ddff1a88488d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1721 microversion: 2.1 time: 0.992788 Jul 20 04:47:10.874407 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2987/5728] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:09 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1721 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:10.946315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e7446c20-8f9c-495f-9af8-5061d0bcfbd6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:10.970721 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e7446c20-8f9c-495f-9af8-5061d0bcfbd6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.367372 Jul 20 04:47:10.991671 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2742/5729] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:10 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:11.062088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d31365f3-d7d5-470b-87b4-18137142e1c2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-917972986", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": -1, "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:11.070260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:11.097957 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-d31365f3-d7d5-470b-87b4-18137142e1c2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Flavor -1 could not be found. Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d31365f3-d7d5-470b-87b4-18137142e1c2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 205 Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-917972986", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": -1, "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: exception: Flavor -1 could not be found. Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-917972986', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': -1, 'networks': [{'uuid': '251a4e63-1968-40ea-8261-3caafe352db6'}]}}} Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:11.102759 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:11.108021 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:11.108021 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:11.108021 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:11.108021 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:11.108021 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:47:11.108021 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 04:47:11.108021 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:47:11.108021 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 20 04:47:11.108021 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:11.108021 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:11.108021 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:11.108021 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:11.108021 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:11.108021 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:11.108021 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:11.108021 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:11.108021 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 20 04:47:11.108021 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:11.110445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d31365f3-d7d5-470b-87b4-18137142e1c2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:11.112236 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d31365f3-d7d5-470b-87b4-18137142e1c2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.055118 Jul 20 04:47:11.113425 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2988/5730] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:11 2022] POST /compute/v2.1/servers => generated 73 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:47:11.123563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-11673e44-6b19-4ef1-b369-31a569cb1b45 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:11.124386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-11673e44-6b19-4ef1-b369-31a569cb1b45 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:11.137906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11673e44-6b19-4ef1-b369-31a569cb1b45 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:11.140701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11673e44-6b19-4ef1-b369-31a569cb1b45 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:11.142710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11673e44-6b19-4ef1-b369-31a569cb1b45 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:11.143922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11673e44-6b19-4ef1-b369-31a569cb1b45 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:11.208974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d47781f5-1bac-4af8-90e5-021fd1c55520 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:11.211246 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d47781f5-1bac-4af8-90e5-021fd1c55520 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:11.225118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d47781f5-1bac-4af8-90e5-021fd1c55520 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:11.226759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d47781f5-1bac-4af8-90e5-021fd1c55520 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:11.226759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d47781f5-1bac-4af8-90e5-021fd1c55520 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:11.229150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d47781f5-1bac-4af8-90e5-021fd1c55520 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:11.475745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d47781f5-1bac-4af8-90e5-021fd1c55520 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:11.482409 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-11673e44-6b19-4ef1-b369-31a569cb1b45 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:11.488407 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d47781f5-1bac-4af8-90e5-021fd1c55520 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 200 len: 1266 microversion: 2.1 time: 0.289686 Jul 20 04:47:11.492054 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2989/5731] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:11 2022] GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:11.495076 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-11673e44-6b19-4ef1-b369-31a569cb1b45 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.377291 Jul 20 04:47:11.495966 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2743/5732] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:11 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:11.522573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1624c97a-fde8-484e-a145-5347211a1b82 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:11.523438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1624c97a-fde8-484e-a145-5347211a1b82 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:11.535851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1624c97a-fde8-484e-a145-5347211a1b82 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:11.536373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1624c97a-fde8-484e-a145-5347211a1b82 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:11.537392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1624c97a-fde8-484e-a145-5347211a1b82 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:11.537996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1624c97a-fde8-484e-a145-5347211a1b82 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:11.897621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-311eb4bb-3367-4b8c-b328-44a9072fa52a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:11.899217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-311eb4bb-3367-4b8c-b328-44a9072fa52a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:11.910376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-311eb4bb-3367-4b8c-b328-44a9072fa52a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:11.911903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-311eb4bb-3367-4b8c-b328-44a9072fa52a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:11.913436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-311eb4bb-3367-4b8c-b328-44a9072fa52a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:11.914596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-311eb4bb-3367-4b8c-b328-44a9072fa52a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:12.094434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1624c97a-fde8-484e-a145-5347211a1b82 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:12.105077 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1624c97a-fde8-484e-a145-5347211a1b82 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.587102 Jul 20 04:47:12.110349 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2990/5733] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:11 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:12.196824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cdfaeea9-b082-4419-996d-9b9d25cda762 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2048755805", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cdfaeea9-b082-4419-996d-9b9d25cda762 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 173 Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2048755805", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2048755805', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '251a4e63-1968-40ea-8261-3caafe352db6'}]}}} Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi -1 Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:47:12.199690 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:47:12.204375 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:47:12.204375 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:47:12.204375 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 20 04:47:12.204375 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:12.204375 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:12.204375 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:12.204375 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:12.204375 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:12.204375 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:12.204375 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:47:12.204375 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:47:12.204375 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 20 04:47:12.204375 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:12.204375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cdfaeea9-b082-4419-996d-9b9d25cda762 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:12.204375 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cdfaeea9-b082-4419-996d-9b9d25cda762 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.008275 Jul 20 04:47:12.204375 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2991/5734] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:12 2022] POST /compute/v2.1/servers => generated 145 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:47:12.217326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-86e6ffdf-77f4-4209-ad7f-94de3e0db6a7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:12.217985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-86e6ffdf-77f4-4209-ad7f-94de3e0db6a7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:12.234501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86e6ffdf-77f4-4209-ad7f-94de3e0db6a7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:12.234976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86e6ffdf-77f4-4209-ad7f-94de3e0db6a7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:12.235805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86e6ffdf-77f4-4209-ad7f-94de3e0db6a7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:12.236247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86e6ffdf-77f4-4209-ad7f-94de3e0db6a7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:12.258758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-311eb4bb-3367-4b8c-b328-44a9072fa52a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:12.269198 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-311eb4bb-3367-4b8c-b328-44a9072fa52a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1721 microversion: 2.1 time: 0.377585 Jul 20 04:47:12.281205 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2744/5735] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:11 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1721 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:12.519883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-36b61677-55b5-4071-9696-40a2259ade15 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:12.522280 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-36b61677-55b5-4071-9696-40a2259ade15 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:12.543367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36b61677-55b5-4071-9696-40a2259ade15 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:12.544085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36b61677-55b5-4071-9696-40a2259ade15 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:12.546050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36b61677-55b5-4071-9696-40a2259ade15 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:12.547044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36b61677-55b5-4071-9696-40a2259ade15 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:12.700858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-36b61677-55b5-4071-9696-40a2259ade15 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:12.717179 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-36b61677-55b5-4071-9696-40a2259ade15 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 200 len: 1266 microversion: 2.1 time: 0.205863 Jul 20 04:47:12.718993 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2745/5736] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:12 2022] GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:12.861539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-86e6ffdf-77f4-4209-ad7f-94de3e0db6a7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:12.861788 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-96a0bf22-467a-4850-bb95-003287acb85f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:12.862887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-96a0bf22-467a-4850-bb95-003287acb85f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:12.874288 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-86e6ffdf-77f4-4209-ad7f-94de3e0db6a7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.660736 Jul 20 04:47:12.875208 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2992/5737] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:12 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:12.880394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96a0bf22-467a-4850-bb95-003287acb85f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:12.882391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96a0bf22-467a-4850-bb95-003287acb85f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:12.883811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-0b0979c2-df9b-4be9-9313-f8bcd46faaf6 req-a1626054-5e16-421e-bb7b-1d0290abb138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9cbd595-7323-4d8a-b0d1-da8952f04529", "tag": "4fe14c15-fa2a-465e-8d12-695d6280d0e2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:12.884196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96a0bf22-467a-4850-bb95-003287acb85f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:12.892387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96a0bf22-467a-4850-bb95-003287acb85f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:12.905112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-0b0979c2-df9b-4be9-9313-f8bcd46faaf6 req-a1626054-5e16-421e-bb7b-1d0290abb138 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:12.905870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-0b0979c2-df9b-4be9-9313-f8bcd46faaf6 req-a1626054-5e16-421e-bb7b-1d0290abb138 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:12.930273 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-0b0979c2-df9b-4be9-9313-f8bcd46faaf6 req-a1626054-5e16-421e-bb7b-1d0290abb138 service nova] Creating event network-changed:4fe14c15-fa2a-465e-8d12-695d6280d0e2 for instance f9cbd595-7323-4d8a-b0d1-da8952f04529 on n-h1-826526-5 Jul 20 04:47:12.940636 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-0b0979c2-df9b-4be9-9313-f8bcd46faaf6 req-a1626054-5e16-421e-bb7b-1d0290abb138 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060095 Jul 20 04:47:12.946241 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2993/5738] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:12.970437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3f24b208-7c9f-4826-9a06-46319538168f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:12.971813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3f24b208-7c9f-4826-9a06-46319538168f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:12.990679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f24b208-7c9f-4826-9a06-46319538168f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:12.991444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f24b208-7c9f-4826-9a06-46319538168f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:12.992004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f24b208-7c9f-4826-9a06-46319538168f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:12.992829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f24b208-7c9f-4826-9a06-46319538168f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:13.308534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3f24b208-7c9f-4826-9a06-46319538168f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:13.337804 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3f24b208-7c9f-4826-9a06-46319538168f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.387832 Jul 20 04:47:13.338456 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2994/5739] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:12 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:13.374595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b64258fa-3860-46c7-befd-33429c906708 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:13.375231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b64258fa-3860-46c7-befd-33429c906708 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:13.404099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b64258fa-3860-46c7-befd-33429c906708 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:13.405260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b64258fa-3860-46c7-befd-33429c906708 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:13.409617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b64258fa-3860-46c7-befd-33429c906708 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:13.411413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b64258fa-3860-46c7-befd-33429c906708 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:14.018854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-96a0bf22-467a-4850-bb95-003287acb85f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:14.028731 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-96a0bf22-467a-4850-bb95-003287acb85f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1563 microversion: 2.1 time: 1.180772 Jul 20 04:47:14.038191 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2746/5740] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:12 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1563 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:14.043777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e661421b-8a81-44fb-be58-efb7d0cdf5bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1449204374", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:14.047532 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-e661421b-8a81-44fb-be58-efb7d0cdf5bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e661421b-8a81-44fb-be58-efb7d0cdf5bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 216 Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1449204374", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1449204374', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:14.058379 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:14.063932 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:14.063932 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:14.063932 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:14.063932 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:14.063932 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:14.063932 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 04:47:14.063932 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:14.066643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e661421b-8a81-44fb-be58-efb7d0cdf5bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:14.070580 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e661421b-8a81-44fb-be58-efb7d0cdf5bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.031033 Jul 20 04:47:14.071405 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2747/5741] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:14 2022] POST /compute/v2.1/servers => generated 123 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:47:14.087182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b50d5ea7-2baa-412a-968a-a28ab25d2d78 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:14.088026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b50d5ea7-2baa-412a-968a-a28ab25d2d78 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:14.110960 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b50d5ea7-2baa-412a-968a-a28ab25d2d78 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:14.111756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b50d5ea7-2baa-412a-968a-a28ab25d2d78 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:14.112776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b50d5ea7-2baa-412a-968a-a28ab25d2d78 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:14.113390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b50d5ea7-2baa-412a-968a-a28ab25d2d78 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:14.658371 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b50d5ea7-2baa-412a-968a-a28ab25d2d78 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:14.672679 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b50d5ea7-2baa-412a-968a-a28ab25d2d78 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 200 len: 1308 microversion: 2.1 time: 0.595787 Jul 20 04:47:14.673493 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2748/5742] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:14 2022] GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 1308 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:14.690858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8da3e46f-370b-487c-8fe0-4ae9b12dca8c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:14.693286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8da3e46f-370b-487c-8fe0-4ae9b12dca8c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:14.709395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8da3e46f-370b-487c-8fe0-4ae9b12dca8c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:14.711125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8da3e46f-370b-487c-8fe0-4ae9b12dca8c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:14.712942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8da3e46f-370b-487c-8fe0-4ae9b12dca8c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:14.713653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8da3e46f-370b-487c-8fe0-4ae9b12dca8c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:14.755320 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b64258fa-3860-46c7-befd-33429c906708 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:14.785559 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b64258fa-3860-46c7-befd-33429c906708 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1721 microversion: 2.1 time: 1.443172 Jul 20 04:47:14.786553 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2995/5743] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:13 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1721 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:15.186295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8da3e46f-370b-487c-8fe0-4ae9b12dca8c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:15.201518 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8da3e46f-370b-487c-8fe0-4ae9b12dca8c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.523944 Jul 20 04:47:15.202134 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2749/5744] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:14 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:15.230312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-55923404-f16b-4c98-a115-22f804c91255 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:15.233357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-55923404-f16b-4c98-a115-22f804c91255 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:15.241919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55923404-f16b-4c98-a115-22f804c91255 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:15.242625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55923404-f16b-4c98-a115-22f804c91255 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:15.243894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55923404-f16b-4c98-a115-22f804c91255 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:15.244664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55923404-f16b-4c98-a115-22f804c91255 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:15.689789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-63ec29f2-92c8-44a4-bda0-1119cd1f87f0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:15.690821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-63ec29f2-92c8-44a4-bda0-1119cd1f87f0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:15.701402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63ec29f2-92c8-44a4-bda0-1119cd1f87f0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:15.702061 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63ec29f2-92c8-44a4-bda0-1119cd1f87f0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:15.703457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63ec29f2-92c8-44a4-bda0-1119cd1f87f0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:15.704599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63ec29f2-92c8-44a4-bda0-1119cd1f87f0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:15.716349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-55923404-f16b-4c98-a115-22f804c91255 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:15.724493 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-55923404-f16b-4c98-a115-22f804c91255 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.498249 Jul 20 04:47:15.730103 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2996/5745] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:15 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:15.806553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-deb6dcf7-df39-47ca-b228-1c6737957bf3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:15.808230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-deb6dcf7-df39-47ca-b228-1c6737957bf3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:15.815680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-deb6dcf7-df39-47ca-b228-1c6737957bf3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:15.816514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-deb6dcf7-df39-47ca-b228-1c6737957bf3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:15.819204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-deb6dcf7-df39-47ca-b228-1c6737957bf3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:15.820285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-deb6dcf7-df39-47ca-b228-1c6737957bf3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:16.018891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-63ec29f2-92c8-44a4-bda0-1119cd1f87f0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:16.031256 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-63ec29f2-92c8-44a4-bda0-1119cd1f87f0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 200 len: 1308 microversion: 2.1 time: 0.345031 Jul 20 04:47:16.043410 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2750/5746] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:15 2022] GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:16.060298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-64c07d77-096a-4135-8251-249913ae838a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1377156270", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "key_name": "tempest-key-1894221433", "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:16.157853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-deb6dcf7-df39-47ca-b228-1c6737957bf3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:16.167629 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-deb6dcf7-df39-47ca-b228-1c6737957bf3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1721 microversion: 2.1 time: 0.366080 Jul 20 04:47:16.168222 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2997/5747] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:15 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1721 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:16.184866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-64c07d77-096a-4135-8251-249913ae838a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] validate_networks() for [('251a4e63-1968-40ea-8261-3caafe352db6', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:47:16.671082 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-64c07d77-096a-4135-8251-249913ae838a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Invalid key_name provided. Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-64c07d77-096a-4135-8251-249913ae838a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 247 Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1377156270", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "key_name": "tempest-key-1894221433", "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid key_name provided. Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1377156270', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'key_name': 'tempest-key-1894221433', 'networks': [{'uuid': '251a4e63-1968-40ea-8261-3caafe352db6'}]}}} Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1894221433 not found for user dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:16.674739 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 20 04:47:16.679951 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:16.682084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-64c07d77-096a-4135-8251-249913ae838a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 400 to user: Invalid key_name provided. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:16.682811 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-64c07d77-096a-4135-8251-249913ae838a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.637902 Jul 20 04:47:16.686717 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2751/5748] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:16 2022] POST /compute/v2.1/servers => generated 70 bytes in 642 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:47:16.695887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bfc34134-020c-4bcc-a095-715f92590001 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:16.697120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bfc34134-020c-4bcc-a095-715f92590001 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:16.712594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bfc34134-020c-4bcc-a095-715f92590001 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:16.715008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bfc34134-020c-4bcc-a095-715f92590001 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:16.717068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bfc34134-020c-4bcc-a095-715f92590001 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:16.719348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bfc34134-020c-4bcc-a095-715f92590001 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:16.999765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-93b9dd4c-d01f-45b0-a2cb-3f632a7102b8 req-9d943b81-9cb2-4374-a71c-936272f5d050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e6cac09-b07c-46af-a9a4-adfff5096e84", "tag": "6455328c-b569-43a3-bf56-87b28419716b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:17.017342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-93b9dd4c-d01f-45b0-a2cb-3f632a7102b8 req-9d943b81-9cb2-4374-a71c-936272f5d050 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:17.019297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-93b9dd4c-d01f-45b0-a2cb-3f632a7102b8 req-9d943b81-9cb2-4374-a71c-936272f5d050 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:17.034593 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-93b9dd4c-d01f-45b0-a2cb-3f632a7102b8 req-9d943b81-9cb2-4374-a71c-936272f5d050 service nova] Creating event network-changed:6455328c-b569-43a3-bf56-87b28419716b for instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 on n-h2-826526-5 Jul 20 04:47:17.043496 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-93b9dd4c-d01f-45b0-a2cb-3f632a7102b8 req-9d943b81-9cb2-4374-a71c-936272f5d050 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064146 Jul 20 04:47:17.045045 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2752/5749] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:17.056665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dbd41100-57f1-4cd3-9269-5d858e3c5e5e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:17.059294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dbd41100-57f1-4cd3-9269-5d858e3c5e5e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:17.070846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbd41100-57f1-4cd3-9269-5d858e3c5e5e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:17.071705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbd41100-57f1-4cd3-9269-5d858e3c5e5e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:17.073738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbd41100-57f1-4cd3-9269-5d858e3c5e5e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:17.074567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dbd41100-57f1-4cd3-9269-5d858e3c5e5e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:17.080837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:17.186587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bfc34134-020c-4bcc-a095-715f92590001 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:17.195475 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bfc34134-020c-4bcc-a095-715f92590001 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.504708 Jul 20 04:47:17.207895 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2998/5750] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:16 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:17.207895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5dd2b716-4efa-4d81-8757-6b517b5efa81 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:17.207895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5dd2b716-4efa-4d81-8757-6b517b5efa81 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:17.212316 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dd2b716-4efa-4d81-8757-6b517b5efa81 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:17.212556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dd2b716-4efa-4d81-8757-6b517b5efa81 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:17.213427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dd2b716-4efa-4d81-8757-6b517b5efa81 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:17.213776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dd2b716-4efa-4d81-8757-6b517b5efa81 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:17.487038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dbd41100-57f1-4cd3-9269-5d858e3c5e5e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:17.504517 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dbd41100-57f1-4cd3-9269-5d858e3c5e5e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 200 len: 1308 microversion: 2.1 time: 0.452797 Jul 20 04:47:17.518518 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2753/5751] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:17 2022] GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 1308 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:17.525946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-59240b8e-f034-4a85-aa6d-ad95435a2db2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:17.526907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-59240b8e-f034-4a85-aa6d-ad95435a2db2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:17.536385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59240b8e-f034-4a85-aa6d-ad95435a2db2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:17.537127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59240b8e-f034-4a85-aa6d-ad95435a2db2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:17.538114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59240b8e-f034-4a85-aa6d-ad95435a2db2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:17.539023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59240b8e-f034-4a85-aa6d-ad95435a2db2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:17.584423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5dd2b716-4efa-4d81-8757-6b517b5efa81 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:17.595807 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5dd2b716-4efa-4d81-8757-6b517b5efa81 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1698 microversion: 2.1 time: 0.398197 Jul 20 04:47:17.599022 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 2999/5752] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:17 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1698 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:17.630166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9c1ca982-f66a-418b-a829-51ff45ab8027 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:17.638634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c1ca982-f66a-418b-a829-51ff45ab8027 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:17.639416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9c1ca982-f66a-418b-a829-51ff45ab8027 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:17.698519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9c1ca982-f66a-418b-a829-51ff45ab8027 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Going to try to start instance {{(pid=127871) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:47:17.811183 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9c1ca982-f66a-418b-a829-51ff45ab8027 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "POST /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf/action" status: 202 len: 0 microversion: 2.1 time: 0.192655 Jul 20 04:47:17.812928 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3000/5753] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:17 2022] POST /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:47:17.822624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-40ebef13-a79e-4626-9dce-e85283656286 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:17.823678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-40ebef13-a79e-4626-9dce-e85283656286 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:17.833698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40ebef13-a79e-4626-9dce-e85283656286 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:17.834650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40ebef13-a79e-4626-9dce-e85283656286 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:17.835775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40ebef13-a79e-4626-9dce-e85283656286 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:17.836508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-40ebef13-a79e-4626-9dce-e85283656286 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:17.843399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:17.986332 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:18.064769 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-59240b8e-f034-4a85-aa6d-ad95435a2db2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:18.080716 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-59240b8e-f034-4a85-aa6d-ad95435a2db2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.559858 Jul 20 04:47:18.087125 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2754/5754] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:17 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:18.206801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-79d98a49-f29d-4b85-a09b-8d21a0f58336 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1347460273", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:18.223479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-40ebef13-a79e-4626-9dce-e85283656286 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:18.241866 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-40ebef13-a79e-4626-9dce-e85283656286 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1707 microversion: 2.1 time: 0.423569 Jul 20 04:47:18.243674 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3001/5755] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:17 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1707 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:18.527542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a33ebfb0-091a-4b89-85f3-113ef842e4dc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:18.528747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a33ebfb0-091a-4b89-85f3-113ef842e4dc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:18.538501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a33ebfb0-091a-4b89-85f3-113ef842e4dc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:18.544861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a33ebfb0-091a-4b89-85f3-113ef842e4dc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:18.547360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a33ebfb0-091a-4b89-85f3-113ef842e4dc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:18.547731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a33ebfb0-091a-4b89-85f3-113ef842e4dc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:18.843442 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.security_group_api [None req-79d98a49-f29d-4b85-a09b-8d21a0f58336 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Neutron security group does_not_exist not found {{(pid=127870) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 20 04:47:18.843877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a33ebfb0-091a-4b89-85f3-113ef842e4dc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:18.844026 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-79d98a49-f29d-4b85-a09b-8d21a0f58336 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:47:18.853804 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a33ebfb0-091a-4b89-85f3-113ef842e4dc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 200 len: 1308 microversion: 2.1 time: 0.331825 Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-79d98a49-f29d-4b85-a09b-8d21a0f58336 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 258 Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1347460273", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1347460273', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '251a4e63-1968-40ea-8261-3caafe352db6'}]}}} Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 20 04:47:18.854812 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:47:18.859764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:18.863853 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3002/5756] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:18 2022] GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 1308 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:18.864917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-79d98a49-f29d-4b85-a09b-8d21a0f58336 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:18.866037 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-79d98a49-f29d-4b85-a09b-8d21a0f58336 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.663446 Jul 20 04:47:18.869981 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2755/5757] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:18 2022] POST /compute/v2.1/servers => generated 106 bytes in 668 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:47:18.880138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d5087f06-63b5-42ce-a99a-a85fdf57a010 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:18.882908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d5087f06-63b5-42ce-a99a-a85fdf57a010 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:18.893964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5087f06-63b5-42ce-a99a-a85fdf57a010 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:18.894832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5087f06-63b5-42ce-a99a-a85fdf57a010 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:18.896693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5087f06-63b5-42ce-a99a-a85fdf57a010 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:18.897767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d5087f06-63b5-42ce-a99a-a85fdf57a010 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:19.129481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d5087f06-63b5-42ce-a99a-a85fdf57a010 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:19.146979 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d5087f06-63b5-42ce-a99a-a85fdf57a010 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.273359 Jul 20 04:47:19.150753 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3003/5758] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:18 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:19.177813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b58620a5-5cac-4afe-9d14-c2d3c2bd70d7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:19.179602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b58620a5-5cac-4afe-9d14-c2d3c2bd70d7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:19.187563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:19.191613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b58620a5-5cac-4afe-9d14-c2d3c2bd70d7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:19.192393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b58620a5-5cac-4afe-9d14-c2d3c2bd70d7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:19.195905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b58620a5-5cac-4afe-9d14-c2d3c2bd70d7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:19.196677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b58620a5-5cac-4afe-9d14-c2d3c2bd70d7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:19.262312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2152e982-c9a7-4a03-8036-02913756b23a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:19.263571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2152e982-c9a7-4a03-8036-02913756b23a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:19.285452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2152e982-c9a7-4a03-8036-02913756b23a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:19.286920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2152e982-c9a7-4a03-8036-02913756b23a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:19.289780 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2152e982-c9a7-4a03-8036-02913756b23a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:19.292953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2152e982-c9a7-4a03-8036-02913756b23a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:19.677050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b58620a5-5cac-4afe-9d14-c2d3c2bd70d7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:19.690503 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b58620a5-5cac-4afe-9d14-c2d3c2bd70d7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.517859 Jul 20 04:47:19.692553 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2756/5759] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:19 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:19.714590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-518ccff3-8ae3-4f74-a1b2-7c6cb5b20bcd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:19.718583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-518ccff3-8ae3-4f74-a1b2-7c6cb5b20bcd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: c1431bc3-31c8-4e31-b7e3-5b01f088cf96] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:19.731974 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-518ccff3-8ae3-4f74-a1b2-7c6cb5b20bcd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance c1431bc3-31c8-4e31-b7e3-5b01f088cf96 could not be found. Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-518ccff3-8ae3-4f74-a1b2-7c6cb5b20bcd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/c1431bc3-31c8-4e31-b7e3-5b01f088cf96 HTTP/1.1 Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance c1431bc3-31c8-4e31-b7e3-5b01f088cf96 could not be found. Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'c1431bc3-31c8-4e31-b7e3-5b01f088cf96'} Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1431bc3-31c8-4e31-b7e3-5b01f088cf96 could not be found. Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1431bc3-31c8-4e31-b7e3-5b01f088cf96 could not be found. Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:19.734214 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:19.739637 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:19.739637 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:19.739637 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:19.739637 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:19.739637 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:19.739637 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:19.739637 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1431bc3-31c8-4e31-b7e3-5b01f088cf96 could not be found. Jul 20 04:47:19.739637 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:19.743842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-518ccff3-8ae3-4f74-a1b2-7c6cb5b20bcd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance c1431bc3-31c8-4e31-b7e3-5b01f088cf96 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:19.745010 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-518ccff3-8ae3-4f74-a1b2-7c6cb5b20bcd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c1431bc3-31c8-4e31-b7e3-5b01f088cf96" status: 404 len: 111 microversion: 2.1 time: 0.036472 Jul 20 04:47:19.748102 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2757/5760] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:47:19 2022] DELETE /compute/v2.1/servers/c1431bc3-31c8-4e31-b7e3-5b01f088cf96 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:47:19.757478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94b9c5e7-7edf-4bc9-8bf4-930543a50a4a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:19.762006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-94b9c5e7-7edf-4bc9-8bf4-930543a50a4a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:19.801705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94b9c5e7-7edf-4bc9-8bf4-930543a50a4a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:19.801705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94b9c5e7-7edf-4bc9-8bf4-930543a50a4a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:19.801705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94b9c5e7-7edf-4bc9-8bf4-930543a50a4a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:19.801705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94b9c5e7-7edf-4bc9-8bf4-930543a50a4a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:19.853513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2152e982-c9a7-4a03-8036-02913756b23a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:19.866435 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2152e982-c9a7-4a03-8036-02913756b23a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1707 microversion: 2.1 time: 0.609256 Jul 20 04:47:19.869359 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3004/5761] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:19 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1707 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:19.883334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bd2b75ec-3fef-4189-a82e-34257490f774 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:19.886227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bd2b75ec-3fef-4189-a82e-34257490f774 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:19.901766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd2b75ec-3fef-4189-a82e-34257490f774 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:19.904570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd2b75ec-3fef-4189-a82e-34257490f774 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:19.905727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd2b75ec-3fef-4189-a82e-34257490f774 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:19.908251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd2b75ec-3fef-4189-a82e-34257490f774 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:20.348543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bd2b75ec-3fef-4189-a82e-34257490f774 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:20.362625 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bd2b75ec-3fef-4189-a82e-34257490f774 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 200 len: 1308 microversion: 2.1 time: 0.484188 Jul 20 04:47:20.363394 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3005/5762] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:19 2022] GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 1308 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:20.525734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-94b9c5e7-7edf-4bc9-8bf4-930543a50a4a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:20.546247 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-94b9c5e7-7edf-4bc9-8bf4-930543a50a4a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.792400 Jul 20 04:47:20.548510 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2758/5763] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:19 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:20.569661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6f287050-5e03-4d38-a6ae-1affa3f3fc59 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:20.570281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6f287050-5e03-4d38-a6ae-1affa3f3fc59 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:20.577316 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f287050-5e03-4d38-a6ae-1affa3f3fc59 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:20.578025 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f287050-5e03-4d38-a6ae-1affa3f3fc59 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:20.579014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f287050-5e03-4d38-a6ae-1affa3f3fc59 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:20.579589 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6f287050-5e03-4d38-a6ae-1affa3f3fc59 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:20.804947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6f287050-5e03-4d38-a6ae-1affa3f3fc59 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:20.814037 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6f287050-5e03-4d38-a6ae-1affa3f3fc59 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.248283 Jul 20 04:47:20.814881 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3006/5764] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:20 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:20.834898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b8eb91be-ae53-47e1-812c-051204ec9bea tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:20.836400 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b8eb91be-ae53-47e1-812c-051204ec9bea tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Failed to fetch instance by id 9223372036854775808 {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:47:20.837166 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-b8eb91be-ae53-47e1-812c-051204ec9bea tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b8eb91be-ae53-47e1-812c-051204ec9bea tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 9223372036854775808 could not be found. Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '9223372036854775808'} Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:20.839594 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:20.845488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:20.845488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:20.845488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:20.845488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 20 04:47:20.845488 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:20.845488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b8eb91be-ae53-47e1-812c-051204ec9bea tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:20.845488 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b8eb91be-ae53-47e1-812c-051204ec9bea tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.011004 Jul 20 04:47:20.845488 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2759/5765] 10.222.0.17 () {58 vars in 1187 bytes} [Wed Jul 20 04:47:20 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:47:20.856749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-add8578f-5fc9-4fcf-b06b-c668c5bc3362 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:20.857480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-add8578f-5fc9-4fcf-b06b-c668c5bc3362 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:20.864405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-add8578f-5fc9-4fcf-b06b-c668c5bc3362 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:20.864858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-add8578f-5fc9-4fcf-b06b-c668c5bc3362 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:20.865649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-add8578f-5fc9-4fcf-b06b-c668c5bc3362 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:20.866079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-add8578f-5fc9-4fcf-b06b-c668c5bc3362 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:20.898205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3b8cc361-6dd2-4fb1-b202-360cff490dd2 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:20.899299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3b8cc361-6dd2-4fb1-b202-360cff490dd2 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:20.907938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b8cc361-6dd2-4fb1-b202-360cff490dd2 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:20.908685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b8cc361-6dd2-4fb1-b202-360cff490dd2 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:20.910089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b8cc361-6dd2-4fb1-b202-360cff490dd2 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:20.910734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b8cc361-6dd2-4fb1-b202-360cff490dd2 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:21.107863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-add8578f-5fc9-4fcf-b06b-c668c5bc3362 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:21.133875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3b8cc361-6dd2-4fb1-b202-360cff490dd2 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:21.145995 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-add8578f-5fc9-4fcf-b06b-c668c5bc3362 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.294194 Jul 20 04:47:21.147390 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3b8cc361-6dd2-4fb1-b202-360cff490dd2 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1707 microversion: 2.1 time: 0.254679 Jul 20 04:47:21.148526 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2760/5766] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:20 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1707 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:21.156943 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3007/5767] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:20 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:21.184395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-927074b4-a4e8-4cf5-9e3d-615d2c6ab1ee tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:21.185807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-927074b4-a4e8-4cf5-9e3d-615d2c6ab1ee tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:21.212070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-927074b4-a4e8-4cf5-9e3d-615d2c6ab1ee tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:21.212750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-927074b4-a4e8-4cf5-9e3d-615d2c6ab1ee tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:21.213684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-927074b4-a4e8-4cf5-9e3d-615d2c6ab1ee tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:21.214335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-927074b4-a4e8-4cf5-9e3d-615d2c6ab1ee tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:21.380695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b5183a7d-b6cf-4d5c-9cf0-b70b6516fe7a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:21.381496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b5183a7d-b6cf-4d5c-9cf0-b70b6516fe7a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:21.397966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5183a7d-b6cf-4d5c-9cf0-b70b6516fe7a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:21.398407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5183a7d-b6cf-4d5c-9cf0-b70b6516fe7a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:21.399157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5183a7d-b6cf-4d5c-9cf0-b70b6516fe7a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:21.399607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5183a7d-b6cf-4d5c-9cf0-b70b6516fe7a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:21.575509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-927074b4-a4e8-4cf5-9e3d-615d2c6ab1ee tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:21.593480 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-927074b4-a4e8-4cf5-9e3d-615d2c6ab1ee tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.414563 Jul 20 04:47:21.596065 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2761/5768] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:21 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:21.601501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-9105733f-4a40-4b2e-b6a0-a7700563a213 req-0b45e9b6-7a0e-4f7f-bf8b-d6db2ade3437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e6cac09-b07c-46af-a9a4-adfff5096e84", "name": "network-vif-plugged", "status": "completed", "tag": "6455328c-b569-43a3-bf56-87b28419716b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:21.617292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-9105733f-4a40-4b2e-b6a0-a7700563a213 req-0b45e9b6-7a0e-4f7f-bf8b-d6db2ade3437 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:21.618336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-9105733f-4a40-4b2e-b6a0-a7700563a213 req-0b45e9b6-7a0e-4f7f-bf8b-d6db2ade3437 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:21.640550 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-9105733f-4a40-4b2e-b6a0-a7700563a213 req-0b45e9b6-7a0e-4f7f-bf8b-d6db2ade3437 service nova] Creating event network-vif-plugged:6455328c-b569-43a3-bf56-87b28419716b for instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 on n-h2-826526-5 Jul 20 04:47:21.647730 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-9105733f-4a40-4b2e-b6a0-a7700563a213 req-0b45e9b6-7a0e-4f7f-bf8b-d6db2ade3437 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050028 Jul 20 04:47:21.648958 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2762/5769] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:21.657421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d00cc5d6-f2da-44d2-8bdf-2b8e2d983876 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:21.658340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d00cc5d6-f2da-44d2-8bdf-2b8e2d983876 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Failed to fetch instance by id -1 {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:47:21.659780 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-d00cc5d6-f2da-44d2-8bdf-2b8e2d983876 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance -1 could not be found. Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d00cc5d6-f2da-44d2-8bdf-2b8e2d983876 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance -1 could not be found. Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '-1'} Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:21.661995 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:21.665071 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:21.665071 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:21.665071 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 20 04:47:21.665071 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:21.671621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d00cc5d6-f2da-44d2-8bdf-2b8e2d983876 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance -1 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:21.673775 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d00cc5d6-f2da-44d2-8bdf-2b8e2d983876 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.022544 Jul 20 04:47:21.675058 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2763/5770] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 04:47:21 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:47:21.735055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7fce6074-e887-410c-82fa-e2a49f407596 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:21.736044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7fce6074-e887-410c-82fa-e2a49f407596 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:21.753443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fce6074-e887-410c-82fa-e2a49f407596 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:21.756122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fce6074-e887-410c-82fa-e2a49f407596 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:21.757494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fce6074-e887-410c-82fa-e2a49f407596 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:21.758373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fce6074-e887-410c-82fa-e2a49f407596 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:21.857626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b5183a7d-b6cf-4d5c-9cf0-b70b6516fe7a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:21.882767 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b5183a7d-b6cf-4d5c-9cf0-b70b6516fe7a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 200 len: 1308 microversion: 2.1 time: 0.506253 Jul 20 04:47:21.892550 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3008/5771] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:21 2022] GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 1308 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:22.174210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2af69568-8cbc-41fd-a167-7074da2ed5d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:22.175814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2af69568-8cbc-41fd-a167-7074da2ed5d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:22.185400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2af69568-8cbc-41fd-a167-7074da2ed5d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.185859 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2af69568-8cbc-41fd-a167-7074da2ed5d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.186697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2af69568-8cbc-41fd-a167-7074da2ed5d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.187146 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2af69568-8cbc-41fd-a167-7074da2ed5d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.328939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7fce6074-e887-410c-82fa-e2a49f407596 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:22.345272 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7fce6074-e887-410c-82fa-e2a49f407596 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.663211 Jul 20 04:47:22.348422 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2764/5772] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:21 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:22.368502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-78d53c72-51d8-4ac0-b565-0d4215645cd3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:22.369570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-78d53c72-51d8-4ac0-b565-0d4215645cd3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:22.384093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2af69568-8cbc-41fd-a167-7074da2ed5d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:22.385971 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78d53c72-51d8-4ac0-b565-0d4215645cd3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.387451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78d53c72-51d8-4ac0-b565-0d4215645cd3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.390309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78d53c72-51d8-4ac0-b565-0d4215645cd3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.392969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78d53c72-51d8-4ac0-b565-0d4215645cd3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.394772 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2af69568-8cbc-41fd-a167-7074da2ed5d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1711 microversion: 2.1 time: 0.227522 Jul 20 04:47:22.395696 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3009/5773] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:22 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1711 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:22.607541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-78d53c72-51d8-4ac0-b565-0d4215645cd3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:22.616709 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-78d53c72-51d8-4ac0-b565-0d4215645cd3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.253966 Jul 20 04:47:22.617883 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2765/5774] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:22 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:22.644541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-81521851-81d6-4be3-93fa-c69ea9c8f369 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:22.645832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-81521851-81d6-4be3-93fa-c69ea9c8f369 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 8ad618d6-4018-44c3-b7b2-e5a5c0e14442] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:22.655145 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-81521851-81d6-4be3-93fa-c69ea9c8f369 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance 8ad618d6-4018-44c3-b7b2-e5a5c0e14442 could not be found. Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-81521851-81d6-4be3-93fa-c69ea9c8f369 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/8ad618d6-4018-44c3-b7b2-e5a5c0e14442/action HTTP/1.1 Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 19 Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: {"forceDelete": {}} Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 8ad618d6-4018-44c3-b7b2-e5a5c0e14442 could not be found. Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '8ad618d6-4018-44c3-b7b2-e5a5c0e14442', 'body': {'forceDelete': {}}} Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad618d6-4018-44c3-b7b2-e5a5c0e14442 could not be found. Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad618d6-4018-44c3-b7b2-e5a5c0e14442 could not be found. Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:22.663929 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:22.667563 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:22.667563 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:22.667563 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad618d6-4018-44c3-b7b2-e5a5c0e14442 could not be found. Jul 20 04:47:22.667563 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:22.668632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-81521851-81d6-4be3-93fa-c69ea9c8f369 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance 8ad618d6-4018-44c3-b7b2-e5a5c0e14442 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:22.669576 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-81521851-81d6-4be3-93fa-c69ea9c8f369 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/8ad618d6-4018-44c3-b7b2-e5a5c0e14442/action" status: 404 len: 111 microversion: 2.1 time: 0.038065 Jul 20 04:47:22.670542 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3010/5775] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:22 2022] POST /compute/v2.1/servers/8ad618d6-4018-44c3-b7b2-e5a5c0e14442/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:22.680480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f4c2f076-65f4-40dd-ad5a-ae290816d6e7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:22.681371 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f4c2f076-65f4-40dd-ad5a-ae290816d6e7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:22.690800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4c2f076-65f4-40dd-ad5a-ae290816d6e7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.691665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4c2f076-65f4-40dd-ad5a-ae290816d6e7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.694020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4c2f076-65f4-40dd-ad5a-ae290816d6e7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.694853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4c2f076-65f4-40dd-ad5a-ae290816d6e7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.903686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d31c4088-2be4-43d3-a0a7-d6c831307896 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:22.904783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d31c4088-2be4-43d3-a0a7-d6c831307896 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:22.915771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d31c4088-2be4-43d3-a0a7-d6c831307896 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.916768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d31c4088-2be4-43d3-a0a7-d6c831307896 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.917866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d31c4088-2be4-43d3-a0a7-d6c831307896 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.918729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d31c4088-2be4-43d3-a0a7-d6c831307896 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.924519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f4c2f076-65f4-40dd-ad5a-ae290816d6e7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:22.935108 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f4c2f076-65f4-40dd-ad5a-ae290816d6e7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.259878 Jul 20 04:47:22.937856 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2766/5776] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:22 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:22.961088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-26a98fae-57d2-4a5a-8437-ffc1a4ad4259 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:22.962165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-26a98fae-57d2-4a5a-8437-ffc1a4ad4259 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:22.970757 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26a98fae-57d2-4a5a-8437-ffc1a4ad4259 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.971229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26a98fae-57d2-4a5a-8437-ffc1a4ad4259 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.972119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26a98fae-57d2-4a5a-8437-ffc1a4ad4259 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.973273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26a98fae-57d2-4a5a-8437-ffc1a4ad4259 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:23.163676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-26a98fae-57d2-4a5a-8437-ffc1a4ad4259 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:23.172315 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-26a98fae-57d2-4a5a-8437-ffc1a4ad4259 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.220577 Jul 20 04:47:23.172957 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2767/5777] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:22 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:23.209076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b40ca758-aab3-46a5-b383-7125a7d02cb8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:23.210252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b40ca758-aab3-46a5-b383-7125a7d02cb8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 660647d3-9c13-41de-828a-51af02cbc6d0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:23.218721 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-b40ca758-aab3-46a5-b383-7125a7d02cb8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance 660647d3-9c13-41de-828a-51af02cbc6d0 could not be found. Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b40ca758-aab3-46a5-b383-7125a7d02cb8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/660647d3-9c13-41de-828a-51af02cbc6d0/action HTTP/1.1 Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 39 Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: {"os-getConsoleOutput": {"length": 10}} Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 660647d3-9c13-41de-828a-51af02cbc6d0 could not be found. Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '660647d3-9c13-41de-828a-51af02cbc6d0', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 660647d3-9c13-41de-828a-51af02cbc6d0 could not be found. Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 660647d3-9c13-41de-828a-51af02cbc6d0 could not be found. Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:23.223836 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:23.228621 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:23.228621 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:23.228621 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:23.228621 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:23.228621 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 660647d3-9c13-41de-828a-51af02cbc6d0 could not be found. Jul 20 04:47:23.228621 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:23.228621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b40ca758-aab3-46a5-b383-7125a7d02cb8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance 660647d3-9c13-41de-828a-51af02cbc6d0 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:23.228621 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b40ca758-aab3-46a5-b383-7125a7d02cb8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/660647d3-9c13-41de-828a-51af02cbc6d0/action" status: 404 len: 111 microversion: 2.1 time: 0.039470 Jul 20 04:47:23.228621 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2768/5778] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:23 2022] POST /compute/v2.1/servers/660647d3-9c13-41de-828a-51af02cbc6d0/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:23.236591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2c12b4ab-25a7-4e6a-9302-7c8e71db599b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:23.237463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2c12b4ab-25a7-4e6a-9302-7c8e71db599b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:23.246453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c12b4ab-25a7-4e6a-9302-7c8e71db599b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:23.247315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c12b4ab-25a7-4e6a-9302-7c8e71db599b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:23.248135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c12b4ab-25a7-4e6a-9302-7c8e71db599b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:23.248636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c12b4ab-25a7-4e6a-9302-7c8e71db599b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:23.410507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2c12b4ab-25a7-4e6a-9302-7c8e71db599b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:23.420018 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2c12b4ab-25a7-4e6a-9302-7c8e71db599b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.187480 Jul 20 04:47:23.421193 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2769/5779] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:23 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:23.446841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-64049c71-b262-42f8-a246-2fe02dec2462 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:23.449073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-64049c71-b262-42f8-a246-2fe02dec2462 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:23.458051 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64049c71-b262-42f8-a246-2fe02dec2462 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:23.458512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64049c71-b262-42f8-a246-2fe02dec2462 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:23.459462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64049c71-b262-42f8-a246-2fe02dec2462 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:23.460056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64049c71-b262-42f8-a246-2fe02dec2462 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:23.613192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d31c4088-2be4-43d3-a0a7-d6c831307896 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:23.622824 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d31c4088-2be4-43d3-a0a7-d6c831307896 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 200 len: 1308 microversion: 2.1 time: 0.723545 Jul 20 04:47:23.635366 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3011/5780] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:22 2022] GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 1308 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:23.665058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-64049c71-b262-42f8-a246-2fe02dec2462 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:23.676308 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-64049c71-b262-42f8-a246-2fe02dec2462 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.235393 Jul 20 04:47:23.676308 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2770/5781] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:23 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:23.697320 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2c3e76a6-e63e-4a45-920d-13a3f4b32347 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:23.697320 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2c3e76a6-e63e-4a45-920d-13a3f4b32347 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: e081cd78-b344-4604-891d-88bc746cd4a9] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:23.704915 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-2c3e76a6-e63e-4a45-920d-13a3f4b32347 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance e081cd78-b344-4604-891d-88bc746cd4a9 could not be found. Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2c3e76a6-e63e-4a45-920d-13a3f4b32347 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/e081cd78-b344-4604-891d-88bc746cd4a9 HTTP/1.1 Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance e081cd78-b344-4604-891d-88bc746cd4a9 could not be found. Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'e081cd78-b344-4604-891d-88bc746cd4a9'} Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e081cd78-b344-4604-891d-88bc746cd4a9 could not be found. Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e081cd78-b344-4604-891d-88bc746cd4a9 could not be found. Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:23.706960 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:23.712374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:23.712374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:23.712374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:23.712374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e081cd78-b344-4604-891d-88bc746cd4a9 could not be found. Jul 20 04:47:23.712374 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:23.712374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2c3e76a6-e63e-4a45-920d-13a3f4b32347 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance e081cd78-b344-4604-891d-88bc746cd4a9 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:23.712374 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2c3e76a6-e63e-4a45-920d-13a3f4b32347 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/e081cd78-b344-4604-891d-88bc746cd4a9" status: 404 len: 111 microversion: 2.1 time: 0.016243 Jul 20 04:47:23.712374 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3012/5782] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:23 2022] GET /compute/v2.1/servers/e081cd78-b344-4604-891d-88bc746cd4a9 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:23.724328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c5ba4471-87ed-4735-b2f7-d0890e0ea7b1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:23.724328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c5ba4471-87ed-4735-b2f7-d0890e0ea7b1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:23.727242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5ba4471-87ed-4735-b2f7-d0890e0ea7b1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:23.727920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5ba4471-87ed-4735-b2f7-d0890e0ea7b1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:23.729081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5ba4471-87ed-4735-b2f7-d0890e0ea7b1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:23.729858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5ba4471-87ed-4735-b2f7-d0890e0ea7b1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:23.931462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c5ba4471-87ed-4735-b2f7-d0890e0ea7b1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:23.939677 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c5ba4471-87ed-4735-b2f7-d0890e0ea7b1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.225527 Jul 20 04:47:23.940396 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2771/5783] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:23 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:23.958064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-25bb1cb5-1fe7-4241-89c7-3c94c5631bf4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:23.958670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-25bb1cb5-1fe7-4241-89c7-3c94c5631bf4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:23.969004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-25bb1cb5-1fe7-4241-89c7-3c94c5631bf4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:23.969784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-25bb1cb5-1fe7-4241-89c7-3c94c5631bf4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:23.970817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-25bb1cb5-1fe7-4241-89c7-3c94c5631bf4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:23.971253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-25bb1cb5-1fe7-4241-89c7-3c94c5631bf4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:24.251985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-25bb1cb5-1fe7-4241-89c7-3c94c5631bf4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:24.261825 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-25bb1cb5-1fe7-4241-89c7-3c94c5631bf4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.307579 Jul 20 04:47:24.262565 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3013/5784] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:23 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:24.393803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5bd705eb-cf14-4adb-9202-a80f5d9a989c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-444152789", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5bd705eb-cf14-4adb-9202-a80f5d9a989c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 237 Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-444152789", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-444152789', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '251a4e63-1968-40ea-8261-3caafe352db6'}]}}} Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:47:24.396562 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:47:24.400806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:47:24.400806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:47:24.400806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 20 04:47:24.400806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:24.400806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:24.400806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:24.400806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:24.400806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:24.400806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:24.400806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:47:24.400806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:47:24.400806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 20 04:47:24.400806 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:24.400806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5bd705eb-cf14-4adb-9202-a80f5d9a989c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:24.400806 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5bd705eb-cf14-4adb-9202-a80f5d9a989c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.009883 Jul 20 04:47:24.400806 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2772/5785] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:24 2022] POST /compute/v2.1/servers => generated 139 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:47:24.408459 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-045f5d9a-cdbc-4277-943a-9a3e25e4384b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:24.409078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-045f5d9a-cdbc-4277-943a-9a3e25e4384b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:24.418479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-045f5d9a-cdbc-4277-943a-9a3e25e4384b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:24.418935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-045f5d9a-cdbc-4277-943a-9a3e25e4384b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:24.420152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-045f5d9a-cdbc-4277-943a-9a3e25e4384b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:24.420840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-045f5d9a-cdbc-4277-943a-9a3e25e4384b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:24.640631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-69b44e61-e9d3-4b38-877d-018baf4dcc39 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:24.641270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-69b44e61-e9d3-4b38-877d-018baf4dcc39 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:24.648897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-69b44e61-e9d3-4b38-877d-018baf4dcc39 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:24.649574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-69b44e61-e9d3-4b38-877d-018baf4dcc39 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:24.650386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-69b44e61-e9d3-4b38-877d-018baf4dcc39 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:24.650843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-69b44e61-e9d3-4b38-877d-018baf4dcc39 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:24.714039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-045f5d9a-cdbc-4277-943a-9a3e25e4384b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:24.723164 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-045f5d9a-cdbc-4277-943a-9a3e25e4384b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.319096 Jul 20 04:47:24.724379 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3014/5786] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:24 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:24.749438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9ba43815-37cc-4338-9c6f-95f57345c61c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:24.750772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9ba43815-37cc-4338-9c6f-95f57345c61c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:24.761290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ba43815-37cc-4338-9c6f-95f57345c61c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:24.762440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ba43815-37cc-4338-9c6f-95f57345c61c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:24.763635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ba43815-37cc-4338-9c6f-95f57345c61c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:24.764287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ba43815-37cc-4338-9c6f-95f57345c61c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:24.880199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-69b44e61-e9d3-4b38-877d-018baf4dcc39 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:24.900643 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-69b44e61-e9d3-4b38-877d-018baf4dcc39 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 200 len: 1489 microversion: 2.1 time: 0.263803 Jul 20 04:47:24.922158 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2773/5787] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:24 2022] GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 1489 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:25.005424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9ba43815-37cc-4338-9c6f-95f57345c61c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:25.016033 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9ba43815-37cc-4338-9c6f-95f57345c61c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.271933 Jul 20 04:47:25.017626 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3015/5788] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:24 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:25.077047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-275dbec0-d9f8-4785-94f0-3a72c4ea7c16 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-837476973", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:25.078978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a587dbb5-67ac-4deb-9c56-806570f667ff tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-957825597", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "3d22ba6e-7662-4637-bb0f-d3084b1def5c"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-275dbec0-d9f8-4785-94f0-3a72c4ea7c16 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 234 Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-837476973", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-837476973', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '251a4e63-1968-40ea-8261-3caafe352db6'}]}}} Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:25.084596 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 20 04:47:25.087749 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:25.091654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-275dbec0-d9f8-4785-94f0-3a72c4ea7c16 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:25.092797 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-275dbec0-d9f8-4785-94f0-3a72c4ea7c16 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.019964 Jul 20 04:47:25.094176 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2774/5789] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:25 2022] POST /compute/v2.1/servers => generated 133 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:47:25.120494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-805b821e-8f0e-43e1-ba43-498b0174407b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:25.121499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-805b821e-8f0e-43e1-ba43-498b0174407b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:25.132454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-805b821e-8f0e-43e1-ba43-498b0174407b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:25.133394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-805b821e-8f0e-43e1-ba43-498b0174407b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:25.134516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-805b821e-8f0e-43e1-ba43-498b0174407b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:25.135539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-805b821e-8f0e-43e1-ba43-498b0174407b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:25.157086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-a587dbb5-67ac-4deb-9c56-806570f667ff tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] validate_networks() for [('3d22ba6e-7662-4637-bb0f-d3084b1def5c', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:47:25.677820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-a587dbb5-67ac-4deb-9c56-806570f667ff tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:47:25.680419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-a587dbb5-67ac-4deb-9c56-806570f667ff tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:47:25.680613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-a587dbb5-67ac-4deb-9c56-806570f667ff tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:47:25.683824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-a587dbb5-67ac-4deb-9c56-806570f667ff tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:47:25.683824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-a587dbb5-67ac-4deb-9c56-806570f667ff tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:47:25.695984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a587dbb5-67ac-4deb-9c56-806570f667ff tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:25.696526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a587dbb5-67ac-4deb-9c56-806570f667ff tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:25.697339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a587dbb5-67ac-4deb-9c56-806570f667ff tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:25.697779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a587dbb5-67ac-4deb-9c56-806570f667ff tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:25.721621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-a587dbb5-67ac-4deb-9c56-806570f667ff tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Getting quotas for project fc751c3978da4e05b6d7aab178723ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:47:25.734309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-a587dbb5-67ac-4deb-9c56-806570f667ff tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Getting quotas for user a5e17b2cb6654e4584b62ac8d08833f2 and project fc751c3978da4e05b6d7aab178723ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:47:25.754119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a587dbb5-67ac-4deb-9c56-806570f667ff tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:47:25.758139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a587dbb5-67ac-4deb-9c56-806570f667ff tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:47:25.832590 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a587dbb5-67ac-4deb-9c56-806570f667ff tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757000 Jul 20 04:47:25.834645 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3016/5790] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:47:25.854746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8cd76135-b507-48aa-9f0f-f5fcc57dd146 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:25.857858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8cd76135-b507-48aa-9f0f-f5fcc57dd146 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:25.866569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-805b821e-8f0e-43e1-ba43-498b0174407b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:25.887260 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-805b821e-8f0e-43e1-ba43-498b0174407b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.788287 Jul 20 04:47:25.891169 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2775/5791] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:25 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:25.909507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d2de58f1-dc54-4c1e-bc67-759e8f8fb008 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:25.910296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d2de58f1-dc54-4c1e-bc67-759e8f8fb008 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:25.917810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2de58f1-dc54-4c1e-bc67-759e8f8fb008 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:25.918413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2de58f1-dc54-4c1e-bc67-759e8f8fb008 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:25.919373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2de58f1-dc54-4c1e-bc67-759e8f8fb008 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:25.919936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2de58f1-dc54-4c1e-bc67-759e8f8fb008 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:26.023083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8cd76135-b507-48aa-9f0f-f5fcc57dd146 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:26.046687 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8cd76135-b507-48aa-9f0f-f5fcc57dd146 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 200 len: 1208 microversion: 2.1 time: 0.200008 Jul 20 04:47:26.048101 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3017/5792] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:25 2022] GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 1208 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:26.199505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d2de58f1-dc54-4c1e-bc67-759e8f8fb008 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:26.209381 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d2de58f1-dc54-4c1e-bc67-759e8f8fb008 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.304101 Jul 20 04:47:26.210426 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2776/5793] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:25 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:26.231712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-85ba1664-6cd1-453d-89be-6bf93ef58213 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:26.232244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-85ba1664-6cd1-453d-89be-6bf93ef58213 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: c2e4905a-5975-4155-9b80-ad986c39e1bb] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:26.254190 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-85ba1664-6cd1-453d-89be-6bf93ef58213 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance c2e4905a-5975-4155-9b80-ad986c39e1bb could not be found. Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-85ba1664-6cd1-453d-89be-6bf93ef58213 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/c2e4905a-5975-4155-9b80-ad986c39e1bb/action HTTP/1.1 Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 13 Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: {"pause": {}} Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance c2e4905a-5975-4155-9b80-ad986c39e1bb could not be found. Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'c2e4905a-5975-4155-9b80-ad986c39e1bb', 'body': {'pause': {}}} Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2e4905a-5975-4155-9b80-ad986c39e1bb could not be found. Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2e4905a-5975-4155-9b80-ad986c39e1bb could not be found. Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:26.280027 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:26.286249 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:26.286249 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:26.286249 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2e4905a-5975-4155-9b80-ad986c39e1bb could not be found. Jul 20 04:47:26.286249 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:26.286249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-85ba1664-6cd1-453d-89be-6bf93ef58213 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance c2e4905a-5975-4155-9b80-ad986c39e1bb could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:26.286249 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-85ba1664-6cd1-453d-89be-6bf93ef58213 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/c2e4905a-5975-4155-9b80-ad986c39e1bb/action" status: 404 len: 111 microversion: 2.1 time: 0.054897 Jul 20 04:47:26.289556 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3018/5794] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:26 2022] POST /compute/v2.1/servers/c2e4905a-5975-4155-9b80-ad986c39e1bb/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:26.296914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1c8bdb96-d026-4221-9a11-c9cf94e1d61c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:26.296914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1c8bdb96-d026-4221-9a11-c9cf94e1d61c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:26.309555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c8bdb96-d026-4221-9a11-c9cf94e1d61c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:26.310035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c8bdb96-d026-4221-9a11-c9cf94e1d61c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:26.310854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c8bdb96-d026-4221-9a11-c9cf94e1d61c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:26.311306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c8bdb96-d026-4221-9a11-c9cf94e1d61c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:26.337571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:26.572207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1c8bdb96-d026-4221-9a11-c9cf94e1d61c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:26.580626 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1c8bdb96-d026-4221-9a11-c9cf94e1d61c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.290241 Jul 20 04:47:26.581227 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2777/5795] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:26 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:26.599624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e5070218-5473-4072-935c-c99d13e9439c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:26.600693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e5070218-5473-4072-935c-c99d13e9439c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:26.608645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5070218-5473-4072-935c-c99d13e9439c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:26.609481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5070218-5473-4072-935c-c99d13e9439c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:26.610526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5070218-5473-4072-935c-c99d13e9439c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:26.611287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5070218-5473-4072-935c-c99d13e9439c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:26.823212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e5070218-5473-4072-935c-c99d13e9439c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:26.833699 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e5070218-5473-4072-935c-c99d13e9439c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.238122 Jul 20 04:47:26.845572 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3019/5796] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:26 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:26.851155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4fa229ba-0899-4d80-9fbb-49fa517e57d2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:26.852175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4fa229ba-0899-4d80-9fbb-49fa517e57d2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:26.859266 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4fa229ba-0899-4d80-9fbb-49fa517e57d2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:26.860029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4fa229ba-0899-4d80-9fbb-49fa517e57d2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:26.861070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4fa229ba-0899-4d80-9fbb-49fa517e57d2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:26.861722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4fa229ba-0899-4d80-9fbb-49fa517e57d2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:26.970677 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4fa229ba-0899-4d80-9fbb-49fa517e57d2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action" status: 202 len: 0 microversion: 2.1 time: 0.123101 Jul 20 04:47:26.971684 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2778/5797] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:26 2022] POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:47:26.985290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ee311ad7-c976-4ce8-b743-124b0de32fb9 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:26.986019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ee311ad7-c976-4ce8-b743-124b0de32fb9 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:26.994926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee311ad7-c976-4ce8-b743-124b0de32fb9 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:26.995485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee311ad7-c976-4ce8-b743-124b0de32fb9 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:26.996394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee311ad7-c976-4ce8-b743-124b0de32fb9 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:26.996902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee311ad7-c976-4ce8-b743-124b0de32fb9 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:27.068184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-27c0dd4c-2819-4e4f-ba2b-8ccc4c26af70 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:27.069075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-27c0dd4c-2819-4e4f-ba2b-8ccc4c26af70 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:27.076678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27c0dd4c-2819-4e4f-ba2b-8ccc4c26af70 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:27.077370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27c0dd4c-2819-4e4f-ba2b-8ccc4c26af70 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:27.078404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27c0dd4c-2819-4e4f-ba2b-8ccc4c26af70 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:27.079008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27c0dd4c-2819-4e4f-ba2b-8ccc4c26af70 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:27.166202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ee311ad7-c976-4ce8-b743-124b0de32fb9 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:27.174962 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ee311ad7-c976-4ce8-b743-124b0de32fb9 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1510 microversion: 2.1 time: 0.197201 Jul 20 04:47:27.175555 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3020/5798] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:26 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:27.238807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-27c0dd4c-2819-4e4f-ba2b-8ccc4c26af70 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:27.249413 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-27c0dd4c-2819-4e4f-ba2b-8ccc4c26af70 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 200 len: 1260 microversion: 2.1 time: 0.185852 Jul 20 04:47:27.250751 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2779/5799] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:27 2022] GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:28.192526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-48f6d782-aea6-43d8-833c-590acd96c9c4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:28.193737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-48f6d782-aea6-43d8-833c-590acd96c9c4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:28.221994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48f6d782-aea6-43d8-833c-590acd96c9c4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.222451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48f6d782-aea6-43d8-833c-590acd96c9c4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.223533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48f6d782-aea6-43d8-833c-590acd96c9c4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.224228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-48f6d782-aea6-43d8-833c-590acd96c9c4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.274153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7068f5dd-94e9-4300-a2e5-c011b0c96e0d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:28.275490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7068f5dd-94e9-4300-a2e5-c011b0c96e0d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:28.286718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7068f5dd-94e9-4300-a2e5-c011b0c96e0d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.288990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7068f5dd-94e9-4300-a2e5-c011b0c96e0d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.290569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7068f5dd-94e9-4300-a2e5-c011b0c96e0d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.291193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7068f5dd-94e9-4300-a2e5-c011b0c96e0d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.614006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7068f5dd-94e9-4300-a2e5-c011b0c96e0d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:28.630781 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7068f5dd-94e9-4300-a2e5-c011b0c96e0d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 200 len: 1308 microversion: 2.1 time: 0.365667 Jul 20 04:47:28.631814 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2780/5800] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:28 2022] GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 1308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:28.738866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-48f6d782-aea6-43d8-833c-590acd96c9c4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:28.753203 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-48f6d782-aea6-43d8-833c-590acd96c9c4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1490 microversion: 2.1 time: 0.564509 Jul 20 04:47:28.754435 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3021/5801] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:28 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1490 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:28.773259 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-53539e9c-9c5c-4a25-981f-98983ea29892 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:28.773747 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-53539e9c-9c5c-4a25-981f-98983ea29892 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:28.781809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53539e9c-9c5c-4a25-981f-98983ea29892 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.783191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53539e9c-9c5c-4a25-981f-98983ea29892 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.785503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53539e9c-9c5c-4a25-981f-98983ea29892 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.786824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53539e9c-9c5c-4a25-981f-98983ea29892 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.855368 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-53539e9c-9c5c-4a25-981f-98983ea29892 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Cannot 'pause' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state paused Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-53539e9c-9c5c-4a25-981f-98983ea29892 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action HTTP/1.1 Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 13 Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: {"pause": {}} Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: exception: Cannot 'pause' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state paused Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '1d530bf9-a3da-4006-9120-3bc00e8266e3', 'body': {'pause': {}}} Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 in vm_state paused. Cannot pause while the instance is in this state. Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state paused Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:28.857834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:28.864870 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:28.864870 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:28.864870 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:28.864870 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state paused Jul 20 04:47:28.864870 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:28.866755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-53539e9c-9c5c-4a25-981f-98983ea29892 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 409 to user: Cannot 'pause' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state paused {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:28.868122 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-53539e9c-9c5c-4a25-981f-98983ea29892 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action" status: 409 len: 143 microversion: 2.1 time: 0.099709 Jul 20 04:47:28.873889 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2781/5802] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:28 2022] POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action => generated 143 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:47:28.879679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-35f8b045-21b0-46c5-b742-12f724d75700 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:28.880220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35f8b045-21b0-46c5-b742-12f724d75700 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:28.896101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35f8b045-21b0-46c5-b742-12f724d75700 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.896720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35f8b045-21b0-46c5-b742-12f724d75700 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.897445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35f8b045-21b0-46c5-b742-12f724d75700 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.898107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35f8b045-21b0-46c5-b742-12f724d75700 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.920837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:29.013234 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-35f8b045-21b0-46c5-b742-12f724d75700 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action" status: 202 len: 0 microversion: 2.1 time: 0.135121 Jul 20 04:47:29.013234 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3022/5803] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:28 2022] POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:47:29.022824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ee7a82df-59c4-439b-a2a5-07f3dfe8a9e5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:29.023903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ee7a82df-59c4-439b-a2a5-07f3dfe8a9e5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:29.039148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee7a82df-59c4-439b-a2a5-07f3dfe8a9e5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:29.041180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee7a82df-59c4-439b-a2a5-07f3dfe8a9e5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:29.043126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee7a82df-59c4-439b-a2a5-07f3dfe8a9e5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:29.043806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee7a82df-59c4-439b-a2a5-07f3dfe8a9e5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:29.475322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ee7a82df-59c4-439b-a2a5-07f3dfe8a9e5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:29.484610 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ee7a82df-59c4-439b-a2a5-07f3dfe8a9e5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1497 microversion: 2.1 time: 0.467001 Jul 20 04:47:29.496943 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2782/5804] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:29 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1497 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:29.650317 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c3c64372-cad3-4274-9e85-e969d0fbea76 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:29.651617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c3c64372-cad3-4274-9e85-e969d0fbea76 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:29.659526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3c64372-cad3-4274-9e85-e969d0fbea76 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:29.659981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3c64372-cad3-4274-9e85-e969d0fbea76 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:29.660781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3c64372-cad3-4274-9e85-e969d0fbea76 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:29.661204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3c64372-cad3-4274-9e85-e969d0fbea76 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:29.773342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-186fbab0-839b-4b77-9ad5-5ec321e1d742 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:29.774659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-186fbab0-839b-4b77-9ad5-5ec321e1d742 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:29.788751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-186fbab0-839b-4b77-9ad5-5ec321e1d742 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:29.789608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-186fbab0-839b-4b77-9ad5-5ec321e1d742 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:29.790590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-186fbab0-839b-4b77-9ad5-5ec321e1d742 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:29.791200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-186fbab0-839b-4b77-9ad5-5ec321e1d742 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:29.846948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c3c64372-cad3-4274-9e85-e969d0fbea76 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:29.858151 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c3c64372-cad3-4274-9e85-e969d0fbea76 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 200 len: 1308 microversion: 2.1 time: 0.211929 Jul 20 04:47:29.859642 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3023/5805] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:29 2022] GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 1308 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:29.867693 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-186fbab0-839b-4b77-9ad5-5ec321e1d742 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529/action" status: 200 len: 24565 microversion: 2.1 time: 0.104265 Jul 20 04:47:29.869514 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2783/5806] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:29 2022] POST /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529/action => generated 24565 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:47:30.507691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-49270e9d-146b-4d4c-8c6c-abbc8cf045bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:30.509532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-49270e9d-146b-4d4c-8c6c-abbc8cf045bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:30.517002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-49270e9d-146b-4d4c-8c6c-abbc8cf045bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:30.517531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-49270e9d-146b-4d4c-8c6c-abbc8cf045bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:30.518931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-49270e9d-146b-4d4c-8c6c-abbc8cf045bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:30.519516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-49270e9d-146b-4d4c-8c6c-abbc8cf045bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:30.591604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-27c8dafa-edb9-40ba-a75e-449604686958 req-bba32cc2-8be8-4a2d-9a2f-d76829799551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfacab33-2416-4749-98f6-964d2033f472", "tag": "88d01b91-c7c2-442f-a6a1-b4460cb2c3a9"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:30.616549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:30.631340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-27c8dafa-edb9-40ba-a75e-449604686958 req-bba32cc2-8be8-4a2d-9a2f-d76829799551 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:30.631564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-27c8dafa-edb9-40ba-a75e-449604686958 req-bba32cc2-8be8-4a2d-9a2f-d76829799551 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:30.656575 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-27c8dafa-edb9-40ba-a75e-449604686958 req-bba32cc2-8be8-4a2d-9a2f-d76829799551 service nova] Creating event network-changed:88d01b91-c7c2-442f-a6a1-b4460cb2c3a9 for instance dfacab33-2416-4749-98f6-964d2033f472 on n-h1-826526-5 Jul 20 04:47:30.664937 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-27c8dafa-edb9-40ba-a75e-449604686958 req-bba32cc2-8be8-4a2d-9a2f-d76829799551 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079270 Jul 20 04:47:30.665949 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2784/5807] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:47:30.754780 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-49270e9d-146b-4d4c-8c6c-abbc8cf045bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:30.764422 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-49270e9d-146b-4d4c-8c6c-abbc8cf045bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1497 microversion: 2.1 time: 0.262020 Jul 20 04:47:30.765225 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3024/5808] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:30 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1497 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:30.877271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a74d3065-7e5a-4db6-aa8b-f8816a8e3866 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:30.877978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a74d3065-7e5a-4db6-aa8b-f8816a8e3866 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:30.884846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a74d3065-7e5a-4db6-aa8b-f8816a8e3866 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:30.885319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a74d3065-7e5a-4db6-aa8b-f8816a8e3866 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:30.886633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a74d3065-7e5a-4db6-aa8b-f8816a8e3866 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:30.887264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a74d3065-7e5a-4db6-aa8b-f8816a8e3866 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:31.176577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a74d3065-7e5a-4db6-aa8b-f8816a8e3866 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:31.186900 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a74d3065-7e5a-4db6-aa8b-f8816a8e3866 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 200 len: 1308 microversion: 2.1 time: 0.314884 Jul 20 04:47:31.188285 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2785/5809] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:30 2022] GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:31.587906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d635c980-93fb-41ae-b5b5-9ec088926b2e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1696650111", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1993339905", "security_groups": [{"name": "tempest-secgroup-smoke-1136622068"}], "block_device_mapping_v2": [{"uuid": "a4bd1182-996b-4180-a68f-65a716537c12", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7f25ae6d-be40-4c15-969a-9d88fe94c163"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:31.782218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-31e539b9-9651-4ebb-8cb5-d8efb5105faf tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:31.783101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-31e539b9-9651-4ebb-8cb5-d8efb5105faf tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:31.789312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-d635c980-93fb-41ae-b5b5-9ec088926b2e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] validate_networks() for [('7f25ae6d-be40-4c15-969a-9d88fe94c163', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:47:31.791276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31e539b9-9651-4ebb-8cb5-d8efb5105faf tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:31.791891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31e539b9-9651-4ebb-8cb5-d8efb5105faf tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:31.792792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31e539b9-9651-4ebb-8cb5-d8efb5105faf tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:31.793408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31e539b9-9651-4ebb-8cb5-d8efb5105faf tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:31.963091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-31e539b9-9651-4ebb-8cb5-d8efb5105faf tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:31.982194 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-31e539b9-9651-4ebb-8cb5-d8efb5105faf tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1497 microversion: 2.1 time: 0.203663 Jul 20 04:47:31.983101 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2786/5810] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:31 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1497 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:32.212698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-46c283c2-5491-40b4-8d1e-723e1ea96e20 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:32.213741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-46c283c2-5491-40b4-8d1e-723e1ea96e20 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:32.220463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46c283c2-5491-40b4-8d1e-723e1ea96e20 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:32.221025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46c283c2-5491-40b4-8d1e-723e1ea96e20 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:32.221981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46c283c2-5491-40b4-8d1e-723e1ea96e20 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:32.222545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46c283c2-5491-40b4-8d1e-723e1ea96e20 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:32.474574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-46c283c2-5491-40b4-8d1e-723e1ea96e20 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:32.483176 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-46c283c2-5491-40b4-8d1e-723e1ea96e20 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 200 len: 1308 microversion: 2.1 time: 0.274534 Jul 20 04:47:32.483985 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2787/5811] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:32 2022] GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 1308 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:32.529477 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-d635c980-93fb-41ae-b5b5-9ec088926b2e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:47:32.529904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-d635c980-93fb-41ae-b5b5-9ec088926b2e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:47:32.530387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-d635c980-93fb-41ae-b5b5-9ec088926b2e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:47:32.530792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-d635c980-93fb-41ae-b5b5-9ec088926b2e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:47:32.531288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-d635c980-93fb-41ae-b5b5-9ec088926b2e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:47:32.541859 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d635c980-93fb-41ae-b5b5-9ec088926b2e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:32.542522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d635c980-93fb-41ae-b5b5-9ec088926b2e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:32.543470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d635c980-93fb-41ae-b5b5-9ec088926b2e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:32.544053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d635c980-93fb-41ae-b5b5-9ec088926b2e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:32.569840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-d635c980-93fb-41ae-b5b5-9ec088926b2e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Getting quotas for project b889ad56221143f0a54450c81ba738a7. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:47:32.581772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-d635c980-93fb-41ae-b5b5-9ec088926b2e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Getting quotas for user bc760e8f522640fc9190460719f5dcc2 and project b889ad56221143f0a54450c81ba738a7. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:47:32.591799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:32.658310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d635c980-93fb-41ae-b5b5-9ec088926b2e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:47:32.661600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d635c980-93fb-41ae-b5b5-9ec088926b2e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a4bd1182-996b-4180-a68f-65a716537c12',volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:47:32.815991 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d635c980-93fb-41ae-b5b5-9ec088926b2e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.232168 Jul 20 04:47:32.819265 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3025/5812] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:47:32.829039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-44988e91-6038-445c-bfc4-4dbc47334b55 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:32.830369 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-44988e91-6038-445c-bfc4-4dbc47334b55 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:32.897173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-44988e91-6038-445c-bfc4-4dbc47334b55 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:32.905796 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-44988e91-6038-445c-bfc4-4dbc47334b55 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1095 microversion: 2.1 time: 0.080779 Jul 20 04:47:32.906604 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2788/5813] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:32 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:33.004136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-577b3c9b-c2ed-44ff-849a-cc099e36b7be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:33.004877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-577b3c9b-c2ed-44ff-849a-cc099e36b7be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:33.021730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-577b3c9b-c2ed-44ff-849a-cc099e36b7be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:33.022237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-577b3c9b-c2ed-44ff-849a-cc099e36b7be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:33.023060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-577b3c9b-c2ed-44ff-849a-cc099e36b7be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:33.023520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-577b3c9b-c2ed-44ff-849a-cc099e36b7be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:33.262055 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-577b3c9b-c2ed-44ff-849a-cc099e36b7be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:33.275834 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-577b3c9b-c2ed-44ff-849a-cc099e36b7be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1497 microversion: 2.1 time: 0.276394 Jul 20 04:47:33.277672 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3026/5814] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:32 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1497 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:33.511103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ac27490c-fcca-4f93-8add-1dfcf0a2d4b5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:33.512954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ac27490c-fcca-4f93-8add-1dfcf0a2d4b5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:33.534214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac27490c-fcca-4f93-8add-1dfcf0a2d4b5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:33.535171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac27490c-fcca-4f93-8add-1dfcf0a2d4b5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:33.537011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac27490c-fcca-4f93-8add-1dfcf0a2d4b5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:33.537471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac27490c-fcca-4f93-8add-1dfcf0a2d4b5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:33.684685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ac27490c-fcca-4f93-8add-1dfcf0a2d4b5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:33.692430 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ac27490c-fcca-4f93-8add-1dfcf0a2d4b5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 200 len: 1308 microversion: 2.1 time: 0.192367 Jul 20 04:47:33.695758 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2789/5815] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:33 2022] GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 1308 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:33.923677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8ea00644-9e2d-4c1a-a1a7-f810ce9955dd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:33.925034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8ea00644-9e2d-4c1a-a1a7-f810ce9955dd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:33.932609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8ea00644-9e2d-4c1a-a1a7-f810ce9955dd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:33.933450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8ea00644-9e2d-4c1a-a1a7-f810ce9955dd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:33.934677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8ea00644-9e2d-4c1a-a1a7-f810ce9955dd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:33.935672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8ea00644-9e2d-4c1a-a1a7-f810ce9955dd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:34.033231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8ea00644-9e2d-4c1a-a1a7-f810ce9955dd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:34.044956 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8ea00644-9e2d-4c1a-a1a7-f810ce9955dd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1211 microversion: 2.1 time: 0.125395 Jul 20 04:47:34.045578 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3027/5816] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:33 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1211 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:34.296579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94c326e2-718d-49f7-8065-ad20100a4cdf tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:34.297961 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-94c326e2-718d-49f7-8065-ad20100a4cdf tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:34.310085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94c326e2-718d-49f7-8065-ad20100a4cdf tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:34.313230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94c326e2-718d-49f7-8065-ad20100a4cdf tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:34.315210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94c326e2-718d-49f7-8065-ad20100a4cdf tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:34.316166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94c326e2-718d-49f7-8065-ad20100a4cdf tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:34.641023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-94c326e2-718d-49f7-8065-ad20100a4cdf tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:34.661746 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-94c326e2-718d-49f7-8065-ad20100a4cdf tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1497 microversion: 2.1 time: 0.368783 Jul 20 04:47:34.671660 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2790/5817] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:34 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1497 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:34.710962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fede4aa6-4d93-4138-abde-aadb2e5b6a61 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:34.711850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fede4aa6-4d93-4138-abde-aadb2e5b6a61 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:34.724379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fede4aa6-4d93-4138-abde-aadb2e5b6a61 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:34.724837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fede4aa6-4d93-4138-abde-aadb2e5b6a61 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:34.725822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fede4aa6-4d93-4138-abde-aadb2e5b6a61 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:34.728484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fede4aa6-4d93-4138-abde-aadb2e5b6a61 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:35.032464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fede4aa6-4d93-4138-abde-aadb2e5b6a61 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:35.042055 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fede4aa6-4d93-4138-abde-aadb2e5b6a61 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 200 len: 1308 microversion: 2.1 time: 0.336019 Jul 20 04:47:35.042661 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3028/5818] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:34 2022] GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 1308 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:35.063479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b07bf1bd-e05e-483c-8414-02b8794f208f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:35.064176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b07bf1bd-e05e-483c-8414-02b8794f208f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:35.091341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b07bf1bd-e05e-483c-8414-02b8794f208f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:35.091955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b07bf1bd-e05e-483c-8414-02b8794f208f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:35.093120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b07bf1bd-e05e-483c-8414-02b8794f208f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:35.093660 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b07bf1bd-e05e-483c-8414-02b8794f208f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:35.632103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b07bf1bd-e05e-483c-8414-02b8794f208f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:35.647882 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b07bf1bd-e05e-483c-8414-02b8794f208f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1279 microversion: 2.1 time: 0.589133 Jul 20 04:47:35.649070 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2791/5819] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:35 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1279 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:35.678708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-029cee49-9023-4a80-8f83-154bf0f2532b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:35.679584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-029cee49-9023-4a80-8f83-154bf0f2532b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:35.687323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-029cee49-9023-4a80-8f83-154bf0f2532b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:35.688413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-029cee49-9023-4a80-8f83-154bf0f2532b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:35.689231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-029cee49-9023-4a80-8f83-154bf0f2532b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:35.689852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-029cee49-9023-4a80-8f83-154bf0f2532b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:35.914650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-029cee49-9023-4a80-8f83-154bf0f2532b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:35.926105 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-029cee49-9023-4a80-8f83-154bf0f2532b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.251114 Jul 20 04:47:35.931152 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3029/5820] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:35 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:35.949015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9c3919c1-f10d-4a6e-8deb-046208c6ce03 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:35.949753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9c3919c1-f10d-4a6e-8deb-046208c6ce03 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:35.959514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c3919c1-f10d-4a6e-8deb-046208c6ce03 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:35.960415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c3919c1-f10d-4a6e-8deb-046208c6ce03 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:35.961524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c3919c1-f10d-4a6e-8deb-046208c6ce03 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:35.962131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c3919c1-f10d-4a6e-8deb-046208c6ce03 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.064243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a8553157-bad7-4a59-a366-bc6ecb51c14c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:36.067524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a8553157-bad7-4a59-a366-bc6ecb51c14c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:36.077487 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8553157-bad7-4a59-a366-bc6ecb51c14c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.078977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8553157-bad7-4a59-a366-bc6ecb51c14c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.078977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8553157-bad7-4a59-a366-bc6ecb51c14c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.079568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8553157-bad7-4a59-a366-bc6ecb51c14c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.257625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a8553157-bad7-4a59-a366-bc6ecb51c14c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:36.266429 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a8553157-bad7-4a59-a366-bc6ecb51c14c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 200 len: 1308 microversion: 2.1 time: 0.208447 Jul 20 04:47:36.276598 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3030/5821] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:36 2022] GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 1308 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:36.385009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9c3919c1-f10d-4a6e-8deb-046208c6ce03 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:36.418090 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9c3919c1-f10d-4a6e-8deb-046208c6ce03 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.474794 Jul 20 04:47:36.420819 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2792/5822] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:35 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:36.437558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4f50636b-9df6-4450-81a2-02e0637224b3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:36.439080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4f50636b-9df6-4450-81a2-02e0637224b3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:36.451511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f50636b-9df6-4450-81a2-02e0637224b3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.453188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f50636b-9df6-4450-81a2-02e0637224b3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.455377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f50636b-9df6-4450-81a2-02e0637224b3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.457720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f50636b-9df6-4450-81a2-02e0637224b3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.487393 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-4f50636b-9df6-4450-81a2-02e0637224b3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4f50636b-9df6-4450-81a2-02e0637224b3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3/action HTTP/1.1 Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 28 Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: {"reboot": {"type": "SOFT"}} Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '52498332-97f4-4f2c-8f6a-5803b2c641b3', 'body': {'reboot': {'type': 'SOFT'}}} Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:36.489304 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:36.493923 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:47:36.493923 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:36.493923 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:36.493923 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:36.493923 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:36.493923 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:36.493923 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:36.493923 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:36.493923 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:36.493923 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:47:36.493923 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:36.493923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4f50636b-9df6-4450-81a2-02e0637224b3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:36.493923 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4f50636b-9df6-4450-81a2-02e0637224b3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3/action" status: 404 len: 111 microversion: 2.1 time: 0.058480 Jul 20 04:47:36.493923 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3031/5823] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:36 2022] POST /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:36.500250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f1e42c30-c4d0-436c-90ff-dc9456dd8306 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:36.500940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f1e42c30-c4d0-436c-90ff-dc9456dd8306 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:36.516204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1e42c30-c4d0-436c-90ff-dc9456dd8306 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.516785 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1e42c30-c4d0-436c-90ff-dc9456dd8306 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.517780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1e42c30-c4d0-436c-90ff-dc9456dd8306 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.518380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1e42c30-c4d0-436c-90ff-dc9456dd8306 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.665625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f1e2eb4e-b282-4484-87b3-f483b71d62ef tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:36.666575 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f1e2eb4e-b282-4484-87b3-f483b71d62ef tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:36.673511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1e2eb4e-b282-4484-87b3-f483b71d62ef tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.674189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1e2eb4e-b282-4484-87b3-f483b71d62ef tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.675199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1e2eb4e-b282-4484-87b3-f483b71d62ef tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.675771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f1e2eb4e-b282-4484-87b3-f483b71d62ef tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.900511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f1e2eb4e-b282-4484-87b3-f483b71d62ef tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:36.909762 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f1e2eb4e-b282-4484-87b3-f483b71d62ef tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1279 microversion: 2.1 time: 0.248273 Jul 20 04:47:36.910369 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3032/5824] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:36 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:36.916810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-1b0197b7-fad0-4a06-ae01-3d2f86cb262b req-bf262808-79d0-4367-8d96-36e0f395dbca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfacab33-2416-4749-98f6-964d2033f472", "name": "network-vif-plugged", "status": "completed", "tag": "88d01b91-c7c2-442f-a6a1-b4460cb2c3a9"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:36.927356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1b0197b7-fad0-4a06-ae01-3d2f86cb262b req-bf262808-79d0-4367-8d96-36e0f395dbca service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.928373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1b0197b7-fad0-4a06-ae01-3d2f86cb262b req-bf262808-79d0-4367-8d96-36e0f395dbca service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.957066 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-1b0197b7-fad0-4a06-ae01-3d2f86cb262b req-bf262808-79d0-4367-8d96-36e0f395dbca service nova] Creating event network-vif-plugged:88d01b91-c7c2-442f-a6a1-b4460cb2c3a9 for instance dfacab33-2416-4749-98f6-964d2033f472 on n-h1-826526-5 Jul 20 04:47:36.964154 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-1b0197b7-fad0-4a06-ae01-3d2f86cb262b req-bf262808-79d0-4367-8d96-36e0f395dbca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051184 Jul 20 04:47:36.965731 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3033/5825] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:36.970782 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f1e42c30-c4d0-436c-90ff-dc9456dd8306 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:36.992605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-d2e695fa-f650-4e04-867e-58fd70c8d1cf req-1ab7a774-2182-42e6-835f-b59df43c614d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbcc3e27-5b1a-4e63-8d64-53aeb92f237a", "tag": "e468a9ce-ee35-4c82-b0b7-a44a299daa9b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:36.994805 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f1e42c30-c4d0-436c-90ff-dc9456dd8306 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.498518 Jul 20 04:47:36.996798 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2793/5826] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:36 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:37.025924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d2e695fa-f650-4e04-867e-58fd70c8d1cf req-1ab7a774-2182-42e6-835f-b59df43c614d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:37.027616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d2e695fa-f650-4e04-867e-58fd70c8d1cf req-1ab7a774-2182-42e6-835f-b59df43c614d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:37.036188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7528b5dc-00e2-48a0-9a92-90b4a2a305fb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:37.039965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7528b5dc-00e2-48a0-9a92-90b4a2a305fb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:37.048701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7528b5dc-00e2-48a0-9a92-90b4a2a305fb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:37.053966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7528b5dc-00e2-48a0-9a92-90b4a2a305fb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:37.056015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7528b5dc-00e2-48a0-9a92-90b4a2a305fb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:37.056233 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-d2e695fa-f650-4e04-867e-58fd70c8d1cf req-1ab7a774-2182-42e6-835f-b59df43c614d service nova] Creating event network-changed:e468a9ce-ee35-4c82-b0b7-a44a299daa9b for instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a on n-h1-826526-5 Jul 20 04:47:37.057363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7528b5dc-00e2-48a0-9a92-90b4a2a305fb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:37.069289 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-d2e695fa-f650-4e04-867e-58fd70c8d1cf req-1ab7a774-2182-42e6-835f-b59df43c614d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083716 Jul 20 04:47:37.072546 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3034/5827] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:37.289163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cb27d235-81e5-43f9-b46a-c1bc7311ac4c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:37.290132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cb27d235-81e5-43f9-b46a-c1bc7311ac4c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:37.300220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb27d235-81e5-43f9-b46a-c1bc7311ac4c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:37.300951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb27d235-81e5-43f9-b46a-c1bc7311ac4c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:37.301945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb27d235-81e5-43f9-b46a-c1bc7311ac4c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:37.302574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb27d235-81e5-43f9-b46a-c1bc7311ac4c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:37.544996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cb27d235-81e5-43f9-b46a-c1bc7311ac4c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:37.556783 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cb27d235-81e5-43f9-b46a-c1bc7311ac4c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 200 len: 1308 microversion: 2.1 time: 0.274781 Jul 20 04:47:37.557724 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3035/5828] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:37 2022] GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 1308 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:37.939510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-beb8f56f-1159-482d-8384-0dc8c2503175 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:37.940529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-beb8f56f-1159-482d-8384-0dc8c2503175 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:37.953421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-beb8f56f-1159-482d-8384-0dc8c2503175 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:37.954260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-beb8f56f-1159-482d-8384-0dc8c2503175 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:37.955592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-beb8f56f-1159-482d-8384-0dc8c2503175 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:37.956350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-beb8f56f-1159-482d-8384-0dc8c2503175 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:37.994720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7528b5dc-00e2-48a0-9a92-90b4a2a305fb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:38.044081 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7528b5dc-00e2-48a0-9a92-90b4a2a305fb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 1.004286 Jul 20 04:47:38.045748 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2794/5829] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:37 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:38.063645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94d73b02-5ed7-4bf2-a83a-cb6fb0c192c2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:38.065086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-94d73b02-5ed7-4bf2-a83a-cb6fb0c192c2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: b173ce4d-07d3-402f-bac1-83e7bf65f1d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:38.078680 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-94d73b02-5ed7-4bf2-a83a-cb6fb0c192c2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance b173ce4d-07d3-402f-bac1-83e7bf65f1d7 could not be found. Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94d73b02-5ed7-4bf2-a83a-cb6fb0c192c2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/b173ce4d-07d3-402f-bac1-83e7bf65f1d7/action HTTP/1.1 Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 28 Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: {"reboot": {"type": "SOFT"}} Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance b173ce4d-07d3-402f-bac1-83e7bf65f1d7 could not be found. Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'b173ce4d-07d3-402f-bac1-83e7bf65f1d7', 'body': {'reboot': {'type': 'SOFT'}}} Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b173ce4d-07d3-402f-bac1-83e7bf65f1d7 could not be found. Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b173ce4d-07d3-402f-bac1-83e7bf65f1d7 could not be found. Jul 20 04:47:38.081041 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:38.085098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:38.085098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:38.085098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:38.085098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:38.085098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:38.085098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:38.085098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:38.085098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b173ce4d-07d3-402f-bac1-83e7bf65f1d7 could not be found. Jul 20 04:47:38.085098 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:38.086983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94d73b02-5ed7-4bf2-a83a-cb6fb0c192c2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance b173ce4d-07d3-402f-bac1-83e7bf65f1d7 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:38.088586 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-94d73b02-5ed7-4bf2-a83a-cb6fb0c192c2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/b173ce4d-07d3-402f-bac1-83e7bf65f1d7/action" status: 404 len: 111 microversion: 2.1 time: 0.029504 Jul 20 04:47:38.092976 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2795/5830] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:38 2022] POST /compute/v2.1/servers/b173ce4d-07d3-402f-bac1-83e7bf65f1d7/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:38.098587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-50aa8f80-a96a-44f2-9228-29b5f6b3b94d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:38.099691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-50aa8f80-a96a-44f2-9228-29b5f6b3b94d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:38.108628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50aa8f80-a96a-44f2-9228-29b5f6b3b94d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:38.109210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50aa8f80-a96a-44f2-9228-29b5f6b3b94d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:38.110183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50aa8f80-a96a-44f2-9228-29b5f6b3b94d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:38.110755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50aa8f80-a96a-44f2-9228-29b5f6b3b94d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:38.138335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:38.173633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-beb8f56f-1159-482d-8384-0dc8c2503175 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:38.192550 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-beb8f56f-1159-482d-8384-0dc8c2503175 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1279 microversion: 2.1 time: 0.256522 Jul 20 04:47:38.193851 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3036/5831] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:37 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1279 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:38.490292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-50aa8f80-a96a-44f2-9228-29b5f6b3b94d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:38.505622 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-50aa8f80-a96a-44f2-9228-29b5f6b3b94d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.410874 Jul 20 04:47:38.507277 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2796/5832] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:38 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:38.526282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d595ee5f-774d-4f69-9ff2-c98d1ee33498 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:38.528205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d595ee5f-774d-4f69-9ff2-c98d1ee33498 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:38.534372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d595ee5f-774d-4f69-9ff2-c98d1ee33498 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:38.535064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d595ee5f-774d-4f69-9ff2-c98d1ee33498 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:38.536001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d595ee5f-774d-4f69-9ff2-c98d1ee33498 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:38.536642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d595ee5f-774d-4f69-9ff2-c98d1ee33498 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:38.578728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cebb5113-66d3-4e36-8af8-77817ec3c3fc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:38.579802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cebb5113-66d3-4e36-8af8-77817ec3c3fc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:38.599771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cebb5113-66d3-4e36-8af8-77817ec3c3fc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:38.600632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cebb5113-66d3-4e36-8af8-77817ec3c3fc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:38.602176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cebb5113-66d3-4e36-8af8-77817ec3c3fc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:38.603423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cebb5113-66d3-4e36-8af8-77817ec3c3fc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:38.766180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d595ee5f-774d-4f69-9ff2-c98d1ee33498 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:38.781689 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d595ee5f-774d-4f69-9ff2-c98d1ee33498 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.259237 Jul 20 04:47:38.782746 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3037/5833] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:38 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:38.804350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-976bade2-84d9-429c-88a1-a599e6321d48 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:38.806834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-976bade2-84d9-429c-88a1-a599e6321d48 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:38.812362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-976bade2-84d9-429c-88a1-a599e6321d48 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:38.812810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-976bade2-84d9-429c-88a1-a599e6321d48 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:38.813755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-976bade2-84d9-429c-88a1-a599e6321d48 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:38.814343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-976bade2-84d9-429c-88a1-a599e6321d48 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:38.830982 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-976bade2-84d9-429c-88a1-a599e6321d48 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-976bade2-84d9-429c-88a1-a599e6321d48 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3/action HTTP/1.1 Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 65 Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: {"rebuild": {"imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b"}} Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '52498332-97f4-4f2c-8f6a-5803b2c641b3', 'body': {'rebuild': {'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b'}}} Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 20 04:47:38.832844 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-976bade2-84d9-429c-88a1-a599e6321d48 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-976bade2-84d9-429c-88a1-a599e6321d48 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3/action" status: 404 len: 111 microversion: 2.1 time: 0.035486 Jul 20 04:47:38.840063 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3038/5834] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:38 2022] POST /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:47:38.845019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-873a7d86-b5e6-4327-86fc-0b6a7be82d52 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:38.845646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-873a7d86-b5e6-4327-86fc-0b6a7be82d52 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:38.852835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-873a7d86-b5e6-4327-86fc-0b6a7be82d52 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:38.853274 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-873a7d86-b5e6-4327-86fc-0b6a7be82d52 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:38.854094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-873a7d86-b5e6-4327-86fc-0b6a7be82d52 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:38.854528 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-873a7d86-b5e6-4327-86fc-0b6a7be82d52 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:39.073861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cebb5113-66d3-4e36-8af8-77817ec3c3fc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:39.086981 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cebb5113-66d3-4e36-8af8-77817ec3c3fc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 200 len: 1308 microversion: 2.1 time: 0.513388 Jul 20 04:47:39.100303 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2797/5835] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:38 2022] GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 1308 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:39.131324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-873a7d86-b5e6-4327-86fc-0b6a7be82d52 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:39.146025 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-873a7d86-b5e6-4327-86fc-0b6a7be82d52 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.305214 Jul 20 04:47:39.146881 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3039/5836] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:38 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:39.177104 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1aafe9bc-4134-47ce-8439-4ce4eccc16bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:39.178828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1aafe9bc-4134-47ce-8439-4ce4eccc16bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:39.191075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1aafe9bc-4134-47ce-8439-4ce4eccc16bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:39.192036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1aafe9bc-4134-47ce-8439-4ce4eccc16bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:39.193358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1aafe9bc-4134-47ce-8439-4ce4eccc16bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:39.194414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1aafe9bc-4134-47ce-8439-4ce4eccc16bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:39.219646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-776d08fb-e625-4595-9ed9-552d3e4f2077 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:39.220295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-776d08fb-e625-4595-9ed9-552d3e4f2077 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:39.227104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-776d08fb-e625-4595-9ed9-552d3e4f2077 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:39.227545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-776d08fb-e625-4595-9ed9-552d3e4f2077 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:39.228516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-776d08fb-e625-4595-9ed9-552d3e4f2077 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:39.229162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-776d08fb-e625-4595-9ed9-552d3e4f2077 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:39.405867 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-776d08fb-e625-4595-9ed9-552d3e4f2077 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:39.418593 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-776d08fb-e625-4595-9ed9-552d3e4f2077 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1279 microversion: 2.1 time: 0.202827 Jul 20 04:47:39.419307 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3040/5837] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:39 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1279 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:39.601555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1aafe9bc-4134-47ce-8439-4ce4eccc16bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:39.623718 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1aafe9bc-4134-47ce-8439-4ce4eccc16bc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.450897 Jul 20 04:47:39.623718 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2798/5838] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:39 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:39.639795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-abd059a3-bce9-44f5-b9b6-a8a7262c231b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:39.642397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-abd059a3-bce9-44f5-b9b6-a8a7262c231b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 8d98f1ed-33bb-4d64-9d5a-eea64f93e734] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:39.650867 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-abd059a3-bce9-44f5-b9b6-a8a7262c231b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance 8d98f1ed-33bb-4d64-9d5a-eea64f93e734 could not be found. Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-abd059a3-bce9-44f5-b9b6-a8a7262c231b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/8d98f1ed-33bb-4d64-9d5a-eea64f93e734/action HTTP/1.1 Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 65 Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: {"rebuild": {"imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b"}} Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 8d98f1ed-33bb-4d64-9d5a-eea64f93e734 could not be found. Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '8d98f1ed-33bb-4d64-9d5a-eea64f93e734', 'body': {'rebuild': {'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b'}}} Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d98f1ed-33bb-4d64-9d5a-eea64f93e734 could not be found. Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:47:39.653558 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:39.659579 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:39.659579 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:39.659579 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:39.659579 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d98f1ed-33bb-4d64-9d5a-eea64f93e734 could not be found. Jul 20 04:47:39.659579 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:39.659579 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:39.659579 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:39.659579 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:39.659579 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:39.659579 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:39.659579 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:39.659579 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:39.659579 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d98f1ed-33bb-4d64-9d5a-eea64f93e734 could not be found. Jul 20 04:47:39.659579 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:39.659579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-abd059a3-bce9-44f5-b9b6-a8a7262c231b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance 8d98f1ed-33bb-4d64-9d5a-eea64f93e734 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:39.659579 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-abd059a3-bce9-44f5-b9b6-a8a7262c231b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/8d98f1ed-33bb-4d64-9d5a-eea64f93e734/action" status: 404 len: 111 microversion: 2.1 time: 0.023858 Jul 20 04:47:39.662121 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3041/5839] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:39 2022] POST /compute/v2.1/servers/8d98f1ed-33bb-4d64-9d5a-eea64f93e734/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:47:39.670261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-68639e72-9070-4dca-ac05-dc70bcd20c3c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:39.671072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-68639e72-9070-4dca-ac05-dc70bcd20c3c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:39.677942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68639e72-9070-4dca-ac05-dc70bcd20c3c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:39.678563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68639e72-9070-4dca-ac05-dc70bcd20c3c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:39.679417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68639e72-9070-4dca-ac05-dc70bcd20c3c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:39.680788 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68639e72-9070-4dca-ac05-dc70bcd20c3c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:39.944762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-68639e72-9070-4dca-ac05-dc70bcd20c3c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:39.955340 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-68639e72-9070-4dca-ac05-dc70bcd20c3c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.289562 Jul 20 04:47:39.957477 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2799/5840] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:39 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:39.975270 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-12d368d4-fa4a-4c09-abec-0bc372ba924c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:39.976168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-12d368d4-fa4a-4c09-abec-0bc372ba924c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:39.985112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-12d368d4-fa4a-4c09-abec-0bc372ba924c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:39.985841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-12d368d4-fa4a-4c09-abec-0bc372ba924c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:39.986789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-12d368d4-fa4a-4c09-abec-0bc372ba924c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:39.987376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-12d368d4-fa4a-4c09-abec-0bc372ba924c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.009312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:40.115392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fe5e0067-dd33-4382-bc77-88ec91319e0e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:40.116767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fe5e0067-dd33-4382-bc77-88ec91319e0e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:40.127809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe5e0067-dd33-4382-bc77-88ec91319e0e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.132555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe5e0067-dd33-4382-bc77-88ec91319e0e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.133768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe5e0067-dd33-4382-bc77-88ec91319e0e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.141271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe5e0067-dd33-4382-bc77-88ec91319e0e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.276668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-12d368d4-fa4a-4c09-abec-0bc372ba924c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:40.288856 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-12d368d4-fa4a-4c09-abec-0bc372ba924c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.317358 Jul 20 04:47:40.290116 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3042/5841] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:39 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:40.310149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6f255b77-7d08-4f36-8fcc-588f5ad7078d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:40.310680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6f255b77-7d08-4f36-8fcc-588f5ad7078d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: a58c39e5-d910-444d-a3ba-00d48955124b] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:40.319478 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-6f255b77-7d08-4f36-8fcc-588f5ad7078d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance a58c39e5-d910-444d-a3ba-00d48955124b could not be found. Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6f255b77-7d08-4f36-8fcc-588f5ad7078d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/a58c39e5-d910-444d-a3ba-00d48955124b/action HTTP/1.1 Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 15 Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: {"restore": {}} Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance a58c39e5-d910-444d-a3ba-00d48955124b could not be found. Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'a58c39e5-d910-444d-a3ba-00d48955124b', 'body': {'restore': {}}} Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a58c39e5-d910-444d-a3ba-00d48955124b could not be found. Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a58c39e5-d910-444d-a3ba-00d48955124b could not be found. Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:40.321333 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:40.325459 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:40.325459 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:40.325459 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a58c39e5-d910-444d-a3ba-00d48955124b could not be found. Jul 20 04:47:40.325459 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:40.327343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6f255b77-7d08-4f36-8fcc-588f5ad7078d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance a58c39e5-d910-444d-a3ba-00d48955124b could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:40.328510 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6f255b77-7d08-4f36-8fcc-588f5ad7078d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/a58c39e5-d910-444d-a3ba-00d48955124b/action" status: 404 len: 111 microversion: 2.1 time: 0.023071 Jul 20 04:47:40.329594 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3043/5842] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:40 2022] POST /compute/v2.1/servers/a58c39e5-d910-444d-a3ba-00d48955124b/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:40.341353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bde5010c-b65d-4e76-9e19-7958ed5ec518 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:40.342002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bde5010c-b65d-4e76-9e19-7958ed5ec518 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:40.353154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bde5010c-b65d-4e76-9e19-7958ed5ec518 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.353616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bde5010c-b65d-4e76-9e19-7958ed5ec518 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.354454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bde5010c-b65d-4e76-9e19-7958ed5ec518 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.354820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fe5e0067-dd33-4382-bc77-88ec91319e0e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:40.355009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bde5010c-b65d-4e76-9e19-7958ed5ec518 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.364938 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fe5e0067-dd33-4382-bc77-88ec91319e0e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 200 len: 1490 microversion: 2.1 time: 0.252758 Jul 20 04:47:40.369106 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2800/5843] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:40 2022] GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 1490 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:40.386417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-acd1fde5-b6c3-4ed8-8e09-6ae11a7fa496 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:40.387271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-acd1fde5-b6c3-4ed8-8e09-6ae11a7fa496 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:40.402441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-acd1fde5-b6c3-4ed8-8e09-6ae11a7fa496 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.402898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-acd1fde5-b6c3-4ed8-8e09-6ae11a7fa496 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.404534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-acd1fde5-b6c3-4ed8-8e09-6ae11a7fa496 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.405124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-acd1fde5-b6c3-4ed8-8e09-6ae11a7fa496 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.562082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-acd1fde5-b6c3-4ed8-8e09-6ae11a7fa496 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:40.571926 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-acd1fde5-b6c3-4ed8-8e09-6ae11a7fa496 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 200 len: 1489 microversion: 2.1 time: 0.189694 Jul 20 04:47:40.573936 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2801/5844] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:40 2022] GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 1489 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:40.580855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cee6ffa0-0b9b-451a-a3c8-be2c7bf2c6bc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:40.581924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cee6ffa0-0b9b-451a-a3c8-be2c7bf2c6bc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:40.592569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cee6ffa0-0b9b-451a-a3c8-be2c7bf2c6bc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.593327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cee6ffa0-0b9b-451a-a3c8-be2c7bf2c6bc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.594559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cee6ffa0-0b9b-451a-a3c8-be2c7bf2c6bc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.595309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cee6ffa0-0b9b-451a-a3c8-be2c7bf2c6bc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.606188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bde5010c-b65d-4e76-9e19-7958ed5ec518 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:40.639827 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bde5010c-b65d-4e76-9e19-7958ed5ec518 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.304757 Jul 20 04:47:40.640620 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3044/5845] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:40 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:40.648933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-504741bd-9dc9-4313-8301-cbf7cc3f9dfb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:40.649937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-504741bd-9dc9-4313-8301-cbf7cc3f9dfb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:40.661080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-504741bd-9dc9-4313-8301-cbf7cc3f9dfb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.661733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-504741bd-9dc9-4313-8301-cbf7cc3f9dfb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.663483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-504741bd-9dc9-4313-8301-cbf7cc3f9dfb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.664811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-504741bd-9dc9-4313-8301-cbf7cc3f9dfb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.772337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cee6ffa0-0b9b-451a-a3c8-be2c7bf2c6bc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:40.780880 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cee6ffa0-0b9b-451a-a3c8-be2c7bf2c6bc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1267 microversion: 2.1 time: 0.206424 Jul 20 04:47:40.781487 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2802/5846] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:40 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:40.793809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-87487b8b-f40d-46a8-beed-0db53355d7c4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:40.794596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-87487b8b-f40d-46a8-beed-0db53355d7c4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:40.803463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87487b8b-f40d-46a8-beed-0db53355d7c4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.803923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87487b8b-f40d-46a8-beed-0db53355d7c4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.804770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87487b8b-f40d-46a8-beed-0db53355d7c4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.805224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87487b8b-f40d-46a8-beed-0db53355d7c4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.923158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-504741bd-9dc9-4313-8301-cbf7cc3f9dfb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:40.933643 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-504741bd-9dc9-4313-8301-cbf7cc3f9dfb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 200 len: 1490 microversion: 2.1 time: 0.291679 Jul 20 04:47:40.934261 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3045/5847] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:40 2022] GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 1490 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:40.950536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e7cfd6e6-9fed-48b5-975a-f125af1bf491 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:40.951277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e7cfd6e6-9fed-48b5-975a-f125af1bf491 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:40.958454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e7cfd6e6-9fed-48b5-975a-f125af1bf491 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.959898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e7cfd6e6-9fed-48b5-975a-f125af1bf491 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.960751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e7cfd6e6-9fed-48b5-975a-f125af1bf491 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.961191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e7cfd6e6-9fed-48b5-975a-f125af1bf491 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.962760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-87487b8b-f40d-46a8-beed-0db53355d7c4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:40.977743 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-87487b8b-f40d-46a8-beed-0db53355d7c4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.195140 Jul 20 04:47:40.978772 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2803/5848] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:40 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:40.990464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e7cfd6e6-9fed-48b5-975a-f125af1bf491 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:47:40.997570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0cc2e8b5-85b7-4130-b216-187f7286ffee tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:40.998227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0cc2e8b5-85b7-4130-b216-187f7286ffee tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:41.005307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0cc2e8b5-85b7-4130-b216-187f7286ffee tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.005973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0cc2e8b5-85b7-4130-b216-187f7286ffee tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.006781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0cc2e8b5-85b7-4130-b216-187f7286ffee tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.007381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0cc2e8b5-85b7-4130-b216-187f7286ffee tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.031915 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-0cc2e8b5-85b7-4130-b216-187f7286ffee tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Cannot 'restore' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0cc2e8b5-85b7-4130-b216-187f7286ffee tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action HTTP/1.1 Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 15 Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: {"restore": {}} Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: exception: Cannot 'restore' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '1d530bf9-a3da-4006-9120-3bc00e8266e3', 'body': {'restore': {}}} Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 in vm_state active. Cannot restore while the instance is in this state. Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:41.033942 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:41.037790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:41.037790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:41.037790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:41.037790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active Jul 20 04:47:41.037790 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:41.037790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0cc2e8b5-85b7-4130-b216-187f7286ffee tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 409 to user: Cannot 'restore' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:41.037790 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0cc2e8b5-85b7-4130-b216-187f7286ffee tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action" status: 409 len: 145 microversion: 2.1 time: 0.043553 Jul 20 04:47:41.037790 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2804/5849] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:40 2022] POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action => generated 145 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:47:41.045172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-085c777e-809e-4597-ba15-02b8f5e1d80f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:41.045787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-085c777e-809e-4597-ba15-02b8f5e1d80f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:41.054005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-085c777e-809e-4597-ba15-02b8f5e1d80f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.054481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-085c777e-809e-4597-ba15-02b8f5e1d80f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.055396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-085c777e-809e-4597-ba15-02b8f5e1d80f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.055904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-085c777e-809e-4597-ba15-02b8f5e1d80f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.091654 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e7cfd6e6-9fed-48b5-975a-f125af1bf491 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 204 len: 0 microversion: 2.1 time: 0.145385 Jul 20 04:47:41.092396 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3046/5850] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:47:40 2022] DELETE /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:47:41.101148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c8f4b729-868f-42a8-9cc3-3067452919e2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:41.102002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c8f4b729-868f-42a8-9cc3-3067452919e2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:41.109208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8f4b729-868f-42a8-9cc3-3067452919e2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.109663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8f4b729-868f-42a8-9cc3-3067452919e2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.110453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8f4b729-868f-42a8-9cc3-3067452919e2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.110893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8f4b729-868f-42a8-9cc3-3067452919e2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.219921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-085c777e-809e-4597-ba15-02b8f5e1d80f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:41.230945 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-085c777e-809e-4597-ba15-02b8f5e1d80f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1681 microversion: 2.1 time: 0.189700 Jul 20 04:47:41.234526 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2805/5851] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:41 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1681 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:41.236936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c58b2334-0cab-43fb-a86b-9e5f2cc9488a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:41.243883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c58b2334-0cab-43fb-a86b-9e5f2cc9488a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:41.256977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c58b2334-0cab-43fb-a86b-9e5f2cc9488a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.257506 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c58b2334-0cab-43fb-a86b-9e5f2cc9488a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.258518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c58b2334-0cab-43fb-a86b-9e5f2cc9488a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.258978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c58b2334-0cab-43fb-a86b-9e5f2cc9488a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.300759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c8f4b729-868f-42a8-9cc3-3067452919e2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:41.310294 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c8f4b729-868f-42a8-9cc3-3067452919e2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.213533 Jul 20 04:47:41.311027 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3047/5852] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:41 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:41.328387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-db933e21-5db4-4c97-9a47-9b2ff3b1bc54 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:41.329230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-db933e21-5db4-4c97-9a47-9b2ff3b1bc54 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:41.335786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db933e21-5db4-4c97-9a47-9b2ff3b1bc54 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.336231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db933e21-5db4-4c97-9a47-9b2ff3b1bc54 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.337131 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db933e21-5db4-4c97-9a47-9b2ff3b1bc54 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.337731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db933e21-5db4-4c97-9a47-9b2ff3b1bc54 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.493717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-db933e21-5db4-4c97-9a47-9b2ff3b1bc54 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:41.502306 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-db933e21-5db4-4c97-9a47-9b2ff3b1bc54 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.178392 Jul 20 04:47:41.502887 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3048/5853] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:41 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:41.514197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e2c61fdb-5beb-4f5e-bc82-1905123c7f45 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:41.515251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e2c61fdb-5beb-4f5e-bc82-1905123c7f45 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:41.523260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e2c61fdb-5beb-4f5e-bc82-1905123c7f45 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.523916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e2c61fdb-5beb-4f5e-bc82-1905123c7f45 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.525029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e2c61fdb-5beb-4f5e-bc82-1905123c7f45 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.525567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e2c61fdb-5beb-4f5e-bc82-1905123c7f45 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.555997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c58b2334-0cab-43fb-a86b-9e5f2cc9488a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:41.564727 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c58b2334-0cab-43fb-a86b-9e5f2cc9488a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 200 len: 1496 microversion: 2.1 time: 0.331514 Jul 20 04:47:41.565492 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2806/5854] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:41 2022] GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 1496 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:41.570707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1540224f-33a7-400d-bd2e-af845afaa126 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:41.571837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1540224f-33a7-400d-bd2e-af845afaa126 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 9b9a767a-041d-4bc2-af89-59d6c1c6d3a4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:41.583391 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-1540224f-33a7-400d-bd2e-af845afaa126 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance 9b9a767a-041d-4bc2-af89-59d6c1c6d3a4 could not be found. Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1540224f-33a7-400d-bd2e-af845afaa126 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/9b9a767a-041d-4bc2-af89-59d6c1c6d3a4/action HTTP/1.1 Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 14 Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: {"resume": {}} Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 9b9a767a-041d-4bc2-af89-59d6c1c6d3a4 could not be found. Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '9b9a767a-041d-4bc2-af89-59d6c1c6d3a4', 'body': {'resume': {}}} Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b9a767a-041d-4bc2-af89-59d6c1c6d3a4 could not be found. Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b9a767a-041d-4bc2-af89-59d6c1c6d3a4 could not be found. Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:41.596454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:41.601072 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:41.601072 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:41.601072 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b9a767a-041d-4bc2-af89-59d6c1c6d3a4 could not be found. Jul 20 04:47:41.601072 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:41.601349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1540224f-33a7-400d-bd2e-af845afaa126 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance 9b9a767a-041d-4bc2-af89-59d6c1c6d3a4 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:41.602325 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1540224f-33a7-400d-bd2e-af845afaa126 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/9b9a767a-041d-4bc2-af89-59d6c1c6d3a4/action" status: 404 len: 111 microversion: 2.1 time: 0.035780 Jul 20 04:47:41.603007 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2807/5855] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:41 2022] POST /compute/v2.1/servers/9b9a767a-041d-4bc2-af89-59d6c1c6d3a4/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:41.611783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a415614b-9bb1-4d19-9c7c-f8d3ad28c31b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:41.613706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a415614b-9bb1-4d19-9c7c-f8d3ad28c31b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:41.625254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a415614b-9bb1-4d19-9c7c-f8d3ad28c31b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.625979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a415614b-9bb1-4d19-9c7c-f8d3ad28c31b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.626826 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a415614b-9bb1-4d19-9c7c-f8d3ad28c31b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.627380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a415614b-9bb1-4d19-9c7c-f8d3ad28c31b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.889743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a415614b-9bb1-4d19-9c7c-f8d3ad28c31b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:41.897893 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a415614b-9bb1-4d19-9c7c-f8d3ad28c31b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.290114 Jul 20 04:47:41.898445 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2808/5856] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:41 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:41.903299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e19324d8-5fec-432f-afce-acb55a5e1c0d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:41.903914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e19324d8-5fec-432f-afce-acb55a5e1c0d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:41.913122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e19324d8-5fec-432f-afce-acb55a5e1c0d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.913584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e19324d8-5fec-432f-afce-acb55a5e1c0d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.914393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e19324d8-5fec-432f-afce-acb55a5e1c0d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.914846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e19324d8-5fec-432f-afce-acb55a5e1c0d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.144707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e19324d8-5fec-432f-afce-acb55a5e1c0d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:42.156553 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e19324d8-5fec-432f-afce-acb55a5e1c0d tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1267 microversion: 2.1 time: 0.256771 Jul 20 04:47:42.157802 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2809/5857] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:41 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1267 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:42.160048 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e2c61fdb-5beb-4f5e-bc82-1905123c7f45 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529/action" status: 200 len: 32634 microversion: 2.1 time: 0.650582 Jul 20 04:47:42.161887 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3049/5858] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:41 2022] POST /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529/action => generated 32634 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:47:42.172817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-16a8a6ee-9735-4303-bdef-a60da97ff94a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:42.173478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-16a8a6ee-9735-4303-bdef-a60da97ff94a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:42.180796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16a8a6ee-9735-4303-bdef-a60da97ff94a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:42.181419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16a8a6ee-9735-4303-bdef-a60da97ff94a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.182347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16a8a6ee-9735-4303-bdef-a60da97ff94a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:42.182829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16a8a6ee-9735-4303-bdef-a60da97ff94a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.346827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-eb50aad6-3725-49f0-a8ed-44e4f2efc52f tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:42.347852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-eb50aad6-3725-49f0-a8ed-44e4f2efc52f tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:42.356718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb50aad6-3725-49f0-a8ed-44e4f2efc52f tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:42.357205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb50aad6-3725-49f0-a8ed-44e4f2efc52f tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.358028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb50aad6-3725-49f0-a8ed-44e4f2efc52f tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:42.358468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eb50aad6-3725-49f0-a8ed-44e4f2efc52f tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.415743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-16a8a6ee-9735-4303-bdef-a60da97ff94a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:42.426465 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-16a8a6ee-9735-4303-bdef-a60da97ff94a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.257318 Jul 20 04:47:42.427546 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2810/5859] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:42 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:42.447849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c080e6dc-96af-40ef-b28a-46aa1dc9598f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:42.448400 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c080e6dc-96af-40ef-b28a-46aa1dc9598f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:42.455089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c080e6dc-96af-40ef-b28a-46aa1dc9598f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:42.455884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c080e6dc-96af-40ef-b28a-46aa1dc9598f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.456671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c080e6dc-96af-40ef-b28a-46aa1dc9598f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:42.457132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c080e6dc-96af-40ef-b28a-46aa1dc9598f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.485413 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-c080e6dc-96af-40ef-b28a-46aa1dc9598f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Cannot 'resume' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c080e6dc-96af-40ef-b28a-46aa1dc9598f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action HTTP/1.1 Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 14 Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: {"resume": {}} Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: exception: Cannot 'resume' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '1d530bf9-a3da-4006-9120-3bc00e8266e3', 'body': {'resume': {}}} Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 in vm_state active. Cannot resume while the instance is in this state. Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:42.487421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:42.496031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:42.496031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:42.496031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:42.496031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active Jul 20 04:47:42.496031 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:42.496031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c080e6dc-96af-40ef-b28a-46aa1dc9598f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 409 to user: Cannot 'resume' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:42.496031 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c080e6dc-96af-40ef-b28a-46aa1dc9598f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action" status: 409 len: 144 microversion: 2.1 time: 0.046992 Jul 20 04:47:42.496031 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2811/5860] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:42 2022] POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action => generated 144 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:47:42.499645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7eccb9e5-efe9-4535-8d5d-9aaf285e424f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:42.500888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7eccb9e5-efe9-4535-8d5d-9aaf285e424f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:42.513580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7eccb9e5-efe9-4535-8d5d-9aaf285e424f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:42.514098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7eccb9e5-efe9-4535-8d5d-9aaf285e424f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.514941 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7eccb9e5-efe9-4535-8d5d-9aaf285e424f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:42.515400 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7eccb9e5-efe9-4535-8d5d-9aaf285e424f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.534038 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-eb50aad6-3725-49f0-a8ed-44e4f2efc52f tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1832 microversion: 2.1 time: 0.192231 Jul 20 04:47:42.536316 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3050/5861] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:42 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1832 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:42.561730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8d6111b2-429a-4989-a76b-7038b4c73121 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:42.562903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8d6111b2-429a-4989-a76b-7038b4c73121 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:42.567435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:42.574844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d6111b2-429a-4989-a76b-7038b4c73121 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:42.575623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d6111b2-429a-4989-a76b-7038b4c73121 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.577133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d6111b2-429a-4989-a76b-7038b4c73121 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:42.577771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d6111b2-429a-4989-a76b-7038b4c73121 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.602562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=14 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:42.617141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-8d6111b2-429a-4989-a76b-7038b4c73121 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lazy-loading 'flavor' on Instance uuid f9cbd595-7323-4d8a-b0d1-da8952f04529 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:47:42.635617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8d6111b2-429a-4989-a76b-7038b4c73121 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Going to try to live migrate instance to another host {{(pid=127871) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:47:42.901462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:43.320398 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7eccb9e5-efe9-4535-8d5d-9aaf285e424f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:43.332841 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7eccb9e5-efe9-4535-8d5d-9aaf285e424f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.838274 Jul 20 04:47:43.333567 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2812/5862] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:42 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:43.339594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-740463b4-6f22-48c8-889d-b4adf91b7ee2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:43.340404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-740463b4-6f22-48c8-889d-b4adf91b7ee2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:43.348553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-740463b4-6f22-48c8-889d-b4adf91b7ee2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:43.349016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-740463b4-6f22-48c8-889d-b4adf91b7ee2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:43.350035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-740463b4-6f22-48c8-889d-b4adf91b7ee2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:43.350621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-740463b4-6f22-48c8-889d-b4adf91b7ee2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:43.706672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-740463b4-6f22-48c8-889d-b4adf91b7ee2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:43.715200 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-740463b4-6f22-48c8-889d-b4adf91b7ee2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 200 len: 1496 microversion: 2.1 time: 0.380472 Jul 20 04:47:43.715802 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2813/5863] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:43 2022] GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 1496 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:43.720710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf80165a-e12a-4dfb-9d3a-2b0d78b1c124 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:43.721459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cf80165a-e12a-4dfb-9d3a-2b0d78b1c124 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:43.729580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf80165a-e12a-4dfb-9d3a-2b0d78b1c124 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:43.730138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf80165a-e12a-4dfb-9d3a-2b0d78b1c124 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:43.731038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf80165a-e12a-4dfb-9d3a-2b0d78b1c124 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:43.731562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf80165a-e12a-4dfb-9d3a-2b0d78b1c124 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.149593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cf80165a-e12a-4dfb-9d3a-2b0d78b1c124 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:44.157371 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:44.176312 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cf80165a-e12a-4dfb-9d3a-2b0d78b1c124 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1267 microversion: 2.1 time: 0.459261 Jul 20 04:47:44.177313 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2814/5864] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:43 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1267 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:44.182686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d2e18f3a-2198-465b-8117-8beee5840971 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:44.183330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d2e18f3a-2198-465b-8117-8beee5840971 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:44.190969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2e18f3a-2198-465b-8117-8beee5840971 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.191454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2e18f3a-2198-465b-8117-8beee5840971 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.192466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2e18f3a-2198-465b-8117-8beee5840971 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.193138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2e18f3a-2198-465b-8117-8beee5840971 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.492098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d2e18f3a-2198-465b-8117-8beee5840971 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:44.500208 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d2e18f3a-2198-465b-8117-8beee5840971 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.321620 Jul 20 04:47:44.500861 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2815/5865] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:44 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:44.506424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-c10640c3-0a32-40f2-a43c-9e6bc7d5e0e9 req-37c35bfa-6427-428f-8e7b-16a0c76cc0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfacab33-2416-4749-98f6-964d2033f472", "name": "network-vif-deleted", "tag": "88d01b91-c7c2-442f-a6a1-b4460cb2c3a9"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:44.514892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c10640c3-0a32-40f2-a43c-9e6bc7d5e0e9 req-37c35bfa-6427-428f-8e7b-16a0c76cc0c8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.516034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c10640c3-0a32-40f2-a43c-9e6bc7d5e0e9 req-37c35bfa-6427-428f-8e7b-16a0c76cc0c8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.531346 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-c10640c3-0a32-40f2-a43c-9e6bc7d5e0e9 req-37c35bfa-6427-428f-8e7b-16a0c76cc0c8 service nova] Creating event network-vif-deleted:88d01b91-c7c2-442f-a6a1-b4460cb2c3a9 for instance dfacab33-2416-4749-98f6-964d2033f472 on n-h1-826526-5 Jul 20 04:47:44.536987 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-c10640c3-0a32-40f2-a43c-9e6bc7d5e0e9 req-37c35bfa-6427-428f-8e7b-16a0c76cc0c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033868 Jul 20 04:47:44.538009 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2816/5866] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:44.566767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ae2ed10d-ca54-4a46-9a46-580d1da7a793 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ae2ed10d-ca54-4a46-9a46-580d1da7a793 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 160 Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: {"server": {"name": "", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "251a4e63-1968-40ea-8261-3caafe352db6"}]}} Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'body': {'server': {'name': '', 'imageRef': 'dd295612-2ec2-458d-9fdf-8704437a5c0b', 'flavorRef': '452', 'networks': [{'uuid': '251a4e63-1968-40ea-8261-3caafe352db6'}]}}} Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi '' Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:47:44.569412 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:47:44.573666 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:47:44.573666 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:47:44.573666 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:44.573666 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:44.573666 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:44.573666 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:44.573666 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:44.573666 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:44.573666 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:47:44.573666 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:47:44.573666 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:47:44.573666 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:44.573666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ae2ed10d-ca54-4a46-9a46-580d1da7a793 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:44.573666 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ae2ed10d-ca54-4a46-9a46-580d1da7a793 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.009686 Jul 20 04:47:44.573666 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2817/5867] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:44 2022] POST /compute/v2.1/servers => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:47:44.581903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4360a8bd-c284-45ad-99f6-c796d2d91458 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:44.582891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4360a8bd-c284-45ad-99f6-c796d2d91458 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:44.593313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4360a8bd-c284-45ad-99f6-c796d2d91458 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.593921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4360a8bd-c284-45ad-99f6-c796d2d91458 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.594767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4360a8bd-c284-45ad-99f6-c796d2d91458 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.596048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4360a8bd-c284-45ad-99f6-c796d2d91458 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.804850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4360a8bd-c284-45ad-99f6-c796d2d91458 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:44.818606 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4360a8bd-c284-45ad-99f6-c796d2d91458 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.242079 Jul 20 04:47:44.819321 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2818/5868] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:44 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:44.831334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-602884e3-257c-423d-b32b-2321061646f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:44.832026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-602884e3-257c-423d-b32b-2321061646f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:44.851496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-602884e3-257c-423d-b32b-2321061646f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.852051 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-602884e3-257c-423d-b32b-2321061646f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.853294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-602884e3-257c-423d-b32b-2321061646f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.854895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-602884e3-257c-423d-b32b-2321061646f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.871066 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-602884e3-257c-423d-b32b-2321061646f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance dfacab33-2416-4749-98f6-964d2033f472 could not be found. Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-602884e3-257c-423d-b32b-2321061646f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 HTTP/1.1 Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance dfacab33-2416-4749-98f6-964d2033f472 could not be found. Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'dfacab33-2416-4749-98f6-964d2033f472'} Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfacab33-2416-4749-98f6-964d2033f472 could not be found. Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfacab33-2416-4749-98f6-964d2033f472 could not be found. Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:44.872736 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:44.882668 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:44.882668 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:44.882668 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:44.882668 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:44.882668 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfacab33-2416-4749-98f6-964d2033f472 could not be found. Jul 20 04:47:44.882668 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:44.882668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-602884e3-257c-423d-b32b-2321061646f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance dfacab33-2416-4749-98f6-964d2033f472 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:44.882668 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-602884e3-257c-423d-b32b-2321061646f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 404 len: 111 microversion: 2.1 time: 0.054018 Jul 20 04:47:44.882668 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2819/5869] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:44 2022] GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:44.882668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ff727640-7f96-4ea3-aefb-6d957b2dc54a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:44.882668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ff727640-7f96-4ea3-aefb-6d957b2dc54a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:44.887401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff727640-7f96-4ea3-aefb-6d957b2dc54a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.887989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff727640-7f96-4ea3-aefb-6d957b2dc54a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.888806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff727640-7f96-4ea3-aefb-6d957b2dc54a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.889275 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff727640-7f96-4ea3-aefb-6d957b2dc54a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:45.095559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ff727640-7f96-4ea3-aefb-6d957b2dc54a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:45.106029 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ff727640-7f96-4ea3-aefb-6d957b2dc54a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.229337 Jul 20 04:47:45.107330 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2820/5870] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:44 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:45.113784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6c0b28f0-8d58-441d-9dee-c5b385e4203a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:45.114644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6c0b28f0-8d58-441d-9dee-c5b385e4203a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:45.125846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c0b28f0-8d58-441d-9dee-c5b385e4203a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:45.127499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c0b28f0-8d58-441d-9dee-c5b385e4203a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:45.128810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c0b28f0-8d58-441d-9dee-c5b385e4203a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:45.129389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c0b28f0-8d58-441d-9dee-c5b385e4203a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:45.163235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6c0b28f0-8d58-441d-9dee-c5b385e4203a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:47:45.276582 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8d6111b2-429a-4989-a76b-7038b4c73121 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529/action" status: 202 len: 0 microversion: 2.1 time: 2.719471 Jul 20 04:47:45.277548 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3051/5871] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:42 2022] POST /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529/action => generated 0 bytes in 2722 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:47:45.286223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2dd17dc9-eb85-48d5-81f4-931926770b34 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:45.286461 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6c0b28f0-8d58-441d-9dee-c5b385e4203a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 204 len: 0 microversion: 2.1 time: 0.177493 Jul 20 04:47:45.286829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2dd17dc9-eb85-48d5-81f4-931926770b34 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 3c0c4d34-650c-4625-bf38-022efafd1265] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:45.287481 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2821/5872] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:47:45 2022] DELETE /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:47:45.294333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-24a23af3-8f5d-416e-adf9-580cf8f3b068 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:45.295138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-24a23af3-8f5d-416e-adf9-580cf8f3b068 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:45.296470 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-2dd17dc9-eb85-48d5-81f4-931926770b34 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance 3c0c4d34-650c-4625-bf38-022efafd1265 could not be found. Jul 20 04:47:45.302704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24a23af3-8f5d-416e-adf9-580cf8f3b068 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:45.303892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24a23af3-8f5d-416e-adf9-580cf8f3b068 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:45.304413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24a23af3-8f5d-416e-adf9-580cf8f3b068 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:45.304861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24a23af3-8f5d-416e-adf9-580cf8f3b068 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2dd17dc9-eb85-48d5-81f4-931926770b34 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/3c0c4d34-650c-4625-bf38-022efafd1265/action HTTP/1.1 Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 14 Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: {"shelve": {}} Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 3c0c4d34-650c-4625-bf38-022efafd1265 could not be found. Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '3c0c4d34-650c-4625-bf38-022efafd1265', 'body': {'shelve': {}}} Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c0c4d34-650c-4625-bf38-022efafd1265 could not be found. Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c0c4d34-650c-4625-bf38-022efafd1265 could not be found. Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:45.305974 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:45.310303 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:45.310303 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:45.310303 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c0c4d34-650c-4625-bf38-022efafd1265 could not be found. Jul 20 04:47:45.310303 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:47:45.310303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2dd17dc9-eb85-48d5-81f4-931926770b34 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance 3c0c4d34-650c-4625-bf38-022efafd1265 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:45.311525 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2dd17dc9-eb85-48d5-81f4-931926770b34 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/3c0c4d34-650c-4625-bf38-022efafd1265/action" status: 404 len: 111 microversion: 2.1 time: 0.032243 Jul 20 04:47:45.312388 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3052/5873] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:45 2022] POST /compute/v2.1/servers/3c0c4d34-650c-4625-bf38-022efafd1265/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:45.323774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9e80144d-4e6a-4b98-8148-4409e4d6ab0f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:45.324726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9e80144d-4e6a-4b98-8148-4409e4d6ab0f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:45.337183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e80144d-4e6a-4b98-8148-4409e4d6ab0f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:45.340020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e80144d-4e6a-4b98-8148-4409e4d6ab0f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:45.341051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e80144d-4e6a-4b98-8148-4409e4d6ab0f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:45.346540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e80144d-4e6a-4b98-8148-4409e4d6ab0f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:45.493088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-24a23af3-8f5d-416e-adf9-580cf8f3b068 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:45.502988 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-24a23af3-8f5d-416e-adf9-580cf8f3b068 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1267 microversion: 2.1 time: 0.214150 Jul 20 04:47:45.503893 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2822/5874] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:45 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:45.508703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-245552d0-a073-43f9-9265-c1f25bdc7f5a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:45.509432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-245552d0-a073-43f9-9265-c1f25bdc7f5a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:45.515723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-245552d0-a073-43f9-9265-c1f25bdc7f5a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:45.516424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-245552d0-a073-43f9-9265-c1f25bdc7f5a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:45.517402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-245552d0-a073-43f9-9265-c1f25bdc7f5a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:45.517857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-245552d0-a073-43f9-9265-c1f25bdc7f5a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:45.590900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9e80144d-4e6a-4b98-8148-4409e4d6ab0f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:45.599296 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9e80144d-4e6a-4b98-8148-4409e4d6ab0f tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1691 microversion: 2.1 time: 0.285588 Jul 20 04:47:45.599916 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3053/5875] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:45 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1691 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:45.605284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6dc591c0-9f4d-4b48-a1a7-c8a8d466adcc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:45.606143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6dc591c0-9f4d-4b48-a1a7-c8a8d466adcc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:45.632661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6dc591c0-9f4d-4b48-a1a7-c8a8d466adcc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:45.633057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6dc591c0-9f4d-4b48-a1a7-c8a8d466adcc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:45.633846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6dc591c0-9f4d-4b48-a1a7-c8a8d466adcc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:45.634588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6dc591c0-9f4d-4b48-a1a7-c8a8d466adcc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:45.663118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-245552d0-a073-43f9-9265-c1f25bdc7f5a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:45.674783 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-245552d0-a073-43f9-9265-c1f25bdc7f5a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 200 len: 1495 microversion: 2.1 time: 0.169409 Jul 20 04:47:45.676319 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2823/5876] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:45 2022] GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 1495 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:45.897565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6dc591c0-9f4d-4b48-a1a7-c8a8d466adcc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:45.913318 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6dc591c0-9f4d-4b48-a1a7-c8a8d466adcc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.311977 Jul 20 04:47:45.914284 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3054/5877] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:45 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:45.932863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e80d52cc-eb54-4222-95fa-8c5def7efafe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:45.934134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e80d52cc-eb54-4222-95fa-8c5def7efafe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:45.941042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e80d52cc-eb54-4222-95fa-8c5def7efafe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:45.941543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e80d52cc-eb54-4222-95fa-8c5def7efafe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:45.942296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e80d52cc-eb54-4222-95fa-8c5def7efafe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:45.942738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e80d52cc-eb54-4222-95fa-8c5def7efafe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.092298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e80d52cc-eb54-4222-95fa-8c5def7efafe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:46.103375 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e80d52cc-eb54-4222-95fa-8c5def7efafe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.174754 Jul 20 04:47:46.104382 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2824/5878] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:45 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:46.119652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2225c21c-6417-4200-a8fc-71cc77122ee8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:46.120228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2225c21c-6417-4200-a8fc-71cc77122ee8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:46.126705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2225c21c-6417-4200-a8fc-71cc77122ee8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.127156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2225c21c-6417-4200-a8fc-71cc77122ee8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.127920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2225c21c-6417-4200-a8fc-71cc77122ee8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.128548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2225c21c-6417-4200-a8fc-71cc77122ee8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.158622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-2225c21c-6417-4200-a8fc-71cc77122ee8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lazy-loading 'flavor' on Instance uuid 1d530bf9-a3da-4006-9120-3bc00e8266e3 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:47:46.427930 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2225c21c-6417-4200-a8fc-71cc77122ee8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action" status: 202 len: 0 microversion: 2.1 time: 0.311815 Jul 20 04:47:46.429266 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3055/5879] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:46 2022] POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:47:46.440719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e28f33dc-8f0d-46f1-965e-59fce6ba2539 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:46.442792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e28f33dc-8f0d-46f1-965e-59fce6ba2539 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:46.464450 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e28f33dc-8f0d-46f1-965e-59fce6ba2539 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.465249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e28f33dc-8f0d-46f1-965e-59fce6ba2539 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.466097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e28f33dc-8f0d-46f1-965e-59fce6ba2539 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.466542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e28f33dc-8f0d-46f1-965e-59fce6ba2539 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.522439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5e01d5ca-ef3e-4483-9446-7dd66b4ff4fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:46.523343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5e01d5ca-ef3e-4483-9446-7dd66b4ff4fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:46.532603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e01d5ca-ef3e-4483-9446-7dd66b4ff4fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.533083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e01d5ca-ef3e-4483-9446-7dd66b4ff4fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.533849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e01d5ca-ef3e-4483-9446-7dd66b4ff4fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.535129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e01d5ca-ef3e-4483-9446-7dd66b4ff4fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.560531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:46.732506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5e01d5ca-ef3e-4483-9446-7dd66b4ff4fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:46.744707 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5e01d5ca-ef3e-4483-9446-7dd66b4ff4fc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1267 microversion: 2.1 time: 0.226766 Jul 20 04:47:46.746216 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3056/5880] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:46 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:46.752554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4ea0b7ed-82d6-45b0-bc58-2226d11e201c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:46.753538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4ea0b7ed-82d6-45b0-bc58-2226d11e201c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:46.761199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ea0b7ed-82d6-45b0-bc58-2226d11e201c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.762083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ea0b7ed-82d6-45b0-bc58-2226d11e201c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.763198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ea0b7ed-82d6-45b0-bc58-2226d11e201c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.763834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ea0b7ed-82d6-45b0-bc58-2226d11e201c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.770548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e28f33dc-8f0d-46f1-965e-59fce6ba2539 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:46.789904 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e28f33dc-8f0d-46f1-965e-59fce6ba2539 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1511 microversion: 2.1 time: 0.354926 Jul 20 04:47:46.791343 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2825/5881] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:46 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1511 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:46.800579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d7e8ff32-4226-4f74-b292-b4487486aec8 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:46.801308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d7e8ff32-4226-4f74-b292-b4487486aec8 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:46.813566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7e8ff32-4226-4f74-b292-b4487486aec8 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.814865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7e8ff32-4226-4f74-b292-b4487486aec8 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.816019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7e8ff32-4226-4f74-b292-b4487486aec8 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.817035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7e8ff32-4226-4f74-b292-b4487486aec8 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:47.023813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d7e8ff32-4226-4f74-b292-b4487486aec8 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:47.032148 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d7e8ff32-4226-4f74-b292-b4487486aec8 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 200 len: 1495 microversion: 2.1 time: 0.239228 Jul 20 04:47:47.033274 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2826/5882] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:46 2022] GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 1495 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:47.221161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4ea0b7ed-82d6-45b0-bc58-2226d11e201c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:47.230321 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4ea0b7ed-82d6-45b0-bc58-2226d11e201c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1691 microversion: 2.1 time: 0.482709 Jul 20 04:47:47.230912 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3057/5883] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:46 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1691 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:47.763553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5741f16f-ae33-40fa-8954-f4c115597a75 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:47.764205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5741f16f-ae33-40fa-8954-f4c115597a75 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:47.776592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5741f16f-ae33-40fa-8954-f4c115597a75 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:47.777064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5741f16f-ae33-40fa-8954-f4c115597a75 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:47.778788 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5741f16f-ae33-40fa-8954-f4c115597a75 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:47.781339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5741f16f-ae33-40fa-8954-f4c115597a75 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:47.818092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1048638b-fdfe-4ac5-917f-dd33de4d2424 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:47.818729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1048638b-fdfe-4ac5-917f-dd33de4d2424 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:47.831871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1048638b-fdfe-4ac5-917f-dd33de4d2424 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:47.832083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1048638b-fdfe-4ac5-917f-dd33de4d2424 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:47.839314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1048638b-fdfe-4ac5-917f-dd33de4d2424 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:47.839783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1048638b-fdfe-4ac5-917f-dd33de4d2424 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:48.113167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5741f16f-ae33-40fa-8954-f4c115597a75 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:48.128998 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5741f16f-ae33-40fa-8954-f4c115597a75 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1267 microversion: 2.1 time: 0.369536 Jul 20 04:47:48.129676 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2827/5884] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:47 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1267 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:48.134531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-5f0ffdf3-fb3d-448a-9350-dd3b9f303306 req-3a2394f2-2ec5-48d9-8357-87a29acc74c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e6cac09-b07c-46af-a9a4-adfff5096e84", "name": "network-vif-deleted", "tag": "6455328c-b569-43a3-bf56-87b28419716b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:48.144389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5f0ffdf3-fb3d-448a-9350-dd3b9f303306 req-3a2394f2-2ec5-48d9-8357-87a29acc74c3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:48.145116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5f0ffdf3-fb3d-448a-9350-dd3b9f303306 req-3a2394f2-2ec5-48d9-8357-87a29acc74c3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:48.176203 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-5f0ffdf3-fb3d-448a-9350-dd3b9f303306 req-3a2394f2-2ec5-48d9-8357-87a29acc74c3 service nova] Creating event network-vif-deleted:6455328c-b569-43a3-bf56-87b28419716b for instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 on n-h2-826526-5 Jul 20 04:47:48.185387 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-5f0ffdf3-fb3d-448a-9350-dd3b9f303306 req-3a2394f2-2ec5-48d9-8357-87a29acc74c3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054111 Jul 20 04:47:48.186740 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2828/5885] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:48.199587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7efa0e15-979e-452c-81a8-d0f31348eba0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:48.200774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7efa0e15-979e-452c-81a8-d0f31348eba0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:48.211751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7efa0e15-979e-452c-81a8-d0f31348eba0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:48.213417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7efa0e15-979e-452c-81a8-d0f31348eba0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:48.222130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7efa0e15-979e-452c-81a8-d0f31348eba0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:48.225449 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7efa0e15-979e-452c-81a8-d0f31348eba0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:48.256294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1048638b-fdfe-4ac5-917f-dd33de4d2424 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:48.270053 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1048638b-fdfe-4ac5-917f-dd33de4d2424 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1511 microversion: 2.1 time: 0.462379 Jul 20 04:47:48.274208 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3058/5886] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:47 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1511 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:48.281938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-584f4700-9425-42c3-9f6c-439e1008dde4 req-e222fe0f-186a-4705-a6e9-1a4ec3b6fa7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9cbd595-7323-4d8a-b0d1-da8952f04529", "name": "network-vif-unplugged", "status": "completed", "tag": "4fe14c15-fa2a-465e-8d12-695d6280d0e2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:48.294810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-584f4700-9425-42c3-9f6c-439e1008dde4 req-e222fe0f-186a-4705-a6e9-1a4ec3b6fa7b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:48.297031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-584f4700-9425-42c3-9f6c-439e1008dde4 req-e222fe0f-186a-4705-a6e9-1a4ec3b6fa7b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:48.313237 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-584f4700-9425-42c3-9f6c-439e1008dde4 req-e222fe0f-186a-4705-a6e9-1a4ec3b6fa7b service nova] Creating event network-vif-unplugged:4fe14c15-fa2a-465e-8d12-695d6280d0e2 for instance f9cbd595-7323-4d8a-b0d1-da8952f04529 on n-h1-826526-5 Jul 20 04:47:48.340701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7efa0e15-979e-452c-81a8-d0f31348eba0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:48.340954 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-584f4700-9425-42c3-9f6c-439e1008dde4 req-e222fe0f-186a-4705-a6e9-1a4ec3b6fa7b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058040 Jul 20 04:47:48.341677 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3059/5887] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:48.342033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7efa0e15-979e-452c-81a8-d0f31348eba0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:48.342768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-7efa0e15-979e-452c-81a8-d0f31348eba0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lazy-loading 'fault' on Instance uuid 2e6cac09-b07c-46af-a9a4-adfff5096e84 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:47:48.354461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-917e1fe2-b824-4188-b8ed-f09ede2200db tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:48.357751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-917e1fe2-b824-4188-b8ed-f09ede2200db tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:48.372979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-917e1fe2-b824-4188-b8ed-f09ede2200db tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:48.373473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-917e1fe2-b824-4188-b8ed-f09ede2200db tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:48.374274 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-917e1fe2-b824-4188-b8ed-f09ede2200db tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:48.374720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-917e1fe2-b824-4188-b8ed-f09ede2200db tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:48.458010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7efa0e15-979e-452c-81a8-d0f31348eba0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:48.466984 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7efa0e15-979e-452c-81a8-d0f31348eba0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 200 len: 1298 microversion: 2.1 time: 0.278569 Jul 20 04:47:48.474017 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2829/5888] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:48 2022] GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 1298 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:48.645538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-917e1fe2-b824-4188-b8ed-f09ede2200db tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:48.688868 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-917e1fe2-b824-4188-b8ed-f09ede2200db tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1691 microversion: 2.1 time: 0.342631 Jul 20 04:47:48.691194 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3060/5889] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:48 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1691 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:49.151112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e0db6f00-2816-4e90-bbf0-08e18ff4a22c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:49.151865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e0db6f00-2816-4e90-bbf0-08e18ff4a22c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:49.157059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:49.161754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0db6f00-2816-4e90-bbf0-08e18ff4a22c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:49.163194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0db6f00-2816-4e90-bbf0-08e18ff4a22c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:49.164037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0db6f00-2816-4e90-bbf0-08e18ff4a22c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:49.164524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0db6f00-2816-4e90-bbf0-08e18ff4a22c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:49.293192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0fb3688b-df9d-4cb3-977a-16fa5dbde9f0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:49.294720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0fb3688b-df9d-4cb3-977a-16fa5dbde9f0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:49.302989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0fb3688b-df9d-4cb3-977a-16fa5dbde9f0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:49.303722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0fb3688b-df9d-4cb3-977a-16fa5dbde9f0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:49.304697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0fb3688b-df9d-4cb3-977a-16fa5dbde9f0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:49.305724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0fb3688b-df9d-4cb3-977a-16fa5dbde9f0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:49.355522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e0db6f00-2816-4e90-bbf0-08e18ff4a22c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:49.364326 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e0db6f00-2816-4e90-bbf0-08e18ff4a22c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1267 microversion: 2.1 time: 0.221677 Jul 20 04:47:49.365109 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2830/5890] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:49 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:49.489966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-995ee9f6-d878-4393-92e1-2dcab6d469db tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:49.491166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-995ee9f6-d878-4393-92e1-2dcab6d469db tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:49.512888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0fb3688b-df9d-4cb3-977a-16fa5dbde9f0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:49.520472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-995ee9f6-d878-4393-92e1-2dcab6d469db tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:49.521582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-995ee9f6-d878-4393-92e1-2dcab6d469db tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:49.523435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-995ee9f6-d878-4393-92e1-2dcab6d469db tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:49.525005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-995ee9f6-d878-4393-92e1-2dcab6d469db tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:49.525204 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0fb3688b-df9d-4cb3-977a-16fa5dbde9f0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1511 microversion: 2.1 time: 0.237609 Jul 20 04:47:49.525755 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3061/5891] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:49 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1511 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:49.553192 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-995ee9f6-d878-4393-92e1-2dcab6d469db tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 could not be found. Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-995ee9f6-d878-4393-92e1-2dcab6d469db tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 HTTP/1.1 Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 could not be found. Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '2e6cac09-b07c-46af-a9a4-adfff5096e84'} Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 could not be found. Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 could not be found. Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:49.555710 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:49.561665 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:49.561665 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:49.561665 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:49.561665 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:49.561665 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 could not be found. Jul 20 04:47:49.561665 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:47:49.561665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-995ee9f6-d878-4393-92e1-2dcab6d469db tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:49.561665 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-995ee9f6-d878-4393-92e1-2dcab6d469db tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 404 len: 111 microversion: 2.1 time: 0.071860 Jul 20 04:47:49.561665 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2831/5892] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:49 2022] GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:47:49.709315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-702dff64-1997-4e0c-b103-8b6b15e2087c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:49.710431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-702dff64-1997-4e0c-b103-8b6b15e2087c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:49.723659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-702dff64-1997-4e0c-b103-8b6b15e2087c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:49.724428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-702dff64-1997-4e0c-b103-8b6b15e2087c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:49.725403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-702dff64-1997-4e0c-b103-8b6b15e2087c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:49.726081 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-702dff64-1997-4e0c-b103-8b6b15e2087c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:49.736551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-71cb5abc-7fee-4c81-9e56-7085b7016052 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-160224757", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "3d22ba6e-7662-4637-bb0f-d3084b1def5c"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:49.824591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-71cb5abc-7fee-4c81-9e56-7085b7016052 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] validate_networks() for [('3d22ba6e-7662-4637-bb0f-d3084b1def5c', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:47:49.936024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-702dff64-1997-4e0c-b103-8b6b15e2087c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:49.946371 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-702dff64-1997-4e0c-b103-8b6b15e2087c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1691 microversion: 2.1 time: 0.242129 Jul 20 04:47:49.947150 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3062/5893] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:49 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1691 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:50.362306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-08c15f63-7f90-42fb-81fd-02ea7d1f1d3a req-2d180d81-4039-43d5-892e-ee78a7541ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9cbd595-7323-4d8a-b0d1-da8952f04529", "tag": "4fe14c15-fa2a-465e-8d12-695d6280d0e2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:50.374609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-08c15f63-7f90-42fb-81fd-02ea7d1f1d3a req-2d180d81-4039-43d5-892e-ee78a7541ba2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:50.375148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-08c15f63-7f90-42fb-81fd-02ea7d1f1d3a req-2d180d81-4039-43d5-892e-ee78a7541ba2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:50.390716 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-08c15f63-7f90-42fb-81fd-02ea7d1f1d3a req-2d180d81-4039-43d5-892e-ee78a7541ba2 service nova] Creating event network-changed:4fe14c15-fa2a-465e-8d12-695d6280d0e2 for instance f9cbd595-7323-4d8a-b0d1-da8952f04529 on n-h1-826526-5 Jul 20 04:47:50.398107 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-08c15f63-7f90-42fb-81fd-02ea7d1f1d3a req-2d180d81-4039-43d5-892e-ee78a7541ba2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039666 Jul 20 04:47:50.399180 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3063/5894] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:47:50.404972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f089e954-cf6c-4c70-80ec-fbde32c25657 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:50.405584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f089e954-cf6c-4c70-80ec-fbde32c25657 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:50.413743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f089e954-cf6c-4c70-80ec-fbde32c25657 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:50.414197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f089e954-cf6c-4c70-80ec-fbde32c25657 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:50.415164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f089e954-cf6c-4c70-80ec-fbde32c25657 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:50.415403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f089e954-cf6c-4c70-80ec-fbde32c25657 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:50.593427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f089e954-cf6c-4c70-80ec-fbde32c25657 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:50.605318 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f089e954-cf6c-4c70-80ec-fbde32c25657 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1267 microversion: 2.1 time: 0.204481 Jul 20 04:47:50.607287 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3064/5895] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:50 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:50.612932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7ce3aea5-3718-4a37-b9eb-2c436317d60c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:50.613743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7ce3aea5-3718-4a37-b9eb-2c436317d60c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:50.623723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ce3aea5-3718-4a37-b9eb-2c436317d60c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:50.624334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ce3aea5-3718-4a37-b9eb-2c436317d60c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:50.625136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ce3aea5-3718-4a37-b9eb-2c436317d60c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:50.625840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ce3aea5-3718-4a37-b9eb-2c436317d60c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:50.843280 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7ce3aea5-3718-4a37-b9eb-2c436317d60c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:50.853842 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7ce3aea5-3718-4a37-b9eb-2c436317d60c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1511 microversion: 2.1 time: 0.244792 Jul 20 04:47:50.855197 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3065/5896] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:50 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1511 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:50.870299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-ab6c0dc5-57d4-4496-9c11-2d327840562b req-49490a76-a8fb-4d0b-a271-f2b55ce6eba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcc3e27-5b1a-4e63-8d64-53aeb92f237a", "name": "network-vif-plugged", "status": "completed", "tag": "e468a9ce-ee35-4c82-b0b7-a44a299daa9b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:50.879564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ab6c0dc5-57d4-4496-9c11-2d327840562b req-49490a76-a8fb-4d0b-a271-f2b55ce6eba2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:50.880007 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ab6c0dc5-57d4-4496-9c11-2d327840562b req-49490a76-a8fb-4d0b-a271-f2b55ce6eba2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:50.894003 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-ab6c0dc5-57d4-4496-9c11-2d327840562b req-49490a76-a8fb-4d0b-a271-f2b55ce6eba2 service nova] Creating event network-vif-plugged:e468a9ce-ee35-4c82-b0b7-a44a299daa9b for instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a on n-h1-826526-5 Jul 20 04:47:50.899983 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-ab6c0dc5-57d4-4496-9c11-2d327840562b req-49490a76-a8fb-4d0b-a271-f2b55ce6eba2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033314 Jul 20 04:47:50.901342 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3066/5897] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:50.969724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-71cb5abc-7fee-4c81-9e56-7085b7016052 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:47:50.970496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-71cb5abc-7fee-4c81-9e56-7085b7016052 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:47:50.971404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-71cb5abc-7fee-4c81-9e56-7085b7016052 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:47:50.972165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-71cb5abc-7fee-4c81-9e56-7085b7016052 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:47:50.972687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-345d81d1-d0a7-4e86-b620-af38f66f8c28 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:50.972954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-71cb5abc-7fee-4c81-9e56-7085b7016052 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:47:50.973463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-345d81d1-d0a7-4e86-b620-af38f66f8c28 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:50.985036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-345d81d1-d0a7-4e86-b620-af38f66f8c28 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:50.985909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-345d81d1-d0a7-4e86-b620-af38f66f8c28 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:50.986899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-345d81d1-d0a7-4e86-b620-af38f66f8c28 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:50.988062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-345d81d1-d0a7-4e86-b620-af38f66f8c28 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:50.991839 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71cb5abc-7fee-4c81-9e56-7085b7016052 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:50.992860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71cb5abc-7fee-4c81-9e56-7085b7016052 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:50.994714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71cb5abc-7fee-4c81-9e56-7085b7016052 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:50.995864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71cb5abc-7fee-4c81-9e56-7085b7016052 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:51.034371 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-71cb5abc-7fee-4c81-9e56-7085b7016052 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Getting quotas for project fc751c3978da4e05b6d7aab178723ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:47:51.043683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-71cb5abc-7fee-4c81-9e56-7085b7016052 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Getting quotas for user a5e17b2cb6654e4584b62ac8d08833f2 and project fc751c3978da4e05b6d7aab178723ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:47:51.062886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-71cb5abc-7fee-4c81-9e56-7085b7016052 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:47:51.075390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-71cb5abc-7fee-4c81-9e56-7085b7016052 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:47:51.176363 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-71cb5abc-7fee-4c81-9e56-7085b7016052 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.447542 Jul 20 04:47:51.186926 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2832/5898] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:47:51.198259 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-20cd0491-255c-45d8-8ec3-d3bf38c31d33 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:51.201635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-20cd0491-255c-45d8-8ec3-d3bf38c31d33 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:51.254932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-345d81d1-d0a7-4e86-b620-af38f66f8c28 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:51.267230 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-345d81d1-d0a7-4e86-b620-af38f66f8c28 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1691 microversion: 2.1 time: 0.302500 Jul 20 04:47:51.279719 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3067/5899] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:50 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1691 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:51.312048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-20cd0491-255c-45d8-8ec3-d3bf38c31d33 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:51.323672 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-20cd0491-255c-45d8-8ec3-d3bf38c31d33 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1208 microversion: 2.1 time: 0.133915 Jul 20 04:47:51.325003 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2833/5900] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:51 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1208 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:51.628699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9ed6cc82-43e7-445d-828e-8c8f004efb09 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:51.630749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9ed6cc82-43e7-445d-828e-8c8f004efb09 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:51.644809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ed6cc82-43e7-445d-828e-8c8f004efb09 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:51.645350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ed6cc82-43e7-445d-828e-8c8f004efb09 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:51.646153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ed6cc82-43e7-445d-828e-8c8f004efb09 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:51.646581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ed6cc82-43e7-445d-828e-8c8f004efb09 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:51.858147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9ed6cc82-43e7-445d-828e-8c8f004efb09 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:51.877705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d8d486b8-4dc7-45fc-ae21-602d7aeb4a58 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:51.877705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d8d486b8-4dc7-45fc-ae21-602d7aeb4a58 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:51.879171 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9ed6cc82-43e7-445d-828e-8c8f004efb09 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1267 microversion: 2.1 time: 0.258783 Jul 20 04:47:51.881199 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3068/5901] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:51 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1267 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:51.893454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8d486b8-4dc7-45fc-ae21-602d7aeb4a58 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:51.893799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8d486b8-4dc7-45fc-ae21-602d7aeb4a58 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:51.894717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8d486b8-4dc7-45fc-ae21-602d7aeb4a58 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:51.895351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8d486b8-4dc7-45fc-ae21-602d7aeb4a58 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:52.086975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d8d486b8-4dc7-45fc-ae21-602d7aeb4a58 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:52.093149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:52.104455 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d8d486b8-4dc7-45fc-ae21-602d7aeb4a58 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1511 microversion: 2.1 time: 0.236205 Jul 20 04:47:52.105282 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2834/5902] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:51 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1511 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:52.286895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d363ecc6-c46c-4406-92a4-fbae745a7e26 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:52.287507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d363ecc6-c46c-4406-92a4-fbae745a7e26 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:52.289629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:52.295199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d363ecc6-c46c-4406-92a4-fbae745a7e26 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:52.295766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d363ecc6-c46c-4406-92a4-fbae745a7e26 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:52.296459 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d363ecc6-c46c-4406-92a4-fbae745a7e26 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:52.296898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d363ecc6-c46c-4406-92a4-fbae745a7e26 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:52.342098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf4afc2c-04f1-47c3-9cdf-1b5d7d80b55e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:52.342822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf4afc2c-04f1-47c3-9cdf-1b5d7d80b55e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:52.352610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf4afc2c-04f1-47c3-9cdf-1b5d7d80b55e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:52.353064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf4afc2c-04f1-47c3-9cdf-1b5d7d80b55e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:52.353916 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf4afc2c-04f1-47c3-9cdf-1b5d7d80b55e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:52.354383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf4afc2c-04f1-47c3-9cdf-1b5d7d80b55e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:52.500442 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bf4afc2c-04f1-47c3-9cdf-1b5d7d80b55e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:52.525043 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf4afc2c-04f1-47c3-9cdf-1b5d7d80b55e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1260 microversion: 2.1 time: 0.187975 Jul 20 04:47:52.536629 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2835/5903] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:52 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:52.711873 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d363ecc6-c46c-4406-92a4-fbae745a7e26 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:52.724631 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d363ecc6-c46c-4406-92a4-fbae745a7e26 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1691 microversion: 2.1 time: 0.441699 Jul 20 04:47:52.725954 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3069/5904] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:52 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1691 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:52.902116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-91ffa40a-b8bd-4aa0-a5c3-f6ed79790b12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:52.903382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-91ffa40a-b8bd-4aa0-a5c3-f6ed79790b12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:52.914855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91ffa40a-b8bd-4aa0-a5c3-f6ed79790b12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:52.915685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91ffa40a-b8bd-4aa0-a5c3-f6ed79790b12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:52.917200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91ffa40a-b8bd-4aa0-a5c3-f6ed79790b12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:52.918231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91ffa40a-b8bd-4aa0-a5c3-f6ed79790b12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:53.122981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d5ce4a7-82ae-444d-8c8c-f241153bb2fe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:53.124784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4d5ce4a7-82ae-444d-8c8c-f241153bb2fe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:53.132512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d5ce4a7-82ae-444d-8c8c-f241153bb2fe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:53.133508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d5ce4a7-82ae-444d-8c8c-f241153bb2fe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:53.134719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d5ce4a7-82ae-444d-8c8c-f241153bb2fe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:53.135622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d5ce4a7-82ae-444d-8c8c-f241153bb2fe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:53.189892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-91ffa40a-b8bd-4aa0-a5c3-f6ed79790b12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:53.205021 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-91ffa40a-b8bd-4aa0-a5c3-f6ed79790b12 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1453 microversion: 2.1 time: 0.310606 Jul 20 04:47:53.205614 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2836/5905] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:52 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1453 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:53.225064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5b5aa183-ff1a-4f6f-8502-1e4285784728 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:53.225667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5b5aa183-ff1a-4f6f-8502-1e4285784728 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:53.232538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b5aa183-ff1a-4f6f-8502-1e4285784728 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:53.233255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b5aa183-ff1a-4f6f-8502-1e4285784728 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:53.234335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b5aa183-ff1a-4f6f-8502-1e4285784728 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:53.234927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b5aa183-ff1a-4f6f-8502-1e4285784728 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:53.339292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4d5ce4a7-82ae-444d-8c8c-f241153bb2fe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:53.350132 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4d5ce4a7-82ae-444d-8c8c-f241153bb2fe tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1511 microversion: 2.1 time: 0.231563 Jul 20 04:47:53.351466 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3070/5906] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:53 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:53.553023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ca4ca2e9-ca49-41c8-b890-9d51a3b0aec4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:53.554159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ca4ca2e9-ca49-41c8-b890-9d51a3b0aec4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:53.563621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca4ca2e9-ca49-41c8-b890-9d51a3b0aec4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:53.564537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca4ca2e9-ca49-41c8-b890-9d51a3b0aec4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:53.565808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca4ca2e9-ca49-41c8-b890-9d51a3b0aec4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:53.566521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca4ca2e9-ca49-41c8-b890-9d51a3b0aec4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:53.629572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5b5aa183-ff1a-4f6f-8502-1e4285784728 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:53.652610 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5b5aa183-ff1a-4f6f-8502-1e4285784728 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1453 microversion: 2.1 time: 0.433550 Jul 20 04:47:53.664348 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2837/5907] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:53 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1453 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:53.668960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ca4ca2e9-ca49-41c8-b890-9d51a3b0aec4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:53.687749 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ca4ca2e9-ca49-41c8-b890-9d51a3b0aec4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1266 microversion: 2.1 time: 0.141802 Jul 20 04:47:53.689933 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3071/5908] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:53 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:53.745267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fe43ca95-380d-4319-a804-814e9524129c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:53.746009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fe43ca95-380d-4319-a804-814e9524129c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:53.759999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe43ca95-380d-4319-a804-814e9524129c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:53.760596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe43ca95-380d-4319-a804-814e9524129c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:53.762342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe43ca95-380d-4319-a804-814e9524129c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:53.768729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe43ca95-380d-4319-a804-814e9524129c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:54.307482 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fe43ca95-380d-4319-a804-814e9524129c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:54.319910 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fe43ca95-380d-4319-a804-814e9524129c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1691 microversion: 2.1 time: 0.578725 Jul 20 04:47:54.324416 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2838/5909] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:53 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1691 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:54.383374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-993bba1a-43af-41d5-a16f-9f8f59ec60ea tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:54.385281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-993bba1a-43af-41d5-a16f-9f8f59ec60ea tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:54.394825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-993bba1a-43af-41d5-a16f-9f8f59ec60ea tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:54.395630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-993bba1a-43af-41d5-a16f-9f8f59ec60ea tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:54.396656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-993bba1a-43af-41d5-a16f-9f8f59ec60ea tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:54.397389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-993bba1a-43af-41d5-a16f-9f8f59ec60ea tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:54.628829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-993bba1a-43af-41d5-a16f-9f8f59ec60ea tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:54.643630 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-993bba1a-43af-41d5-a16f-9f8f59ec60ea tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1511 microversion: 2.1 time: 0.278668 Jul 20 04:47:54.644548 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3072/5910] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:54 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1511 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:54.714342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a34488fe-b500-43d3-bf58-3d5eac0cad37 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:54.718388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a34488fe-b500-43d3-bf58-3d5eac0cad37 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:54.727556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a34488fe-b500-43d3-bf58-3d5eac0cad37 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:54.728664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a34488fe-b500-43d3-bf58-3d5eac0cad37 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:54.729597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a34488fe-b500-43d3-bf58-3d5eac0cad37 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:54.730215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a34488fe-b500-43d3-bf58-3d5eac0cad37 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:55.030971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-6be0e7c5-744a-4582-8449-e93fa4ce8f78 req-aa7fbd8a-4acd-4772-ad64-5f432b1abe19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9cbd595-7323-4d8a-b0d1-da8952f04529", "name": "network-vif-unplugged", "status": "completed", "tag": "4fe14c15-fa2a-465e-8d12-695d6280d0e2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:55.043089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-6be0e7c5-744a-4582-8449-e93fa4ce8f78 req-aa7fbd8a-4acd-4772-ad64-5f432b1abe19 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:55.044022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-6be0e7c5-744a-4582-8449-e93fa4ce8f78 req-aa7fbd8a-4acd-4772-ad64-5f432b1abe19 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:55.063896 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-6be0e7c5-744a-4582-8449-e93fa4ce8f78 req-aa7fbd8a-4acd-4772-ad64-5f432b1abe19 service nova] Creating event network-vif-unplugged:4fe14c15-fa2a-465e-8d12-695d6280d0e2 for instance f9cbd595-7323-4d8a-b0d1-da8952f04529 on n-h1-826526-5 Jul 20 04:47:55.072718 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-6be0e7c5-744a-4582-8449-e93fa4ce8f78 req-aa7fbd8a-4acd-4772-ad64-5f432b1abe19 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050454 Jul 20 04:47:55.074575 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3073/5911] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:55.349814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d9b5027f-24ff-4bf1-9831-1dd5ee8e2c1a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:55.350745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d9b5027f-24ff-4bf1-9831-1dd5ee8e2c1a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:55.358074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d9b5027f-24ff-4bf1-9831-1dd5ee8e2c1a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:55.358615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d9b5027f-24ff-4bf1-9831-1dd5ee8e2c1a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:55.359497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d9b5027f-24ff-4bf1-9831-1dd5ee8e2c1a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:55.360012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d9b5027f-24ff-4bf1-9831-1dd5ee8e2c1a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:55.613483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a34488fe-b500-43d3-bf58-3d5eac0cad37 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:55.626815 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a34488fe-b500-43d3-bf58-3d5eac0cad37 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1308 microversion: 2.1 time: 0.916832 Jul 20 04:47:55.638609 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2839/5912] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:54 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1308 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:55.645693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3c4d7038-329d-4828-bcec-fa0ae0419941 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:55.647352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3c4d7038-329d-4828-bcec-fa0ae0419941 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:55.654381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c4d7038-329d-4828-bcec-fa0ae0419941 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:55.654888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c4d7038-329d-4828-bcec-fa0ae0419941 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:55.655744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c4d7038-329d-4828-bcec-fa0ae0419941 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:55.656233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3c4d7038-329d-4828-bcec-fa0ae0419941 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:55.801394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-3c4d7038-329d-4828-bcec-fa0ae0419941 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lazy-loading 'services' on Instance uuid 3333b1e8-7653-4bc2-a218-7a8521a338cf {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:47:55.927358 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3c4d7038-329d-4828-bcec-fa0ae0419941 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf/os-volume_attachments/887c2435-2034-4a92-ab6a-f398d11c6214" status: 202 len: 0 microversion: 2.1 time: 0.286207 Jul 20 04:47:55.928580 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2840/5913] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 04:47:55 2022] DELETE /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf/os-volume_attachments/887c2435-2034-4a92-ab6a-f398d11c6214 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:47:55.938538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8211669c-c674-48c3-a213-aba8cade9da7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:55.939507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8211669c-c674-48c3-a213-aba8cade9da7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:55.973697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8211669c-c674-48c3-a213-aba8cade9da7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:55.977138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8211669c-c674-48c3-a213-aba8cade9da7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:56.001943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8211669c-c674-48c3-a213-aba8cade9da7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:56.004226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8211669c-c674-48c3-a213-aba8cade9da7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:56.123257 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d9b5027f-24ff-4bf1-9831-1dd5ee8e2c1a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:56.141538 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d9b5027f-24ff-4bf1-9831-1dd5ee8e2c1a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1691 microversion: 2.1 time: 0.796751 Jul 20 04:47:56.143387 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3074/5914] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:55 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1691 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:56.645966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7a52bf84-bffa-4b08-9fa3-d0b411e56f1c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:56.646960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7a52bf84-bffa-4b08-9fa3-d0b411e56f1c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:56.654717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a52bf84-bffa-4b08-9fa3-d0b411e56f1c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:56.655451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a52bf84-bffa-4b08-9fa3-d0b411e56f1c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:56.656562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a52bf84-bffa-4b08-9fa3-d0b411e56f1c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:56.657138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a52bf84-bffa-4b08-9fa3-d0b411e56f1c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:56.682328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:56.770971 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8211669c-c674-48c3-a213-aba8cade9da7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:56.786458 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8211669c-c674-48c3-a213-aba8cade9da7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1511 microversion: 2.1 time: 0.852289 Jul 20 04:47:56.787964 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2841/5915] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:55 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1511 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:57.069840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7a52bf84-bffa-4b08-9fa3-d0b411e56f1c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:57.088082 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7a52bf84-bffa-4b08-9fa3-d0b411e56f1c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1308 microversion: 2.1 time: 0.445918 Jul 20 04:47:57.105029 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3075/5916] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:56 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1308 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:57.107362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-b7e23aa2-0812-4575-acf9-52fe50c5e9d0 req-ec59b90e-2a81-481e-a7c0-58aa0c27d0fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbcc3e27-5b1a-4e63-8d64-53aeb92f237a", "tag": "e468a9ce-ee35-4c82-b0b7-a44a299daa9b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:57.127296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b7e23aa2-0812-4575-acf9-52fe50c5e9d0 req-ec59b90e-2a81-481e-a7c0-58aa0c27d0fb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:57.138972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b7e23aa2-0812-4575-acf9-52fe50c5e9d0 req-ec59b90e-2a81-481e-a7c0-58aa0c27d0fb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:57.153096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-7d8afd6c-209d-4997-b6ec-306013c2a765 req-0f62cb30-49d2-41c7-8060-c40778058f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52ad379b-7eee-4356-99cc-969e3420f4b4", "tag": "317081fe-e568-4173-9ac8-55b3aef1a299"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:57.175015 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-b7e23aa2-0812-4575-acf9-52fe50c5e9d0 req-ec59b90e-2a81-481e-a7c0-58aa0c27d0fb service nova] Creating event network-changed:e468a9ce-ee35-4c82-b0b7-a44a299daa9b for instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a on n-h1-826526-5 Jul 20 04:47:57.179705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7d8afd6c-209d-4997-b6ec-306013c2a765 req-0f62cb30-49d2-41c7-8060-c40778058f1b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:57.180148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7d8afd6c-209d-4997-b6ec-306013c2a765 req-0f62cb30-49d2-41c7-8060-c40778058f1b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:57.199058 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-b7e23aa2-0812-4575-acf9-52fe50c5e9d0 req-ec59b90e-2a81-481e-a7c0-58aa0c27d0fb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096829 Jul 20 04:47:57.201180 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2842/5917] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:57.209842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a8d599a8-60db-4b95-a6ef-82adc37bcbe5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:57.210911 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a8d599a8-60db-4b95-a6ef-82adc37bcbe5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:57.220011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8d599a8-60db-4b95-a6ef-82adc37bcbe5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:57.221144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8d599a8-60db-4b95-a6ef-82adc37bcbe5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:57.222503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8d599a8-60db-4b95-a6ef-82adc37bcbe5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:57.225207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8d599a8-60db-4b95-a6ef-82adc37bcbe5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:57.227957 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-7d8afd6c-209d-4997-b6ec-306013c2a765 req-0f62cb30-49d2-41c7-8060-c40778058f1b service nova] Creating event network-changed:317081fe-e568-4173-9ac8-55b3aef1a299 for instance 52ad379b-7eee-4356-99cc-969e3420f4b4 on n-h2-826526-5 Jul 20 04:47:57.253786 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-7d8afd6c-209d-4997-b6ec-306013c2a765 req-0f62cb30-49d2-41c7-8060-c40778058f1b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115831 Jul 20 04:47:57.255737 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3076/5918] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:57.808013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2eee8e59-dce6-4fe3-ac6e-549b4f91a4e1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:57.810001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2eee8e59-dce6-4fe3-ac6e-549b4f91a4e1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:57.818985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2eee8e59-dce6-4fe3-ac6e-549b4f91a4e1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:57.823567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2eee8e59-dce6-4fe3-ac6e-549b4f91a4e1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:57.824785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2eee8e59-dce6-4fe3-ac6e-549b4f91a4e1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:57.825495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2eee8e59-dce6-4fe3-ac6e-549b4f91a4e1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:57.984674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a8d599a8-60db-4b95-a6ef-82adc37bcbe5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:57.998758 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a8d599a8-60db-4b95-a6ef-82adc37bcbe5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1691 microversion: 2.1 time: 0.790698 Jul 20 04:47:58.000152 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2843/5919] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:57 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1691 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:58.113557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e557f32a-5ddc-42a9-b82b-7793d4c6d1fa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:58.114601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e557f32a-5ddc-42a9-b82b-7793d4c6d1fa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:58.118409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2eee8e59-dce6-4fe3-ac6e-549b4f91a4e1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:58.125212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e557f32a-5ddc-42a9-b82b-7793d4c6d1fa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:58.129692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e557f32a-5ddc-42a9-b82b-7793d4c6d1fa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:58.130826 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e557f32a-5ddc-42a9-b82b-7793d4c6d1fa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:58.131474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e557f32a-5ddc-42a9-b82b-7793d4c6d1fa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:58.133479 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2eee8e59-dce6-4fe3-ac6e-549b4f91a4e1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1511 microversion: 2.1 time: 0.330791 Jul 20 04:47:58.134315 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3077/5920] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:57 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1511 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:58.592979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e557f32a-5ddc-42a9-b82b-7793d4c6d1fa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:58.602647 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e557f32a-5ddc-42a9-b82b-7793d4c6d1fa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1308 microversion: 2.1 time: 0.494436 Jul 20 04:47:58.617466 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2844/5921] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:58 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1308 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:59.022895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1995e2af-3028-4435-9f24-b42e5e57dc42 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:59.023444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1995e2af-3028-4435-9f24-b42e5e57dc42 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:59.030639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1995e2af-3028-4435-9f24-b42e5e57dc42 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.031106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1995e2af-3028-4435-9f24-b42e5e57dc42 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.031902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1995e2af-3028-4435-9f24-b42e5e57dc42 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.032438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1995e2af-3028-4435-9f24-b42e5e57dc42 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.151318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-29cef07c-aa76-41fb-98c1-c894d60c58b8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:59.152742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-29cef07c-aa76-41fb-98c1-c894d60c58b8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:59.160544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29cef07c-aa76-41fb-98c1-c894d60c58b8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.161251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29cef07c-aa76-41fb-98c1-c894d60c58b8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.162049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29cef07c-aa76-41fb-98c1-c894d60c58b8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.162494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29cef07c-aa76-41fb-98c1-c894d60c58b8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.284432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1995e2af-3028-4435-9f24-b42e5e57dc42 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:59.295287 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1995e2af-3028-4435-9f24-b42e5e57dc42 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1681 microversion: 2.1 time: 0.279975 Jul 20 04:47:59.307704 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3078/5922] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:59 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1681 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:59.312833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cd1848e2-0d20-44aa-8897-3e3722d24ac0 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:59.313744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cd1848e2-0d20-44aa-8897-3e3722d24ac0 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:59.320879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd1848e2-0d20-44aa-8897-3e3722d24ac0 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.321654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd1848e2-0d20-44aa-8897-3e3722d24ac0 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.322701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd1848e2-0d20-44aa-8897-3e3722d24ac0 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.323349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd1848e2-0d20-44aa-8897-3e3722d24ac0 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.324304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-29cef07c-aa76-41fb-98c1-c894d60c58b8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:59.335542 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-29cef07c-aa76-41fb-98c1-c894d60c58b8 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1511 microversion: 2.1 time: 0.188023 Jul 20 04:47:59.347024 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2845/5923] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:59 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:59.550806 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cd1848e2-0d20-44aa-8897-3e3722d24ac0 tempest-TestNetworkAdvancedServerOps-1198188758 tempest-TestNetworkAdvancedServerOps-1198188758-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1832 microversion: 2.1 time: 0.241444 Jul 20 04:47:59.551570 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3079/5924] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:59 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1832 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:59.568704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9e0b19bd-140a-4043-a7f8-3e8b260b2ca0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:59.569337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9e0b19bd-140a-4043-a7f8-3e8b260b2ca0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:59.576855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e0b19bd-140a-4043-a7f8-3e8b260b2ca0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.577331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e0b19bd-140a-4043-a7f8-3e8b260b2ca0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.584330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e0b19bd-140a-4043-a7f8-3e8b260b2ca0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.585001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e0b19bd-140a-4043-a7f8-3e8b260b2ca0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.622346 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0a1aac99-84d7-4e8c-9885-463b516b2ac0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:59.623085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0a1aac99-84d7-4e8c-9885-463b516b2ac0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:59.631283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a1aac99-84d7-4e8c-9885-463b516b2ac0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.631974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a1aac99-84d7-4e8c-9885-463b516b2ac0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.633012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a1aac99-84d7-4e8c-9885-463b516b2ac0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.633733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a1aac99-84d7-4e8c-9885-463b516b2ac0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.749525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9e0b19bd-140a-4043-a7f8-3e8b260b2ca0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:59.759175 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9e0b19bd-140a-4043-a7f8-3e8b260b2ca0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1681 microversion: 2.1 time: 0.194300 Jul 20 04:47:59.760025 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2846/5925] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:59 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:59.863804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-862bac19-4a27-4d73-8a52-cc57b2b55c25 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:59.865029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-862bac19-4a27-4d73-8a52-cc57b2b55c25 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:59.875433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-862bac19-4a27-4d73-8a52-cc57b2b55c25 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.876500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-862bac19-4a27-4d73-8a52-cc57b2b55c25 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.877493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-862bac19-4a27-4d73-8a52-cc57b2b55c25 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.877986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-862bac19-4a27-4d73-8a52-cc57b2b55c25 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.939121 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-862bac19-4a27-4d73-8a52-cc57b2b55c25 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529/action" status: 200 len: 38626 microversion: 2.1 time: 0.080301 Jul 20 04:47:59.950099 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2847/5926] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:59 2022] POST /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529/action => generated 38626 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:48:00.061076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0a1aac99-84d7-4e8c-9885-463b516b2ac0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:00.072162 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0a1aac99-84d7-4e8c-9885-463b516b2ac0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1308 microversion: 2.1 time: 0.454844 Jul 20 04:48:00.076318 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3080/5927] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:59 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1308 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:00.355110 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5b7b62d4-819f-4b0d-973e-5c8bab4d5c0f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:00.356782 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5b7b62d4-819f-4b0d-973e-5c8bab4d5c0f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:00.367902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b7b62d4-819f-4b0d-973e-5c8bab4d5c0f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:00.368897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b7b62d4-819f-4b0d-973e-5c8bab4d5c0f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:00.370642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b7b62d4-819f-4b0d-973e-5c8bab4d5c0f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:00.371277 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b7b62d4-819f-4b0d-973e-5c8bab4d5c0f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:00.905193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5b7b62d4-819f-4b0d-973e-5c8bab4d5c0f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:00.916130 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5b7b62d4-819f-4b0d-973e-5c8bab4d5c0f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1511 microversion: 2.1 time: 0.566839 Jul 20 04:48:00.925972 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2848/5928] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:00 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1511 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:01.109829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0f1d999d-bf73-486b-9368-91766d8a9efa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:01.112042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0f1d999d-bf73-486b-9368-91766d8a9efa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:01.129835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f1d999d-bf73-486b-9368-91766d8a9efa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:01.131694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f1d999d-bf73-486b-9368-91766d8a9efa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:01.132849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f1d999d-bf73-486b-9368-91766d8a9efa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:01.133448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f1d999d-bf73-486b-9368-91766d8a9efa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:01.403764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0f1d999d-bf73-486b-9368-91766d8a9efa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:01.414797 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0f1d999d-bf73-486b-9368-91766d8a9efa tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1308 microversion: 2.1 time: 0.327282 Jul 20 04:48:01.416809 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3081/5929] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:01 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1308 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:01.702952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-108403b6-3c53-41a8-8ae4-e5665e8869a0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:01.704198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-108403b6-3c53-41a8-8ae4-e5665e8869a0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:01.707627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:01.708390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:01.710117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-665a204b-2a31-495b-9f36-41080fbc7bf3 req-61d4101f-d824-4a55-8588-4dab87f68e24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9cbd595-7323-4d8a-b0d1-da8952f04529", "tag": "4fe14c15-fa2a-465e-8d12-695d6280d0e2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:01.726649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-108403b6-3c53-41a8-8ae4-e5665e8869a0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:01.727123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-108403b6-3c53-41a8-8ae4-e5665e8869a0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:01.728618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-665a204b-2a31-495b-9f36-41080fbc7bf3 req-61d4101f-d824-4a55-8588-4dab87f68e24 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:01.729081 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-665a204b-2a31-495b-9f36-41080fbc7bf3 req-61d4101f-d824-4a55-8588-4dab87f68e24 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:01.730804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-108403b6-3c53-41a8-8ae4-e5665e8869a0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:01.734038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-108403b6-3c53-41a8-8ae4-e5665e8869a0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:01.753434 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-665a204b-2a31-495b-9f36-41080fbc7bf3 req-61d4101f-d824-4a55-8588-4dab87f68e24 service nova] Creating event network-changed:4fe14c15-fa2a-465e-8d12-695d6280d0e2 for instance f9cbd595-7323-4d8a-b0d1-da8952f04529 on n-h2-826526-5 Jul 20 04:48:01.764968 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-665a204b-2a31-495b-9f36-41080fbc7bf3 req-61d4101f-d824-4a55-8588-4dab87f68e24 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060203 Jul 20 04:48:01.770048 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3082/5930] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:01.775602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-108403b6-3c53-41a8-8ae4-e5665e8869a0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:48:01.935183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5378e1b9-06ee-403d-8240-def6523bdb02 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:01.935985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5378e1b9-06ee-403d-8240-def6523bdb02 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:01.947676 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-108403b6-3c53-41a8-8ae4-e5665e8869a0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 204 len: 0 microversion: 2.1 time: 0.249799 Jul 20 04:48:01.948293 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2849/5931] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:48:01 2022] DELETE /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:48:01.958818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aba03217-d37e-4bc7-ab66-67f632f85f3a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:01.959541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aba03217-d37e-4bc7-ab66-67f632f85f3a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:01.960887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5378e1b9-06ee-403d-8240-def6523bdb02 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:01.961354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5378e1b9-06ee-403d-8240-def6523bdb02 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:01.962189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5378e1b9-06ee-403d-8240-def6523bdb02 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:01.962655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5378e1b9-06ee-403d-8240-def6523bdb02 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:01.976621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aba03217-d37e-4bc7-ab66-67f632f85f3a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:01.978101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aba03217-d37e-4bc7-ab66-67f632f85f3a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:01.980223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aba03217-d37e-4bc7-ab66-67f632f85f3a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:01.980719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aba03217-d37e-4bc7-ab66-67f632f85f3a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:01.987351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:02.174532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aba03217-d37e-4bc7-ab66-67f632f85f3a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:02.186993 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aba03217-d37e-4bc7-ab66-67f632f85f3a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1687 microversion: 2.1 time: 0.232348 Jul 20 04:48:02.187661 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2850/5932] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:01 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1687 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:02.348153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5378e1b9-06ee-403d-8240-def6523bdb02 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:02.354241 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5378e1b9-06ee-403d-8240-def6523bdb02 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1532 microversion: 2.1 time: 0.424376 Jul 20 04:48:02.354834 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3083/5933] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:01 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1532 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:02.431641 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f1ee1fe7-d3b7-40d5-98ee-28d86346eadb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:02.432720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f1ee1fe7-d3b7-40d5-98ee-28d86346eadb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:02.440577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1ee1fe7-d3b7-40d5-98ee-28d86346eadb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:02.441378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1ee1fe7-d3b7-40d5-98ee-28d86346eadb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:02.442263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1ee1fe7-d3b7-40d5-98ee-28d86346eadb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:02.443067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1ee1fe7-d3b7-40d5-98ee-28d86346eadb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:02.659520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4649a57e-4bcf-4e56-9158-7f44ebf9fae4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:02.670207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4649a57e-4bcf-4e56-9158-7f44ebf9fae4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:02.670810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4649a57e-4bcf-4e56-9158-7f44ebf9fae4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:02.702421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f1ee1fe7-d3b7-40d5-98ee-28d86346eadb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:02.705435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4649a57e-4bcf-4e56-9158-7f44ebf9fae4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Going to try to stop instance {{(pid=127871) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:48:02.712473 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f1ee1fe7-d3b7-40d5-98ee-28d86346eadb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1308 microversion: 2.1 time: 0.285020 Jul 20 04:48:02.716015 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2851/5934] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:02 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1308 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:02.778448 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4649a57e-4bcf-4e56-9158-7f44ebf9fae4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "POST /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf/action" status: 202 len: 0 microversion: 2.1 time: 0.124540 Jul 20 04:48:02.779460 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3084/5935] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:48:02 2022] POST /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:48:02.788025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ceb156e5-f0b6-4e5f-b036-0a080f43f4a5 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:02.798973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ceb156e5-f0b6-4e5f-b036-0a080f43f4a5 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:02.810081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ceb156e5-f0b6-4e5f-b036-0a080f43f4a5 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:02.814212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ceb156e5-f0b6-4e5f-b036-0a080f43f4a5 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:02.815460 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ceb156e5-f0b6-4e5f-b036-0a080f43f4a5 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:02.816211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ceb156e5-f0b6-4e5f-b036-0a080f43f4a5 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:03.099636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ceb156e5-f0b6-4e5f-b036-0a080f43f4a5 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:03.111179 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ceb156e5-f0b6-4e5f-b036-0a080f43f4a5 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1675 microversion: 2.1 time: 0.325334 Jul 20 04:48:03.111826 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2852/5936] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:02 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1675 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:03.208535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ab85576c-3a36-4b90-a842-111adacd0c0d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:03.209362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ab85576c-3a36-4b90-a842-111adacd0c0d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:03.223194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab85576c-3a36-4b90-a842-111adacd0c0d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:03.224061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab85576c-3a36-4b90-a842-111adacd0c0d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:03.233012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab85576c-3a36-4b90-a842-111adacd0c0d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:03.233716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab85576c-3a36-4b90-a842-111adacd0c0d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:03.362522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ab85576c-3a36-4b90-a842-111adacd0c0d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:03.373579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0ca6e897-1fc8-4836-9a10-bc217b23fc1f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:03.374721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0ca6e897-1fc8-4836-9a10-bc217b23fc1f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:03.374940 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ab85576c-3a36-4b90-a842-111adacd0c0d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 200 len: 1502 microversion: 2.1 time: 0.172040 Jul 20 04:48:03.376150 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3085/5937] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:03 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:03.386217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ca6e897-1fc8-4836-9a10-bc217b23fc1f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:03.387287 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ca6e897-1fc8-4836-9a10-bc217b23fc1f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:03.388186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ca6e897-1fc8-4836-9a10-bc217b23fc1f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:03.388838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ca6e897-1fc8-4836-9a10-bc217b23fc1f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:03.569442 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0ca6e897-1fc8-4836-9a10-bc217b23fc1f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:03.582454 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0ca6e897-1fc8-4836-9a10-bc217b23fc1f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1532 microversion: 2.1 time: 0.213813 Jul 20 04:48:03.584344 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2853/5938] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:03 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1532 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:03.735529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-280170e4-18af-4cf0-a995-1bfeb8f74022 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:03.736178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-280170e4-18af-4cf0-a995-1bfeb8f74022 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:03.749487 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-280170e4-18af-4cf0-a995-1bfeb8f74022 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:03.750406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-280170e4-18af-4cf0-a995-1bfeb8f74022 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:03.751629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-280170e4-18af-4cf0-a995-1bfeb8f74022 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:03.752152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-280170e4-18af-4cf0-a995-1bfeb8f74022 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:03.790326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-345bc35f-7a94-400e-8bda-e38663144d0b req-a91d8f0c-95ad-4c4f-9cd6-6f6652baac07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9cbd595-7323-4d8a-b0d1-da8952f04529", "name": "network-vif-deleted", "tag": "4fe14c15-fa2a-465e-8d12-695d6280d0e2"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:03.807043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-345bc35f-7a94-400e-8bda-e38663144d0b req-a91d8f0c-95ad-4c4f-9cd6-6f6652baac07 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:03.807477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-345bc35f-7a94-400e-8bda-e38663144d0b req-a91d8f0c-95ad-4c4f-9cd6-6f6652baac07 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:03.842610 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-345bc35f-7a94-400e-8bda-e38663144d0b req-a91d8f0c-95ad-4c4f-9cd6-6f6652baac07 service nova] Creating event network-vif-deleted:4fe14c15-fa2a-465e-8d12-695d6280d0e2 for instance f9cbd595-7323-4d8a-b0d1-da8952f04529 on n-h2-826526-5 Jul 20 04:48:03.848489 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-345bc35f-7a94-400e-8bda-e38663144d0b req-a91d8f0c-95ad-4c4f-9cd6-6f6652baac07 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062221 Jul 20 04:48:03.849420 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2854/5939] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:48:03.993876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-280170e4-18af-4cf0-a995-1bfeb8f74022 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:04.005675 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-280170e4-18af-4cf0-a995-1bfeb8f74022 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1308 microversion: 2.1 time: 0.274162 Jul 20 04:48:04.015909 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3086/5940] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:03 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1308 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:04.137773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-07d3bbae-647a-416f-b772-247b766a7e2d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:04.138699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-07d3bbae-647a-416f-b772-247b766a7e2d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:04.146406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07d3bbae-647a-416f-b772-247b766a7e2d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:04.146940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07d3bbae-647a-416f-b772-247b766a7e2d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:04.147840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07d3bbae-647a-416f-b772-247b766a7e2d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:04.148514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07d3bbae-647a-416f-b772-247b766a7e2d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:04.379269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-07d3bbae-647a-416f-b772-247b766a7e2d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:04.387756 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-07d3bbae-647a-416f-b772-247b766a7e2d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1675 microversion: 2.1 time: 0.257950 Jul 20 04:48:04.388734 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2855/5941] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:04 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1675 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:04.394279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e5c054f2-d10d-42a4-b997-c08391fd9c04 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:04.395584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e5c054f2-d10d-42a4-b997-c08391fd9c04 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: f9cbd595-7323-4d8a-b0d1-da8952f04529] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:04.402781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5c054f2-d10d-42a4-b997-c08391fd9c04 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:04.403326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5c054f2-d10d-42a4-b997-c08391fd9c04 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:04.404116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5c054f2-d10d-42a4-b997-c08391fd9c04 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:04.404590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5c054f2-d10d-42a4-b997-c08391fd9c04 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:04.426120 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-e5c054f2-d10d-42a4-b997-c08391fd9c04 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] HTTP exception thrown: Instance f9cbd595-7323-4d8a-b0d1-da8952f04529 could not be found. Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e5c054f2-d10d-42a4-b997-c08391fd9c04 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Request method failure captured: Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 HTTP/1.1 Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14c5OmC7e7piHc62Oprmt58gJ43Ds2Gqro50k_jodCbcdTngwgD8D9bbOTQvC3Ba8WRVQD5lFU65LIKPn-I3EI2C2ZihLQJYKiEb4d5a-fdETDJHV4IJmro-RJ_S60NX-1yKHowzAlku6MRitdI9SUmpfigUaUfx-6x70eCIR240NVE Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: a678d19d82d248958a3d7df804ccfa95 Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-574298032 Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a678d19d82d248958a3d7df804ccfa95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a678d19d82d248958a3d7df804ccfa95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a678d19d82d248958a3d7df804ccfa95", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a678d19d82d248958a3d7df804ccfa95"}]}] Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestNetworkAdvancedServerOps-574298032 Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: a678d19d82d248958a3d7df804ccfa95 Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-574298032 Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestNetworkAdvancedServerOps-574298032-project Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: cffe347e0a094346afd74f178a0fde5d Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestNetworkAdvancedServerOps-574298032-project Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance f9cbd595-7323-4d8a-b0d1-da8952f04529 could not be found. Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'f9cbd595-7323-4d8a-b0d1-da8952f04529'} Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9cbd595-7323-4d8a-b0d1-da8952f04529 could not be found. Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9cbd595-7323-4d8a-b0d1-da8952f04529 could not be found. Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:04.429438 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:04.433716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:04.433716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:04.433716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:04.433716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:04.433716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:04.433716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9cbd595-7323-4d8a-b0d1-da8952f04529 could not be found. Jul 20 04:48:04.433716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:04.433716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e5c054f2-d10d-42a4-b997-c08391fd9c04 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Returning 404 to user: Instance f9cbd595-7323-4d8a-b0d1-da8952f04529 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:04.433716 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e5c054f2-d10d-42a4-b997-c08391fd9c04 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529" status: 404 len: 111 microversion: 2.1 time: 0.041000 Jul 20 04:48:04.435560 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3087/5942] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:04 2022] GET /compute/v2.1/servers/f9cbd595-7323-4d8a-b0d1-da8952f04529 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:48:04.605291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8f70a881-af4a-435c-ae14-ad7d16be816d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:04.620190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8f70a881-af4a-435c-ae14-ad7d16be816d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:04.634774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f70a881-af4a-435c-ae14-ad7d16be816d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:04.635337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f70a881-af4a-435c-ae14-ad7d16be816d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:04.636163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f70a881-af4a-435c-ae14-ad7d16be816d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:04.636881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f70a881-af4a-435c-ae14-ad7d16be816d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:04.963947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8f70a881-af4a-435c-ae14-ad7d16be816d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:04.973180 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8f70a881-af4a-435c-ae14-ad7d16be816d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1527 microversion: 2.1 time: 0.373730 Jul 20 04:48:04.983968 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2856/5943] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:04 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1527 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:05.027644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7de4b1bc-5040-4815-b70b-932524701ef4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:05.029846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7de4b1bc-5040-4815-b70b-932524701ef4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:05.052085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7de4b1bc-5040-4815-b70b-932524701ef4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:05.052574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7de4b1bc-5040-4815-b70b-932524701ef4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:05.053381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7de4b1bc-5040-4815-b70b-932524701ef4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:05.053808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7de4b1bc-5040-4815-b70b-932524701ef4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:05.357884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7de4b1bc-5040-4815-b70b-932524701ef4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:05.370121 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7de4b1bc-5040-4815-b70b-932524701ef4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1308 microversion: 2.1 time: 0.350369 Jul 20 04:48:05.373651 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3088/5944] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:05 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1308 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:05.406153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e812663c-ae6e-45ab-9214-18aec06564fc tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:05.406787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e812663c-ae6e-45ab-9214-18aec06564fc tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:05.422754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e812663c-ae6e-45ab-9214-18aec06564fc tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:05.423226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e812663c-ae6e-45ab-9214-18aec06564fc tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:05.434629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e812663c-ae6e-45ab-9214-18aec06564fc tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:05.435168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e812663c-ae6e-45ab-9214-18aec06564fc tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:05.716809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e812663c-ae6e-45ab-9214-18aec06564fc tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:05.732928 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e812663c-ae6e-45ab-9214-18aec06564fc tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1675 microversion: 2.1 time: 0.328861 Jul 20 04:48:05.734835 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2857/5945] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:05 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1675 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:05.923881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-d4bc927c-4462-409c-9f45-61d85145e4ce req-3a850296-e6ca-4538-9d93-40cfdae09cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52ad379b-7eee-4356-99cc-969e3420f4b4", "name": "network-vif-plugged", "status": "completed", "tag": "317081fe-e568-4173-9ac8-55b3aef1a299"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:05.962702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d4bc927c-4462-409c-9f45-61d85145e4ce req-3a850296-e6ca-4538-9d93-40cfdae09cbb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:05.966437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d4bc927c-4462-409c-9f45-61d85145e4ce req-3a850296-e6ca-4538-9d93-40cfdae09cbb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:05.991392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-73d6a007-9e2e-499e-8167-504a0502d71c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:05.992255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-73d6a007-9e2e-499e-8167-504a0502d71c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:06.017967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73d6a007-9e2e-499e-8167-504a0502d71c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:06.023111 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73d6a007-9e2e-499e-8167-504a0502d71c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:06.024239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73d6a007-9e2e-499e-8167-504a0502d71c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:06.029908 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-d4bc927c-4462-409c-9f45-61d85145e4ce req-3a850296-e6ca-4538-9d93-40cfdae09cbb service nova] Creating event network-vif-plugged:317081fe-e568-4173-9ac8-55b3aef1a299 for instance 52ad379b-7eee-4356-99cc-969e3420f4b4 on n-h2-826526-5 Jul 20 04:48:06.031417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73d6a007-9e2e-499e-8167-504a0502d71c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:06.068291 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-d4bc927c-4462-409c-9f45-61d85145e4ce req-3a850296-e6ca-4538-9d93-40cfdae09cbb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144056 Jul 20 04:48:06.070336 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3089/5946] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:48:06.389005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ed99614a-68d0-41b2-8557-b2e344c90a94 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:06.389985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ed99614a-68d0-41b2-8557-b2e344c90a94 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:06.401275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ed99614a-68d0-41b2-8557-b2e344c90a94 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:06.404925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ed99614a-68d0-41b2-8557-b2e344c90a94 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:06.406424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ed99614a-68d0-41b2-8557-b2e344c90a94 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:06.407080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ed99614a-68d0-41b2-8557-b2e344c90a94 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:06.669966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-73d6a007-9e2e-499e-8167-504a0502d71c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:06.681503 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-73d6a007-9e2e-499e-8167-504a0502d71c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1527 microversion: 2.1 time: 0.693986 Jul 20 04:48:06.682647 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2858/5947] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:05 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1527 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:06.750086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0aecb190-6a43-462a-b678-fcc9fdaa2fb3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:06.751268 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0aecb190-6a43-462a-b678-fcc9fdaa2fb3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:06.760573 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0aecb190-6a43-462a-b678-fcc9fdaa2fb3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:06.761042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0aecb190-6a43-462a-b678-fcc9fdaa2fb3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:06.765225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0aecb190-6a43-462a-b678-fcc9fdaa2fb3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:06.771391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0aecb190-6a43-462a-b678-fcc9fdaa2fb3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:06.869447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ed99614a-68d0-41b2-8557-b2e344c90a94 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:06.889789 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ed99614a-68d0-41b2-8557-b2e344c90a94 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1308 microversion: 2.1 time: 0.505196 Jul 20 04:48:06.892218 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3090/5948] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:06 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1308 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:07.036970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0aecb190-6a43-462a-b678-fcc9fdaa2fb3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:07.051894 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0aecb190-6a43-462a-b678-fcc9fdaa2fb3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1675 microversion: 2.1 time: 0.306137 Jul 20 04:48:07.052559 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2859/5949] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:06 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1675 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:07.701527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6c6f555c-46d2-406c-a796-6725fc1dfd9b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:07.703064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6c6f555c-46d2-406c-a796-6725fc1dfd9b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:07.745009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c6f555c-46d2-406c-a796-6725fc1dfd9b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:07.748613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c6f555c-46d2-406c-a796-6725fc1dfd9b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:07.752813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c6f555c-46d2-406c-a796-6725fc1dfd9b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:07.755319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c6f555c-46d2-406c-a796-6725fc1dfd9b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:07.913827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8428e821-6c52-42c6-b763-de765dd741e1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:07.916460 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8428e821-6c52-42c6-b763-de765dd741e1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:07.960345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8428e821-6c52-42c6-b763-de765dd741e1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:07.965078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8428e821-6c52-42c6-b763-de765dd741e1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:07.965949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8428e821-6c52-42c6-b763-de765dd741e1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:07.966419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8428e821-6c52-42c6-b763-de765dd741e1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:08.257463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6c6f555c-46d2-406c-a796-6725fc1dfd9b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:08.266813 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6c6f555c-46d2-406c-a796-6725fc1dfd9b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1527 microversion: 2.1 time: 0.571409 Jul 20 04:48:08.267415 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3091/5950] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:07 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1527 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:08.284020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-771f7098-ac85-4e34-9676-905747311c92 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:08.285915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-771f7098-ac85-4e34-9676-905747311c92 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:08.294518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-771f7098-ac85-4e34-9676-905747311c92 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:08.295332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-771f7098-ac85-4e34-9676-905747311c92 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:08.296368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-771f7098-ac85-4e34-9676-905747311c92 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:08.297018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-771f7098-ac85-4e34-9676-905747311c92 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:08.445354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8428e821-6c52-42c6-b763-de765dd741e1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:08.460084 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8428e821-6c52-42c6-b763-de765dd741e1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1490 microversion: 2.1 time: 0.552537 Jul 20 04:48:08.461157 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2860/5951] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:07 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1490 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:08.469495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f2fcf8ad-dc05-4990-9b61-caefab393a80 req-3f09ae46-9da2-4854-b874-5e7515693dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d530bf9-a3da-4006-9120-3bc00e8266e3", "name": "network-vif-plugged", "status": "completed", "tag": "7d6173a0-c778-42ab-8c13-3f45b04a097d"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:08.507970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f2fcf8ad-dc05-4990-9b61-caefab393a80 req-3f09ae46-9da2-4854-b874-5e7515693dd9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:08.513776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f2fcf8ad-dc05-4990-9b61-caefab393a80 req-3f09ae46-9da2-4854-b874-5e7515693dd9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:08.559655 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f2fcf8ad-dc05-4990-9b61-caefab393a80 req-3f09ae46-9da2-4854-b874-5e7515693dd9 service nova] Creating event network-vif-plugged:7d6173a0-c778-42ab-8c13-3f45b04a097d for instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 on n-h2-826526-5 Jul 20 04:48:08.578484 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f2fcf8ad-dc05-4990-9b61-caefab393a80 req-3f09ae46-9da2-4854-b874-5e7515693dd9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110912 Jul 20 04:48:08.581058 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2861/5952] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:08.603919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3685471d-a43a-48af-b895-d81964fbbbf3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:08.612034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3685471d-a43a-48af-b895-d81964fbbbf3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:08.630373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3685471d-a43a-48af-b895-d81964fbbbf3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:08.632982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3685471d-a43a-48af-b895-d81964fbbbf3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:08.634572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3685471d-a43a-48af-b895-d81964fbbbf3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:08.636716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3685471d-a43a-48af-b895-d81964fbbbf3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:08.797414 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3685471d-a43a-48af-b895-d81964fbbbf3 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "PUT /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1085 microversion: 2.1 time: 0.210185 Jul 20 04:48:08.799462 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2862/5953] 10.222.0.17 () {60 vars in 1255 bytes} [Wed Jul 20 04:48:08 2022] PUT /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1085 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:08.813407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4cd899a2-bc4a-403e-bf57-591a4a29e73e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:08.814041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4cd899a2-bc4a-403e-bf57-591a4a29e73e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:08.828976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cd899a2-bc4a-403e-bf57-591a4a29e73e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:08.829410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cd899a2-bc4a-403e-bf57-591a4a29e73e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:08.830229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cd899a2-bc4a-403e-bf57-591a4a29e73e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:08.831121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4cd899a2-bc4a-403e-bf57-591a4a29e73e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:09.346364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-771f7098-ac85-4e34-9676-905747311c92 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:09.366224 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-771f7098-ac85-4e34-9676-905747311c92 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1675 microversion: 2.1 time: 1.093985 Jul 20 04:48:09.367459 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3092/5954] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:08 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1675 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:09.376396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f409aae1-1e70-4380-9ae9-3d3c52dcf3be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:09.377250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f409aae1-1e70-4380-9ae9-3d3c52dcf3be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:09.385912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f409aae1-1e70-4380-9ae9-3d3c52dcf3be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:09.386611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f409aae1-1e70-4380-9ae9-3d3c52dcf3be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:09.387601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f409aae1-1e70-4380-9ae9-3d3c52dcf3be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:09.388199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f409aae1-1e70-4380-9ae9-3d3c52dcf3be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:09.601516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f409aae1-1e70-4380-9ae9-3d3c52dcf3be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:09.622119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:09.633613 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f409aae1-1e70-4380-9ae9-3d3c52dcf3be tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1527 microversion: 2.1 time: 0.260709 Jul 20 04:48:09.634976 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3093/5955] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:09 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1527 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:09.665588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4cd899a2-bc4a-403e-bf57-591a4a29e73e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:09.674008 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4cd899a2-bc4a-403e-bf57-591a4a29e73e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1511 microversion: 2.1 time: 0.864696 Jul 20 04:48:09.675230 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2863/5956] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:08 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1511 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:09.697547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-78e61913-9e60-4eb0-b5d9-2323c4843928 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:09.698797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-78e61913-9e60-4eb0-b5d9-2323c4843928 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:09.708761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78e61913-9e60-4eb0-b5d9-2323c4843928 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:09.709301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78e61913-9e60-4eb0-b5d9-2323c4843928 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:09.710157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78e61913-9e60-4eb0-b5d9-2323c4843928 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:09.710676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78e61913-9e60-4eb0-b5d9-2323c4843928 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:10.042190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-78e61913-9e60-4eb0-b5d9-2323c4843928 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:10.061269 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-78e61913-9e60-4eb0-b5d9-2323c4843928 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1511 microversion: 2.1 time: 0.369185 Jul 20 04:48:10.062381 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3094/5957] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:09 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1511 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:10.082914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4acd7985-4923-49c1-bd29-869b2dfad1d1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:10.083962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4acd7985-4923-49c1-bd29-869b2dfad1d1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:10.093012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4acd7985-4923-49c1-bd29-869b2dfad1d1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:10.093743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4acd7985-4923-49c1-bd29-869b2dfad1d1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:10.094680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4acd7985-4923-49c1-bd29-869b2dfad1d1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:10.095268 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4acd7985-4923-49c1-bd29-869b2dfad1d1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:10.150491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4acd7985-4923-49c1-bd29-869b2dfad1d1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:48:10.333871 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4acd7985-4923-49c1-bd29-869b2dfad1d1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "DELETE /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 204 len: 0 microversion: 2.1 time: 0.254921 Jul 20 04:48:10.341500 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2864/5958] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:48:10 2022] DELETE /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:48:10.345511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a116b2c7-d9e6-49d5-acc1-dbff1a70a28d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:10.346122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a116b2c7-d9e6-49d5-acc1-dbff1a70a28d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:10.370083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a116b2c7-d9e6-49d5-acc1-dbff1a70a28d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:10.372915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a116b2c7-d9e6-49d5-acc1-dbff1a70a28d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:10.373924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a116b2c7-d9e6-49d5-acc1-dbff1a70a28d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:10.374928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a116b2c7-d9e6-49d5-acc1-dbff1a70a28d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:10.387870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ab22c97b-7e28-432c-bf97-1bb40e3a27f6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:10.388623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ab22c97b-7e28-432c-bf97-1bb40e3a27f6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:10.406426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab22c97b-7e28-432c-bf97-1bb40e3a27f6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:10.407169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab22c97b-7e28-432c-bf97-1bb40e3a27f6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:10.408604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab22c97b-7e28-432c-bf97-1bb40e3a27f6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:10.409408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab22c97b-7e28-432c-bf97-1bb40e3a27f6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:10.697601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a116b2c7-d9e6-49d5-acc1-dbff1a70a28d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:10.714264 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a116b2c7-d9e6-49d5-acc1-dbff1a70a28d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1517 microversion: 2.1 time: 0.372562 Jul 20 04:48:10.716106 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3095/5959] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:10 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1517 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:10.723254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-44a9bb63-8132-4a38-bd22-6d3c85fc6e87 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:10.725226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-44a9bb63-8132-4a38-bd22-6d3c85fc6e87 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:10.742035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44a9bb63-8132-4a38-bd22-6d3c85fc6e87 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:10.743111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44a9bb63-8132-4a38-bd22-6d3c85fc6e87 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:10.744762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44a9bb63-8132-4a38-bd22-6d3c85fc6e87 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:10.745690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44a9bb63-8132-4a38-bd22-6d3c85fc6e87 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:10.758137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ab22c97b-7e28-432c-bf97-1bb40e3a27f6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:10.762892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:10.768194 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ab22c97b-7e28-432c-bf97-1bb40e3a27f6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1675 microversion: 2.1 time: 0.388235 Jul 20 04:48:10.776127 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2865/5960] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:10 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1675 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:11.020658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-44a9bb63-8132-4a38-bd22-6d3c85fc6e87 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:11.033231 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-44a9bb63-8132-4a38-bd22-6d3c85fc6e87 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1527 microversion: 2.1 time: 0.313732 Jul 20 04:48:11.048682 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3096/5961] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:10 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1527 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:11.203136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0e9098d5-7ea4-44f9-9a18-0318561278c5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '.version_select at 0x7f06bd141a60>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:11.214202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:11.254064 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0e9098d5-7ea4-44f9-9a18-0318561278c5 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1009459422" status: 202 len: 0 microversion: 2.1 time: 0.055392 Jul 20 04:48:11.254758 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2866/5962] 10.222.0.17 () {58 vars in 1283 bytes} [Wed Jul 20 04:48:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1009459422 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:48:11.288564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-be1d766b-ffe4-4197-8f51-d00c0ddc53c6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'create', calling method: .version_select at 0x7f06be0def70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1871636326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfTC3TjdGZQULfP6etFZtdCmMFtXnR4seDXJCUhLulIjFZBhJ77ZXIQQ4W8YCXTjHP1AuE1kSY8GmpSAOSDDFLdCZrL+/16abUq1KCYFEiIGGeFPl2B06lxCefH8jTPWw=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:11.307881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-be1d766b-ffe4-4197-8f51-d00c0ddc53c6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Getting quotas for project a678d19d82d248958a3d7df804ccfa95. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:48:11.315629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-be1d766b-ffe4-4197-8f51-d00c0ddc53c6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Getting quotas for user cffe347e0a094346afd74f178a0fde5d and project a678d19d82d248958a3d7df804ccfa95. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:48:11.350651 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-be1d766b-ffe4-4197-8f51-d00c0ddc53c6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.066074 Jul 20 04:48:11.351565 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3097/5963] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:48:11 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:11.769431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9450c773-6e63-49b0-a623-02a504134820 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:11.770075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9450c773-6e63-49b0-a623-02a504134820 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:11.781892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9450c773-6e63-49b0-a623-02a504134820 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:11.782361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9450c773-6e63-49b0-a623-02a504134820 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:11.783339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9450c773-6e63-49b0-a623-02a504134820 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:11.783799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9450c773-6e63-49b0-a623-02a504134820 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:11.793834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9783bbb8-ebad-4125-97e6-0ee59847edb7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:11.795147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9783bbb8-ebad-4125-97e6-0ee59847edb7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:11.807870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9783bbb8-ebad-4125-97e6-0ee59847edb7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:11.816069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9783bbb8-ebad-4125-97e6-0ee59847edb7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:11.817178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9783bbb8-ebad-4125-97e6-0ee59847edb7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:11.817778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9783bbb8-ebad-4125-97e6-0ee59847edb7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:12.122844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9450c773-6e63-49b0-a623-02a504134820 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:12.132112 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9450c773-6e63-49b0-a623-02a504134820 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1517 microversion: 2.1 time: 0.368779 Jul 20 04:48:12.133140 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2867/5964] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:11 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1517 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:12.138136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8eb0baf9-32fc-4ea0-8b1f-de4b3c83f897 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:12.138958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8eb0baf9-32fc-4ea0-8b1f-de4b3c83f897 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:12.145738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8eb0baf9-32fc-4ea0-8b1f-de4b3c83f897 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:12.146404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8eb0baf9-32fc-4ea0-8b1f-de4b3c83f897 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:12.147313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8eb0baf9-32fc-4ea0-8b1f-de4b3c83f897 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:12.147915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8eb0baf9-32fc-4ea0-8b1f-de4b3c83f897 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:12.341650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9783bbb8-ebad-4125-97e6-0ee59847edb7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:12.350478 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9783bbb8-ebad-4125-97e6-0ee59847edb7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1675 microversion: 2.1 time: 0.560949 Jul 20 04:48:12.360744 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3098/5965] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:11 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1675 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:12.586360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8eb0baf9-32fc-4ea0-8b1f-de4b3c83f897 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:12.595477 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8eb0baf9-32fc-4ea0-8b1f-de4b3c83f897 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1527 microversion: 2.1 time: 0.461160 Jul 20 04:48:12.596279 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2868/5966] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:12 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1527 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:12.925785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-830a190f-119f-40f4-a7f4-e231c4990df7 req-0930e2c3-d44e-4b0a-a38b-afa24b9c58b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52ad379b-7eee-4356-99cc-969e3420f4b4", "name": "network-vif-deleted", "tag": "317081fe-e568-4173-9ac8-55b3aef1a299"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:12.953128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-830a190f-119f-40f4-a7f4-e231c4990df7 req-0930e2c3-d44e-4b0a-a38b-afa24b9c58b3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:12.953590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-830a190f-119f-40f4-a7f4-e231c4990df7 req-0930e2c3-d44e-4b0a-a38b-afa24b9c58b3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:12.980588 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-830a190f-119f-40f4-a7f4-e231c4990df7 req-0930e2c3-d44e-4b0a-a38b-afa24b9c58b3 service nova] Creating event network-vif-deleted:317081fe-e568-4173-9ac8-55b3aef1a299 for instance 52ad379b-7eee-4356-99cc-969e3420f4b4 on n-h2-826526-5 Jul 20 04:48:12.987291 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-830a190f-119f-40f4-a7f4-e231c4990df7 req-0930e2c3-d44e-4b0a-a38b-afa24b9c58b3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065990 Jul 20 04:48:12.992355 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3099/5967] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:13.157389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-81ac62f4-e1ab-4d97-89d5-f5a76f14076d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:13.158351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-81ac62f4-e1ab-4d97-89d5-f5a76f14076d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:13.165841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81ac62f4-e1ab-4d97-89d5-f5a76f14076d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:13.166300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81ac62f4-e1ab-4d97-89d5-f5a76f14076d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:13.174050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81ac62f4-e1ab-4d97-89d5-f5a76f14076d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:13.177228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81ac62f4-e1ab-4d97-89d5-f5a76f14076d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:13.256876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81ac62f4-e1ab-4d97-89d5-f5a76f14076d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:13.257612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81ac62f4-e1ab-4d97-89d5-f5a76f14076d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:13.258365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-81ac62f4-e1ab-4d97-89d5-f5a76f14076d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lazy-loading 'fault' on Instance uuid 52ad379b-7eee-4356-99cc-969e3420f4b4 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:48:13.329829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-81ac62f4-e1ab-4d97-89d5-f5a76f14076d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:13.348781 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-81ac62f4-e1ab-4d97-89d5-f5a76f14076d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 200 len: 1319 microversion: 2.1 time: 0.195544 Jul 20 04:48:13.349405 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2869/5968] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:13 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:13.376912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-64fb28ef-22ba-4bf1-952c-040c32efb85e tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:13.378034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-64fb28ef-22ba-4bf1-952c-040c32efb85e tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:13.418987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64fb28ef-22ba-4bf1-952c-040c32efb85e tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:13.421520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64fb28ef-22ba-4bf1-952c-040c32efb85e tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:13.422911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64fb28ef-22ba-4bf1-952c-040c32efb85e tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:13.424853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-64fb28ef-22ba-4bf1-952c-040c32efb85e tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:13.613513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-53dad6b4-b53f-4632-89d6-5e33f3c0453b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:13.614608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-53dad6b4-b53f-4632-89d6-5e33f3c0453b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:13.631716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53dad6b4-b53f-4632-89d6-5e33f3c0453b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:13.631716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53dad6b4-b53f-4632-89d6-5e33f3c0453b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:13.631716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53dad6b4-b53f-4632-89d6-5e33f3c0453b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:13.631716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53dad6b4-b53f-4632-89d6-5e33f3c0453b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:13.765338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-64fb28ef-22ba-4bf1-952c-040c32efb85e tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:13.786273 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-64fb28ef-22ba-4bf1-952c-040c32efb85e tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1652 microversion: 2.1 time: 0.419204 Jul 20 04:48:13.801885 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3100/5969] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:13 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1652 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:13.809311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-30db0bc2-aa0b-4437-8d2e-9d146c67959d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:13.820221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30db0bc2-aa0b-4437-8d2e-9d146c67959d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:13.821237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30db0bc2-aa0b-4437-8d2e-9d146c67959d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:13.859129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-30db0bc2-aa0b-4437-8d2e-9d146c67959d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Going to try to start instance {{(pid=127871) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:48:13.913154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-53dad6b4-b53f-4632-89d6-5e33f3c0453b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:13.926359 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-53dad6b4-b53f-4632-89d6-5e33f3c0453b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1527 microversion: 2.1 time: 0.317549 Jul 20 04:48:13.938302 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2870/5970] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:13 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1527 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:13.950954 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-30db0bc2-aa0b-4437-8d2e-9d146c67959d tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "POST /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf/action" status: 202 len: 0 microversion: 2.1 time: 0.147671 Jul 20 04:48:13.951647 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3101/5971] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:48:13 2022] POST /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:48:13.978851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c346b3c9-09aa-4555-9513-60429c809f8c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:13.981886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c346b3c9-09aa-4555-9513-60429c809f8c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:14.035406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c346b3c9-09aa-4555-9513-60429c809f8c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:14.041927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c346b3c9-09aa-4555-9513-60429c809f8c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:14.046161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c346b3c9-09aa-4555-9513-60429c809f8c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:14.047505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c346b3c9-09aa-4555-9513-60429c809f8c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:14.371622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7c1eb552-8b59-4534-8935-e67877b0ba22 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:14.372356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7c1eb552-8b59-4534-8935-e67877b0ba22 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:14.386735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c1eb552-8b59-4534-8935-e67877b0ba22 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:14.387775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c1eb552-8b59-4534-8935-e67877b0ba22 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:14.388866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c1eb552-8b59-4534-8935-e67877b0ba22 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:14.393962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c1eb552-8b59-4534-8935-e67877b0ba22 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:14.423182 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-7c1eb552-8b59-4534-8935-e67877b0ba22 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance 52ad379b-7eee-4356-99cc-969e3420f4b4 could not be found. Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7c1eb552-8b59-4534-8935-e67877b0ba22 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 HTTP/1.1 Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 52ad379b-7eee-4356-99cc-969e3420f4b4 could not be found. Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '52ad379b-7eee-4356-99cc-969e3420f4b4'} Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52ad379b-7eee-4356-99cc-969e3420f4b4 could not be found. Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52ad379b-7eee-4356-99cc-969e3420f4b4 could not be found. Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:14.426743 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:14.430100 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:14.430100 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:14.430100 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:14.430100 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:14.430100 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52ad379b-7eee-4356-99cc-969e3420f4b4 could not be found. Jul 20 04:48:14.430100 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:14.431930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7c1eb552-8b59-4534-8935-e67877b0ba22 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance 52ad379b-7eee-4356-99cc-969e3420f4b4 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:14.433095 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7c1eb552-8b59-4534-8935-e67877b0ba22 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 404 len: 111 microversion: 2.1 time: 0.066473 Jul 20 04:48:14.434240 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3102/5972] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:14 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:48:14.556220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c346b3c9-09aa-4555-9513-60429c809f8c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:14.565672 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c346b3c9-09aa-4555-9513-60429c809f8c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1661 microversion: 2.1 time: 0.609265 Jul 20 04:48:14.572902 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2871/5973] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:13 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1661 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:14.616374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-240beb1f-43f8-4679-821e-9acdb1adaf68 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-63264033", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "3d22ba6e-7662-4637-bb0f-d3084b1def5c"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:14.707037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-240beb1f-43f8-4679-821e-9acdb1adaf68 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] validate_networks() for [('3d22ba6e-7662-4637-bb0f-d3084b1def5c', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:48:14.958697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dcf0d093-6180-40e3-ad4b-8dac2e3e58cc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:14.959413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dcf0d093-6180-40e3-ad4b-8dac2e3e58cc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:14.971312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcf0d093-6180-40e3-ad4b-8dac2e3e58cc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:14.972980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcf0d093-6180-40e3-ad4b-8dac2e3e58cc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:14.974907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcf0d093-6180-40e3-ad4b-8dac2e3e58cc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:14.976147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcf0d093-6180-40e3-ad4b-8dac2e3e58cc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:15.405183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dcf0d093-6180-40e3-ad4b-8dac2e3e58cc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:15.436007 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dcf0d093-6180-40e3-ad4b-8dac2e3e58cc tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1527 microversion: 2.1 time: 0.482694 Jul 20 04:48:15.443906 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2872/5974] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:14 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1527 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:15.592668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-383bb899-2839-4900-bc6f-3fec17c5d8b9 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:15.594280 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-383bb899-2839-4900-bc6f-3fec17c5d8b9 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:15.607171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-383bb899-2839-4900-bc6f-3fec17c5d8b9 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:15.613329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-383bb899-2839-4900-bc6f-3fec17c5d8b9 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:15.614895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-383bb899-2839-4900-bc6f-3fec17c5d8b9 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:15.624688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-383bb899-2839-4900-bc6f-3fec17c5d8b9 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:15.948693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-383bb899-2839-4900-bc6f-3fec17c5d8b9 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:15.966180 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-383bb899-2839-4900-bc6f-3fec17c5d8b9 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1661 microversion: 2.1 time: 0.379381 Jul 20 04:48:15.973403 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2873/5975] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:15 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1661 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:16.085963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-240beb1f-43f8-4679-821e-9acdb1adaf68 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:48:16.087056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-240beb1f-43f8-4679-821e-9acdb1adaf68 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:48:16.088890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-240beb1f-43f8-4679-821e-9acdb1adaf68 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:48:16.089548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-240beb1f-43f8-4679-821e-9acdb1adaf68 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:48:16.090718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-240beb1f-43f8-4679-821e-9acdb1adaf68 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:48:16.119228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-240beb1f-43f8-4679-821e-9acdb1adaf68 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:16.120091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-240beb1f-43f8-4679-821e-9acdb1adaf68 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:16.125481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-240beb1f-43f8-4679-821e-9acdb1adaf68 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:16.126241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-240beb1f-43f8-4679-821e-9acdb1adaf68 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:16.147361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-240beb1f-43f8-4679-821e-9acdb1adaf68 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Getting quotas for project fc751c3978da4e05b6d7aab178723ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:48:16.155241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-240beb1f-43f8-4679-821e-9acdb1adaf68 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Getting quotas for user a5e17b2cb6654e4584b62ac8d08833f2 and project fc751c3978da4e05b6d7aab178723ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:48:16.170813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-240beb1f-43f8-4679-821e-9acdb1adaf68 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:48:16.173229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-240beb1f-43f8-4679-821e-9acdb1adaf68 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:48:16.237896 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-240beb1f-43f8-4679-821e-9acdb1adaf68 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.621087 Jul 20 04:48:16.243811 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3103/5976] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:48:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:48:16.252023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-88b1ec03-e741-4cdd-a265-9ebf7e2785f5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:16.253007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-88b1ec03-e741-4cdd-a265-9ebf7e2785f5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:16.388065 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-88b1ec03-e741-4cdd-a265-9ebf7e2785f5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:16.401162 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-88b1ec03-e741-4cdd-a265-9ebf7e2785f5 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1207 microversion: 2.1 time: 0.155945 Jul 20 04:48:16.402048 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2874/5977] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:16 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1207 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:16.466256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7cb8ffd5-9d04-4e00-9ddb-bef5870f6490 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:16.466899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7cb8ffd5-9d04-4e00-9ddb-bef5870f6490 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:16.498958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7cb8ffd5-9d04-4e00-9ddb-bef5870f6490 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:16.499449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7cb8ffd5-9d04-4e00-9ddb-bef5870f6490 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:16.513117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7cb8ffd5-9d04-4e00-9ddb-bef5870f6490 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:16.514742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7cb8ffd5-9d04-4e00-9ddb-bef5870f6490 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:16.763405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7cb8ffd5-9d04-4e00-9ddb-bef5870f6490 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:16.773823 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7cb8ffd5-9d04-4e00-9ddb-bef5870f6490 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1527 microversion: 2.1 time: 0.313169 Jul 20 04:48:16.777843 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3104/5978] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:16 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1527 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:16.995059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6174914d-56e2-4827-ad50-e3bf5715b600 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:16.997063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6174914d-56e2-4827-ad50-e3bf5715b600 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:17.011079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6174914d-56e2-4827-ad50-e3bf5715b600 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:17.012032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6174914d-56e2-4827-ad50-e3bf5715b600 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:17.013340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6174914d-56e2-4827-ad50-e3bf5715b600 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:17.014132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6174914d-56e2-4827-ad50-e3bf5715b600 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:17.421893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0abe8ebb-a931-4672-8486-7bb764aab308 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:17.424611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0abe8ebb-a931-4672-8486-7bb764aab308 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:17.433469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0abe8ebb-a931-4672-8486-7bb764aab308 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:17.434428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0abe8ebb-a931-4672-8486-7bb764aab308 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:17.435522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0abe8ebb-a931-4672-8486-7bb764aab308 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:17.436230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0abe8ebb-a931-4672-8486-7bb764aab308 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:17.485523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6174914d-56e2-4827-ad50-e3bf5715b600 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:17.495453 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6174914d-56e2-4827-ad50-e3bf5715b600 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1665 microversion: 2.1 time: 0.503814 Jul 20 04:48:17.496335 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2875/5979] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:16 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1665 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:17.565228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0abe8ebb-a931-4672-8486-7bb764aab308 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:17.574100 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0abe8ebb-a931-4672-8486-7bb764aab308 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1259 microversion: 2.1 time: 0.158840 Jul 20 04:48:17.575812 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3105/5980] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:17 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:17.796773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f10cb2f4-b0aa-4f9c-ac1b-0c2c9e9d43c6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:17.797814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f10cb2f4-b0aa-4f9c-ac1b-0c2c9e9d43c6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:17.806554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f10cb2f4-b0aa-4f9c-ac1b-0c2c9e9d43c6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:17.811180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f10cb2f4-b0aa-4f9c-ac1b-0c2c9e9d43c6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:17.812019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f10cb2f4-b0aa-4f9c-ac1b-0c2c9e9d43c6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:17.813060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f10cb2f4-b0aa-4f9c-ac1b-0c2c9e9d43c6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:18.385135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f10cb2f4-b0aa-4f9c-ac1b-0c2c9e9d43c6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:18.394615 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f10cb2f4-b0aa-4f9c-ac1b-0c2c9e9d43c6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1527 microversion: 2.1 time: 0.602006 Jul 20 04:48:18.404775 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2876/5981] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:17 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1527 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:18.594989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-34e34deb-66ff-4b84-881c-44e1750ab77b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:18.596325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-34e34deb-66ff-4b84-881c-44e1750ab77b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:18.603906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-34e34deb-66ff-4b84-881c-44e1750ab77b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:18.604678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-34e34deb-66ff-4b84-881c-44e1750ab77b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:18.605674 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-34e34deb-66ff-4b84-881c-44e1750ab77b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:18.606181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-34e34deb-66ff-4b84-881c-44e1750ab77b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:18.691712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-34e34deb-66ff-4b84-881c-44e1750ab77b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:18.703908 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-34e34deb-66ff-4b84-881c-44e1750ab77b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1265 microversion: 2.1 time: 0.112840 Jul 20 04:48:18.707084 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3106/5982] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:18 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:19.412487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-738fd43d-fbc8-4869-8d10-879602011e12 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:19.414315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-738fd43d-fbc8-4869-8d10-879602011e12 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:19.422546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-738fd43d-fbc8-4869-8d10-879602011e12 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:19.423359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-738fd43d-fbc8-4869-8d10-879602011e12 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:19.424721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-738fd43d-fbc8-4869-8d10-879602011e12 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:19.425429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-738fd43d-fbc8-4869-8d10-879602011e12 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:19.722962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-71f75604-69b3-4180-ab72-898141ed83e6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:19.724432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-71f75604-69b3-4180-ab72-898141ed83e6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:19.728200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:19.736890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71f75604-69b3-4180-ab72-898141ed83e6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:19.737481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71f75604-69b3-4180-ab72-898141ed83e6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:19.741006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71f75604-69b3-4180-ab72-898141ed83e6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:19.741705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71f75604-69b3-4180-ab72-898141ed83e6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:19.842294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-71f75604-69b3-4180-ab72-898141ed83e6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:19.856431 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-71f75604-69b3-4180-ab72-898141ed83e6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1265 microversion: 2.1 time: 0.135756 Jul 20 04:48:19.857672 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3107/5983] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:19 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:19.924286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-738fd43d-fbc8-4869-8d10-879602011e12 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:19.941335 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-738fd43d-fbc8-4869-8d10-879602011e12 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1527 microversion: 2.1 time: 0.533071 Jul 20 04:48:19.941960 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2877/5984] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:19 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1527 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:20.875838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ec20b9f8-f2bd-4a83-8f8c-d262170e4af6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:20.877814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ec20b9f8-f2bd-4a83-8f8c-d262170e4af6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:20.885932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec20b9f8-f2bd-4a83-8f8c-d262170e4af6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:20.886639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec20b9f8-f2bd-4a83-8f8c-d262170e4af6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:20.887679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec20b9f8-f2bd-4a83-8f8c-d262170e4af6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:20.888290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec20b9f8-f2bd-4a83-8f8c-d262170e4af6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:20.960386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-305e2a89-fad4-4da0-8e25-d0fe8633aca2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:20.961781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-305e2a89-fad4-4da0-8e25-d0fe8633aca2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:20.969986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-305e2a89-fad4-4da0-8e25-d0fe8633aca2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:20.970790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-305e2a89-fad4-4da0-8e25-d0fe8633aca2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:20.972175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-305e2a89-fad4-4da0-8e25-d0fe8633aca2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:20.972963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-305e2a89-fad4-4da0-8e25-d0fe8633aca2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:21.236054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-305e2a89-fad4-4da0-8e25-d0fe8633aca2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:21.258775 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-305e2a89-fad4-4da0-8e25-d0fe8633aca2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1509 microversion: 2.1 time: 0.302479 Jul 20 04:48:21.272077 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2878/5985] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:20 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1509 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:21.672587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ec20b9f8-f2bd-4a83-8f8c-d262170e4af6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:21.689620 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ec20b9f8-f2bd-4a83-8f8c-d262170e4af6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1307 microversion: 2.1 time: 0.815982 Jul 20 04:48:21.692093 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3108/5986] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:20 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1307 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:22.282333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4825f136-75ee-4391-8d39-fd97201f88ad tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:22.284749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4825f136-75ee-4391-8d39-fd97201f88ad tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:22.307040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4825f136-75ee-4391-8d39-fd97201f88ad tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:22.307855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4825f136-75ee-4391-8d39-fd97201f88ad tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:22.308961 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4825f136-75ee-4391-8d39-fd97201f88ad tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:22.309603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4825f136-75ee-4391-8d39-fd97201f88ad tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:22.543284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-23a9f8e5-1704-4b47-9852-755901082115 req-9517936c-209e-403e-a469-0c95fd8a5443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344", "tag": "42c825bb-cbca-4195-8529-5186d05bb589"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:22.565670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-23a9f8e5-1704-4b47-9852-755901082115 req-9517936c-209e-403e-a469-0c95fd8a5443 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:22.568916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-23a9f8e5-1704-4b47-9852-755901082115 req-9517936c-209e-403e-a469-0c95fd8a5443 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:22.582866 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-23a9f8e5-1704-4b47-9852-755901082115 req-9517936c-209e-403e-a469-0c95fd8a5443 service nova] Creating event network-changed:42c825bb-cbca-4195-8529-5186d05bb589 for instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 on n-h1-826526-5 Jul 20 04:48:22.594586 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-23a9f8e5-1704-4b47-9852-755901082115 req-9517936c-209e-403e-a469-0c95fd8a5443 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055399 Jul 20 04:48:22.595211 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3109/5987] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:48:22.731607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ebce6f1b-d434-4d5c-a035-d901bc75b85f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:22.733154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ebce6f1b-d434-4d5c-a035-d901bc75b85f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:22.764373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebce6f1b-d434-4d5c-a035-d901bc75b85f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:22.765558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebce6f1b-d434-4d5c-a035-d901bc75b85f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:22.767824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebce6f1b-d434-4d5c-a035-d901bc75b85f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:22.768470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ebce6f1b-d434-4d5c-a035-d901bc75b85f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:22.968327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ebce6f1b-d434-4d5c-a035-d901bc75b85f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:22.978143 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ebce6f1b-d434-4d5c-a035-d901bc75b85f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1307 microversion: 2.1 time: 0.252594 Jul 20 04:48:22.978783 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3110/5988] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:22 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1307 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:23.012132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4825f136-75ee-4391-8d39-fd97201f88ad tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:23.020584 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4825f136-75ee-4391-8d39-fd97201f88ad tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1509 microversion: 2.1 time: 0.746637 Jul 20 04:48:23.030579 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2879/5989] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:22 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1509 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:23.546189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-18f9eea2-eec4-42a5-b30b-df7c63786818 req-fa370049-9883-4909-b8cb-16de649e1a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d530bf9-a3da-4006-9120-3bc00e8266e3", "name": "network-vif-unplugged", "status": "completed", "tag": "7d6173a0-c778-42ab-8c13-3f45b04a097d"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:23.564066 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-18f9eea2-eec4-42a5-b30b-df7c63786818 req-fa370049-9883-4909-b8cb-16de649e1a04 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:23.566266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-18f9eea2-eec4-42a5-b30b-df7c63786818 req-fa370049-9883-4909-b8cb-16de649e1a04 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:23.593739 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-18f9eea2-eec4-42a5-b30b-df7c63786818 req-fa370049-9883-4909-b8cb-16de649e1a04 service nova] Creating event network-vif-unplugged:7d6173a0-c778-42ab-8c13-3f45b04a097d for instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 on n-h2-826526-5 Jul 20 04:48:23.605487 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-18f9eea2-eec4-42a5-b30b-df7c63786818 req-fa370049-9883-4909-b8cb-16de649e1a04 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065809 Jul 20 04:48:23.606833 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3111/5990] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:24.002834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f00c85e6-c9c8-49e7-aaf1-453d9d61905c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:24.004656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f00c85e6-c9c8-49e7-aaf1-453d9d61905c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:24.013464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f00c85e6-c9c8-49e7-aaf1-453d9d61905c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:24.014436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f00c85e6-c9c8-49e7-aaf1-453d9d61905c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:24.015578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f00c85e6-c9c8-49e7-aaf1-453d9d61905c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:24.016182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f00c85e6-c9c8-49e7-aaf1-453d9d61905c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:24.038914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fe9d66eb-18ce-48cc-83c6-7e8183f4dcd3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:24.039649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fe9d66eb-18ce-48cc-83c6-7e8183f4dcd3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:24.046679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe9d66eb-18ce-48cc-83c6-7e8183f4dcd3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:24.047379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe9d66eb-18ce-48cc-83c6-7e8183f4dcd3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:24.048799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe9d66eb-18ce-48cc-83c6-7e8183f4dcd3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:24.049454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe9d66eb-18ce-48cc-83c6-7e8183f4dcd3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:24.316632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fe9d66eb-18ce-48cc-83c6-7e8183f4dcd3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:24.332485 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fe9d66eb-18ce-48cc-83c6-7e8183f4dcd3 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1509 microversion: 2.1 time: 0.296827 Jul 20 04:48:24.336035 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3112/5991] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:24 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1509 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:24.561033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f00c85e6-c9c8-49e7-aaf1-453d9d61905c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:24.569817 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f00c85e6-c9c8-49e7-aaf1-453d9d61905c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1307 microversion: 2.1 time: 0.578170 Jul 20 04:48:24.573689 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2880/5992] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:23 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1307 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:25.351215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-db7e7299-e628-4ab4-b088-be5d789318e5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:25.352636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-db7e7299-e628-4ab4-b088-be5d789318e5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:25.359909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db7e7299-e628-4ab4-b088-be5d789318e5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:25.360295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db7e7299-e628-4ab4-b088-be5d789318e5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:25.361497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db7e7299-e628-4ab4-b088-be5d789318e5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:25.361497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db7e7299-e628-4ab4-b088-be5d789318e5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:25.495908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-db7e7299-e628-4ab4-b088-be5d789318e5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:25.498332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:25.506890 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-db7e7299-e628-4ab4-b088-be5d789318e5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1452 microversion: 2.1 time: 0.159869 Jul 20 04:48:25.507972 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3113/5993] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:25 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:25.523991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-896c120e-c654-497c-9edd-4e237f6f2619 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:25.524736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-896c120e-c654-497c-9edd-4e237f6f2619 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:25.533484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-896c120e-c654-497c-9edd-4e237f6f2619 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:25.533952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-896c120e-c654-497c-9edd-4e237f6f2619 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:25.534755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-896c120e-c654-497c-9edd-4e237f6f2619 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:25.535209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-896c120e-c654-497c-9edd-4e237f6f2619 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:25.589701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6a2ba82b-233f-48b9-9b7d-3c7fb6db4b50 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:25.590315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6a2ba82b-233f-48b9-9b7d-3c7fb6db4b50 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:25.597500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a2ba82b-233f-48b9-9b7d-3c7fb6db4b50 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:25.597952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a2ba82b-233f-48b9-9b7d-3c7fb6db4b50 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:25.598726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a2ba82b-233f-48b9-9b7d-3c7fb6db4b50 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:25.599163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a2ba82b-233f-48b9-9b7d-3c7fb6db4b50 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:25.740393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6a2ba82b-233f-48b9-9b7d-3c7fb6db4b50 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:25.750339 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6a2ba82b-233f-48b9-9b7d-3c7fb6db4b50 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1307 microversion: 2.1 time: 0.164658 Jul 20 04:48:25.751261 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3114/5994] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:25 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1307 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:26.071512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-896c120e-c654-497c-9edd-4e237f6f2619 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:26.080136 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-896c120e-c654-497c-9edd-4e237f6f2619 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1452 microversion: 2.1 time: 0.560163 Jul 20 04:48:26.081508 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2881/5995] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:25 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1452 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:26.129304 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e8a2022e-b03f-450a-8512-45ea7a8796ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:26.130062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e8a2022e-b03f-450a-8512-45ea7a8796ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:26.136909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:26.139470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8a2022e-b03f-450a-8512-45ea7a8796ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:26.140140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8a2022e-b03f-450a-8512-45ea7a8796ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:26.141348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8a2022e-b03f-450a-8512-45ea7a8796ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:26.141970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e8a2022e-b03f-450a-8512-45ea7a8796ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:26.163783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=10 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:26.171901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-e8a2022e-b03f-450a-8512-45ea7a8796ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lazy-loading 'flavor' on Instance uuid 1d530bf9-a3da-4006-9120-3bc00e8266e3 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:48:26.185192 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-e8a2022e-b03f-450a-8512-45ea7a8796ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Cannot 'shelve' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state shelved_offloaded Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e8a2022e-b03f-450a-8512-45ea7a8796ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action HTTP/1.1 Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 14 Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: {"shelve": {}} Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: exception: Cannot 'shelve' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state shelved_offloaded Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '1d530bf9-a3da-4006-9120-3bc00e8266e3', 'body': {'shelve': {}}} Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 20 04:48:26.188876 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:48:26.193264 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:48:26.193264 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:48:26.193264 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state shelved_offloaded Jul 20 04:48:26.193264 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:26.193264 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:26.193264 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:26.193264 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:26.193264 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:26.193264 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:26.193264 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:26.193264 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:26.193264 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state shelved_offloaded Jul 20 04:48:26.193264 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:26.195341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e8a2022e-b03f-450a-8512-45ea7a8796ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 409 to user: Cannot 'shelve' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state shelved_offloaded {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:26.196586 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e8a2022e-b03f-450a-8512-45ea7a8796ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action" status: 409 len: 155 microversion: 2.1 time: 0.072094 Jul 20 04:48:26.197693 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3115/5996] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:48:26 2022] POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action => generated 155 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:48:26.209464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a6b7acc2-ba04-4cdf-bf07-bab615245477 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:26.210383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a6b7acc2-ba04-4cdf-bf07-bab615245477 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:26.219724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6b7acc2-ba04-4cdf-bf07-bab615245477 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:26.219724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6b7acc2-ba04-4cdf-bf07-bab615245477 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:26.220078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6b7acc2-ba04-4cdf-bf07-bab615245477 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:26.225217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6b7acc2-ba04-4cdf-bf07-bab615245477 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:26.327873 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a6b7acc2-ba04-4cdf-bf07-bab615245477 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action" status: 202 len: 0 microversion: 2.1 time: 0.124982 Jul 20 04:48:26.332405 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2882/5997] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:48:26 2022] POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:48:26.339393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b91b5df-7f2b-42a9-9b18-0f61444ad29f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:26.340297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9b91b5df-7f2b-42a9-9b18-0f61444ad29f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:26.349217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b91b5df-7f2b-42a9-9b18-0f61444ad29f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:26.349668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b91b5df-7f2b-42a9-9b18-0f61444ad29f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:26.350613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b91b5df-7f2b-42a9-9b18-0f61444ad29f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:26.351260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b91b5df-7f2b-42a9-9b18-0f61444ad29f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:26.524674 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9b91b5df-7f2b-42a9-9b18-0f61444ad29f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:26.535783 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9b91b5df-7f2b-42a9-9b18-0f61444ad29f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1460 microversion: 2.1 time: 0.202226 Jul 20 04:48:26.546709 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3116/5998] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:26 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1460 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:26.769397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:26.774646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1248845f-8de6-4dae-844c-df2d5265bbb3 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1989894385", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "0bf96977-5193-4e03-9709-6340c8de194b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1871636326", "security_groups": [{"name": "tempest-secgroup-smoke-1828621079"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:26.777449 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7e43b626-de46-4c15-8d08-02b67287f8d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:26.785837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7e43b626-de46-4c15-8d08-02b67287f8d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:26.799672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e43b626-de46-4c15-8d08-02b67287f8d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:26.800138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e43b626-de46-4c15-8d08-02b67287f8d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:26.809326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e43b626-de46-4c15-8d08-02b67287f8d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:26.816589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e43b626-de46-4c15-8d08-02b67287f8d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:26.821171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:27.024522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7e43b626-de46-4c15-8d08-02b67287f8d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:27.034053 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7e43b626-de46-4c15-8d08-02b67287f8d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1307 microversion: 2.1 time: 0.269946 Jul 20 04:48:27.044536 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2883/5999] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:26 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1307 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:27.516662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-1248845f-8de6-4dae-844c-df2d5265bbb3 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] validate_networks() for [('0bf96977-5193-4e03-9709-6340c8de194b', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:48:27.553592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bb7b9b3b-1f26-4e89-9a54-b0ca240f44e6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:27.554685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bb7b9b3b-1f26-4e89-9a54-b0ca240f44e6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:27.561570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb7b9b3b-1f26-4e89-9a54-b0ca240f44e6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:27.562412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb7b9b3b-1f26-4e89-9a54-b0ca240f44e6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:27.563447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb7b9b3b-1f26-4e89-9a54-b0ca240f44e6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:27.564105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb7b9b3b-1f26-4e89-9a54-b0ca240f44e6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:27.788394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bb7b9b3b-1f26-4e89-9a54-b0ca240f44e6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:27.799259 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bb7b9b3b-1f26-4e89-9a54-b0ca240f44e6 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1460 microversion: 2.1 time: 0.249573 Jul 20 04:48:27.800649 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2884/6000] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:27 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1460 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:28.055966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1811c477-b67b-4c13-b500-2de77db6bc31 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:28.057173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1811c477-b67b-4c13-b500-2de77db6bc31 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:28.069451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1811c477-b67b-4c13-b500-2de77db6bc31 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:28.072914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1811c477-b67b-4c13-b500-2de77db6bc31 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:28.074116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1811c477-b67b-4c13-b500-2de77db6bc31 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:28.076653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1811c477-b67b-4c13-b500-2de77db6bc31 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:28.456719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1811c477-b67b-4c13-b500-2de77db6bc31 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:28.466360 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1811c477-b67b-4c13-b500-2de77db6bc31 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1307 microversion: 2.1 time: 0.419118 Jul 20 04:48:28.480026 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2885/6001] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:28 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1307 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:28.639109 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-1248845f-8de6-4dae-844c-df2d5265bbb3 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:48:28.641071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-1248845f-8de6-4dae-844c-df2d5265bbb3 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:48:28.643096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-1248845f-8de6-4dae-844c-df2d5265bbb3 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:48:28.643853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-1248845f-8de6-4dae-844c-df2d5265bbb3 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:48:28.644304 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-1248845f-8de6-4dae-844c-df2d5265bbb3 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:48:28.675235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1248845f-8de6-4dae-844c-df2d5265bbb3 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:28.682839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1248845f-8de6-4dae-844c-df2d5265bbb3 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:28.696766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1248845f-8de6-4dae-844c-df2d5265bbb3 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:28.699095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1248845f-8de6-4dae-844c-df2d5265bbb3 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:28.727248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-1248845f-8de6-4dae-844c-df2d5265bbb3 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Getting quotas for project a678d19d82d248958a3d7df804ccfa95. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:48:28.733367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-1248845f-8de6-4dae-844c-df2d5265bbb3 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Getting quotas for user cffe347e0a094346afd74f178a0fde5d and project a678d19d82d248958a3d7df804ccfa95. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:48:28.763487 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1248845f-8de6-4dae-844c-df2d5265bbb3 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:48:28.774190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1248845f-8de6-4dae-844c-df2d5265bbb3 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:48:28.818959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7710722f-0820-4da2-a307-6ba3d53df073 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:28.820233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7710722f-0820-4da2-a307-6ba3d53df073 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:28.835032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7710722f-0820-4da2-a307-6ba3d53df073 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:28.836857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7710722f-0820-4da2-a307-6ba3d53df073 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:28.840415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7710722f-0820-4da2-a307-6ba3d53df073 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:28.840844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7710722f-0820-4da2-a307-6ba3d53df073 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:28.850621 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1248845f-8de6-4dae-844c-df2d5265bbb3 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.079656 Jul 20 04:48:28.857239 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3117/6002] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:48:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 2087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:48:28.863088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-87663350-d92a-4602-93a7-f1b9b06f5fdb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:28.863965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-87663350-d92a-4602-93a7-f1b9b06f5fdb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:29.136951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-87663350-d92a-4602-93a7-f1b9b06f5fdb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:29.149568 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-87663350-d92a-4602-93a7-f1b9b06f5fdb tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1267 microversion: 2.1 time: 0.290428 Jul 20 04:48:29.152680 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3118/6003] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:28 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1267 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:29.180652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-cf0bbb49-8e52-4764-a739-794f8041af50 req-ccb4cb1f-0bf6-4e19-9020-3c27bdaf0362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344", "name": "network-vif-plugged", "status": "completed", "tag": "42c825bb-cbca-4195-8529-5186d05bb589"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:29.182992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7710722f-0820-4da2-a307-6ba3d53df073 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:29.189661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-cf0bbb49-8e52-4764-a739-794f8041af50 req-ccb4cb1f-0bf6-4e19-9020-3c27bdaf0362 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:29.190114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-cf0bbb49-8e52-4764-a739-794f8041af50 req-ccb4cb1f-0bf6-4e19-9020-3c27bdaf0362 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:29.193312 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7710722f-0820-4da2-a307-6ba3d53df073 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1518 microversion: 2.1 time: 0.379735 Jul 20 04:48:29.193925 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2886/6004] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:28 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1518 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:29.213015 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-cf0bbb49-8e52-4764-a739-794f8041af50 req-ccb4cb1f-0bf6-4e19-9020-3c27bdaf0362 service nova] Creating event network-vif-plugged:42c825bb-cbca-4195-8529-5186d05bb589 for instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 on n-h1-826526-5 Jul 20 04:48:29.219525 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-cf0bbb49-8e52-4764-a739-794f8041af50 req-ccb4cb1f-0bf6-4e19-9020-3c27bdaf0362 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057171 Jul 20 04:48:29.222268 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3119/6005] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:29.486919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-66b47050-c026-45bb-aaa7-e1e36e7762be tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:29.487545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-66b47050-c026-45bb-aaa7-e1e36e7762be tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:29.494768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66b47050-c026-45bb-aaa7-e1e36e7762be tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:29.496910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66b47050-c026-45bb-aaa7-e1e36e7762be tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:29.497833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66b47050-c026-45bb-aaa7-e1e36e7762be tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:29.498425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66b47050-c026-45bb-aaa7-e1e36e7762be tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:29.686721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-66b47050-c026-45bb-aaa7-e1e36e7762be tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:29.698295 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-66b47050-c026-45bb-aaa7-e1e36e7762be tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1307 microversion: 2.1 time: 0.215212 Jul 20 04:48:29.704400 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2887/6006] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:29 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1307 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:30.171892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c461c665-47d6-499a-8e4a-4a18dc9e8d60 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:30.173083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c461c665-47d6-499a-8e4a-4a18dc9e8d60 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:30.188814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c461c665-47d6-499a-8e4a-4a18dc9e8d60 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:30.189267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c461c665-47d6-499a-8e4a-4a18dc9e8d60 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:30.204414 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c461c665-47d6-499a-8e4a-4a18dc9e8d60 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:30.205353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c461c665-47d6-499a-8e4a-4a18dc9e8d60 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:30.212165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dc0a5426-4407-4970-817d-27092e27198d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:30.213438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dc0a5426-4407-4970-817d-27092e27198d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:30.230707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc0a5426-4407-4970-817d-27092e27198d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:30.232589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc0a5426-4407-4970-817d-27092e27198d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:30.233950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc0a5426-4407-4970-817d-27092e27198d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:30.235305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc0a5426-4407-4970-817d-27092e27198d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:30.417544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c461c665-47d6-499a-8e4a-4a18dc9e8d60 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:30.429920 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c461c665-47d6-499a-8e4a-4a18dc9e8d60 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1337 microversion: 2.1 time: 0.262250 Jul 20 04:48:30.432636 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3120/6007] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:30 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1337 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:30.649488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dc0a5426-4407-4970-817d-27092e27198d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:30.662875 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dc0a5426-4407-4970-817d-27092e27198d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1518 microversion: 2.1 time: 0.455611 Jul 20 04:48:30.666278 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2888/6008] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:30 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1518 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:30.721459 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7b44a314-3ef3-4af4-bed0-76057f35e041 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:30.722401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7b44a314-3ef3-4af4-bed0-76057f35e041 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:30.732944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7b44a314-3ef3-4af4-bed0-76057f35e041 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:30.736694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7b44a314-3ef3-4af4-bed0-76057f35e041 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:30.737733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7b44a314-3ef3-4af4-bed0-76057f35e041 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:30.742245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7b44a314-3ef3-4af4-bed0-76057f35e041 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:31.257506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7b44a314-3ef3-4af4-bed0-76057f35e041 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:31.266406 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7b44a314-3ef3-4af4-bed0-76057f35e041 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1489 microversion: 2.1 time: 0.550820 Jul 20 04:48:31.271071 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3121/6009] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:30 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1489 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:31.286377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5aeef8c3-df89-4701-a58f-eb9bb3ecb1e4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-507775706"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:31.287857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5aeef8c3-df89-4701-a58f-eb9bb3ecb1e4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:31.304076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5aeef8c3-df89-4701-a58f-eb9bb3ecb1e4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:31.304673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5aeef8c3-df89-4701-a58f-eb9bb3ecb1e4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:31.306288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5aeef8c3-df89-4701-a58f-eb9bb3ecb1e4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:31.306985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5aeef8c3-df89-4701-a58f-eb9bb3ecb1e4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:31.407873 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5aeef8c3-df89-4701-a58f-eb9bb3ecb1e4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "PUT /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1075 microversion: 2.1 time: 0.125494 Jul 20 04:48:31.409008 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2889/6010] 10.222.0.17 () {60 vars in 1255 bytes} [Wed Jul 20 04:48:31 2022] PUT /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1075 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:31.426495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-83d747e9-ac7f-4f51-87da-da048aef8c2c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:31.427354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-83d747e9-ac7f-4f51-87da-da048aef8c2c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:31.443462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83d747e9-ac7f-4f51-87da-da048aef8c2c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:31.453116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf91eefa-d8db-4b21-a9d3-3315d8acc9f9 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:31.454655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf91eefa-d8db-4b21-a9d3-3315d8acc9f9 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:31.459020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83d747e9-ac7f-4f51-87da-da048aef8c2c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:31.460514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83d747e9-ac7f-4f51-87da-da048aef8c2c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:31.462668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83d747e9-ac7f-4f51-87da-da048aef8c2c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:31.469890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf91eefa-d8db-4b21-a9d3-3315d8acc9f9 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:31.472924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf91eefa-d8db-4b21-a9d3-3315d8acc9f9 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:31.475448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf91eefa-d8db-4b21-a9d3-3315d8acc9f9 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:31.476799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf91eefa-d8db-4b21-a9d3-3315d8acc9f9 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:31.802470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bf91eefa-d8db-4b21-a9d3-3315d8acc9f9 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:31.816862 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf91eefa-d8db-4b21-a9d3-3315d8acc9f9 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1325 microversion: 2.1 time: 0.370993 Jul 20 04:48:31.827631 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2890/6011] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:31 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1325 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:31.835861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-895b0203-d81b-4e05-adcd-00d9e992bb3c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:31.836997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-895b0203-d81b-4e05-adcd-00d9e992bb3c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:31.843604 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-83d747e9-ac7f-4f51-87da-da048aef8c2c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:31.845066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-895b0203-d81b-4e05-adcd-00d9e992bb3c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:31.845835 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-895b0203-d81b-4e05-adcd-00d9e992bb3c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:31.846913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-895b0203-d81b-4e05-adcd-00d9e992bb3c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:31.848156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-895b0203-d81b-4e05-adcd-00d9e992bb3c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:31.852049 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-83d747e9-ac7f-4f51-87da-da048aef8c2c tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1501 microversion: 2.1 time: 0.430849 Jul 20 04:48:31.852674 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3122/6012] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:31 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1501 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:31.872912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-71f85f8c-552e-4588-967e-d604894fcb8f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:31.873526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-71f85f8c-552e-4588-967e-d604894fcb8f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:31.890590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71f85f8c-552e-4588-967e-d604894fcb8f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:31.890939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71f85f8c-552e-4588-967e-d604894fcb8f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:31.891916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71f85f8c-552e-4588-967e-d604894fcb8f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:31.892390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71f85f8c-552e-4588-967e-d604894fcb8f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:32.308835 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-895b0203-d81b-4e05-adcd-00d9e992bb3c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:32.317681 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-895b0203-d81b-4e05-adcd-00d9e992bb3c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1518 microversion: 2.1 time: 0.488474 Jul 20 04:48:32.322122 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2891/6013] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:31 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1518 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:32.418115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-71f85f8c-552e-4588-967e-d604894fcb8f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:32.439985 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-71f85f8c-552e-4588-967e-d604894fcb8f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1501 microversion: 2.1 time: 0.570981 Jul 20 04:48:32.452798 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3123/6014] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:31 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1501 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:32.460937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b5eadd4f-e5f5-4ba6-b1d3-aa5e1705e193 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:32.471920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b5eadd4f-e5f5-4ba6-b1d3-aa5e1705e193 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:32.475685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b5eadd4f-e5f5-4ba6-b1d3-aa5e1705e193 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:32.529418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b5eadd4f-e5f5-4ba6-b1d3-aa5e1705e193 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Going to try to stop instance {{(pid=127870) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:48:32.607271 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b5eadd4f-e5f5-4ba6-b1d3-aa5e1705e193 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "POST /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344/action" status: 202 len: 0 microversion: 2.1 time: 0.150739 Jul 20 04:48:32.611124 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2892/6015] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:48:32 2022] POST /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:48:32.618801 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f7676396-0c7e-48b5-a1f2-9a6d42ba6f1a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:32.619903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f7676396-0c7e-48b5-a1f2-9a6d42ba6f1a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:32.650824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7676396-0c7e-48b5-a1f2-9a6d42ba6f1a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:32.651780 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7676396-0c7e-48b5-a1f2-9a6d42ba6f1a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:32.654348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7676396-0c7e-48b5-a1f2-9a6d42ba6f1a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:32.655144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7676396-0c7e-48b5-a1f2-9a6d42ba6f1a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:32.849890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9a4b814a-ea86-49c1-89f6-b3edd2d0bee8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:32.850692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9a4b814a-ea86-49c1-89f6-b3edd2d0bee8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:32.858805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a4b814a-ea86-49c1-89f6-b3edd2d0bee8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:32.859421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a4b814a-ea86-49c1-89f6-b3edd2d0bee8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:32.860415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a4b814a-ea86-49c1-89f6-b3edd2d0bee8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:32.860891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a4b814a-ea86-49c1-89f6-b3edd2d0bee8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:33.081443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9a4b814a-ea86-49c1-89f6-b3edd2d0bee8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:33.092530 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9a4b814a-ea86-49c1-89f6-b3edd2d0bee8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1393 microversion: 2.1 time: 0.253614 Jul 20 04:48:33.093210 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2893/6016] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:32 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1393 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:33.336340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d961f5e-2b7b-48aa-bf67-2884b276d8fd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:33.337825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d961f5e-2b7b-48aa-bf67-2884b276d8fd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:33.350677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d961f5e-2b7b-48aa-bf67-2884b276d8fd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:33.352560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d961f5e-2b7b-48aa-bf67-2884b276d8fd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:33.353884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d961f5e-2b7b-48aa-bf67-2884b276d8fd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:33.354886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d961f5e-2b7b-48aa-bf67-2884b276d8fd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:33.476093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f7676396-0c7e-48b5-a1f2-9a6d42ba6f1a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:33.495238 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f7676396-0c7e-48b5-a1f2-9a6d42ba6f1a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.881026 Jul 20 04:48:33.508520 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3124/6017] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:32 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:33.557557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d961f5e-2b7b-48aa-bf67-2884b276d8fd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:33.566962 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d961f5e-2b7b-48aa-bf67-2884b276d8fd tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1518 microversion: 2.1 time: 0.235580 Jul 20 04:48:33.572975 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2894/6018] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:33 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1518 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:34.109712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-55268429-27b2-4efa-9a10-bef177529c44 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:34.110323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-55268429-27b2-4efa-9a10-bef177529c44 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:34.125260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55268429-27b2-4efa-9a10-bef177529c44 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:34.126029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55268429-27b2-4efa-9a10-bef177529c44 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:34.127039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55268429-27b2-4efa-9a10-bef177529c44 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:34.127467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55268429-27b2-4efa-9a10-bef177529c44 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:34.330145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-55268429-27b2-4efa-9a10-bef177529c44 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:34.341175 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-55268429-27b2-4efa-9a10-bef177529c44 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1393 microversion: 2.1 time: 0.235377 Jul 20 04:48:34.350846 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3125/6019] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:34 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1393 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:34.518223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d7f80d6a-b5f8-4e1f-b632-dbfaa5573a54 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:34.519654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d7f80d6a-b5f8-4e1f-b632-dbfaa5573a54 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:34.528184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7f80d6a-b5f8-4e1f-b632-dbfaa5573a54 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:34.528823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7f80d6a-b5f8-4e1f-b632-dbfaa5573a54 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:34.529760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7f80d6a-b5f8-4e1f-b632-dbfaa5573a54 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:34.530407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7f80d6a-b5f8-4e1f-b632-dbfaa5573a54 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:34.589424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-75a049a3-568e-4767-802a-231123eca58a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:34.590079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-75a049a3-568e-4767-802a-231123eca58a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:34.616198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-75a049a3-568e-4767-802a-231123eca58a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:34.616911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-75a049a3-568e-4767-802a-231123eca58a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:34.617949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-75a049a3-568e-4767-802a-231123eca58a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:34.618541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-75a049a3-568e-4767-802a-231123eca58a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:34.762463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d7f80d6a-b5f8-4e1f-b632-dbfaa5573a54 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:34.770461 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d7f80d6a-b5f8-4e1f-b632-dbfaa5573a54 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.256981 Jul 20 04:48:34.770956 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2895/6020] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:34 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:34.783905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-75a049a3-568e-4767-802a-231123eca58a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:34.795482 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-75a049a3-568e-4767-802a-231123eca58a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1518 microversion: 2.1 time: 0.210822 Jul 20 04:48:34.796516 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3126/6021] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:34 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:35.367551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c4a31319-0139-4f32-bab4-83b6a9a9f324 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:35.369463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c4a31319-0139-4f32-bab4-83b6a9a9f324 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:35.377433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4a31319-0139-4f32-bab4-83b6a9a9f324 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:35.378605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4a31319-0139-4f32-bab4-83b6a9a9f324 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:35.378914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4a31319-0139-4f32-bab4-83b6a9a9f324 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:35.379360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4a31319-0139-4f32-bab4-83b6a9a9f324 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:35.590519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c4a31319-0139-4f32-bab4-83b6a9a9f324 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:35.599268 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c4a31319-0139-4f32-bab4-83b6a9a9f324 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1393 microversion: 2.1 time: 0.245090 Jul 20 04:48:35.599874 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2896/6022] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:35 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1393 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:35.788065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e491d73b-6cb0-4224-ab03-e78bc903297e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:35.789406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e491d73b-6cb0-4224-ab03-e78bc903297e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:35.797170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e491d73b-6cb0-4224-ab03-e78bc903297e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:35.797794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e491d73b-6cb0-4224-ab03-e78bc903297e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:35.798717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e491d73b-6cb0-4224-ab03-e78bc903297e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:35.799294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e491d73b-6cb0-4224-ab03-e78bc903297e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:35.816212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-968f1824-f0a4-45d8-bf6b-54f0d5f66bcb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:35.816212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-968f1824-f0a4-45d8-bf6b-54f0d5f66bcb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:35.829975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-968f1824-f0a4-45d8-bf6b-54f0d5f66bcb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:35.830467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-968f1824-f0a4-45d8-bf6b-54f0d5f66bcb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:35.831387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-968f1824-f0a4-45d8-bf6b-54f0d5f66bcb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:35.831849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-968f1824-f0a4-45d8-bf6b-54f0d5f66bcb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:36.019948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-968f1824-f0a4-45d8-bf6b-54f0d5f66bcb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:36.037150 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-968f1824-f0a4-45d8-bf6b-54f0d5f66bcb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1518 microversion: 2.1 time: 0.228339 Jul 20 04:48:36.044286 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2897/6023] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:35 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1518 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:36.061975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e491d73b-6cb0-4224-ab03-e78bc903297e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:36.074769 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e491d73b-6cb0-4224-ab03-e78bc903297e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.290866 Jul 20 04:48:36.075511 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3127/6024] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:35 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:36.630746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d6b58e6a-ef08-47f2-a351-14ad40f9f41d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:36.631954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d6b58e6a-ef08-47f2-a351-14ad40f9f41d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:36.640071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6b58e6a-ef08-47f2-a351-14ad40f9f41d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:36.640999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6b58e6a-ef08-47f2-a351-14ad40f9f41d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:36.642193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6b58e6a-ef08-47f2-a351-14ad40f9f41d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:36.642858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6b58e6a-ef08-47f2-a351-14ad40f9f41d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:36.648396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:36.912777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d6b58e6a-ef08-47f2-a351-14ad40f9f41d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:36.933940 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d6b58e6a-ef08-47f2-a351-14ad40f9f41d tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1393 microversion: 2.1 time: 0.317442 Jul 20 04:48:36.937533 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2898/6025] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:36 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1393 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:37.058618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-382bf383-ff5c-40a8-97a3-3b597a6c9f39 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:37.060496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-382bf383-ff5c-40a8-97a3-3b597a6c9f39 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:37.071325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-382bf383-ff5c-40a8-97a3-3b597a6c9f39 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:37.073119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-382bf383-ff5c-40a8-97a3-3b597a6c9f39 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:37.074225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-382bf383-ff5c-40a8-97a3-3b597a6c9f39 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:37.074743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-382bf383-ff5c-40a8-97a3-3b597a6c9f39 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:37.100805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b37f84cd-e7f3-40d5-8a9d-346d679610e4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:37.127765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b37f84cd-e7f3-40d5-8a9d-346d679610e4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:37.139849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b37f84cd-e7f3-40d5-8a9d-346d679610e4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:37.140497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b37f84cd-e7f3-40d5-8a9d-346d679610e4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:37.141426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b37f84cd-e7f3-40d5-8a9d-346d679610e4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:37.141979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b37f84cd-e7f3-40d5-8a9d-346d679610e4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:37.311406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-382bf383-ff5c-40a8-97a3-3b597a6c9f39 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:37.333572 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-382bf383-ff5c-40a8-97a3-3b597a6c9f39 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1518 microversion: 2.1 time: 0.281832 Jul 20 04:48:37.334987 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3128/6026] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:37 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1518 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:37.390645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b37f84cd-e7f3-40d5-8a9d-346d679610e4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:37.405548 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b37f84cd-e7f3-40d5-8a9d-346d679610e4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.315492 Jul 20 04:48:37.409091 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2899/6027] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:37 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:37.952708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fbb13994-61e1-4f5a-92d8-ec2eca9101ec tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:37.953540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fbb13994-61e1-4f5a-92d8-ec2eca9101ec tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:37.960029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fbb13994-61e1-4f5a-92d8-ec2eca9101ec tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:37.960646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fbb13994-61e1-4f5a-92d8-ec2eca9101ec tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:37.961671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fbb13994-61e1-4f5a-92d8-ec2eca9101ec tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:37.962237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fbb13994-61e1-4f5a-92d8-ec2eca9101ec tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:38.183330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fbb13994-61e1-4f5a-92d8-ec2eca9101ec tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:38.192859 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fbb13994-61e1-4f5a-92d8-ec2eca9101ec tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1393 microversion: 2.1 time: 0.244770 Jul 20 04:48:38.204989 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3129/6028] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:37 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1393 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:38.352555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-35e1c02e-4e45-4798-b6c7-13fa79ffbad7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:38.353195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-35e1c02e-4e45-4798-b6c7-13fa79ffbad7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:38.370799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35e1c02e-4e45-4798-b6c7-13fa79ffbad7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:38.371262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35e1c02e-4e45-4798-b6c7-13fa79ffbad7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:38.372168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35e1c02e-4e45-4798-b6c7-13fa79ffbad7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:38.372656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35e1c02e-4e45-4798-b6c7-13fa79ffbad7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:38.425586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5f10f24d-2564-4f47-bb77-0c4ccf12cd86 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:38.426543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5f10f24d-2564-4f47-bb77-0c4ccf12cd86 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:38.438295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f10f24d-2564-4f47-bb77-0c4ccf12cd86 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:38.439023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f10f24d-2564-4f47-bb77-0c4ccf12cd86 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:38.439968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f10f24d-2564-4f47-bb77-0c4ccf12cd86 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:38.440588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5f10f24d-2564-4f47-bb77-0c4ccf12cd86 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:38.619888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5f10f24d-2564-4f47-bb77-0c4ccf12cd86 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:38.636489 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5f10f24d-2564-4f47-bb77-0c4ccf12cd86 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.214647 Jul 20 04:48:38.645984 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3130/6029] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:38 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:38.661028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-35e1c02e-4e45-4798-b6c7-13fa79ffbad7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:38.669131 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-35e1c02e-4e45-4798-b6c7-13fa79ffbad7 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1518 microversion: 2.1 time: 0.321847 Jul 20 04:48:38.678085 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2900/6030] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:38 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1518 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:39.210869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-896eac64-23d4-4b6e-a8f8-022c5c33da04 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:39.211474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-896eac64-23d4-4b6e-a8f8-022c5c33da04 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:39.214404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:39.215991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=8 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:39.221991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-896eac64-23d4-4b6e-a8f8-022c5c33da04 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:39.222436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-896eac64-23d4-4b6e-a8f8-022c5c33da04 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:39.223245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-896eac64-23d4-4b6e-a8f8-022c5c33da04 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:39.223691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-896eac64-23d4-4b6e-a8f8-022c5c33da04 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:39.456598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-896eac64-23d4-4b6e-a8f8-022c5c33da04 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:39.468202 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-896eac64-23d4-4b6e-a8f8-022c5c33da04 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1393 microversion: 2.1 time: 0.261318 Jul 20 04:48:39.470245 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3131/6031] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:39 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1393 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:39.656162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-32508b3d-11f1-4c4e-8944-c17537004c79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:39.661247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-32508b3d-11f1-4c4e-8944-c17537004c79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:39.670909 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32508b3d-11f1-4c4e-8944-c17537004c79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:39.671609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32508b3d-11f1-4c4e-8944-c17537004c79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:39.672650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32508b3d-11f1-4c4e-8944-c17537004c79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:39.673189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32508b3d-11f1-4c4e-8944-c17537004c79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:39.690123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b9d9f719-f8f0-4883-8ee2-b503d33bfb71 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:39.691299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b9d9f719-f8f0-4883-8ee2-b503d33bfb71 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:39.703882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9d9f719-f8f0-4883-8ee2-b503d33bfb71 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:39.704984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9d9f719-f8f0-4883-8ee2-b503d33bfb71 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:39.707220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9d9f719-f8f0-4883-8ee2-b503d33bfb71 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:39.708147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9d9f719-f8f0-4883-8ee2-b503d33bfb71 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:39.928873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-32508b3d-11f1-4c4e-8944-c17537004c79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:39.947523 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-32508b3d-11f1-4c4e-8944-c17537004c79 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.297352 Jul 20 04:48:39.952837 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2901/6032] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:39 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:39.965266 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-79389bdf-b509-40f7-aac2-2c17889c0181 req-19bc76c5-6d1f-4e63-9ea5-4c7348784185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dfaa1f0-02ae-495b-8a76-798f196026a6", "tag": "3f58cd69-4a4d-4b1c-b702-d369b59e734b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:39.981167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-79389bdf-b509-40f7-aac2-2c17889c0181 req-19bc76c5-6d1f-4e63-9ea5-4c7348784185 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:39.982030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-79389bdf-b509-40f7-aac2-2c17889c0181 req-19bc76c5-6d1f-4e63-9ea5-4c7348784185 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:39.996307 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-79389bdf-b509-40f7-aac2-2c17889c0181 req-19bc76c5-6d1f-4e63-9ea5-4c7348784185 service nova] Creating event network-changed:3f58cd69-4a4d-4b1c-b702-d369b59e734b for instance 5dfaa1f0-02ae-495b-8a76-798f196026a6 on n-h2-826526-5 Jul 20 04:48:40.002494 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-79389bdf-b509-40f7-aac2-2c17889c0181 req-19bc76c5-6d1f-4e63-9ea5-4c7348784185 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048429 Jul 20 04:48:40.010544 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2902/6033] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:40.011501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b9d9f719-f8f0-4883-8ee2-b503d33bfb71 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:40.013888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:40.024400 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b9d9f719-f8f0-4883-8ee2-b503d33bfb71 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1518 microversion: 2.1 time: 0.341801 Jul 20 04:48:40.025174 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3132/6034] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:39 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1518 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:40.488612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4004ded0-5fa5-4da5-825d-e145ea18a57b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:40.489301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4004ded0-5fa5-4da5-825d-e145ea18a57b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:40.496607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4004ded0-5fa5-4da5-825d-e145ea18a57b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:40.497420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4004ded0-5fa5-4da5-825d-e145ea18a57b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:40.498663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4004ded0-5fa5-4da5-825d-e145ea18a57b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:40.499154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4004ded0-5fa5-4da5-825d-e145ea18a57b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:40.804847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4004ded0-5fa5-4da5-825d-e145ea18a57b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:40.812662 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4004ded0-5fa5-4da5-825d-e145ea18a57b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1393 microversion: 2.1 time: 0.328560 Jul 20 04:48:40.813261 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2903/6035] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:40 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1393 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:40.969879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5e6afd7d-8cbb-4e96-98a7-2d031180329e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:40.970667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5e6afd7d-8cbb-4e96-98a7-2d031180329e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:40.979613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e6afd7d-8cbb-4e96-98a7-2d031180329e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:40.980065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e6afd7d-8cbb-4e96-98a7-2d031180329e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:40.980873 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e6afd7d-8cbb-4e96-98a7-2d031180329e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:40.981310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e6afd7d-8cbb-4e96-98a7-2d031180329e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:41.042553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c553b1f4-07f5-471c-a1ff-c52f8ba09922 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:41.043393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c553b1f4-07f5-471c-a1ff-c52f8ba09922 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:41.050341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c553b1f4-07f5-471c-a1ff-c52f8ba09922 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:41.050817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c553b1f4-07f5-471c-a1ff-c52f8ba09922 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:41.051662 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c553b1f4-07f5-471c-a1ff-c52f8ba09922 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:41.052851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c553b1f4-07f5-471c-a1ff-c52f8ba09922 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:41.131179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5e6afd7d-8cbb-4e96-98a7-2d031180329e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:41.139724 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5e6afd7d-8cbb-4e96-98a7-2d031180329e tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.174094 Jul 20 04:48:41.140593 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3133/6036] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:40 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:41.371721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c553b1f4-07f5-471c-a1ff-c52f8ba09922 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:41.380416 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c553b1f4-07f5-471c-a1ff-c52f8ba09922 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1518 microversion: 2.1 time: 0.342152 Jul 20 04:48:41.381020 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2904/6037] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:41 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1518 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:41.830854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a06cb15a-31f2-42e7-a52e-92184e6b83f6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:41.831470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a06cb15a-31f2-42e7-a52e-92184e6b83f6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:41.844844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a06cb15a-31f2-42e7-a52e-92184e6b83f6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:41.845217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a06cb15a-31f2-42e7-a52e-92184e6b83f6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:41.846012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a06cb15a-31f2-42e7-a52e-92184e6b83f6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:41.846472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a06cb15a-31f2-42e7-a52e-92184e6b83f6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:41.985620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a06cb15a-31f2-42e7-a52e-92184e6b83f6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:41.993868 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a06cb15a-31f2-42e7-a52e-92184e6b83f6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1393 microversion: 2.1 time: 0.167121 Jul 20 04:48:41.994803 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3134/6038] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:41 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:42.157834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d43f21fd-39f9-430c-85e6-bf1ae0668787 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:42.158836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d43f21fd-39f9-430c-85e6-bf1ae0668787 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:42.162626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:42.171787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d43f21fd-39f9-430c-85e6-bf1ae0668787 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:42.172251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d43f21fd-39f9-430c-85e6-bf1ae0668787 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:42.173107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d43f21fd-39f9-430c-85e6-bf1ae0668787 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:42.173592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d43f21fd-39f9-430c-85e6-bf1ae0668787 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:42.393339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d43f21fd-39f9-430c-85e6-bf1ae0668787 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:42.396800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fd0541dd-8244-41b5-a024-5b1ce09f62eb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:42.397663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fd0541dd-8244-41b5-a024-5b1ce09f62eb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:42.401410 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d43f21fd-39f9-430c-85e6-bf1ae0668787 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.247654 Jul 20 04:48:42.402200 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2905/6039] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:42 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:42.404217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd0541dd-8244-41b5-a024-5b1ce09f62eb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:42.404694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd0541dd-8244-41b5-a024-5b1ce09f62eb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:42.405466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd0541dd-8244-41b5-a024-5b1ce09f62eb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:42.405899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd0541dd-8244-41b5-a024-5b1ce09f62eb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:42.544762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fd0541dd-8244-41b5-a024-5b1ce09f62eb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:42.554285 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fd0541dd-8244-41b5-a024-5b1ce09f62eb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1518 microversion: 2.1 time: 0.160931 Jul 20 04:48:42.555398 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3135/6040] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:42 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:43.012770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-31620441-bb36-411b-83b7-e37e6ae39050 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:43.013305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-31620441-bb36-411b-83b7-e37e6ae39050 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:43.020013 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31620441-bb36-411b-83b7-e37e6ae39050 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:43.020616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31620441-bb36-411b-83b7-e37e6ae39050 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:43.021391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31620441-bb36-411b-83b7-e37e6ae39050 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:43.021946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31620441-bb36-411b-83b7-e37e6ae39050 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:43.225784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-31620441-bb36-411b-83b7-e37e6ae39050 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:43.234178 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-31620441-bb36-411b-83b7-e37e6ae39050 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1393 microversion: 2.1 time: 0.225444 Jul 20 04:48:43.234865 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2906/6041] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:43 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1393 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:43.419331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-29418620-6120-4215-b599-29fe9d115734 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:43.420153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-29418620-6120-4215-b599-29fe9d115734 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:43.437027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29418620-6120-4215-b599-29fe9d115734 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:43.437888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29418620-6120-4215-b599-29fe9d115734 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:43.439898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29418620-6120-4215-b599-29fe9d115734 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:43.440713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29418620-6120-4215-b599-29fe9d115734 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:43.589043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dc02563f-d5c9-4eca-b840-369549895478 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:43.592193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dc02563f-d5c9-4eca-b840-369549895478 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:43.609552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc02563f-d5c9-4eca-b840-369549895478 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:43.610994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc02563f-d5c9-4eca-b840-369549895478 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:43.613781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc02563f-d5c9-4eca-b840-369549895478 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:43.614310 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc02563f-d5c9-4eca-b840-369549895478 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:43.751527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-29418620-6120-4215-b599-29fe9d115734 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:43.763060 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-29418620-6120-4215-b599-29fe9d115734 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.347854 Jul 20 04:48:43.765004 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3136/6042] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:43 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:43.869937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dc02563f-d5c9-4eca-b840-369549895478 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:43.880896 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dc02563f-d5c9-4eca-b840-369549895478 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1518 microversion: 2.1 time: 0.309423 Jul 20 04:48:43.881973 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2907/6043] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:43 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1518 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:44.255770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5aad8b71-78ab-43ef-8393-f1b30422d71c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:44.256830 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5aad8b71-78ab-43ef-8393-f1b30422d71c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:44.269003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5aad8b71-78ab-43ef-8393-f1b30422d71c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:44.269996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5aad8b71-78ab-43ef-8393-f1b30422d71c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:44.271553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5aad8b71-78ab-43ef-8393-f1b30422d71c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:44.272901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5aad8b71-78ab-43ef-8393-f1b30422d71c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:44.465646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5aad8b71-78ab-43ef-8393-f1b30422d71c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:44.474360 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5aad8b71-78ab-43ef-8393-f1b30422d71c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1393 microversion: 2.1 time: 0.226337 Jul 20 04:48:44.475135 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3137/6044] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:44 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1393 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:44.782339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9252eff4-6e2f-484f-81c4-b51d8368dc2b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:44.783668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9252eff4-6e2f-484f-81c4-b51d8368dc2b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:44.791654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9252eff4-6e2f-484f-81c4-b51d8368dc2b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:44.792479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9252eff4-6e2f-484f-81c4-b51d8368dc2b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:44.793592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9252eff4-6e2f-484f-81c4-b51d8368dc2b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:44.794247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9252eff4-6e2f-484f-81c4-b51d8368dc2b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:44.907833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4fcd86ac-125e-4ded-9d98-b310e96bcbd5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:44.908794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4fcd86ac-125e-4ded-9d98-b310e96bcbd5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:44.918020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4fcd86ac-125e-4ded-9d98-b310e96bcbd5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:44.918647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4fcd86ac-125e-4ded-9d98-b310e96bcbd5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:44.919662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4fcd86ac-125e-4ded-9d98-b310e96bcbd5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:44.920251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4fcd86ac-125e-4ded-9d98-b310e96bcbd5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:45.058239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9252eff4-6e2f-484f-81c4-b51d8368dc2b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:45.067212 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9252eff4-6e2f-484f-81c4-b51d8368dc2b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.288744 Jul 20 04:48:45.077048 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2908/6045] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:44 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:45.105351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4fcd86ac-125e-4ded-9d98-b310e96bcbd5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:45.113771 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4fcd86ac-125e-4ded-9d98-b310e96bcbd5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1518 microversion: 2.1 time: 0.212975 Jul 20 04:48:45.114769 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3138/6046] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:44 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1518 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:45.491401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2e1decda-5c5a-4d38-a289-aa8a3b0b04c6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:45.492476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2e1decda-5c5a-4d38-a289-aa8a3b0b04c6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:45.499545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e1decda-5c5a-4d38-a289-aa8a3b0b04c6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:45.500915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e1decda-5c5a-4d38-a289-aa8a3b0b04c6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:45.502096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e1decda-5c5a-4d38-a289-aa8a3b0b04c6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:45.502793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e1decda-5c5a-4d38-a289-aa8a3b0b04c6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:45.808090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2e1decda-5c5a-4d38-a289-aa8a3b0b04c6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:45.821586 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2e1decda-5c5a-4d38-a289-aa8a3b0b04c6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1393 microversion: 2.1 time: 0.334081 Jul 20 04:48:45.822876 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2909/6047] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:45 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1393 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:45.875473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-b1a72827-4fc8-4c36-949a-70bc4585b8d8 req-aab7cb0b-a682-4b9f-97e4-24eee1ef7d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d530bf9-a3da-4006-9120-3bc00e8266e3", "name": "network-vif-plugged", "status": "completed", "tag": "7d6173a0-c778-42ab-8c13-3f45b04a097d"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:45.896718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-b1a72827-4fc8-4c36-949a-70bc4585b8d8 req-aab7cb0b-a682-4b9f-97e4-24eee1ef7d53 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:45.897984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-b1a72827-4fc8-4c36-949a-70bc4585b8d8 req-aab7cb0b-a682-4b9f-97e4-24eee1ef7d53 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:45.917044 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-b1a72827-4fc8-4c36-949a-70bc4585b8d8 req-aab7cb0b-a682-4b9f-97e4-24eee1ef7d53 service nova] Creating event network-vif-plugged:7d6173a0-c778-42ab-8c13-3f45b04a097d for instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 on n-h2-826526-5 Jul 20 04:48:45.926186 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-b1a72827-4fc8-4c36-949a-70bc4585b8d8 req-aab7cb0b-a682-4b9f-97e4-24eee1ef7d53 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058575 Jul 20 04:48:45.927378 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3139/6048] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:46.096179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ebf94987-437f-489a-b183-0b9850d9c676 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:46.099094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ebf94987-437f-489a-b183-0b9850d9c676 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:46.115003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ebf94987-437f-489a-b183-0b9850d9c676 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:46.115485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ebf94987-437f-489a-b183-0b9850d9c676 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:46.116412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ebf94987-437f-489a-b183-0b9850d9c676 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:46.117446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ebf94987-437f-489a-b183-0b9850d9c676 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:46.133854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3c534c7f-b7c9-46f3-8804-89db4d095304 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:46.135013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3c534c7f-b7c9-46f3-8804-89db4d095304 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:46.142882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c534c7f-b7c9-46f3-8804-89db4d095304 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:46.143599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c534c7f-b7c9-46f3-8804-89db4d095304 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:46.144655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c534c7f-b7c9-46f3-8804-89db4d095304 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:46.145229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3c534c7f-b7c9-46f3-8804-89db4d095304 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:46.354640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3c534c7f-b7c9-46f3-8804-89db4d095304 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:46.369569 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3c534c7f-b7c9-46f3-8804-89db4d095304 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1518 microversion: 2.1 time: 0.240408 Jul 20 04:48:46.371074 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3140/6049] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:46 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1518 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:46.472333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ebf94987-437f-489a-b183-0b9850d9c676 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:46.483543 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ebf94987-437f-489a-b183-0b9850d9c676 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.401952 Jul 20 04:48:46.484727 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2910/6050] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:46 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:46.841701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a0684f26-81f8-4648-aceb-1c8a444e33b7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:46.842911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a0684f26-81f8-4648-aceb-1c8a444e33b7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:46.850093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0684f26-81f8-4648-aceb-1c8a444e33b7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:46.850726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0684f26-81f8-4648-aceb-1c8a444e33b7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:46.852297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0684f26-81f8-4648-aceb-1c8a444e33b7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:46.852433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0684f26-81f8-4648-aceb-1c8a444e33b7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:47.100078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a0684f26-81f8-4648-aceb-1c8a444e33b7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:47.108771 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a0684f26-81f8-4648-aceb-1c8a444e33b7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1393 microversion: 2.1 time: 0.273038 Jul 20 04:48:47.109279 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3141/6051] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:46 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1393 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:47.387865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-52840a81-1352-4c16-814c-0495d59ce5a2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:47.389188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-52840a81-1352-4c16-814c-0495d59ce5a2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:47.395790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52840a81-1352-4c16-814c-0495d59ce5a2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:47.396256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52840a81-1352-4c16-814c-0495d59ce5a2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:47.397084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52840a81-1352-4c16-814c-0495d59ce5a2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:47.397541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52840a81-1352-4c16-814c-0495d59ce5a2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:47.519771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-909482e9-5bcb-4413-9701-a973aaf36730 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:47.520774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-909482e9-5bcb-4413-9701-a973aaf36730 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:47.540575 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-909482e9-5bcb-4413-9701-a973aaf36730 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:47.544557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-909482e9-5bcb-4413-9701-a973aaf36730 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:47.545520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-909482e9-5bcb-4413-9701-a973aaf36730 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:47.546941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-909482e9-5bcb-4413-9701-a973aaf36730 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:47.558276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-52840a81-1352-4c16-814c-0495d59ce5a2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:47.571043 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-52840a81-1352-4c16-814c-0495d59ce5a2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1518 microversion: 2.1 time: 0.187476 Jul 20 04:48:47.573014 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2911/6052] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:47 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1518 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:47.831829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-909482e9-5bcb-4413-9701-a973aaf36730 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:47.846279 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-909482e9-5bcb-4413-9701-a973aaf36730 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.342265 Jul 20 04:48:47.847335 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3142/6053] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:47 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:47.962300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-ee6d8ed9-9b02-498c-8a9e-3ae7feba582c req-6cf128e1-f6f4-4a21-b28e-266f3b671e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dfaa1f0-02ae-495b-8a76-798f196026a6", "name": "network-vif-plugged", "status": "completed", "tag": "3f58cd69-4a4d-4b1c-b702-d369b59e734b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:47.973552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ee6d8ed9-9b02-498c-8a9e-3ae7feba582c req-6cf128e1-f6f4-4a21-b28e-266f3b671e14 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:47.974026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ee6d8ed9-9b02-498c-8a9e-3ae7feba582c req-6cf128e1-f6f4-4a21-b28e-266f3b671e14 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:47.986582 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-ee6d8ed9-9b02-498c-8a9e-3ae7feba582c req-6cf128e1-f6f4-4a21-b28e-266f3b671e14 service nova] Creating event network-vif-plugged:3f58cd69-4a4d-4b1c-b702-d369b59e734b for instance 5dfaa1f0-02ae-495b-8a76-798f196026a6 on n-h2-826526-5 Jul 20 04:48:47.991942 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-ee6d8ed9-9b02-498c-8a9e-3ae7feba582c req-6cf128e1-f6f4-4a21-b28e-266f3b671e14 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034623 Jul 20 04:48:47.997718 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2912/6054] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:48:48.130316 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a5365eda-d6ba-4884-a4db-1e7a1bd1649e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:48.131653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a5365eda-d6ba-4884-a4db-1e7a1bd1649e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:48.143697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5365eda-d6ba-4884-a4db-1e7a1bd1649e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:48.144159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5365eda-d6ba-4884-a4db-1e7a1bd1649e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:48.145049 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5365eda-d6ba-4884-a4db-1e7a1bd1649e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:48.154103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5365eda-d6ba-4884-a4db-1e7a1bd1649e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:48.414466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a5365eda-d6ba-4884-a4db-1e7a1bd1649e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:48.426442 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a5365eda-d6ba-4884-a4db-1e7a1bd1649e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1393 microversion: 2.1 time: 0.304272 Jul 20 04:48:48.427054 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3143/6055] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:48 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1393 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:48.596734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-72e6da4f-f0ce-4573-954b-c4b44851bcc4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:48.597469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-72e6da4f-f0ce-4573-954b-c4b44851bcc4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:48.604082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-72e6da4f-f0ce-4573-954b-c4b44851bcc4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:48.604580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-72e6da4f-f0ce-4573-954b-c4b44851bcc4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:48.605361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-72e6da4f-f0ce-4573-954b-c4b44851bcc4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:48.606009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-72e6da4f-f0ce-4573-954b-c4b44851bcc4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:48.749407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-72e6da4f-f0ce-4573-954b-c4b44851bcc4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:48.758018 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-72e6da4f-f0ce-4573-954b-c4b44851bcc4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.166486 Jul 20 04:48:48.759703 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2913/6056] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:48 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:48.778255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b36dc0ff-3a46-404f-9d16-f5d8f28e2311 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:48.778949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b36dc0ff-3a46-404f-9d16-f5d8f28e2311 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:48.785899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b36dc0ff-3a46-404f-9d16-f5d8f28e2311 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:48.786672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b36dc0ff-3a46-404f-9d16-f5d8f28e2311 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:48.787646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b36dc0ff-3a46-404f-9d16-f5d8f28e2311 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:48.788452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b36dc0ff-3a46-404f-9d16-f5d8f28e2311 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:48.863254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-95985d02-df84-48b3-9d1f-771e5281bd42 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:48.863881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-95985d02-df84-48b3-9d1f-771e5281bd42 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:48.870859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95985d02-df84-48b3-9d1f-771e5281bd42 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:48.871326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95985d02-df84-48b3-9d1f-771e5281bd42 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:48.872114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95985d02-df84-48b3-9d1f-771e5281bd42 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:48.872667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95985d02-df84-48b3-9d1f-771e5281bd42 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:49.030112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-95985d02-df84-48b3-9d1f-771e5281bd42 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:49.047413 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-95985d02-df84-48b3-9d1f-771e5281bd42 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.188072 Jul 20 04:48:49.048821 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2914/6057] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:48 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:49.379856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b36dc0ff-3a46-404f-9d16-f5d8f28e2311 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:49.389226 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b36dc0ff-3a46-404f-9d16-f5d8f28e2311 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.615244 Jul 20 04:48:49.389778 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3144/6058] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:48 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:49.414014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e883a555-9a87-4640-bef1-7ecdbfc7bbd0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:49.415257 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e883a555-9a87-4640-bef1-7ecdbfc7bbd0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:49.421575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e883a555-9a87-4640-bef1-7ecdbfc7bbd0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:49.422048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e883a555-9a87-4640-bef1-7ecdbfc7bbd0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:49.422851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e883a555-9a87-4640-bef1-7ecdbfc7bbd0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:49.423301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e883a555-9a87-4640-bef1-7ecdbfc7bbd0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:49.447764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8379c96d-641e-4f4e-813e-c21802cf7238 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:49.449284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8379c96d-641e-4f4e-813e-c21802cf7238 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:49.456866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8379c96d-641e-4f4e-813e-c21802cf7238 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:49.457408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8379c96d-641e-4f4e-813e-c21802cf7238 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:49.458276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8379c96d-641e-4f4e-813e-c21802cf7238 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:49.458827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8379c96d-641e-4f4e-813e-c21802cf7238 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:49.602858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e883a555-9a87-4640-bef1-7ecdbfc7bbd0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:49.635360 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e883a555-9a87-4640-bef1-7ecdbfc7bbd0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.225602 Jul 20 04:48:49.636301 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2915/6059] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:49 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:49.637469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8379c96d-641e-4f4e-813e-c21802cf7238 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:49.646098 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8379c96d-641e-4f4e-813e-c21802cf7238 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1565 microversion: 2.1 time: 0.204797 Jul 20 04:48:49.647744 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3145/6060] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:49 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1565 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:49.656374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9c30396a-9904-4e9c-af34-215e977ea012 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:49.666846 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-9c30396a-9904-4e9c-af34-215e977ea012 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance 44a3187a-67aa-4f3c-bd37-f61bc4c4f528 has no mapping to a cell. Jul 20 04:48:49.667050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0929c26a-58ee-4d63-9653-4d8cf8884848 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:49.667744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0929c26a-58ee-4d63-9653-4d8cf8884848 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:49.675867 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0929c26a-58ee-4d63-9653-4d8cf8884848 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:49.676354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0929c26a-58ee-4d63-9653-4d8cf8884848 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:49.677154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0929c26a-58ee-4d63-9653-4d8cf8884848 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:49.677597 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0929c26a-58ee-4d63-9653-4d8cf8884848 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9c30396a-9904-4e9c-af34-215e977ea012 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/44a3187a-67aa-4f3c-bd37-f61bc4c4f528/action HTTP/1.1 Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 15 Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: {"os-stop": {}} Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 44a3187a-67aa-4f3c-bd37-f61bc4c4f528 has no mapping to a cell. Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '44a3187a-67aa-4f3c-bd37-f61bc4c4f528', 'body': {'os-stop': {}}} Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 44a3187a-67aa-4f3c-bd37-f61bc4c4f528 has no mapping to a cell. Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:48:49.679496 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44a3187a-67aa-4f3c-bd37-f61bc4c4f528 has no mapping to a cell. Jul 20 04:48:49.684474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:49.684474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:49.684474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:49.684474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:49.684474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:49.684474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:49.684474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:49.684474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:49.684474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44a3187a-67aa-4f3c-bd37-f61bc4c4f528 has no mapping to a cell. Jul 20 04:48:49.684474 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:49.685887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9c30396a-9904-4e9c-af34-215e977ea012 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance 44a3187a-67aa-4f3c-bd37-f61bc4c4f528 has no mapping to a cell. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:49.686864 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9c30396a-9904-4e9c-af34-215e977ea012 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/44a3187a-67aa-4f3c-bd37-f61bc4c4f528/action" status: 404 len: 117 microversion: 2.1 time: 0.034567 Jul 20 04:48:49.687862 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2916/6061] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:48:49 2022] POST /compute/v2.1/servers/44a3187a-67aa-4f3c-bd37-f61bc4c4f528/action => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:48:49.696908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b3ddb01f-0bf6-4670-bc25-6661896ec6a1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:49.697991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b3ddb01f-0bf6-4670-bc25-6661896ec6a1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:49.710354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b3ddb01f-0bf6-4670-bc25-6661896ec6a1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:49.714105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b3ddb01f-0bf6-4670-bc25-6661896ec6a1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:49.715360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b3ddb01f-0bf6-4670-bc25-6661896ec6a1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:49.716453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b3ddb01f-0bf6-4670-bc25-6661896ec6a1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:49.721819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:49.824510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0929c26a-58ee-4d63-9653-4d8cf8884848 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:49.832232 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0929c26a-58ee-4d63-9653-4d8cf8884848 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1565 microversion: 2.1 time: 0.171288 Jul 20 04:48:49.832853 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3146/6062] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:49 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:49.960911 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b3ddb01f-0bf6-4670-bc25-6661896ec6a1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:49.971082 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b3ddb01f-0bf6-4670-bc25-6661896ec6a1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.279052 Jul 20 04:48:49.971814 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2917/6063] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:49 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:49.989631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b889ec1c-8ac8-4b2d-97f7-d11afe31be2b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:49.990441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b889ec1c-8ac8-4b2d-97f7-d11afe31be2b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:49.998134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:50.000838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b889ec1c-8ac8-4b2d-97f7-d11afe31be2b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:50.001612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b889ec1c-8ac8-4b2d-97f7-d11afe31be2b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:50.002938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b889ec1c-8ac8-4b2d-97f7-d11afe31be2b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:50.003558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b889ec1c-8ac8-4b2d-97f7-d11afe31be2b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:50.065098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ce1cba46-dce6-438c-bdff-b5f2983138a2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:50.065743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ce1cba46-dce6-438c-bdff-b5f2983138a2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:50.072903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce1cba46-dce6-438c-bdff-b5f2983138a2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:50.073374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce1cba46-dce6-438c-bdff-b5f2983138a2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:50.074179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce1cba46-dce6-438c-bdff-b5f2983138a2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:50.074630 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ce1cba46-dce6-438c-bdff-b5f2983138a2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:50.211575 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b889ec1c-8ac8-4b2d-97f7-d11afe31be2b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:50.220139 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b889ec1c-8ac8-4b2d-97f7-d11afe31be2b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.234304 Jul 20 04:48:50.220919 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3147/6064] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:49 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:50.240362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0f257f38-3611-4b1e-985b-6c4481c5c7d1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:50.241169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0f257f38-3611-4b1e-985b-6c4481c5c7d1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 015ee539-1383-448c-a876-a6a2099a5933] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:50.248959 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-0f257f38-3611-4b1e-985b-6c4481c5c7d1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance 015ee539-1383-448c-a876-a6a2099a5933 could not be found. Jul 20 04:48:50.251429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ce1cba46-dce6-438c-bdff-b5f2983138a2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0f257f38-3611-4b1e-985b-6c4481c5c7d1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/015ee539-1383-448c-a876-a6a2099a5933/action HTTP/1.1 Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 15 Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: {"suspend": {}} Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 015ee539-1383-448c-a876-a6a2099a5933 could not be found. Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '015ee539-1383-448c-a876-a6a2099a5933', 'body': {'suspend': {}}} Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 015ee539-1383-448c-a876-a6a2099a5933 could not be found. Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 015ee539-1383-448c-a876-a6a2099a5933 could not be found. Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:50.251994 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:50.258421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:50.258421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:50.258421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 015ee539-1383-448c-a876-a6a2099a5933 could not be found. Jul 20 04:48:50.258421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:50.258421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0f257f38-3611-4b1e-985b-6c4481c5c7d1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance 015ee539-1383-448c-a876-a6a2099a5933 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:50.258421 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0f257f38-3611-4b1e-985b-6c4481c5c7d1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/015ee539-1383-448c-a876-a6a2099a5933/action" status: 404 len: 111 microversion: 2.1 time: 0.019122 Jul 20 04:48:50.258421 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3148/6065] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:48:50 2022] POST /compute/v2.1/servers/015ee539-1383-448c-a876-a6a2099a5933/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:48:50.262799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a8ee93ac-f433-4427-a31f-2a127077d733 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:50.263399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a8ee93ac-f433-4427-a31f-2a127077d733 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:50.270932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8ee93ac-f433-4427-a31f-2a127077d733 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:50.271399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8ee93ac-f433-4427-a31f-2a127077d733 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:50.272427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8ee93ac-f433-4427-a31f-2a127077d733 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:50.272897 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ce1cba46-dce6-438c-bdff-b5f2983138a2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.212055 Jul 20 04:48:50.273018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8ee93ac-f433-4427-a31f-2a127077d733 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:50.273868 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2918/6066] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:50 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:50.499288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a8ee93ac-f433-4427-a31f-2a127077d733 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:50.511403 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a8ee93ac-f433-4427-a31f-2a127077d733 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.252692 Jul 20 04:48:50.512326 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3149/6067] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:50 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:50.529557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b19b422a-e180-42ee-b1e8-46450bf941da tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:50.530402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b19b422a-e180-42ee-b1e8-46450bf941da tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:50.537090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b19b422a-e180-42ee-b1e8-46450bf941da tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:50.537824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b19b422a-e180-42ee-b1e8-46450bf941da tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:50.538948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b19b422a-e180-42ee-b1e8-46450bf941da tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:50.539514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b19b422a-e180-42ee-b1e8-46450bf941da tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:50.810827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b19b422a-e180-42ee-b1e8-46450bf941da tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:50.818779 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b19b422a-e180-42ee-b1e8-46450bf941da tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.293112 Jul 20 04:48:50.819379 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2919/6068] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:50 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:50.836348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e258a042-d8cb-4cc2-ba7c-ff22abb64933 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:50.837011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e258a042-d8cb-4cc2-ba7c-ff22abb64933 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:50.858456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e258a042-d8cb-4cc2-ba7c-ff22abb64933 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:50.858456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e258a042-d8cb-4cc2-ba7c-ff22abb64933 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:50.858456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e258a042-d8cb-4cc2-ba7c-ff22abb64933 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:50.858456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e258a042-d8cb-4cc2-ba7c-ff22abb64933 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:50.866258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f9fb4856-a692-4460-a8c8-361e4e6c4503 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:50.867678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f9fb4856-a692-4460-a8c8-361e4e6c4503 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:50.877087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9fb4856-a692-4460-a8c8-361e4e6c4503 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:50.877721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9fb4856-a692-4460-a8c8-361e4e6c4503 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:50.879275 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9fb4856-a692-4460-a8c8-361e4e6c4503 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:50.879845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9fb4856-a692-4460-a8c8-361e4e6c4503 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:50.883382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-e258a042-d8cb-4cc2-ba7c-ff22abb64933 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lazy-loading 'flavor' on Instance uuid 1d530bf9-a3da-4006-9120-3bc00e8266e3 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:48:50.909213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:50.922182 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f9fb4856-a692-4460-a8c8-361e4e6c4503 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062052 Jul 20 04:48:50.927535 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2920/6069] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:48:50 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:48:50.991481 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e258a042-d8cb-4cc2-ba7c-ff22abb64933 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action" status: 202 len: 0 microversion: 2.1 time: 0.160025 Jul 20 04:48:50.992442 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3150/6070] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:48:50 2022] POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:48:50.997704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ab242e92-ad47-4480-bbd0-b9d4d9c7b17f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:50.998243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ab242e92-ad47-4480-bbd0-b9d4d9c7b17f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:51.005922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ad6d5308-2370-4beb-93f3-ba5d9669e9ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:51.008898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ad6d5308-2370-4beb-93f3-ba5d9669e9ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:51.010152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab242e92-ad47-4480-bbd0-b9d4d9c7b17f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:51.010724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab242e92-ad47-4480-bbd0-b9d4d9c7b17f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:51.011508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab242e92-ad47-4480-bbd0-b9d4d9c7b17f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:51.016975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab242e92-ad47-4480-bbd0-b9d4d9c7b17f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:51.019769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad6d5308-2370-4beb-93f3-ba5d9669e9ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:51.020167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad6d5308-2370-4beb-93f3-ba5d9669e9ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:51.021040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad6d5308-2370-4beb-93f3-ba5d9669e9ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:51.021512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad6d5308-2370-4beb-93f3-ba5d9669e9ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:51.057693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ab242e92-ad47-4480-bbd0-b9d4d9c7b17f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:48:51.173550 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ab242e92-ad47-4480-bbd0-b9d4d9c7b17f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 204 len: 0 microversion: 2.1 time: 0.183533 Jul 20 04:48:51.174468 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2921/6071] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:48:50 2022] DELETE /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:48:51.184787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5e580c55-5fed-417e-8475-da38f36d7dc6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:51.185926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5e580c55-5fed-417e-8475-da38f36d7dc6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:51.194118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e580c55-5fed-417e-8475-da38f36d7dc6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:51.194875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e580c55-5fed-417e-8475-da38f36d7dc6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:51.196186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e580c55-5fed-417e-8475-da38f36d7dc6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:51.196869 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5e580c55-5fed-417e-8475-da38f36d7dc6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:51.240050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ad6d5308-2370-4beb-93f3-ba5d9669e9ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:51.251023 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ad6d5308-2370-4beb-93f3-ba5d9669e9ce tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1513 microversion: 2.1 time: 0.252499 Jul 20 04:48:51.252790 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3151/6072] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:50 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:51.294051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e20b831a-c371-464f-9e92-f014fdb8da77 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:51.294676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e20b831a-c371-464f-9e92-f014fdb8da77 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:51.302532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e20b831a-c371-464f-9e92-f014fdb8da77 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:51.302992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e20b831a-c371-464f-9e92-f014fdb8da77 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:51.303806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e20b831a-c371-464f-9e92-f014fdb8da77 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:51.304228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e20b831a-c371-464f-9e92-f014fdb8da77 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:51.463046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5e580c55-5fed-417e-8475-da38f36d7dc6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:51.473864 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5e580c55-5fed-417e-8475-da38f36d7dc6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1671 microversion: 2.1 time: 0.294284 Jul 20 04:48:51.486420 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2922/6073] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:51 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1671 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:51.535633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e20b831a-c371-464f-9e92-f014fdb8da77 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:51.549880 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e20b831a-c371-464f-9e92-f014fdb8da77 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.260817 Jul 20 04:48:51.550873 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3152/6074] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:51 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:52.137714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-08c859a8-771a-41af-a0a9-223bb9144722 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:52.138367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-08c859a8-771a-41af-a0a9-223bb9144722 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:52.149998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08c859a8-771a-41af-a0a9-223bb9144722 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:52.150476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08c859a8-771a-41af-a0a9-223bb9144722 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:52.151289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08c859a8-771a-41af-a0a9-223bb9144722 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:52.151752 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08c859a8-771a-41af-a0a9-223bb9144722 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:52.257823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-d4cecdd5-9ed3-4ca8-a7e3-f5fadb71aeb8 req-81d17d29-b13d-4bfd-bd9c-66426c3cd8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dfaa1f0-02ae-495b-8a76-798f196026a6", "tag": "3f58cd69-4a4d-4b1c-b702-d369b59e734b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:52.273884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d4cecdd5-9ed3-4ca8-a7e3-f5fadb71aeb8 req-81d17d29-b13d-4bfd-bd9c-66426c3cd8b6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:52.274333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d4cecdd5-9ed3-4ca8-a7e3-f5fadb71aeb8 req-81d17d29-b13d-4bfd-bd9c-66426c3cd8b6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:52.286888 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-d4cecdd5-9ed3-4ca8-a7e3-f5fadb71aeb8 req-81d17d29-b13d-4bfd-bd9c-66426c3cd8b6 service nova] Creating event network-changed:3f58cd69-4a4d-4b1c-b702-d369b59e734b for instance 5dfaa1f0-02ae-495b-8a76-798f196026a6 on n-h2-826526-5 Jul 20 04:48:52.292891 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-d4cecdd5-9ed3-4ca8-a7e3-f5fadb71aeb8 req-81d17d29-b13d-4bfd-bd9c-66426c3cd8b6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147223 Jul 20 04:48:52.295521 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3153/6075] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:52.301842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-de436a4d-077b-46a3-b244-74a077ee314d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:52.303260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-de436a4d-077b-46a3-b244-74a077ee314d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:52.310188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de436a4d-077b-46a3-b244-74a077ee314d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:52.310639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de436a4d-077b-46a3-b244-74a077ee314d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:52.311420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de436a4d-077b-46a3-b244-74a077ee314d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:52.311856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de436a4d-077b-46a3-b244-74a077ee314d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:52.478048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-de436a4d-077b-46a3-b244-74a077ee314d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:52.488642 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-de436a4d-077b-46a3-b244-74a077ee314d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1513 microversion: 2.1 time: 0.190500 Jul 20 04:48:52.490100 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3154/6076] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:52 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:52.499417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-39d28d2c-fe14-46ec-a362-47cb3c6d8f9b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:52.501396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-39d28d2c-fe14-46ec-a362-47cb3c6d8f9b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:52.514149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39d28d2c-fe14-46ec-a362-47cb3c6d8f9b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:52.515609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39d28d2c-fe14-46ec-a362-47cb3c6d8f9b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:52.518246 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39d28d2c-fe14-46ec-a362-47cb3c6d8f9b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:52.519819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39d28d2c-fe14-46ec-a362-47cb3c6d8f9b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:52.732216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-39d28d2c-fe14-46ec-a362-47cb3c6d8f9b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:52.742206 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-39d28d2c-fe14-46ec-a362-47cb3c6d8f9b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1671 microversion: 2.1 time: 0.250309 Jul 20 04:48:52.742953 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3155/6077] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:52 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1671 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:52.752950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ff2df829-6b28-4e1b-8305-08086f2b8097 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:52.754062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ff2df829-6b28-4e1b-8305-08086f2b8097 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:52.761541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff2df829-6b28-4e1b-8305-08086f2b8097 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:52.762288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff2df829-6b28-4e1b-8305-08086f2b8097 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:52.763279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff2df829-6b28-4e1b-8305-08086f2b8097 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:52.763944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff2df829-6b28-4e1b-8305-08086f2b8097 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:52.851293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-08c859a8-771a-41af-a0a9-223bb9144722 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:52.862743 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-08c859a8-771a-41af-a0a9-223bb9144722 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1565 microversion: 2.1 time: 0.729070 Jul 20 04:48:52.874744 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2923/6078] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:52 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1565 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:52.972178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ff2df829-6b28-4e1b-8305-08086f2b8097 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:52.986217 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ff2df829-6b28-4e1b-8305-08086f2b8097 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.241258 Jul 20 04:48:52.987881 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3156/6079] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:52 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:53.518036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fb6cf086-f268-4f3d-957a-8418ca0f0c9c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:53.519257 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fb6cf086-f268-4f3d-957a-8418ca0f0c9c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:53.528438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb6cf086-f268-4f3d-957a-8418ca0f0c9c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:53.529144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb6cf086-f268-4f3d-957a-8418ca0f0c9c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:53.530296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb6cf086-f268-4f3d-957a-8418ca0f0c9c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:53.530894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb6cf086-f268-4f3d-957a-8418ca0f0c9c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:53.772927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3e8aa740-ad8f-4356-aab6-05d8540a90f7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:53.774301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3e8aa740-ad8f-4356-aab6-05d8540a90f7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:53.782325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e8aa740-ad8f-4356-aab6-05d8540a90f7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:53.783337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e8aa740-ad8f-4356-aab6-05d8540a90f7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:53.784552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e8aa740-ad8f-4356-aab6-05d8540a90f7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:53.785301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3e8aa740-ad8f-4356-aab6-05d8540a90f7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:53.979911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3e8aa740-ad8f-4356-aab6-05d8540a90f7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:53.990906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fb6cf086-f268-4f3d-957a-8418ca0f0c9c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:54.008750 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3e8aa740-ad8f-4356-aab6-05d8540a90f7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1603 microversion: 2.1 time: 0.237139 Jul 20 04:48:54.010595 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3157/6080] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:53 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1603 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:54.015028 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fb6cf086-f268-4f3d-957a-8418ca0f0c9c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1496 microversion: 2.1 time: 0.501356 Jul 20 04:48:54.019880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0479c811-84d8-4aa8-aa0c-def00d2cf5a6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:54.021536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0479c811-84d8-4aa8-aa0c-def00d2cf5a6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:54.029187 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2924/6081] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:53 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1496 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:54.036168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0479c811-84d8-4aa8-aa0c-def00d2cf5a6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:54.037067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0479c811-84d8-4aa8-aa0c-def00d2cf5a6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:54.038296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0479c811-84d8-4aa8-aa0c-def00d2cf5a6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:54.039575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf01de3c-e47b-4c7d-b11b-a344398f8401 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:54.040304 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0479c811-84d8-4aa8-aa0c-def00d2cf5a6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:54.041690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cf01de3c-e47b-4c7d-b11b-a344398f8401 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:54.067872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf01de3c-e47b-4c7d-b11b-a344398f8401 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:54.072042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf01de3c-e47b-4c7d-b11b-a344398f8401 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:54.077429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf01de3c-e47b-4c7d-b11b-a344398f8401 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:54.078128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf01de3c-e47b-4c7d-b11b-a344398f8401 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:54.138206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-cf01de3c-e47b-4c7d-b11b-a344398f8401 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lazy-loading 'flavor' on Instance uuid 1d530bf9-a3da-4006-9120-3bc00e8266e3 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:48:54.159572 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-cf01de3c-e47b-4c7d-b11b-a344398f8401 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Cannot 'suspend' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state suspended Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf01de3c-e47b-4c7d-b11b-a344398f8401 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action HTTP/1.1 Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 15 Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: {"suspend": {}} Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: exception: Cannot 'suspend' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state suspended Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '1d530bf9-a3da-4006-9120-3bc00e8266e3', 'body': {'suspend': {}}} Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 in vm_state suspended. Cannot suspend while the instance is in this state. Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 20 04:48:54.162567 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:48:54.166673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:48:54.166673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:48:54.166673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state suspended Jul 20 04:48:54.166673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:54.166673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:54.166673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:54.166673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:54.166673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:54.166673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:54.166673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:54.166673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:54.166673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state suspended Jul 20 04:48:54.166673 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:54.169299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf01de3c-e47b-4c7d-b11b-a344398f8401 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 409 to user: Cannot 'suspend' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state suspended {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:54.170503 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cf01de3c-e47b-4c7d-b11b-a344398f8401 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action" status: 409 len: 148 microversion: 2.1 time: 0.138789 Jul 20 04:48:54.171587 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2925/6082] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:48:54 2022] POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action => generated 148 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:48:54.181628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b43bfeff-60e6-47d9-b540-8abaf1c75ae1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:54.182437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b43bfeff-60e6-47d9-b540-8abaf1c75ae1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:54.189714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b43bfeff-60e6-47d9-b540-8abaf1c75ae1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:54.190414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b43bfeff-60e6-47d9-b540-8abaf1c75ae1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:54.191373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b43bfeff-60e6-47d9-b540-8abaf1c75ae1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:54.193352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b43bfeff-60e6-47d9-b540-8abaf1c75ae1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:54.325891 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b43bfeff-60e6-47d9-b540-8abaf1c75ae1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action" status: 202 len: 0 microversion: 2.1 time: 0.146435 Jul 20 04:48:54.327427 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2926/6083] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:48:54 2022] POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:48:54.363238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0479c811-84d8-4aa8-aa0c-def00d2cf5a6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:54.375509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a30aa7b8-3f2b-44ac-873f-c1d926eceeba tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:54.377532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a30aa7b8-3f2b-44ac-873f-c1d926eceeba tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:54.379122 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0479c811-84d8-4aa8-aa0c-def00d2cf5a6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.366561 Jul 20 04:48:54.381135 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3158/6084] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:54 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:54.389932 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a30aa7b8-3f2b-44ac-873f-c1d926eceeba tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:54.390704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a30aa7b8-3f2b-44ac-873f-c1d926eceeba tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:54.391666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a30aa7b8-3f2b-44ac-873f-c1d926eceeba tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:54.392307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a30aa7b8-3f2b-44ac-873f-c1d926eceeba tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:54.443321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-a1dea9e1-dc40-4658-9c9f-b10660852d38 req-c91ed0c1-856b-46a0-aff7-792f271f75ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3333b1e8-7653-4bc2-a218-7a8521a338cf", "name": "network-vif-deleted", "tag": "f0786273-0f1f-49de-86fb-2b745295ba8b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:54.454218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a1dea9e1-dc40-4658-9c9f-b10660852d38 req-c91ed0c1-856b-46a0-aff7-792f271f75ad service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:54.455214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a1dea9e1-dc40-4658-9c9f-b10660852d38 req-c91ed0c1-856b-46a0-aff7-792f271f75ad service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:54.472167 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-a1dea9e1-dc40-4658-9c9f-b10660852d38 req-c91ed0c1-856b-46a0-aff7-792f271f75ad service nova] Creating event network-vif-deleted:f0786273-0f1f-49de-86fb-2b745295ba8b for instance 3333b1e8-7653-4bc2-a218-7a8521a338cf on n-h2-826526-5 Jul 20 04:48:54.487337 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-a1dea9e1-dc40-4658-9c9f-b10660852d38 req-c91ed0c1-856b-46a0-aff7-792f271f75ad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047471 Jul 20 04:48:54.491854 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3159/6085] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:48:54.767982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a30aa7b8-3f2b-44ac-873f-c1d926eceeba tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:54.783265 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a30aa7b8-3f2b-44ac-873f-c1d926eceeba tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1502 microversion: 2.1 time: 0.424365 Jul 20 04:48:54.784764 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2927/6086] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:54 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1502 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:55.028762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5b784136-6846-4c3e-8b80-b2391fc4fe87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:55.030069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5b784136-6846-4c3e-8b80-b2391fc4fe87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:55.038114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b784136-6846-4c3e-8b80-b2391fc4fe87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:55.039032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b784136-6846-4c3e-8b80-b2391fc4fe87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:55.040183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b784136-6846-4c3e-8b80-b2391fc4fe87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:55.040881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b784136-6846-4c3e-8b80-b2391fc4fe87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:55.075997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b784136-6846-4c3e-8b80-b2391fc4fe87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:55.076744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b784136-6846-4c3e-8b80-b2391fc4fe87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:55.077183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-5b784136-6846-4c3e-8b80-b2391fc4fe87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lazy-loading 'fault' on Instance uuid 3333b1e8-7653-4bc2-a218-7a8521a338cf {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:48:55.196111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5b784136-6846-4c3e-8b80-b2391fc4fe87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:55.205698 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5b784136-6846-4c3e-8b80-b2391fc4fe87 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 200 len: 1328 microversion: 2.1 time: 0.181552 Jul 20 04:48:55.207479 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3160/6087] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:55 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 1328 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:55.406360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d938ae2-8558-47fa-86a2-c4de9110e257 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:55.407766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d938ae2-8558-47fa-86a2-c4de9110e257 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:55.417523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d938ae2-8558-47fa-86a2-c4de9110e257 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:55.418196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d938ae2-8558-47fa-86a2-c4de9110e257 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:55.419181 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d938ae2-8558-47fa-86a2-c4de9110e257 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:55.420168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d938ae2-8558-47fa-86a2-c4de9110e257 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:55.627903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d938ae2-8558-47fa-86a2-c4de9110e257 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:55.637995 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d938ae2-8558-47fa-86a2-c4de9110e257 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.236512 Jul 20 04:48:55.639362 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2928/6088] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:55 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:55.802556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-29677bfa-e06b-4068-87b3-b1b60a9a4573 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:55.803139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-29677bfa-e06b-4068-87b3-b1b60a9a4573 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:55.809969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29677bfa-e06b-4068-87b3-b1b60a9a4573 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:55.810785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29677bfa-e06b-4068-87b3-b1b60a9a4573 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:55.811651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29677bfa-e06b-4068-87b3-b1b60a9a4573 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:55.812166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-29677bfa-e06b-4068-87b3-b1b60a9a4573 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:56.112439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-29677bfa-e06b-4068-87b3-b1b60a9a4573 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:56.120552 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-29677bfa-e06b-4068-87b3-b1b60a9a4573 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1502 microversion: 2.1 time: 0.322495 Jul 20 04:48:56.121177 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3161/6089] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:55 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1502 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:56.226265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6e7e6324-5ac0-48c2-98c7-255935360685 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:56.227512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6e7e6324-5ac0-48c2-98c7-255935360685 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:56.234641 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e7e6324-5ac0-48c2-98c7-255935360685 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:56.235111 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e7e6324-5ac0-48c2-98c7-255935360685 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:56.235946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e7e6324-5ac0-48c2-98c7-255935360685 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:56.236636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e7e6324-5ac0-48c2-98c7-255935360685 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:56.251374 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-6e7e6324-5ac0-48c2-98c7-255935360685 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] HTTP exception thrown: Instance 3333b1e8-7653-4bc2-a218-7a8521a338cf could not be found. Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6e7e6324-5ac0-48c2-98c7-255935360685 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Request method failure captured: Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf HTTP/1.1 Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14hrxprVuz_dHHOcR8GTo7pu8oCPLaQwPysrUltUoQBMKG3EqE-4oLk9T0h1XMYcyu1LBfKJBCVuAPbSsxe2W99Xl1mxIlOeXYH_2W5rgSXfZky8i8sul9PUmO6H70mSQjHTpDxAEZitdYiOtIRrpg803BtaQXjc4s8jpEEKwJfeT60 Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: bf61df9cc1e340469412fe282057f903 Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeTestJSON-2123877240 Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bf61df9cc1e340469412fe282057f903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bf61df9cc1e340469412fe282057f903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bf61df9cc1e340469412fe282057f903", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bf61df9cc1e340469412fe282057f903"}]}] Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeTestJSON-2123877240 Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: bf61df9cc1e340469412fe282057f903 Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2123877240 Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AttachVolumeTestJSON-2123877240-project Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 4a8bade1b5244107b43bdf34c9663dc7 Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeTestJSON-2123877240-project Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 3333b1e8-7653-4bc2-a218-7a8521a338cf could not be found. Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '3333b1e8-7653-4bc2-a218-7a8521a338cf'} Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3333b1e8-7653-4bc2-a218-7a8521a338cf could not be found. Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3333b1e8-7653-4bc2-a218-7a8521a338cf could not be found. Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:56.253118 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:56.257747 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:56.257747 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:56.257747 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:56.257747 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:56.257747 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:56.257747 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3333b1e8-7653-4bc2-a218-7a8521a338cf could not be found. Jul 20 04:48:56.257747 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:56.257747 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6e7e6324-5ac0-48c2-98c7-255935360685 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Returning 404 to user: Instance 3333b1e8-7653-4bc2-a218-7a8521a338cf could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:56.257747 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6e7e6324-5ac0-48c2-98c7-255935360685 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 404 len: 111 microversion: 2.1 time: 0.032478 Jul 20 04:48:56.257747 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2929/6090] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:56 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:48:56.263877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-efbf6c95-4d93-4ba8-9e6b-a90780655168 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '.version_select at 0x7f06be0b1160>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:56.287803 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-efbf6c95-4d93-4ba8-9e6b-a90780655168 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318803767" status: 202 len: 0 microversion: 2.1 time: 0.027883 Jul 20 04:48:56.288418 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3162/6091] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jul 20 04:48:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318803767 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:48:56.655348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-68dae9ba-aa5c-4d83-8af8-504a2d63b314 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:56.656887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-68dae9ba-aa5c-4d83-8af8-504a2d63b314 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:56.669006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68dae9ba-aa5c-4d83-8af8-504a2d63b314 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:56.669945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68dae9ba-aa5c-4d83-8af8-504a2d63b314 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:56.671556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68dae9ba-aa5c-4d83-8af8-504a2d63b314 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:56.672405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68dae9ba-aa5c-4d83-8af8-504a2d63b314 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:56.860203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-68dae9ba-aa5c-4d83-8af8-504a2d63b314 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:56.868535 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-68dae9ba-aa5c-4d83-8af8-504a2d63b314 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.217358 Jul 20 04:48:56.869388 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2930/6092] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:56 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:57.138831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-501471ae-91f3-44b9-8e9e-6aae0f5127ad tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:57.139450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-501471ae-91f3-44b9-8e9e-6aae0f5127ad tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:57.146640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-501471ae-91f3-44b9-8e9e-6aae0f5127ad tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:57.147176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-501471ae-91f3-44b9-8e9e-6aae0f5127ad tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:57.147971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-501471ae-91f3-44b9-8e9e-6aae0f5127ad tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:57.148755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-501471ae-91f3-44b9-8e9e-6aae0f5127ad tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:57.440217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-501471ae-91f3-44b9-8e9e-6aae0f5127ad tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:57.463996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0c11af4a-1006-45f2-9617-65335e0e7bd9 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Action: 'create', calling method: .version_select at 0x7f06bd4cf310>, body: {"keypair": {"name": "tempest-keypair-1609813670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2YGLZNM8xAzY4Y7vq4pb0gAranabO85wzT1qNX/9TKxhpPgJBj8Y3u4yxHBs1tJB14DQ912Mg2YwsLHAKoxOpVrAOQLqjSwbBo+74GWJ18Hlghgop6zxQiwuM6Gzvg0g=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:57.466123 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-501471ae-91f3-44b9-8e9e-6aae0f5127ad tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.331594 Jul 20 04:48:57.476850 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3163/6093] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:57 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:57.492081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-0c11af4a-1006-45f2-9617-65335e0e7bd9 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Getting quotas for project bf61df9cc1e340469412fe282057f903. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:48:57.495995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4ad1f48d-7035-4963-9d1b-aa30666fe0e0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:57.497229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4ad1f48d-7035-4963-9d1b-aa30666fe0e0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:57.498789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-0c11af4a-1006-45f2-9617-65335e0e7bd9 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Getting quotas for user 4a8bade1b5244107b43bdf34c9663dc7 and project bf61df9cc1e340469412fe282057f903. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:48:57.522390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ad1f48d-7035-4963-9d1b-aa30666fe0e0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:57.522974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ad1f48d-7035-4963-9d1b-aa30666fe0e0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:57.523698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ad1f48d-7035-4963-9d1b-aa30666fe0e0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:57.524357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ad1f48d-7035-4963-9d1b-aa30666fe0e0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:57.532472 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0c11af4a-1006-45f2-9617-65335e0e7bd9 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072583 Jul 20 04:48:57.533748 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2931/6094] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:48:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:57.684067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4ad1f48d-7035-4963-9d1b-aa30666fe0e0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:57.702534 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4ad1f48d-7035-4963-9d1b-aa30666fe0e0 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.212680 Jul 20 04:48:57.703649 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3164/6095] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:57 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:57.721244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a892304d-0724-43f5-ae06-85e510d6b85f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:57.721801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a892304d-0724-43f5-ae06-85e510d6b85f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 40bd0527-b34c-447b-becd-adaa30e18bc3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:57.727634 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-a892304d-0724-43f5-ae06-85e510d6b85f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance 40bd0527-b34c-447b-becd-adaa30e18bc3 could not be found. Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a892304d-0724-43f5-ae06-85e510d6b85f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/40bd0527-b34c-447b-becd-adaa30e18bc3/action HTTP/1.1 Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 15 Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: {"unpause": {}} Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 40bd0527-b34c-447b-becd-adaa30e18bc3 could not be found. Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '40bd0527-b34c-447b-becd-adaa30e18bc3', 'body': {'unpause': {}}} Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40bd0527-b34c-447b-becd-adaa30e18bc3 could not be found. Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40bd0527-b34c-447b-becd-adaa30e18bc3 could not be found. Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:57.729248 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:57.736093 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:57.736093 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:57.736093 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40bd0527-b34c-447b-becd-adaa30e18bc3 could not be found. Jul 20 04:48:57.736093 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:57.736093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a892304d-0724-43f5-ae06-85e510d6b85f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance 40bd0527-b34c-447b-becd-adaa30e18bc3 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:57.736093 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a892304d-0724-43f5-ae06-85e510d6b85f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/40bd0527-b34c-447b-becd-adaa30e18bc3/action" status: 404 len: 111 microversion: 2.1 time: 0.014421 Jul 20 04:48:57.736093 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2932/6096] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:48:57 2022] POST /compute/v2.1/servers/40bd0527-b34c-447b-becd-adaa30e18bc3/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:48:57.742663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c8977004-f7c5-4684-bba2-38ee36e2a6a5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:57.743477 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c8977004-f7c5-4684-bba2-38ee36e2a6a5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:57.751164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8977004-f7c5-4684-bba2-38ee36e2a6a5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:57.751888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8977004-f7c5-4684-bba2-38ee36e2a6a5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:57.752843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8977004-f7c5-4684-bba2-38ee36e2a6a5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:57.753430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8977004-f7c5-4684-bba2-38ee36e2a6a5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:57.899904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aaf1ef2c-295c-42aa-86db-5c2e13215bae tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:57.910630 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aaf1ef2c-295c-42aa-86db-5c2e13215bae tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:57.923880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aaf1ef2c-295c-42aa-86db-5c2e13215bae tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:57.926499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aaf1ef2c-295c-42aa-86db-5c2e13215bae tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:57.929030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aaf1ef2c-295c-42aa-86db-5c2e13215bae tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:57.930886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aaf1ef2c-295c-42aa-86db-5c2e13215bae tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:58.029811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c8977004-f7c5-4684-bba2-38ee36e2a6a5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:58.038893 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c8977004-f7c5-4684-bba2-38ee36e2a6a5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.299749 Jul 20 04:48:58.039488 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3165/6097] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:57 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:58.058675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f6185fb7-c85f-4f96-9e94-06460579e08f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:58.059332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f6185fb7-c85f-4f96-9e94-06460579e08f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:58.066140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f6185fb7-c85f-4f96-9e94-06460579e08f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:58.066808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f6185fb7-c85f-4f96-9e94-06460579e08f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:58.067942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f6185fb7-c85f-4f96-9e94-06460579e08f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:58.068839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f6185fb7-c85f-4f96-9e94-06460579e08f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:58.247782 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aaf1ef2c-295c-42aa-86db-5c2e13215bae tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:58.252746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:58.259559 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aaf1ef2c-295c-42aa-86db-5c2e13215bae tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1511 microversion: 2.1 time: 0.376853 Jul 20 04:48:58.260347 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2933/6098] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:57 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1511 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:58.280531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f6185fb7-c85f-4f96-9e94-06460579e08f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:58.289009 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f6185fb7-c85f-4f96-9e94-06460579e08f tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.234712 Jul 20 04:48:58.289752 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3166/6099] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:58 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:58.306219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cfdc8e97-f760-4372-946c-290750184f33 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:58.307573 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cfdc8e97-f760-4372-946c-290750184f33 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:58.321068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cfdc8e97-f760-4372-946c-290750184f33 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:58.321774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cfdc8e97-f760-4372-946c-290750184f33 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:58.322723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cfdc8e97-f760-4372-946c-290750184f33 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:58.323305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cfdc8e97-f760-4372-946c-290750184f33 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:58.352298 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-cfdc8e97-f760-4372-946c-290750184f33 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Cannot 'unpause' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cfdc8e97-f760-4372-946c-290750184f33 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action HTTP/1.1 Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 15 Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: {"unpause": {}} Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: exception: Cannot 'unpause' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '1d530bf9-a3da-4006-9120-3bc00e8266e3', 'body': {'unpause': {}}} Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 in vm_state active. Cannot unpause while the instance is in this state. Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:58.354125 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:58.357764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:58.357764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:58.357764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:58.357764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active Jul 20 04:48:58.357764 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:48:58.357764 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cfdc8e97-f760-4372-946c-290750184f33 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 409 to user: Cannot 'unpause' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:58.357764 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cfdc8e97-f760-4372-946c-290750184f33 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action" status: 409 len: 145 microversion: 2.1 time: 0.053926 Jul 20 04:48:58.359755 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2934/6100] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:48:58 2022] POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action => generated 145 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:48:58.367119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-89a80a82-8860-486f-bea1-5379e4319b2a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:58.367735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-89a80a82-8860-486f-bea1-5379e4319b2a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:58.377516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89a80a82-8860-486f-bea1-5379e4319b2a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:58.378104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89a80a82-8860-486f-bea1-5379e4319b2a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:58.379516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89a80a82-8860-486f-bea1-5379e4319b2a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:58.381063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89a80a82-8860-486f-bea1-5379e4319b2a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:58.538004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-89a80a82-8860-486f-bea1-5379e4319b2a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:58.545781 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-89a80a82-8860-486f-bea1-5379e4319b2a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.182822 Jul 20 04:48:58.546365 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3167/6101] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:58 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:58.566371 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-66191805-7d7b-4ea7-8d96-6360974c92cb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:58.567087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-66191805-7d7b-4ea7-8d96-6360974c92cb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:58.574245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66191805-7d7b-4ea7-8d96-6360974c92cb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:58.574829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66191805-7d7b-4ea7-8d96-6360974c92cb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:58.576222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66191805-7d7b-4ea7-8d96-6360974c92cb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:58.576766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66191805-7d7b-4ea7-8d96-6360974c92cb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:58.931563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-66191805-7d7b-4ea7-8d96-6360974c92cb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:58.944353 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-66191805-7d7b-4ea7-8d96-6360974c92cb tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.384006 Jul 20 04:48:58.945312 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2935/6102] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:58 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:58.980455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a35d0bd8-8316-4a1b-bd79-fb41edd28a32 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:58.981660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a35d0bd8-8316-4a1b-bd79-fb41edd28a32 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1cc94cec-5c47-4f24-8ea3-eff9fe2b9f07] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:58.993387 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-a35d0bd8-8316-4a1b-bd79-fb41edd28a32 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance 1cc94cec-5c47-4f24-8ea3-eff9fe2b9f07 could not be found. Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a35d0bd8-8316-4a1b-bd79-fb41edd28a32 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/1cc94cec-5c47-4f24-8ea3-eff9fe2b9f07/action HTTP/1.1 Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 18 Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: {"unshelve": null} Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 1cc94cec-5c47-4f24-8ea3-eff9fe2b9f07 could not be found. Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '1cc94cec-5c47-4f24-8ea3-eff9fe2b9f07', 'body': {'unshelve': None}} Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc94cec-5c47-4f24-8ea3-eff9fe2b9f07 could not be found. Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc94cec-5c47-4f24-8ea3-eff9fe2b9f07 could not be found. Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:58.995153 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:58.999038 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:58.999038 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:58.999038 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:58.999038 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:58.999038 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc94cec-5c47-4f24-8ea3-eff9fe2b9f07 could not be found. Jul 20 04:48:58.999038 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:48:58.999038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a35d0bd8-8316-4a1b-bd79-fb41edd28a32 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance 1cc94cec-5c47-4f24-8ea3-eff9fe2b9f07 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:58.999038 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a35d0bd8-8316-4a1b-bd79-fb41edd28a32 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/1cc94cec-5c47-4f24-8ea3-eff9fe2b9f07/action" status: 404 len: 111 microversion: 2.1 time: 0.023965 Jul 20 04:48:58.999038 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3168/6103] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:48:58 2022] POST /compute/v2.1/servers/1cc94cec-5c47-4f24-8ea3-eff9fe2b9f07/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:48:59.008480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-69608e41-000f-4fbc-8955-20f277db7c7a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:59.008956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-69608e41-000f-4fbc-8955-20f277db7c7a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:59.015700 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-69608e41-000f-4fbc-8955-20f277db7c7a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:59.016167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-69608e41-000f-4fbc-8955-20f277db7c7a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:59.017009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-69608e41-000f-4fbc-8955-20f277db7c7a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:59.017463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-69608e41-000f-4fbc-8955-20f277db7c7a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:59.278349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a1c8b07a-6491-42a8-8b71-7685071d94f6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:59.279527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a1c8b07a-6491-42a8-8b71-7685071d94f6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:59.288744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1c8b07a-6491-42a8-8b71-7685071d94f6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:59.291123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1c8b07a-6491-42a8-8b71-7685071d94f6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:59.292093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1c8b07a-6491-42a8-8b71-7685071d94f6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:59.292580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1c8b07a-6491-42a8-8b71-7685071d94f6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:59.295671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:59.300334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-69608e41-000f-4fbc-8955-20f277db7c7a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:59.309919 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-69608e41-000f-4fbc-8955-20f277db7c7a tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.305918 Jul 20 04:48:59.310789 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2936/6104] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:59 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:59.336350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a4607e28-b29d-4522-a88d-0ac0e47425f4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:59.337909 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a4607e28-b29d-4522-a88d-0ac0e47425f4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:59.346078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4607e28-b29d-4522-a88d-0ac0e47425f4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:59.346983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4607e28-b29d-4522-a88d-0ac0e47425f4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:59.348329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4607e28-b29d-4522-a88d-0ac0e47425f4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:59.349581 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4607e28-b29d-4522-a88d-0ac0e47425f4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:59.482619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a1c8b07a-6491-42a8-8b71-7685071d94f6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:59.494728 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a1c8b07a-6491-42a8-8b71-7685071d94f6 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1488 microversion: 2.1 time: 0.221030 Jul 20 04:48:59.495603 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3169/6105] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:59 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1488 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:59.517868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cb47b79a-7251-4445-9bc5-94169a07a2ac tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1100762409"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:59.519161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cb47b79a-7251-4445-9bc5-94169a07a2ac tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:59.526302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb47b79a-7251-4445-9bc5-94169a07a2ac tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:59.526825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb47b79a-7251-4445-9bc5-94169a07a2ac tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:59.527629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb47b79a-7251-4445-9bc5-94169a07a2ac tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:59.528159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb47b79a-7251-4445-9bc5-94169a07a2ac tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:59.602472 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cb47b79a-7251-4445-9bc5-94169a07a2ac tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "PUT /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1062 microversion: 2.1 time: 0.088629 Jul 20 04:48:59.612416 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3170/6106] 10.222.0.17 () {60 vars in 1255 bytes} [Wed Jul 20 04:48:59 2022] PUT /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1062 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:59.620065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8e692b15-06b2-4c1a-b698-505a8320377a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:59.621024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8e692b15-06b2-4c1a-b698-505a8320377a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:59.630545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8e692b15-06b2-4c1a-b698-505a8320377a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:59.631185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8e692b15-06b2-4c1a-b698-505a8320377a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:59.632484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8e692b15-06b2-4c1a-b698-505a8320377a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:59.633106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8e692b15-06b2-4c1a-b698-505a8320377a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:59.797271 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8e692b15-06b2-4c1a-b698-505a8320377a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:59.806820 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8e692b15-06b2-4c1a-b698-505a8320377a tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1489 microversion: 2.1 time: 0.192847 Jul 20 04:48:59.807438 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3171/6107] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:59 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1489 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:59.825648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-68d89aae-8336-460d-bbbe-dc71420e965b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:59.826299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-68d89aae-8336-460d-bbbe-dc71420e965b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:59.833334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68d89aae-8336-460d-bbbe-dc71420e965b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:59.833808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68d89aae-8336-460d-bbbe-dc71420e965b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:59.834766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68d89aae-8336-460d-bbbe-dc71420e965b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:59.836085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68d89aae-8336-460d-bbbe-dc71420e965b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:00.034794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a4607e28-b29d-4522-a88d-0ac0e47425f4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:00.044071 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a4607e28-b29d-4522-a88d-0ac0e47425f4 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.715145 Jul 20 04:49:00.045374 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2937/6108] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:59 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:00.062258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c46b69fe-e921-445a-a250-39bbad7e7fa2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:00.062850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c46b69fe-e921-445a-a250-39bbad7e7fa2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:00.073866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c46b69fe-e921-445a-a250-39bbad7e7fa2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:00.074333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c46b69fe-e921-445a-a250-39bbad7e7fa2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:00.075135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c46b69fe-e921-445a-a250-39bbad7e7fa2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:00.075580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c46b69fe-e921-445a-a250-39bbad7e7fa2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:00.099533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-68d89aae-8336-460d-bbbe-dc71420e965b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:00.113073 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-68d89aae-8336-460d-bbbe-dc71420e965b tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1489 microversion: 2.1 time: 0.291520 Jul 20 04:49:00.115941 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3172/6109] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:59 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1489 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:00.117690 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-c46b69fe-e921-445a-a250-39bbad7e7fa2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Cannot 'unshelve' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c46b69fe-e921-445a-a250-39bbad7e7fa2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action HTTP/1.1 Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 18 Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: {"unshelve": null} Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: exception: Cannot 'unshelve' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '1d530bf9-a3da-4006-9120-3bc00e8266e3', 'body': {'unshelve': None}} Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 in vm_state active. Cannot unshelve while the instance is in this state. Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:49:00.120011 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active Jul 20 04:49:00.124061 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:00.124061 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:00.124061 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:00.124061 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:00.124061 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:00.124061 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:00.124061 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:00.124061 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:00.124061 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active Jul 20 04:49:00.124061 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:00.125810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c46b69fe-e921-445a-a250-39bbad7e7fa2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 409 to user: Cannot 'unshelve' instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 while it is in vm_state active {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:00.126813 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c46b69fe-e921-445a-a250-39bbad7e7fa2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action" status: 409 len: 146 microversion: 2.1 time: 0.068755 Jul 20 04:49:00.127874 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2938/6110] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:49:00 2022] POST /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3/action => generated 146 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:49:00.137316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7cec4079-f507-4c63-8564-71c11f1f1fb1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:00.138674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7cec4079-f507-4c63-8564-71c11f1f1fb1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:00.140123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-89c45736-6671-4c6e-8f07-aa5c4c743b43 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:00.140773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-89c45736-6671-4c6e-8f07-aa5c4c743b43 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:00.147681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7cec4079-f507-4c63-8564-71c11f1f1fb1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:00.148174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7cec4079-f507-4c63-8564-71c11f1f1fb1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:00.149185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7cec4079-f507-4c63-8564-71c11f1f1fb1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:00.149779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7cec4079-f507-4c63-8564-71c11f1f1fb1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:00.150445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89c45736-6671-4c6e-8f07-aa5c4c743b43 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:00.151055 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89c45736-6671-4c6e-8f07-aa5c4c743b43 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:00.155284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89c45736-6671-4c6e-8f07-aa5c4c743b43 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:00.156092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89c45736-6671-4c6e-8f07-aa5c4c743b43 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:00.203758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-89c45736-6671-4c6e-8f07-aa5c4c743b43 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:49:00.350660 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-89c45736-6671-4c6e-8f07-aa5c4c743b43 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 204 len: 0 microversion: 2.1 time: 0.214953 Jul 20 04:49:00.353379 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3173/6111] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:00 2022] DELETE /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:49:00.367826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b6e8c90f-21eb-4418-81e7-d36f1f740bc0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:00.369197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b6e8c90f-21eb-4418-81e7-d36f1f740bc0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:00.380227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b6e8c90f-21eb-4418-81e7-d36f1f740bc0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:00.381268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b6e8c90f-21eb-4418-81e7-d36f1f740bc0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:00.383339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b6e8c90f-21eb-4418-81e7-d36f1f740bc0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:00.384379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b6e8c90f-21eb-4418-81e7-d36f1f740bc0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:00.417601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7cec4079-f507-4c63-8564-71c11f1f1fb1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:00.432371 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7cec4079-f507-4c63-8564-71c11f1f1fb1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.298479 Jul 20 04:49:00.433402 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2939/6112] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:00 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:00.462177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aaab8289-7ca5-47de-81ca-0678180f5302 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:00.462883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aaab8289-7ca5-47de-81ca-0678180f5302 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:00.478095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aaab8289-7ca5-47de-81ca-0678180f5302 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:00.478592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aaab8289-7ca5-47de-81ca-0678180f5302 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:00.487209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aaab8289-7ca5-47de-81ca-0678180f5302 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:00.488633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aaab8289-7ca5-47de-81ca-0678180f5302 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:00.705093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aaab8289-7ca5-47de-81ca-0678180f5302 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:00.714641 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aaab8289-7ca5-47de-81ca-0678180f5302 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.257262 Jul 20 04:49:00.716303 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2940/6113] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:00 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:00.734763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2794014a-e93d-4718-b1ca-a48aa8397197 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-675722705_updated"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:00.736576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2794014a-e93d-4718-b1ca-a48aa8397197 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 41773044-6ebc-4022-9db9-8dacb9d9083f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:00.744755 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-2794014a-e93d-4718-b1ca-a48aa8397197 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance 41773044-6ebc-4022-9db9-8dacb9d9083f could not be found. Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2794014a-e93d-4718-b1ca-a48aa8397197 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: request: PUT /compute/v2.1/servers/41773044-6ebc-4022-9db9-8dacb9d9083f HTTP/1.1 Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 80 Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-675722705_updated"}} Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 41773044-6ebc-4022-9db9-8dacb9d9083f could not be found. Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '41773044-6ebc-4022-9db9-8dacb9d9083f', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-675722705_updated'}}} Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41773044-6ebc-4022-9db9-8dacb9d9083f could not be found. Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 20 04:49:00.746748 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:00.753597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:00.753597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:00.753597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:00.753597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41773044-6ebc-4022-9db9-8dacb9d9083f could not be found. Jul 20 04:49:00.753597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:00.753597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:00.753597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:00.753597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:00.753597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:00.753597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:00.753597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:00.753597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:00.753597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41773044-6ebc-4022-9db9-8dacb9d9083f could not be found. Jul 20 04:49:00.753597 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:00.753597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2794014a-e93d-4718-b1ca-a48aa8397197 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance 41773044-6ebc-4022-9db9-8dacb9d9083f could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:00.753597 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2794014a-e93d-4718-b1ca-a48aa8397197 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "PUT /compute/v2.1/servers/41773044-6ebc-4022-9db9-8dacb9d9083f" status: 404 len: 111 microversion: 2.1 time: 0.019688 Jul 20 04:49:00.753597 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2941/6114] 10.222.0.17 () {60 vars in 1255 bytes} [Wed Jul 20 04:49:00 2022] PUT /compute/v2.1/servers/41773044-6ebc-4022-9db9-8dacb9d9083f => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:49:00.759547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ad90ac4f-7ce7-4831-a12f-feff821ce092 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:00.760291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ad90ac4f-7ce7-4831-a12f-feff821ce092 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:00.770765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad90ac4f-7ce7-4831-a12f-feff821ce092 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:00.771366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad90ac4f-7ce7-4831-a12f-feff821ce092 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:00.772430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad90ac4f-7ce7-4831-a12f-feff821ce092 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:00.773048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad90ac4f-7ce7-4831-a12f-feff821ce092 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:00.798177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b6e8c90f-21eb-4418-81e7-d36f1f740bc0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:00.807398 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b6e8c90f-21eb-4418-81e7-d36f1f740bc0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1495 microversion: 2.1 time: 0.447401 Jul 20 04:49:00.808570 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3174/6115] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:00 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1495 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:00.814316 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f0453fb2-de74-4564-974b-448b0e484325 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1442976468", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0f3a866-bb27-4dc7-bcc2-280a4ea073e4"}], "security_groups": [{"name": "tempest-securitygroup--1138048443"}], "key_name": "tempest-keypair-1609813670", "user_data": "}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:00.988556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ad90ac4f-7ce7-4831-a12f-feff821ce092 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:00.992060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-f0453fb2-de74-4564-974b-448b0e484325 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] validate_networks() for [('a0f3a866-bb27-4dc7-bcc2-280a4ea073e4', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:49:01.001371 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ad90ac4f-7ce7-4831-a12f-feff821ce092 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.245192 Jul 20 04:49:01.002085 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2942/6116] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:00 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:01.027800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-87cd3050-9738-4358-a14f-d9f03ac741e1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:01.028705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-87cd3050-9738-4358-a14f-d9f03ac741e1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:01.037297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87cd3050-9738-4358-a14f-d9f03ac741e1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:01.037297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87cd3050-9738-4358-a14f-d9f03ac741e1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:01.040645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87cd3050-9738-4358-a14f-d9f03ac741e1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:01.041141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-87cd3050-9738-4358-a14f-d9f03ac741e1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:01.310096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-87cd3050-9738-4358-a14f-d9f03ac741e1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:01.318632 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-87cd3050-9738-4358-a14f-d9f03ac741e1 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.295435 Jul 20 04:49:01.326441 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2943/6117] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:01 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:01.341933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-10802b60-ab96-46b1-b93d-ab06052f35f9 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-10802b60-ab96-46b1-b93d-ab06052f35f9 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: request: PUT /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 HTTP/1.1 Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 280 Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '1d530bf9-a3da-4006-9120-3bc00e8266e3', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:01.344387 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-10802b60-ab96-46b1-b93d-ab06052f35f9 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-10802b60-ab96-46b1-b93d-ab06052f35f9 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "PUT /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 400 len: 619 microversion: 2.1 time: 0.010041 Jul 20 04:49:01.349261 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2944/6118] 10.222.0.17 () {60 vars in 1256 bytes} [Wed Jul 20 04:49:01 2022] PUT /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:49:01.355648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7ebfbbb6-fd03-434d-b9db-b50dc685b99d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:01.356303 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7ebfbbb6-fd03-434d-b9db-b50dc685b99d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:01.364622 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ebfbbb6-fd03-434d-b9db-b50dc685b99d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:01.365088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ebfbbb6-fd03-434d-b9db-b50dc685b99d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:01.365973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ebfbbb6-fd03-434d-b9db-b50dc685b99d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:01.366386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ebfbbb6-fd03-434d-b9db-b50dc685b99d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:01.491458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f0453fb2-de74-4564-974b-448b0e484325 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:49:01.492546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f0453fb2-de74-4564-974b-448b0e484325 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:49:01.493262 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f0453fb2-de74-4564-974b-448b0e484325 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:49:01.493858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f0453fb2-de74-4564-974b-448b0e484325 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:49:01.494264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f0453fb2-de74-4564-974b-448b0e484325 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:49:01.505732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0453fb2-de74-4564-974b-448b0e484325 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:01.506466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0453fb2-de74-4564-974b-448b0e484325 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:01.507250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0453fb2-de74-4564-974b-448b0e484325 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:01.507690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0453fb2-de74-4564-974b-448b0e484325 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:01.526793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-f0453fb2-de74-4564-974b-448b0e484325 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Getting quotas for project bf61df9cc1e340469412fe282057f903. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:49:01.533501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-f0453fb2-de74-4564-974b-448b0e484325 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Getting quotas for user 4a8bade1b5244107b43bdf34c9663dc7 and project bf61df9cc1e340469412fe282057f903. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:49:01.552504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f0453fb2-de74-4564-974b-448b0e484325 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:49:01.554856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f0453fb2-de74-4564-974b-448b0e484325 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:49:01.616866 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f0453fb2-de74-4564-974b-448b0e484325 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.806737 Jul 20 04:49:01.623193 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3175/6119] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:49:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:49:01.629637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3d85db88-0ecc-4e54-bb56-0ee8ae62cc0a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:01.630638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3d85db88-0ecc-4e54-bb56-0ee8ae62cc0a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:01.672074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7ebfbbb6-fd03-434d-b9db-b50dc685b99d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:01.682818 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7ebfbbb6-fd03-434d-b9db-b50dc685b99d tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.330862 Jul 20 04:49:01.683657 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2945/6120] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:01 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:01.699120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3d85db88-0ecc-4e54-bb56-0ee8ae62cc0a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:01.700515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-70166a4e-e7a8-4f19-b93f-9aa7b8025f51 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:01.701357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-70166a4e-e7a8-4f19-b93f-9aa7b8025f51 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:01.712848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70166a4e-e7a8-4f19-b93f-9aa7b8025f51 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:01.714245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70166a4e-e7a8-4f19-b93f-9aa7b8025f51 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:01.715240 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70166a4e-e7a8-4f19-b93f-9aa7b8025f51 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:01.715547 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3d85db88-0ecc-4e54-bb56-0ee8ae62cc0a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03" status: 200 len: 1238 microversion: 2.1 time: 0.089283 Jul 20 04:49:01.715886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70166a4e-e7a8-4f19-b93f-9aa7b8025f51 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:01.725892 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3176/6121] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:01 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 => generated 1238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:01.827893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-28b86f98-16a5-4f37-89bf-d43118fae64d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:01.828684 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-28b86f98-16a5-4f37-89bf-d43118fae64d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:01.836566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28b86f98-16a5-4f37-89bf-d43118fae64d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:01.837115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28b86f98-16a5-4f37-89bf-d43118fae64d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:01.837987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28b86f98-16a5-4f37-89bf-d43118fae64d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:01.838521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28b86f98-16a5-4f37-89bf-d43118fae64d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:02.004848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-28b86f98-16a5-4f37-89bf-d43118fae64d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:02.014964 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-28b86f98-16a5-4f37-89bf-d43118fae64d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1495 microversion: 2.1 time: 0.191580 Jul 20 04:49:02.017401 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3177/6122] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:01 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1495 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:02.074248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-70166a4e-e7a8-4f19-b93f-9aa7b8025f51 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:02.083694 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-70166a4e-e7a8-4f19-b93f-9aa7b8025f51 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.387223 Jul 20 04:49:02.085584 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2946/6123] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:01 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:02.106389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f880749a-5625-4cd1-8fd9-2a59b1fda966 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f880749a-5625-4cd1-8fd9-2a59b1fda966 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: request: PUT /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 HTTP/1.1 Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 24 Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: {"server": {"name": ""}} Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '1d530bf9-a3da-4006-9120-3bc00e8266e3', 'body': {'server': {'name': ''}}} Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi '' Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:49:02.110818 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:49:02.115459 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:02.115459 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:02.115459 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:02.115459 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:02.115459 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:02.115459 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:02.115459 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:49:02.115459 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:49:02.115459 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:49:02.115459 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:02.115459 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f880749a-5625-4cd1-8fd9-2a59b1fda966 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:02.115459 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f880749a-5625-4cd1-8fd9-2a59b1fda966 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "PUT /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 400 len: 108 microversion: 2.1 time: 0.012829 Jul 20 04:49:02.115459 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3178/6124] 10.222.0.17 () {60 vars in 1255 bytes} [Wed Jul 20 04:49:02 2022] PUT /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 108 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:49:02.124471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b182f276-15a3-42ed-bbb3-07cbb9a1cff5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:02.125983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b182f276-15a3-42ed-bbb3-07cbb9a1cff5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:02.134619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b182f276-15a3-42ed-bbb3-07cbb9a1cff5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:02.138868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b182f276-15a3-42ed-bbb3-07cbb9a1cff5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:02.139772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b182f276-15a3-42ed-bbb3-07cbb9a1cff5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:02.140476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b182f276-15a3-42ed-bbb3-07cbb9a1cff5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:02.415982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b182f276-15a3-42ed-bbb3-07cbb9a1cff5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:02.426193 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b182f276-15a3-42ed-bbb3-07cbb9a1cff5 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1505 microversion: 2.1 time: 0.307927 Jul 20 04:49:02.439553 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2947/6125] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:02 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:02.551982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-2a1e6c0c-00aa-451a-9a50-06806811d186 req-fb0f8814-dc87-4130-814d-ee0d4e7b93fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344", "name": "network-vif-deleted", "tag": "42c825bb-cbca-4195-8529-5186d05bb589"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:02.572876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-2a1e6c0c-00aa-451a-9a50-06806811d186 req-fb0f8814-dc87-4130-814d-ee0d4e7b93fe service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:02.573630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-2a1e6c0c-00aa-451a-9a50-06806811d186 req-fb0f8814-dc87-4130-814d-ee0d4e7b93fe service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:02.591133 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-2a1e6c0c-00aa-451a-9a50-06806811d186 req-fb0f8814-dc87-4130-814d-ee0d4e7b93fe service nova] Creating event network-vif-deleted:42c825bb-cbca-4195-8529-5186d05bb589 for instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 on n-h1-826526-5 Jul 20 04:49:02.598768 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-2a1e6c0c-00aa-451a-9a50-06806811d186 req-fb0f8814-dc87-4130-814d-ee0d4e7b93fe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050605 Jul 20 04:49:02.600038 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3179/6126] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:02.734974 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-42c5ea2c-c536-49f3-b8c5-476813898324 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:02.735856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-42c5ea2c-c536-49f3-b8c5-476813898324 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:02.738193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:02.754704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-42c5ea2c-c536-49f3-b8c5-476813898324 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:02.755405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-42c5ea2c-c536-49f3-b8c5-476813898324 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:02.758249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-42c5ea2c-c536-49f3-b8c5-476813898324 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:02.759293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-42c5ea2c-c536-49f3-b8c5-476813898324 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:02.870834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-42c5ea2c-c536-49f3-b8c5-476813898324 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:02.880303 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-42c5ea2c-c536-49f3-b8c5-476813898324 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03" status: 200 len: 1290 microversion: 2.1 time: 0.150197 Jul 20 04:49:02.881533 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2948/6127] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:02 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 => generated 1290 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:03.035466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-344d4438-4b85-4df0-bd67-e383e9dc1a63 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:03.036285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-344d4438-4b85-4df0-bd67-e383e9dc1a63 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:03.052656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-344d4438-4b85-4df0-bd67-e383e9dc1a63 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:03.053239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-344d4438-4b85-4df0-bd67-e383e9dc1a63 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:03.054207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-344d4438-4b85-4df0-bd67-e383e9dc1a63 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:03.055712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-344d4438-4b85-4df0-bd67-e383e9dc1a63 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:03.112372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-344d4438-4b85-4df0-bd67-e383e9dc1a63 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:03.113082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-344d4438-4b85-4df0-bd67-e383e9dc1a63 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:03.113763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-344d4438-4b85-4df0-bd67-e383e9dc1a63 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lazy-loading 'fault' on Instance uuid 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:49:03.198745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-344d4438-4b85-4df0-bd67-e383e9dc1a63 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:03.213382 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-344d4438-4b85-4df0-bd67-e383e9dc1a63 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 200 len: 1310 microversion: 2.1 time: 0.183284 Jul 20 04:49:03.224421 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3180/6128] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:03 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 1310 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:03.900127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-65c7abb8-a092-42ca-b0ce-216c5373b989 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:03.900830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-65c7abb8-a092-42ca-b0ce-216c5373b989 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:03.910413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65c7abb8-a092-42ca-b0ce-216c5373b989 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:03.910895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65c7abb8-a092-42ca-b0ce-216c5373b989 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:03.911691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65c7abb8-a092-42ca-b0ce-216c5373b989 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:03.912146 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65c7abb8-a092-42ca-b0ce-216c5373b989 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.233384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bd7a114c-2451-4233-93d4-bb879ed9c979 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:04.234315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bd7a114c-2451-4233-93d4-bb879ed9c979 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:04.246445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd7a114c-2451-4233-93d4-bb879ed9c979 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.247327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd7a114c-2451-4233-93d4-bb879ed9c979 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.248885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd7a114c-2451-4233-93d4-bb879ed9c979 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.249536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd7a114c-2451-4233-93d4-bb879ed9c979 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.269680 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-bd7a114c-2451-4233-93d4-bb879ed9c979 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 could not be found. Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bd7a114c-2451-4233-93d4-bb879ed9c979 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 HTTP/1.1 Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 could not be found. Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344'} Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 could not be found. Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 could not be found. Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.278600 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.282157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.282157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.282157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:04.282157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:04.282157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 could not be found. Jul 20 04:49:04.282157 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.282157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bd7a114c-2451-4233-93d4-bb879ed9c979 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:04.282157 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bd7a114c-2451-4233-93d4-bb879ed9c979 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 404 len: 111 microversion: 2.1 time: 0.052572 Jul 20 04:49:04.282157 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3181/6129] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:04 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:04.307437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6d7d9621-b30f-456a-8004-b6a4ff0c6295 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:04.308243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6d7d9621-b30f-456a-8004-b6a4ff0c6295 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:04.314672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d7d9621-b30f-456a-8004-b6a4ff0c6295 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.315296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d7d9621-b30f-456a-8004-b6a4ff0c6295 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.316120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d7d9621-b30f-456a-8004-b6a4ff0c6295 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.316582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6d7d9621-b30f-456a-8004-b6a4ff0c6295 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.332899 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-6d7d9621-b30f-456a-8004-b6a4ff0c6295 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 could not be found. Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6d7d9621-b30f-456a-8004-b6a4ff0c6295 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 HTTP/1.1 Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 could not be found. Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344'} Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 could not be found. Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:04.335400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 could not be found. Jul 20 04:49:04.339087 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.339087 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.339087 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.339087 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.339087 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.339087 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.339087 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:04.339087 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:04.339087 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 could not be found. Jul 20 04:49:04.339087 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.342436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6d7d9621-b30f-456a-8004-b6a4ff0c6295 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:04.343956 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6d7d9621-b30f-456a-8004-b6a4ff0c6295 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 404 len: 111 microversion: 2.1 time: 0.040878 Jul 20 04:49:04.344899 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3182/6130] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:04 2022] DELETE /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:49:04.353297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-73cb63ed-94d2-4fbe-9d34-111499a8bbf4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:04.353907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-73cb63ed-94d2-4fbe-9d34-111499a8bbf4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:04.355820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-65c7abb8-a092-42ca-b0ce-216c5373b989 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:04.367041 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-65c7abb8-a092-42ca-b0ce-216c5373b989 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03" status: 200 len: 1364 microversion: 2.1 time: 0.471994 Jul 20 04:49:04.367917 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2949/6131] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:03 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 => generated 1364 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:04.372633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:04.380332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73cb63ed-94d2-4fbe-9d34-111499a8bbf4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.381860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73cb63ed-94d2-4fbe-9d34-111499a8bbf4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.382700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73cb63ed-94d2-4fbe-9d34-111499a8bbf4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.383141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73cb63ed-94d2-4fbe-9d34-111499a8bbf4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.411482 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-73cb63ed-94d2-4fbe-9d34-111499a8bbf4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 could not be found. Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-73cb63ed-94d2-4fbe-9d34-111499a8bbf4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 HTTP/1.1 Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 could not be found. Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344'} Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 could not be found. Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 could not be found. Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.413443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.417641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.417641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.417641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:04.417641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:04.417641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 could not be found. Jul 20 04:49:04.417641 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.417641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-73cb63ed-94d2-4fbe-9d34-111499a8bbf4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance 3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:04.417641 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-73cb63ed-94d2-4fbe-9d34-111499a8bbf4 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344" status: 404 len: 111 microversion: 2.1 time: 0.065525 Jul 20 04:49:04.417641 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3183/6132] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:04 2022] GET /compute/v2.1/servers/3fe9b4e2-b5bc-4a5b-bff0-9ef87fecd344 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:04.425029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-26e0397c-cb17-492d-a558-a4b49fa39e16 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:04.425901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-26e0397c-cb17-492d-a558-a4b49fa39e16 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:04.433977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26e0397c-cb17-492d-a558-a4b49fa39e16 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.435153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26e0397c-cb17-492d-a558-a4b49fa39e16 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.436183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26e0397c-cb17-492d-a558-a4b49fa39e16 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.436856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26e0397c-cb17-492d-a558-a4b49fa39e16 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.461351 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-26e0397c-cb17-492d-a558-a4b49fa39e16 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance 52ad379b-7eee-4356-99cc-969e3420f4b4 could not be found. Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-26e0397c-cb17-492d-a558-a4b49fa39e16 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 HTTP/1.1 Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 52ad379b-7eee-4356-99cc-969e3420f4b4 could not be found. Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '52ad379b-7eee-4356-99cc-969e3420f4b4'} Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52ad379b-7eee-4356-99cc-969e3420f4b4 could not be found. Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:04.463270 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52ad379b-7eee-4356-99cc-969e3420f4b4 could not be found. Jul 20 04:49:04.467109 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.467109 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.467109 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.467109 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.467109 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.467109 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.467109 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:04.467109 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:04.467109 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52ad379b-7eee-4356-99cc-969e3420f4b4 could not be found. Jul 20 04:49:04.467109 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.467109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-26e0397c-cb17-492d-a558-a4b49fa39e16 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance 52ad379b-7eee-4356-99cc-969e3420f4b4 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:04.467109 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-26e0397c-cb17-492d-a558-a4b49fa39e16 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "DELETE /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 404 len: 111 microversion: 2.1 time: 0.046531 Jul 20 04:49:04.467754 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2950/6133] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:04 2022] DELETE /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:04.475173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-81d86fcd-45f6-4b02-9d85-e5662a4fd169 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:04.475824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-81d86fcd-45f6-4b02-9d85-e5662a4fd169 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 52ad379b-7eee-4356-99cc-969e3420f4b4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:04.490321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81d86fcd-45f6-4b02-9d85-e5662a4fd169 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.490778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81d86fcd-45f6-4b02-9d85-e5662a4fd169 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.491631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81d86fcd-45f6-4b02-9d85-e5662a4fd169 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.492072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81d86fcd-45f6-4b02-9d85-e5662a4fd169 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.530144 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-81d86fcd-45f6-4b02-9d85-e5662a4fd169 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance 52ad379b-7eee-4356-99cc-969e3420f4b4 could not be found. Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-81d86fcd-45f6-4b02-9d85-e5662a4fd169 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 HTTP/1.1 Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 52ad379b-7eee-4356-99cc-969e3420f4b4 could not be found. Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '52ad379b-7eee-4356-99cc-969e3420f4b4'} Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52ad379b-7eee-4356-99cc-969e3420f4b4 could not be found. Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52ad379b-7eee-4356-99cc-969e3420f4b4 could not be found. Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.531739 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.535208 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.535208 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.535208 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:04.535208 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:04.535208 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52ad379b-7eee-4356-99cc-969e3420f4b4 could not be found. Jul 20 04:49:04.535208 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.535208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-81d86fcd-45f6-4b02-9d85-e5662a4fd169 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance 52ad379b-7eee-4356-99cc-969e3420f4b4 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:04.535208 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-81d86fcd-45f6-4b02-9d85-e5662a4fd169 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4" status: 404 len: 111 microversion: 2.1 time: 0.062141 Jul 20 04:49:04.542409 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f6d2742f-cd26-4654-9844-3c8b470e70e0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:04.542938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f6d2742f-cd26-4654-9844-3c8b470e70e0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:04.547456 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3184/6134] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:04 2022] GET /compute/v2.1/servers/52ad379b-7eee-4356-99cc-969e3420f4b4 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:04.552829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6d2742f-cd26-4654-9844-3c8b470e70e0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.553709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6d2742f-cd26-4654-9844-3c8b470e70e0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.554806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6d2742f-cd26-4654-9844-3c8b470e70e0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.555653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6d2742f-cd26-4654-9844-3c8b470e70e0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.578375 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-f6d2742f-cd26-4654-9844-3c8b470e70e0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance dfacab33-2416-4749-98f6-964d2033f472 could not be found. Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f6d2742f-cd26-4654-9844-3c8b470e70e0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 HTTP/1.1 Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance dfacab33-2416-4749-98f6-964d2033f472 could not be found. Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'dfacab33-2416-4749-98f6-964d2033f472'} Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfacab33-2416-4749-98f6-964d2033f472 could not be found. Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:04.581502 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfacab33-2416-4749-98f6-964d2033f472 could not be found. Jul 20 04:49:04.584969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.584969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.584969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.584969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.584969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.584969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.584969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:04.584969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:04.584969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfacab33-2416-4749-98f6-964d2033f472 could not be found. Jul 20 04:49:04.584969 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.587529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f6d2742f-cd26-4654-9844-3c8b470e70e0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance dfacab33-2416-4749-98f6-964d2033f472 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:04.588859 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f6d2742f-cd26-4654-9844-3c8b470e70e0 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 404 len: 111 microversion: 2.1 time: 0.050786 Jul 20 04:49:04.589988 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2951/6135] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:04 2022] DELETE /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:49:04.598167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7ea671bb-b573-474a-bd2d-4ab9ef36e136 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:04.598799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7ea671bb-b573-474a-bd2d-4ab9ef36e136 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dfacab33-2416-4749-98f6-964d2033f472] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:04.614339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ea671bb-b573-474a-bd2d-4ab9ef36e136 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.615105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ea671bb-b573-474a-bd2d-4ab9ef36e136 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.616092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ea671bb-b573-474a-bd2d-4ab9ef36e136 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.616795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ea671bb-b573-474a-bd2d-4ab9ef36e136 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.651101 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-7ea671bb-b573-474a-bd2d-4ab9ef36e136 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance dfacab33-2416-4749-98f6-964d2033f472 could not be found. Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7ea671bb-b573-474a-bd2d-4ab9ef36e136 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 HTTP/1.1 Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance dfacab33-2416-4749-98f6-964d2033f472 could not be found. Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'dfacab33-2416-4749-98f6-964d2033f472'} Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfacab33-2416-4749-98f6-964d2033f472 could not be found. Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfacab33-2416-4749-98f6-964d2033f472 could not be found. Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.656310 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.659827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.659827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.659827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:04.659827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:04.659827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfacab33-2416-4749-98f6-964d2033f472 could not be found. Jul 20 04:49:04.659827 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.665505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7ea671bb-b573-474a-bd2d-4ab9ef36e136 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance dfacab33-2416-4749-98f6-964d2033f472 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:04.666714 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7ea671bb-b573-474a-bd2d-4ab9ef36e136 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472" status: 404 len: 111 microversion: 2.1 time: 0.072914 Jul 20 04:49:04.670236 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3185/6136] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:04 2022] GET /compute/v2.1/servers/dfacab33-2416-4749-98f6-964d2033f472 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:04.679264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-92ae9458-af74-4862-89ec-64b942eeeefc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:04.680311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-92ae9458-af74-4862-89ec-64b942eeeefc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:04.690483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92ae9458-af74-4862-89ec-64b942eeeefc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.691050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92ae9458-af74-4862-89ec-64b942eeeefc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.695130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92ae9458-af74-4862-89ec-64b942eeeefc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.695734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-92ae9458-af74-4862-89ec-64b942eeeefc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.730932 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-92ae9458-af74-4862-89ec-64b942eeeefc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 could not be found. Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-92ae9458-af74-4862-89ec-64b942eeeefc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 HTTP/1.1 Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 could not be found. Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '2e6cac09-b07c-46af-a9a4-adfff5096e84'} Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 could not be found. Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:04.738261 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 could not be found. Jul 20 04:49:04.742675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.742675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.742675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.742675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.742675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.742675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.742675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:04.742675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:04.742675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 could not be found. Jul 20 04:49:04.742675 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.745298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-92ae9458-af74-4862-89ec-64b942eeeefc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:04.747235 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-92ae9458-af74-4862-89ec-64b942eeeefc tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 404 len: 111 microversion: 2.1 time: 0.072285 Jul 20 04:49:04.748044 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2952/6137] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:04 2022] DELETE /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:49:04.757061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9069495b-4d78-4ad8-9c1a-3711b24575f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:04.757715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9069495b-4d78-4ad8-9c1a-3711b24575f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 2e6cac09-b07c-46af-a9a4-adfff5096e84] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:04.771364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9069495b-4d78-4ad8-9c1a-3711b24575f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.771845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9069495b-4d78-4ad8-9c1a-3711b24575f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.772723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9069495b-4d78-4ad8-9c1a-3711b24575f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.773169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9069495b-4d78-4ad8-9c1a-3711b24575f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.814216 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-9069495b-4d78-4ad8-9c1a-3711b24575f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 could not be found. Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9069495b-4d78-4ad8-9c1a-3711b24575f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 HTTP/1.1 Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 could not be found. Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '2e6cac09-b07c-46af-a9a4-adfff5096e84'} Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 could not be found. Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 could not be found. Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.816143 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.820852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.820852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.820852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:04.820852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:04.820852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 could not be found. Jul 20 04:49:04.820852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.820852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9069495b-4d78-4ad8-9c1a-3711b24575f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance 2e6cac09-b07c-46af-a9a4-adfff5096e84 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:04.820852 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9069495b-4d78-4ad8-9c1a-3711b24575f1 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84" status: 404 len: 111 microversion: 2.1 time: 0.065120 Jul 20 04:49:04.820852 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3186/6138] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:04 2022] GET /compute/v2.1/servers/2e6cac09-b07c-46af-a9a4-adfff5096e84 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:04.845125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eb460473-f29e-4464-bbfa-13d4037bd905 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:04.846127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eb460473-f29e-4464-bbfa-13d4037bd905 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:04.854690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb460473-f29e-4464-bbfa-13d4037bd905 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.855515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb460473-f29e-4464-bbfa-13d4037bd905 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.856862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb460473-f29e-4464-bbfa-13d4037bd905 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.860525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb460473-f29e-4464-bbfa-13d4037bd905 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.896722 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-eb460473-f29e-4464-bbfa-13d4037bd905 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance 9f97abf1-25eb-4320-9fec-849f74260307 could not be found. Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eb460473-f29e-4464-bbfa-13d4037bd905 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 HTTP/1.1 Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 9f97abf1-25eb-4320-9fec-849f74260307 could not be found. Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '9f97abf1-25eb-4320-9fec-849f74260307'} Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f97abf1-25eb-4320-9fec-849f74260307 could not be found. Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:04.901690 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f97abf1-25eb-4320-9fec-849f74260307 could not be found. Jul 20 04:49:04.906148 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.906148 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.906148 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.906148 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.906148 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.906148 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.906148 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:04.906148 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:04.906148 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f97abf1-25eb-4320-9fec-849f74260307 could not be found. Jul 20 04:49:04.906148 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.912301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eb460473-f29e-4464-bbfa-13d4037bd905 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance 9f97abf1-25eb-4320-9fec-849f74260307 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:04.913676 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eb460473-f29e-4464-bbfa-13d4037bd905 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307" status: 404 len: 111 microversion: 2.1 time: 0.090227 Jul 20 04:49:04.915925 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2953/6139] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:04 2022] DELETE /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:04.926935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-05e9eb7b-19db-4264-936e-44f3f7ac706f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:04.927701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-05e9eb7b-19db-4264-936e-44f3f7ac706f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 9f97abf1-25eb-4320-9fec-849f74260307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:04.936730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-05e9eb7b-19db-4264-936e-44f3f7ac706f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.937323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-05e9eb7b-19db-4264-936e-44f3f7ac706f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.938114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-05e9eb7b-19db-4264-936e-44f3f7ac706f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.938547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-05e9eb7b-19db-4264-936e-44f3f7ac706f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.986381 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-05e9eb7b-19db-4264-936e-44f3f7ac706f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance 9f97abf1-25eb-4320-9fec-849f74260307 could not be found. Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-05e9eb7b-19db-4264-936e-44f3f7ac706f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 HTTP/1.1 Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 9f97abf1-25eb-4320-9fec-849f74260307 could not be found. Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '9f97abf1-25eb-4320-9fec-849f74260307'} Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f97abf1-25eb-4320-9fec-849f74260307 could not be found. Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f97abf1-25eb-4320-9fec-849f74260307 could not be found. Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.990065 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:04.993727 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:04.993727 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:04.993727 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:04.993727 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:04.993727 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f97abf1-25eb-4320-9fec-849f74260307 could not be found. Jul 20 04:49:04.993727 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:04.994586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-05e9eb7b-19db-4264-936e-44f3f7ac706f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance 9f97abf1-25eb-4320-9fec-849f74260307 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:04.995559 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-05e9eb7b-19db-4264-936e-44f3f7ac706f tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307" status: 404 len: 111 microversion: 2.1 time: 0.073651 Jul 20 04:49:04.996357 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3187/6140] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:04 2022] GET /compute/v2.1/servers/9f97abf1-25eb-4320-9fec-849f74260307 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:05.006316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-11186588-c4f5-4036-85c3-4fe9206cc8b8 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:05.007713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-11186588-c4f5-4036-85c3-4fe9206cc8b8 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:05.017092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11186588-c4f5-4036-85c3-4fe9206cc8b8 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:05.017924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11186588-c4f5-4036-85c3-4fe9206cc8b8 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:05.019138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11186588-c4f5-4036-85c3-4fe9206cc8b8 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:05.019871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11186588-c4f5-4036-85c3-4fe9206cc8b8 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:05.057232 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-11186588-c4f5-4036-85c3-4fe9206cc8b8 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 could not be found. Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-11186588-c4f5-4036-85c3-4fe9206cc8b8 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 HTTP/1.1 Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 could not be found. Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '3b80de7c-33fd-4d2b-a3c5-c73c607c5e43'} Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 could not be found. Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:05.064627 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 could not be found. Jul 20 04:49:05.068745 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.068745 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:05.068745 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.068745 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:05.068745 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:05.068745 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:05.068745 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:05.068745 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:05.068745 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 could not be found. Jul 20 04:49:05.068745 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.071858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-11186588-c4f5-4036-85c3-4fe9206cc8b8 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:05.074425 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-11186588-c4f5-4036-85c3-4fe9206cc8b8 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 404 len: 111 microversion: 2.1 time: 0.073067 Jul 20 04:49:05.075826 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2954/6141] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:04 2022] DELETE /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:05.089063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b520ba5a-2d42-48b8-b4c5-20c3e7e03dce tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:05.089063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b520ba5a-2d42-48b8-b4c5-20c3e7e03dce tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:05.097818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b520ba5a-2d42-48b8-b4c5-20c3e7e03dce tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:05.098526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b520ba5a-2d42-48b8-b4c5-20c3e7e03dce tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:05.099604 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b520ba5a-2d42-48b8-b4c5-20c3e7e03dce tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:05.100301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b520ba5a-2d42-48b8-b4c5-20c3e7e03dce tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:05.116567 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-b520ba5a-2d42-48b8-b4c5-20c3e7e03dce tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 could not be found. Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b520ba5a-2d42-48b8-b4c5-20c3e7e03dce tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 HTTP/1.1 Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 could not be found. Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '3b80de7c-33fd-4d2b-a3c5-c73c607c5e43'} Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 could not be found. Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 could not be found. Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.118161 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:05.121883 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:05.121883 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:05.121883 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:05.121883 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:05.121883 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 could not be found. Jul 20 04:49:05.121883 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.125534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b520ba5a-2d42-48b8-b4c5-20c3e7e03dce tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance 3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:05.127654 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b520ba5a-2d42-48b8-b4c5-20c3e7e03dce tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43" status: 404 len: 111 microversion: 2.1 time: 0.045725 Jul 20 04:49:05.131762 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3188/6142] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:05 2022] GET /compute/v2.1/servers/3b80de7c-33fd-4d2b-a3c5-c73c607c5e43 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:05.144566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-31beb963-8f61-4234-8dc9-40358b7a5adb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:05.145096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-31beb963-8f61-4234-8dc9-40358b7a5adb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: cf1c7826-cc0b-4418-9231-b00aa703b6d1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:05.166459 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-31beb963-8f61-4234-8dc9-40358b7a5adb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 could not be found. Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-31beb963-8f61-4234-8dc9-40358b7a5adb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/cf1c7826-cc0b-4418-9231-b00aa703b6d1 HTTP/1.1 Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 could not be found. Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'cf1c7826-cc0b-4418-9231-b00aa703b6d1'} Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 could not be found. Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 could not be found. Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:05.169197 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.173473 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:05.173473 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:05.173473 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:05.173473 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:05.173473 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:05.173473 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 could not be found. Jul 20 04:49:05.173473 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.175971 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-31beb963-8f61-4234-8dc9-40358b7a5adb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:05.177014 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-31beb963-8f61-4234-8dc9-40358b7a5adb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cf1c7826-cc0b-4418-9231-b00aa703b6d1" status: 404 len: 111 microversion: 2.1 time: 0.044241 Jul 20 04:49:05.184138 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2955/6143] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:05 2022] DELETE /compute/v2.1/servers/cf1c7826-cc0b-4418-9231-b00aa703b6d1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:49:05.188107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4fd6f802-2823-451b-8720-ff2f43a588d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:05.188805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4fd6f802-2823-451b-8720-ff2f43a588d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: cf1c7826-cc0b-4418-9231-b00aa703b6d1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:05.200405 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-4fd6f802-2823-451b-8720-ff2f43a588d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 could not be found. Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4fd6f802-2823-451b-8720-ff2f43a588d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/cf1c7826-cc0b-4418-9231-b00aa703b6d1 HTTP/1.1 Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 could not be found. Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'cf1c7826-cc0b-4418-9231-b00aa703b6d1'} Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 could not be found. Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 could not be found. Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:05.202003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:05.205623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:05.205623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:05.205623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 could not be found. Jul 20 04:49:05.205623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:05.205623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4fd6f802-2823-451b-8720-ff2f43a588d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance cf1c7826-cc0b-4418-9231-b00aa703b6d1 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:05.205623 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4fd6f802-2823-451b-8720-ff2f43a588d2 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/cf1c7826-cc0b-4418-9231-b00aa703b6d1" status: 404 len: 111 microversion: 2.1 time: 0.020733 Jul 20 04:49:05.207550 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3189/6144] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:05 2022] GET /compute/v2.1/servers/cf1c7826-cc0b-4418-9231-b00aa703b6d1 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:05.212324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a259f615-6472-435e-a8c3-69b0be7f278d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:05.212851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a259f615-6472-435e-a8c3-69b0be7f278d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:05.221608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a259f615-6472-435e-a8c3-69b0be7f278d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:05.222078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a259f615-6472-435e-a8c3-69b0be7f278d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:05.222877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a259f615-6472-435e-a8c3-69b0be7f278d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:05.230062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a259f615-6472-435e-a8c3-69b0be7f278d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:05.302687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a259f615-6472-435e-a8c3-69b0be7f278d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:49:05.372204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:05.385527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-609d0555-8c13-43ef-bf89-974e66893ede tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:05.386658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-609d0555-8c13-43ef-bf89-974e66893ede tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:05.404162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-609d0555-8c13-43ef-bf89-974e66893ede tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:05.404661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-609d0555-8c13-43ef-bf89-974e66893ede tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:05.405474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-609d0555-8c13-43ef-bf89-974e66893ede tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:05.405920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-609d0555-8c13-43ef-bf89-974e66893ede tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:05.459876 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a259f615-6472-435e-a8c3-69b0be7f278d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab" status: 204 len: 0 microversion: 2.1 time: 0.251164 Jul 20 04:49:05.461516 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2956/6145] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:05 2022] DELETE /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:49:05.475017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7eaec972-1ee8-4156-a9c3-868c12d5220d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:05.476945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7eaec972-1ee8-4156-a9c3-868c12d5220d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:05.493628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7eaec972-1ee8-4156-a9c3-868c12d5220d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:05.501687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7eaec972-1ee8-4156-a9c3-868c12d5220d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:05.503174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7eaec972-1ee8-4156-a9c3-868c12d5220d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:05.503901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7eaec972-1ee8-4156-a9c3-868c12d5220d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:05.893551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7eaec972-1ee8-4156-a9c3-868c12d5220d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:05.922525 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7eaec972-1ee8-4156-a9c3-868c12d5220d tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab" status: 200 len: 1480 microversion: 2.1 time: 0.454582 Jul 20 04:49:05.934967 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2957/6146] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:05 2022] GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab => generated 1480 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:05.936833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-609d0555-8c13-43ef-bf89-974e66893ede tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:05.940806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-9c2b83ad-db6a-4f60-b34f-3d65e40ab903 req-00945a9b-22ef-4c56-ad46-139d38bbefc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ece988e9-4b9b-4016-83bb-28eebecaff03", "tag": "b5fd2411-aea9-45dd-955e-5d3e83373de2"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:05.946877 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-609d0555-8c13-43ef-bf89-974e66893ede tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03" status: 200 len: 1364 microversion: 2.1 time: 0.565811 Jul 20 04:49:05.951272 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3190/6147] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:05 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 => generated 1364 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:05.972452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-9c2b83ad-db6a-4f60-b34f-3d65e40ab903 req-00945a9b-22ef-4c56-ad46-139d38bbefc2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:05.973248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-9c2b83ad-db6a-4f60-b34f-3d65e40ab903 req-00945a9b-22ef-4c56-ad46-139d38bbefc2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:05.986404 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-9c2b83ad-db6a-4f60-b34f-3d65e40ab903 req-00945a9b-22ef-4c56-ad46-139d38bbefc2 service nova] Creating event network-changed:b5fd2411-aea9-45dd-955e-5d3e83373de2 for instance ece988e9-4b9b-4016-83bb-28eebecaff03 on n-h2-826526-5 Jul 20 04:49:06.002901 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-9c2b83ad-db6a-4f60-b34f-3d65e40ab903 req-00945a9b-22ef-4c56-ad46-139d38bbefc2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065630 Jul 20 04:49:06.006735 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2958/6148] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:06.948943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-049ee428-3da0-476f-808b-94c1535e7d34 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:06.950363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-049ee428-3da0-476f-808b-94c1535e7d34 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:06.968742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-db1569b0-640c-4739-be8b-323f688665f4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:06.970898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-db1569b0-640c-4739-be8b-323f688665f4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:06.987814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-049ee428-3da0-476f-808b-94c1535e7d34 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:06.990476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-049ee428-3da0-476f-808b-94c1535e7d34 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:06.998011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-049ee428-3da0-476f-808b-94c1535e7d34 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:07.000620 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db1569b0-640c-4739-be8b-323f688665f4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:07.001704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db1569b0-640c-4739-be8b-323f688665f4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:07.002957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-049ee428-3da0-476f-808b-94c1535e7d34 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:07.007988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db1569b0-640c-4739-be8b-323f688665f4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:07.012820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db1569b0-640c-4739-be8b-323f688665f4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:07.430370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-db1569b0-640c-4739-be8b-323f688665f4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:07.448180 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-db1569b0-640c-4739-be8b-323f688665f4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03" status: 200 len: 1364 microversion: 2.1 time: 0.484582 Jul 20 04:49:07.451262 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2959/6149] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:06 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 => generated 1364 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:07.457944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-ceca1b9b-1ef6-429c-9947-b7419d19d030 req-4de439e0-2076-4c94-9eb4-681479ebec03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dae3d96c-7588-4c6e-b197-7190865618ab", "name": "network-vif-deleted", "tag": "7d93cd36-4317-44e6-a3cc-d2a5a9b8f2ae"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:07.474390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ceca1b9b-1ef6-429c-9947-b7419d19d030 req-4de439e0-2076-4c94-9eb4-681479ebec03 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:07.475158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ceca1b9b-1ef6-429c-9947-b7419d19d030 req-4de439e0-2076-4c94-9eb4-681479ebec03 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:07.503171 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-ceca1b9b-1ef6-429c-9947-b7419d19d030 req-4de439e0-2076-4c94-9eb4-681479ebec03 service nova] Creating event network-vif-deleted:7d93cd36-4317-44e6-a3cc-d2a5a9b8f2ae for instance dae3d96c-7588-4c6e-b197-7190865618ab on n-h1-826526-5 Jul 20 04:49:07.510025 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-ceca1b9b-1ef6-429c-9947-b7419d19d030 req-4de439e0-2076-4c94-9eb4-681479ebec03 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056911 Jul 20 04:49:07.511350 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2960/6150] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:07.537165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-049ee428-3da0-476f-808b-94c1535e7d34 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e17b2cb6654e4584b62ac8d08833f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc751c3978da4e05b6d7aab178723ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:07.551849 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-049ee428-3da0-476f-808b-94c1535e7d34 tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab" status: 200 len: 1480 microversion: 2.1 time: 0.613353 Jul 20 04:49:07.553121 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3191/6151] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:06 2022] GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab => generated 1480 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:08.466955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:08.472689 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9debe272-786c-4a53-80e8-190c0520b09c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:08.473761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9debe272-786c-4a53-80e8-190c0520b09c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:08.481386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9debe272-786c-4a53-80e8-190c0520b09c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:08.482240 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9debe272-786c-4a53-80e8-190c0520b09c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:08.482695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9debe272-786c-4a53-80e8-190c0520b09c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:08.483324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9debe272-786c-4a53-80e8-190c0520b09c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:08.572154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ae4ec98f-9f06-4d95-95b3-0dfe68b2cdeb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:08.573046 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ae4ec98f-9f06-4d95-95b3-0dfe68b2cdeb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] [instance: dae3d96c-7588-4c6e-b197-7190865618ab] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:08.585324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae4ec98f-9f06-4d95-95b3-0dfe68b2cdeb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:08.585791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae4ec98f-9f06-4d95-95b3-0dfe68b2cdeb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:08.586596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae4ec98f-9f06-4d95-95b3-0dfe68b2cdeb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:08.587043 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae4ec98f-9f06-4d95-95b3-0dfe68b2cdeb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:08.608314 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-ae4ec98f-9f06-4d95-95b3-0dfe68b2cdeb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] HTTP exception thrown: Instance dae3d96c-7588-4c6e-b197-7190865618ab could not be found. Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ae4ec98f-9f06-4d95-95b3-0dfe68b2cdeb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Request method failure captured: Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab HTTP/1.1 Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14h4u02vnRc9MSJwn_Y6fGhXe01u0rl6dAcJcdCDhDW6eZld8fUNzu1cjV-0bMWdshL9c8atxGrQm27ieTQKmBC_4svYPHDPEPVQFvqDzpaRZ01d4iJfllrhaPSwzNpHVnHMzBqZbssz8E9jSE0nbT1qSsXBq3TrivVg1LofLsYABJs Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fc751c3978da4e05b6d7aab178723ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fc751c3978da4e05b6d7aab178723ae5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fc751c3978da4e05b6d7aab178723ae5"}]}] Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersTestJSON-1687688617 Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: fc751c3978da4e05b6d7aab178723ae5 Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersTestJSON-1687688617 Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a5e17b2cb6654e4584b62ac8d08833f2 Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersTestJSON-1687688617-project Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance dae3d96c-7588-4c6e-b197-7190865618ab could not be found. Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'dae3d96c-7588-4c6e-b197-7190865618ab'} Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dae3d96c-7588-4c6e-b197-7190865618ab could not be found. Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dae3d96c-7588-4c6e-b197-7190865618ab could not be found. Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:08.610372 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:08.615076 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:08.615076 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:08.615076 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:08.615076 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:08.615076 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dae3d96c-7588-4c6e-b197-7190865618ab could not be found. Jul 20 04:49:08.615076 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:08.616485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ae4ec98f-9f06-4d95-95b3-0dfe68b2cdeb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] Returning 404 to user: Instance dae3d96c-7588-4c6e-b197-7190865618ab could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:08.617556 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ae4ec98f-9f06-4d95-95b3-0dfe68b2cdeb tempest-ServersTestJSON-1687688617 tempest-ServersTestJSON-1687688617-project] 10.222.0.17 "GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab" status: 404 len: 111 microversion: 2.1 time: 0.051743 Jul 20 04:49:08.618616 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3192/6152] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:08 2022] GET /compute/v2.1/servers/dae3d96c-7588-4c6e-b197-7190865618ab => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:08.777167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9debe272-786c-4a53-80e8-190c0520b09c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:08.789741 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9debe272-786c-4a53-80e8-190c0520b09c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03" status: 200 len: 1364 microversion: 2.1 time: 0.323598 Jul 20 04:49:08.790566 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2961/6153] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:08 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 => generated 1364 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:09.314382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-42204d15-d227-4223-b2e5-e9ee233e7977 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:09.315228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-42204d15-d227-4223-b2e5-e9ee233e7977 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:09.328727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42204d15-d227-4223-b2e5-e9ee233e7977 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:09.329971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42204d15-d227-4223-b2e5-e9ee233e7977 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:09.331535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42204d15-d227-4223-b2e5-e9ee233e7977 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:09.332694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42204d15-d227-4223-b2e5-e9ee233e7977 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:09.352650 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-42204d15-d227-4223-b2e5-e9ee233e7977 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-42204d15-d227-4223-b2e5-e9ee233e7977 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 HTTP/1.1 Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '52498332-97f4-4f2c-8f6a-5803b2c641b3'} Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:09.354325 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:09.358186 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:49:09.358186 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:09.358186 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:09.358186 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:09.358186 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:09.358186 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:09.358186 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:09.358186 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:09.358186 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:09.358186 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:49:09.358186 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:09.359714 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-42204d15-d227-4223-b2e5-e9ee233e7977 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:09.360730 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-42204d15-d227-4223-b2e5-e9ee233e7977 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "DELETE /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 404 len: 111 microversion: 2.1 time: 0.051126 Jul 20 04:49:09.361227 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3193/6154] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:09 2022] DELETE /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:09.372193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-834d3db4-e4e4-4c14-9a3f-e44674d30a49 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:09.372467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-834d3db4-e4e4-4c14-9a3f-e44674d30a49 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 52498332-97f4-4f2c-8f6a-5803b2c641b3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:09.381665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-834d3db4-e4e4-4c14-9a3f-e44674d30a49 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:09.382200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-834d3db4-e4e4-4c14-9a3f-e44674d30a49 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:09.383200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-834d3db4-e4e4-4c14-9a3f-e44674d30a49 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:09.383657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-834d3db4-e4e4-4c14-9a3f-e44674d30a49 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:09.400806 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-834d3db4-e4e4-4c14-9a3f-e44674d30a49 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-834d3db4-e4e4-4c14-9a3f-e44674d30a49 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 HTTP/1.1 Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '52498332-97f4-4f2c-8f6a-5803b2c641b3'} Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:09.402515 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:09.409865 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:09.409865 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:09.409865 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:09.409865 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:09.409865 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:09.409865 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. Jul 20 04:49:09.409865 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:49:09.409865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-834d3db4-e4e4-4c14-9a3f-e44674d30a49 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance 52498332-97f4-4f2c-8f6a-5803b2c641b3 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:09.409865 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-834d3db4-e4e4-4c14-9a3f-e44674d30a49 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3" status: 404 len: 111 microversion: 2.1 time: 0.038389 Jul 20 04:49:09.409865 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2962/6155] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:09 2022] GET /compute/v2.1/servers/52498332-97f4-4f2c-8f6a-5803b2c641b3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:09.413493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bbcb8cbd-85d1-42a9-8096-eaf8118cef73 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:09.414015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bbcb8cbd-85d1-42a9-8096-eaf8118cef73 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:09.429370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bbcb8cbd-85d1-42a9-8096-eaf8118cef73 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:09.429824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bbcb8cbd-85d1-42a9-8096-eaf8118cef73 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:09.430619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bbcb8cbd-85d1-42a9-8096-eaf8118cef73 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:09.431105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bbcb8cbd-85d1-42a9-8096-eaf8118cef73 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:09.434169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:09.462223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bbcb8cbd-85d1-42a9-8096-eaf8118cef73 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:49:09.585210 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bbcb8cbd-85d1-42a9-8096-eaf8118cef73 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 204 len: 0 microversion: 2.1 time: 0.174428 Jul 20 04:49:09.590156 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3194/6156] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:09 2022] DELETE /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:49:09.597723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-74092709-2f20-4a83-86ec-eb3cf83e8db2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:09.599073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-74092709-2f20-4a83-86ec-eb3cf83e8db2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:09.609414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74092709-2f20-4a83-86ec-eb3cf83e8db2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:09.610263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74092709-2f20-4a83-86ec-eb3cf83e8db2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:09.612426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74092709-2f20-4a83-86ec-eb3cf83e8db2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:09.614289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74092709-2f20-4a83-86ec-eb3cf83e8db2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:09.808740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-30030cff-2347-4769-a56f-a10ceb9ea24a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:09.810343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-30030cff-2347-4769-a56f-a10ceb9ea24a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:09.833197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30030cff-2347-4769-a56f-a10ceb9ea24a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:09.833968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30030cff-2347-4769-a56f-a10ceb9ea24a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:09.835071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30030cff-2347-4769-a56f-a10ceb9ea24a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:09.836209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30030cff-2347-4769-a56f-a10ceb9ea24a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:09.870704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-74092709-2f20-4a83-86ec-eb3cf83e8db2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:09.885832 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-74092709-2f20-4a83-86ec-eb3cf83e8db2 tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1511 microversion: 2.1 time: 0.293714 Jul 20 04:49:09.904538 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2963/6157] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:09 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1511 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:10.163793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-30030cff-2347-4769-a56f-a10ceb9ea24a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:10.202600 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-30030cff-2347-4769-a56f-a10ceb9ea24a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03" status: 200 len: 1364 microversion: 2.1 time: 0.398765 Jul 20 04:49:10.206696 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3195/6158] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:09 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 => generated 1364 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:10.911330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e7b7eb19-e2e5-418d-8cee-e1f3e52a516b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:10.912830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e7b7eb19-e2e5-418d-8cee-e1f3e52a516b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:10.921926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7b7eb19-e2e5-418d-8cee-e1f3e52a516b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:10.922864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7b7eb19-e2e5-418d-8cee-e1f3e52a516b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:10.924498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7b7eb19-e2e5-418d-8cee-e1f3e52a516b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:10.925164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7b7eb19-e2e5-418d-8cee-e1f3e52a516b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:11.162681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e7b7eb19-e2e5-418d-8cee-e1f3e52a516b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:11.199218 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e7b7eb19-e2e5-418d-8cee-e1f3e52a516b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1511 microversion: 2.1 time: 0.290981 Jul 20 04:49:11.199862 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2964/6159] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:10 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1511 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:11.224871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-706e3831-7ca3-4d28-a7e6-1f0f9cc4f98a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:11.225752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-706e3831-7ca3-4d28-a7e6-1f0f9cc4f98a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:11.240790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-706e3831-7ca3-4d28-a7e6-1f0f9cc4f98a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:11.241594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-706e3831-7ca3-4d28-a7e6-1f0f9cc4f98a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:11.242690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-706e3831-7ca3-4d28-a7e6-1f0f9cc4f98a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:11.243291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-706e3831-7ca3-4d28-a7e6-1f0f9cc4f98a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:11.517501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:11.704583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=8 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:11.918411 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f5e27a1d-bdd2-4623-9616-b8422b7b942f req-beea7a1d-d2e4-4cd5-8791-6d77ff6a3ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece988e9-4b9b-4016-83bb-28eebecaff03", "name": "network-vif-plugged", "status": "completed", "tag": "b5fd2411-aea9-45dd-955e-5d3e83373de2"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:11.934578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f5e27a1d-bdd2-4623-9616-b8422b7b942f req-beea7a1d-d2e4-4cd5-8791-6d77ff6a3ab5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:11.935396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f5e27a1d-bdd2-4623-9616-b8422b7b942f req-beea7a1d-d2e4-4cd5-8791-6d77ff6a3ab5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:11.975393 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f5e27a1d-bdd2-4623-9616-b8422b7b942f req-beea7a1d-d2e4-4cd5-8791-6d77ff6a3ab5 service nova] Creating event network-vif-plugged:b5fd2411-aea9-45dd-955e-5d3e83373de2 for instance ece988e9-4b9b-4016-83bb-28eebecaff03 on n-h2-826526-5 Jul 20 04:49:11.991578 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f5e27a1d-bdd2-4623-9616-b8422b7b942f req-beea7a1d-d2e4-4cd5-8791-6d77ff6a3ab5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077056 Jul 20 04:49:11.992765 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2965/6160] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:49:12.042484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-706e3831-7ca3-4d28-a7e6-1f0f9cc4f98a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:12.054647 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-706e3831-7ca3-4d28-a7e6-1f0f9cc4f98a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03" status: 200 len: 1364 microversion: 2.1 time: 0.834702 Jul 20 04:49:12.068349 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3196/6161] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:11 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 => generated 1364 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:12.226858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aecf93c9-3b74-4d4c-8212-d06f1cedee9b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:12.227964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aecf93c9-3b74-4d4c-8212-d06f1cedee9b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:12.240872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aecf93c9-3b74-4d4c-8212-d06f1cedee9b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:12.241792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aecf93c9-3b74-4d4c-8212-d06f1cedee9b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:12.243083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aecf93c9-3b74-4d4c-8212-d06f1cedee9b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:12.243772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aecf93c9-3b74-4d4c-8212-d06f1cedee9b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:12.540528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aecf93c9-3b74-4d4c-8212-d06f1cedee9b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6f3db734dc4e0197653b83e0eb746a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3cfeac44614a9888245f21ca0f3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:12.551215 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aecf93c9-3b74-4d4c-8212-d06f1cedee9b tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 200 len: 1511 microversion: 2.1 time: 0.329603 Jul 20 04:49:12.553426 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2966/6162] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:12 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 1511 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:12.842566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e6d6051d-cefa-46a8-ac83-9235ca9798d0 req-b57d7a9a-e271-4dea-97f3-f201eb1e9018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d530bf9-a3da-4006-9120-3bc00e8266e3", "name": "network-vif-deleted", "tag": "7d6173a0-c778-42ab-8c13-3f45b04a097d"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:12.868195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e6d6051d-cefa-46a8-ac83-9235ca9798d0 req-b57d7a9a-e271-4dea-97f3-f201eb1e9018 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:12.868693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e6d6051d-cefa-46a8-ac83-9235ca9798d0 req-b57d7a9a-e271-4dea-97f3-f201eb1e9018 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:12.896896 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e6d6051d-cefa-46a8-ac83-9235ca9798d0 req-b57d7a9a-e271-4dea-97f3-f201eb1e9018 service nova] Creating event network-vif-deleted:7d6173a0-c778-42ab-8c13-3f45b04a097d for instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 on n-h2-826526-5 Jul 20 04:49:12.911101 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e6d6051d-cefa-46a8-ac83-9235ca9798d0 req-b57d7a9a-e271-4dea-97f3-f201eb1e9018 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073896 Jul 20 04:49:12.917594 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3197/6163] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:13.073479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7c8a44f8-4d48-414c-bf74-2bf8c821fc83 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:13.074187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7c8a44f8-4d48-414c-bf74-2bf8c821fc83 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:13.086336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c8a44f8-4d48-414c-bf74-2bf8c821fc83 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:13.086817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c8a44f8-4d48-414c-bf74-2bf8c821fc83 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:13.087638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c8a44f8-4d48-414c-bf74-2bf8c821fc83 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:13.090954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c8a44f8-4d48-414c-bf74-2bf8c821fc83 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:13.463276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7c8a44f8-4d48-414c-bf74-2bf8c821fc83 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:13.476339 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7c8a44f8-4d48-414c-bf74-2bf8c821fc83 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03" status: 200 len: 1364 microversion: 2.1 time: 0.404076 Jul 20 04:49:13.487493 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2967/6164] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:13 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 => generated 1364 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:13.580980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c852963a-c575-40ea-a222-9200c061893c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:13.582497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c852963a-c575-40ea-a222-9200c061893c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] [instance: 1d530bf9-a3da-4006-9120-3bc00e8266e3] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:13.599183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c852963a-c575-40ea-a222-9200c061893c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:13.601689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c852963a-c575-40ea-a222-9200c061893c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:13.603825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c852963a-c575-40ea-a222-9200c061893c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:13.605098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c852963a-c575-40ea-a222-9200c061893c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:13.670842 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-c852963a-c575-40ea-a222-9200c061893c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] HTTP exception thrown: Instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 could not be found. Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c852963a-c575-40ea-a222-9200c061893c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Request method failure captured: Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 HTTP/1.1 Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14iRrOX2-1WvLX__iXz43KoySz6PPXPKxueERmsxAnYYbfqTiB8eql6A37kE8qc8HGs2PZvcX2-74_VAJPjt3CV0B0Ue6xxTJTYPUWVLPRxcfnQItsq2VhYKo_ZlG9CIuE3kqge_wKv93NqquOrQFZpQeza8ytiy251BA9h28qExxMM Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c3cfeac44614a9888245f21ca0f3811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c3cfeac44614a9888245f21ca0f3811", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c3cfeac44614a9888245f21ca0f3811"}]}] Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4c3cfeac44614a9888245f21ca0f3811 Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1813154923 Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: dd6f3db734dc4e0197653b83e0eb746a Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1813154923-project Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 could not be found. Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '1d530bf9-a3da-4006-9120-3bc00e8266e3'} Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 could not be found. Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 could not be found. Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:13.675504 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:13.680120 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:13.680120 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:13.680120 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:13.680120 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:13.680120 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:13.680120 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 could not be found. Jul 20 04:49:13.680120 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:13.680120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c852963a-c575-40ea-a222-9200c061893c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] Returning 404 to user: Instance 1d530bf9-a3da-4006-9120-3bc00e8266e3 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:13.680120 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c852963a-c575-40ea-a222-9200c061893c tempest-ServersNegativeTestJSON-1813154923 tempest-ServersNegativeTestJSON-1813154923-project] 10.222.0.17 "GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3" status: 404 len: 111 microversion: 2.1 time: 0.109867 Jul 20 04:49:13.680120 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3198/6165] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:13 2022] GET /compute/v2.1/servers/1d530bf9-a3da-4006-9120-3bc00e8266e3 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:14.523547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8359b112-2b10-47b5-89fa-5d11b5dc94fb tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:14.538066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8359b112-2b10-47b5-89fa-5d11b5dc94fb tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:14.558204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8359b112-2b10-47b5-89fa-5d11b5dc94fb tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:14.558692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8359b112-2b10-47b5-89fa-5d11b5dc94fb tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:14.559936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8359b112-2b10-47b5-89fa-5d11b5dc94fb tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:14.560503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8359b112-2b10-47b5-89fa-5d11b5dc94fb tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:14.875802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8359b112-2b10-47b5-89fa-5d11b5dc94fb tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:14.889496 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8359b112-2b10-47b5-89fa-5d11b5dc94fb tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03" status: 200 len: 1547 microversion: 2.1 time: 0.395998 Jul 20 04:49:14.892597 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2968/6166] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:14 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 => generated 1547 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:14.917385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f99107f6-9bdb-4c2e-a9a7-2a86fd97f2db tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:14.920815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f99107f6-9bdb-4c2e-a9a7-2a86fd97f2db tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:14.937158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f99107f6-9bdb-4c2e-a9a7-2a86fd97f2db tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:14.937834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f99107f6-9bdb-4c2e-a9a7-2a86fd97f2db tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:14.938873 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f99107f6-9bdb-4c2e-a9a7-2a86fd97f2db tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:14.940023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f99107f6-9bdb-4c2e-a9a7-2a86fd97f2db tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:15.083701 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f99107f6-9bdb-4c2e-a9a7-2a86fd97f2db tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.177989 Jul 20 04:49:15.084893 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3199/6167] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:49:14 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:16.378990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eb3b50a5-870a-496c-b892-c4bdc7cc0f0e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:16.380769 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eb3b50a5-870a-496c-b892-c4bdc7cc0f0e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:16.392234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb3b50a5-870a-496c-b892-c4bdc7cc0f0e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:16.403358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb3b50a5-870a-496c-b892-c4bdc7cc0f0e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:16.404579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb3b50a5-870a-496c-b892-c4bdc7cc0f0e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:16.405298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb3b50a5-870a-496c-b892-c4bdc7cc0f0e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:16.497928 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eb3b50a5-870a-496c-b892-c4bdc7cc0f0e tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6/action" status: 200 len: 24570 microversion: 2.1 time: 0.124333 Jul 20 04:49:16.508297 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2969/6168] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:49:16 2022] POST /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6/action => generated 24570 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:49:18.211361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-4470580e-c620-4521-9182-5d835ece451c req-83334696-aa87-438d-ac21-ba6179432e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ece988e9-4b9b-4016-83bb-28eebecaff03", "tag": "b5fd2411-aea9-45dd-955e-5d3e83373de2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:18.234367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4470580e-c620-4521-9182-5d835ece451c req-83334696-aa87-438d-ac21-ba6179432e50 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:18.234367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4470580e-c620-4521-9182-5d835ece451c req-83334696-aa87-438d-ac21-ba6179432e50 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:18.272211 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-4470580e-c620-4521-9182-5d835ece451c req-83334696-aa87-438d-ac21-ba6179432e50 service nova] Creating event network-changed:b5fd2411-aea9-45dd-955e-5d3e83373de2 for instance ece988e9-4b9b-4016-83bb-28eebecaff03 on n-h2-826526-5 Jul 20 04:49:18.291490 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-4470580e-c620-4521-9182-5d835ece451c req-83334696-aa87-438d-ac21-ba6179432e50 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085901 Jul 20 04:49:18.292126 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3200/6169] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:27.404197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:27.406004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=64,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:27.414511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-412c5be4-1738-416e-afab-5b01268317c7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:27.416829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-412c5be4-1738-416e-afab-5b01268317c7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:27.427129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-412c5be4-1738-416e-afab-5b01268317c7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:27.427956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-412c5be4-1738-416e-afab-5b01268317c7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:27.429137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-412c5be4-1738-416e-afab-5b01268317c7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:27.429779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-412c5be4-1738-416e-afab-5b01268317c7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:27.610285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-412c5be4-1738-416e-afab-5b01268317c7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:49:27.611389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-412c5be4-1738-416e-afab-5b01268317c7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:49:27.612001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-412c5be4-1738-416e-afab-5b01268317c7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:49:27.612692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-412c5be4-1738-416e-afab-5b01268317c7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:49:27.613519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-412c5be4-1738-416e-afab-5b01268317c7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:49:27.761354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-412c5be4-1738-416e-afab-5b01268317c7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:27.768407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-412c5be4-1738-416e-afab-5b01268317c7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:27.769230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-412c5be4-1738-416e-afab-5b01268317c7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:27.770218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-412c5be4-1738-416e-afab-5b01268317c7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:27.770914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-412c5be4-1738-416e-afab-5b01268317c7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:27.815744 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-412c5be4-1738-416e-afab-5b01268317c7 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6/action" status: 202 len: 1136 microversion: 2.1 time: 0.414421 Jul 20 04:49:27.816851 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2970/6170] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:49:27 2022] POST /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6/action => generated 1136 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 20 04:49:27.834700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-130bb9d8-f277-4308-ace3-b3b04db9ddf6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:27.835634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-130bb9d8-f277-4308-ace3-b3b04db9ddf6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:27.847471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-130bb9d8-f277-4308-ace3-b3b04db9ddf6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:27.848596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-130bb9d8-f277-4308-ace3-b3b04db9ddf6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:27.850274 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-130bb9d8-f277-4308-ace3-b3b04db9ddf6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:27.851274 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-130bb9d8-f277-4308-ace3-b3b04db9ddf6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:28.091197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-130bb9d8-f277-4308-ace3-b3b04db9ddf6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:28.101103 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-130bb9d8-f277-4308-ace3-b3b04db9ddf6 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1691 microversion: 2.1 time: 0.272527 Jul 20 04:49:28.112968 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3201/6171] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:27 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1691 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:29.130256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ae97f289-8c3d-41be-93b3-8aee4e693dc8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:29.131811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ae97f289-8c3d-41be-93b3-8aee4e693dc8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:29.154198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae97f289-8c3d-41be-93b3-8aee4e693dc8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:29.155216 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae97f289-8c3d-41be-93b3-8aee4e693dc8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:29.157634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae97f289-8c3d-41be-93b3-8aee4e693dc8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:29.158360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae97f289-8c3d-41be-93b3-8aee4e693dc8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:29.519268 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ae97f289-8c3d-41be-93b3-8aee4e693dc8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:29.549191 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ae97f289-8c3d-41be-93b3-8aee4e693dc8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1691 microversion: 2.1 time: 0.431439 Jul 20 04:49:29.552144 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2971/6172] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:29 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1691 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:30.603030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-23630f3a-fc36-4c0c-9265-fc24e2cde3f8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:30.603943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-23630f3a-fc36-4c0c-9265-fc24e2cde3f8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:30.633555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-23630f3a-fc36-4c0c-9265-fc24e2cde3f8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:30.634059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-23630f3a-fc36-4c0c-9265-fc24e2cde3f8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:30.635288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-23630f3a-fc36-4c0c-9265-fc24e2cde3f8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:30.635963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-23630f3a-fc36-4c0c-9265-fc24e2cde3f8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:30.879256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-23630f3a-fc36-4c0c-9265-fc24e2cde3f8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:30.892510 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-23630f3a-fc36-4c0c-9265-fc24e2cde3f8 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1691 microversion: 2.1 time: 0.325699 Jul 20 04:49:30.915433 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3202/6173] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:30 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1691 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:31.919137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f12f70e5-2d2d-4263-97cb-bd1076ee99d1 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:31.920495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f12f70e5-2d2d-4263-97cb-bd1076ee99d1 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:31.928489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f12f70e5-2d2d-4263-97cb-bd1076ee99d1 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:31.929656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f12f70e5-2d2d-4263-97cb-bd1076ee99d1 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:31.931212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f12f70e5-2d2d-4263-97cb-bd1076ee99d1 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:31.931896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f12f70e5-2d2d-4263-97cb-bd1076ee99d1 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:32.246546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f12f70e5-2d2d-4263-97cb-bd1076ee99d1 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:32.270013 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f12f70e5-2d2d-4263-97cb-bd1076ee99d1 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1691 microversion: 2.1 time: 0.354691 Jul 20 04:49:32.271141 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2972/6174] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:31 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1691 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:33.287358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-17a3288a-49ce-4141-bfb0-28bd3a810cbe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:33.287964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-17a3288a-49ce-4141-bfb0-28bd3a810cbe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:33.301786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17a3288a-49ce-4141-bfb0-28bd3a810cbe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:33.304749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17a3288a-49ce-4141-bfb0-28bd3a810cbe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:33.305586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17a3288a-49ce-4141-bfb0-28bd3a810cbe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:33.314047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17a3288a-49ce-4141-bfb0-28bd3a810cbe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:33.639442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-17a3288a-49ce-4141-bfb0-28bd3a810cbe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:33.655330 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-17a3288a-49ce-4141-bfb0-28bd3a810cbe tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1691 microversion: 2.1 time: 0.369061 Jul 20 04:49:33.657371 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3203/6175] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:33 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1691 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:34.674989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d1cfe481-ca28-46de-9a30-94bd95734c42 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:34.675608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d1cfe481-ca28-46de-9a30-94bd95734c42 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:34.691899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1cfe481-ca28-46de-9a30-94bd95734c42 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:34.694648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1cfe481-ca28-46de-9a30-94bd95734c42 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:34.697282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1cfe481-ca28-46de-9a30-94bd95734c42 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:34.697891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1cfe481-ca28-46de-9a30-94bd95734c42 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:36.145096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d1cfe481-ca28-46de-9a30-94bd95734c42 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:36.171935 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d1cfe481-ca28-46de-9a30-94bd95734c42 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1691 microversion: 2.1 time: 1.499154 Jul 20 04:49:36.174580 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2973/6176] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:34 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1691 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:37.192161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7fed0e8b-e6ba-46b2-ba6e-50fd4f92bd97 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:37.192941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7fed0e8b-e6ba-46b2-ba6e-50fd4f92bd97 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:37.207840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:37.216006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fed0e8b-e6ba-46b2-ba6e-50fd4f92bd97 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:37.216592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fed0e8b-e6ba-46b2-ba6e-50fd4f92bd97 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:37.218061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fed0e8b-e6ba-46b2-ba6e-50fd4f92bd97 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:37.218515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7fed0e8b-e6ba-46b2-ba6e-50fd4f92bd97 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:37.654780 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7fed0e8b-e6ba-46b2-ba6e-50fd4f92bd97 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:37.681071 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7fed0e8b-e6ba-46b2-ba6e-50fd4f92bd97 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1691 microversion: 2.1 time: 0.489672 Jul 20 04:49:37.696434 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3204/6177] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:37 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1691 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:38.705329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d798250f-43b7-4c66-b98b-73f555ea12db tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:38.706550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d798250f-43b7-4c66-b98b-73f555ea12db tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:38.729328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d798250f-43b7-4c66-b98b-73f555ea12db tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:38.730048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d798250f-43b7-4c66-b98b-73f555ea12db tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:38.731151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d798250f-43b7-4c66-b98b-73f555ea12db tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:38.736437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d798250f-43b7-4c66-b98b-73f555ea12db tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:39.375637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d798250f-43b7-4c66-b98b-73f555ea12db tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:39.405018 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d798250f-43b7-4c66-b98b-73f555ea12db tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1691 microversion: 2.1 time: 0.704055 Jul 20 04:49:39.406378 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2974/6178] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:38 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1691 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:40.435429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-186f0823-c654-4420-b100-1f503e3c4487 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:40.442474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-186f0823-c654-4420-b100-1f503e3c4487 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:40.469030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-186f0823-c654-4420-b100-1f503e3c4487 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:40.469784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-186f0823-c654-4420-b100-1f503e3c4487 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:40.470756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-186f0823-c654-4420-b100-1f503e3c4487 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:40.471355 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-186f0823-c654-4420-b100-1f503e3c4487 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:40.484035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:40.990714 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-186f0823-c654-4420-b100-1f503e3c4487 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:40.999130 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-186f0823-c654-4420-b100-1f503e3c4487 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1691 microversion: 2.1 time: 0.569954 Jul 20 04:49:41.000060 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3205/6179] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:40 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1691 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:41.796175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d2621af1-35c5-492c-a983-61f58e06c624 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-6242477", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "6cbffc97-009b-4e95-b4db-d0ad048f2a3b"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:41.866059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-d2621af1-35c5-492c-a983-61f58e06c624 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] validate_networks() for [('6cbffc97-009b-4e95-b4db-d0ad048f2a3b', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:49:42.018839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-45506fd3-13e8-482e-8c3e-77d6537b48f2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:42.019885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-45506fd3-13e8-482e-8c3e-77d6537b48f2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:42.037706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-45506fd3-13e8-482e-8c3e-77d6537b48f2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:42.040329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-45506fd3-13e8-482e-8c3e-77d6537b48f2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:42.041620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-45506fd3-13e8-482e-8c3e-77d6537b48f2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:42.044763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-45506fd3-13e8-482e-8c3e-77d6537b48f2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:42.353483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-45506fd3-13e8-482e-8c3e-77d6537b48f2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:42.381224 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-45506fd3-13e8-482e-8c3e-77d6537b48f2 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1691 microversion: 2.1 time: 0.367859 Jul 20 04:49:42.382343 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3206/6180] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:42 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1691 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:42.753667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-d2621af1-35c5-492c-a983-61f58e06c624 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:49:42.754115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-d2621af1-35c5-492c-a983-61f58e06c624 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:49:42.754614 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-d2621af1-35c5-492c-a983-61f58e06c624 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:49:42.755044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-d2621af1-35c5-492c-a983-61f58e06c624 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:49:42.755891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-d2621af1-35c5-492c-a983-61f58e06c624 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:49:42.766398 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2621af1-35c5-492c-a983-61f58e06c624 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:42.767016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2621af1-35c5-492c-a983-61f58e06c624 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:42.767846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2621af1-35c5-492c-a983-61f58e06c624 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:42.768326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2621af1-35c5-492c-a983-61f58e06c624 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:42.788799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-d2621af1-35c5-492c-a983-61f58e06c624 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Getting quotas for project 1411a9f117b74cdbab42aa6767cc6296. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:49:42.795984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-d2621af1-35c5-492c-a983-61f58e06c624 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Getting quotas for user 9fe38c50ae5b4d2cbec2ee25198771ce and project 1411a9f117b74cdbab42aa6767cc6296. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:49:42.811188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d2621af1-35c5-492c-a983-61f58e06c624 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:49:42.813559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d2621af1-35c5-492c-a983-61f58e06c624 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:49:42.887147 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d2621af1-35c5-492c-a983-61f58e06c624 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.321285 Jul 20 04:49:42.887945 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2975/6181] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:49:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:49:42.904805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e95249d3-8fe0-4fe7-b989-a679e7158688 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:42.909991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e95249d3-8fe0-4fe7-b989-a679e7158688 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:42.995269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e95249d3-8fe0-4fe7-b989-a679e7158688 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe38c50ae5b4d2cbec2ee25198771ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1411a9f117b74cdbab42aa6767cc6296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:43.004804 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e95249d3-8fe0-4fe7-b989-a679e7158688 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 200 len: 1225 microversion: 2.1 time: 0.108820 Jul 20 04:49:43.005953 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3207/6182] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:42 2022] GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:43.422958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6711e166-6f30-4110-9794-b33fa97f1b47 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:43.424293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6711e166-6f30-4110-9794-b33fa97f1b47 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:43.439108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6711e166-6f30-4110-9794-b33fa97f1b47 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:43.439619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6711e166-6f30-4110-9794-b33fa97f1b47 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:43.440476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6711e166-6f30-4110-9794-b33fa97f1b47 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:43.440938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6711e166-6f30-4110-9794-b33fa97f1b47 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:43.766404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6711e166-6f30-4110-9794-b33fa97f1b47 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:43.784748 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6711e166-6f30-4110-9794-b33fa97f1b47 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1691 microversion: 2.1 time: 0.371444 Jul 20 04:49:43.797618 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2976/6183] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:43 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1691 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:44.024473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0f50db5c-bc94-4148-89af-288bc0a63aba tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:44.029165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0f50db5c-bc94-4148-89af-288bc0a63aba tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:44.042624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f50db5c-bc94-4148-89af-288bc0a63aba tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:44.045048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f50db5c-bc94-4148-89af-288bc0a63aba tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:44.046944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f50db5c-bc94-4148-89af-288bc0a63aba tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:44.052061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f50db5c-bc94-4148-89af-288bc0a63aba tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:44.197808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0f50db5c-bc94-4148-89af-288bc0a63aba tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe38c50ae5b4d2cbec2ee25198771ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1411a9f117b74cdbab42aa6767cc6296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:44.230528 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0f50db5c-bc94-4148-89af-288bc0a63aba tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 200 len: 1277 microversion: 2.1 time: 0.211687 Jul 20 04:49:44.252744 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3208/6184] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:44 2022] GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 1277 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:44.820148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a99d9ba2-b926-481b-a5b0-71d52db6772b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:44.820944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a99d9ba2-b926-481b-a5b0-71d52db6772b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:44.829117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a99d9ba2-b926-481b-a5b0-71d52db6772b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:44.829878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a99d9ba2-b926-481b-a5b0-71d52db6772b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:44.835279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a99d9ba2-b926-481b-a5b0-71d52db6772b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:44.836020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a99d9ba2-b926-481b-a5b0-71d52db6772b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:45.260159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4496bb8c-7a47-41e0-8fef-b2d8ca10e1d7 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:45.261480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4496bb8c-7a47-41e0-8fef-b2d8ca10e1d7 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:45.271732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4496bb8c-7a47-41e0-8fef-b2d8ca10e1d7 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:45.272185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4496bb8c-7a47-41e0-8fef-b2d8ca10e1d7 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:45.273175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4496bb8c-7a47-41e0-8fef-b2d8ca10e1d7 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:45.273809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4496bb8c-7a47-41e0-8fef-b2d8ca10e1d7 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:45.372444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a99d9ba2-b926-481b-a5b0-71d52db6772b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:45.412638 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a99d9ba2-b926-481b-a5b0-71d52db6772b tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1709 microversion: 2.1 time: 0.596951 Jul 20 04:49:45.416255 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2977/6185] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:44 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1709 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:45.451054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4496bb8c-7a47-41e0-8fef-b2d8ca10e1d7 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe38c50ae5b4d2cbec2ee25198771ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1411a9f117b74cdbab42aa6767cc6296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:45.461909 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4496bb8c-7a47-41e0-8fef-b2d8ca10e1d7 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 200 len: 1283 microversion: 2.1 time: 0.206621 Jul 20 04:49:45.462853 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3209/6186] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:45 2022] GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 1283 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:46.432742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-48fdd325-97b1-4bee-ac43-a2795a3921da tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:46.433389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-48fdd325-97b1-4bee-ac43-a2795a3921da tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:46.451944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48fdd325-97b1-4bee-ac43-a2795a3921da tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:46.451944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48fdd325-97b1-4bee-ac43-a2795a3921da tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:46.452355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48fdd325-97b1-4bee-ac43-a2795a3921da tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:46.465366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48fdd325-97b1-4bee-ac43-a2795a3921da tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:46.479525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-60319477-a6f1-4a83-ade2-2ea0141e7b0e tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:46.480153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-60319477-a6f1-4a83-ade2-2ea0141e7b0e tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:46.492949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60319477-a6f1-4a83-ade2-2ea0141e7b0e tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:46.505053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60319477-a6f1-4a83-ade2-2ea0141e7b0e tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:46.506216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60319477-a6f1-4a83-ade2-2ea0141e7b0e tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:46.506822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-60319477-a6f1-4a83-ade2-2ea0141e7b0e tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:46.819543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-60319477-a6f1-4a83-ade2-2ea0141e7b0e tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe38c50ae5b4d2cbec2ee25198771ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1411a9f117b74cdbab42aa6767cc6296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:46.834433 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-60319477-a6f1-4a83-ade2-2ea0141e7b0e tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 200 len: 1325 microversion: 2.1 time: 0.358935 Jul 20 04:49:46.835782 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3210/6187] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:46 2022] GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 1325 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:46.960236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-48fdd325-97b1-4bee-ac43-a2795a3921da tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:46.977614 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-48fdd325-97b1-4bee-ac43-a2795a3921da tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1697 microversion: 2.1 time: 0.548709 Jul 20 04:49:46.978247 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2978/6188] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:46 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1697 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:47.852193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5878d895-fd3c-432d-9c9b-2f046191acbf tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:47.853432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5878d895-fd3c-432d-9c9b-2f046191acbf tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:47.873584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5878d895-fd3c-432d-9c9b-2f046191acbf tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:47.875045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5878d895-fd3c-432d-9c9b-2f046191acbf tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:47.879398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5878d895-fd3c-432d-9c9b-2f046191acbf tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:47.880167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5878d895-fd3c-432d-9c9b-2f046191acbf tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:48.001340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-656740bd-fac8-473a-a7b8-f843ebd0085a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:48.003807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-656740bd-fac8-473a-a7b8-f843ebd0085a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:48.012648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-656740bd-fac8-473a-a7b8-f843ebd0085a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:48.014148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-656740bd-fac8-473a-a7b8-f843ebd0085a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:48.015297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-656740bd-fac8-473a-a7b8-f843ebd0085a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:48.016977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-656740bd-fac8-473a-a7b8-f843ebd0085a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:48.272783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5878d895-fd3c-432d-9c9b-2f046191acbf tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe38c50ae5b4d2cbec2ee25198771ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1411a9f117b74cdbab42aa6767cc6296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:48.290373 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5878d895-fd3c-432d-9c9b-2f046191acbf tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 200 len: 1325 microversion: 2.1 time: 0.442912 Jul 20 04:49:48.295302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-656740bd-fac8-473a-a7b8-f843ebd0085a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:48.297987 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3211/6189] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:47 2022] GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 1325 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:48.309938 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-656740bd-fac8-473a-a7b8-f843ebd0085a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1682 microversion: 2.1 time: 0.318024 Jul 20 04:49:48.311123 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2979/6190] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:47 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1682 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:48.434039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-d1b4a20c-b58d-41e7-99bb-192059fe9403 req-6501e2b3-5ee5-45c0-bdb3-8e18f620d8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3584ceba-c7a4-4da1-a94e-e34d56ffbef5", "tag": "7be27448-460b-4657-9b0e-c3153d866b3c"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:48.456970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d1b4a20c-b58d-41e7-99bb-192059fe9403 req-6501e2b3-5ee5-45c0-bdb3-8e18f620d8f9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:48.457695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d1b4a20c-b58d-41e7-99bb-192059fe9403 req-6501e2b3-5ee5-45c0-bdb3-8e18f620d8f9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:48.486304 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-d1b4a20c-b58d-41e7-99bb-192059fe9403 req-6501e2b3-5ee5-45c0-bdb3-8e18f620d8f9 service nova] Creating event network-changed:7be27448-460b-4657-9b0e-c3153d866b3c for instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 on n-h1-826526-5 Jul 20 04:49:48.495908 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-d1b4a20c-b58d-41e7-99bb-192059fe9403 req-6501e2b3-5ee5-45c0-bdb3-8e18f620d8f9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071199 Jul 20 04:49:48.496636 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3212/6191] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:48.555940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-22f96f6c-d81a-4dbf-80e4-24f4f4a26a7d req-025aec01-451d-4916-8a73-5aedb50e7428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dfaa1f0-02ae-495b-8a76-798f196026a6", "name": "network-vif-unplugged", "status": "completed", "tag": "3f58cd69-4a4d-4b1c-b702-d369b59e734b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:48.565718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-22f96f6c-d81a-4dbf-80e4-24f4f4a26a7d req-025aec01-451d-4916-8a73-5aedb50e7428 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:48.566410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-22f96f6c-d81a-4dbf-80e4-24f4f4a26a7d req-025aec01-451d-4916-8a73-5aedb50e7428 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:48.579401 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-22f96f6c-d81a-4dbf-80e4-24f4f4a26a7d req-025aec01-451d-4916-8a73-5aedb50e7428 service nova] Creating event network-vif-unplugged:3f58cd69-4a4d-4b1c-b702-d369b59e734b for instance 5dfaa1f0-02ae-495b-8a76-798f196026a6 on n-h2-826526-5 Jul 20 04:49:48.586395 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-22f96f6c-d81a-4dbf-80e4-24f4f4a26a7d req-025aec01-451d-4916-8a73-5aedb50e7428 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034516 Jul 20 04:49:48.587028 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2980/6192] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:49.312062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-14c91d1e-51ca-4942-9fba-60affa37a618 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:49.312817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-14c91d1e-51ca-4942-9fba-60affa37a618 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:49.320606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14c91d1e-51ca-4942-9fba-60affa37a618 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:49.321208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14c91d1e-51ca-4942-9fba-60affa37a618 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:49.322014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14c91d1e-51ca-4942-9fba-60affa37a618 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:49.322454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14c91d1e-51ca-4942-9fba-60affa37a618 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:49.608133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-14c91d1e-51ca-4942-9fba-60affa37a618 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe38c50ae5b4d2cbec2ee25198771ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1411a9f117b74cdbab42aa6767cc6296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:49.623048 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-14c91d1e-51ca-4942-9fba-60affa37a618 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 200 len: 1325 microversion: 2.1 time: 0.316488 Jul 20 04:49:49.628501 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3213/6193] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:49 2022] GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 1325 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:50.642652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-62178b47-c879-4424-b5ca-7a1075b7034b tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:50.644049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62178b47-c879-4424-b5ca-7a1075b7034b tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:50.653404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62178b47-c879-4424-b5ca-7a1075b7034b tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:50.654183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62178b47-c879-4424-b5ca-7a1075b7034b tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:50.655533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62178b47-c879-4424-b5ca-7a1075b7034b tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:50.656530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62178b47-c879-4424-b5ca-7a1075b7034b tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:50.847550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-62178b47-c879-4424-b5ca-7a1075b7034b tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe38c50ae5b4d2cbec2ee25198771ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1411a9f117b74cdbab42aa6767cc6296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:50.857662 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-62178b47-c879-4424-b5ca-7a1075b7034b tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 200 len: 1325 microversion: 2.1 time: 0.219999 Jul 20 04:49:50.858898 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2981/6194] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:50 2022] GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 1325 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:51.878056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6666fbae-1bc8-418f-b08e-e6e5fba057d7 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:51.879724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6666fbae-1bc8-418f-b08e-e6e5fba057d7 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:51.888323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6666fbae-1bc8-418f-b08e-e6e5fba057d7 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:51.889969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6666fbae-1bc8-418f-b08e-e6e5fba057d7 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:51.891958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6666fbae-1bc8-418f-b08e-e6e5fba057d7 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:51.893192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6666fbae-1bc8-418f-b08e-e6e5fba057d7 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:51.918764 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-c3ba6b43-e162-49a4-8f67-c607700557c8 req-da1afc35-ede3-44c5-a911-cc23d863cf5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dfaa1f0-02ae-495b-8a76-798f196026a6", "name": "network-vif-plugged", "status": "completed", "tag": "3f58cd69-4a4d-4b1c-b702-d369b59e734b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:51.934066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c3ba6b43-e162-49a4-8f67-c607700557c8 req-da1afc35-ede3-44c5-a911-cc23d863cf5a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:51.934516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c3ba6b43-e162-49a4-8f67-c607700557c8 req-da1afc35-ede3-44c5-a911-cc23d863cf5a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:51.951839 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-c3ba6b43-e162-49a4-8f67-c607700557c8 req-da1afc35-ede3-44c5-a911-cc23d863cf5a service nova] Creating event network-vif-plugged:3f58cd69-4a4d-4b1c-b702-d369b59e734b for instance 5dfaa1f0-02ae-495b-8a76-798f196026a6 on n-h2-826526-5 Jul 20 04:49:51.958444 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-c3ba6b43-e162-49a4-8f67-c607700557c8 req-da1afc35-ede3-44c5-a911-cc23d863cf5a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043836 Jul 20 04:49:51.960371 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2982/6195] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:49:52.134687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c79fd1fa-fb3d-4ed4-b11d-1914915d66f3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:52.138622 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c79fd1fa-fb3d-4ed4-b11d-1914915d66f3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:52.144971 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c79fd1fa-fb3d-4ed4-b11d-1914915d66f3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:52.145439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c79fd1fa-fb3d-4ed4-b11d-1914915d66f3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:52.146499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c79fd1fa-fb3d-4ed4-b11d-1914915d66f3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:52.147042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c79fd1fa-fb3d-4ed4-b11d-1914915d66f3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:52.178303 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c79fd1fa-fb3d-4ed4-b11d-1914915d66f3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/ips" status: 200 len: 143 microversion: 2.1 time: 0.048389 Jul 20 04:49:52.178940 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2983/6196] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 04:49:52 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/ips => generated 143 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:52.413008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6666fbae-1bc8-418f-b08e-e6e5fba057d7 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe38c50ae5b4d2cbec2ee25198771ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1411a9f117b74cdbab42aa6767cc6296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:52.445230 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6666fbae-1bc8-418f-b08e-e6e5fba057d7 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 200 len: 1325 microversion: 2.1 time: 0.571726 Jul 20 04:49:52.447994 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3214/6197] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:51 2022] GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 1325 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:53.463364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-10d1eb9a-db92-4ab6-86b9-12690618136b tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:53.464860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-10d1eb9a-db92-4ab6-86b9-12690618136b tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:53.488539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:53.489951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:53.496158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10d1eb9a-db92-4ab6-86b9-12690618136b tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:53.497255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10d1eb9a-db92-4ab6-86b9-12690618136b tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:53.500125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10d1eb9a-db92-4ab6-86b9-12690618136b tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:53.502084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-10d1eb9a-db92-4ab6-86b9-12690618136b tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:53.609175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0efa116a-3361-40e2-bc24-e73f2ff82abc tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6fc0540-70d8-4771-a695-20ff597cc623"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:53.611510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0efa116a-3361-40e2-bc24-e73f2ff82abc tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:53.619335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:53.623563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0efa116a-3361-40e2-bc24-e73f2ff82abc tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:53.624740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0efa116a-3361-40e2-bc24-e73f2ff82abc tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:53.625824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0efa116a-3361-40e2-bc24-e73f2ff82abc tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:53.626486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0efa116a-3361-40e2-bc24-e73f2ff82abc tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:53.836704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-10d1eb9a-db92-4ab6-86b9-12690618136b tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe38c50ae5b4d2cbec2ee25198771ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1411a9f117b74cdbab42aa6767cc6296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:53.846561 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-10d1eb9a-db92-4ab6-86b9-12690618136b tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 200 len: 1325 microversion: 2.1 time: 0.387273 Jul 20 04:49:53.847388 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2984/6198] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:53 2022] GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 1325 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:53.852291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-06225912-d37c-4dcb-b320-8c6185466164 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:53.853016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-06225912-d37c-4dcb-b320-8c6185466164 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:53.859348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06225912-d37c-4dcb-b320-8c6185466164 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:53.859981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06225912-d37c-4dcb-b320-8c6185466164 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:53.860958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06225912-d37c-4dcb-b320-8c6185466164 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:53.861570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06225912-d37c-4dcb-b320-8c6185466164 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:53.918645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-06225912-d37c-4dcb-b320-8c6185466164 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:49:53.967980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:54.036822 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-06225912-d37c-4dcb-b320-8c6185466164 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 204 len: 0 microversion: 2.1 time: 0.186346 Jul 20 04:49:54.037715 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2985/6199] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:53 2022] DELETE /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:49:54.048219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5c7f2a60-1bde-488a-b46c-b8a3548cf2b3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:54.049246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5c7f2a60-1bde-488a-b46c-b8a3548cf2b3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:54.059203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c7f2a60-1bde-488a-b46c-b8a3548cf2b3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:54.061026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c7f2a60-1bde-488a-b46c-b8a3548cf2b3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:54.062206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c7f2a60-1bde-488a-b46c-b8a3548cf2b3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:54.062867 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c7f2a60-1bde-488a-b46c-b8a3548cf2b3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:54.222339 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0efa116a-3361-40e2-bc24-e73f2ff82abc tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "POST /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.616967 Jul 20 04:49:54.223741 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3215/6200] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 04:49:53 2022] POST /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments => generated 194 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:49:54.336173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5c7f2a60-1bde-488a-b46c-b8a3548cf2b3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:54.345307 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5c7f2a60-1bde-488a-b46c-b8a3548cf2b3 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1578 microversion: 2.1 time: 0.302798 Jul 20 04:49:54.349951 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2986/6201] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:54 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1578 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:54.866623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-44371f61-fbd0-451f-8222-6445c172ca72 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:54.868987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-44371f61-fbd0-451f-8222-6445c172ca72 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:54.888545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44371f61-fbd0-451f-8222-6445c172ca72 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:54.890381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44371f61-fbd0-451f-8222-6445c172ca72 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:54.892837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44371f61-fbd0-451f-8222-6445c172ca72 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:54.893654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-44371f61-fbd0-451f-8222-6445c172ca72 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:55.178419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-44371f61-fbd0-451f-8222-6445c172ca72 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe38c50ae5b4d2cbec2ee25198771ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1411a9f117b74cdbab42aa6767cc6296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:55.192109 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-44371f61-fbd0-451f-8222-6445c172ca72 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 200 len: 1325 microversion: 2.1 time: 0.331670 Jul 20 04:49:55.193067 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3216/6202] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:54 2022] GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 1325 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:55.338732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f4f8a661-e7f1-488b-80f4-2930632de843 req-8e9eb48f-f8a8-491e-9da6-59923046bd20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3584ceba-c7a4-4da1-a94e-e34d56ffbef5", "name": "network-vif-plugged", "status": "completed", "tag": "7be27448-460b-4657-9b0e-c3153d866b3c"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:55.365179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f4f8a661-e7f1-488b-80f4-2930632de843 req-8e9eb48f-f8a8-491e-9da6-59923046bd20 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:55.367407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f4f8a661-e7f1-488b-80f4-2930632de843 req-8e9eb48f-f8a8-491e-9da6-59923046bd20 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:55.388446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1558ef9b-0268-4479-abb4-aa61e592716b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:55.389049 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1558ef9b-0268-4479-abb4-aa61e592716b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:55.397664 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f4f8a661-e7f1-488b-80f4-2930632de843 req-8e9eb48f-f8a8-491e-9da6-59923046bd20 service nova] Creating event network-vif-plugged:7be27448-460b-4657-9b0e-c3153d866b3c for instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 on n-h1-826526-5 Jul 20 04:49:55.403304 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f4f8a661-e7f1-488b-80f4-2930632de843 req-8e9eb48f-f8a8-491e-9da6-59923046bd20 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071293 Jul 20 04:49:55.404371 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2987/6203] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:55.408697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1558ef9b-0268-4479-abb4-aa61e592716b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:55.409383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1558ef9b-0268-4479-abb4-aa61e592716b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:55.410353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1558ef9b-0268-4479-abb4-aa61e592716b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:55.410947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1558ef9b-0268-4479-abb4-aa61e592716b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:55.735647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1558ef9b-0268-4479-abb4-aa61e592716b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:55.753337 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1558ef9b-0268-4479-abb4-aa61e592716b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1578 microversion: 2.1 time: 0.390062 Jul 20 04:49:55.755220 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3217/6204] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:55 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1578 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:56.209755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0ae82fe9-d1c9-45f3-8f1c-4022b91bf255 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:56.210490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0ae82fe9-d1c9-45f3-8f1c-4022b91bf255 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:56.222459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ae82fe9-d1c9-45f3-8f1c-4022b91bf255 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:56.222851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ae82fe9-d1c9-45f3-8f1c-4022b91bf255 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:56.223713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ae82fe9-d1c9-45f3-8f1c-4022b91bf255 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:56.224336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ae82fe9-d1c9-45f3-8f1c-4022b91bf255 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:56.771899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4423350e-a156-4e1b-bb3b-d9f72a858b13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:56.773225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4423350e-a156-4e1b-bb3b-d9f72a858b13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:56.781348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4423350e-a156-4e1b-bb3b-d9f72a858b13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:56.782121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4423350e-a156-4e1b-bb3b-d9f72a858b13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:56.783348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4423350e-a156-4e1b-bb3b-d9f72a858b13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:56.784033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4423350e-a156-4e1b-bb3b-d9f72a858b13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:56.992940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4423350e-a156-4e1b-bb3b-d9f72a858b13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:57.004130 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4423350e-a156-4e1b-bb3b-d9f72a858b13 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1578 microversion: 2.1 time: 0.236545 Jul 20 04:49:57.005374 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3218/6205] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:56 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1578 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:57.045046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0ae82fe9-d1c9-45f3-8f1c-4022b91bf255 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe38c50ae5b4d2cbec2ee25198771ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1411a9f117b74cdbab42aa6767cc6296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:57.055918 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0ae82fe9-d1c9-45f3-8f1c-4022b91bf255 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 200 len: 1325 microversion: 2.1 time: 0.850386 Jul 20 04:49:57.057158 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2988/6206] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:56 2022] GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 1325 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:58.003476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-bd7808fe-48a8-4edb-a8b4-d9044f4621d6 req-81ee2c79-8ea0-4dc0-aa76-f4739a7105b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcc3e27-5b1a-4e63-8d64-53aeb92f237a", "name": "network-vif-deleted", "tag": "e468a9ce-ee35-4c82-b0b7-a44a299daa9b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:58.033099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-858b5a46-8782-46d3-937d-fcd8ee53adfd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:58.036779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-858b5a46-8782-46d3-937d-fcd8ee53adfd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:58.038751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bd7808fe-48a8-4edb-a8b4-d9044f4621d6 req-81ee2c79-8ea0-4dc0-aa76-f4739a7105b8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:58.039392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bd7808fe-48a8-4edb-a8b4-d9044f4621d6 req-81ee2c79-8ea0-4dc0-aa76-f4739a7105b8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:58.056534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:58.068217 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-bd7808fe-48a8-4edb-a8b4-d9044f4621d6 req-81ee2c79-8ea0-4dc0-aa76-f4739a7105b8 service nova] Creating event network-vif-deleted:e468a9ce-ee35-4c82-b0b7-a44a299daa9b for instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a on n-h1-826526-5 Jul 20 04:49:58.075121 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-bd7808fe-48a8-4edb-a8b4-d9044f4621d6 req-81ee2c79-8ea0-4dc0-aa76-f4739a7105b8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077153 Jul 20 04:49:58.076661 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3219/6207] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:58.078150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-858b5a46-8782-46d3-937d-fcd8ee53adfd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:58.084123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-858b5a46-8782-46d3-937d-fcd8ee53adfd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:58.086362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-858b5a46-8782-46d3-937d-fcd8ee53adfd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:58.091048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-858b5a46-8782-46d3-937d-fcd8ee53adfd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:58.094662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e5ad31d2-5bcd-45c2-be03-03e7083f16fa tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:58.096413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e5ad31d2-5bcd-45c2-be03-03e7083f16fa tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:58.112180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5ad31d2-5bcd-45c2-be03-03e7083f16fa tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:58.112711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5ad31d2-5bcd-45c2-be03-03e7083f16fa tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:58.113494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5ad31d2-5bcd-45c2-be03-03e7083f16fa tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:58.113927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5ad31d2-5bcd-45c2-be03-03e7083f16fa tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:58.322635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-858b5a46-8782-46d3-937d-fcd8ee53adfd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:58.333016 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-858b5a46-8782-46d3-937d-fcd8ee53adfd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1226 microversion: 2.1 time: 0.313553 Jul 20 04:49:58.335291 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2989/6208] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:58 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1226 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:58.441030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e5ad31d2-5bcd-45c2-be03-03e7083f16fa tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe38c50ae5b4d2cbec2ee25198771ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1411a9f117b74cdbab42aa6767cc6296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:58.450222 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e5ad31d2-5bcd-45c2-be03-03e7083f16fa tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 200 len: 1525 microversion: 2.1 time: 0.372020 Jul 20 04:49:58.452962 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3220/6209] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:58 2022] GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 1525 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:58.473269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6de7fcbc-af46-4df5-a5df-ab37fab1c173 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:58.474742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6de7fcbc-af46-4df5-a5df-ab37fab1c173 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:58.486068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6de7fcbc-af46-4df5-a5df-ab37fab1c173 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:58.486858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6de7fcbc-af46-4df5-a5df-ab37fab1c173 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:58.489746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6de7fcbc-af46-4df5-a5df-ab37fab1c173 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:58.490465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6de7fcbc-af46-4df5-a5df-ab37fab1c173 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:58.764835 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6de7fcbc-af46-4df5-a5df-ab37fab1c173 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe38c50ae5b4d2cbec2ee25198771ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1411a9f117b74cdbab42aa6767cc6296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:58.773920 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6de7fcbc-af46-4df5-a5df-ab37fab1c173 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 200 len: 1525 microversion: 2.1 time: 0.308301 Jul 20 04:49:58.780163 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2990/6210] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:58 2022] GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 1525 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:59.271840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4f53e23e-d215-4c7e-8eef-f80581111021 tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:59.274267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4f53e23e-d215-4c7e-8eef-f80581111021 tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:59.288245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f53e23e-d215-4c7e-8eef-f80581111021 tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:59.289273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f53e23e-d215-4c7e-8eef-f80581111021 tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:59.291026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f53e23e-d215-4c7e-8eef-f80581111021 tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:59.291680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f53e23e-d215-4c7e-8eef-f80581111021 tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:59.321508 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-4f53e23e-d215-4c7e-8eef-f80581111021 tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] HTTP exception thrown: Instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 could not be found. Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4f53e23e-d215-4c7e-8eef-f80581111021 tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] Request method failure captured: Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 HTTP/1.1 Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14llnOUNDTZrwOn6enLlCQJSdIhCX4cTqWCPQ7uBSxjOLJ07PTd9aK-QL6Oqfty3erTEudpGV57gsBr47Zdw9DT-4GlR3D3J7ZjCss0cEXHmnqLeTRxoXmUE3396yHUotWhuonjFBs_o37RDIsDu_zOoZzH9ctFnIayIlXnUZmp24f0 Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: bc9b097c089d4aae9c0e53cfbe587fd8 Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1365575143 Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bc9b097c089d4aae9c0e53cfbe587fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bc9b097c089d4aae9c0e53cfbe587fd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bc9b097c089d4aae9c0e53cfbe587fd8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bc9b097c089d4aae9c0e53cfbe587fd8"}]}] Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1365575143 Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: bc9b097c089d4aae9c0e53cfbe587fd8 Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1365575143 Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1365575143-project Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: ba6fb24af4954386b4c0ef9b992444c2 Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1365575143-project Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 could not be found. Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '3584ceba-c7a4-4da1-a94e-e34d56ffbef5'} Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 could not be found. Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:59.324566 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:59.329003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 could not be found. Jul 20 04:49:59.329003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:59.329003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:59.329003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:59.329003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:59.329003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:59.329003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:59.329003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:59.329003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:59.329003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 could not be found. Jul 20 04:49:59.329003 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:59.330434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4f53e23e-d215-4c7e-8eef-f80581111021 tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] Returning 404 to user: Instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:59.331440 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4f53e23e-d215-4c7e-8eef-f80581111021 tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 404 len: 111 microversion: 2.1 time: 0.544873 Jul 20 04:49:59.333299 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3221/6211] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:58 2022] DELETE /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 111 bytes in 548 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:59.344200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c0745944-00b6-4a86-94c3-1038b7bce8bb tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:59.345272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c0745944-00b6-4a86-94c3-1038b7bce8bb tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:59.350028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c3107117-b9bb-419c-b31d-0f06f5622b10 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:59.350679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c3107117-b9bb-419c-b31d-0f06f5622b10 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:59.360512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3107117-b9bb-419c-b31d-0f06f5622b10 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:59.360974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3107117-b9bb-419c-b31d-0f06f5622b10 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:59.361774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3107117-b9bb-419c-b31d-0f06f5622b10 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:59.362215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c3107117-b9bb-419c-b31d-0f06f5622b10 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:59.363116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0745944-00b6-4a86-94c3-1038b7bce8bb tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:59.363755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0745944-00b6-4a86-94c3-1038b7bce8bb tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:59.366805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0745944-00b6-4a86-94c3-1038b7bce8bb tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:59.369385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0745944-00b6-4a86-94c3-1038b7bce8bb tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:59.519188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c3107117-b9bb-419c-b31d-0f06f5622b10 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:59.528120 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c3107117-b9bb-419c-b31d-0f06f5622b10 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1226 microversion: 2.1 time: 0.182141 Jul 20 04:49:59.529240 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3222/6212] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:59 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1226 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:59.638200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c0745944-00b6-4a86-94c3-1038b7bce8bb tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe38c50ae5b4d2cbec2ee25198771ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1411a9f117b74cdbab42aa6767cc6296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:59.649971 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c0745944-00b6-4a86-94c3-1038b7bce8bb tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 200 len: 1525 microversion: 2.1 time: 0.311219 Jul 20 04:49:59.651888 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2991/6213] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:59 2022] GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 1525 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:59.678934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-980e1d9d-5d04-4473-ac25-99c0f8f8ea7b tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] Action: 'update', calling method: >, body: {"server": {"name": "3584ceba-c7a4-4da1-a94e-e34d56ffbef5_new"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:59.683646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-980e1d9d-5d04-4473-ac25-99c0f8f8ea7b tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:59.691491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-980e1d9d-5d04-4473-ac25-99c0f8f8ea7b tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:59.692029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-980e1d9d-5d04-4473-ac25-99c0f8f8ea7b tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:59.693251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-980e1d9d-5d04-4473-ac25-99c0f8f8ea7b tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:59.693707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-980e1d9d-5d04-4473-ac25-99c0f8f8ea7b tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:59.713892 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-980e1d9d-5d04-4473-ac25-99c0f8f8ea7b tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] HTTP exception thrown: Instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 could not be found. Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-980e1d9d-5d04-4473-ac25-99c0f8f8ea7b tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] Request method failure captured: Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: request: PUT /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 HTTP/1.1 Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 64 Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14llnOUNDTZrwOn6enLlCQJSdIhCX4cTqWCPQ7uBSxjOLJ07PTd9aK-QL6Oqfty3erTEudpGV57gsBr47Zdw9DT-4GlR3D3J7ZjCss0cEXHmnqLeTRxoXmUE3396yHUotWhuonjFBs_o37RDIsDu_zOoZzH9ctFnIayIlXnUZmp24f0 Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: bc9b097c089d4aae9c0e53cfbe587fd8 Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1365575143 Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bc9b097c089d4aae9c0e53cfbe587fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bc9b097c089d4aae9c0e53cfbe587fd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bc9b097c089d4aae9c0e53cfbe587fd8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bc9b097c089d4aae9c0e53cfbe587fd8"}]}] Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1365575143 Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: bc9b097c089d4aae9c0e53cfbe587fd8 Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1365575143 Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1365575143-project Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: ba6fb24af4954386b4c0ef9b992444c2 Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1365575143-project Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: {"server": {"name": "3584ceba-c7a4-4da1-a94e-e34d56ffbef5_new"}} Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 could not be found. Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '3584ceba-c7a4-4da1-a94e-e34d56ffbef5', 'body': {'server': {'name': '3584ceba-c7a4-4da1-a94e-e34d56ffbef5_new'}}} Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 could not be found. Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:49:59.716622 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 20 04:49:59.721142 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 20 04:49:59.721142 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:59.721142 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:59.721142 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:59.721142 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:59.721142 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 could not be found. Jul 20 04:49:59.721142 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:59.721142 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:59.721142 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:59.721142 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:59.721142 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:59.721142 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:59.721142 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:59.721142 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:59.721142 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 could not be found. Jul 20 04:49:59.721142 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:49:59.724287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-980e1d9d-5d04-4473-ac25-99c0f8f8ea7b tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] Returning 404 to user: Instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:59.725615 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-980e1d9d-5d04-4473-ac25-99c0f8f8ea7b tempest-ServersNegativeTestMultiTenantJSON-1365575143 tempest-ServersNegativeTestMultiTenantJSON-1365575143-project] 10.222.0.17 "PUT /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 404 len: 111 microversion: 2.1 time: 0.051905 Jul 20 04:49:59.726873 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3223/6214] 10.222.0.17 () {60 vars in 1255 bytes} [Wed Jul 20 04:49:59 2022] PUT /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:59.737274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-df06fd6b-9c32-412c-a2cb-975767f4c9df tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:59.738031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-df06fd6b-9c32-412c-a2cb-975767f4c9df tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:59.747755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df06fd6b-9c32-412c-a2cb-975767f4c9df tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:59.748606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df06fd6b-9c32-412c-a2cb-975767f4c9df tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:59.749897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df06fd6b-9c32-412c-a2cb-975767f4c9df tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:59.750488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df06fd6b-9c32-412c-a2cb-975767f4c9df tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:59.797164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-df06fd6b-9c32-412c-a2cb-975767f4c9df tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:49:59.910992 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-df06fd6b-9c32-412c-a2cb-975767f4c9df tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 204 len: 0 microversion: 2.1 time: 0.178515 Jul 20 04:49:59.912722 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2992/6215] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:59 2022] DELETE /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:49:59.922518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-270567d2-bf66-4647-9d9b-32d786c3aa5c tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:59.923148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-270567d2-bf66-4647-9d9b-32d786c3aa5c tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:59.932565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-270567d2-bf66-4647-9d9b-32d786c3aa5c tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:59.933024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-270567d2-bf66-4647-9d9b-32d786c3aa5c tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:59.935717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-270567d2-bf66-4647-9d9b-32d786c3aa5c tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:59.936166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-270567d2-bf66-4647-9d9b-32d786c3aa5c tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:59.951069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:00.140100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-270567d2-bf66-4647-9d9b-32d786c3aa5c tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe38c50ae5b4d2cbec2ee25198771ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1411a9f117b74cdbab42aa6767cc6296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:00.148850 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-270567d2-bf66-4647-9d9b-32d786c3aa5c tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 200 len: 1531 microversion: 2.1 time: 0.231533 Jul 20 04:50:00.149458 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3224/6216] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:59 2022] GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 1531 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:00.546982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0c830e43-55e8-460c-bf7c-fdde48792941 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:00.547770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0c830e43-55e8-460c-bf7c-fdde48792941 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:00.556108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c830e43-55e8-460c-bf7c-fdde48792941 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:00.556987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c830e43-55e8-460c-bf7c-fdde48792941 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:00.557983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c830e43-55e8-460c-bf7c-fdde48792941 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:00.558617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c830e43-55e8-460c-bf7c-fdde48792941 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:00.663791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0c830e43-55e8-460c-bf7c-fdde48792941 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:00.673790 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0c830e43-55e8-460c-bf7c-fdde48792941 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1226 microversion: 2.1 time: 0.131170 Jul 20 04:50:00.685148 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2993/6217] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:00 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1226 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:01.168212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-eee12646-fa46-461d-8d92-65c8bdbac203 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:01.169762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-eee12646-fa46-461d-8d92-65c8bdbac203 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:01.178640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eee12646-fa46-461d-8d92-65c8bdbac203 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:01.179610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eee12646-fa46-461d-8d92-65c8bdbac203 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:01.180757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eee12646-fa46-461d-8d92-65c8bdbac203 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:01.181431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eee12646-fa46-461d-8d92-65c8bdbac203 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:01.523983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-eee12646-fa46-461d-8d92-65c8bdbac203 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe38c50ae5b4d2cbec2ee25198771ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1411a9f117b74cdbab42aa6767cc6296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:01.536137 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-eee12646-fa46-461d-8d92-65c8bdbac203 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 200 len: 1531 microversion: 2.1 time: 0.373037 Jul 20 04:50:01.548034 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3225/6218] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:01 2022] GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 1531 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:01.693218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0e9cd0e6-d32b-4b33-b01c-6cbc2bae129f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:01.694064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0e9cd0e6-d32b-4b33-b01c-6cbc2bae129f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:01.707031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e9cd0e6-d32b-4b33-b01c-6cbc2bae129f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:01.711215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e9cd0e6-d32b-4b33-b01c-6cbc2bae129f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:01.715234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e9cd0e6-d32b-4b33-b01c-6cbc2bae129f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:01.715234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e9cd0e6-d32b-4b33-b01c-6cbc2bae129f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:01.893934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0e9cd0e6-d32b-4b33-b01c-6cbc2bae129f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:01.903750 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0e9cd0e6-d32b-4b33-b01c-6cbc2bae129f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1226 microversion: 2.1 time: 0.216346 Jul 20 04:50:01.913663 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2994/6219] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:01 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1226 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:02.086269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-18d3a953-bf37-4f93-b61a-7f9fae428b8d req-a3b3428f-3a10-4c6b-8019-3a4bd58d1b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3584ceba-c7a4-4da1-a94e-e34d56ffbef5", "name": "network-vif-deleted", "tag": "7be27448-460b-4657-9b0e-c3153d866b3c"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:02.128667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-18d3a953-bf37-4f93-b61a-7f9fae428b8d req-a3b3428f-3a10-4c6b-8019-3a4bd58d1b90 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:02.129834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-18d3a953-bf37-4f93-b61a-7f9fae428b8d req-a3b3428f-3a10-4c6b-8019-3a4bd58d1b90 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:02.150325 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-18d3a953-bf37-4f93-b61a-7f9fae428b8d req-a3b3428f-3a10-4c6b-8019-3a4bd58d1b90 service nova] Creating event network-vif-deleted:7be27448-460b-4657-9b0e-c3153d866b3c for instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 on n-h1-826526-5 Jul 20 04:50:02.161111 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-18d3a953-bf37-4f93-b61a-7f9fae428b8d req-a3b3428f-3a10-4c6b-8019-3a4bd58d1b90 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080691 Jul 20 04:50:02.169641 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3226/6220] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:02.554893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-002fe322-6e9e-41bc-9a92-d44d5e5a4c37 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:02.556988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-002fe322-6e9e-41bc-9a92-d44d5e5a4c37 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:02.567737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-002fe322-6e9e-41bc-9a92-d44d5e5a4c37 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:02.569139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-002fe322-6e9e-41bc-9a92-d44d5e5a4c37 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:02.570239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-002fe322-6e9e-41bc-9a92-d44d5e5a4c37 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:02.570934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-002fe322-6e9e-41bc-9a92-d44d5e5a4c37 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:02.610144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-002fe322-6e9e-41bc-9a92-d44d5e5a4c37 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:02.610847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-002fe322-6e9e-41bc-9a92-d44d5e5a4c37 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:02.611496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-002fe322-6e9e-41bc-9a92-d44d5e5a4c37 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lazy-loading 'fault' on Instance uuid 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:50:02.700153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-002fe322-6e9e-41bc-9a92-d44d5e5a4c37 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe38c50ae5b4d2cbec2ee25198771ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1411a9f117b74cdbab42aa6767cc6296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:02.712362 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-002fe322-6e9e-41bc-9a92-d44d5e5a4c37 tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 200 len: 1315 microversion: 2.1 time: 0.161046 Jul 20 04:50:02.722896 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2995/6221] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:02 2022] GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:02.939475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fa90c4fd-06e9-4dc4-ab6a-ce2a17104c67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:02.945149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fa90c4fd-06e9-4dc4-ab6a-ce2a17104c67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:02.962121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa90c4fd-06e9-4dc4-ab6a-ce2a17104c67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:02.965834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa90c4fd-06e9-4dc4-ab6a-ce2a17104c67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:02.967054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa90c4fd-06e9-4dc4-ab6a-ce2a17104c67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:02.970541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa90c4fd-06e9-4dc4-ab6a-ce2a17104c67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:03.136596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fa90c4fd-06e9-4dc4-ab6a-ce2a17104c67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:03.154340 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fa90c4fd-06e9-4dc4-ab6a-ce2a17104c67 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1226 microversion: 2.1 time: 0.226184 Jul 20 04:50:03.156087 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3227/6222] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:02 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1226 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:03.732190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-93180611-90ab-4bf4-999b-21cd02c52d8c tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:03.732951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-93180611-90ab-4bf4-999b-21cd02c52d8c tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] [instance: 3584ceba-c7a4-4da1-a94e-e34d56ffbef5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:03.741992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93180611-90ab-4bf4-999b-21cd02c52d8c tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:03.742515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93180611-90ab-4bf4-999b-21cd02c52d8c tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:03.743850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93180611-90ab-4bf4-999b-21cd02c52d8c tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:03.744754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-93180611-90ab-4bf4-999b-21cd02c52d8c tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:03.764293 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-93180611-90ab-4bf4-999b-21cd02c52d8c tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] HTTP exception thrown: Instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 could not be found. Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-93180611-90ab-4bf4-999b-21cd02c52d8c tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Request method failure captured: Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 HTTP/1.1 Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14lbpuMtwv-jiu7JIUMEg1wpHOygyrvK7xpV3Mee4Do3MkYLcu5SkyPGpz66x3i0H3U5Ofg0DGH02fjtkGYk957DB13JI8jyTxebrRZyHQqXVb5g9DFzE-px5DfvGaX8jlK_j3CA3rdL_Gfl7mmwj_lVCrlYWMUXkkTzGtJt-yPc9Ew Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 1411a9f117b74cdbab42aa6767cc6296 Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-283443545 Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1411a9f117b74cdbab42aa6767cc6296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1411a9f117b74cdbab42aa6767cc6296"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1411a9f117b74cdbab42aa6767cc6296", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1411a9f117b74cdbab42aa6767cc6296"}]}] Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-283443545 Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 1411a9f117b74cdbab42aa6767cc6296 Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-283443545 Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestMultiTenantJSON-283443545-project Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 9fe38c50ae5b4d2cbec2ee25198771ce Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-283443545-project Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 could not be found. Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '3584ceba-c7a4-4da1-a94e-e34d56ffbef5'} Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 could not be found. Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 could not be found. Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:50:03.766454 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:50:03.770375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:50:03.770375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:03.770375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:50:03.770375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:50:03.770375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:50:03.770375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:50:03.770375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 could not be found. Jul 20 04:50:03.770375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:50:03.773482 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-93180611-90ab-4bf4-999b-21cd02c52d8c tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] Returning 404 to user: Instance 3584ceba-c7a4-4da1-a94e-e34d56ffbef5 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:50:03.774657 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-93180611-90ab-4bf4-999b-21cd02c52d8c tempest-ServersNegativeTestMultiTenantJSON-283443545 tempest-ServersNegativeTestMultiTenantJSON-283443545-project] 10.222.0.17 "GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5" status: 404 len: 111 microversion: 2.1 time: 0.047780 Jul 20 04:50:03.775780 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2996/6223] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:03 2022] GET /compute/v2.1/servers/3584ceba-c7a4-4da1-a94e-e34d56ffbef5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:50:04.175587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-72fa9e53-b540-4075-bb3c-23c6804a71b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:04.177399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-72fa9e53-b540-4075-bb3c-23c6804a71b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:04.187356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72fa9e53-b540-4075-bb3c-23c6804a71b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:04.188083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72fa9e53-b540-4075-bb3c-23c6804a71b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:04.189857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72fa9e53-b540-4075-bb3c-23c6804a71b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:04.190543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72fa9e53-b540-4075-bb3c-23c6804a71b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:04.270076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72fa9e53-b540-4075-bb3c-23c6804a71b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:04.271090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72fa9e53-b540-4075-bb3c-23c6804a71b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:04.271726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-72fa9e53-b540-4075-bb3c-23c6804a71b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lazy-loading 'fault' on Instance uuid cbcc3e27-5b1a-4e63-8d64-53aeb92f237a {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:50:04.444149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-72fa9e53-b540-4075-bb3c-23c6804a71b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:04.454085 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-72fa9e53-b540-4075-bb3c-23c6804a71b0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 200 len: 1231 microversion: 2.1 time: 0.282553 Jul 20 04:50:04.454899 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3228/6224] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:04 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 1231 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:05.477129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1fcef67b-1b51-4b1a-aa70-4535f1beb365 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:05.477775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1fcef67b-1b51-4b1a-aa70-4535f1beb365 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:05.496945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1fcef67b-1b51-4b1a-aa70-4535f1beb365 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:05.497452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1fcef67b-1b51-4b1a-aa70-4535f1beb365 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:05.498316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1fcef67b-1b51-4b1a-aa70-4535f1beb365 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:05.498767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1fcef67b-1b51-4b1a-aa70-4535f1beb365 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:05.529578 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-1fcef67b-1b51-4b1a-aa70-4535f1beb365 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] HTTP exception thrown: Instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a could not be found. Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1fcef67b-1b51-4b1a-aa70-4535f1beb365 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Request method failure captured: Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a HTTP/1.1 Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14dGzvYcPg3NF43f6ZRAI_AjtsB7nnPabtQnWEyYg-EXw30wVgvbZX3EBgp2DuSsT-UZ385yph2nVbWQKDH20kvx2xMXBhHcpx3bIjpA8OEQ9j_bQ2MqW2hbHHtIFQtSaphPYv0KfZxRo98jYdMcipaN9CmzRsyzwLTotDNtaeBR3wc Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b889ad56221143f0a54450c81ba738a7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}] Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: bc760e8f522640fc9190460719f5dcc2 Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a could not be found. Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'cbcc3e27-5b1a-4e63-8d64-53aeb92f237a'} Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a could not be found. Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a could not be found. Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:50:05.531559 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:50:05.536235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:05.536235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:50:05.536235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:50:05.536235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:50:05.536235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:50:05.536235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a could not be found. Jul 20 04:50:05.536235 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:50:05.538122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1fcef67b-1b51-4b1a-aa70-4535f1beb365 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Returning 404 to user: Instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:50:05.539271 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1fcef67b-1b51-4b1a-aa70-4535f1beb365 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 404 len: 111 microversion: 2.1 time: 0.067266 Jul 20 04:50:05.550141 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2997/6225] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:05 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:50:05.811205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-befad562-6d28-4222-8c56-f91bb9ceba2a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1713652624", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1993339905", "security_groups": [{"name": "tempest-secgroup-smoke-1136622068"}], "block_device_mapping_v2": [{"uuid": "a4bd1182-996b-4180-a68f-65a716537c12", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7f25ae6d-be40-4c15-969a-9d88fe94c163"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:06.088389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-befad562-6d28-4222-8c56-f91bb9ceba2a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] validate_networks() for [('7f25ae6d-be40-4c15-969a-9d88fe94c163', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:50:07.050111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-befad562-6d28-4222-8c56-f91bb9ceba2a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:50:07.050949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-befad562-6d28-4222-8c56-f91bb9ceba2a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:50:07.052337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-befad562-6d28-4222-8c56-f91bb9ceba2a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:50:07.053236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-befad562-6d28-4222-8c56-f91bb9ceba2a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:50:07.053977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-befad562-6d28-4222-8c56-f91bb9ceba2a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:50:07.074230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-befad562-6d28-4222-8c56-f91bb9ceba2a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:07.075525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-befad562-6d28-4222-8c56-f91bb9ceba2a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:07.077217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-befad562-6d28-4222-8c56-f91bb9ceba2a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:07.078155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-befad562-6d28-4222-8c56-f91bb9ceba2a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:07.118496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-befad562-6d28-4222-8c56-f91bb9ceba2a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Getting quotas for project b889ad56221143f0a54450c81ba738a7. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:50:07.130335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-befad562-6d28-4222-8c56-f91bb9ceba2a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Getting quotas for user bc760e8f522640fc9190460719f5dcc2 and project b889ad56221143f0a54450c81ba738a7. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:50:07.250223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-befad562-6d28-4222-8c56-f91bb9ceba2a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:50:07.255151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-befad562-6d28-4222-8c56-f91bb9ceba2a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a4bd1182-996b-4180-a68f-65a716537c12',volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:50:07.447799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=68 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:07.500733 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-befad562-6d28-4222-8c56-f91bb9ceba2a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.696259 Jul 20 04:50:07.502017 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3229/6226] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:50:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:50:07.519057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ee644411-04a4-42aa-8ee2-b13e8809e58e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:07.521952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ee644411-04a4-42aa-8ee2-b13e8809e58e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:07.744569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ee644411-04a4-42aa-8ee2-b13e8809e58e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:07.757577 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ee644411-04a4-42aa-8ee2-b13e8809e58e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1095 microversion: 2.1 time: 0.249361 Jul 20 04:50:07.767383 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2998/6227] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:07 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1095 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:08.775849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bda51e0d-25e0-442a-b7c1-3f2b17417a5c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:08.777089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bda51e0d-25e0-442a-b7c1-3f2b17417a5c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:08.784484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bda51e0d-25e0-442a-b7c1-3f2b17417a5c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:08.785204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bda51e0d-25e0-442a-b7c1-3f2b17417a5c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:08.786205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bda51e0d-25e0-442a-b7c1-3f2b17417a5c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:08.786790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bda51e0d-25e0-442a-b7c1-3f2b17417a5c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:08.890766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bda51e0d-25e0-442a-b7c1-3f2b17417a5c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:08.903405 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bda51e0d-25e0-442a-b7c1-3f2b17417a5c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1201 microversion: 2.1 time: 0.132271 Jul 20 04:50:08.912423 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3230/6228] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:08 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1201 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:09.923498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-727b7ddc-9d75-4743-b470-54f8afab1b63 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:09.924136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-727b7ddc-9d75-4743-b470-54f8afab1b63 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:09.935208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-727b7ddc-9d75-4743-b470-54f8afab1b63 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:09.935691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-727b7ddc-9d75-4743-b470-54f8afab1b63 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:09.941923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-727b7ddc-9d75-4743-b470-54f8afab1b63 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:09.942480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-727b7ddc-9d75-4743-b470-54f8afab1b63 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:10.162046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-727b7ddc-9d75-4743-b470-54f8afab1b63 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:10.192447 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-727b7ddc-9d75-4743-b470-54f8afab1b63 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1211 microversion: 2.1 time: 0.268850 Jul 20 04:50:10.194082 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2999/6229] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:09 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1211 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:11.212529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2e8cd207-86a6-407d-b179-3df7b1a8ec24 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:11.213151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2e8cd207-86a6-407d-b179-3df7b1a8ec24 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:11.230143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e8cd207-86a6-407d-b179-3df7b1a8ec24 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:11.230600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e8cd207-86a6-407d-b179-3df7b1a8ec24 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:11.231395 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e8cd207-86a6-407d-b179-3df7b1a8ec24 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:11.231833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e8cd207-86a6-407d-b179-3df7b1a8ec24 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:12.086619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-3da51756-cdc1-4003-8b93-b06fbbbba962 req-3b950019-7b11-4c23-aa77-12a660c21efe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01995acf-17fd-4f88-8a11-94bc6d7e4660", "tag": "0ca1c5d5-8446-4b52-bd23-4c77b26e751c"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:12.104029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-3da51756-cdc1-4003-8b93-b06fbbbba962 req-3b950019-7b11-4c23-aa77-12a660c21efe service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:12.105764 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-3da51756-cdc1-4003-8b93-b06fbbbba962 req-3b950019-7b11-4c23-aa77-12a660c21efe service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:12.146313 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-3da51756-cdc1-4003-8b93-b06fbbbba962 req-3b950019-7b11-4c23-aa77-12a660c21efe service nova] Creating event network-changed:0ca1c5d5-8446-4b52-bd23-4c77b26e751c for instance 01995acf-17fd-4f88-8a11-94bc6d7e4660 on n-h1-826526-5 Jul 20 04:50:12.163799 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-3da51756-cdc1-4003-8b93-b06fbbbba962 req-3b950019-7b11-4c23-aa77-12a660c21efe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078736 Jul 20 04:50:12.166319 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3000/6230] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:12.316031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2e8cd207-86a6-407d-b179-3df7b1a8ec24 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:12.325696 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2e8cd207-86a6-407d-b179-3df7b1a8ec24 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1279 microversion: 2.1 time: 1.117083 Jul 20 04:50:12.328526 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3231/6231] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:11 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1279 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:12.629495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c7c15e5a-665e-41cc-a3f7-380859400b67 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:12.632451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c7c15e5a-665e-41cc-a3f7-380859400b67 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:12.645636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7c15e5a-665e-41cc-a3f7-380859400b67 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:12.646126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7c15e5a-665e-41cc-a3f7-380859400b67 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:12.646906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7c15e5a-665e-41cc-a3f7-380859400b67 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:12.647354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7c15e5a-665e-41cc-a3f7-380859400b67 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:12.734952 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c7c15e5a-665e-41cc-a3f7-380859400b67 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "POST /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6/action" status: 200 len: 24558 microversion: 2.1 time: 0.109777 Jul 20 04:50:12.736597 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3001/6232] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:50:12 2022] POST /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6/action => generated 24558 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:50:12.923209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fba2277b-3df9-4232-a0b6-9fee24c8cbc7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:12.924216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fba2277b-3df9-4232-a0b6-9fee24c8cbc7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:12.937148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fba2277b-3df9-4232-a0b6-9fee24c8cbc7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:12.937602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fba2277b-3df9-4232-a0b6-9fee24c8cbc7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:12.938987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fba2277b-3df9-4232-a0b6-9fee24c8cbc7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:12.939993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fba2277b-3df9-4232-a0b6-9fee24c8cbc7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:13.004477 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fba2277b-3df9-4232-a0b6-9fee24c8cbc7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086345 Jul 20 04:50:13.005685 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3232/6233] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:50:12 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:50:13.016610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1a4a774f-3813-4022-a066-4694e79ebf92 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:13.017473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1a4a774f-3813-4022-a066-4694e79ebf92 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:13.035067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1a4a774f-3813-4022-a066-4694e79ebf92 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:13.035903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1a4a774f-3813-4022-a066-4694e79ebf92 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:13.036942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1a4a774f-3813-4022-a066-4694e79ebf92 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:13.040043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1a4a774f-3813-4022-a066-4694e79ebf92 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:13.102492 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1a4a774f-3813-4022-a066-4694e79ebf92 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments/f6fc0540-70d8-4771-a695-20ff597cc623" status: 200 len: 194 microversion: 2.1 time: 0.090356 Jul 20 04:50:13.106282 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3002/6234] 10.222.0.17 () {58 vars in 1412 bytes} [Wed Jul 20 04:50:13 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments/f6fc0540-70d8-4771-a695-20ff597cc623 => generated 194 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:13.346314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-abc2d793-dbbe-4baa-a6a6-fb3901b0de43 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:13.347160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-abc2d793-dbbe-4baa-a6a6-fb3901b0de43 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:13.369525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abc2d793-dbbe-4baa-a6a6-fb3901b0de43 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:13.372331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abc2d793-dbbe-4baa-a6a6-fb3901b0de43 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:13.374723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abc2d793-dbbe-4baa-a6a6-fb3901b0de43 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:13.376200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abc2d793-dbbe-4baa-a6a6-fb3901b0de43 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:14.001947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-abc2d793-dbbe-4baa-a6a6-fb3901b0de43 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:14.012412 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-abc2d793-dbbe-4baa-a6a6-fb3901b0de43 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1279 microversion: 2.1 time: 0.672132 Jul 20 04:50:14.016701 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3233/6235] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:13 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1279 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:15.035212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c48a33ea-59fd-40dc-ac2f-17bf694f12b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:15.036062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c48a33ea-59fd-40dc-ac2f-17bf694f12b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:15.047249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c48a33ea-59fd-40dc-ac2f-17bf694f12b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:15.047728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c48a33ea-59fd-40dc-ac2f-17bf694f12b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:15.053899 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c48a33ea-59fd-40dc-ac2f-17bf694f12b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:15.054387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c48a33ea-59fd-40dc-ac2f-17bf694f12b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:15.465383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c48a33ea-59fd-40dc-ac2f-17bf694f12b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:15.473433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:15.485672 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c48a33ea-59fd-40dc-ac2f-17bf694f12b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1279 microversion: 2.1 time: 0.455109 Jul 20 04:50:15.487588 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3003/6236] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:15 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1279 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:15.833276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1c93db47-6db2-4d3d-ba7e-5341d63db6ac tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5face541-00f7-4c8b-aca6-70c955373550"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:15.834364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1c93db47-6db2-4d3d-ba7e-5341d63db6ac tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:15.846499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c93db47-6db2-4d3d-ba7e-5341d63db6ac tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:15.847890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c93db47-6db2-4d3d-ba7e-5341d63db6ac tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:15.849721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c93db47-6db2-4d3d-ba7e-5341d63db6ac tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:15.850753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1c93db47-6db2-4d3d-ba7e-5341d63db6ac tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:16.238226 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1c93db47-6db2-4d3d-ba7e-5341d63db6ac tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "POST /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408163 Jul 20 04:50:16.239377 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3234/6237] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 04:50:15 2022] POST /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments => generated 194 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:16.507768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9a8650c0-397d-4d5e-b8dd-66dd61cc5d47 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:16.508621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9a8650c0-397d-4d5e-b8dd-66dd61cc5d47 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:16.530173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a8650c0-397d-4d5e-b8dd-66dd61cc5d47 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:16.530933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a8650c0-397d-4d5e-b8dd-66dd61cc5d47 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:16.532675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a8650c0-397d-4d5e-b8dd-66dd61cc5d47 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:16.533298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9a8650c0-397d-4d5e-b8dd-66dd61cc5d47 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:17.067224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9a8650c0-397d-4d5e-b8dd-66dd61cc5d47 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:17.075793 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9a8650c0-397d-4d5e-b8dd-66dd61cc5d47 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1267 microversion: 2.1 time: 0.575028 Jul 20 04:50:17.082541 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3004/6238] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:16 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1267 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:18.091567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:18.092882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:18.097397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ea460ebd-c3fa-448e-9310-dda421941248 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:18.098151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ea460ebd-c3fa-448e-9310-dda421941248 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:18.119222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea460ebd-c3fa-448e-9310-dda421941248 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:18.119790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea460ebd-c3fa-448e-9310-dda421941248 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:18.120624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea460ebd-c3fa-448e-9310-dda421941248 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:18.121067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea460ebd-c3fa-448e-9310-dda421941248 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:18.418417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ea460ebd-c3fa-448e-9310-dda421941248 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:18.444893 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ea460ebd-c3fa-448e-9310-dda421941248 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1267 microversion: 2.1 time: 0.354765 Jul 20 04:50:18.485616 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3235/6239] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:18 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1267 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:19.491074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-960a5898-1e64-4f24-b3d4-a9115e9f3bec tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:19.491716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-960a5898-1e64-4f24-b3d4-a9115e9f3bec tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:19.495357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:19.509617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-960a5898-1e64-4f24-b3d4-a9115e9f3bec tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:19.510361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-960a5898-1e64-4f24-b3d4-a9115e9f3bec tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:19.511479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-960a5898-1e64-4f24-b3d4-a9115e9f3bec tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:19.511839 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-960a5898-1e64-4f24-b3d4-a9115e9f3bec tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:19.718103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-960a5898-1e64-4f24-b3d4-a9115e9f3bec tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:19.727855 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-960a5898-1e64-4f24-b3d4-a9115e9f3bec tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1267 microversion: 2.1 time: 0.240654 Jul 20 04:50:19.737871 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3005/6240] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:19 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1267 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:20.747930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d00c8572-1733-4efe-a98a-c517913f68ca tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:20.749518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d00c8572-1733-4efe-a98a-c517913f68ca tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:20.757683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d00c8572-1733-4efe-a98a-c517913f68ca tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:20.758741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d00c8572-1733-4efe-a98a-c517913f68ca tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:20.760087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d00c8572-1733-4efe-a98a-c517913f68ca tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:20.760928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d00c8572-1733-4efe-a98a-c517913f68ca tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:20.927968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d00c8572-1733-4efe-a98a-c517913f68ca tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:20.936456 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d00c8572-1733-4efe-a98a-c517913f68ca tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1267 microversion: 2.1 time: 0.194317 Jul 20 04:50:20.937248 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3236/6241] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:20 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:21.953982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-844514ba-e88d-4ccf-810d-3aa599b6dd42 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:21.955529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-844514ba-e88d-4ccf-810d-3aa599b6dd42 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:21.963476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-844514ba-e88d-4ccf-810d-3aa599b6dd42 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:21.964237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-844514ba-e88d-4ccf-810d-3aa599b6dd42 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:21.965167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-844514ba-e88d-4ccf-810d-3aa599b6dd42 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:21.965828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-844514ba-e88d-4ccf-810d-3aa599b6dd42 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:22.165603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-844514ba-e88d-4ccf-810d-3aa599b6dd42 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:22.174759 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-844514ba-e88d-4ccf-810d-3aa599b6dd42 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1267 microversion: 2.1 time: 0.224435 Jul 20 04:50:22.184628 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3006/6242] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:21 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:23.191390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e34d20a3-5981-4b05-95d3-83564e88b806 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:23.192060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e34d20a3-5981-4b05-95d3-83564e88b806 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:23.201944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e34d20a3-5981-4b05-95d3-83564e88b806 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:23.202635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e34d20a3-5981-4b05-95d3-83564e88b806 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:23.204132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e34d20a3-5981-4b05-95d3-83564e88b806 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:23.204603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e34d20a3-5981-4b05-95d3-83564e88b806 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:23.350633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e34d20a3-5981-4b05-95d3-83564e88b806 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:23.359684 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e34d20a3-5981-4b05-95d3-83564e88b806 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1267 microversion: 2.1 time: 0.172596 Jul 20 04:50:23.360469 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3237/6243] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:23 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:24.377033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6c4c81cf-1110-4145-8652-e49b99d591e8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:24.378276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6c4c81cf-1110-4145-8652-e49b99d591e8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:24.386635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c4c81cf-1110-4145-8652-e49b99d591e8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:24.387105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c4c81cf-1110-4145-8652-e49b99d591e8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:24.387904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c4c81cf-1110-4145-8652-e49b99d591e8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:24.388557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c4c81cf-1110-4145-8652-e49b99d591e8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:24.596607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6c4c81cf-1110-4145-8652-e49b99d591e8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:24.612981 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6c4c81cf-1110-4145-8652-e49b99d591e8 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1267 microversion: 2.1 time: 0.240052 Jul 20 04:50:24.615371 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3007/6244] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:24 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:25.122822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c1a38caf-f373-426e-8887-8206cf0b408a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:25.123319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c1a38caf-f373-426e-8887-8206cf0b408a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:25.127756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-8633ce77-8912-4184-a05c-b205ae4a4fdb req-ddde064c-fe2a-4725-9a8d-87ca1a1047e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dfaa1f0-02ae-495b-8a76-798f196026a6", "tag": "3f58cd69-4a4d-4b1c-b702-d369b59e734b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:25.143330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8633ce77-8912-4184-a05c-b205ae4a4fdb req-ddde064c-fe2a-4725-9a8d-87ca1a1047e7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:25.144306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8633ce77-8912-4184-a05c-b205ae4a4fdb req-ddde064c-fe2a-4725-9a8d-87ca1a1047e7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:25.152689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1a38caf-f373-426e-8887-8206cf0b408a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:25.153250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1a38caf-f373-426e-8887-8206cf0b408a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:25.155057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1a38caf-f373-426e-8887-8206cf0b408a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:25.157818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1a38caf-f373-426e-8887-8206cf0b408a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:25.163117 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-8633ce77-8912-4184-a05c-b205ae4a4fdb req-ddde064c-fe2a-4725-9a8d-87ca1a1047e7 service nova] Creating event network-changed:3f58cd69-4a4d-4b1c-b702-d369b59e734b for instance 5dfaa1f0-02ae-495b-8a76-798f196026a6 on n-h2-826526-5 Jul 20 04:50:25.169584 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-8633ce77-8912-4184-a05c-b205ae4a4fdb req-ddde064c-fe2a-4725-9a8d-87ca1a1047e7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048174 Jul 20 04:50:25.170556 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3008/6245] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:25.214398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c1a38caf-f373-426e-8887-8206cf0b408a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:50:25.318272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:25.405094 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c1a38caf-f373-426e-8887-8206cf0b408a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 204 len: 0 microversion: 2.1 time: 0.285091 Jul 20 04:50:25.406945 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3238/6246] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:50:25 2022] DELETE /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:50:25.420488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ccacffab-b356-4bec-9d27-a8733c09301a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:25.421780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ccacffab-b356-4bec-9d27-a8733c09301a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:25.430593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccacffab-b356-4bec-9d27-a8733c09301a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:25.431969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccacffab-b356-4bec-9d27-a8733c09301a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:25.433150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccacffab-b356-4bec-9d27-a8733c09301a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:25.433780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccacffab-b356-4bec-9d27-a8733c09301a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:25.638138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a7eff264-bae8-4ece-8404-be736e3ca706 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:25.639125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a7eff264-bae8-4ece-8404-be736e3ca706 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:25.646938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7eff264-bae8-4ece-8404-be736e3ca706 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:25.647626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7eff264-bae8-4ece-8404-be736e3ca706 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:25.648718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7eff264-bae8-4ece-8404-be736e3ca706 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:25.649448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7eff264-bae8-4ece-8404-be736e3ca706 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:25.696055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ccacffab-b356-4bec-9d27-a8733c09301a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:25.717961 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ccacffab-b356-4bec-9d27-a8733c09301a tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1688 microversion: 2.1 time: 0.303523 Jul 20 04:50:25.719697 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3009/6247] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:25 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1688 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:50:25.832774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a7eff264-bae8-4ece-8404-be736e3ca706 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:25.845265 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a7eff264-bae8-4ece-8404-be736e3ca706 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1267 microversion: 2.1 time: 0.215176 Jul 20 04:50:25.846508 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3239/6248] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:25 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:26.741359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bc51eb4d-7cff-4a01-8095-b8f21e978519 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:26.742013 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bc51eb4d-7cff-4a01-8095-b8f21e978519 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:26.762330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc51eb4d-7cff-4a01-8095-b8f21e978519 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:26.763983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc51eb4d-7cff-4a01-8095-b8f21e978519 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:26.765068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc51eb4d-7cff-4a01-8095-b8f21e978519 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:26.765863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc51eb4d-7cff-4a01-8095-b8f21e978519 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:26.865171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-194edd71-9671-4def-bcfc-70096a0d273f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:26.866504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-194edd71-9671-4def-bcfc-70096a0d273f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:26.892428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-194edd71-9671-4def-bcfc-70096a0d273f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:26.893098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-194edd71-9671-4def-bcfc-70096a0d273f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:26.894080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-194edd71-9671-4def-bcfc-70096a0d273f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:26.894789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-194edd71-9671-4def-bcfc-70096a0d273f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:27.133503 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-194edd71-9671-4def-bcfc-70096a0d273f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:27.149011 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-194edd71-9671-4def-bcfc-70096a0d273f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1267 microversion: 2.1 time: 0.289320 Jul 20 04:50:27.150034 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3240/6249] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:26 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1267 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:27.214887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bc51eb4d-7cff-4a01-8095-b8f21e978519 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:27.253754 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bc51eb4d-7cff-4a01-8095-b8f21e978519 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1688 microversion: 2.1 time: 0.512312 Jul 20 04:50:27.254840 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3010/6250] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:26 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1688 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:27.411225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-df6a080f-be9a-4e63-b9da-98207b5d15a1 req-f4bf85e9-937a-48b1-b0ab-814222270205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01995acf-17fd-4f88-8a11-94bc6d7e4660", "name": "network-vif-plugged", "status": "completed", "tag": "0ca1c5d5-8446-4b52-bd23-4c77b26e751c"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:27.432362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-df6a080f-be9a-4e63-b9da-98207b5d15a1 req-f4bf85e9-937a-48b1-b0ab-814222270205 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:27.434034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-df6a080f-be9a-4e63-b9da-98207b5d15a1 req-f4bf85e9-937a-48b1-b0ab-814222270205 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:27.471875 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-df6a080f-be9a-4e63-b9da-98207b5d15a1 req-f4bf85e9-937a-48b1-b0ab-814222270205 service nova] Creating event network-vif-plugged:0ca1c5d5-8446-4b52-bd23-4c77b26e751c for instance 01995acf-17fd-4f88-8a11-94bc6d7e4660 on n-h1-826526-5 Jul 20 04:50:27.481214 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-df6a080f-be9a-4e63-b9da-98207b5d15a1 req-f4bf85e9-937a-48b1-b0ab-814222270205 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076347 Jul 20 04:50:27.482420 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3241/6251] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:27.642811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-0ec73906-4359-497f-aa17-8ff91c76b169 req-457609a9-19df-4a8a-b7c6-6ca68b239937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dfaa1f0-02ae-495b-8a76-798f196026a6", "name": "network-vif-deleted", "tag": "3f58cd69-4a4d-4b1c-b702-d369b59e734b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:27.682696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0ec73906-4359-497f-aa17-8ff91c76b169 req-457609a9-19df-4a8a-b7c6-6ca68b239937 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:27.683175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0ec73906-4359-497f-aa17-8ff91c76b169 req-457609a9-19df-4a8a-b7c6-6ca68b239937 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:27.726198 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-0ec73906-4359-497f-aa17-8ff91c76b169 req-457609a9-19df-4a8a-b7c6-6ca68b239937 service nova] Creating event network-vif-deleted:3f58cd69-4a4d-4b1c-b702-d369b59e734b for instance 5dfaa1f0-02ae-495b-8a76-798f196026a6 on n-h2-826526-5 Jul 20 04:50:27.745127 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-0ec73906-4359-497f-aa17-8ff91c76b169 req-457609a9-19df-4a8a-b7c6-6ca68b239937 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105971 Jul 20 04:50:27.746482 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3011/6252] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:28.169862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8711b461-5f34-4a28-aed5-4a69abf7aded tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:28.170590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8711b461-5f34-4a28-aed5-4a69abf7aded tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:28.178760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8711b461-5f34-4a28-aed5-4a69abf7aded tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:28.179289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8711b461-5f34-4a28-aed5-4a69abf7aded tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:28.180133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8711b461-5f34-4a28-aed5-4a69abf7aded tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:28.180852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8711b461-5f34-4a28-aed5-4a69abf7aded tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:28.275742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8da82204-9519-4b3e-b512-142f2fae96ba tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:28.276631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8da82204-9519-4b3e-b512-142f2fae96ba tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:28.278716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:28.296073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8da82204-9519-4b3e-b512-142f2fae96ba tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:28.296893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8da82204-9519-4b3e-b512-142f2fae96ba tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:28.299053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8da82204-9519-4b3e-b512-142f2fae96ba tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:28.300532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8da82204-9519-4b3e-b512-142f2fae96ba tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:28.354145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8da82204-9519-4b3e-b512-142f2fae96ba tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:28.355160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8da82204-9519-4b3e-b512-142f2fae96ba tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:28.355886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-8da82204-9519-4b3e-b512-142f2fae96ba tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lazy-loading 'fault' on Instance uuid 5dfaa1f0-02ae-495b-8a76-798f196026a6 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:50:28.393612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8711b461-5f34-4a28-aed5-4a69abf7aded tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:28.403987 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8711b461-5f34-4a28-aed5-4a69abf7aded tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1267 microversion: 2.1 time: 0.240188 Jul 20 04:50:28.404621 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3242/6253] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:28 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1267 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:28.423215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8da82204-9519-4b3e-b512-142f2fae96ba tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffe347e0a094346afd74f178a0fde5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a678d19d82d248958a3d7df804ccfa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:28.431250 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8da82204-9519-4b3e-b512-142f2fae96ba tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 200 len: 1357 microversion: 2.1 time: 0.163536 Jul 20 04:50:28.432217 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3012/6254] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:28 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:28.448682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-632e8ee3-8b3c-4308-ad5f-f0f10e67cbbd tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:28.450114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-632e8ee3-8b3c-4308-ad5f-f0f10e67cbbd tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:28.457564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-632e8ee3-8b3c-4308-ad5f-f0f10e67cbbd tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:28.458410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-632e8ee3-8b3c-4308-ad5f-f0f10e67cbbd tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:28.459202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-632e8ee3-8b3c-4308-ad5f-f0f10e67cbbd tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:28.459809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-632e8ee3-8b3c-4308-ad5f-f0f10e67cbbd tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:28.498120 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-632e8ee3-8b3c-4308-ad5f-f0f10e67cbbd tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055348 Jul 20 04:50:28.499460 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3243/6255] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:50:28 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:28.645777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-750cccab-f4ac-4b6e-a080-2dd8e5abb63f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:28.646481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-750cccab-f4ac-4b6e-a080-2dd8e5abb63f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:28.655058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-750cccab-f4ac-4b6e-a080-2dd8e5abb63f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:28.655799 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-750cccab-f4ac-4b6e-a080-2dd8e5abb63f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:28.656846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-750cccab-f4ac-4b6e-a080-2dd8e5abb63f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:28.657851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-750cccab-f4ac-4b6e-a080-2dd8e5abb63f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:28.705926 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-750cccab-f4ac-4b6e-a080-2dd8e5abb63f tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments/f6fc0540-70d8-4771-a695-20ff597cc623" status: 200 len: 194 microversion: 2.1 time: 0.066842 Jul 20 04:50:28.708512 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3013/6256] 10.222.0.17 () {58 vars in 1412 bytes} [Wed Jul 20 04:50:28 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments/f6fc0540-70d8-4771-a695-20ff597cc623 => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:28.718257 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fb73b852-e99b-49f2-bc19-976b39d5fcb4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:28.718748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fb73b852-e99b-49f2-bc19-976b39d5fcb4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:28.738530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb73b852-e99b-49f2-bc19-976b39d5fcb4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:28.739178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb73b852-e99b-49f2-bc19-976b39d5fcb4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:28.740113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb73b852-e99b-49f2-bc19-976b39d5fcb4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:28.740837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb73b852-e99b-49f2-bc19-976b39d5fcb4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:28.867137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-fb73b852-e99b-49f2-bc19-976b39d5fcb4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lazy-loading 'services' on Instance uuid ece988e9-4b9b-4016-83bb-28eebecaff03 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:50:29.005959 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fb73b852-e99b-49f2-bc19-976b39d5fcb4 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments/f6fc0540-70d8-4771-a695-20ff597cc623" status: 202 len: 0 microversion: 2.1 time: 0.291121 Jul 20 04:50:29.008665 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3244/6257] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 04:50:28 2022] DELETE /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments/f6fc0540-70d8-4771-a695-20ff597cc623 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:50:29.425921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-34613a89-70be-4a37-b8c9-545479e8dc44 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:29.426944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-34613a89-70be-4a37-b8c9-545479e8dc44 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:29.437294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-34613a89-70be-4a37-b8c9-545479e8dc44 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:29.438114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-34613a89-70be-4a37-b8c9-545479e8dc44 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:29.439242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-34613a89-70be-4a37-b8c9-545479e8dc44 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:29.440199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-34613a89-70be-4a37-b8c9-545479e8dc44 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:29.450118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-85452140-486f-4cf8-85d4-6b6648a5f30c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:29.451636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-85452140-486f-4cf8-85d4-6b6648a5f30c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] [instance: 5dfaa1f0-02ae-495b-8a76-798f196026a6] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:29.462560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85452140-486f-4cf8-85d4-6b6648a5f30c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:29.463427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85452140-486f-4cf8-85d4-6b6648a5f30c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:29.464986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85452140-486f-4cf8-85d4-6b6648a5f30c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:29.465691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-85452140-486f-4cf8-85d4-6b6648a5f30c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:29.486031 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-85452140-486f-4cf8-85d4-6b6648a5f30c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] HTTP exception thrown: Instance 5dfaa1f0-02ae-495b-8a76-798f196026a6 could not be found. Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-85452140-486f-4cf8-85d4-6b6648a5f30c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Request method failure captured: Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 HTTP/1.1 Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14c5OmC7e7piHc62Oprmt58gJ43Ds2Gqro50k_jodCbcdTngwgD8D9bbOTQvC3Ba8WRVQD5lFU65LIKPn-I3EI2C2ZihLQJYKiEb4d5a-fdETDJHV4IJmro-RJ_S60NX-1yKHowzAlku6MRitdI9SUmpfigUaUfx-6x70eCIR240NVE Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: a678d19d82d248958a3d7df804ccfa95 Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-574298032 Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a678d19d82d248958a3d7df804ccfa95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a678d19d82d248958a3d7df804ccfa95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a678d19d82d248958a3d7df804ccfa95", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a678d19d82d248958a3d7df804ccfa95"}]}] Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestNetworkAdvancedServerOps-574298032 Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: a678d19d82d248958a3d7df804ccfa95 Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-574298032 Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestNetworkAdvancedServerOps-574298032-project Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: cffe347e0a094346afd74f178a0fde5d Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestNetworkAdvancedServerOps-574298032-project Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 5dfaa1f0-02ae-495b-8a76-798f196026a6 could not be found. Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '5dfaa1f0-02ae-495b-8a76-798f196026a6'} Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dfaa1f0-02ae-495b-8a76-798f196026a6 could not be found. Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dfaa1f0-02ae-495b-8a76-798f196026a6 could not be found. Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:50:29.488875 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:50:29.493777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:29.493777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:50:29.493777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:50:29.493777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:50:29.493777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:50:29.493777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dfaa1f0-02ae-495b-8a76-798f196026a6 could not be found. Jul 20 04:50:29.493777 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:50:29.495301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-85452140-486f-4cf8-85d4-6b6648a5f30c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Returning 404 to user: Instance 5dfaa1f0-02ae-495b-8a76-798f196026a6 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:50:29.496507 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-85452140-486f-4cf8-85d4-6b6648a5f30c tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6" status: 404 len: 111 microversion: 2.1 time: 0.051356 Jul 20 04:50:29.502608 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3245/6258] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:29 2022] GET /compute/v2.1/servers/5dfaa1f0-02ae-495b-8a76-798f196026a6 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:50:29.698774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-34613a89-70be-4a37-b8c9-545479e8dc44 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:29.709998 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-34613a89-70be-4a37-b8c9-545479e8dc44 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1453 microversion: 2.1 time: 0.291696 Jul 20 04:50:29.713118 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3014/6259] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:29 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1453 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:29.728008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-94a56026-f126-4518-9d8b-54186fadd738 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:29.730835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-94a56026-f126-4518-9d8b-54186fadd738 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:29.744232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-94a56026-f126-4518-9d8b-54186fadd738 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:29.744721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-94a56026-f126-4518-9d8b-54186fadd738 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:29.745521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-94a56026-f126-4518-9d8b-54186fadd738 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:29.745964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-94a56026-f126-4518-9d8b-54186fadd738 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:30.128085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-94a56026-f126-4518-9d8b-54186fadd738 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:30.140763 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-94a56026-f126-4518-9d8b-54186fadd738 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1453 microversion: 2.1 time: 0.415558 Jul 20 04:50:30.156035 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3246/6260] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:29 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1453 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:35.724212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-7ec7ea38-395a-453f-8d9e-b1c75e2dac4e req-f42c4196-e768-4fca-bbfb-ccf2c78e26b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01995acf-17fd-4f88-8a11-94bc6d7e4660", "tag": "0ca1c5d5-8446-4b52-bd23-4c77b26e751c"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:35.738059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7ec7ea38-395a-453f-8d9e-b1c75e2dac4e req-f42c4196-e768-4fca-bbfb-ccf2c78e26b8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:35.738967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7ec7ea38-395a-453f-8d9e-b1c75e2dac4e req-f42c4196-e768-4fca-bbfb-ccf2c78e26b8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:35.775194 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-7ec7ea38-395a-453f-8d9e-b1c75e2dac4e req-f42c4196-e768-4fca-bbfb-ccf2c78e26b8 service nova] Creating event network-changed:0ca1c5d5-8446-4b52-bd23-4c77b26e751c for instance 01995acf-17fd-4f88-8a11-94bc6d7e4660 on n-h1-826526-5 Jul 20 04:50:35.804401 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-7ec7ea38-395a-453f-8d9e-b1c75e2dac4e req-f42c4196-e768-4fca-bbfb-ccf2c78e26b8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077147 Jul 20 04:50:35.806142 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3015/6261] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:37.656583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-73ae2e3b-9f4e-4a4d-898e-8e0835abea69 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:37.657208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-73ae2e3b-9f4e-4a4d-898e-8e0835abea69 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:37.668485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:37.702300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73ae2e3b-9f4e-4a4d-898e-8e0835abea69 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:37.714212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73ae2e3b-9f4e-4a4d-898e-8e0835abea69 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:37.715201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73ae2e3b-9f4e-4a4d-898e-8e0835abea69 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:37.715666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73ae2e3b-9f4e-4a4d-898e-8e0835abea69 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:37.845730 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-73ae2e3b-9f4e-4a4d-898e-8e0835abea69 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments/5face541-00f7-4c8b-aca6-70c955373550" status: 200 len: 194 microversion: 2.1 time: 0.192702 Jul 20 04:50:37.850844 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3247/6262] 10.222.0.17 () {58 vars in 1412 bytes} [Wed Jul 20 04:50:37 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments/5face541-00f7-4c8b-aca6-70c955373550 => generated 194 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:37.860020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fcda7517-a787-4f05-94bf-197262680ea3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:37.860718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fcda7517-a787-4f05-94bf-197262680ea3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:37.878259 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fcda7517-a787-4f05-94bf-197262680ea3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:37.882494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fcda7517-a787-4f05-94bf-197262680ea3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:37.885972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fcda7517-a787-4f05-94bf-197262680ea3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:37.886577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fcda7517-a787-4f05-94bf-197262680ea3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:38.204556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-fcda7517-a787-4f05-94bf-197262680ea3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lazy-loading 'services' on Instance uuid ece988e9-4b9b-4016-83bb-28eebecaff03 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:50:38.391299 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fcda7517-a787-4f05-94bf-197262680ea3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments/5face541-00f7-4c8b-aca6-70c955373550" status: 202 len: 0 microversion: 2.1 time: 0.537766 Jul 20 04:50:38.401856 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3016/6263] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 04:50:37 2022] DELETE /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments/5face541-00f7-4c8b-aca6-70c955373550 => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:50:40.122470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-60f9ed72-c3d4-4a39-b49d-365c8c8a1ec0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] Calling method '.version_select at 0x7f06c73b2e50>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:40.169955 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-60f9ed72-c3d4-4a39-b49d-365c8c8a1ec0 tempest-TestNetworkAdvancedServerOps-574298032 tempest-TestNetworkAdvancedServerOps-574298032-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1871636326" status: 202 len: 0 microversion: 2.1 time: 0.051464 Jul 20 04:50:40.173240 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3248/6264] 10.222.0.17 () {58 vars in 1283 bytes} [Wed Jul 20 04:50:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1871636326 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:50:44.906271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-336ca634-7525-4a20-b652-b8b86a6d0751 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Action: 'create', calling method: .version_select at 0x7f06be1e5820>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-352168082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRjnaJ4S6LVDg6tSXxbLL/tE5EU/IFKkE9vO7AiBkedAIVhYGjObWPgHPdvN4qNu22EfTFFXki+baJqF82X8ZEDOr7aO3rXjiNZfZjdd25W9gfmYWSmtwBPwbSOQuoSNg=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:44.927081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-336ca634-7525-4a20-b652-b8b86a6d0751 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Getting quotas for project 222a979e18d041edbe26d2f393181846. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:50:44.935151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-336ca634-7525-4a20-b652-b8b86a6d0751 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Getting quotas for user 5a107bc948d74e05a622710e8758f841 and project 222a979e18d041edbe26d2f393181846. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:50:44.981144 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-336ca634-7525-4a20-b652-b8b86a6d0751 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.437655 Jul 20 04:50:44.989778 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3017/6265] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:50:44 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:46.372136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d538916f-883e-40b8-a4d7-4a50c3109466 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:46.375439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d538916f-883e-40b8-a4d7-4a50c3109466 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:46.408611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d538916f-883e-40b8-a4d7-4a50c3109466 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:46.409330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d538916f-883e-40b8-a4d7-4a50c3109466 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:46.412347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d538916f-883e-40b8-a4d7-4a50c3109466 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:46.414352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d538916f-883e-40b8-a4d7-4a50c3109466 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:46.507629 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d538916f-883e-40b8-a4d7-4a50c3109466 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.145558 Jul 20 04:50:46.508765 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3249/6266] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:50:46 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments => generated 25 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:50:46.707504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-edccb051-aefd-4392-a91c-7a54755527c6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:46.709738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-edccb051-aefd-4392-a91c-7a54755527c6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:46.721097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-edccb051-aefd-4392-a91c-7a54755527c6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:46.722001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-edccb051-aefd-4392-a91c-7a54755527c6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:46.723274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-edccb051-aefd-4392-a91c-7a54755527c6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:46.724290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-edccb051-aefd-4392-a91c-7a54755527c6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:46.729930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:46.780992 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-edccb051-aefd-4392-a91c-7a54755527c6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079561 Jul 20 04:50:46.797952 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3018/6267] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:50:46 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:50:46.851865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0d07588e-8ce9-48ee-b52d-81101f49b0b1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:46.852460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0d07588e-8ce9-48ee-b52d-81101f49b0b1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:46.861404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d07588e-8ce9-48ee-b52d-81101f49b0b1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:46.862174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d07588e-8ce9-48ee-b52d-81101f49b0b1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:46.863725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d07588e-8ce9-48ee-b52d-81101f49b0b1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:46.864932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d07588e-8ce9-48ee-b52d-81101f49b0b1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:46.904746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0d07588e-8ce9-48ee-b52d-81101f49b0b1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:50:47.024538 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0d07588e-8ce9-48ee-b52d-81101f49b0b1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03" status: 204 len: 0 microversion: 2.1 time: 0.176354 Jul 20 04:50:47.026393 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3250/6268] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:50:46 2022] DELETE /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:50:47.034744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4d61c8bb-afae-4ac8-b9ef-37987076bc32 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:47.036117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4d61c8bb-afae-4ac8-b9ef-37987076bc32 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:47.043571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d61c8bb-afae-4ac8-b9ef-37987076bc32 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:47.044039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d61c8bb-afae-4ac8-b9ef-37987076bc32 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:47.046734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d61c8bb-afae-4ac8-b9ef-37987076bc32 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:47.047224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d61c8bb-afae-4ac8-b9ef-37987076bc32 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:47.364709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4d61c8bb-afae-4ac8-b9ef-37987076bc32 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:47.379507 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4d61c8bb-afae-4ac8-b9ef-37987076bc32 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03" status: 200 len: 1672 microversion: 2.1 time: 0.348932 Jul 20 04:50:47.380683 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3019/6269] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:47 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 => generated 1672 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:48.398378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-93b065e0-8b49-4852-8e4e-f8d45bf0ede5 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:48.399228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-93b065e0-8b49-4852-8e4e-f8d45bf0ede5 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:48.407331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93b065e0-8b49-4852-8e4e-f8d45bf0ede5 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:48.408362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93b065e0-8b49-4852-8e4e-f8d45bf0ede5 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:48.409668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93b065e0-8b49-4852-8e4e-f8d45bf0ede5 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:48.410383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-93b065e0-8b49-4852-8e4e-f8d45bf0ede5 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:48.599256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-93b065e0-8b49-4852-8e4e-f8d45bf0ede5 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:48.608563 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-93b065e0-8b49-4852-8e4e-f8d45bf0ede5 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03" status: 200 len: 1672 microversion: 2.1 time: 0.214436 Jul 20 04:50:48.618459 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3251/6270] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:48 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 => generated 1672 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:49.635925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf9e526c-a49f-44c4-8128-72797bdf24d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:49.636992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cf9e526c-a49f-44c4-8128-72797bdf24d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:49.656414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf9e526c-a49f-44c4-8128-72797bdf24d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:49.656940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf9e526c-a49f-44c4-8128-72797bdf24d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:49.657854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf9e526c-a49f-44c4-8128-72797bdf24d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:49.658352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf9e526c-a49f-44c4-8128-72797bdf24d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:50.029293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cf9e526c-a49f-44c4-8128-72797bdf24d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:50.074540 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cf9e526c-a49f-44c4-8128-72797bdf24d1 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03" status: 200 len: 1672 microversion: 2.1 time: 0.442723 Jul 20 04:50:50.075791 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3020/6271] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:49 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 => generated 1672 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:51.138020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9e924b59-dc6d-4b9b-8ad6-40b4ac046ec7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:51.141309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9e924b59-dc6d-4b9b-8ad6-40b4ac046ec7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:51.161775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e924b59-dc6d-4b9b-8ad6-40b4ac046ec7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:51.162473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e924b59-dc6d-4b9b-8ad6-40b4ac046ec7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:51.164167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e924b59-dc6d-4b9b-8ad6-40b4ac046ec7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:51.164969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e924b59-dc6d-4b9b-8ad6-40b4ac046ec7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:51.394945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9e924b59-dc6d-4b9b-8ad6-40b4ac046ec7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8bade1b5244107b43bdf34c9663dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf61df9cc1e340469412fe282057f903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:51.395184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-a00cfcce-60ef-41a5-ab8b-f3a653cffe25 req-7e5bab07-9007-45df-a087-42bb7b26be4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece988e9-4b9b-4016-83bb-28eebecaff03", "name": "network-vif-deleted", "tag": "b5fd2411-aea9-45dd-955e-5d3e83373de2"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:51.406661 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9e924b59-dc6d-4b9b-8ad6-40b4ac046ec7 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03" status: 200 len: 1604 microversion: 2.1 time: 0.301674 Jul 20 04:50:51.420433 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3252/6272] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:51 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 => generated 1604 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:51.426599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a00cfcce-60ef-41a5-ab8b-f3a653cffe25 req-7e5bab07-9007-45df-a087-42bb7b26be4f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:51.434762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a00cfcce-60ef-41a5-ab8b-f3a653cffe25 req-7e5bab07-9007-45df-a087-42bb7b26be4f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:51.491858 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-a00cfcce-60ef-41a5-ab8b-f3a653cffe25 req-7e5bab07-9007-45df-a087-42bb7b26be4f service nova] Creating event network-vif-deleted:b5fd2411-aea9-45dd-955e-5d3e83373de2 for instance ece988e9-4b9b-4016-83bb-28eebecaff03 on n-h2-826526-5 Jul 20 04:50:51.527165 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-a00cfcce-60ef-41a5-ab8b-f3a653cffe25 req-7e5bab07-9007-45df-a087-42bb7b26be4f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130658 Jul 20 04:50:51.529894 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3021/6273] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:50:52.437094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-54ed108a-4562-4617-a1e7-976288f4cf6a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:52.437968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-54ed108a-4562-4617-a1e7-976288f4cf6a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:52.455529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54ed108a-4562-4617-a1e7-976288f4cf6a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:52.463552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54ed108a-4562-4617-a1e7-976288f4cf6a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:52.464494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54ed108a-4562-4617-a1e7-976288f4cf6a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:52.466545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54ed108a-4562-4617-a1e7-976288f4cf6a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:52.528984 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-54ed108a-4562-4617-a1e7-976288f4cf6a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] HTTP exception thrown: Instance ece988e9-4b9b-4016-83bb-28eebecaff03 could not be found. Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-54ed108a-4562-4617-a1e7-976288f4cf6a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Request method failure captured: Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 HTTP/1.1 Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14hrxprVuz_dHHOcR8GTo7pu8oCPLaQwPysrUltUoQBMKG3EqE-4oLk9T0h1XMYcyu1LBfKJBCVuAPbSsxe2W99Xl1mxIlOeXYH_2W5rgSXfZky8i8sul9PUmO6H70mSQjHTpDxAEZitdYiOtIRrpg803BtaQXjc4s8jpEEKwJfeT60 Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: bf61df9cc1e340469412fe282057f903 Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AttachVolumeTestJSON-2123877240 Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bf61df9cc1e340469412fe282057f903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bf61df9cc1e340469412fe282057f903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bf61df9cc1e340469412fe282057f903", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bf61df9cc1e340469412fe282057f903"}]}] Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AttachVolumeTestJSON-2123877240 Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: bf61df9cc1e340469412fe282057f903 Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2123877240 Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AttachVolumeTestJSON-2123877240-project Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 4a8bade1b5244107b43bdf34c9663dc7 Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AttachVolumeTestJSON-2123877240-project Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance ece988e9-4b9b-4016-83bb-28eebecaff03 could not be found. Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'ece988e9-4b9b-4016-83bb-28eebecaff03'} Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece988e9-4b9b-4016-83bb-28eebecaff03 could not be found. Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece988e9-4b9b-4016-83bb-28eebecaff03 could not be found. Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:50:52.531251 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:50:52.536705 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:52.536705 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:50:52.536705 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:50:52.536705 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:50:52.536705 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:50:52.536705 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece988e9-4b9b-4016-83bb-28eebecaff03 could not be found. Jul 20 04:50:52.536705 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:50:52.546441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-54ed108a-4562-4617-a1e7-976288f4cf6a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Returning 404 to user: Instance ece988e9-4b9b-4016-83bb-28eebecaff03 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:50:52.549010 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-54ed108a-4562-4617-a1e7-976288f4cf6a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03" status: 404 len: 111 microversion: 2.1 time: 0.115432 Jul 20 04:50:52.551642 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3253/6274] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:52 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:50:52.561325 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-68a223fa-7ff9-48ab-80ba-1b8e1fc18da6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '.version_select at 0x7f06bebb8160>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:52.640499 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-68a223fa-7ff9-48ab-80ba-1b8e1fc18da6 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1609813670" status: 202 len: 0 microversion: 2.1 time: 0.083852 Jul 20 04:50:52.644861 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3022/6275] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jul 20 04:50:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1609813670 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:50:56.600602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8e976bf6-c004-489a-9938-7eb3b8f8aaf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1246159580-access_point-173823386", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "1b72ad82-fdac-48da-a26d-5e533244a6ec"}], "key_name": "tempest-TestSecurityGroupsBasicOps-352168082", "security_groups": [{"name": "tempest-secgroup_access--1198830103"}, {"name": "tempest-secgroup_general--1122251770"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:56.647828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:56.824868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b1a80954-6347-4819-a6ac-edb27ce0f882 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1403795317 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1403795317-project-admin] Calling method '.version_select at 0x7f06bd3ee940>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:56.826670 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:50:56.826670 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:50:56.828303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b1a80954-6347-4819-a6ac-edb27ce0f882 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1403795317 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1403795317-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:56.829148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b1a80954-6347-4819-a6ac-edb27ce0f882 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1403795317 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1403795317-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:56.848599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=84,nova_cell1:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:56.885714 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b1a80954-6347-4819-a6ac-edb27ce0f882 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1403795317 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1403795317-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:56.886171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b1a80954-6347-4819-a6ac-edb27ce0f882 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1403795317 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1403795317-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:56.903452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b1a80954-6347-4819-a6ac-edb27ce0f882 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1403795317 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1403795317-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:56.904163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b1a80954-6347-4819-a6ac-edb27ce0f882 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1403795317 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1403795317-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:56.913752 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b1a80954-6347-4819-a6ac-edb27ce0f882 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1403795317 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1403795317-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.414310 Jul 20 04:50:56.915351 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3254/6276] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:50:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:57.039890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-8e976bf6-c004-489a-9938-7eb3b8f8aaf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] validate_networks() for [('1b72ad82-fdac-48da-a26d-5e533244a6ec', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:50:58.262248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8e976bf6-c004-489a-9938-7eb3b8f8aaf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:50:58.263692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8e976bf6-c004-489a-9938-7eb3b8f8aaf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:50:58.264693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8e976bf6-c004-489a-9938-7eb3b8f8aaf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:50:58.265730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8e976bf6-c004-489a-9938-7eb3b8f8aaf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:50:58.266478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8e976bf6-c004-489a-9938-7eb3b8f8aaf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:50:58.303953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e976bf6-c004-489a-9938-7eb3b8f8aaf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:58.304995 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e976bf6-c004-489a-9938-7eb3b8f8aaf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:58.306659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e976bf6-c004-489a-9938-7eb3b8f8aaf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:58.307483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e976bf6-c004-489a-9938-7eb3b8f8aaf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:58.372131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:58.410108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8e976bf6-c004-489a-9938-7eb3b8f8aaf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Getting quotas for project 222a979e18d041edbe26d2f393181846. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:50:58.433658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8e976bf6-c004-489a-9938-7eb3b8f8aaf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Getting quotas for user 5a107bc948d74e05a622710e8758f841 and project 222a979e18d041edbe26d2f393181846. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:50:58.478286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8e976bf6-c004-489a-9938-7eb3b8f8aaf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:50:58.489461 n-d-826526-5 devstack@n-api.service[127870]: WARNING nova.utils [None req-8e976bf6-c004-489a-9938-7eb3b8f8aaf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1246159580-access_point-173823386 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1246159580-ac Jul 20 04:50:58.490654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8e976bf6-c004-489a-9938-7eb3b8f8aaf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:50:58.682279 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8e976bf6-c004-489a-9938-7eb3b8f8aaf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 2.086085 Jul 20 04:50:58.685446 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3023/6277] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:50:56 2022] POST /compute/v2.1/servers => generated 458 bytes in 2090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:50:58.696420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ee235731-c26e-4168-9681-c40014f46c0f tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:58.697049 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ee235731-c26e-4168-9681-c40014f46c0f tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:58.844868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ee235731-c26e-4168-9681-c40014f46c0f tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:58.881496 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ee235731-c26e-4168-9681-c40014f46c0f tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 200 len: 1293 microversion: 2.1 time: 0.186522 Jul 20 04:50:58.891701 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3255/6278] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:58 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 1293 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:59.906338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4a1fdd8d-0d7d-40b8-bcb5-d091a32312b8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:59.907081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4a1fdd8d-0d7d-40b8-bcb5-d091a32312b8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:00.022114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4a1fdd8d-0d7d-40b8-bcb5-d091a32312b8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:00.030731 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4a1fdd8d-0d7d-40b8-bcb5-d091a32312b8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 200 len: 1293 microversion: 2.1 time: 0.129814 Jul 20 04:51:00.032740 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3024/6279] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:59 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 1293 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:01.063353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a918911e-f0e8-414a-bbec-8543585745cc tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:01.064854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a918911e-f0e8-414a-bbec-8543585745cc tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:01.075673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a918911e-f0e8-414a-bbec-8543585745cc tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:01.076387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a918911e-f0e8-414a-bbec-8543585745cc tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:01.077439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a918911e-f0e8-414a-bbec-8543585745cc tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:01.078029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a918911e-f0e8-414a-bbec-8543585745cc tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:01.227318 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a918911e-f0e8-414a-bbec-8543585745cc tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:01.244810 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a918911e-f0e8-414a-bbec-8543585745cc tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 200 len: 1351 microversion: 2.1 time: 0.192641 Jul 20 04:51:01.262659 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3256/6280] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:01 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 1351 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:02.286861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-69afc77f-b149-4db6-8bc9-136a13499f65 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:02.288631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-69afc77f-b149-4db6-8bc9-136a13499f65 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:02.302774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-69afc77f-b149-4db6-8bc9-136a13499f65 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:02.303486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-69afc77f-b149-4db6-8bc9-136a13499f65 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:02.304535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-69afc77f-b149-4db6-8bc9-136a13499f65 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:02.305145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-69afc77f-b149-4db6-8bc9-136a13499f65 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:02.847842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-69afc77f-b149-4db6-8bc9-136a13499f65 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:02.873080 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-69afc77f-b149-4db6-8bc9-136a13499f65 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 200 len: 1471 microversion: 2.1 time: 0.586921 Jul 20 04:51:02.876036 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3025/6281] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:02 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 1471 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:03.855547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-b71ae468-89cb-43ae-9f43-f118bf16fb10 req-a4447a98-f246-4f3c-bcf6-3a792f695346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e4f01a-5e8a-44e9-91c1-d8c3d62eed43", "tag": "37fcf64f-a6f4-4362-9023-c589f3313737"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:03.870428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-b71ae468-89cb-43ae-9f43-f118bf16fb10 req-a4447a98-f246-4f3c-bcf6-3a792f695346 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:03.873779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-b71ae468-89cb-43ae-9f43-f118bf16fb10 req-a4447a98-f246-4f3c-bcf6-3a792f695346 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:03.894317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f7782c03-c1fa-47c4-b064-c28124392cd9 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:03.895640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f7782c03-c1fa-47c4-b064-c28124392cd9 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:03.930465 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-b71ae468-89cb-43ae-9f43-f118bf16fb10 req-a4447a98-f246-4f3c-bcf6-3a792f695346 service nova] Creating event network-changed:37fcf64f-a6f4-4362-9023-c589f3313737 for instance 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 on n-h2-826526-5 Jul 20 04:51:03.939257 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f7782c03-c1fa-47c4-b064-c28124392cd9 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:03.941114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f7782c03-c1fa-47c4-b064-c28124392cd9 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:03.945542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f7782c03-c1fa-47c4-b064-c28124392cd9 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:03.946220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f7782c03-c1fa-47c4-b064-c28124392cd9 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:03.951897 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-b71ae468-89cb-43ae-9f43-f118bf16fb10 req-a4447a98-f246-4f3c-bcf6-3a792f695346 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099198 Jul 20 04:51:03.955717 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3257/6282] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:04.407364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f7782c03-c1fa-47c4-b064-c28124392cd9 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:04.428674 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f7782c03-c1fa-47c4-b064-c28124392cd9 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 200 len: 1471 microversion: 2.1 time: 0.540865 Jul 20 04:51:04.431748 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3026/6283] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:03 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 1471 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:05.451161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ad5e7016-ee0a-4eaa-8923-0c03efbd4d8f tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:05.453194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ad5e7016-ee0a-4eaa-8923-0c03efbd4d8f tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:05.465908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad5e7016-ee0a-4eaa-8923-0c03efbd4d8f tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:05.466687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad5e7016-ee0a-4eaa-8923-0c03efbd4d8f tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:05.468168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad5e7016-ee0a-4eaa-8923-0c03efbd4d8f tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:05.468899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad5e7016-ee0a-4eaa-8923-0c03efbd4d8f tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:06.159694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ad5e7016-ee0a-4eaa-8923-0c03efbd4d8f tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:06.167294 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ad5e7016-ee0a-4eaa-8923-0c03efbd4d8f tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 200 len: 1471 microversion: 2.1 time: 0.722354 Jul 20 04:51:06.167930 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3258/6284] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:05 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 1471 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:07.185447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-22be70d5-21bb-4f4d-ba6e-9b16ab7a302c tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:07.186267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-22be70d5-21bb-4f4d-ba6e-9b16ab7a302c tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:07.212294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22be70d5-21bb-4f4d-ba6e-9b16ab7a302c tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:07.213822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22be70d5-21bb-4f4d-ba6e-9b16ab7a302c tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:07.215975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22be70d5-21bb-4f4d-ba6e-9b16ab7a302c tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:07.218998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22be70d5-21bb-4f4d-ba6e-9b16ab7a302c tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:07.259118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-838a1092-d205-4529-b518-11ce59c0193a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:07.260780 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-838a1092-d205-4529-b518-11ce59c0193a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:07.292535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-838a1092-d205-4529-b518-11ce59c0193a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:07.299787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-838a1092-d205-4529-b518-11ce59c0193a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:07.300737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-838a1092-d205-4529-b518-11ce59c0193a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:07.301182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-838a1092-d205-4529-b518-11ce59c0193a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:07.333829 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-838a1092-d205-4529-b518-11ce59c0193a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] HTTP exception thrown: Instance ece988e9-4b9b-4016-83bb-28eebecaff03 could not be found. Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-838a1092-d205-4529-b518-11ce59c0193a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Request method failure captured: Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 HTTP/1.1 Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14hrxprVuz_dHHOcR8GTo7pu8oCPLaQwPysrUltUoQBMKG3EqE-4oLk9T0h1XMYcyu1LBfKJBCVuAPbSsxe2W99Xl1mxIlOeXYH_2W5rgSXfZky8i8sul9PUmO6H70mSQjHTpDxAEZitdYiOtIRrpg803BtaQXjc4s8jpEEKwJfeT60 Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: bf61df9cc1e340469412fe282057f903 Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AttachVolumeTestJSON-2123877240 Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bf61df9cc1e340469412fe282057f903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bf61df9cc1e340469412fe282057f903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bf61df9cc1e340469412fe282057f903", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bf61df9cc1e340469412fe282057f903"}]}] Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AttachVolumeTestJSON-2123877240 Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: bf61df9cc1e340469412fe282057f903 Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2123877240 Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AttachVolumeTestJSON-2123877240-project Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 4a8bade1b5244107b43bdf34c9663dc7 Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AttachVolumeTestJSON-2123877240-project Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance ece988e9-4b9b-4016-83bb-28eebecaff03 could not be found. Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'ece988e9-4b9b-4016-83bb-28eebecaff03'} Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece988e9-4b9b-4016-83bb-28eebecaff03 could not be found. Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:51:07.335768 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:51:07.339872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece988e9-4b9b-4016-83bb-28eebecaff03 could not be found. Jul 20 04:51:07.339872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:51:07.339872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:07.339872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:51:07.339872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:07.339872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:07.339872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:07.339872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:51:07.339872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:51:07.339872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece988e9-4b9b-4016-83bb-28eebecaff03 could not be found. Jul 20 04:51:07.339872 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:51:07.341469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-838a1092-d205-4529-b518-11ce59c0193a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Returning 404 to user: Instance ece988e9-4b9b-4016-83bb-28eebecaff03 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:51:07.342533 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-838a1092-d205-4529-b518-11ce59c0193a tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03" status: 404 len: 111 microversion: 2.1 time: 0.091123 Jul 20 04:51:07.356458 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3259/6285] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:51:07 2022] DELETE /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:51:07.363214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4a8f9f98-e822-4642-aae8-ec459dc075d3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:07.365490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4a8f9f98-e822-4642-aae8-ec459dc075d3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: ece988e9-4b9b-4016-83bb-28eebecaff03] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:07.382347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4a8f9f98-e822-4642-aae8-ec459dc075d3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:07.383337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4a8f9f98-e822-4642-aae8-ec459dc075d3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:07.385221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4a8f9f98-e822-4642-aae8-ec459dc075d3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:07.386723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4a8f9f98-e822-4642-aae8-ec459dc075d3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:07.419602 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-4a8f9f98-e822-4642-aae8-ec459dc075d3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] HTTP exception thrown: Instance ece988e9-4b9b-4016-83bb-28eebecaff03 could not be found. Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4a8f9f98-e822-4642-aae8-ec459dc075d3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Request method failure captured: Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 HTTP/1.1 Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14hrxprVuz_dHHOcR8GTo7pu8oCPLaQwPysrUltUoQBMKG3EqE-4oLk9T0h1XMYcyu1LBfKJBCVuAPbSsxe2W99Xl1mxIlOeXYH_2W5rgSXfZky8i8sul9PUmO6H70mSQjHTpDxAEZitdYiOtIRrpg803BtaQXjc4s8jpEEKwJfeT60 Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: bf61df9cc1e340469412fe282057f903 Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AttachVolumeTestJSON-2123877240 Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bf61df9cc1e340469412fe282057f903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bf61df9cc1e340469412fe282057f903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bf61df9cc1e340469412fe282057f903", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bf61df9cc1e340469412fe282057f903"}]}] Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AttachVolumeTestJSON-2123877240 Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: bf61df9cc1e340469412fe282057f903 Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2123877240 Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AttachVolumeTestJSON-2123877240-project Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 4a8bade1b5244107b43bdf34c9663dc7 Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AttachVolumeTestJSON-2123877240-project Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance ece988e9-4b9b-4016-83bb-28eebecaff03 could not be found. Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'ece988e9-4b9b-4016-83bb-28eebecaff03'} Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece988e9-4b9b-4016-83bb-28eebecaff03 could not be found. Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece988e9-4b9b-4016-83bb-28eebecaff03 could not be found. Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:07.421623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:51:07.425585 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:07.425585 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:07.425585 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:07.425585 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:51:07.425585 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:51:07.425585 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece988e9-4b9b-4016-83bb-28eebecaff03 could not be found. Jul 20 04:51:07.425585 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:51:07.425998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4a8f9f98-e822-4642-aae8-ec459dc075d3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Returning 404 to user: Instance ece988e9-4b9b-4016-83bb-28eebecaff03 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:51:07.426744 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4a8f9f98-e822-4642-aae8-ec459dc075d3 tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03" status: 404 len: 111 microversion: 2.1 time: 0.068680 Jul 20 04:51:07.427331 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3260/6286] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:07 2022] GET /compute/v2.1/servers/ece988e9-4b9b-4016-83bb-28eebecaff03 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:51:07.639877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-22be70d5-21bb-4f4d-ba6e-9b16ab7a302c tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:07.649272 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-22be70d5-21bb-4f4d-ba6e-9b16ab7a302c tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 200 len: 1471 microversion: 2.1 time: 0.467921 Jul 20 04:51:07.650133 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3027/6287] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:07 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 1471 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:08.669725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-27fcdf8a-9c17-4e95-8617-39c1bd722236 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:08.670970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-27fcdf8a-9c17-4e95-8617-39c1bd722236 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:08.678178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:08.685749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27fcdf8a-9c17-4e95-8617-39c1bd722236 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:08.688302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27fcdf8a-9c17-4e95-8617-39c1bd722236 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:08.692715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27fcdf8a-9c17-4e95-8617-39c1bd722236 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:08.692715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27fcdf8a-9c17-4e95-8617-39c1bd722236 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:08.871171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:09.011912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-27fcdf8a-9c17-4e95-8617-39c1bd722236 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:09.022966 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-27fcdf8a-9c17-4e95-8617-39c1bd722236 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 200 len: 1471 microversion: 2.1 time: 0.359580 Jul 20 04:51:09.024479 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3261/6288] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:08 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 1471 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:10.042424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f838fd39-6be6-428e-adae-c48e0261d43d tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:10.043161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f838fd39-6be6-428e-adae-c48e0261d43d tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:10.069960 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:10.072999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:10.079466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f838fd39-6be6-428e-adae-c48e0261d43d tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:10.081718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f838fd39-6be6-428e-adae-c48e0261d43d tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:10.084779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f838fd39-6be6-428e-adae-c48e0261d43d tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:10.085339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f838fd39-6be6-428e-adae-c48e0261d43d tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:10.553690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f838fd39-6be6-428e-adae-c48e0261d43d tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:10.565971 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f838fd39-6be6-428e-adae-c48e0261d43d tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 200 len: 1471 microversion: 2.1 time: 0.528832 Jul 20 04:51:10.566826 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3028/6289] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:10 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 1471 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:10.720419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-a776e4be-8e0f-4522-a5e8-cc706a6f6910 req-8215c98b-036c-4092-bf2a-7fb3ef6cd845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e4f01a-5e8a-44e9-91c1-d8c3d62eed43", "name": "network-vif-plugged", "status": "completed", "tag": "37fcf64f-a6f4-4362-9023-c589f3313737"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:10.736788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a776e4be-8e0f-4522-a5e8-cc706a6f6910 req-8215c98b-036c-4092-bf2a-7fb3ef6cd845 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:10.737560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a776e4be-8e0f-4522-a5e8-cc706a6f6910 req-8215c98b-036c-4092-bf2a-7fb3ef6cd845 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:10.754699 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-a776e4be-8e0f-4522-a5e8-cc706a6f6910 req-8215c98b-036c-4092-bf2a-7fb3ef6cd845 service nova] Creating event network-vif-plugged:37fcf64f-a6f4-4362-9023-c589f3313737 for instance 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 on n-h2-826526-5 Jul 20 04:51:10.762360 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-a776e4be-8e0f-4522-a5e8-cc706a6f6910 req-8215c98b-036c-4092-bf2a-7fb3ef6cd845 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.426085 Jul 20 04:51:10.764116 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3262/6290] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:11.587298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f8bdadb2-4bdb-428c-89bb-781bb97403f1 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:11.588507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f8bdadb2-4bdb-428c-89bb-781bb97403f1 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:11.601895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8bdadb2-4bdb-428c-89bb-781bb97403f1 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:11.603043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8bdadb2-4bdb-428c-89bb-781bb97403f1 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:11.604791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8bdadb2-4bdb-428c-89bb-781bb97403f1 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:11.605849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8bdadb2-4bdb-428c-89bb-781bb97403f1 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:11.890446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f8bdadb2-4bdb-428c-89bb-781bb97403f1 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:11.900790 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f8bdadb2-4bdb-428c-89bb-781bb97403f1 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 200 len: 1471 microversion: 2.1 time: 0.320319 Jul 20 04:51:11.901946 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3029/6291] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:11 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 1471 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:12.919477 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6b0c8b4a-d69d-44c9-b01d-36dc8f7db798 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:12.921467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6b0c8b4a-d69d-44c9-b01d-36dc8f7db798 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:12.939372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6b0c8b4a-d69d-44c9-b01d-36dc8f7db798 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:12.940567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6b0c8b4a-d69d-44c9-b01d-36dc8f7db798 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:12.942351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6b0c8b4a-d69d-44c9-b01d-36dc8f7db798 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:12.942661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6b0c8b4a-d69d-44c9-b01d-36dc8f7db798 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:13.133942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f3d89d0b-dd5c-4907-982f-460df6947c9b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:13.134537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f3d89d0b-dd5c-4907-982f-460df6947c9b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:13.146952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3d89d0b-dd5c-4907-982f-460df6947c9b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:13.147422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3d89d0b-dd5c-4907-982f-460df6947c9b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:13.153272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3d89d0b-dd5c-4907-982f-460df6947c9b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:13.153789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3d89d0b-dd5c-4907-982f-460df6947c9b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:13.196051 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-f3d89d0b-dd5c-4907-982f-460df6947c9b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] HTTP exception thrown: Instance 3333b1e8-7653-4bc2-a218-7a8521a338cf could not be found. Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f3d89d0b-dd5c-4907-982f-460df6947c9b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Request method failure captured: Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf HTTP/1.1 Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14hrxprVuz_dHHOcR8GTo7pu8oCPLaQwPysrUltUoQBMKG3EqE-4oLk9T0h1XMYcyu1LBfKJBCVuAPbSsxe2W99Xl1mxIlOeXYH_2W5rgSXfZky8i8sul9PUmO6H70mSQjHTpDxAEZitdYiOtIRrpg803BtaQXjc4s8jpEEKwJfeT60 Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: bf61df9cc1e340469412fe282057f903 Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeTestJSON-2123877240 Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bf61df9cc1e340469412fe282057f903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bf61df9cc1e340469412fe282057f903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bf61df9cc1e340469412fe282057f903", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bf61df9cc1e340469412fe282057f903"}]}] Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeTestJSON-2123877240 Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: bf61df9cc1e340469412fe282057f903 Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2123877240 Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AttachVolumeTestJSON-2123877240-project Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 4a8bade1b5244107b43bdf34c9663dc7 Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeTestJSON-2123877240-project Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 3333b1e8-7653-4bc2-a218-7a8521a338cf could not be found. Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '3333b1e8-7653-4bc2-a218-7a8521a338cf'} Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3333b1e8-7653-4bc2-a218-7a8521a338cf could not be found. Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:51:13.201952 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:51:13.206686 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3333b1e8-7653-4bc2-a218-7a8521a338cf could not be found. Jul 20 04:51:13.206686 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:51:13.206686 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:13.206686 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:51:13.206686 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:13.206686 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:13.206686 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:13.206686 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:51:13.206686 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:51:13.206686 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3333b1e8-7653-4bc2-a218-7a8521a338cf could not be found. Jul 20 04:51:13.206686 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:51:13.208342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6b0c8b4a-d69d-44c9-b01d-36dc8f7db798 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:13.209203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f3d89d0b-dd5c-4907-982f-460df6947c9b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Returning 404 to user: Instance 3333b1e8-7653-4bc2-a218-7a8521a338cf could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:51:13.211080 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f3d89d0b-dd5c-4907-982f-460df6947c9b tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 404 len: 111 microversion: 2.1 time: 0.083798 Jul 20 04:51:13.216854 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3030/6292] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:51:13 2022] DELETE /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:51:13.218528 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6b0c8b4a-d69d-44c9-b01d-36dc8f7db798 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 200 len: 1643 microversion: 2.1 time: 0.303954 Jul 20 04:51:13.219619 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3263/6293] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:12 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 1643 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:13.233239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c325fd55-2314-4a32-bb1e-a47084b2bd8c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:13.235083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c325fd55-2314-4a32-bb1e-a47084b2bd8c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] [instance: 3333b1e8-7653-4bc2-a218-7a8521a338cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:13.236712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fa770c08-be83-4f68-a4aa-7fd84c413157 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:13.237329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fa770c08-be83-4f68-a4aa-7fd84c413157 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:13.243548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa770c08-be83-4f68-a4aa-7fd84c413157 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:13.243998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa770c08-be83-4f68-a4aa-7fd84c413157 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:13.245496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c325fd55-2314-4a32-bb1e-a47084b2bd8c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:13.247157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c325fd55-2314-4a32-bb1e-a47084b2bd8c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:13.248654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c325fd55-2314-4a32-bb1e-a47084b2bd8c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:13.249854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c325fd55-2314-4a32-bb1e-a47084b2bd8c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:13.250225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa770c08-be83-4f68-a4aa-7fd84c413157 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:13.251101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa770c08-be83-4f68-a4aa-7fd84c413157 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:13.306164 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-c325fd55-2314-4a32-bb1e-a47084b2bd8c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] HTTP exception thrown: Instance 3333b1e8-7653-4bc2-a218-7a8521a338cf could not be found. Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c325fd55-2314-4a32-bb1e-a47084b2bd8c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Request method failure captured: Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf HTTP/1.1 Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14hrxprVuz_dHHOcR8GTo7pu8oCPLaQwPysrUltUoQBMKG3EqE-4oLk9T0h1XMYcyu1LBfKJBCVuAPbSsxe2W99Xl1mxIlOeXYH_2W5rgSXfZky8i8sul9PUmO6H70mSQjHTpDxAEZitdYiOtIRrpg803BtaQXjc4s8jpEEKwJfeT60 Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: bf61df9cc1e340469412fe282057f903 Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeTestJSON-2123877240 Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bf61df9cc1e340469412fe282057f903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bf61df9cc1e340469412fe282057f903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bf61df9cc1e340469412fe282057f903", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bf61df9cc1e340469412fe282057f903"}]}] Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeTestJSON-2123877240 Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: bf61df9cc1e340469412fe282057f903 Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2123877240 Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AttachVolumeTestJSON-2123877240-project Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 4a8bade1b5244107b43bdf34c9663dc7 Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeTestJSON-2123877240-project Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 3333b1e8-7653-4bc2-a218-7a8521a338cf could not be found. Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '3333b1e8-7653-4bc2-a218-7a8521a338cf'} Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3333b1e8-7653-4bc2-a218-7a8521a338cf could not be found. Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3333b1e8-7653-4bc2-a218-7a8521a338cf could not be found. Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:13.308908 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:51:13.315629 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:13.315629 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:13.315629 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:13.315629 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:51:13.315629 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:51:13.315629 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3333b1e8-7653-4bc2-a218-7a8521a338cf could not be found. Jul 20 04:51:13.315629 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:51:13.319032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c325fd55-2314-4a32-bb1e-a47084b2bd8c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] Returning 404 to user: Instance 3333b1e8-7653-4bc2-a218-7a8521a338cf could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:51:13.320825 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c325fd55-2314-4a32-bb1e-a47084b2bd8c tempest-AttachVolumeTestJSON-2123877240 tempest-AttachVolumeTestJSON-2123877240-project] 10.222.0.17 "GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf" status: 404 len: 111 microversion: 2.1 time: 0.102141 Jul 20 04:51:13.322211 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3031/6294] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:13 2022] GET /compute/v2.1/servers/3333b1e8-7653-4bc2-a218-7a8521a338cf => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:51:13.519991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fa770c08-be83-4f68-a4aa-7fd84c413157 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:13.534877 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fa770c08-be83-4f68-a4aa-7fd84c413157 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 200 len: 1643 microversion: 2.1 time: 0.302532 Jul 20 04:51:13.535476 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3264/6295] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:13 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 1643 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:13.551506 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-490526b9-f03b-488e-bcdc-8106aa1b4745 tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:13.552200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-490526b9-f03b-488e-bcdc-8106aa1b4745 tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:13.560825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-490526b9-f03b-488e-bcdc-8106aa1b4745 tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:13.563186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-490526b9-f03b-488e-bcdc-8106aa1b4745 tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:13.564366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-490526b9-f03b-488e-bcdc-8106aa1b4745 tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:13.566112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-490526b9-f03b-488e-bcdc-8106aa1b4745 tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:14.555643 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-490526b9-f03b-488e-bcdc-8106aa1b4745 tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 200 len: 1794 microversion: 2.1 time: 1.007876 Jul 20 04:51:14.561638 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3032/6296] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:13 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 1794 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:20.242404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-cce00676-a4b2-45ed-a604-f9249d048f16 req-90551d64-3f89-4a4f-bbc2-5ae8fc4e98d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e4f01a-5e8a-44e9-91c1-d8c3d62eed43", "tag": "37fcf64f-a6f4-4362-9023-c589f3313737"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:20.266791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-cce00676-a4b2-45ed-a604-f9249d048f16 req-90551d64-3f89-4a4f-bbc2-5ae8fc4e98d5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:20.269148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-cce00676-a4b2-45ed-a604-f9249d048f16 req-90551d64-3f89-4a4f-bbc2-5ae8fc4e98d5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:20.300635 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-cce00676-a4b2-45ed-a604-f9249d048f16 req-90551d64-3f89-4a4f-bbc2-5ae8fc4e98d5 service nova] Creating event network-changed:37fcf64f-a6f4-4362-9023-c589f3313737 for instance 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 on n-h2-826526-5 Jul 20 04:51:20.325877 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-cce00676-a4b2-45ed-a604-f9249d048f16 req-90551d64-3f89-4a4f-bbc2-5ae8fc4e98d5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072952 Jul 20 04:51:20.327445 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3265/6297] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:51:35.729600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:35.732704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=61 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:35.966557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4ce4f526-c04d-4ff5-8114-d630dae13fea tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Action: 'create', calling method: .version_select at 0x7f06bdde9160>, body: {"keypair": {"name": "tempest-keypair-1078696086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClHSWHRLMy5lN62OLQNNRb/pI7QSBtmwp7bGXGYSYWZ1lnsY+YptdqBAlhf4t8145WkYtnhBp86iGvGBHgGveUbYNgLLSiRpsrTatual5FOSJzydvsMDSjs07j39mAF2A=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:35.987471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-4ce4f526-c04d-4ff5-8114-d630dae13fea tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Getting quotas for project d90f217b019840929bacafcacbbd1a3d. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:51:35.994849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-4ce4f526-c04d-4ff5-8114-d630dae13fea tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Getting quotas for user a241f748f0ef4775b46e4fcd113174e5 and project d90f217b019840929bacafcacbbd1a3d. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:51:36.070037 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4ce4f526-c04d-4ff5-8114-d630dae13fea tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.349617 Jul 20 04:51:36.072185 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3033/6298] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:51:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:40.050460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1d9688a4-d84f-4560-a03e-314de94ccc31 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1028514553", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64107751-d7d5-48c2-b064-28befc37e9c1"}], "security_groups": [{"name": "tempest-securitygroup--1313739646"}], "key_name": "tempest-keypair-1078696086", "user_data": "}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:40.080067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=9 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:40.080788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=45 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:40.278667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-1d9688a4-d84f-4560-a03e-314de94ccc31 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] validate_networks() for [('64107751-d7d5-48c2-b064-28befc37e9c1', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:51:41.267672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-1d9688a4-d84f-4560-a03e-314de94ccc31 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:51:41.269059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-1d9688a4-d84f-4560-a03e-314de94ccc31 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:51:41.272511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-1d9688a4-d84f-4560-a03e-314de94ccc31 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:51:41.273957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-1d9688a4-d84f-4560-a03e-314de94ccc31 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:51:41.274932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-1d9688a4-d84f-4560-a03e-314de94ccc31 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:51:41.291646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d9688a4-d84f-4560-a03e-314de94ccc31 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:41.292628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d9688a4-d84f-4560-a03e-314de94ccc31 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:41.296092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d9688a4-d84f-4560-a03e-314de94ccc31 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:41.296973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1d9688a4-d84f-4560-a03e-314de94ccc31 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:41.331824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-1d9688a4-d84f-4560-a03e-314de94ccc31 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Getting quotas for project d90f217b019840929bacafcacbbd1a3d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:51:41.341963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-1d9688a4-d84f-4560-a03e-314de94ccc31 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Getting quotas for user a241f748f0ef4775b46e4fcd113174e5 and project d90f217b019840929bacafcacbbd1a3d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:51:41.368740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1d9688a4-d84f-4560-a03e-314de94ccc31 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:51:41.378835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1d9688a4-d84f-4560-a03e-314de94ccc31 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:51:41.541884 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1d9688a4-d84f-4560-a03e-314de94ccc31 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.497687 Jul 20 04:51:41.542548 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3266/6299] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:51:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:51:41.554750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ac3f3c1b-2d94-4005-b208-b627ca9e6aef tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:41.556726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ac3f3c1b-2d94-4005-b208-b627ca9e6aef tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:41.695636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ac3f3c1b-2d94-4005-b208-b627ca9e6aef tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:41.708566 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ac3f3c1b-2d94-4005-b208-b627ca9e6aef tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 200 len: 1242 microversion: 2.1 time: 0.156079 Jul 20 04:51:41.713032 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3034/6300] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:41 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 1242 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:42.730797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b6df3c44-7dc6-4422-979d-799d521b15bc tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:42.732663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b6df3c44-7dc6-4422-979d-799d521b15bc tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:42.742420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b6df3c44-7dc6-4422-979d-799d521b15bc tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:42.745880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b6df3c44-7dc6-4422-979d-799d521b15bc tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:42.747016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b6df3c44-7dc6-4422-979d-799d521b15bc tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:42.747475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b6df3c44-7dc6-4422-979d-799d521b15bc tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:42.857709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b6df3c44-7dc6-4422-979d-799d521b15bc tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:42.866771 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b6df3c44-7dc6-4422-979d-799d521b15bc tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 200 len: 1238 microversion: 2.1 time: 0.140543 Jul 20 04:51:42.878791 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3267/6301] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:42 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 1238 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:43.888480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-66c31d4b-f223-47fb-99d3-b11695140056 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:43.894804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-66c31d4b-f223-47fb-99d3-b11695140056 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:43.904465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66c31d4b-f223-47fb-99d3-b11695140056 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:43.905179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66c31d4b-f223-47fb-99d3-b11695140056 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:43.906976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66c31d4b-f223-47fb-99d3-b11695140056 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:43.907465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66c31d4b-f223-47fb-99d3-b11695140056 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:44.050467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-66c31d4b-f223-47fb-99d3-b11695140056 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:44.059460 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-66c31d4b-f223-47fb-99d3-b11695140056 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 200 len: 1300 microversion: 2.1 time: 0.176599 Jul 20 04:51:44.070747 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3035/6302] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:43 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 1300 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:45.082470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d0652c35-1acb-4a8d-9966-a3126615422a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:45.083929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d0652c35-1acb-4a8d-9966-a3126615422a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:45.093981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0652c35-1acb-4a8d-9966-a3126615422a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:45.094786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0652c35-1acb-4a8d-9966-a3126615422a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:45.096354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0652c35-1acb-4a8d-9966-a3126615422a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:45.097205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0652c35-1acb-4a8d-9966-a3126615422a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:45.286854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d0652c35-1acb-4a8d-9966-a3126615422a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:45.297580 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d0652c35-1acb-4a8d-9966-a3126615422a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 200 len: 1368 microversion: 2.1 time: 0.223640 Jul 20 04:51:45.298233 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3268/6303] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:45 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:46.314831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cdd583e3-f328-4161-9f19-63e7bc079438 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:46.316364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cdd583e3-f328-4161-9f19-63e7bc079438 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:46.325966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdd583e3-f328-4161-9f19-63e7bc079438 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:46.326472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdd583e3-f328-4161-9f19-63e7bc079438 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:46.327487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdd583e3-f328-4161-9f19-63e7bc079438 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:46.328547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdd583e3-f328-4161-9f19-63e7bc079438 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:46.925972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cdd583e3-f328-4161-9f19-63e7bc079438 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:46.941696 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cdd583e3-f328-4161-9f19-63e7bc079438 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 200 len: 1368 microversion: 2.1 time: 0.626918 Jul 20 04:51:46.942634 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3036/6304] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:46 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 1368 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:47.434492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-82cc66c8-7bb2-45da-b516-1c42909dde00 req-bf9999fd-9482-470f-8b43-8d3b5b60456f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8036792e-0b6c-48cd-b555-ae12a1e52658", "tag": "601b62f4-2275-4b41-82fe-63f8c38fec2e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:47.454495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-82cc66c8-7bb2-45da-b516-1c42909dde00 req-bf9999fd-9482-470f-8b43-8d3b5b60456f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:47.454968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-82cc66c8-7bb2-45da-b516-1c42909dde00 req-bf9999fd-9482-470f-8b43-8d3b5b60456f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:47.459640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-33cfeabb-0207-425d-8a9e-f38619548540 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-226314030", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "34e1da3c-c8a9-41fc-9b63-0cafb422fa9e"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:47.468295 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-82cc66c8-7bb2-45da-b516-1c42909dde00 req-bf9999fd-9482-470f-8b43-8d3b5b60456f service nova] Creating event network-changed:601b62f4-2275-4b41-82fe-63f8c38fec2e for instance 8036792e-0b6c-48cd-b555-ae12a1e52658 on n-h1-826526-5 Jul 20 04:51:47.476222 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-82cc66c8-7bb2-45da-b516-1c42909dde00 req-bf9999fd-9482-470f-8b43-8d3b5b60456f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233890 Jul 20 04:51:47.477196 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3037/6305] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:47.530312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-33cfeabb-0207-425d-8a9e-f38619548540 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] validate_networks() for [('34e1da3c-c8a9-41fc-9b63-0cafb422fa9e', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:51:47.962419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f8e0000a-c478-4011-9ed3-2d152147f568 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:47.964019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f8e0000a-c478-4011-9ed3-2d152147f568 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:47.996850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8e0000a-c478-4011-9ed3-2d152147f568 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:47.996850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8e0000a-c478-4011-9ed3-2d152147f568 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:47.996850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8e0000a-c478-4011-9ed3-2d152147f568 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:47.996850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8e0000a-c478-4011-9ed3-2d152147f568 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:48.116910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-33cfeabb-0207-425d-8a9e-f38619548540 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:51:48.117808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-33cfeabb-0207-425d-8a9e-f38619548540 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:51:48.118525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-33cfeabb-0207-425d-8a9e-f38619548540 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:51:48.119032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-33cfeabb-0207-425d-8a9e-f38619548540 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:51:48.119446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-33cfeabb-0207-425d-8a9e-f38619548540 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:51:48.134467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33cfeabb-0207-425d-8a9e-f38619548540 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:48.134912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33cfeabb-0207-425d-8a9e-f38619548540 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:48.135707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33cfeabb-0207-425d-8a9e-f38619548540 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:48.136141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33cfeabb-0207-425d-8a9e-f38619548540 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:48.158542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-33cfeabb-0207-425d-8a9e-f38619548540 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Getting quotas for project 4c94e927bd3e4a0d8e1ce4d8ed4b50c9. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:51:48.163858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-33cfeabb-0207-425d-8a9e-f38619548540 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Getting quotas for user 3d25864ee6c04c47a76b8c5e1663d7b9 and project 4c94e927bd3e4a0d8e1ce4d8ed4b50c9. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:51:48.177935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-33cfeabb-0207-425d-8a9e-f38619548540 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:51:48.180532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-33cfeabb-0207-425d-8a9e-f38619548540 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:51:48.237845 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-33cfeabb-0207-425d-8a9e-f38619548540 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.028554 Jul 20 04:51:48.238959 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3269/6306] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:51:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:51:48.259841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2927ce89-b2e1-426b-a209-00854186692f tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:48.260571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2927ce89-b2e1-426b-a209-00854186692f tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:48.346610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2927ce89-b2e1-426b-a209-00854186692f tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d25864ee6c04c47a76b8c5e1663d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c94e927bd3e4a0d8e1ce4d8ed4b50c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:48.355225 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2927ce89-b2e1-426b-a209-00854186692f tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4" status: 200 len: 1213 microversion: 2.1 time: 0.105146 Jul 20 04:51:48.356459 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3270/6307] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:48 2022] GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4 => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:48.418730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f8e0000a-c478-4011-9ed3-2d152147f568 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:48.430707 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f8e0000a-c478-4011-9ed3-2d152147f568 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 200 len: 1368 microversion: 2.1 time: 0.473755 Jul 20 04:51:48.432414 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3038/6308] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:47 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 1368 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:49.373743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fffebddc-7710-4732-b20d-5c9d0b9e5d84 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:49.375235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fffebddc-7710-4732-b20d-5c9d0b9e5d84 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:49.398693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fffebddc-7710-4732-b20d-5c9d0b9e5d84 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:49.400681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fffebddc-7710-4732-b20d-5c9d0b9e5d84 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:49.402264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fffebddc-7710-4732-b20d-5c9d0b9e5d84 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:49.402705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fffebddc-7710-4732-b20d-5c9d0b9e5d84 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:49.449261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-22010b38-4f32-4480-b354-b08db670e09b tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:49.449965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-22010b38-4f32-4480-b354-b08db670e09b tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:49.465476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22010b38-4f32-4480-b354-b08db670e09b tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:49.466492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22010b38-4f32-4480-b354-b08db670e09b tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:49.469286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22010b38-4f32-4480-b354-b08db670e09b tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:49.470012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22010b38-4f32-4480-b354-b08db670e09b tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:49.577472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fffebddc-7710-4732-b20d-5c9d0b9e5d84 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d25864ee6c04c47a76b8c5e1663d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c94e927bd3e4a0d8e1ce4d8ed4b50c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:49.605460 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fffebddc-7710-4732-b20d-5c9d0b9e5d84 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4" status: 200 len: 1265 microversion: 2.1 time: 0.235411 Jul 20 04:51:49.607250 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3271/6309] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:49 2022] GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:49.985190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-22010b38-4f32-4480-b354-b08db670e09b tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:49.995182 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-22010b38-4f32-4480-b354-b08db670e09b tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 200 len: 1368 microversion: 2.1 time: 0.550802 Jul 20 04:51:50.006034 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3039/6310] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:49 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 1368 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:50.624238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9add78de-cfe2-427e-a904-317d1e906970 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:50.625054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9add78de-cfe2-427e-a904-317d1e906970 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:50.639622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9add78de-cfe2-427e-a904-317d1e906970 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:50.640154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9add78de-cfe2-427e-a904-317d1e906970 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:50.641211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9add78de-cfe2-427e-a904-317d1e906970 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:50.641736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9add78de-cfe2-427e-a904-317d1e906970 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:50.753627 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9add78de-cfe2-427e-a904-317d1e906970 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d25864ee6c04c47a76b8c5e1663d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c94e927bd3e4a0d8e1ce4d8ed4b50c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:50.762188 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9add78de-cfe2-427e-a904-317d1e906970 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4" status: 200 len: 1271 microversion: 2.1 time: 0.142119 Jul 20 04:51:50.763360 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3272/6311] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:50 2022] GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4 => generated 1271 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:51.014766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-65415a58-9271-4ec4-8db5-7fd510198f3f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:51.016141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-65415a58-9271-4ec4-8db5-7fd510198f3f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:51.023795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65415a58-9271-4ec4-8db5-7fd510198f3f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:51.024458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65415a58-9271-4ec4-8db5-7fd510198f3f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:51.025522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65415a58-9271-4ec4-8db5-7fd510198f3f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:51.026083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65415a58-9271-4ec4-8db5-7fd510198f3f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:51.175076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-65415a58-9271-4ec4-8db5-7fd510198f3f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:51.186514 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-65415a58-9271-4ec4-8db5-7fd510198f3f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 200 len: 1368 microversion: 2.1 time: 0.176751 Jul 20 04:51:51.188609 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3040/6312] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:51 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:51.782664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3b014f8d-30b3-4c19-966d-d02bc9d273dd tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:51.784538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3b014f8d-30b3-4c19-966d-d02bc9d273dd tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:51.798658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b014f8d-30b3-4c19-966d-d02bc9d273dd tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:51.802330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b014f8d-30b3-4c19-966d-d02bc9d273dd tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:51.803340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b014f8d-30b3-4c19-966d-d02bc9d273dd tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:51.805712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b014f8d-30b3-4c19-966d-d02bc9d273dd tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:52.205938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-29c77be3-52a1-45a9-b5f8-21effd8457bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:52.206582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-29c77be3-52a1-45a9-b5f8-21effd8457bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:52.219036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:52.223886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29c77be3-52a1-45a9-b5f8-21effd8457bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:52.224386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29c77be3-52a1-45a9-b5f8-21effd8457bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:52.228357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29c77be3-52a1-45a9-b5f8-21effd8457bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:52.231833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-29c77be3-52a1-45a9-b5f8-21effd8457bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:52.512017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-29c77be3-52a1-45a9-b5f8-21effd8457bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:52.526392 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-29c77be3-52a1-45a9-b5f8-21effd8457bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 200 len: 1368 microversion: 2.1 time: 0.324292 Jul 20 04:51:52.535704 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3041/6313] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:52 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 1368 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:52.536152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3b014f8d-30b3-4c19-966d-d02bc9d273dd tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d25864ee6c04c47a76b8c5e1663d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c94e927bd3e4a0d8e1ce4d8ed4b50c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:52.545985 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3b014f8d-30b3-4c19-966d-d02bc9d273dd tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4" status: 200 len: 1313 microversion: 2.1 time: 0.769112 Jul 20 04:51:52.555675 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3273/6314] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:51 2022] GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4 => generated 1313 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:53.090479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-9dcdeb25-a8b5-456c-a999-310febb4491d req-b6944f9a-ecc3-4e6e-89a1-022c767a6cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ebd2b2-ab92-441f-9186-c5642abd54d4", "tag": "66c9d937-e6ea-42ab-b95f-e8c768448485"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:53.121749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-9dcdeb25-a8b5-456c-a999-310febb4491d req-b6944f9a-ecc3-4e6e-89a1-022c767a6cb6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:53.123016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-9dcdeb25-a8b5-456c-a999-310febb4491d req-b6944f9a-ecc3-4e6e-89a1-022c767a6cb6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:53.140210 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-9dcdeb25-a8b5-456c-a999-310febb4491d req-b6944f9a-ecc3-4e6e-89a1-022c767a6cb6 service nova] Creating event network-changed:66c9d937-e6ea-42ab-b95f-e8c768448485 for instance b5ebd2b2-ab92-441f-9186-c5642abd54d4 on n-h2-826526-5 Jul 20 04:51:53.155478 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-9dcdeb25-a8b5-456c-a999-310febb4491d req-b6944f9a-ecc3-4e6e-89a1-022c767a6cb6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071084 Jul 20 04:51:53.156339 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3042/6315] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:53.544019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fabee1c6-1c29-461d-8ffb-dacceb3d04eb tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:53.545458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fabee1c6-1c29-461d-8ffb-dacceb3d04eb tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:53.564363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6504c164-a4c1-409a-9ad8-1bff3283e0f8 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:53.565860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6504c164-a4c1-409a-9ad8-1bff3283e0f8 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:53.577842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fabee1c6-1c29-461d-8ffb-dacceb3d04eb tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:53.581498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6504c164-a4c1-409a-9ad8-1bff3283e0f8 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:53.582469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fabee1c6-1c29-461d-8ffb-dacceb3d04eb tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:53.583548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fabee1c6-1c29-461d-8ffb-dacceb3d04eb tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:53.585737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fabee1c6-1c29-461d-8ffb-dacceb3d04eb tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:53.593891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6504c164-a4c1-409a-9ad8-1bff3283e0f8 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:53.595311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6504c164-a4c1-409a-9ad8-1bff3283e0f8 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:53.596010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6504c164-a4c1-409a-9ad8-1bff3283e0f8 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:54.105353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fabee1c6-1c29-461d-8ffb-dacceb3d04eb tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:54.119730 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fabee1c6-1c29-461d-8ffb-dacceb3d04eb tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 200 len: 1368 microversion: 2.1 time: 0.579209 Jul 20 04:51:54.121056 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3274/6316] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:53 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 1368 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:54.129519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-622ba52c-c025-460f-82f8-60f737dc84cb req-a62cdbe5-6ebd-489a-85ec-76770e9a3f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8036792e-0b6c-48cd-b555-ae12a1e52658", "name": "network-vif-plugged", "status": "completed", "tag": "601b62f4-2275-4b41-82fe-63f8c38fec2e"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:54.157431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-622ba52c-c025-460f-82f8-60f737dc84cb req-a62cdbe5-6ebd-489a-85ec-76770e9a3f00 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:54.158021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-622ba52c-c025-460f-82f8-60f737dc84cb req-a62cdbe5-6ebd-489a-85ec-76770e9a3f00 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:54.191017 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-622ba52c-c025-460f-82f8-60f737dc84cb req-a62cdbe5-6ebd-489a-85ec-76770e9a3f00 service nova] Creating event network-vif-plugged:601b62f4-2275-4b41-82fe-63f8c38fec2e for instance 8036792e-0b6c-48cd-b555-ae12a1e52658 on n-h1-826526-5 Jul 20 04:51:54.196776 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-622ba52c-c025-460f-82f8-60f737dc84cb req-a62cdbe5-6ebd-489a-85ec-76770e9a3f00 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070927 Jul 20 04:51:54.198136 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3275/6317] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:54.258138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6504c164-a4c1-409a-9ad8-1bff3283e0f8 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d25864ee6c04c47a76b8c5e1663d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c94e927bd3e4a0d8e1ce4d8ed4b50c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:54.276326 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6504c164-a4c1-409a-9ad8-1bff3283e0f8 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4" status: 200 len: 1313 microversion: 2.1 time: 0.716599 Jul 20 04:51:54.276952 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3043/6318] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:53 2022] GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4 => generated 1313 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:55.154387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-da1ff066-e4f1-47ea-a84b-a2e1386736c1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:55.158270 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-da1ff066-e4f1-47ea-a84b-a2e1386736c1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:55.171297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da1ff066-e4f1-47ea-a84b-a2e1386736c1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:55.172790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da1ff066-e4f1-47ea-a84b-a2e1386736c1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:55.174198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da1ff066-e4f1-47ea-a84b-a2e1386736c1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:55.174818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-da1ff066-e4f1-47ea-a84b-a2e1386736c1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:55.300028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2cd4b3db-56b8-4832-b7a7-80e7f40b949e tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:55.301363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2cd4b3db-56b8-4832-b7a7-80e7f40b949e tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:55.321138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cd4b3db-56b8-4832-b7a7-80e7f40b949e tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:55.324981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cd4b3db-56b8-4832-b7a7-80e7f40b949e tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:55.326664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cd4b3db-56b8-4832-b7a7-80e7f40b949e tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:55.327440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cd4b3db-56b8-4832-b7a7-80e7f40b949e tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:55.782097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2cd4b3db-56b8-4832-b7a7-80e7f40b949e tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d25864ee6c04c47a76b8c5e1663d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c94e927bd3e4a0d8e1ce4d8ed4b50c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:55.794817 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2cd4b3db-56b8-4832-b7a7-80e7f40b949e tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4" status: 200 len: 1313 microversion: 2.1 time: 0.502950 Jul 20 04:51:55.796886 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3044/6319] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:55 2022] GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4 => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:55.999174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-da1ff066-e4f1-47ea-a84b-a2e1386736c1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:56.018406 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-da1ff066-e4f1-47ea-a84b-a2e1386736c1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 200 len: 1368 microversion: 2.1 time: 0.882191 Jul 20 04:51:56.032207 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3276/6320] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:55 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 1368 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:56.816427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3d007711-2f89-47c8-aeb6-e13f9e96b1d3 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:56.817797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3d007711-2f89-47c8-aeb6-e13f9e96b1d3 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:56.826724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d007711-2f89-47c8-aeb6-e13f9e96b1d3 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:56.827540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d007711-2f89-47c8-aeb6-e13f9e96b1d3 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:56.828479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d007711-2f89-47c8-aeb6-e13f9e96b1d3 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:56.829138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d007711-2f89-47c8-aeb6-e13f9e96b1d3 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:57.037503 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-800accce-d0b8-4c06-9810-36f9b384b4f3 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:57.038170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-800accce-d0b8-4c06-9810-36f9b384b4f3 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:57.053211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-800accce-d0b8-4c06-9810-36f9b384b4f3 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:57.054630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-800accce-d0b8-4c06-9810-36f9b384b4f3 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:57.057343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-800accce-d0b8-4c06-9810-36f9b384b4f3 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:57.057904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-800accce-d0b8-4c06-9810-36f9b384b4f3 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:57.076851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3d007711-2f89-47c8-aeb6-e13f9e96b1d3 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d25864ee6c04c47a76b8c5e1663d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c94e927bd3e4a0d8e1ce4d8ed4b50c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:57.089651 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3d007711-2f89-47c8-aeb6-e13f9e96b1d3 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4" status: 200 len: 1313 microversion: 2.1 time: 0.277270 Jul 20 04:51:57.092859 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3045/6321] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:56 2022] GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:57.734052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-800accce-d0b8-4c06-9810-36f9b384b4f3 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:57.743692 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-800accce-d0b8-4c06-9810-36f9b384b4f3 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 200 len: 1558 microversion: 2.1 time: 0.710281 Jul 20 04:51:57.749094 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3277/6322] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:57 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 1558 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:57.764912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1948f9a4-914c-471b-b711-d338c8010f75 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:57.765039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1948f9a4-914c-471b-b711-d338c8010f75 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:57.778705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1948f9a4-914c-471b-b711-d338c8010f75 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:57.779452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1948f9a4-914c-471b-b711-d338c8010f75 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:57.780461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1948f9a4-914c-471b-b711-d338c8010f75 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:57.781070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1948f9a4-914c-471b-b711-d338c8010f75 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:58.038353 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1948f9a4-914c-471b-b711-d338c8010f75 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.279733 Jul 20 04:51:58.047769 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3046/6323] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:51:57 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/os-interface => generated 284 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:58.109696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-db6624dc-e469-48ad-a7c0-347fd7e0a23e tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:58.110357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-db6624dc-e469-48ad-a7c0-347fd7e0a23e tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:58.130111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db6624dc-e469-48ad-a7c0-347fd7e0a23e tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:58.130580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db6624dc-e469-48ad-a7c0-347fd7e0a23e tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:58.131624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db6624dc-e469-48ad-a7c0-347fd7e0a23e tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:58.132226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db6624dc-e469-48ad-a7c0-347fd7e0a23e tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:58.172603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:58.351513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=14 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:58.409216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-db6624dc-e469-48ad-a7c0-347fd7e0a23e tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d25864ee6c04c47a76b8c5e1663d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c94e927bd3e4a0d8e1ce4d8ed4b50c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:58.419009 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-db6624dc-e469-48ad-a7c0-347fd7e0a23e tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4" status: 200 len: 1313 microversion: 2.1 time: 0.313884 Jul 20 04:51:58.429813 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3278/6324] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:58 2022] GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4 => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:58.848150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-665a0204-3efd-4a46-8330-cf057626c88a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1510163388", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "84bd0965-3bd5-4a89-8e99-492e0edb1cdf"}], "key_name": "tempest-TestSecurityGroupsBasicOps-352168082", "security_groups": []}, "os:scheduler_hints": {"different_host": ["37e4f01a-5e8a-44e9-91c1-d8c3d62eed43"]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:58.919346 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-665a0204-3efd-4a46-8330-cf057626c88a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] validate_networks() for [('84bd0965-3bd5-4a89-8e99-492e0edb1cdf', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:51:59.440980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-09a6e4b1-af7a-45b9-bca0-4791500eb154 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:59.442508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-09a6e4b1-af7a-45b9-bca0-4791500eb154 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:59.476159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09a6e4b1-af7a-45b9-bca0-4791500eb154 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:59.477740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09a6e4b1-af7a-45b9-bca0-4791500eb154 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:59.478925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09a6e4b1-af7a-45b9-bca0-4791500eb154 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:59.479634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09a6e4b1-af7a-45b9-bca0-4791500eb154 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:59.797469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-09a6e4b1-af7a-45b9-bca0-4791500eb154 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d25864ee6c04c47a76b8c5e1663d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c94e927bd3e4a0d8e1ce4d8ed4b50c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:59.813202 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-09a6e4b1-af7a-45b9-bca0-4791500eb154 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4" status: 200 len: 1313 microversion: 2.1 time: 0.380116 Jul 20 04:51:59.814261 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3279/6325] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:59 2022] GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4 => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:00.507663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-665a0204-3efd-4a46-8330-cf057626c88a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:52:00.508325 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-665a0204-3efd-4a46-8330-cf057626c88a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:52:00.508819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-665a0204-3efd-4a46-8330-cf057626c88a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:52:00.509294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-665a0204-3efd-4a46-8330-cf057626c88a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:52:00.509760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-665a0204-3efd-4a46-8330-cf057626c88a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:52:00.526604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-665a0204-3efd-4a46-8330-cf057626c88a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:00.527082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-665a0204-3efd-4a46-8330-cf057626c88a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:00.527942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-665a0204-3efd-4a46-8330-cf057626c88a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:00.538874 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-665a0204-3efd-4a46-8330-cf057626c88a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:00.590787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-665a0204-3efd-4a46-8330-cf057626c88a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Getting quotas for project 222a979e18d041edbe26d2f393181846. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:52:00.621315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-665a0204-3efd-4a46-8330-cf057626c88a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Getting quotas for user 5a107bc948d74e05a622710e8758f841 and project 222a979e18d041edbe26d2f393181846. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:52:00.677626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-665a0204-3efd-4a46-8330-cf057626c88a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:52:00.688393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-665a0204-3efd-4a46-8330-cf057626c88a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:52:00.783606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-c93dad5c-4e00-44e0-89ac-16126fcb7495 req-f7186624-dfee-4209-a53b-ef0e990ad1ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ebd2b2-ab92-441f-9186-c5642abd54d4", "name": "network-vif-plugged", "status": "completed", "tag": "66c9d937-e6ea-42ab-b95f-e8c768448485"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:00.821501 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-665a0204-3efd-4a46-8330-cf057626c88a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.977343 Jul 20 04:52:00.823203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c93dad5c-4e00-44e0-89ac-16126fcb7495 req-f7186624-dfee-4209-a53b-ef0e990ad1ad service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:00.823857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c93dad5c-4e00-44e0-89ac-16126fcb7495 req-f7186624-dfee-4209-a53b-ef0e990ad1ad service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:00.826201 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3047/6326] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:51:58 2022] POST /compute/v2.1/servers => generated 361 bytes in 1984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:52:00.839342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9d8f8cfe-b50d-4c6b-bf8a-4e66e0a21730 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:00.840531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9d8f8cfe-b50d-4c6b-bf8a-4e66e0a21730 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:00.860851 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-c93dad5c-4e00-44e0-89ac-16126fcb7495 req-f7186624-dfee-4209-a53b-ef0e990ad1ad service nova] Creating event network-vif-plugged:66c9d937-e6ea-42ab-b95f-e8c768448485 for instance b5ebd2b2-ab92-441f-9186-c5642abd54d4 on n-h2-826526-5 Jul 20 04:52:00.875750 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-c93dad5c-4e00-44e0-89ac-16126fcb7495 req-f7186624-dfee-4209-a53b-ef0e990ad1ad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103337 Jul 20 04:52:00.879673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d8f8cfe-b50d-4c6b-bf8a-4e66e0a21730 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:00.882754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d8f8cfe-b50d-4c6b-bf8a-4e66e0a21730 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:00.885543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d8f8cfe-b50d-4c6b-bf8a-4e66e0a21730 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:00.889208 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3280/6327] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:00.889763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d8f8cfe-b50d-4c6b-bf8a-4e66e0a21730 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:00.923338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bc97d14b-2a6d-4443-9ce2-9a47083bb545 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:00.924695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bc97d14b-2a6d-4443-9ce2-9a47083bb545 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:01.253693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9d8f8cfe-b50d-4c6b-bf8a-4e66e0a21730 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d25864ee6c04c47a76b8c5e1663d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c94e927bd3e4a0d8e1ce4d8ed4b50c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:01.273323 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9d8f8cfe-b50d-4c6b-bf8a-4e66e0a21730 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4" status: 200 len: 1313 microversion: 2.1 time: 0.442404 Jul 20 04:52:01.275275 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3048/6328] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:00 2022] GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4 => generated 1313 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:01.303037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-7de26715-9926-40b7-bca4-da2ca7c14678 req-13f18a33-bfc7-44ee-ae6a-3dd7dd7ec527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8036792e-0b6c-48cd-b555-ae12a1e52658", "tag": "601b62f4-2275-4b41-82fe-63f8c38fec2e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:01.349501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7de26715-9926-40b7-bca4-da2ca7c14678 req-13f18a33-bfc7-44ee-ae6a-3dd7dd7ec527 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:01.350596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7de26715-9926-40b7-bca4-da2ca7c14678 req-13f18a33-bfc7-44ee-ae6a-3dd7dd7ec527 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:01.381812 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-7de26715-9926-40b7-bca4-da2ca7c14678 req-13f18a33-bfc7-44ee-ae6a-3dd7dd7ec527 service nova] Creating event network-changed:601b62f4-2275-4b41-82fe-63f8c38fec2e for instance 8036792e-0b6c-48cd-b555-ae12a1e52658 on n-h1-826526-5 Jul 20 04:52:01.406754 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-7de26715-9926-40b7-bca4-da2ca7c14678 req-13f18a33-bfc7-44ee-ae6a-3dd7dd7ec527 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116376 Jul 20 04:52:01.407953 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3049/6329] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:01.490936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bc97d14b-2a6d-4443-9ce2-9a47083bb545 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:01.501765 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bc97d14b-2a6d-4443-9ce2-9a47083bb545 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf" status: 200 len: 1241 microversion: 2.1 time: 0.606904 Jul 20 04:52:01.504579 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3281/6330] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:00 2022] GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf => generated 1241 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:02.292650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6892f5b5-ffd3-4472-bd35-1b18d636ee1c tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:02.293397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6892f5b5-ffd3-4472-bd35-1b18d636ee1c tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:02.312742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6892f5b5-ffd3-4472-bd35-1b18d636ee1c tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:02.318976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6892f5b5-ffd3-4472-bd35-1b18d636ee1c tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:02.319936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6892f5b5-ffd3-4472-bd35-1b18d636ee1c tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:02.320421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6892f5b5-ffd3-4472-bd35-1b18d636ee1c tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:02.526321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-878b0706-1136-4007-99d8-a34bce2ff696 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:02.532629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-878b0706-1136-4007-99d8-a34bce2ff696 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:02.551716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-878b0706-1136-4007-99d8-a34bce2ff696 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:02.561253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-878b0706-1136-4007-99d8-a34bce2ff696 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:02.575722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-878b0706-1136-4007-99d8-a34bce2ff696 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:02.578886 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-878b0706-1136-4007-99d8-a34bce2ff696 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:02.946352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-878b0706-1136-4007-99d8-a34bce2ff696 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:02.957375 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-878b0706-1136-4007-99d8-a34bce2ff696 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf" status: 200 len: 1293 microversion: 2.1 time: 0.435367 Jul 20 04:52:02.973347 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3282/6331] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:02 2022] GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf => generated 1293 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:03.190006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6892f5b5-ffd3-4472-bd35-1b18d636ee1c tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d25864ee6c04c47a76b8c5e1663d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c94e927bd3e4a0d8e1ce4d8ed4b50c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:03.204438 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6892f5b5-ffd3-4472-bd35-1b18d636ee1c tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4" status: 200 len: 1313 microversion: 2.1 time: 0.915704 Jul 20 04:52:03.216999 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3050/6332] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:02 2022] GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4 => generated 1313 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:03.975113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-843035bb-7ff8-44eb-a9bc-8b5af98ed416 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:03.975920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-843035bb-7ff8-44eb-a9bc-8b5af98ed416 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:03.994620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-843035bb-7ff8-44eb-a9bc-8b5af98ed416 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:03.995204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-843035bb-7ff8-44eb-a9bc-8b5af98ed416 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:03.997714 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-843035bb-7ff8-44eb-a9bc-8b5af98ed416 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:03.998304 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-843035bb-7ff8-44eb-a9bc-8b5af98ed416 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:04.162722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-843035bb-7ff8-44eb-a9bc-8b5af98ed416 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:04.187918 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-843035bb-7ff8-44eb-a9bc-8b5af98ed416 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf" status: 200 len: 1299 microversion: 2.1 time: 0.214302 Jul 20 04:52:04.189477 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3283/6333] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:03 2022] GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf => generated 1299 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:04.239743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ad6e5abb-1f4f-4abe-942d-e8e5e46e34e0 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:04.245160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ad6e5abb-1f4f-4abe-942d-e8e5e46e34e0 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:04.277855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad6e5abb-1f4f-4abe-942d-e8e5e46e34e0 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:04.278739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad6e5abb-1f4f-4abe-942d-e8e5e46e34e0 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:04.279837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad6e5abb-1f4f-4abe-942d-e8e5e46e34e0 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:04.280619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad6e5abb-1f4f-4abe-942d-e8e5e46e34e0 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:04.694999 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ad6e5abb-1f4f-4abe-942d-e8e5e46e34e0 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d25864ee6c04c47a76b8c5e1663d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c94e927bd3e4a0d8e1ce4d8ed4b50c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:04.705888 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ad6e5abb-1f4f-4abe-942d-e8e5e46e34e0 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4" status: 200 len: 1496 microversion: 2.1 time: 0.486446 Jul 20 04:52:04.720239 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3051/6334] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:04 2022] GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4 => generated 1496 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:05.208880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7d136c50-c66e-4fcc-b236-28f75472afce tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:05.209678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7d136c50-c66e-4fcc-b236-28f75472afce tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:05.231722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d136c50-c66e-4fcc-b236-28f75472afce tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:05.232887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d136c50-c66e-4fcc-b236-28f75472afce tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:05.237314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d136c50-c66e-4fcc-b236-28f75472afce tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:05.238090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d136c50-c66e-4fcc-b236-28f75472afce tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:05.535788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7d136c50-c66e-4fcc-b236-28f75472afce tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:05.549525 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7d136c50-c66e-4fcc-b236-28f75472afce tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf" status: 200 len: 1299 microversion: 2.1 time: 0.344993 Jul 20 04:52:05.555432 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3284/6335] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:05 2022] GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf => generated 1299 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:05.919956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f3d205c2-2137-4dcf-b131-29a23bb67a1c req-c8d77a99-8b6e-4d03-8dd2-daad5a6c2d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba590824-3a10-46f1-8a33-6dedae1c42cf", "tag": "37983b66-6083-4b3d-9e37-9ff6f2b13eb2"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:05.962445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:05.991746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f3d205c2-2137-4dcf-b131-29a23bb67a1c req-c8d77a99-8b6e-4d03-8dd2-daad5a6c2d62 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:05.993468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f3d205c2-2137-4dcf-b131-29a23bb67a1c req-c8d77a99-8b6e-4d03-8dd2-daad5a6c2d62 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:06.025953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=85 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:06.033362 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f3d205c2-2137-4dcf-b131-29a23bb67a1c req-c8d77a99-8b6e-4d03-8dd2-daad5a6c2d62 service nova] Creating event network-changed:37983b66-6083-4b3d-9e37-9ff6f2b13eb2 for instance ba590824-3a10-46f1-8a33-6dedae1c42cf on n-h1-826526-5 Jul 20 04:52:06.049284 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f3d205c2-2137-4dcf-b131-29a23bb67a1c req-c8d77a99-8b6e-4d03-8dd2-daad5a6c2d62 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131331 Jul 20 04:52:06.052542 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3052/6336] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:06.573446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8181909f-4ade-42ba-8611-365cfff346de tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:06.574241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8181909f-4ade-42ba-8611-365cfff346de tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:06.602797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8181909f-4ade-42ba-8611-365cfff346de tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:06.603420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8181909f-4ade-42ba-8611-365cfff346de tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:06.604359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8181909f-4ade-42ba-8611-365cfff346de tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:06.604949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8181909f-4ade-42ba-8611-365cfff346de tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:06.848616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8181909f-4ade-42ba-8611-365cfff346de tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:06.863567 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8181909f-4ade-42ba-8611-365cfff346de tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf" status: 200 len: 1299 microversion: 2.1 time: 0.295806 Jul 20 04:52:06.864318 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3285/6337] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:06 2022] GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf => generated 1299 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:07.889593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-86ab0d8c-8176-4e03-b45a-72a1a86c55c2 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:07.890965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-86ab0d8c-8176-4e03-b45a-72a1a86c55c2 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:07.917946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86ab0d8c-8176-4e03-b45a-72a1a86c55c2 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:07.919115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86ab0d8c-8176-4e03-b45a-72a1a86c55c2 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:07.921944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86ab0d8c-8176-4e03-b45a-72a1a86c55c2 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:07.923979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86ab0d8c-8176-4e03-b45a-72a1a86c55c2 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:08.155556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-86ab0d8c-8176-4e03-b45a-72a1a86c55c2 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:08.170384 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-86ab0d8c-8176-4e03-b45a-72a1a86c55c2 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf" status: 200 len: 1299 microversion: 2.1 time: 0.292357 Jul 20 04:52:08.177876 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3053/6338] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:07 2022] GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf => generated 1299 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:09.142982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d905ff5c-5e86-4a47-b21f-0bd286dc232f tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:09.144286 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d905ff5c-5e86-4a47-b21f-0bd286dc232f tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:09.152985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d905ff5c-5e86-4a47-b21f-0bd286dc232f tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.153432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d905ff5c-5e86-4a47-b21f-0bd286dc232f tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.155125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d905ff5c-5e86-4a47-b21f-0bd286dc232f tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.156721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d905ff5c-5e86-4a47-b21f-0bd286dc232f tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.205721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bede98e9-3cb6-42a5-85a2-90bc333c2ef3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:09.216341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bede98e9-3cb6-42a5-85a2-90bc333c2ef3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:09.234508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bede98e9-3cb6-42a5-85a2-90bc333c2ef3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.238904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d905ff5c-5e86-4a47-b21f-0bd286dc232f tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:52:09.239750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bede98e9-3cb6-42a5-85a2-90bc333c2ef3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.246196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bede98e9-3cb6-42a5-85a2-90bc333c2ef3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.251368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bede98e9-3cb6-42a5-85a2-90bc333c2ef3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.372862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:09.478161 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d905ff5c-5e86-4a47-b21f-0bd286dc232f tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4" status: 204 len: 0 microversion: 2.1 time: 0.340822 Jul 20 04:52:09.479616 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3286/6339] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:52:09 2022] DELETE /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:52:09.500028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bede98e9-3cb6-42a5-85a2-90bc333c2ef3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:09.505425 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-38f8a1d1-436d-49be-ab63-2824eb009b97 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:09.506354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-38f8a1d1-436d-49be-ab63-2824eb009b97 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:09.526865 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bede98e9-3cb6-42a5-85a2-90bc333c2ef3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf" status: 200 len: 1299 microversion: 2.1 time: 0.333992 Jul 20 04:52:09.527488 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3054/6340] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:09 2022] GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf => generated 1299 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:09.528847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38f8a1d1-436d-49be-ab63-2824eb009b97 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.529644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38f8a1d1-436d-49be-ab63-2824eb009b97 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.532727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38f8a1d1-436d-49be-ab63-2824eb009b97 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.533481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38f8a1d1-436d-49be-ab63-2824eb009b97 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.826961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-38f8a1d1-436d-49be-ab63-2824eb009b97 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d25864ee6c04c47a76b8c5e1663d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c94e927bd3e4a0d8e1ce4d8ed4b50c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:09.837663 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-38f8a1d1-436d-49be-ab63-2824eb009b97 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4" status: 200 len: 1502 microversion: 2.1 time: 0.350488 Jul 20 04:52:09.838236 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3287/6341] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:09 2022] GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4 => generated 1502 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:10.543383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9bffbbac-adca-48e3-be74-ccabc975a5e3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:10.544009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9bffbbac-adca-48e3-be74-ccabc975a5e3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:10.551947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9bffbbac-adca-48e3-be74-ccabc975a5e3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:10.552472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9bffbbac-adca-48e3-be74-ccabc975a5e3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:10.553264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9bffbbac-adca-48e3-be74-ccabc975a5e3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:10.553718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9bffbbac-adca-48e3-be74-ccabc975a5e3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:10.577706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:10.643293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:10.675265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9bffbbac-adca-48e3-be74-ccabc975a5e3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:10.689497 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9bffbbac-adca-48e3-be74-ccabc975a5e3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf" status: 200 len: 1299 microversion: 2.1 time: 0.149990 Jul 20 04:52:10.690877 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3055/6342] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:10 2022] GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf => generated 1299 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:10.861565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4e823c37-ef70-4a69-94c7-f7db5083252a tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:10.862804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4e823c37-ef70-4a69-94c7-f7db5083252a tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:10.866660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:10.877295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e823c37-ef70-4a69-94c7-f7db5083252a tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:10.877730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e823c37-ef70-4a69-94c7-f7db5083252a tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:10.878664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e823c37-ef70-4a69-94c7-f7db5083252a tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:10.879841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4e823c37-ef70-4a69-94c7-f7db5083252a tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:11.270766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4e823c37-ef70-4a69-94c7-f7db5083252a tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d25864ee6c04c47a76b8c5e1663d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c94e927bd3e4a0d8e1ce4d8ed4b50c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:11.281685 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4e823c37-ef70-4a69-94c7-f7db5083252a tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4" status: 200 len: 1502 microversion: 2.1 time: 0.424083 Jul 20 04:52:11.282510 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3288/6343] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:10 2022] GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4 => generated 1502 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:11.714832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-67b04e5a-12e8-4bc7-87a7-523f6de04583 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:11.715597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-67b04e5a-12e8-4bc7-87a7-523f6de04583 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:11.751223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-67b04e5a-12e8-4bc7-87a7-523f6de04583 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:11.765915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-67b04e5a-12e8-4bc7-87a7-523f6de04583 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:11.766941 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-67b04e5a-12e8-4bc7-87a7-523f6de04583 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:11.767541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-67b04e5a-12e8-4bc7-87a7-523f6de04583 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:11.836556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-1af1afde-ffdb-4731-996e-87d9eb1b9c82 req-9ce5f35d-2548-48f9-90a0-d8ce6d6f2bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ebd2b2-ab92-441f-9186-c5642abd54d4", "name": "network-vif-deleted", "tag": "66c9d937-e6ea-42ab-b95f-e8c768448485"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:11.849406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:11.855219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1af1afde-ffdb-4731-996e-87d9eb1b9c82 req-9ce5f35d-2548-48f9-90a0-d8ce6d6f2bf5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:11.856327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1af1afde-ffdb-4731-996e-87d9eb1b9c82 req-9ce5f35d-2548-48f9-90a0-d8ce6d6f2bf5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:11.873147 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-1af1afde-ffdb-4731-996e-87d9eb1b9c82 req-9ce5f35d-2548-48f9-90a0-d8ce6d6f2bf5 service nova] Creating event network-vif-deleted:66c9d937-e6ea-42ab-b95f-e8c768448485 for instance b5ebd2b2-ab92-441f-9186-c5642abd54d4 on n-h2-826526-5 Jul 20 04:52:11.879755 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-1af1afde-ffdb-4731-996e-87d9eb1b9c82 req-9ce5f35d-2548-48f9-90a0-d8ce6d6f2bf5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050482 Jul 20 04:52:11.885316 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3289/6344] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:11.971739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-3bd22f0f-9923-4b55-881d-5bd79a39f9f4 req-5daa21d7-5fc8-4adf-8768-04a4d1865d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba590824-3a10-46f1-8a33-6dedae1c42cf", "name": "network-vif-plugged", "status": "completed", "tag": "37983b66-6083-4b3d-9e37-9ff6f2b13eb2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:12.005107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-67b04e5a-12e8-4bc7-87a7-523f6de04583 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:12.018794 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-67b04e5a-12e8-4bc7-87a7-523f6de04583 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf" status: 200 len: 1299 microversion: 2.1 time: 0.310560 Jul 20 04:52:12.031941 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3056/6345] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:11 2022] GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf => generated 1299 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:12.034694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3bd22f0f-9923-4b55-881d-5bd79a39f9f4 req-5daa21d7-5fc8-4adf-8768-04a4d1865d9e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:12.039599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3bd22f0f-9923-4b55-881d-5bd79a39f9f4 req-5daa21d7-5fc8-4adf-8768-04a4d1865d9e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:12.063209 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-3bd22f0f-9923-4b55-881d-5bd79a39f9f4 req-5daa21d7-5fc8-4adf-8768-04a4d1865d9e service nova] Creating event network-vif-plugged:37983b66-6083-4b3d-9e37-9ff6f2b13eb2 for instance ba590824-3a10-46f1-8a33-6dedae1c42cf on n-h1-826526-5 Jul 20 04:52:12.072605 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-3bd22f0f-9923-4b55-881d-5bd79a39f9f4 req-5daa21d7-5fc8-4adf-8768-04a4d1865d9e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106455 Jul 20 04:52:12.073360 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3290/6346] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:12.302416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea40127d-5b4b-4e58-a3e4-d8a8a1ad8814 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:12.303123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ea40127d-5b4b-4e58-a3e4-d8a8a1ad8814 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:12.313821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea40127d-5b4b-4e58-a3e4-d8a8a1ad8814 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:12.315305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea40127d-5b4b-4e58-a3e4-d8a8a1ad8814 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:12.316440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea40127d-5b4b-4e58-a3e4-d8a8a1ad8814 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:12.317930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea40127d-5b4b-4e58-a3e4-d8a8a1ad8814 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:12.371292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea40127d-5b4b-4e58-a3e4-d8a8a1ad8814 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:12.379412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea40127d-5b4b-4e58-a3e4-d8a8a1ad8814 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:12.381431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-ea40127d-5b4b-4e58-a3e4-d8a8a1ad8814 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lazy-loading 'fault' on Instance uuid b5ebd2b2-ab92-441f-9186-c5642abd54d4 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:52:12.454158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ea40127d-5b4b-4e58-a3e4-d8a8a1ad8814 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d25864ee6c04c47a76b8c5e1663d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c94e927bd3e4a0d8e1ce4d8ed4b50c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:12.465624 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ea40127d-5b4b-4e58-a3e4-d8a8a1ad8814 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4" status: 200 len: 1303 microversion: 2.1 time: 0.167027 Jul 20 04:52:12.467640 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3057/6347] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:12 2022] GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4 => generated 1303 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:13.039999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1341c280-5fc2-41fd-9413-24f67c3b767e tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:13.042312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1341c280-5fc2-41fd-9413-24f67c3b767e tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:13.052246 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1341c280-5fc2-41fd-9413-24f67c3b767e tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:13.052850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1341c280-5fc2-41fd-9413-24f67c3b767e tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:13.053834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1341c280-5fc2-41fd-9413-24f67c3b767e tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:13.054277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1341c280-5fc2-41fd-9413-24f67c3b767e tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:13.201039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1341c280-5fc2-41fd-9413-24f67c3b767e tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:13.210171 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1341c280-5fc2-41fd-9413-24f67c3b767e tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf" status: 200 len: 1299 microversion: 2.1 time: 0.175233 Jul 20 04:52:13.211390 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3291/6348] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:13 2022] GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf => generated 1299 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:13.491183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0b5a786e-c2e5-4724-bf4b-d25f09f20be5 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:13.492875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0b5a786e-c2e5-4724-bf4b-d25f09f20be5 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] [instance: b5ebd2b2-ab92-441f-9186-c5642abd54d4] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:13.502608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b5a786e-c2e5-4724-bf4b-d25f09f20be5 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:13.503302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b5a786e-c2e5-4724-bf4b-d25f09f20be5 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:13.507933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b5a786e-c2e5-4724-bf4b-d25f09f20be5 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:13.508827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b5a786e-c2e5-4724-bf4b-d25f09f20be5 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:13.525486 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-0b5a786e-c2e5-4724-bf4b-d25f09f20be5 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] HTTP exception thrown: Instance b5ebd2b2-ab92-441f-9186-c5642abd54d4 could not be found. Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0b5a786e-c2e5-4724-bf4b-d25f09f20be5 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Request method failure captured: Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4 HTTP/1.1 Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14ng0P5xhx6uXYpo8-qdGd6qOEf7P_GlFi9WRFVnsCccFShytPIS3iJNHv_tKkAIVkGPv4wnnwGlpEPXHcZAzDvD60ALhSFA2xj-SRwrdkp8oUD1rQZtbS4I4A3dyCXdAjcUox2vwr4rk7ynFWCa1wURL2w8zzUpoEJOoq75l5L7mAc Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4c94e927bd3e4a0d8e1ce4d8ed4b50c9 Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-VolumesActionsTest-1244003334 Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c94e927bd3e4a0d8e1ce4d8ed4b50c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c94e927bd3e4a0d8e1ce4d8ed4b50c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c94e927bd3e4a0d8e1ce4d8ed4b50c9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c94e927bd3e4a0d8e1ce4d8ed4b50c9"}]}] Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-VolumesActionsTest-1244003334 Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4c94e927bd3e4a0d8e1ce4d8ed4b50c9 Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-VolumesActionsTest-1244003334 Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-VolumesActionsTest-1244003334-project Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 3d25864ee6c04c47a76b8c5e1663d7b9 Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-VolumesActionsTest-1244003334-project Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance b5ebd2b2-ab92-441f-9186-c5642abd54d4 could not be found. Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'b5ebd2b2-ab92-441f-9186-c5642abd54d4'} Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5ebd2b2-ab92-441f-9186-c5642abd54d4 could not be found. Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5ebd2b2-ab92-441f-9186-c5642abd54d4 could not be found. Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:13.527639 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.531918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:13.531918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:13.531918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:13.531918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:52:13.531918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:52:13.531918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5ebd2b2-ab92-441f-9186-c5642abd54d4 could not be found. Jul 20 04:52:13.531918 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.533732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0b5a786e-c2e5-4724-bf4b-d25f09f20be5 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] Returning 404 to user: Instance b5ebd2b2-ab92-441f-9186-c5642abd54d4 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:52:13.534766 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0b5a786e-c2e5-4724-bf4b-d25f09f20be5 tempest-VolumesActionsTest-1244003334 tempest-VolumesActionsTest-1244003334-project] 10.222.0.17 "GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4" status: 404 len: 111 microversion: 2.1 time: 0.048758 Jul 20 04:52:13.535537 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3058/6349] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:13 2022] GET /compute/v2.1/servers/b5ebd2b2-ab92-441f-9186-c5642abd54d4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:52:14.228224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-24cd446d-992a-4e19-a1a0-f261dbd58eeb tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:14.228879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-24cd446d-992a-4e19-a1a0-f261dbd58eeb tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:14.240190 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24cd446d-992a-4e19-a1a0-f261dbd58eeb tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:14.241149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24cd446d-992a-4e19-a1a0-f261dbd58eeb tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:14.242097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24cd446d-992a-4e19-a1a0-f261dbd58eeb tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:14.242698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24cd446d-992a-4e19-a1a0-f261dbd58eeb tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:14.380468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-24cd446d-992a-4e19-a1a0-f261dbd58eeb tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:14.401611 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-24cd446d-992a-4e19-a1a0-f261dbd58eeb tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf" status: 200 len: 1472 microversion: 2.1 time: 0.177974 Jul 20 04:52:14.404991 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3292/6350] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:14 2022] GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf => generated 1472 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:14.422810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2a7114f2-547e-432c-bb1e-036a6a84a8d3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:14.423577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2a7114f2-547e-432c-bb1e-036a6a84a8d3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:14.432807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a7114f2-547e-432c-bb1e-036a6a84a8d3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:14.433569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a7114f2-547e-432c-bb1e-036a6a84a8d3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:14.434714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a7114f2-547e-432c-bb1e-036a6a84a8d3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:14.435487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a7114f2-547e-432c-bb1e-036a6a84a8d3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:14.576395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2a7114f2-547e-432c-bb1e-036a6a84a8d3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:14.590211 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2a7114f2-547e-432c-bb1e-036a6a84a8d3 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf" status: 200 len: 1472 microversion: 2.1 time: 0.172083 Jul 20 04:52:14.591112 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3059/6351] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:14 2022] GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf => generated 1472 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:14.617781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ab281652-d275-445e-8788-77d8bc2f8a5f tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:14.618403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ab281652-d275-445e-8788-77d8bc2f8a5f tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:14.638660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab281652-d275-445e-8788-77d8bc2f8a5f tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:14.649062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab281652-d275-445e-8788-77d8bc2f8a5f tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:14.650141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab281652-d275-445e-8788-77d8bc2f8a5f tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:14.650740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab281652-d275-445e-8788-77d8bc2f8a5f tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:14.804781 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ab281652-d275-445e-8788-77d8bc2f8a5f tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf" status: 200 len: 1623 microversion: 2.1 time: 0.198578 Jul 20 04:52:14.806030 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3293/6352] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:14 2022] GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf => generated 1623 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:14.829937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7d284988-22d6-4764-b294-01ac1766c360 tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:14.830588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7d284988-22d6-4764-b294-01ac1766c360 tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:14.850886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d284988-22d6-4764-b294-01ac1766c360 tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:14.850886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d284988-22d6-4764-b294-01ac1766c360 tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:14.851665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d284988-22d6-4764-b294-01ac1766c360 tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:14.852124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d284988-22d6-4764-b294-01ac1766c360 tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:15.143657 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7d284988-22d6-4764-b294-01ac1766c360 tempest-TestSecurityGroupsBasicOps-529941220 tempest-TestSecurityGroupsBasicOps-529941220-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 200 len: 1913 microversion: 2.1 time: 0.317867 Jul 20 04:52:15.144284 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3060/6353] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:14 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 1913 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:15.291482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7a4c2aa2-38db-4224-9cb5-e35d6f52d5d8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:15.294152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7a4c2aa2-38db-4224-9cb5-e35d6f52d5d8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:15.302560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a4c2aa2-38db-4224-9cb5-e35d6f52d5d8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:15.303032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a4c2aa2-38db-4224-9cb5-e35d6f52d5d8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:15.303860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a4c2aa2-38db-4224-9cb5-e35d6f52d5d8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:15.304233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7a4c2aa2-38db-4224-9cb5-e35d6f52d5d8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:15.339693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7a4c2aa2-38db-4224-9cb5-e35d6f52d5d8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:52:15.492619 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7a4c2aa2-38db-4224-9cb5-e35d6f52d5d8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf" status: 204 len: 0 microversion: 2.1 time: 0.204982 Jul 20 04:52:15.493155 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3294/6354] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:52:15 2022] DELETE /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:52:15.502996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e9c931c2-8b59-4394-b651-67fcd5fe2b53 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:15.503647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e9c931c2-8b59-4394-b651-67fcd5fe2b53 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:15.536179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9c931c2-8b59-4394-b651-67fcd5fe2b53 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:15.540693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9c931c2-8b59-4394-b651-67fcd5fe2b53 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:15.545494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9c931c2-8b59-4394-b651-67fcd5fe2b53 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:15.550727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9c931c2-8b59-4394-b651-67fcd5fe2b53 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:15.701138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e9c931c2-8b59-4394-b651-67fcd5fe2b53 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:15.712379 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e9c931c2-8b59-4394-b651-67fcd5fe2b53 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf" status: 200 len: 1478 microversion: 2.1 time: 0.214298 Jul 20 04:52:15.724024 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3061/6355] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:15 2022] GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf => generated 1478 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:16.731437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8e12187f-1870-4ee2-9f44-cfab39a5ce0d tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:16.732339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8e12187f-1870-4ee2-9f44-cfab39a5ce0d tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:16.744923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8e12187f-1870-4ee2-9f44-cfab39a5ce0d tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:16.745266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8e12187f-1870-4ee2-9f44-cfab39a5ce0d tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:16.746526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8e12187f-1870-4ee2-9f44-cfab39a5ce0d tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:16.747140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8e12187f-1870-4ee2-9f44-cfab39a5ce0d tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:16.944600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8e12187f-1870-4ee2-9f44-cfab39a5ce0d tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:16.975215 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8e12187f-1870-4ee2-9f44-cfab39a5ce0d tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf" status: 200 len: 1478 microversion: 2.1 time: 0.247840 Jul 20 04:52:16.975832 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3295/6356] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:16 2022] GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf => generated 1478 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:17.719121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-d9ca1e02-20b2-409f-9c8d-7727d0cb4ad6 req-67c9e5b5-4ecf-45a7-99ea-535735e66c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba590824-3a10-46f1-8a33-6dedae1c42cf", "name": "network-vif-deleted", "tag": "37983b66-6083-4b3d-9e37-9ff6f2b13eb2"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:17.730218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d9ca1e02-20b2-409f-9c8d-7727d0cb4ad6 req-67c9e5b5-4ecf-45a7-99ea-535735e66c06 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:17.731194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d9ca1e02-20b2-409f-9c8d-7727d0cb4ad6 req-67c9e5b5-4ecf-45a7-99ea-535735e66c06 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:17.747472 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-d9ca1e02-20b2-409f-9c8d-7727d0cb4ad6 req-67c9e5b5-4ecf-45a7-99ea-535735e66c06 service nova] Creating event network-vif-deleted:37983b66-6083-4b3d-9e37-9ff6f2b13eb2 for instance ba590824-3a10-46f1-8a33-6dedae1c42cf on n-h1-826526-5 Jul 20 04:52:17.758130 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-d9ca1e02-20b2-409f-9c8d-7727d0cb4ad6 req-67c9e5b5-4ecf-45a7-99ea-535735e66c06 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047400 Jul 20 04:52:17.759530 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3062/6357] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:17.997144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4f3b9dd2-add4-4fa9-8e14-371f0c59cf16 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:18.000127 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4f3b9dd2-add4-4fa9-8e14-371f0c59cf16 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:18.011491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f3b9dd2-add4-4fa9-8e14-371f0c59cf16 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:18.011952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f3b9dd2-add4-4fa9-8e14-371f0c59cf16 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:18.012761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f3b9dd2-add4-4fa9-8e14-371f0c59cf16 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:18.019268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f3b9dd2-add4-4fa9-8e14-371f0c59cf16 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:18.077569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f3b9dd2-add4-4fa9-8e14-371f0c59cf16 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:18.078253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f3b9dd2-add4-4fa9-8e14-371f0c59cf16 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:18.078904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-4f3b9dd2-add4-4fa9-8e14-371f0c59cf16 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lazy-loading 'fault' on Instance uuid ba590824-3a10-46f1-8a33-6dedae1c42cf {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:52:18.153888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4f3b9dd2-add4-4fa9-8e14-371f0c59cf16 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:18.166621 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4f3b9dd2-add4-4fa9-8e14-371f0c59cf16 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf" status: 200 len: 1331 microversion: 2.1 time: 0.177391 Jul 20 04:52:18.167970 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3296/6358] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:17 2022] GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf => generated 1331 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:19.194061 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d722dc33-47ca-4c4d-8918-d04eced58737 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:19.195357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d722dc33-47ca-4c4d-8918-d04eced58737 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: ba590824-3a10-46f1-8a33-6dedae1c42cf] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:19.206933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d722dc33-47ca-4c4d-8918-d04eced58737 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:19.207430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d722dc33-47ca-4c4d-8918-d04eced58737 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:19.208607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d722dc33-47ca-4c4d-8918-d04eced58737 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:19.209730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d722dc33-47ca-4c4d-8918-d04eced58737 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:19.230380 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-d722dc33-47ca-4c4d-8918-d04eced58737 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] HTTP exception thrown: Instance ba590824-3a10-46f1-8a33-6dedae1c42cf could not be found. Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d722dc33-47ca-4c4d-8918-d04eced58737 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Request method failure captured: Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf HTTP/1.1 Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14miVidoxtf5CS6nQ_rEFbB4xMjPDadGYrfJDxrZfT3-JdXdoG4rWy_krynifoqcOMCgSPd0QDw7yxZHvjF8yEawkv3yaVhDGnzX50C4rfMuFsFH2omFBtpIM_bQNdKFznX3j6Jja4S7l2LbCjROInqkRV8BhSpHjCbGig6ESmG2gQ4 Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 222a979e18d041edbe26d2f393181846 Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1246159580 Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/222a979e18d041edbe26d2f393181846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/222a979e18d041edbe26d2f393181846"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_222a979e18d041edbe26d2f393181846", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/222a979e18d041edbe26d2f393181846"}]}] Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1246159580 Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 222a979e18d041edbe26d2f393181846 Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1246159580 Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestSecurityGroupsBasicOps-1246159580-project Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 5a107bc948d74e05a622710e8758f841 Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1246159580-project Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance ba590824-3a10-46f1-8a33-6dedae1c42cf could not be found. Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'ba590824-3a10-46f1-8a33-6dedae1c42cf'} Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba590824-3a10-46f1-8a33-6dedae1c42cf could not be found. Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba590824-3a10-46f1-8a33-6dedae1c42cf could not be found. Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:19.232494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:52:19.237592 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:19.237592 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:19.237592 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:19.237592 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:52:19.237592 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:52:19.237592 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba590824-3a10-46f1-8a33-6dedae1c42cf could not be found. Jul 20 04:52:19.237592 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:52:19.239391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d722dc33-47ca-4c4d-8918-d04eced58737 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Returning 404 to user: Instance ba590824-3a10-46f1-8a33-6dedae1c42cf could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:52:19.241678 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d722dc33-47ca-4c4d-8918-d04eced58737 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf" status: 404 len: 111 microversion: 2.1 time: 0.057169 Jul 20 04:52:19.247774 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3063/6359] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:19 2022] GET /compute/v2.1/servers/ba590824-3a10-46f1-8a33-6dedae1c42cf => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:52:19.316762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ec1bb86b-3d4c-4cec-8b4f-f63366a19120 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-32373345", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1993339905", "security_groups": [{"name": "tempest-secgroup-smoke-1136622068"}], "block_device_mapping_v2": [{"uuid": "027e9877-4b64-494a-bfc8-fedab5b30745", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7f25ae6d-be40-4c15-969a-9d88fe94c163"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:19.535463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-ec1bb86b-3d4c-4cec-8b4f-f63366a19120 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] validate_networks() for [('7f25ae6d-be40-4c15-969a-9d88fe94c163', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:52:20.313529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ec1bb86b-3d4c-4cec-8b4f-f63366a19120 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:52:20.314191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ec1bb86b-3d4c-4cec-8b4f-f63366a19120 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:52:20.314901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ec1bb86b-3d4c-4cec-8b4f-f63366a19120 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:52:20.316032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ec1bb86b-3d4c-4cec-8b4f-f63366a19120 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:52:20.316660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-ec1bb86b-3d4c-4cec-8b4f-f63366a19120 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:52:20.334932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec1bb86b-3d4c-4cec-8b4f-f63366a19120 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:20.335648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec1bb86b-3d4c-4cec-8b4f-f63366a19120 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:20.340719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec1bb86b-3d4c-4cec-8b4f-f63366a19120 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:20.341180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec1bb86b-3d4c-4cec-8b4f-f63366a19120 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:20.375512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-ec1bb86b-3d4c-4cec-8b4f-f63366a19120 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Getting quotas for project b889ad56221143f0a54450c81ba738a7. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:52:20.384033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-ec1bb86b-3d4c-4cec-8b4f-f63366a19120 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Getting quotas for user bc760e8f522640fc9190460719f5dcc2 and project b889ad56221143f0a54450c81ba738a7. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:52:20.502570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ec1bb86b-3d4c-4cec-8b4f-f63366a19120 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:52:20.505533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ec1bb86b-3d4c-4cec-8b4f-f63366a19120 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='027e9877-4b64-494a-bfc8-fedab5b30745',volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:52:20.852341 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ec1bb86b-3d4c-4cec-8b4f-f63366a19120 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.539589 Jul 20 04:52:20.855383 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3297/6360] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:52:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:52:20.864136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bc11bf35-9168-43d5-aa7e-3dccf9e1a033 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:20.865389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bc11bf35-9168-43d5-aa7e-3dccf9e1a033 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:21.061795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bc11bf35-9168-43d5-aa7e-3dccf9e1a033 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:21.071585 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bc11bf35-9168-43d5-aa7e-3dccf9e1a033 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1093 microversion: 2.1 time: 0.211828 Jul 20 04:52:21.074469 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3064/6361] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:20 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1093 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:22.090967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c21919e4-4a2f-4701-bf3b-4db10fd51056 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:22.091692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c21919e4-4a2f-4701-bf3b-4db10fd51056 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:22.113969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c21919e4-4a2f-4701-bf3b-4db10fd51056 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:22.114899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c21919e4-4a2f-4701-bf3b-4db10fd51056 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:22.117420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c21919e4-4a2f-4701-bf3b-4db10fd51056 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:22.119209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c21919e4-4a2f-4701-bf3b-4db10fd51056 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:22.261571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c21919e4-4a2f-4701-bf3b-4db10fd51056 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:22.281380 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c21919e4-4a2f-4701-bf3b-4db10fd51056 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1135 microversion: 2.1 time: 0.195498 Jul 20 04:52:22.285790 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3298/6362] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:22 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1135 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:23.305024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ccfcdf43-5a00-408d-bb24-550092247a9e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:23.310205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ccfcdf43-5a00-408d-bb24-550092247a9e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:23.331478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccfcdf43-5a00-408d-bb24-550092247a9e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:23.331949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccfcdf43-5a00-408d-bb24-550092247a9e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:23.332804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccfcdf43-5a00-408d-bb24-550092247a9e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:23.333256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccfcdf43-5a00-408d-bb24-550092247a9e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:23.809806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ccfcdf43-5a00-408d-bb24-550092247a9e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:23.818422 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ccfcdf43-5a00-408d-bb24-550092247a9e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1209 microversion: 2.1 time: 0.518811 Jul 20 04:52:23.819000 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3065/6363] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:23 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1209 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:24.836222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cf817925-1557-4c1c-83b7-0d8380706e1c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:24.837088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cf817925-1557-4c1c-83b7-0d8380706e1c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:24.857338 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf817925-1557-4c1c-83b7-0d8380706e1c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:24.858139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf817925-1557-4c1c-83b7-0d8380706e1c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:24.861766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf817925-1557-4c1c-83b7-0d8380706e1c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:24.865208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf817925-1557-4c1c-83b7-0d8380706e1c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:25.208416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cf817925-1557-4c1c-83b7-0d8380706e1c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:25.225168 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cf817925-1557-4c1c-83b7-0d8380706e1c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1209 microversion: 2.1 time: 0.389463 Jul 20 04:52:25.227013 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3299/6364] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:24 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1209 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:26.243609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a6d40e94-7b0e-480e-8df6-f73069ce87e2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:26.247184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a6d40e94-7b0e-480e-8df6-f73069ce87e2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:26.259228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6d40e94-7b0e-480e-8df6-f73069ce87e2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:26.261550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6d40e94-7b0e-480e-8df6-f73069ce87e2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:26.262470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6d40e94-7b0e-480e-8df6-f73069ce87e2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:26.264199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6d40e94-7b0e-480e-8df6-f73069ce87e2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:26.443376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a6d40e94-7b0e-480e-8df6-f73069ce87e2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:26.452546 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a6d40e94-7b0e-480e-8df6-f73069ce87e2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1209 microversion: 2.1 time: 0.213295 Jul 20 04:52:26.456716 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3066/6365] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:26 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1209 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:27.472621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9fc0e0a7-86c2-4371-979f-c8a6b4d5e8b2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:27.473422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9fc0e0a7-86c2-4371-979f-c8a6b4d5e8b2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:27.492069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fc0e0a7-86c2-4371-979f-c8a6b4d5e8b2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:27.495098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fc0e0a7-86c2-4371-979f-c8a6b4d5e8b2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:27.495961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fc0e0a7-86c2-4371-979f-c8a6b4d5e8b2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:27.496546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fc0e0a7-86c2-4371-979f-c8a6b4d5e8b2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:28.410179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9fc0e0a7-86c2-4371-979f-c8a6b4d5e8b2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:28.421750 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9fc0e0a7-86c2-4371-979f-c8a6b4d5e8b2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1277 microversion: 2.1 time: 0.954618 Jul 20 04:52:28.426391 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3300/6366] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:27 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1277 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:29.443177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-258b3d91-b264-46c2-834a-e6f0d759779e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:29.443828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-258b3d91-b264-46c2-834a-e6f0d759779e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:29.452115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-258b3d91-b264-46c2-834a-e6f0d759779e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:29.455305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-258b3d91-b264-46c2-834a-e6f0d759779e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:29.456449 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-258b3d91-b264-46c2-834a-e6f0d759779e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:29.457124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-258b3d91-b264-46c2-834a-e6f0d759779e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:29.889340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-258b3d91-b264-46c2-834a-e6f0d759779e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:29.898607 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-258b3d91-b264-46c2-834a-e6f0d759779e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1277 microversion: 2.1 time: 0.460198 Jul 20 04:52:29.909467 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3067/6367] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:29 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1277 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:30.163686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-471b7009-a951-4450-8853-2d9c62bee1fc tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:30.164613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-471b7009-a951-4450-8853-2d9c62bee1fc tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:30.178864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-471b7009-a951-4450-8853-2d9c62bee1fc tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:30.179327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-471b7009-a951-4450-8853-2d9c62bee1fc tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:30.180121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-471b7009-a951-4450-8853-2d9c62bee1fc tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:30.180598 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-471b7009-a951-4450-8853-2d9c62bee1fc tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:30.215080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-26aa31f4-fa8b-4c53-a32b-466786653418 req-0c8b7e74-964c-4b57-acf6-a0178114b962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e4f01a-5e8a-44e9-91c1-d8c3d62eed43", "tag": "37fcf64f-a6f4-4362-9023-c589f3313737"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:30.232929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-26aa31f4-fa8b-4c53-a32b-466786653418 req-0c8b7e74-964c-4b57-acf6-a0178114b962 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:30.233132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-26aa31f4-fa8b-4c53-a32b-466786653418 req-0c8b7e74-964c-4b57-acf6-a0178114b962 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:30.255257 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-471b7009-a951-4450-8853-2d9c62bee1fc tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:52:30.288090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:30.298667 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-26aa31f4-fa8b-4c53-a32b-466786653418 req-0c8b7e74-964c-4b57-acf6-a0178114b962 service nova] Creating event network-changed:37fcf64f-a6f4-4362-9023-c589f3313737 for instance 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 on n-h2-826526-5 Jul 20 04:52:30.329996 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-26aa31f4-fa8b-4c53-a32b-466786653418 req-0c8b7e74-964c-4b57-acf6-a0178114b962 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116298 Jul 20 04:52:30.334087 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3068/6368] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:52:30.378543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:30.400881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:30.470497 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-471b7009-a951-4450-8853-2d9c62bee1fc tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "DELETE /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 204 len: 0 microversion: 2.1 time: 0.307572 Jul 20 04:52:30.477747 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3301/6369] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:52:30 2022] DELETE /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:52:30.488709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-af7e4d02-70fe-4091-9508-1b2e0e1b7b62 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:30.489790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-af7e4d02-70fe-4091-9508-1b2e0e1b7b62 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:30.512707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af7e4d02-70fe-4091-9508-1b2e0e1b7b62 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:30.514206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af7e4d02-70fe-4091-9508-1b2e0e1b7b62 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:30.516282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af7e4d02-70fe-4091-9508-1b2e0e1b7b62 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:30.516282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af7e4d02-70fe-4091-9508-1b2e0e1b7b62 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:30.720037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-31961f5b-5735-476b-884d-b88cb67c2632 req-625727d3-f101-494a-9b0b-0f44b0604658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e90e3d-5a5f-4482-8fc8-8614c72b94ca", "tag": "89445be6-97ad-43c3-9071-1cefd5f48b69"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:30.737580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-31961f5b-5735-476b-884d-b88cb67c2632 req-625727d3-f101-494a-9b0b-0f44b0604658 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:30.741162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-31961f5b-5735-476b-884d-b88cb67c2632 req-625727d3-f101-494a-9b0b-0f44b0604658 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:30.784562 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-31961f5b-5735-476b-884d-b88cb67c2632 req-625727d3-f101-494a-9b0b-0f44b0604658 service nova] Creating event network-changed:89445be6-97ad-43c3-9071-1cefd5f48b69 for instance 29e90e3d-5a5f-4482-8fc8-8614c72b94ca on n-h2-826526-5 Jul 20 04:52:30.794139 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-31961f5b-5735-476b-884d-b88cb67c2632 req-625727d3-f101-494a-9b0b-0f44b0604658 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078415 Jul 20 04:52:30.797496 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3302/6370] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:30.918473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cc8c8d3e-9ae8-47bc-ab0f-b387303e4b43 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:30.919532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cc8c8d3e-9ae8-47bc-ab0f-b387303e4b43 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:30.932708 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-af7e4d02-70fe-4091-9508-1b2e0e1b7b62 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:30.940103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc8c8d3e-9ae8-47bc-ab0f-b387303e4b43 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:30.941014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc8c8d3e-9ae8-47bc-ab0f-b387303e4b43 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:30.941161 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-af7e4d02-70fe-4091-9508-1b2e0e1b7b62 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 200 len: 1768 microversion: 2.1 time: 0.458153 Jul 20 04:52:30.946342 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3069/6371] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:30 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 1768 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:30.955571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc8c8d3e-9ae8-47bc-ab0f-b387303e4b43 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:30.960899 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc8c8d3e-9ae8-47bc-ab0f-b387303e4b43 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:31.345623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cc8c8d3e-9ae8-47bc-ab0f-b387303e4b43 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:31.355697 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cc8c8d3e-9ae8-47bc-ab0f-b387303e4b43 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1277 microversion: 2.1 time: 0.443601 Jul 20 04:52:31.369439 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3303/6372] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:30 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1277 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:31.961353 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1418b1ba-dd90-4cd6-ae2d-22606c6f1bf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:31.961957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1418b1ba-dd90-4cd6-ae2d-22606c6f1bf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:31.975533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:31.981291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1418b1ba-dd90-4cd6-ae2d-22606c6f1bf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:31.986992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1418b1ba-dd90-4cd6-ae2d-22606c6f1bf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:31.989301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1418b1ba-dd90-4cd6-ae2d-22606c6f1bf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:31.989921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1418b1ba-dd90-4cd6-ae2d-22606c6f1bf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:32.396535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7adff98c-2a1d-4b01-81ec-d52d730f7e2f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:32.401594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7adff98c-2a1d-4b01-81ec-d52d730f7e2f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:32.492901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7adff98c-2a1d-4b01-81ec-d52d730f7e2f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:32.495331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7adff98c-2a1d-4b01-81ec-d52d730f7e2f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:32.497695 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7adff98c-2a1d-4b01-81ec-d52d730f7e2f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:32.503801 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7adff98c-2a1d-4b01-81ec-d52d730f7e2f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:32.898956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1418b1ba-dd90-4cd6-ae2d-22606c6f1bf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:32.912362 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1418b1ba-dd90-4cd6-ae2d-22606c6f1bf0 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 200 len: 1768 microversion: 2.1 time: 0.956998 Jul 20 04:52:32.916601 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3070/6373] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:31 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 1768 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:33.412640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ba73c4c6-1a8c-4653-8992-5241403deb47 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:33.413278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ba73c4c6-1a8c-4653-8992-5241403deb47 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:33.464212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba73c4c6-1a8c-4653-8992-5241403deb47 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:33.470679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba73c4c6-1a8c-4653-8992-5241403deb47 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:33.496740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba73c4c6-1a8c-4653-8992-5241403deb47 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:33.497348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba73c4c6-1a8c-4653-8992-5241403deb47 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:33.538906 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ba73c4c6-1a8c-4653-8992-5241403deb47 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/ips" status: 200 len: 149 microversion: 2.1 time: 0.146732 Jul 20 04:52:33.539767 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3071/6374] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 04:52:33 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/ips => generated 149 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:33.900709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7adff98c-2a1d-4b01-81ec-d52d730f7e2f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:33.919313 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7adff98c-2a1d-4b01-81ec-d52d730f7e2f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1277 microversion: 2.1 time: 1.530267 Jul 20 04:52:33.942913 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3304/6375] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:32 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1277 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:33.949134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1456f093-9485-4e48-8980-be9845e4437a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:33.950027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1456f093-9485-4e48-8980-be9845e4437a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:33.965607 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1456f093-9485-4e48-8980-be9845e4437a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:33.967088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1456f093-9485-4e48-8980-be9845e4437a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:33.968337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1456f093-9485-4e48-8980-be9845e4437a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:33.968732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1456f093-9485-4e48-8980-be9845e4437a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:34.308004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1456f093-9485-4e48-8980-be9845e4437a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:34.317170 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1456f093-9485-4e48-8980-be9845e4437a tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 200 len: 1649 microversion: 2.1 time: 0.389941 Jul 20 04:52:34.320542 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3072/6376] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:33 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 1649 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:34.686206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-b1a99c18-97e7-4c8e-b6cf-d7ed4ab216ea req-95b89c8c-284d-48de-a4d7-c464e302fdcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e4f01a-5e8a-44e9-91c1-d8c3d62eed43", "name": "network-vif-deleted", "tag": "37fcf64f-a6f4-4362-9023-c589f3313737"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:34.710553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-b1a99c18-97e7-4c8e-b6cf-d7ed4ab216ea req-95b89c8c-284d-48de-a4d7-c464e302fdcd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:34.711334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-b1a99c18-97e7-4c8e-b6cf-d7ed4ab216ea req-95b89c8c-284d-48de-a4d7-c464e302fdcd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:34.739774 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-b1a99c18-97e7-4c8e-b6cf-d7ed4ab216ea req-95b89c8c-284d-48de-a4d7-c464e302fdcd service nova] Creating event network-vif-deleted:37fcf64f-a6f4-4362-9023-c589f3313737 for instance 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 on n-h2-826526-5 Jul 20 04:52:34.753415 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-b1a99c18-97e7-4c8e-b6cf-d7ed4ab216ea req-95b89c8c-284d-48de-a4d7-c464e302fdcd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069225 Jul 20 04:52:34.754517 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3305/6377] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:34.950447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b99634dc-658f-4ca8-812f-fa035101133b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:34.951444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b99634dc-658f-4ca8-812f-fa035101133b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:34.965073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b99634dc-658f-4ca8-812f-fa035101133b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:34.965545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b99634dc-658f-4ca8-812f-fa035101133b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:34.973986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b99634dc-658f-4ca8-812f-fa035101133b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:34.974514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b99634dc-658f-4ca8-812f-fa035101133b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:34.977722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:35.339296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ac90ea06-94ed-44c2-97fa-9a9bd1f7a0e8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:35.340169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ac90ea06-94ed-44c2-97fa-9a9bd1f7a0e8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:35.356404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac90ea06-94ed-44c2-97fa-9a9bd1f7a0e8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:35.357730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac90ea06-94ed-44c2-97fa-9a9bd1f7a0e8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:35.358591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac90ea06-94ed-44c2-97fa-9a9bd1f7a0e8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:35.359044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac90ea06-94ed-44c2-97fa-9a9bd1f7a0e8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:35.507240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac90ea06-94ed-44c2-97fa-9a9bd1f7a0e8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:35.507694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac90ea06-94ed-44c2-97fa-9a9bd1f7a0e8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:35.508153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-ac90ea06-94ed-44c2-97fa-9a9bd1f7a0e8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lazy-loading 'fault' on Instance uuid 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:52:35.619890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b99634dc-658f-4ca8-812f-fa035101133b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:35.633833 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b99634dc-658f-4ca8-812f-fa035101133b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1265 microversion: 2.1 time: 0.687172 Jul 20 04:52:35.646136 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3073/6378] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:34 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1265 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:35.736106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ac90ea06-94ed-44c2-97fa-9a9bd1f7a0e8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a107bc948d74e05a622710e8758f841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222a979e18d041edbe26d2f393181846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:35.748178 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ac90ea06-94ed-44c2-97fa-9a9bd1f7a0e8 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 200 len: 1383 microversion: 2.1 time: 0.411836 Jul 20 04:52:35.750989 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3306/6379] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:35 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 1383 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:36.668895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-634f7e46-4115-4490-b33c-e95c036a76b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:36.669545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-634f7e46-4115-4490-b33c-e95c036a76b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:36.680075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=48 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:36.681776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-634f7e46-4115-4490-b33c-e95c036a76b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:36.683416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-634f7e46-4115-4490-b33c-e95c036a76b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:36.684407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-634f7e46-4115-4490-b33c-e95c036a76b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:36.689198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-634f7e46-4115-4490-b33c-e95c036a76b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:36.770080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e63ff6e5-147d-4f50-9ea1-e9f23e2c8651 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:36.771458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e63ff6e5-147d-4f50-9ea1-e9f23e2c8651 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] [instance: 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:36.787025 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e63ff6e5-147d-4f50-9ea1-e9f23e2c8651 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:36.791887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e63ff6e5-147d-4f50-9ea1-e9f23e2c8651 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:36.793022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e63ff6e5-147d-4f50-9ea1-e9f23e2c8651 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:36.793625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e63ff6e5-147d-4f50-9ea1-e9f23e2c8651 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:36.830828 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-e63ff6e5-147d-4f50-9ea1-e9f23e2c8651 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] HTTP exception thrown: Instance 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 could not be found. Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e63ff6e5-147d-4f50-9ea1-e9f23e2c8651 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Request method failure captured: Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 HTTP/1.1 Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14miVidoxtf5CS6nQ_rEFbB4xMjPDadGYrfJDxrZfT3-JdXdoG4rWy_krynifoqcOMCgSPd0QDw7yxZHvjF8yEawkv3yaVhDGnzX50C4rfMuFsFH2omFBtpIM_bQNdKFznX3j6Jja4S7l2LbCjROInqkRV8BhSpHjCbGig6ESmG2gQ4 Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 222a979e18d041edbe26d2f393181846 Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1246159580 Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/222a979e18d041edbe26d2f393181846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/222a979e18d041edbe26d2f393181846"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_222a979e18d041edbe26d2f393181846", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/222a979e18d041edbe26d2f393181846"}]}] Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1246159580 Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 222a979e18d041edbe26d2f393181846 Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1246159580 Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestSecurityGroupsBasicOps-1246159580-project Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 5a107bc948d74e05a622710e8758f841 Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1246159580-project Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 could not be found. Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '37e4f01a-5e8a-44e9-91c1-d8c3d62eed43'} Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 could not be found. Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 could not be found. Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:36.834010 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:52:36.838356 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:36.838356 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:36.838356 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:36.838356 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:52:36.838356 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:52:36.838356 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 could not be found. Jul 20 04:52:36.838356 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:52:36.840058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e63ff6e5-147d-4f50-9ea1-e9f23e2c8651 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Returning 404 to user: Instance 37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:52:36.840968 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e63ff6e5-147d-4f50-9ea1-e9f23e2c8651 tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43" status: 404 len: 111 microversion: 2.1 time: 0.076405 Jul 20 04:52:36.842775 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3307/6380] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:36 2022] GET /compute/v2.1/servers/37e4f01a-5e8a-44e9-91c1-d8c3d62eed43 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:52:36.865507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a4034798-7e7b-4b34-9c6a-3b18478aa8c5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0080264c-e178-40d2-8976-42bff113007c"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:36.873781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a4034798-7e7b-4b34-9c6a-3b18478aa8c5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:36.884161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a4034798-7e7b-4b34-9c6a-3b18478aa8c5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:36.887278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a4034798-7e7b-4b34-9c6a-3b18478aa8c5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:36.889081 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a4034798-7e7b-4b34-9c6a-3b18478aa8c5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:36.893083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a4034798-7e7b-4b34-9c6a-3b18478aa8c5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:37.500121 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a4034798-7e7b-4b34-9c6a-3b18478aa8c5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "POST /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.652435 Jul 20 04:52:37.502732 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3308/6381] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 04:52:36 2022] POST /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/os-volume_attachments => generated 194 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:37.753520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-634f7e46-4115-4490-b33c-e95c036a76b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:37.764096 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-634f7e46-4115-4490-b33c-e95c036a76b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1265 microversion: 2.1 time: 1.099379 Jul 20 04:52:37.765351 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3074/6382] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:36 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1265 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:38.782603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-24a13b50-5a6d-45ac-a77b-b3fb42f6a8d7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:38.784380 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-24a13b50-5a6d-45ac-a77b-b3fb42f6a8d7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:38.804551 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24a13b50-5a6d-45ac-a77b-b3fb42f6a8d7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:38.805260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24a13b50-5a6d-45ac-a77b-b3fb42f6a8d7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:38.806234 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24a13b50-5a6d-45ac-a77b-b3fb42f6a8d7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:38.806828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24a13b50-5a6d-45ac-a77b-b3fb42f6a8d7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:39.344343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-24a13b50-5a6d-45ac-a77b-b3fb42f6a8d7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:39.354248 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-24a13b50-5a6d-45ac-a77b-b3fb42f6a8d7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1265 microversion: 2.1 time: 0.576641 Jul 20 04:52:39.379429 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3309/6383] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:38 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1265 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:40.395484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d5a9e570-8eff-45d0-9634-e96355b8d079 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:40.396750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d5a9e570-8eff-45d0-9634-e96355b8d079 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:40.408110 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5a9e570-8eff-45d0-9634-e96355b8d079 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:40.410279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5a9e570-8eff-45d0-9634-e96355b8d079 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:40.411327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5a9e570-8eff-45d0-9634-e96355b8d079 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:40.414519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d5a9e570-8eff-45d0-9634-e96355b8d079 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:40.813367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d5a9e570-8eff-45d0-9634-e96355b8d079 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:40.822120 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d5a9e570-8eff-45d0-9634-e96355b8d079 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1265 microversion: 2.1 time: 0.430780 Jul 20 04:52:40.829446 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3075/6384] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:40 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1265 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:41.849064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d43a07f0-2026-4a1d-9e79-d1ebf1a1dddc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:41.849871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d43a07f0-2026-4a1d-9e79-d1ebf1a1dddc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:41.855779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:41.865863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d43a07f0-2026-4a1d-9e79-d1ebf1a1dddc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:41.869519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d43a07f0-2026-4a1d-9e79-d1ebf1a1dddc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:41.870511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d43a07f0-2026-4a1d-9e79-d1ebf1a1dddc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:41.871078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d43a07f0-2026-4a1d-9e79-d1ebf1a1dddc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:42.428839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d43a07f0-2026-4a1d-9e79-d1ebf1a1dddc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:42.440057 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d43a07f0-2026-4a1d-9e79-d1ebf1a1dddc tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1265 microversion: 2.1 time: 0.595389 Jul 20 04:52:42.460003 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3310/6385] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:41 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1265 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:43.463686 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bb599b53-e7ae-4cd0-ab3b-940bc3b7f65e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:43.464980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bb599b53-e7ae-4cd0-ab3b-940bc3b7f65e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:43.479082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb599b53-e7ae-4cd0-ab3b-940bc3b7f65e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:43.479890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb599b53-e7ae-4cd0-ab3b-940bc3b7f65e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:43.482252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb599b53-e7ae-4cd0-ab3b-940bc3b7f65e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:43.482889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb599b53-e7ae-4cd0-ab3b-940bc3b7f65e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:43.814420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b5b4f26d-5ee3-4fbd-946e-5d27b687a12d tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] Calling method '.version_select at 0x7f06bcdeaca0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:43.889620 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b5b4f26d-5ee3-4fbd-946e-5d27b687a12d tempest-TestSecurityGroupsBasicOps-1246159580 tempest-TestSecurityGroupsBasicOps-1246159580-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-352168082" status: 202 len: 0 microversion: 2.1 time: 0.075302 Jul 20 04:52:43.902081 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3311/6386] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:52:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-352168082 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:52:44.018945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bb599b53-e7ae-4cd0-ab3b-940bc3b7f65e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:44.040545 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bb599b53-e7ae-4cd0-ab3b-940bc3b7f65e tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1265 microversion: 2.1 time: 0.579383 Jul 20 04:52:44.044608 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3076/6387] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:43 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1265 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:45.060847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-66aaa049-55da-44dd-9029-3600ec55caa2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:45.061799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-66aaa049-55da-44dd-9029-3600ec55caa2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:45.102063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66aaa049-55da-44dd-9029-3600ec55caa2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:45.107105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66aaa049-55da-44dd-9029-3600ec55caa2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:45.110098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66aaa049-55da-44dd-9029-3600ec55caa2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:45.114003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66aaa049-55da-44dd-9029-3600ec55caa2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:45.367056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-1000b56b-427d-491e-a02d-d464a9f8aa9b req-a14514fe-9016-4217-bec2-93dfe24b2175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e90e3d-5a5f-4482-8fc8-8614c72b94ca", "name": "network-vif-plugged", "status": "completed", "tag": "89445be6-97ad-43c3-9071-1cefd5f48b69"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:45.397159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-1000b56b-427d-491e-a02d-d464a9f8aa9b req-a14514fe-9016-4217-bec2-93dfe24b2175 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:45.400245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-1000b56b-427d-491e-a02d-d464a9f8aa9b req-a14514fe-9016-4217-bec2-93dfe24b2175 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:45.445594 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-1000b56b-427d-491e-a02d-d464a9f8aa9b req-a14514fe-9016-4217-bec2-93dfe24b2175 service nova] Creating event network-vif-plugged:89445be6-97ad-43c3-9071-1cefd5f48b69 for instance 29e90e3d-5a5f-4482-8fc8-8614c72b94ca on n-h2-826526-5 Jul 20 04:52:45.475094 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-1000b56b-427d-491e-a02d-d464a9f8aa9b req-a14514fe-9016-4217-bec2-93dfe24b2175 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118054 Jul 20 04:52:45.476134 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3077/6388] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:52:45.577003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-66aaa049-55da-44dd-9029-3600ec55caa2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:45.594962 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-66aaa049-55da-44dd-9029-3600ec55caa2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1265 microversion: 2.1 time: 0.538543 Jul 20 04:52:45.615578 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3312/6389] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:45 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1265 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:46.634334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f9da7358-85e0-4c59-b2db-9ebe5709a9cd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:46.635080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f9da7358-85e0-4c59-b2db-9ebe5709a9cd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:46.655635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9da7358-85e0-4c59-b2db-9ebe5709a9cd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:46.656022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9da7358-85e0-4c59-b2db-9ebe5709a9cd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:46.656880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9da7358-85e0-4c59-b2db-9ebe5709a9cd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:46.659942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9da7358-85e0-4c59-b2db-9ebe5709a9cd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:47.043408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f9da7358-85e0-4c59-b2db-9ebe5709a9cd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:47.059593 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f9da7358-85e0-4c59-b2db-9ebe5709a9cd tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1265 microversion: 2.1 time: 0.440979 Jul 20 04:52:47.071164 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3078/6390] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:46 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1265 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:48.079784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-aa1bdd51-31d3-420f-9086-613c8747e72c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:48.081243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-aa1bdd51-31d3-420f-9086-613c8747e72c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:48.096710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa1bdd51-31d3-420f-9086-613c8747e72c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:48.097777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa1bdd51-31d3-420f-9086-613c8747e72c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:48.098994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa1bdd51-31d3-420f-9086-613c8747e72c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:48.102588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-aa1bdd51-31d3-420f-9086-613c8747e72c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:48.660609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-aa1bdd51-31d3-420f-9086-613c8747e72c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:48.669505 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-aa1bdd51-31d3-420f-9086-613c8747e72c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1451 microversion: 2.1 time: 0.595040 Jul 20 04:52:48.673315 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3313/6391] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:48 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1451 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:48.691323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3cf3d5a4-4ecc-4a4f-a97e-10a9ae5c5dda tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:48.691966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3cf3d5a4-4ecc-4a4f-a97e-10a9ae5c5dda tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:48.700431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3cf3d5a4-4ecc-4a4f-a97e-10a9ae5c5dda tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:48.700903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3cf3d5a4-4ecc-4a4f-a97e-10a9ae5c5dda tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:48.702138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3cf3d5a4-4ecc-4a4f-a97e-10a9ae5c5dda tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:48.702606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3cf3d5a4-4ecc-4a4f-a97e-10a9ae5c5dda tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:48.959226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3cf3d5a4-4ecc-4a4f-a97e-10a9ae5c5dda tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:48.973845 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3cf3d5a4-4ecc-4a4f-a97e-10a9ae5c5dda tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1451 microversion: 2.1 time: 0.288099 Jul 20 04:52:48.976130 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3079/6392] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:48 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1451 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:52.336072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-83f6a4ac-4c6f-492f-b499-517037c8d4af req-2a25ef85-9c0d-42a4-8487-41856c079659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e90e3d-5a5f-4482-8fc8-8614c72b94ca", "tag": "89445be6-97ad-43c3-9071-1cefd5f48b69"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:52.347771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-83f6a4ac-4c6f-492f-b499-517037c8d4af req-2a25ef85-9c0d-42a4-8487-41856c079659 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:52.348331 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-83f6a4ac-4c6f-492f-b499-517037c8d4af req-2a25ef85-9c0d-42a4-8487-41856c079659 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:52.365358 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-83f6a4ac-4c6f-492f-b499-517037c8d4af req-2a25ef85-9c0d-42a4-8487-41856c079659 service nova] Creating event network-changed:89445be6-97ad-43c3-9071-1cefd5f48b69 for instance 29e90e3d-5a5f-4482-8fc8-8614c72b94ca on n-h2-826526-5 Jul 20 04:52:52.372871 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-83f6a4ac-4c6f-492f-b499-517037c8d4af req-2a25ef85-9c0d-42a4-8487-41856c079659 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042607 Jul 20 04:52:52.374070 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3314/6393] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:52:52.870683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a839e522-2d53-434e-b824-97403ff76e9b tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Action: 'create', calling method: .version_select at 0x7f06c746a0d0>, body: {"keypair": {"name": "tempest-keypair-1077931411", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7OfiDSRbJD9euDpx8T/olVyXYY01OFMzwLct+aIqtBUeA5gKNldYbuIQyn5EXMGTuzUXKqDDSV2kJ4HD+39U/05r26yUw1bj7n1E+jHXq6klnLCpuQV/2XzbplPnrOkQ=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:52.900985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-a839e522-2d53-434e-b824-97403ff76e9b tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Getting quotas for project d90f217b019840929bacafcacbbd1a3d. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:52:52.918893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-a839e522-2d53-434e-b824-97403ff76e9b tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Getting quotas for user a241f748f0ef4775b46e4fcd113174e5 and project d90f217b019840929bacafcacbbd1a3d. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:52:52.984448 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a839e522-2d53-434e-b824-97403ff76e9b tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119798 Jul 20 04:52:52.985099 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3080/6394] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:52:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:55.868901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0d202507-9df8-4874-8cc3-10e0668a9d95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-114370952", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64107751-d7d5-48c2-b064-28befc37e9c1"}], "security_groups": [{"name": "tempest-securitygroup--323475120"}], "key_name": "tempest-keypair-1077931411", "user_data": "}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:56.006259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-0d202507-9df8-4874-8cc3-10e0668a9d95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] validate_networks() for [('64107751-d7d5-48c2-b064-28befc37e9c1', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:52:56.570435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0d202507-9df8-4874-8cc3-10e0668a9d95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:52:56.571265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0d202507-9df8-4874-8cc3-10e0668a9d95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:52:56.571901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0d202507-9df8-4874-8cc3-10e0668a9d95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:52:56.572505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0d202507-9df8-4874-8cc3-10e0668a9d95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:52:56.573093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-0d202507-9df8-4874-8cc3-10e0668a9d95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:52:56.583153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d202507-9df8-4874-8cc3-10e0668a9d95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:56.583884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d202507-9df8-4874-8cc3-10e0668a9d95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:56.584887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d202507-9df8-4874-8cc3-10e0668a9d95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:56.585483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d202507-9df8-4874-8cc3-10e0668a9d95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:56.609912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-0d202507-9df8-4874-8cc3-10e0668a9d95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Getting quotas for project d90f217b019840929bacafcacbbd1a3d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:52:56.634391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-0d202507-9df8-4874-8cc3-10e0668a9d95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Getting quotas for user a241f748f0ef4775b46e4fcd113174e5 and project d90f217b019840929bacafcacbbd1a3d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:52:56.655593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0d202507-9df8-4874-8cc3-10e0668a9d95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:52:56.660075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0d202507-9df8-4874-8cc3-10e0668a9d95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:52:56.736661 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0d202507-9df8-4874-8cc3-10e0668a9d95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.870748 Jul 20 04:52:56.740756 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3315/6395] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:52:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:52:56.761247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8d3f24d7-47b6-4929-873e-bf3c90a03d58 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:56.761896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8d3f24d7-47b6-4929-873e-bf3c90a03d58 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:56.872692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8d3f24d7-47b6-4929-873e-bf3c90a03d58 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:56.885879 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8d3f24d7-47b6-4929-873e-bf3c90a03d58 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27" status: 200 len: 1241 microversion: 2.1 time: 0.139046 Jul 20 04:52:56.887073 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3081/6396] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:56 2022] GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 => generated 1241 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:57.918760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-303c5d4d-0dcc-46cf-9312-4d59f5530528 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:57.920513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-303c5d4d-0dcc-46cf-9312-4d59f5530528 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:57.941903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-303c5d4d-0dcc-46cf-9312-4d59f5530528 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:57.943542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-303c5d4d-0dcc-46cf-9312-4d59f5530528 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:57.945041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-303c5d4d-0dcc-46cf-9312-4d59f5530528 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:57.946629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-303c5d4d-0dcc-46cf-9312-4d59f5530528 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:58.049618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-303c5d4d-0dcc-46cf-9312-4d59f5530528 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:58.064276 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-303c5d4d-0dcc-46cf-9312-4d59f5530528 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27" status: 200 len: 1293 microversion: 2.1 time: 0.151406 Jul 20 04:52:58.066558 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3316/6397] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:57 2022] GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 => generated 1293 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:59.090914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-179541fb-65f3-487e-bf32-3578e91b642d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:59.092613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-179541fb-65f3-487e-bf32-3578e91b642d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:59.101489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=37 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:59.104333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-179541fb-65f3-487e-bf32-3578e91b642d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:59.104983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-179541fb-65f3-487e-bf32-3578e91b642d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:59.106021 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-179541fb-65f3-487e-bf32-3578e91b642d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:59.107751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-179541fb-65f3-487e-bf32-3578e91b642d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:59.292572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-179541fb-65f3-487e-bf32-3578e91b642d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:59.309166 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-179541fb-65f3-487e-bf32-3578e91b642d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27" status: 200 len: 1299 microversion: 2.1 time: 0.221923 Jul 20 04:52:59.310117 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3082/6398] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:59 2022] GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 => generated 1299 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:00.330661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-97aa4a79-5e1f-4b45-996e-c687faa0673c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:00.331293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-97aa4a79-5e1f-4b45-996e-c687faa0673c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:00.346054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97aa4a79-5e1f-4b45-996e-c687faa0673c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:00.348755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97aa4a79-5e1f-4b45-996e-c687faa0673c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:00.349889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97aa4a79-5e1f-4b45-996e-c687faa0673c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:00.350490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97aa4a79-5e1f-4b45-996e-c687faa0673c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:00.368447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:00.691280 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-97aa4a79-5e1f-4b45-996e-c687faa0673c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:00.709684 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-97aa4a79-5e1f-4b45-996e-c687faa0673c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27" status: 200 len: 1366 microversion: 2.1 time: 0.382885 Jul 20 04:53:00.711649 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3317/6399] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:00 2022] GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:00.980922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-c3fe357d-9095-4e64-9d65-65c79a4eb0f3 req-cc3548fa-5ecc-4239-b135-a9c6ae12b990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81d97a97-540c-4203-a6b5-fb688194ca27", "tag": "14deef1f-99ad-4217-8b19-9a1fcdbd15ba"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:01.008650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c3fe357d-9095-4e64-9d65-65c79a4eb0f3 req-cc3548fa-5ecc-4239-b135-a9c6ae12b990 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:01.012517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c3fe357d-9095-4e64-9d65-65c79a4eb0f3 req-cc3548fa-5ecc-4239-b135-a9c6ae12b990 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:01.051774 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-c3fe357d-9095-4e64-9d65-65c79a4eb0f3 req-cc3548fa-5ecc-4239-b135-a9c6ae12b990 service nova] Creating event network-changed:14deef1f-99ad-4217-8b19-9a1fcdbd15ba for instance 81d97a97-540c-4203-a6b5-fb688194ca27 on n-h1-826526-5 Jul 20 04:53:01.078025 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-c3fe357d-9095-4e64-9d65-65c79a4eb0f3 req-cc3548fa-5ecc-4239-b135-a9c6ae12b990 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102048 Jul 20 04:53:01.079157 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3083/6400] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:01.727941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-69ce752e-eb86-4179-b1ce-bb6c7803ce9e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:01.728705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-69ce752e-eb86-4179-b1ce-bb6c7803ce9e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:01.737900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69ce752e-eb86-4179-b1ce-bb6c7803ce9e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:01.738628 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69ce752e-eb86-4179-b1ce-bb6c7803ce9e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:01.741050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69ce752e-eb86-4179-b1ce-bb6c7803ce9e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:01.741864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69ce752e-eb86-4179-b1ce-bb6c7803ce9e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:02.019983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-69ce752e-eb86-4179-b1ce-bb6c7803ce9e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:02.033044 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-69ce752e-eb86-4179-b1ce-bb6c7803ce9e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27" status: 200 len: 1366 microversion: 2.1 time: 0.309132 Jul 20 04:53:02.033910 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3318/6401] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:01 2022] GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:03.066088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5415dc35-d11e-41b3-8e67-86491ecf367c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:03.067736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5415dc35-d11e-41b3-8e67-86491ecf367c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:03.079411 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5415dc35-d11e-41b3-8e67-86491ecf367c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:03.079985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5415dc35-d11e-41b3-8e67-86491ecf367c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:03.080952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5415dc35-d11e-41b3-8e67-86491ecf367c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:03.081658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5415dc35-d11e-41b3-8e67-86491ecf367c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:03.382034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5415dc35-d11e-41b3-8e67-86491ecf367c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:03.399801 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5415dc35-d11e-41b3-8e67-86491ecf367c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27" status: 200 len: 1366 microversion: 2.1 time: 0.352654 Jul 20 04:53:03.411388 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3084/6402] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:03 2022] GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:04.419718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d1c48b9-3fa2-4691-877f-eef81e794345 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:04.420741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4d1c48b9-3fa2-4691-877f-eef81e794345 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:04.440232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d1c48b9-3fa2-4691-877f-eef81e794345 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:04.440690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d1c48b9-3fa2-4691-877f-eef81e794345 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:04.441472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d1c48b9-3fa2-4691-877f-eef81e794345 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:04.441910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d1c48b9-3fa2-4691-877f-eef81e794345 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:04.718806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4d1c48b9-3fa2-4691-877f-eef81e794345 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:04.728998 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4d1c48b9-3fa2-4691-877f-eef81e794345 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27" status: 200 len: 1366 microversion: 2.1 time: 0.314042 Jul 20 04:53:04.729964 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3319/6403] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:04 2022] GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:05.753558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-69f5189b-c9cd-4bde-9d6e-b930f23991c2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:05.757079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-69f5189b-c9cd-4bde-9d6e-b930f23991c2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:05.771124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-69f5189b-c9cd-4bde-9d6e-b930f23991c2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:05.771585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-69f5189b-c9cd-4bde-9d6e-b930f23991c2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:05.773380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-69f5189b-c9cd-4bde-9d6e-b930f23991c2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:05.773834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-69f5189b-c9cd-4bde-9d6e-b930f23991c2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:06.105968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-69f5189b-c9cd-4bde-9d6e-b930f23991c2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:06.114709 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-69f5189b-c9cd-4bde-9d6e-b930f23991c2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27" status: 200 len: 1366 microversion: 2.1 time: 0.371905 Jul 20 04:53:06.126497 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3085/6404] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:05 2022] GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 => generated 1366 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:06.389696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-36fc3fae-1994-48ab-85e9-502daea0aa5b req-9e8b2cf0-2961-4afd-a035-35f926c97b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81d97a97-540c-4203-a6b5-fb688194ca27", "name": "network-vif-plugged", "status": "completed", "tag": "14deef1f-99ad-4217-8b19-9a1fcdbd15ba"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:06.403350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-36fc3fae-1994-48ab-85e9-502daea0aa5b req-9e8b2cf0-2961-4afd-a035-35f926c97b86 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:06.403792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-36fc3fae-1994-48ab-85e9-502daea0aa5b req-9e8b2cf0-2961-4afd-a035-35f926c97b86 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:06.425228 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-36fc3fae-1994-48ab-85e9-502daea0aa5b req-9e8b2cf0-2961-4afd-a035-35f926c97b86 service nova] Creating event network-vif-plugged:14deef1f-99ad-4217-8b19-9a1fcdbd15ba for instance 81d97a97-540c-4203-a6b5-fb688194ca27 on n-h1-826526-5 Jul 20 04:53:06.442534 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-36fc3fae-1994-48ab-85e9-502daea0aa5b req-9e8b2cf0-2961-4afd-a035-35f926c97b86 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056989 Jul 20 04:53:06.443084 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3320/6405] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:07.133266 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6d000f27-c4a2-4a20-98b0-879fd8f05bf5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:07.134488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6d000f27-c4a2-4a20-98b0-879fd8f05bf5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:07.138874 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:07.147478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:07.151588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d000f27-c4a2-4a20-98b0-879fd8f05bf5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:07.152279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d000f27-c4a2-4a20-98b0-879fd8f05bf5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:07.153238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d000f27-c4a2-4a20-98b0-879fd8f05bf5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:07.159944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d000f27-c4a2-4a20-98b0-879fd8f05bf5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:07.456128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6d000f27-c4a2-4a20-98b0-879fd8f05bf5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:07.480871 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6d000f27-c4a2-4a20-98b0-879fd8f05bf5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27" status: 200 len: 1366 microversion: 2.1 time: 0.348136 Jul 20 04:53:07.483772 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3086/6406] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:07 2022] GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:08.507645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6ff32cc6-4666-48aa-b3db-b65261e46a95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:08.509032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6ff32cc6-4666-48aa-b3db-b65261e46a95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:08.525486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:08.526432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:08.529390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ff32cc6-4666-48aa-b3db-b65261e46a95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:08.530054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ff32cc6-4666-48aa-b3db-b65261e46a95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:08.532324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ff32cc6-4666-48aa-b3db-b65261e46a95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:08.533062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ff32cc6-4666-48aa-b3db-b65261e46a95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:08.798917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6ff32cc6-4666-48aa-b3db-b65261e46a95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:08.820346 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6ff32cc6-4666-48aa-b3db-b65261e46a95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27" status: 200 len: 1557 microversion: 2.1 time: 0.324549 Jul 20 04:53:08.820948 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3321/6407] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:08 2022] GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 => generated 1557 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:08.838555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d2ef3f37-28c3-44a9-a656-43dd5891633f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:08.839403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d2ef3f37-28c3-44a9-a656-43dd5891633f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:08.851801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2ef3f37-28c3-44a9-a656-43dd5891633f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:08.852669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2ef3f37-28c3-44a9-a656-43dd5891633f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:08.856603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2ef3f37-28c3-44a9-a656-43dd5891633f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:08.859262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2ef3f37-28c3-44a9-a656-43dd5891633f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:09.079416 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d2ef3f37-28c3-44a9-a656-43dd5891633f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.244158 Jul 20 04:53:09.079841 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3087/6408] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:53:08 2022] GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27/os-interface => generated 285 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:53:12.469995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-9c4545a0-5a01-4a06-9696-951889d024de req-40bf50d3-53cd-4c9c-834a-dd31c905e3ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81d97a97-540c-4203-a6b5-fb688194ca27", "tag": "14deef1f-99ad-4217-8b19-9a1fcdbd15ba"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:12.475244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:12.501328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9c4545a0-5a01-4a06-9696-951889d024de req-40bf50d3-53cd-4c9c-834a-dd31c905e3ce service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:12.502972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9c4545a0-5a01-4a06-9696-951889d024de req-40bf50d3-53cd-4c9c-834a-dd31c905e3ce service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:12.522587 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9c4545a0-5a01-4a06-9696-951889d024de req-40bf50d3-53cd-4c9c-834a-dd31c905e3ce service nova] Creating event network-changed:14deef1f-99ad-4217-8b19-9a1fcdbd15ba for instance 81d97a97-540c-4203-a6b5-fb688194ca27 on n-h1-826526-5 Jul 20 04:53:12.550982 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-9c4545a0-5a01-4a06-9696-951889d024de req-40bf50d3-53cd-4c9c-834a-dd31c905e3ce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080416 Jul 20 04:53:12.553715 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3322/6409] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:17.188383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7aa09dc2-9403-44a7-a4dc-bba27c0ea043 tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-370004288", "availability_zone": "foo_zone"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:17.189992 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:53:17.189992 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:53:17.190935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.aggregate [None req-7aa09dc2-9403-44a7-a4dc-bba27c0ea043 tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Generated uuid 64215038-8bde-43c0-aee3-094b78b7018f for aggregate {{(pid=127870) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:53:17.221714 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7aa09dc2-9403-44a7-a4dc-bba27c0ea043 tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.173803 Jul 20 04:53:17.222489 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3088/6410] 10.222.0.17 () {60 vars in 1163 bytes} [Wed Jul 20 04:53:17 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:17.235624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-914bbcd2-0bd8-40de-9435-2d51d9d02178 tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:17.238313 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:53:17.238313 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:53:17.269404 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-914bbcd2-0bd8-40de-9435-2d51d9d02178 tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.039237 Jul 20 04:53:17.271020 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3323/6411] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 04:53:17 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:17.280784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-819bf024-b66a-4ee4-a7a2-37ff0ee04a9f tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:17.282334 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:53:17.282334 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:53:17.283682 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-819bf024-b66a-4ee4-a7a2-37ff0ee04a9f tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:17.284151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-819bf024-b66a-4ee4-a7a2-37ff0ee04a9f tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:17.285220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-819bf024-b66a-4ee4-a7a2-37ff0ee04a9f tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:17.285742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-819bf024-b66a-4ee4-a7a2-37ff0ee04a9f tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:17.311582 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-819bf024-b66a-4ee4-a7a2-37ff0ee04a9f tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.034494 Jul 20 04:53:17.312252 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3089/6412] 10.222.0.17 () {58 vars in 1175 bytes} [Wed Jul 20 04:53:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:17.323761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fea68ad6-2e31-457c-a39e-dfe864de9918 tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:17.330235 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:53:17.330235 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:53:17.346462 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fea68ad6-2e31-457c-a39e-dfe864de9918 tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.026975 Jul 20 04:53:17.348710 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3324/6413] 10.222.0.17 () {58 vars in 1142 bytes} [Wed Jul 20 04:53:17 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:53:17.359862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-82448aa8-bdfb-4d9f-9dd8-fd70823989e9 tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-826526-5"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:17.361335 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:53:17.361335 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:53:17.374001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82448aa8-bdfb-4d9f-9dd8-fd70823989e9 tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:17.374622 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-82448aa8-bdfb-4d9f-9dd8-fd70823989e9 tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:17.687696 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-82448aa8-bdfb-4d9f-9dd8-fd70823989e9 tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.332510 Jul 20 04:53:17.688679 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3090/6414] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 04:53:17 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:53:17.699386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4e54f4fe-a2f3-4f32-9feb-683e031cdc8b tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:17.700618 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:53:17.700618 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:53:17.709795 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4e54f4fe-a2f3-4f32-9feb-683e031cdc8b tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.015115 Jul 20 04:53:17.711168 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3325/6415] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:53:17 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:17.723024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-68b68639-3123-4144-b3a3-6804f8a969c9 tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1543063219", "availability_zone": "foo_zone"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:17.724989 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:53:17.724989 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:53:17.779870 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-68b68639-3123-4144-b3a3-6804f8a969c9 tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.061734 Jul 20 04:53:17.789931 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3091/6416] 10.222.0.17 () {60 vars in 1172 bytes} [Wed Jul 20 04:53:17 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:17.791563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a33abeff-cbcd-4267-a972-f85b43a4b067 tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:17.793112 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:53:17.793112 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:53:17.829674 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a33abeff-cbcd-4267-a972-f85b43a4b067 tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.041973 Jul 20 04:53:17.842363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea5ea4b5-9a6d-49b3-bf94-51fa64c23d6d tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:17.844286 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:53:17.844286 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:53:17.848102 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3326/6417] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 04:53:17 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:53:17.855228 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ea5ea4b5-9a6d-49b3-bf94-51fa64c23d6d tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.017058 Jul 20 04:53:17.866398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-245724a1-e387-4f1f-be91-26619e5e714b tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-826526-5"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:17.866978 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3092/6418] 10.222.0.17 () {58 vars in 1151 bytes} [Wed Jul 20 04:53:17 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:17.868070 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:53:17.868070 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:53:17.884025 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-245724a1-e387-4f1f-be91-26619e5e714b tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:17.885778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-245724a1-e387-4f1f-be91-26619e5e714b tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:18.163806 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-245724a1-e387-4f1f-be91-26619e5e714b tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.300858 Jul 20 04:53:18.164801 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3327/6419] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 04:53:17 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:53:18.178282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-296d21f4-0707-4a4f-a2ff-c6e7585d6c90 tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:18.179728 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:53:18.179728 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:53:18.212585 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-296d21f4-0707-4a4f-a2ff-c6e7585d6c90 tempest-TestAggregatesBasicOps-202406881 tempest-TestAggregatesBasicOps-202406881-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.040341 Jul 20 04:53:18.213203 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3093/6420] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jul 20 04:53:18 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 20 04:53:35.072799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=31 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:35.073823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:35.239810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-279f6a72-d00b-4096-a76d-fbb0500616b6 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1880919101", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "b0068ab5-79d7-4ced-8b3c-0c5e78a04020"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:35.315406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-279f6a72-d00b-4096-a76d-fbb0500616b6 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] validate_networks() for [('b0068ab5-79d7-4ced-8b3c-0c5e78a04020', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:53:36.278534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-279f6a72-d00b-4096-a76d-fbb0500616b6 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:53:36.279148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-279f6a72-d00b-4096-a76d-fbb0500616b6 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:53:36.279409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-279f6a72-d00b-4096-a76d-fbb0500616b6 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:53:36.279996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-279f6a72-d00b-4096-a76d-fbb0500616b6 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:53:36.280439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-279f6a72-d00b-4096-a76d-fbb0500616b6 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:53:36.295902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-279f6a72-d00b-4096-a76d-fbb0500616b6 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:36.296621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-279f6a72-d00b-4096-a76d-fbb0500616b6 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:36.297974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-279f6a72-d00b-4096-a76d-fbb0500616b6 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:36.298816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-279f6a72-d00b-4096-a76d-fbb0500616b6 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:36.325151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-279f6a72-d00b-4096-a76d-fbb0500616b6 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Getting quotas for project fd81b4e344d1498689dc8b32e484ab4e. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:53:36.331008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-279f6a72-d00b-4096-a76d-fbb0500616b6 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Getting quotas for user bce007d7f5b043aeaaa4840bfda3f1fd and project fd81b4e344d1498689dc8b32e484ab4e. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:53:36.350005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-279f6a72-d00b-4096-a76d-fbb0500616b6 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:53:36.352935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-279f6a72-d00b-4096-a76d-fbb0500616b6 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:53:36.409931 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-279f6a72-d00b-4096-a76d-fbb0500616b6 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.340199 Jul 20 04:53:36.416170 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3328/6421] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:53:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:53:36.421823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e0a4545a-2aa7-4c4e-881d-4e9d46f5407d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:36.423131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e0a4545a-2aa7-4c4e-881d-4e9d46f5407d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:36.427105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:36.428425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=36 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:36.443135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:36.586394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e0a4545a-2aa7-4c4e-881d-4e9d46f5407d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:36.594774 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e0a4545a-2aa7-4c4e-881d-4e9d46f5407d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1215 microversion: 2.1 time: 0.177147 Jul 20 04:53:36.595376 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3094/6422] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:36 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1215 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:37.620715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fd4422ad-58d4-4a4d-a385-235773de15fb tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:37.622158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fd4422ad-58d4-4a4d-a385-235773de15fb tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:37.661940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd4422ad-58d4-4a4d-a385-235773de15fb tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:37.663151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd4422ad-58d4-4a4d-a385-235773de15fb tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:37.665894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd4422ad-58d4-4a4d-a385-235773de15fb tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:37.666887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fd4422ad-58d4-4a4d-a385-235773de15fb tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:37.837455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fd4422ad-58d4-4a4d-a385-235773de15fb tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:37.849317 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fd4422ad-58d4-4a4d-a385-235773de15fb tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1267 microversion: 2.1 time: 0.239646 Jul 20 04:53:37.852048 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3329/6423] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:37 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:38.867033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b12ebba9-971e-42a5-af10-4aba5fee5295 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:38.867690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b12ebba9-971e-42a5-af10-4aba5fee5295 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:38.877277 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b12ebba9-971e-42a5-af10-4aba5fee5295 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:38.878086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b12ebba9-971e-42a5-af10-4aba5fee5295 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:38.879086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b12ebba9-971e-42a5-af10-4aba5fee5295 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:38.880459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b12ebba9-971e-42a5-af10-4aba5fee5295 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:38.981751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b12ebba9-971e-42a5-af10-4aba5fee5295 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:38.990749 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b12ebba9-971e-42a5-af10-4aba5fee5295 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1273 microversion: 2.1 time: 0.127613 Jul 20 04:53:38.991987 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3095/6424] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:38 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1273 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:40.013391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-30eeed43-722e-423b-8783-bc63b2f2ada1 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:40.015129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-30eeed43-722e-423b-8783-bc63b2f2ada1 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:40.054821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30eeed43-722e-423b-8783-bc63b2f2ada1 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:40.057796 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30eeed43-722e-423b-8783-bc63b2f2ada1 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:40.060473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30eeed43-722e-423b-8783-bc63b2f2ada1 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:40.061898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30eeed43-722e-423b-8783-bc63b2f2ada1 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:40.275375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-30eeed43-722e-423b-8783-bc63b2f2ada1 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:40.285803 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-30eeed43-722e-423b-8783-bc63b2f2ada1 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1315 microversion: 2.1 time: 0.278650 Jul 20 04:53:40.286834 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3330/6425] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:40 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:41.302957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-addfee85-f0e4-4c2e-8c29-24078baaa78e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:41.304228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-addfee85-f0e4-4c2e-8c29-24078baaa78e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:41.312099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-addfee85-f0e4-4c2e-8c29-24078baaa78e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:41.312825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-addfee85-f0e4-4c2e-8c29-24078baaa78e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:41.313796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-addfee85-f0e4-4c2e-8c29-24078baaa78e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:41.314550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-addfee85-f0e4-4c2e-8c29-24078baaa78e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:41.568470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-d0dd16f7-b1bf-4461-b1d5-3db8ad3b93d3 req-699e9dd5-68b2-4da0-8190-d69a38861abc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4dcbb09-eef5-431c-8ccd-7e8e804316c1", "tag": "751efc11-0915-4d75-ab3b-6e0eac0be9fd"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:41.589815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d0dd16f7-b1bf-4461-b1d5-3db8ad3b93d3 req-699e9dd5-68b2-4da0-8190-d69a38861abc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:41.590271 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d0dd16f7-b1bf-4461-b1d5-3db8ad3b93d3 req-699e9dd5-68b2-4da0-8190-d69a38861abc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:41.634379 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-d0dd16f7-b1bf-4461-b1d5-3db8ad3b93d3 req-699e9dd5-68b2-4da0-8190-d69a38861abc service nova] Creating event network-changed:751efc11-0915-4d75-ab3b-6e0eac0be9fd for instance b4dcbb09-eef5-431c-8ccd-7e8e804316c1 on n-h1-826526-5 Jul 20 04:53:41.654214 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-d0dd16f7-b1bf-4461-b1d5-3db8ad3b93d3 req-699e9dd5-68b2-4da0-8190-d69a38861abc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096010 Jul 20 04:53:41.655015 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3331/6426] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:53:41.712395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-addfee85-f0e4-4c2e-8c29-24078baaa78e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:41.722190 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-addfee85-f0e4-4c2e-8c29-24078baaa78e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1315 microversion: 2.1 time: 0.423629 Jul 20 04:53:41.722809 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3096/6427] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:41 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:42.740075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5486de86-1006-4028-baa7-58ea1b1beaad tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:42.741187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5486de86-1006-4028-baa7-58ea1b1beaad tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:42.754185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5486de86-1006-4028-baa7-58ea1b1beaad tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:42.754648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5486de86-1006-4028-baa7-58ea1b1beaad tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:42.755444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5486de86-1006-4028-baa7-58ea1b1beaad tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:42.755891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5486de86-1006-4028-baa7-58ea1b1beaad tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:42.943677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5486de86-1006-4028-baa7-58ea1b1beaad tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:42.951784 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5486de86-1006-4028-baa7-58ea1b1beaad tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1315 microversion: 2.1 time: 0.216511 Jul 20 04:53:42.953155 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3332/6428] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:42 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:43.969479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf2f7901-0d22-4b60-a0a3-cbfc9df9baee tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:43.970117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf2f7901-0d22-4b60-a0a3-cbfc9df9baee tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:43.982694 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf2f7901-0d22-4b60-a0a3-cbfc9df9baee tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:43.983473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf2f7901-0d22-4b60-a0a3-cbfc9df9baee tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:43.984594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf2f7901-0d22-4b60-a0a3-cbfc9df9baee tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:43.985213 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf2f7901-0d22-4b60-a0a3-cbfc9df9baee tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:44.159214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bf2f7901-0d22-4b60-a0a3-cbfc9df9baee tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:44.170990 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf2f7901-0d22-4b60-a0a3-cbfc9df9baee tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1315 microversion: 2.1 time: 0.205329 Jul 20 04:53:44.182015 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3097/6429] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:43 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:44.878687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-37cc5077-fb05-454e-9d58-0d338b964e9a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:44.879400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-37cc5077-fb05-454e-9d58-0d338b964e9a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:44.889859 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37cc5077-fb05-454e-9d58-0d338b964e9a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:44.890580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37cc5077-fb05-454e-9d58-0d338b964e9a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:44.891900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37cc5077-fb05-454e-9d58-0d338b964e9a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:44.893243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-37cc5077-fb05-454e-9d58-0d338b964e9a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:44.928666 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-37cc5077-fb05-454e-9d58-0d338b964e9a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27/ips" status: 200 len: 150 microversion: 2.1 time: 0.055729 Jul 20 04:53:44.930511 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3333/6430] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 04:53:44 2022] GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27/ips => generated 150 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:44.943444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7dc7718b-b90d-4386-9a40-64a600104836 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0080264c-e178-40d2-8976-42bff113007c"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:44.945715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7dc7718b-b90d-4386-9a40-64a600104836 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:44.954578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7dc7718b-b90d-4386-9a40-64a600104836 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:44.955629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7dc7718b-b90d-4386-9a40-64a600104836 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:44.957023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7dc7718b-b90d-4386-9a40-64a600104836 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:44.957605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7dc7718b-b90d-4386-9a40-64a600104836 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:45.069668 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-7dc7718b-b90d-4386-9a40-64a600104836 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] HTTP exception thrown: Invalid volume: volume 0080264c-e178-40d2-8976-42bff113007c is already attached to instances: 8036792e-0b6c-48cd-b555-ae12a1e52658 Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7dc7718b-b90d-4386-9a40-64a600104836 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Request method failure captured: Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27/os-volume_attachments HTTP/1.1 Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 74 Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14nXZ97dPvJ1vYjndXy08u0I-QfwsZLjzwhTwPLlHMlDVbR0IZdTAqSZqYran5Cvn4wC7UUKrlJHR7Rd5sBdXlrakajTzWxMCZYT9KggIWGgJVLkrs7-SbyDEPoD28498TR330QVEV33AslM-uldVFYVsaXG-pQNZ1Cq9xOqgPIH54M Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d90f217b019840929bacafcacbbd1a3d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}] Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a241f748f0ef4775b46e4fcd113174e5 Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: {"volumeAttachment": {"volumeId": "0080264c-e178-40d2-8976-42bff113007c"}} Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid volume: volume 0080264c-e178-40d2-8976-42bff113007c is already attached to instances: 8036792e-0b6c-48cd-b555-ae12a1e52658 Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'server_id': '81d97a97-540c-4203-a6b5-fb688194ca27', 'body': {'volumeAttachment': {'volumeId': '0080264c-e178-40d2-8976-42bff113007c'}}} Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0080264c-e178-40d2-8976-42bff113007c is already attached to instances: 8036792e-0b6c-48cd-b555-ae12a1e52658 Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:53:45.071643 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:53:45.078615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:53:45.078615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:53:45.078615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 04:53:45.078615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:53:45.078615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0080264c-e178-40d2-8976-42bff113007c is already attached to instances: 8036792e-0b6c-48cd-b555-ae12a1e52658 Jul 20 04:53:45.078615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:53:45.078615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:53:45.078615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:53:45.078615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:45.078615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:53:45.078615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:53:45.078615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:53:45.078615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:53:45.078615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0080264c-e178-40d2-8976-42bff113007c is already attached to instances: 8036792e-0b6c-48cd-b555-ae12a1e52658 Jul 20 04:53:45.078615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:53:45.078615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7dc7718b-b90d-4386-9a40-64a600104836 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Returning 400 to user: Invalid volume: volume 0080264c-e178-40d2-8976-42bff113007c is already attached to instances: 8036792e-0b6c-48cd-b555-ae12a1e52658 {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:53:45.078615 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7dc7718b-b90d-4386-9a40-64a600104836 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "POST /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.135977 Jul 20 04:53:45.078615 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3098/6431] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 04:53:44 2022] POST /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27/os-volume_attachments => generated 174 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:53:45.083623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-735eb8a4-b359-4456-8d8f-945c43cddb1a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:45.084133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-735eb8a4-b359-4456-8d8f-945c43cddb1a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:45.093396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-735eb8a4-b359-4456-8d8f-945c43cddb1a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:45.093960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-735eb8a4-b359-4456-8d8f-945c43cddb1a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:45.094949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-735eb8a4-b359-4456-8d8f-945c43cddb1a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:45.095349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-735eb8a4-b359-4456-8d8f-945c43cddb1a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:45.124842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-735eb8a4-b359-4456-8d8f-945c43cddb1a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:53:45.188925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2aa56e69-4160-45c7-8467-b6db30ea35fd tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:45.189696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2aa56e69-4160-45c7-8467-b6db30ea35fd tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:45.196468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2aa56e69-4160-45c7-8467-b6db30ea35fd tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:45.196939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2aa56e69-4160-45c7-8467-b6db30ea35fd tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:45.197900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2aa56e69-4160-45c7-8467-b6db30ea35fd tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:45.198517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2aa56e69-4160-45c7-8467-b6db30ea35fd tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:45.230369 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-735eb8a4-b359-4456-8d8f-945c43cddb1a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "DELETE /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27" status: 204 len: 0 microversion: 2.1 time: 0.150789 Jul 20 04:53:45.231311 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3334/6432] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:53:45 2022] DELETE /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:53:45.241953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dbe55328-3a1b-4109-a514-424638f19024 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:45.243015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dbe55328-3a1b-4109-a514-424638f19024 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:45.251584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbe55328-3a1b-4109-a514-424638f19024 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:45.252405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbe55328-3a1b-4109-a514-424638f19024 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:45.253452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbe55328-3a1b-4109-a514-424638f19024 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:45.254093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbe55328-3a1b-4109-a514-424638f19024 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:45.350243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2aa56e69-4160-45c7-8467-b6db30ea35fd tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:45.362609 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2aa56e69-4160-45c7-8467-b6db30ea35fd tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1315 microversion: 2.1 time: 0.177655 Jul 20 04:53:45.372532 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3099/6433] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:45 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:45.412744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dbe55328-3a1b-4109-a514-424638f19024 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:45.422090 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dbe55328-3a1b-4109-a514-424638f19024 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27" status: 200 len: 1681 microversion: 2.1 time: 0.185641 Jul 20 04:53:45.423093 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3335/6434] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:45 2022] GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 => generated 1681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:46.125420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-8b66d595-0d5a-4ac9-840b-9e890232375e req-3d9da642-fb75-49a5-9f0d-233cdb55dca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4dcbb09-eef5-431c-8ccd-7e8e804316c1", "name": "network-vif-plugged", "status": "completed", "tag": "751efc11-0915-4d75-ab3b-6e0eac0be9fd"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:46.135360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8b66d595-0d5a-4ac9-840b-9e890232375e req-3d9da642-fb75-49a5-9f0d-233cdb55dca0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:46.136093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8b66d595-0d5a-4ac9-840b-9e890232375e req-3d9da642-fb75-49a5-9f0d-233cdb55dca0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:46.148682 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-8b66d595-0d5a-4ac9-840b-9e890232375e req-3d9da642-fb75-49a5-9f0d-233cdb55dca0 service nova] Creating event network-vif-plugged:751efc11-0915-4d75-ab3b-6e0eac0be9fd for instance b4dcbb09-eef5-431c-8ccd-7e8e804316c1 on n-h1-826526-5 Jul 20 04:53:46.154207 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-8b66d595-0d5a-4ac9-840b-9e890232375e req-3d9da642-fb75-49a5-9f0d-233cdb55dca0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032933 Jul 20 04:53:46.155139 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3100/6435] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:46.379504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7ee63b69-4cb6-4285-a4a3-0d3a65355735 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:46.380170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7ee63b69-4cb6-4285-a4a3-0d3a65355735 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:46.382931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:46.383770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:46.391945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ee63b69-4cb6-4285-a4a3-0d3a65355735 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:46.392493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ee63b69-4cb6-4285-a4a3-0d3a65355735 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:46.394819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ee63b69-4cb6-4285-a4a3-0d3a65355735 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:46.395515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7ee63b69-4cb6-4285-a4a3-0d3a65355735 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:46.441717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-61d23eea-1b4c-4ec3-bb87-1bfca781c6a7 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:46.442858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-61d23eea-1b4c-4ec3-bb87-1bfca781c6a7 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:46.451684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61d23eea-1b4c-4ec3-bb87-1bfca781c6a7 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:46.452844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61d23eea-1b4c-4ec3-bb87-1bfca781c6a7 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:46.457336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61d23eea-1b4c-4ec3-bb87-1bfca781c6a7 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:46.458653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61d23eea-1b4c-4ec3-bb87-1bfca781c6a7 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:46.550515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7ee63b69-4cb6-4285-a4a3-0d3a65355735 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:46.558514 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7ee63b69-4cb6-4285-a4a3-0d3a65355735 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1315 microversion: 2.1 time: 0.183299 Jul 20 04:53:46.559294 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3336/6436] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:46 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:46.591623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:46.611644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-61d23eea-1b4c-4ec3-bb87-1bfca781c6a7 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:46.620070 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-61d23eea-1b4c-4ec3-bb87-1bfca781c6a7 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27" status: 200 len: 1681 microversion: 2.1 time: 0.183533 Jul 20 04:53:46.620727 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3101/6437] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:46 2022] GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:47.579254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-19c1bbb0-e82f-45e4-aadd-d74c71af834f tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:47.580239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-19c1bbb0-e82f-45e4-aadd-d74c71af834f tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:47.589205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19c1bbb0-e82f-45e4-aadd-d74c71af834f tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:47.590236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19c1bbb0-e82f-45e4-aadd-d74c71af834f tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:47.591192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19c1bbb0-e82f-45e4-aadd-d74c71af834f tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:47.591893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-19c1bbb0-e82f-45e4-aadd-d74c71af834f tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:47.638341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f6e7c069-1521-457e-a5ad-47884fd3bf58 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:47.638966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f6e7c069-1521-457e-a5ad-47884fd3bf58 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:47.649188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6e7c069-1521-457e-a5ad-47884fd3bf58 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:47.649649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6e7c069-1521-457e-a5ad-47884fd3bf58 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:47.650615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6e7c069-1521-457e-a5ad-47884fd3bf58 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:47.651270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6e7c069-1521-457e-a5ad-47884fd3bf58 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:47.761775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f6e7c069-1521-457e-a5ad-47884fd3bf58 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:47.762235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-19c1bbb0-e82f-45e4-aadd-d74c71af834f tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:47.770598 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-19c1bbb0-e82f-45e4-aadd-d74c71af834f tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1503 microversion: 2.1 time: 0.198516 Jul 20 04:53:47.772765 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f6e7c069-1521-457e-a5ad-47884fd3bf58 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27" status: 200 len: 1614 microversion: 2.1 time: 0.137470 Jul 20 04:53:47.775027 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3102/6438] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:47 2022] GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 => generated 1614 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:47.781650 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3337/6439] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:47 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:47.786592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-335916ab-ec47-4e33-8a95-7a832122f4a7 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:47.787753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-335916ab-ec47-4e33-8a95-7a832122f4a7 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:47.798000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-335916ab-ec47-4e33-8a95-7a832122f4a7 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:47.798460 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-335916ab-ec47-4e33-8a95-7a832122f4a7 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:47.799501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-335916ab-ec47-4e33-8a95-7a832122f4a7 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:47.800118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-335916ab-ec47-4e33-8a95-7a832122f4a7 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:48.008326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-335916ab-ec47-4e33-8a95-7a832122f4a7 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:48.021029 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-335916ab-ec47-4e33-8a95-7a832122f4a7 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1503 microversion: 2.1 time: 0.238201 Jul 20 04:53:48.032567 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3103/6440] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:47 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1503 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:48.040158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-91a0b8a2-b773-4db1-81ef-f7aa3cda1c7d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:48.041290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-91a0b8a2-b773-4db1-81ef-f7aa3cda1c7d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:48.048555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91a0b8a2-b773-4db1-81ef-f7aa3cda1c7d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.049592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91a0b8a2-b773-4db1-81ef-f7aa3cda1c7d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:48.050667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91a0b8a2-b773-4db1-81ef-f7aa3cda1c7d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.051376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91a0b8a2-b773-4db1-81ef-f7aa3cda1c7d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:48.084734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-872e1cd6-47e7-4939-9f67-e2e3b629b2d0 req-829860d8-cbb0-4cbd-97a7-ac579c830f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81d97a97-540c-4203-a6b5-fb688194ca27", "name": "network-vif-deleted", "tag": "14deef1f-99ad-4217-8b19-9a1fcdbd15ba"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:48.095342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-872e1cd6-47e7-4939-9f67-e2e3b629b2d0 req-829860d8-cbb0-4cbd-97a7-ac579c830f02 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.096330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-872e1cd6-47e7-4939-9f67-e2e3b629b2d0 req-829860d8-cbb0-4cbd-97a7-ac579c830f02 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:48.103512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-91a0b8a2-b773-4db1-81ef-f7aa3cda1c7d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lazy-loading 'flavor' on Instance uuid b4dcbb09-eef5-431c-8ccd-7e8e804316c1 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:53:48.115487 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-872e1cd6-47e7-4939-9f67-e2e3b629b2d0 req-829860d8-cbb0-4cbd-97a7-ac579c830f02 service nova] Creating event network-vif-deleted:14deef1f-99ad-4217-8b19-9a1fcdbd15ba for instance 81d97a97-540c-4203-a6b5-fb688194ca27 on n-h1-826526-5 Jul 20 04:53:48.129712 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-872e1cd6-47e7-4939-9f67-e2e3b629b2d0 req-829860d8-cbb0-4cbd-97a7-ac579c830f02 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048433 Jul 20 04:53:48.131100 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3104/6441] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:48.215372 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-91a0b8a2-b773-4db1-81ef-f7aa3cda1c7d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "POST /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1/action" status: 202 len: 0 microversion: 2.1 time: 0.180010 Jul 20 04:53:48.217180 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3338/6442] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:53:48 2022] POST /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:53:48.228437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-153ded42-51eb-4975-91c5-851b6e790713 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:48.229182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-153ded42-51eb-4975-91c5-851b6e790713 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:48.240326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153ded42-51eb-4975-91c5-851b6e790713 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.241088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153ded42-51eb-4975-91c5-851b6e790713 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:48.242088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153ded42-51eb-4975-91c5-851b6e790713 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.242703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153ded42-51eb-4975-91c5-851b6e790713 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:48.396531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-153ded42-51eb-4975-91c5-851b6e790713 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:48.404925 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-153ded42-51eb-4975-91c5-851b6e790713 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1511 microversion: 2.1 time: 0.183224 Jul 20 04:53:48.405533 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3105/6443] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:48 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1511 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:48.793448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-af53cda0-7975-4f72-856f-a8fbe36e6141 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:48.794429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-af53cda0-7975-4f72-856f-a8fbe36e6141 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:48.805403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af53cda0-7975-4f72-856f-a8fbe36e6141 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.806427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af53cda0-7975-4f72-856f-a8fbe36e6141 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:48.807308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af53cda0-7975-4f72-856f-a8fbe36e6141 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.807816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af53cda0-7975-4f72-856f-a8fbe36e6141 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:48.832249 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-af53cda0-7975-4f72-856f-a8fbe36e6141 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] HTTP exception thrown: Instance 81d97a97-540c-4203-a6b5-fb688194ca27 could not be found. Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-af53cda0-7975-4f72-856f-a8fbe36e6141 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Request method failure captured: Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 HTTP/1.1 Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14nXZ97dPvJ1vYjndXy08u0I-QfwsZLjzwhTwPLlHMlDVbR0IZdTAqSZqYran5Cvn4wC7UUKrlJHR7Rd5sBdXlrakajTzWxMCZYT9KggIWGgJVLkrs7-SbyDEPoD28498TR330QVEV33AslM-uldVFYVsaXG-pQNZ1Cq9xOqgPIH54M Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d90f217b019840929bacafcacbbd1a3d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}] Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a241f748f0ef4775b46e4fcd113174e5 Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 81d97a97-540c-4203-a6b5-fb688194ca27 could not be found. Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '81d97a97-540c-4203-a6b5-fb688194ca27'} Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81d97a97-540c-4203-a6b5-fb688194ca27 could not be found. Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81d97a97-540c-4203-a6b5-fb688194ca27 could not be found. Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:53:48.834772 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:53:48.839683 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:48.839683 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:53:48.839683 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:53:48.839683 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:53:48.839683 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:53:48.839683 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81d97a97-540c-4203-a6b5-fb688194ca27 could not be found. Jul 20 04:53:48.839683 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:53:48.839683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-af53cda0-7975-4f72-856f-a8fbe36e6141 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Returning 404 to user: Instance 81d97a97-540c-4203-a6b5-fb688194ca27 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:53:48.839683 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-af53cda0-7975-4f72-856f-a8fbe36e6141 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27" status: 404 len: 111 microversion: 2.1 time: 0.048755 Jul 20 04:53:48.839683 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3339/6444] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:48 2022] GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:53:48.847625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3d45a46c-f33f-4c4a-9824-b39d425ad6af tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '.version_select at 0x7f06be871700>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:48.870946 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3d45a46c-f33f-4c4a-9824-b39d425ad6af tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1077931411" status: 202 len: 0 microversion: 2.1 time: 0.028129 Jul 20 04:53:48.871900 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3106/6445] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jul 20 04:53:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1077931411 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:53:49.422886 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cde63dc7-6e75-470d-a621-0ebf85e5eb7d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:49.423236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cde63dc7-6e75-470d-a621-0ebf85e5eb7d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:49.430201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cde63dc7-6e75-470d-a621-0ebf85e5eb7d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:49.430789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cde63dc7-6e75-470d-a621-0ebf85e5eb7d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:49.431903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cde63dc7-6e75-470d-a621-0ebf85e5eb7d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:49.432778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cde63dc7-6e75-470d-a621-0ebf85e5eb7d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:49.660238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cde63dc7-6e75-470d-a621-0ebf85e5eb7d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:49.673411 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cde63dc7-6e75-470d-a621-0ebf85e5eb7d tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1494 microversion: 2.1 time: 0.252246 Jul 20 04:53:49.673411 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3340/6446] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:49 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1494 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:49.688233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f784af7d-03bb-45fb-9f2c-a565a9e500fa tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:49.688771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f784af7d-03bb-45fb-9f2c-a565a9e500fa tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:49.692570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bc416abf-c789-493b-b05c-5faaab9cff13 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:49.693084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bc416abf-c789-493b-b05c-5faaab9cff13 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:49.696784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f784af7d-03bb-45fb-9f2c-a565a9e500fa tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:49.697258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f784af7d-03bb-45fb-9f2c-a565a9e500fa tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:49.698049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f784af7d-03bb-45fb-9f2c-a565a9e500fa tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:49.698784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f784af7d-03bb-45fb-9f2c-a565a9e500fa tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:49.699866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc416abf-c789-493b-b05c-5faaab9cff13 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:49.700405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc416abf-c789-493b-b05c-5faaab9cff13 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:49.701212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc416abf-c789-493b-b05c-5faaab9cff13 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:49.701700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc416abf-c789-493b-b05c-5faaab9cff13 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:49.774375 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f784af7d-03bb-45fb-9f2c-a565a9e500fa tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "POST /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1/action" status: 202 len: 0 microversion: 2.1 time: 0.090014 Jul 20 04:53:49.775290 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3107/6447] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:53:49 2022] POST /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:53:49.786633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-752b4afa-d4f9-4179-81f6-9fc9dea00dfc tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:49.787862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-752b4afa-d4f9-4179-81f6-9fc9dea00dfc tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:49.794436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-752b4afa-d4f9-4179-81f6-9fc9dea00dfc tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:49.794918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-bc416abf-c789-493b-b05c-5faaab9cff13 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lazy-loading 'services' on Instance uuid 8036792e-0b6c-48cd-b555-ae12a1e52658 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:53:49.795447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-752b4afa-d4f9-4179-81f6-9fc9dea00dfc tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:49.797007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-752b4afa-d4f9-4179-81f6-9fc9dea00dfc tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:49.797587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-752b4afa-d4f9-4179-81f6-9fc9dea00dfc tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:49.891828 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bc416abf-c789-493b-b05c-5faaab9cff13 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/os-volume_attachments/0080264c-e178-40d2-8976-42bff113007c" status: 202 len: 0 microversion: 2.1 time: 0.203327 Jul 20 04:53:49.893198 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3341/6448] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 04:53:49 2022] DELETE /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/os-volume_attachments/0080264c-e178-40d2-8976-42bff113007c => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:53:49.916868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8294d9b9-9fe4-407e-8d27-8b50116e3986 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:49.918536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8294d9b9-9fe4-407e-8d27-8b50116e3986 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:49.925850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8294d9b9-9fe4-407e-8d27-8b50116e3986 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:49.926299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8294d9b9-9fe4-407e-8d27-8b50116e3986 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:49.927152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8294d9b9-9fe4-407e-8d27-8b50116e3986 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:49.927645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8294d9b9-9fe4-407e-8d27-8b50116e3986 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:49.961015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:49.971630 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8294d9b9-9fe4-407e-8d27-8b50116e3986 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063777 Jul 20 04:53:49.973038 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3342/6449] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:53:49 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:50.056865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-752b4afa-d4f9-4179-81f6-9fc9dea00dfc tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:50.066463 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-752b4afa-d4f9-4179-81f6-9fc9dea00dfc tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1500 microversion: 2.1 time: 0.285959 Jul 20 04:53:50.067041 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3108/6450] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:49 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1500 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:50.983353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b617a110-d610-42db-afef-f32f2a63a03d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:50.985655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b617a110-d610-42db-afef-f32f2a63a03d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:50.994308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b617a110-d610-42db-afef-f32f2a63a03d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:50.994958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b617a110-d610-42db-afef-f32f2a63a03d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:50.996295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b617a110-d610-42db-afef-f32f2a63a03d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:50.996963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b617a110-d610-42db-afef-f32f2a63a03d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:51.033841 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b617a110-d610-42db-afef-f32f2a63a03d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054470 Jul 20 04:53:51.037641 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3343/6451] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:53:50 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:51.083831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b3432728-3fff-414f-9947-e8b4e156817e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:51.084478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b3432728-3fff-414f-9947-e8b4e156817e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:51.091954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b3432728-3fff-414f-9947-e8b4e156817e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:51.092690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b3432728-3fff-414f-9947-e8b4e156817e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:51.093685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b3432728-3fff-414f-9947-e8b4e156817e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:51.094147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b3432728-3fff-414f-9947-e8b4e156817e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:51.266865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b3432728-3fff-414f-9947-e8b4e156817e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:51.276893 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b3432728-3fff-414f-9947-e8b4e156817e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1500 microversion: 2.1 time: 0.197254 Jul 20 04:53:51.278575 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3109/6452] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:51 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1500 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:52.045457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-72473b5c-16e6-47fe-b741-aeef58a063d6 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:52.046515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-72473b5c-16e6-47fe-b741-aeef58a063d6 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:52.055269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72473b5c-16e6-47fe-b741-aeef58a063d6 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:52.055821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72473b5c-16e6-47fe-b741-aeef58a063d6 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:52.056733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72473b5c-16e6-47fe-b741-aeef58a063d6 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:52.057234 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72473b5c-16e6-47fe-b741-aeef58a063d6 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:52.092659 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-72473b5c-16e6-47fe-b741-aeef58a063d6 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051418 Jul 20 04:53:52.094003 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3344/6453] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:53:52 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:52.295847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-49e98948-2e45-433b-bc07-72326b8c8da5 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:52.296852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-49e98948-2e45-433b-bc07-72326b8c8da5 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:52.304408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49e98948-2e45-433b-bc07-72326b8c8da5 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:52.305354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49e98948-2e45-433b-bc07-72326b8c8da5 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:52.307162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49e98948-2e45-433b-bc07-72326b8c8da5 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:52.310331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49e98948-2e45-433b-bc07-72326b8c8da5 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:52.455331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-49e98948-2e45-433b-bc07-72326b8c8da5 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:52.464302 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-49e98948-2e45-433b-bc07-72326b8c8da5 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1503 microversion: 2.1 time: 0.172546 Jul 20 04:53:52.464895 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3110/6454] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:52 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:52.481630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5d8a9128-05d0-4ba6-b0b4-edbb8c5e6c81 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:52.482266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5d8a9128-05d0-4ba6-b0b4-edbb8c5e6c81 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:52.489774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d8a9128-05d0-4ba6-b0b4-edbb8c5e6c81 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:52.489976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d8a9128-05d0-4ba6-b0b4-edbb8c5e6c81 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:52.490994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d8a9128-05d0-4ba6-b0b4-edbb8c5e6c81 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:52.491521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d8a9128-05d0-4ba6-b0b4-edbb8c5e6c81 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:52.519083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-5d8a9128-05d0-4ba6-b0b4-edbb8c5e6c81 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lazy-loading 'flavor' on Instance uuid b4dcbb09-eef5-431c-8ccd-7e8e804316c1 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:53:52.620870 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5d8a9128-05d0-4ba6-b0b4-edbb8c5e6c81 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "POST /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1/action" status: 202 len: 0 microversion: 2.1 time: 0.143526 Jul 20 04:53:52.621723 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3345/6455] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:53:52 2022] POST /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:53:52.635644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-84ba7ce1-6c09-429f-add5-340f8bbdd698 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:52.636368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-84ba7ce1-6c09-429f-add5-340f8bbdd698 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:52.643036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84ba7ce1-6c09-429f-add5-340f8bbdd698 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:52.643671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84ba7ce1-6c09-429f-add5-340f8bbdd698 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:52.644971 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84ba7ce1-6c09-429f-add5-340f8bbdd698 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:52.645569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84ba7ce1-6c09-429f-add5-340f8bbdd698 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:52.801705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-84ba7ce1-6c09-429f-add5-340f8bbdd698 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:52.809749 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-84ba7ce1-6c09-429f-add5-340f8bbdd698 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1511 microversion: 2.1 time: 0.178268 Jul 20 04:53:52.812194 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3111/6456] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:52 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:53.106110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-97e05456-c722-41f2-8d6a-945c20ad0fc1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:53.107148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-97e05456-c722-41f2-8d6a-945c20ad0fc1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:53.117327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97e05456-c722-41f2-8d6a-945c20ad0fc1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:53.118184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97e05456-c722-41f2-8d6a-945c20ad0fc1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:53.119141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97e05456-c722-41f2-8d6a-945c20ad0fc1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:53.119749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-97e05456-c722-41f2-8d6a-945c20ad0fc1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:53.175209 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-97e05456-c722-41f2-8d6a-945c20ad0fc1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073632 Jul 20 04:53:53.180841 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3346/6457] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:53:53 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:53.829277 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bee6b174-ff37-4c98-bb98-7ad09d94c08e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:53.829988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bee6b174-ff37-4c98-bb98-7ad09d94c08e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:53.838183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bee6b174-ff37-4c98-bb98-7ad09d94c08e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:53.838725 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bee6b174-ff37-4c98-bb98-7ad09d94c08e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:53.839600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bee6b174-ff37-4c98-bb98-7ad09d94c08e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:53.842034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bee6b174-ff37-4c98-bb98-7ad09d94c08e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:53.988239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bee6b174-ff37-4c98-bb98-7ad09d94c08e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:53.991997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:53.999317 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bee6b174-ff37-4c98-bb98-7ad09d94c08e tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1494 microversion: 2.1 time: 0.174498 Jul 20 04:53:54.007616 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3112/6458] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:53 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1494 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:54.016940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-27ac9045-e7f8-418f-9d6b-04c065e89ddc tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:54.017699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-27ac9045-e7f8-418f-9d6b-04c065e89ddc tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:54.024863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27ac9045-e7f8-418f-9d6b-04c065e89ddc tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:54.025316 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27ac9045-e7f8-418f-9d6b-04c065e89ddc tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:54.026732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27ac9045-e7f8-418f-9d6b-04c065e89ddc tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:54.026732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27ac9045-e7f8-418f-9d6b-04c065e89ddc tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:54.103075 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-27ac9045-e7f8-418f-9d6b-04c065e89ddc tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "POST /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1/action" status: 202 len: 0 microversion: 2.1 time: 0.090071 Jul 20 04:53:54.104698 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3347/6459] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:53:54 2022] POST /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:53:54.112448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2a4f1560-7907-45e2-9315-52d339f4fa5c tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:54.113075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2a4f1560-7907-45e2-9315-52d339f4fa5c tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:54.120953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a4f1560-7907-45e2-9315-52d339f4fa5c tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:54.121834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a4f1560-7907-45e2-9315-52d339f4fa5c tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:54.122868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a4f1560-7907-45e2-9315-52d339f4fa5c tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:54.123312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2a4f1560-7907-45e2-9315-52d339f4fa5c tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:54.195722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5ab3d735-0f81-4bf2-8bc5-d6073cc95ed4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:54.198244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5ab3d735-0f81-4bf2-8bc5-d6073cc95ed4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:54.207593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ab3d735-0f81-4bf2-8bc5-d6073cc95ed4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:54.208199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ab3d735-0f81-4bf2-8bc5-d6073cc95ed4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:54.209393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ab3d735-0f81-4bf2-8bc5-d6073cc95ed4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:54.209968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ab3d735-0f81-4bf2-8bc5-d6073cc95ed4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:54.254759 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5ab3d735-0f81-4bf2-8bc5-d6073cc95ed4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066180 Jul 20 04:53:54.258752 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3348/6460] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:53:54 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:54.386067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2a4f1560-7907-45e2-9315-52d339f4fa5c tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:54.396305 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2a4f1560-7907-45e2-9315-52d339f4fa5c tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1500 microversion: 2.1 time: 0.287968 Jul 20 04:53:54.408298 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3113/6461] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:54 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1500 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:55.266927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-62971c87-864a-4f79-ad7a-a1086a19e844 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:55.268092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-62971c87-864a-4f79-ad7a-a1086a19e844 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:55.275445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62971c87-864a-4f79-ad7a-a1086a19e844 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:55.275892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62971c87-864a-4f79-ad7a-a1086a19e844 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:55.276700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62971c87-864a-4f79-ad7a-a1086a19e844 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:55.277137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62971c87-864a-4f79-ad7a-a1086a19e844 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:55.309134 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-62971c87-864a-4f79-ad7a-a1086a19e844 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046220 Jul 20 04:53:55.309734 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3349/6462] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:53:55 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:53:55.368987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-45a0e526-91eb-4c9e-a2ec-0a41d68803f4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:55.369546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-45a0e526-91eb-4c9e-a2ec-0a41d68803f4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:55.377493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45a0e526-91eb-4c9e-a2ec-0a41d68803f4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:55.377957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45a0e526-91eb-4c9e-a2ec-0a41d68803f4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:55.378740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45a0e526-91eb-4c9e-a2ec-0a41d68803f4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:55.379379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45a0e526-91eb-4c9e-a2ec-0a41d68803f4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:55.406207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-45a0e526-91eb-4c9e-a2ec-0a41d68803f4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:53:55.415214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4ae84b90-f1f9-4411-976f-8d9de3dbb4f4 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:55.416196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4ae84b90-f1f9-4411-976f-8d9de3dbb4f4 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:55.422675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ae84b90-f1f9-4411-976f-8d9de3dbb4f4 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:55.423231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ae84b90-f1f9-4411-976f-8d9de3dbb4f4 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:55.424547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ae84b90-f1f9-4411-976f-8d9de3dbb4f4 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:55.425178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4ae84b90-f1f9-4411-976f-8d9de3dbb4f4 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:55.491618 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-45a0e526-91eb-4c9e-a2ec-0a41d68803f4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 204 len: 0 microversion: 2.1 time: 0.126488 Jul 20 04:53:55.492280 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3114/6463] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:53:55 2022] DELETE /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:53:55.502088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-261fb621-f208-464b-b897-db612b34d035 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:55.503072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-261fb621-f208-464b-b897-db612b34d035 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:55.510032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-261fb621-f208-464b-b897-db612b34d035 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:55.510544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-261fb621-f208-464b-b897-db612b34d035 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:55.511351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-261fb621-f208-464b-b897-db612b34d035 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:55.511848 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-261fb621-f208-464b-b897-db612b34d035 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:55.644869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4ae84b90-f1f9-4411-976f-8d9de3dbb4f4 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:55.652867 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4ae84b90-f1f9-4411-976f-8d9de3dbb4f4 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1500 microversion: 2.1 time: 0.242112 Jul 20 04:53:55.653657 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3350/6464] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:55 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1500 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:55.678609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-261fb621-f208-464b-b897-db612b34d035 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:55.686702 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-261fb621-f208-464b-b897-db612b34d035 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 200 len: 1682 microversion: 2.1 time: 0.190101 Jul 20 04:53:55.687389 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3115/6465] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:55 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 1682 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:56.670987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7d731d11-752b-400c-9296-4aad52f0a4a9 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:56.671607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7d731d11-752b-400c-9296-4aad52f0a4a9 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:56.679183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d731d11-752b-400c-9296-4aad52f0a4a9 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:56.679637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d731d11-752b-400c-9296-4aad52f0a4a9 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:56.680450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d731d11-752b-400c-9296-4aad52f0a4a9 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:56.680895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d731d11-752b-400c-9296-4aad52f0a4a9 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:56.704642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b52cbbc8-c948-429b-85f7-0ecd423f8106 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:56.705444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b52cbbc8-c948-429b-85f7-0ecd423f8106 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:56.716367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b52cbbc8-c948-429b-85f7-0ecd423f8106 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:56.716931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b52cbbc8-c948-429b-85f7-0ecd423f8106 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:56.718401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b52cbbc8-c948-429b-85f7-0ecd423f8106 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:56.718615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b52cbbc8-c948-429b-85f7-0ecd423f8106 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:56.834005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7d731d11-752b-400c-9296-4aad52f0a4a9 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:56.841987 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7d731d11-752b-400c-9296-4aad52f0a4a9 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1503 microversion: 2.1 time: 0.174964 Jul 20 04:53:56.842853 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3351/6466] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:56 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:56.858776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-adb3b09b-9de5-4784-b58e-17db1804f740 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:56.859385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-adb3b09b-9de5-4784-b58e-17db1804f740 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:56.866248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adb3b09b-9de5-4784-b58e-17db1804f740 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:56.867078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adb3b09b-9de5-4784-b58e-17db1804f740 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:56.867950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adb3b09b-9de5-4784-b58e-17db1804f740 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:56.868512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adb3b09b-9de5-4784-b58e-17db1804f740 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:56.871873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b52cbbc8-c948-429b-85f7-0ecd423f8106 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:56.880347 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b52cbbc8-c948-429b-85f7-0ecd423f8106 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 200 len: 1682 microversion: 2.1 time: 0.179671 Jul 20 04:53:56.882236 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3116/6467] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:56 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:56.902020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-adb3b09b-9de5-4784-b58e-17db1804f740 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:53:56.987680 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-adb3b09b-9de5-4784-b58e-17db1804f740 tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 204 len: 0 microversion: 2.1 time: 0.132381 Jul 20 04:53:56.988323 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3352/6468] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:53:56 2022] DELETE /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:53:56.996849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-07e4d25a-2eea-42ba-a37f-c984490ea80a tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:56.997486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-07e4d25a-2eea-42ba-a37f-c984490ea80a tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:57.004820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07e4d25a-2eea-42ba-a37f-c984490ea80a tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:57.005883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07e4d25a-2eea-42ba-a37f-c984490ea80a tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:57.006079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07e4d25a-2eea-42ba-a37f-c984490ea80a tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:57.006517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07e4d25a-2eea-42ba-a37f-c984490ea80a tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:57.169134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-07e4d25a-2eea-42ba-a37f-c984490ea80a tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:57.177507 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-07e4d25a-2eea-42ba-a37f-c984490ea80a tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1509 microversion: 2.1 time: 0.184636 Jul 20 04:53:57.178099 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3117/6469] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:56 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:57.899556 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a06a80a7-d09e-4a7f-8d26-149407191a30 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:57.900237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a06a80a7-d09e-4a7f-8d26-149407191a30 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:57.907772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a06a80a7-d09e-4a7f-8d26-149407191a30 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:57.908470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a06a80a7-d09e-4a7f-8d26-149407191a30 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:57.909294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a06a80a7-d09e-4a7f-8d26-149407191a30 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:57.909739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a06a80a7-d09e-4a7f-8d26-149407191a30 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:58.046192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a06a80a7-d09e-4a7f-8d26-149407191a30 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:58.054868 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a06a80a7-d09e-4a7f-8d26-149407191a30 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 200 len: 1682 microversion: 2.1 time: 0.159564 Jul 20 04:53:58.055474 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3353/6470] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:57 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:58.194877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-981e3d42-4e67-4faa-bbdd-8dbb34321f2c tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:58.195452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-981e3d42-4e67-4faa-bbdd-8dbb34321f2c tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:58.203553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-981e3d42-4e67-4faa-bbdd-8dbb34321f2c tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:58.204145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-981e3d42-4e67-4faa-bbdd-8dbb34321f2c tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:58.205028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-981e3d42-4e67-4faa-bbdd-8dbb34321f2c tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:58.205482 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-981e3d42-4e67-4faa-bbdd-8dbb34321f2c tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:58.346434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-981e3d42-4e67-4faa-bbdd-8dbb34321f2c tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:58.354768 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-981e3d42-4e67-4faa-bbdd-8dbb34321f2c tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1509 microversion: 2.1 time: 0.163888 Jul 20 04:53:58.355373 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3118/6471] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:58 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:59.073500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-24379944-e82f-429c-87f4-a508f538ae74 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:59.074409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-24379944-e82f-429c-87f4-a508f538ae74 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:59.085141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24379944-e82f-429c-87f4-a508f538ae74 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:59.085674 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24379944-e82f-429c-87f4-a508f538ae74 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:59.086531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24379944-e82f-429c-87f4-a508f538ae74 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:59.087045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-24379944-e82f-429c-87f4-a508f538ae74 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:59.284400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-24379944-e82f-429c-87f4-a508f538ae74 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:59.294240 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-24379944-e82f-429c-87f4-a508f538ae74 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 200 len: 1682 microversion: 2.1 time: 0.225105 Jul 20 04:53:59.295122 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3354/6472] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:59 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 1682 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:59.372043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-74c986ce-86e4-46c5-8602-88875dc4250a tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:59.372719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-74c986ce-86e4-46c5-8602-88875dc4250a tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:59.380214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74c986ce-86e4-46c5-8602-88875dc4250a tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:59.380720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74c986ce-86e4-46c5-8602-88875dc4250a tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:59.381518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74c986ce-86e4-46c5-8602-88875dc4250a tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:59.382156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74c986ce-86e4-46c5-8602-88875dc4250a tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:59.664519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-74c986ce-86e4-46c5-8602-88875dc4250a tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce007d7f5b043aeaaa4840bfda3f1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd81b4e344d1498689dc8b32e484ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:59.673523 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-74c986ce-86e4-46c5-8602-88875dc4250a tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 200 len: 1509 microversion: 2.1 time: 0.304742 Jul 20 04:53:59.674856 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3119/6473] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:59 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 1509 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:59.736528 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-59c5ee27-a0bd-4e23-88bf-07512d45e17a req-ff2a4164-1c6d-4d4f-b201-c4e4a6a01427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4dcbb09-eef5-431c-8ccd-7e8e804316c1", "name": "network-vif-deleted", "tag": "751efc11-0915-4d75-ab3b-6e0eac0be9fd"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:59.748721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-59c5ee27-a0bd-4e23-88bf-07512d45e17a req-ff2a4164-1c6d-4d4f-b201-c4e4a6a01427 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:59.749562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-59c5ee27-a0bd-4e23-88bf-07512d45e17a req-ff2a4164-1c6d-4d4f-b201-c4e4a6a01427 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:59.754855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:59.765294 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-59c5ee27-a0bd-4e23-88bf-07512d45e17a req-ff2a4164-1c6d-4d4f-b201-c4e4a6a01427 service nova] Creating event network-vif-deleted:751efc11-0915-4d75-ab3b-6e0eac0be9fd for instance b4dcbb09-eef5-431c-8ccd-7e8e804316c1 on n-h1-826526-5 Jul 20 04:53:59.772429 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-59c5ee27-a0bd-4e23-88bf-07512d45e17a req-ff2a4164-1c6d-4d4f-b201-c4e4a6a01427 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042580 Jul 20 04:53:59.774243 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3355/6474] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:00.313121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-321cef5b-a68a-4a37-8e0f-7356d4ffe0bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:00.313866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-321cef5b-a68a-4a37-8e0f-7356d4ffe0bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:00.320612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-321cef5b-a68a-4a37-8e0f-7356d4ffe0bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:00.321091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-321cef5b-a68a-4a37-8e0f-7356d4ffe0bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:00.321902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-321cef5b-a68a-4a37-8e0f-7356d4ffe0bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:00.322381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-321cef5b-a68a-4a37-8e0f-7356d4ffe0bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:00.356530 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-321cef5b-a68a-4a37-8e0f-7356d4ffe0bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:00.357073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-321cef5b-a68a-4a37-8e0f-7356d4ffe0bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:00.357538 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-321cef5b-a68a-4a37-8e0f-7356d4ffe0bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lazy-loading 'fault' on Instance uuid 8036792e-0b6c-48cd-b555-ae12a1e52658 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:54:00.399825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-321cef5b-a68a-4a37-8e0f-7356d4ffe0bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:00.407497 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-321cef5b-a68a-4a37-8e0f-7356d4ffe0bf tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 200 len: 1332 microversion: 2.1 time: 0.098935 Jul 20 04:54:00.408100 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3120/6475] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:00 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:00.693454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-11d7a4af-5e71-41e3-b155-5fcffca344ac tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:00.694360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-11d7a4af-5e71-41e3-b155-5fcffca344ac tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] [instance: b4dcbb09-eef5-431c-8ccd-7e8e804316c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:00.702057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11d7a4af-5e71-41e3-b155-5fcffca344ac tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:00.702610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11d7a4af-5e71-41e3-b155-5fcffca344ac tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:00.703589 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11d7a4af-5e71-41e3-b155-5fcffca344ac tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:00.704050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-11d7a4af-5e71-41e3-b155-5fcffca344ac tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:00.719286 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-11d7a4af-5e71-41e3-b155-5fcffca344ac tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] HTTP exception thrown: Instance b4dcbb09-eef5-431c-8ccd-7e8e804316c1 could not be found. Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-11d7a4af-5e71-41e3-b155-5fcffca344ac tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Request method failure captured: Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 HTTP/1.1 Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14pMkYy3a_Hm0lm1gAM2H2_wtiFKOUIkOrQIg_cv9f51PiDe-nA6RpAgZWMsrXEgb2egXwvsRmVcl4jjS6H9UnE8I_Gu6dwsjhO_T_2nVG-oXKXAOa1oIO-xxmP9dWiOEChprK2DZz5ZaIC-BGXReCxPGEB1nnzTcDNEG_GeseLC03w Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: fd81b4e344d1498689dc8b32e484ab4e Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestServerAdvancedOps-989588261 Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd81b4e344d1498689dc8b32e484ab4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fd81b4e344d1498689dc8b32e484ab4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fd81b4e344d1498689dc8b32e484ab4e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd81b4e344d1498689dc8b32e484ab4e"}]}] Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestServerAdvancedOps-989588261 Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: fd81b4e344d1498689dc8b32e484ab4e Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestServerAdvancedOps-989588261 Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestServerAdvancedOps-989588261-project Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: bce007d7f5b043aeaaa4840bfda3f1fd Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestServerAdvancedOps-989588261-project Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance b4dcbb09-eef5-431c-8ccd-7e8e804316c1 could not be found. Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'b4dcbb09-eef5-431c-8ccd-7e8e804316c1'} Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4dcbb09-eef5-431c-8ccd-7e8e804316c1 could not be found. Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4dcbb09-eef5-431c-8ccd-7e8e804316c1 could not be found. Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:00.721040 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:00.726307 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:00.726307 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:00.726307 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:00.726307 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:54:00.726307 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:54:00.726307 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4dcbb09-eef5-431c-8ccd-7e8e804316c1 could not be found. Jul 20 04:54:00.726307 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:00.726307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-11d7a4af-5e71-41e3-b155-5fcffca344ac tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] Returning 404 to user: Instance b4dcbb09-eef5-431c-8ccd-7e8e804316c1 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:54:00.726307 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-11d7a4af-5e71-41e3-b155-5fcffca344ac tempest-TestServerAdvancedOps-989588261 tempest-TestServerAdvancedOps-989588261-project] 10.222.0.17 "GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1" status: 404 len: 111 microversion: 2.1 time: 0.035022 Jul 20 04:54:00.726307 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3356/6476] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:00 2022] GET /compute/v2.1/servers/b4dcbb09-eef5-431c-8ccd-7e8e804316c1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:54:01.426951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-55a18dc5-b5b6-44b3-b543-51a116a65521 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:01.427800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-55a18dc5-b5b6-44b3-b543-51a116a65521 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:01.435153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-55a18dc5-b5b6-44b3-b543-51a116a65521 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:01.435826 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-55a18dc5-b5b6-44b3-b543-51a116a65521 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:01.436823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-55a18dc5-b5b6-44b3-b543-51a116a65521 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:01.437444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-55a18dc5-b5b6-44b3-b543-51a116a65521 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:01.458950 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-55a18dc5-b5b6-44b3-b543-51a116a65521 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] HTTP exception thrown: Instance 8036792e-0b6c-48cd-b555-ae12a1e52658 could not be found. Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-55a18dc5-b5b6-44b3-b543-51a116a65521 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Request method failure captured: Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 HTTP/1.1 Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14nXZ97dPvJ1vYjndXy08u0I-QfwsZLjzwhTwPLlHMlDVbR0IZdTAqSZqYran5Cvn4wC7UUKrlJHR7Rd5sBdXlrakajTzWxMCZYT9KggIWGgJVLkrs7-SbyDEPoD28498TR330QVEV33AslM-uldVFYVsaXG-pQNZ1Cq9xOqgPIH54M Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d90f217b019840929bacafcacbbd1a3d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}] Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a241f748f0ef4775b46e4fcd113174e5 Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 8036792e-0b6c-48cd-b555-ae12a1e52658 could not be found. Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '8036792e-0b6c-48cd-b555-ae12a1e52658'} Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8036792e-0b6c-48cd-b555-ae12a1e52658 could not be found. Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8036792e-0b6c-48cd-b555-ae12a1e52658 could not be found. Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:01.460740 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:54:01.465568 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:01.465568 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:01.465568 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:01.465568 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:54:01.465568 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:54:01.465568 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8036792e-0b6c-48cd-b555-ae12a1e52658 could not be found. Jul 20 04:54:01.465568 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:54:01.465568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-55a18dc5-b5b6-44b3-b543-51a116a65521 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Returning 404 to user: Instance 8036792e-0b6c-48cd-b555-ae12a1e52658 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:54:01.465568 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-55a18dc5-b5b6-44b3-b543-51a116a65521 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 404 len: 111 microversion: 2.1 time: 0.039790 Jul 20 04:54:01.466497 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3121/6477] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:01 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:54:01.472216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-afe2305a-392f-4a64-a8ef-faedd6cf46e0 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '.version_select at 0x7f06bcdeaee0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:01.492881 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-afe2305a-392f-4a64-a8ef-faedd6cf46e0 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1078696086" status: 202 len: 0 microversion: 2.1 time: 0.024824 Jul 20 04:54:01.493904 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3357/6478] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jul 20 04:54:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1078696086 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:54:01.812656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f58f999a-dea7-4dd9-8f62-ab8f360b57e3 req-e463bbee-5bd9-4812-8cae-eef7076bc6cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8036792e-0b6c-48cd-b555-ae12a1e52658", "name": "network-vif-deleted", "tag": "601b62f4-2275-4b41-82fe-63f8c38fec2e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:01.824730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f58f999a-dea7-4dd9-8f62-ab8f360b57e3 req-e463bbee-5bd9-4812-8cae-eef7076bc6cd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:01.825425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f58f999a-dea7-4dd9-8f62-ab8f360b57e3 req-e463bbee-5bd9-4812-8cae-eef7076bc6cd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:01.840833 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f58f999a-dea7-4dd9-8f62-ab8f360b57e3 req-e463bbee-5bd9-4812-8cae-eef7076bc6cd service nova] Creating event network-vif-deleted:601b62f4-2275-4b41-82fe-63f8c38fec2e for instance 8036792e-0b6c-48cd-b555-ae12a1e52658 on n-h1-826526-5 Jul 20 04:54:01.848895 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f58f999a-dea7-4dd9-8f62-ab8f360b57e3 req-e463bbee-5bd9-4812-8cae-eef7076bc6cd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041996 Jul 20 04:54:01.850859 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3122/6479] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:02.255076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fd2f816f-d0df-4c1f-9afc-56fe29a14c2a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Action: 'create', calling method: .version_select at 0x7f06bcd9bd30>, body: {"keypair": {"name": "tempest-keypair-2029940142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKBv9GLJDA4PRdTxF6ISWziHa9OhTIwOylNz84cI5HIXbepo8kylJ5YBPCKzYQVZUyDLIXxCuqEI3H/Kg3T7KslNXUf7gJazcNWaOmn/KKcna33xfWKWYFmBvsZS66PrA=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:02.270060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-fd2f816f-d0df-4c1f-9afc-56fe29a14c2a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Getting quotas for project d90f217b019840929bacafcacbbd1a3d. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:54:02.275477 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-fd2f816f-d0df-4c1f-9afc-56fe29a14c2a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Getting quotas for user a241f748f0ef4775b46e4fcd113174e5 and project d90f217b019840929bacafcacbbd1a3d. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:54:02.294523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:02.304088 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fd2f816f-d0df-4c1f-9afc-56fe29a14c2a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054132 Jul 20 04:54:02.304791 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3358/6480] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:54:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:03.877393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0155a018-bc30-4280-8126-fe56b5dcb1e2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1853904841", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64107751-d7d5-48c2-b064-28befc37e9c1"}], "security_groups": [{"name": "tempest-securitygroup--1556609777"}], "key_name": "tempest-keypair-2029940142", "user_data": "}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:04.234660 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-0155a018-bc30-4280-8126-fe56b5dcb1e2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] validate_networks() for [('64107751-d7d5-48c2-b064-28befc37e9c1', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:54:05.141105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0155a018-bc30-4280-8126-fe56b5dcb1e2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:54:05.142182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0155a018-bc30-4280-8126-fe56b5dcb1e2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:54:05.142885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0155a018-bc30-4280-8126-fe56b5dcb1e2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:54:05.143465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0155a018-bc30-4280-8126-fe56b5dcb1e2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:54:05.144080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-0155a018-bc30-4280-8126-fe56b5dcb1e2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:54:05.153573 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0155a018-bc30-4280-8126-fe56b5dcb1e2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:05.154307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0155a018-bc30-4280-8126-fe56b5dcb1e2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:05.155280 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0155a018-bc30-4280-8126-fe56b5dcb1e2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:05.155894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0155a018-bc30-4280-8126-fe56b5dcb1e2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:05.176534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-0155a018-bc30-4280-8126-fe56b5dcb1e2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Getting quotas for project d90f217b019840929bacafcacbbd1a3d. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:54:05.182776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-0155a018-bc30-4280-8126-fe56b5dcb1e2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Getting quotas for user a241f748f0ef4775b46e4fcd113174e5 and project d90f217b019840929bacafcacbbd1a3d. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:54:05.200139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0155a018-bc30-4280-8126-fe56b5dcb1e2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:54:05.203016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0155a018-bc30-4280-8126-fe56b5dcb1e2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:54:05.288980 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0155a018-bc30-4280-8126-fe56b5dcb1e2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.417136 Jul 20 04:54:05.298474 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3123/6481] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:54:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:54:05.302910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-811926ec-926a-4053-a602-6c578667256e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:05.303546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-811926ec-926a-4053-a602-6c578667256e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:06.187141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-811926ec-926a-4053-a602-6c578667256e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:06.197905 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-811926ec-926a-4053-a602-6c578667256e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0" status: 200 len: 1242 microversion: 2.1 time: 0.899290 Jul 20 04:54:06.199314 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3359/6482] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:05 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 => generated 1242 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:54:07.217059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d293f80-be04-4cb1-bf89-f9939805251e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:07.218329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d293f80-be04-4cb1-bf89-f9939805251e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:07.223428 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:07.226988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d293f80-be04-4cb1-bf89-f9939805251e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:07.227699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d293f80-be04-4cb1-bf89-f9939805251e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:07.228513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d293f80-be04-4cb1-bf89-f9939805251e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:07.229282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d293f80-be04-4cb1-bf89-f9939805251e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:07.321249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d293f80-be04-4cb1-bf89-f9939805251e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:07.329485 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d293f80-be04-4cb1-bf89-f9939805251e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0" status: 200 len: 1300 microversion: 2.1 time: 0.118093 Jul 20 04:54:07.330071 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3124/6483] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:07 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:08.347186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-70ce3e66-b37c-4726-912a-5fd5e57d0979 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:08.347770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-70ce3e66-b37c-4726-912a-5fd5e57d0979 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:08.360927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70ce3e66-b37c-4726-912a-5fd5e57d0979 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:08.362771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70ce3e66-b37c-4726-912a-5fd5e57d0979 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:08.364829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70ce3e66-b37c-4726-912a-5fd5e57d0979 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:08.365494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70ce3e66-b37c-4726-912a-5fd5e57d0979 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:08.791585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-70ce3e66-b37c-4726-912a-5fd5e57d0979 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:08.804003 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-70ce3e66-b37c-4726-912a-5fd5e57d0979 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0" status: 200 len: 1368 microversion: 2.1 time: 0.460262 Jul 20 04:54:08.804318 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3360/6484] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:08 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 => generated 1368 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:09.821391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-82010268-ef9d-4a65-abc7-663445c74b95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:09.823001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-82010268-ef9d-4a65-abc7-663445c74b95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:09.831955 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82010268-ef9d-4a65-abc7-663445c74b95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:09.837265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82010268-ef9d-4a65-abc7-663445c74b95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:09.840089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82010268-ef9d-4a65-abc7-663445c74b95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:09.843193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82010268-ef9d-4a65-abc7-663445c74b95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:09.857942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-22503c01-2f3d-4312-b65c-ff989126ea37 req-c25f0bdc-5016-44fe-a1af-bbfe0e39a99c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8258e3-0404-41f7-87f5-aacc6034d9d0", "tag": "8a261c6f-d63c-4134-ad68-d87c5e0606d2"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:09.882260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-22503c01-2f3d-4312-b65c-ff989126ea37 req-c25f0bdc-5016-44fe-a1af-bbfe0e39a99c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:09.890090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-22503c01-2f3d-4312-b65c-ff989126ea37 req-c25f0bdc-5016-44fe-a1af-bbfe0e39a99c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:09.951072 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-22503c01-2f3d-4312-b65c-ff989126ea37 req-c25f0bdc-5016-44fe-a1af-bbfe0e39a99c service nova] Creating event network-changed:8a261c6f-d63c-4134-ad68-d87c5e0606d2 for instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 on n-h2-826526-5 Jul 20 04:54:09.959006 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-22503c01-2f3d-4312-b65c-ff989126ea37 req-c25f0bdc-5016-44fe-a1af-bbfe0e39a99c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204363 Jul 20 04:54:09.963076 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3125/6485] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:10.292506 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-82010268-ef9d-4a65-abc7-663445c74b95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:10.300907 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-82010268-ef9d-4a65-abc7-663445c74b95 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0" status: 200 len: 1368 microversion: 2.1 time: 0.484916 Jul 20 04:54:10.304807 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3361/6486] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:09 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 => generated 1368 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:54:11.323040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2cb42706-fbed-4fd7-88ae-d8993eab17a4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:11.324673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2cb42706-fbed-4fd7-88ae-d8993eab17a4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:11.334210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cb42706-fbed-4fd7-88ae-d8993eab17a4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:11.335489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cb42706-fbed-4fd7-88ae-d8993eab17a4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:11.336573 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cb42706-fbed-4fd7-88ae-d8993eab17a4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:11.337230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cb42706-fbed-4fd7-88ae-d8993eab17a4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:11.581215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2cb42706-fbed-4fd7-88ae-d8993eab17a4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:11.601759 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2cb42706-fbed-4fd7-88ae-d8993eab17a4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0" status: 200 len: 1368 microversion: 2.1 time: 0.284462 Jul 20 04:54:11.605134 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3126/6487] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:11 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 => generated 1368 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:12.621283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-83c75222-57ec-4727-b704-ffe053fab1c5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:12.621917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-83c75222-57ec-4727-b704-ffe053fab1c5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:12.635059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83c75222-57ec-4727-b704-ffe053fab1c5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:12.635516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83c75222-57ec-4727-b704-ffe053fab1c5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:12.636322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83c75222-57ec-4727-b704-ffe053fab1c5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:12.636926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83c75222-57ec-4727-b704-ffe053fab1c5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:12.850662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-83c75222-57ec-4727-b704-ffe053fab1c5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:12.863135 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-83c75222-57ec-4727-b704-ffe053fab1c5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0" status: 200 len: 1368 microversion: 2.1 time: 0.246212 Jul 20 04:54:12.874155 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3362/6488] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:12 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 => generated 1368 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:13.881829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e7b6c9d2-6703-48f0-83d7-57990aa40068 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:13.882480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e7b6c9d2-6703-48f0-83d7-57990aa40068 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:13.917086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7b6c9d2-6703-48f0-83d7-57990aa40068 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:13.917690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7b6c9d2-6703-48f0-83d7-57990aa40068 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:13.919802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7b6c9d2-6703-48f0-83d7-57990aa40068 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:13.921313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7b6c9d2-6703-48f0-83d7-57990aa40068 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:14.278694 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e7b6c9d2-6703-48f0-83d7-57990aa40068 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:14.295793 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e7b6c9d2-6703-48f0-83d7-57990aa40068 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0" status: 200 len: 1368 microversion: 2.1 time: 0.419286 Jul 20 04:54:14.297561 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3127/6489] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:13 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 => generated 1368 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:15.316504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-98a93471-c632-4962-943c-49e49889784e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:15.317343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-98a93471-c632-4962-943c-49e49889784e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:15.346084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98a93471-c632-4962-943c-49e49889784e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:15.351142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98a93471-c632-4962-943c-49e49889784e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:15.352801 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98a93471-c632-4962-943c-49e49889784e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:15.355097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-98a93471-c632-4962-943c-49e49889784e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:16.155883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-98a93471-c632-4962-943c-49e49889784e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:16.175402 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-98a93471-c632-4962-943c-49e49889784e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0" status: 200 len: 1368 microversion: 2.1 time: 0.865470 Jul 20 04:54:16.183494 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3363/6490] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:15 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 => generated 1368 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:16.304517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-fc2a0711-6e7a-4049-aea0-1f5c5dc114c5 req-89797607-51c9-4009-b122-4d1d13a4559b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8258e3-0404-41f7-87f5-aacc6034d9d0", "name": "network-vif-plugged", "status": "completed", "tag": "8a261c6f-d63c-4134-ad68-d87c5e0606d2"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:16.326237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:16.327301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:16.330020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-fc2a0711-6e7a-4049-aea0-1f5c5dc114c5 req-89797607-51c9-4009-b122-4d1d13a4559b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:16.330756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-fc2a0711-6e7a-4049-aea0-1f5c5dc114c5 req-89797607-51c9-4009-b122-4d1d13a4559b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:16.346046 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-fc2a0711-6e7a-4049-aea0-1f5c5dc114c5 req-89797607-51c9-4009-b122-4d1d13a4559b service nova] Creating event network-vif-plugged:8a261c6f-d63c-4134-ad68-d87c5e0606d2 for instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 on n-h2-826526-5 Jul 20 04:54:16.352769 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-fc2a0711-6e7a-4049-aea0-1f5c5dc114c5 req-89797607-51c9-4009-b122-4d1d13a4559b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055601 Jul 20 04:54:16.354144 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3128/6491] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:16.909880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5eafcc8a-c33f-4626-9f59-0279955e2e70 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-201145013", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:16.926112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:16.997473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-5eafcc8a-c33f-4626-9f59-0279955e2e70 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:54:17.209286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3749dd8a-2d2a-4fa8-afa2-25437d6fa5fa tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:17.210491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3749dd8a-2d2a-4fa8-afa2-25437d6fa5fa tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:17.224225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3749dd8a-2d2a-4fa8-afa2-25437d6fa5fa tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:17.227766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3749dd8a-2d2a-4fa8-afa2-25437d6fa5fa tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:17.229401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3749dd8a-2d2a-4fa8-afa2-25437d6fa5fa tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:17.234645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3749dd8a-2d2a-4fa8-afa2-25437d6fa5fa tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:17.481416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3749dd8a-2d2a-4fa8-afa2-25437d6fa5fa tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:17.495230 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3749dd8a-2d2a-4fa8-afa2-25437d6fa5fa tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0" status: 200 len: 1368 microversion: 2.1 time: 0.293120 Jul 20 04:54:17.495834 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3129/6492] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:17 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 => generated 1368 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:17.671335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-5eafcc8a-c33f-4626-9f59-0279955e2e70 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:54:17.672024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-5eafcc8a-c33f-4626-9f59-0279955e2e70 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:54:17.672719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-5eafcc8a-c33f-4626-9f59-0279955e2e70 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:54:17.673335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-5eafcc8a-c33f-4626-9f59-0279955e2e70 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:54:17.673962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-5eafcc8a-c33f-4626-9f59-0279955e2e70 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:54:17.710356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eafcc8a-c33f-4626-9f59-0279955e2e70 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:17.713399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eafcc8a-c33f-4626-9f59-0279955e2e70 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:17.722339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eafcc8a-c33f-4626-9f59-0279955e2e70 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:17.724842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eafcc8a-c33f-4626-9f59-0279955e2e70 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:17.775979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-5eafcc8a-c33f-4626-9f59-0279955e2e70 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Getting quotas for project 7e8fd7b60e5d4ed68419a815e9ea4524. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:54:17.807464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-5eafcc8a-c33f-4626-9f59-0279955e2e70 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Getting quotas for user 54fea5863db248c0bcee6f99c28ef01b and project 7e8fd7b60e5d4ed68419a815e9ea4524. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:54:17.835099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5eafcc8a-c33f-4626-9f59-0279955e2e70 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:54:17.841748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5eafcc8a-c33f-4626-9f59-0279955e2e70 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] [instance: 42cc1d1e-f98b-412d-8277-57689ca7fa0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:54:17.929314 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5eafcc8a-c33f-4626-9f59-0279955e2e70 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.023833 Jul 20 04:54:17.931233 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3364/6493] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:54:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:54:17.941588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4e7afc55-fcb5-4625-ba4c-1e57a6d8b2da tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:17.942500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4e7afc55-fcb5-4625-ba4c-1e57a6d8b2da tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] [instance: 42cc1d1e-f98b-412d-8277-57689ca7fa0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:18.048787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4e7afc55-fcb5-4625-ba4c-1e57a6d8b2da tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fea5863db248c0bcee6f99c28ef01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8fd7b60e5d4ed68419a815e9ea4524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:18.065883 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4e7afc55-fcb5-4625-ba4c-1e57a6d8b2da tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] 10.222.0.17 "GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e" status: 200 len: 1214 microversion: 2.1 time: 0.128752 Jul 20 04:54:18.066594 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3130/6494] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:17 2022] GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:18.514186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-00dd1ff8-473e-4d32-8ce8-c1e98d42d61e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:18.515016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-00dd1ff8-473e-4d32-8ce8-c1e98d42d61e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:18.523902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00dd1ff8-473e-4d32-8ce8-c1e98d42d61e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:18.524645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00dd1ff8-473e-4d32-8ce8-c1e98d42d61e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:18.526053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00dd1ff8-473e-4d32-8ce8-c1e98d42d61e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:18.526775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00dd1ff8-473e-4d32-8ce8-c1e98d42d61e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:18.940717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-00dd1ff8-473e-4d32-8ce8-c1e98d42d61e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:18.951751 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-00dd1ff8-473e-4d32-8ce8-c1e98d42d61e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0" status: 200 len: 1558 microversion: 2.1 time: 0.442202 Jul 20 04:54:18.953013 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3365/6495] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:18 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 => generated 1558 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:18.974117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fef84c28-832f-431c-a8fc-30c7297fe29c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:18.975421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fef84c28-832f-431c-a8fc-30c7297fe29c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:18.986877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fef84c28-832f-431c-a8fc-30c7297fe29c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:18.987750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fef84c28-832f-431c-a8fc-30c7297fe29c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:18.988827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fef84c28-832f-431c-a8fc-30c7297fe29c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:18.989615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fef84c28-832f-431c-a8fc-30c7297fe29c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:19.082154 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fef84c28-832f-431c-a8fc-30c7297fe29c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115435 Jul 20 04:54:19.082983 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3131/6496] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:54:18 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:19.083554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3bb823f4-7ec4-4a0e-8b19-42c68072c052 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:19.084420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3bb823f4-7ec4-4a0e-8b19-42c68072c052 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] [instance: 42cc1d1e-f98b-412d-8277-57689ca7fa0e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:19.091230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3bb823f4-7ec4-4a0e-8b19-42c68072c052 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:19.091850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3bb823f4-7ec4-4a0e-8b19-42c68072c052 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:19.093449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3bb823f4-7ec4-4a0e-8b19-42c68072c052 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:19.093895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3bb823f4-7ec4-4a0e-8b19-42c68072c052 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:19.192165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3bb823f4-7ec4-4a0e-8b19-42c68072c052 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fea5863db248c0bcee6f99c28ef01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8fd7b60e5d4ed68419a815e9ea4524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:19.212067 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3bb823f4-7ec4-4a0e-8b19-42c68072c052 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] 10.222.0.17 "GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e" status: 200 len: 1266 microversion: 2.1 time: 0.132588 Jul 20 04:54:19.214158 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3366/6497] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:19 2022] GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:20.231589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-324cd6b1-aa12-4018-88d8-ea57a571061a tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:20.233028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-324cd6b1-aa12-4018-88d8-ea57a571061a tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] [instance: 42cc1d1e-f98b-412d-8277-57689ca7fa0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:20.243594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-324cd6b1-aa12-4018-88d8-ea57a571061a tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:20.244635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-324cd6b1-aa12-4018-88d8-ea57a571061a tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:20.246192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-324cd6b1-aa12-4018-88d8-ea57a571061a tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:20.248358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-324cd6b1-aa12-4018-88d8-ea57a571061a tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:20.255381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:20.396164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-324cd6b1-aa12-4018-88d8-ea57a571061a tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fea5863db248c0bcee6f99c28ef01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8fd7b60e5d4ed68419a815e9ea4524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:20.412739 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-324cd6b1-aa12-4018-88d8-ea57a571061a tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] 10.222.0.17 "GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e" status: 200 len: 1272 microversion: 2.1 time: 0.185761 Jul 20 04:54:20.415844 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3132/6498] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:20 2022] GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e => generated 1272 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:21.322223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-679b352e-5fbe-4386-96d6-fd90808d15e0 req-9b906910-1666-4438-a7e1-607566f48573 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8258e3-0404-41f7-87f5-aacc6034d9d0", "tag": "8a261c6f-d63c-4134-ad68-d87c5e0606d2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:21.332319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-679b352e-5fbe-4386-96d6-fd90808d15e0 req-9b906910-1666-4438-a7e1-607566f48573 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:21.333050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-679b352e-5fbe-4386-96d6-fd90808d15e0 req-9b906910-1666-4438-a7e1-607566f48573 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:21.347315 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-679b352e-5fbe-4386-96d6-fd90808d15e0 req-9b906910-1666-4438-a7e1-607566f48573 service nova] Creating event network-changed:8a261c6f-d63c-4134-ad68-d87c5e0606d2 for instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 on n-h2-826526-5 Jul 20 04:54:21.355924 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-679b352e-5fbe-4386-96d6-fd90808d15e0 req-9b906910-1666-4438-a7e1-607566f48573 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037646 Jul 20 04:54:21.357560 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3367/6499] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:21.431991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bcd5fb00-b8af-4960-a1a0-83e90c0ef8a0 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:21.433468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bcd5fb00-b8af-4960-a1a0-83e90c0ef8a0 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] [instance: 42cc1d1e-f98b-412d-8277-57689ca7fa0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:21.445539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcd5fb00-b8af-4960-a1a0-83e90c0ef8a0 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:21.449594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcd5fb00-b8af-4960-a1a0-83e90c0ef8a0 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:21.452883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcd5fb00-b8af-4960-a1a0-83e90c0ef8a0 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:21.456056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bcd5fb00-b8af-4960-a1a0-83e90c0ef8a0 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:21.773050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bcd5fb00-b8af-4960-a1a0-83e90c0ef8a0 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fea5863db248c0bcee6f99c28ef01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8fd7b60e5d4ed68419a815e9ea4524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:21.788129 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bcd5fb00-b8af-4960-a1a0-83e90c0ef8a0 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] 10.222.0.17 "GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e" status: 200 len: 1314 microversion: 2.1 time: 0.359316 Jul 20 04:54:21.790053 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3133/6500] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:21 2022] GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:22.809640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f3803134-e262-48cc-a5b5-d75a6a28fa1c tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:22.811160 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f3803134-e262-48cc-a5b5-d75a6a28fa1c tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] [instance: 42cc1d1e-f98b-412d-8277-57689ca7fa0e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:22.823522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3803134-e262-48cc-a5b5-d75a6a28fa1c tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:22.832488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3803134-e262-48cc-a5b5-d75a6a28fa1c tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:22.834299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3803134-e262-48cc-a5b5-d75a6a28fa1c tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:22.834919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3803134-e262-48cc-a5b5-d75a6a28fa1c tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:23.075497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f3803134-e262-48cc-a5b5-d75a6a28fa1c tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fea5863db248c0bcee6f99c28ef01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8fd7b60e5d4ed68419a815e9ea4524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:23.085558 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f3803134-e262-48cc-a5b5-d75a6a28fa1c tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] 10.222.0.17 "GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e" status: 200 len: 1314 microversion: 2.1 time: 0.281843 Jul 20 04:54:23.086624 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3368/6501] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:22 2022] GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:23.380297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-2b6511b3-8cbb-4dee-a363-f6d016c54e9c req-de4bd201-dd93-4b77-a242-5ee75d89d329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42cc1d1e-f98b-412d-8277-57689ca7fa0e", "tag": "33d40d0b-2e79-46ce-9e71-b58c117a7070"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:23.391710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2b6511b3-8cbb-4dee-a363-f6d016c54e9c req-de4bd201-dd93-4b77-a242-5ee75d89d329 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:23.392202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2b6511b3-8cbb-4dee-a363-f6d016c54e9c req-de4bd201-dd93-4b77-a242-5ee75d89d329 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:23.404543 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-2b6511b3-8cbb-4dee-a363-f6d016c54e9c req-de4bd201-dd93-4b77-a242-5ee75d89d329 service nova] Creating event network-changed:33d40d0b-2e79-46ce-9e71-b58c117a7070 for instance 42cc1d1e-f98b-412d-8277-57689ca7fa0e on n-h1-826526-5 Jul 20 04:54:23.411819 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-2b6511b3-8cbb-4dee-a363-f6d016c54e9c req-de4bd201-dd93-4b77-a242-5ee75d89d329 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035522 Jul 20 04:54:23.412843 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3134/6502] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:24.103279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3d2c48c5-50fb-4c83-acd9-4c3018a89311 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:24.103943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3d2c48c5-50fb-4c83-acd9-4c3018a89311 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] [instance: 42cc1d1e-f98b-412d-8277-57689ca7fa0e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:24.112154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3d2c48c5-50fb-4c83-acd9-4c3018a89311 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:24.112836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3d2c48c5-50fb-4c83-acd9-4c3018a89311 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:24.113690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3d2c48c5-50fb-4c83-acd9-4c3018a89311 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:24.114212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3d2c48c5-50fb-4c83-acd9-4c3018a89311 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:24.651566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3d2c48c5-50fb-4c83-acd9-4c3018a89311 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fea5863db248c0bcee6f99c28ef01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8fd7b60e5d4ed68419a815e9ea4524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:24.666210 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3d2c48c5-50fb-4c83-acd9-4c3018a89311 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] 10.222.0.17 "GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e" status: 200 len: 1314 microversion: 2.1 time: 0.567355 Jul 20 04:54:24.667348 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3369/6503] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:24 2022] GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:25.073536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f3fcb38e-236c-40e1-a9c1-7f08ad26b2b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:25.074121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f3fcb38e-236c-40e1-a9c1-7f08ad26b2b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:25.077204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-bab03f49-55e8-485a-80c5-49069542e4c2 req-2a0d9ff7-162c-467d-babb-cdc95265ef52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e90e3d-5a5f-4482-8fc8-8614c72b94ca", "tag": "89445be6-97ad-43c3-9071-1cefd5f48b69"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:25.090314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bab03f49-55e8-485a-80c5-49069542e4c2 req-2a0d9ff7-162c-467d-babb-cdc95265ef52 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:25.091271 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bab03f49-55e8-485a-80c5-49069542e4c2 req-2a0d9ff7-162c-467d-babb-cdc95265ef52 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:25.092576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3fcb38e-236c-40e1-a9c1-7f08ad26b2b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:25.092576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3fcb38e-236c-40e1-a9c1-7f08ad26b2b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:25.093230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3fcb38e-236c-40e1-a9c1-7f08ad26b2b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:25.093673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3fcb38e-236c-40e1-a9c1-7f08ad26b2b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:25.112626 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-bab03f49-55e8-485a-80c5-49069542e4c2 req-2a0d9ff7-162c-467d-babb-cdc95265ef52 service nova] Creating event network-changed:89445be6-97ad-43c3-9071-1cefd5f48b69 for instance 29e90e3d-5a5f-4482-8fc8-8614c72b94ca on n-h2-826526-5 Jul 20 04:54:25.119628 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-bab03f49-55e8-485a-80c5-49069542e4c2 req-2a0d9ff7-162c-467d-babb-cdc95265ef52 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052552 Jul 20 04:54:25.123610 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3370/6504] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:25.143132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f3fcb38e-236c-40e1-a9c1-7f08ad26b2b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:54:25.264093 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f3fcb38e-236c-40e1-a9c1-7f08ad26b2b6 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 204 len: 0 microversion: 2.1 time: 0.200097 Jul 20 04:54:25.269606 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3135/6505] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:54:25 2022] DELETE /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:54:25.275949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-299eb2e1-b82e-4881-8e0c-490a02865614 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:25.276786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-299eb2e1-b82e-4881-8e0c-490a02865614 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:25.289689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-299eb2e1-b82e-4881-8e0c-490a02865614 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:25.290158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-299eb2e1-b82e-4881-8e0c-490a02865614 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:25.290972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-299eb2e1-b82e-4881-8e0c-490a02865614 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:25.291430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-299eb2e1-b82e-4881-8e0c-490a02865614 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:25.447416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-299eb2e1-b82e-4881-8e0c-490a02865614 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:25.457722 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-299eb2e1-b82e-4881-8e0c-490a02865614 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1576 microversion: 2.1 time: 0.186826 Jul 20 04:54:25.458584 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3371/6506] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:25 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:25.683682 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d242dac4-3bb7-4ba3-a7e8-104cffa6baa0 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:25.684434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d242dac4-3bb7-4ba3-a7e8-104cffa6baa0 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] [instance: 42cc1d1e-f98b-412d-8277-57689ca7fa0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:25.690891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d242dac4-3bb7-4ba3-a7e8-104cffa6baa0 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:25.691362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d242dac4-3bb7-4ba3-a7e8-104cffa6baa0 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:25.692151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d242dac4-3bb7-4ba3-a7e8-104cffa6baa0 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:25.692624 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d242dac4-3bb7-4ba3-a7e8-104cffa6baa0 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:25.838202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d242dac4-3bb7-4ba3-a7e8-104cffa6baa0 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fea5863db248c0bcee6f99c28ef01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8fd7b60e5d4ed68419a815e9ea4524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:25.848314 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d242dac4-3bb7-4ba3-a7e8-104cffa6baa0 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] 10.222.0.17 "GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e" status: 200 len: 1314 microversion: 2.1 time: 0.168781 Jul 20 04:54:25.858356 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3136/6507] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:25 2022] GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:26.476867 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f731aea7-6b5e-405b-84b1-38ff3790878b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:26.477482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f731aea7-6b5e-405b-84b1-38ff3790878b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:26.484687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f731aea7-6b5e-405b-84b1-38ff3790878b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:26.485384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f731aea7-6b5e-405b-84b1-38ff3790878b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:26.486191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f731aea7-6b5e-405b-84b1-38ff3790878b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:26.486623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f731aea7-6b5e-405b-84b1-38ff3790878b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:26.688647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f731aea7-6b5e-405b-84b1-38ff3790878b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:26.703651 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f731aea7-6b5e-405b-84b1-38ff3790878b tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1576 microversion: 2.1 time: 0.230628 Jul 20 04:54:26.716017 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3372/6508] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:26 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1576 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:26.864752 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-adeeff5c-6e68-4fe8-b57c-9146ff1dc97d tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:26.865493 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-adeeff5c-6e68-4fe8-b57c-9146ff1dc97d tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] [instance: 42cc1d1e-f98b-412d-8277-57689ca7fa0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:26.873279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-adeeff5c-6e68-4fe8-b57c-9146ff1dc97d tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:26.874156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-adeeff5c-6e68-4fe8-b57c-9146ff1dc97d tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:26.875096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-adeeff5c-6e68-4fe8-b57c-9146ff1dc97d tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:26.875994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-adeeff5c-6e68-4fe8-b57c-9146ff1dc97d tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:27.025388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-adeeff5c-6e68-4fe8-b57c-9146ff1dc97d tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fea5863db248c0bcee6f99c28ef01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8fd7b60e5d4ed68419a815e9ea4524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:27.033458 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-adeeff5c-6e68-4fe8-b57c-9146ff1dc97d tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] 10.222.0.17 "GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e" status: 200 len: 1314 microversion: 2.1 time: 0.172695 Jul 20 04:54:27.034286 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3137/6509] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:26 2022] GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:27.325767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-a2d71b5c-2efb-4769-a261-13ca35b9860f req-53e8d24b-4ae3-4248-a410-668abbfaff50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e90e3d-5a5f-4482-8fc8-8614c72b94ca", "name": "network-vif-deleted", "tag": "89445be6-97ad-43c3-9071-1cefd5f48b69"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:27.338785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a2d71b5c-2efb-4769-a261-13ca35b9860f req-53e8d24b-4ae3-4248-a410-668abbfaff50 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:27.339583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a2d71b5c-2efb-4769-a261-13ca35b9860f req-53e8d24b-4ae3-4248-a410-668abbfaff50 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:27.352962 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-a2d71b5c-2efb-4769-a261-13ca35b9860f req-53e8d24b-4ae3-4248-a410-668abbfaff50 service nova] Creating event network-vif-deleted:89445be6-97ad-43c3-9071-1cefd5f48b69 for instance 29e90e3d-5a5f-4482-8fc8-8614c72b94ca on n-h2-826526-5 Jul 20 04:54:27.358867 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-a2d71b5c-2efb-4769-a261-13ca35b9860f req-53e8d24b-4ae3-4248-a410-668abbfaff50 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037033 Jul 20 04:54:27.359773 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3373/6510] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:27.723343 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0d681690-75c0-48c0-bb5a-a1408345a93c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:27.723968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0d681690-75c0-48c0-bb5a-a1408345a93c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:27.733072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d681690-75c0-48c0-bb5a-a1408345a93c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:27.733539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d681690-75c0-48c0-bb5a-a1408345a93c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:27.734326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d681690-75c0-48c0-bb5a-a1408345a93c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:27.734931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d681690-75c0-48c0-bb5a-a1408345a93c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:27.826383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0d681690-75c0-48c0-bb5a-a1408345a93c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:27.837867 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0d681690-75c0-48c0-bb5a-a1408345a93c tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1224 microversion: 2.1 time: 0.119617 Jul 20 04:54:27.838490 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3138/6511] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:27 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1224 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:28.048940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:28.049843 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:28.058142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4b41a0c5-2f41-4c67-89b8-1acf540d25a2 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:28.059274 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4b41a0c5-2f41-4c67-89b8-1acf540d25a2 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] [instance: 42cc1d1e-f98b-412d-8277-57689ca7fa0e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:28.068414 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b41a0c5-2f41-4c67-89b8-1acf540d25a2 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:28.069152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b41a0c5-2f41-4c67-89b8-1acf540d25a2 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:28.069924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b41a0c5-2f41-4c67-89b8-1acf540d25a2 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:28.070332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b41a0c5-2f41-4c67-89b8-1acf540d25a2 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:28.253067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4b41a0c5-2f41-4c67-89b8-1acf540d25a2 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fea5863db248c0bcee6f99c28ef01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8fd7b60e5d4ed68419a815e9ea4524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:28.262011 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4b41a0c5-2f41-4c67-89b8-1acf540d25a2 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] 10.222.0.17 "GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e" status: 200 len: 1314 microversion: 2.1 time: 0.214887 Jul 20 04:54:28.272121 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3374/6512] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:28 2022] GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:28.319260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-eb540b10-d3bc-4e7b-89c5-f4e00deee629 req-f82ceeed-0506-41a2-a393-bc4da22ae231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42cc1d1e-f98b-412d-8277-57689ca7fa0e", "name": "network-vif-plugged", "status": "completed", "tag": "33d40d0b-2e79-46ce-9e71-b58c117a7070"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:28.327905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:28.331162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-eb540b10-d3bc-4e7b-89c5-f4e00deee629 req-f82ceeed-0506-41a2-a393-bc4da22ae231 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:28.332149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-eb540b10-d3bc-4e7b-89c5-f4e00deee629 req-f82ceeed-0506-41a2-a393-bc4da22ae231 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:28.347180 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-eb540b10-d3bc-4e7b-89c5-f4e00deee629 req-f82ceeed-0506-41a2-a393-bc4da22ae231 service nova] Creating event network-vif-plugged:33d40d0b-2e79-46ce-9e71-b58c117a7070 for instance 42cc1d1e-f98b-412d-8277-57689ca7fa0e on n-h1-826526-5 Jul 20 04:54:28.354668 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-eb540b10-d3bc-4e7b-89c5-f4e00deee629 req-f82ceeed-0506-41a2-a393-bc4da22ae231 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036961 Jul 20 04:54:28.355536 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3139/6513] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:28.855018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f3c6edcd-d46e-48a4-a6ba-a85e10b96668 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:28.856069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f3c6edcd-d46e-48a4-a6ba-a85e10b96668 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:28.863912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3c6edcd-d46e-48a4-a6ba-a85e10b96668 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:28.864469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3c6edcd-d46e-48a4-a6ba-a85e10b96668 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:28.865319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3c6edcd-d46e-48a4-a6ba-a85e10b96668 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:28.866141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f3c6edcd-d46e-48a4-a6ba-a85e10b96668 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:28.936235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f3c6edcd-d46e-48a4-a6ba-a85e10b96668 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:28.946313 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f3c6edcd-d46e-48a4-a6ba-a85e10b96668 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1224 microversion: 2.1 time: 0.094817 Jul 20 04:54:28.948771 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3375/6514] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:28 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:29.282412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-68a496f8-a157-4f3f-a810-c77f96ba2d27 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:29.283466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-68a496f8-a157-4f3f-a810-c77f96ba2d27 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] [instance: 42cc1d1e-f98b-412d-8277-57689ca7fa0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:29.291160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68a496f8-a157-4f3f-a810-c77f96ba2d27 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:29.291650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68a496f8-a157-4f3f-a810-c77f96ba2d27 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:29.292490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68a496f8-a157-4f3f-a810-c77f96ba2d27 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:29.293210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68a496f8-a157-4f3f-a810-c77f96ba2d27 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:29.459217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-68a496f8-a157-4f3f-a810-c77f96ba2d27 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fea5863db248c0bcee6f99c28ef01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8fd7b60e5d4ed68419a815e9ea4524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:29.467732 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-68a496f8-a157-4f3f-a810-c77f96ba2d27 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] 10.222.0.17 "GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e" status: 200 len: 1314 microversion: 2.1 time: 0.192288 Jul 20 04:54:29.468331 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3140/6515] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:29 2022] GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:29.963035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2c9c8772-7771-4424-84ce-2caa3f2a0164 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:29.964565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2c9c8772-7771-4424-84ce-2caa3f2a0164 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:29.972031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c9c8772-7771-4424-84ce-2caa3f2a0164 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:29.972855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c9c8772-7771-4424-84ce-2caa3f2a0164 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:29.973759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c9c8772-7771-4424-84ce-2caa3f2a0164 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:29.974465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c9c8772-7771-4424-84ce-2caa3f2a0164 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:30.040640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2c9c8772-7771-4424-84ce-2caa3f2a0164 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:30.049850 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2c9c8772-7771-4424-84ce-2caa3f2a0164 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1224 microversion: 2.1 time: 0.090626 Jul 20 04:54:30.050567 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3376/6516] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:29 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:30.484481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eb385254-cede-43c7-af9f-22c2b0f0a4f9 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:30.485020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eb385254-cede-43c7-af9f-22c2b0f0a4f9 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] [instance: 42cc1d1e-f98b-412d-8277-57689ca7fa0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:30.492873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb385254-cede-43c7-af9f-22c2b0f0a4f9 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:30.493338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb385254-cede-43c7-af9f-22c2b0f0a4f9 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:30.494114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb385254-cede-43c7-af9f-22c2b0f0a4f9 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:30.494560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb385254-cede-43c7-af9f-22c2b0f0a4f9 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:30.638583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eb385254-cede-43c7-af9f-22c2b0f0a4f9 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fea5863db248c0bcee6f99c28ef01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8fd7b60e5d4ed68419a815e9ea4524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:30.646545 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eb385254-cede-43c7-af9f-22c2b0f0a4f9 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] 10.222.0.17 "GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e" status: 200 len: 1464 microversion: 2.1 time: 0.166100 Jul 20 04:54:30.647260 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3141/6517] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:30 2022] GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e => generated 1464 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:30.687141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5d6868e7-5a2e-4a5e-9e62-12a62f371b79 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:30.687819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5d6868e7-5a2e-4a5e-9e62-12a62f371b79 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] [instance: 42cc1d1e-f98b-412d-8277-57689ca7fa0e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:30.694409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d6868e7-5a2e-4a5e-9e62-12a62f371b79 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:30.694857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d6868e7-5a2e-4a5e-9e62-12a62f371b79 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:30.695615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d6868e7-5a2e-4a5e-9e62-12a62f371b79 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:30.696044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5d6868e7-5a2e-4a5e-9e62-12a62f371b79 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:30.698994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=89 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:30.723499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5d6868e7-5a2e-4a5e-9e62-12a62f371b79 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] [instance: 42cc1d1e-f98b-412d-8277-57689ca7fa0e] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:54:30.829027 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5d6868e7-5a2e-4a5e-9e62-12a62f371b79 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] 10.222.0.17 "DELETE /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e" status: 204 len: 0 microversion: 2.1 time: 0.145360 Jul 20 04:54:30.833406 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3377/6518] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:54:30 2022] DELETE /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:54:30.839012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c0dca5bd-dad5-4ac7-989e-b3f1af648154 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:30.839643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c0dca5bd-dad5-4ac7-989e-b3f1af648154 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] [instance: 42cc1d1e-f98b-412d-8277-57689ca7fa0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:30.847897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0dca5bd-dad5-4ac7-989e-b3f1af648154 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:30.848441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0dca5bd-dad5-4ac7-989e-b3f1af648154 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:30.849278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0dca5bd-dad5-4ac7-989e-b3f1af648154 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:30.849808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0dca5bd-dad5-4ac7-989e-b3f1af648154 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:31.001147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c0dca5bd-dad5-4ac7-989e-b3f1af648154 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fea5863db248c0bcee6f99c28ef01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8fd7b60e5d4ed68419a815e9ea4524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:31.011007 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c0dca5bd-dad5-4ac7-989e-b3f1af648154 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] 10.222.0.17 "GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e" status: 200 len: 1470 microversion: 2.1 time: 0.175947 Jul 20 04:54:31.012210 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3142/6519] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:30 2022] GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:31.067698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4f4d311c-2452-4e6e-adf3-64d45c1a47b7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:31.068645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4f4d311c-2452-4e6e-adf3-64d45c1a47b7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:31.075750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f4d311c-2452-4e6e-adf3-64d45c1a47b7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:31.076362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f4d311c-2452-4e6e-adf3-64d45c1a47b7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:31.077202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f4d311c-2452-4e6e-adf3-64d45c1a47b7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:31.077709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4f4d311c-2452-4e6e-adf3-64d45c1a47b7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:31.141880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4f4d311c-2452-4e6e-adf3-64d45c1a47b7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:31.150046 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4f4d311c-2452-4e6e-adf3-64d45c1a47b7 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 200 len: 1224 microversion: 2.1 time: 0.086695 Jul 20 04:54:31.150630 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3378/6520] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:31 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:54:32.030404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-24692fb1-363f-4b7d-92e5-592069ac8edd tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:32.031105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-24692fb1-363f-4b7d-92e5-592069ac8edd tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] [instance: 42cc1d1e-f98b-412d-8277-57689ca7fa0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:32.039548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24692fb1-363f-4b7d-92e5-592069ac8edd tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:32.040228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24692fb1-363f-4b7d-92e5-592069ac8edd tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:32.041203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24692fb1-363f-4b7d-92e5-592069ac8edd tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:32.041647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24692fb1-363f-4b7d-92e5-592069ac8edd tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:32.167245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-63b5ed02-4eb6-42c0-8082-46024c443039 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:32.167863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-63b5ed02-4eb6-42c0-8082-46024c443039 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 29e90e3d-5a5f-4482-8fc8-8614c72b94ca] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:32.174995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63b5ed02-4eb6-42c0-8082-46024c443039 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:32.175713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63b5ed02-4eb6-42c0-8082-46024c443039 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:32.176527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63b5ed02-4eb6-42c0-8082-46024c443039 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:32.177020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63b5ed02-4eb6-42c0-8082-46024c443039 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:32.192990 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-63b5ed02-4eb6-42c0-8082-46024c443039 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] HTTP exception thrown: Instance 29e90e3d-5a5f-4482-8fc8-8614c72b94ca could not be found. Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-63b5ed02-4eb6-42c0-8082-46024c443039 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Request method failure captured: Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca HTTP/1.1 Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14dGzvYcPg3NF43f6ZRAI_AjtsB7nnPabtQnWEyYg-EXw30wVgvbZX3EBgp2DuSsT-UZ385yph2nVbWQKDH20kvx2xMXBhHcpx3bIjpA8OEQ9j_bQ2MqW2hbHHtIFQtSaphPYv0KfZxRo98jYdMcipaN9CmzRsyzwLTotDNtaeBR3wc Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b889ad56221143f0a54450c81ba738a7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}] Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: bc760e8f522640fc9190460719f5dcc2 Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 29e90e3d-5a5f-4482-8fc8-8614c72b94ca could not be found. Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '29e90e3d-5a5f-4482-8fc8-8614c72b94ca'} Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e90e3d-5a5f-4482-8fc8-8614c72b94ca could not be found. Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e90e3d-5a5f-4482-8fc8-8614c72b94ca could not be found. Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:32.194655 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:32.200008 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:32.200008 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:32.200008 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:32.200008 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:54:32.200008 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:54:32.200008 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e90e3d-5a5f-4482-8fc8-8614c72b94ca could not be found. Jul 20 04:54:32.200008 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:32.200008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-63b5ed02-4eb6-42c0-8082-46024c443039 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Returning 404 to user: Instance 29e90e3d-5a5f-4482-8fc8-8614c72b94ca could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:54:32.200008 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-63b5ed02-4eb6-42c0-8082-46024c443039 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca" status: 404 len: 111 microversion: 2.1 time: 0.033051 Jul 20 04:54:32.204463 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3379/6521] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:32 2022] GET /compute/v2.1/servers/29e90e3d-5a5f-4482-8fc8-8614c72b94ca => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:54:32.315926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-24692fb1-363f-4b7d-92e5-592069ac8edd tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fea5863db248c0bcee6f99c28ef01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8fd7b60e5d4ed68419a815e9ea4524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:32.329288 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-24692fb1-363f-4b7d-92e5-592069ac8edd tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] 10.222.0.17 "GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e" status: 200 len: 1470 microversion: 2.1 time: 0.303756 Jul 20 04:54:32.340122 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3143/6522] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:32 2022] GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e => generated 1470 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:32.991909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-f1d500e7-2109-4bf5-80e1-94b752d7a4c0 req-e235ce50-f565-437c-8dfd-932329aa0fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42cc1d1e-f98b-412d-8277-57689ca7fa0e", "name": "network-vif-deleted", "tag": "33d40d0b-2e79-46ce-9e71-b58c117a7070"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:33.007244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f1d500e7-2109-4bf5-80e1-94b752d7a4c0 req-e235ce50-f565-437c-8dfd-932329aa0fdb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:33.007925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f1d500e7-2109-4bf5-80e1-94b752d7a4c0 req-e235ce50-f565-437c-8dfd-932329aa0fdb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:33.068323 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-f1d500e7-2109-4bf5-80e1-94b752d7a4c0 req-e235ce50-f565-437c-8dfd-932329aa0fdb service nova] Creating event network-vif-deleted:33d40d0b-2e79-46ce-9e71-b58c117a7070 for instance 42cc1d1e-f98b-412d-8277-57689ca7fa0e on n-h1-826526-5 Jul 20 04:54:33.076919 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-f1d500e7-2109-4bf5-80e1-94b752d7a4c0 req-e235ce50-f565-437c-8dfd-932329aa0fdb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095693 Jul 20 04:54:33.077540 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3380/6523] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:33.347352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f9c25a37-a809-45a9-98e1-6b59e3f201f3 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:33.347986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f9c25a37-a809-45a9-98e1-6b59e3f201f3 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] [instance: 42cc1d1e-f98b-412d-8277-57689ca7fa0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:33.355507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9c25a37-a809-45a9-98e1-6b59e3f201f3 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:33.356032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9c25a37-a809-45a9-98e1-6b59e3f201f3 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:33.356928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9c25a37-a809-45a9-98e1-6b59e3f201f3 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:33.357441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9c25a37-a809-45a9-98e1-6b59e3f201f3 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:33.391147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9c25a37-a809-45a9-98e1-6b59e3f201f3 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:33.392110 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9c25a37-a809-45a9-98e1-6b59e3f201f3 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:33.392683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-f9c25a37-a809-45a9-98e1-6b59e3f201f3 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lazy-loading 'fault' on Instance uuid 42cc1d1e-f98b-412d-8277-57689ca7fa0e {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:54:33.450533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f9c25a37-a809-45a9-98e1-6b59e3f201f3 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fea5863db248c0bcee6f99c28ef01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8fd7b60e5d4ed68419a815e9ea4524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:33.463451 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f9c25a37-a809-45a9-98e1-6b59e3f201f3 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] 10.222.0.17 "GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e" status: 200 len: 1304 microversion: 2.1 time: 0.120213 Jul 20 04:54:33.464291 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3144/6524] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:33 2022] GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:34.483236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-68cadfc9-dbbe-480e-bf10-8baab922a588 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:34.484078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-68cadfc9-dbbe-480e-bf10-8baab922a588 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] [instance: 42cc1d1e-f98b-412d-8277-57689ca7fa0e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:34.497890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68cadfc9-dbbe-480e-bf10-8baab922a588 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:34.498503 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68cadfc9-dbbe-480e-bf10-8baab922a588 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:34.499923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68cadfc9-dbbe-480e-bf10-8baab922a588 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:34.501221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-68cadfc9-dbbe-480e-bf10-8baab922a588 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:34.519481 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-68cadfc9-dbbe-480e-bf10-8baab922a588 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] HTTP exception thrown: Instance 42cc1d1e-f98b-412d-8277-57689ca7fa0e could not be found. Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-68cadfc9-dbbe-480e-bf10-8baab922a588 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Request method failure captured: Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e HTTP/1.1 Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14p1E2BzesmPsgkCv9zFIHQw20ngcZ5Oum050dHF1ngqFLRSwskbRD0FJX8gzTbXMX8DNF6kKxJAIOJzCDEJVesMDFtOhXMi__iOumL4MUyuXcV-7-D85gXtuG037YOZu9wC6h8rRiavNwykVoNEB-r2QobZLbkOuymB4bi_xOjEKwo Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 7e8fd7b60e5d4ed68419a815e9ea4524 Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-VolumesNegativeTest-1758807626 Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e8fd7b60e5d4ed68419a815e9ea4524"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7e8fd7b60e5d4ed68419a815e9ea4524"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7e8fd7b60e5d4ed68419a815e9ea4524", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e8fd7b60e5d4ed68419a815e9ea4524"}]}] Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-VolumesNegativeTest-1758807626 Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 7e8fd7b60e5d4ed68419a815e9ea4524 Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-VolumesNegativeTest-1758807626 Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-VolumesNegativeTest-1758807626-project Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 54fea5863db248c0bcee6f99c28ef01b Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-VolumesNegativeTest-1758807626-project Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 42cc1d1e-f98b-412d-8277-57689ca7fa0e could not be found. Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '42cc1d1e-f98b-412d-8277-57689ca7fa0e'} Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42cc1d1e-f98b-412d-8277-57689ca7fa0e could not be found. Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42cc1d1e-f98b-412d-8277-57689ca7fa0e could not be found. Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:34.521198 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:34.526311 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:34.526311 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:34.526311 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:34.526311 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:54:34.526311 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:54:34.526311 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42cc1d1e-f98b-412d-8277-57689ca7fa0e could not be found. Jul 20 04:54:34.526311 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:34.526311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-68cadfc9-dbbe-480e-bf10-8baab922a588 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] Returning 404 to user: Instance 42cc1d1e-f98b-412d-8277-57689ca7fa0e could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:54:34.526311 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-68cadfc9-dbbe-480e-bf10-8baab922a588 tempest-VolumesNegativeTest-1758807626 tempest-VolumesNegativeTest-1758807626-project] 10.222.0.17 "GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e" status: 404 len: 111 microversion: 2.1 time: 0.044732 Jul 20 04:54:34.526311 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3381/6525] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:34 2022] GET /compute/v2.1/servers/42cc1d1e-f98b-412d-8277-57689ca7fa0e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:54:38.754000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-d401de40-d154-4877-b63c-d8bbd5df2b2c req-4a67971c-8487-4c4b-9edd-2e998cb1f294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01995acf-17fd-4f88-8a11-94bc6d7e4660", "tag": "0ca1c5d5-8446-4b52-bd23-4c77b26e751c"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:38.758213 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ffa11c46-b25d-48a4-bd6f-0e05fdc4143f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:38.758819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ffa11c46-b25d-48a4-bd6f-0e05fdc4143f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:38.762236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:38.766608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:38.777137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d401de40-d154-4877-b63c-d8bbd5df2b2c req-4a67971c-8487-4c4b-9edd-2e998cb1f294 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:38.777586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d401de40-d154-4877-b63c-d8bbd5df2b2c req-4a67971c-8487-4c4b-9edd-2e998cb1f294 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:38.784906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffa11c46-b25d-48a4-bd6f-0e05fdc4143f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:38.785408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffa11c46-b25d-48a4-bd6f-0e05fdc4143f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:38.786306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffa11c46-b25d-48a4-bd6f-0e05fdc4143f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:38.786789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffa11c46-b25d-48a4-bd6f-0e05fdc4143f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:38.811675 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-d401de40-d154-4877-b63c-d8bbd5df2b2c req-4a67971c-8487-4c4b-9edd-2e998cb1f294 service nova] Creating event network-changed:0ca1c5d5-8446-4b52-bd23-4c77b26e751c for instance 01995acf-17fd-4f88-8a11-94bc6d7e4660 on n-h1-826526-5 Jul 20 04:54:38.819813 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-d401de40-d154-4877-b63c-d8bbd5df2b2c req-4a67971c-8487-4c4b-9edd-2e998cb1f294 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070166 Jul 20 04:54:38.820829 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3382/6526] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:38.841102 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ffa11c46-b25d-48a4-bd6f-0e05fdc4143f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:54:38.963854 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ffa11c46-b25d-48a4-bd6f-0e05fdc4143f tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 204 len: 0 microversion: 2.1 time: 0.217353 Jul 20 04:54:38.967921 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3145/6527] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:54:38 2022] DELETE /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:54:38.976586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-769d06fd-4e9e-459b-ae65-c2b2cec28aec tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:38.977614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-769d06fd-4e9e-459b-ae65-c2b2cec28aec tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:38.985033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-769d06fd-4e9e-459b-ae65-c2b2cec28aec tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:38.985948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-769d06fd-4e9e-459b-ae65-c2b2cec28aec tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:38.986920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-769d06fd-4e9e-459b-ae65-c2b2cec28aec tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:38.987696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-769d06fd-4e9e-459b-ae65-c2b2cec28aec tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:39.141676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-769d06fd-4e9e-459b-ae65-c2b2cec28aec tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:39.150165 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-769d06fd-4e9e-459b-ae65-c2b2cec28aec tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1576 microversion: 2.1 time: 0.180293 Jul 20 04:54:39.150814 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3383/6528] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:38 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:40.169319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c4478d17-c402-4243-a82b-bee52f55fb79 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:40.193753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c4478d17-c402-4243-a82b-bee52f55fb79 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:40.203659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4478d17-c402-4243-a82b-bee52f55fb79 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:40.204515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4478d17-c402-4243-a82b-bee52f55fb79 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:40.205578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4478d17-c402-4243-a82b-bee52f55fb79 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:40.206235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4478d17-c402-4243-a82b-bee52f55fb79 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:40.238614 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:40.473278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c4478d17-c402-4243-a82b-bee52f55fb79 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:40.485316 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c4478d17-c402-4243-a82b-bee52f55fb79 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1576 microversion: 2.1 time: 0.319586 Jul 20 04:54:40.496051 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3146/6529] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:40 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1576 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:41.097501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-f7430238-a660-4903-accb-65231cb6acc1 req-2ca1daf0-9a68-4a20-b1b0-896360a38c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01995acf-17fd-4f88-8a11-94bc6d7e4660", "name": "network-vif-deleted", "tag": "0ca1c5d5-8446-4b52-bd23-4c77b26e751c"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:41.112612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f7430238-a660-4903-accb-65231cb6acc1 req-2ca1daf0-9a68-4a20-b1b0-896360a38c26 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:41.113341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-f7430238-a660-4903-accb-65231cb6acc1 req-2ca1daf0-9a68-4a20-b1b0-896360a38c26 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:41.129986 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-f7430238-a660-4903-accb-65231cb6acc1 req-2ca1daf0-9a68-4a20-b1b0-896360a38c26 service nova] Creating event network-vif-deleted:0ca1c5d5-8446-4b52-bd23-4c77b26e751c for instance 01995acf-17fd-4f88-8a11-94bc6d7e4660 on n-h1-826526-5 Jul 20 04:54:41.137063 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-f7430238-a660-4903-accb-65231cb6acc1 req-2ca1daf0-9a68-4a20-b1b0-896360a38c26 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043903 Jul 20 04:54:41.138496 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3384/6530] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:41.504211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c8c6b6d4-e9f9-4597-be63-351dd123a7b2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:41.504870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c8c6b6d4-e9f9-4597-be63-351dd123a7b2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:41.517782 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8c6b6d4-e9f9-4597-be63-351dd123a7b2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:41.518118 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8c6b6d4-e9f9-4597-be63-351dd123a7b2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:41.521941 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8c6b6d4-e9f9-4597-be63-351dd123a7b2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:41.522411 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8c6b6d4-e9f9-4597-be63-351dd123a7b2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:41.631143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c8c6b6d4-e9f9-4597-be63-351dd123a7b2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:41.641774 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c8c6b6d4-e9f9-4597-be63-351dd123a7b2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1226 microversion: 2.1 time: 0.142599 Jul 20 04:54:41.651682 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3147/6531] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:41 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1226 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:42.661145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ef3be213-d45d-4107-a2c6-eb5eaa5dbe4a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:42.661848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ef3be213-d45d-4107-a2c6-eb5eaa5dbe4a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:42.668670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef3be213-d45d-4107-a2c6-eb5eaa5dbe4a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:42.669221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef3be213-d45d-4107-a2c6-eb5eaa5dbe4a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:42.669967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef3be213-d45d-4107-a2c6-eb5eaa5dbe4a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:42.670408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef3be213-d45d-4107-a2c6-eb5eaa5dbe4a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:42.742694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ef3be213-d45d-4107-a2c6-eb5eaa5dbe4a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:42.751380 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ef3be213-d45d-4107-a2c6-eb5eaa5dbe4a tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1226 microversion: 2.1 time: 0.095855 Jul 20 04:54:42.752594 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3385/6532] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:42 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:43.769179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9f3978bc-4bc4-4aa8-b261-0bcd7681fec0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:43.769827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9f3978bc-4bc4-4aa8-b261-0bcd7681fec0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:43.777352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f3978bc-4bc4-4aa8-b261-0bcd7681fec0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:43.777903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f3978bc-4bc4-4aa8-b261-0bcd7681fec0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:43.778785 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f3978bc-4bc4-4aa8-b261-0bcd7681fec0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:43.782214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f3978bc-4bc4-4aa8-b261-0bcd7681fec0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:43.852029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9f3978bc-4bc4-4aa8-b261-0bcd7681fec0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:43.861027 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9f3978bc-4bc4-4aa8-b261-0bcd7681fec0 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1226 microversion: 2.1 time: 0.096190 Jul 20 04:54:43.861945 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3148/6533] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:43 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:44.879646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2f911866-cef3-4db5-b1ac-afc045ea7c87 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:44.880408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2f911866-cef3-4db5-b1ac-afc045ea7c87 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:44.887992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f911866-cef3-4db5-b1ac-afc045ea7c87 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:44.888517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f911866-cef3-4db5-b1ac-afc045ea7c87 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:44.889413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f911866-cef3-4db5-b1ac-afc045ea7c87 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:44.889927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f911866-cef3-4db5-b1ac-afc045ea7c87 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:44.961266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2f911866-cef3-4db5-b1ac-afc045ea7c87 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:44.968737 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2f911866-cef3-4db5-b1ac-afc045ea7c87 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1226 microversion: 2.1 time: 0.093341 Jul 20 04:54:44.970260 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3386/6534] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:44 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:45.987487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-44cf1ff6-63e4-4817-82ea-4f9977454602 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:45.988524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-44cf1ff6-63e4-4817-82ea-4f9977454602 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:45.995787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44cf1ff6-63e4-4817-82ea-4f9977454602 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:45.996361 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44cf1ff6-63e4-4817-82ea-4f9977454602 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:45.997223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44cf1ff6-63e4-4817-82ea-4f9977454602 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:45.997756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44cf1ff6-63e4-4817-82ea-4f9977454602 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:46.069847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-44cf1ff6-63e4-4817-82ea-4f9977454602 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:46.078207 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-44cf1ff6-63e4-4817-82ea-4f9977454602 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1226 microversion: 2.1 time: 0.095969 Jul 20 04:54:46.079911 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3149/6535] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:45 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:47.117852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9f33291d-e9de-4916-a64e-11645586a415 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:47.118668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9f33291d-e9de-4916-a64e-11645586a415 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:47.129620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f33291d-e9de-4916-a64e-11645586a415 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:47.132712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f33291d-e9de-4916-a64e-11645586a415 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:47.133800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f33291d-e9de-4916-a64e-11645586a415 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:47.134660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f33291d-e9de-4916-a64e-11645586a415 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:47.202614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9f33291d-e9de-4916-a64e-11645586a415 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc760e8f522640fc9190460719f5dcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889ad56221143f0a54450c81ba738a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:47.212053 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9f33291d-e9de-4916-a64e-11645586a415 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 200 len: 1226 microversion: 2.1 time: 0.109151 Jul 20 04:54:47.213004 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3387/6536] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:47 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:48.229678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e9854b8a-6c60-4759-8860-784017910c49 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:48.231087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e9854b8a-6c60-4759-8860-784017910c49 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: 01995acf-17fd-4f88-8a11-94bc6d7e4660] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:48.238940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9854b8a-6c60-4759-8860-784017910c49 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:48.239656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9854b8a-6c60-4759-8860-784017910c49 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:48.240499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9854b8a-6c60-4759-8860-784017910c49 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:48.240955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9854b8a-6c60-4759-8860-784017910c49 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:48.256526 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-e9854b8a-6c60-4759-8860-784017910c49 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] HTTP exception thrown: Instance 01995acf-17fd-4f88-8a11-94bc6d7e4660 could not be found. Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e9854b8a-6c60-4759-8860-784017910c49 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Request method failure captured: Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 HTTP/1.1 Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14dGzvYcPg3NF43f6ZRAI_AjtsB7nnPabtQnWEyYg-EXw30wVgvbZX3EBgp2DuSsT-UZ385yph2nVbWQKDH20kvx2xMXBhHcpx3bIjpA8OEQ9j_bQ2MqW2hbHHtIFQtSaphPYv0KfZxRo98jYdMcipaN9CmzRsyzwLTotDNtaeBR3wc Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b889ad56221143f0a54450c81ba738a7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}] Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: bc760e8f522640fc9190460719f5dcc2 Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 01995acf-17fd-4f88-8a11-94bc6d7e4660 could not be found. Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '01995acf-17fd-4f88-8a11-94bc6d7e4660'} Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01995acf-17fd-4f88-8a11-94bc6d7e4660 could not be found. Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01995acf-17fd-4f88-8a11-94bc6d7e4660 could not be found. Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:48.258134 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:54:48.262875 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:48.262875 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:48.262875 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:48.262875 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:54:48.262875 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:54:48.262875 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01995acf-17fd-4f88-8a11-94bc6d7e4660 could not be found. Jul 20 04:54:48.262875 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:54:48.262875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e9854b8a-6c60-4759-8860-784017910c49 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Returning 404 to user: Instance 01995acf-17fd-4f88-8a11-94bc6d7e4660 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:54:48.262875 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e9854b8a-6c60-4759-8860-784017910c49 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660" status: 404 len: 111 microversion: 2.1 time: 0.033949 Jul 20 04:54:48.262875 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3150/6537] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:48 2022] GET /compute/v2.1/servers/01995acf-17fd-4f88-8a11-94bc6d7e4660 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:54:48.769998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-615fd829-7585-4ede-98ba-842f8a23ed08 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:48.770736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-615fd829-7585-4ede-98ba-842f8a23ed08 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:48.778520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-615fd829-7585-4ede-98ba-842f8a23ed08 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:48.779072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-615fd829-7585-4ede-98ba-842f8a23ed08 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:48.780004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-615fd829-7585-4ede-98ba-842f8a23ed08 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:48.780594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-615fd829-7585-4ede-98ba-842f8a23ed08 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:48.797728 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-615fd829-7585-4ede-98ba-842f8a23ed08 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] HTTP exception thrown: Instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a could not be found. Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-615fd829-7585-4ede-98ba-842f8a23ed08 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Request method failure captured: Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a HTTP/1.1 Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14dGzvYcPg3NF43f6ZRAI_AjtsB7nnPabtQnWEyYg-EXw30wVgvbZX3EBgp2DuSsT-UZ385yph2nVbWQKDH20kvx2xMXBhHcpx3bIjpA8OEQ9j_bQ2MqW2hbHHtIFQtSaphPYv0KfZxRo98jYdMcipaN9CmzRsyzwLTotDNtaeBR3wc Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b889ad56221143f0a54450c81ba738a7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}] Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: bc760e8f522640fc9190460719f5dcc2 Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a could not be found. Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'cbcc3e27-5b1a-4e63-8d64-53aeb92f237a'} Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a could not be found. Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:54:48.800489 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:54:48.805104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a could not be found. Jul 20 04:54:48.805104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:48.805104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:48.805104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:48.805104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:48.805104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:48.805104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:48.805104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:54:48.805104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:54:48.805104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a could not be found. Jul 20 04:54:48.805104 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:54:48.805104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-615fd829-7585-4ede-98ba-842f8a23ed08 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Returning 404 to user: Instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:54:48.805104 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-615fd829-7585-4ede-98ba-842f8a23ed08 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 404 len: 111 microversion: 2.1 time: 0.037647 Jul 20 04:54:48.805104 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3388/6538] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:54:48 2022] DELETE /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:54:48.813245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1f386af1-a624-4284-8323-032b576af2ff tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:48.813909 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1f386af1-a624-4284-8323-032b576af2ff tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] [instance: cbcc3e27-5b1a-4e63-8d64-53aeb92f237a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:48.821031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f386af1-a624-4284-8323-032b576af2ff tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:48.821617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f386af1-a624-4284-8323-032b576af2ff tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:48.822477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f386af1-a624-4284-8323-032b576af2ff tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:48.822920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f386af1-a624-4284-8323-032b576af2ff tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:48.838675 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-1f386af1-a624-4284-8323-032b576af2ff tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] HTTP exception thrown: Instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a could not be found. Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1f386af1-a624-4284-8323-032b576af2ff tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Request method failure captured: Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a HTTP/1.1 Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14dGzvYcPg3NF43f6ZRAI_AjtsB7nnPabtQnWEyYg-EXw30wVgvbZX3EBgp2DuSsT-UZ385yph2nVbWQKDH20kvx2xMXBhHcpx3bIjpA8OEQ9j_bQ2MqW2hbHHtIFQtSaphPYv0KfZxRo98jYdMcipaN9CmzRsyzwLTotDNtaeBR3wc Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b889ad56221143f0a54450c81ba738a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b889ad56221143f0a54450c81ba738a7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b889ad56221143f0a54450c81ba738a7"}]}] Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: b889ad56221143f0a54450c81ba738a7 Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestVolumeBootPattern-1200242547 Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: bc760e8f522640fc9190460719f5dcc2 Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestVolumeBootPattern-1200242547-project Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a could not be found. Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'cbcc3e27-5b1a-4e63-8d64-53aeb92f237a'} Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a could not be found. Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a could not be found. Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:48.840375 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:54:48.846919 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:48.846919 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:48.846919 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:48.846919 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:54:48.846919 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:54:48.846919 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a could not be found. Jul 20 04:54:48.846919 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:54:48.846919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1f386af1-a624-4284-8323-032b576af2ff tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Returning 404 to user: Instance cbcc3e27-5b1a-4e63-8d64-53aeb92f237a could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:54:48.846919 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1f386af1-a624-4284-8323-032b576af2ff tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a" status: 404 len: 111 microversion: 2.1 time: 0.033061 Jul 20 04:54:48.846919 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3151/6539] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:48 2022] GET /compute/v2.1/servers/cbcc3e27-5b1a-4e63-8d64-53aeb92f237a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:54:53.424881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e73ac9a3-14fe-47ee-a5ac-ee56cce0f2d2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] Calling method '.version_select at 0x7f06bcdc43a0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:53.468471 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e73ac9a3-14fe-47ee-a5ac-ee56cce0f2d2 tempest-TestVolumeBootPattern-1200242547 tempest-TestVolumeBootPattern-1200242547-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1993339905" status: 202 len: 0 microversion: 2.1 time: 0.047307 Jul 20 04:54:53.469753 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3389/6540] 10.222.0.17 () {58 vars in 1262 bytes} [Wed Jul 20 04:54:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1993339905 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:54:55.100736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0e3353ba-6862-43e0-bc22-752f9eea2fd8 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:55.101295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0e3353ba-6862-43e0-bc22-752f9eea2fd8 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:55.108130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e3353ba-6862-43e0-bc22-752f9eea2fd8 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:55.108832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e3353ba-6862-43e0-bc22-752f9eea2fd8 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:55.109997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e3353ba-6862-43e0-bc22-752f9eea2fd8 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:55.110501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e3353ba-6862-43e0-bc22-752f9eea2fd8 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:55.165274 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0e3353ba-6862-43e0-bc22-752f9eea2fd8 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/ips" status: 200 len: 150 microversion: 2.1 time: 0.068781 Jul 20 04:54:55.167177 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3152/6541] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 04:54:55 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/ips => generated 150 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:57.739519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4068dd68-845e-4dab-b673-c8435bf4cded tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1eef089-0a47-4616-b6d0-03ebe355ee71"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:57.740642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4068dd68-845e-4dab-b673-c8435bf4cded tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:57.749235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4068dd68-845e-4dab-b673-c8435bf4cded tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:57.750206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4068dd68-845e-4dab-b673-c8435bf4cded tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:57.750471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4068dd68-845e-4dab-b673-c8435bf4cded tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:57.751082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4068dd68-845e-4dab-b673-c8435bf4cded tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:58.036553 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4068dd68-845e-4dab-b673-c8435bf4cded tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "POST /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301052 Jul 20 04:54:58.037898 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3390/6542] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 04:54:57 2022] POST /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:10.021190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:10.022492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=28 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:10.028283 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-64337364-df0f-4f09-8c74-6e0fa078aa6d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1eef089-0a47-4616-b6d0-03ebe355ee71"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:10.029692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-64337364-df0f-4f09-8c74-6e0fa078aa6d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:10.038031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64337364-df0f-4f09-8c74-6e0fa078aa6d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:10.038513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64337364-df0f-4f09-8c74-6e0fa078aa6d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:10.039308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64337364-df0f-4f09-8c74-6e0fa078aa6d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:10.039771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64337364-df0f-4f09-8c74-6e0fa078aa6d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:10.123592 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-64337364-df0f-4f09-8c74-6e0fa078aa6d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] HTTP exception thrown: Invalid volume: volume d1eef089-0a47-4616-b6d0-03ebe355ee71 is already attached to instances: 2d8258e3-0404-41f7-87f5-aacc6034d9d0 Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-64337364-df0f-4f09-8c74-6e0fa078aa6d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Request method failure captured: Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments HTTP/1.1 Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 74 Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14nXZ97dPvJ1vYjndXy08u0I-QfwsZLjzwhTwPLlHMlDVbR0IZdTAqSZqYran5Cvn4wC7UUKrlJHR7Rd5sBdXlrakajTzWxMCZYT9KggIWGgJVLkrs7-SbyDEPoD28498TR330QVEV33AslM-uldVFYVsaXG-pQNZ1Cq9xOqgPIH54M Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d90f217b019840929bacafcacbbd1a3d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}] Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a241f748f0ef4775b46e4fcd113174e5 Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: {"volumeAttachment": {"volumeId": "d1eef089-0a47-4616-b6d0-03ebe355ee71"}} Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: exception: Invalid volume: volume d1eef089-0a47-4616-b6d0-03ebe355ee71 is already attached to instances: 2d8258e3-0404-41f7-87f5-aacc6034d9d0 Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'server_id': '2d8258e3-0404-41f7-87f5-aacc6034d9d0', 'body': {'volumeAttachment': {'volumeId': 'd1eef089-0a47-4616-b6d0-03ebe355ee71'}}} Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d1eef089-0a47-4616-b6d0-03ebe355ee71 is already attached to instances: 2d8258e3-0404-41f7-87f5-aacc6034d9d0 Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:55:10.125265 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:55:10.130811 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:55:10.130811 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:55:10.130811 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 04:55:10.130811 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:55:10.130811 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d1eef089-0a47-4616-b6d0-03ebe355ee71 is already attached to instances: 2d8258e3-0404-41f7-87f5-aacc6034d9d0 Jul 20 04:55:10.130811 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:55:10.130811 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:55:10.130811 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:55:10.130811 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:55:10.130811 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:55:10.130811 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:55:10.130811 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:55:10.130811 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:55:10.130811 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d1eef089-0a47-4616-b6d0-03ebe355ee71 is already attached to instances: 2d8258e3-0404-41f7-87f5-aacc6034d9d0 Jul 20 04:55:10.130811 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:55:10.130811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-64337364-df0f-4f09-8c74-6e0fa078aa6d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Returning 400 to user: Invalid volume: volume d1eef089-0a47-4616-b6d0-03ebe355ee71 is already attached to instances: 2d8258e3-0404-41f7-87f5-aacc6034d9d0 {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:55:10.130811 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-64337364-df0f-4f09-8c74-6e0fa078aa6d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "POST /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107193 Jul 20 04:55:10.133112 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3153/6543] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 04:55:10 2022] POST /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:55:10.192009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:10.192810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:10.197056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-91af2029-f545-49ff-8ebc-aa735a966a16 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:10.197758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-91af2029-f545-49ff-8ebc-aa735a966a16 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:10.205544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91af2029-f545-49ff-8ebc-aa735a966a16 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:10.205967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91af2029-f545-49ff-8ebc-aa735a966a16 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:10.206741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91af2029-f545-49ff-8ebc-aa735a966a16 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:10.207177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91af2029-f545-49ff-8ebc-aa735a966a16 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:10.297913 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-91af2029-f545-49ff-8ebc-aa735a966a16 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lazy-loading 'services' on Instance uuid 2d8258e3-0404-41f7-87f5-aacc6034d9d0 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:55:10.387131 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-91af2029-f545-49ff-8ebc-aa735a966a16 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments/d1eef089-0a47-4616-b6d0-03ebe355ee71" status: 202 len: 0 microversion: 2.1 time: 0.196923 Jul 20 04:55:10.388179 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3391/6544] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 04:55:10 2022] DELETE /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments/d1eef089-0a47-4616-b6d0-03ebe355ee71 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:55:10.396609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-59adfc6d-9445-4b10-b729-5b2e58935833 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:10.397854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-59adfc6d-9445-4b10-b729-5b2e58935833 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:10.405155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59adfc6d-9445-4b10-b729-5b2e58935833 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:10.405884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59adfc6d-9445-4b10-b729-5b2e58935833 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:10.406905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59adfc6d-9445-4b10-b729-5b2e58935833 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:10.407424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-59adfc6d-9445-4b10-b729-5b2e58935833 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:10.461122 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-59adfc6d-9445-4b10-b729-5b2e58935833 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068210 Jul 20 04:55:10.462126 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3154/6545] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:55:10 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:11.475629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-131fa573-d134-49ad-8360-83504abc2387 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:11.477996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-131fa573-d134-49ad-8360-83504abc2387 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:11.485554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-131fa573-d134-49ad-8360-83504abc2387 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:11.486404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-131fa573-d134-49ad-8360-83504abc2387 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:11.487395 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-131fa573-d134-49ad-8360-83504abc2387 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:11.487835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-131fa573-d134-49ad-8360-83504abc2387 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:11.522507 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-131fa573-d134-49ad-8360-83504abc2387 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052642 Jul 20 04:55:11.523096 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3392/6546] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:55:11 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:12.535136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dc7f14eb-31cd-441c-9846-4007abe3ea41 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:12.536346 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dc7f14eb-31cd-441c-9846-4007abe3ea41 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:12.543718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc7f14eb-31cd-441c-9846-4007abe3ea41 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:12.544187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc7f14eb-31cd-441c-9846-4007abe3ea41 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:12.545016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc7f14eb-31cd-441c-9846-4007abe3ea41 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:12.545471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc7f14eb-31cd-441c-9846-4007abe3ea41 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:12.581737 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dc7f14eb-31cd-441c-9846-4007abe3ea41 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051178 Jul 20 04:55:12.584321 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3155/6547] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:55:12 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:13.593941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-541fdfff-ca26-4890-97df-4c8ff685ed99 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:13.595047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-541fdfff-ca26-4890-97df-4c8ff685ed99 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:13.602673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-541fdfff-ca26-4890-97df-4c8ff685ed99 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:13.603130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-541fdfff-ca26-4890-97df-4c8ff685ed99 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:13.603912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-541fdfff-ca26-4890-97df-4c8ff685ed99 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:13.604383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-541fdfff-ca26-4890-97df-4c8ff685ed99 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:13.646278 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-541fdfff-ca26-4890-97df-4c8ff685ed99 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056496 Jul 20 04:55:13.646923 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3393/6548] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:55:13 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:14.658706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3ec380c9-7d11-480c-8465-b232acda919f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:14.660010 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3ec380c9-7d11-480c-8465-b232acda919f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:14.667427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ec380c9-7d11-480c-8465-b232acda919f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:14.667981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ec380c9-7d11-480c-8465-b232acda919f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:14.668861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ec380c9-7d11-480c-8465-b232acda919f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:14.669589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ec380c9-7d11-480c-8465-b232acda919f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:14.700925 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3ec380c9-7d11-480c-8465-b232acda919f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046464 Jul 20 04:55:14.704411 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3156/6549] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:55:14 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:15.712740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-630289a5-c3e2-4a83-8bcb-9340b40ad9d9 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:15.713684 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-630289a5-c3e2-4a83-8bcb-9340b40ad9d9 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:15.720868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-630289a5-c3e2-4a83-8bcb-9340b40ad9d9 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:15.721324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-630289a5-c3e2-4a83-8bcb-9340b40ad9d9 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:15.722090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-630289a5-c3e2-4a83-8bcb-9340b40ad9d9 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:15.722558 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-630289a5-c3e2-4a83-8bcb-9340b40ad9d9 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:15.753985 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-630289a5-c3e2-4a83-8bcb-9340b40ad9d9 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044738 Jul 20 04:55:15.754563 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3394/6550] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:55:15 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:55:15.815949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-37c8b437-404e-4f7b-aa68-5d02a32591c9 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:15.816736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-37c8b437-404e-4f7b-aa68-5d02a32591c9 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:15.823663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37c8b437-404e-4f7b-aa68-5d02a32591c9 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:15.824127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37c8b437-404e-4f7b-aa68-5d02a32591c9 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:15.824977 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37c8b437-404e-4f7b-aa68-5d02a32591c9 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:15.825424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-37c8b437-404e-4f7b-aa68-5d02a32591c9 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:15.850804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-37c8b437-404e-4f7b-aa68-5d02a32591c9 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:55:15.931041 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-37c8b437-404e-4f7b-aa68-5d02a32591c9 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0" status: 204 len: 0 microversion: 2.1 time: 0.118747 Jul 20 04:55:15.931941 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3157/6551] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:55:15 2022] DELETE /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:55:15.940396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5178598a-a3b0-4120-96bd-de4db2bd158f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:15.941110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5178598a-a3b0-4120-96bd-de4db2bd158f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:15.947812 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5178598a-a3b0-4120-96bd-de4db2bd158f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:15.948611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5178598a-a3b0-4120-96bd-de4db2bd158f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:15.949486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5178598a-a3b0-4120-96bd-de4db2bd158f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:15.950026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5178598a-a3b0-4120-96bd-de4db2bd158f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:16.084240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5178598a-a3b0-4120-96bd-de4db2bd158f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:16.092767 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5178598a-a3b0-4120-96bd-de4db2bd158f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0" status: 200 len: 1683 microversion: 2.1 time: 0.156327 Jul 20 04:55:16.093424 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3395/6552] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:15 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:17.113331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b2d7c6f1-810f-4818-be47-4fdfd5e11e2c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:17.114465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b2d7c6f1-810f-4818-be47-4fdfd5e11e2c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:17.121662 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2d7c6f1-810f-4818-be47-4fdfd5e11e2c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:17.122138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2d7c6f1-810f-4818-be47-4fdfd5e11e2c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:17.122924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2d7c6f1-810f-4818-be47-4fdfd5e11e2c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:17.123374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2d7c6f1-810f-4818-be47-4fdfd5e11e2c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:17.265057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b2d7c6f1-810f-4818-be47-4fdfd5e11e2c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:17.273352 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b2d7c6f1-810f-4818-be47-4fdfd5e11e2c tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0" status: 200 len: 1683 microversion: 2.1 time: 0.164495 Jul 20 04:55:17.273946 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3158/6553] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:17 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:18.227681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-c146e4fa-03bc-4bc1-ad52-a888fa730c82 req-22fb4628-0a4a-4c31-895b-9aa8f457d378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8258e3-0404-41f7-87f5-aacc6034d9d0", "name": "network-vif-deleted", "tag": "8a261c6f-d63c-4134-ad68-d87c5e0606d2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:18.246286 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c146e4fa-03bc-4bc1-ad52-a888fa730c82 req-22fb4628-0a4a-4c31-895b-9aa8f457d378 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:18.247079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c146e4fa-03bc-4bc1-ad52-a888fa730c82 req-22fb4628-0a4a-4c31-895b-9aa8f457d378 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:18.273894 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-c146e4fa-03bc-4bc1-ad52-a888fa730c82 req-22fb4628-0a4a-4c31-895b-9aa8f457d378 service nova] Creating event network-vif-deleted:8a261c6f-d63c-4134-ad68-d87c5e0606d2 for instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 on n-h2-826526-5 Jul 20 04:55:18.281659 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-c146e4fa-03bc-4bc1-ad52-a888fa730c82 req-22fb4628-0a4a-4c31-895b-9aa8f457d378 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057642 Jul 20 04:55:18.289113 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3396/6554] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:18.292443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ba13aada-d63e-4705-a559-e3d72747b68e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:18.293169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ba13aada-d63e-4705-a559-e3d72747b68e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:18.306059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba13aada-d63e-4705-a559-e3d72747b68e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:18.308648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba13aada-d63e-4705-a559-e3d72747b68e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:18.310873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba13aada-d63e-4705-a559-e3d72747b68e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:18.311540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba13aada-d63e-4705-a559-e3d72747b68e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:18.449539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ba13aada-d63e-4705-a559-e3d72747b68e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:18.460994 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ba13aada-d63e-4705-a559-e3d72747b68e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0" status: 200 len: 1327 microversion: 2.1 time: 0.173790 Jul 20 04:55:18.462322 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3159/6555] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:18 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 => generated 1327 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:19.479911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f60e9f93-b517-4241-be4d-22f95ddf73b0 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:19.480694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f60e9f93-b517-4241-be4d-22f95ddf73b0 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:19.488536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f60e9f93-b517-4241-be4d-22f95ddf73b0 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:19.489559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f60e9f93-b517-4241-be4d-22f95ddf73b0 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:19.490416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f60e9f93-b517-4241-be4d-22f95ddf73b0 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:19.490831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f60e9f93-b517-4241-be4d-22f95ddf73b0 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:19.505666 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-f60e9f93-b517-4241-be4d-22f95ddf73b0 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] HTTP exception thrown: Instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 could not be found. Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f60e9f93-b517-4241-be4d-22f95ddf73b0 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Request method failure captured: Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 HTTP/1.1 Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14nXZ97dPvJ1vYjndXy08u0I-QfwsZLjzwhTwPLlHMlDVbR0IZdTAqSZqYran5Cvn4wC7UUKrlJHR7Rd5sBdXlrakajTzWxMCZYT9KggIWGgJVLkrs7-SbyDEPoD28498TR330QVEV33AslM-uldVFYVsaXG-pQNZ1Cq9xOqgPIH54M Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d90f217b019840929bacafcacbbd1a3d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}] Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a241f748f0ef4775b46e4fcd113174e5 Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 could not be found. Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '2d8258e3-0404-41f7-87f5-aacc6034d9d0'} Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 could not be found. Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 could not be found. Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:55:19.507343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:55:19.514722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:55:19.514722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:55:19.514722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:55:19.514722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:55:19.514722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:55:19.514722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 could not be found. Jul 20 04:55:19.514722 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:55:19.514722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f60e9f93-b517-4241-be4d-22f95ddf73b0 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Returning 404 to user: Instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:55:19.514722 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f60e9f93-b517-4241-be4d-22f95ddf73b0 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0" status: 404 len: 111 microversion: 2.1 time: 0.033620 Jul 20 04:55:19.514722 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3397/6556] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:19 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:55:19.518354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-392edd78-2da0-4bb7-99fd-7524b7aab6e5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '.version_select at 0x7f06be981ee0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:19.539022 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-392edd78-2da0-4bb7-99fd-7524b7aab6e5 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2029940142" status: 202 len: 0 microversion: 2.1 time: 0.024902 Jul 20 04:55:19.540049 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3160/6557] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jul 20 04:55:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2029940142 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:55:20.196061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-239a23ca-1827-4133-bd53-3b0918856db2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Action: 'create', calling method: .version_select at 0x7f06bcd4f8b0>, body: {"keypair": {"name": "tempest-keypair-1942246623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1d+Jp68zoBYO0DIE/Iob1KME7MVXsSLWce7iGUCqkfselM9X2EW9p9vkN6vJFt5LztNcp8Hropqiz0paBT8IfnqS2rASjE99A7K5JwW2GoMNVENUSf1OL3/8TtOqBclA=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:20.211615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-239a23ca-1827-4133-bd53-3b0918856db2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Getting quotas for project d90f217b019840929bacafcacbbd1a3d. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:55:20.217727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-239a23ca-1827-4133-bd53-3b0918856db2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Getting quotas for user a241f748f0ef4775b46e4fcd113174e5 and project d90f217b019840929bacafcacbbd1a3d. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:55:20.243835 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-239a23ca-1827-4133-bd53-3b0918856db2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051777 Jul 20 04:55:20.244792 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3398/6558] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:55:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:21.620402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b73de743-7ddc-4b79-9242-a01a5d413de2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1816103901", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64107751-d7d5-48c2-b064-28befc37e9c1"}], "security_groups": [{"name": "tempest-securitygroup--363368181"}], "key_name": "tempest-keypair-1942246623", "user_data": "}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:21.742966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-b73de743-7ddc-4b79-9242-a01a5d413de2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] validate_networks() for [('64107751-d7d5-48c2-b064-28befc37e9c1', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:55:22.297159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b73de743-7ddc-4b79-9242-a01a5d413de2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:55:22.297761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b73de743-7ddc-4b79-9242-a01a5d413de2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:55:22.298646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b73de743-7ddc-4b79-9242-a01a5d413de2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:55:22.299274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b73de743-7ddc-4b79-9242-a01a5d413de2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:55:22.299847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-b73de743-7ddc-4b79-9242-a01a5d413de2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:55:22.310044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b73de743-7ddc-4b79-9242-a01a5d413de2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:22.310559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b73de743-7ddc-4b79-9242-a01a5d413de2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:22.311586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b73de743-7ddc-4b79-9242-a01a5d413de2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:22.312103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b73de743-7ddc-4b79-9242-a01a5d413de2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:22.332805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-b73de743-7ddc-4b79-9242-a01a5d413de2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Getting quotas for project d90f217b019840929bacafcacbbd1a3d. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:55:22.338637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-b73de743-7ddc-4b79-9242-a01a5d413de2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Getting quotas for user a241f748f0ef4775b46e4fcd113174e5 and project d90f217b019840929bacafcacbbd1a3d. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:55:22.351659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b73de743-7ddc-4b79-9242-a01a5d413de2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:55:22.354014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b73de743-7ddc-4b79-9242-a01a5d413de2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:55:22.408376 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b73de743-7ddc-4b79-9242-a01a5d413de2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.794948 Jul 20 04:55:22.408950 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3161/6559] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:55:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:55:22.419999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1ed7d55c-b1f6-4545-94ef-185033540252 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:22.428781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1ed7d55c-b1f6-4545-94ef-185033540252 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:22.507875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1ed7d55c-b1f6-4545-94ef-185033540252 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:22.515392 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1ed7d55c-b1f6-4545-94ef-185033540252 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e" status: 200 len: 1242 microversion: 2.1 time: 0.099964 Jul 20 04:55:22.518526 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3399/6560] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:22 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:23.540356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dd19b984-22ae-464d-8f2c-c5dd8b6d6029 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:23.542541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dd19b984-22ae-464d-8f2c-c5dd8b6d6029 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:23.558698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd19b984-22ae-464d-8f2c-c5dd8b6d6029 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:23.559535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd19b984-22ae-464d-8f2c-c5dd8b6d6029 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:23.560920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd19b984-22ae-464d-8f2c-c5dd8b6d6029 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:23.561693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd19b984-22ae-464d-8f2c-c5dd8b6d6029 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:23.659427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dd19b984-22ae-464d-8f2c-c5dd8b6d6029 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:23.669467 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dd19b984-22ae-464d-8f2c-c5dd8b6d6029 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e" status: 200 len: 1300 microversion: 2.1 time: 0.138795 Jul 20 04:55:23.670217 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3162/6561] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:23 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e => generated 1300 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:24.686907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ff6c1f2e-e3e8-4d64-b078-b0bcdce18bae tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:24.687547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ff6c1f2e-e3e8-4d64-b078-b0bcdce18bae tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:24.697702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff6c1f2e-e3e8-4d64-b078-b0bcdce18bae tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:24.698163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff6c1f2e-e3e8-4d64-b078-b0bcdce18bae tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:24.698930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff6c1f2e-e3e8-4d64-b078-b0bcdce18bae tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:24.702085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff6c1f2e-e3e8-4d64-b078-b0bcdce18bae tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:24.931341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ff6c1f2e-e3e8-4d64-b078-b0bcdce18bae tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:24.957131 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ff6c1f2e-e3e8-4d64-b078-b0bcdce18bae tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e" status: 200 len: 1367 microversion: 2.1 time: 0.273656 Jul 20 04:55:24.958285 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3400/6562] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:24 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:25.074915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-51ae0c9f-bbaa-4be4-8040-0e70e31fa7e4 req-df5b462a-e225-498c-adc0-069a3b8535c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bfbcf8d-ba71-4312-920d-2b23e634d74e", "tag": "45a463d1-ac49-426f-ba52-9e21a6774a7b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:25.087771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-51ae0c9f-bbaa-4be4-8040-0e70e31fa7e4 req-df5b462a-e225-498c-adc0-069a3b8535c3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:25.090890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-51ae0c9f-bbaa-4be4-8040-0e70e31fa7e4 req-df5b462a-e225-498c-adc0-069a3b8535c3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:25.117588 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-51ae0c9f-bbaa-4be4-8040-0e70e31fa7e4 req-df5b462a-e225-498c-adc0-069a3b8535c3 service nova] Creating event network-changed:45a463d1-ac49-426f-ba52-9e21a6774a7b for instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e on n-h2-826526-5 Jul 20 04:55:25.126938 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-51ae0c9f-bbaa-4be4-8040-0e70e31fa7e4 req-df5b462a-e225-498c-adc0-069a3b8535c3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061071 Jul 20 04:55:25.128529 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3163/6563] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:25.983742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-efcfe60c-ca6a-4933-983f-4b93d5774483 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:25.984374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-efcfe60c-ca6a-4933-983f-4b93d5774483 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:25.993438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-efcfe60c-ca6a-4933-983f-4b93d5774483 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:25.993882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-efcfe60c-ca6a-4933-983f-4b93d5774483 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:25.994713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-efcfe60c-ca6a-4933-983f-4b93d5774483 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:25.995183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-efcfe60c-ca6a-4933-983f-4b93d5774483 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:26.140839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-efcfe60c-ca6a-4933-983f-4b93d5774483 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:26.149411 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-efcfe60c-ca6a-4933-983f-4b93d5774483 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e" status: 200 len: 1367 microversion: 2.1 time: 0.169615 Jul 20 04:55:26.150024 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3401/6564] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:25 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:27.168558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7adf86fd-9cb7-4dfd-810e-adb15c596dc4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:27.169467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7adf86fd-9cb7-4dfd-810e-adb15c596dc4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:27.178061 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7adf86fd-9cb7-4dfd-810e-adb15c596dc4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:27.178860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7adf86fd-9cb7-4dfd-810e-adb15c596dc4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:27.179805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7adf86fd-9cb7-4dfd-810e-adb15c596dc4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:27.180375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7adf86fd-9cb7-4dfd-810e-adb15c596dc4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:27.322561 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7adf86fd-9cb7-4dfd-810e-adb15c596dc4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:27.330508 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7adf86fd-9cb7-4dfd-810e-adb15c596dc4 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e" status: 200 len: 1367 microversion: 2.1 time: 0.166730 Jul 20 04:55:27.331154 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3164/6565] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:27 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:28.348196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e732bdb5-7712-47b4-b7d4-652a78f43aff tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:28.348938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e732bdb5-7712-47b4-b7d4-652a78f43aff tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:28.356974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e732bdb5-7712-47b4-b7d4-652a78f43aff tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:28.357440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e732bdb5-7712-47b4-b7d4-652a78f43aff tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:28.358308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e732bdb5-7712-47b4-b7d4-652a78f43aff tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:28.358820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e732bdb5-7712-47b4-b7d4-652a78f43aff tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:28.501588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e732bdb5-7712-47b4-b7d4-652a78f43aff tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:28.509815 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e732bdb5-7712-47b4-b7d4-652a78f43aff tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e" status: 200 len: 1367 microversion: 2.1 time: 0.166174 Jul 20 04:55:28.510441 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3402/6566] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:28 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:29.529885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6c289594-ecd4-492f-b746-0849fd1c5508 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:29.530660 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6c289594-ecd4-492f-b746-0849fd1c5508 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:29.538565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c289594-ecd4-492f-b746-0849fd1c5508 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:29.539193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c289594-ecd4-492f-b746-0849fd1c5508 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:29.539970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c289594-ecd4-492f-b746-0849fd1c5508 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:29.540527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c289594-ecd4-492f-b746-0849fd1c5508 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:29.572444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-187a3e05-7dfb-4436-9f35-2e2255d1fc12 req-e32d085d-8803-44ee-96e2-444268f3278c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfbcf8d-ba71-4312-920d-2b23e634d74e", "name": "network-vif-plugged", "status": "completed", "tag": "45a463d1-ac49-426f-ba52-9e21a6774a7b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:29.587878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-187a3e05-7dfb-4436-9f35-2e2255d1fc12 req-e32d085d-8803-44ee-96e2-444268f3278c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:29.588575 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-187a3e05-7dfb-4436-9f35-2e2255d1fc12 req-e32d085d-8803-44ee-96e2-444268f3278c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:29.600798 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-187a3e05-7dfb-4436-9f35-2e2255d1fc12 req-e32d085d-8803-44ee-96e2-444268f3278c service nova] Creating event network-vif-plugged:45a463d1-ac49-426f-ba52-9e21a6774a7b for instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e on n-h2-826526-5 Jul 20 04:55:29.606339 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-187a3e05-7dfb-4436-9f35-2e2255d1fc12 req-e32d085d-8803-44ee-96e2-444268f3278c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037598 Jul 20 04:55:29.607462 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3403/6567] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:29.743326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6c289594-ecd4-492f-b746-0849fd1c5508 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:29.751871 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6c289594-ecd4-492f-b746-0849fd1c5508 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e" status: 200 len: 1367 microversion: 2.1 time: 0.227018 Jul 20 04:55:29.752502 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3165/6568] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:29 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:30.771003 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f55e3a9f-b02c-46d0-a17d-5cbd576f8a1e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:30.771657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f55e3a9f-b02c-46d0-a17d-5cbd576f8a1e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:30.787747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f55e3a9f-b02c-46d0-a17d-5cbd576f8a1e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:30.788519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f55e3a9f-b02c-46d0-a17d-5cbd576f8a1e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:30.789298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f55e3a9f-b02c-46d0-a17d-5cbd576f8a1e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:30.789727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f55e3a9f-b02c-46d0-a17d-5cbd576f8a1e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:30.931655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f55e3a9f-b02c-46d0-a17d-5cbd576f8a1e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:30.939526 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f55e3a9f-b02c-46d0-a17d-5cbd576f8a1e tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e" status: 200 len: 1557 microversion: 2.1 time: 0.173938 Jul 20 04:55:30.940435 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3404/6569] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:30 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:30.956073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4896c950-042f-4e12-97e4-5fa1bfca9ea8 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:30.956624 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4896c950-042f-4e12-97e4-5fa1bfca9ea8 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:30.963748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4896c950-042f-4e12-97e4-5fa1bfca9ea8 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:30.964239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4896c950-042f-4e12-97e4-5fa1bfca9ea8 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:30.965039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4896c950-042f-4e12-97e4-5fa1bfca9ea8 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:30.965492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4896c950-042f-4e12-97e4-5fa1bfca9ea8 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:31.048459 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4896c950-042f-4e12-97e4-5fa1bfca9ea8 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096112 Jul 20 04:55:31.049119 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3166/6570] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 04:55:30 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:32.037950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-c3dee098-a781-459e-9b99-04ec8657d40e req-f3717713-9bf2-4d7a-8e3c-59d4544241b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bfbcf8d-ba71-4312-920d-2b23e634d74e", "tag": "45a463d1-ac49-426f-ba52-9e21a6774a7b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:32.047293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c3dee098-a781-459e-9b99-04ec8657d40e req-f3717713-9bf2-4d7a-8e3c-59d4544241b0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:32.047812 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c3dee098-a781-459e-9b99-04ec8657d40e req-f3717713-9bf2-4d7a-8e3c-59d4544241b0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:32.060726 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-c3dee098-a781-459e-9b99-04ec8657d40e req-f3717713-9bf2-4d7a-8e3c-59d4544241b0 service nova] Creating event network-changed:45a463d1-ac49-426f-ba52-9e21a6774a7b for instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e on n-h2-826526-5 Jul 20 04:55:32.067826 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-c3dee098-a781-459e-9b99-04ec8657d40e req-f3717713-9bf2-4d7a-8e3c-59d4544241b0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033714 Jul 20 04:55:32.072442 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3405/6571] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:07.294107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-537edddc-00e0-42e7-8f50-942228e3b383 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:07.294776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-537edddc-00e0-42e7-8f50-942228e3b383 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:07.297917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:07.298733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:07.299477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:07.300137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:07.307832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-537edddc-00e0-42e7-8f50-942228e3b383 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:07.308318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-537edddc-00e0-42e7-8f50-942228e3b383 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:07.309115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-537edddc-00e0-42e7-8f50-942228e3b383 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:07.309572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-537edddc-00e0-42e7-8f50-942228e3b383 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:07.336017 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-537edddc-00e0-42e7-8f50-942228e3b383 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/ips" status: 200 len: 150 microversion: 2.1 time: 0.046329 Jul 20 04:56:07.336658 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3167/6572] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 04:56:07 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:08.671691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:08.674496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:08.675195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:08.682351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4dd461e8-019f-4138-b7ec-5dc787a08fc2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20d6ecef-da86-49d2-8fef-313c29a5053f"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:08.683758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4dd461e8-019f-4138-b7ec-5dc787a08fc2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:08.693423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4dd461e8-019f-4138-b7ec-5dc787a08fc2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:08.693892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4dd461e8-019f-4138-b7ec-5dc787a08fc2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:08.694651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4dd461e8-019f-4138-b7ec-5dc787a08fc2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:08.695094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4dd461e8-019f-4138-b7ec-5dc787a08fc2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:09.003533 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4dd461e8-019f-4138-b7ec-5dc787a08fc2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "POST /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332479 Jul 20 04:56:09.004629 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3406/6573] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 04:56:08 2022] POST /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:19.877284 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-877540c1-a05f-438a-8b72-c98fe77afdc2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:19.878466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-877540c1-a05f-438a-8b72-c98fe77afdc2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:19.885395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:19.886647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:19.888355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-877540c1-a05f-438a-8b72-c98fe77afdc2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:19.889014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-877540c1-a05f-438a-8b72-c98fe77afdc2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:19.890002 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-877540c1-a05f-438a-8b72-c98fe77afdc2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:19.890644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-877540c1-a05f-438a-8b72-c98fe77afdc2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:19.987201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-877540c1-a05f-438a-8b72-c98fe77afdc2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lazy-loading 'services' on Instance uuid 6bfbcf8d-ba71-4312-920d-2b23e634d74e {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:56:20.069555 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-877540c1-a05f-438a-8b72-c98fe77afdc2 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-volume_attachments/20d6ecef-da86-49d2-8fef-313c29a5053f" status: 202 len: 0 microversion: 2.1 time: 0.195693 Jul 20 04:56:20.070185 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3168/6574] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 04:56:19 2022] DELETE /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-volume_attachments/20d6ecef-da86-49d2-8fef-313c29a5053f => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:56:20.077579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:20.078924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:20.084303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d9080d60-c293-477a-99cc-43f06f85f210 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:20.085562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d9080d60-c293-477a-99cc-43f06f85f210 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:20.094968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d9080d60-c293-477a-99cc-43f06f85f210 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:20.095807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d9080d60-c293-477a-99cc-43f06f85f210 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:20.096748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d9080d60-c293-477a-99cc-43f06f85f210 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:20.097287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d9080d60-c293-477a-99cc-43f06f85f210 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:20.130368 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d9080d60-c293-477a-99cc-43f06f85f210 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054870 Jul 20 04:56:20.131257 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3407/6575] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:56:20 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:21.143422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cbdb2687-62b0-4974-8aba-b0023965c744 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:21.144366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cbdb2687-62b0-4974-8aba-b0023965c744 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:21.151915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cbdb2687-62b0-4974-8aba-b0023965c744 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:21.152412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cbdb2687-62b0-4974-8aba-b0023965c744 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:21.153197 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cbdb2687-62b0-4974-8aba-b0023965c744 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:21.153646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cbdb2687-62b0-4974-8aba-b0023965c744 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:21.185559 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cbdb2687-62b0-4974-8aba-b0023965c744 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046705 Jul 20 04:56:21.186140 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3169/6576] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:56:21 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:22.197731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2e8a21db-2cca-4210-a301-9cb09fe39d12 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:22.198683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2e8a21db-2cca-4210-a301-9cb09fe39d12 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:22.206648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e8a21db-2cca-4210-a301-9cb09fe39d12 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:22.207495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e8a21db-2cca-4210-a301-9cb09fe39d12 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:22.208536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e8a21db-2cca-4210-a301-9cb09fe39d12 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:22.209101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e8a21db-2cca-4210-a301-9cb09fe39d12 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:22.246674 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2e8a21db-2cca-4210-a301-9cb09fe39d12 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053034 Jul 20 04:56:22.247255 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3408/6577] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:56:22 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:22.393705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dbcc5799-2416-476f-835f-bbbaa43f8ab5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Action: 'create', calling method: .version_select at 0x7f06bddcb4c0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1857990520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAI8gYkg354hi6MWDAjIMotveYW1NAiyqdJ/Bj7sWpoloe635N51ZjvfxOdqRbCLZebIvc0OYOdKMpMNQ5TDNYPXGvVkT6iwJYYr8hYMtV4+02+k3gaxofn7tWH0jzyi6g=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:22.412126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-dbcc5799-2416-476f-835f-bbbaa43f8ab5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Getting quotas for project 67277dd25ee74830a1b2235ad5b9bb7d. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:56:22.418647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-dbcc5799-2416-476f-835f-bbbaa43f8ab5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Getting quotas for user bbea4ac4f0a049cca80558ea79d86285 and project 67277dd25ee74830a1b2235ad5b9bb7d. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:56:22.447589 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dbcc5799-2416-476f-835f-bbbaa43f8ab5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.058365 Jul 20 04:56:22.448243 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3170/6578] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 04:56:22 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:23.260785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cec79e97-8e76-413c-998a-906330fd7627 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:23.262607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cec79e97-8e76-413c-998a-906330fd7627 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:23.270650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cec79e97-8e76-413c-998a-906330fd7627 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:23.271105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cec79e97-8e76-413c-998a-906330fd7627 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:23.271891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cec79e97-8e76-413c-998a-906330fd7627 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:23.272413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cec79e97-8e76-413c-998a-906330fd7627 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:23.305700 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cec79e97-8e76-413c-998a-906330fd7627 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049660 Jul 20 04:56:23.306310 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3409/6579] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:56:23 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:23.537795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8bc8374f-7381-4e6e-8f08-9c1ca4e5a1bc tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-2091800452", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a4d56f85-acb7-4132-8584-84f84a391b90", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1857990520", "security_groups": [{"name": "tempest-secgroup-smoke-494798121"}], "networks": [{"uuid": "7000205c-de2f-460b-8774-d4f74da7311b"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:23.658143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-8bc8374f-7381-4e6e-8f08-9c1ca4e5a1bc tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] validate_networks() for [('7000205c-de2f-460b-8774-d4f74da7311b', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:56:24.052621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8bc8374f-7381-4e6e-8f08-9c1ca4e5a1bc tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:56:24.053135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8bc8374f-7381-4e6e-8f08-9c1ca4e5a1bc tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:56:24.053696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8bc8374f-7381-4e6e-8f08-9c1ca4e5a1bc tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:56:24.054187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8bc8374f-7381-4e6e-8f08-9c1ca4e5a1bc tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:56:24.054706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8bc8374f-7381-4e6e-8f08-9c1ca4e5a1bc tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:56:24.065152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8bc8374f-7381-4e6e-8f08-9c1ca4e5a1bc tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:24.066163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8bc8374f-7381-4e6e-8f08-9c1ca4e5a1bc tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:24.067168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8bc8374f-7381-4e6e-8f08-9c1ca4e5a1bc tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:24.067704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8bc8374f-7381-4e6e-8f08-9c1ca4e5a1bc tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:24.086299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8bc8374f-7381-4e6e-8f08-9c1ca4e5a1bc tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Getting quotas for project 67277dd25ee74830a1b2235ad5b9bb7d. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:56:24.092302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8bc8374f-7381-4e6e-8f08-9c1ca4e5a1bc tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Getting quotas for user bbea4ac4f0a049cca80558ea79d86285 and project 67277dd25ee74830a1b2235ad5b9bb7d. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:56:24.154959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8bc8374f-7381-4e6e-8f08-9c1ca4e5a1bc tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:56:24.157528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8bc8374f-7381-4e6e-8f08-9c1ca4e5a1bc tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a4d56f85-acb7-4132-8584-84f84a391b90',volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:56:24.298266 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8bc8374f-7381-4e6e-8f08-9c1ca4e5a1bc tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.764273 Jul 20 04:56:24.299031 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3171/6580] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:56:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:56:24.309367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0f3934d1-0ba3-4ad4-954b-175e82b8f1d6 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:24.309997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0f3934d1-0ba3-4ad4-954b-175e82b8f1d6 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:24.319166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5eb74301-707c-4fb0-bf60-d7ad809da63f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:24.320657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5eb74301-707c-4fb0-bf60-d7ad809da63f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:24.329528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5eb74301-707c-4fb0-bf60-d7ad809da63f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:24.329528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5eb74301-707c-4fb0-bf60-d7ad809da63f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:24.330897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5eb74301-707c-4fb0-bf60-d7ad809da63f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:24.331486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5eb74301-707c-4fb0-bf60-d7ad809da63f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:24.365894 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5eb74301-707c-4fb0-bf60-d7ad809da63f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052355 Jul 20 04:56:24.367094 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3172/6581] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:56:24 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:56:24.385051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0f3934d1-0ba3-4ad4-954b-175e82b8f1d6 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:24.392775 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0f3934d1-0ba3-4ad4-954b-175e82b8f1d6 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1099 microversion: 2.1 time: 0.087378 Jul 20 04:56:24.393576 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3410/6582] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:24 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1099 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:25.377830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0b038517-fe06-421e-8307-7fdcfa05ac77 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:25.378798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0b038517-fe06-421e-8307-7fdcfa05ac77 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:25.386832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b038517-fe06-421e-8307-7fdcfa05ac77 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:25.387524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b038517-fe06-421e-8307-7fdcfa05ac77 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:25.388513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b038517-fe06-421e-8307-7fdcfa05ac77 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:25.389111 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b038517-fe06-421e-8307-7fdcfa05ac77 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:25.410874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2e5874b6-d592-4dbb-ad65-54dcc978796b tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:25.412029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2e5874b6-d592-4dbb-ad65-54dcc978796b tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:25.420831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e5874b6-d592-4dbb-ad65-54dcc978796b tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:25.421500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e5874b6-d592-4dbb-ad65-54dcc978796b tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:25.422456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e5874b6-d592-4dbb-ad65-54dcc978796b tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:25.423120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e5874b6-d592-4dbb-ad65-54dcc978796b tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:25.439939 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0b038517-fe06-421e-8307-7fdcfa05ac77 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066084 Jul 20 04:56:25.440912 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3173/6583] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:56:25 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:25.504158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2e5874b6-d592-4dbb-ad65-54dcc978796b tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:25.513446 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2e5874b6-d592-4dbb-ad65-54dcc978796b tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1215 microversion: 2.1 time: 0.107451 Jul 20 04:56:25.514030 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3411/6584] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:25 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:56:26.451828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b0228efe-170e-48f0-9087-e8c44d307c08 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:26.452830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b0228efe-170e-48f0-9087-e8c44d307c08 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:26.460304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0228efe-170e-48f0-9087-e8c44d307c08 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:26.461017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0228efe-170e-48f0-9087-e8c44d307c08 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:26.461819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0228efe-170e-48f0-9087-e8c44d307c08 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:26.462429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0228efe-170e-48f0-9087-e8c44d307c08 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:26.494099 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b0228efe-170e-48f0-9087-e8c44d307c08 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046260 Jul 20 04:56:26.499639 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3174/6585] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 04:56:26 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:56:26.532042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dbef999d-f0bc-473c-ba9c-5c8139d3bf0d tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:26.534178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dbef999d-f0bc-473c-ba9c-5c8139d3bf0d tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:26.549392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbef999d-f0bc-473c-ba9c-5c8139d3bf0d tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:26.550273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbef999d-f0bc-473c-ba9c-5c8139d3bf0d tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:26.551872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbef999d-f0bc-473c-ba9c-5c8139d3bf0d tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:26.552581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbef999d-f0bc-473c-ba9c-5c8139d3bf0d tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:26.559688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d106b583-a915-41de-8387-5128f5e12130 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:26.560209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d106b583-a915-41de-8387-5128f5e12130 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:26.569533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d106b583-a915-41de-8387-5128f5e12130 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:26.570085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d106b583-a915-41de-8387-5128f5e12130 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:26.570933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d106b583-a915-41de-8387-5128f5e12130 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:26.571430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d106b583-a915-41de-8387-5128f5e12130 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:26.606311 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d106b583-a915-41de-8387-5128f5e12130 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:56:26.753297 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d106b583-a915-41de-8387-5128f5e12130 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e" status: 204 len: 0 microversion: 2.1 time: 0.197206 Jul 20 04:56:26.759699 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3175/6586] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:56:26 2022] DELETE /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:56:26.768554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a7b1f965-d86c-437f-a9be-2ba61fd4f8e6 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:26.769582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a7b1f965-d86c-437f-a9be-2ba61fd4f8e6 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:26.779697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7b1f965-d86c-437f-a9be-2ba61fd4f8e6 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:26.780494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7b1f965-d86c-437f-a9be-2ba61fd4f8e6 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:26.781957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7b1f965-d86c-437f-a9be-2ba61fd4f8e6 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:26.782857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7b1f965-d86c-437f-a9be-2ba61fd4f8e6 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:26.785665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dbef999d-f0bc-473c-ba9c-5c8139d3bf0d tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:26.797244 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dbef999d-f0bc-473c-ba9c-5c8139d3bf0d tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1282 microversion: 2.1 time: 0.270311 Jul 20 04:56:26.800314 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3412/6587] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:26 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1282 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:27.323979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a7b1f965-d86c-437f-a9be-2ba61fd4f8e6 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:27.333287 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a7b1f965-d86c-437f-a9be-2ba61fd4f8e6 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e" status: 200 len: 1682 microversion: 2.1 time: 0.571429 Jul 20 04:56:27.334326 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3176/6588] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:26 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e => generated 1682 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:27.383174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-17739623-8d2d-4d88-819e-e01fd5827588 req-403ac267-0343-4115-9cb8-1a9b6fb46daa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8bd6e6-7aa4-4c97-ab59-4b6929938375", "tag": "f25beca5-1668-446b-8590-754b85684392"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:27.401528 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-17739623-8d2d-4d88-819e-e01fd5827588 req-403ac267-0343-4115-9cb8-1a9b6fb46daa service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:27.401964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-17739623-8d2d-4d88-819e-e01fd5827588 req-403ac267-0343-4115-9cb8-1a9b6fb46daa service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:27.418722 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-17739623-8d2d-4d88-819e-e01fd5827588 req-403ac267-0343-4115-9cb8-1a9b6fb46daa service nova] Creating event network-changed:f25beca5-1668-446b-8590-754b85684392 for instance aa8bd6e6-7aa4-4c97-ab59-4b6929938375 on n-h1-826526-5 Jul 20 04:56:27.424934 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-17739623-8d2d-4d88-819e-e01fd5827588 req-403ac267-0343-4115-9cb8-1a9b6fb46daa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046290 Jul 20 04:56:27.426178 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3413/6589] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:27.814716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-06ccdb5b-303c-4c87-8464-f9adae966bb5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:27.815634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-06ccdb5b-303c-4c87-8464-f9adae966bb5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:27.823725 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06ccdb5b-303c-4c87-8464-f9adae966bb5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:27.824481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06ccdb5b-303c-4c87-8464-f9adae966bb5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:27.825376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06ccdb5b-303c-4c87-8464-f9adae966bb5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:27.825920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-06ccdb5b-303c-4c87-8464-f9adae966bb5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:28.059097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-06ccdb5b-303c-4c87-8464-f9adae966bb5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:28.070238 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-06ccdb5b-303c-4c87-8464-f9adae966bb5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1282 microversion: 2.1 time: 0.259511 Jul 20 04:56:28.070823 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3177/6590] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:27 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1282 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:28.352517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-de9072c8-04a1-45c6-9146-cf72c8fa11fc tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:28.354037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-de9072c8-04a1-45c6-9146-cf72c8fa11fc tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:28.361953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de9072c8-04a1-45c6-9146-cf72c8fa11fc tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:28.362676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de9072c8-04a1-45c6-9146-cf72c8fa11fc tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:28.363616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de9072c8-04a1-45c6-9146-cf72c8fa11fc tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:28.364207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-de9072c8-04a1-45c6-9146-cf72c8fa11fc tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:28.583370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-de9072c8-04a1-45c6-9146-cf72c8fa11fc tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:28.591662 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-de9072c8-04a1-45c6-9146-cf72c8fa11fc tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e" status: 200 len: 1682 microversion: 2.1 time: 0.243374 Jul 20 04:56:28.592675 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3414/6591] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:28 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e => generated 1682 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:29.091168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d84688ca-6af4-4beb-81eb-b270c11cb9db tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:29.092466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d84688ca-6af4-4beb-81eb-b270c11cb9db tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:29.104477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d84688ca-6af4-4beb-81eb-b270c11cb9db tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:29.105441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d84688ca-6af4-4beb-81eb-b270c11cb9db tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:29.106996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d84688ca-6af4-4beb-81eb-b270c11cb9db tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:29.107752 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d84688ca-6af4-4beb-81eb-b270c11cb9db tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:29.224161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-be0e7a9e-550b-4383-9a95-50fd9b490fff req-bce1a25e-bcc7-4b19-b66b-00feea8aff84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfbcf8d-ba71-4312-920d-2b23e634d74e", "name": "network-vif-deleted", "tag": "45a463d1-ac49-426f-ba52-9e21a6774a7b"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:29.266813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-be0e7a9e-550b-4383-9a95-50fd9b490fff req-bce1a25e-bcc7-4b19-b66b-00feea8aff84 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:29.267944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-be0e7a9e-550b-4383-9a95-50fd9b490fff req-bce1a25e-bcc7-4b19-b66b-00feea8aff84 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:29.301097 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-be0e7a9e-550b-4383-9a95-50fd9b490fff req-bce1a25e-bcc7-4b19-b66b-00feea8aff84 service nova] Creating event network-vif-deleted:45a463d1-ac49-426f-ba52-9e21a6774a7b for instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e on n-h2-826526-5 Jul 20 04:56:29.328683 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-be0e7a9e-550b-4383-9a95-50fd9b490fff req-bce1a25e-bcc7-4b19-b66b-00feea8aff84 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111583 Jul 20 04:56:29.337552 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3415/6592] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:29.439045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d84688ca-6af4-4beb-81eb-b270c11cb9db tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:29.447746 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d84688ca-6af4-4beb-81eb-b270c11cb9db tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1282 microversion: 2.1 time: 0.364232 Jul 20 04:56:29.448142 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3178/6593] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:29 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1282 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:29.610418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-96e3a117-567c-4d8f-a44a-429dd27fe26a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:29.612002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-96e3a117-567c-4d8f-a44a-429dd27fe26a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:29.620538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96e3a117-567c-4d8f-a44a-429dd27fe26a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:29.621323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96e3a117-567c-4d8f-a44a-429dd27fe26a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:29.622327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96e3a117-567c-4d8f-a44a-429dd27fe26a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:29.622964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96e3a117-567c-4d8f-a44a-429dd27fe26a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:29.668461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96e3a117-567c-4d8f-a44a-429dd27fe26a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:29.669159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-96e3a117-567c-4d8f-a44a-429dd27fe26a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:29.669642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-96e3a117-567c-4d8f-a44a-429dd27fe26a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lazy-loading 'fault' on Instance uuid 6bfbcf8d-ba71-4312-920d-2b23e634d74e {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:56:29.716599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-96e3a117-567c-4d8f-a44a-429dd27fe26a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a241f748f0ef4775b46e4fcd113174e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90f217b019840929bacafcacbbd1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:29.727209 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-96e3a117-567c-4d8f-a44a-429dd27fe26a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e" status: 200 len: 1332 microversion: 2.1 time: 0.121655 Jul 20 04:56:29.728985 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3416/6594] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:29 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e => generated 1332 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:30.464964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a0496501-f0e4-4ece-9670-102014a285e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:30.466478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a0496501-f0e4-4ece-9670-102014a285e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:30.474463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0496501-f0e4-4ece-9670-102014a285e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:30.474921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0496501-f0e4-4ece-9670-102014a285e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:30.476587 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0496501-f0e4-4ece-9670-102014a285e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:30.477044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0496501-f0e4-4ece-9670-102014a285e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:30.640915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a0496501-f0e4-4ece-9670-102014a285e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:30.649240 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a0496501-f0e4-4ece-9670-102014a285e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1282 microversion: 2.1 time: 0.188274 Jul 20 04:56:30.650170 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3179/6595] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:30 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:30.747216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8d58f95a-147f-499c-91d1-d78e0ab3ed8f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:30.747878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8d58f95a-147f-499c-91d1-d78e0ab3ed8f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:30.757272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d58f95a-147f-499c-91d1-d78e0ab3ed8f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:30.757645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d58f95a-147f-499c-91d1-d78e0ab3ed8f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:30.758422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d58f95a-147f-499c-91d1-d78e0ab3ed8f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:30.758858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d58f95a-147f-499c-91d1-d78e0ab3ed8f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:30.774500 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-8d58f95a-147f-499c-91d1-d78e0ab3ed8f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] HTTP exception thrown: Instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e could not be found. Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8d58f95a-147f-499c-91d1-d78e0ab3ed8f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Request method failure captured: Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e HTTP/1.1 Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14nXZ97dPvJ1vYjndXy08u0I-QfwsZLjzwhTwPLlHMlDVbR0IZdTAqSZqYran5Cvn4wC7UUKrlJHR7Rd5sBdXlrakajTzWxMCZYT9KggIWGgJVLkrs7-SbyDEPoD28498TR330QVEV33AslM-uldVFYVsaXG-pQNZ1Cq9xOqgPIH54M Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d90f217b019840929bacafcacbbd1a3d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}] Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a241f748f0ef4775b46e4fcd113174e5 Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e could not be found. Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '6bfbcf8d-ba71-4312-920d-2b23e634d74e'} Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e could not be found. Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e could not be found. Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:30.776343 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:30.782745 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:30.782745 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:30.782745 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:30.782745 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:30.782745 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:30.782745 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e could not be found. Jul 20 04:56:30.782745 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:30.782745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8d58f95a-147f-499c-91d1-d78e0ab3ed8f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Returning 404 to user: Instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:30.782745 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8d58f95a-147f-499c-91d1-d78e0ab3ed8f tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e" status: 404 len: 111 microversion: 2.1 time: 0.035414 Jul 20 04:56:30.782745 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3417/6596] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:30 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:30.787955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-99b8e82c-ace9-4620-9a83-890350d930f3 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '.version_select at 0x7f06bd4cf4c0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:30.807769 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-99b8e82c-ace9-4620-9a83-890350d930f3 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1942246623" status: 202 len: 0 microversion: 2.1 time: 0.023931 Jul 20 04:56:30.808330 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3180/6597] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jul 20 04:56:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1942246623 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:56:31.667057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-db245af3-e63b-404a-8b71-d769b26667ce tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:31.667706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-db245af3-e63b-404a-8b71-d769b26667ce tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:31.674728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db245af3-e63b-404a-8b71-d769b26667ce tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:31.675262 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db245af3-e63b-404a-8b71-d769b26667ce tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:31.676157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db245af3-e63b-404a-8b71-d769b26667ce tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:31.676631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-db245af3-e63b-404a-8b71-d769b26667ce tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:31.821247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-db245af3-e63b-404a-8b71-d769b26667ce tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:31.829734 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-db245af3-e63b-404a-8b71-d769b26667ce tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1270 microversion: 2.1 time: 0.167012 Jul 20 04:56:31.839240 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3418/6598] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:31 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:32.850688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e5ba6950-8169-46fb-838f-f8d54fa8ea55 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:32.850688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e5ba6950-8169-46fb-838f-f8d54fa8ea55 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:32.859275 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5ba6950-8169-46fb-838f-f8d54fa8ea55 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:32.859745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5ba6950-8169-46fb-838f-f8d54fa8ea55 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:32.860671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5ba6950-8169-46fb-838f-f8d54fa8ea55 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:32.861192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5ba6950-8169-46fb-838f-f8d54fa8ea55 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:33.013646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e5ba6950-8169-46fb-838f-f8d54fa8ea55 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:33.022496 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e5ba6950-8169-46fb-838f-f8d54fa8ea55 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1270 microversion: 2.1 time: 0.179151 Jul 20 04:56:33.023094 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3181/6599] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:32 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:34.040117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d8e2207-f7b6-427c-957a-e487314ae3e1 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:34.040714 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4d8e2207-f7b6-427c-957a-e487314ae3e1 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:34.048233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d8e2207-f7b6-427c-957a-e487314ae3e1 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:34.048716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d8e2207-f7b6-427c-957a-e487314ae3e1 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:34.049481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d8e2207-f7b6-427c-957a-e487314ae3e1 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:34.049916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d8e2207-f7b6-427c-957a-e487314ae3e1 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:34.194091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4d8e2207-f7b6-427c-957a-e487314ae3e1 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:34.202317 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4d8e2207-f7b6-427c-957a-e487314ae3e1 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1270 microversion: 2.1 time: 0.166205 Jul 20 04:56:34.202930 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3419/6600] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:34 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:34.739860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cfca2b23-e407-4336-a3fc-71c25b154301 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:34.740413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cfca2b23-e407-4336-a3fc-71c25b154301 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:34.743229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:34.744028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=10 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:34.749945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cfca2b23-e407-4336-a3fc-71c25b154301 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:34.750409 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cfca2b23-e407-4336-a3fc-71c25b154301 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:34.751341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cfca2b23-e407-4336-a3fc-71c25b154301 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:34.751791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cfca2b23-e407-4336-a3fc-71c25b154301 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:34.766443 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-cfca2b23-e407-4336-a3fc-71c25b154301 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] HTTP exception thrown: Instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e could not be found. Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cfca2b23-e407-4336-a3fc-71c25b154301 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Request method failure captured: Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e HTTP/1.1 Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14nXZ97dPvJ1vYjndXy08u0I-QfwsZLjzwhTwPLlHMlDVbR0IZdTAqSZqYran5Cvn4wC7UUKrlJHR7Rd5sBdXlrakajTzWxMCZYT9KggIWGgJVLkrs7-SbyDEPoD28498TR330QVEV33AslM-uldVFYVsaXG-pQNZ1Cq9xOqgPIH54M Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d90f217b019840929bacafcacbbd1a3d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}] Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a241f748f0ef4775b46e4fcd113174e5 Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e could not be found. Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '6bfbcf8d-ba71-4312-920d-2b23e634d74e'} Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e could not be found. Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:34.768190 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:34.772481 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e could not be found. Jul 20 04:56:34.772481 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:34.772481 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:34.772481 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:34.772481 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:34.772481 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:34.772481 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:34.772481 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:34.772481 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:34.772481 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e could not be found. Jul 20 04:56:34.772481 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:34.772481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cfca2b23-e407-4336-a3fc-71c25b154301 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Returning 404 to user: Instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:34.772481 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cfca2b23-e407-4336-a3fc-71c25b154301 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e" status: 404 len: 111 microversion: 2.1 time: 0.033862 Jul 20 04:56:34.772481 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3182/6601] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:56:34 2022] DELETE /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:34.778349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ef38228a-9005-41a4-958e-af8a1f419b92 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:34.778968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ef38228a-9005-41a4-958e-af8a1f419b92 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 6bfbcf8d-ba71-4312-920d-2b23e634d74e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:34.781012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:34.786509 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef38228a-9005-41a4-958e-af8a1f419b92 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:34.786952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef38228a-9005-41a4-958e-af8a1f419b92 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:34.787733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef38228a-9005-41a4-958e-af8a1f419b92 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:34.788170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef38228a-9005-41a4-958e-af8a1f419b92 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:34.802085 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-ef38228a-9005-41a4-958e-af8a1f419b92 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] HTTP exception thrown: Instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e could not be found. Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ef38228a-9005-41a4-958e-af8a1f419b92 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Request method failure captured: Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e HTTP/1.1 Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14nXZ97dPvJ1vYjndXy08u0I-QfwsZLjzwhTwPLlHMlDVbR0IZdTAqSZqYran5Cvn4wC7UUKrlJHR7Rd5sBdXlrakajTzWxMCZYT9KggIWGgJVLkrs7-SbyDEPoD28498TR330QVEV33AslM-uldVFYVsaXG-pQNZ1Cq9xOqgPIH54M Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d90f217b019840929bacafcacbbd1a3d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}] Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a241f748f0ef4775b46e4fcd113174e5 Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e could not be found. Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '6bfbcf8d-ba71-4312-920d-2b23e634d74e'} Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e could not be found. Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e could not be found. Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:34.803638 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:34.808132 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:34.808132 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:34.808132 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:34.808132 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:34.808132 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:34.808132 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e could not be found. Jul 20 04:56:34.808132 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:34.808132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ef38228a-9005-41a4-958e-af8a1f419b92 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Returning 404 to user: Instance 6bfbcf8d-ba71-4312-920d-2b23e634d74e could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:34.808132 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ef38228a-9005-41a4-958e-af8a1f419b92 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e" status: 404 len: 111 microversion: 2.1 time: 0.030617 Jul 20 04:56:34.808132 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3420/6602] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:34 2022] GET /compute/v2.1/servers/6bfbcf8d-ba71-4312-920d-2b23e634d74e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:35.219904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3b397afc-ebe1-471e-91e3-f9c54fa5c678 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:35.220494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3b397afc-ebe1-471e-91e3-f9c54fa5c678 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:35.227134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b397afc-ebe1-471e-91e3-f9c54fa5c678 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:35.227755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b397afc-ebe1-471e-91e3-f9c54fa5c678 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:35.228946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b397afc-ebe1-471e-91e3-f9c54fa5c678 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:35.229400 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3b397afc-ebe1-471e-91e3-f9c54fa5c678 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:35.384382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3b397afc-ebe1-471e-91e3-f9c54fa5c678 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:35.392160 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3b397afc-ebe1-471e-91e3-f9c54fa5c678 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1270 microversion: 2.1 time: 0.176680 Jul 20 04:56:35.392778 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3183/6603] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:35 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1270 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:36.409408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1ecaf771-6c8b-4115-a2da-de7a2e4a8d26 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:36.409976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1ecaf771-6c8b-4115-a2da-de7a2e4a8d26 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:36.417258 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ecaf771-6c8b-4115-a2da-de7a2e4a8d26 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:36.417712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ecaf771-6c8b-4115-a2da-de7a2e4a8d26 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:36.418486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ecaf771-6c8b-4115-a2da-de7a2e4a8d26 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:36.418922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1ecaf771-6c8b-4115-a2da-de7a2e4a8d26 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:36.563555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1ecaf771-6c8b-4115-a2da-de7a2e4a8d26 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:36.571455 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1ecaf771-6c8b-4115-a2da-de7a2e4a8d26 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1270 microversion: 2.1 time: 0.166275 Jul 20 04:56:36.572007 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3421/6604] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:36 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:37.590536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-44819387-9a85-464c-8342-7ee7724729dd tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:37.591289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-44819387-9a85-464c-8342-7ee7724729dd tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:37.598872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44819387-9a85-464c-8342-7ee7724729dd tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:37.599338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44819387-9a85-464c-8342-7ee7724729dd tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:37.600128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44819387-9a85-464c-8342-7ee7724729dd tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:37.600612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-44819387-9a85-464c-8342-7ee7724729dd tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:37.738132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-44819387-9a85-464c-8342-7ee7724729dd tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:37.745966 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-44819387-9a85-464c-8342-7ee7724729dd tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1270 microversion: 2.1 time: 0.159672 Jul 20 04:56:37.746580 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3184/6605] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:37 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:38.174732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d167f1b-82aa-429b-b695-9e0616a7ce16 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:38.175274 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4d167f1b-82aa-429b-b695-9e0616a7ce16 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:38.182301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d167f1b-82aa-429b-b695-9e0616a7ce16 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:38.182754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d167f1b-82aa-429b-b695-9e0616a7ce16 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:38.183510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d167f1b-82aa-429b-b695-9e0616a7ce16 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:38.183941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d167f1b-82aa-429b-b695-9e0616a7ce16 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:38.198435 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-4d167f1b-82aa-429b-b695-9e0616a7ce16 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] HTTP exception thrown: Instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 could not be found. Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d167f1b-82aa-429b-b695-9e0616a7ce16 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Request method failure captured: Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 HTTP/1.1 Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14nXZ97dPvJ1vYjndXy08u0I-QfwsZLjzwhTwPLlHMlDVbR0IZdTAqSZqYran5Cvn4wC7UUKrlJHR7Rd5sBdXlrakajTzWxMCZYT9KggIWGgJVLkrs7-SbyDEPoD28498TR330QVEV33AslM-uldVFYVsaXG-pQNZ1Cq9xOqgPIH54M Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d90f217b019840929bacafcacbbd1a3d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}] Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a241f748f0ef4775b46e4fcd113174e5 Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 could not be found. Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '2d8258e3-0404-41f7-87f5-aacc6034d9d0'} Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 could not be found. Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:38.200048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:38.204629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 could not be found. Jul 20 04:56:38.204629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.204629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:38.204629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.204629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:38.204629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:38.204629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:38.204629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:38.204629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:38.204629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 could not be found. Jul 20 04:56:38.204629 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.204629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d167f1b-82aa-429b-b695-9e0616a7ce16 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Returning 404 to user: Instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:38.204629 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4d167f1b-82aa-429b-b695-9e0616a7ce16 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0" status: 404 len: 111 microversion: 2.1 time: 0.031022 Jul 20 04:56:38.204629 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3422/6606] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:56:38 2022] DELETE /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:38.210880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9dc777c2-e20b-49ad-abad-f90a9933bd66 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:38.211514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9dc777c2-e20b-49ad-abad-f90a9933bd66 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 2d8258e3-0404-41f7-87f5-aacc6034d9d0] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:38.218446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9dc777c2-e20b-49ad-abad-f90a9933bd66 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:38.218948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9dc777c2-e20b-49ad-abad-f90a9933bd66 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:38.219877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9dc777c2-e20b-49ad-abad-f90a9933bd66 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:38.220459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9dc777c2-e20b-49ad-abad-f90a9933bd66 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:38.236684 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-9dc777c2-e20b-49ad-abad-f90a9933bd66 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] HTTP exception thrown: Instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 could not be found. Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9dc777c2-e20b-49ad-abad-f90a9933bd66 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Request method failure captured: Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 HTTP/1.1 Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14nXZ97dPvJ1vYjndXy08u0I-QfwsZLjzwhTwPLlHMlDVbR0IZdTAqSZqYran5Cvn4wC7UUKrlJHR7Rd5sBdXlrakajTzWxMCZYT9KggIWGgJVLkrs7-SbyDEPoD28498TR330QVEV33AslM-uldVFYVsaXG-pQNZ1Cq9xOqgPIH54M Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d90f217b019840929bacafcacbbd1a3d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}] Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a241f748f0ef4775b46e4fcd113174e5 Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 could not be found. Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '2d8258e3-0404-41f7-87f5-aacc6034d9d0'} Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 could not be found. Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 could not be found. Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:38.238320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.243294 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:38.243294 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:38.243294 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:38.243294 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:38.243294 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:38.243294 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 could not be found. Jul 20 04:56:38.243294 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.243294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9dc777c2-e20b-49ad-abad-f90a9933bd66 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Returning 404 to user: Instance 2d8258e3-0404-41f7-87f5-aacc6034d9d0 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:38.243294 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9dc777c2-e20b-49ad-abad-f90a9933bd66 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0" status: 404 len: 111 microversion: 2.1 time: 0.032975 Jul 20 04:56:38.243294 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3185/6607] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:38 2022] GET /compute/v2.1/servers/2d8258e3-0404-41f7-87f5-aacc6034d9d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:38.249577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ad546a09-8766-4015-9942-5ce4b59a654d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:38.250321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ad546a09-8766-4015-9942-5ce4b59a654d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:38.257022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad546a09-8766-4015-9942-5ce4b59a654d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:38.257447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad546a09-8766-4015-9942-5ce4b59a654d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:38.258219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad546a09-8766-4015-9942-5ce4b59a654d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:38.258650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad546a09-8766-4015-9942-5ce4b59a654d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:38.273593 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-ad546a09-8766-4015-9942-5ce4b59a654d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] HTTP exception thrown: Instance 81d97a97-540c-4203-a6b5-fb688194ca27 could not be found. Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ad546a09-8766-4015-9942-5ce4b59a654d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Request method failure captured: Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 HTTP/1.1 Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14nXZ97dPvJ1vYjndXy08u0I-QfwsZLjzwhTwPLlHMlDVbR0IZdTAqSZqYran5Cvn4wC7UUKrlJHR7Rd5sBdXlrakajTzWxMCZYT9KggIWGgJVLkrs7-SbyDEPoD28498TR330QVEV33AslM-uldVFYVsaXG-pQNZ1Cq9xOqgPIH54M Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d90f217b019840929bacafcacbbd1a3d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}] Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a241f748f0ef4775b46e4fcd113174e5 Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 81d97a97-540c-4203-a6b5-fb688194ca27 could not be found. Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '81d97a97-540c-4203-a6b5-fb688194ca27'} Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81d97a97-540c-4203-a6b5-fb688194ca27 could not be found. Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:38.275155 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:38.282978 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81d97a97-540c-4203-a6b5-fb688194ca27 could not be found. Jul 20 04:56:38.282978 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.282978 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:38.282978 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.282978 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:38.282978 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:38.282978 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:38.282978 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:38.282978 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:38.282978 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81d97a97-540c-4203-a6b5-fb688194ca27 could not be found. Jul 20 04:56:38.282978 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.282978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ad546a09-8766-4015-9942-5ce4b59a654d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Returning 404 to user: Instance 81d97a97-540c-4203-a6b5-fb688194ca27 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:38.282978 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ad546a09-8766-4015-9942-5ce4b59a654d tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "DELETE /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27" status: 404 len: 111 microversion: 2.1 time: 0.031072 Jul 20 04:56:38.282978 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3423/6608] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:56:38 2022] DELETE /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:38.285317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d8815a90-574d-45bb-bae7-0bdd3e3a42c1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:38.285966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d8815a90-574d-45bb-bae7-0bdd3e3a42c1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 81d97a97-540c-4203-a6b5-fb688194ca27] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:38.292348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8815a90-574d-45bb-bae7-0bdd3e3a42c1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:38.292811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8815a90-574d-45bb-bae7-0bdd3e3a42c1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:38.293641 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8815a90-574d-45bb-bae7-0bdd3e3a42c1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:38.294085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8815a90-574d-45bb-bae7-0bdd3e3a42c1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:38.298416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:38.309560 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-d8815a90-574d-45bb-bae7-0bdd3e3a42c1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] HTTP exception thrown: Instance 81d97a97-540c-4203-a6b5-fb688194ca27 could not be found. Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d8815a90-574d-45bb-bae7-0bdd3e3a42c1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Request method failure captured: Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 HTTP/1.1 Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14nXZ97dPvJ1vYjndXy08u0I-QfwsZLjzwhTwPLlHMlDVbR0IZdTAqSZqYran5Cvn4wC7UUKrlJHR7Rd5sBdXlrakajTzWxMCZYT9KggIWGgJVLkrs7-SbyDEPoD28498TR330QVEV33AslM-uldVFYVsaXG-pQNZ1Cq9xOqgPIH54M Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d90f217b019840929bacafcacbbd1a3d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}] Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a241f748f0ef4775b46e4fcd113174e5 Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 81d97a97-540c-4203-a6b5-fb688194ca27 could not be found. Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '81d97a97-540c-4203-a6b5-fb688194ca27'} Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81d97a97-540c-4203-a6b5-fb688194ca27 could not be found. Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81d97a97-540c-4203-a6b5-fb688194ca27 could not be found. Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:38.311320 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.316781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:38.316781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:38.316781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:38.316781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:38.316781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:38.316781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81d97a97-540c-4203-a6b5-fb688194ca27 could not be found. Jul 20 04:56:38.316781 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.316781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d8815a90-574d-45bb-bae7-0bdd3e3a42c1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Returning 404 to user: Instance 81d97a97-540c-4203-a6b5-fb688194ca27 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:38.316781 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d8815a90-574d-45bb-bae7-0bdd3e3a42c1 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27" status: 404 len: 111 microversion: 2.1 time: 0.031529 Jul 20 04:56:38.316781 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3186/6609] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:38 2022] GET /compute/v2.1/servers/81d97a97-540c-4203-a6b5-fb688194ca27 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:38.763277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-333c635f-33c6-4aef-a807-15b136aa511d tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:38.764209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-333c635f-33c6-4aef-a807-15b136aa511d tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:38.771007 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-333c635f-33c6-4aef-a807-15b136aa511d tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:38.771472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-333c635f-33c6-4aef-a807-15b136aa511d tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:38.772270 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-333c635f-33c6-4aef-a807-15b136aa511d tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:38.772727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-333c635f-33c6-4aef-a807-15b136aa511d tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:38.951122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-333c635f-33c6-4aef-a807-15b136aa511d tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:38.959968 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-333c635f-33c6-4aef-a807-15b136aa511d tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1270 microversion: 2.1 time: 0.200574 Jul 20 04:56:38.960679 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3424/6610] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:38 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1270 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:39.977291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-35bd2fce-13fc-49c4-9045-c8beb49353e4 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:39.977909 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-35bd2fce-13fc-49c4-9045-c8beb49353e4 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:39.985602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35bd2fce-13fc-49c4-9045-c8beb49353e4 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:39.986058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35bd2fce-13fc-49c4-9045-c8beb49353e4 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:39.986847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35bd2fce-13fc-49c4-9045-c8beb49353e4 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:39.987291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-35bd2fce-13fc-49c4-9045-c8beb49353e4 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:40.129655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-35bd2fce-13fc-49c4-9045-c8beb49353e4 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:40.137870 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-35bd2fce-13fc-49c4-9045-c8beb49353e4 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1270 microversion: 2.1 time: 0.164885 Jul 20 04:56:40.138569 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3187/6611] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:39 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:41.082886 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-9b431a6b-4ce7-4ac0-bc71-1723d7d47270 req-979b42a9-43b5-435a-9c30-4bed217b0493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8bd6e6-7aa4-4c97-ab59-4b6929938375", "name": "network-vif-plugged", "status": "completed", "tag": "f25beca5-1668-446b-8590-754b85684392"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:41.091903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9b431a6b-4ce7-4ac0-bc71-1723d7d47270 req-979b42a9-43b5-435a-9c30-4bed217b0493 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:41.092390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9b431a6b-4ce7-4ac0-bc71-1723d7d47270 req-979b42a9-43b5-435a-9c30-4bed217b0493 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:41.103833 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9b431a6b-4ce7-4ac0-bc71-1723d7d47270 req-979b42a9-43b5-435a-9c30-4bed217b0493 service nova] Creating event network-vif-plugged:f25beca5-1668-446b-8590-754b85684392 for instance aa8bd6e6-7aa4-4c97-ab59-4b6929938375 on n-h1-826526-5 Jul 20 04:56:41.108965 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-9b431a6b-4ce7-4ac0-bc71-1723d7d47270 req-979b42a9-43b5-435a-9c30-4bed217b0493 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193436 Jul 20 04:56:41.109555 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3425/6612] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:41.156497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0d16a72d-af15-4fef-b776-f7004a4636e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:41.157398 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0d16a72d-af15-4fef-b776-f7004a4636e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:41.166231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d16a72d-af15-4fef-b776-f7004a4636e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:41.166963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d16a72d-af15-4fef-b776-f7004a4636e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:41.178666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d16a72d-af15-4fef-b776-f7004a4636e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:41.179414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d16a72d-af15-4fef-b776-f7004a4636e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:41.374705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0d16a72d-af15-4fef-b776-f7004a4636e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:41.383315 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0d16a72d-af15-4fef-b776-f7004a4636e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1270 microversion: 2.1 time: 0.231678 Jul 20 04:56:41.384228 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3188/6613] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:41 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1270 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:41.566123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-63722a7f-8ab1-42ec-ac84-b11942d37b8a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:41.567079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-63722a7f-8ab1-42ec-ac84-b11942d37b8a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:41.577842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63722a7f-8ab1-42ec-ac84-b11942d37b8a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:41.578300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63722a7f-8ab1-42ec-ac84-b11942d37b8a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:41.581567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63722a7f-8ab1-42ec-ac84-b11942d37b8a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:41.582373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-63722a7f-8ab1-42ec-ac84-b11942d37b8a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:41.597840 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-63722a7f-8ab1-42ec-ac84-b11942d37b8a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] HTTP exception thrown: Instance 8036792e-0b6c-48cd-b555-ae12a1e52658 could not be found. Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-63722a7f-8ab1-42ec-ac84-b11942d37b8a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Request method failure captured: Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 HTTP/1.1 Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14nXZ97dPvJ1vYjndXy08u0I-QfwsZLjzwhTwPLlHMlDVbR0IZdTAqSZqYran5Cvn4wC7UUKrlJHR7Rd5sBdXlrakajTzWxMCZYT9KggIWGgJVLkrs7-SbyDEPoD28498TR330QVEV33AslM-uldVFYVsaXG-pQNZ1Cq9xOqgPIH54M Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d90f217b019840929bacafcacbbd1a3d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}] Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: a241f748f0ef4775b46e4fcd113174e5 Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 8036792e-0b6c-48cd-b555-ae12a1e52658 could not be found. Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '8036792e-0b6c-48cd-b555-ae12a1e52658'} Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8036792e-0b6c-48cd-b555-ae12a1e52658 could not be found. Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:41.599555 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:41.604795 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8036792e-0b6c-48cd-b555-ae12a1e52658 could not be found. Jul 20 04:56:41.604795 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:41.604795 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:41.604795 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:41.604795 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:41.604795 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:41.604795 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:41.604795 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:41.604795 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:41.604795 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8036792e-0b6c-48cd-b555-ae12a1e52658 could not be found. Jul 20 04:56:41.604795 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:56:41.604795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-63722a7f-8ab1-42ec-ac84-b11942d37b8a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Returning 404 to user: Instance 8036792e-0b6c-48cd-b555-ae12a1e52658 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:41.604795 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-63722a7f-8ab1-42ec-ac84-b11942d37b8a tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 404 len: 111 microversion: 2.1 time: 0.039620 Jul 20 04:56:41.604795 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3426/6614] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:56:41 2022] DELETE /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:41.609829 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c8df024d-81ce-43b8-82d6-dc294d49d729 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:41.610486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c8df024d-81ce-43b8-82d6-dc294d49d729 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] [instance: 8036792e-0b6c-48cd-b555-ae12a1e52658] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:41.616821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8df024d-81ce-43b8-82d6-dc294d49d729 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:41.617275 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8df024d-81ce-43b8-82d6-dc294d49d729 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:41.618115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8df024d-81ce-43b8-82d6-dc294d49d729 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:41.618560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8df024d-81ce-43b8-82d6-dc294d49d729 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:41.633056 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-c8df024d-81ce-43b8-82d6-dc294d49d729 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] HTTP exception thrown: Instance 8036792e-0b6c-48cd-b555-ae12a1e52658 could not be found. Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c8df024d-81ce-43b8-82d6-dc294d49d729 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Request method failure captured: Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 HTTP/1.1 Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14nXZ97dPvJ1vYjndXy08u0I-QfwsZLjzwhTwPLlHMlDVbR0IZdTAqSZqYran5Cvn4wC7UUKrlJHR7Rd5sBdXlrakajTzWxMCZYT9KggIWGgJVLkrs7-SbyDEPoD28498TR330QVEV33AslM-uldVFYVsaXG-pQNZ1Cq9xOqgPIH54M Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d90f217b019840929bacafcacbbd1a3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d90f217b019840929bacafcacbbd1a3d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d90f217b019840929bacafcacbbd1a3d"}]}] Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: d90f217b019840929bacafcacbbd1a3d Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822836307 Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: a241f748f0ef4775b46e4fcd113174e5 Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeNegativeTest-1822836307-project Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 8036792e-0b6c-48cd-b555-ae12a1e52658 could not be found. Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '8036792e-0b6c-48cd-b555-ae12a1e52658'} Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8036792e-0b6c-48cd-b555-ae12a1e52658 could not be found. Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8036792e-0b6c-48cd-b555-ae12a1e52658 could not be found. Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:41.634651 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:41.639494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:41.639494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:41.639494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:41.639494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:41.639494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:41.639494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8036792e-0b6c-48cd-b555-ae12a1e52658 could not be found. Jul 20 04:56:41.639494 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:56:41.639494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c8df024d-81ce-43b8-82d6-dc294d49d729 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] Returning 404 to user: Instance 8036792e-0b6c-48cd-b555-ae12a1e52658 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:41.639494 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c8df024d-81ce-43b8-82d6-dc294d49d729 tempest-AttachVolumeNegativeTest-1822836307 tempest-AttachVolumeNegativeTest-1822836307-project] 10.222.0.17 "GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658" status: 404 len: 111 microversion: 2.1 time: 0.030193 Jul 20 04:56:41.639494 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3189/6615] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:41 2022] GET /compute/v2.1/servers/8036792e-0b6c-48cd-b555-ae12a1e52658 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:42.403958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-af6736b8-cb20-4b32-bb20-e8346ba1dc4c tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:42.404655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-af6736b8-cb20-4b32-bb20-e8346ba1dc4c tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:42.418872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af6736b8-cb20-4b32-bb20-e8346ba1dc4c tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:42.419373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af6736b8-cb20-4b32-bb20-e8346ba1dc4c tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:42.420176 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af6736b8-cb20-4b32-bb20-e8346ba1dc4c tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:42.420919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af6736b8-cb20-4b32-bb20-e8346ba1dc4c tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:42.563967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-af6736b8-cb20-4b32-bb20-e8346ba1dc4c tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:42.571904 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-af6736b8-cb20-4b32-bb20-e8346ba1dc4c tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1459 microversion: 2.1 time: 0.174612 Jul 20 04:56:42.572579 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3427/6616] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:42 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1459 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:42.590505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-236c25dc-504a-4e53-8019-c0b3fb83f6e8 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:42.591123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-236c25dc-504a-4e53-8019-c0b3fb83f6e8 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:42.598429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-236c25dc-504a-4e53-8019-c0b3fb83f6e8 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:42.599009 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-236c25dc-504a-4e53-8019-c0b3fb83f6e8 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:42.599912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-236c25dc-504a-4e53-8019-c0b3fb83f6e8 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:42.600396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-236c25dc-504a-4e53-8019-c0b3fb83f6e8 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:42.879921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-236c25dc-504a-4e53-8019-c0b3fb83f6e8 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:42.889384 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-236c25dc-504a-4e53-8019-c0b3fb83f6e8 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1459 microversion: 2.1 time: 0.304931 Jul 20 04:56:42.890045 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3190/6617] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:42 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1459 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:45.152968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-80110c86-ee3e-456b-ba60-70be5ef31f28 req-46f47eea-8922-453d-927b-876411e5ac9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8bd6e6-7aa4-4c97-ab59-4b6929938375", "tag": "f25beca5-1668-446b-8590-754b85684392"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:45.162718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-80110c86-ee3e-456b-ba60-70be5ef31f28 req-46f47eea-8922-453d-927b-876411e5ac9a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:45.163242 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-80110c86-ee3e-456b-ba60-70be5ef31f28 req-46f47eea-8922-453d-927b-876411e5ac9a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:45.175063 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-80110c86-ee3e-456b-ba60-70be5ef31f28 req-46f47eea-8922-453d-927b-876411e5ac9a service nova] Creating event network-changed:f25beca5-1668-446b-8590-754b85684392 for instance aa8bd6e6-7aa4-4c97-ab59-4b6929938375 on n-h1-826526-5 Jul 20 04:56:45.180734 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-80110c86-ee3e-456b-ba60-70be5ef31f28 req-46f47eea-8922-453d-927b-876411e5ac9a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031407 Jul 20 04:56:45.186665 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3428/6618] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:47.199718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f46ecc9b-314a-4ed2-82c2-32612254a99f req-1c2ffbfe-5146-4893-adfa-1bab662a946f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8bd6e6-7aa4-4c97-ab59-4b6929938375", "tag": "f25beca5-1668-446b-8590-754b85684392"}, {"name": "network-changed", "server_uuid": "aa8bd6e6-7aa4-4c97-ab59-4b6929938375", "tag": "f25beca5-1668-446b-8590-754b85684392"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:47.212152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f46ecc9b-314a-4ed2-82c2-32612254a99f req-1c2ffbfe-5146-4893-adfa-1bab662a946f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:47.212937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f46ecc9b-314a-4ed2-82c2-32612254a99f req-1c2ffbfe-5146-4893-adfa-1bab662a946f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:47.229008 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f46ecc9b-314a-4ed2-82c2-32612254a99f req-1c2ffbfe-5146-4893-adfa-1bab662a946f service nova] Creating event network-changed:f25beca5-1668-446b-8590-754b85684392 for instance aa8bd6e6-7aa4-4c97-ab59-4b6929938375 on n-h1-826526-5 Jul 20 04:56:47.230095 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f46ecc9b-314a-4ed2-82c2-32612254a99f req-1c2ffbfe-5146-4893-adfa-1bab662a946f service nova] Creating event network-changed:f25beca5-1668-446b-8590-754b85684392 for instance aa8bd6e6-7aa4-4c97-ab59-4b6929938375 on n-h1-826526-5 Jul 20 04:56:47.237351 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f46ecc9b-314a-4ed2-82c2-32612254a99f req-1c2ffbfe-5146-4893-adfa-1bab662a946f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041382 Jul 20 04:56:47.238201 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3191/6619] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:57:17.174935 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:57:17.175659 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 04:57:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:57:20.773557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=48 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:20.774631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=92 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:20.779235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-171bc505-5fe4-40bd-909b-4c700fc2a3e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:20.780050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-171bc505-5fe4-40bd-909b-4c700fc2a3e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:20.781354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-c23c2984-6d9f-472c-92e8-691cf9cd6d2f req-d1021478-b902-416f-99dc-881e2e40bb5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8bd6e6-7aa4-4c97-ab59-4b6929938375", "tag": "f25beca5-1668-446b-8590-754b85684392"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:57:20.785997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:20.786650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=22 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:20.794984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c23c2984-6d9f-472c-92e8-691cf9cd6d2f req-d1021478-b902-416f-99dc-881e2e40bb5c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:20.796057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c23c2984-6d9f-472c-92e8-691cf9cd6d2f req-d1021478-b902-416f-99dc-881e2e40bb5c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:20.800416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-171bc505-5fe4-40bd-909b-4c700fc2a3e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:20.801103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-171bc505-5fe4-40bd-909b-4c700fc2a3e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:20.801966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-171bc505-5fe4-40bd-909b-4c700fc2a3e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:20.802597 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-171bc505-5fe4-40bd-909b-4c700fc2a3e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:20.811678 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-c23c2984-6d9f-472c-92e8-691cf9cd6d2f req-d1021478-b902-416f-99dc-881e2e40bb5c service nova] Creating event network-changed:f25beca5-1668-446b-8590-754b85684392 for instance aa8bd6e6-7aa4-4c97-ab59-4b6929938375 on n-h1-826526-5 Jul 20 04:57:20.818022 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-c23c2984-6d9f-472c-92e8-691cf9cd6d2f req-d1021478-b902-416f-99dc-881e2e40bb5c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043571 Jul 20 04:57:20.819964 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3192/6620] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:57:20.849412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-171bc505-5fe4-40bd-909b-4c700fc2a3e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:57:20.957258 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-171bc505-5fe4-40bd-909b-4c700fc2a3e0 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "DELETE /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 204 len: 0 microversion: 2.1 time: 0.183205 Jul 20 04:57:20.959526 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3429/6621] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:57:20 2022] DELETE /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:57:20.969220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-287d3b56-039f-47b8-bd2d-8472fa7482fe tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:20.970279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-287d3b56-039f-47b8-bd2d-8472fa7482fe tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:20.978129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-287d3b56-039f-47b8-bd2d-8472fa7482fe tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:20.978592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-287d3b56-039f-47b8-bd2d-8472fa7482fe tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:20.979583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-287d3b56-039f-47b8-bd2d-8472fa7482fe tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:20.980226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-287d3b56-039f-47b8-bd2d-8472fa7482fe tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:21.161824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-287d3b56-039f-47b8-bd2d-8472fa7482fe tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:21.171675 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-287d3b56-039f-47b8-bd2d-8472fa7482fe tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1584 microversion: 2.1 time: 0.206731 Jul 20 04:57:21.172337 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3193/6622] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:20 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1584 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:22.193396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-440103d7-1f05-4115-88ef-a14efb4accd5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:22.194280 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-440103d7-1f05-4115-88ef-a14efb4accd5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:22.203453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-440103d7-1f05-4115-88ef-a14efb4accd5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:22.203944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-440103d7-1f05-4115-88ef-a14efb4accd5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:22.204902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-440103d7-1f05-4115-88ef-a14efb4accd5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:22.205341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-440103d7-1f05-4115-88ef-a14efb4accd5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:22.357161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-440103d7-1f05-4115-88ef-a14efb4accd5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:22.367319 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-440103d7-1f05-4115-88ef-a14efb4accd5 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1584 microversion: 2.1 time: 0.178224 Jul 20 04:57:22.368103 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3430/6623] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:22 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1584 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:23.084630 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f3f0bdb3-7da9-4ffd-9599-b94cc8df6dcf req-f40ffa0f-28d9-45f8-96b6-c46b3706e622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8bd6e6-7aa4-4c97-ab59-4b6929938375", "name": "network-vif-deleted", "tag": "f25beca5-1668-446b-8590-754b85684392"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:57:23.095965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f3f0bdb3-7da9-4ffd-9599-b94cc8df6dcf req-f40ffa0f-28d9-45f8-96b6-c46b3706e622 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:23.096735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f3f0bdb3-7da9-4ffd-9599-b94cc8df6dcf req-f40ffa0f-28d9-45f8-96b6-c46b3706e622 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:23.108837 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f3f0bdb3-7da9-4ffd-9599-b94cc8df6dcf req-f40ffa0f-28d9-45f8-96b6-c46b3706e622 service nova] Creating event network-vif-deleted:f25beca5-1668-446b-8590-754b85684392 for instance aa8bd6e6-7aa4-4c97-ab59-4b6929938375 on n-h1-826526-5 Jul 20 04:57:23.114843 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f3f0bdb3-7da9-4ffd-9599-b94cc8df6dcf req-f40ffa0f-28d9-45f8-96b6-c46b3706e622 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186553 Jul 20 04:57:23.116363 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3194/6624] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:57:23.395273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-498fd6ec-5434-4db1-b399-4ad4ec8af348 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:23.395987 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-498fd6ec-5434-4db1-b399-4ad4ec8af348 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:23.409148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-498fd6ec-5434-4db1-b399-4ad4ec8af348 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:23.409613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-498fd6ec-5434-4db1-b399-4ad4ec8af348 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:23.410897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-498fd6ec-5434-4db1-b399-4ad4ec8af348 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:23.411438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-498fd6ec-5434-4db1-b399-4ad4ec8af348 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:23.499425 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-498fd6ec-5434-4db1-b399-4ad4ec8af348 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:23.509272 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-498fd6ec-5434-4db1-b399-4ad4ec8af348 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1230 microversion: 2.1 time: 0.127399 Jul 20 04:57:23.510283 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3431/6625] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:23 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1230 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:24.528717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4ab11770-6e95-417c-b811-805d0108457c tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:24.529425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4ab11770-6e95-417c-b811-805d0108457c tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:24.535948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ab11770-6e95-417c-b811-805d0108457c tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:24.536447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ab11770-6e95-417c-b811-805d0108457c tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:24.537226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ab11770-6e95-417c-b811-805d0108457c tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:24.537669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ab11770-6e95-417c-b811-805d0108457c tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:24.633459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4ab11770-6e95-417c-b811-805d0108457c tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:24.642549 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4ab11770-6e95-417c-b811-805d0108457c tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1230 microversion: 2.1 time: 0.118831 Jul 20 04:57:24.644423 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3195/6626] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:24 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1230 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:25.662334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c251ebfe-19ea-475f-89aa-2b43838087cb tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:25.663499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c251ebfe-19ea-475f-89aa-2b43838087cb tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:25.671151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c251ebfe-19ea-475f-89aa-2b43838087cb tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:25.672215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c251ebfe-19ea-475f-89aa-2b43838087cb tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:25.673363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c251ebfe-19ea-475f-89aa-2b43838087cb tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:25.673895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c251ebfe-19ea-475f-89aa-2b43838087cb tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:25.745766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c251ebfe-19ea-475f-89aa-2b43838087cb tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:25.755671 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c251ebfe-19ea-475f-89aa-2b43838087cb tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1230 microversion: 2.1 time: 0.097224 Jul 20 04:57:25.756581 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3432/6627] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:25 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:26.772855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0e39ec21-ba2f-4c55-a852-fd9ff93a3133 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:26.773465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0e39ec21-ba2f-4c55-a852-fd9ff93a3133 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:26.780703 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e39ec21-ba2f-4c55-a852-fd9ff93a3133 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:26.781173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e39ec21-ba2f-4c55-a852-fd9ff93a3133 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:26.781982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e39ec21-ba2f-4c55-a852-fd9ff93a3133 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:26.782433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0e39ec21-ba2f-4c55-a852-fd9ff93a3133 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:26.870474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0e39ec21-ba2f-4c55-a852-fd9ff93a3133 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbea4ac4f0a049cca80558ea79d86285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67277dd25ee74830a1b2235ad5b9bb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:26.881305 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0e39ec21-ba2f-4c55-a852-fd9ff93a3133 tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 200 len: 1230 microversion: 2.1 time: 0.111869 Jul 20 04:57:26.883809 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3196/6628] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:26 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 1230 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:27.900134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-936ec0ab-7d8e-4401-820c-eb3860c2bebf tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:27.901432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-936ec0ab-7d8e-4401-820c-eb3860c2bebf tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] [instance: aa8bd6e6-7aa4-4c97-ab59-4b6929938375] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:27.908829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-936ec0ab-7d8e-4401-820c-eb3860c2bebf tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:27.909211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-936ec0ab-7d8e-4401-820c-eb3860c2bebf tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:27.910015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-936ec0ab-7d8e-4401-820c-eb3860c2bebf tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:27.910560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-936ec0ab-7d8e-4401-820c-eb3860c2bebf tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:27.924748 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-936ec0ab-7d8e-4401-820c-eb3860c2bebf tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] HTTP exception thrown: Instance aa8bd6e6-7aa4-4c97-ab59-4b6929938375 could not be found. Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-936ec0ab-7d8e-4401-820c-eb3860c2bebf tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Request method failure captured: Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 HTTP/1.1 Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14pzlTCGHK4_vz5rlFE4QgrovM0Ebf8dpXZLqPsMb7-pSfNt5DJrrhqAd0DiB2sXIYX3KONXQhg0bvmhhPfEO0psIAHsGHc5PCyYHL4WWWRnL6TKkoigZKjKP5MzMdRyucylkJTIQMokomZ2cKpzIuSVd7jJFivTwO9mMT5DSTWsnU0 Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 67277dd25ee74830a1b2235ad5b9bb7d Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestVolumeBackupRestore-1650201806 Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/67277dd25ee74830a1b2235ad5b9bb7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/67277dd25ee74830a1b2235ad5b9bb7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_67277dd25ee74830a1b2235ad5b9bb7d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/67277dd25ee74830a1b2235ad5b9bb7d"}]}] Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestVolumeBackupRestore-1650201806 Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 67277dd25ee74830a1b2235ad5b9bb7d Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1650201806 Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestVolumeBackupRestore-1650201806-project Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: bbea4ac4f0a049cca80558ea79d86285 Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestVolumeBackupRestore-1650201806-project Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance aa8bd6e6-7aa4-4c97-ab59-4b6929938375 could not be found. Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'aa8bd6e6-7aa4-4c97-ab59-4b6929938375'} Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa8bd6e6-7aa4-4c97-ab59-4b6929938375 could not be found. Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa8bd6e6-7aa4-4c97-ab59-4b6929938375 could not be found. Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:57:27.926421 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:57:27.931793 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:57:27.931793 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:57:27.931793 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:57:27.931793 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:57:27.931793 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:57:27.931793 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa8bd6e6-7aa4-4c97-ab59-4b6929938375 could not be found. Jul 20 04:57:27.931793 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:57:27.931793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-936ec0ab-7d8e-4401-820c-eb3860c2bebf tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Returning 404 to user: Instance aa8bd6e6-7aa4-4c97-ab59-4b6929938375 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:57:27.931793 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-936ec0ab-7d8e-4401-820c-eb3860c2bebf tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375" status: 404 len: 111 microversion: 2.1 time: 0.031633 Jul 20 04:57:27.931793 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3433/6629] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:27 2022] GET /compute/v2.1/servers/aa8bd6e6-7aa4-4c97-ab59-4b6929938375 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:57:28.190141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a5f8e0f1-61f1-45bf-b0c5-b18eb6159e0d tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] Calling method '.version_select at 0x7f06bd4cfa60>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:28.211725 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a5f8e0f1-61f1-45bf-b0c5-b18eb6159e0d tempest-TestVolumeBackupRestore-1650201806 tempest-TestVolumeBackupRestore-1650201806-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1857990520" status: 202 len: 0 microversion: 2.1 time: 0.026061 Jul 20 04:57:28.212400 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3197/6630] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 04:57:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1857990520 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:58:08.302377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7535832b-6b03-4a4f-8c20-a7986ca48621 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1164474025", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "a118cfab-b185-454a-99eb-3c9c614fc9ba"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:08.309281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:08.309955 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:08.356706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-7535832b-6b03-4a4f-8c20-a7986ca48621 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] validate_networks() for [('a118cfab-b185-454a-99eb-3c9c614fc9ba', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:58:08.759492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-7535832b-6b03-4a4f-8c20-a7986ca48621 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:58:08.759914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-7535832b-6b03-4a4f-8c20-a7986ca48621 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:58:08.760415 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-7535832b-6b03-4a4f-8c20-a7986ca48621 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:58:08.760854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-7535832b-6b03-4a4f-8c20-a7986ca48621 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:58:08.761261 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-7535832b-6b03-4a4f-8c20-a7986ca48621 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:58:08.771353 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7535832b-6b03-4a4f-8c20-a7986ca48621 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:08.771794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7535832b-6b03-4a4f-8c20-a7986ca48621 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:08.772632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7535832b-6b03-4a4f-8c20-a7986ca48621 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:08.773068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7535832b-6b03-4a4f-8c20-a7986ca48621 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:08.790167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-7535832b-6b03-4a4f-8c20-a7986ca48621 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Getting quotas for project 1b90e02719254de7ad92165e7ebabc6a. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:58:08.795633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-7535832b-6b03-4a4f-8c20-a7986ca48621 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Getting quotas for user f6dbe6365ae8463d9f40ad6c592ce63b and project 1b90e02719254de7ad92165e7ebabc6a. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:58:08.808222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7535832b-6b03-4a4f-8c20-a7986ca48621 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:58:08.810507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7535832b-6b03-4a4f-8c20-a7986ca48621 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: fbc67719-f5bb-4a92-92f6-7aa42030c303] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:58:08.868920 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7535832b-6b03-4a4f-8c20-a7986ca48621 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570436 Jul 20 04:58:08.869569 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3434/6631] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:58:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:58:08.879859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=22 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:08.880870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:08.886430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fcc09a38-8d8b-4b2d-b5b1-ce84cb5ad441 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:08.888289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fcc09a38-8d8b-4b2d-b5b1-ce84cb5ad441 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: fbc67719-f5bb-4a92-92f6-7aa42030c303] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:08.943417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fcc09a38-8d8b-4b2d-b5b1-ce84cb5ad441 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:08.950241 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fcc09a38-8d8b-4b2d-b5b1-ce84cb5ad441 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303" status: 200 len: 1214 microversion: 2.1 time: 0.072493 Jul 20 04:58:08.950819 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3198/6632] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:08 2022] GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:09.968880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-181adc77-5a06-4a63-b8b1-3c43bd7e9651 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:09.969442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-181adc77-5a06-4a63-b8b1-3c43bd7e9651 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: fbc67719-f5bb-4a92-92f6-7aa42030c303] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:09.977244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-181adc77-5a06-4a63-b8b1-3c43bd7e9651 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:09.977692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-181adc77-5a06-4a63-b8b1-3c43bd7e9651 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:09.978461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-181adc77-5a06-4a63-b8b1-3c43bd7e9651 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:09.978895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-181adc77-5a06-4a63-b8b1-3c43bd7e9651 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:10.045038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-181adc77-5a06-4a63-b8b1-3c43bd7e9651 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:10.053646 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-181adc77-5a06-4a63-b8b1-3c43bd7e9651 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303" status: 200 len: 1266 microversion: 2.1 time: 0.090152 Jul 20 04:58:10.054589 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3435/6633] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:09 2022] GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:11.071321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-05fcb65c-2bd6-4520-8c6f-59ddf09f60d5 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:11.071943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-05fcb65c-2bd6-4520-8c6f-59ddf09f60d5 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: fbc67719-f5bb-4a92-92f6-7aa42030c303] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:11.079434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-05fcb65c-2bd6-4520-8c6f-59ddf09f60d5 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:11.079896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-05fcb65c-2bd6-4520-8c6f-59ddf09f60d5 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:11.080729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-05fcb65c-2bd6-4520-8c6f-59ddf09f60d5 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:11.081177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-05fcb65c-2bd6-4520-8c6f-59ddf09f60d5 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:11.318750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-05fcb65c-2bd6-4520-8c6f-59ddf09f60d5 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:11.326595 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-05fcb65c-2bd6-4520-8c6f-59ddf09f60d5 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303" status: 200 len: 1314 microversion: 2.1 time: 0.259445 Jul 20 04:58:11.327198 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3199/6634] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:11 2022] GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:11.754814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-65dfa207-4c06-4f63-8d57-3fff5c4ddafa req-ddc8491a-e874-430e-8382-46b690ff1ecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbc67719-f5bb-4a92-92f6-7aa42030c303", "tag": "ea59a749-1559-47bb-88cf-89843eb60bed"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:11.765737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-65dfa207-4c06-4f63-8d57-3fff5c4ddafa req-ddc8491a-e874-430e-8382-46b690ff1ecf service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:11.766362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-65dfa207-4c06-4f63-8d57-3fff5c4ddafa req-ddc8491a-e874-430e-8382-46b690ff1ecf service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:11.780647 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-65dfa207-4c06-4f63-8d57-3fff5c4ddafa req-ddc8491a-e874-430e-8382-46b690ff1ecf service nova] Creating event network-changed:ea59a749-1559-47bb-88cf-89843eb60bed for instance fbc67719-f5bb-4a92-92f6-7aa42030c303 on n-h1-826526-5 Jul 20 04:58:11.785661 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-65dfa207-4c06-4f63-8d57-3fff5c4ddafa req-ddc8491a-e874-430e-8382-46b690ff1ecf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035786 Jul 20 04:58:11.786316 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3436/6635] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:12.345094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0852c47c-aabe-421c-9357-25d07c298957 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:12.345749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0852c47c-aabe-421c-9357-25d07c298957 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: fbc67719-f5bb-4a92-92f6-7aa42030c303] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:12.353287 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0852c47c-aabe-421c-9357-25d07c298957 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:12.353793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0852c47c-aabe-421c-9357-25d07c298957 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:12.354568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0852c47c-aabe-421c-9357-25d07c298957 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:12.355019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0852c47c-aabe-421c-9357-25d07c298957 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:12.509491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0852c47c-aabe-421c-9357-25d07c298957 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:12.519574 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0852c47c-aabe-421c-9357-25d07c298957 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303" status: 200 len: 1314 microversion: 2.1 time: 0.179489 Jul 20 04:58:12.520186 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3200/6636] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:12 2022] GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:13.538531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c37a6f71-f992-4188-8a51-64bdbbadb690 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:13.539228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c37a6f71-f992-4188-8a51-64bdbbadb690 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: fbc67719-f5bb-4a92-92f6-7aa42030c303] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:13.545908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c37a6f71-f992-4188-8a51-64bdbbadb690 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:13.546357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c37a6f71-f992-4188-8a51-64bdbbadb690 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:13.547212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c37a6f71-f992-4188-8a51-64bdbbadb690 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:13.547642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c37a6f71-f992-4188-8a51-64bdbbadb690 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:13.697916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c37a6f71-f992-4188-8a51-64bdbbadb690 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:13.706111 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c37a6f71-f992-4188-8a51-64bdbbadb690 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303" status: 200 len: 1314 microversion: 2.1 time: 0.172673 Jul 20 04:58:13.706699 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3437/6637] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:13 2022] GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:14.723583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-89ea35f7-0005-4121-8a8a-d9cf16731dd7 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:14.724278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-89ea35f7-0005-4121-8a8a-d9cf16731dd7 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: fbc67719-f5bb-4a92-92f6-7aa42030c303] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:14.731941 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89ea35f7-0005-4121-8a8a-d9cf16731dd7 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:14.732590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89ea35f7-0005-4121-8a8a-d9cf16731dd7 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:14.733491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89ea35f7-0005-4121-8a8a-d9cf16731dd7 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:14.733939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89ea35f7-0005-4121-8a8a-d9cf16731dd7 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:14.879150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-89ea35f7-0005-4121-8a8a-d9cf16731dd7 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:14.890633 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-89ea35f7-0005-4121-8a8a-d9cf16731dd7 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303" status: 200 len: 1314 microversion: 2.1 time: 0.170655 Jul 20 04:58:14.891141 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3201/6638] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:14 2022] GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:15.908650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5ef74a3d-f855-4f8e-8fb8-361542e3e448 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:15.909277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5ef74a3d-f855-4f8e-8fb8-361542e3e448 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: fbc67719-f5bb-4a92-92f6-7aa42030c303] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:15.916501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ef74a3d-f855-4f8e-8fb8-361542e3e448 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:15.916977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ef74a3d-f855-4f8e-8fb8-361542e3e448 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:15.917736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ef74a3d-f855-4f8e-8fb8-361542e3e448 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:15.918151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ef74a3d-f855-4f8e-8fb8-361542e3e448 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:16.058660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5ef74a3d-f855-4f8e-8fb8-361542e3e448 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:16.067566 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5ef74a3d-f855-4f8e-8fb8-361542e3e448 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303" status: 200 len: 1314 microversion: 2.1 time: 0.163247 Jul 20 04:58:16.068144 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3438/6639] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:15 2022] GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:17.084915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d9a2a26a-7b25-4d03-8d82-4d2d4eb3210b tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:17.085622 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d9a2a26a-7b25-4d03-8d82-4d2d4eb3210b tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: fbc67719-f5bb-4a92-92f6-7aa42030c303] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:17.092735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9a2a26a-7b25-4d03-8d82-4d2d4eb3210b tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:17.093202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9a2a26a-7b25-4d03-8d82-4d2d4eb3210b tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:17.093963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9a2a26a-7b25-4d03-8d82-4d2d4eb3210b tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:17.094408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9a2a26a-7b25-4d03-8d82-4d2d4eb3210b tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:17.238828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d9a2a26a-7b25-4d03-8d82-4d2d4eb3210b tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:17.246774 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d9a2a26a-7b25-4d03-8d82-4d2d4eb3210b tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303" status: 200 len: 1314 microversion: 2.1 time: 0.165741 Jul 20 04:58:17.247371 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3202/6640] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:17 2022] GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:17.314891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-684a109b-c102-479d-a7b9-9ce6b558ad8a req-38e4be88-84ae-4e72-8289-998fb6a44dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc67719-f5bb-4a92-92f6-7aa42030c303", "name": "network-vif-plugged", "status": "completed", "tag": "ea59a749-1559-47bb-88cf-89843eb60bed"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:17.324958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-684a109b-c102-479d-a7b9-9ce6b558ad8a req-38e4be88-84ae-4e72-8289-998fb6a44dc1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:17.325513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-684a109b-c102-479d-a7b9-9ce6b558ad8a req-38e4be88-84ae-4e72-8289-998fb6a44dc1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:17.337148 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-684a109b-c102-479d-a7b9-9ce6b558ad8a req-38e4be88-84ae-4e72-8289-998fb6a44dc1 service nova] Creating event network-vif-plugged:ea59a749-1559-47bb-88cf-89843eb60bed for instance fbc67719-f5bb-4a92-92f6-7aa42030c303 on n-h1-826526-5 Jul 20 04:58:17.342198 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-684a109b-c102-479d-a7b9-9ce6b558ad8a req-38e4be88-84ae-4e72-8289-998fb6a44dc1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031965 Jul 20 04:58:17.342821 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3439/6641] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:18.266806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ff35c56b-e76a-4b65-8a27-6edd5b3360cf tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:18.267525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ff35c56b-e76a-4b65-8a27-6edd5b3360cf tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: fbc67719-f5bb-4a92-92f6-7aa42030c303] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:18.275811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff35c56b-e76a-4b65-8a27-6edd5b3360cf tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:18.276358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff35c56b-e76a-4b65-8a27-6edd5b3360cf tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:18.277200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff35c56b-e76a-4b65-8a27-6edd5b3360cf tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:18.277724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff35c56b-e76a-4b65-8a27-6edd5b3360cf tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:18.424134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ff35c56b-e76a-4b65-8a27-6edd5b3360cf tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:18.433860 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ff35c56b-e76a-4b65-8a27-6edd5b3360cf tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303" status: 200 len: 1314 microversion: 2.1 time: 0.171196 Jul 20 04:58:18.434955 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3203/6642] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:18 2022] GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:19.453732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:19.454537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:19.459084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-81f6dae4-2de4-47ac-9450-2ef60013d26f tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:19.459914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-81f6dae4-2de4-47ac-9450-2ef60013d26f tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: fbc67719-f5bb-4a92-92f6-7aa42030c303] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:19.467726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81f6dae4-2de4-47ac-9450-2ef60013d26f tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:19.468204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81f6dae4-2de4-47ac-9450-2ef60013d26f tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:19.469098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81f6dae4-2de4-47ac-9450-2ef60013d26f tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:19.469673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-81f6dae4-2de4-47ac-9450-2ef60013d26f tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:19.608518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-81f6dae4-2de4-47ac-9450-2ef60013d26f tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:19.617041 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-81f6dae4-2de4-47ac-9450-2ef60013d26f tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303" status: 200 len: 1497 microversion: 2.1 time: 0.166324 Jul 20 04:58:19.617631 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3440/6643] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:19 2022] GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303 => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:20.020858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d7b0c7c8-9e80-4c40-92c2-2e890b52de4e tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:20.021471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d7b0c7c8-9e80-4c40-92c2-2e890b52de4e tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: fbc67719-f5bb-4a92-92f6-7aa42030c303] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:20.024309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:20.031000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7b0c7c8-9e80-4c40-92c2-2e890b52de4e tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:20.033543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7b0c7c8-9e80-4c40-92c2-2e890b52de4e tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:20.034794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7b0c7c8-9e80-4c40-92c2-2e890b52de4e tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:20.035470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7b0c7c8-9e80-4c40-92c2-2e890b52de4e tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:20.070784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d7b0c7c8-9e80-4c40-92c2-2e890b52de4e tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: fbc67719-f5bb-4a92-92f6-7aa42030c303] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:58:20.164602 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d7b0c7c8-9e80-4c40-92c2-2e890b52de4e tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303" status: 204 len: 0 microversion: 2.1 time: 0.149637 Jul 20 04:58:20.165281 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3204/6644] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:58:20 2022] DELETE /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:58:20.174256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-18d5644e-90d6-4677-8d65-22a6c1bd3034 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:20.174882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-18d5644e-90d6-4677-8d65-22a6c1bd3034 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: fbc67719-f5bb-4a92-92f6-7aa42030c303] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:20.181084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-18d5644e-90d6-4677-8d65-22a6c1bd3034 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:20.181524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-18d5644e-90d6-4677-8d65-22a6c1bd3034 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:20.182278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-18d5644e-90d6-4677-8d65-22a6c1bd3034 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:20.182728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-18d5644e-90d6-4677-8d65-22a6c1bd3034 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:20.325177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-18d5644e-90d6-4677-8d65-22a6c1bd3034 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:20.334214 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-18d5644e-90d6-4677-8d65-22a6c1bd3034 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303" status: 200 len: 1503 microversion: 2.1 time: 0.164268 Jul 20 04:58:20.334789 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3441/6645] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:20 2022] GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:21.352841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dc42c949-6b88-4de6-b04a-3804ab8b41d9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:21.353589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dc42c949-6b88-4de6-b04a-3804ab8b41d9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: fbc67719-f5bb-4a92-92f6-7aa42030c303] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:21.361092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc42c949-6b88-4de6-b04a-3804ab8b41d9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:21.361549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc42c949-6b88-4de6-b04a-3804ab8b41d9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:21.362324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc42c949-6b88-4de6-b04a-3804ab8b41d9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:21.362770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc42c949-6b88-4de6-b04a-3804ab8b41d9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:21.577283 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dc42c949-6b88-4de6-b04a-3804ab8b41d9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:21.586511 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dc42c949-6b88-4de6-b04a-3804ab8b41d9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303" status: 200 len: 1503 microversion: 2.1 time: 0.238068 Jul 20 04:58:21.587242 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3205/6646] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:21 2022] GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303 => generated 1503 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:21.965872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-65330691-443e-4eb6-ad90-ce7a5962c9c6 req-b4302043-a873-4ed0-8e3b-dd3cd9f5401c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc67719-f5bb-4a92-92f6-7aa42030c303", "name": "network-vif-deleted", "tag": "ea59a749-1559-47bb-88cf-89843eb60bed"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:21.976864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-65330691-443e-4eb6-ad90-ce7a5962c9c6 req-b4302043-a873-4ed0-8e3b-dd3cd9f5401c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:21.977312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-65330691-443e-4eb6-ad90-ce7a5962c9c6 req-b4302043-a873-4ed0-8e3b-dd3cd9f5401c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:21.990205 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-65330691-443e-4eb6-ad90-ce7a5962c9c6 req-b4302043-a873-4ed0-8e3b-dd3cd9f5401c service nova] Creating event network-vif-deleted:ea59a749-1559-47bb-88cf-89843eb60bed for instance fbc67719-f5bb-4a92-92f6-7aa42030c303 on n-h1-826526-5 Jul 20 04:58:21.995605 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-65330691-443e-4eb6-ad90-ce7a5962c9c6 req-b4302043-a873-4ed0-8e3b-dd3cd9f5401c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033628 Jul 20 04:58:21.996227 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3442/6647] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:22.604615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7c756444-8cfe-4ba3-b31a-15def5daa7fc tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:22.605292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7c756444-8cfe-4ba3-b31a-15def5daa7fc tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: fbc67719-f5bb-4a92-92f6-7aa42030c303] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:22.613423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c756444-8cfe-4ba3-b31a-15def5daa7fc tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:22.613889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c756444-8cfe-4ba3-b31a-15def5daa7fc tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:22.614705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c756444-8cfe-4ba3-b31a-15def5daa7fc tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:22.615185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7c756444-8cfe-4ba3-b31a-15def5daa7fc tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:22.631094 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-7c756444-8cfe-4ba3-b31a-15def5daa7fc tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] HTTP exception thrown: Instance fbc67719-f5bb-4a92-92f6-7aa42030c303 could not be found. Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7c756444-8cfe-4ba3-b31a-15def5daa7fc tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Request method failure captured: Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303 HTTP/1.1 Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14teKPeZWyVW-swYg291FM4DWWZkiIy5F1qmUCvrsJok_9LLU3UMjLB19rCyXhTz0OCGijLNkNZYQNfVfsps_TmhQgDhWD8ZqPtpZq7yZt1e5WmjkdH8cwsfOOgcEPy1R6pO7s2YAbynFRCPkZJd3wEidTC5iEqgawx7Kf4gekVrM2s Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 1b90e02719254de7ad92165e7ebabc6a Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-VolumesActionsTest-2102244560 Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1b90e02719254de7ad92165e7ebabc6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1b90e02719254de7ad92165e7ebabc6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1b90e02719254de7ad92165e7ebabc6a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1b90e02719254de7ad92165e7ebabc6a"}]}] Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-VolumesActionsTest-2102244560 Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 1b90e02719254de7ad92165e7ebabc6a Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-VolumesActionsTest-2102244560 Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-VolumesActionsTest-2102244560-project Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f6dbe6365ae8463d9f40ad6c592ce63b Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-VolumesActionsTest-2102244560-project Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance fbc67719-f5bb-4a92-92f6-7aa42030c303 could not be found. Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'fbc67719-f5bb-4a92-92f6-7aa42030c303'} Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbc67719-f5bb-4a92-92f6-7aa42030c303 could not be found. Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbc67719-f5bb-4a92-92f6-7aa42030c303 could not be found. Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:58:22.633063 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:58:22.638966 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:58:22.638966 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:58:22.638966 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:58:22.638966 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:58:22.638966 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:58:22.638966 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbc67719-f5bb-4a92-92f6-7aa42030c303 could not be found. Jul 20 04:58:22.638966 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:58:22.638966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7c756444-8cfe-4ba3-b31a-15def5daa7fc tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Returning 404 to user: Instance fbc67719-f5bb-4a92-92f6-7aa42030c303 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:58:22.638966 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7c756444-8cfe-4ba3-b31a-15def5daa7fc tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303" status: 404 len: 111 microversion: 2.1 time: 0.034597 Jul 20 04:58:22.638966 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3206/6648] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:22 2022] GET /compute/v2.1/servers/fbc67719-f5bb-4a92-92f6-7aa42030c303 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:58:22.690255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5deb8856-0dbe-4882-ac64-6ef38635b54a tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1659545962", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "a118cfab-b185-454a-99eb-3c9c614fc9ba"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:22.741217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-5deb8856-0dbe-4882-ac64-6ef38635b54a tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] validate_networks() for [('a118cfab-b185-454a-99eb-3c9c614fc9ba', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:58:23.120698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-5deb8856-0dbe-4882-ac64-6ef38635b54a tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:58:23.121393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-5deb8856-0dbe-4882-ac64-6ef38635b54a tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:58:23.121824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-5deb8856-0dbe-4882-ac64-6ef38635b54a tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:58:23.122283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-5deb8856-0dbe-4882-ac64-6ef38635b54a tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:58:23.122686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-5deb8856-0dbe-4882-ac64-6ef38635b54a tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:58:23.137775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5deb8856-0dbe-4882-ac64-6ef38635b54a tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:23.138418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5deb8856-0dbe-4882-ac64-6ef38635b54a tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:23.139757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5deb8856-0dbe-4882-ac64-6ef38635b54a tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:23.140603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5deb8856-0dbe-4882-ac64-6ef38635b54a tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:23.159021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-5deb8856-0dbe-4882-ac64-6ef38635b54a tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Getting quotas for project 1b90e02719254de7ad92165e7ebabc6a. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:58:23.165111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-5deb8856-0dbe-4882-ac64-6ef38635b54a tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Getting quotas for user f6dbe6365ae8463d9f40ad6c592ce63b and project 1b90e02719254de7ad92165e7ebabc6a. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:58:23.179044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5deb8856-0dbe-4882-ac64-6ef38635b54a tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:58:23.181475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5deb8856-0dbe-4882-ac64-6ef38635b54a tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: 805ebf7a-c463-4138-99de-197cdc378307] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:58:23.229341 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5deb8856-0dbe-4882-ac64-6ef38635b54a tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544382 Jul 20 04:58:23.230004 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3443/6649] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:58:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:58:23.240217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aca784cf-bafa-4e02-9d7a-e71bc099f9e5 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:23.240877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aca784cf-bafa-4e02-9d7a-e71bc099f9e5 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: 805ebf7a-c463-4138-99de-197cdc378307] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:23.309710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aca784cf-bafa-4e02-9d7a-e71bc099f9e5 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:23.317306 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aca784cf-bafa-4e02-9d7a-e71bc099f9e5 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307" status: 200 len: 1214 microversion: 2.1 time: 0.080957 Jul 20 04:58:23.317878 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3207/6650] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:23 2022] GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:24.337015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b5867e5c-601c-479d-b267-31f66d52a756 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:24.337716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b5867e5c-601c-479d-b267-31f66d52a756 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: 805ebf7a-c463-4138-99de-197cdc378307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:24.344661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5867e5c-601c-479d-b267-31f66d52a756 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:24.345417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5867e5c-601c-479d-b267-31f66d52a756 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:24.346510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5867e5c-601c-479d-b267-31f66d52a756 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:24.347174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5867e5c-601c-479d-b267-31f66d52a756 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:24.698824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b5867e5c-601c-479d-b267-31f66d52a756 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:24.706644 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b5867e5c-601c-479d-b267-31f66d52a756 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307" status: 200 len: 1284 microversion: 2.1 time: 0.375535 Jul 20 04:58:24.707211 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3444/6651] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:24 2022] GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307 => generated 1284 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:25.650732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-24b66b36-1a61-425b-95a4-2f2f6806b8ce req-b90eea27-ab7b-47d8-a1e7-9c299b040da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "805ebf7a-c463-4138-99de-197cdc378307", "tag": "74d862cb-dae8-4b6d-97a0-f9a9b1444dbd"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:25.662205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-24b66b36-1a61-425b-95a4-2f2f6806b8ce req-b90eea27-ab7b-47d8-a1e7-9c299b040da7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:25.662691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-24b66b36-1a61-425b-95a4-2f2f6806b8ce req-b90eea27-ab7b-47d8-a1e7-9c299b040da7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:25.675388 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-24b66b36-1a61-425b-95a4-2f2f6806b8ce req-b90eea27-ab7b-47d8-a1e7-9c299b040da7 service nova] Creating event network-changed:74d862cb-dae8-4b6d-97a0-f9a9b1444dbd for instance 805ebf7a-c463-4138-99de-197cdc378307 on n-h1-826526-5 Jul 20 04:58:25.680756 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-24b66b36-1a61-425b-95a4-2f2f6806b8ce req-b90eea27-ab7b-47d8-a1e7-9c299b040da7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034072 Jul 20 04:58:25.681372 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3208/6652] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:25.723971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8fdf87f1-2235-44cc-9569-53e3304106a9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:25.724619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8fdf87f1-2235-44cc-9569-53e3304106a9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: 805ebf7a-c463-4138-99de-197cdc378307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:25.732926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fdf87f1-2235-44cc-9569-53e3304106a9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:25.733378 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fdf87f1-2235-44cc-9569-53e3304106a9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:25.734175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fdf87f1-2235-44cc-9569-53e3304106a9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:25.734606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8fdf87f1-2235-44cc-9569-53e3304106a9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:25.876510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8fdf87f1-2235-44cc-9569-53e3304106a9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:25.884545 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8fdf87f1-2235-44cc-9569-53e3304106a9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307" status: 200 len: 1314 microversion: 2.1 time: 0.164854 Jul 20 04:58:25.885076 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3445/6653] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:25 2022] GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:26.902610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-196682b8-66d9-4f46-a45e-eb4501c96068 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:26.903312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-196682b8-66d9-4f46-a45e-eb4501c96068 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: 805ebf7a-c463-4138-99de-197cdc378307] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:26.910138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-196682b8-66d9-4f46-a45e-eb4501c96068 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:26.910647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-196682b8-66d9-4f46-a45e-eb4501c96068 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:26.911439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-196682b8-66d9-4f46-a45e-eb4501c96068 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:26.912013 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-196682b8-66d9-4f46-a45e-eb4501c96068 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:27.139944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-196682b8-66d9-4f46-a45e-eb4501c96068 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:27.150290 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-196682b8-66d9-4f46-a45e-eb4501c96068 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307" status: 200 len: 1314 microversion: 2.1 time: 0.252418 Jul 20 04:58:27.151170 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3209/6654] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:26 2022] GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:28.172578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3ffc46e5-2fd4-469a-a196-ae1f48b101e3 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:28.173213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3ffc46e5-2fd4-469a-a196-ae1f48b101e3 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: 805ebf7a-c463-4138-99de-197cdc378307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:28.184882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ffc46e5-2fd4-469a-a196-ae1f48b101e3 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:28.185516 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ffc46e5-2fd4-469a-a196-ae1f48b101e3 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:28.186661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ffc46e5-2fd4-469a-a196-ae1f48b101e3 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:28.187464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ffc46e5-2fd4-469a-a196-ae1f48b101e3 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:28.332706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3ffc46e5-2fd4-469a-a196-ae1f48b101e3 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:28.340893 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3ffc46e5-2fd4-469a-a196-ae1f48b101e3 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307" status: 200 len: 1314 microversion: 2.1 time: 0.174133 Jul 20 04:58:28.341433 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3446/6655] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:28 2022] GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:29.363373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-912fac0a-5e08-4e77-b110-1f6ca7b88a7d tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:29.364040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-912fac0a-5e08-4e77-b110-1f6ca7b88a7d tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: 805ebf7a-c463-4138-99de-197cdc378307] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:29.371328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-912fac0a-5e08-4e77-b110-1f6ca7b88a7d tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:29.371797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-912fac0a-5e08-4e77-b110-1f6ca7b88a7d tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:29.372625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-912fac0a-5e08-4e77-b110-1f6ca7b88a7d tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:29.373073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-912fac0a-5e08-4e77-b110-1f6ca7b88a7d tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:29.512877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-912fac0a-5e08-4e77-b110-1f6ca7b88a7d tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:29.521025 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-912fac0a-5e08-4e77-b110-1f6ca7b88a7d tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307" status: 200 len: 1314 microversion: 2.1 time: 0.161801 Jul 20 04:58:29.521633 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3210/6656] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:29 2022] GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:30.538645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9fa18979-8083-4408-b200-7a59e1a64078 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:30.539224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9fa18979-8083-4408-b200-7a59e1a64078 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: 805ebf7a-c463-4138-99de-197cdc378307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:30.547258 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fa18979-8083-4408-b200-7a59e1a64078 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:30.547766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fa18979-8083-4408-b200-7a59e1a64078 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:30.548654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fa18979-8083-4408-b200-7a59e1a64078 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:30.549175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fa18979-8083-4408-b200-7a59e1a64078 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:30.701944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9fa18979-8083-4408-b200-7a59e1a64078 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:30.709875 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9fa18979-8083-4408-b200-7a59e1a64078 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307" status: 200 len: 1314 microversion: 2.1 time: 0.175315 Jul 20 04:58:30.710516 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3447/6657] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:30 2022] GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:31.332442 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-dbb60984-39b7-4f9f-a31c-ac837be4cd14 req-ed6decd4-c90d-4eec-b9cc-28bc51cd87ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "805ebf7a-c463-4138-99de-197cdc378307", "name": "network-vif-plugged", "status": "completed", "tag": "74d862cb-dae8-4b6d-97a0-f9a9b1444dbd"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:31.342034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-dbb60984-39b7-4f9f-a31c-ac837be4cd14 req-ed6decd4-c90d-4eec-b9cc-28bc51cd87ae service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:31.342421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-dbb60984-39b7-4f9f-a31c-ac837be4cd14 req-ed6decd4-c90d-4eec-b9cc-28bc51cd87ae service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:31.353958 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-dbb60984-39b7-4f9f-a31c-ac837be4cd14 req-ed6decd4-c90d-4eec-b9cc-28bc51cd87ae service nova] Creating event network-vif-plugged:74d862cb-dae8-4b6d-97a0-f9a9b1444dbd for instance 805ebf7a-c463-4138-99de-197cdc378307 on n-h1-826526-5 Jul 20 04:58:31.359160 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-dbb60984-39b7-4f9f-a31c-ac837be4cd14 req-ed6decd4-c90d-4eec-b9cc-28bc51cd87ae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030391 Jul 20 04:58:31.359767 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3211/6658] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:31.732358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ceb57e0c-67c4-46f3-b60f-efa664e18bf9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:31.733125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ceb57e0c-67c4-46f3-b60f-efa664e18bf9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: 805ebf7a-c463-4138-99de-197cdc378307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:31.740722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ceb57e0c-67c4-46f3-b60f-efa664e18bf9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:31.741174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ceb57e0c-67c4-46f3-b60f-efa664e18bf9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:31.741953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ceb57e0c-67c4-46f3-b60f-efa664e18bf9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:31.742387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ceb57e0c-67c4-46f3-b60f-efa664e18bf9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:31.893112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ceb57e0c-67c4-46f3-b60f-efa664e18bf9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:31.900802 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ceb57e0c-67c4-46f3-b60f-efa664e18bf9 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307" status: 200 len: 1314 microversion: 2.1 time: 0.172583 Jul 20 04:58:31.901367 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3448/6659] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:31 2022] GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:32.919930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2477d048-15b4-492c-a1f4-b11b9e12e164 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:32.920524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2477d048-15b4-492c-a1f4-b11b9e12e164 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: 805ebf7a-c463-4138-99de-197cdc378307] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:32.927976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2477d048-15b4-492c-a1f4-b11b9e12e164 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:32.928489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2477d048-15b4-492c-a1f4-b11b9e12e164 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:32.929270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2477d048-15b4-492c-a1f4-b11b9e12e164 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:32.929726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2477d048-15b4-492c-a1f4-b11b9e12e164 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:33.078696 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2477d048-15b4-492c-a1f4-b11b9e12e164 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:33.086620 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2477d048-15b4-492c-a1f4-b11b9e12e164 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307" status: 200 len: 1497 microversion: 2.1 time: 0.172040 Jul 20 04:58:33.087204 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3212/6660] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:32 2022] GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307 => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:33.523990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3ea54548-191e-45d5-9a82-0a8ed7efd09b tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:33.524634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3ea54548-191e-45d5-9a82-0a8ed7efd09b tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: 805ebf7a-c463-4138-99de-197cdc378307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:33.527483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:33.528152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:33.536133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ea54548-191e-45d5-9a82-0a8ed7efd09b tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:33.536800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ea54548-191e-45d5-9a82-0a8ed7efd09b tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:33.537985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ea54548-191e-45d5-9a82-0a8ed7efd09b tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:33.538590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ea54548-191e-45d5-9a82-0a8ed7efd09b tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:33.567325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3ea54548-191e-45d5-9a82-0a8ed7efd09b tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: 805ebf7a-c463-4138-99de-197cdc378307] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:58:33.646957 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3ea54548-191e-45d5-9a82-0a8ed7efd09b tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "DELETE /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307" status: 204 len: 0 microversion: 2.1 time: 0.127034 Jul 20 04:58:33.647686 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3449/6661] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:58:33 2022] DELETE /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:58:33.660155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8c638e37-e53c-4fc0-b875-d5e3ef0bf082 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:33.660755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8c638e37-e53c-4fc0-b875-d5e3ef0bf082 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: 805ebf7a-c463-4138-99de-197cdc378307] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:33.662774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:33.668564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c638e37-e53c-4fc0-b875-d5e3ef0bf082 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:33.669020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c638e37-e53c-4fc0-b875-d5e3ef0bf082 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:33.669897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c638e37-e53c-4fc0-b875-d5e3ef0bf082 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:33.670380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c638e37-e53c-4fc0-b875-d5e3ef0bf082 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:33.806525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8c638e37-e53c-4fc0-b875-d5e3ef0bf082 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:33.818492 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8c638e37-e53c-4fc0-b875-d5e3ef0bf082 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307" status: 200 len: 1503 microversion: 2.1 time: 0.164883 Jul 20 04:58:33.819354 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3213/6662] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:33 2022] GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:34.837047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2fea5aa2-0d17-452a-bf64-21d6b13927c4 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:34.837752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2fea5aa2-0d17-452a-bf64-21d6b13927c4 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: 805ebf7a-c463-4138-99de-197cdc378307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:34.845324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2fea5aa2-0d17-452a-bf64-21d6b13927c4 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:34.845771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2fea5aa2-0d17-452a-bf64-21d6b13927c4 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:34.846542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2fea5aa2-0d17-452a-bf64-21d6b13927c4 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:34.847002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2fea5aa2-0d17-452a-bf64-21d6b13927c4 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:34.991580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2fea5aa2-0d17-452a-bf64-21d6b13927c4 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:35.004227 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2fea5aa2-0d17-452a-bf64-21d6b13927c4 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307" status: 200 len: 1503 microversion: 2.1 time: 0.171204 Jul 20 04:58:35.005587 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3450/6663] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:34 2022] GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:35.907704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-9857af54-f4b2-4136-b502-ad8fd526f5dc req-9907e75f-e109-4893-8ffc-0a194b83d841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "805ebf7a-c463-4138-99de-197cdc378307", "name": "network-vif-deleted", "tag": "74d862cb-dae8-4b6d-97a0-f9a9b1444dbd"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:35.921256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-9857af54-f4b2-4136-b502-ad8fd526f5dc req-9907e75f-e109-4893-8ffc-0a194b83d841 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:35.922174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-9857af54-f4b2-4136-b502-ad8fd526f5dc req-9907e75f-e109-4893-8ffc-0a194b83d841 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:35.934872 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-9857af54-f4b2-4136-b502-ad8fd526f5dc req-9907e75f-e109-4893-8ffc-0a194b83d841 service nova] Creating event network-vif-deleted:74d862cb-dae8-4b6d-97a0-f9a9b1444dbd for instance 805ebf7a-c463-4138-99de-197cdc378307 on n-h1-826526-5 Jul 20 04:58:35.940251 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-9857af54-f4b2-4136-b502-ad8fd526f5dc req-9907e75f-e109-4893-8ffc-0a194b83d841 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038568 Jul 20 04:58:35.940881 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3214/6664] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:36.027984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bc545a9f-7bb0-4af8-bdc6-0b68785c5d28 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:36.028641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bc545a9f-7bb0-4af8-bdc6-0b68785c5d28 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: 805ebf7a-c463-4138-99de-197cdc378307] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:36.037455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc545a9f-7bb0-4af8-bdc6-0b68785c5d28 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:36.038021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc545a9f-7bb0-4af8-bdc6-0b68785c5d28 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:36.039566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc545a9f-7bb0-4af8-bdc6-0b68785c5d28 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:36.040057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc545a9f-7bb0-4af8-bdc6-0b68785c5d28 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:36.073976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc545a9f-7bb0-4af8-bdc6-0b68785c5d28 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:36.074422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc545a9f-7bb0-4af8-bdc6-0b68785c5d28 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:36.074875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-bc545a9f-7bb0-4af8-bdc6-0b68785c5d28 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lazy-loading 'fault' on Instance uuid 805ebf7a-c463-4138-99de-197cdc378307 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:58:36.125247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bc545a9f-7bb0-4af8-bdc6-0b68785c5d28 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dbe6365ae8463d9f40ad6c592ce63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90e02719254de7ad92165e7ebabc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:36.129018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:36.134193 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bc545a9f-7bb0-4af8-bdc6-0b68785c5d28 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307" status: 200 len: 1304 microversion: 2.1 time: 0.110743 Jul 20 04:58:36.134844 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3451/6665] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:36 2022] GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:37.156163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-076edec8-7f8e-4dd3-bfc4-d91b5fa58738 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:37.156949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-076edec8-7f8e-4dd3-bfc4-d91b5fa58738 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] [instance: 805ebf7a-c463-4138-99de-197cdc378307] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:37.163666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-076edec8-7f8e-4dd3-bfc4-d91b5fa58738 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:37.164133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-076edec8-7f8e-4dd3-bfc4-d91b5fa58738 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:37.164969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-076edec8-7f8e-4dd3-bfc4-d91b5fa58738 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:37.165420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-076edec8-7f8e-4dd3-bfc4-d91b5fa58738 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:37.181700 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-076edec8-7f8e-4dd3-bfc4-d91b5fa58738 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] HTTP exception thrown: Instance 805ebf7a-c463-4138-99de-197cdc378307 could not be found. Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-076edec8-7f8e-4dd3-bfc4-d91b5fa58738 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Request method failure captured: Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307 HTTP/1.1 Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14teKPeZWyVW-swYg291FM4DWWZkiIy5F1qmUCvrsJok_9LLU3UMjLB19rCyXhTz0OCGijLNkNZYQNfVfsps_TmhQgDhWD8ZqPtpZq7yZt1e5WmjkdH8cwsfOOgcEPy1R6pO7s2YAbynFRCPkZJd3wEidTC5iEqgawx7Kf4gekVrM2s Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 1b90e02719254de7ad92165e7ebabc6a Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-VolumesActionsTest-2102244560 Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1b90e02719254de7ad92165e7ebabc6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1b90e02719254de7ad92165e7ebabc6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1b90e02719254de7ad92165e7ebabc6a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1b90e02719254de7ad92165e7ebabc6a"}]}] Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-VolumesActionsTest-2102244560 Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 1b90e02719254de7ad92165e7ebabc6a Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-VolumesActionsTest-2102244560 Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-VolumesActionsTest-2102244560-project Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: f6dbe6365ae8463d9f40ad6c592ce63b Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-VolumesActionsTest-2102244560-project Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 805ebf7a-c463-4138-99de-197cdc378307 could not be found. Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '805ebf7a-c463-4138-99de-197cdc378307'} Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 805ebf7a-c463-4138-99de-197cdc378307 could not be found. Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 805ebf7a-c463-4138-99de-197cdc378307 could not be found. Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:58:37.183458 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:58:37.188834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:58:37.188834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:58:37.188834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:58:37.188834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:58:37.188834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:58:37.188834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 805ebf7a-c463-4138-99de-197cdc378307 could not be found. Jul 20 04:58:37.188834 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:58:37.188834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-076edec8-7f8e-4dd3-bfc4-d91b5fa58738 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] Returning 404 to user: Instance 805ebf7a-c463-4138-99de-197cdc378307 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:58:37.188834 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-076edec8-7f8e-4dd3-bfc4-d91b5fa58738 tempest-VolumesActionsTest-2102244560 tempest-VolumesActionsTest-2102244560-project] 10.222.0.17 "GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307" status: 404 len: 111 microversion: 2.1 time: 0.036231 Jul 20 04:58:37.188834 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3215/6666] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:37 2022] GET /compute/v2.1/servers/805ebf7a-c463-4138-99de-197cdc378307 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:58:55.278638 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:58:55.279753 n-d-826526-5 devstack@n-api.service[127870]: Wed Jul 20 04:58:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:59:26.981198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:27.117671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-99b4b74a-de33-49ba-9fbb-c766ce9193a1 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1420013776", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:27.323249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-99b4b74a-de33-49ba-9fbb-c766ce9193a1 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] validate_networks() for None {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:59:27.615888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-99b4b74a-de33-49ba-9fbb-c766ce9193a1 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:59:27.616299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-99b4b74a-de33-49ba-9fbb-c766ce9193a1 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:59:27.616811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-99b4b74a-de33-49ba-9fbb-c766ce9193a1 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:59:27.617219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-99b4b74a-de33-49ba-9fbb-c766ce9193a1 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:59:27.617636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-99b4b74a-de33-49ba-9fbb-c766ce9193a1 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:59:27.627476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-99b4b74a-de33-49ba-9fbb-c766ce9193a1 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:27.627929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-99b4b74a-de33-49ba-9fbb-c766ce9193a1 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:27.628762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-99b4b74a-de33-49ba-9fbb-c766ce9193a1 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:27.629196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-99b4b74a-de33-49ba-9fbb-c766ce9193a1 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:27.648177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-99b4b74a-de33-49ba-9fbb-c766ce9193a1 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Getting quotas for project 92698c8672f04395a71a3efd3c2ba616. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:59:27.653655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-99b4b74a-de33-49ba-9fbb-c766ce9193a1 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Getting quotas for user 4aeadb1e3a55470e9fdf730f0cd7180e and project 92698c8672f04395a71a3efd3c2ba616. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:59:27.666985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-99b4b74a-de33-49ba-9fbb-c766ce9193a1 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:59:27.669413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-99b4b74a-de33-49ba-9fbb-c766ce9193a1 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:59:27.717307 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-99b4b74a-de33-49ba-9fbb-c766ce9193a1 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.741364 Jul 20 04:59:27.717974 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3452/6667] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:59:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:59:27.728603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-26f0fb0d-cccc-4965-a5a5-77ea64655450 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:27.729319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-26f0fb0d-cccc-4965-a5a5-77ea64655450 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:27.731969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:27.732670 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:27.901252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-26f0fb0d-cccc-4965-a5a5-77ea64655450 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aeadb1e3a55470e9fdf730f0cd7180e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92698c8672f04395a71a3efd3c2ba616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:27.909515 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-26f0fb0d-cccc-4965-a5a5-77ea64655450 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] 10.222.0.17 "GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043" status: 200 len: 1222 microversion: 2.1 time: 0.184926 Jul 20 04:59:27.910193 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3216/6668] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:27 2022] GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043 => generated 1222 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:28.927427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9bdea7d1-8ee1-4363-911b-9d4c0d311da6 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:28.928027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9bdea7d1-8ee1-4363-911b-9d4c0d311da6 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:28.936031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9bdea7d1-8ee1-4363-911b-9d4c0d311da6 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:28.936624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9bdea7d1-8ee1-4363-911b-9d4c0d311da6 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:28.937407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9bdea7d1-8ee1-4363-911b-9d4c0d311da6 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:28.937844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9bdea7d1-8ee1-4363-911b-9d4c0d311da6 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:28.999789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9bdea7d1-8ee1-4363-911b-9d4c0d311da6 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aeadb1e3a55470e9fdf730f0cd7180e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92698c8672f04395a71a3efd3c2ba616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:29.008526 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9bdea7d1-8ee1-4363-911b-9d4c0d311da6 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] 10.222.0.17 "GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043" status: 200 len: 1280 microversion: 2.1 time: 0.085191 Jul 20 04:59:29.009147 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3453/6669] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:28 2022] GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043 => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:30.026037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2711f8d7-fd39-44f8-a31b-0f29dc28813e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:30.028509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2711f8d7-fd39-44f8-a31b-0f29dc28813e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:30.037246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2711f8d7-fd39-44f8-a31b-0f29dc28813e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:30.038343 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2711f8d7-fd39-44f8-a31b-0f29dc28813e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:30.039193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2711f8d7-fd39-44f8-a31b-0f29dc28813e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:30.039652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2711f8d7-fd39-44f8-a31b-0f29dc28813e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:30.233844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2711f8d7-fd39-44f8-a31b-0f29dc28813e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aeadb1e3a55470e9fdf730f0cd7180e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92698c8672f04395a71a3efd3c2ba616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:30.242352 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2711f8d7-fd39-44f8-a31b-0f29dc28813e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] 10.222.0.17 "GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043" status: 200 len: 1322 microversion: 2.1 time: 0.220372 Jul 20 04:59:30.242952 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3217/6670] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:30 2022] GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:30.315087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-113b6887-2e39-4dfe-b7e7-fff07ff6fa98 req-90d122f4-3828-4ec5-bcd6-9d38e6794697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaafeec6-bc25-4a7e-bffb-ddc839bf9043", "tag": "290194bb-3a3e-4ce7-965f-dacbf08a80b4"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:30.323889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-113b6887-2e39-4dfe-b7e7-fff07ff6fa98 req-90d122f4-3828-4ec5-bcd6-9d38e6794697 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:30.324355 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-113b6887-2e39-4dfe-b7e7-fff07ff6fa98 req-90d122f4-3828-4ec5-bcd6-9d38e6794697 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:30.336245 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-113b6887-2e39-4dfe-b7e7-fff07ff6fa98 req-90d122f4-3828-4ec5-bcd6-9d38e6794697 service nova] Creating event network-changed:290194bb-3a3e-4ce7-965f-dacbf08a80b4 for instance aaafeec6-bc25-4a7e-bffb-ddc839bf9043 on n-h1-826526-5 Jul 20 04:59:30.342831 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-113b6887-2e39-4dfe-b7e7-fff07ff6fa98 req-90d122f4-3828-4ec5-bcd6-9d38e6794697 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032023 Jul 20 04:59:30.342831 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3454/6671] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:59:31.259841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2c019dba-b99a-44ae-8a32-6c597c071ce9 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:31.260498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2c019dba-b99a-44ae-8a32-6c597c071ce9 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:31.268490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c019dba-b99a-44ae-8a32-6c597c071ce9 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:31.269100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c019dba-b99a-44ae-8a32-6c597c071ce9 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:31.269894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c019dba-b99a-44ae-8a32-6c597c071ce9 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:31.270384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c019dba-b99a-44ae-8a32-6c597c071ce9 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:31.404502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2c019dba-b99a-44ae-8a32-6c597c071ce9 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aeadb1e3a55470e9fdf730f0cd7180e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92698c8672f04395a71a3efd3c2ba616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:31.417166 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2c019dba-b99a-44ae-8a32-6c597c071ce9 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] 10.222.0.17 "GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043" status: 200 len: 1322 microversion: 2.1 time: 0.161353 Jul 20 04:59:31.418110 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3218/6672] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:31 2022] GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:32.439518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ac1d1795-f685-4d01-9a16-f3d98838c540 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:32.440247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ac1d1795-f685-4d01-9a16-f3d98838c540 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:32.447553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac1d1795-f685-4d01-9a16-f3d98838c540 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:32.448001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac1d1795-f685-4d01-9a16-f3d98838c540 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:32.449210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac1d1795-f685-4d01-9a16-f3d98838c540 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:32.449210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac1d1795-f685-4d01-9a16-f3d98838c540 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:32.585009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ac1d1795-f685-4d01-9a16-f3d98838c540 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aeadb1e3a55470e9fdf730f0cd7180e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92698c8672f04395a71a3efd3c2ba616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:32.593644 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ac1d1795-f685-4d01-9a16-f3d98838c540 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] 10.222.0.17 "GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043" status: 200 len: 1322 microversion: 2.1 time: 0.160919 Jul 20 04:59:32.594474 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3455/6673] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:32 2022] GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:33.611381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4deaa68d-8d50-4239-b629-84317b7cc56d tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:33.612151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4deaa68d-8d50-4239-b629-84317b7cc56d tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:33.619772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4deaa68d-8d50-4239-b629-84317b7cc56d tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:33.620235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4deaa68d-8d50-4239-b629-84317b7cc56d tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:33.621053 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4deaa68d-8d50-4239-b629-84317b7cc56d tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:33.621505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4deaa68d-8d50-4239-b629-84317b7cc56d tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:33.761365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4deaa68d-8d50-4239-b629-84317b7cc56d tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aeadb1e3a55470e9fdf730f0cd7180e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92698c8672f04395a71a3efd3c2ba616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:33.770591 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4deaa68d-8d50-4239-b629-84317b7cc56d tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] 10.222.0.17 "GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043" status: 200 len: 1322 microversion: 2.1 time: 0.163180 Jul 20 04:59:33.771191 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3219/6674] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:33 2022] GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:34.788223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a3f3b7a7-8c07-42b0-adb3-c31db9b966ec tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:34.788898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a3f3b7a7-8c07-42b0-adb3-c31db9b966ec tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:34.796587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a3f3b7a7-8c07-42b0-adb3-c31db9b966ec tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:34.797039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a3f3b7a7-8c07-42b0-adb3-c31db9b966ec tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:34.797816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a3f3b7a7-8c07-42b0-adb3-c31db9b966ec tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:34.798261 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a3f3b7a7-8c07-42b0-adb3-c31db9b966ec tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:35.279381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a3f3b7a7-8c07-42b0-adb3-c31db9b966ec tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aeadb1e3a55470e9fdf730f0cd7180e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92698c8672f04395a71a3efd3c2ba616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:35.287446 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a3f3b7a7-8c07-42b0-adb3-c31db9b966ec tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] 10.222.0.17 "GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043" status: 200 len: 1322 microversion: 2.1 time: 0.503333 Jul 20 04:59:35.288040 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3456/6675] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:34 2022] GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043 => generated 1322 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:35.638386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-c1a9eb95-c45f-4f8b-8faf-10aa6e81497c req-4a047e43-23ab-40a4-b067-efdf1d91d9ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaafeec6-bc25-4a7e-bffb-ddc839bf9043", "name": "network-vif-plugged", "status": "completed", "tag": "290194bb-3a3e-4ce7-965f-dacbf08a80b4"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:35.649042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c1a9eb95-c45f-4f8b-8faf-10aa6e81497c req-4a047e43-23ab-40a4-b067-efdf1d91d9ee service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:35.649491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c1a9eb95-c45f-4f8b-8faf-10aa6e81497c req-4a047e43-23ab-40a4-b067-efdf1d91d9ee service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:35.661982 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-c1a9eb95-c45f-4f8b-8faf-10aa6e81497c req-4a047e43-23ab-40a4-b067-efdf1d91d9ee service nova] Creating event network-vif-plugged:290194bb-3a3e-4ce7-965f-dacbf08a80b4 for instance aaafeec6-bc25-4a7e-bffb-ddc839bf9043 on n-h1-826526-5 Jul 20 04:59:35.667071 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-c1a9eb95-c45f-4f8b-8faf-10aa6e81497c req-4a047e43-23ab-40a4-b067-efdf1d91d9ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032611 Jul 20 04:59:35.667850 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3220/6676] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:59:36.304707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e3205d3d-4949-4f15-b612-bad2f9ce86fd tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:36.305369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e3205d3d-4949-4f15-b612-bad2f9ce86fd tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:36.312824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3205d3d-4949-4f15-b612-bad2f9ce86fd tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:36.313274 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3205d3d-4949-4f15-b612-bad2f9ce86fd tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:36.314173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3205d3d-4949-4f15-b612-bad2f9ce86fd tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:36.314607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e3205d3d-4949-4f15-b612-bad2f9ce86fd tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:36.446963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e3205d3d-4949-4f15-b612-bad2f9ce86fd tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aeadb1e3a55470e9fdf730f0cd7180e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92698c8672f04395a71a3efd3c2ba616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:36.455414 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e3205d3d-4949-4f15-b612-bad2f9ce86fd tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] 10.222.0.17 "GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043" status: 200 len: 1322 microversion: 2.1 time: 0.154789 Jul 20 04:59:36.455991 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3457/6677] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:36 2022] GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:37.474814 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c3c81342-f166-4ac8-83bf-949a253597da tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:37.475509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c3c81342-f166-4ac8-83bf-949a253597da tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:37.483038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3c81342-f166-4ac8-83bf-949a253597da tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:37.483500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3c81342-f166-4ac8-83bf-949a253597da tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:37.484294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3c81342-f166-4ac8-83bf-949a253597da tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:37.484741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3c81342-f166-4ac8-83bf-949a253597da tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:37.624855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c3c81342-f166-4ac8-83bf-949a253597da tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aeadb1e3a55470e9fdf730f0cd7180e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92698c8672f04395a71a3efd3c2ba616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:37.633066 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c3c81342-f166-4ac8-83bf-949a253597da tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] 10.222.0.17 "GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043" status: 200 len: 1472 microversion: 2.1 time: 0.162661 Jul 20 04:59:37.633631 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3221/6678] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:37 2022] GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043 => generated 1472 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:37.653409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:37.660735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:37.703073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e0428ae3-ffe2-4355-b2dd-8b5c25c16c28 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Calling method '.version_select at 0x7f06bcd9bf70>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:37.769212 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e0428ae3-ffe2-4355-b2dd-8b5c25c16c28 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/b178af821bab49f19dde9276b8da22f0" status: 200 len: 371 microversion: 2.1 time: 0.121224 Jul 20 04:59:37.769766 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3458/6679] 10.222.0.17 () {58 vars in 1241 bytes} [Wed Jul 20 04:59:37 2022] GET /compute/v2.1/os-quota-sets/b178af821bab49f19dde9276b8da22f0 => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:59:37.780508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-918b6383-fdb6-4aaf-8c17-9c0786d4383b tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1574283608", "id": 603062798, "os-flavor-access:is_public": "True"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:37.782201 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:59:37.782201 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:59:37.797799 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-918b6383-fdb6-4aaf-8c17-9c0786d4383b tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.021309 Jul 20 04:59:37.798389 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3222/6680] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:59:37 2022] POST /compute/v2.1/flavors => generated 435 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:59:37.809377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "603062798"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:37.810528 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:37.817696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:37.818145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:37.818907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:37.819345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:37.968045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '33923904d6d4419c8468671a30993f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b178af821bab49f19dde9276b8da22f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:37.975081 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1574283608 {{(pid=127871) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:59:37.982170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:37.982853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:37.983593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:37.984029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:38.005446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Getting quotas for project 92698c8672f04395a71a3efd3c2ba616. Resources: {'ram', 'cores'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:59:38.011120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Getting quotas for user 4aeadb1e3a55470e9fdf730f0cd7180e and project 92698c8672f04395a71a3efd3c2ba616. Resources: {'ram', 'cores'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:59:38.026791 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.compute.api [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] ram quota exceeded for b178af821bab49f19dde9276b8da22f0, tried to resize instance. Jul 20 04:59:38.027327 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Request method failure captured: Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043/action HTTP/1.1 Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 38 Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14uuoUhrNu5tA_DMZZr0Z3Zsh3GTN7uzzEAHNR9JzOqH7wel23HM8Ikvd_4RYcx8RSd6Q1dfNVo1f0OKFhaz24XuW0hFUxDNYtcHb8ttwm0QBXg0mWbtZd9ujF4uc2Fk72N-SkH-MKzADH4FhoAAATlipzLXhcdxyBX1DaUXCJ7yTjQ Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b178af821bab49f19dde9276b8da22f0 Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1651780160 Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member,admin Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member,admin Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b178af821bab49f19dde9276b8da22f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b178af821bab49f19dde9276b8da22f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b178af821bab49f19dde9276b8da22f0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b178af821bab49f19dde9276b8da22f0"}]}] Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1651780160 Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b178af821bab49f19dde9276b8da22f0 Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1651780160 Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersAdminNegativeTestJSON-1651780160-project-admin Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 33923904d6d4419c8468671a30993f45 Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1651780160-project-admin Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: {"resize": {"flavorRef": "603062798"}} Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'aaafeec6-bc25-4a7e-bffb-ddc839bf9043', 'body': {'resize': {'flavorRef': '603062798'}}} Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:59:38.029478 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c1c3624f-b0eb-4761-9553-be20cd7ec2bf tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043/action" status: 403 len: 118 microversion: 2.1 time: 0.225600 Jul 20 04:59:38.035102 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3459/6681] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:59:37 2022] POST /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043/action => generated 118 bytes in 227 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:59:38.041599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f6702635-9c51-4026-b87f-a407eeafdaef tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:38.042637 n-d-826526-5 devstack@n-api.service[127870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:59:38.042637 n-d-826526-5 devstack@n-api.service[127870]: warnings.warn(msg) Jul 20 04:59:38.045442 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:38.062159 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f6702635-9c51-4026-b87f-a407eeafdaef tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/603062798" status: 202 len: 0 microversion: 2.1 time: 0.025147 Jul 20 04:59:38.062752 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3223/6682] 10.222.0.17 () {58 vars in 1157 bytes} [Wed Jul 20 04:59:38 2022] DELETE /compute/v2.1/flavors/603062798 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:59:38.071044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7de4322b-9e2d-4202-b0a4-3180002f4eea tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:38.090304 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7de4322b-9e2d-4202-b0a4-3180002f4eea tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022916 Jul 20 04:59:38.090898 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3460/6683] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:59:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:38.107728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-83afc4d2-553f-4424-9739-97b4a2fb8c91 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Calling method '.version_select at 0x7f06bcd9c700>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:38.191949 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-83afc4d2-553f-4424-9739-97b4a2fb8c91 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/b178af821bab49f19dde9276b8da22f0" status: 200 len: 371 microversion: 2.1 time: 0.087886 Jul 20 04:59:38.192576 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3224/6684] 10.222.0.17 () {58 vars in 1241 bytes} [Wed Jul 20 04:59:38 2022] GET /compute/v2.1/os-quota-sets/b178af821bab49f19dde9276b8da22f0 => generated 371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:59:38.203724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3800a296-1bd1-419a-9719-f373c702d992 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-998976809", "id": 1951881402, "os-flavor-access:is_public": "True"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:38.205363 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:59:38.205363 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:59:38.225770 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3800a296-1bd1-419a-9719-f373c702d992 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.025740 Jul 20 04:59:38.226442 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3461/6685] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:59:38 2022] POST /compute/v2.1/flavors => generated 436 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:59:38.238234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1951881402"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:38.239183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:38.247693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:38.248584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:38.250409 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:38.250409 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:38.344833 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '33923904d6d4419c8468671a30993f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b178af821bab49f19dde9276b8da22f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:38.353475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-998976809 {{(pid=127870) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:59:38.360544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:38.361003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:38.361820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:38.362266 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:38.383678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Getting quotas for project 92698c8672f04395a71a3efd3c2ba616. Resources: {'ram', 'cores'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:59:38.389187 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Getting quotas for user 4aeadb1e3a55470e9fdf730f0cd7180e and project 92698c8672f04395a71a3efd3c2ba616. Resources: {'ram', 'cores'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:59:38.407305 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.compute.api [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] cores quota exceeded for b178af821bab49f19dde9276b8da22f0, tried to resize instance. Jul 20 04:59:38.407892 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Request method failure captured: Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043/action HTTP/1.1 Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 39 Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14uuoUhrNu5tA_DMZZr0Z3Zsh3GTN7uzzEAHNR9JzOqH7wel23HM8Ikvd_4RYcx8RSd6Q1dfNVo1f0OKFhaz24XuW0hFUxDNYtcHb8ttwm0QBXg0mWbtZd9ujF4uc2Fk72N-SkH-MKzADH4FhoAAATlipzLXhcdxyBX1DaUXCJ7yTjQ Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: b178af821bab49f19dde9276b8da22f0 Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1651780160 Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member,admin Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member,admin Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b178af821bab49f19dde9276b8da22f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b178af821bab49f19dde9276b8da22f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b178af821bab49f19dde9276b8da22f0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b178af821bab49f19dde9276b8da22f0"}]}] Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1651780160 Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: b178af821bab49f19dde9276b8da22f0 Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1651780160 Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersAdminNegativeTestJSON-1651780160-project-admin Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 33923904d6d4419c8468671a30993f45 Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1651780160-project-admin Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: {"resize": {"flavorRef": "1951881402"}} Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'aaafeec6-bc25-4a7e-bffb-ddc839bf9043', 'body': {'resize': {'flavorRef': '1951881402'}}} Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:59:38.411144 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a503b9fd-02b6-4a02-af3f-f5358870b265 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043/action" status: 403 len: 113 microversion: 2.1 time: 0.177405 Jul 20 04:59:38.415750 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3225/6686] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:59:38 2022] POST /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043/action => generated 113 bytes in 179 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:59:38.423744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6e471bab-ea41-42b6-bc7f-1a1b61b80991 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:38.424537 n-d-826526-5 devstack@n-api.service[127871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:59:38.424537 n-d-826526-5 devstack@n-api.service[127871]: warnings.warn(msg) Jul 20 04:59:38.444592 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6e471bab-ea41-42b6-bc7f-1a1b61b80991 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1951881402" status: 202 len: 0 microversion: 2.1 time: 0.026902 Jul 20 04:59:38.445161 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3462/6687] 10.222.0.17 () {58 vars in 1160 bytes} [Wed Jul 20 04:59:38 2022] DELETE /compute/v2.1/flavors/1951881402 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:59:38.454658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-23176724-0a44-4427-af77-9ae81af77636 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:38.474480 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-23176724-0a44-4427-af77-9ae81af77636 tempest-ServersAdminNegativeTestJSON-1651780160 tempest-ServersAdminNegativeTestJSON-1651780160-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023787 Jul 20 04:59:38.475313 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3226/6688] 10.222.0.17 () {58 vars in 1145 bytes} [Wed Jul 20 04:59:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:38.496436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ee408765-7d3b-4410-99a8-2429e5e8d3e4 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:38.497765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ee408765-7d3b-4410-99a8-2429e5e8d3e4 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:38.509681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee408765-7d3b-4410-99a8-2429e5e8d3e4 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:38.510439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee408765-7d3b-4410-99a8-2429e5e8d3e4 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:38.512502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee408765-7d3b-4410-99a8-2429e5e8d3e4 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:38.513333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ee408765-7d3b-4410-99a8-2429e5e8d3e4 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:38.549689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ee408765-7d3b-4410-99a8-2429e5e8d3e4 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:59:38.669207 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ee408765-7d3b-4410-99a8-2429e5e8d3e4 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] 10.222.0.17 "DELETE /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043" status: 204 len: 0 microversion: 2.1 time: 0.178684 Jul 20 04:59:38.673163 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3463/6689] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 04:59:38 2022] DELETE /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:59:38.679179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-56c166bd-5fbc-4576-8363-b8ed8b861c1e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:38.679822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-56c166bd-5fbc-4576-8363-b8ed8b861c1e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:38.690243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56c166bd-5fbc-4576-8363-b8ed8b861c1e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:38.690780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56c166bd-5fbc-4576-8363-b8ed8b861c1e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:38.691766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56c166bd-5fbc-4576-8363-b8ed8b861c1e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:38.693269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56c166bd-5fbc-4576-8363-b8ed8b861c1e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:38.840727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-56c166bd-5fbc-4576-8363-b8ed8b861c1e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aeadb1e3a55470e9fdf730f0cd7180e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92698c8672f04395a71a3efd3c2ba616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:38.849324 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-56c166bd-5fbc-4576-8363-b8ed8b861c1e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] 10.222.0.17 "GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043" status: 200 len: 1478 microversion: 2.1 time: 0.174571 Jul 20 04:59:38.849920 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3227/6690] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:38 2022] GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043 => generated 1478 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:39.870402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3ddc7291-0b35-4f0a-9a66-0d3245d86414 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:39.871681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3ddc7291-0b35-4f0a-9a66-0d3245d86414 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:39.884806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ddc7291-0b35-4f0a-9a66-0d3245d86414 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:39.885171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ddc7291-0b35-4f0a-9a66-0d3245d86414 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:39.885958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ddc7291-0b35-4f0a-9a66-0d3245d86414 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:39.886400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ddc7291-0b35-4f0a-9a66-0d3245d86414 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:40.038807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3ddc7291-0b35-4f0a-9a66-0d3245d86414 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aeadb1e3a55470e9fdf730f0cd7180e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92698c8672f04395a71a3efd3c2ba616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:40.047248 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3ddc7291-0b35-4f0a-9a66-0d3245d86414 tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] 10.222.0.17 "GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043" status: 200 len: 1478 microversion: 2.1 time: 0.184239 Jul 20 04:59:40.047946 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3464/6691] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:39 2022] GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043 => generated 1478 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:40.547855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-466575f3-a2a1-4fa4-9dc2-3e1146c40262 req-27acd32e-17a4-48d2-ab14-96fbd19d2655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaafeec6-bc25-4a7e-bffb-ddc839bf9043", "name": "network-vif-deleted", "tag": "290194bb-3a3e-4ce7-965f-dacbf08a80b4"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:40.558102 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-466575f3-a2a1-4fa4-9dc2-3e1146c40262 req-27acd32e-17a4-48d2-ab14-96fbd19d2655 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:40.558559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-466575f3-a2a1-4fa4-9dc2-3e1146c40262 req-27acd32e-17a4-48d2-ab14-96fbd19d2655 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:40.572657 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-466575f3-a2a1-4fa4-9dc2-3e1146c40262 req-27acd32e-17a4-48d2-ab14-96fbd19d2655 service nova] Creating event network-vif-deleted:290194bb-3a3e-4ce7-965f-dacbf08a80b4 for instance aaafeec6-bc25-4a7e-bffb-ddc839bf9043 on n-h1-826526-5 Jul 20 04:59:40.579663 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-466575f3-a2a1-4fa4-9dc2-3e1146c40262 req-27acd32e-17a4-48d2-ab14-96fbd19d2655 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035600 Jul 20 04:59:40.580481 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3228/6692] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:59:41.065105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6ff83f4e-71cf-426b-90f1-2ab33191888e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:41.065735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6ff83f4e-71cf-426b-90f1-2ab33191888e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] [instance: aaafeec6-bc25-4a7e-bffb-ddc839bf9043] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:41.072896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ff83f4e-71cf-426b-90f1-2ab33191888e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:41.073350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ff83f4e-71cf-426b-90f1-2ab33191888e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:41.074119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ff83f4e-71cf-426b-90f1-2ab33191888e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:41.074563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6ff83f4e-71cf-426b-90f1-2ab33191888e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:41.090705 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-6ff83f4e-71cf-426b-90f1-2ab33191888e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] HTTP exception thrown: Instance aaafeec6-bc25-4a7e-bffb-ddc839bf9043 could not be found. Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6ff83f4e-71cf-426b-90f1-2ab33191888e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Request method failure captured: Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043 HTTP/1.1 Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14uuTYz4pfdSW3F5H6JFUa4YG1WXOSLrYTUxuQfWKAnJ7VRscagAQgPkPz5SuSg1rrWmhG7Tr9nwGqP94xrO46Z02WdHJ_KbP89vhIbIoFTYR_zZptBlBZQNQFD5__YytMLBLTkxJXRs48m8REgjPcDBXGhvbQiTuXVRE4AVAqAuGvs Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 92698c8672f04395a71a3efd3c2ba616 Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1795238799 Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/92698c8672f04395a71a3efd3c2ba616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/92698c8672f04395a71a3efd3c2ba616"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_92698c8672f04395a71a3efd3c2ba616", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/92698c8672f04395a71a3efd3c2ba616"}]}] Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1795238799 Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 92698c8672f04395a71a3efd3c2ba616 Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1795238799 Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersAdminNegativeTestJSON-1795238799-project Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 4aeadb1e3a55470e9fdf730f0cd7180e Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1795238799-project Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance aaafeec6-bc25-4a7e-bffb-ddc839bf9043 could not be found. Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'aaafeec6-bc25-4a7e-bffb-ddc839bf9043'} Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaafeec6-bc25-4a7e-bffb-ddc839bf9043 could not be found. Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaafeec6-bc25-4a7e-bffb-ddc839bf9043 could not be found. Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:59:41.092469 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:41.101680 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:59:41.101680 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:41.101680 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:41.101680 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:41.101680 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:59:41.101680 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:59:41.101680 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaafeec6-bc25-4a7e-bffb-ddc839bf9043 could not be found. Jul 20 04:59:41.101680 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 04:59:41.101680 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6ff83f4e-71cf-426b-90f1-2ab33191888e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] Returning 404 to user: Instance aaafeec6-bc25-4a7e-bffb-ddc839bf9043 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:59:41.101680 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6ff83f4e-71cf-426b-90f1-2ab33191888e tempest-ServersAdminNegativeTestJSON-1795238799 tempest-ServersAdminNegativeTestJSON-1795238799-project] 10.222.0.17 "GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043" status: 404 len: 111 microversion: 2.1 time: 0.033091 Jul 20 04:59:41.101680 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3465/6693] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:41 2022] GET /compute/v2.1/servers/aaafeec6-bc25-4a7e-bffb-ddc839bf9043 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:59:47.824502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a8b977d7-3cb0-458a-bdb9-af3d0142482e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1624346888", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "b63dac39-defe-43b3-98a0-7cbaa25ad0db"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:47.882558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-a8b977d7-3cb0-458a-bdb9-af3d0142482e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] validate_networks() for [('b63dac39-defe-43b3-98a0-7cbaa25ad0db', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:59:48.184201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:48.312798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a8b977d7-3cb0-458a-bdb9-af3d0142482e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:59:48.313392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a8b977d7-3cb0-458a-bdb9-af3d0142482e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:59:48.314228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a8b977d7-3cb0-458a-bdb9-af3d0142482e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:59:48.314887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a8b977d7-3cb0-458a-bdb9-af3d0142482e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:59:48.315543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-a8b977d7-3cb0-458a-bdb9-af3d0142482e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:59:48.328076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8b977d7-3cb0-458a-bdb9-af3d0142482e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:48.328778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8b977d7-3cb0-458a-bdb9-af3d0142482e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:48.329953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8b977d7-3cb0-458a-bdb9-af3d0142482e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:48.330599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8b977d7-3cb0-458a-bdb9-af3d0142482e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:48.353285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-a8b977d7-3cb0-458a-bdb9-af3d0142482e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Getting quotas for project 3043987777554ce1b8860247b1c1567b. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:59:48.359022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-a8b977d7-3cb0-458a-bdb9-af3d0142482e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Getting quotas for user 043c457262a143ffbc880b6661f75b17 and project 3043987777554ce1b8860247b1c1567b. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:59:48.377849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a8b977d7-3cb0-458a-bdb9-af3d0142482e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:59:48.381988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a8b977d7-3cb0-458a-bdb9-af3d0142482e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:59:48.451609 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a8b977d7-3cb0-458a-bdb9-af3d0142482e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771894 Jul 20 04:59:48.452501 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3229/6694] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 04:59:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:59:48.466061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f8ebf438-47b7-4ae7-b2b6-2e6e3a2b66de tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:48.466813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f8ebf438-47b7-4ae7-b2b6-2e6e3a2b66de tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:48.473357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:48.474513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:48.551233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f8ebf438-47b7-4ae7-b2b6-2e6e3a2b66de tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:48.561580 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f8ebf438-47b7-4ae7-b2b6-2e6e3a2b66de tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1215 microversion: 2.1 time: 0.101448 Jul 20 04:59:48.562274 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3466/6695] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:48 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:49.581222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bb49e67d-698a-4931-8826-f9cbc8c54e41 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:49.582675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bb49e67d-698a-4931-8826-f9cbc8c54e41 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:49.593514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb49e67d-698a-4931-8826-f9cbc8c54e41 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:49.594507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb49e67d-698a-4931-8826-f9cbc8c54e41 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:49.596622 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb49e67d-698a-4931-8826-f9cbc8c54e41 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:49.597265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb49e67d-698a-4931-8826-f9cbc8c54e41 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:49.708570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bb49e67d-698a-4931-8826-f9cbc8c54e41 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:49.723806 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bb49e67d-698a-4931-8826-f9cbc8c54e41 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1285 microversion: 2.1 time: 0.148293 Jul 20 04:59:49.725180 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3230/6696] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:49 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:50.757672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0aef0728-53c6-4814-93ec-3fedaf9c95b1 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:50.758709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0aef0728-53c6-4814-93ec-3fedaf9c95b1 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:50.774235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0aef0728-53c6-4814-93ec-3fedaf9c95b1 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:50.775942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0aef0728-53c6-4814-93ec-3fedaf9c95b1 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:50.777458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0aef0728-53c6-4814-93ec-3fedaf9c95b1 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:50.777903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0aef0728-53c6-4814-93ec-3fedaf9c95b1 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:51.058596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0aef0728-53c6-4814-93ec-3fedaf9c95b1 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:51.068177 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0aef0728-53c6-4814-93ec-3fedaf9c95b1 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1315 microversion: 2.1 time: 0.316479 Jul 20 04:59:51.081190 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3467/6697] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:50 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:51.350462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-d6163be9-c0ab-463d-bab8-3b6e9e8c73c1 req-7891fcb3-5158-411b-a921-c8aba452b604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6334645c-31f6-48bb-8e2c-ce1903195893", "tag": "8e4fc832-fed0-40b4-b06e-fa673ed4f935"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:51.366107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d6163be9-c0ab-463d-bab8-3b6e9e8c73c1 req-7891fcb3-5158-411b-a921-c8aba452b604 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:51.366598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d6163be9-c0ab-463d-bab8-3b6e9e8c73c1 req-7891fcb3-5158-411b-a921-c8aba452b604 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:51.382717 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-d6163be9-c0ab-463d-bab8-3b6e9e8c73c1 req-7891fcb3-5158-411b-a921-c8aba452b604 service nova] Creating event network-changed:8e4fc832-fed0-40b4-b06e-fa673ed4f935 for instance 6334645c-31f6-48bb-8e2c-ce1903195893 on n-h2-826526-5 Jul 20 04:59:51.392445 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-d6163be9-c0ab-463d-bab8-3b6e9e8c73c1 req-7891fcb3-5158-411b-a921-c8aba452b604 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157223 Jul 20 04:59:51.394368 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3231/6698] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:59:52.092087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e74b076c-4ef0-48b0-b0ac-bca4eb731731 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:52.093090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e74b076c-4ef0-48b0-b0ac-bca4eb731731 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:52.101483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e74b076c-4ef0-48b0-b0ac-bca4eb731731 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:52.101947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e74b076c-4ef0-48b0-b0ac-bca4eb731731 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:52.102732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e74b076c-4ef0-48b0-b0ac-bca4eb731731 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:52.103174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e74b076c-4ef0-48b0-b0ac-bca4eb731731 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:52.250197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e74b076c-4ef0-48b0-b0ac-bca4eb731731 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:52.258704 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e74b076c-4ef0-48b0-b0ac-bca4eb731731 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1315 microversion: 2.1 time: 0.173445 Jul 20 04:59:52.259272 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3468/6699] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:52 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:53.275791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ab404c6b-f58e-44ba-8d8f-12b716fbc001 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:53.276666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ab404c6b-f58e-44ba-8d8f-12b716fbc001 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:53.284100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab404c6b-f58e-44ba-8d8f-12b716fbc001 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:53.284595 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab404c6b-f58e-44ba-8d8f-12b716fbc001 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:53.285400 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab404c6b-f58e-44ba-8d8f-12b716fbc001 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:53.285847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ab404c6b-f58e-44ba-8d8f-12b716fbc001 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:53.425868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ab404c6b-f58e-44ba-8d8f-12b716fbc001 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:53.433782 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ab404c6b-f58e-44ba-8d8f-12b716fbc001 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1315 microversion: 2.1 time: 0.162332 Jul 20 04:59:53.434337 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3232/6700] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:53 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:54.452669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-679d581b-c94a-4736-ac39-43ea01864fc2 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:54.453319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-679d581b-c94a-4736-ac39-43ea01864fc2 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:54.461552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-679d581b-c94a-4736-ac39-43ea01864fc2 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:54.462266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-679d581b-c94a-4736-ac39-43ea01864fc2 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:54.463521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-679d581b-c94a-4736-ac39-43ea01864fc2 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:54.464347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-679d581b-c94a-4736-ac39-43ea01864fc2 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:54.596518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-679d581b-c94a-4736-ac39-43ea01864fc2 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:54.604606 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-679d581b-c94a-4736-ac39-43ea01864fc2 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1315 microversion: 2.1 time: 0.157242 Jul 20 04:59:54.605245 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3469/6701] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:54 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:55.629269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b6e2f845-51ef-458a-abe4-27a9d2cbac6a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:55.630320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b6e2f845-51ef-458a-abe4-27a9d2cbac6a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:55.641562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6e2f845-51ef-458a-abe4-27a9d2cbac6a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:55.642348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6e2f845-51ef-458a-abe4-27a9d2cbac6a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:55.643610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6e2f845-51ef-458a-abe4-27a9d2cbac6a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:55.644381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6e2f845-51ef-458a-abe4-27a9d2cbac6a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:55.792684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b6e2f845-51ef-458a-abe4-27a9d2cbac6a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:55.804624 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b6e2f845-51ef-458a-abe4-27a9d2cbac6a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1315 microversion: 2.1 time: 0.185793 Jul 20 04:59:55.805462 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3233/6702] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:55 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:56.794150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-eee3899b-f8f4-4cff-a25d-9386f0731f98 req-9ec3d441-0b25-4637-9aad-d6b9fee1c196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6334645c-31f6-48bb-8e2c-ce1903195893", "name": "network-vif-plugged", "status": "completed", "tag": "8e4fc832-fed0-40b4-b06e-fa673ed4f935"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:56.804444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-eee3899b-f8f4-4cff-a25d-9386f0731f98 req-9ec3d441-0b25-4637-9aad-d6b9fee1c196 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:56.804878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-eee3899b-f8f4-4cff-a25d-9386f0731f98 req-9ec3d441-0b25-4637-9aad-d6b9fee1c196 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:56.817029 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-eee3899b-f8f4-4cff-a25d-9386f0731f98 req-9ec3d441-0b25-4637-9aad-d6b9fee1c196 service nova] Creating event network-vif-plugged:8e4fc832-fed0-40b4-b06e-fa673ed4f935 for instance 6334645c-31f6-48bb-8e2c-ce1903195893 on n-h2-826526-5 Jul 20 04:59:56.823837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d9e4b094-7785-4d2a-9ac9-708d2d57e975 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:56.824495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d9e4b094-7785-4d2a-9ac9-708d2d57e975 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:56.832177 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-eee3899b-f8f4-4cff-a25d-9386f0731f98 req-9ec3d441-0b25-4637-9aad-d6b9fee1c196 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041635 Jul 20 04:59:56.832949 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3470/6703] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:59:56.833228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9e4b094-7785-4d2a-9ac9-708d2d57e975 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:56.833690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9e4b094-7785-4d2a-9ac9-708d2d57e975 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:56.834477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9e4b094-7785-4d2a-9ac9-708d2d57e975 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:56.834923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9e4b094-7785-4d2a-9ac9-708d2d57e975 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:56.992872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d9e4b094-7785-4d2a-9ac9-708d2d57e975 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:57.000962 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d9e4b094-7785-4d2a-9ac9-708d2d57e975 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1315 microversion: 2.1 time: 0.180945 Jul 20 04:59:57.001568 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3234/6704] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:56 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:58.022971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-386061a5-082b-406f-a1a4-68501923d4ea tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:58.023675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-386061a5-082b-406f-a1a4-68501923d4ea tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:58.025947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:58.031792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-386061a5-082b-406f-a1a4-68501923d4ea tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:58.032294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-386061a5-082b-406f-a1a4-68501923d4ea tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:58.033057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-386061a5-082b-406f-a1a4-68501923d4ea tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:58.033527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-386061a5-082b-406f-a1a4-68501923d4ea tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:58.050017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:58.184129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-386061a5-082b-406f-a1a4-68501923d4ea tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:58.192467 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-386061a5-082b-406f-a1a4-68501923d4ea tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1501 microversion: 2.1 time: 0.176039 Jul 20 04:59:58.192986 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3471/6705] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:58 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1501 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:58.217941 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-753ebe2e-89f6-4d8e-a609-942923711619 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:58.218933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-753ebe2e-89f6-4d8e-a609-942923711619 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:58.221884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:58.228045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-753ebe2e-89f6-4d8e-a609-942923711619 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:58.228606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-753ebe2e-89f6-4d8e-a609-942923711619 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:58.229397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-753ebe2e-89f6-4d8e-a609-942923711619 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:58.229849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-753ebe2e-89f6-4d8e-a609-942923711619 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:58.235188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=76 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:58.261901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-753ebe2e-89f6-4d8e-a609-942923711619 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:58.268360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-753ebe2e-89f6-4d8e-a609-942923711619 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Old instance type m1.heat2, new instance type m1.heat {{(pid=127870) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:59:58.275034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-753ebe2e-89f6-4d8e-a609-942923711619 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:59:58.275466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-753ebe2e-89f6-4d8e-a609-942923711619 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:59:58.275954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-753ebe2e-89f6-4d8e-a609-942923711619 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:59:58.276411 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-753ebe2e-89f6-4d8e-a609-942923711619 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:59:58.276835 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-753ebe2e-89f6-4d8e-a609-942923711619 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:59:58.342819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=5 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:58.344931 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-753ebe2e-89f6-4d8e-a609-942923711619 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "POST /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893/action" status: 202 len: 0 microversion: 2.1 time: 0.132792 Jul 20 04:59:58.345585 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3235/6706] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 04:59:58 2022] POST /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:59:58.354163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1adff966-eeb2-4fa2-afc0-8e7f5ed0f2ee tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:58.354887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1adff966-eeb2-4fa2-afc0-8e7f5ed0f2ee tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:58.361513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1adff966-eeb2-4fa2-afc0-8e7f5ed0f2ee tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:58.361975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1adff966-eeb2-4fa2-afc0-8e7f5ed0f2ee tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:58.362757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1adff966-eeb2-4fa2-afc0-8e7f5ed0f2ee tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:58.363204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1adff966-eeb2-4fa2-afc0-8e7f5ed0f2ee tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:58.515124 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1adff966-eeb2-4fa2-afc0-8e7f5ed0f2ee tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:58.522989 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1adff966-eeb2-4fa2-afc0-8e7f5ed0f2ee tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1510 microversion: 2.1 time: 0.172961 Jul 20 04:59:58.523598 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3472/6707] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:58 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:59.539216 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:59.545501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-52453528-7bcf-4b06-a3de-164516498653 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:59.546233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-52453528-7bcf-4b06-a3de-164516498653 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:59.555276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52453528-7bcf-4b06-a3de-164516498653 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:59.555849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52453528-7bcf-4b06-a3de-164516498653 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:59.556773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52453528-7bcf-4b06-a3de-164516498653 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:59.557288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-52453528-7bcf-4b06-a3de-164516498653 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:59.708542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-52453528-7bcf-4b06-a3de-164516498653 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:59.719715 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-52453528-7bcf-4b06-a3de-164516498653 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1510 microversion: 2.1 time: 0.181493 Jul 20 04:59:59.720332 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3236/6708] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:59 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:00.738525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1513f8e7-b427-4ece-806e-165076bdf890 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:00.739152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1513f8e7-b427-4ece-806e-165076bdf890 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:00.741099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:00.747573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1513f8e7-b427-4ece-806e-165076bdf890 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:00.748043 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1513f8e7-b427-4ece-806e-165076bdf890 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:00.748857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1513f8e7-b427-4ece-806e-165076bdf890 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:00.749298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1513f8e7-b427-4ece-806e-165076bdf890 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:00.891866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1513f8e7-b427-4ece-806e-165076bdf890 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:00.899945 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1513f8e7-b427-4ece-806e-165076bdf890 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.165928 Jul 20 05:00:00.900569 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3473/6709] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:00 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:01.918967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-197e2596-d668-4659-80c5-fbb4190554fc tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:01.919640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-197e2596-d668-4659-80c5-fbb4190554fc tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:01.927189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-197e2596-d668-4659-80c5-fbb4190554fc tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:01.927684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-197e2596-d668-4659-80c5-fbb4190554fc tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:01.928589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-197e2596-d668-4659-80c5-fbb4190554fc tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:01.929047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-197e2596-d668-4659-80c5-fbb4190554fc tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:02.072973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-197e2596-d668-4659-80c5-fbb4190554fc tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:02.081579 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-197e2596-d668-4659-80c5-fbb4190554fc tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.166910 Jul 20 05:00:02.082159 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3237/6710] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:01 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:03.102866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-591b1f0d-e233-4bfa-af5a-ccd7c8ed4fbe tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:03.103750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-591b1f0d-e233-4bfa-af5a-ccd7c8ed4fbe tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:03.111948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-591b1f0d-e233-4bfa-af5a-ccd7c8ed4fbe tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:03.112433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-591b1f0d-e233-4bfa-af5a-ccd7c8ed4fbe tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:03.113208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-591b1f0d-e233-4bfa-af5a-ccd7c8ed4fbe tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:03.113649 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-591b1f0d-e233-4bfa-af5a-ccd7c8ed4fbe tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:03.260793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-591b1f0d-e233-4bfa-af5a-ccd7c8ed4fbe tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:03.270862 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-591b1f0d-e233-4bfa-af5a-ccd7c8ed4fbe tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.173217 Jul 20 05:00:03.271667 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3474/6711] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:03 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:04.293570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8a5cc0d9-c184-4866-bf4b-b8ec0d196d74 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:04.294851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8a5cc0d9-c184-4866-bf4b-b8ec0d196d74 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:04.303832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a5cc0d9-c184-4866-bf4b-b8ec0d196d74 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:04.304309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a5cc0d9-c184-4866-bf4b-b8ec0d196d74 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:04.305088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a5cc0d9-c184-4866-bf4b-b8ec0d196d74 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:04.305561 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a5cc0d9-c184-4866-bf4b-b8ec0d196d74 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:04.446006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8a5cc0d9-c184-4866-bf4b-b8ec0d196d74 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:04.454078 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8a5cc0d9-c184-4866-bf4b-b8ec0d196d74 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.167066 Jul 20 05:00:04.454687 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3238/6712] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:04 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:05.472462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b11aa55c-1405-4d1b-a5cd-5df8366c4739 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:05.473078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b11aa55c-1405-4d1b-a5cd-5df8366c4739 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:05.480209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b11aa55c-1405-4d1b-a5cd-5df8366c4739 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:05.480685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b11aa55c-1405-4d1b-a5cd-5df8366c4739 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:05.481465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b11aa55c-1405-4d1b-a5cd-5df8366c4739 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:05.481902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b11aa55c-1405-4d1b-a5cd-5df8366c4739 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:05.619672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b11aa55c-1405-4d1b-a5cd-5df8366c4739 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:05.629515 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b11aa55c-1405-4d1b-a5cd-5df8366c4739 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.161109 Jul 20 05:00:05.630091 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3475/6713] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:05 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:06.647520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94c4bb07-f043-498c-8b0c-f4a72e187049 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:06.648095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-94c4bb07-f043-498c-8b0c-f4a72e187049 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:06.655285 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94c4bb07-f043-498c-8b0c-f4a72e187049 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:06.655754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94c4bb07-f043-498c-8b0c-f4a72e187049 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:06.656586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94c4bb07-f043-498c-8b0c-f4a72e187049 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:06.657038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-94c4bb07-f043-498c-8b0c-f4a72e187049 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:06.813970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-94c4bb07-f043-498c-8b0c-f4a72e187049 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:06.825674 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-94c4bb07-f043-498c-8b0c-f4a72e187049 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.182021 Jul 20 05:00:06.826343 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3239/6714] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:06 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:07.843486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-00a9aee7-30ce-4601-9576-75482dce604e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:07.844069 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-00a9aee7-30ce-4601-9576-75482dce604e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:07.851783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00a9aee7-30ce-4601-9576-75482dce604e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:07.852233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00a9aee7-30ce-4601-9576-75482dce604e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:07.853048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00a9aee7-30ce-4601-9576-75482dce604e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:07.853485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-00a9aee7-30ce-4601-9576-75482dce604e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:07.994215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-00a9aee7-30ce-4601-9576-75482dce604e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:08.006192 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-00a9aee7-30ce-4601-9576-75482dce604e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.166163 Jul 20 05:00:08.006975 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3476/6715] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:07 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:09.023987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-956a6eee-11bd-4ab9-af46-669130996268 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:09.024623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-956a6eee-11bd-4ab9-af46-669130996268 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:09.032058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-956a6eee-11bd-4ab9-af46-669130996268 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:09.032556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-956a6eee-11bd-4ab9-af46-669130996268 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:09.033351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-956a6eee-11bd-4ab9-af46-669130996268 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:09.033808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-956a6eee-11bd-4ab9-af46-669130996268 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:09.170488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-956a6eee-11bd-4ab9-af46-669130996268 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:09.178283 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-956a6eee-11bd-4ab9-af46-669130996268 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.158295 Jul 20 05:00:09.178899 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3240/6716] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:09 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:10.196195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-71534282-6ffe-430e-bca7-aac80190e703 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:10.196978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-71534282-6ffe-430e-bca7-aac80190e703 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:10.205219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71534282-6ffe-430e-bca7-aac80190e703 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:10.205885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71534282-6ffe-430e-bca7-aac80190e703 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:10.206428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71534282-6ffe-430e-bca7-aac80190e703 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:10.206862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-71534282-6ffe-430e-bca7-aac80190e703 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:10.354165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-71534282-6ffe-430e-bca7-aac80190e703 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:10.362548 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-71534282-6ffe-430e-bca7-aac80190e703 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.170419 Jul 20 05:00:10.363130 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3477/6717] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:10 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:11.382524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2d29421c-27f0-43e8-9737-e75250fa1fa3 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:11.383223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2d29421c-27f0-43e8-9737-e75250fa1fa3 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:11.390807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d29421c-27f0-43e8-9737-e75250fa1fa3 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:11.391324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d29421c-27f0-43e8-9737-e75250fa1fa3 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:11.392190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d29421c-27f0-43e8-9737-e75250fa1fa3 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:11.392790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d29421c-27f0-43e8-9737-e75250fa1fa3 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:11.532990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2d29421c-27f0-43e8-9737-e75250fa1fa3 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:11.540720 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2d29421c-27f0-43e8-9737-e75250fa1fa3 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.163771 Jul 20 05:00:11.541299 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3241/6718] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:11 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:12.558608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-43a4f2f6-5113-4574-a5f7-934c629f4395 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:12.559377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-43a4f2f6-5113-4574-a5f7-934c629f4395 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:12.566884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43a4f2f6-5113-4574-a5f7-934c629f4395 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:12.567343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43a4f2f6-5113-4574-a5f7-934c629f4395 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:12.568118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43a4f2f6-5113-4574-a5f7-934c629f4395 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:12.568596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-43a4f2f6-5113-4574-a5f7-934c629f4395 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:12.711438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-43a4f2f6-5113-4574-a5f7-934c629f4395 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:12.723025 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-43a4f2f6-5113-4574-a5f7-934c629f4395 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.168192 Jul 20 05:00:12.723635 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3478/6719] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:12 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:13.744877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-79ac1cd0-cbb4-4ae9-a6cc-d1d0cdfbb7f5 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:13.745529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-79ac1cd0-cbb4-4ae9-a6cc-d1d0cdfbb7f5 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:13.752422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79ac1cd0-cbb4-4ae9-a6cc-d1d0cdfbb7f5 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:13.752892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79ac1cd0-cbb4-4ae9-a6cc-d1d0cdfbb7f5 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:13.753683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79ac1cd0-cbb4-4ae9-a6cc-d1d0cdfbb7f5 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:13.754142 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79ac1cd0-cbb4-4ae9-a6cc-d1d0cdfbb7f5 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:13.910517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-79ac1cd0-cbb4-4ae9-a6cc-d1d0cdfbb7f5 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:13.918400 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-79ac1cd0-cbb4-4ae9-a6cc-d1d0cdfbb7f5 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.179333 Jul 20 05:00:13.919032 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3242/6720] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:13 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:14.941336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ccd6ea87-54bb-417d-8aad-3ebaefd3d023 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:14.942074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ccd6ea87-54bb-417d-8aad-3ebaefd3d023 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:14.951813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ccd6ea87-54bb-417d-8aad-3ebaefd3d023 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:14.952283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ccd6ea87-54bb-417d-8aad-3ebaefd3d023 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:14.953064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ccd6ea87-54bb-417d-8aad-3ebaefd3d023 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:14.953500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ccd6ea87-54bb-417d-8aad-3ebaefd3d023 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:15.094398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ccd6ea87-54bb-417d-8aad-3ebaefd3d023 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:15.102195 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ccd6ea87-54bb-417d-8aad-3ebaefd3d023 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.169511 Jul 20 05:00:15.102774 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3479/6721] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:14 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:16.120534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-81e3915b-c229-4131-a818-ae0f4e05f467 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:16.121156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-81e3915b-c229-4131-a818-ae0f4e05f467 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:16.128705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81e3915b-c229-4131-a818-ae0f4e05f467 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:16.129176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81e3915b-c229-4131-a818-ae0f4e05f467 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:16.129937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81e3915b-c229-4131-a818-ae0f4e05f467 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:16.130410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81e3915b-c229-4131-a818-ae0f4e05f467 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:16.274437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-81e3915b-c229-4131-a818-ae0f4e05f467 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:16.284279 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-81e3915b-c229-4131-a818-ae0f4e05f467 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.167885 Jul 20 05:00:16.284882 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3243/6722] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:16 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:17.302311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a61da67b-10eb-4a85-b804-f800dae48c45 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:17.302885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a61da67b-10eb-4a85-b804-f800dae48c45 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:17.310135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a61da67b-10eb-4a85-b804-f800dae48c45 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:17.310621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a61da67b-10eb-4a85-b804-f800dae48c45 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:17.311396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a61da67b-10eb-4a85-b804-f800dae48c45 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:17.311836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a61da67b-10eb-4a85-b804-f800dae48c45 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:17.453464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a61da67b-10eb-4a85-b804-f800dae48c45 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:17.461607 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a61da67b-10eb-4a85-b804-f800dae48c45 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.163471 Jul 20 05:00:17.462175 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3480/6723] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:17 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:18.483089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2dbb2b17-7b1b-4743-ab6c-19d8bac5b7bf tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:18.483748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2dbb2b17-7b1b-4743-ab6c-19d8bac5b7bf tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:18.491396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2dbb2b17-7b1b-4743-ab6c-19d8bac5b7bf tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:18.491860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2dbb2b17-7b1b-4743-ab6c-19d8bac5b7bf tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:18.493035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2dbb2b17-7b1b-4743-ab6c-19d8bac5b7bf tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:18.493495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2dbb2b17-7b1b-4743-ab6c-19d8bac5b7bf tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:18.635657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2dbb2b17-7b1b-4743-ab6c-19d8bac5b7bf tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:18.644208 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2dbb2b17-7b1b-4743-ab6c-19d8bac5b7bf tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.167534 Jul 20 05:00:18.645126 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3244/6724] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:18 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:19.661966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a6ff1f9a-6854-4b8c-90c0-53d03ec3195a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:19.662578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a6ff1f9a-6854-4b8c-90c0-53d03ec3195a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:19.670729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a6ff1f9a-6854-4b8c-90c0-53d03ec3195a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:19.671323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a6ff1f9a-6854-4b8c-90c0-53d03ec3195a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:19.672091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a6ff1f9a-6854-4b8c-90c0-53d03ec3195a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:19.672561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a6ff1f9a-6854-4b8c-90c0-53d03ec3195a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:19.822022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a6ff1f9a-6854-4b8c-90c0-53d03ec3195a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:19.831384 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a6ff1f9a-6854-4b8c-90c0-53d03ec3195a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.173823 Jul 20 05:00:19.831976 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3481/6725] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:19 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:20.849613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-553daa32-c28e-4f51-b49a-dceac14cae1d tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:20.850288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-553daa32-c28e-4f51-b49a-dceac14cae1d tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:20.858404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-553daa32-c28e-4f51-b49a-dceac14cae1d tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:20.858863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-553daa32-c28e-4f51-b49a-dceac14cae1d tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:20.859626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-553daa32-c28e-4f51-b49a-dceac14cae1d tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:20.860064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-553daa32-c28e-4f51-b49a-dceac14cae1d tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:21.008451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-553daa32-c28e-4f51-b49a-dceac14cae1d tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:21.017244 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-553daa32-c28e-4f51-b49a-dceac14cae1d tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.172031 Jul 20 05:00:21.017827 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3245/6726] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:20 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:22.039122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f699262c-a781-43a6-8681-8d677ecfd55c tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:22.040136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f699262c-a781-43a6-8681-8d677ecfd55c tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:22.051912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f699262c-a781-43a6-8681-8d677ecfd55c tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:22.052718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f699262c-a781-43a6-8681-8d677ecfd55c tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:22.054001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f699262c-a781-43a6-8681-8d677ecfd55c tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:22.054774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f699262c-a781-43a6-8681-8d677ecfd55c tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:22.196018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f699262c-a781-43a6-8681-8d677ecfd55c tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:22.208138 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f699262c-a781-43a6-8681-8d677ecfd55c tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.175594 Jul 20 05:00:22.209021 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3482/6727] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:22 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:23.234440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d918f2d4-443b-4385-b151-ad2b8318092a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:23.235076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d918f2d4-443b-4385-b151-ad2b8318092a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:23.242604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d918f2d4-443b-4385-b151-ad2b8318092a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:23.243067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d918f2d4-443b-4385-b151-ad2b8318092a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:23.243836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d918f2d4-443b-4385-b151-ad2b8318092a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:23.244317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d918f2d4-443b-4385-b151-ad2b8318092a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:23.385481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d918f2d4-443b-4385-b151-ad2b8318092a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:23.397679 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d918f2d4-443b-4385-b151-ad2b8318092a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.168226 Jul 20 05:00:23.398596 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3246/6728] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:23 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:24.420768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-086ce01b-129a-481d-83f8-9cc09bc168e7 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:24.421436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-086ce01b-129a-481d-83f8-9cc09bc168e7 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:24.428862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-086ce01b-129a-481d-83f8-9cc09bc168e7 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:24.429314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-086ce01b-129a-481d-83f8-9cc09bc168e7 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:24.430085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-086ce01b-129a-481d-83f8-9cc09bc168e7 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:24.430527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-086ce01b-129a-481d-83f8-9cc09bc168e7 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:24.570709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-086ce01b-129a-481d-83f8-9cc09bc168e7 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:24.580106 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-086ce01b-129a-481d-83f8-9cc09bc168e7 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.163280 Jul 20 05:00:24.580734 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3483/6729] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:24 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:25.599649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2c1c2e67-d578-44c6-819d-d290dabe4776 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:25.600078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2c1c2e67-d578-44c6-819d-d290dabe4776 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:25.608203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c1c2e67-d578-44c6-819d-d290dabe4776 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:25.608717 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c1c2e67-d578-44c6-819d-d290dabe4776 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:25.609543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c1c2e67-d578-44c6-819d-d290dabe4776 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:25.610006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c1c2e67-d578-44c6-819d-d290dabe4776 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:25.753489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2c1c2e67-d578-44c6-819d-d290dabe4776 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:25.766511 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2c1c2e67-d578-44c6-819d-d290dabe4776 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.171603 Jul 20 05:00:25.767459 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3247/6730] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:25 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:26.791000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-03bd831e-0d21-4b96-9a3b-ffd8c0c004c4 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:26.791744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-03bd831e-0d21-4b96-9a3b-ffd8c0c004c4 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:26.799944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03bd831e-0d21-4b96-9a3b-ffd8c0c004c4 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:26.800450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03bd831e-0d21-4b96-9a3b-ffd8c0c004c4 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:26.801199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03bd831e-0d21-4b96-9a3b-ffd8c0c004c4 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:26.801638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03bd831e-0d21-4b96-9a3b-ffd8c0c004c4 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:26.942344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-03bd831e-0d21-4b96-9a3b-ffd8c0c004c4 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:26.950411 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-03bd831e-0d21-4b96-9a3b-ffd8c0c004c4 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1515 microversion: 2.1 time: 0.164807 Jul 20 05:00:26.951063 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3484/6731] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:26 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:27.967271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-985bdb48-db29-4fd0-8780-0fa80f8fca6b tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:27.967929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-985bdb48-db29-4fd0-8780-0fa80f8fca6b tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:27.975129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-985bdb48-db29-4fd0-8780-0fa80f8fca6b tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:27.975598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-985bdb48-db29-4fd0-8780-0fa80f8fca6b tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:27.976514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-985bdb48-db29-4fd0-8780-0fa80f8fca6b tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:27.976950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-985bdb48-db29-4fd0-8780-0fa80f8fca6b tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:28.207993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-985bdb48-db29-4fd0-8780-0fa80f8fca6b tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:28.216696 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-985bdb48-db29-4fd0-8780-0fa80f8fca6b tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1514 microversion: 2.1 time: 0.253166 Jul 20 05:00:28.226772 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3248/6732] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:27 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:28.290930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-986c51b7-e5e6-4a8d-835e-d4ed3b93022b req-35395788-5091-4089-aec7-0b25b5ac8ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6334645c-31f6-48bb-8e2c-ce1903195893", "name": "network-vif-unplugged", "status": "completed", "tag": "8e4fc832-fed0-40b4-b06e-fa673ed4f935"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:28.295503 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=28 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:28.302593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-986c51b7-e5e6-4a8d-835e-d4ed3b93022b req-35395788-5091-4089-aec7-0b25b5ac8ad9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:28.303033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-986c51b7-e5e6-4a8d-835e-d4ed3b93022b req-35395788-5091-4089-aec7-0b25b5ac8ad9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:28.313205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=84 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:28.315786 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-986c51b7-e5e6-4a8d-835e-d4ed3b93022b req-35395788-5091-4089-aec7-0b25b5ac8ad9 service nova] Creating event network-vif-unplugged:8e4fc832-fed0-40b4-b06e-fa673ed4f935 for instance 6334645c-31f6-48bb-8e2c-ce1903195893 on n-h1-826526-5 Jul 20 05:00:28.321606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-986c51b7-e5e6-4a8d-835e-d4ed3b93022b req-35395788-5091-4089-aec7-0b25b5ac8ad9 service nova] Instance 6334645c-31f6-48bb-8e2c-ce1903195893 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:00:28.332905 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-986c51b7-e5e6-4a8d-835e-d4ed3b93022b req-35395788-5091-4089-aec7-0b25b5ac8ad9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046026 Jul 20 05:00:28.333751 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3485/6733] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:29.236892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4eb3965a-3339-43b1-aef0-9fe4d9e1d92d tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:29.237513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4eb3965a-3339-43b1-aef0-9fe4d9e1d92d tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:29.240486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=32 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:29.246650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4eb3965a-3339-43b1-aef0-9fe4d9e1d92d tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:29.247132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4eb3965a-3339-43b1-aef0-9fe4d9e1d92d tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:29.247951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4eb3965a-3339-43b1-aef0-9fe4d9e1d92d tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:29.248459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4eb3965a-3339-43b1-aef0-9fe4d9e1d92d tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:29.251535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:29.412035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4eb3965a-3339-43b1-aef0-9fe4d9e1d92d tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:29.420442 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4eb3965a-3339-43b1-aef0-9fe4d9e1d92d tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1512 microversion: 2.1 time: 0.188145 Jul 20 05:00:29.421014 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3249/6734] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:29 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1512 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:30.351961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-378cb874-d00a-4753-bdd3-60402a7e863e req-8c5f990c-0f26-49db-ae74-828649f036ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6334645c-31f6-48bb-8e2c-ce1903195893", "tag": "8e4fc832-fed0-40b4-b06e-fa673ed4f935"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:30.361307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-378cb874-d00a-4753-bdd3-60402a7e863e req-8c5f990c-0f26-49db-ae74-828649f036ba service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:30.361749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-378cb874-d00a-4753-bdd3-60402a7e863e req-8c5f990c-0f26-49db-ae74-828649f036ba service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:30.374048 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-378cb874-d00a-4753-bdd3-60402a7e863e req-8c5f990c-0f26-49db-ae74-828649f036ba service nova] Creating event network-changed:8e4fc832-fed0-40b4-b06e-fa673ed4f935 for instance 6334645c-31f6-48bb-8e2c-ce1903195893 on n-h1-826526-5 Jul 20 05:00:30.379977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-378cb874-d00a-4753-bdd3-60402a7e863e req-8c5f990c-0f26-49db-ae74-828649f036ba service nova] Instance 6334645c-31f6-48bb-8e2c-ce1903195893 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:00:30.391703 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-378cb874-d00a-4753-bdd3-60402a7e863e req-8c5f990c-0f26-49db-ae74-828649f036ba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044976 Jul 20 05:00:30.392333 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3486/6735] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:30.440351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7e742aba-ea7e-4c61-96f7-65e9664250b6 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:30.440971 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7e742aba-ea7e-4c61-96f7-65e9664250b6 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:30.449995 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e742aba-ea7e-4c61-96f7-65e9664250b6 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:30.450535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e742aba-ea7e-4c61-96f7-65e9664250b6 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:30.451736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e742aba-ea7e-4c61-96f7-65e9664250b6 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:30.452560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7e742aba-ea7e-4c61-96f7-65e9664250b6 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:30.660854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7e742aba-ea7e-4c61-96f7-65e9664250b6 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:30.669028 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7e742aba-ea7e-4c61-96f7-65e9664250b6 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1512 microversion: 2.1 time: 0.234409 Jul 20 05:00:30.670011 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3250/6736] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:30 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1512 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:31.688965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-91a8a693-fdd3-4362-8477-c98f0d0b8006 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:31.689660 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-91a8a693-fdd3-4362-8477-c98f0d0b8006 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:31.696579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91a8a693-fdd3-4362-8477-c98f0d0b8006 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:31.697028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91a8a693-fdd3-4362-8477-c98f0d0b8006 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:31.697792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91a8a693-fdd3-4362-8477-c98f0d0b8006 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:31.698224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-91a8a693-fdd3-4362-8477-c98f0d0b8006 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:31.847134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-91a8a693-fdd3-4362-8477-c98f0d0b8006 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:31.855006 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-91a8a693-fdd3-4362-8477-c98f0d0b8006 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1509 microversion: 2.1 time: 0.171571 Jul 20 05:00:31.855579 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3487/6737] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:31 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:31.871066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-636e3053-fd18-488c-8714-f29106ada99b tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:31.871653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-636e3053-fd18-488c-8714-f29106ada99b tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:31.878844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-636e3053-fd18-488c-8714-f29106ada99b tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:31.879307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-636e3053-fd18-488c-8714-f29106ada99b tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:31.880136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-636e3053-fd18-488c-8714-f29106ada99b tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:31.880541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-636e3053-fd18-488c-8714-f29106ada99b tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:31.906938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-636e3053-fd18-488c-8714-f29106ada99b tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:00:31.963742 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.compute.api [None req-636e3053-fd18-488c-8714-f29106ada99b tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Found an unconfirmed migration during delete, id: 16, status: finished Jul 20 05:00:33.345860 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-636e3053-fd18-488c-8714-f29106ada99b tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 204 len: 0 microversion: 2.1 time: 1.478366 Jul 20 05:00:33.349588 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3251/6738] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:00:31 2022] DELETE /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 0 bytes in 1480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:00:33.354853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f38cbc56-83a1-4b64-8a73-353694c0a98e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:33.355941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f38cbc56-83a1-4b64-8a73-353694c0a98e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:33.363266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f38cbc56-83a1-4b64-8a73-353694c0a98e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:33.363862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f38cbc56-83a1-4b64-8a73-353694c0a98e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:33.364593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f38cbc56-83a1-4b64-8a73-353694c0a98e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:33.365031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f38cbc56-83a1-4b64-8a73-353694c0a98e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:33.499441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f38cbc56-83a1-4b64-8a73-353694c0a98e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:33.511768 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f38cbc56-83a1-4b64-8a73-353694c0a98e tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1501 microversion: 2.1 time: 0.160517 Jul 20 05:00:33.512522 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3488/6739] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:33 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:33.968382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-b397b112-e502-4904-a92b-b5662e883772 req-3049728c-63b0-4235-875a-572e82292835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6334645c-31f6-48bb-8e2c-ce1903195893", "name": "network-vif-plugged", "status": "completed", "tag": "8e4fc832-fed0-40b4-b06e-fa673ed4f935"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:33.979375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b397b112-e502-4904-a92b-b5662e883772 req-3049728c-63b0-4235-875a-572e82292835 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:33.979844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b397b112-e502-4904-a92b-b5662e883772 req-3049728c-63b0-4235-875a-572e82292835 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:33.991282 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-b397b112-e502-4904-a92b-b5662e883772 req-3049728c-63b0-4235-875a-572e82292835 service nova] Creating event network-vif-plugged:8e4fc832-fed0-40b4-b06e-fa673ed4f935 for instance 6334645c-31f6-48bb-8e2c-ce1903195893 on n-h1-826526-5 Jul 20 05:00:33.996207 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-b397b112-e502-4904-a92b-b5662e883772 req-3049728c-63b0-4235-875a-572e82292835 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032911 Jul 20 05:00:33.996968 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3252/6740] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:34.532054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-13c27b6c-4589-4071-adde-72fa19f846da tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:34.532734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-13c27b6c-4589-4071-adde-72fa19f846da tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:34.542761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13c27b6c-4589-4071-adde-72fa19f846da tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:34.543109 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13c27b6c-4589-4071-adde-72fa19f846da tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:34.543993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13c27b6c-4589-4071-adde-72fa19f846da tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:34.544551 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13c27b6c-4589-4071-adde-72fa19f846da tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:34.698355 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-13c27b6c-4589-4071-adde-72fa19f846da tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c457262a143ffbc880b6661f75b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3043987777554ce1b8860247b1c1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:34.705967 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-13c27b6c-4589-4071-adde-72fa19f846da tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 200 len: 1501 microversion: 2.1 time: 0.179107 Jul 20 05:00:34.706554 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3489/6741] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:34 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 1501 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:35.131763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e5df1b23-f1cc-45fe-a8e9-7c441df9314e req-3ed713f9-8dc8-4359-821a-8b65902ae4ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6334645c-31f6-48bb-8e2c-ce1903195893", "name": "network-vif-deleted", "tag": "8e4fc832-fed0-40b4-b06e-fa673ed4f935"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:35.142681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e5df1b23-f1cc-45fe-a8e9-7c441df9314e req-3ed713f9-8dc8-4359-821a-8b65902ae4ed service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:35.143435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e5df1b23-f1cc-45fe-a8e9-7c441df9314e req-3ed713f9-8dc8-4359-821a-8b65902ae4ed service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:35.155315 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e5df1b23-f1cc-45fe-a8e9-7c441df9314e req-3ed713f9-8dc8-4359-821a-8b65902ae4ed service nova] Creating event network-vif-deleted:8e4fc832-fed0-40b4-b06e-fa673ed4f935 for instance 6334645c-31f6-48bb-8e2c-ce1903195893 on n-h1-826526-5 Jul 20 05:00:35.160496 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e5df1b23-f1cc-45fe-a8e9-7c441df9314e req-3ed713f9-8dc8-4359-821a-8b65902ae4ed service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034925 Jul 20 05:00:35.161489 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3253/6742] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:35.232058 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:00:35.232559 n-d-826526-5 devstack@n-api.service[127870]: Wed Jul 20 05:00:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:00:35.723583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fbb34919-08fa-4358-9aea-c51c3c8b9b64 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:35.724157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fbb34919-08fa-4358-9aea-c51c3c8b9b64 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:35.731545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fbb34919-08fa-4358-9aea-c51c3c8b9b64 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:35.732101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fbb34919-08fa-4358-9aea-c51c3c8b9b64 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:35.732929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fbb34919-08fa-4358-9aea-c51c3c8b9b64 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:35.733370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fbb34919-08fa-4358-9aea-c51c3c8b9b64 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:35.747246 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-fbb34919-08fa-4358-9aea-c51c3c8b9b64 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] HTTP exception thrown: Instance 6334645c-31f6-48bb-8e2c-ce1903195893 could not be found. Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fbb34919-08fa-4358-9aea-c51c3c8b9b64 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Request method failure captured: Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 HTTP/1.1 Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14vDJKpcIa-gtG-5K96lfGl5QYnHXHM7oizI8k04Vxx_Io7ILEwtG-MgJJfaphEQhMabavUpj37FLC6vU7pZBaKrHJm8egIULOpvzdQlA6ZYm8kwXAy4JxkuodlUljATIGi-ujHewJiGfyb4cwX8wFsFi-L8ZFo0QAb7y4Unm-KU0aA Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 3043987777554ce1b8860247b1c1567b Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1280168688 Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3043987777554ce1b8860247b1c1567b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3043987777554ce1b8860247b1c1567b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3043987777554ce1b8860247b1c1567b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3043987777554ce1b8860247b1c1567b"}]}] Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1280168688 Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 3043987777554ce1b8860247b1c1567b Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1280168688 Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1280168688-project Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 043c457262a143ffbc880b6661f75b17 Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1280168688-project Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 6334645c-31f6-48bb-8e2c-ce1903195893 could not be found. Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '6334645c-31f6-48bb-8e2c-ce1903195893'} Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6334645c-31f6-48bb-8e2c-ce1903195893 could not be found. Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6334645c-31f6-48bb-8e2c-ce1903195893 could not be found. Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:35.748962 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:00:35.754624 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:35.754624 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:35.754624 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:35.754624 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:00:35.754624 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:00:35.754624 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6334645c-31f6-48bb-8e2c-ce1903195893 could not be found. Jul 20 05:00:35.754624 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:00:35.754624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fbb34919-08fa-4358-9aea-c51c3c8b9b64 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Returning 404 to user: Instance 6334645c-31f6-48bb-8e2c-ce1903195893 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:00:35.754624 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fbb34919-08fa-4358-9aea-c51c3c8b9b64 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 404 len: 111 microversion: 2.1 time: 0.030934 Jul 20 05:00:35.754624 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3490/6743] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:35 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:00:35.765957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6cba65b8-bc1f-4c30-8527-e04e1714aff8 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:35.766561 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6cba65b8-bc1f-4c30-8527-e04e1714aff8 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:35.773553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6cba65b8-bc1f-4c30-8527-e04e1714aff8 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:35.774008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6cba65b8-bc1f-4c30-8527-e04e1714aff8 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:35.774786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6cba65b8-bc1f-4c30-8527-e04e1714aff8 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:35.775261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6cba65b8-bc1f-4c30-8527-e04e1714aff8 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:35.789090 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-6cba65b8-bc1f-4c30-8527-e04e1714aff8 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] HTTP exception thrown: Instance 6334645c-31f6-48bb-8e2c-ce1903195893 could not be found. Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6cba65b8-bc1f-4c30-8527-e04e1714aff8 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Request method failure captured: Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 HTTP/1.1 Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14vDJKpcIa-gtG-5K96lfGl5QYnHXHM7oizI8k04Vxx_Io7ILEwtG-MgJJfaphEQhMabavUpj37FLC6vU7pZBaKrHJm8egIULOpvzdQlA6ZYm8kwXAy4JxkuodlUljATIGi-ujHewJiGfyb4cwX8wFsFi-L8ZFo0QAb7y4Unm-KU0aA Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 3043987777554ce1b8860247b1c1567b Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-DeleteServersTestJSON-1280168688 Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3043987777554ce1b8860247b1c1567b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3043987777554ce1b8860247b1c1567b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3043987777554ce1b8860247b1c1567b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3043987777554ce1b8860247b1c1567b"}]}] Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-DeleteServersTestJSON-1280168688 Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 3043987777554ce1b8860247b1c1567b Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-DeleteServersTestJSON-1280168688 Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-DeleteServersTestJSON-1280168688-project Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 043c457262a143ffbc880b6661f75b17 Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-DeleteServersTestJSON-1280168688-project Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 6334645c-31f6-48bb-8e2c-ce1903195893 could not be found. Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '6334645c-31f6-48bb-8e2c-ce1903195893'} Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6334645c-31f6-48bb-8e2c-ce1903195893 could not be found. Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:00:35.790810 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:00:35.795853 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6334645c-31f6-48bb-8e2c-ce1903195893 could not be found. Jul 20 05:00:35.795853 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:00:35.795853 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:35.795853 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:00:35.795853 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:35.795853 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:35.795853 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:35.795853 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:00:35.795853 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:00:35.795853 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6334645c-31f6-48bb-8e2c-ce1903195893 could not be found. Jul 20 05:00:35.795853 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:00:35.795853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6cba65b8-bc1f-4c30-8527-e04e1714aff8 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Returning 404 to user: Instance 6334645c-31f6-48bb-8e2c-ce1903195893 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:00:35.795853 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6cba65b8-bc1f-4c30-8527-e04e1714aff8 tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 404 len: 111 microversion: 2.1 time: 0.030767 Jul 20 05:00:35.795853 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3254/6744] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:00:35 2022] DELETE /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:00:35.801463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bc1af8b1-df49-481b-bb31-e5e3e4a3f39a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:35.802084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bc1af8b1-df49-481b-bb31-e5e3e4a3f39a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] [instance: 6334645c-31f6-48bb-8e2c-ce1903195893] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:35.808699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc1af8b1-df49-481b-bb31-e5e3e4a3f39a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:35.809152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc1af8b1-df49-481b-bb31-e5e3e4a3f39a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:35.809943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc1af8b1-df49-481b-bb31-e5e3e4a3f39a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:35.810364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bc1af8b1-df49-481b-bb31-e5e3e4a3f39a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:35.824351 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-bc1af8b1-df49-481b-bb31-e5e3e4a3f39a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] HTTP exception thrown: Instance 6334645c-31f6-48bb-8e2c-ce1903195893 could not be found. Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bc1af8b1-df49-481b-bb31-e5e3e4a3f39a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Request method failure captured: Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 HTTP/1.1 Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14vDJKpcIa-gtG-5K96lfGl5QYnHXHM7oizI8k04Vxx_Io7ILEwtG-MgJJfaphEQhMabavUpj37FLC6vU7pZBaKrHJm8egIULOpvzdQlA6ZYm8kwXAy4JxkuodlUljATIGi-ujHewJiGfyb4cwX8wFsFi-L8ZFo0QAb7y4Unm-KU0aA Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 3043987777554ce1b8860247b1c1567b Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-DeleteServersTestJSON-1280168688 Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3043987777554ce1b8860247b1c1567b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3043987777554ce1b8860247b1c1567b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3043987777554ce1b8860247b1c1567b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3043987777554ce1b8860247b1c1567b"}]}] Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-DeleteServersTestJSON-1280168688 Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 3043987777554ce1b8860247b1c1567b Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1280168688 Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-DeleteServersTestJSON-1280168688-project Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 043c457262a143ffbc880b6661f75b17 Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-DeleteServersTestJSON-1280168688-project Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 6334645c-31f6-48bb-8e2c-ce1903195893 could not be found. Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '6334645c-31f6-48bb-8e2c-ce1903195893'} Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6334645c-31f6-48bb-8e2c-ce1903195893 could not be found. Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6334645c-31f6-48bb-8e2c-ce1903195893 could not be found. Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:35.826004 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:00:35.831386 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:35.831386 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:35.831386 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:35.831386 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:00:35.831386 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:00:35.831386 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6334645c-31f6-48bb-8e2c-ce1903195893 could not be found. Jul 20 05:00:35.831386 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:00:35.831386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bc1af8b1-df49-481b-bb31-e5e3e4a3f39a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] Returning 404 to user: Instance 6334645c-31f6-48bb-8e2c-ce1903195893 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:00:35.831386 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bc1af8b1-df49-481b-bb31-e5e3e4a3f39a tempest-DeleteServersTestJSON-1280168688 tempest-DeleteServersTestJSON-1280168688-project] 10.222.0.17 "GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893" status: 404 len: 111 microversion: 2.1 time: 0.029842 Jul 20 05:00:35.831386 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3491/6745] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:35 2022] GET /compute/v2.1/servers/6334645c-31f6-48bb-8e2c-ce1903195893 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:00:41.671966 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:00:41.672644 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:00:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:00:45.039135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-62901856-2d46-4e63-bf1e-e0c4961ba427 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1856997543", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "b5f65407-eff7-427d-8f1b-90ca91891dc5"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:45.100539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-62901856-2d46-4e63-bf1e-e0c4961ba427 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] validate_networks() for [('b5f65407-eff7-427d-8f1b-90ca91891dc5', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:00:45.577182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-62901856-2d46-4e63-bf1e-e0c4961ba427 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:00:45.577709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-62901856-2d46-4e63-bf1e-e0c4961ba427 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:00:45.578259 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-62901856-2d46-4e63-bf1e-e0c4961ba427 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:00:45.578790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-62901856-2d46-4e63-bf1e-e0c4961ba427 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:00:45.579270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-62901856-2d46-4e63-bf1e-e0c4961ba427 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:00:45.593011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62901856-2d46-4e63-bf1e-e0c4961ba427 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:45.593566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62901856-2d46-4e63-bf1e-e0c4961ba427 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:45.594438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62901856-2d46-4e63-bf1e-e0c4961ba427 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:45.594953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62901856-2d46-4e63-bf1e-e0c4961ba427 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:45.615728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-62901856-2d46-4e63-bf1e-e0c4961ba427 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Getting quotas for project 6517d6bf02fd4f8ab4b08fe971213a05. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:00:45.622174 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-62901856-2d46-4e63-bf1e-e0c4961ba427 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Getting quotas for user fb52a348825240f087f44d56aaa42cc4 and project 6517d6bf02fd4f8ab4b08fe971213a05. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:00:45.635885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62901856-2d46-4e63-bf1e-e0c4961ba427 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:00:45.638487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62901856-2d46-4e63-bf1e-e0c4961ba427 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:00:45.688776 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-62901856-2d46-4e63-bf1e-e0c4961ba427 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.811840 Jul 20 05:00:45.695243 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3255/6746] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:00:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:00:45.701451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9ecde9a9-cde7-4e0b-9ddb-340d1716b716 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:45.701893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9ecde9a9-cde7-4e0b-9ddb-340d1716b716 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:45.765559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9ecde9a9-cde7-4e0b-9ddb-340d1716b716 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:45.776558 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9ecde9a9-cde7-4e0b-9ddb-340d1716b716 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1218 microversion: 2.1 time: 0.079802 Jul 20 05:00:45.777269 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3492/6747] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:45 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:46.798134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-717a010d-f1d6-47a0-9867-68940b376ccf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:46.798781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-717a010d-f1d6-47a0-9867-68940b376ccf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:46.806624 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-717a010d-f1d6-47a0-9867-68940b376ccf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:46.807690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-717a010d-f1d6-47a0-9867-68940b376ccf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:46.808558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-717a010d-f1d6-47a0-9867-68940b376ccf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:46.809012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-717a010d-f1d6-47a0-9867-68940b376ccf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:46.901540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-717a010d-f1d6-47a0-9867-68940b376ccf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:46.912131 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-717a010d-f1d6-47a0-9867-68940b376ccf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1288 microversion: 2.1 time: 0.120117 Jul 20 05:00:46.913086 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3256/6748] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:46 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1288 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:47.930594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-25989466-44d5-478f-ac88-8d443e63da1b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:47.931213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-25989466-44d5-478f-ac88-8d443e63da1b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:47.934359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=29 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:47.945178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-25989466-44d5-478f-ac88-8d443e63da1b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:47.947250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-25989466-44d5-478f-ac88-8d443e63da1b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:47.948284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-25989466-44d5-478f-ac88-8d443e63da1b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:47.949355 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-25989466-44d5-478f-ac88-8d443e63da1b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:48.222054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-25989466-44d5-478f-ac88-8d443e63da1b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:48.231839 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-25989466-44d5-478f-ac88-8d443e63da1b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1318 microversion: 2.1 time: 0.305032 Jul 20 05:00:48.232838 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3493/6749] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:47 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:48.355900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-14b1acc0-02e5-4188-986f-db89ce3308ce req-1c63ff68-c971-4aff-bdda-90e2db8de148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14540834-fcd8-4705-9c4e-8e6a3e8896ee", "tag": "a9449cec-1612-44e8-b273-f6594baf53a5"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:48.379902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-14b1acc0-02e5-4188-986f-db89ce3308ce req-1c63ff68-c971-4aff-bdda-90e2db8de148 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:48.380771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-14b1acc0-02e5-4188-986f-db89ce3308ce req-1c63ff68-c971-4aff-bdda-90e2db8de148 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:48.401557 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-14b1acc0-02e5-4188-986f-db89ce3308ce req-1c63ff68-c971-4aff-bdda-90e2db8de148 service nova] Creating event network-changed:a9449cec-1612-44e8-b273-f6594baf53a5 for instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee on n-h1-826526-5 Jul 20 05:00:48.411188 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-14b1acc0-02e5-4188-986f-db89ce3308ce req-1c63ff68-c971-4aff-bdda-90e2db8de148 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058863 Jul 20 05:00:48.412939 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3257/6750] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:49.249911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-742f39db-6280-40c2-9f27-7c05f8133e28 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:49.250550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-742f39db-6280-40c2-9f27-7c05f8133e28 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:49.258045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-742f39db-6280-40c2-9f27-7c05f8133e28 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:49.258494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-742f39db-6280-40c2-9f27-7c05f8133e28 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:49.259255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-742f39db-6280-40c2-9f27-7c05f8133e28 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:49.259687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-742f39db-6280-40c2-9f27-7c05f8133e28 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:49.405653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-742f39db-6280-40c2-9f27-7c05f8133e28 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:49.417477 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-742f39db-6280-40c2-9f27-7c05f8133e28 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1318 microversion: 2.1 time: 0.171220 Jul 20 05:00:49.418166 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3494/6751] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:49 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:50.437133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fe776fe8-b8eb-413d-a51c-7417b32f6b1a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:50.437837 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fe776fe8-b8eb-413d-a51c-7417b32f6b1a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:50.445130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe776fe8-b8eb-413d-a51c-7417b32f6b1a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:50.445609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe776fe8-b8eb-413d-a51c-7417b32f6b1a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:50.446406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe776fe8-b8eb-413d-a51c-7417b32f6b1a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:50.446870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe776fe8-b8eb-413d-a51c-7417b32f6b1a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:50.582315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fe776fe8-b8eb-413d-a51c-7417b32f6b1a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:50.590219 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fe776fe8-b8eb-413d-a51c-7417b32f6b1a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1318 microversion: 2.1 time: 0.158368 Jul 20 05:00:50.590825 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3258/6752] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:50 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:51.608957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-82b2ff00-b8f1-4389-802d-16e19ab4bd61 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:51.609616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-82b2ff00-b8f1-4389-802d-16e19ab4bd61 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:51.616967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82b2ff00-b8f1-4389-802d-16e19ab4bd61 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:51.617417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82b2ff00-b8f1-4389-802d-16e19ab4bd61 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:51.618186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82b2ff00-b8f1-4389-802d-16e19ab4bd61 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:51.618643 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82b2ff00-b8f1-4389-802d-16e19ab4bd61 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:51.766227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-82b2ff00-b8f1-4389-802d-16e19ab4bd61 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:51.774331 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-82b2ff00-b8f1-4389-802d-16e19ab4bd61 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1318 microversion: 2.1 time: 0.170237 Jul 20 05:00:51.774888 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3495/6753] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:51 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:52.796182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ad97b987-3bf5-4053-828b-faa19074f208 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:52.797274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ad97b987-3bf5-4053-828b-faa19074f208 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:52.810020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad97b987-3bf5-4053-828b-faa19074f208 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:52.810203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad97b987-3bf5-4053-828b-faa19074f208 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:52.811033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad97b987-3bf5-4053-828b-faa19074f208 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:52.811498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad97b987-3bf5-4053-828b-faa19074f208 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:52.958728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ad97b987-3bf5-4053-828b-faa19074f208 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:52.967488 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ad97b987-3bf5-4053-828b-faa19074f208 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1318 microversion: 2.1 time: 0.178013 Jul 20 05:00:52.968078 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3259/6754] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:52 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:53.985340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8c92862f-fdc2-4777-afe7-b2d18c7f2bd7 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:53.985973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8c92862f-fdc2-4777-afe7-b2d18c7f2bd7 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:53.993729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c92862f-fdc2-4777-afe7-b2d18c7f2bd7 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:53.994184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c92862f-fdc2-4777-afe7-b2d18c7f2bd7 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:53.994967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c92862f-fdc2-4777-afe7-b2d18c7f2bd7 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:53.995407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c92862f-fdc2-4777-afe7-b2d18c7f2bd7 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:54.143627 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8c92862f-fdc2-4777-afe7-b2d18c7f2bd7 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:54.152597 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8c92862f-fdc2-4777-afe7-b2d18c7f2bd7 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1318 microversion: 2.1 time: 0.171394 Jul 20 05:00:54.153711 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3496/6755] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:53 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:54.159382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-6870b97a-2d9a-4944-85e0-96ab4bb06aee req-fae1600f-4d54-4a1d-afef-469d8e32f0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14540834-fcd8-4705-9c4e-8e6a3e8896ee", "name": "network-vif-plugged", "status": "completed", "tag": "a9449cec-1612-44e8-b273-f6594baf53a5"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:54.170112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6870b97a-2d9a-4944-85e0-96ab4bb06aee req-fae1600f-4d54-4a1d-afef-469d8e32f0f6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:54.171477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6870b97a-2d9a-4944-85e0-96ab4bb06aee req-fae1600f-4d54-4a1d-afef-469d8e32f0f6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:54.183559 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-6870b97a-2d9a-4944-85e0-96ab4bb06aee req-fae1600f-4d54-4a1d-afef-469d8e32f0f6 service nova] Creating event network-vif-plugged:a9449cec-1612-44e8-b273-f6594baf53a5 for instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee on n-h1-826526-5 Jul 20 05:00:54.188745 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-6870b97a-2d9a-4944-85e0-96ab4bb06aee req-fae1600f-4d54-4a1d-afef-469d8e32f0f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037467 Jul 20 05:00:54.189302 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3260/6756] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:55.173091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f46200d7-2d95-41a3-b0d1-97f1c54f371f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:55.173714 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f46200d7-2d95-41a3-b0d1-97f1c54f371f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:55.183952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f46200d7-2d95-41a3-b0d1-97f1c54f371f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:55.184564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f46200d7-2d95-41a3-b0d1-97f1c54f371f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:55.185625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f46200d7-2d95-41a3-b0d1-97f1c54f371f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:55.186059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f46200d7-2d95-41a3-b0d1-97f1c54f371f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:55.334207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f46200d7-2d95-41a3-b0d1-97f1c54f371f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:55.342720 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f46200d7-2d95-41a3-b0d1-97f1c54f371f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1318 microversion: 2.1 time: 0.175431 Jul 20 05:00:55.343273 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3497/6757] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:55 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:56.358102 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:56.358861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:56.363600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-89258940-4233-4fb5-9552-1fc37e413a30 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:56.364324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-89258940-4233-4fb5-9552-1fc37e413a30 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:56.371550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89258940-4233-4fb5-9552-1fc37e413a30 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:56.372006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89258940-4233-4fb5-9552-1fc37e413a30 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:56.372830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89258940-4233-4fb5-9552-1fc37e413a30 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:56.373278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89258940-4233-4fb5-9552-1fc37e413a30 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:56.522512 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-89258940-4233-4fb5-9552-1fc37e413a30 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:56.533970 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-89258940-4233-4fb5-9552-1fc37e413a30 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1507 microversion: 2.1 time: 0.177436 Jul 20 05:00:56.534702 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3261/6758] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:56 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:56.555583 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-520da123-5436-4d62-a076-509ddf6d0bb6 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:56.556208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-520da123-5436-4d62-a076-509ddf6d0bb6 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:56.558240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:56.564848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-520da123-5436-4d62-a076-509ddf6d0bb6 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:56.565310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-520da123-5436-4d62-a076-509ddf6d0bb6 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:56.566093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-520da123-5436-4d62-a076-509ddf6d0bb6 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:56.566544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-520da123-5436-4d62-a076-509ddf6d0bb6 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:56.699902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-520da123-5436-4d62-a076-509ddf6d0bb6 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:56.708157 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-520da123-5436-4d62-a076-509ddf6d0bb6 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1507 microversion: 2.1 time: 0.156615 Jul 20 05:00:56.708774 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3498/6759] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:56 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:56.728369 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0d0036b0-145e-4995-8447-9b7324f80355 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:56.729551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0d0036b0-145e-4995-8447-9b7324f80355 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:56.736055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d0036b0-145e-4995-8447-9b7324f80355 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:56.736570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d0036b0-145e-4995-8447-9b7324f80355 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:56.737417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d0036b0-145e-4995-8447-9b7324f80355 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:56.737867 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d0036b0-145e-4995-8447-9b7324f80355 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:56.805984 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0d0036b0-145e-4995-8447-9b7324f80355 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "PUT /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1079 microversion: 2.1 time: 0.081458 Jul 20 05:00:56.806536 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3262/6760] 10.222.0.17 () {60 vars in 1255 bytes} [Wed Jul 20 05:00:56 2022] PUT /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1079 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:56.823125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c40e37e4-cd46-4f2c-9ef5-43bfdcef25fd tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:56.823938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c40e37e4-cd46-4f2c-9ef5-43bfdcef25fd tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:56.833186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c40e37e4-cd46-4f2c-9ef5-43bfdcef25fd tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:56.833867 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c40e37e4-cd46-4f2c-9ef5-43bfdcef25fd tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:56.835047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c40e37e4-cd46-4f2c-9ef5-43bfdcef25fd tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:56.835862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c40e37e4-cd46-4f2c-9ef5-43bfdcef25fd tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:56.985217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c40e37e4-cd46-4f2c-9ef5-43bfdcef25fd tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:56.997258 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c40e37e4-cd46-4f2c-9ef5-43bfdcef25fd tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1505 microversion: 2.1 time: 0.179810 Jul 20 05:00:56.998160 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3499/6761] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:56 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:57.014059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a14079a9-3f3b-4258-890a-82d90eca31b5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:57.014682 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a14079a9-3f3b-4258-890a-82d90eca31b5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:57.021063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a14079a9-3f3b-4258-890a-82d90eca31b5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:57.021516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a14079a9-3f3b-4258-890a-82d90eca31b5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:57.022273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a14079a9-3f3b-4258-890a-82d90eca31b5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:57.022715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a14079a9-3f3b-4258-890a-82d90eca31b5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:57.157986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a14079a9-3f3b-4258-890a-82d90eca31b5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:57.166248 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a14079a9-3f3b-4258-890a-82d90eca31b5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1505 microversion: 2.1 time: 0.156053 Jul 20 05:00:57.166817 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3263/6762] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:57 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:57.182992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3aa26316-d7b9-4cf7-8849-600f5839d046 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:57.183990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3aa26316-d7b9-4cf7-8849-600f5839d046 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:57.190381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3aa26316-d7b9-4cf7-8849-600f5839d046 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:57.190831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3aa26316-d7b9-4cf7-8849-600f5839d046 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:57.191592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3aa26316-d7b9-4cf7-8849-600f5839d046 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:57.192027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3aa26316-d7b9-4cf7-8849-600f5839d046 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:57.221226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3aa26316-d7b9-4cf7-8849-600f5839d046 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:57.227490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3aa26316-d7b9-4cf7-8849-600f5839d046 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Old instance type m1.heat2, new instance type m1.heat {{(pid=127871) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:00:57.234193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-3aa26316-d7b9-4cf7-8849-600f5839d046 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:00:57.234612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-3aa26316-d7b9-4cf7-8849-600f5839d046 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:00:57.235149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-3aa26316-d7b9-4cf7-8849-600f5839d046 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:00:57.235559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-3aa26316-d7b9-4cf7-8849-600f5839d046 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:00:57.235970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-3aa26316-d7b9-4cf7-8849-600f5839d046 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:00:57.310887 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3aa26316-d7b9-4cf7-8849-600f5839d046 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "POST /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee/action" status: 202 len: 0 microversion: 2.1 time: 0.131869 Jul 20 05:00:57.311572 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3500/6763] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:00:57 2022] POST /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:00:57.319875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-43cae62b-f1d4-4f2e-9fe7-18e6c4324adf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:57.320689 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-43cae62b-f1d4-4f2e-9fe7-18e6c4324adf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:57.327003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43cae62b-f1d4-4f2e-9fe7-18e6c4324adf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:57.327471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43cae62b-f1d4-4f2e-9fe7-18e6c4324adf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:57.328251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43cae62b-f1d4-4f2e-9fe7-18e6c4324adf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:57.328841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43cae62b-f1d4-4f2e-9fe7-18e6c4324adf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:57.491313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-43cae62b-f1d4-4f2e-9fe7-18e6c4324adf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:57.498872 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-43cae62b-f1d4-4f2e-9fe7-18e6c4324adf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1516 microversion: 2.1 time: 0.182942 Jul 20 05:00:57.499446 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3264/6764] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:57 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:58.517978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f17cf0b1-e2ce-436b-9160-d9b7b3495048 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:58.518609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f17cf0b1-e2ce-436b-9160-d9b7b3495048 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:58.522310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=38 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:58.538934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f17cf0b1-e2ce-436b-9160-d9b7b3495048 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:58.539394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f17cf0b1-e2ce-436b-9160-d9b7b3495048 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:58.540188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f17cf0b1-e2ce-436b-9160-d9b7b3495048 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:58.540656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f17cf0b1-e2ce-436b-9160-d9b7b3495048 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:58.701517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f17cf0b1-e2ce-436b-9160-d9b7b3495048 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:58.709684 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f17cf0b1-e2ce-436b-9160-d9b7b3495048 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1516 microversion: 2.1 time: 0.196358 Jul 20 05:00:58.710264 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3501/6765] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:58 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1516 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:59.731494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-62d0984e-4f35-4a1b-8340-67d80b060c3f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:59.732527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62d0984e-4f35-4a1b-8340-67d80b060c3f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:59.736917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:59.749030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62d0984e-4f35-4a1b-8340-67d80b060c3f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:59.750109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62d0984e-4f35-4a1b-8340-67d80b060c3f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:59.751115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62d0984e-4f35-4a1b-8340-67d80b060c3f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:59.751807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62d0984e-4f35-4a1b-8340-67d80b060c3f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:59.757608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:59.889895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-62d0984e-4f35-4a1b-8340-67d80b060c3f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:59.898012 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-62d0984e-4f35-4a1b-8340-67d80b060c3f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.173297 Jul 20 05:00:59.898617 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3265/6766] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:59 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:00.920732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ac6da029-4e33-42f9-ad9f-54db4a55fea5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:00.921640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ac6da029-4e33-42f9-ad9f-54db4a55fea5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:00.929603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac6da029-4e33-42f9-ad9f-54db4a55fea5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:00.930054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac6da029-4e33-42f9-ad9f-54db4a55fea5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:00.930862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac6da029-4e33-42f9-ad9f-54db4a55fea5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:00.931288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac6da029-4e33-42f9-ad9f-54db4a55fea5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:01.067305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ac6da029-4e33-42f9-ad9f-54db4a55fea5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:01.075611 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ac6da029-4e33-42f9-ad9f-54db4a55fea5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.161932 Jul 20 05:01:01.076200 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3502/6767] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:00 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:02.094601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-26c460b6-a03e-4211-81db-bb56d7690252 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:02.095218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-26c460b6-a03e-4211-81db-bb56d7690252 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:02.102438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26c460b6-a03e-4211-81db-bb56d7690252 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:02.102902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26c460b6-a03e-4211-81db-bb56d7690252 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:02.103675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26c460b6-a03e-4211-81db-bb56d7690252 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:02.104120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26c460b6-a03e-4211-81db-bb56d7690252 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:02.236566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-26c460b6-a03e-4211-81db-bb56d7690252 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:02.244697 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-26c460b6-a03e-4211-81db-bb56d7690252 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.154809 Jul 20 05:01:02.245316 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3266/6768] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:02 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:03.265483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ef5b1792-199b-46d8-a5cf-381a9bd643db tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:03.266192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ef5b1792-199b-46d8-a5cf-381a9bd643db tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:03.273847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef5b1792-199b-46d8-a5cf-381a9bd643db tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:03.274339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef5b1792-199b-46d8-a5cf-381a9bd643db tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:03.275118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef5b1792-199b-46d8-a5cf-381a9bd643db tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:03.275555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef5b1792-199b-46d8-a5cf-381a9bd643db tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:03.431126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ef5b1792-199b-46d8-a5cf-381a9bd643db tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:03.442174 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ef5b1792-199b-46d8-a5cf-381a9bd643db tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.182899 Jul 20 05:01:03.442756 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3503/6769] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:03 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:04.459375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3d391a74-7f21-4981-a0fe-9ec35b51672e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:04.460110 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3d391a74-7f21-4981-a0fe-9ec35b51672e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:04.468251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d391a74-7f21-4981-a0fe-9ec35b51672e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:04.468756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d391a74-7f21-4981-a0fe-9ec35b51672e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:04.469556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d391a74-7f21-4981-a0fe-9ec35b51672e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:04.470000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d391a74-7f21-4981-a0fe-9ec35b51672e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:04.613225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3d391a74-7f21-4981-a0fe-9ec35b51672e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:04.621899 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3d391a74-7f21-4981-a0fe-9ec35b51672e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.166574 Jul 20 05:01:04.627477 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3267/6770] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:04 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:05.639684 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e20350df-f7bc-45e1-81ac-1d22cd8d18f5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:05.640420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e20350df-f7bc-45e1-81ac-1d22cd8d18f5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:05.648194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e20350df-f7bc-45e1-81ac-1d22cd8d18f5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:05.648642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e20350df-f7bc-45e1-81ac-1d22cd8d18f5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:05.649456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e20350df-f7bc-45e1-81ac-1d22cd8d18f5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:05.649892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e20350df-f7bc-45e1-81ac-1d22cd8d18f5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:05.794842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e20350df-f7bc-45e1-81ac-1d22cd8d18f5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:05.806501 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e20350df-f7bc-45e1-81ac-1d22cd8d18f5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.170825 Jul 20 05:01:05.807709 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3504/6771] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:05 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:06.831364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dcfeaa5c-db11-4e74-bb3f-67c50e3c4790 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:06.831978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dcfeaa5c-db11-4e74-bb3f-67c50e3c4790 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:06.839220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcfeaa5c-db11-4e74-bb3f-67c50e3c4790 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:06.839769 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcfeaa5c-db11-4e74-bb3f-67c50e3c4790 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:06.840776 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcfeaa5c-db11-4e74-bb3f-67c50e3c4790 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:06.841374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dcfeaa5c-db11-4e74-bb3f-67c50e3c4790 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:06.978293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dcfeaa5c-db11-4e74-bb3f-67c50e3c4790 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:06.986231 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dcfeaa5c-db11-4e74-bb3f-67c50e3c4790 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.161525 Jul 20 05:01:06.986920 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3268/6772] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:06 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:08.005995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-123424b8-0e7f-4f75-a12d-9fe0a8771a95 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:08.006978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-123424b8-0e7f-4f75-a12d-9fe0a8771a95 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:08.014797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-123424b8-0e7f-4f75-a12d-9fe0a8771a95 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:08.015257 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-123424b8-0e7f-4f75-a12d-9fe0a8771a95 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:08.016027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-123424b8-0e7f-4f75-a12d-9fe0a8771a95 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:08.016520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-123424b8-0e7f-4f75-a12d-9fe0a8771a95 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:08.167613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-123424b8-0e7f-4f75-a12d-9fe0a8771a95 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:08.179298 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-123424b8-0e7f-4f75-a12d-9fe0a8771a95 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.177712 Jul 20 05:01:08.179919 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3505/6773] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:07 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:09.204250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4e806b06-d622-4f97-a900-e94b0382c1d3 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:09.205137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4e806b06-d622-4f97-a900-e94b0382c1d3 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:09.213605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e806b06-d622-4f97-a900-e94b0382c1d3 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:09.214109 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e806b06-d622-4f97-a900-e94b0382c1d3 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:09.214948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e806b06-d622-4f97-a900-e94b0382c1d3 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:09.215407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e806b06-d622-4f97-a900-e94b0382c1d3 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:09.367826 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4e806b06-d622-4f97-a900-e94b0382c1d3 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:09.380242 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4e806b06-d622-4f97-a900-e94b0382c1d3 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.182546 Jul 20 05:01:09.380870 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3269/6774] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:09 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:10.402042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-802d53e2-1967-4fe5-9090-3aab91849d8e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:10.402824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-802d53e2-1967-4fe5-9090-3aab91849d8e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:10.412919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-802d53e2-1967-4fe5-9090-3aab91849d8e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:10.413371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-802d53e2-1967-4fe5-9090-3aab91849d8e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:10.414167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-802d53e2-1967-4fe5-9090-3aab91849d8e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:10.414601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-802d53e2-1967-4fe5-9090-3aab91849d8e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:10.560594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-802d53e2-1967-4fe5-9090-3aab91849d8e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:10.572340 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-802d53e2-1967-4fe5-9090-3aab91849d8e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.176986 Jul 20 05:01:10.573185 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3506/6775] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:10 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:11.594547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-786b36d3-86f3-4d76-bf8d-0a8a841ac709 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:11.595631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-786b36d3-86f3-4d76-bf8d-0a8a841ac709 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:11.604955 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-786b36d3-86f3-4d76-bf8d-0a8a841ac709 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:11.605401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-786b36d3-86f3-4d76-bf8d-0a8a841ac709 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:11.606230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-786b36d3-86f3-4d76-bf8d-0a8a841ac709 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:11.606671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-786b36d3-86f3-4d76-bf8d-0a8a841ac709 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:11.746093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-786b36d3-86f3-4d76-bf8d-0a8a841ac709 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:11.754548 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-786b36d3-86f3-4d76-bf8d-0a8a841ac709 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.166806 Jul 20 05:01:11.755129 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3270/6776] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:11 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:12.772352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fee99198-1b8b-4245-8e10-8e1af6e177cf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:12.772951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fee99198-1b8b-4245-8e10-8e1af6e177cf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:12.780386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fee99198-1b8b-4245-8e10-8e1af6e177cf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:12.780929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fee99198-1b8b-4245-8e10-8e1af6e177cf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:12.781743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fee99198-1b8b-4245-8e10-8e1af6e177cf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:12.782183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fee99198-1b8b-4245-8e10-8e1af6e177cf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:12.928037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fee99198-1b8b-4245-8e10-8e1af6e177cf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:12.938501 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fee99198-1b8b-4245-8e10-8e1af6e177cf tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.170191 Jul 20 05:01:12.939243 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3507/6777] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:12 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:13.964844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-49bb9ed5-ccff-4cfe-baa0-43dc08fd4b40 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:13.965725 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-49bb9ed5-ccff-4cfe-baa0-43dc08fd4b40 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:13.976486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49bb9ed5-ccff-4cfe-baa0-43dc08fd4b40 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:13.976949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49bb9ed5-ccff-4cfe-baa0-43dc08fd4b40 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:13.977719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49bb9ed5-ccff-4cfe-baa0-43dc08fd4b40 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:13.978189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49bb9ed5-ccff-4cfe-baa0-43dc08fd4b40 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:14.128147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-49bb9ed5-ccff-4cfe-baa0-43dc08fd4b40 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:14.137803 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-49bb9ed5-ccff-4cfe-baa0-43dc08fd4b40 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.179678 Jul 20 05:01:14.138390 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3271/6778] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:13 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:01:15.163808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9470715a-42fc-42bb-83e8-86aca47b68a0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:15.165089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9470715a-42fc-42bb-83e8-86aca47b68a0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:15.177892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9470715a-42fc-42bb-83e8-86aca47b68a0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:15.178326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9470715a-42fc-42bb-83e8-86aca47b68a0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:15.179178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9470715a-42fc-42bb-83e8-86aca47b68a0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:15.179610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9470715a-42fc-42bb-83e8-86aca47b68a0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:15.183839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:15.324549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9470715a-42fc-42bb-83e8-86aca47b68a0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:15.336947 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9470715a-42fc-42bb-83e8-86aca47b68a0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.179406 Jul 20 05:01:15.337772 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3508/6779] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:15 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:16.362165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ede96c23-0e98-41ab-9027-13609faf4aad tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:16.363232 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ede96c23-0e98-41ab-9027-13609faf4aad tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:16.374536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ede96c23-0e98-41ab-9027-13609faf4aad tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:16.375220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ede96c23-0e98-41ab-9027-13609faf4aad tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:16.376474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ede96c23-0e98-41ab-9027-13609faf4aad tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:16.377164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ede96c23-0e98-41ab-9027-13609faf4aad tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:16.514056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ede96c23-0e98-41ab-9027-13609faf4aad tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:16.522596 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ede96c23-0e98-41ab-9027-13609faf4aad tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.166677 Jul 20 05:01:16.523151 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3272/6780] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:16 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:17.543053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-73055507-4507-40a8-b2e0-c324e40befbc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:17.543701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-73055507-4507-40a8-b2e0-c324e40befbc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:17.553589 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73055507-4507-40a8-b2e0-c324e40befbc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:17.554047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73055507-4507-40a8-b2e0-c324e40befbc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:17.554824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73055507-4507-40a8-b2e0-c324e40befbc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:17.555264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73055507-4507-40a8-b2e0-c324e40befbc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:17.703403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-73055507-4507-40a8-b2e0-c324e40befbc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:17.715950 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-73055507-4507-40a8-b2e0-c324e40befbc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.179299 Jul 20 05:01:17.716845 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3509/6781] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:17 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:18.736878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-08e75e63-a1c3-460a-b10e-151275baacc5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:18.737476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-08e75e63-a1c3-460a-b10e-151275baacc5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:18.745088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08e75e63-a1c3-460a-b10e-151275baacc5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:18.745554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08e75e63-a1c3-460a-b10e-151275baacc5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:18.746328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08e75e63-a1c3-460a-b10e-151275baacc5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:18.746778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08e75e63-a1c3-460a-b10e-151275baacc5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:18.887813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-08e75e63-a1c3-460a-b10e-151275baacc5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:18.895693 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-08e75e63-a1c3-460a-b10e-151275baacc5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.162774 Jul 20 05:01:18.896366 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3273/6782] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:18 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:19.918191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b19252e9-f0ca-4f80-a7ae-63396d08c067 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:19.918860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b19252e9-f0ca-4f80-a7ae-63396d08c067 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:19.928775 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b19252e9-f0ca-4f80-a7ae-63396d08c067 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:19.929308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b19252e9-f0ca-4f80-a7ae-63396d08c067 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:19.930227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b19252e9-f0ca-4f80-a7ae-63396d08c067 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:19.930754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b19252e9-f0ca-4f80-a7ae-63396d08c067 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:20.075385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b19252e9-f0ca-4f80-a7ae-63396d08c067 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:20.086424 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b19252e9-f0ca-4f80-a7ae-63396d08c067 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.175718 Jul 20 05:01:20.087016 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3510/6783] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:19 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:21.109917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-64c5c5e5-de10-4973-964a-810b5f9fd591 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:21.110870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-64c5c5e5-de10-4973-964a-810b5f9fd591 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:21.120391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64c5c5e5-de10-4973-964a-810b5f9fd591 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:21.120853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64c5c5e5-de10-4973-964a-810b5f9fd591 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:21.121627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64c5c5e5-de10-4973-964a-810b5f9fd591 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:21.122068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64c5c5e5-de10-4973-964a-810b5f9fd591 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:21.270517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-64c5c5e5-de10-4973-964a-810b5f9fd591 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:21.279239 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-64c5c5e5-de10-4973-964a-810b5f9fd591 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.177022 Jul 20 05:01:21.279866 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3274/6784] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:21 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:22.302428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0f10aeb6-473c-4718-8305-e2617b352972 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:22.303203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0f10aeb6-473c-4718-8305-e2617b352972 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:22.315144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f10aeb6-473c-4718-8305-e2617b352972 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:22.315825 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f10aeb6-473c-4718-8305-e2617b352972 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:22.317181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f10aeb6-473c-4718-8305-e2617b352972 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:22.317890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0f10aeb6-473c-4718-8305-e2617b352972 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:22.466847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0f10aeb6-473c-4718-8305-e2617b352972 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:22.478142 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0f10aeb6-473c-4718-8305-e2617b352972 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.182207 Jul 20 05:01:22.478948 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3511/6785] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:22 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:23.499392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fdcdf686-006f-41af-bfa9-5899d61b9441 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:23.500026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fdcdf686-006f-41af-bfa9-5899d61b9441 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:23.508317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fdcdf686-006f-41af-bfa9-5899d61b9441 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:23.508704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fdcdf686-006f-41af-bfa9-5899d61b9441 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:23.509484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fdcdf686-006f-41af-bfa9-5899d61b9441 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:23.509926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fdcdf686-006f-41af-bfa9-5899d61b9441 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:23.650964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fdcdf686-006f-41af-bfa9-5899d61b9441 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:23.662906 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fdcdf686-006f-41af-bfa9-5899d61b9441 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.167201 Jul 20 05:01:23.663829 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3275/6786] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:23 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:24.683296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b799660a-fdfc-4788-a36a-f059b5207f9f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:24.683900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b799660a-fdfc-4788-a36a-f059b5207f9f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:24.692013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b799660a-fdfc-4788-a36a-f059b5207f9f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:24.692640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b799660a-fdfc-4788-a36a-f059b5207f9f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:24.693406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b799660a-fdfc-4788-a36a-f059b5207f9f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:24.693886 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b799660a-fdfc-4788-a36a-f059b5207f9f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:24.838834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b799660a-fdfc-4788-a36a-f059b5207f9f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:24.850883 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b799660a-fdfc-4788-a36a-f059b5207f9f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.173572 Jul 20 05:01:24.851481 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3512/6787] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:24 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:25.870805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2dc8324f-1989-4a09-8fe7-4b4f25caa510 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:25.871491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2dc8324f-1989-4a09-8fe7-4b4f25caa510 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:25.881802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2dc8324f-1989-4a09-8fe7-4b4f25caa510 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:25.882402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2dc8324f-1989-4a09-8fe7-4b4f25caa510 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:25.883328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2dc8324f-1989-4a09-8fe7-4b4f25caa510 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:25.883860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2dc8324f-1989-4a09-8fe7-4b4f25caa510 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:26.300994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2dc8324f-1989-4a09-8fe7-4b4f25caa510 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:26.309006 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2dc8324f-1989-4a09-8fe7-4b4f25caa510 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1521 microversion: 2.1 time: 0.444574 Jul 20 05:01:26.309578 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3276/6788] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:25 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:26.748571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-11bef47e-dc7d-435d-ad6b-1122a401f3f5 req-c2566633-a5ed-49de-84ba-c92a5b84b9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14540834-fcd8-4705-9c4e-8e6a3e8896ee", "name": "network-vif-unplugged", "status": "completed", "tag": "a9449cec-1612-44e8-b273-f6594baf53a5"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:26.758784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-11bef47e-dc7d-435d-ad6b-1122a401f3f5 req-c2566633-a5ed-49de-84ba-c92a5b84b9d6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:26.759310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-11bef47e-dc7d-435d-ad6b-1122a401f3f5 req-c2566633-a5ed-49de-84ba-c92a5b84b9d6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:26.772422 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-11bef47e-dc7d-435d-ad6b-1122a401f3f5 req-c2566633-a5ed-49de-84ba-c92a5b84b9d6 service nova] Creating event network-vif-unplugged:a9449cec-1612-44e8-b273-f6594baf53a5 for instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee on n-h2-826526-5 Jul 20 05:01:26.780701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-11bef47e-dc7d-435d-ad6b-1122a401f3f5 req-c2566633-a5ed-49de-84ba-c92a5b84b9d6 service nova] Instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:01:26.794732 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-11bef47e-dc7d-435d-ad6b-1122a401f3f5 req-c2566633-a5ed-49de-84ba-c92a5b84b9d6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049627 Jul 20 05:01:26.795518 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3513/6789] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:01:27.326787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5239f029-4887-40f2-a44e-700dc8d966fa tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:27.327443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5239f029-4887-40f2-a44e-700dc8d966fa tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:27.335062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5239f029-4887-40f2-a44e-700dc8d966fa tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:27.335524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5239f029-4887-40f2-a44e-700dc8d966fa tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:27.336316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5239f029-4887-40f2-a44e-700dc8d966fa tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:27.336805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5239f029-4887-40f2-a44e-700dc8d966fa tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:27.470018 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5239f029-4887-40f2-a44e-700dc8d966fa tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:27.477921 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5239f029-4887-40f2-a44e-700dc8d966fa tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1520 microversion: 2.1 time: 0.155356 Jul 20 05:01:27.478819 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3277/6790] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:27 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:28.498724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b45e9a08-28ea-4f3d-b8c4-0eb74d19ab02 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:28.499544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b45e9a08-28ea-4f3d-b8c4-0eb74d19ab02 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:28.508793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b45e9a08-28ea-4f3d-b8c4-0eb74d19ab02 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:28.509326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b45e9a08-28ea-4f3d-b8c4-0eb74d19ab02 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:28.510225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b45e9a08-28ea-4f3d-b8c4-0eb74d19ab02 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:28.510934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b45e9a08-28ea-4f3d-b8c4-0eb74d19ab02 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:28.651337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b45e9a08-28ea-4f3d-b8c4-0eb74d19ab02 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:28.659042 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b45e9a08-28ea-4f3d-b8c4-0eb74d19ab02 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1518 microversion: 2.1 time: 0.166146 Jul 20 05:01:28.659624 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3514/6791] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:28 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:28.812448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-0febda21-5ab7-4748-93fd-5a3ec2dd5fe3 req-d0a305bb-3e19-42f8-89c5-e45373a9239e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14540834-fcd8-4705-9c4e-8e6a3e8896ee", "tag": "a9449cec-1612-44e8-b273-f6594baf53a5"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:28.822440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0febda21-5ab7-4748-93fd-5a3ec2dd5fe3 req-d0a305bb-3e19-42f8-89c5-e45373a9239e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:28.822898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0febda21-5ab7-4748-93fd-5a3ec2dd5fe3 req-d0a305bb-3e19-42f8-89c5-e45373a9239e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:28.835465 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-0febda21-5ab7-4748-93fd-5a3ec2dd5fe3 req-d0a305bb-3e19-42f8-89c5-e45373a9239e service nova] Creating event network-changed:a9449cec-1612-44e8-b273-f6594baf53a5 for instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee on n-h2-826526-5 Jul 20 05:01:28.841358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [req-0febda21-5ab7-4748-93fd-5a3ec2dd5fe3 req-d0a305bb-3e19-42f8-89c5-e45373a9239e service nova] Instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:01:28.852489 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-0febda21-5ab7-4748-93fd-5a3ec2dd5fe3 req-d0a305bb-3e19-42f8-89c5-e45373a9239e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043957 Jul 20 05:01:28.853124 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3278/6792] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:01:29.679996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d40c40c4-86fa-438f-a7e3-591f42982a98 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:29.680601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d40c40c4-86fa-438f-a7e3-591f42982a98 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:29.684603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=28 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:29.691561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d40c40c4-86fa-438f-a7e3-591f42982a98 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:29.692147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d40c40c4-86fa-438f-a7e3-591f42982a98 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:29.693420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d40c40c4-86fa-438f-a7e3-591f42982a98 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:29.694085 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d40c40c4-86fa-438f-a7e3-591f42982a98 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:29.848713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d40c40c4-86fa-438f-a7e3-591f42982a98 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:29.856714 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d40c40c4-86fa-438f-a7e3-591f42982a98 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1515 microversion: 2.1 time: 0.183170 Jul 20 05:01:29.857314 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3515/6793] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:29 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:29.874773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8dfd524f-f1bc-4009-9e6d-78cb96ee4b27 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:29.875400 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8dfd524f-f1bc-4009-9e6d-78cb96ee4b27 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:29.877389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=28 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:29.883634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8dfd524f-f1bc-4009-9e6d-78cb96ee4b27 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:29.884100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8dfd524f-f1bc-4009-9e6d-78cb96ee4b27 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:29.884935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8dfd524f-f1bc-4009-9e6d-78cb96ee4b27 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:29.885383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8dfd524f-f1bc-4009-9e6d-78cb96ee4b27 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:29.888609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=82 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:29.950503 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8dfd524f-f1bc-4009-9e6d-78cb96ee4b27 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "POST /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee/action" status: 204 len: 0 microversion: 2.1 time: 0.080493 Jul 20 05:01:29.951061 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3279/6794] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:01:29 2022] POST /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:01:29.959451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a6cb13a3-10ce-49c6-b671-e764ee6de3d8 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:29.960155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a6cb13a3-10ce-49c6-b671-e764ee6de3d8 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:29.966518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a6cb13a3-10ce-49c6-b671-e764ee6de3d8 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:29.966975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a6cb13a3-10ce-49c6-b671-e764ee6de3d8 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:29.967735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a6cb13a3-10ce-49c6-b671-e764ee6de3d8 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:29.968164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a6cb13a3-10ce-49c6-b671-e764ee6de3d8 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:30.103615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a6cb13a3-10ce-49c6-b671-e764ee6de3d8 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:30.111920 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a6cb13a3-10ce-49c6-b671-e764ee6de3d8 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1515 microversion: 2.1 time: 0.156348 Jul 20 05:01:30.112559 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3516/6795] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:29 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:31.130674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1004828d-a3f3-4cd5-a3b1-86af5750b0c4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:31.132613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1004828d-a3f3-4cd5-a3b1-86af5750b0c4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:31.140597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1004828d-a3f3-4cd5-a3b1-86af5750b0c4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:31.141072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1004828d-a3f3-4cd5-a3b1-86af5750b0c4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:31.141876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1004828d-a3f3-4cd5-a3b1-86af5750b0c4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:31.142357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1004828d-a3f3-4cd5-a3b1-86af5750b0c4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:31.180862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-7dca2a8c-4510-4223-8b63-bb2de82ab97a req-11388eda-ae17-4e5c-a27b-b10dd69c8534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14540834-fcd8-4705-9c4e-8e6a3e8896ee", "name": "network-vif-plugged", "status": "completed", "tag": "a9449cec-1612-44e8-b273-f6594baf53a5"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:31.190335 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7dca2a8c-4510-4223-8b63-bb2de82ab97a req-11388eda-ae17-4e5c-a27b-b10dd69c8534 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:31.190888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7dca2a8c-4510-4223-8b63-bb2de82ab97a req-11388eda-ae17-4e5c-a27b-b10dd69c8534 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:31.204096 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-7dca2a8c-4510-4223-8b63-bb2de82ab97a req-11388eda-ae17-4e5c-a27b-b10dd69c8534 service nova] Creating event network-vif-plugged:a9449cec-1612-44e8-b273-f6594baf53a5 for instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee on n-h2-826526-5 Jul 20 05:01:31.217388 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-7dca2a8c-4510-4223-8b63-bb2de82ab97a req-11388eda-ae17-4e5c-a27b-b10dd69c8534 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040423 Jul 20 05:01:31.218270 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3517/6796] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:01:31.292469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1004828d-a3f3-4cd5-a3b1-86af5750b0c4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:31.301299 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1004828d-a3f3-4cd5-a3b1-86af5750b0c4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1507 microversion: 2.1 time: 0.175329 Jul 20 05:01:31.301979 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3280/6797] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:31 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:31.321319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3f35754f-829b-4fa9-acb4-eeb782f55f82 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:31.322279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3f35754f-829b-4fa9-acb4-eeb782f55f82 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:31.328902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f35754f-829b-4fa9-acb4-eeb782f55f82 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:31.329440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f35754f-829b-4fa9-acb4-eeb782f55f82 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:31.330307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f35754f-829b-4fa9-acb4-eeb782f55f82 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:31.330805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3f35754f-829b-4fa9-acb4-eeb782f55f82 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:31.468634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3f35754f-829b-4fa9-acb4-eeb782f55f82 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:31.480797 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3f35754f-829b-4fa9-acb4-eeb782f55f82 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1507 microversion: 2.1 time: 0.164464 Jul 20 05:01:31.481684 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3518/6798] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:31 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:31.505712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cbd6b964-af37-48cd-9093-983c05acc255 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Action: 'create', calling method: .version_select at 0x7f06bc2f1e50>, body: {"keypair": {"name": "tempest-keypair-646284294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXGfwqh98h440yey5iJtYoOyXD0l28ayISEgCKhM9gmYEFLkxxmMo6qN0vo4CqyP+Vy3oDi4jiXZ81w1Wyk3bg50zotXNmIZDhCz8QTeyyolwOfU0YGJpo3DGdz4MBSuQ=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:31.520892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-cbd6b964-af37-48cd-9093-983c05acc255 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Getting quotas for project 6517d6bf02fd4f8ab4b08fe971213a05. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:01:31.526027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-cbd6b964-af37-48cd-9093-983c05acc255 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Getting quotas for user fb52a348825240f087f44d56aaa42cc4 and project 6517d6bf02fd4f8ab4b08fe971213a05. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:01:31.557947 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cbd6b964-af37-48cd-9093-983c05acc255 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056182 Jul 20 05:01:31.558588 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3281/6799] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 05:01:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:01:32.805964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2326d0d9-e1dc-42c1-9fee-b25b5fd562f1 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:32.806616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2326d0d9-e1dc-42c1-9fee-b25b5fd562f1 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:32.813527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2326d0d9-e1dc-42c1-9fee-b25b5fd562f1 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:32.813984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2326d0d9-e1dc-42c1-9fee-b25b5fd562f1 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:32.814752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2326d0d9-e1dc-42c1-9fee-b25b5fd562f1 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:32.815192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2326d0d9-e1dc-42c1-9fee-b25b5fd562f1 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:32.956847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2326d0d9-e1dc-42c1-9fee-b25b5fd562f1 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:32.964810 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2326d0d9-e1dc-42c1-9fee-b25b5fd562f1 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 200 len: 1507 microversion: 2.1 time: 0.162948 Jul 20 05:01:32.965364 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3519/6800] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:32 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:32.982502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-24beea29-d48c-4748-8291-e6571dce5201 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:32.983049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-24beea29-d48c-4748-8291-e6571dce5201 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:32.990324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24beea29-d48c-4748-8291-e6571dce5201 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:32.990812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24beea29-d48c-4748-8291-e6571dce5201 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:32.991589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24beea29-d48c-4748-8291-e6571dce5201 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:32.992038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24beea29-d48c-4748-8291-e6571dce5201 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:33.020922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-24beea29-d48c-4748-8291-e6571dce5201 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:01:33.107067 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-24beea29-d48c-4748-8291-e6571dce5201 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "DELETE /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 204 len: 0 microversion: 2.1 time: 0.129399 Jul 20 05:01:33.108375 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3282/6801] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:01:32 2022] DELETE /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:01:33.167351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e6611e0a-bda6-4f75-9e25-813237df2ebc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-783322024", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "b5f65407-eff7-427d-8f1b-90ca91891dc5"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:33.226116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-e6611e0a-bda6-4f75-9e25-813237df2ebc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] validate_networks() for [('b5f65407-eff7-427d-8f1b-90ca91891dc5', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:01:33.641164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-e6611e0a-bda6-4f75-9e25-813237df2ebc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:01:33.641589 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-e6611e0a-bda6-4f75-9e25-813237df2ebc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:01:33.642071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-e6611e0a-bda6-4f75-9e25-813237df2ebc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:01:33.642468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-e6611e0a-bda6-4f75-9e25-813237df2ebc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:01:33.642878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-e6611e0a-bda6-4f75-9e25-813237df2ebc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:01:33.654932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6611e0a-bda6-4f75-9e25-813237df2ebc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:33.655524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6611e0a-bda6-4f75-9e25-813237df2ebc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:33.656776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6611e0a-bda6-4f75-9e25-813237df2ebc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:33.657401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6611e0a-bda6-4f75-9e25-813237df2ebc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:33.682550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-e6611e0a-bda6-4f75-9e25-813237df2ebc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Getting quotas for project 6517d6bf02fd4f8ab4b08fe971213a05. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:01:33.688287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-e6611e0a-bda6-4f75-9e25-813237df2ebc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Getting quotas for user fb52a348825240f087f44d56aaa42cc4 and project 6517d6bf02fd4f8ab4b08fe971213a05. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:01:33.708792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e6611e0a-bda6-4f75-9e25-813237df2ebc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:01:33.711797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e6611e0a-bda6-4f75-9e25-813237df2ebc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:01:33.774111 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e6611e0a-bda6-4f75-9e25-813237df2ebc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610795 Jul 20 05:01:33.774843 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3520/6802] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:01:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:01:33.785970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ccff4c3b-78f5-4772-a02d-773deb7ac7c5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:33.786975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ccff4c3b-78f5-4772-a02d-773deb7ac7c5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:33.844862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ccff4c3b-78f5-4772-a02d-773deb7ac7c5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:33.852048 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ccff4c3b-78f5-4772-a02d-773deb7ac7c5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1217 microversion: 2.1 time: 0.070456 Jul 20 05:01:33.852664 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3283/6803] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:33 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:34.872510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5dcea886-3c37-4bcb-adb0-177b7687a6fa tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:34.873189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5dcea886-3c37-4bcb-adb0-177b7687a6fa tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:34.881549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dcea886-3c37-4bcb-adb0-177b7687a6fa tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:34.882293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dcea886-3c37-4bcb-adb0-177b7687a6fa tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:34.883074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dcea886-3c37-4bcb-adb0-177b7687a6fa tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:34.883512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dcea886-3c37-4bcb-adb0-177b7687a6fa tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:34.955927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-af70ac45-5d2e-4ded-9d57-dffe13604920 req-43fc4c27-7a07-4611-9299-070189a4104e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14540834-fcd8-4705-9c4e-8e6a3e8896ee", "name": "network-vif-deleted", "tag": "a9449cec-1612-44e8-b273-f6594baf53a5"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:34.969511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-af70ac45-5d2e-4ded-9d57-dffe13604920 req-43fc4c27-7a07-4611-9299-070189a4104e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:34.970056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-af70ac45-5d2e-4ded-9d57-dffe13604920 req-43fc4c27-7a07-4611-9299-070189a4104e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:34.986427 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-af70ac45-5d2e-4ded-9d57-dffe13604920 req-43fc4c27-7a07-4611-9299-070189a4104e service nova] Creating event network-vif-deleted:a9449cec-1612-44e8-b273-f6594baf53a5 for instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee on n-h2-826526-5 Jul 20 05:01:34.992892 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-af70ac45-5d2e-4ded-9d57-dffe13604920 req-43fc4c27-7a07-4611-9299-070189a4104e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040371 Jul 20 05:01:34.994063 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3284/6804] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:01:35.272180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5dcea886-3c37-4bcb-adb0-177b7687a6fa tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:35.280583 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5dcea886-3c37-4bcb-adb0-177b7687a6fa tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1287 microversion: 2.1 time: 0.413311 Jul 20 05:01:35.281183 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3521/6805] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:34 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1287 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:36.299546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ec04d2ff-b6df-4ce6-afb4-a90c84b9b4f6 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:36.300286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ec04d2ff-b6df-4ce6-afb4-a90c84b9b4f6 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:36.307341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec04d2ff-b6df-4ce6-afb4-a90c84b9b4f6 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:36.307887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec04d2ff-b6df-4ce6-afb4-a90c84b9b4f6 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:36.309140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec04d2ff-b6df-4ce6-afb4-a90c84b9b4f6 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:36.309140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec04d2ff-b6df-4ce6-afb4-a90c84b9b4f6 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:36.459765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ec04d2ff-b6df-4ce6-afb4-a90c84b9b4f6 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:36.468155 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ec04d2ff-b6df-4ce6-afb4-a90c84b9b4f6 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1317 microversion: 2.1 time: 0.173197 Jul 20 05:01:36.468927 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3285/6806] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:36 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:37.276249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-b62473f0-70fe-4ca0-abe1-afaa25c2f270 req-5c728ad6-7c99-442d-bec5-f637c7674616 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edded2a5-1b15-47a8-978e-779130339ce8", "tag": "2a0acc1f-46f3-4d75-a26f-df5f2ce98abd"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:37.286001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-b62473f0-70fe-4ca0-abe1-afaa25c2f270 req-5c728ad6-7c99-442d-bec5-f637c7674616 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:37.286446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-b62473f0-70fe-4ca0-abe1-afaa25c2f270 req-5c728ad6-7c99-442d-bec5-f637c7674616 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:37.298196 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-b62473f0-70fe-4ca0-abe1-afaa25c2f270 req-5c728ad6-7c99-442d-bec5-f637c7674616 service nova] Creating event network-changed:2a0acc1f-46f3-4d75-a26f-df5f2ce98abd for instance edded2a5-1b15-47a8-978e-779130339ce8 on n-h2-826526-5 Jul 20 05:01:37.303631 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-b62473f0-70fe-4ca0-abe1-afaa25c2f270 req-5c728ad6-7c99-442d-bec5-f637c7674616 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031148 Jul 20 05:01:37.304221 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3522/6807] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:01:37.490265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-092e43e4-dbad-48da-8afc-ca053c0d8d61 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:37.491233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-092e43e4-dbad-48da-8afc-ca053c0d8d61 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:37.499953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-092e43e4-dbad-48da-8afc-ca053c0d8d61 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:37.500465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-092e43e4-dbad-48da-8afc-ca053c0d8d61 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:37.501262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-092e43e4-dbad-48da-8afc-ca053c0d8d61 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:37.501729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-092e43e4-dbad-48da-8afc-ca053c0d8d61 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:37.641400 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-092e43e4-dbad-48da-8afc-ca053c0d8d61 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:37.649649 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-092e43e4-dbad-48da-8afc-ca053c0d8d61 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1317 microversion: 2.1 time: 0.166051 Jul 20 05:01:37.650292 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3286/6808] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:37 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:38.670316 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5e5fddfb-146f-45a8-9e28-aef9099f4c14 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:38.671014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5e5fddfb-146f-45a8-9e28-aef9099f4c14 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:38.678097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e5fddfb-146f-45a8-9e28-aef9099f4c14 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:38.679151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e5fddfb-146f-45a8-9e28-aef9099f4c14 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:38.679933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e5fddfb-146f-45a8-9e28-aef9099f4c14 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:38.680412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5e5fddfb-146f-45a8-9e28-aef9099f4c14 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:38.828092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5e5fddfb-146f-45a8-9e28-aef9099f4c14 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:38.836115 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5e5fddfb-146f-45a8-9e28-aef9099f4c14 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1317 microversion: 2.1 time: 0.171190 Jul 20 05:01:38.836767 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3523/6809] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:38 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:39.854636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e3e57113-25ed-427c-bac9-206c207df260 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:39.855312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e3e57113-25ed-427c-bac9-206c207df260 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:39.862553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3e57113-25ed-427c-bac9-206c207df260 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:39.863050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3e57113-25ed-427c-bac9-206c207df260 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:39.863828 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3e57113-25ed-427c-bac9-206c207df260 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:39.864304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3e57113-25ed-427c-bac9-206c207df260 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:39.999343 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e3e57113-25ed-427c-bac9-206c207df260 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:40.011297 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e3e57113-25ed-427c-bac9-206c207df260 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1317 microversion: 2.1 time: 0.161010 Jul 20 05:01:40.011890 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3287/6810] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:39 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:41.032949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ff20fc18-a688-4338-89e8-d319e41ef598 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:41.033910 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ff20fc18-a688-4338-89e8-d319e41ef598 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:41.043983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff20fc18-a688-4338-89e8-d319e41ef598 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:41.044479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff20fc18-a688-4338-89e8-d319e41ef598 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:41.045255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff20fc18-a688-4338-89e8-d319e41ef598 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:41.045699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ff20fc18-a688-4338-89e8-d319e41ef598 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:41.192074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ff20fc18-a688-4338-89e8-d319e41ef598 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:41.201522 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ff20fc18-a688-4338-89e8-d319e41ef598 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1317 microversion: 2.1 time: 0.175341 Jul 20 05:01:41.202520 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3524/6811] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:41 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:41.341688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-03b703e5-4744-4ea8-ac22-d337f45e3ec9 req-3d5edbb5-ddb5-4f6e-9d95-e5aa7a00e23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edded2a5-1b15-47a8-978e-779130339ce8", "name": "network-vif-plugged", "status": "completed", "tag": "2a0acc1f-46f3-4d75-a26f-df5f2ce98abd"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:41.350032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-03b703e5-4744-4ea8-ac22-d337f45e3ec9 req-3d5edbb5-ddb5-4f6e-9d95-e5aa7a00e23e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:41.350488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-03b703e5-4744-4ea8-ac22-d337f45e3ec9 req-3d5edbb5-ddb5-4f6e-9d95-e5aa7a00e23e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:41.362160 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-03b703e5-4744-4ea8-ac22-d337f45e3ec9 req-3d5edbb5-ddb5-4f6e-9d95-e5aa7a00e23e service nova] Creating event network-vif-plugged:2a0acc1f-46f3-4d75-a26f-df5f2ce98abd for instance edded2a5-1b15-47a8-978e-779130339ce8 on n-h2-826526-5 Jul 20 05:01:41.367161 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-03b703e5-4744-4ea8-ac22-d337f45e3ec9 req-3d5edbb5-ddb5-4f6e-9d95-e5aa7a00e23e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100413 Jul 20 05:01:41.367841 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3288/6812] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:01:42.222411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a16b7c8c-0ce4-4f34-a18c-88d570659330 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:42.223410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a16b7c8c-0ce4-4f34-a18c-88d570659330 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:42.232526 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a16b7c8c-0ce4-4f34-a18c-88d570659330 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:42.232974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a16b7c8c-0ce4-4f34-a18c-88d570659330 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:42.233742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a16b7c8c-0ce4-4f34-a18c-88d570659330 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:42.234183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a16b7c8c-0ce4-4f34-a18c-88d570659330 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:42.367233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a16b7c8c-0ce4-4f34-a18c-88d570659330 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:42.375051 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a16b7c8c-0ce4-4f34-a18c-88d570659330 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1317 microversion: 2.1 time: 0.159035 Jul 20 05:01:42.375644 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3525/6813] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:42 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:43.395030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-74b14e48-65ff-43ad-af35-259a7af81473 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:43.395620 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-74b14e48-65ff-43ad-af35-259a7af81473 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:43.403770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74b14e48-65ff-43ad-af35-259a7af81473 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:43.404225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74b14e48-65ff-43ad-af35-259a7af81473 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:43.405221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74b14e48-65ff-43ad-af35-259a7af81473 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:43.405733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74b14e48-65ff-43ad-af35-259a7af81473 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:43.559927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-74b14e48-65ff-43ad-af35-259a7af81473 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:43.568856 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-74b14e48-65ff-43ad-af35-259a7af81473 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1507 microversion: 2.1 time: 0.178956 Jul 20 05:01:43.569447 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3289/6814] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:43 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:43.585770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d0b2c572-3886-44e7-85aa-cb7c3311b92e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:43.586532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d0b2c572-3886-44e7-85aa-cb7c3311b92e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:43.594742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0b2c572-3886-44e7-85aa-cb7c3311b92e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:43.595231 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0b2c572-3886-44e7-85aa-cb7c3311b92e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:43.596011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0b2c572-3886-44e7-85aa-cb7c3311b92e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:43.596504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0b2c572-3886-44e7-85aa-cb7c3311b92e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:43.667167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:43.699434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:43.740574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d0b2c572-3886-44e7-85aa-cb7c3311b92e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:43.748871 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d0b2c572-3886-44e7-85aa-cb7c3311b92e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1507 microversion: 2.1 time: 0.167177 Jul 20 05:01:43.749423 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3526/6815] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:43 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:43.766901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e3fc05d6-c5fb-44f2-bcfa-be2ed58e418d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:43.768712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e3fc05d6-c5fb-44f2-bcfa-be2ed58e418d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:43.775611 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3fc05d6-c5fb-44f2-bcfa-be2ed58e418d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:43.776244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3fc05d6-c5fb-44f2-bcfa-be2ed58e418d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:43.777000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3fc05d6-c5fb-44f2-bcfa-be2ed58e418d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:43.777448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3fc05d6-c5fb-44f2-bcfa-be2ed58e418d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:43.808739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e3fc05d6-c5fb-44f2-bcfa-be2ed58e418d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:43.815489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e3fc05d6-c5fb-44f2-bcfa-be2ed58e418d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Old instance type m1.heat2, new instance type m1.heat {{(pid=127870) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:01:43.822845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e3fc05d6-c5fb-44f2-bcfa-be2ed58e418d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:01:43.823293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e3fc05d6-c5fb-44f2-bcfa-be2ed58e418d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:01:43.823793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e3fc05d6-c5fb-44f2-bcfa-be2ed58e418d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:01:43.824213 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e3fc05d6-c5fb-44f2-bcfa-be2ed58e418d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:01:43.824669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e3fc05d6-c5fb-44f2-bcfa-be2ed58e418d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:01:43.854080 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:43.894514 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e3fc05d6-c5fb-44f2-bcfa-be2ed58e418d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "POST /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8/action" status: 202 len: 0 microversion: 2.1 time: 0.132033 Jul 20 05:01:43.895151 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3290/6816] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:01:43 2022] POST /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:01:43.909013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1997b73d-2db4-49ff-89c6-e5efea2e0d30 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:43.909974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1997b73d-2db4-49ff-89c6-e5efea2e0d30 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:43.917006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1997b73d-2db4-49ff-89c6-e5efea2e0d30 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:43.917560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1997b73d-2db4-49ff-89c6-e5efea2e0d30 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:43.918393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1997b73d-2db4-49ff-89c6-e5efea2e0d30 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:43.918853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1997b73d-2db4-49ff-89c6-e5efea2e0d30 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:43.923292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=100 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:44.064789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1997b73d-2db4-49ff-89c6-e5efea2e0d30 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:44.073160 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1997b73d-2db4-49ff-89c6-e5efea2e0d30 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1514 microversion: 2.1 time: 0.172691 Jul 20 05:01:44.073854 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3527/6817] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:43 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:45.092141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-db6f1ffd-542c-4529-856f-5e7811d61c19 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:45.092935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-db6f1ffd-542c-4529-856f-5e7811d61c19 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:45.101921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db6f1ffd-542c-4529-856f-5e7811d61c19 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:45.102732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db6f1ffd-542c-4529-856f-5e7811d61c19 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:45.103765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db6f1ffd-542c-4529-856f-5e7811d61c19 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:45.104337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db6f1ffd-542c-4529-856f-5e7811d61c19 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:45.241056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-db6f1ffd-542c-4529-856f-5e7811d61c19 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:45.248990 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-db6f1ffd-542c-4529-856f-5e7811d61c19 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1514 microversion: 2.1 time: 0.160995 Jul 20 05:01:45.249796 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3291/6818] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:45 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:46.267471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-601616a4-3282-4c6c-be1f-c201e5782b68 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:46.268059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-601616a4-3282-4c6c-be1f-c201e5782b68 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:46.275725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-601616a4-3282-4c6c-be1f-c201e5782b68 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:46.276181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-601616a4-3282-4c6c-be1f-c201e5782b68 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:46.276991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-601616a4-3282-4c6c-be1f-c201e5782b68 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:46.277433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-601616a4-3282-4c6c-be1f-c201e5782b68 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:46.418071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-601616a4-3282-4c6c-be1f-c201e5782b68 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:46.426490 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-601616a4-3282-4c6c-be1f-c201e5782b68 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.163269 Jul 20 05:01:46.427083 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3528/6819] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:46 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:47.444652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-be77cc59-d625-41d4-9aaf-19b833ec7868 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:47.445326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-be77cc59-d625-41d4-9aaf-19b833ec7868 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:47.452807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be77cc59-d625-41d4-9aaf-19b833ec7868 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:47.453271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be77cc59-d625-41d4-9aaf-19b833ec7868 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:47.454064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be77cc59-d625-41d4-9aaf-19b833ec7868 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:47.454526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be77cc59-d625-41d4-9aaf-19b833ec7868 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:47.595017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-be77cc59-d625-41d4-9aaf-19b833ec7868 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:47.604557 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-be77cc59-d625-41d4-9aaf-19b833ec7868 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.163873 Jul 20 05:01:47.605124 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3292/6820] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:47 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:48.622820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-70815094-01a0-470b-8c80-cf2b3b1e6d1d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:48.623438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-70815094-01a0-470b-8c80-cf2b3b1e6d1d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:48.630884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70815094-01a0-470b-8c80-cf2b3b1e6d1d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:48.631647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70815094-01a0-470b-8c80-cf2b3b1e6d1d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:48.632446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70815094-01a0-470b-8c80-cf2b3b1e6d1d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:48.632881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70815094-01a0-470b-8c80-cf2b3b1e6d1d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:48.767004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-70815094-01a0-470b-8c80-cf2b3b1e6d1d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:48.775225 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-70815094-01a0-470b-8c80-cf2b3b1e6d1d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.156474 Jul 20 05:01:48.775824 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3529/6821] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:48 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:49.793140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c3c529ee-4fc0-42ed-a0da-3e231d9a5af4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:49.793832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c3c529ee-4fc0-42ed-a0da-3e231d9a5af4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:49.801339 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3c529ee-4fc0-42ed-a0da-3e231d9a5af4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:49.801806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3c529ee-4fc0-42ed-a0da-3e231d9a5af4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:49.802600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3c529ee-4fc0-42ed-a0da-3e231d9a5af4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:49.803078 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3c529ee-4fc0-42ed-a0da-3e231d9a5af4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:49.933403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c3c529ee-4fc0-42ed-a0da-3e231d9a5af4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:49.941705 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c3c529ee-4fc0-42ed-a0da-3e231d9a5af4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.152734 Jul 20 05:01:49.942290 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3293/6822] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:49 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:50.959472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9a88f229-e4f2-4c68-89ac-7e612c99fdcc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:50.960035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9a88f229-e4f2-4c68-89ac-7e612c99fdcc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:50.967622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a88f229-e4f2-4c68-89ac-7e612c99fdcc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:50.968076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a88f229-e4f2-4c68-89ac-7e612c99fdcc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:50.968883 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a88f229-e4f2-4c68-89ac-7e612c99fdcc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:50.969323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a88f229-e4f2-4c68-89ac-7e612c99fdcc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:51.104833 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9a88f229-e4f2-4c68-89ac-7e612c99fdcc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:51.112702 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9a88f229-e4f2-4c68-89ac-7e612c99fdcc tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.157271 Jul 20 05:01:51.113286 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3530/6823] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:50 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:52.131788 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-76b03d49-e791-4b8e-88a0-e1b16af3926b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:52.132451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-76b03d49-e791-4b8e-88a0-e1b16af3926b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:52.140609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76b03d49-e791-4b8e-88a0-e1b16af3926b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:52.141082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76b03d49-e791-4b8e-88a0-e1b16af3926b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:52.141876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76b03d49-e791-4b8e-88a0-e1b16af3926b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:52.142330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76b03d49-e791-4b8e-88a0-e1b16af3926b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:52.278713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-76b03d49-e791-4b8e-88a0-e1b16af3926b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:52.282269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:52.288210 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-76b03d49-e791-4b8e-88a0-e1b16af3926b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.162620 Jul 20 05:01:52.288895 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3294/6824] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:52 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:53.309328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d8a3ba47-2247-4300-b3a6-b892e3fc61e7 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:53.311199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d8a3ba47-2247-4300-b3a6-b892e3fc61e7 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:53.317454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8a3ba47-2247-4300-b3a6-b892e3fc61e7 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:53.317908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8a3ba47-2247-4300-b3a6-b892e3fc61e7 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:53.318677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8a3ba47-2247-4300-b3a6-b892e3fc61e7 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:53.319109 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8a3ba47-2247-4300-b3a6-b892e3fc61e7 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:53.464919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d8a3ba47-2247-4300-b3a6-b892e3fc61e7 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:53.473201 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d8a3ba47-2247-4300-b3a6-b892e3fc61e7 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.170028 Jul 20 05:01:53.473754 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3531/6825] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:53 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:54.490600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2241b72e-28c0-4553-b620-de258adb605f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:54.491233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2241b72e-28c0-4553-b620-de258adb605f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:54.499679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2241b72e-28c0-4553-b620-de258adb605f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:54.500145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2241b72e-28c0-4553-b620-de258adb605f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:54.500970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2241b72e-28c0-4553-b620-de258adb605f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:54.501427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2241b72e-28c0-4553-b620-de258adb605f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:54.648673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2241b72e-28c0-4553-b620-de258adb605f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:54.657138 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2241b72e-28c0-4553-b620-de258adb605f tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.170503 Jul 20 05:01:54.657741 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3295/6826] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:54 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:55.675354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b03feb4d-e5d0-434f-90a6-84af994ecfe4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:55.676004 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b03feb4d-e5d0-434f-90a6-84af994ecfe4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:55.684084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b03feb4d-e5d0-434f-90a6-84af994ecfe4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:55.684560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b03feb4d-e5d0-434f-90a6-84af994ecfe4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:55.685329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b03feb4d-e5d0-434f-90a6-84af994ecfe4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:55.685764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b03feb4d-e5d0-434f-90a6-84af994ecfe4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:55.830511 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b03feb4d-e5d0-434f-90a6-84af994ecfe4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:55.840802 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b03feb4d-e5d0-434f-90a6-84af994ecfe4 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.169506 Jul 20 05:01:55.841413 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3532/6827] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:55 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:56.860212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-700d9713-1e26-4abd-aa09-de290c5ac851 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:56.860855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-700d9713-1e26-4abd-aa09-de290c5ac851 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:56.868329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-700d9713-1e26-4abd-aa09-de290c5ac851 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:56.868777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-700d9713-1e26-4abd-aa09-de290c5ac851 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:56.869564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-700d9713-1e26-4abd-aa09-de290c5ac851 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:56.870013 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-700d9713-1e26-4abd-aa09-de290c5ac851 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:57.013744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-700d9713-1e26-4abd-aa09-de290c5ac851 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:57.022247 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-700d9713-1e26-4abd-aa09-de290c5ac851 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.166078 Jul 20 05:01:57.022849 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3296/6828] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:56 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:58.045344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1e5631d7-5879-4601-b135-1d428f5aab1e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:58.045921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1e5631d7-5879-4601-b135-1d428f5aab1e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:58.053337 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e5631d7-5879-4601-b135-1d428f5aab1e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:58.054011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e5631d7-5879-4601-b135-1d428f5aab1e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:58.055144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e5631d7-5879-4601-b135-1d428f5aab1e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:58.055853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e5631d7-5879-4601-b135-1d428f5aab1e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:58.209582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1e5631d7-5879-4601-b135-1d428f5aab1e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:58.220822 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1e5631d7-5879-4601-b135-1d428f5aab1e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.179596 Jul 20 05:01:58.221423 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3533/6829] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:58 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:59.238802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2af4ec95-886b-435c-8a9a-0bf0ba2b1543 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:59.239430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2af4ec95-886b-435c-8a9a-0bf0ba2b1543 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:59.247404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2af4ec95-886b-435c-8a9a-0bf0ba2b1543 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:59.247866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2af4ec95-886b-435c-8a9a-0bf0ba2b1543 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:59.248687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2af4ec95-886b-435c-8a9a-0bf0ba2b1543 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:59.249136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2af4ec95-886b-435c-8a9a-0bf0ba2b1543 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:59.385155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2af4ec95-886b-435c-8a9a-0bf0ba2b1543 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:59.393015 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2af4ec95-886b-435c-8a9a-0bf0ba2b1543 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.158166 Jul 20 05:01:59.393607 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3297/6830] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:59 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:00.412157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d4d0fc69-1843-46ff-963a-88b61e85d00d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:00.412822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d4d0fc69-1843-46ff-963a-88b61e85d00d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:00.415719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:00.421860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4d0fc69-1843-46ff-963a-88b61e85d00d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:00.422354 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4d0fc69-1843-46ff-963a-88b61e85d00d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:00.423275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4d0fc69-1843-46ff-963a-88b61e85d00d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:00.423781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d4d0fc69-1843-46ff-963a-88b61e85d00d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:00.564625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d4d0fc69-1843-46ff-963a-88b61e85d00d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:00.575591 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d4d0fc69-1843-46ff-963a-88b61e85d00d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.167532 Jul 20 05:02:00.576183 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3534/6831] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:00 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:01.595780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-91cca1f4-fd88-419d-aea1-d4a668d92b18 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:01.596465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-91cca1f4-fd88-419d-aea1-d4a668d92b18 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:01.599286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:01.605110 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91cca1f4-fd88-419d-aea1-d4a668d92b18 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:01.605578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91cca1f4-fd88-419d-aea1-d4a668d92b18 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:01.606350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91cca1f4-fd88-419d-aea1-d4a668d92b18 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:01.606827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-91cca1f4-fd88-419d-aea1-d4a668d92b18 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:01.743857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-91cca1f4-fd88-419d-aea1-d4a668d92b18 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:01.751770 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-91cca1f4-fd88-419d-aea1-d4a668d92b18 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.160014 Jul 20 05:02:01.752564 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3298/6832] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:01 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:02.770659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-89b4b9fe-463c-46c5-ac0d-068421acf5a9 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:02.771271 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-89b4b9fe-463c-46c5-ac0d-068421acf5a9 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:02.778743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89b4b9fe-463c-46c5-ac0d-068421acf5a9 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:02.779198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89b4b9fe-463c-46c5-ac0d-068421acf5a9 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:02.779978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89b4b9fe-463c-46c5-ac0d-068421acf5a9 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:02.780472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89b4b9fe-463c-46c5-ac0d-068421acf5a9 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:02.918538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-89b4b9fe-463c-46c5-ac0d-068421acf5a9 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:02.926840 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-89b4b9fe-463c-46c5-ac0d-068421acf5a9 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.160445 Jul 20 05:02:02.927418 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3535/6833] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:02 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:03.944274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c91d78b4-49fa-45ca-b1a3-8827ea9fa590 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:03.944882 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c91d78b4-49fa-45ca-b1a3-8827ea9fa590 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:03.952345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c91d78b4-49fa-45ca-b1a3-8827ea9fa590 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:03.952819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c91d78b4-49fa-45ca-b1a3-8827ea9fa590 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:03.953618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c91d78b4-49fa-45ca-b1a3-8827ea9fa590 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:03.954070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c91d78b4-49fa-45ca-b1a3-8827ea9fa590 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:04.098029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c91d78b4-49fa-45ca-b1a3-8827ea9fa590 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:04.106336 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c91d78b4-49fa-45ca-b1a3-8827ea9fa590 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.166190 Jul 20 05:02:04.106950 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3299/6834] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:03 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:05.125508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8d529c31-6009-40f2-8a33-43f333ca2dd5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:05.126418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8d529c31-6009-40f2-8a33-43f333ca2dd5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:05.134621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d529c31-6009-40f2-8a33-43f333ca2dd5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:05.135080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d529c31-6009-40f2-8a33-43f333ca2dd5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:05.135880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d529c31-6009-40f2-8a33-43f333ca2dd5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:05.136340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8d529c31-6009-40f2-8a33-43f333ca2dd5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:05.294930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8d529c31-6009-40f2-8a33-43f333ca2dd5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:05.303512 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8d529c31-6009-40f2-8a33-43f333ca2dd5 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.183434 Jul 20 05:02:05.304077 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3536/6835] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:05 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:06.322902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-58f0c11f-08ca-4192-b4ac-c7a36627149d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:06.323543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-58f0c11f-08ca-4192-b4ac-c7a36627149d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:06.330889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58f0c11f-08ca-4192-b4ac-c7a36627149d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:06.331371 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58f0c11f-08ca-4192-b4ac-c7a36627149d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:06.332158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58f0c11f-08ca-4192-b4ac-c7a36627149d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:06.332641 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58f0c11f-08ca-4192-b4ac-c7a36627149d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:06.481374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-58f0c11f-08ca-4192-b4ac-c7a36627149d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:06.490420 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-58f0c11f-08ca-4192-b4ac-c7a36627149d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.171488 Jul 20 05:02:06.491217 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3300/6836] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:06 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:07.510664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-578b4655-fb4b-48fc-b70f-4bd8bcc9c85b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:07.511300 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-578b4655-fb4b-48fc-b70f-4bd8bcc9c85b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:07.520319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-578b4655-fb4b-48fc-b70f-4bd8bcc9c85b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:07.520866 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-578b4655-fb4b-48fc-b70f-4bd8bcc9c85b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:07.521934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-578b4655-fb4b-48fc-b70f-4bd8bcc9c85b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:07.522564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-578b4655-fb4b-48fc-b70f-4bd8bcc9c85b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:07.666409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-578b4655-fb4b-48fc-b70f-4bd8bcc9c85b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:07.675070 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-578b4655-fb4b-48fc-b70f-4bd8bcc9c85b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.169826 Jul 20 05:02:07.675657 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3537/6837] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:07 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:08.695529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4b57de2c-8ab4-45b1-85b6-747bb154a6b9 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:08.696154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4b57de2c-8ab4-45b1-85b6-747bb154a6b9 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:08.703559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b57de2c-8ab4-45b1-85b6-747bb154a6b9 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:08.704057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b57de2c-8ab4-45b1-85b6-747bb154a6b9 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:08.704889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b57de2c-8ab4-45b1-85b6-747bb154a6b9 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:08.705345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b57de2c-8ab4-45b1-85b6-747bb154a6b9 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:08.840387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4b57de2c-8ab4-45b1-85b6-747bb154a6b9 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:08.848309 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4b57de2c-8ab4-45b1-85b6-747bb154a6b9 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.156859 Jul 20 05:02:08.848935 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3301/6838] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:08 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:09.866407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-45dbee4b-3db7-4a91-814e-0519ee68882b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:09.867039 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-45dbee4b-3db7-4a91-814e-0519ee68882b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:09.874534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-45dbee4b-3db7-4a91-814e-0519ee68882b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:09.874993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-45dbee4b-3db7-4a91-814e-0519ee68882b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:09.875756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-45dbee4b-3db7-4a91-814e-0519ee68882b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:09.876180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-45dbee4b-3db7-4a91-814e-0519ee68882b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:10.018832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-45dbee4b-3db7-4a91-814e-0519ee68882b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:10.026746 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-45dbee4b-3db7-4a91-814e-0519ee68882b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.164400 Jul 20 05:02:10.027343 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3538/6839] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:09 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:11.044215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9d6ba61b-4f32-4731-944b-04b1caa0ef91 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:11.044984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9d6ba61b-4f32-4731-944b-04b1caa0ef91 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:11.053921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d6ba61b-4f32-4731-944b-04b1caa0ef91 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:11.054495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d6ba61b-4f32-4731-944b-04b1caa0ef91 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:11.055599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d6ba61b-4f32-4731-944b-04b1caa0ef91 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:11.056243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d6ba61b-4f32-4731-944b-04b1caa0ef91 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:11.213537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9d6ba61b-4f32-4731-944b-04b1caa0ef91 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:11.225134 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9d6ba61b-4f32-4731-944b-04b1caa0ef91 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.185004 Jul 20 05:02:11.225885 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3302/6840] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:11 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:12.246470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ea1178a2-6a87-4540-bbe7-11b1704c76c0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:12.247351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ea1178a2-6a87-4540-bbe7-11b1704c76c0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:12.257056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea1178a2-6a87-4540-bbe7-11b1704c76c0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:12.257499 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea1178a2-6a87-4540-bbe7-11b1704c76c0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:12.258272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea1178a2-6a87-4540-bbe7-11b1704c76c0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:12.258704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea1178a2-6a87-4540-bbe7-11b1704c76c0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:12.412977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ea1178a2-6a87-4540-bbe7-11b1704c76c0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:12.422264 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ea1178a2-6a87-4540-bbe7-11b1704c76c0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1519 microversion: 2.1 time: 0.182085 Jul 20 05:02:12.422884 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3539/6841] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:12 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:13.242950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-5bdb0280-5a4e-4ffc-b872-995fe36de233 req-bdf53a35-354f-43c6-a550-774eaf9e48b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edded2a5-1b15-47a8-978e-779130339ce8", "name": "network-vif-unplugged", "status": "completed", "tag": "2a0acc1f-46f3-4d75-a26f-df5f2ce98abd"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:13.254199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5bdb0280-5a4e-4ffc-b872-995fe36de233 req-bdf53a35-354f-43c6-a550-774eaf9e48b2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:13.254847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5bdb0280-5a4e-4ffc-b872-995fe36de233 req-bdf53a35-354f-43c6-a550-774eaf9e48b2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:13.269006 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-5bdb0280-5a4e-4ffc-b872-995fe36de233 req-bdf53a35-354f-43c6-a550-774eaf9e48b2 service nova] Creating event network-vif-unplugged:2a0acc1f-46f3-4d75-a26f-df5f2ce98abd for instance edded2a5-1b15-47a8-978e-779130339ce8 on n-h1-826526-5 Jul 20 05:02:13.275617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [req-5bdb0280-5a4e-4ffc-b872-995fe36de233 req-bdf53a35-354f-43c6-a550-774eaf9e48b2 service nova] Instance edded2a5-1b15-47a8-978e-779130339ce8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:02:13.287608 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-5bdb0280-5a4e-4ffc-b872-995fe36de233 req-bdf53a35-354f-43c6-a550-774eaf9e48b2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049748 Jul 20 05:02:13.289110 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3303/6842] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:13.439862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2fe5affe-c7fc-44f1-a13a-97b03f69576e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:13.440639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2fe5affe-c7fc-44f1-a13a-97b03f69576e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:13.448432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2fe5affe-c7fc-44f1-a13a-97b03f69576e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:13.449350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2fe5affe-c7fc-44f1-a13a-97b03f69576e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:13.450383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2fe5affe-c7fc-44f1-a13a-97b03f69576e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:13.450827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2fe5affe-c7fc-44f1-a13a-97b03f69576e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:13.626272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2fe5affe-c7fc-44f1-a13a-97b03f69576e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:13.634811 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2fe5affe-c7fc-44f1-a13a-97b03f69576e tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1518 microversion: 2.1 time: 0.199407 Jul 20 05:02:13.635402 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3540/6843] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:13 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1518 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:14.654674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f8f5554b-adde-4fa5-81b1-e4930bb95f7b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:14.655287 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f8f5554b-adde-4fa5-81b1-e4930bb95f7b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:14.662297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8f5554b-adde-4fa5-81b1-e4930bb95f7b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:14.662765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8f5554b-adde-4fa5-81b1-e4930bb95f7b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:14.663550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8f5554b-adde-4fa5-81b1-e4930bb95f7b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:14.664011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8f5554b-adde-4fa5-81b1-e4930bb95f7b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:14.814153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f8f5554b-adde-4fa5-81b1-e4930bb95f7b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:14.822688 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f8f5554b-adde-4fa5-81b1-e4930bb95f7b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1516 microversion: 2.1 time: 0.173619 Jul 20 05:02:14.823400 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3304/6844] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:14 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1516 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:15.304678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-bfe435a4-bb62-4a61-8e92-0d6ad10d260c req-edc69b0c-ca9e-4046-8e3d-c305c545d473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edded2a5-1b15-47a8-978e-779130339ce8", "tag": "2a0acc1f-46f3-4d75-a26f-df5f2ce98abd"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:15.314305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bfe435a4-bb62-4a61-8e92-0d6ad10d260c req-edc69b0c-ca9e-4046-8e3d-c305c545d473 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:15.314749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bfe435a4-bb62-4a61-8e92-0d6ad10d260c req-edc69b0c-ca9e-4046-8e3d-c305c545d473 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:15.317350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=83 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:15.328308 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-bfe435a4-bb62-4a61-8e92-0d6ad10d260c req-edc69b0c-ca9e-4046-8e3d-c305c545d473 service nova] Creating event network-changed:2a0acc1f-46f3-4d75-a26f-df5f2ce98abd for instance edded2a5-1b15-47a8-978e-779130339ce8 on n-h1-826526-5 Jul 20 05:02:15.334285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-bfe435a4-bb62-4a61-8e92-0d6ad10d260c req-edc69b0c-ca9e-4046-8e3d-c305c545d473 service nova] Instance edded2a5-1b15-47a8-978e-779130339ce8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:02:15.345892 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-bfe435a4-bb62-4a61-8e92-0d6ad10d260c req-edc69b0c-ca9e-4046-8e3d-c305c545d473 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045064 Jul 20 05:02:15.346415 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3541/6845] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:15.842794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-633a9241-c0df-418f-873c-d6e4f2ba55d0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:15.843424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-633a9241-c0df-418f-873c-d6e4f2ba55d0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:15.850244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-633a9241-c0df-418f-873c-d6e4f2ba55d0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:15.850716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-633a9241-c0df-418f-873c-d6e4f2ba55d0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:15.851726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-633a9241-c0df-418f-873c-d6e4f2ba55d0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:15.852168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-633a9241-c0df-418f-873c-d6e4f2ba55d0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:16.025902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-633a9241-c0df-418f-873c-d6e4f2ba55d0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:16.034449 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-633a9241-c0df-418f-873c-d6e4f2ba55d0 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1513 microversion: 2.1 time: 0.196882 Jul 20 05:02:16.035048 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3305/6846] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:15 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:16.056156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3091f953-1c25-40ca-91a2-449d99546b41 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:16.056901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3091f953-1c25-40ca-91a2-449d99546b41 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:16.064407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3091f953-1c25-40ca-91a2-449d99546b41 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:16.064857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3091f953-1c25-40ca-91a2-449d99546b41 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:16.065719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3091f953-1c25-40ca-91a2-449d99546b41 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:16.066224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3091f953-1c25-40ca-91a2-449d99546b41 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:16.126860 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3091f953-1c25-40ca-91a2-449d99546b41 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "POST /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8/action" status: 204 len: 0 microversion: 2.1 time: 0.075612 Jul 20 05:02:16.127508 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3542/6847] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:02:16 2022] POST /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:02:16.137802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7b0200c5-3c4f-4c42-bcaf-17fe8714381a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:16.138597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7b0200c5-3c4f-4c42-bcaf-17fe8714381a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:16.145034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b0200c5-3c4f-4c42-bcaf-17fe8714381a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:16.145519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b0200c5-3c4f-4c42-bcaf-17fe8714381a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:16.146309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b0200c5-3c4f-4c42-bcaf-17fe8714381a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:16.146801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b0200c5-3c4f-4c42-bcaf-17fe8714381a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:16.283787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7b0200c5-3c4f-4c42-bcaf-17fe8714381a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:16.291588 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7b0200c5-3c4f-4c42-bcaf-17fe8714381a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1513 microversion: 2.1 time: 0.159081 Jul 20 05:02:16.292209 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3306/6848] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:16 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:17.311259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7906f1d4-094d-4efc-be2e-ebe2b16f872b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:17.311967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7906f1d4-094d-4efc-be2e-ebe2b16f872b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:17.318819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7906f1d4-094d-4efc-be2e-ebe2b16f872b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:17.319269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7906f1d4-094d-4efc-be2e-ebe2b16f872b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:17.320045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7906f1d4-094d-4efc-be2e-ebe2b16f872b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:17.320529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7906f1d4-094d-4efc-be2e-ebe2b16f872b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:17.493947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7906f1d4-094d-4efc-be2e-ebe2b16f872b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:17.503920 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7906f1d4-094d-4efc-be2e-ebe2b16f872b tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1505 microversion: 2.1 time: 0.197937 Jul 20 05:02:17.504573 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3543/6849] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:17 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:17.521225 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3d67a4e7-7f5d-4876-bf0e-a7c5706aaa91 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:17.521757 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3d67a4e7-7f5d-4876-bf0e-a7c5706aaa91 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:17.529481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d67a4e7-7f5d-4876-bf0e-a7c5706aaa91 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:17.529951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d67a4e7-7f5d-4876-bf0e-a7c5706aaa91 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:17.530741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d67a4e7-7f5d-4876-bf0e-a7c5706aaa91 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:17.531168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d67a4e7-7f5d-4876-bf0e-a7c5706aaa91 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:17.681378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3d67a4e7-7f5d-4876-bf0e-a7c5706aaa91 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:17.689623 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3d67a4e7-7f5d-4876-bf0e-a7c5706aaa91 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1505 microversion: 2.1 time: 0.172343 Jul 20 05:02:17.690235 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3307/6850] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:17 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:17.705931 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bdf532ca-a3ac-40d9-9eb6-42cfebdf804d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:17.706545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bdf532ca-a3ac-40d9-9eb6-42cfebdf804d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:17.713272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bdf532ca-a3ac-40d9-9eb6-42cfebdf804d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:17.715845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bdf532ca-a3ac-40d9-9eb6-42cfebdf804d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:17.715845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bdf532ca-a3ac-40d9-9eb6-42cfebdf804d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:17.715845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bdf532ca-a3ac-40d9-9eb6-42cfebdf804d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:17.851116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bdf532ca-a3ac-40d9-9eb6-42cfebdf804d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:17.861867 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bdf532ca-a3ac-40d9-9eb6-42cfebdf804d tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1505 microversion: 2.1 time: 0.159658 Jul 20 05:02:17.862648 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3544/6851] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:17 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:17.880718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-be784dc9-de95-4c2b-b12a-0cb36d9c3dff tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:17.881250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-be784dc9-de95-4c2b-b12a-0cb36d9c3dff tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:17.888859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be784dc9-de95-4c2b-b12a-0cb36d9c3dff tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:17.889323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be784dc9-de95-4c2b-b12a-0cb36d9c3dff tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:17.890128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be784dc9-de95-4c2b-b12a-0cb36d9c3dff tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:17.890584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-be784dc9-de95-4c2b-b12a-0cb36d9c3dff tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:17.916938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-be784dc9-de95-4c2b-b12a-0cb36d9c3dff tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:02:18.000596 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-be784dc9-de95-4c2b-b12a-0cb36d9c3dff tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "DELETE /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 204 len: 0 microversion: 2.1 time: 0.123343 Jul 20 05:02:18.001225 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3308/6852] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:02:17 2022] DELETE /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:02:18.022305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e1703b84-ee94-43a0-a32a-d0054d18a0a2 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:18.022816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e1703b84-ee94-43a0-a32a-d0054d18a0a2 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:18.029374 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1703b84-ee94-43a0-a32a-d0054d18a0a2 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:18.029828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1703b84-ee94-43a0-a32a-d0054d18a0a2 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:18.030592 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1703b84-ee94-43a0-a32a-d0054d18a0a2 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:18.031031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e1703b84-ee94-43a0-a32a-d0054d18a0a2 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:18.057682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e1703b84-ee94-43a0-a32a-d0054d18a0a2 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:02:18.103851 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.compute.api [None req-e1703b84-ee94-43a0-a32a-d0054d18a0a2 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Instance is already in deleting state, ignoring this request Jul 20 05:02:18.104732 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e1703b84-ee94-43a0-a32a-d0054d18a0a2 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "DELETE /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 204 len: 0 microversion: 2.1 time: 0.086961 Jul 20 05:02:18.105339 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3545/6853] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:02:18 2022] DELETE /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:02:18.114198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-132b7b70-6852-438a-9d21-e43feab83a17 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:18.114937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-132b7b70-6852-438a-9d21-e43feab83a17 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:18.121559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-132b7b70-6852-438a-9d21-e43feab83a17 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:18.122027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-132b7b70-6852-438a-9d21-e43feab83a17 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:18.122844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-132b7b70-6852-438a-9d21-e43feab83a17 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:18.123307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-132b7b70-6852-438a-9d21-e43feab83a17 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:18.265120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-132b7b70-6852-438a-9d21-e43feab83a17 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:18.273045 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-132b7b70-6852-438a-9d21-e43feab83a17 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1511 microversion: 2.1 time: 0.163251 Jul 20 05:02:18.273885 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3309/6854] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:18 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:19.289876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-af75a7bc-5bb8-47f3-ab64-4e38071ef175 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:19.290488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-af75a7bc-5bb8-47f3-ab64-4e38071ef175 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:19.298386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af75a7bc-5bb8-47f3-ab64-4e38071ef175 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:19.298839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af75a7bc-5bb8-47f3-ab64-4e38071ef175 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:19.299610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af75a7bc-5bb8-47f3-ab64-4e38071ef175 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:19.300052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af75a7bc-5bb8-47f3-ab64-4e38071ef175 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:19.438299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-af75a7bc-5bb8-47f3-ab64-4e38071ef175 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52a348825240f087f44d56aaa42cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6517d6bf02fd4f8ab4b08fe971213a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:19.446632 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-af75a7bc-5bb8-47f3-ab64-4e38071ef175 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 200 len: 1511 microversion: 2.1 time: 0.160753 Jul 20 05:02:19.447234 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3546/6855] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:19 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:20.055855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-b3fb10ce-9636-4d06-865a-b05da40941e4 req-2ea01b09-def9-492d-b3b8-273ad9885559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edded2a5-1b15-47a8-978e-779130339ce8", "name": "network-vif-deleted", "tag": "2a0acc1f-46f3-4d75-a26f-df5f2ce98abd"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:20.065331 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b3fb10ce-9636-4d06-865a-b05da40941e4 req-2ea01b09-def9-492d-b3b8-273ad9885559 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:20.065812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b3fb10ce-9636-4d06-865a-b05da40941e4 req-2ea01b09-def9-492d-b3b8-273ad9885559 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:20.070439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:20.078786 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-b3fb10ce-9636-4d06-865a-b05da40941e4 req-2ea01b09-def9-492d-b3b8-273ad9885559 service nova] Creating event network-vif-deleted:2a0acc1f-46f3-4d75-a26f-df5f2ce98abd for instance edded2a5-1b15-47a8-978e-779130339ce8 on n-h1-826526-5 Jul 20 05:02:20.084017 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-b3fb10ce-9636-4d06-865a-b05da40941e4 req-2ea01b09-def9-492d-b3b8-273ad9885559 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032164 Jul 20 05:02:20.084664 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3310/6856] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:20.463829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bd7b7d43-4075-4881-8c64-74aeccd9b18a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:20.464514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bd7b7d43-4075-4881-8c64-74aeccd9b18a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: edded2a5-1b15-47a8-978e-779130339ce8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:20.472634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd7b7d43-4075-4881-8c64-74aeccd9b18a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:20.473093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd7b7d43-4075-4881-8c64-74aeccd9b18a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:20.473880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd7b7d43-4075-4881-8c64-74aeccd9b18a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:20.474312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd7b7d43-4075-4881-8c64-74aeccd9b18a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:20.489673 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-bd7b7d43-4075-4881-8c64-74aeccd9b18a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] HTTP exception thrown: Instance edded2a5-1b15-47a8-978e-779130339ce8 could not be found. Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bd7b7d43-4075-4881-8c64-74aeccd9b18a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Request method failure captured: Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 HTTP/1.1 Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14v8yUC7oJnyjmyBuejb0xj5N-t-R80jQ_3fkJSTp74VOWvp4cuchxPXSLXe8Ln7AMZ7RwoQxJIrAk-IJuiYtZWz7mUj6MghJjPGgJW-S5qo5T7cNB1UIbg_aKRHRwNBXkURXh-syWWcIVApg-lgokc36wpQr2a8VcRKsw2yUVrJv3w Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 6517d6bf02fd4f8ab4b08fe971213a05 Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerDiskConfigTestJSON-214180711 Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6517d6bf02fd4f8ab4b08fe971213a05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6517d6bf02fd4f8ab4b08fe971213a05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6517d6bf02fd4f8ab4b08fe971213a05", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6517d6bf02fd4f8ab4b08fe971213a05"}]}] Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerDiskConfigTestJSON-214180711 Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 6517d6bf02fd4f8ab4b08fe971213a05 Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-214180711 Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerDiskConfigTestJSON-214180711-project Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: fb52a348825240f087f44d56aaa42cc4 Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerDiskConfigTestJSON-214180711-project Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance edded2a5-1b15-47a8-978e-779130339ce8 could not be found. Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'edded2a5-1b15-47a8-978e-779130339ce8'} Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edded2a5-1b15-47a8-978e-779130339ce8 could not be found. Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edded2a5-1b15-47a8-978e-779130339ce8 could not be found. Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:02:20.491390 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:02:20.496711 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:02:20.496711 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:02:20.496711 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:02:20.496711 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:02:20.496711 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:02:20.496711 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edded2a5-1b15-47a8-978e-779130339ce8 could not be found. Jul 20 05:02:20.496711 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:02:20.496711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bd7b7d43-4075-4881-8c64-74aeccd9b18a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Returning 404 to user: Instance edded2a5-1b15-47a8-978e-779130339ce8 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:02:20.496711 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bd7b7d43-4075-4881-8c64-74aeccd9b18a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8" status: 404 len: 111 microversion: 2.1 time: 0.033228 Jul 20 05:02:20.496711 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3547/6857] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:20 2022] GET /compute/v2.1/servers/edded2a5-1b15-47a8-978e-779130339ce8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:02:20.502546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3447d619-90a5-4d15-b461-da5214f5da57 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '.version_select at 0x7f06be997af0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:20.524111 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3447d619-90a5-4d15-b461-da5214f5da57 tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-646284294" status: 202 len: 0 microversion: 2.1 time: 0.025789 Jul 20 05:02:20.524744 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3311/6858] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jul 20 05:02:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-646284294 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:02:21.176940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ca86044f-dc9d-486d-a950-b6511f21751c tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:21.177565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ca86044f-dc9d-486d-a950-b6511f21751c tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:21.184207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca86044f-dc9d-486d-a950-b6511f21751c tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:21.184692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca86044f-dc9d-486d-a950-b6511f21751c tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:21.185467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca86044f-dc9d-486d-a950-b6511f21751c tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:21.185898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca86044f-dc9d-486d-a950-b6511f21751c tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:21.201129 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-ca86044f-dc9d-486d-a950-b6511f21751c tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] HTTP exception thrown: Instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee could not be found. Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ca86044f-dc9d-486d-a950-b6511f21751c tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Request method failure captured: Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee HTTP/1.1 Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14v8yUC7oJnyjmyBuejb0xj5N-t-R80jQ_3fkJSTp74VOWvp4cuchxPXSLXe8Ln7AMZ7RwoQxJIrAk-IJuiYtZWz7mUj6MghJjPGgJW-S5qo5T7cNB1UIbg_aKRHRwNBXkURXh-syWWcIVApg-lgokc36wpQr2a8VcRKsw2yUVrJv3w Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 6517d6bf02fd4f8ab4b08fe971213a05 Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerDiskConfigTestJSON-214180711 Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6517d6bf02fd4f8ab4b08fe971213a05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6517d6bf02fd4f8ab4b08fe971213a05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6517d6bf02fd4f8ab4b08fe971213a05", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6517d6bf02fd4f8ab4b08fe971213a05"}]}] Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerDiskConfigTestJSON-214180711 Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 6517d6bf02fd4f8ab4b08fe971213a05 Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-214180711 Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerDiskConfigTestJSON-214180711-project Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: fb52a348825240f087f44d56aaa42cc4 Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerDiskConfigTestJSON-214180711-project Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee could not be found. Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '14540834-fcd8-4705-9c4e-8e6a3e8896ee'} Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee could not be found. Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:02:21.202428 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:02:21.209716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee could not be found. Jul 20 05:02:21.209716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:02:21.209716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:02:21.209716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:02:21.209716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:02:21.209716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:02:21.209716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:02:21.209716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:02:21.209716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:02:21.209716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee could not be found. Jul 20 05:02:21.209716 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:02:21.209716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ca86044f-dc9d-486d-a950-b6511f21751c tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Returning 404 to user: Instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:02:21.209716 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ca86044f-dc9d-486d-a950-b6511f21751c tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "DELETE /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 404 len: 111 microversion: 2.1 time: 0.031195 Jul 20 05:02:21.209716 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3548/6859] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:02:21 2022] DELETE /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:02:21.212779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cb86052a-7d71-463c-94ad-4fd66524b34a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:21.213561 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cb86052a-7d71-463c-94ad-4fd66524b34a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] [instance: 14540834-fcd8-4705-9c4e-8e6a3e8896ee] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:21.221620 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb86052a-7d71-463c-94ad-4fd66524b34a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:21.222087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb86052a-7d71-463c-94ad-4fd66524b34a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:21.222883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb86052a-7d71-463c-94ad-4fd66524b34a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:21.223343 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb86052a-7d71-463c-94ad-4fd66524b34a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:21.237917 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-cb86052a-7d71-463c-94ad-4fd66524b34a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] HTTP exception thrown: Instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee could not be found. Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cb86052a-7d71-463c-94ad-4fd66524b34a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Request method failure captured: Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee HTTP/1.1 Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14v8yUC7oJnyjmyBuejb0xj5N-t-R80jQ_3fkJSTp74VOWvp4cuchxPXSLXe8Ln7AMZ7RwoQxJIrAk-IJuiYtZWz7mUj6MghJjPGgJW-S5qo5T7cNB1UIbg_aKRHRwNBXkURXh-syWWcIVApg-lgokc36wpQr2a8VcRKsw2yUVrJv3w Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 6517d6bf02fd4f8ab4b08fe971213a05 Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerDiskConfigTestJSON-214180711 Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6517d6bf02fd4f8ab4b08fe971213a05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6517d6bf02fd4f8ab4b08fe971213a05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6517d6bf02fd4f8ab4b08fe971213a05", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6517d6bf02fd4f8ab4b08fe971213a05"}]}] Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerDiskConfigTestJSON-214180711 Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 6517d6bf02fd4f8ab4b08fe971213a05 Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-214180711 Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerDiskConfigTestJSON-214180711-project Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: fb52a348825240f087f44d56aaa42cc4 Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerDiskConfigTestJSON-214180711-project Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee could not be found. Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '14540834-fcd8-4705-9c4e-8e6a3e8896ee'} Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee could not be found. Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee could not be found. Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:02:21.239688 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:02:21.244902 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:02:21.244902 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:02:21.244902 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:02:21.244902 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:02:21.244902 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:02:21.244902 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee could not be found. Jul 20 05:02:21.244902 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:02:21.244902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cb86052a-7d71-463c-94ad-4fd66524b34a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] Returning 404 to user: Instance 14540834-fcd8-4705-9c4e-8e6a3e8896ee could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:02:21.244902 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cb86052a-7d71-463c-94ad-4fd66524b34a tempest-ServerDiskConfigTestJSON-214180711 tempest-ServerDiskConfigTestJSON-214180711-project] 10.222.0.17 "GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee" status: 404 len: 111 microversion: 2.1 time: 0.032393 Jul 20 05:02:21.244902 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3312/6860] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:21 2022] GET /compute/v2.1/servers/14540834-fcd8-4705-9c4e-8e6a3e8896ee => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:02:29.853718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d68c5c8f-e6ff-4eb5-8849-15b99451bbc2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Action: 'create', calling method: .version_select at 0x7f06bd3ee1f0>, body: {"keypair": {"name": "tempest-keypair-1918112510", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqKnn7UnDTjZY0ae1MY5WHA4H+bdXvedJeLmKLZBwzrEd/Q1+CxKOuO9TVSWyEIWWacEAeXZBRaEglSR1r4HLZM/fOhkZBWJbryqmWxvYwb5qcLNO2xuGDf6xe/x4me1w=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:29.870341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-d68c5c8f-e6ff-4eb5-8849-15b99451bbc2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Getting quotas for project c48dbfac2a784ca7a2d027f8c102df69. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:02:29.881313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-d68c5c8f-e6ff-4eb5-8849-15b99451bbc2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Getting quotas for user c1b8ef10ecd447b8b2a3cc297731059c and project c48dbfac2a784ca7a2d027f8c102df69. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:02:29.913714 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d68c5c8f-e6ff-4eb5-8849-15b99451bbc2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.184437 Jul 20 05:02:29.914943 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3549/6861] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 05:02:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:31.590005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c207fd40-fab0-4cd9-b1c1-4b22167f532b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-332471836", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1762f2f-2565-44bb-a011-b37176955a43"}], "security_groups": [{"name": "tempest-securitygroup--1758487340"}], "key_name": "tempest-keypair-1918112510", "user_data": "}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:31.598724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:31.599831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:31.712008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-c207fd40-fab0-4cd9-b1c1-4b22167f532b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] validate_networks() for [('b1762f2f-2565-44bb-a011-b37176955a43', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:02:32.124165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-c207fd40-fab0-4cd9-b1c1-4b22167f532b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:02:32.124646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-c207fd40-fab0-4cd9-b1c1-4b22167f532b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:02:32.125164 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-c207fd40-fab0-4cd9-b1c1-4b22167f532b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:02:32.125563 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-c207fd40-fab0-4cd9-b1c1-4b22167f532b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:02:32.126014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-c207fd40-fab0-4cd9-b1c1-4b22167f532b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:02:32.136442 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c207fd40-fab0-4cd9-b1c1-4b22167f532b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:32.136914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c207fd40-fab0-4cd9-b1c1-4b22167f532b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:32.137733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c207fd40-fab0-4cd9-b1c1-4b22167f532b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:32.138180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c207fd40-fab0-4cd9-b1c1-4b22167f532b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:32.155679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-c207fd40-fab0-4cd9-b1c1-4b22167f532b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Getting quotas for project c48dbfac2a784ca7a2d027f8c102df69. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:02:32.161593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-c207fd40-fab0-4cd9-b1c1-4b22167f532b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Getting quotas for user c1b8ef10ecd447b8b2a3cc297731059c and project c48dbfac2a784ca7a2d027f8c102df69. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:02:32.174995 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c207fd40-fab0-4cd9-b1c1-4b22167f532b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:02:32.177374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c207fd40-fab0-4cd9-b1c1-4b22167f532b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:02:32.231008 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c207fd40-fab0-4cd9-b1c1-4b22167f532b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.646807 Jul 20 05:02:32.232413 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3313/6862] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:02:31 2022] POST /compute/v2.1/servers => generated 409 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:02:32.244517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5b3e0241-6202-4957-89ab-8e539f545627 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:32.245909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5b3e0241-6202-4957-89ab-8e539f545627 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:32.252305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:32.253518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:32.324880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5b3e0241-6202-4957-89ab-8e539f545627 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:32.332882 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5b3e0241-6202-4957-89ab-8e539f545627 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1238 microversion: 2.1 time: 0.094321 Jul 20 05:02:32.337532 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3550/6863] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:32 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:33.353051 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3124d8d0-1650-49bb-a128-a03892c847a0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:33.353790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3124d8d0-1650-49bb-a128-a03892c847a0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:33.362125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3124d8d0-1650-49bb-a128-a03892c847a0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:33.362771 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3124d8d0-1650-49bb-a128-a03892c847a0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:33.363912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3124d8d0-1650-49bb-a128-a03892c847a0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:33.365357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3124d8d0-1650-49bb-a128-a03892c847a0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:33.459191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3124d8d0-1650-49bb-a128-a03892c847a0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:33.468067 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3124d8d0-1650-49bb-a128-a03892c847a0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1298 microversion: 2.1 time: 0.120798 Jul 20 05:02:33.469060 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3314/6864] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:33 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1298 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:34.485703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-87143f4b-2cba-4743-8e24-4940ebc73b48 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:34.486421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-87143f4b-2cba-4743-8e24-4940ebc73b48 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:34.494479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-87143f4b-2cba-4743-8e24-4940ebc73b48 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:34.494930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-87143f4b-2cba-4743-8e24-4940ebc73b48 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:34.495810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-87143f4b-2cba-4743-8e24-4940ebc73b48 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:34.496244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-87143f4b-2cba-4743-8e24-4940ebc73b48 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:34.657329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-87143f4b-2cba-4743-8e24-4940ebc73b48 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:34.666132 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-87143f4b-2cba-4743-8e24-4940ebc73b48 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1364 microversion: 2.1 time: 0.184364 Jul 20 05:02:34.666770 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3551/6865] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:34 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:35.016403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-c6cfdf1a-de5f-4889-bd7f-586b25ce6344 req-2e1fb533-c472-442b-a74f-c2394d4dcff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e665a555-bc6e-4074-9fda-f1a9e4e8a8be", "tag": "7253f14a-00fd-468f-8a6d-9d5341f14398"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:35.025223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c6cfdf1a-de5f-4889-bd7f-586b25ce6344 req-2e1fb533-c472-442b-a74f-c2394d4dcff1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:35.025684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c6cfdf1a-de5f-4889-bd7f-586b25ce6344 req-2e1fb533-c472-442b-a74f-c2394d4dcff1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:35.037974 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-c6cfdf1a-de5f-4889-bd7f-586b25ce6344 req-2e1fb533-c472-442b-a74f-c2394d4dcff1 service nova] Creating event network-changed:7253f14a-00fd-468f-8a6d-9d5341f14398 for instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be on n-h1-826526-5 Jul 20 05:02:35.043943 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-c6cfdf1a-de5f-4889-bd7f-586b25ce6344 req-2e1fb533-c472-442b-a74f-c2394d4dcff1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124136 Jul 20 05:02:35.044932 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3315/6866] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:35.685470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1289550a-86b0-486c-aa19-71c368ad243c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:35.686081 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1289550a-86b0-486c-aa19-71c368ad243c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:35.693342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1289550a-86b0-486c-aa19-71c368ad243c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:35.693794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1289550a-86b0-486c-aa19-71c368ad243c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:35.694579 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1289550a-86b0-486c-aa19-71c368ad243c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:35.695021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1289550a-86b0-486c-aa19-71c368ad243c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:35.831510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1289550a-86b0-486c-aa19-71c368ad243c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:35.839350 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1289550a-86b0-486c-aa19-71c368ad243c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1364 microversion: 2.1 time: 0.158258 Jul 20 05:02:35.839909 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3552/6867] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:35 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:36.859943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-80c674b3-2cd5-4aaa-afd9-991a842986cd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:36.860698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-80c674b3-2cd5-4aaa-afd9-991a842986cd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:36.867631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80c674b3-2cd5-4aaa-afd9-991a842986cd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:36.868105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80c674b3-2cd5-4aaa-afd9-991a842986cd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:36.868933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80c674b3-2cd5-4aaa-afd9-991a842986cd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:36.869389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-80c674b3-2cd5-4aaa-afd9-991a842986cd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:37.020388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-80c674b3-2cd5-4aaa-afd9-991a842986cd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:37.028509 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-80c674b3-2cd5-4aaa-afd9-991a842986cd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1364 microversion: 2.1 time: 0.174467 Jul 20 05:02:37.029079 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3316/6868] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:36 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:38.045735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7c1b1fa0-5a44-41f3-bf6e-50b34c7f9a2e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:38.046389 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7c1b1fa0-5a44-41f3-bf6e-50b34c7f9a2e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:38.054630 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c1b1fa0-5a44-41f3-bf6e-50b34c7f9a2e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:38.055108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c1b1fa0-5a44-41f3-bf6e-50b34c7f9a2e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:38.055947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c1b1fa0-5a44-41f3-bf6e-50b34c7f9a2e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:38.056554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c1b1fa0-5a44-41f3-bf6e-50b34c7f9a2e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:38.204491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7c1b1fa0-5a44-41f3-bf6e-50b34c7f9a2e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:38.215250 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7c1b1fa0-5a44-41f3-bf6e-50b34c7f9a2e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1364 microversion: 2.1 time: 0.173718 Jul 20 05:02:38.215808 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3553/6869] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:38 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:39.234226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ac0ada64-3864-4046-bb7c-cc918282b435 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:39.234789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ac0ada64-3864-4046-bb7c-cc918282b435 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:39.241739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac0ada64-3864-4046-bb7c-cc918282b435 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:39.242219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac0ada64-3864-4046-bb7c-cc918282b435 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:39.243013 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac0ada64-3864-4046-bb7c-cc918282b435 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:39.243470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ac0ada64-3864-4046-bb7c-cc918282b435 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:39.396832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ac0ada64-3864-4046-bb7c-cc918282b435 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:39.410641 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ac0ada64-3864-4046-bb7c-cc918282b435 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1364 microversion: 2.1 time: 0.181278 Jul 20 05:02:39.411951 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3317/6870] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:39 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:40.432474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-701d34bb-9ee3-41d7-9d14-732612c507b8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:40.433164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-701d34bb-9ee3-41d7-9d14-732612c507b8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:40.440794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-701d34bb-9ee3-41d7-9d14-732612c507b8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:40.441302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-701d34bb-9ee3-41d7-9d14-732612c507b8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:40.442150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-701d34bb-9ee3-41d7-9d14-732612c507b8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:40.442652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-701d34bb-9ee3-41d7-9d14-732612c507b8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:40.461086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-04e04544-dcd6-4a5d-bc17-9f8a1689ca6b req-1dfba3e0-237f-4ca7-a107-7cc7fb9856fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e665a555-bc6e-4074-9fda-f1a9e4e8a8be", "name": "network-vif-plugged", "status": "completed", "tag": "7253f14a-00fd-468f-8a6d-9d5341f14398"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:40.472875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-04e04544-dcd6-4a5d-bc17-9f8a1689ca6b req-1dfba3e0-237f-4ca7-a107-7cc7fb9856fc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:40.473635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-04e04544-dcd6-4a5d-bc17-9f8a1689ca6b req-1dfba3e0-237f-4ca7-a107-7cc7fb9856fc service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:40.502309 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-04e04544-dcd6-4a5d-bc17-9f8a1689ca6b req-1dfba3e0-237f-4ca7-a107-7cc7fb9856fc service nova] Creating event network-vif-plugged:7253f14a-00fd-468f-8a6d-9d5341f14398 for instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be on n-h1-826526-5 Jul 20 05:02:40.507917 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-04e04544-dcd6-4a5d-bc17-9f8a1689ca6b req-1dfba3e0-237f-4ca7-a107-7cc7fb9856fc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050689 Jul 20 05:02:40.508749 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3318/6871] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:02:40.587568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-701d34bb-9ee3-41d7-9d14-732612c507b8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:40.595476 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-701d34bb-9ee3-41d7-9d14-732612c507b8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1364 microversion: 2.1 time: 0.167057 Jul 20 05:02:40.596592 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3554/6872] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:40 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:41.615094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c10ee8ba-a31e-49e1-9cdf-5fa48dd32113 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:41.615818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c10ee8ba-a31e-49e1-9cdf-5fa48dd32113 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:41.622616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c10ee8ba-a31e-49e1-9cdf-5fa48dd32113 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:41.623084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c10ee8ba-a31e-49e1-9cdf-5fa48dd32113 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:41.623878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c10ee8ba-a31e-49e1-9cdf-5fa48dd32113 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:41.624333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c10ee8ba-a31e-49e1-9cdf-5fa48dd32113 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:41.764876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c10ee8ba-a31e-49e1-9cdf-5fa48dd32113 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:41.772853 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c10ee8ba-a31e-49e1-9cdf-5fa48dd32113 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1364 microversion: 2.1 time: 0.163005 Jul 20 05:02:41.773630 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3319/6873] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:41 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:42.794336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-36c01aba-2105-4fc3-98ad-0f1fc5f8879a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:42.795257 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-36c01aba-2105-4fc3-98ad-0f1fc5f8879a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:42.799467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:42.808872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36c01aba-2105-4fc3-98ad-0f1fc5f8879a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:42.809326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36c01aba-2105-4fc3-98ad-0f1fc5f8879a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:42.810099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36c01aba-2105-4fc3-98ad-0f1fc5f8879a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:42.810531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-36c01aba-2105-4fc3-98ad-0f1fc5f8879a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:42.957929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-36c01aba-2105-4fc3-98ad-0f1fc5f8879a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:42.966073 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-36c01aba-2105-4fc3-98ad-0f1fc5f8879a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1552 microversion: 2.1 time: 0.178692 Jul 20 05:02:42.966658 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3555/6874] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:42 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1552 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:42.983889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-668af371-ece3-44e8-a210-41ac163b1720 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:42.984430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-668af371-ece3-44e8-a210-41ac163b1720 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:42.986450 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:42.987171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:42.993421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-668af371-ece3-44e8-a210-41ac163b1720 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:42.993889 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-668af371-ece3-44e8-a210-41ac163b1720 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:42.994704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-668af371-ece3-44e8-a210-41ac163b1720 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:42.995158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-668af371-ece3-44e8-a210-41ac163b1720 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:43.077350 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-668af371-ece3-44e8-a210-41ac163b1720 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097848 Jul 20 05:02:43.078165 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3320/6875] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 05:02:42 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:44.105519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-68949272-f7df-46de-9632-4c4331d2003c req-12335068-69fb-4b47-bb7e-02df07915168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e665a555-bc6e-4074-9fda-f1a9e4e8a8be", "tag": "7253f14a-00fd-468f-8a6d-9d5341f14398"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:44.115626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-68949272-f7df-46de-9632-4c4331d2003c req-12335068-69fb-4b47-bb7e-02df07915168 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:44.116178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-68949272-f7df-46de-9632-4c4331d2003c req-12335068-69fb-4b47-bb7e-02df07915168 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:44.128818 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-68949272-f7df-46de-9632-4c4331d2003c req-12335068-69fb-4b47-bb7e-02df07915168 service nova] Creating event network-changed:7253f14a-00fd-468f-8a6d-9d5341f14398 for instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be on n-h1-826526-5 Jul 20 05:02:44.134762 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-68949272-f7df-46de-9632-4c4331d2003c req-12335068-69fb-4b47-bb7e-02df07915168 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033133 Jul 20 05:02:44.135439 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3556/6876] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:03:13.796291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:13.797294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=34 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:13.801880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b1f23342-b1ee-4198-9bbc-55bc98ee82a9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:13.802502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b1f23342-b1ee-4198-9bbc-55bc98ee82a9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:13.810186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1f23342-b1ee-4198-9bbc-55bc98ee82a9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:13.810649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1f23342-b1ee-4198-9bbc-55bc98ee82a9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:13.811428 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1f23342-b1ee-4198-9bbc-55bc98ee82a9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:13.811872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1f23342-b1ee-4198-9bbc-55bc98ee82a9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:13.957975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b1f23342-b1ee-4198-9bbc-55bc98ee82a9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:13.966819 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b1f23342-b1ee-4198-9bbc-55bc98ee82a9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1670 microversion: 2.1 time: 0.173414 Jul 20 05:03:13.967403 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3321/6877] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:13 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:13.981677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=15 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:13.982433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=32 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:13.986568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1155e7a3-b733-4671-a958-8a8f2aa82d85 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:13.987264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1155e7a3-b733-4671-a958-8a8f2aa82d85 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:13.994392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1155e7a3-b733-4671-a958-8a8f2aa82d85 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:13.994841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1155e7a3-b733-4671-a958-8a8f2aa82d85 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:13.995596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1155e7a3-b733-4671-a958-8a8f2aa82d85 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:13.996024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1155e7a3-b733-4671-a958-8a8f2aa82d85 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:14.143197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1155e7a3-b733-4671-a958-8a8f2aa82d85 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:14.151791 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1155e7a3-b733-4671-a958-8a8f2aa82d85 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1670 microversion: 2.1 time: 0.172194 Jul 20 05:03:14.152664 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3557/6878] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:13 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:14.168780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f12dc96f-87ef-4f8c-b3d7-c3fdcbb23917 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:14.169522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f12dc96f-87ef-4f8c-b3d7-c3fdcbb23917 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:14.181515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f12dc96f-87ef-4f8c-b3d7-c3fdcbb23917 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:14.181975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f12dc96f-87ef-4f8c-b3d7-c3fdcbb23917 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:14.182762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f12dc96f-87ef-4f8c-b3d7-c3fdcbb23917 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:14.183227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f12dc96f-87ef-4f8c-b3d7-c3fdcbb23917 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:14.333894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f12dc96f-87ef-4f8c-b3d7-c3fdcbb23917 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:14.342273 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f12dc96f-87ef-4f8c-b3d7-c3fdcbb23917 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1670 microversion: 2.1 time: 0.177548 Jul 20 05:03:14.342851 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3322/6879] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:14 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1670 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:14.361590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-334f72a7-4150-44b2-9ed3-31aa7fde91a5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:14.362596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-334f72a7-4150-44b2-9ed3-31aa7fde91a5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:14.369392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-334f72a7-4150-44b2-9ed3-31aa7fde91a5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:14.369839 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-334f72a7-4150-44b2-9ed3-31aa7fde91a5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:14.370600 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-334f72a7-4150-44b2-9ed3-31aa7fde91a5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:14.371030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-334f72a7-4150-44b2-9ed3-31aa7fde91a5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:14.401309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-334f72a7-4150-44b2-9ed3-31aa7fde91a5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:14.407837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-334f72a7-4150-44b2-9ed3-31aa7fde91a5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Old instance type m1.heat2, new instance type m1.heat {{(pid=127871) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:03:14.414730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-334f72a7-4150-44b2-9ed3-31aa7fde91a5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:03:14.415153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-334f72a7-4150-44b2-9ed3-31aa7fde91a5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:03:14.415632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-334f72a7-4150-44b2-9ed3-31aa7fde91a5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:03:14.416042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-334f72a7-4150-44b2-9ed3-31aa7fde91a5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:03:14.416513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-334f72a7-4150-44b2-9ed3-31aa7fde91a5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:03:14.486188 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-334f72a7-4150-44b2-9ed3-31aa7fde91a5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "POST /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be/action" status: 202 len: 0 microversion: 2.1 time: 0.130924 Jul 20 05:03:14.487101 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3558/6880] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:03:14 2022] POST /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:03:14.500669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b2e364e2-3a88-4e4c-8b74-e810ce149238 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:14.501860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b2e364e2-3a88-4e4c-8b74-e810ce149238 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:14.510409 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2e364e2-3a88-4e4c-8b74-e810ce149238 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:14.510978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2e364e2-3a88-4e4c-8b74-e810ce149238 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:14.511978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2e364e2-3a88-4e4c-8b74-e810ce149238 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:14.512557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2e364e2-3a88-4e4c-8b74-e810ce149238 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:14.676431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b2e364e2-3a88-4e4c-8b74-e810ce149238 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:14.684294 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b2e364e2-3a88-4e4c-8b74-e810ce149238 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1679 microversion: 2.1 time: 0.191218 Jul 20 05:03:14.684899 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3323/6881] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:14 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1679 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:15.704250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a0b3a8d9-8309-4a4f-a1c9-8ff32a6ecc3c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:15.704942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a0b3a8d9-8309-4a4f-a1c9-8ff32a6ecc3c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:15.711501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0b3a8d9-8309-4a4f-a1c9-8ff32a6ecc3c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:15.711956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0b3a8d9-8309-4a4f-a1c9-8ff32a6ecc3c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:15.712786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0b3a8d9-8309-4a4f-a1c9-8ff32a6ecc3c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:15.713247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0b3a8d9-8309-4a4f-a1c9-8ff32a6ecc3c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:15.863050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a0b3a8d9-8309-4a4f-a1c9-8ff32a6ecc3c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:15.870950 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a0b3a8d9-8309-4a4f-a1c9-8ff32a6ecc3c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1679 microversion: 2.1 time: 0.171542 Jul 20 05:03:15.871533 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3559/6882] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:15 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:16.889173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a0cb61e5-2e66-4dab-9485-898c1cf4cdb6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:16.889790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a0cb61e5-2e66-4dab-9485-898c1cf4cdb6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:16.896888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0cb61e5-2e66-4dab-9485-898c1cf4cdb6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:16.897354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0cb61e5-2e66-4dab-9485-898c1cf4cdb6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:16.898150 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0cb61e5-2e66-4dab-9485-898c1cf4cdb6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:16.898634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a0cb61e5-2e66-4dab-9485-898c1cf4cdb6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:17.039159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a0cb61e5-2e66-4dab-9485-898c1cf4cdb6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:17.047233 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a0cb61e5-2e66-4dab-9485-898c1cf4cdb6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1684 microversion: 2.1 time: 0.162296 Jul 20 05:03:17.047808 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3324/6883] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:16 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:03:18.066019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-28b04982-b899-4380-9e1b-ada168c123d2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:18.066535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-28b04982-b899-4380-9e1b-ada168c123d2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:18.075084 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28b04982-b899-4380-9e1b-ada168c123d2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:18.075490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28b04982-b899-4380-9e1b-ada168c123d2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:18.076297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28b04982-b899-4380-9e1b-ada168c123d2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:18.076736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-28b04982-b899-4380-9e1b-ada168c123d2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:18.220352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-28b04982-b899-4380-9e1b-ada168c123d2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:18.229072 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-28b04982-b899-4380-9e1b-ada168c123d2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1684 microversion: 2.1 time: 0.167187 Jul 20 05:03:18.229664 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3560/6884] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:18 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:19.246881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-46bde22b-1eb0-465e-bfd2-b1556ebc36b2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:19.247519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-46bde22b-1eb0-465e-bfd2-b1556ebc36b2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:19.255877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46bde22b-1eb0-465e-bfd2-b1556ebc36b2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:19.256981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46bde22b-1eb0-465e-bfd2-b1556ebc36b2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:19.258133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46bde22b-1eb0-465e-bfd2-b1556ebc36b2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:19.258896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46bde22b-1eb0-465e-bfd2-b1556ebc36b2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:19.399661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-46bde22b-1eb0-465e-bfd2-b1556ebc36b2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:19.407682 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-46bde22b-1eb0-465e-bfd2-b1556ebc36b2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1684 microversion: 2.1 time: 0.164837 Jul 20 05:03:19.408327 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3325/6885] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:19 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:20.425405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-edcb97ac-fcb0-4e6f-84f6-b3bb793c5215 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:20.426005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-edcb97ac-fcb0-4e6f-84f6-b3bb793c5215 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:20.433442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edcb97ac-fcb0-4e6f-84f6-b3bb793c5215 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:20.433894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edcb97ac-fcb0-4e6f-84f6-b3bb793c5215 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:20.434673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edcb97ac-fcb0-4e6f-84f6-b3bb793c5215 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:20.435108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edcb97ac-fcb0-4e6f-84f6-b3bb793c5215 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:20.578205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-edcb97ac-fcb0-4e6f-84f6-b3bb793c5215 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:20.586160 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-edcb97ac-fcb0-4e6f-84f6-b3bb793c5215 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1684 microversion: 2.1 time: 0.164860 Jul 20 05:03:20.586737 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3561/6886] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:20 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:21.604107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cc6a02a6-5dd7-4c7b-a4c6-331eb7a427ff tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:21.604730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cc6a02a6-5dd7-4c7b-a4c6-331eb7a427ff tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:21.612308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc6a02a6-5dd7-4c7b-a4c6-331eb7a427ff tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:21.612777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc6a02a6-5dd7-4c7b-a4c6-331eb7a427ff tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:21.613644 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc6a02a6-5dd7-4c7b-a4c6-331eb7a427ff tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:21.614095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc6a02a6-5dd7-4c7b-a4c6-331eb7a427ff tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:21.749045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cc6a02a6-5dd7-4c7b-a4c6-331eb7a427ff tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:21.757369 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cc6a02a6-5dd7-4c7b-a4c6-331eb7a427ff tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1684 microversion: 2.1 time: 0.157419 Jul 20 05:03:21.757942 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3326/6887] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:21 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:22.775608 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fc99c4d3-b2ef-40eb-93e8-d5d373e6acae tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:22.776255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fc99c4d3-b2ef-40eb-93e8-d5d373e6acae tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:22.783742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fc99c4d3-b2ef-40eb-93e8-d5d373e6acae tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:22.784229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fc99c4d3-b2ef-40eb-93e8-d5d373e6acae tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:22.785018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fc99c4d3-b2ef-40eb-93e8-d5d373e6acae tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:22.785483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fc99c4d3-b2ef-40eb-93e8-d5d373e6acae tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:22.917534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fc99c4d3-b2ef-40eb-93e8-d5d373e6acae tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:22.925567 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fc99c4d3-b2ef-40eb-93e8-d5d373e6acae tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1684 microversion: 2.1 time: 0.154222 Jul 20 05:03:22.926119 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3562/6888] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:22 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:23.943698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ff339016-3054-42a7-968c-e3de2d2532c3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:23.944352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ff339016-3054-42a7-968c-e3de2d2532c3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:23.951996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff339016-3054-42a7-968c-e3de2d2532c3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:23.952496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff339016-3054-42a7-968c-e3de2d2532c3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:23.953295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff339016-3054-42a7-968c-e3de2d2532c3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:23.953744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ff339016-3054-42a7-968c-e3de2d2532c3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:24.089040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ff339016-3054-42a7-968c-e3de2d2532c3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:24.097209 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ff339016-3054-42a7-968c-e3de2d2532c3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1684 microversion: 2.1 time: 0.157556 Jul 20 05:03:24.097815 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3327/6889] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:23 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:25.117076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c18e3c68-0e57-4488-8fa5-1fb2711d4963 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:25.117857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c18e3c68-0e57-4488-8fa5-1fb2711d4963 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:25.128285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c18e3c68-0e57-4488-8fa5-1fb2711d4963 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:25.128753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c18e3c68-0e57-4488-8fa5-1fb2711d4963 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:25.129542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c18e3c68-0e57-4488-8fa5-1fb2711d4963 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:25.129985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c18e3c68-0e57-4488-8fa5-1fb2711d4963 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:25.279336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c18e3c68-0e57-4488-8fa5-1fb2711d4963 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:25.287301 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c18e3c68-0e57-4488-8fa5-1fb2711d4963 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1684 microversion: 2.1 time: 0.175735 Jul 20 05:03:25.287890 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3563/6890] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:25 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:26.305736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2e5aac49-47b1-4366-b5fd-0f2d00f0bfe2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:26.306317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2e5aac49-47b1-4366-b5fd-0f2d00f0bfe2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:26.313916 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e5aac49-47b1-4366-b5fd-0f2d00f0bfe2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:26.314411 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e5aac49-47b1-4366-b5fd-0f2d00f0bfe2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:26.315190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e5aac49-47b1-4366-b5fd-0f2d00f0bfe2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:26.315632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e5aac49-47b1-4366-b5fd-0f2d00f0bfe2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:26.447189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2e5aac49-47b1-4366-b5fd-0f2d00f0bfe2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:26.455304 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2e5aac49-47b1-4366-b5fd-0f2d00f0bfe2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1684 microversion: 2.1 time: 0.153637 Jul 20 05:03:26.455906 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3328/6891] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:26 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:27.473605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b7ab3c87-df21-4db0-895a-d1c894f67199 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:27.474307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b7ab3c87-df21-4db0-895a-d1c894f67199 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:27.481629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b7ab3c87-df21-4db0-895a-d1c894f67199 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:27.482195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b7ab3c87-df21-4db0-895a-d1c894f67199 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:27.482991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b7ab3c87-df21-4db0-895a-d1c894f67199 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:27.483420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b7ab3c87-df21-4db0-895a-d1c894f67199 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:27.626687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b7ab3c87-df21-4db0-895a-d1c894f67199 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:27.635227 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b7ab3c87-df21-4db0-895a-d1c894f67199 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1684 microversion: 2.1 time: 0.165625 Jul 20 05:03:27.635835 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3564/6892] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:27 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:28.653707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c5342427-7be9-403f-ae2a-692e67eec5f1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:28.654433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c5342427-7be9-403f-ae2a-692e67eec5f1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:28.661752 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5342427-7be9-403f-ae2a-692e67eec5f1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:28.662224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5342427-7be9-403f-ae2a-692e67eec5f1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:28.663138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5342427-7be9-403f-ae2a-692e67eec5f1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:28.663521 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5342427-7be9-403f-ae2a-692e67eec5f1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:28.828454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c5342427-7be9-403f-ae2a-692e67eec5f1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:28.838909 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c5342427-7be9-403f-ae2a-692e67eec5f1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1684 microversion: 2.1 time: 0.189301 Jul 20 05:03:28.839592 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3329/6893] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:28 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1684 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:29.202709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-fc190280-837d-4f8c-b6b5-3715da6a258c req-7429b0ca-4a21-4ee6-ad2a-b5f3d6cf3780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e665a555-bc6e-4074-9fda-f1a9e4e8a8be", "name": "network-vif-unplugged", "status": "completed", "tag": "7253f14a-00fd-468f-8a6d-9d5341f14398"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:29.212861 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-fc190280-837d-4f8c-b6b5-3715da6a258c req-7429b0ca-4a21-4ee6-ad2a-b5f3d6cf3780 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:29.213255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-fc190280-837d-4f8c-b6b5-3715da6a258c req-7429b0ca-4a21-4ee6-ad2a-b5f3d6cf3780 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:29.230238 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-fc190280-837d-4f8c-b6b5-3715da6a258c req-7429b0ca-4a21-4ee6-ad2a-b5f3d6cf3780 service nova] Creating event network-vif-unplugged:7253f14a-00fd-468f-8a6d-9d5341f14398 for instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be on n-h2-826526-5 Jul 20 05:03:29.240103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-fc190280-837d-4f8c-b6b5-3715da6a258c req-7429b0ca-4a21-4ee6-ad2a-b5f3d6cf3780 service nova] Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:03:29.252793 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-fc190280-837d-4f8c-b6b5-3715da6a258c req-7429b0ca-4a21-4ee6-ad2a-b5f3d6cf3780 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055125 Jul 20 05:03:29.253801 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3565/6894] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:03:29.864674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7ed3361b-c142-4ae1-8a19-07f6aab09bd4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:29.865344 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7ed3361b-c142-4ae1-8a19-07f6aab09bd4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:29.873176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ed3361b-c142-4ae1-8a19-07f6aab09bd4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:29.873640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ed3361b-c142-4ae1-8a19-07f6aab09bd4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:29.874640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ed3361b-c142-4ae1-8a19-07f6aab09bd4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:29.875088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ed3361b-c142-4ae1-8a19-07f6aab09bd4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:30.040936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7ed3361b-c142-4ae1-8a19-07f6aab09bd4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:30.057513 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7ed3361b-c142-4ae1-8a19-07f6aab09bd4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1683 microversion: 2.1 time: 0.196518 Jul 20 05:03:30.058340 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3330/6895] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:29 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1683 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:31.077041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9f4fd1dd-0159-4d47-8054-1410cf954425 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:31.077794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9f4fd1dd-0159-4d47-8054-1410cf954425 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:31.084758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f4fd1dd-0159-4d47-8054-1410cf954425 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:31.085204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f4fd1dd-0159-4d47-8054-1410cf954425 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:31.085976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f4fd1dd-0159-4d47-8054-1410cf954425 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:31.086393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f4fd1dd-0159-4d47-8054-1410cf954425 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:31.226719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9f4fd1dd-0159-4d47-8054-1410cf954425 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:31.234745 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9f4fd1dd-0159-4d47-8054-1410cf954425 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1681 microversion: 2.1 time: 0.163026 Jul 20 05:03:31.235328 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3566/6896] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:31 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:31.269820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-8099fe95-307f-42bc-80c0-fa71686303d3 req-bc49b772-fd29-40d4-a366-ebe5bb43162f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e665a555-bc6e-4074-9fda-f1a9e4e8a8be", "tag": "7253f14a-00fd-468f-8a6d-9d5341f14398"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:31.279238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8099fe95-307f-42bc-80c0-fa71686303d3 req-bc49b772-fd29-40d4-a366-ebe5bb43162f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:31.279695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8099fe95-307f-42bc-80c0-fa71686303d3 req-bc49b772-fd29-40d4-a366-ebe5bb43162f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:31.291941 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-8099fe95-307f-42bc-80c0-fa71686303d3 req-bc49b772-fd29-40d4-a366-ebe5bb43162f service nova] Creating event network-changed:7253f14a-00fd-468f-8a6d-9d5341f14398 for instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be on n-h2-826526-5 Jul 20 05:03:31.297967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [req-8099fe95-307f-42bc-80c0-fa71686303d3 req-bc49b772-fd29-40d4-a366-ebe5bb43162f service nova] Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:03:31.310851 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-8099fe95-307f-42bc-80c0-fa71686303d3 req-bc49b772-fd29-40d4-a366-ebe5bb43162f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044668 Jul 20 05:03:31.311461 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3331/6897] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:03:32.253390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e13990ec-fb8a-497f-9f2d-bbf3ffa06e6e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:32.254324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e13990ec-fb8a-497f-9f2d-bbf3ffa06e6e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:32.262785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e13990ec-fb8a-497f-9f2d-bbf3ffa06e6e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:32.263533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e13990ec-fb8a-497f-9f2d-bbf3ffa06e6e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:32.264636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e13990ec-fb8a-497f-9f2d-bbf3ffa06e6e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:32.265285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e13990ec-fb8a-497f-9f2d-bbf3ffa06e6e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:32.470365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e13990ec-fb8a-497f-9f2d-bbf3ffa06e6e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:32.478360 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e13990ec-fb8a-497f-9f2d-bbf3ffa06e6e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1678 microversion: 2.1 time: 0.229177 Jul 20 05:03:32.478968 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3567/6898] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:32 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1678 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:32.497914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9e5828b1-15c6-4ad0-9f6b-e0f0cbd470f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:32.498626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9e5828b1-15c6-4ad0-9f6b-e0f0cbd470f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:32.506243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e5828b1-15c6-4ad0-9f6b-e0f0cbd470f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:32.507049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e5828b1-15c6-4ad0-9f6b-e0f0cbd470f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:32.507849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e5828b1-15c6-4ad0-9f6b-e0f0cbd470f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:32.508338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e5828b1-15c6-4ad0-9f6b-e0f0cbd470f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:32.574043 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9e5828b1-15c6-4ad0-9f6b-e0f0cbd470f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "POST /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be/action" status: 204 len: 0 microversion: 2.1 time: 0.081690 Jul 20 05:03:32.574740 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3332/6899] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:03:32 2022] POST /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:03:32.583140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c5bfc25a-c4c0-484c-9529-c5210f7629de tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:32.583856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c5bfc25a-c4c0-484c-9529-c5210f7629de tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:32.590464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5bfc25a-c4c0-484c-9529-c5210f7629de tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:32.590801 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5bfc25a-c4c0-484c-9529-c5210f7629de tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:32.591605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5bfc25a-c4c0-484c-9529-c5210f7629de tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:32.592090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5bfc25a-c4c0-484c-9529-c5210f7629de tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:32.731778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c5bfc25a-c4c0-484c-9529-c5210f7629de tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:32.739764 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c5bfc25a-c4c0-484c-9529-c5210f7629de tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1678 microversion: 2.1 time: 0.160543 Jul 20 05:03:32.740360 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3568/6900] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:32 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:33.760915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-21313df6-4ea1-4129-b400-0a89226db63e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:33.761712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-21313df6-4ea1-4129-b400-0a89226db63e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:33.769700 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21313df6-4ea1-4129-b400-0a89226db63e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:33.770329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21313df6-4ea1-4129-b400-0a89226db63e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:33.771452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21313df6-4ea1-4129-b400-0a89226db63e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:33.771626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-21313df6-4ea1-4129-b400-0a89226db63e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:33.882377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-8ac6c121-5234-48ae-85d6-a6f6eb6d0aa4 req-a5fc7745-bbce-4503-a5f5-b64d33c833b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e665a555-bc6e-4074-9fda-f1a9e4e8a8be", "name": "network-vif-plugged", "status": "completed", "tag": "7253f14a-00fd-468f-8a6d-9d5341f14398"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:33.894942 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8ac6c121-5234-48ae-85d6-a6f6eb6d0aa4 req-a5fc7745-bbce-4503-a5f5-b64d33c833b7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:33.895835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8ac6c121-5234-48ae-85d6-a6f6eb6d0aa4 req-a5fc7745-bbce-4503-a5f5-b64d33c833b7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:33.910669 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-8ac6c121-5234-48ae-85d6-a6f6eb6d0aa4 req-a5fc7745-bbce-4503-a5f5-b64d33c833b7 service nova] Creating event network-vif-plugged:7253f14a-00fd-468f-8a6d-9d5341f14398 for instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be on n-h2-826526-5 Jul 20 05:03:33.917224 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-8ac6c121-5234-48ae-85d6-a6f6eb6d0aa4 req-a5fc7745-bbce-4503-a5f5-b64d33c833b7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040282 Jul 20 05:03:33.918207 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3569/6901] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:03:33.930966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-21313df6-4ea1-4129-b400-0a89226db63e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:33.941364 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-21313df6-4ea1-4129-b400-0a89226db63e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1670 microversion: 2.1 time: 0.186783 Jul 20 05:03:33.942189 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3333/6902] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:33 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1670 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:03:33.959934 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9371b1e6-2600-490b-871c-42261169b8a6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:33.961330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9371b1e6-2600-490b-871c-42261169b8a6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:33.967818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9371b1e6-2600-490b-871c-42261169b8a6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:33.968284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9371b1e6-2600-490b-871c-42261169b8a6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:33.969245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9371b1e6-2600-490b-871c-42261169b8a6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:33.969837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9371b1e6-2600-490b-871c-42261169b8a6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:34.119383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9371b1e6-2600-490b-871c-42261169b8a6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:34.127481 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9371b1e6-2600-490b-871c-42261169b8a6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1670 microversion: 2.1 time: 0.172358 Jul 20 05:03:34.128057 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3570/6903] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:33 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:34.144144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0f1396ce-3f6f-477c-ab7b-125750688538 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:34.144732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0f1396ce-3f6f-477c-ab7b-125750688538 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:34.153272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f1396ce-3f6f-477c-ab7b-125750688538 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:34.153725 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f1396ce-3f6f-477c-ab7b-125750688538 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:34.155684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f1396ce-3f6f-477c-ab7b-125750688538 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:34.155684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f1396ce-3f6f-477c-ab7b-125750688538 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:34.298676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0f1396ce-3f6f-477c-ab7b-125750688538 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:34.306598 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0f1396ce-3f6f-477c-ab7b-125750688538 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1670 microversion: 2.1 time: 0.166473 Jul 20 05:03:34.307184 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3334/6904] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:34 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:34.322855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b025cb4b-7e5d-4a3b-889b-15d57d9280b1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:34.323535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b025cb4b-7e5d-4a3b-889b-15d57d9280b1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:34.329476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b025cb4b-7e5d-4a3b-889b-15d57d9280b1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:34.329956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b025cb4b-7e5d-4a3b-889b-15d57d9280b1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:34.330718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b025cb4b-7e5d-4a3b-889b-15d57d9280b1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:34.331158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b025cb4b-7e5d-4a3b-889b-15d57d9280b1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:34.357582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b025cb4b-7e5d-4a3b-889b-15d57d9280b1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:03:34.403907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:34.441571 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b025cb4b-7e5d-4a3b-889b-15d57d9280b1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 204 len: 0 microversion: 2.1 time: 0.122421 Jul 20 05:03:34.442201 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3571/6905] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:03:34 2022] DELETE /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:03:34.451002 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-863ad92d-2130-4b2e-90ee-df7cc88d2717 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:34.451670 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-863ad92d-2130-4b2e-90ee-df7cc88d2717 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:34.458112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-863ad92d-2130-4b2e-90ee-df7cc88d2717 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:34.458584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-863ad92d-2130-4b2e-90ee-df7cc88d2717 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:34.459370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-863ad92d-2130-4b2e-90ee-df7cc88d2717 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:34.459844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-863ad92d-2130-4b2e-90ee-df7cc88d2717 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:34.594584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-863ad92d-2130-4b2e-90ee-df7cc88d2717 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:34.602649 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-863ad92d-2130-4b2e-90ee-df7cc88d2717 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1676 microversion: 2.1 time: 0.155812 Jul 20 05:03:34.603237 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3335/6906] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:34 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:35.620432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f7f490d1-3e8a-4f43-ad95-b18c896e4d53 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:35.621350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f7f490d1-3e8a-4f43-ad95-b18c896e4d53 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:35.630020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7f490d1-3e8a-4f43-ad95-b18c896e4d53 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:35.630804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7f490d1-3e8a-4f43-ad95-b18c896e4d53 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:35.632147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7f490d1-3e8a-4f43-ad95-b18c896e4d53 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:35.632818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7f490d1-3e8a-4f43-ad95-b18c896e4d53 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:35.830879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f7f490d1-3e8a-4f43-ad95-b18c896e4d53 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:35.838970 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f7f490d1-3e8a-4f43-ad95-b18c896e4d53 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 200 len: 1676 microversion: 2.1 time: 0.223054 Jul 20 05:03:35.839575 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3572/6907] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:35 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 1676 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:36.581535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-7cbdc174-06f6-499b-ab1d-5202d0bfb494 req-8d99bb80-753c-4a5c-b063-8e35f6fb8cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e665a555-bc6e-4074-9fda-f1a9e4e8a8be", "name": "network-vif-deleted", "tag": "7253f14a-00fd-468f-8a6d-9d5341f14398"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:36.595036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7cbdc174-06f6-499b-ab1d-5202d0bfb494 req-8d99bb80-753c-4a5c-b063-8e35f6fb8cd3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:36.595575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7cbdc174-06f6-499b-ab1d-5202d0bfb494 req-8d99bb80-753c-4a5c-b063-8e35f6fb8cd3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:36.610527 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-7cbdc174-06f6-499b-ab1d-5202d0bfb494 req-8d99bb80-753c-4a5c-b063-8e35f6fb8cd3 service nova] Creating event network-vif-deleted:7253f14a-00fd-468f-8a6d-9d5341f14398 for instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be on n-h2-826526-5 Jul 20 05:03:36.617116 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-7cbdc174-06f6-499b-ab1d-5202d0bfb494 req-8d99bb80-753c-4a5c-b063-8e35f6fb8cd3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039026 Jul 20 05:03:36.618076 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3336/6908] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:03:36.856403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c6627038-7d0c-4291-b7a4-67cfd0e46b3d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:36.857051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c6627038-7d0c-4291-b7a4-67cfd0e46b3d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:36.864369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6627038-7d0c-4291-b7a4-67cfd0e46b3d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:36.864814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6627038-7d0c-4291-b7a4-67cfd0e46b3d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:36.865588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6627038-7d0c-4291-b7a4-67cfd0e46b3d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:36.866030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c6627038-7d0c-4291-b7a4-67cfd0e46b3d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:36.881161 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-c6627038-7d0c-4291-b7a4-67cfd0e46b3d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] HTTP exception thrown: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c6627038-7d0c-4291-b7a4-67cfd0e46b3d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Request method failure captured: Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be HTTP/1.1 Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14xl7kYURKR1dAkImi-dAM82dgRxeC4kwp-cBHDMeNqZvthepvqFh3YSxp0Sn4tCx2nWbnu1dX7qXdmEBl_1kCyJIPxFOMsgNP1G8qlJkVXjjexD8ZbQbeqq1Hv8-MpYrMoSqBIpZdvX2pvMr-M6p7LeV-yJHws23gLehuzUB9GuSSo Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c48dbfac2a784ca7a2d027f8c102df69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}] Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c1b8ef10ecd447b8b2a3cc297731059c Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'e665a555-bc6e-4074-9fda-f1a9e4e8a8be'} Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:03:36.883302 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:03:36.886893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:36.886893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:03:36.886893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:03:36.886893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:03:36.886893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:03:36.886893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:03:36.886893 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:03:36.886893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c6627038-7d0c-4291-b7a4-67cfd0e46b3d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Returning 404 to user: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:03:36.886893 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c6627038-7d0c-4291-b7a4-67cfd0e46b3d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 404 len: 111 microversion: 2.1 time: 0.032371 Jul 20 05:03:36.886893 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3573/6909] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:36 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:03:36.902302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9529b4a0-0690-4c5c-a5e5-ad9e72bfbf92 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:36.903045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9529b4a0-0690-4c5c-a5e5-ad9e72bfbf92 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:36.911089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9529b4a0-0690-4c5c-a5e5-ad9e72bfbf92 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:36.911546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9529b4a0-0690-4c5c-a5e5-ad9e72bfbf92 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:36.912385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9529b4a0-0690-4c5c-a5e5-ad9e72bfbf92 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:36.912851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9529b4a0-0690-4c5c-a5e5-ad9e72bfbf92 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:36.927772 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-9529b4a0-0690-4c5c-a5e5-ad9e72bfbf92 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] HTTP exception thrown: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9529b4a0-0690-4c5c-a5e5-ad9e72bfbf92 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Request method failure captured: Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be HTTP/1.1 Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14xl7kYURKR1dAkImi-dAM82dgRxeC4kwp-cBHDMeNqZvthepvqFh3YSxp0Sn4tCx2nWbnu1dX7qXdmEBl_1kCyJIPxFOMsgNP1G8qlJkVXjjexD8ZbQbeqq1Hv8-MpYrMoSqBIpZdvX2pvMr-M6p7LeV-yJHws23gLehuzUB9GuSSo Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c48dbfac2a784ca7a2d027f8c102df69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}] Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: c1b8ef10ecd447b8b2a3cc297731059c Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'e665a555-bc6e-4074-9fda-f1a9e4e8a8be'} Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:03:36.929436 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:03:36.932588 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:36.932588 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:03:36.932588 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:03:36.932588 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:03:36.932588 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:03:36.932588 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:03:36.932588 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:03:36.932588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9529b4a0-0690-4c5c-a5e5-ad9e72bfbf92 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Returning 404 to user: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:03:36.932588 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9529b4a0-0690-4c5c-a5e5-ad9e72bfbf92 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 404 len: 111 microversion: 2.1 time: 0.034989 Jul 20 05:03:36.932588 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3337/6910] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:36 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:03:36.978691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a7503bdb-db2a-4c0b-a5c9-373941bf6523 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-88763340", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "b1762f2f-2565-44bb-a011-b37176955a43"}], "security_groups": [{"name": "tempest-securitygroup--1758487340"}], "key_name": "tempest-keypair-1918112510", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:37.093120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-a7503bdb-db2a-4c0b-a5c9-373941bf6523 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] validate_networks() for [('b1762f2f-2565-44bb-a011-b37176955a43', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:03:37.509280 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-a7503bdb-db2a-4c0b-a5c9-373941bf6523 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:03:37.509802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-a7503bdb-db2a-4c0b-a5c9-373941bf6523 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:03:37.510279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-a7503bdb-db2a-4c0b-a5c9-373941bf6523 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:03:37.510719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-a7503bdb-db2a-4c0b-a5c9-373941bf6523 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:03:37.511130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-a7503bdb-db2a-4c0b-a5c9-373941bf6523 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:03:37.521491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7503bdb-db2a-4c0b-a5c9-373941bf6523 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:37.521937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7503bdb-db2a-4c0b-a5c9-373941bf6523 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:37.522729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7503bdb-db2a-4c0b-a5c9-373941bf6523 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:37.523169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a7503bdb-db2a-4c0b-a5c9-373941bf6523 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:37.541821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-a7503bdb-db2a-4c0b-a5c9-373941bf6523 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Getting quotas for project c48dbfac2a784ca7a2d027f8c102df69. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:03:37.547602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-a7503bdb-db2a-4c0b-a5c9-373941bf6523 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Getting quotas for user c1b8ef10ecd447b8b2a3cc297731059c and project c48dbfac2a784ca7a2d027f8c102df69. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:03:37.562036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a7503bdb-db2a-4c0b-a5c9-373941bf6523 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:03:37.564520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a7503bdb-db2a-4c0b-a5c9-373941bf6523 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:03:37.616294 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a7503bdb-db2a-4c0b-a5c9-373941bf6523 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.641815 Jul 20 05:03:37.616945 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3574/6911] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:03:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:03:37.627125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b508af1c-6b64-4c20-a0f5-5f3074149ad6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:37.628070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b508af1c-6b64-4c20-a0f5-5f3074149ad6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:37.685094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b508af1c-6b64-4c20-a0f5-5f3074149ad6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:37.693530 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b508af1c-6b64-4c20-a0f5-5f3074149ad6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1237 microversion: 2.1 time: 0.070355 Jul 20 05:03:37.694105 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3338/6912] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:37 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:03:38.712586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a63238fd-7c1e-4d39-92e8-de2281261064 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:38.713416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a63238fd-7c1e-4d39-92e8-de2281261064 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:38.723550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a63238fd-7c1e-4d39-92e8-de2281261064 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:38.724029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a63238fd-7c1e-4d39-92e8-de2281261064 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:38.724878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a63238fd-7c1e-4d39-92e8-de2281261064 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:38.725549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a63238fd-7c1e-4d39-92e8-de2281261064 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:38.801491 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a63238fd-7c1e-4d39-92e8-de2281261064 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:38.809520 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a63238fd-7c1e-4d39-92e8-de2281261064 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1295 microversion: 2.1 time: 0.101925 Jul 20 05:03:38.810111 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3575/6913] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:38 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1295 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:03:39.829546 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cb7fe708-076f-406b-b0fd-da2252efa3e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:39.830276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cb7fe708-076f-406b-b0fd-da2252efa3e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:39.837419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb7fe708-076f-406b-b0fd-da2252efa3e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:39.837885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb7fe708-076f-406b-b0fd-da2252efa3e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:39.838684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb7fe708-076f-406b-b0fd-da2252efa3e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:39.839139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb7fe708-076f-406b-b0fd-da2252efa3e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:39.842288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:39.993480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cb7fe708-076f-406b-b0fd-da2252efa3e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:40.002329 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cb7fe708-076f-406b-b0fd-da2252efa3e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1363 microversion: 2.1 time: 0.178157 Jul 20 05:03:40.003197 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3339/6914] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:39 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:40.368720 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-9df7e6e1-678b-4945-b438-6c659f8a1db5 req-488a53e4-62b2-4503-9eca-50e651d735a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50765564-6f99-456e-80a1-104a57d0b86c", "tag": "1c1c10db-ce54-4464-b78a-5c6a6953d9fd"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:40.396100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9df7e6e1-678b-4945-b438-6c659f8a1db5 req-488a53e4-62b2-4503-9eca-50e651d735a2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:40.396668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9df7e6e1-678b-4945-b438-6c659f8a1db5 req-488a53e4-62b2-4503-9eca-50e651d735a2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:40.414836 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9df7e6e1-678b-4945-b438-6c659f8a1db5 req-488a53e4-62b2-4503-9eca-50e651d735a2 service nova] Creating event network-changed:1c1c10db-ce54-4464-b78a-5c6a6953d9fd for instance 50765564-6f99-456e-80a1-104a57d0b86c on n-h2-826526-5 Jul 20 05:03:40.420215 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-9df7e6e1-678b-4945-b438-6c659f8a1db5 req-488a53e4-62b2-4503-9eca-50e651d735a2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063380 Jul 20 05:03:40.421300 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3576/6915] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:03:41.021266 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2b631ab9-24df-4e16-8a29-14c80ab9c320 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:41.021784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2b631ab9-24df-4e16-8a29-14c80ab9c320 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:41.031136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b631ab9-24df-4e16-8a29-14c80ab9c320 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:41.031593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b631ab9-24df-4e16-8a29-14c80ab9c320 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:41.032956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b631ab9-24df-4e16-8a29-14c80ab9c320 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:41.033411 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b631ab9-24df-4e16-8a29-14c80ab9c320 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:41.170302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2b631ab9-24df-4e16-8a29-14c80ab9c320 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:41.179001 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2b631ab9-24df-4e16-8a29-14c80ab9c320 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1363 microversion: 2.1 time: 0.162002 Jul 20 05:03:41.179589 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3340/6916] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:41 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:03:42.198172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dbeae33c-6f64-4ecf-9fe8-347cc338fbb9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:42.199581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dbeae33c-6f64-4ecf-9fe8-347cc338fbb9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:42.208391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbeae33c-6f64-4ecf-9fe8-347cc338fbb9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:42.209560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbeae33c-6f64-4ecf-9fe8-347cc338fbb9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:42.210777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbeae33c-6f64-4ecf-9fe8-347cc338fbb9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:42.211299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dbeae33c-6f64-4ecf-9fe8-347cc338fbb9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:42.424475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dbeae33c-6f64-4ecf-9fe8-347cc338fbb9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:42.432417 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dbeae33c-6f64-4ecf-9fe8-347cc338fbb9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1363 microversion: 2.1 time: 0.239007 Jul 20 05:03:42.433005 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3577/6917] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:42 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:43.450114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fe81f5b3-fbfa-4a6a-9fe4-f7869a10c77c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:43.450743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fe81f5b3-fbfa-4a6a-9fe4-f7869a10c77c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:43.458377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe81f5b3-fbfa-4a6a-9fe4-f7869a10c77c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:43.458850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe81f5b3-fbfa-4a6a-9fe4-f7869a10c77c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:43.459648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe81f5b3-fbfa-4a6a-9fe4-f7869a10c77c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:43.460108 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe81f5b3-fbfa-4a6a-9fe4-f7869a10c77c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:43.600578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fe81f5b3-fbfa-4a6a-9fe4-f7869a10c77c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:43.608287 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fe81f5b3-fbfa-4a6a-9fe4-f7869a10c77c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1363 microversion: 2.1 time: 0.162232 Jul 20 05:03:43.609066 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3341/6918] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:43 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:43.869915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-017c4a22-7a98-4d03-970e-49d45bdad214 req-c85c837d-7a19-469d-9451-c29535569446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50765564-6f99-456e-80a1-104a57d0b86c", "name": "network-vif-plugged", "status": "completed", "tag": "1c1c10db-ce54-4464-b78a-5c6a6953d9fd"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:43.881330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-017c4a22-7a98-4d03-970e-49d45bdad214 req-c85c837d-7a19-469d-9451-c29535569446 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:43.882073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-017c4a22-7a98-4d03-970e-49d45bdad214 req-c85c837d-7a19-469d-9451-c29535569446 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:43.894475 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-017c4a22-7a98-4d03-970e-49d45bdad214 req-c85c837d-7a19-469d-9451-c29535569446 service nova] Creating event network-vif-plugged:1c1c10db-ce54-4464-b78a-5c6a6953d9fd for instance 50765564-6f99-456e-80a1-104a57d0b86c on n-h2-826526-5 Jul 20 05:03:43.899801 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-017c4a22-7a98-4d03-970e-49d45bdad214 req-c85c837d-7a19-469d-9451-c29535569446 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033838 Jul 20 05:03:43.900683 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3578/6919] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:03:44.625901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-00148e87-82f0-4b4a-ac2d-1e9d06c00cd1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:44.626606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-00148e87-82f0-4b4a-ac2d-1e9d06c00cd1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:44.630219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=45 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:44.636570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00148e87-82f0-4b4a-ac2d-1e9d06c00cd1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:44.637033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00148e87-82f0-4b4a-ac2d-1e9d06c00cd1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:44.637820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00148e87-82f0-4b4a-ac2d-1e9d06c00cd1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:44.638266 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00148e87-82f0-4b4a-ac2d-1e9d06c00cd1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:44.777900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-00148e87-82f0-4b4a-ac2d-1e9d06c00cd1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:44.788140 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-00148e87-82f0-4b4a-ac2d-1e9d06c00cd1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1363 microversion: 2.1 time: 0.166316 Jul 20 05:03:44.788789 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3342/6920] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:44 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:45.808091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f8264f2c-8805-4e3b-87fb-f54d37b8aaac tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:45.808823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f8264f2c-8805-4e3b-87fb-f54d37b8aaac tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:45.810793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:45.816997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8264f2c-8805-4e3b-87fb-f54d37b8aaac tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:45.817453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8264f2c-8805-4e3b-87fb-f54d37b8aaac tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:45.818234 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8264f2c-8805-4e3b-87fb-f54d37b8aaac tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:45.818683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f8264f2c-8805-4e3b-87fb-f54d37b8aaac tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:45.963999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f8264f2c-8805-4e3b-87fb-f54d37b8aaac tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:45.974200 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f8264f2c-8805-4e3b-87fb-f54d37b8aaac tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1551 microversion: 2.1 time: 0.171429 Jul 20 05:03:45.974774 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3579/6921] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:45 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1551 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:45.991443 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-71614157-c299-407f-95c2-0f6bddc468c3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:45.991958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-71614157-c299-407f-95c2-0f6bddc468c3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:45.999645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71614157-c299-407f-95c2-0f6bddc468c3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:46.000116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71614157-c299-407f-95c2-0f6bddc468c3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:46.000950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71614157-c299-407f-95c2-0f6bddc468c3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:46.001406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71614157-c299-407f-95c2-0f6bddc468c3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:46.093428 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-71614157-c299-407f-95c2-0f6bddc468c3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105551 Jul 20 05:03:46.094395 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3343/6922] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 05:03:45 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:03:47.095827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-7e2baae9-64d2-4f23-a1f8-0419892e3b61 req-5b424557-5f39-4504-ab2f-f30eab875be5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50765564-6f99-456e-80a1-104a57d0b86c", "tag": "1c1c10db-ce54-4464-b78a-5c6a6953d9fd"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:47.105464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7e2baae9-64d2-4f23-a1f8-0419892e3b61 req-5b424557-5f39-4504-ab2f-f30eab875be5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:47.105844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7e2baae9-64d2-4f23-a1f8-0419892e3b61 req-5b424557-5f39-4504-ab2f-f30eab875be5 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:47.118076 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-7e2baae9-64d2-4f23-a1f8-0419892e3b61 req-5b424557-5f39-4504-ab2f-f30eab875be5 service nova] Creating event network-changed:1c1c10db-ce54-4464-b78a-5c6a6953d9fd for instance 50765564-6f99-456e-80a1-104a57d0b86c on n-h2-826526-5 Jul 20 05:03:47.123454 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-7e2baae9-64d2-4f23-a1f8-0419892e3b61 req-5b424557-5f39-4504-ab2f-f30eab875be5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031635 Jul 20 05:03:47.124060 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3580/6923] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:04:20.025403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:20.026435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:20.027153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=27 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:20.031573 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-455f7bab-8c0e-45ce-b874-6c790778d24f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:20.039213 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-455f7bab-8c0e-45ce-b874-6c790778d24f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:20.039673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-455f7bab-8c0e-45ce-b874-6c790778d24f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:20.062803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-455f7bab-8c0e-45ce-b874-6c790778d24f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Going to try to stop instance {{(pid=127870) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 05:04:20.114859 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-455f7bab-8c0e-45ce-b874-6c790778d24f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "POST /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c/action" status: 202 len: 0 microversion: 2.1 time: 0.090557 Jul 20 05:04:20.115545 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3344/6924] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:04:20 2022] POST /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:04:20.125404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-86676df1-cd0a-4c74-83f6-14e4888469c6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:20.126194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-86676df1-cd0a-4c74-83f6-14e4888469c6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:20.128377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:20.129229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:20.130999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:20.132194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:20.139838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86676df1-cd0a-4c74-83f6-14e4888469c6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:20.140305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86676df1-cd0a-4c74-83f6-14e4888469c6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:20.141107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86676df1-cd0a-4c74-83f6-14e4888469c6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:20.141539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86676df1-cd0a-4c74-83f6-14e4888469c6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:20.283035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-86676df1-cd0a-4c74-83f6-14e4888469c6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:20.291318 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-86676df1-cd0a-4c74-83f6-14e4888469c6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1679 microversion: 2.1 time: 0.170278 Jul 20 05:04:20.291906 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3581/6925] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:20 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:21.312809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-922882b6-9a7a-45e8-99f5-0a736865c737 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:21.313594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-922882b6-9a7a-45e8-99f5-0a736865c737 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:21.321870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-922882b6-9a7a-45e8-99f5-0a736865c737 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:21.322438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-922882b6-9a7a-45e8-99f5-0a736865c737 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:21.323252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-922882b6-9a7a-45e8-99f5-0a736865c737 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:21.323720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-922882b6-9a7a-45e8-99f5-0a736865c737 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:21.468162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-922882b6-9a7a-45e8-99f5-0a736865c737 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:21.480138 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-922882b6-9a7a-45e8-99f5-0a736865c737 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1679 microversion: 2.1 time: 0.171816 Jul 20 05:04:21.480976 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3345/6926] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:21 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:22.500591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-349dcf39-00fa-47b2-b641-5ab3e37d2f6e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:22.501415 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-349dcf39-00fa-47b2-b641-5ab3e37d2f6e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:22.512438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-349dcf39-00fa-47b2-b641-5ab3e37d2f6e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:22.512893 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-349dcf39-00fa-47b2-b641-5ab3e37d2f6e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:22.513676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-349dcf39-00fa-47b2-b641-5ab3e37d2f6e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:22.514101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-349dcf39-00fa-47b2-b641-5ab3e37d2f6e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:22.657619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-349dcf39-00fa-47b2-b641-5ab3e37d2f6e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:22.665827 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-349dcf39-00fa-47b2-b641-5ab3e37d2f6e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1679 microversion: 2.1 time: 0.171002 Jul 20 05:04:22.666428 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3582/6927] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:22 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:23.684421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9d4ccf1c-ef35-42c8-9dbb-fc90d11fa739 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:23.687337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9d4ccf1c-ef35-42c8-9dbb-fc90d11fa739 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:23.692650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d4ccf1c-ef35-42c8-9dbb-fc90d11fa739 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:23.693103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d4ccf1c-ef35-42c8-9dbb-fc90d11fa739 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:23.693884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d4ccf1c-ef35-42c8-9dbb-fc90d11fa739 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:23.694334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d4ccf1c-ef35-42c8-9dbb-fc90d11fa739 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:23.832335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9d4ccf1c-ef35-42c8-9dbb-fc90d11fa739 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:23.840507 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9d4ccf1c-ef35-42c8-9dbb-fc90d11fa739 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1679 microversion: 2.1 time: 0.160484 Jul 20 05:04:23.841093 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3346/6928] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:23 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:24.862294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5caed441-3038-433b-affa-aa98a50ff10e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:24.863301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5caed441-3038-433b-affa-aa98a50ff10e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:24.873989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5caed441-3038-433b-affa-aa98a50ff10e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:24.874439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5caed441-3038-433b-affa-aa98a50ff10e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:24.875203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5caed441-3038-433b-affa-aa98a50ff10e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:24.875639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5caed441-3038-433b-affa-aa98a50ff10e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:25.023508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5caed441-3038-433b-affa-aa98a50ff10e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:25.035428 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5caed441-3038-433b-affa-aa98a50ff10e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1679 microversion: 2.1 time: 0.179594 Jul 20 05:04:25.036331 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3583/6929] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:24 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:26.057288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ee8481b2-ccc0-4748-8a9b-52e834645611 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:26.057880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ee8481b2-ccc0-4748-8a9b-52e834645611 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:26.065494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee8481b2-ccc0-4748-8a9b-52e834645611 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:26.065963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee8481b2-ccc0-4748-8a9b-52e834645611 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:26.066756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee8481b2-ccc0-4748-8a9b-52e834645611 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:26.067214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ee8481b2-ccc0-4748-8a9b-52e834645611 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:26.213976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ee8481b2-ccc0-4748-8a9b-52e834645611 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:26.222573 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ee8481b2-ccc0-4748-8a9b-52e834645611 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1679 microversion: 2.1 time: 0.170151 Jul 20 05:04:26.223168 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3347/6930] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:26 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:27.239721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-89b0376e-1ac0-44ae-8dd2-bf2fe9d7170c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:27.240994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-89b0376e-1ac0-44ae-8dd2-bf2fe9d7170c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:27.248427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89b0376e-1ac0-44ae-8dd2-bf2fe9d7170c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:27.248884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89b0376e-1ac0-44ae-8dd2-bf2fe9d7170c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:27.249647 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89b0376e-1ac0-44ae-8dd2-bf2fe9d7170c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:27.250138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89b0376e-1ac0-44ae-8dd2-bf2fe9d7170c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:27.458728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-89b0376e-1ac0-44ae-8dd2-bf2fe9d7170c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:27.467021 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-89b0376e-1ac0-44ae-8dd2-bf2fe9d7170c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1679 microversion: 2.1 time: 0.231608 Jul 20 05:04:27.467612 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3584/6931] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:27 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1679 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:28.488640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1ef527d0-7e4e-4dca-95a7-0cba8c1b7cb1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:28.489408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1ef527d0-7e4e-4dca-95a7-0cba8c1b7cb1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:28.499881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ef527d0-7e4e-4dca-95a7-0cba8c1b7cb1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:28.500383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ef527d0-7e4e-4dca-95a7-0cba8c1b7cb1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:28.501170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ef527d0-7e4e-4dca-95a7-0cba8c1b7cb1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:28.501623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ef527d0-7e4e-4dca-95a7-0cba8c1b7cb1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:28.715165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1ef527d0-7e4e-4dca-95a7-0cba8c1b7cb1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:28.727500 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1ef527d0-7e4e-4dca-95a7-0cba8c1b7cb1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1679 microversion: 2.1 time: 0.245101 Jul 20 05:04:28.728280 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3348/6932] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:28 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1679 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:29.756225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-eeca9cc2-9355-4759-86b6-d3c8eb19b3c2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:29.757878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-eeca9cc2-9355-4759-86b6-d3c8eb19b3c2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:29.767635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eeca9cc2-9355-4759-86b6-d3c8eb19b3c2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:29.768096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eeca9cc2-9355-4759-86b6-d3c8eb19b3c2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:29.768906 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eeca9cc2-9355-4759-86b6-d3c8eb19b3c2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:29.769348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eeca9cc2-9355-4759-86b6-d3c8eb19b3c2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:29.984739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-eeca9cc2-9355-4759-86b6-d3c8eb19b3c2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:29.996019 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-eeca9cc2-9355-4759-86b6-d3c8eb19b3c2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1679 microversion: 2.1 time: 0.246365 Jul 20 05:04:29.996803 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3585/6933] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:29 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1679 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:31.016488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fe8a3e3c-8722-4223-944d-87e15c5f9050 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:31.017025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fe8a3e3c-8722-4223-944d-87e15c5f9050 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:31.024731 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe8a3e3c-8722-4223-944d-87e15c5f9050 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:31.025210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe8a3e3c-8722-4223-944d-87e15c5f9050 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:31.025981 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe8a3e3c-8722-4223-944d-87e15c5f9050 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:31.026441 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe8a3e3c-8722-4223-944d-87e15c5f9050 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:31.179319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fe8a3e3c-8722-4223-944d-87e15c5f9050 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:31.191140 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fe8a3e3c-8722-4223-944d-87e15c5f9050 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1679 microversion: 2.1 time: 0.179362 Jul 20 05:04:31.191953 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3349/6934] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:31 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:32.212446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f130e121-f030-4a0e-badf-6af393525f2d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:32.212984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f130e121-f030-4a0e-badf-6af393525f2d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:32.220184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f130e121-f030-4a0e-badf-6af393525f2d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:32.220666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f130e121-f030-4a0e-badf-6af393525f2d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:32.221432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f130e121-f030-4a0e-badf-6af393525f2d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:32.221867 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f130e121-f030-4a0e-badf-6af393525f2d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:32.354999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f130e121-f030-4a0e-badf-6af393525f2d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:32.362839 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f130e121-f030-4a0e-badf-6af393525f2d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1679 microversion: 2.1 time: 0.154697 Jul 20 05:04:32.363405 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3586/6935] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:32 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:33.385504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-73c9b0ee-6d50-4df2-bab5-a14950e8c7d8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:33.386466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-73c9b0ee-6d50-4df2-bab5-a14950e8c7d8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:33.394673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c9b0ee-6d50-4df2-bab5-a14950e8c7d8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:33.395142 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c9b0ee-6d50-4df2-bab5-a14950e8c7d8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:33.395926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c9b0ee-6d50-4df2-bab5-a14950e8c7d8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:33.396416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c9b0ee-6d50-4df2-bab5-a14950e8c7d8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:33.537298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-73c9b0ee-6d50-4df2-bab5-a14950e8c7d8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:33.547427 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-73c9b0ee-6d50-4df2-bab5-a14950e8c7d8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1679 microversion: 2.1 time: 0.169272 Jul 20 05:04:33.548020 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3350/6936] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:33 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:34.566332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3b2720be-ac02-4927-b7d3-3f81f72aab84 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:34.566968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3b2720be-ac02-4927-b7d3-3f81f72aab84 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:34.575264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b2720be-ac02-4927-b7d3-3f81f72aab84 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:34.575770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b2720be-ac02-4927-b7d3-3f81f72aab84 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:34.576654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b2720be-ac02-4927-b7d3-3f81f72aab84 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:34.577132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b2720be-ac02-4927-b7d3-3f81f72aab84 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:34.716217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3b2720be-ac02-4927-b7d3-3f81f72aab84 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:34.724516 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3b2720be-ac02-4927-b7d3-3f81f72aab84 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1679 microversion: 2.1 time: 0.162540 Jul 20 05:04:34.725168 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3587/6937] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:34 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:35.746000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8fe12bf6-efc6-42ee-a378-85540244245d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:35.746767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8fe12bf6-efc6-42ee-a378-85540244245d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:35.755651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8fe12bf6-efc6-42ee-a378-85540244245d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:35.756202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8fe12bf6-efc6-42ee-a378-85540244245d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:35.757617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8fe12bf6-efc6-42ee-a378-85540244245d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:35.758147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8fe12bf6-efc6-42ee-a378-85540244245d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:35.902685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8fe12bf6-efc6-42ee-a378-85540244245d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:35.910436 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8fe12bf6-efc6-42ee-a378-85540244245d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1656 microversion: 2.1 time: 0.169216 Jul 20 05:04:35.911008 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3351/6938] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:35 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1656 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:35.927188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8c2c92e6-43e5-452c-b036-88ddd0ea53e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:35.928167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8c2c92e6-43e5-452c-b036-88ddd0ea53e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:35.935250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c2c92e6-43e5-452c-b036-88ddd0ea53e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:35.935702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c2c92e6-43e5-452c-b036-88ddd0ea53e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:35.936481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c2c92e6-43e5-452c-b036-88ddd0ea53e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:35.936915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8c2c92e6-43e5-452c-b036-88ddd0ea53e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:35.967903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8c2c92e6-43e5-452c-b036-88ddd0ea53e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:35.973784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8c2c92e6-43e5-452c-b036-88ddd0ea53e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Old instance type m1.heat2, new instance type m1.heat {{(pid=127871) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:04:35.980601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8c2c92e6-43e5-452c-b036-88ddd0ea53e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:04:35.981022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8c2c92e6-43e5-452c-b036-88ddd0ea53e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:04:35.981527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8c2c92e6-43e5-452c-b036-88ddd0ea53e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:04:35.981940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8c2c92e6-43e5-452c-b036-88ddd0ea53e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:04:35.982349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-8c2c92e6-43e5-452c-b036-88ddd0ea53e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:04:36.051069 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8c2c92e6-43e5-452c-b036-88ddd0ea53e2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "POST /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c/action" status: 202 len: 0 microversion: 2.1 time: 0.127724 Jul 20 05:04:36.052204 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3588/6939] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:04:35 2022] POST /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:04:36.063265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf88218c-138e-45b9-ae54-d4f4e75002f3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:36.063912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf88218c-138e-45b9-ae54-d4f4e75002f3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:36.070379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf88218c-138e-45b9-ae54-d4f4e75002f3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:36.070845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf88218c-138e-45b9-ae54-d4f4e75002f3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:36.071632 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf88218c-138e-45b9-ae54-d4f4e75002f3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:36.072119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf88218c-138e-45b9-ae54-d4f4e75002f3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:36.237842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bf88218c-138e-45b9-ae54-d4f4e75002f3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:36.245681 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf88218c-138e-45b9-ae54-d4f4e75002f3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1679 microversion: 2.1 time: 0.187253 Jul 20 05:04:36.246470 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3352/6940] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:36 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1679 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:37.267077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2d3c5285-bc1d-4695-8118-4135dfac18ff tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:37.267673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2d3c5285-bc1d-4695-8118-4135dfac18ff tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:37.274580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d3c5285-bc1d-4695-8118-4135dfac18ff tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:37.275067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d3c5285-bc1d-4695-8118-4135dfac18ff tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:37.275842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d3c5285-bc1d-4695-8118-4135dfac18ff tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:37.276304 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2d3c5285-bc1d-4695-8118-4135dfac18ff tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:37.484002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2d3c5285-bc1d-4695-8118-4135dfac18ff tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:37.492296 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2d3c5285-bc1d-4695-8118-4135dfac18ff tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1679 microversion: 2.1 time: 0.230335 Jul 20 05:04:37.492926 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3589/6941] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:37 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1679 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:38.512760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d0698fb6-9a63-45c8-865e-61740a75c9e1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:38.513549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d0698fb6-9a63-45c8-865e-61740a75c9e1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:38.521177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0698fb6-9a63-45c8-865e-61740a75c9e1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:38.521646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0698fb6-9a63-45c8-865e-61740a75c9e1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:38.522436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0698fb6-9a63-45c8-865e-61740a75c9e1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:38.522892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0698fb6-9a63-45c8-865e-61740a75c9e1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:38.671072 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d0698fb6-9a63-45c8-865e-61740a75c9e1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:38.679155 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d0698fb6-9a63-45c8-865e-61740a75c9e1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1684 microversion: 2.1 time: 0.171813 Jul 20 05:04:38.679795 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3353/6942] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:38 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:39.697109 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-07b71338-cd12-49ff-ab5c-77a89db1a4bf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:39.697783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-07b71338-cd12-49ff-ab5c-77a89db1a4bf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:39.705002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07b71338-cd12-49ff-ab5c-77a89db1a4bf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:39.705452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07b71338-cd12-49ff-ab5c-77a89db1a4bf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:39.706212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07b71338-cd12-49ff-ab5c-77a89db1a4bf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:39.706645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07b71338-cd12-49ff-ab5c-77a89db1a4bf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:39.858364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-07b71338-cd12-49ff-ab5c-77a89db1a4bf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:39.866234 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-07b71338-cd12-49ff-ab5c-77a89db1a4bf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1684 microversion: 2.1 time: 0.173144 Jul 20 05:04:39.866823 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3590/6943] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:39 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:40.263621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-854b29ae-60a1-4007-98d8-6684341e17e4 req-85f013d3-a8b2-4865-a154-6e101c9324c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50765564-6f99-456e-80a1-104a57d0b86c", "name": "network-vif-unplugged", "status": "completed", "tag": "1c1c10db-ce54-4464-b78a-5c6a6953d9fd"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:40.274700 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-854b29ae-60a1-4007-98d8-6684341e17e4 req-85f013d3-a8b2-4865-a154-6e101c9324c6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:40.275161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-854b29ae-60a1-4007-98d8-6684341e17e4 req-85f013d3-a8b2-4865-a154-6e101c9324c6 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:40.287531 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-854b29ae-60a1-4007-98d8-6684341e17e4 req-85f013d3-a8b2-4865-a154-6e101c9324c6 service nova] Creating event network-vif-unplugged:1c1c10db-ce54-4464-b78a-5c6a6953d9fd for instance 50765564-6f99-456e-80a1-104a57d0b86c on n-h1-826526-5 Jul 20 05:04:40.293233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [req-854b29ae-60a1-4007-98d8-6684341e17e4 req-85f013d3-a8b2-4865-a154-6e101c9324c6 service nova] Instance 50765564-6f99-456e-80a1-104a57d0b86c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:04:40.304550 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-854b29ae-60a1-4007-98d8-6684341e17e4 req-85f013d3-a8b2-4865-a154-6e101c9324c6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047592 Jul 20 05:04:40.305382 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3354/6944] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:04:40.885697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-557bdd42-61c4-4ac0-965e-cd2e3b155d8a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:40.886375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-557bdd42-61c4-4ac0-965e-cd2e3b155d8a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:40.897603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-557bdd42-61c4-4ac0-965e-cd2e3b155d8a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:40.898101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-557bdd42-61c4-4ac0-965e-cd2e3b155d8a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:40.899025 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-557bdd42-61c4-4ac0-965e-cd2e3b155d8a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:40.899495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-557bdd42-61c4-4ac0-965e-cd2e3b155d8a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:41.046249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-557bdd42-61c4-4ac0-965e-cd2e3b155d8a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:41.054729 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-557bdd42-61c4-4ac0-965e-cd2e3b155d8a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1683 microversion: 2.1 time: 0.173490 Jul 20 05:04:41.055350 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3591/6945] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:40 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:42.080668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-89671108-7580-447a-8b39-cb8d4ce918ce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:42.081844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-89671108-7580-447a-8b39-cb8d4ce918ce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:42.092216 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89671108-7580-447a-8b39-cb8d4ce918ce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:42.092709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89671108-7580-447a-8b39-cb8d4ce918ce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:42.093507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89671108-7580-447a-8b39-cb8d4ce918ce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:42.093957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89671108-7580-447a-8b39-cb8d4ce918ce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:42.247130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-89671108-7580-447a-8b39-cb8d4ce918ce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:42.258855 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-89671108-7580-447a-8b39-cb8d4ce918ce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1681 microversion: 2.1 time: 0.186933 Jul 20 05:04:42.259663 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3355/6946] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:42 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:42.324220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-ce0f312b-e193-423e-ad0d-18facb694673 req-513f5787-005b-4ba9-8e38-5c9d45506d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50765564-6f99-456e-80a1-104a57d0b86c", "tag": "1c1c10db-ce54-4464-b78a-5c6a6953d9fd"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:42.334351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ce0f312b-e193-423e-ad0d-18facb694673 req-513f5787-005b-4ba9-8e38-5c9d45506d34 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:42.334903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ce0f312b-e193-423e-ad0d-18facb694673 req-513f5787-005b-4ba9-8e38-5c9d45506d34 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:42.347304 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-ce0f312b-e193-423e-ad0d-18facb694673 req-513f5787-005b-4ba9-8e38-5c9d45506d34 service nova] Creating event network-changed:1c1c10db-ce54-4464-b78a-5c6a6953d9fd for instance 50765564-6f99-456e-80a1-104a57d0b86c on n-h1-826526-5 Jul 20 05:04:42.353256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-ce0f312b-e193-423e-ad0d-18facb694673 req-513f5787-005b-4ba9-8e38-5c9d45506d34 service nova] Instance 50765564-6f99-456e-80a1-104a57d0b86c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:04:42.364295 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-ce0f312b-e193-423e-ad0d-18facb694673 req-513f5787-005b-4ba9-8e38-5c9d45506d34 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046201 Jul 20 05:04:42.364906 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3592/6947] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:04:43.279564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a80ffb8c-d76e-4e17-842e-55012b50e1c8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:43.280324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a80ffb8c-d76e-4e17-842e-55012b50e1c8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:43.288511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a80ffb8c-d76e-4e17-842e-55012b50e1c8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:43.289202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a80ffb8c-d76e-4e17-842e-55012b50e1c8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:43.289992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a80ffb8c-d76e-4e17-842e-55012b50e1c8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:43.290674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a80ffb8c-d76e-4e17-842e-55012b50e1c8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:43.446883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a80ffb8c-d76e-4e17-842e-55012b50e1c8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:43.454865 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a80ffb8c-d76e-4e17-842e-55012b50e1c8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1677 microversion: 2.1 time: 0.180696 Jul 20 05:04:43.455436 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3356/6948] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:43 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:43.474120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e92b0ca5-6c20-4ed0-93db-ed424f7ca1f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:43.474949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e92b0ca5-6c20-4ed0-93db-ed424f7ca1f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:43.481533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e92b0ca5-6c20-4ed0-93db-ed424f7ca1f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:43.482020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e92b0ca5-6c20-4ed0-93db-ed424f7ca1f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:43.482795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e92b0ca5-6c20-4ed0-93db-ed424f7ca1f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:43.483239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e92b0ca5-6c20-4ed0-93db-ed424f7ca1f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:43.544923 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e92b0ca5-6c20-4ed0-93db-ed424f7ca1f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "POST /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c/action" status: 204 len: 0 microversion: 2.1 time: 0.075892 Jul 20 05:04:43.545760 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3593/6949] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:04:43 2022] POST /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:04:43.554012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8f8f7e9f-f0f1-4bdb-ba20-b367436462d3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:43.554801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8f8f7e9f-f0f1-4bdb-ba20-b367436462d3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:43.561274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f8f7e9f-f0f1-4bdb-ba20-b367436462d3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:43.561812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f8f7e9f-f0f1-4bdb-ba20-b367436462d3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:43.562941 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f8f7e9f-f0f1-4bdb-ba20-b367436462d3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:43.563427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f8f7e9f-f0f1-4bdb-ba20-b367436462d3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:43.771497 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8f8f7e9f-f0f1-4bdb-ba20-b367436462d3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:43.780278 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8f8f7e9f-f0f1-4bdb-ba20-b367436462d3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1677 microversion: 2.1 time: 0.230285 Jul 20 05:04:43.786621 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3357/6950] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:43 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1677 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:44.806110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e599ba02-fe6a-4d54-be61-cd152fef47df tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:44.806949 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e599ba02-fe6a-4d54-be61-cd152fef47df tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:44.815795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e599ba02-fe6a-4d54-be61-cd152fef47df tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:44.816254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e599ba02-fe6a-4d54-be61-cd152fef47df tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:44.817059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e599ba02-fe6a-4d54-be61-cd152fef47df tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:44.817762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e599ba02-fe6a-4d54-be61-cd152fef47df tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:44.976616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e599ba02-fe6a-4d54-be61-cd152fef47df tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:44.984521 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e599ba02-fe6a-4d54-be61-cd152fef47df tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1656 microversion: 2.1 time: 0.188749 Jul 20 05:04:44.985136 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3594/6951] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:44 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1656 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:45.001251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c455c3f6-f47a-4309-b5c1-9e304b4ac99c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:45.001906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c455c3f6-f47a-4309-b5c1-9e304b4ac99c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:45.010032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c455c3f6-f47a-4309-b5c1-9e304b4ac99c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:45.010516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c455c3f6-f47a-4309-b5c1-9e304b4ac99c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:45.011315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c455c3f6-f47a-4309-b5c1-9e304b4ac99c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:45.011768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c455c3f6-f47a-4309-b5c1-9e304b4ac99c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:45.151558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c455c3f6-f47a-4309-b5c1-9e304b4ac99c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:45.160138 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c455c3f6-f47a-4309-b5c1-9e304b4ac99c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1656 microversion: 2.1 time: 0.162931 Jul 20 05:04:45.160785 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3358/6952] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:44 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1656 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:45.176754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-137e8104-7f2b-4a63-807d-09e2a7d3e82c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:45.183419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-137e8104-7f2b-4a63-807d-09e2a7d3e82c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:45.183875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-137e8104-7f2b-4a63-807d-09e2a7d3e82c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:45.198786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:45.208918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-137e8104-7f2b-4a63-807d-09e2a7d3e82c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Going to try to start instance {{(pid=127871) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 05:04:45.255343 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-137e8104-7f2b-4a63-807d-09e2a7d3e82c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "POST /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c/action" status: 202 len: 0 microversion: 2.1 time: 0.082576 Jul 20 05:04:45.255967 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3595/6953] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:04:45 2022] POST /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:04:45.265107 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-27a7f724-6a40-4df0-a645-ab5a8c3e855f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:45.265746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-27a7f724-6a40-4df0-a645-ab5a8c3e855f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:45.272364 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27a7f724-6a40-4df0-a645-ab5a8c3e855f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:45.272852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27a7f724-6a40-4df0-a645-ab5a8c3e855f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:45.273667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27a7f724-6a40-4df0-a645-ab5a8c3e855f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:45.274075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27a7f724-6a40-4df0-a645-ab5a8c3e855f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:45.456844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-27a7f724-6a40-4df0-a645-ab5a8c3e855f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:45.460475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:45.466864 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-27a7f724-6a40-4df0-a645-ab5a8c3e855f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1665 microversion: 2.1 time: 0.206094 Jul 20 05:04:45.467682 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3359/6954] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:45 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1665 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:46.489249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-babde934-b44e-4726-82e4-471bdc677914 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:46.490135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-babde934-b44e-4726-82e4-471bdc677914 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:46.498016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-babde934-b44e-4726-82e4-471bdc677914 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:46.498466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-babde934-b44e-4726-82e4-471bdc677914 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:46.499256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-babde934-b44e-4726-82e4-471bdc677914 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:46.499696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-babde934-b44e-4726-82e4-471bdc677914 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:46.655017 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-babde934-b44e-4726-82e4-471bdc677914 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:46.662785 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-babde934-b44e-4726-82e4-471bdc677914 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1669 microversion: 2.1 time: 0.181493 Jul 20 05:04:46.663386 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3596/6955] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:46 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1669 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:46.679896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-336c6007-dec5-47ef-921a-b04a433b4e21 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:46.680448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-336c6007-dec5-47ef-921a-b04a433b4e21 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:46.688350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-336c6007-dec5-47ef-921a-b04a433b4e21 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:46.688819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-336c6007-dec5-47ef-921a-b04a433b4e21 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:46.689610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-336c6007-dec5-47ef-921a-b04a433b4e21 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:46.690060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-336c6007-dec5-47ef-921a-b04a433b4e21 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:46.719878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-336c6007-dec5-47ef-921a-b04a433b4e21 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:04:46.801349 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-336c6007-dec5-47ef-921a-b04a433b4e21 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "DELETE /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 204 len: 0 microversion: 2.1 time: 0.125357 Jul 20 05:04:46.801967 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3360/6956] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:04:46 2022] DELETE /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:04:46.810540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9ac7299e-d8fc-4d18-8e05-a710e8f153d4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:46.811120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9ac7299e-d8fc-4d18-8e05-a710e8f153d4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:46.817370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ac7299e-d8fc-4d18-8e05-a710e8f153d4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:46.817816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ac7299e-d8fc-4d18-8e05-a710e8f153d4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:46.818591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ac7299e-d8fc-4d18-8e05-a710e8f153d4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:46.819146 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9ac7299e-d8fc-4d18-8e05-a710e8f153d4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:46.971397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9ac7299e-d8fc-4d18-8e05-a710e8f153d4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:46.980750 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9ac7299e-d8fc-4d18-8e05-a710e8f153d4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1675 microversion: 2.1 time: 0.174347 Jul 20 05:04:46.981349 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3597/6957] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:46 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:47.007769 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-4b692c3b-2dbb-42b2-a302-26bf4e41ba0b req-c311a212-465b-4ddd-90d3-6ff3e2e758ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50765564-6f99-456e-80a1-104a57d0b86c", "name": "network-vif-plugged", "status": "completed", "tag": "1c1c10db-ce54-4464-b78a-5c6a6953d9fd"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:47.017600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4b692c3b-2dbb-42b2-a302-26bf4e41ba0b req-c311a212-465b-4ddd-90d3-6ff3e2e758ac service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:47.018132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4b692c3b-2dbb-42b2-a302-26bf4e41ba0b req-c311a212-465b-4ddd-90d3-6ff3e2e758ac service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:47.031314 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-4b692c3b-2dbb-42b2-a302-26bf4e41ba0b req-c311a212-465b-4ddd-90d3-6ff3e2e758ac service nova] Creating event network-vif-plugged:1c1c10db-ce54-4464-b78a-5c6a6953d9fd for instance 50765564-6f99-456e-80a1-104a57d0b86c on n-h1-826526-5 Jul 20 05:04:47.036713 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-4b692c3b-2dbb-42b2-a302-26bf4e41ba0b req-c311a212-465b-4ddd-90d3-6ff3e2e758ac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035651 Jul 20 05:04:47.037733 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3361/6958] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:04:48.000283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ab9a2f41-cf81-471a-a1e8-82fffa6cc213 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:48.000874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ab9a2f41-cf81-471a-a1e8-82fffa6cc213 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:48.008688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab9a2f41-cf81-471a-a1e8-82fffa6cc213 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:48.009143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab9a2f41-cf81-471a-a1e8-82fffa6cc213 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:48.009919 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab9a2f41-cf81-471a-a1e8-82fffa6cc213 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:48.010357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab9a2f41-cf81-471a-a1e8-82fffa6cc213 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:48.163522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ab9a2f41-cf81-471a-a1e8-82fffa6cc213 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:48.171660 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ab9a2f41-cf81-471a-a1e8-82fffa6cc213 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1675 microversion: 2.1 time: 0.176234 Jul 20 05:04:48.172249 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3598/6959] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:47 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:48.954554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-dbcc6e99-7624-4f7a-b52e-5587da212aa4 req-e728c057-7e0b-4e49-abfd-eb81cd572eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50765564-6f99-456e-80a1-104a57d0b86c", "name": "network-vif-deleted", "tag": "1c1c10db-ce54-4464-b78a-5c6a6953d9fd"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:48.964427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-dbcc6e99-7624-4f7a-b52e-5587da212aa4 req-e728c057-7e0b-4e49-abfd-eb81cd572eb3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:48.965146 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-dbcc6e99-7624-4f7a-b52e-5587da212aa4 req-e728c057-7e0b-4e49-abfd-eb81cd572eb3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:48.977115 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-dbcc6e99-7624-4f7a-b52e-5587da212aa4 req-e728c057-7e0b-4e49-abfd-eb81cd572eb3 service nova] Creating event network-vif-deleted:1c1c10db-ce54-4464-b78a-5c6a6953d9fd for instance 50765564-6f99-456e-80a1-104a57d0b86c on n-h1-826526-5 Jul 20 05:04:48.982744 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-dbcc6e99-7624-4f7a-b52e-5587da212aa4 req-e728c057-7e0b-4e49-abfd-eb81cd572eb3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032782 Jul 20 05:04:48.983825 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3362/6960] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:04:49.188898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5b4d39bb-a9d7-4515-8792-d1c82f931e2a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:49.189619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5b4d39bb-a9d7-4515-8792-d1c82f931e2a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:49.196865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b4d39bb-a9d7-4515-8792-d1c82f931e2a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:49.197603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b4d39bb-a9d7-4515-8792-d1c82f931e2a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:49.198445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b4d39bb-a9d7-4515-8792-d1c82f931e2a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:49.198963 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b4d39bb-a9d7-4515-8792-d1c82f931e2a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:49.231481 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b4d39bb-a9d7-4515-8792-d1c82f931e2a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:49.232025 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5b4d39bb-a9d7-4515-8792-d1c82f931e2a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:49.232490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-5b4d39bb-a9d7-4515-8792-d1c82f931e2a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lazy-loading 'fault' on Instance uuid 50765564-6f99-456e-80a1-104a57d0b86c {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:04:49.281792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5b4d39bb-a9d7-4515-8792-d1c82f931e2a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:49.290988 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5b4d39bb-a9d7-4515-8792-d1c82f931e2a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 200 len: 1327 microversion: 2.1 time: 0.106241 Jul 20 05:04:49.291785 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3599/6961] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:49 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:50.311565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d1d71ab4-d159-4718-ba5a-c7aa51a2a3e7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:50.312199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d1d71ab4-d159-4718-ba5a-c7aa51a2a3e7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:50.314208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:50.319484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1d71ab4-d159-4718-ba5a-c7aa51a2a3e7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:50.319953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1d71ab4-d159-4718-ba5a-c7aa51a2a3e7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:50.320760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1d71ab4-d159-4718-ba5a-c7aa51a2a3e7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:50.321212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d1d71ab4-d159-4718-ba5a-c7aa51a2a3e7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:50.336338 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-d1d71ab4-d159-4718-ba5a-c7aa51a2a3e7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] HTTP exception thrown: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d1d71ab4-d159-4718-ba5a-c7aa51a2a3e7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Request method failure captured: Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c HTTP/1.1 Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14xl7kYURKR1dAkImi-dAM82dgRxeC4kwp-cBHDMeNqZvthepvqFh3YSxp0Sn4tCx2nWbnu1dX7qXdmEBl_1kCyJIPxFOMsgNP1G8qlJkVXjjexD8ZbQbeqq1Hv8-MpYrMoSqBIpZdvX2pvMr-M6p7LeV-yJHws23gLehuzUB9GuSSo Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c48dbfac2a784ca7a2d027f8c102df69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}] Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: c1b8ef10ecd447b8b2a3cc297731059c Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '50765564-6f99-456e-80a1-104a57d0b86c'} Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:04:50.338044 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:04:50.341341 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:04:50.341341 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:04:50.341341 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:04:50.341341 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:04:50.341341 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:04:50.341341 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:04:50.341341 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:04:50.341341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d1d71ab4-d159-4718-ba5a-c7aa51a2a3e7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Returning 404 to user: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:04:50.341341 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d1d71ab4-d159-4718-ba5a-c7aa51a2a3e7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 404 len: 111 microversion: 2.1 time: 0.033520 Jul 20 05:04:50.341341 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3363/6962] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:50 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:04:50.357744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-84210392-121b-40f6-9239-067be6e97bbb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:50.358360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-84210392-121b-40f6-9239-067be6e97bbb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:50.361238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=45 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:50.366580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84210392-121b-40f6-9239-067be6e97bbb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:50.367031 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84210392-121b-40f6-9239-067be6e97bbb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:50.367801 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84210392-121b-40f6-9239-067be6e97bbb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:50.368240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84210392-121b-40f6-9239-067be6e97bbb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:50.382482 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-84210392-121b-40f6-9239-067be6e97bbb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] HTTP exception thrown: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-84210392-121b-40f6-9239-067be6e97bbb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Request method failure captured: Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c HTTP/1.1 Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14xl7kYURKR1dAkImi-dAM82dgRxeC4kwp-cBHDMeNqZvthepvqFh3YSxp0Sn4tCx2nWbnu1dX7qXdmEBl_1kCyJIPxFOMsgNP1G8qlJkVXjjexD8ZbQbeqq1Hv8-MpYrMoSqBIpZdvX2pvMr-M6p7LeV-yJHws23gLehuzUB9GuSSo Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c48dbfac2a784ca7a2d027f8c102df69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}] Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c1b8ef10ecd447b8b2a3cc297731059c Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '50765564-6f99-456e-80a1-104a57d0b86c'} Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:04:50.384133 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:04:50.387916 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:04:50.387916 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:04:50.387916 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:04:50.387916 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:04:50.387916 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:04:50.387916 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:04:50.387916 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:04:50.387916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-84210392-121b-40f6-9239-067be6e97bbb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Returning 404 to user: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:04:50.387916 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-84210392-121b-40f6-9239-067be6e97bbb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 404 len: 111 microversion: 2.1 time: 0.031802 Jul 20 05:04:50.388683 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3600/6963] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:50 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:04:50.436785 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-49ae6caa-9fc0-4c58-b6aa-e8ae372bed18 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1305952920", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "b1762f2f-2565-44bb-a011-b37176955a43"}], "security_groups": [{"name": "tempest-securitygroup--1758487340"}], "key_name": "tempest-keypair-1918112510", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:50.556851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-49ae6caa-9fc0-4c58-b6aa-e8ae372bed18 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] validate_networks() for [('b1762f2f-2565-44bb-a011-b37176955a43', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:04:50.948603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-49ae6caa-9fc0-4c58-b6aa-e8ae372bed18 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:04:50.949244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-49ae6caa-9fc0-4c58-b6aa-e8ae372bed18 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:04:50.950003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-49ae6caa-9fc0-4c58-b6aa-e8ae372bed18 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:04:50.950639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-49ae6caa-9fc0-4c58-b6aa-e8ae372bed18 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:04:50.951181 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-49ae6caa-9fc0-4c58-b6aa-e8ae372bed18 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:04:50.964786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49ae6caa-9fc0-4c58-b6aa-e8ae372bed18 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:50.965478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49ae6caa-9fc0-4c58-b6aa-e8ae372bed18 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:50.966721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49ae6caa-9fc0-4c58-b6aa-e8ae372bed18 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:50.967172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49ae6caa-9fc0-4c58-b6aa-e8ae372bed18 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:50.985058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-49ae6caa-9fc0-4c58-b6aa-e8ae372bed18 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Getting quotas for project c48dbfac2a784ca7a2d027f8c102df69. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:04:50.990902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-49ae6caa-9fc0-4c58-b6aa-e8ae372bed18 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Getting quotas for user c1b8ef10ecd447b8b2a3cc297731059c and project c48dbfac2a784ca7a2d027f8c102df69. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:04:51.005395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-49ae6caa-9fc0-4c58-b6aa-e8ae372bed18 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:04:51.008157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-49ae6caa-9fc0-4c58-b6aa-e8ae372bed18 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:04:51.056412 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-49ae6caa-9fc0-4c58-b6aa-e8ae372bed18 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.625338 Jul 20 05:04:51.057108 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3364/6964] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:04:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:04:51.067483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-134b6692-cbb1-4ab4-b575-d49e0d75408d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:51.068173 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-134b6692-cbb1-4ab4-b575-d49e0d75408d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:51.128360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-134b6692-cbb1-4ab4-b575-d49e0d75408d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:51.136317 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-134b6692-cbb1-4ab4-b575-d49e0d75408d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1239 microversion: 2.1 time: 0.072727 Jul 20 05:04:51.136912 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3601/6965] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:51 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:52.155609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bd855d32-3e9f-4899-8286-648312d874db tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:52.156235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bd855d32-3e9f-4899-8286-648312d874db tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:52.164048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd855d32-3e9f-4899-8286-648312d874db tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:52.164556 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd855d32-3e9f-4899-8286-648312d874db tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:52.165367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd855d32-3e9f-4899-8286-648312d874db tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:52.165797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd855d32-3e9f-4899-8286-648312d874db tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:52.259224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bd855d32-3e9f-4899-8286-648312d874db tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:52.267699 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bd855d32-3e9f-4899-8286-648312d874db tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1297 microversion: 2.1 time: 0.117502 Jul 20 05:04:52.268291 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3365/6966] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:52 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1297 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:53.286055 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d27770f1-0618-4ae4-86da-c4eda0a1e877 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:53.287070 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d27770f1-0618-4ae4-86da-c4eda0a1e877 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:53.298915 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d27770f1-0618-4ae4-86da-c4eda0a1e877 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:53.299370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d27770f1-0618-4ae4-86da-c4eda0a1e877 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:53.300158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d27770f1-0618-4ae4-86da-c4eda0a1e877 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:53.300782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d27770f1-0618-4ae4-86da-c4eda0a1e877 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:53.452577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d27770f1-0618-4ae4-86da-c4eda0a1e877 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:53.461372 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d27770f1-0618-4ae4-86da-c4eda0a1e877 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1365 microversion: 2.1 time: 0.179279 Jul 20 05:04:53.463464 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3602/6967] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:53 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:53.468019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-89323b6f-a69b-4bfa-bfd3-3f38c6c1ef3f req-388901f4-0572-49fb-a9e5-fe33f0a66f64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba285c0-5f71-44ff-aeb7-00640668769d", "tag": "e93caa75-eecb-47f6-a381-72d2f36a2485"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:53.477674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-89323b6f-a69b-4bfa-bfd3-3f38c6c1ef3f req-388901f4-0572-49fb-a9e5-fe33f0a66f64 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:53.478356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-89323b6f-a69b-4bfa-bfd3-3f38c6c1ef3f req-388901f4-0572-49fb-a9e5-fe33f0a66f64 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:53.492109 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-89323b6f-a69b-4bfa-bfd3-3f38c6c1ef3f req-388901f4-0572-49fb-a9e5-fe33f0a66f64 service nova] Creating event network-changed:e93caa75-eecb-47f6-a381-72d2f36a2485 for instance 5ba285c0-5f71-44ff-aeb7-00640668769d on n-h1-826526-5 Jul 20 05:04:53.501993 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-89323b6f-a69b-4bfa-bfd3-3f38c6c1ef3f req-388901f4-0572-49fb-a9e5-fe33f0a66f64 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037545 Jul 20 05:04:53.502605 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3366/6968] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:04:54.481064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fa02201d-e521-4b81-becc-9eeb6a51131b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:54.481673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fa02201d-e521-4b81-becc-9eeb6a51131b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:54.489246 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa02201d-e521-4b81-becc-9eeb6a51131b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:54.489698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa02201d-e521-4b81-becc-9eeb6a51131b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:54.490460 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa02201d-e521-4b81-becc-9eeb6a51131b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:54.490898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa02201d-e521-4b81-becc-9eeb6a51131b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:54.633801 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fa02201d-e521-4b81-becc-9eeb6a51131b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:54.641975 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fa02201d-e521-4b81-becc-9eeb6a51131b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1365 microversion: 2.1 time: 0.164897 Jul 20 05:04:54.642546 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3603/6969] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:54 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:55.661817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-58cfeea0-04c0-4a8e-a234-09b629a94a7e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:55.662562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-58cfeea0-04c0-4a8e-a234-09b629a94a7e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:55.669236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58cfeea0-04c0-4a8e-a234-09b629a94a7e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:55.669700 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58cfeea0-04c0-4a8e-a234-09b629a94a7e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:55.670488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58cfeea0-04c0-4a8e-a234-09b629a94a7e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:55.670978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58cfeea0-04c0-4a8e-a234-09b629a94a7e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:55.810513 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-58cfeea0-04c0-4a8e-a234-09b629a94a7e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:55.818538 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-58cfeea0-04c0-4a8e-a234-09b629a94a7e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1365 microversion: 2.1 time: 0.162342 Jul 20 05:04:55.819212 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3367/6970] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:55 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:56.837291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a9384c10-7e91-4349-accd-3a409d041fcf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:56.838010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a9384c10-7e91-4349-accd-3a409d041fcf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:56.848538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9384c10-7e91-4349-accd-3a409d041fcf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:56.849100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9384c10-7e91-4349-accd-3a409d041fcf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:56.850766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9384c10-7e91-4349-accd-3a409d041fcf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:56.851209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9384c10-7e91-4349-accd-3a409d041fcf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:56.998734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a9384c10-7e91-4349-accd-3a409d041fcf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:57.008723 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a9384c10-7e91-4349-accd-3a409d041fcf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1365 microversion: 2.1 time: 0.175749 Jul 20 05:04:57.009331 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3604/6971] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:56 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:58.027234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-78e6279f-88f3-45d4-ad28-98ce06249423 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:58.027873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-78e6279f-88f3-45d4-ad28-98ce06249423 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:58.035634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78e6279f-88f3-45d4-ad28-98ce06249423 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:58.036099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78e6279f-88f3-45d4-ad28-98ce06249423 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:58.036917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78e6279f-88f3-45d4-ad28-98ce06249423 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:58.037370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78e6279f-88f3-45d4-ad28-98ce06249423 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:58.173270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-78e6279f-88f3-45d4-ad28-98ce06249423 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:58.181279 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-78e6279f-88f3-45d4-ad28-98ce06249423 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1365 microversion: 2.1 time: 0.158060 Jul 20 05:04:58.181843 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3368/6972] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:58 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:59.041027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-40956758-29ac-406f-8c90-f3b83c9c0706 req-19536648-7116-4c40-823b-d6a1cda7fcfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba285c0-5f71-44ff-aeb7-00640668769d", "name": "network-vif-plugged", "status": "completed", "tag": "e93caa75-eecb-47f6-a381-72d2f36a2485"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:59.051661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-40956758-29ac-406f-8c90-f3b83c9c0706 req-19536648-7116-4c40-823b-d6a1cda7fcfa service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:59.052142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-40956758-29ac-406f-8c90-f3b83c9c0706 req-19536648-7116-4c40-823b-d6a1cda7fcfa service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:59.064749 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-40956758-29ac-406f-8c90-f3b83c9c0706 req-19536648-7116-4c40-823b-d6a1cda7fcfa service nova] Creating event network-vif-plugged:e93caa75-eecb-47f6-a381-72d2f36a2485 for instance 5ba285c0-5f71-44ff-aeb7-00640668769d on n-h1-826526-5 Jul 20 05:04:59.070106 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-40956758-29ac-406f-8c90-f3b83c9c0706 req-19536648-7116-4c40-823b-d6a1cda7fcfa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032808 Jul 20 05:04:59.070725 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3605/6973] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:04:59.199358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-33d46e1c-1292-4880-9d86-32c1374bbcf3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:59.200087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-33d46e1c-1292-4880-9d86-32c1374bbcf3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:59.207350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33d46e1c-1292-4880-9d86-32c1374bbcf3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:59.207816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33d46e1c-1292-4880-9d86-32c1374bbcf3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:59.208656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33d46e1c-1292-4880-9d86-32c1374bbcf3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:59.209117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33d46e1c-1292-4880-9d86-32c1374bbcf3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:59.339201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-33d46e1c-1292-4880-9d86-32c1374bbcf3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:59.347545 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-33d46e1c-1292-4880-9d86-32c1374bbcf3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1365 microversion: 2.1 time: 0.152222 Jul 20 05:04:59.348103 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3369/6974] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:59 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:00.366905 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2bf8887e-c6ed-4a98-9bcf-07fb1c08fd41 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:00.367621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2bf8887e-c6ed-4a98-9bcf-07fb1c08fd41 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:00.374234 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bf8887e-c6ed-4a98-9bcf-07fb1c08fd41 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:00.374699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bf8887e-c6ed-4a98-9bcf-07fb1c08fd41 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:00.375475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bf8887e-c6ed-4a98-9bcf-07fb1c08fd41 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:00.375901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2bf8887e-c6ed-4a98-9bcf-07fb1c08fd41 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:00.518215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2bf8887e-c6ed-4a98-9bcf-07fb1c08fd41 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:00.526589 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2bf8887e-c6ed-4a98-9bcf-07fb1c08fd41 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1553 microversion: 2.1 time: 0.164937 Jul 20 05:05:00.527185 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3606/6975] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:00 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:00.550261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ad48f556-2325-47c0-8107-88245d4a8ac5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:00.550756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ad48f556-2325-47c0-8107-88245d4a8ac5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:00.558212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad48f556-2325-47c0-8107-88245d4a8ac5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:00.558655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad48f556-2325-47c0-8107-88245d4a8ac5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:00.559479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad48f556-2325-47c0-8107-88245d4a8ac5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:00.559957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad48f556-2325-47c0-8107-88245d4a8ac5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:00.645733 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ad48f556-2325-47c0-8107-88245d4a8ac5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099083 Jul 20 05:05:00.646541 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3370/6976] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 05:05:00 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:05:02.001872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-a8807b7f-e420-495c-8b84-ff2a2f600796 req-2dd5de9b-c754-4583-9f14-ef16efeedd36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba285c0-5f71-44ff-aeb7-00640668769d", "tag": "e93caa75-eecb-47f6-a381-72d2f36a2485"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:02.008181 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:02.015734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a8807b7f-e420-495c-8b84-ff2a2f600796 req-2dd5de9b-c754-4583-9f14-ef16efeedd36 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:02.016299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a8807b7f-e420-495c-8b84-ff2a2f600796 req-2dd5de9b-c754-4583-9f14-ef16efeedd36 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:02.028181 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-a8807b7f-e420-495c-8b84-ff2a2f600796 req-2dd5de9b-c754-4583-9f14-ef16efeedd36 service nova] Creating event network-changed:e93caa75-eecb-47f6-a381-72d2f36a2485 for instance 5ba285c0-5f71-44ff-aeb7-00640668769d on n-h1-826526-5 Jul 20 05:05:02.033341 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-a8807b7f-e420-495c-8b84-ff2a2f600796 req-2dd5de9b-c754-4583-9f14-ef16efeedd36 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037510 Jul 20 05:05:02.034040 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3607/6977] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:05:34.961948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:34.963173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:34.966213 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:34.967267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:34.974059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e0a56719-e77e-499c-8676-d64cf34dabcd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:34.975054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e0a56719-e77e-499c-8676-d64cf34dabcd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:34.984231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0a56719-e77e-499c-8676-d64cf34dabcd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:34.984721 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0a56719-e77e-499c-8676-d64cf34dabcd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:34.985504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0a56719-e77e-499c-8676-d64cf34dabcd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:34.985954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0a56719-e77e-499c-8676-d64cf34dabcd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:35.015900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e0a56719-e77e-499c-8676-d64cf34dabcd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:35.022037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e0a56719-e77e-499c-8676-d64cf34dabcd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Old instance type m1.heat2, new instance type m1.heat {{(pid=127870) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:05:35.028879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e0a56719-e77e-499c-8676-d64cf34dabcd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:05:35.029317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e0a56719-e77e-499c-8676-d64cf34dabcd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:05:35.029801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e0a56719-e77e-499c-8676-d64cf34dabcd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:05:35.030226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e0a56719-e77e-499c-8676-d64cf34dabcd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:05:35.030645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e0a56719-e77e-499c-8676-d64cf34dabcd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:05:35.107870 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e0a56719-e77e-499c-8676-d64cf34dabcd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "POST /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d/action" status: 202 len: 0 microversion: 2.1 time: 0.147176 Jul 20 05:05:35.108847 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3371/6978] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:05:34 2022] POST /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:05:35.117972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1e4ed3d7-8d84-4b4a-ad95-6ca819270d8f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:35.119150 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1e4ed3d7-8d84-4b4a-ad95-6ca819270d8f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:35.121828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=17 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:35.122574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:35.128146 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e4ed3d7-8d84-4b4a-ad95-6ca819270d8f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:35.128622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e4ed3d7-8d84-4b4a-ad95-6ca819270d8f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:35.129539 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e4ed3d7-8d84-4b4a-ad95-6ca819270d8f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:35.129921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e4ed3d7-8d84-4b4a-ad95-6ca819270d8f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:35.243155 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:05:35.243397 n-d-826526-5 devstack@n-api.service[127870]: Wed Jul 20 05:05:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:05:35.272534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1e4ed3d7-8d84-4b4a-ad95-6ca819270d8f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:35.280452 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1e4ed3d7-8d84-4b4a-ad95-6ca819270d8f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1680 microversion: 2.1 time: 0.166842 Jul 20 05:05:35.281271 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3608/6979] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:35 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:36.300226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f5c027c9-5edc-4c4a-a573-dbc6623dbd9a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:36.301088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f5c027c9-5edc-4c4a-a573-dbc6623dbd9a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:36.310314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5c027c9-5edc-4c4a-a573-dbc6623dbd9a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:36.310795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5c027c9-5edc-4c4a-a573-dbc6623dbd9a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:36.312067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5c027c9-5edc-4c4a-a573-dbc6623dbd9a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:36.312557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5c027c9-5edc-4c4a-a573-dbc6623dbd9a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:36.450114 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f5c027c9-5edc-4c4a-a573-dbc6623dbd9a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:36.461281 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f5c027c9-5edc-4c4a-a573-dbc6623dbd9a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1680 microversion: 2.1 time: 0.165509 Jul 20 05:05:36.462033 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3372/6980] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:36 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:37.483397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0b37aecd-8dc0-4e37-8d06-1800a7499636 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:37.484037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0b37aecd-8dc0-4e37-8d06-1800a7499636 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:37.491806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b37aecd-8dc0-4e37-8d06-1800a7499636 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:37.492246 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b37aecd-8dc0-4e37-8d06-1800a7499636 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:37.493071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b37aecd-8dc0-4e37-8d06-1800a7499636 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:37.493512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0b37aecd-8dc0-4e37-8d06-1800a7499636 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:37.927553 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0b37aecd-8dc0-4e37-8d06-1800a7499636 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:37.935903 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0b37aecd-8dc0-4e37-8d06-1800a7499636 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1685 microversion: 2.1 time: 0.456564 Jul 20 05:05:37.936551 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3609/6981] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:37 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1685 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:38.956297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fb5e4476-d363-4f26-81f0-2ed50d9ee150 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:38.956857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fb5e4476-d363-4f26-81f0-2ed50d9ee150 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:38.964849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb5e4476-d363-4f26-81f0-2ed50d9ee150 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:38.965318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb5e4476-d363-4f26-81f0-2ed50d9ee150 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:38.966096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb5e4476-d363-4f26-81f0-2ed50d9ee150 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:38.966537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb5e4476-d363-4f26-81f0-2ed50d9ee150 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:39.113315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fb5e4476-d363-4f26-81f0-2ed50d9ee150 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:39.121777 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fb5e4476-d363-4f26-81f0-2ed50d9ee150 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1685 microversion: 2.1 time: 0.169649 Jul 20 05:05:39.122365 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3373/6982] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:38 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:40.140311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8f3ce8de-20ed-4a2b-a2c1-5acaa1abc458 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:40.140900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8f3ce8de-20ed-4a2b-a2c1-5acaa1abc458 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:40.148197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f3ce8de-20ed-4a2b-a2c1-5acaa1abc458 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:40.148683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f3ce8de-20ed-4a2b-a2c1-5acaa1abc458 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:40.149432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f3ce8de-20ed-4a2b-a2c1-5acaa1abc458 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:40.149880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8f3ce8de-20ed-4a2b-a2c1-5acaa1abc458 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:40.283827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8f3ce8de-20ed-4a2b-a2c1-5acaa1abc458 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:40.292116 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8f3ce8de-20ed-4a2b-a2c1-5acaa1abc458 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1685 microversion: 2.1 time: 0.155793 Jul 20 05:05:40.292745 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3610/6983] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:40 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:41.311358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0a8ba24b-aed2-43ab-8655-15c8822b44ce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:41.311972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0a8ba24b-aed2-43ab-8655-15c8822b44ce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:41.319444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0a8ba24b-aed2-43ab-8655-15c8822b44ce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:41.319911 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0a8ba24b-aed2-43ab-8655-15c8822b44ce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:41.320742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0a8ba24b-aed2-43ab-8655-15c8822b44ce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:41.321239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0a8ba24b-aed2-43ab-8655-15c8822b44ce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:41.470068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0a8ba24b-aed2-43ab-8655-15c8822b44ce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:41.477971 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0a8ba24b-aed2-43ab-8655-15c8822b44ce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1685 microversion: 2.1 time: 0.170647 Jul 20 05:05:41.478555 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3374/6984] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:41 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:41.684887 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:05:41.685358 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:05:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:05:42.495465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9cc4b5b6-68d8-4846-914f-1a1a3f459f73 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:42.495998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9cc4b5b6-68d8-4846-914f-1a1a3f459f73 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:42.503605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9cc4b5b6-68d8-4846-914f-1a1a3f459f73 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:42.504038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9cc4b5b6-68d8-4846-914f-1a1a3f459f73 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:42.505083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9cc4b5b6-68d8-4846-914f-1a1a3f459f73 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:42.505665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9cc4b5b6-68d8-4846-914f-1a1a3f459f73 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:42.645195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9cc4b5b6-68d8-4846-914f-1a1a3f459f73 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:42.653208 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9cc4b5b6-68d8-4846-914f-1a1a3f459f73 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1685 microversion: 2.1 time: 0.161864 Jul 20 05:05:42.654385 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3611/6985] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:42 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:43.671359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8061f5ec-2b8d-4164-8166-9abbc981c759 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:43.671979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8061f5ec-2b8d-4164-8166-9abbc981c759 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:43.681455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8061f5ec-2b8d-4164-8166-9abbc981c759 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:43.681914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8061f5ec-2b8d-4164-8166-9abbc981c759 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:43.682690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8061f5ec-2b8d-4164-8166-9abbc981c759 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:43.683136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8061f5ec-2b8d-4164-8166-9abbc981c759 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:43.830720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8061f5ec-2b8d-4164-8166-9abbc981c759 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:43.839225 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8061f5ec-2b8d-4164-8166-9abbc981c759 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1685 microversion: 2.1 time: 0.171929 Jul 20 05:05:43.839852 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3375/6986] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:43 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:44.860149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-055caff8-5420-4844-a09b-9c131d224f3a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:44.861168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-055caff8-5420-4844-a09b-9c131d224f3a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:44.870383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-055caff8-5420-4844-a09b-9c131d224f3a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:44.870841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-055caff8-5420-4844-a09b-9c131d224f3a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:44.871626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-055caff8-5420-4844-a09b-9c131d224f3a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:44.872065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-055caff8-5420-4844-a09b-9c131d224f3a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:45.005889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-055caff8-5420-4844-a09b-9c131d224f3a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:45.014433 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-055caff8-5420-4844-a09b-9c131d224f3a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1685 microversion: 2.1 time: 0.161186 Jul 20 05:05:45.015026 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3612/6987] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:44 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:46.031337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-010f13d4-ed90-47c4-9cfc-85866ef0fc30 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:46.031982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-010f13d4-ed90-47c4-9cfc-85866ef0fc30 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:46.039473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-010f13d4-ed90-47c4-9cfc-85866ef0fc30 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:46.039944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-010f13d4-ed90-47c4-9cfc-85866ef0fc30 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:46.040775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-010f13d4-ed90-47c4-9cfc-85866ef0fc30 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:46.041194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-010f13d4-ed90-47c4-9cfc-85866ef0fc30 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:46.189143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-010f13d4-ed90-47c4-9cfc-85866ef0fc30 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:46.197522 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-010f13d4-ed90-47c4-9cfc-85866ef0fc30 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1685 microversion: 2.1 time: 0.170257 Jul 20 05:05:46.198119 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3376/6988] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:46 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:47.215638 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ac2ebbce-38fd-43ad-9e0b-9a171c343562 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:47.216183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ac2ebbce-38fd-43ad-9e0b-9a171c343562 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:47.224220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac2ebbce-38fd-43ad-9e0b-9a171c343562 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:47.224708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac2ebbce-38fd-43ad-9e0b-9a171c343562 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:47.225473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac2ebbce-38fd-43ad-9e0b-9a171c343562 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:47.225908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac2ebbce-38fd-43ad-9e0b-9a171c343562 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:47.359826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ac2ebbce-38fd-43ad-9e0b-9a171c343562 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:47.367757 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ac2ebbce-38fd-43ad-9e0b-9a171c343562 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1685 microversion: 2.1 time: 0.156403 Jul 20 05:05:47.368586 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3613/6989] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:47 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:48.386481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-00f18435-602c-4738-a8c3-afd8ef559ffb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:48.387159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-00f18435-602c-4738-a8c3-afd8ef559ffb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:48.395328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00f18435-602c-4738-a8c3-afd8ef559ffb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:48.395792 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00f18435-602c-4738-a8c3-afd8ef559ffb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:48.396872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00f18435-602c-4738-a8c3-afd8ef559ffb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:48.397324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00f18435-602c-4738-a8c3-afd8ef559ffb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:48.538334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-00f18435-602c-4738-a8c3-afd8ef559ffb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:48.547052 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-00f18435-602c-4738-a8c3-afd8ef559ffb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1685 microversion: 2.1 time: 0.164319 Jul 20 05:05:48.547655 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3377/6990] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:48 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:49.565753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-117a7f1f-2fc1-4353-b27f-ec2ae4346a4a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:49.566589 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-117a7f1f-2fc1-4353-b27f-ec2ae4346a4a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:49.578268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-117a7f1f-2fc1-4353-b27f-ec2ae4346a4a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:49.579020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-117a7f1f-2fc1-4353-b27f-ec2ae4346a4a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:49.580367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-117a7f1f-2fc1-4353-b27f-ec2ae4346a4a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:49.581032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-117a7f1f-2fc1-4353-b27f-ec2ae4346a4a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:49.719567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-117a7f1f-2fc1-4353-b27f-ec2ae4346a4a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:49.727911 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-117a7f1f-2fc1-4353-b27f-ec2ae4346a4a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1685 microversion: 2.1 time: 0.166808 Jul 20 05:05:49.728541 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3614/6991] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:49 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:50.749267 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1ee3f67b-c4b7-404e-ab64-564c87bf832d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:50.749900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1ee3f67b-c4b7-404e-ab64-564c87bf832d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:50.757693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ee3f67b-c4b7-404e-ab64-564c87bf832d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:50.758161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ee3f67b-c4b7-404e-ab64-564c87bf832d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:50.758958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ee3f67b-c4b7-404e-ab64-564c87bf832d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:50.759417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ee3f67b-c4b7-404e-ab64-564c87bf832d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:50.900135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1ee3f67b-c4b7-404e-ab64-564c87bf832d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:50.907949 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1ee3f67b-c4b7-404e-ab64-564c87bf832d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1685 microversion: 2.1 time: 0.162779 Jul 20 05:05:50.908595 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3378/6992] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:50 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:51.925593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-09ec6f8c-f5c0-4d80-b407-d53c6adc0b13 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:51.926226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-09ec6f8c-f5c0-4d80-b407-d53c6adc0b13 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:51.933502 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09ec6f8c-f5c0-4d80-b407-d53c6adc0b13 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:51.933978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09ec6f8c-f5c0-4d80-b407-d53c6adc0b13 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:51.934752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09ec6f8c-f5c0-4d80-b407-d53c6adc0b13 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:51.935193 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09ec6f8c-f5c0-4d80-b407-d53c6adc0b13 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:52.074277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-09ec6f8c-f5c0-4d80-b407-d53c6adc0b13 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:52.082565 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-09ec6f8c-f5c0-4d80-b407-d53c6adc0b13 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1685 microversion: 2.1 time: 0.161148 Jul 20 05:05:52.083150 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3615/6993] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:51 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:53.101743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-357566c2-a4e7-4336-8562-7ebb48093e56 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:53.102367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-357566c2-a4e7-4336-8562-7ebb48093e56 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:53.110062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-357566c2-a4e7-4336-8562-7ebb48093e56 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:53.110548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-357566c2-a4e7-4336-8562-7ebb48093e56 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:53.111329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-357566c2-a4e7-4336-8562-7ebb48093e56 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:53.111775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-357566c2-a4e7-4336-8562-7ebb48093e56 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:53.258040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-357566c2-a4e7-4336-8562-7ebb48093e56 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:53.265943 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-357566c2-a4e7-4336-8562-7ebb48093e56 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1685 microversion: 2.1 time: 0.168977 Jul 20 05:05:53.266497 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3379/6994] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:53 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:54.286152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-df5b1a3f-3d8d-411f-8616-0acc03737d34 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:54.287316 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-df5b1a3f-3d8d-411f-8616-0acc03737d34 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:54.298263 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df5b1a3f-3d8d-411f-8616-0acc03737d34 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:54.299681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df5b1a3f-3d8d-411f-8616-0acc03737d34 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:54.299681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df5b1a3f-3d8d-411f-8616-0acc03737d34 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:54.299902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df5b1a3f-3d8d-411f-8616-0acc03737d34 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:54.528826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-df5b1a3f-3d8d-411f-8616-0acc03737d34 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:54.537609 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-df5b1a3f-3d8d-411f-8616-0acc03737d34 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1684 microversion: 2.1 time: 0.257686 Jul 20 05:05:54.538117 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3616/6995] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:54 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1684 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:54.905461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-46b8daf9-cf2e-4632-bc76-6d44041f5699 req-fb134d90-0dda-4282-bfef-37dc2fa99edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba285c0-5f71-44ff-aeb7-00640668769d", "name": "network-vif-unplugged", "status": "completed", "tag": "e93caa75-eecb-47f6-a381-72d2f36a2485"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:54.916209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-46b8daf9-cf2e-4632-bc76-6d44041f5699 req-fb134d90-0dda-4282-bfef-37dc2fa99edd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:54.916731 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-46b8daf9-cf2e-4632-bc76-6d44041f5699 req-fb134d90-0dda-4282-bfef-37dc2fa99edd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:54.931933 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-46b8daf9-cf2e-4632-bc76-6d44041f5699 req-fb134d90-0dda-4282-bfef-37dc2fa99edd service nova] Creating event network-vif-unplugged:e93caa75-eecb-47f6-a381-72d2f36a2485 for instance 5ba285c0-5f71-44ff-aeb7-00640668769d on n-h2-826526-5 Jul 20 05:05:54.938742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [req-46b8daf9-cf2e-4632-bc76-6d44041f5699 req-fb134d90-0dda-4282-bfef-37dc2fa99edd service nova] Instance 5ba285c0-5f71-44ff-aeb7-00640668769d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:05:54.951144 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-46b8daf9-cf2e-4632-bc76-6d44041f5699 req-fb134d90-0dda-4282-bfef-37dc2fa99edd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128627 Jul 20 05:05:54.952042 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3380/6996] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:05:55.558488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a8c64fd4-9833-4c50-ba0b-4eff1c8f311a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:55.559167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a8c64fd4-9833-4c50-ba0b-4eff1c8f311a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:55.566999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8c64fd4-9833-4c50-ba0b-4eff1c8f311a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:55.567448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8c64fd4-9833-4c50-ba0b-4eff1c8f311a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:55.568531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8c64fd4-9833-4c50-ba0b-4eff1c8f311a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:55.569195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8c64fd4-9833-4c50-ba0b-4eff1c8f311a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:55.783038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a8c64fd4-9833-4c50-ba0b-4eff1c8f311a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:55.791468 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a8c64fd4-9833-4c50-ba0b-4eff1c8f311a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1684 microversion: 2.1 time: 0.237381 Jul 20 05:05:55.792277 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3617/6997] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:55 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1684 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:56.815134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ceb03b5a-0288-4a63-b13d-8d4f7c12b646 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:56.816093 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ceb03b5a-0288-4a63-b13d-8d4f7c12b646 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:56.823454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ceb03b5a-0288-4a63-b13d-8d4f7c12b646 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:56.823911 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ceb03b5a-0288-4a63-b13d-8d4f7c12b646 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:56.824745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ceb03b5a-0288-4a63-b13d-8d4f7c12b646 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:56.825189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ceb03b5a-0288-4a63-b13d-8d4f7c12b646 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:56.976787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-391016d4-0a21-4b02-b8d3-cd2b43636394 req-a2f27ec8-93dd-494e-b66f-aa1230c24803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba285c0-5f71-44ff-aeb7-00640668769d", "tag": "e93caa75-eecb-47f6-a381-72d2f36a2485"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:56.987620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-391016d4-0a21-4b02-b8d3-cd2b43636394 req-a2f27ec8-93dd-494e-b66f-aa1230c24803 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:56.987861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ceb03b5a-0288-4a63-b13d-8d4f7c12b646 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:56.988593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-391016d4-0a21-4b02-b8d3-cd2b43636394 req-a2f27ec8-93dd-494e-b66f-aa1230c24803 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:56.998605 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ceb03b5a-0288-4a63-b13d-8d4f7c12b646 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1682 microversion: 2.1 time: 0.191275 Jul 20 05:05:56.999216 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3381/6998] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:56 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1682 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:57.009787 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-391016d4-0a21-4b02-b8d3-cd2b43636394 req-a2f27ec8-93dd-494e-b66f-aa1230c24803 service nova] Creating event network-changed:e93caa75-eecb-47f6-a381-72d2f36a2485 for instance 5ba285c0-5f71-44ff-aeb7-00640668769d on n-h2-826526-5 Jul 20 05:05:57.015452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-391016d4-0a21-4b02-b8d3-cd2b43636394 req-a2f27ec8-93dd-494e-b66f-aa1230c24803 service nova] Instance 5ba285c0-5f71-44ff-aeb7-00640668769d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:05:57.026690 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-391016d4-0a21-4b02-b8d3-cd2b43636394 req-a2f27ec8-93dd-494e-b66f-aa1230c24803 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054001 Jul 20 05:05:57.027308 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3618/6999] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:05:58.017245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-147e20d1-6ee3-4194-8362-5864dcdbca32 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:58.017920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-147e20d1-6ee3-4194-8362-5864dcdbca32 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:58.025619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-147e20d1-6ee3-4194-8362-5864dcdbca32 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:58.026089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-147e20d1-6ee3-4194-8362-5864dcdbca32 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:58.026891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-147e20d1-6ee3-4194-8362-5864dcdbca32 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:58.027348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-147e20d1-6ee3-4194-8362-5864dcdbca32 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:58.173865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-147e20d1-6ee3-4194-8362-5864dcdbca32 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:58.181687 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-147e20d1-6ee3-4194-8362-5864dcdbca32 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1679 microversion: 2.1 time: 0.168550 Jul 20 05:05:58.182273 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3382/7000] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:58 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:58.202662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1f3a4c9a-9ce8-41c5-b4f7-56fd5a18b265 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:58.203315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1f3a4c9a-9ce8-41c5-b4f7-56fd5a18b265 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:58.210765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f3a4c9a-9ce8-41c5-b4f7-56fd5a18b265 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:58.211219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f3a4c9a-9ce8-41c5-b4f7-56fd5a18b265 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:58.212006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f3a4c9a-9ce8-41c5-b4f7-56fd5a18b265 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:58.212493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f3a4c9a-9ce8-41c5-b4f7-56fd5a18b265 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:58.255204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f3a4c9a-9ce8-41c5-b4f7-56fd5a18b265 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:58.255616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f3a4c9a-9ce8-41c5-b4f7-56fd5a18b265 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:58.256783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f3a4c9a-9ce8-41c5-b4f7-56fd5a18b265 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:58.257223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1f3a4c9a-9ce8-41c5-b4f7-56fd5a18b265 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:58.278455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-1f3a4c9a-9ce8-41c5-b4f7-56fd5a18b265 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Getting quotas for project c48dbfac2a784ca7a2d027f8c102df69. Resources: {'ram', 'cores'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:05:58.284070 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-1f3a4c9a-9ce8-41c5-b4f7-56fd5a18b265 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Getting quotas for user c1b8ef10ecd447b8b2a3cc297731059c and project c48dbfac2a784ca7a2d027f8c102df69. Resources: {'ram', 'cores'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:05:58.406208 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1f3a4c9a-9ce8-41c5-b4f7-56fd5a18b265 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "POST /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d/action" status: 202 len: 0 microversion: 2.1 time: 0.210691 Jul 20 05:05:58.406831 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3619/7001] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:05:58 2022] POST /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:05:58.415738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-118395b7-5aee-400d-ac7c-1ae7f9c1c3c0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:58.416385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-118395b7-5aee-400d-ac7c-1ae7f9c1c3c0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:58.423322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-118395b7-5aee-400d-ac7c-1ae7f9c1c3c0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:58.424057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-118395b7-5aee-400d-ac7c-1ae7f9c1c3c0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:58.425238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-118395b7-5aee-400d-ac7c-1ae7f9c1c3c0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:58.425779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-118395b7-5aee-400d-ac7c-1ae7f9c1c3c0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:58.562041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-118395b7-5aee-400d-ac7c-1ae7f9c1c3c0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:58.570503 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-118395b7-5aee-400d-ac7c-1ae7f9c1c3c0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1678 microversion: 2.1 time: 0.158989 Jul 20 05:05:58.571876 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3383/7002] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:58 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:59.591840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9a4ddf33-c0d9-4155-9a14-59151f934889 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:59.592576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9a4ddf33-c0d9-4155-9a14-59151f934889 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:59.600735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a4ddf33-c0d9-4155-9a14-59151f934889 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:59.601189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a4ddf33-c0d9-4155-9a14-59151f934889 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:59.602259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a4ddf33-c0d9-4155-9a14-59151f934889 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:59.602804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a4ddf33-c0d9-4155-9a14-59151f934889 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:59.747043 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9a4ddf33-c0d9-4155-9a14-59151f934889 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:59.755707 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9a4ddf33-c0d9-4155-9a14-59151f934889 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1678 microversion: 2.1 time: 0.169584 Jul 20 05:05:59.756621 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3620/7003] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:59 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:00.776208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5289a442-185f-4cae-b84f-9c1e38e3a84e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:00.776906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5289a442-185f-4cae-b84f-9c1e38e3a84e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:00.784253 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5289a442-185f-4cae-b84f-9c1e38e3a84e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:00.784928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5289a442-185f-4cae-b84f-9c1e38e3a84e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:00.785883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5289a442-185f-4cae-b84f-9c1e38e3a84e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:00.786338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5289a442-185f-4cae-b84f-9c1e38e3a84e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:00.941269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5289a442-185f-4cae-b84f-9c1e38e3a84e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:00.949172 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5289a442-185f-4cae-b84f-9c1e38e3a84e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1678 microversion: 2.1 time: 0.177348 Jul 20 05:06:00.949745 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3384/7004] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:00 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:01.785519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-4ddba695-9ef8-4a76-96a1-6c3c4f05180f req-803afac7-ec15-4243-a9db-e9f4bdb4a427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba285c0-5f71-44ff-aeb7-00640668769d", "tag": "e93caa75-eecb-47f6-a381-72d2f36a2485"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:01.796428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4ddba695-9ef8-4a76-96a1-6c3c4f05180f req-803afac7-ec15-4243-a9db-e9f4bdb4a427 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:01.796870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4ddba695-9ef8-4a76-96a1-6c3c4f05180f req-803afac7-ec15-4243-a9db-e9f4bdb4a427 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:01.818471 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-4ddba695-9ef8-4a76-96a1-6c3c4f05180f req-803afac7-ec15-4243-a9db-e9f4bdb4a427 service nova] Creating event network-changed:e93caa75-eecb-47f6-a381-72d2f36a2485 for instance 5ba285c0-5f71-44ff-aeb7-00640668769d on n-h1-826526-5 Jul 20 05:06:01.824925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-4ddba695-9ef8-4a76-96a1-6c3c4f05180f req-803afac7-ec15-4243-a9db-e9f4bdb4a427 service nova] Instance 5ba285c0-5f71-44ff-aeb7-00640668769d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:06:01.838469 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-4ddba695-9ef8-4a76-96a1-6c3c4f05180f req-803afac7-ec15-4243-a9db-e9f4bdb4a427 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056611 Jul 20 05:06:01.839496 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3621/7005] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:01.968077 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c3ad2e77-32f8-4ad3-bc44-71413ccb0f22 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:01.968927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c3ad2e77-32f8-4ad3-bc44-71413ccb0f22 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:01.984903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3ad2e77-32f8-4ad3-bc44-71413ccb0f22 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:01.985369 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3ad2e77-32f8-4ad3-bc44-71413ccb0f22 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:01.986289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3ad2e77-32f8-4ad3-bc44-71413ccb0f22 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:01.986969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c3ad2e77-32f8-4ad3-bc44-71413ccb0f22 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:02.210239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c3ad2e77-32f8-4ad3-bc44-71413ccb0f22 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:02.218709 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c3ad2e77-32f8-4ad3-bc44-71413ccb0f22 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1678 microversion: 2.1 time: 0.255512 Jul 20 05:06:02.219528 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3385/7006] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:01 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1678 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:03.240816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-af199cda-86ae-445d-aefe-47e4e752960f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:03.245106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-af199cda-86ae-445d-aefe-47e4e752960f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:03.248037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af199cda-86ae-445d-aefe-47e4e752960f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:03.248531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af199cda-86ae-445d-aefe-47e4e752960f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:03.249317 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af199cda-86ae-445d-aefe-47e4e752960f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:03.249760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-af199cda-86ae-445d-aefe-47e4e752960f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:03.253988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:03.399011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-af199cda-86ae-445d-aefe-47e4e752960f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:03.413378 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-af199cda-86ae-445d-aefe-47e4e752960f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1678 microversion: 2.1 time: 0.179296 Jul 20 05:06:03.414014 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3622/7007] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:03 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:04.431757 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bbb85cfc-2fb0-4e6d-82a2-75b64dc88409 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:04.432655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bbb85cfc-2fb0-4e6d-82a2-75b64dc88409 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:04.441306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bbb85cfc-2fb0-4e6d-82a2-75b64dc88409 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:04.441768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bbb85cfc-2fb0-4e6d-82a2-75b64dc88409 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:04.442559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bbb85cfc-2fb0-4e6d-82a2-75b64dc88409 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:04.443329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bbb85cfc-2fb0-4e6d-82a2-75b64dc88409 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:04.462185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:04.582937 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bbb85cfc-2fb0-4e6d-82a2-75b64dc88409 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:04.591355 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bbb85cfc-2fb0-4e6d-82a2-75b64dc88409 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1671 microversion: 2.1 time: 0.164049 Jul 20 05:06:04.591961 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3386/7008] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:04 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:04.608370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9bae72a6-8581-4b1b-9c6b-618d92575582 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:04.609089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9bae72a6-8581-4b1b-9c6b-618d92575582 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:04.616967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9bae72a6-8581-4b1b-9c6b-618d92575582 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:04.617424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9bae72a6-8581-4b1b-9c6b-618d92575582 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:04.618327 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9bae72a6-8581-4b1b-9c6b-618d92575582 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:04.618652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9bae72a6-8581-4b1b-9c6b-618d92575582 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:04.758981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9bae72a6-8581-4b1b-9c6b-618d92575582 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:04.769446 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9bae72a6-8581-4b1b-9c6b-618d92575582 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1671 microversion: 2.1 time: 0.164671 Jul 20 05:06:04.770059 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3623/7009] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:04 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:04.787613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-053959ed-62a1-43f0-9a7c-55aceeeb9f32 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:04.788244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-053959ed-62a1-43f0-9a7c-55aceeeb9f32 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:04.795517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-053959ed-62a1-43f0-9a7c-55aceeeb9f32 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:04.795990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-053959ed-62a1-43f0-9a7c-55aceeeb9f32 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:04.796863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-053959ed-62a1-43f0-9a7c-55aceeeb9f32 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:04.797478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-053959ed-62a1-43f0-9a7c-55aceeeb9f32 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:04.942249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-053959ed-62a1-43f0-9a7c-55aceeeb9f32 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:04.954558 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-053959ed-62a1-43f0-9a7c-55aceeeb9f32 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1671 microversion: 2.1 time: 0.171081 Jul 20 05:06:04.955204 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3387/7010] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:04 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:04.973767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-598b6c28-a122-465c-b41a-e574faa59361 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:04.974266 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-598b6c28-a122-465c-b41a-e574faa59361 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:04.981561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-598b6c28-a122-465c-b41a-e574faa59361 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:04.981986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-598b6c28-a122-465c-b41a-e574faa59361 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:04.982767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-598b6c28-a122-465c-b41a-e574faa59361 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:04.983200 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-598b6c28-a122-465c-b41a-e574faa59361 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:05.012668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-598b6c28-a122-465c-b41a-e574faa59361 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:06:05.113214 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-598b6c28-a122-465c-b41a-e574faa59361 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 204 len: 0 microversion: 2.1 time: 0.142723 Jul 20 05:06:05.114000 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3624/7011] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:06:04 2022] DELETE /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:06:05.123342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-50ec4226-2f42-45dd-bb1d-79d66accea31 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:05.124202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-50ec4226-2f42-45dd-bb1d-79d66accea31 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:05.127918 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=39 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:05.133337 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50ec4226-2f42-45dd-bb1d-79d66accea31 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:05.133926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50ec4226-2f42-45dd-bb1d-79d66accea31 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:05.134787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50ec4226-2f42-45dd-bb1d-79d66accea31 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:05.135379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50ec4226-2f42-45dd-bb1d-79d66accea31 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:05.281697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-50ec4226-2f42-45dd-bb1d-79d66accea31 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:05.290263 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-50ec4226-2f42-45dd-bb1d-79d66accea31 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1677 microversion: 2.1 time: 0.171560 Jul 20 05:06:05.291090 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3388/7012] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:05 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:06:06.308664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-090ddda3-16e6-4426-bf2c-571dcf2517dd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:06.309238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-090ddda3-16e6-4426-bf2c-571dcf2517dd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:06.312125 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:06.318174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-090ddda3-16e6-4426-bf2c-571dcf2517dd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:06.318656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-090ddda3-16e6-4426-bf2c-571dcf2517dd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:06.319445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-090ddda3-16e6-4426-bf2c-571dcf2517dd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:06.319891 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-090ddda3-16e6-4426-bf2c-571dcf2517dd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:06.458397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-090ddda3-16e6-4426-bf2c-571dcf2517dd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:06.467166 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-090ddda3-16e6-4426-bf2c-571dcf2517dd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1677 microversion: 2.1 time: 0.162974 Jul 20 05:06:06.468031 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3625/7013] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:06 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:07.209570 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-75561560-2ed2-40d9-964d-cf3fbce971d4 req-065a8ce5-0d6e-4c98-bd33-9aeed5553b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba285c0-5f71-44ff-aeb7-00640668769d", "name": "network-vif-deleted", "tag": "e93caa75-eecb-47f6-a381-72d2f36a2485"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:07.218682 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-75561560-2ed2-40d9-964d-cf3fbce971d4 req-065a8ce5-0d6e-4c98-bd33-9aeed5553b3f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:07.219149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-75561560-2ed2-40d9-964d-cf3fbce971d4 req-065a8ce5-0d6e-4c98-bd33-9aeed5553b3f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:07.232542 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-75561560-2ed2-40d9-964d-cf3fbce971d4 req-065a8ce5-0d6e-4c98-bd33-9aeed5553b3f service nova] Creating event network-vif-deleted:e93caa75-eecb-47f6-a381-72d2f36a2485 for instance 5ba285c0-5f71-44ff-aeb7-00640668769d on n-h1-826526-5 Jul 20 05:06:07.237861 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-75561560-2ed2-40d9-964d-cf3fbce971d4 req-065a8ce5-0d6e-4c98-bd33-9aeed5553b3f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032213 Jul 20 05:06:07.239214 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3389/7014] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:07.485633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-39a757d7-b895-4eeb-840f-afa686238a03 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:07.486250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-39a757d7-b895-4eeb-840f-afa686238a03 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:07.493615 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39a757d7-b895-4eeb-840f-afa686238a03 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:07.494071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39a757d7-b895-4eeb-840f-afa686238a03 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:07.494845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39a757d7-b895-4eeb-840f-afa686238a03 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:07.495284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39a757d7-b895-4eeb-840f-afa686238a03 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:07.529434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39a757d7-b895-4eeb-840f-afa686238a03 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:07.529870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-39a757d7-b895-4eeb-840f-afa686238a03 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:07.530352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-39a757d7-b895-4eeb-840f-afa686238a03 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lazy-loading 'fault' on Instance uuid 5ba285c0-5f71-44ff-aeb7-00640668769d {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:06:07.583712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-39a757d7-b895-4eeb-840f-afa686238a03 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:07.592635 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-39a757d7-b895-4eeb-840f-afa686238a03 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 200 len: 1329 microversion: 2.1 time: 0.110793 Jul 20 05:06:07.593578 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3626/7015] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:07 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 1329 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:08.612959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b23e4809-6e45-4869-9601-4c9118b0ef71 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:08.613579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b23e4809-6e45-4869-9601-4c9118b0ef71 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:08.620378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b23e4809-6e45-4869-9601-4c9118b0ef71 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:08.620834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b23e4809-6e45-4869-9601-4c9118b0ef71 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:08.621651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b23e4809-6e45-4869-9601-4c9118b0ef71 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:08.622097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b23e4809-6e45-4869-9601-4c9118b0ef71 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:08.638305 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-b23e4809-6e45-4869-9601-4c9118b0ef71 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] HTTP exception thrown: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b23e4809-6e45-4869-9601-4c9118b0ef71 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Request method failure captured: Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d HTTP/1.1 Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14xl7kYURKR1dAkImi-dAM82dgRxeC4kwp-cBHDMeNqZvthepvqFh3YSxp0Sn4tCx2nWbnu1dX7qXdmEBl_1kCyJIPxFOMsgNP1G8qlJkVXjjexD8ZbQbeqq1Hv8-MpYrMoSqBIpZdvX2pvMr-M6p7LeV-yJHws23gLehuzUB9GuSSo Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c48dbfac2a784ca7a2d027f8c102df69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}] Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: c1b8ef10ecd447b8b2a3cc297731059c Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '5ba285c0-5f71-44ff-aeb7-00640668769d'} Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:08.639996 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:06:08.644201 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:08.644201 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:06:08.644201 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:06:08.644201 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:06:08.644201 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:06:08.644201 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:06:08.644201 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:06:08.644201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b23e4809-6e45-4869-9601-4c9118b0ef71 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Returning 404 to user: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:06:08.644201 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b23e4809-6e45-4869-9601-4c9118b0ef71 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 404 len: 111 microversion: 2.1 time: 0.033904 Jul 20 05:06:08.644201 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3390/7016] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:08 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:06:08.658163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fb4e2721-fa25-4e28-9bca-93d71a60691c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:08.658844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fb4e2721-fa25-4e28-9bca-93d71a60691c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:08.660996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:08.667530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb4e2721-fa25-4e28-9bca-93d71a60691c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:08.667967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb4e2721-fa25-4e28-9bca-93d71a60691c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:08.668817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb4e2721-fa25-4e28-9bca-93d71a60691c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:08.669260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fb4e2721-fa25-4e28-9bca-93d71a60691c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:08.683642 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-fb4e2721-fa25-4e28-9bca-93d71a60691c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] HTTP exception thrown: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fb4e2721-fa25-4e28-9bca-93d71a60691c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Request method failure captured: Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d HTTP/1.1 Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14xl7kYURKR1dAkImi-dAM82dgRxeC4kwp-cBHDMeNqZvthepvqFh3YSxp0Sn4tCx2nWbnu1dX7qXdmEBl_1kCyJIPxFOMsgNP1G8qlJkVXjjexD8ZbQbeqq1Hv8-MpYrMoSqBIpZdvX2pvMr-M6p7LeV-yJHws23gLehuzUB9GuSSo Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c48dbfac2a784ca7a2d027f8c102df69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}] Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c1b8ef10ecd447b8b2a3cc297731059c Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '5ba285c0-5f71-44ff-aeb7-00640668769d'} Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:08.685385 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:06:08.689048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:08.689048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:06:08.689048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:06:08.689048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:06:08.689048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:06:08.689048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:06:08.689048 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:06:08.689048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fb4e2721-fa25-4e28-9bca-93d71a60691c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Returning 404 to user: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:06:08.689048 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fb4e2721-fa25-4e28-9bca-93d71a60691c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 404 len: 111 microversion: 2.1 time: 0.032769 Jul 20 05:06:08.689048 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3627/7017] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:08 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:06:08.744476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-138eb60d-a1ba-4b21-9ae0-93336ce19985 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1941403257", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "b1762f2f-2565-44bb-a011-b37176955a43"}], "security_groups": [{"name": "tempest-securitygroup--1758487340"}], "key_name": "tempest-keypair-1918112510", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:08.860735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-138eb60d-a1ba-4b21-9ae0-93336ce19985 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] validate_networks() for [('b1762f2f-2565-44bb-a011-b37176955a43', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:06:09.324032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-138eb60d-a1ba-4b21-9ae0-93336ce19985 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:06:09.324491 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-138eb60d-a1ba-4b21-9ae0-93336ce19985 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:06:09.325092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-138eb60d-a1ba-4b21-9ae0-93336ce19985 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:06:09.325652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-138eb60d-a1ba-4b21-9ae0-93336ce19985 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:06:09.326195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-138eb60d-a1ba-4b21-9ae0-93336ce19985 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:06:09.336279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-138eb60d-a1ba-4b21-9ae0-93336ce19985 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:09.336770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-138eb60d-a1ba-4b21-9ae0-93336ce19985 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:09.337593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-138eb60d-a1ba-4b21-9ae0-93336ce19985 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:09.338057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-138eb60d-a1ba-4b21-9ae0-93336ce19985 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:09.356336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-138eb60d-a1ba-4b21-9ae0-93336ce19985 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Getting quotas for project c48dbfac2a784ca7a2d027f8c102df69. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:06:09.361961 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-138eb60d-a1ba-4b21-9ae0-93336ce19985 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Getting quotas for user c1b8ef10ecd447b8b2a3cc297731059c and project c48dbfac2a784ca7a2d027f8c102df69. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:06:09.375421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-138eb60d-a1ba-4b21-9ae0-93336ce19985 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:06:09.378148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-138eb60d-a1ba-4b21-9ae0-93336ce19985 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:06:09.428241 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-138eb60d-a1ba-4b21-9ae0-93336ce19985 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.687882 Jul 20 05:06:09.428935 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3391/7018] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:06:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:06:09.440408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c939ce50-8daf-4267-8ef3-df0b4c53071f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:09.441021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c939ce50-8daf-4267-8ef3-df0b4c53071f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:09.495342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c939ce50-8daf-4267-8ef3-df0b4c53071f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:09.503112 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c939ce50-8daf-4267-8ef3-df0b4c53071f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1239 microversion: 2.1 time: 0.067167 Jul 20 05:06:09.503708 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3628/7019] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:09 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:10.526027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2adaf3cf-ff3e-41b8-b217-ebb1758596f5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:10.526948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2adaf3cf-ff3e-41b8-b217-ebb1758596f5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:10.536045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2adaf3cf-ff3e-41b8-b217-ebb1758596f5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:10.536662 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2adaf3cf-ff3e-41b8-b217-ebb1758596f5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:10.537418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2adaf3cf-ff3e-41b8-b217-ebb1758596f5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:10.537953 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2adaf3cf-ff3e-41b8-b217-ebb1758596f5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:10.604824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2adaf3cf-ff3e-41b8-b217-ebb1758596f5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:10.613583 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2adaf3cf-ff3e-41b8-b217-ebb1758596f5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1297 microversion: 2.1 time: 0.094495 Jul 20 05:06:10.614200 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3392/7020] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:10 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1297 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:06:11.632239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-beeaea24-7c71-41d8-9966-7340b9047a58 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:11.632907 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-beeaea24-7c71-41d8-9966-7340b9047a58 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:11.645812 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-beeaea24-7c71-41d8-9966-7340b9047a58 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:11.646474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-beeaea24-7c71-41d8-9966-7340b9047a58 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:11.647432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-beeaea24-7c71-41d8-9966-7340b9047a58 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:11.648023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-beeaea24-7c71-41d8-9966-7340b9047a58 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:11.818425 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-beeaea24-7c71-41d8-9966-7340b9047a58 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:11.826161 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-beeaea24-7c71-41d8-9966-7340b9047a58 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1365 microversion: 2.1 time: 0.198352 Jul 20 05:06:11.826725 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3629/7021] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:11 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:12.225603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-4b081813-69a0-47b4-8456-624797fae1d0 req-bc49f198-2ea2-48fd-97d5-74447cee93f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5aed8ab-d2c2-4adf-954b-1bfbab2ece87", "tag": "2430d907-de3b-4901-ab3c-2fc03ad08aa5"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:12.254911 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4b081813-69a0-47b4-8456-624797fae1d0 req-bc49f198-2ea2-48fd-97d5-74447cee93f2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:12.255811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4b081813-69a0-47b4-8456-624797fae1d0 req-bc49f198-2ea2-48fd-97d5-74447cee93f2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:12.270452 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-4b081813-69a0-47b4-8456-624797fae1d0 req-bc49f198-2ea2-48fd-97d5-74447cee93f2 service nova] Creating event network-changed:2430d907-de3b-4901-ab3c-2fc03ad08aa5 for instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 on n-h2-826526-5 Jul 20 05:06:12.276452 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-4b081813-69a0-47b4-8456-624797fae1d0 req-bc49f198-2ea2-48fd-97d5-74447cee93f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056914 Jul 20 05:06:12.277080 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3393/7022] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:12.847561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-77a1308f-d263-4366-b9a6-6020e885fc25 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:12.848654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-77a1308f-d263-4366-b9a6-6020e885fc25 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:12.859105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-77a1308f-d263-4366-b9a6-6020e885fc25 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:12.859661 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-77a1308f-d263-4366-b9a6-6020e885fc25 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:12.860748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-77a1308f-d263-4366-b9a6-6020e885fc25 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:12.861293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-77a1308f-d263-4366-b9a6-6020e885fc25 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:13.002791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-77a1308f-d263-4366-b9a6-6020e885fc25 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:13.012372 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-77a1308f-d263-4366-b9a6-6020e885fc25 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1365 microversion: 2.1 time: 0.170863 Jul 20 05:06:13.012955 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3630/7023] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:12 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:14.031423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3e3d19dd-289e-4588-8853-a0d9cd38c60d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:14.032149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3e3d19dd-289e-4588-8853-a0d9cd38c60d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:14.041143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e3d19dd-289e-4588-8853-a0d9cd38c60d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:14.041621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e3d19dd-289e-4588-8853-a0d9cd38c60d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:14.042439 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e3d19dd-289e-4588-8853-a0d9cd38c60d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:14.042897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e3d19dd-289e-4588-8853-a0d9cd38c60d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:14.180437 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3e3d19dd-289e-4588-8853-a0d9cd38c60d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:14.188630 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3e3d19dd-289e-4588-8853-a0d9cd38c60d tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1365 microversion: 2.1 time: 0.161889 Jul 20 05:06:14.189189 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3394/7024] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:14 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:15.208806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b34012bf-d853-4f59-8633-07090f815bf6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:15.209427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b34012bf-d853-4f59-8633-07090f815bf6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:15.217083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b34012bf-d853-4f59-8633-07090f815bf6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:15.217570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b34012bf-d853-4f59-8633-07090f815bf6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:15.218367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b34012bf-d853-4f59-8633-07090f815bf6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:15.218799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b34012bf-d853-4f59-8633-07090f815bf6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:15.360835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b34012bf-d853-4f59-8633-07090f815bf6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:15.370353 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b34012bf-d853-4f59-8633-07090f815bf6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1365 microversion: 2.1 time: 0.166474 Jul 20 05:06:15.370946 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3631/7025] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:15 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:16.389884 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eab26aed-a7fa-4e99-b8ca-b26cd9ef9f7a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:16.390568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eab26aed-a7fa-4e99-b8ca-b26cd9ef9f7a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:16.398132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eab26aed-a7fa-4e99-b8ca-b26cd9ef9f7a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:16.398608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eab26aed-a7fa-4e99-b8ca-b26cd9ef9f7a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:16.399436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eab26aed-a7fa-4e99-b8ca-b26cd9ef9f7a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:16.399939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eab26aed-a7fa-4e99-b8ca-b26cd9ef9f7a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:16.905144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eab26aed-a7fa-4e99-b8ca-b26cd9ef9f7a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:16.913693 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eab26aed-a7fa-4e99-b8ca-b26cd9ef9f7a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1365 microversion: 2.1 time: 0.528758 Jul 20 05:06:16.914329 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3395/7026] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:16 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1365 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:17.932075 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-943f7215-77f8-4620-8e3e-82a78c51c054 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:17.932679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-943f7215-77f8-4620-8e3e-82a78c51c054 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:17.940147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-943f7215-77f8-4620-8e3e-82a78c51c054 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:17.940629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-943f7215-77f8-4620-8e3e-82a78c51c054 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:17.941515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-943f7215-77f8-4620-8e3e-82a78c51c054 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:17.941954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-943f7215-77f8-4620-8e3e-82a78c51c054 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:18.089852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-943f7215-77f8-4620-8e3e-82a78c51c054 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:18.099243 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-943f7215-77f8-4620-8e3e-82a78c51c054 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1365 microversion: 2.1 time: 0.171246 Jul 20 05:06:18.099985 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3632/7027] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:17 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:18.497925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-ed0542a3-c1d5-42e1-8788-b9b0d3906fc8 req-947c197c-248b-4efb-a830-a5102d0eb173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5aed8ab-d2c2-4adf-954b-1bfbab2ece87", "name": "network-vif-plugged", "status": "completed", "tag": "2430d907-de3b-4901-ab3c-2fc03ad08aa5"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:18.507821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ed0542a3-c1d5-42e1-8788-b9b0d3906fc8 req-947c197c-248b-4efb-a830-a5102d0eb173 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:18.508302 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-ed0542a3-c1d5-42e1-8788-b9b0d3906fc8 req-947c197c-248b-4efb-a830-a5102d0eb173 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:18.524907 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-ed0542a3-c1d5-42e1-8788-b9b0d3906fc8 req-947c197c-248b-4efb-a830-a5102d0eb173 service nova] Creating event network-vif-plugged:2430d907-de3b-4901-ab3c-2fc03ad08aa5 for instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 on n-h2-826526-5 Jul 20 05:06:18.530131 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-ed0542a3-c1d5-42e1-8788-b9b0d3906fc8 req-947c197c-248b-4efb-a830-a5102d0eb173 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036002 Jul 20 05:06:18.530769 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3396/7028] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:06:19.117671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8157e54e-d5a9-4277-a725-b4853a54feef tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:19.118384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8157e54e-d5a9-4277-a725-b4853a54feef tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:19.126407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8157e54e-d5a9-4277-a725-b4853a54feef tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:19.126926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8157e54e-d5a9-4277-a725-b4853a54feef tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:19.127803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8157e54e-d5a9-4277-a725-b4853a54feef tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:19.128255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8157e54e-d5a9-4277-a725-b4853a54feef tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:19.272009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8157e54e-d5a9-4277-a725-b4853a54feef tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:19.282174 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8157e54e-d5a9-4277-a725-b4853a54feef tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1365 microversion: 2.1 time: 0.168787 Jul 20 05:06:19.282897 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3633/7029] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:19 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:20.298199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:20.298890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:20.304472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5db8f9ee-db3d-4014-9172-eee6b6f9a0d3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:20.305184 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5db8f9ee-db3d-4014-9172-eee6b6f9a0d3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:20.312681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5db8f9ee-db3d-4014-9172-eee6b6f9a0d3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:20.313149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5db8f9ee-db3d-4014-9172-eee6b6f9a0d3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:20.313902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5db8f9ee-db3d-4014-9172-eee6b6f9a0d3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:20.314384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5db8f9ee-db3d-4014-9172-eee6b6f9a0d3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:20.456921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5db8f9ee-db3d-4014-9172-eee6b6f9a0d3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:20.465108 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5db8f9ee-db3d-4014-9172-eee6b6f9a0d3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1553 microversion: 2.1 time: 0.168008 Jul 20 05:06:20.465695 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3397/7030] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:20 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:20.484639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-66afbc6c-5a4f-4457-a237-b0ee0a353ae0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:20.485267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-66afbc6c-5a4f-4457-a237-b0ee0a353ae0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:20.487838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:20.494815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66afbc6c-5a4f-4457-a237-b0ee0a353ae0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:20.495260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66afbc6c-5a4f-4457-a237-b0ee0a353ae0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:20.496025 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66afbc6c-5a4f-4457-a237-b0ee0a353ae0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:20.496493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66afbc6c-5a4f-4457-a237-b0ee0a353ae0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:20.576927 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-66afbc6c-5a4f-4457-a237-b0ee0a353ae0 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097725 Jul 20 05:06:20.577544 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3634/7031] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 05:06:20 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:21.565129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-8a4d668f-b014-457a-bc2f-23a5eb80894c req-3b058e3f-4bd7-482f-97dd-3c7ad5c563ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5aed8ab-d2c2-4adf-954b-1bfbab2ece87", "tag": "2430d907-de3b-4901-ab3c-2fc03ad08aa5"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:21.574322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8a4d668f-b014-457a-bc2f-23a5eb80894c req-3b058e3f-4bd7-482f-97dd-3c7ad5c563ff service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:21.574787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8a4d668f-b014-457a-bc2f-23a5eb80894c req-3b058e3f-4bd7-482f-97dd-3c7ad5c563ff service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:21.586271 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-8a4d668f-b014-457a-bc2f-23a5eb80894c req-3b058e3f-4bd7-482f-97dd-3c7ad5c563ff service nova] Creating event network-changed:2430d907-de3b-4901-ab3c-2fc03ad08aa5 for instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 on n-h2-826526-5 Jul 20 05:06:21.591265 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-8a4d668f-b014-457a-bc2f-23a5eb80894c req-3b058e3f-4bd7-482f-97dd-3c7ad5c563ff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029890 Jul 20 05:06:21.591875 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3398/7032] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:55.852746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=23 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:55.853564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:55.858055 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6c9c91a9-0ce1-476b-baaf-7eb20e4707f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:55.858709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6c9c91a9-0ce1-476b-baaf-7eb20e4707f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:55.866135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c9c91a9-0ce1-476b-baaf-7eb20e4707f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:55.866637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c9c91a9-0ce1-476b-baaf-7eb20e4707f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:55.867468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c9c91a9-0ce1-476b-baaf-7eb20e4707f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:55.867904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6c9c91a9-0ce1-476b-baaf-7eb20e4707f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:56.208282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6c9c91a9-0ce1-476b-baaf-7eb20e4707f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:56.217634 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6c9c91a9-0ce1-476b-baaf-7eb20e4707f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1671 microversion: 2.1 time: 0.367247 Jul 20 05:06:56.218231 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3635/7033] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:55 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1671 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:56.232827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:56.233594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=50 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:56.238356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5fee44ec-497a-4144-abea-7eb9cc6cd6f9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00a5248c-37cb-4915-86db-a9b02ca61e38"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:56.239536 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5fee44ec-497a-4144-abea-7eb9cc6cd6f9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:56.247123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fee44ec-497a-4144-abea-7eb9cc6cd6f9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:56.247573 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fee44ec-497a-4144-abea-7eb9cc6cd6f9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:56.248389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fee44ec-497a-4144-abea-7eb9cc6cd6f9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:56.248866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fee44ec-497a-4144-abea-7eb9cc6cd6f9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:56.718482 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5fee44ec-497a-4144-abea-7eb9cc6cd6f9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "POST /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.487670 Jul 20 05:06:56.719035 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3399/7034] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 05:06:56 2022] POST /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87/os-volume_attachments => generated 194 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:07.444621 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-523e8c3b-a41f-40ba-bb29-5574d09e88a4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:07.445606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-523e8c3b-a41f-40ba-bb29-5574d09e88a4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:07.447913 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:07.448591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:07.454428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-523e8c3b-a41f-40ba-bb29-5574d09e88a4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:07.454879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-523e8c3b-a41f-40ba-bb29-5574d09e88a4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:07.455810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-523e8c3b-a41f-40ba-bb29-5574d09e88a4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:07.456294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-523e8c3b-a41f-40ba-bb29-5574d09e88a4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:07.487285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-523e8c3b-a41f-40ba-bb29-5574d09e88a4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:07.493371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-523e8c3b-a41f-40ba-bb29-5574d09e88a4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Old instance type m1.heat2, new instance type m1.heat {{(pid=127871) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:07:07.500668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-523e8c3b-a41f-40ba-bb29-5574d09e88a4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:07:07.501083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-523e8c3b-a41f-40ba-bb29-5574d09e88a4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:07:07.501550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-523e8c3b-a41f-40ba-bb29-5574d09e88a4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:07:07.501954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-523e8c3b-a41f-40ba-bb29-5574d09e88a4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:07:07.502360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-523e8c3b-a41f-40ba-bb29-5574d09e88a4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:07:07.575115 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-523e8c3b-a41f-40ba-bb29-5574d09e88a4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "POST /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87/action" status: 202 len: 0 microversion: 2.1 time: 0.134639 Jul 20 05:07:07.575720 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3636/7035] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:07:07 2022] POST /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:07:07.582481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:07.583237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:07.588241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5ceff043-21dd-4a72-a8e7-591d20eadfb6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:07.588919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5ceff043-21dd-4a72-a8e7-591d20eadfb6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:07.596534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ceff043-21dd-4a72-a8e7-591d20eadfb6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:07.597089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ceff043-21dd-4a72-a8e7-591d20eadfb6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:07.598160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ceff043-21dd-4a72-a8e7-591d20eadfb6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:07.598842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ceff043-21dd-4a72-a8e7-591d20eadfb6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:07.767171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5ceff043-21dd-4a72-a8e7-591d20eadfb6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:07.775918 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5ceff043-21dd-4a72-a8e7-591d20eadfb6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1726 microversion: 2.1 time: 0.195568 Jul 20 05:07:07.776494 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3400/7036] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:07 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1726 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:08.798881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ddfb494c-6744-422c-b569-c83b4d1fd918 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:08.799550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ddfb494c-6744-422c-b569-c83b4d1fd918 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:08.807336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ddfb494c-6744-422c-b569-c83b4d1fd918 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:08.807871 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ddfb494c-6744-422c-b569-c83b4d1fd918 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:08.808977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ddfb494c-6744-422c-b569-c83b4d1fd918 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:08.809497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ddfb494c-6744-422c-b569-c83b4d1fd918 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:08.972376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ddfb494c-6744-422c-b569-c83b4d1fd918 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:08.981054 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ddfb494c-6744-422c-b569-c83b4d1fd918 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1726 microversion: 2.1 time: 0.189041 Jul 20 05:07:08.981731 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3637/7037] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:08 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1726 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:10.001193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cc513483-9d74-4651-bc24-dfb1e89e5969 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:10.002627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cc513483-9d74-4651-bc24-dfb1e89e5969 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:10.010863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc513483-9d74-4651-bc24-dfb1e89e5969 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:10.011356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc513483-9d74-4651-bc24-dfb1e89e5969 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:10.012148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc513483-9d74-4651-bc24-dfb1e89e5969 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:10.012709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc513483-9d74-4651-bc24-dfb1e89e5969 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:10.159486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cc513483-9d74-4651-bc24-dfb1e89e5969 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:10.172451 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cc513483-9d74-4651-bc24-dfb1e89e5969 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1731 microversion: 2.1 time: 0.175622 Jul 20 05:07:10.173218 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3401/7038] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:09 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:11.198698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-417e9e51-739a-4799-9a84-ffa166fa8373 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:11.199456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-417e9e51-739a-4799-9a84-ffa166fa8373 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:11.208065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-417e9e51-739a-4799-9a84-ffa166fa8373 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:11.208557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-417e9e51-739a-4799-9a84-ffa166fa8373 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:11.209538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-417e9e51-739a-4799-9a84-ffa166fa8373 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:11.212536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-417e9e51-739a-4799-9a84-ffa166fa8373 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:11.378862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-417e9e51-739a-4799-9a84-ffa166fa8373 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:11.391756 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-417e9e51-739a-4799-9a84-ffa166fa8373 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1731 microversion: 2.1 time: 0.199462 Jul 20 05:07:11.392621 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3638/7039] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:11 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1731 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:12.410342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6a9ca40f-755e-44da-9d99-a7fe6146de75 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:12.410947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6a9ca40f-755e-44da-9d99-a7fe6146de75 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:12.418462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a9ca40f-755e-44da-9d99-a7fe6146de75 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:12.418933 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a9ca40f-755e-44da-9d99-a7fe6146de75 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:12.419719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a9ca40f-755e-44da-9d99-a7fe6146de75 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:12.420179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a9ca40f-755e-44da-9d99-a7fe6146de75 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:12.557495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6a9ca40f-755e-44da-9d99-a7fe6146de75 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:12.571126 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6a9ca40f-755e-44da-9d99-a7fe6146de75 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1731 microversion: 2.1 time: 0.164500 Jul 20 05:07:12.571935 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3402/7040] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:12 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:13.590716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-73a94567-4c56-4357-99e5-8942083331e8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:13.591360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-73a94567-4c56-4357-99e5-8942083331e8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:13.599052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73a94567-4c56-4357-99e5-8942083331e8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:13.599515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73a94567-4c56-4357-99e5-8942083331e8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:13.600299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73a94567-4c56-4357-99e5-8942083331e8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:13.600752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73a94567-4c56-4357-99e5-8942083331e8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:13.748994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-73a94567-4c56-4357-99e5-8942083331e8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:13.757926 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-73a94567-4c56-4357-99e5-8942083331e8 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1731 microversion: 2.1 time: 0.171364 Jul 20 05:07:13.758520 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3639/7041] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:13 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:14.779761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-99e1501c-89b4-4306-9c72-c539eb1b94e9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:14.780846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-99e1501c-89b4-4306-9c72-c539eb1b94e9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:14.793341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-99e1501c-89b4-4306-9c72-c539eb1b94e9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:14.794152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-99e1501c-89b4-4306-9c72-c539eb1b94e9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:14.795204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-99e1501c-89b4-4306-9c72-c539eb1b94e9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:14.795674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-99e1501c-89b4-4306-9c72-c539eb1b94e9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:14.942153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-99e1501c-89b4-4306-9c72-c539eb1b94e9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:14.950395 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-99e1501c-89b4-4306-9c72-c539eb1b94e9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1731 microversion: 2.1 time: 0.177322 Jul 20 05:07:14.951229 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3403/7042] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:14 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:15.971610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d1f33e88-2e42-42a4-8fcb-fa110fa7bece tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:15.972189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d1f33e88-2e42-42a4-8fcb-fa110fa7bece tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:15.980283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d1f33e88-2e42-42a4-8fcb-fa110fa7bece tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:15.980769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d1f33e88-2e42-42a4-8fcb-fa110fa7bece tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:15.981573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d1f33e88-2e42-42a4-8fcb-fa110fa7bece tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:15.982052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d1f33e88-2e42-42a4-8fcb-fa110fa7bece tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:16.134515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d1f33e88-2e42-42a4-8fcb-fa110fa7bece tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:16.143353 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d1f33e88-2e42-42a4-8fcb-fa110fa7bece tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1731 microversion: 2.1 time: 0.175857 Jul 20 05:07:16.144188 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3640/7043] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:15 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:17.162097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e6f291fe-8993-4798-a15a-02fc91811d95 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:17.162811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e6f291fe-8993-4798-a15a-02fc91811d95 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:17.171043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6f291fe-8993-4798-a15a-02fc91811d95 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:17.171442 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6f291fe-8993-4798-a15a-02fc91811d95 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:17.172219 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6f291fe-8993-4798-a15a-02fc91811d95 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:17.172701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6f291fe-8993-4798-a15a-02fc91811d95 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:17.313936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e6f291fe-8993-4798-a15a-02fc91811d95 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:17.326476 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e6f291fe-8993-4798-a15a-02fc91811d95 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1731 microversion: 2.1 time: 0.169069 Jul 20 05:07:17.327102 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3404/7044] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:17 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:18.349659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c91a5533-dd0f-46f6-b118-c3ed14712040 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:18.350310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c91a5533-dd0f-46f6-b118-c3ed14712040 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:18.359436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c91a5533-dd0f-46f6-b118-c3ed14712040 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:18.359880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c91a5533-dd0f-46f6-b118-c3ed14712040 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:18.360712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c91a5533-dd0f-46f6-b118-c3ed14712040 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:18.361139 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c91a5533-dd0f-46f6-b118-c3ed14712040 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:18.509568 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c91a5533-dd0f-46f6-b118-c3ed14712040 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:18.518161 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c91a5533-dd0f-46f6-b118-c3ed14712040 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1731 microversion: 2.1 time: 0.172464 Jul 20 05:07:18.518815 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3641/7045] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:18 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:19.543527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-26cc96ef-b830-4e8e-afdb-84155f24e877 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:19.544220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-26cc96ef-b830-4e8e-afdb-84155f24e877 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:19.553978 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26cc96ef-b830-4e8e-afdb-84155f24e877 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:19.554472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26cc96ef-b830-4e8e-afdb-84155f24e877 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:19.555254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26cc96ef-b830-4e8e-afdb-84155f24e877 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:19.555705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-26cc96ef-b830-4e8e-afdb-84155f24e877 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:19.692179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-26cc96ef-b830-4e8e-afdb-84155f24e877 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:19.703978 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-26cc96ef-b830-4e8e-afdb-84155f24e877 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1731 microversion: 2.1 time: 0.167174 Jul 20 05:07:19.704854 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3405/7046] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:19 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:20.726030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dc734ac3-34b9-4730-a80a-0e6017819d1e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:20.727113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dc734ac3-34b9-4730-a80a-0e6017819d1e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:20.736469 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc734ac3-34b9-4730-a80a-0e6017819d1e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:20.736837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc734ac3-34b9-4730-a80a-0e6017819d1e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:20.737637 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc734ac3-34b9-4730-a80a-0e6017819d1e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:20.738073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dc734ac3-34b9-4730-a80a-0e6017819d1e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:20.888370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dc734ac3-34b9-4730-a80a-0e6017819d1e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:20.896736 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dc734ac3-34b9-4730-a80a-0e6017819d1e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1731 microversion: 2.1 time: 0.177252 Jul 20 05:07:20.897331 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3642/7047] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:20 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:21.917880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0333f620-ace1-4bef-84a2-55128c944071 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:21.918702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0333f620-ace1-4bef-84a2-55128c944071 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:21.929490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0333f620-ace1-4bef-84a2-55128c944071 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:21.930157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0333f620-ace1-4bef-84a2-55128c944071 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:21.931274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0333f620-ace1-4bef-84a2-55128c944071 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:21.931922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0333f620-ace1-4bef-84a2-55128c944071 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:22.067895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0333f620-ace1-4bef-84a2-55128c944071 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:22.076841 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0333f620-ace1-4bef-84a2-55128c944071 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1731 microversion: 2.1 time: 0.165062 Jul 20 05:07:22.077438 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3406/7048] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:21 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:23.098747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c425f184-a566-4c66-bb1b-23a0526e4589 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:23.099725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c425f184-a566-4c66-bb1b-23a0526e4589 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:23.110083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c425f184-a566-4c66-bb1b-23a0526e4589 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:23.110534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c425f184-a566-4c66-bb1b-23a0526e4589 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:23.111318 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c425f184-a566-4c66-bb1b-23a0526e4589 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:23.111723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c425f184-a566-4c66-bb1b-23a0526e4589 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:23.245140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c425f184-a566-4c66-bb1b-23a0526e4589 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:23.253941 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c425f184-a566-4c66-bb1b-23a0526e4589 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1731 microversion: 2.1 time: 0.161872 Jul 20 05:07:23.254512 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3643/7049] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:23 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:24.276340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2e8e295f-ff23-4e0b-9298-4224550959fd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:24.277092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2e8e295f-ff23-4e0b-9298-4224550959fd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:24.285557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e8e295f-ff23-4e0b-9298-4224550959fd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:24.286022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e8e295f-ff23-4e0b-9298-4224550959fd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:24.286805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e8e295f-ff23-4e0b-9298-4224550959fd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:24.287249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e8e295f-ff23-4e0b-9298-4224550959fd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:24.433935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2e8e295f-ff23-4e0b-9298-4224550959fd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:24.442987 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2e8e295f-ff23-4e0b-9298-4224550959fd tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1731 microversion: 2.1 time: 0.173390 Jul 20 05:07:24.443573 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3407/7050] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:24 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:25.463470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9a095319-106e-4ae0-8944-9b35a9d554ee tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:25.464209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9a095319-106e-4ae0-8944-9b35a9d554ee tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:25.473684 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a095319-106e-4ae0-8944-9b35a9d554ee tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:25.474258 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a095319-106e-4ae0-8944-9b35a9d554ee tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:25.475240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a095319-106e-4ae0-8944-9b35a9d554ee tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:25.475792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a095319-106e-4ae0-8944-9b35a9d554ee tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:25.617215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9a095319-106e-4ae0-8944-9b35a9d554ee tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:25.626267 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9a095319-106e-4ae0-8944-9b35a9d554ee tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1731 microversion: 2.1 time: 0.167947 Jul 20 05:07:25.626878 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3644/7051] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:25 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:26.643797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-921840ff-f9c7-42f9-b6f1-6f112b16730c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:26.644502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-921840ff-f9c7-42f9-b6f1-6f112b16730c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:26.652385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-921840ff-f9c7-42f9-b6f1-6f112b16730c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:26.652853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-921840ff-f9c7-42f9-b6f1-6f112b16730c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:26.653649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-921840ff-f9c7-42f9-b6f1-6f112b16730c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:26.654128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-921840ff-f9c7-42f9-b6f1-6f112b16730c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:26.789726 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-921840ff-f9c7-42f9-b6f1-6f112b16730c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:26.798237 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-921840ff-f9c7-42f9-b6f1-6f112b16730c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1731 microversion: 2.1 time: 0.158436 Jul 20 05:07:26.798752 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3408/7052] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:26 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:27.816238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1767df89-8f48-4ebd-85c5-41f707ade0d2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:27.816808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1767df89-8f48-4ebd-85c5-41f707ade0d2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:27.824189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1767df89-8f48-4ebd-85c5-41f707ade0d2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:27.824676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1767df89-8f48-4ebd-85c5-41f707ade0d2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:27.825463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1767df89-8f48-4ebd-85c5-41f707ade0d2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:27.825887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1767df89-8f48-4ebd-85c5-41f707ade0d2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:27.974908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1767df89-8f48-4ebd-85c5-41f707ade0d2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:27.983443 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1767df89-8f48-4ebd-85c5-41f707ade0d2 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1731 microversion: 2.1 time: 0.171510 Jul 20 05:07:27.984055 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3645/7053] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:27 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:29.000789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-07f7ca9a-be7e-4291-bc08-393867d052a7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:29.001561 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-07f7ca9a-be7e-4291-bc08-393867d052a7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:29.009528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07f7ca9a-be7e-4291-bc08-393867d052a7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:29.010083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07f7ca9a-be7e-4291-bc08-393867d052a7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:29.010886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07f7ca9a-be7e-4291-bc08-393867d052a7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:29.011342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07f7ca9a-be7e-4291-bc08-393867d052a7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:29.220584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-07f7ca9a-be7e-4291-bc08-393867d052a7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:29.230941 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-07f7ca9a-be7e-4291-bc08-393867d052a7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1730 microversion: 2.1 time: 0.234300 Jul 20 05:07:29.231820 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3409/7054] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:28 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1730 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:29.329799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e63cc604-a257-459e-a490-10d4f621d25f req-73ca8e89-b4e4-4b6f-a431-f38de2f05b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5aed8ab-d2c2-4adf-954b-1bfbab2ece87", "name": "network-vif-unplugged", "status": "completed", "tag": "2430d907-de3b-4901-ab3c-2fc03ad08aa5"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:29.340098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e63cc604-a257-459e-a490-10d4f621d25f req-73ca8e89-b4e4-4b6f-a431-f38de2f05b64 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:29.340626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e63cc604-a257-459e-a490-10d4f621d25f req-73ca8e89-b4e4-4b6f-a431-f38de2f05b64 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:29.354699 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e63cc604-a257-459e-a490-10d4f621d25f req-73ca8e89-b4e4-4b6f-a431-f38de2f05b64 service nova] Creating event network-vif-unplugged:2430d907-de3b-4901-ab3c-2fc03ad08aa5 for instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 on n-h1-826526-5 Jul 20 05:07:29.361110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-e63cc604-a257-459e-a490-10d4f621d25f req-73ca8e89-b4e4-4b6f-a431-f38de2f05b64 service nova] Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:07:29.373945 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e63cc604-a257-459e-a490-10d4f621d25f req-73ca8e89-b4e4-4b6f-a431-f38de2f05b64 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118747 Jul 20 05:07:29.374889 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3646/7055] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:30.301704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e3c7e0bc-9fab-466a-9af2-fe7835f949d1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:30.302341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e3c7e0bc-9fab-466a-9af2-fe7835f949d1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:30.308477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3c7e0bc-9fab-466a-9af2-fe7835f949d1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:30.308948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3c7e0bc-9fab-466a-9af2-fe7835f949d1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:30.309727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3c7e0bc-9fab-466a-9af2-fe7835f949d1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:30.310231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e3c7e0bc-9fab-466a-9af2-fe7835f949d1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:30.451286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e3c7e0bc-9fab-466a-9af2-fe7835f949d1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:30.459602 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e3c7e0bc-9fab-466a-9af2-fe7835f949d1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1730 microversion: 2.1 time: 0.212475 Jul 20 05:07:30.460157 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3410/7056] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:30 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:31.418652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-b6a6e555-a5bf-4193-908c-b85d132b89f8 req-6a2a0622-0211-490e-93cd-b2dbedc4b392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5aed8ab-d2c2-4adf-954b-1bfbab2ece87", "tag": "2430d907-de3b-4901-ab3c-2fc03ad08aa5"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:31.428586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-b6a6e555-a5bf-4193-908c-b85d132b89f8 req-6a2a0622-0211-490e-93cd-b2dbedc4b392 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:31.429015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-b6a6e555-a5bf-4193-908c-b85d132b89f8 req-6a2a0622-0211-490e-93cd-b2dbedc4b392 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:31.441118 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-b6a6e555-a5bf-4193-908c-b85d132b89f8 req-6a2a0622-0211-490e-93cd-b2dbedc4b392 service nova] Creating event network-changed:2430d907-de3b-4901-ab3c-2fc03ad08aa5 for instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 on n-h1-826526-5 Jul 20 05:07:31.447144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-b6a6e555-a5bf-4193-908c-b85d132b89f8 req-6a2a0622-0211-490e-93cd-b2dbedc4b392 service nova] Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:07:31.458333 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-b6a6e555-a5bf-4193-908c-b85d132b89f8 req-6a2a0622-0211-490e-93cd-b2dbedc4b392 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043853 Jul 20 05:07:31.458943 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3647/7057] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:31.477655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6d798a26-648e-45d9-9b7f-b5f9f5b48966 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:31.481299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6d798a26-648e-45d9-9b7f-b5f9f5b48966 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:31.491249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d798a26-648e-45d9-9b7f-b5f9f5b48966 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:31.491730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d798a26-648e-45d9-9b7f-b5f9f5b48966 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:31.492652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d798a26-648e-45d9-9b7f-b5f9f5b48966 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:31.493113 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d798a26-648e-45d9-9b7f-b5f9f5b48966 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:31.770012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6d798a26-648e-45d9-9b7f-b5f9f5b48966 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:31.783192 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6d798a26-648e-45d9-9b7f-b5f9f5b48966 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1728 microversion: 2.1 time: 0.309241 Jul 20 05:07:31.794171 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3411/7058] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:31 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1728 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:32.803170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-55ea97bb-7207-42fe-a5e9-96f51030717e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:32.803863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-55ea97bb-7207-42fe-a5e9-96f51030717e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:32.810493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55ea97bb-7207-42fe-a5e9-96f51030717e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:32.810947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55ea97bb-7207-42fe-a5e9-96f51030717e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:32.811700 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55ea97bb-7207-42fe-a5e9-96f51030717e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:32.812148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-55ea97bb-7207-42fe-a5e9-96f51030717e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:32.950752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-55ea97bb-7207-42fe-a5e9-96f51030717e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:32.959467 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-55ea97bb-7207-42fe-a5e9-96f51030717e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1728 microversion: 2.1 time: 0.161672 Jul 20 05:07:32.960067 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3648/7059] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:32 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:33.977851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cca2f9ca-5988-428d-afd1-5eb7d9d187d7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:33.978394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cca2f9ca-5988-428d-afd1-5eb7d9d187d7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:33.986195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cca2f9ca-5988-428d-afd1-5eb7d9d187d7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:33.986668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cca2f9ca-5988-428d-afd1-5eb7d9d187d7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:33.987453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cca2f9ca-5988-428d-afd1-5eb7d9d187d7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:33.987910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cca2f9ca-5988-428d-afd1-5eb7d9d187d7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:34.130156 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cca2f9ca-5988-428d-afd1-5eb7d9d187d7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:34.139151 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cca2f9ca-5988-428d-afd1-5eb7d9d187d7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1728 microversion: 2.1 time: 0.165519 Jul 20 05:07:34.139793 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3412/7060] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:33 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:35.157508 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a42dc2bd-f5a0-4591-aba3-d12d4d4fde9c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:35.158224 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a42dc2bd-f5a0-4591-aba3-d12d4d4fde9c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:35.165603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a42dc2bd-f5a0-4591-aba3-d12d4d4fde9c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:35.166054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a42dc2bd-f5a0-4591-aba3-d12d4d4fde9c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:35.166870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a42dc2bd-f5a0-4591-aba3-d12d4d4fde9c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:35.167362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a42dc2bd-f5a0-4591-aba3-d12d4d4fde9c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:35.315090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a42dc2bd-f5a0-4591-aba3-d12d4d4fde9c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:35.323751 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a42dc2bd-f5a0-4591-aba3-d12d4d4fde9c tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1728 microversion: 2.1 time: 0.170398 Jul 20 05:07:35.324330 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3649/7061] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:35 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:36.345190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a7978e6b-a051-4594-9fd5-6e47fe6f3ecf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:36.346365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a7978e6b-a051-4594-9fd5-6e47fe6f3ecf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:36.353518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7978e6b-a051-4594-9fd5-6e47fe6f3ecf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:36.353986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7978e6b-a051-4594-9fd5-6e47fe6f3ecf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:36.354774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7978e6b-a051-4594-9fd5-6e47fe6f3ecf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:36.355228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7978e6b-a051-4594-9fd5-6e47fe6f3ecf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:36.493887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a7978e6b-a051-4594-9fd5-6e47fe6f3ecf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:36.506480 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a7978e6b-a051-4594-9fd5-6e47fe6f3ecf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1728 microversion: 2.1 time: 0.167141 Jul 20 05:07:36.507363 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3413/7062] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:36 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:37.530664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2974a9cf-6f18-4709-9099-772140bddc69 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:37.531450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2974a9cf-6f18-4709-9099-772140bddc69 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:37.534749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=33 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:37.540757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2974a9cf-6f18-4709-9099-772140bddc69 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:37.541202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2974a9cf-6f18-4709-9099-772140bddc69 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:37.542001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2974a9cf-6f18-4709-9099-772140bddc69 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:37.542458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2974a9cf-6f18-4709-9099-772140bddc69 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:37.545275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:37.682632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2974a9cf-6f18-4709-9099-772140bddc69 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:37.691292 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2974a9cf-6f18-4709-9099-772140bddc69 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1728 microversion: 2.1 time: 0.165726 Jul 20 05:07:37.691889 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3650/7063] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:37 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:38.709872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a21b016f-3052-4079-8265-41b7a8164eee tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:38.710503 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a21b016f-3052-4079-8265-41b7a8164eee tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:38.713282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=29 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:38.719076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a21b016f-3052-4079-8265-41b7a8164eee tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:38.719568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a21b016f-3052-4079-8265-41b7a8164eee tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:38.720392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a21b016f-3052-4079-8265-41b7a8164eee tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:38.720849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a21b016f-3052-4079-8265-41b7a8164eee tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:38.723864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=85 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:38.873695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a21b016f-3052-4079-8265-41b7a8164eee tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:38.886472 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a21b016f-3052-4079-8265-41b7a8164eee tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1728 microversion: 2.1 time: 0.180265 Jul 20 05:07:38.887206 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3414/7064] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:38 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:39.907438 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-62e940e4-7e3f-42d8-8bd0-917d90f4ce9a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:39.908105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-62e940e4-7e3f-42d8-8bd0-917d90f4ce9a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:39.915731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62e940e4-7e3f-42d8-8bd0-917d90f4ce9a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:39.916197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62e940e4-7e3f-42d8-8bd0-917d90f4ce9a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:39.917022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62e940e4-7e3f-42d8-8bd0-917d90f4ce9a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:39.917524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62e940e4-7e3f-42d8-8bd0-917d90f4ce9a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:40.070935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-62e940e4-7e3f-42d8-8bd0-917d90f4ce9a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:40.079815 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-62e940e4-7e3f-42d8-8bd0-917d90f4ce9a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1728 microversion: 2.1 time: 0.176696 Jul 20 05:07:40.080414 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3651/7065] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:39 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:41.101919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a5a46761-6549-4903-83e5-a3cc48189bce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:41.102943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a5a46761-6549-4903-83e5-a3cc48189bce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:41.113688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5a46761-6549-4903-83e5-a3cc48189bce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:41.114151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5a46761-6549-4903-83e5-a3cc48189bce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:41.114926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5a46761-6549-4903-83e5-a3cc48189bce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:41.115376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a5a46761-6549-4903-83e5-a3cc48189bce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:41.267334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a5a46761-6549-4903-83e5-a3cc48189bce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:41.276134 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a5a46761-6549-4903-83e5-a3cc48189bce tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1728 microversion: 2.1 time: 0.180939 Jul 20 05:07:41.276756 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3415/7066] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:41 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:42.296844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-baff74ea-ae3d-4627-8f03-5a655abaedfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:42.297370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-baff74ea-ae3d-4627-8f03-5a655abaedfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:42.304806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-baff74ea-ae3d-4627-8f03-5a655abaedfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:42.305262 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-baff74ea-ae3d-4627-8f03-5a655abaedfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:42.306035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-baff74ea-ae3d-4627-8f03-5a655abaedfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:42.306471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-baff74ea-ae3d-4627-8f03-5a655abaedfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:42.441913 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-baff74ea-ae3d-4627-8f03-5a655abaedfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:42.450291 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-baff74ea-ae3d-4627-8f03-5a655abaedfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1725 microversion: 2.1 time: 0.157565 Jul 20 05:07:42.450880 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3652/7067] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:42 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:42.467719 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ffc67149-d3d5-4331-a99f-fb8b784e83f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:42.468316 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ffc67149-d3d5-4331-a99f-fb8b784e83f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:42.475917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffc67149-d3d5-4331-a99f-fb8b784e83f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:42.476423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffc67149-d3d5-4331-a99f-fb8b784e83f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:42.477182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffc67149-d3d5-4331-a99f-fb8b784e83f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:42.477666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffc67149-d3d5-4331-a99f-fb8b784e83f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:42.515658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffc67149-d3d5-4331-a99f-fb8b784e83f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:42.516125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffc67149-d3d5-4331-a99f-fb8b784e83f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:42.516982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffc67149-d3d5-4331-a99f-fb8b784e83f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:42.517473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffc67149-d3d5-4331-a99f-fb8b784e83f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:42.538670 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-ffc67149-d3d5-4331-a99f-fb8b784e83f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Getting quotas for project c48dbfac2a784ca7a2d027f8c102df69. Resources: {'ram', 'cores'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:07:42.544408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-ffc67149-d3d5-4331-a99f-fb8b784e83f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Getting quotas for user c1b8ef10ecd447b8b2a3cc297731059c and project c48dbfac2a784ca7a2d027f8c102df69. Resources: {'ram', 'cores'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:07:42.653485 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ffc67149-d3d5-4331-a99f-fb8b784e83f4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "POST /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87/action" status: 202 len: 0 microversion: 2.1 time: 0.189525 Jul 20 05:07:42.654156 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3416/7068] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:07:42 2022] POST /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:07:42.662437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-51073576-b661-4cf5-a029-ead1c450e858 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:42.663051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-51073576-b661-4cf5-a029-ead1c450e858 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:42.670653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51073576-b661-4cf5-a029-ead1c450e858 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:42.671077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51073576-b661-4cf5-a029-ead1c450e858 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:42.671842 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51073576-b661-4cf5-a029-ead1c450e858 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:42.672291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51073576-b661-4cf5-a029-ead1c450e858 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:42.818146 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-51073576-b661-4cf5-a029-ead1c450e858 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:42.826390 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-51073576-b661-4cf5-a029-ead1c450e858 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1724 microversion: 2.1 time: 0.167819 Jul 20 05:07:42.827066 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3653/7069] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:42 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:43.844577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a1313a33-a4c4-4789-a9d1-a50606d57839 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:43.845369 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a1313a33-a4c4-4789-a9d1-a50606d57839 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:43.853261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1313a33-a4c4-4789-a9d1-a50606d57839 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:43.853812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1313a33-a4c4-4789-a9d1-a50606d57839 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:43.854619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1313a33-a4c4-4789-a9d1-a50606d57839 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:43.855076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1313a33-a4c4-4789-a9d1-a50606d57839 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:43.995360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a1313a33-a4c4-4789-a9d1-a50606d57839 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:44.003885 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a1313a33-a4c4-4789-a9d1-a50606d57839 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1724 microversion: 2.1 time: 0.163870 Jul 20 05:07:44.004772 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3417/7070] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:43 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:45.023459 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a8c9a521-6de3-4656-9ded-d0b610ecb245 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:45.023999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a8c9a521-6de3-4656-9ded-d0b610ecb245 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:45.031298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8c9a521-6de3-4656-9ded-d0b610ecb245 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:45.031761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8c9a521-6de3-4656-9ded-d0b610ecb245 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:45.032752 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8c9a521-6de3-4656-9ded-d0b610ecb245 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:45.033062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a8c9a521-6de3-4656-9ded-d0b610ecb245 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:45.177669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a8c9a521-6de3-4656-9ded-d0b610ecb245 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:45.185829 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a8c9a521-6de3-4656-9ded-d0b610ecb245 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1724 microversion: 2.1 time: 0.166514 Jul 20 05:07:45.187012 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3654/7071] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:45 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:46.101176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-5a0c2c23-3f5a-48bc-aca9-b55e045990ed req-1091819b-9259-4365-bfb2-01e1c5b76d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5aed8ab-d2c2-4adf-954b-1bfbab2ece87", "name": "network-vif-plugged", "status": "completed", "tag": "2430d907-de3b-4901-ab3c-2fc03ad08aa5"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:46.111369 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5a0c2c23-3f5a-48bc-aca9-b55e045990ed req-1091819b-9259-4365-bfb2-01e1c5b76d73 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:46.111840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5a0c2c23-3f5a-48bc-aca9-b55e045990ed req-1091819b-9259-4365-bfb2-01e1c5b76d73 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:46.129402 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-5a0c2c23-3f5a-48bc-aca9-b55e045990ed req-1091819b-9259-4365-bfb2-01e1c5b76d73 service nova] Creating event network-vif-plugged:2430d907-de3b-4901-ab3c-2fc03ad08aa5 for instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 on n-h1-826526-5 Jul 20 05:07:46.137780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [req-5a0c2c23-3f5a-48bc-aca9-b55e045990ed req-1091819b-9259-4365-bfb2-01e1c5b76d73 service nova] Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:07:46.149621 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-5a0c2c23-3f5a-48bc-aca9-b55e045990ed req-1091819b-9259-4365-bfb2-01e1c5b76d73 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114571 Jul 20 05:07:46.150402 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3418/7072] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:46.203114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-72caa6ac-84b2-4f12-abe4-cef030285360 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:46.203728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-72caa6ac-84b2-4f12-abe4-cef030285360 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:46.210997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72caa6ac-84b2-4f12-abe4-cef030285360 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:46.211446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72caa6ac-84b2-4f12-abe4-cef030285360 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:46.212219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72caa6ac-84b2-4f12-abe4-cef030285360 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:46.212687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-72caa6ac-84b2-4f12-abe4-cef030285360 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:46.344448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-72caa6ac-84b2-4f12-abe4-cef030285360 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:46.354160 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-72caa6ac-84b2-4f12-abe4-cef030285360 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1724 microversion: 2.1 time: 0.153921 Jul 20 05:07:46.354160 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3655/7073] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:46 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:47.372653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b747ae95-b09f-41c0-87ca-424577a017c7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:47.373373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b747ae95-b09f-41c0-87ca-424577a017c7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:47.380518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b747ae95-b09f-41c0-87ca-424577a017c7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:47.381300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b747ae95-b09f-41c0-87ca-424577a017c7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:47.382081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b747ae95-b09f-41c0-87ca-424577a017c7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:47.382539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b747ae95-b09f-41c0-87ca-424577a017c7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:47.550226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b747ae95-b09f-41c0-87ca-424577a017c7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:47.561622 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b747ae95-b09f-41c0-87ca-424577a017c7 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1724 microversion: 2.1 time: 0.193794 Jul 20 05:07:47.574173 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3419/7074] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:47 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:48.304040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-563d89eb-ad83-48c8-a08c-7c557fe067a1 req-3bbee74f-e741-424d-b6cb-5bf6213e079b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5aed8ab-d2c2-4adf-954b-1bfbab2ece87", "name": "network-vif-unplugged", "status": "completed", "tag": "2430d907-de3b-4901-ab3c-2fc03ad08aa5"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:48.315990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-563d89eb-ad83-48c8-a08c-7c557fe067a1 req-3bbee74f-e741-424d-b6cb-5bf6213e079b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:48.316493 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-563d89eb-ad83-48c8-a08c-7c557fe067a1 req-3bbee74f-e741-424d-b6cb-5bf6213e079b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:48.330080 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-563d89eb-ad83-48c8-a08c-7c557fe067a1 req-3bbee74f-e741-424d-b6cb-5bf6213e079b service nova] Creating event network-vif-unplugged:2430d907-de3b-4901-ab3c-2fc03ad08aa5 for instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 on n-h2-826526-5 Jul 20 05:07:48.336523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-563d89eb-ad83-48c8-a08c-7c557fe067a1 req-3bbee74f-e741-424d-b6cb-5bf6213e079b service nova] Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:07:48.350179 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-563d89eb-ad83-48c8-a08c-7c557fe067a1 req-3bbee74f-e741-424d-b6cb-5bf6213e079b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050859 Jul 20 05:07:48.351718 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3656/7075] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:48.582137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-510d0159-dd4a-41cd-a125-155ab442a836 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:48.582723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-510d0159-dd4a-41cd-a125-155ab442a836 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:48.590277 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-510d0159-dd4a-41cd-a125-155ab442a836 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:48.590746 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-510d0159-dd4a-41cd-a125-155ab442a836 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:48.591549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-510d0159-dd4a-41cd-a125-155ab442a836 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:48.592043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-510d0159-dd4a-41cd-a125-155ab442a836 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:48.748822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-510d0159-dd4a-41cd-a125-155ab442a836 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:48.761600 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-510d0159-dd4a-41cd-a125-155ab442a836 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1724 microversion: 2.1 time: 0.183357 Jul 20 05:07:48.762847 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3420/7076] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:48 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:49.781237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9641bbf9-fd8b-4e2c-962e-6326d0497e3e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:49.781974 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9641bbf9-fd8b-4e2c-962e-6326d0497e3e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:49.789212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9641bbf9-fd8b-4e2c-962e-6326d0497e3e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:49.789717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9641bbf9-fd8b-4e2c-962e-6326d0497e3e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:49.790543 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9641bbf9-fd8b-4e2c-962e-6326d0497e3e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:49.791042 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9641bbf9-fd8b-4e2c-962e-6326d0497e3e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:49.945676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9641bbf9-fd8b-4e2c-962e-6326d0497e3e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:49.954088 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9641bbf9-fd8b-4e2c-962e-6326d0497e3e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1724 microversion: 2.1 time: 0.178225 Jul 20 05:07:49.954773 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3657/7077] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:49 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:50.367930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-d8c80665-f6a5-43f7-9189-cec883743666 req-92687557-1114-4442-8e80-d7e722517516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5aed8ab-d2c2-4adf-954b-1bfbab2ece87", "tag": "2430d907-de3b-4901-ab3c-2fc03ad08aa5"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:50.380657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d8c80665-f6a5-43f7-9189-cec883743666 req-92687557-1114-4442-8e80-d7e722517516 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:50.381509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d8c80665-f6a5-43f7-9189-cec883743666 req-92687557-1114-4442-8e80-d7e722517516 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:50.393949 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-d8c80665-f6a5-43f7-9189-cec883743666 req-92687557-1114-4442-8e80-d7e722517516 service nova] Creating event network-changed:2430d907-de3b-4901-ab3c-2fc03ad08aa5 for instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 on n-h2-826526-5 Jul 20 05:07:50.399519 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [req-d8c80665-f6a5-43f7-9189-cec883743666 req-92687557-1114-4442-8e80-d7e722517516 service nova] Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:07:50.412888 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-d8c80665-f6a5-43f7-9189-cec883743666 req-92687557-1114-4442-8e80-d7e722517516 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048546 Jul 20 05:07:50.414308 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3421/7078] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:50.971361 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c97502e0-11a1-449e-acf3-59db09653dfc tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:50.972280 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c97502e0-11a1-449e-acf3-59db09653dfc tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:50.980403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c97502e0-11a1-449e-acf3-59db09653dfc tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:50.980851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c97502e0-11a1-449e-acf3-59db09653dfc tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:50.981631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c97502e0-11a1-449e-acf3-59db09653dfc tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:50.982098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c97502e0-11a1-449e-acf3-59db09653dfc tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:51.414027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c97502e0-11a1-449e-acf3-59db09653dfc tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:51.422872 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c97502e0-11a1-449e-acf3-59db09653dfc tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1724 microversion: 2.1 time: 0.455751 Jul 20 05:07:51.423553 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3658/7079] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:50 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1724 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:52.444116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8a33c4fa-69ae-4aa5-9f8b-856c7b28a895 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:52.444863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8a33c4fa-69ae-4aa5-9f8b-856c7b28a895 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:52.452322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a33c4fa-69ae-4aa5-9f8b-856c7b28a895 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:52.453098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a33c4fa-69ae-4aa5-9f8b-856c7b28a895 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:52.454157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a33c4fa-69ae-4aa5-9f8b-856c7b28a895 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:52.454806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a33c4fa-69ae-4aa5-9f8b-856c7b28a895 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:52.527454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:52.615031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8a33c4fa-69ae-4aa5-9f8b-856c7b28a895 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:52.624670 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8a33c4fa-69ae-4aa5-9f8b-856c7b28a895 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1724 microversion: 2.1 time: 0.186550 Jul 20 05:07:52.625879 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3422/7080] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:52 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:53.643666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fcadbc24-40d5-4793-a189-50ae6281e4b1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:53.644311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fcadbc24-40d5-4793-a189-50ae6281e4b1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:53.651633 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcadbc24-40d5-4793-a189-50ae6281e4b1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:53.652099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcadbc24-40d5-4793-a189-50ae6281e4b1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:53.652917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcadbc24-40d5-4793-a189-50ae6281e4b1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:53.653360 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fcadbc24-40d5-4793-a189-50ae6281e4b1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:53.788728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fcadbc24-40d5-4793-a189-50ae6281e4b1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:53.798910 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fcadbc24-40d5-4793-a189-50ae6281e4b1 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1724 microversion: 2.1 time: 0.159298 Jul 20 05:07:53.799546 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3659/7081] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:53 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:54.818222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1f6b9538-4d75-4cb6-b02d-6daa4858ac82 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:54.818813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1f6b9538-4d75-4cb6-b02d-6daa4858ac82 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:54.826265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f6b9538-4d75-4cb6-b02d-6daa4858ac82 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:54.826728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f6b9538-4d75-4cb6-b02d-6daa4858ac82 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:54.827506 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f6b9538-4d75-4cb6-b02d-6daa4858ac82 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:54.827951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f6b9538-4d75-4cb6-b02d-6daa4858ac82 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:54.960683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1f6b9538-4d75-4cb6-b02d-6daa4858ac82 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:54.969177 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1f6b9538-4d75-4cb6-b02d-6daa4858ac82 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1724 microversion: 2.1 time: 0.155221 Jul 20 05:07:54.969764 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3423/7082] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:54 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:55.987611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9fcb0116-9f82-445a-a263-05fb9dedf94a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:55.988165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9fcb0116-9f82-445a-a263-05fb9dedf94a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:55.995554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fcb0116-9f82-445a-a263-05fb9dedf94a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:55.995997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fcb0116-9f82-445a-a263-05fb9dedf94a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:55.996802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fcb0116-9f82-445a-a263-05fb9dedf94a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:55.997237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9fcb0116-9f82-445a-a263-05fb9dedf94a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:56.134309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9fcb0116-9f82-445a-a263-05fb9dedf94a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:56.143054 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9fcb0116-9f82-445a-a263-05fb9dedf94a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1724 microversion: 2.1 time: 0.159711 Jul 20 05:07:56.143636 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3660/7083] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:55 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:57.160969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8f3d7450-8784-49ad-9f8b-a9b1f764cb43 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:57.161545 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8f3d7450-8784-49ad-9f8b-a9b1f764cb43 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:57.169293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f3d7450-8784-49ad-9f8b-a9b1f764cb43 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:57.169777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f3d7450-8784-49ad-9f8b-a9b1f764cb43 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:57.170551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f3d7450-8784-49ad-9f8b-a9b1f764cb43 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:57.171003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f3d7450-8784-49ad-9f8b-a9b1f764cb43 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:57.304090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8f3d7450-8784-49ad-9f8b-a9b1f764cb43 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:57.312513 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8f3d7450-8784-49ad-9f8b-a9b1f764cb43 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1724 microversion: 2.1 time: 0.155570 Jul 20 05:07:57.313102 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3424/7084] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:57 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:58.330562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1da2cdfd-5960-4dda-ad08-381a36411bea tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:58.331208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1da2cdfd-5960-4dda-ad08-381a36411bea tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:58.338426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1da2cdfd-5960-4dda-ad08-381a36411bea tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:58.338877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1da2cdfd-5960-4dda-ad08-381a36411bea tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:58.339651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1da2cdfd-5960-4dda-ad08-381a36411bea tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:58.340088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1da2cdfd-5960-4dda-ad08-381a36411bea tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:58.474032 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1da2cdfd-5960-4dda-ad08-381a36411bea tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:58.482551 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1da2cdfd-5960-4dda-ad08-381a36411bea tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1724 microversion: 2.1 time: 0.156234 Jul 20 05:07:58.483141 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3661/7085] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:58 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:59.500646 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7b33ec94-f0dc-449a-b8ca-cc6828a540cf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:59.501366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7b33ec94-f0dc-449a-b8ca-cc6828a540cf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:59.509434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b33ec94-f0dc-449a-b8ca-cc6828a540cf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:59.509897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b33ec94-f0dc-449a-b8ca-cc6828a540cf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:59.510672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b33ec94-f0dc-449a-b8ca-cc6828a540cf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:59.511120 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7b33ec94-f0dc-449a-b8ca-cc6828a540cf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:59.661185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7b33ec94-f0dc-449a-b8ca-cc6828a540cf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:59.669844 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7b33ec94-f0dc-449a-b8ca-cc6828a540cf tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1724 microversion: 2.1 time: 0.173238 Jul 20 05:07:59.670854 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3425/7086] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:59 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:00.688053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dadf750d-e87b-48ae-862d-4b0b301847bc tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:00.688651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dadf750d-e87b-48ae-862d-4b0b301847bc tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:00.698668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dadf750d-e87b-48ae-862d-4b0b301847bc tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:00.699370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dadf750d-e87b-48ae-862d-4b0b301847bc tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:00.700482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dadf750d-e87b-48ae-862d-4b0b301847bc tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:00.701097 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dadf750d-e87b-48ae-862d-4b0b301847bc tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:00.839675 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dadf750d-e87b-48ae-862d-4b0b301847bc tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:00.853079 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dadf750d-e87b-48ae-862d-4b0b301847bc tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1724 microversion: 2.1 time: 0.168794 Jul 20 05:08:00.853785 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3662/7087] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:00 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:01.870768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cb2d6dff-82f7-4dff-b929-c6e1e4138bfa tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:01.871394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cb2d6dff-82f7-4dff-b929-c6e1e4138bfa tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:01.880321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb2d6dff-82f7-4dff-b929-c6e1e4138bfa tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:01.881028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb2d6dff-82f7-4dff-b929-c6e1e4138bfa tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:01.881870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb2d6dff-82f7-4dff-b929-c6e1e4138bfa tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:01.882319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cb2d6dff-82f7-4dff-b929-c6e1e4138bfa tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:02.019403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cb2d6dff-82f7-4dff-b929-c6e1e4138bfa tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:02.028251 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cb2d6dff-82f7-4dff-b929-c6e1e4138bfa tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1717 microversion: 2.1 time: 0.161493 Jul 20 05:08:02.028875 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3426/7088] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:01 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1717 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:02.045447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f0c9f602-70c8-45ea-b53e-e0eb62efedf5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:02.045985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f0c9f602-70c8-45ea-b53e-e0eb62efedf5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:02.053403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0c9f602-70c8-45ea-b53e-e0eb62efedf5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:02.053863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0c9f602-70c8-45ea-b53e-e0eb62efedf5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:02.054645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0c9f602-70c8-45ea-b53e-e0eb62efedf5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:02.055086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0c9f602-70c8-45ea-b53e-e0eb62efedf5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:02.191272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f0c9f602-70c8-45ea-b53e-e0eb62efedf5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:02.199963 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f0c9f602-70c8-45ea-b53e-e0eb62efedf5 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1717 microversion: 2.1 time: 0.158784 Jul 20 05:08:02.200603 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3663/7089] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:02 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:02.216532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d40104b1-da37-4a01-ae41-cd3b5b701671 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:02.217172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d40104b1-da37-4a01-ae41-cd3b5b701671 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:02.224199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d40104b1-da37-4a01-ae41-cd3b5b701671 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:02.224708 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d40104b1-da37-4a01-ae41-cd3b5b701671 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:02.225495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d40104b1-da37-4a01-ae41-cd3b5b701671 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:02.225950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d40104b1-da37-4a01-ae41-cd3b5b701671 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:02.361752 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d40104b1-da37-4a01-ae41-cd3b5b701671 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:02.370072 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d40104b1-da37-4a01-ae41-cd3b5b701671 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1717 microversion: 2.1 time: 0.157583 Jul 20 05:08:02.370665 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3427/7090] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:02 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1717 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:02.387748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-42044390-d1bf-4b89-a84a-ae839221c58e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:02.388184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-42044390-d1bf-4b89-a84a-ae839221c58e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:02.394790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42044390-d1bf-4b89-a84a-ae839221c58e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:02.395165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42044390-d1bf-4b89-a84a-ae839221c58e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:02.395939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42044390-d1bf-4b89-a84a-ae839221c58e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:02.396442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42044390-d1bf-4b89-a84a-ae839221c58e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:02.422175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-42044390-d1bf-4b89-a84a-ae839221c58e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:08:02.505395 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-42044390-d1bf-4b89-a84a-ae839221c58e tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 204 len: 0 microversion: 2.1 time: 0.121396 Jul 20 05:08:02.506407 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3664/7091] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:08:02 2022] DELETE /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:08:02.515208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-db323f59-a4ae-4dd8-a36d-c8a05e0d9746 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:02.516065 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-db323f59-a4ae-4dd8-a36d-c8a05e0d9746 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:02.522485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db323f59-a4ae-4dd8-a36d-c8a05e0d9746 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:02.522939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db323f59-a4ae-4dd8-a36d-c8a05e0d9746 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:02.523711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db323f59-a4ae-4dd8-a36d-c8a05e0d9746 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:02.524163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db323f59-a4ae-4dd8-a36d-c8a05e0d9746 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:02.542569 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:02.662359 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-db323f59-a4ae-4dd8-a36d-c8a05e0d9746 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:02.671140 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-db323f59-a4ae-4dd8-a36d-c8a05e0d9746 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1723 microversion: 2.1 time: 0.159988 Jul 20 05:08:02.671756 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3428/7092] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:02 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:03.690052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-09bd4410-d98b-4c12-97fb-25aab5744016 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:03.690726 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-09bd4410-d98b-4c12-97fb-25aab5744016 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:03.698242 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09bd4410-d98b-4c12-97fb-25aab5744016 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:03.698679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09bd4410-d98b-4c12-97fb-25aab5744016 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:03.699512 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09bd4410-d98b-4c12-97fb-25aab5744016 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:03.699917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09bd4410-d98b-4c12-97fb-25aab5744016 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:03.717504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:03.844400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-09bd4410-d98b-4c12-97fb-25aab5744016 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:03.857188 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-09bd4410-d98b-4c12-97fb-25aab5744016 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1723 microversion: 2.1 time: 0.171199 Jul 20 05:08:03.858120 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3665/7093] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:03 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:04.882459 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6a434036-d6ff-499c-8335-88c8f0e29882 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:04.886049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6a434036-d6ff-499c-8335-88c8f0e29882 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:04.902176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a434036-d6ff-499c-8335-88c8f0e29882 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:04.903304 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a434036-d6ff-499c-8335-88c8f0e29882 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:04.904956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a434036-d6ff-499c-8335-88c8f0e29882 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:04.906402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a434036-d6ff-499c-8335-88c8f0e29882 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:04.981523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6a434036-d6ff-499c-8335-88c8f0e29882 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:04.992220 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6a434036-d6ff-499c-8335-88c8f0e29882 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1655 microversion: 2.1 time: 0.114127 Jul 20 05:08:04.993526 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3429/7094] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:04 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1655 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:05.035418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-86f00aaf-7c01-4319-8f5c-02261a47eea2 req-20b59553-f592-4d72-b56e-29c1fd81ecfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5aed8ab-d2c2-4adf-954b-1bfbab2ece87", "name": "network-vif-deleted", "tag": "2430d907-de3b-4901-ab3c-2fc03ad08aa5"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:05.045448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-86f00aaf-7c01-4319-8f5c-02261a47eea2 req-20b59553-f592-4d72-b56e-29c1fd81ecfe service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:05.045887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-86f00aaf-7c01-4319-8f5c-02261a47eea2 req-20b59553-f592-4d72-b56e-29c1fd81ecfe service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:05.062072 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-86f00aaf-7c01-4319-8f5c-02261a47eea2 req-20b59553-f592-4d72-b56e-29c1fd81ecfe service nova] Creating event network-vif-deleted:2430d907-de3b-4901-ab3c-2fc03ad08aa5 for instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 on n-h2-826526-5 Jul 20 05:08:05.068593 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-86f00aaf-7c01-4319-8f5c-02261a47eea2 req-20b59553-f592-4d72-b56e-29c1fd81ecfe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036565 Jul 20 05:08:05.072637 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3666/7095] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:08:06.011037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a4ec8a0c-79f4-45e2-9b4d-e004971368d6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:06.012003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a4ec8a0c-79f4-45e2-9b4d-e004971368d6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:06.020888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4ec8a0c-79f4-45e2-9b4d-e004971368d6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:06.021382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4ec8a0c-79f4-45e2-9b4d-e004971368d6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:06.022350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4ec8a0c-79f4-45e2-9b4d-e004971368d6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:06.022802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4ec8a0c-79f4-45e2-9b4d-e004971368d6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:06.094394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a4ec8a0c-79f4-45e2-9b4d-e004971368d6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:06.103354 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a4ec8a0c-79f4-45e2-9b4d-e004971368d6 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1370 microversion: 2.1 time: 0.096314 Jul 20 05:08:06.113487 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3430/7096] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:06 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1370 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:07.122228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a657b066-8ccd-4eb3-b61c-f7b094e738ec tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:07.122971 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a657b066-8ccd-4eb3-b61c-f7b094e738ec tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:07.131188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a657b066-8ccd-4eb3-b61c-f7b094e738ec tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:07.131643 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a657b066-8ccd-4eb3-b61c-f7b094e738ec tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:07.132452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a657b066-8ccd-4eb3-b61c-f7b094e738ec tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:07.132894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a657b066-8ccd-4eb3-b61c-f7b094e738ec tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:07.199068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a657b066-8ccd-4eb3-b61c-f7b094e738ec tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:07.207769 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a657b066-8ccd-4eb3-b61c-f7b094e738ec tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1370 microversion: 2.1 time: 0.090430 Jul 20 05:08:07.208430 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3667/7097] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:07 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1370 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:08.226592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0649afa3-924e-41ee-8b0a-6b1e5f305736 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:08.227220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0649afa3-924e-41ee-8b0a-6b1e5f305736 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:08.235252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0649afa3-924e-41ee-8b0a-6b1e5f305736 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:08.235868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0649afa3-924e-41ee-8b0a-6b1e5f305736 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:08.236650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0649afa3-924e-41ee-8b0a-6b1e5f305736 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:08.237101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0649afa3-924e-41ee-8b0a-6b1e5f305736 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:08.305017 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0649afa3-924e-41ee-8b0a-6b1e5f305736 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:08.315223 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0649afa3-924e-41ee-8b0a-6b1e5f305736 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1370 microversion: 2.1 time: 0.093112 Jul 20 05:08:08.324326 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3431/7098] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:08 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1370 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:09.342123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cd9f9aeb-0076-4eef-98f2-0fa993202bfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:09.342758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cd9f9aeb-0076-4eef-98f2-0fa993202bfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:09.346134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:09.352000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd9f9aeb-0076-4eef-98f2-0fa993202bfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:09.352479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd9f9aeb-0076-4eef-98f2-0fa993202bfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:09.353291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd9f9aeb-0076-4eef-98f2-0fa993202bfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:09.353729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd9f9aeb-0076-4eef-98f2-0fa993202bfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:09.394006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd9f9aeb-0076-4eef-98f2-0fa993202bfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:09.394457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cd9f9aeb-0076-4eef-98f2-0fa993202bfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:09.394914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-cd9f9aeb-0076-4eef-98f2-0fa993202bfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lazy-loading 'fault' on Instance uuid f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:08:09.441199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cd9f9aeb-0076-4eef-98f2-0fa993202bfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b8ef10ecd447b8b2a3cc297731059c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48dbfac2a784ca7a2d027f8c102df69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:09.448388 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cd9f9aeb-0076-4eef-98f2-0fa993202bfe tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 200 len: 1329 microversion: 2.1 time: 0.111398 Jul 20 05:08:09.448953 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3668/7099] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:09 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 1329 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:10.466821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d2d1eee5-6fe9-4699-9b83-6a8560b94dc9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:10.467430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d2d1eee5-6fe9-4699-9b83-6a8560b94dc9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:10.472650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:10.478689 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2d1eee5-6fe9-4699-9b83-6a8560b94dc9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:10.479157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2d1eee5-6fe9-4699-9b83-6a8560b94dc9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:10.479923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2d1eee5-6fe9-4699-9b83-6a8560b94dc9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:10.480518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2d1eee5-6fe9-4699-9b83-6a8560b94dc9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:10.500648 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-d2d1eee5-6fe9-4699-9b83-6a8560b94dc9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] HTTP exception thrown: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d2d1eee5-6fe9-4699-9b83-6a8560b94dc9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Request method failure captured: Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 HTTP/1.1 Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14xl7kYURKR1dAkImi-dAM82dgRxeC4kwp-cBHDMeNqZvthepvqFh3YSxp0Sn4tCx2nWbnu1dX7qXdmEBl_1kCyJIPxFOMsgNP1G8qlJkVXjjexD8ZbQbeqq1Hv8-MpYrMoSqBIpZdvX2pvMr-M6p7LeV-yJHws23gLehuzUB9GuSSo Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c48dbfac2a784ca7a2d027f8c102df69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}] Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: c1b8ef10ecd447b8b2a3cc297731059c Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'f5aed8ab-d2c2-4adf-954b-1bfbab2ece87'} Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:10.502421 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:10.506803 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:10.506803 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:10.506803 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:10.506803 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:10.506803 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:10.506803 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:10.506803 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:10.506803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d2d1eee5-6fe9-4699-9b83-6a8560b94dc9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Returning 404 to user: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:10.506803 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d2d1eee5-6fe9-4699-9b83-6a8560b94dc9 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 404 len: 111 microversion: 2.1 time: 0.041345 Jul 20 05:08:10.506803 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3432/7100] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:10 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:08:10.562912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a2e45e0c-3b06-4701-807b-9d202701a590 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:10.563926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a2e45e0c-3b06-4701-807b-9d202701a590 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:10.571177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2e45e0c-3b06-4701-807b-9d202701a590 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:10.571634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2e45e0c-3b06-4701-807b-9d202701a590 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:10.572572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2e45e0c-3b06-4701-807b-9d202701a590 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:10.573014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a2e45e0c-3b06-4701-807b-9d202701a590 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:10.586888 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-a2e45e0c-3b06-4701-807b-9d202701a590 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] HTTP exception thrown: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a2e45e0c-3b06-4701-807b-9d202701a590 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Request method failure captured: Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87/os-volume_attachments HTTP/1.1 Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14xl7kYURKR1dAkImi-dAM82dgRxeC4kwp-cBHDMeNqZvthepvqFh3YSxp0Sn4tCx2nWbnu1dX7qXdmEBl_1kCyJIPxFOMsgNP1G8qlJkVXjjexD8ZbQbeqq1Hv8-MpYrMoSqBIpZdvX2pvMr-M6p7LeV-yJHws23gLehuzUB9GuSSo Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c48dbfac2a784ca7a2d027f8c102df69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}] Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c1b8ef10ecd447b8b2a3cc297731059c Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'server_id': 'f5aed8ab-d2c2-4adf-954b-1bfbab2ece87'} Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:08:10.588721 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:08:10.592786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:10.592786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:10.592786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:10.592786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:10.592786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:10.592786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:10.592786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:10.592786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:10.592786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:10.592786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:10.592786 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:10.592786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a2e45e0c-3b06-4701-807b-9d202701a590 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Returning 404 to user: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:10.592786 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a2e45e0c-3b06-4701-807b-9d202701a590 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031567 Jul 20 05:08:10.592786 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3669/7101] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:08:10 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:08:13.915247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7a18f61b-2bfc-402b-818f-a7bbf0e6edb3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:13.915894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7a18f61b-2bfc-402b-818f-a7bbf0e6edb3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:13.923975 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a18f61b-2bfc-402b-818f-a7bbf0e6edb3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:13.924834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a18f61b-2bfc-402b-818f-a7bbf0e6edb3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:13.925825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a18f61b-2bfc-402b-818f-a7bbf0e6edb3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:13.926351 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a18f61b-2bfc-402b-818f-a7bbf0e6edb3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:13.941514 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-7a18f61b-2bfc-402b-818f-a7bbf0e6edb3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] HTTP exception thrown: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7a18f61b-2bfc-402b-818f-a7bbf0e6edb3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Request method failure captured: Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 HTTP/1.1 Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14xl7kYURKR1dAkImi-dAM82dgRxeC4kwp-cBHDMeNqZvthepvqFh3YSxp0Sn4tCx2nWbnu1dX7qXdmEBl_1kCyJIPxFOMsgNP1G8qlJkVXjjexD8ZbQbeqq1Hv8-MpYrMoSqBIpZdvX2pvMr-M6p7LeV-yJHws23gLehuzUB9GuSSo Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c48dbfac2a784ca7a2d027f8c102df69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}] Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: c1b8ef10ecd447b8b2a3cc297731059c Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'f5aed8ab-d2c2-4adf-954b-1bfbab2ece87'} Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:08:13.943318 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:08:13.947266 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:13.947266 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:13.947266 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:13.947266 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:13.947266 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:13.947266 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:13.947266 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:13.947266 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:13.947266 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:13.947266 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:13.947266 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:13.947266 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7a18f61b-2bfc-402b-818f-a7bbf0e6edb3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Returning 404 to user: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:13.947266 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7a18f61b-2bfc-402b-818f-a7bbf0e6edb3 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 404 len: 111 microversion: 2.1 time: 0.034274 Jul 20 05:08:13.948885 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3433/7102] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:08:13 2022] DELETE /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:08:13.953817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-82a05823-0a4b-46fe-905d-b25e5b75dc17 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:13.954432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-82a05823-0a4b-46fe-905d-b25e5b75dc17 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: f5aed8ab-d2c2-4adf-954b-1bfbab2ece87] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:13.963838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82a05823-0a4b-46fe-905d-b25e5b75dc17 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:13.964309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82a05823-0a4b-46fe-905d-b25e5b75dc17 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:13.965102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82a05823-0a4b-46fe-905d-b25e5b75dc17 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:13.965563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82a05823-0a4b-46fe-905d-b25e5b75dc17 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:13.980374 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-82a05823-0a4b-46fe-905d-b25e5b75dc17 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] HTTP exception thrown: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-82a05823-0a4b-46fe-905d-b25e5b75dc17 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Request method failure captured: Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 HTTP/1.1 Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14xl7kYURKR1dAkImi-dAM82dgRxeC4kwp-cBHDMeNqZvthepvqFh3YSxp0Sn4tCx2nWbnu1dX7qXdmEBl_1kCyJIPxFOMsgNP1G8qlJkVXjjexD8ZbQbeqq1Hv8-MpYrMoSqBIpZdvX2pvMr-M6p7LeV-yJHws23gLehuzUB9GuSSo Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c48dbfac2a784ca7a2d027f8c102df69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}] Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c1b8ef10ecd447b8b2a3cc297731059c Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'f5aed8ab-d2c2-4adf-954b-1bfbab2ece87'} Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:13.981977 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:13.985792 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:13.985792 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:13.985792 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:13.985792 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:13.985792 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:13.985792 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. Jul 20 05:08:13.985792 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:13.985792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-82a05823-0a4b-46fe-905d-b25e5b75dc17 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Returning 404 to user: Instance f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:13.985792 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-82a05823-0a4b-46fe-905d-b25e5b75dc17 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87" status: 404 len: 111 microversion: 2.1 time: 0.033668 Jul 20 05:08:13.985792 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3670/7103] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:13 2022] GET /compute/v2.1/servers/f5aed8ab-d2c2-4adf-954b-1bfbab2ece87 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:08:13.992525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d90269fb-4e4f-4abc-99d5-6649d59e186b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:13.993064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d90269fb-4e4f-4abc-99d5-6649d59e186b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:13.999568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d90269fb-4e4f-4abc-99d5-6649d59e186b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:14.000031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d90269fb-4e4f-4abc-99d5-6649d59e186b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:14.000926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d90269fb-4e4f-4abc-99d5-6649d59e186b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:14.001580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d90269fb-4e4f-4abc-99d5-6649d59e186b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:14.018327 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-d90269fb-4e4f-4abc-99d5-6649d59e186b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] HTTP exception thrown: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d90269fb-4e4f-4abc-99d5-6649d59e186b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Request method failure captured: Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d HTTP/1.1 Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14xl7kYURKR1dAkImi-dAM82dgRxeC4kwp-cBHDMeNqZvthepvqFh3YSxp0Sn4tCx2nWbnu1dX7qXdmEBl_1kCyJIPxFOMsgNP1G8qlJkVXjjexD8ZbQbeqq1Hv8-MpYrMoSqBIpZdvX2pvMr-M6p7LeV-yJHws23gLehuzUB9GuSSo Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c48dbfac2a784ca7a2d027f8c102df69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}] Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: c1b8ef10ecd447b8b2a3cc297731059c Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '5ba285c0-5f71-44ff-aeb7-00640668769d'} Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:08:14.019944 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:08:14.024928 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:08:14.024928 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.024928 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:14.024928 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.024928 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:14.024928 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:14.024928 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:14.024928 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:14.024928 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:14.024928 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:08:14.024928 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.024928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d90269fb-4e4f-4abc-99d5-6649d59e186b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Returning 404 to user: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:14.024928 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d90269fb-4e4f-4abc-99d5-6649d59e186b tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 404 len: 111 microversion: 2.1 time: 0.033011 Jul 20 05:08:14.024928 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3434/7104] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:08:13 2022] DELETE /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:08:14.030202 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-30c28d6c-2561-40ac-9f8e-13fc094c7122 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:14.030826 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-30c28d6c-2561-40ac-9f8e-13fc094c7122 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 5ba285c0-5f71-44ff-aeb7-00640668769d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:14.037371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30c28d6c-2561-40ac-9f8e-13fc094c7122 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:14.037829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30c28d6c-2561-40ac-9f8e-13fc094c7122 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:14.038605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30c28d6c-2561-40ac-9f8e-13fc094c7122 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:14.039044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-30c28d6c-2561-40ac-9f8e-13fc094c7122 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:14.053433 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-30c28d6c-2561-40ac-9f8e-13fc094c7122 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] HTTP exception thrown: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-30c28d6c-2561-40ac-9f8e-13fc094c7122 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Request method failure captured: Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d HTTP/1.1 Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14xl7kYURKR1dAkImi-dAM82dgRxeC4kwp-cBHDMeNqZvthepvqFh3YSxp0Sn4tCx2nWbnu1dX7qXdmEBl_1kCyJIPxFOMsgNP1G8qlJkVXjjexD8ZbQbeqq1Hv8-MpYrMoSqBIpZdvX2pvMr-M6p7LeV-yJHws23gLehuzUB9GuSSo Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c48dbfac2a784ca7a2d027f8c102df69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}] Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c1b8ef10ecd447b8b2a3cc297731059c Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '5ba285c0-5f71-44ff-aeb7-00640668769d'} Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:14.054997 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.058887 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:14.058887 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:14.058887 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:14.058887 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:14.058887 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:14.058887 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. Jul 20 05:08:14.058887 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.058887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-30c28d6c-2561-40ac-9f8e-13fc094c7122 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Returning 404 to user: Instance 5ba285c0-5f71-44ff-aeb7-00640668769d could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:14.058887 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-30c28d6c-2561-40ac-9f8e-13fc094c7122 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d" status: 404 len: 111 microversion: 2.1 time: 0.030351 Jul 20 05:08:14.058887 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3671/7105] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:14 2022] GET /compute/v2.1/servers/5ba285c0-5f71-44ff-aeb7-00640668769d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:08:14.066602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-438ef5ac-718b-429f-b31b-78e3ddd6314a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:14.067165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-438ef5ac-718b-429f-b31b-78e3ddd6314a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:14.074444 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-438ef5ac-718b-429f-b31b-78e3ddd6314a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:14.074910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-438ef5ac-718b-429f-b31b-78e3ddd6314a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:14.075690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-438ef5ac-718b-429f-b31b-78e3ddd6314a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:14.076142 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-438ef5ac-718b-429f-b31b-78e3ddd6314a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:14.091453 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-438ef5ac-718b-429f-b31b-78e3ddd6314a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] HTTP exception thrown: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-438ef5ac-718b-429f-b31b-78e3ddd6314a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Request method failure captured: Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c HTTP/1.1 Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14xl7kYURKR1dAkImi-dAM82dgRxeC4kwp-cBHDMeNqZvthepvqFh3YSxp0Sn4tCx2nWbnu1dX7qXdmEBl_1kCyJIPxFOMsgNP1G8qlJkVXjjexD8ZbQbeqq1Hv8-MpYrMoSqBIpZdvX2pvMr-M6p7LeV-yJHws23gLehuzUB9GuSSo Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c48dbfac2a784ca7a2d027f8c102df69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}] Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: c1b8ef10ecd447b8b2a3cc297731059c Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '50765564-6f99-456e-80a1-104a57d0b86c'} Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:08:14.093159 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:08:14.097178 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:08:14.097178 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.097178 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:14.097178 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.097178 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:14.097178 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:14.097178 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:14.097178 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:14.097178 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:14.097178 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:08:14.097178 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.097178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-438ef5ac-718b-429f-b31b-78e3ddd6314a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Returning 404 to user: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:14.097178 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-438ef5ac-718b-429f-b31b-78e3ddd6314a tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "DELETE /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 404 len: 111 microversion: 2.1 time: 0.033417 Jul 20 05:08:14.097178 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3435/7106] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:08:14 2022] DELETE /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:08:14.104219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7d1c5768-db61-48b9-93fe-c7f723d14f6f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:14.104980 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7d1c5768-db61-48b9-93fe-c7f723d14f6f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: 50765564-6f99-456e-80a1-104a57d0b86c] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:14.112099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d1c5768-db61-48b9-93fe-c7f723d14f6f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:14.112697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d1c5768-db61-48b9-93fe-c7f723d14f6f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:14.113563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d1c5768-db61-48b9-93fe-c7f723d14f6f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:14.114100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d1c5768-db61-48b9-93fe-c7f723d14f6f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:14.130002 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-7d1c5768-db61-48b9-93fe-c7f723d14f6f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] HTTP exception thrown: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7d1c5768-db61-48b9-93fe-c7f723d14f6f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Request method failure captured: Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c HTTP/1.1 Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14xl7kYURKR1dAkImi-dAM82dgRxeC4kwp-cBHDMeNqZvthepvqFh3YSxp0Sn4tCx2nWbnu1dX7qXdmEBl_1kCyJIPxFOMsgNP1G8qlJkVXjjexD8ZbQbeqq1Hv8-MpYrMoSqBIpZdvX2pvMr-M6p7LeV-yJHws23gLehuzUB9GuSSo Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c48dbfac2a784ca7a2d027f8c102df69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}] Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c1b8ef10ecd447b8b2a3cc297731059c Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '50765564-6f99-456e-80a1-104a57d0b86c'} Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:14.131921 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.136080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:14.136080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:14.136080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:14.136080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:14.136080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:14.136080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. Jul 20 05:08:14.136080 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.136080 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7d1c5768-db61-48b9-93fe-c7f723d14f6f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Returning 404 to user: Instance 50765564-6f99-456e-80a1-104a57d0b86c could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:14.136080 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7d1c5768-db61-48b9-93fe-c7f723d14f6f tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c" status: 404 len: 111 microversion: 2.1 time: 0.033297 Jul 20 05:08:14.136080 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3672/7107] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:14 2022] GET /compute/v2.1/servers/50765564-6f99-456e-80a1-104a57d0b86c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:08:14.143992 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bc26514a-9ca4-4184-a6c5-95c11d2ec1e4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:14.144596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bc26514a-9ca4-4184-a6c5-95c11d2ec1e4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:14.151639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc26514a-9ca4-4184-a6c5-95c11d2ec1e4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:14.152087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc26514a-9ca4-4184-a6c5-95c11d2ec1e4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:14.152939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc26514a-9ca4-4184-a6c5-95c11d2ec1e4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:14.153392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc26514a-9ca4-4184-a6c5-95c11d2ec1e4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:14.169258 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-bc26514a-9ca4-4184-a6c5-95c11d2ec1e4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] HTTP exception thrown: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bc26514a-9ca4-4184-a6c5-95c11d2ec1e4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Request method failure captured: Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be HTTP/1.1 Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14xl7kYURKR1dAkImi-dAM82dgRxeC4kwp-cBHDMeNqZvthepvqFh3YSxp0Sn4tCx2nWbnu1dX7qXdmEBl_1kCyJIPxFOMsgNP1G8qlJkVXjjexD8ZbQbeqq1Hv8-MpYrMoSqBIpZdvX2pvMr-M6p7LeV-yJHws23gLehuzUB9GuSSo Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c48dbfac2a784ca7a2d027f8c102df69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}] Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: c1b8ef10ecd447b8b2a3cc297731059c Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'e665a555-bc6e-4074-9fda-f1a9e4e8a8be'} Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:08:14.170891 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:08:14.175324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:08:14.175324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.175324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:14.175324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.175324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:14.175324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:14.175324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:14.175324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:14.175324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:14.175324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:08:14.175324 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.175324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bc26514a-9ca4-4184-a6c5-95c11d2ec1e4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Returning 404 to user: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:14.175324 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bc26514a-9ca4-4184-a6c5-95c11d2ec1e4 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 404 len: 111 microversion: 2.1 time: 0.033408 Jul 20 05:08:14.176603 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3436/7108] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:08:14 2022] DELETE /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:08:14.181897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b9dfaa69-29a2-4c45-aeaa-f86b52344472 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:14.182544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b9dfaa69-29a2-4c45-aeaa-f86b52344472 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] [instance: e665a555-bc6e-4074-9fda-f1a9e4e8a8be] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:14.190208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9dfaa69-29a2-4c45-aeaa-f86b52344472 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:14.190679 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9dfaa69-29a2-4c45-aeaa-f86b52344472 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:14.191455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9dfaa69-29a2-4c45-aeaa-f86b52344472 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:14.191887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b9dfaa69-29a2-4c45-aeaa-f86b52344472 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:14.206977 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-b9dfaa69-29a2-4c45-aeaa-f86b52344472 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] HTTP exception thrown: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b9dfaa69-29a2-4c45-aeaa-f86b52344472 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Request method failure captured: Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be HTTP/1.1 Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14xl7kYURKR1dAkImi-dAM82dgRxeC4kwp-cBHDMeNqZvthepvqFh3YSxp0Sn4tCx2nWbnu1dX7qXdmEBl_1kCyJIPxFOMsgNP1G8qlJkVXjjexD8ZbQbeqq1Hv8-MpYrMoSqBIpZdvX2pvMr-M6p7LeV-yJHws23gLehuzUB9GuSSo Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c48dbfac2a784ca7a2d027f8c102df69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c48dbfac2a784ca7a2d027f8c102df69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c48dbfac2a784ca7a2d027f8c102df69"}]}] Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: c48dbfac2a784ca7a2d027f8c102df69 Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServerActionsTestJSON-1216576393 Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c1b8ef10ecd447b8b2a3cc297731059c Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServerActionsTestJSON-1216576393-project Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'e665a555-bc6e-4074-9fda-f1a9e4e8a8be'} Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:14.208581 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.212022 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:14.212022 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:14.212022 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:14.212022 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:14.212022 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:14.212022 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. Jul 20 05:08:14.212022 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:14.212022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b9dfaa69-29a2-4c45-aeaa-f86b52344472 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Returning 404 to user: Instance e665a555-bc6e-4074-9fda-f1a9e4e8a8be could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:14.212022 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b9dfaa69-29a2-4c45-aeaa-f86b52344472 tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be" status: 404 len: 111 microversion: 2.1 time: 0.032324 Jul 20 05:08:14.212022 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3673/7109] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:14 2022] GET /compute/v2.1/servers/e665a555-bc6e-4074-9fda-f1a9e4e8a8be => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:08:14.219636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8ebc049f-2242-4d31-83a1-0e2abdb53cfb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] Calling method '.version_select at 0x7f06c7459670>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:14.245027 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8ebc049f-2242-4d31-83a1-0e2abdb53cfb tempest-ServerActionsTestJSON-1216576393 tempest-ServerActionsTestJSON-1216576393-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1918112510" status: 202 len: 0 microversion: 2.1 time: 0.028914 Jul 20 05:08:14.246229 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3437/7110] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jul 20 05:08:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1918112510 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:08:24.187768 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=13 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:24.197120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=29 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:24.230171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2b7c6be8-87a1-42df-a661-83e2ba11130e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-767879228", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "412b3317-99af-4994-b8f3-2c2ab6540a57"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:24.294367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-2b7c6be8-87a1-42df-a661-83e2ba11130e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] validate_networks() for [('412b3317-99af-4994-b8f3-2c2ab6540a57', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:08:24.841666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2b7c6be8-87a1-42df-a661-83e2ba11130e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:08:24.842324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2b7c6be8-87a1-42df-a661-83e2ba11130e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:08:24.842809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2b7c6be8-87a1-42df-a661-83e2ba11130e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:08:24.843328 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2b7c6be8-87a1-42df-a661-83e2ba11130e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:08:24.843902 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-2b7c6be8-87a1-42df-a661-83e2ba11130e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:08:24.856996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b7c6be8-87a1-42df-a661-83e2ba11130e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:24.857365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b7c6be8-87a1-42df-a661-83e2ba11130e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:24.858220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b7c6be8-87a1-42df-a661-83e2ba11130e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:24.858545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2b7c6be8-87a1-42df-a661-83e2ba11130e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:24.883329 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-2b7c6be8-87a1-42df-a661-83e2ba11130e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Getting quotas for project eb82e748c26647f0a65e411660159a39. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:08:24.891265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-2b7c6be8-87a1-42df-a661-83e2ba11130e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Getting quotas for user c7f400eda70b4d5988617eebe12b4aaa and project eb82e748c26647f0a65e411660159a39. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:08:24.916795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2b7c6be8-87a1-42df-a661-83e2ba11130e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:08:24.919294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2b7c6be8-87a1-42df-a661-83e2ba11130e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:08:24.966092 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2b7c6be8-87a1-42df-a661-83e2ba11130e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.880577 Jul 20 05:08:24.966723 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3674/7111] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:08:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:08:24.977090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=31 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:24.977905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:24.983980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7df7b194-0986-4477-ae9a-d1fcbb133a15 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:24.984669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7df7b194-0986-4477-ae9a-d1fcbb133a15 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:25.062628 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-7df7b194-0986-4477-ae9a-d1fcbb133a15 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:25.074247 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7df7b194-0986-4477-ae9a-d1fcbb133a15 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 200 len: 1216 microversion: 2.1 time: 0.100611 Jul 20 05:08:25.074878 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3438/7112] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:24 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 1216 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:26.092550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6b0e515d-2728-448f-96ec-86c212b99c40 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:26.094381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6b0e515d-2728-448f-96ec-86c212b99c40 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:26.103179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6b0e515d-2728-448f-96ec-86c212b99c40 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:26.104490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6b0e515d-2728-448f-96ec-86c212b99c40 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:26.105702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6b0e515d-2728-448f-96ec-86c212b99c40 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:26.107178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6b0e515d-2728-448f-96ec-86c212b99c40 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:26.188081 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6b0e515d-2728-448f-96ec-86c212b99c40 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:26.202848 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6b0e515d-2728-448f-96ec-86c212b99c40 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 200 len: 1274 microversion: 2.1 time: 0.115095 Jul 20 05:08:26.203889 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3675/7113] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:26 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 1274 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:27.220812 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e41ff503-17ab-47aa-a384-70b063826100 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:27.221475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e41ff503-17ab-47aa-a384-70b063826100 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:27.231676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e41ff503-17ab-47aa-a384-70b063826100 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:27.232511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e41ff503-17ab-47aa-a384-70b063826100 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:27.233803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e41ff503-17ab-47aa-a384-70b063826100 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:27.234845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e41ff503-17ab-47aa-a384-70b063826100 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:27.468238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e41ff503-17ab-47aa-a384-70b063826100 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:27.478473 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e41ff503-17ab-47aa-a384-70b063826100 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 200 len: 1316 microversion: 2.1 time: 0.261389 Jul 20 05:08:27.479801 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3439/7114] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:27 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:27.886624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-125ea397-db51-4c3f-b16d-e0bcf18ac318 req-61c0aff5-a2b7-4696-8bf7-8a7abb5d07e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701cc382-e22f-4613-9ca8-0331f38b1b3e", "tag": "98cd3a83-abfb-4aeb-b1e0-cb9ad702caa2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:27.903344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-125ea397-db51-4c3f-b16d-e0bcf18ac318 req-61c0aff5-a2b7-4696-8bf7-8a7abb5d07e3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:27.904230 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-125ea397-db51-4c3f-b16d-e0bcf18ac318 req-61c0aff5-a2b7-4696-8bf7-8a7abb5d07e3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:27.937707 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-125ea397-db51-4c3f-b16d-e0bcf18ac318 req-61c0aff5-a2b7-4696-8bf7-8a7abb5d07e3 service nova] Creating event network-changed:98cd3a83-abfb-4aeb-b1e0-cb9ad702caa2 for instance 701cc382-e22f-4613-9ca8-0331f38b1b3e on n-h1-826526-5 Jul 20 05:08:27.943964 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-125ea397-db51-4c3f-b16d-e0bcf18ac318 req-61c0aff5-a2b7-4696-8bf7-8a7abb5d07e3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067358 Jul 20 05:08:27.945486 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3676/7115] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:08:28.497103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f389ea83-4a06-457a-9915-ff1129c67659 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:28.498888 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f389ea83-4a06-457a-9915-ff1129c67659 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:28.507256 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f389ea83-4a06-457a-9915-ff1129c67659 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:28.507815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f389ea83-4a06-457a-9915-ff1129c67659 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:28.508748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f389ea83-4a06-457a-9915-ff1129c67659 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:28.509362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f389ea83-4a06-457a-9915-ff1129c67659 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:29.007963 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f389ea83-4a06-457a-9915-ff1129c67659 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:29.018734 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f389ea83-4a06-457a-9915-ff1129c67659 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 200 len: 1316 microversion: 2.1 time: 0.525509 Jul 20 05:08:29.019629 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3440/7116] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:28 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 1316 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:30.042101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7f30572d-96e1-4498-b3e2-0fb0c7f41afb tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:30.042801 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7f30572d-96e1-4498-b3e2-0fb0c7f41afb tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:30.050620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f30572d-96e1-4498-b3e2-0fb0c7f41afb tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:30.051059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f30572d-96e1-4498-b3e2-0fb0c7f41afb tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:30.051888 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f30572d-96e1-4498-b3e2-0fb0c7f41afb tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:30.052356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7f30572d-96e1-4498-b3e2-0fb0c7f41afb tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:30.187401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7f30572d-96e1-4498-b3e2-0fb0c7f41afb tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:30.195740 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7f30572d-96e1-4498-b3e2-0fb0c7f41afb tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 200 len: 1316 microversion: 2.1 time: 0.158292 Jul 20 05:08:30.196355 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3677/7117] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:30 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:31.217092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fd60a942-bb0f-4e55-987f-5d5fd98fad31 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:31.218195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fd60a942-bb0f-4e55-987f-5d5fd98fad31 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:31.225878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd60a942-bb0f-4e55-987f-5d5fd98fad31 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:31.226342 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd60a942-bb0f-4e55-987f-5d5fd98fad31 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:31.227130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd60a942-bb0f-4e55-987f-5d5fd98fad31 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:31.227574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd60a942-bb0f-4e55-987f-5d5fd98fad31 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:31.370036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fd60a942-bb0f-4e55-987f-5d5fd98fad31 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:31.382721 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fd60a942-bb0f-4e55-987f-5d5fd98fad31 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 200 len: 1316 microversion: 2.1 time: 0.171169 Jul 20 05:08:31.383329 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3441/7118] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:31 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:32.402877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4861124b-3907-4dea-b83f-ef174d4b983c tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:32.403473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4861124b-3907-4dea-b83f-ef174d4b983c tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:32.412309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4861124b-3907-4dea-b83f-ef174d4b983c tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:32.413221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4861124b-3907-4dea-b83f-ef174d4b983c tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:32.414020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4861124b-3907-4dea-b83f-ef174d4b983c tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:32.414455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4861124b-3907-4dea-b83f-ef174d4b983c tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:32.555713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4861124b-3907-4dea-b83f-ef174d4b983c tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:32.564155 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4861124b-3907-4dea-b83f-ef174d4b983c tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 200 len: 1316 microversion: 2.1 time: 0.167675 Jul 20 05:08:32.564888 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3678/7119] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:32 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:33.582288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1869a8d5-fbfa-4d94-ba91-6fcfeefc9401 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:33.583461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1869a8d5-fbfa-4d94-ba91-6fcfeefc9401 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:33.591284 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1869a8d5-fbfa-4d94-ba91-6fcfeefc9401 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:33.591745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1869a8d5-fbfa-4d94-ba91-6fcfeefc9401 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:33.592591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1869a8d5-fbfa-4d94-ba91-6fcfeefc9401 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:33.593045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1869a8d5-fbfa-4d94-ba91-6fcfeefc9401 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:33.743357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1869a8d5-fbfa-4d94-ba91-6fcfeefc9401 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:33.751345 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1869a8d5-fbfa-4d94-ba91-6fcfeefc9401 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 200 len: 1316 microversion: 2.1 time: 0.173583 Jul 20 05:08:33.752012 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3442/7120] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:33 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:34.301573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-c48555a3-8645-4044-a7c2-01bcfb87c23b req-daf17253-59c5-459f-b99e-02abf6590662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701cc382-e22f-4613-9ca8-0331f38b1b3e", "name": "network-vif-plugged", "status": "completed", "tag": "98cd3a83-abfb-4aeb-b1e0-cb9ad702caa2"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:34.313137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c48555a3-8645-4044-a7c2-01bcfb87c23b req-daf17253-59c5-459f-b99e-02abf6590662 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:34.313699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c48555a3-8645-4044-a7c2-01bcfb87c23b req-daf17253-59c5-459f-b99e-02abf6590662 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:34.326236 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-c48555a3-8645-4044-a7c2-01bcfb87c23b req-daf17253-59c5-459f-b99e-02abf6590662 service nova] Creating event network-vif-plugged:98cd3a83-abfb-4aeb-b1e0-cb9ad702caa2 for instance 701cc382-e22f-4613-9ca8-0331f38b1b3e on n-h1-826526-5 Jul 20 05:08:34.332034 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-c48555a3-8645-4044-a7c2-01bcfb87c23b req-daf17253-59c5-459f-b99e-02abf6590662 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035583 Jul 20 05:08:34.332716 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3679/7121] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:08:34.772178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0c6c69c1-a2ef-4e7f-9d65-8956ae891831 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:34.772861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0c6c69c1-a2ef-4e7f-9d65-8956ae891831 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:34.784603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c6c69c1-a2ef-4e7f-9d65-8956ae891831 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:34.785360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c6c69c1-a2ef-4e7f-9d65-8956ae891831 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:34.786658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c6c69c1-a2ef-4e7f-9d65-8956ae891831 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:34.787404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0c6c69c1-a2ef-4e7f-9d65-8956ae891831 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:34.937241 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0c6c69c1-a2ef-4e7f-9d65-8956ae891831 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:34.946068 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0c6c69c1-a2ef-4e7f-9d65-8956ae891831 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 200 len: 1316 microversion: 2.1 time: 0.178574 Jul 20 05:08:34.946661 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3443/7122] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:34 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 1316 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:35.961805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:35.962663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:35.968561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6a35d570-fa02-491e-9dfb-a2c5ff1b327f tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:35.969312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6a35d570-fa02-491e-9dfb-a2c5ff1b327f tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:35.976968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a35d570-fa02-491e-9dfb-a2c5ff1b327f tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:35.977422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a35d570-fa02-491e-9dfb-a2c5ff1b327f tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:35.978206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a35d570-fa02-491e-9dfb-a2c5ff1b327f tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:35.978645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6a35d570-fa02-491e-9dfb-a2c5ff1b327f tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:36.122507 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6a35d570-fa02-491e-9dfb-a2c5ff1b327f tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:36.134092 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6a35d570-fa02-491e-9dfb-a2c5ff1b327f tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 200 len: 1506 microversion: 2.1 time: 0.173213 Jul 20 05:08:36.134910 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3680/7123] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:35 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:36.193941 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8c1e1f97-f48a-40ad-ab7c-dac0e1eb5115 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-887296257", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "412b3317-99af-4994-b8f3-2c2ab6540a57"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:36.201028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:36.251014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-8c1e1f97-f48a-40ad-ab7c-dac0e1eb5115 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] validate_networks() for [('412b3317-99af-4994-b8f3-2c2ab6540a57', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:08:36.736801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8c1e1f97-f48a-40ad-ab7c-dac0e1eb5115 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:08:36.737243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8c1e1f97-f48a-40ad-ab7c-dac0e1eb5115 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:08:36.737765 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8c1e1f97-f48a-40ad-ab7c-dac0e1eb5115 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:08:36.738194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8c1e1f97-f48a-40ad-ab7c-dac0e1eb5115 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:08:36.738661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-8c1e1f97-f48a-40ad-ab7c-dac0e1eb5115 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:08:36.748640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c1e1f97-f48a-40ad-ab7c-dac0e1eb5115 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:36.749103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c1e1f97-f48a-40ad-ab7c-dac0e1eb5115 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:36.749936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c1e1f97-f48a-40ad-ab7c-dac0e1eb5115 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:36.750384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c1e1f97-f48a-40ad-ab7c-dac0e1eb5115 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:36.777399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8c1e1f97-f48a-40ad-ab7c-dac0e1eb5115 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Getting quotas for project eb82e748c26647f0a65e411660159a39. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:08:36.782943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8c1e1f97-f48a-40ad-ab7c-dac0e1eb5115 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Getting quotas for user c7f400eda70b4d5988617eebe12b4aaa and project eb82e748c26647f0a65e411660159a39. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:08:36.796469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8c1e1f97-f48a-40ad-ab7c-dac0e1eb5115 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:08:36.799362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8c1e1f97-f48a-40ad-ab7c-dac0e1eb5115 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:08:36.847861 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8c1e1f97-f48a-40ad-ab7c-dac0e1eb5115 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657916 Jul 20 05:08:36.848561 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3444/7124] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:08:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:08:36.858948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dfa471c7-05d5-4985-b270-56c006b3abbc tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:36.859622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dfa471c7-05d5-4985-b270-56c006b3abbc tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:36.916090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dfa471c7-05d5-4985-b270-56c006b3abbc tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:36.923127 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dfa471c7-05d5-4985-b270-56c006b3abbc tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e" status: 200 len: 1216 microversion: 2.1 time: 0.068197 Jul 20 05:08:36.923708 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3681/7125] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:36 2022] GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:37.942859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3f256dee-7d33-4e61-8775-2fbfd016fb14 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:37.943473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3f256dee-7d33-4e61-8775-2fbfd016fb14 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:37.953985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f256dee-7d33-4e61-8775-2fbfd016fb14 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:37.954451 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f256dee-7d33-4e61-8775-2fbfd016fb14 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:37.955264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f256dee-7d33-4e61-8775-2fbfd016fb14 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:37.955676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f256dee-7d33-4e61-8775-2fbfd016fb14 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:38.026223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3f256dee-7d33-4e61-8775-2fbfd016fb14 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:38.035371 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3f256dee-7d33-4e61-8775-2fbfd016fb14 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e" status: 200 len: 1268 microversion: 2.1 time: 0.097360 Jul 20 05:08:38.035986 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3445/7126] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:37 2022] GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e => generated 1268 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:39.053314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2381af20-900b-4f18-a7c4-171e8e7bf3ea tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:39.053975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2381af20-900b-4f18-a7c4-171e8e7bf3ea tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:39.061714 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2381af20-900b-4f18-a7c4-171e8e7bf3ea tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:39.062185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2381af20-900b-4f18-a7c4-171e8e7bf3ea tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:39.062926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2381af20-900b-4f18-a7c4-171e8e7bf3ea tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:39.063387 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2381af20-900b-4f18-a7c4-171e8e7bf3ea tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:39.278186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2381af20-900b-4f18-a7c4-171e8e7bf3ea tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:39.296685 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2381af20-900b-4f18-a7c4-171e8e7bf3ea tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e" status: 200 len: 1316 microversion: 2.1 time: 0.247108 Jul 20 05:08:39.297089 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3682/7127] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:39 2022] GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:39.529043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-073ad2cd-e45f-4ee0-b164-a2f4ac824f62 req-b11d0d91-ff74-45c3-a815-2a37570dcbba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b153ef6-9253-48df-9d1e-dca5dd3d9e9e", "tag": "f4ad3620-12c4-4230-bbea-710db4e132fb"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:39.547891 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-073ad2cd-e45f-4ee0-b164-a2f4ac824f62 req-b11d0d91-ff74-45c3-a815-2a37570dcbba service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:39.548714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-073ad2cd-e45f-4ee0-b164-a2f4ac824f62 req-b11d0d91-ff74-45c3-a815-2a37570dcbba service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:39.562077 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-073ad2cd-e45f-4ee0-b164-a2f4ac824f62 req-b11d0d91-ff74-45c3-a815-2a37570dcbba service nova] Creating event network-changed:f4ad3620-12c4-4230-bbea-710db4e132fb for instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e on n-h2-826526-5 Jul 20 05:08:39.574506 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-073ad2cd-e45f-4ee0-b164-a2f4ac824f62 req-b11d0d91-ff74-45c3-a815-2a37570dcbba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058388 Jul 20 05:08:39.575181 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3446/7128] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:08:40.317646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-83d958d4-50fd-4794-a38f-afd9a84fde0c tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:40.318708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-83d958d4-50fd-4794-a38f-afd9a84fde0c tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:40.326182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83d958d4-50fd-4794-a38f-afd9a84fde0c tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:40.326644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83d958d4-50fd-4794-a38f-afd9a84fde0c tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:40.327406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83d958d4-50fd-4794-a38f-afd9a84fde0c tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:40.327878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83d958d4-50fd-4794-a38f-afd9a84fde0c tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:40.477100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-83d958d4-50fd-4794-a38f-afd9a84fde0c tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:40.487705 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-83d958d4-50fd-4794-a38f-afd9a84fde0c tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e" status: 200 len: 1316 microversion: 2.1 time: 0.176324 Jul 20 05:08:40.488643 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3683/7129] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:40 2022] GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:41.510547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eec3e5f1-b101-42ad-b9bc-a01b608ae986 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:41.511168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eec3e5f1-b101-42ad-b9bc-a01b608ae986 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:41.518203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eec3e5f1-b101-42ad-b9bc-a01b608ae986 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:41.518650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eec3e5f1-b101-42ad-b9bc-a01b608ae986 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:41.519429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eec3e5f1-b101-42ad-b9bc-a01b608ae986 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:41.519898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eec3e5f1-b101-42ad-b9bc-a01b608ae986 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:41.666313 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eec3e5f1-b101-42ad-b9bc-a01b608ae986 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:41.677709 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eec3e5f1-b101-42ad-b9bc-a01b608ae986 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e" status: 200 len: 1316 microversion: 2.1 time: 0.173591 Jul 20 05:08:41.678516 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3447/7130] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:41 2022] GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:42.699410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-32e2be18-558c-4c84-8c6f-b40e3ca8aa14 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:42.700001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-32e2be18-558c-4c84-8c6f-b40e3ca8aa14 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:42.707594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32e2be18-558c-4c84-8c6f-b40e3ca8aa14 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:42.708047 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32e2be18-558c-4c84-8c6f-b40e3ca8aa14 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:42.708863 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32e2be18-558c-4c84-8c6f-b40e3ca8aa14 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:42.709305 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-32e2be18-558c-4c84-8c6f-b40e3ca8aa14 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:42.847591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-32e2be18-558c-4c84-8c6f-b40e3ca8aa14 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:42.859142 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-32e2be18-558c-4c84-8c6f-b40e3ca8aa14 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e" status: 200 len: 1316 microversion: 2.1 time: 0.163627 Jul 20 05:08:42.859738 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3684/7131] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:42 2022] GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:43.884348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea35e9c9-74a3-44de-89cc-ed95ffedf70b tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:43.885025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ea35e9c9-74a3-44de-89cc-ed95ffedf70b tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:43.893134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea35e9c9-74a3-44de-89cc-ed95ffedf70b tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:43.893716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea35e9c9-74a3-44de-89cc-ed95ffedf70b tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:43.894489 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea35e9c9-74a3-44de-89cc-ed95ffedf70b tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:43.894950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea35e9c9-74a3-44de-89cc-ed95ffedf70b tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:44.039911 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ea35e9c9-74a3-44de-89cc-ed95ffedf70b tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:44.047774 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ea35e9c9-74a3-44de-89cc-ed95ffedf70b tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e" status: 200 len: 1316 microversion: 2.1 time: 0.168529 Jul 20 05:08:44.048384 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3448/7132] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:43 2022] GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:45.065061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-08948796-139c-425b-82f0-b48844e276f4 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:45.065690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-08948796-139c-425b-82f0-b48844e276f4 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:45.073424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08948796-139c-425b-82f0-b48844e276f4 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:45.073885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08948796-139c-425b-82f0-b48844e276f4 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:45.074694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08948796-139c-425b-82f0-b48844e276f4 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:45.075138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-08948796-139c-425b-82f0-b48844e276f4 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:45.182878 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-d7104eee-611f-4853-b37c-781cd36bc548 req-c930916a-e641-4623-91ab-e51ac25d789c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b153ef6-9253-48df-9d1e-dca5dd3d9e9e", "name": "network-vif-plugged", "status": "completed", "tag": "f4ad3620-12c4-4230-bbea-710db4e132fb"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:45.193044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d7104eee-611f-4853-b37c-781cd36bc548 req-c930916a-e641-4623-91ab-e51ac25d789c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:45.194048 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d7104eee-611f-4853-b37c-781cd36bc548 req-c930916a-e641-4623-91ab-e51ac25d789c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:45.210188 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-d7104eee-611f-4853-b37c-781cd36bc548 req-c930916a-e641-4623-91ab-e51ac25d789c service nova] Creating event network-vif-plugged:f4ad3620-12c4-4230-bbea-710db4e132fb for instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e on n-h2-826526-5 Jul 20 05:08:45.217133 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-d7104eee-611f-4853-b37c-781cd36bc548 req-c930916a-e641-4623-91ab-e51ac25d789c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037913 Jul 20 05:08:45.217971 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3449/7133] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:08:45.222445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-08948796-139c-425b-82f0-b48844e276f4 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:45.230581 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-08948796-139c-425b-82f0-b48844e276f4 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e" status: 200 len: 1316 microversion: 2.1 time: 0.169489 Jul 20 05:08:45.232024 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3685/7134] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:45 2022] GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:46.252129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9ea08367-a47e-4251-9495-a8e2c57310d1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:46.252946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9ea08367-a47e-4251-9495-a8e2c57310d1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:46.260518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9ea08367-a47e-4251-9495-a8e2c57310d1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:46.260986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9ea08367-a47e-4251-9495-a8e2c57310d1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:46.261750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9ea08367-a47e-4251-9495-a8e2c57310d1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:46.262226 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9ea08367-a47e-4251-9495-a8e2c57310d1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:46.408204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9ea08367-a47e-4251-9495-a8e2c57310d1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:46.415979 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9ea08367-a47e-4251-9495-a8e2c57310d1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e" status: 200 len: 1316 microversion: 2.1 time: 0.169615 Jul 20 05:08:46.416597 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3450/7135] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:46 2022] GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:47.433804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-70f5231b-ca29-4a73-8118-464ba9e64668 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:47.434400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-70f5231b-ca29-4a73-8118-464ba9e64668 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:47.437254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:47.442975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70f5231b-ca29-4a73-8118-464ba9e64668 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:47.443433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70f5231b-ca29-4a73-8118-464ba9e64668 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:47.444245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70f5231b-ca29-4a73-8118-464ba9e64668 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:47.444705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70f5231b-ca29-4a73-8118-464ba9e64668 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:47.583078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-70f5231b-ca29-4a73-8118-464ba9e64668 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:47.591214 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-70f5231b-ca29-4a73-8118-464ba9e64668 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e" status: 200 len: 1505 microversion: 2.1 time: 0.161425 Jul 20 05:08:47.591810 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3686/7136] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:47 2022] GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:47.607912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d701060d-05f8-43ed-961f-14ffb21b7cd3 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:47.608488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d701060d-05f8-43ed-961f-14ffb21b7cd3 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:47.610887 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:47.611593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:47.618918 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d701060d-05f8-43ed-961f-14ffb21b7cd3 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:47.619388 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d701060d-05f8-43ed-961f-14ffb21b7cd3 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:47.620224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d701060d-05f8-43ed-961f-14ffb21b7cd3 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:47.620739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d701060d-05f8-43ed-961f-14ffb21b7cd3 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:47.648028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d701060d-05f8-43ed-961f-14ffb21b7cd3 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:08:47.731872 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d701060d-05f8-43ed-961f-14ffb21b7cd3 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e" status: 204 len: 0 microversion: 2.1 time: 0.127616 Jul 20 05:08:47.732539 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3451/7137] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:08:47 2022] DELETE /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:08:47.740943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-66942b9f-3ff8-4f38-8346-d1db15efe1b1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:47.741601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-66942b9f-3ff8-4f38-8346-d1db15efe1b1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:47.748205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66942b9f-3ff8-4f38-8346-d1db15efe1b1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:47.748773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66942b9f-3ff8-4f38-8346-d1db15efe1b1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:47.749545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66942b9f-3ff8-4f38-8346-d1db15efe1b1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:47.750248 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-66942b9f-3ff8-4f38-8346-d1db15efe1b1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:47.890739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-66942b9f-3ff8-4f38-8346-d1db15efe1b1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:47.899476 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-66942b9f-3ff8-4f38-8346-d1db15efe1b1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e" status: 200 len: 1511 microversion: 2.1 time: 0.162444 Jul 20 05:08:47.900078 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3687/7138] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:47 2022] GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:48.918356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-840e4fc8-7345-4c43-b12f-f0f6ee785480 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:48.919063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-840e4fc8-7345-4c43-b12f-f0f6ee785480 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:48.926669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-840e4fc8-7345-4c43-b12f-f0f6ee785480 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:48.927155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-840e4fc8-7345-4c43-b12f-f0f6ee785480 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:48.927961 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-840e4fc8-7345-4c43-b12f-f0f6ee785480 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:48.928436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-840e4fc8-7345-4c43-b12f-f0f6ee785480 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:49.080341 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-840e4fc8-7345-4c43-b12f-f0f6ee785480 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:49.090994 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-840e4fc8-7345-4c43-b12f-f0f6ee785480 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e" status: 200 len: 1511 microversion: 2.1 time: 0.177035 Jul 20 05:08:49.091563 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3452/7139] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:48 2022] GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:49.710189 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-3f9192b9-ee22-4956-8ad6-57d968fa262e req-f7dc6de3-7031-4ed3-b896-709aed53fc79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b153ef6-9253-48df-9d1e-dca5dd3d9e9e", "name": "network-vif-deleted", "tag": "f4ad3620-12c4-4230-bbea-710db4e132fb"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:49.721424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3f9192b9-ee22-4956-8ad6-57d968fa262e req-f7dc6de3-7031-4ed3-b896-709aed53fc79 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:49.722549 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-3f9192b9-ee22-4956-8ad6-57d968fa262e req-f7dc6de3-7031-4ed3-b896-709aed53fc79 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:49.738089 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-3f9192b9-ee22-4956-8ad6-57d968fa262e req-f7dc6de3-7031-4ed3-b896-709aed53fc79 service nova] Creating event network-vif-deleted:f4ad3620-12c4-4230-bbea-710db4e132fb for instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e on n-h2-826526-5 Jul 20 05:08:49.745269 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-3f9192b9-ee22-4956-8ad6-57d968fa262e req-f7dc6de3-7031-4ed3-b896-709aed53fc79 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040821 Jul 20 05:08:49.747562 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3688/7140] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:08:50.111940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3d8a883e-c220-479d-ac17-33ea4e69f1f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:50.112705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3d8a883e-c220-479d-ac17-33ea4e69f1f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:50.121804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d8a883e-c220-479d-ac17-33ea4e69f1f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:50.122262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d8a883e-c220-479d-ac17-33ea4e69f1f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:50.123050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d8a883e-c220-479d-ac17-33ea4e69f1f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:50.123520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d8a883e-c220-479d-ac17-33ea4e69f1f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:50.160193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d8a883e-c220-479d-ac17-33ea4e69f1f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:50.160705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d8a883e-c220-479d-ac17-33ea4e69f1f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:50.161166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-3d8a883e-c220-479d-ac17-33ea4e69f1f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lazy-loading 'fault' on Instance uuid 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:08:50.206552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3d8a883e-c220-479d-ac17-33ea4e69f1f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:50.213954 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3d8a883e-c220-479d-ac17-33ea4e69f1f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e" status: 200 len: 1306 microversion: 2.1 time: 0.107377 Jul 20 05:08:50.214528 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3453/7141] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:50 2022] GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e => generated 1306 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:51.233121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-56100275-545c-4b30-b0a5-04336fc28b79 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:51.233799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-56100275-545c-4b30-b0a5-04336fc28b79 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:51.242323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56100275-545c-4b30-b0a5-04336fc28b79 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:51.242811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56100275-545c-4b30-b0a5-04336fc28b79 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:51.243692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56100275-545c-4b30-b0a5-04336fc28b79 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:51.244187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-56100275-545c-4b30-b0a5-04336fc28b79 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:51.260946 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-56100275-545c-4b30-b0a5-04336fc28b79 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] HTTP exception thrown: Instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e could not be found. Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-56100275-545c-4b30-b0a5-04336fc28b79 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Request method failure captured: Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e HTTP/1.1 Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi143HDvk2L3JsMg3UkMr4xL0AhMJxUgkBEtSMtHHrBZfcvV6p6fIk1kE5503u3UtWZJFqn5FqdtaOyfOBbsGo9jtdGUrMs4goHICnog2J9rxwcRx4wJZMmjqk2QE_rxVfbKQgi-KlmyXE-o0uJyV3t-Qg7vbGEQtevBnnU1n5oV8JIiw Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: eb82e748c26647f0a65e411660159a39 Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb82e748c26647f0a65e411660159a39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb82e748c26647f0a65e411660159a39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb82e748c26647f0a65e411660159a39", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb82e748c26647f0a65e411660159a39"}]}] Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: eb82e748c26647f0a65e411660159a39 Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1054196334-project Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c7f400eda70b4d5988617eebe12b4aaa Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1054196334-project Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e could not be found. Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '8b153ef6-9253-48df-9d1e-dca5dd3d9e9e'} Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e could not be found. Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e could not be found. Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:51.262623 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:51.266917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:51.266917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:51.266917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:51.266917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:51.266917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:51.266917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e could not be found. Jul 20 05:08:51.266917 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:51.266917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-56100275-545c-4b30-b0a5-04336fc28b79 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Returning 404 to user: Instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:51.266917 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-56100275-545c-4b30-b0a5-04336fc28b79 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e" status: 404 len: 111 microversion: 2.1 time: 0.036343 Jul 20 05:08:51.266917 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3689/7142] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:51 2022] GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:08:51.275691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1f7da3a5-7a4b-4f84-b54b-01073afe230f tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:51.276520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1f7da3a5-7a4b-4f84-b54b-01073afe230f tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:51.287420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f7da3a5-7a4b-4f84-b54b-01073afe230f tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:51.288283 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f7da3a5-7a4b-4f84-b54b-01073afe230f tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:51.289081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f7da3a5-7a4b-4f84-b54b-01073afe230f tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:51.289540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f7da3a5-7a4b-4f84-b54b-01073afe230f tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:51.437896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1f7da3a5-7a4b-4f84-b54b-01073afe230f tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:51.448394 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1f7da3a5-7a4b-4f84-b54b-01073afe230f tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 200 len: 1506 microversion: 2.1 time: 0.178172 Jul 20 05:08:51.449073 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3454/7143] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:51 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:51.465737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2fdf05ab-8ca0-4a5e-b019-8ab2c08c02e7 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:51.466729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2fdf05ab-8ca0-4a5e-b019-8ab2c08c02e7 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 32722c28-5fc6-4904-b98a-c1c2b5225de0] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:51.472413 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-2fdf05ab-8ca0-4a5e-b019-8ab2c08c02e7 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] HTTP exception thrown: Instance 32722c28-5fc6-4904-b98a-c1c2b5225de0 could not be found. Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2fdf05ab-8ca0-4a5e-b019-8ab2c08c02e7 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Request method failure captured: Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/32722c28-5fc6-4904-b98a-c1c2b5225de0/action HTTP/1.1 Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 32 Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi143HDvk2L3JsMg3UkMr4xL0AhMJxUgkBEtSMtHHrBZfcvV6p6fIk1kE5503u3UtWZJFqn5FqdtaOyfOBbsGo9jtdGUrMs4goHICnog2J9rxwcRx4wJZMmjqk2QE_rxVfbKQgi-KlmyXE-o0uJyV3t-Qg7vbGEQtevBnnU1n5oV8JIiw Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: eb82e748c26647f0a65e411660159a39 Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb82e748c26647f0a65e411660159a39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb82e748c26647f0a65e411660159a39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb82e748c26647f0a65e411660159a39", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb82e748c26647f0a65e411660159a39"}]}] Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: eb82e748c26647f0a65e411660159a39 Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1054196334-project Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c7f400eda70b4d5988617eebe12b4aaa Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1054196334-project Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: {"resize": {"flavorRef": "452"}} Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 32722c28-5fc6-4904-b98a-c1c2b5225de0 could not be found. Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '32722c28-5fc6-4904-b98a-c1c2b5225de0', 'body': {'resize': {'flavorRef': '452'}}} Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32722c28-5fc6-4904-b98a-c1c2b5225de0 could not be found. Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:08:51.474001 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:08:51.478693 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32722c28-5fc6-4904-b98a-c1c2b5225de0 could not be found. Jul 20 05:08:51.478693 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:51.478693 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:51.478693 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:51.478693 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:51.478693 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:51.478693 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:51.478693 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:51.478693 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:51.478693 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32722c28-5fc6-4904-b98a-c1c2b5225de0 could not be found. Jul 20 05:08:51.478693 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:51.478693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2fdf05ab-8ca0-4a5e-b019-8ab2c08c02e7 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Returning 404 to user: Instance 32722c28-5fc6-4904-b98a-c1c2b5225de0 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:51.478693 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2fdf05ab-8ca0-4a5e-b019-8ab2c08c02e7 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "POST /compute/v2.1/servers/32722c28-5fc6-4904-b98a-c1c2b5225de0/action" status: 404 len: 111 microversion: 2.1 time: 0.013928 Jul 20 05:08:51.478693 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3690/7144] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:08:51 2022] POST /compute/v2.1/servers/32722c28-5fc6-4904-b98a-c1c2b5225de0/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:08:51.484608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fe62c284-4602-442a-87fe-492f19b6aa58 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:51.485242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fe62c284-4602-442a-87fe-492f19b6aa58 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:51.491912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe62c284-4602-442a-87fe-492f19b6aa58 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:51.492420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe62c284-4602-442a-87fe-492f19b6aa58 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:51.493178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe62c284-4602-442a-87fe-492f19b6aa58 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:51.493653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe62c284-4602-442a-87fe-492f19b6aa58 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:51.512705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:51.628850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fe62c284-4602-442a-87fe-492f19b6aa58 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:51.637175 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fe62c284-4602-442a-87fe-492f19b6aa58 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 200 len: 1506 microversion: 2.1 time: 0.156638 Jul 20 05:08:51.637749 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3455/7145] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:51 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:51.654439 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a5480a72-ae4e-4232-9f9b-4cb53d634b28 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:51.655074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a5480a72-ae4e-4232-9f9b-4cb53d634b28 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:51.662619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5480a72-ae4e-4232-9f9b-4cb53d634b28 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:51.663072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5480a72-ae4e-4232-9f9b-4cb53d634b28 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:51.663847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5480a72-ae4e-4232-9f9b-4cb53d634b28 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:51.664289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a5480a72-ae4e-4232-9f9b-4cb53d634b28 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:51.807186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a5480a72-ae4e-4232-9f9b-4cb53d634b28 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:51.819024 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a5480a72-ae4e-4232-9f9b-4cb53d634b28 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 200 len: 1506 microversion: 2.1 time: 0.168327 Jul 20 05:08:51.819813 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3691/7146] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:51 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:51.837739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6b506d37-bfbb-4e95-a0d1-6ceb59088239 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "d4543f85-ec39-4575-99f2-dfff2eb5f56f"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:51.838752 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6b506d37-bfbb-4e95-a0d1-6ceb59088239 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:51.845634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b506d37-bfbb-4e95-a0d1-6ceb59088239 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:51.846100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b506d37-bfbb-4e95-a0d1-6ceb59088239 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:51.846893 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b506d37-bfbb-4e95-a0d1-6ceb59088239 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:51.847340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b506d37-bfbb-4e95-a0d1-6ceb59088239 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:51.878068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6b506d37-bfbb-4e95-a0d1-6ceb59088239 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:51.884102 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-6b506d37-bfbb-4e95-a0d1-6ceb59088239 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] HTTP exception thrown: Flavor d4543f85-ec39-4575-99f2-dfff2eb5f56f could not be found. Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6b506d37-bfbb-4e95-a0d1-6ceb59088239 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Request method failure captured: Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e/action HTTP/1.1 Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 65 Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi143HDvk2L3JsMg3UkMr4xL0AhMJxUgkBEtSMtHHrBZfcvV6p6fIk1kE5503u3UtWZJFqn5FqdtaOyfOBbsGo9jtdGUrMs4goHICnog2J9rxwcRx4wJZMmjqk2QE_rxVfbKQgi-KlmyXE-o0uJyV3t-Qg7vbGEQtevBnnU1n5oV8JIiw Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: eb82e748c26647f0a65e411660159a39 Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb82e748c26647f0a65e411660159a39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb82e748c26647f0a65e411660159a39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb82e748c26647f0a65e411660159a39", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb82e748c26647f0a65e411660159a39"}]}] Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: eb82e748c26647f0a65e411660159a39 Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1054196334-project Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: c7f400eda70b4d5988617eebe12b4aaa Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1054196334-project Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: {"resize": {"flavorRef": "d4543f85-ec39-4575-99f2-dfff2eb5f56f"}} Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: exception: Flavor d4543f85-ec39-4575-99f2-dfff2eb5f56f could not be found. Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '701cc382-e22f-4613-9ca8-0331f38b1b3e', 'body': {'resize': {'flavorRef': 'd4543f85-ec39-4575-99f2-dfff2eb5f56f'}}} Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 05:08:51.886127 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d4543f85-ec39-4575-99f2-dfff2eb5f56f could not be found. Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor d4543f85-ec39-4575-99f2-dfff2eb5f56f could not be found. Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d4543f85-ec39-4575-99f2-dfff2eb5f56f could not be found. Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6b506d37-bfbb-4e95-a0d1-6ceb59088239 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Returning 400 to user: Flavor d4543f85-ec39-4575-99f2-dfff2eb5f56f could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6b506d37-bfbb-4e95-a0d1-6ceb59088239 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "POST /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e/action" status: 400 len: 107 microversion: 2.1 time: 0.054910 Jul 20 05:08:51.890551 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3456/7147] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:08:51 2022] POST /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e/action => generated 107 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 05:08:51.897376 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a116ca3f-7485-42cf-857d-eafa1ede1864 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:51.898165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a116ca3f-7485-42cf-857d-eafa1ede1864 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:51.904681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a116ca3f-7485-42cf-857d-eafa1ede1864 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:51.905157 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a116ca3f-7485-42cf-857d-eafa1ede1864 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:51.905964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a116ca3f-7485-42cf-857d-eafa1ede1864 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:51.906407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a116ca3f-7485-42cf-857d-eafa1ede1864 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:52.056392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a116ca3f-7485-42cf-857d-eafa1ede1864 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:52.065454 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a116ca3f-7485-42cf-857d-eafa1ede1864 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 200 len: 1506 microversion: 2.1 time: 0.171961 Jul 20 05:08:52.065454 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3692/7148] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:51 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:52.082931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d9d9c557-ef7e-49d6-ada5-90a83b31a283 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:52.083549 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d9d9c557-ef7e-49d6-ada5-90a83b31a283 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:52.090348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9d9c557-ef7e-49d6-ada5-90a83b31a283 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:52.090802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9d9c557-ef7e-49d6-ada5-90a83b31a283 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:52.091599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9d9c557-ef7e-49d6-ada5-90a83b31a283 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:52.092045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9d9c557-ef7e-49d6-ada5-90a83b31a283 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:52.244811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d9d9c557-ef7e-49d6-ada5-90a83b31a283 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:52.253269 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d9d9c557-ef7e-49d6-ada5-90a83b31a283 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 200 len: 1506 microversion: 2.1 time: 0.174231 Jul 20 05:08:52.253875 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3457/7149] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:52 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:52.274767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-45934b6e-7a4f-449f-8471-e935fb6e065d tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-45934b6e-7a4f-449f-8471-e935fb6e065d tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Request method failure captured: Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: request: POST /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e/action HTTP/1.1 Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 29 Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi143HDvk2L3JsMg3UkMr4xL0AhMJxUgkBEtSMtHHrBZfcvV6p6fIk1kE5503u3UtWZJFqn5FqdtaOyfOBbsGo9jtdGUrMs4goHICnog2J9rxwcRx4wJZMmjqk2QE_rxVfbKQgi-KlmyXE-o0uJyV3t-Qg7vbGEQtevBnnU1n5oV8JIiw Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: eb82e748c26647f0a65e411660159a39 Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb82e748c26647f0a65e411660159a39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb82e748c26647f0a65e411660159a39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb82e748c26647f0a65e411660159a39", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb82e748c26647f0a65e411660159a39"}]}] Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: eb82e748c26647f0a65e411660159a39 Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1054196334-project Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c7f400eda70b4d5988617eebe12b4aaa Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1054196334-project Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: {"resize": {"flavorRef": ""}} Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '701cc382-e22f-4613-9ca8-0331f38b1b3e', 'body': {'resize': {'flavorRef': ''}}} Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise error Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi '' Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:52.278169 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:52.285201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:52.285201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:52.285201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:52.285201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:52.285201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 05:08:52.285201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 05:08:52.285201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 20 05:08:52.285201 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:52.285201 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-45934b6e-7a4f-449f-8471-e935fb6e065d tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:52.285201 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-45934b6e-7a4f-449f-8471-e935fb6e065d tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "POST /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e/action" status: 400 len: 113 microversion: 2.1 time: 0.010849 Jul 20 05:08:52.285201 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3693/7150] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:08:52 2022] POST /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e/action => generated 113 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 05:08:52.289036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6e432f4f-e4c7-4681-945b-a012aec58aa8 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:52.289656 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6e432f4f-e4c7-4681-945b-a012aec58aa8 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:52.298366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e432f4f-e4c7-4681-945b-a012aec58aa8 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:52.298800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e432f4f-e4c7-4681-945b-a012aec58aa8 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:52.299608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e432f4f-e4c7-4681-945b-a012aec58aa8 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:52.300034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e432f4f-e4c7-4681-945b-a012aec58aa8 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:52.453657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6e432f4f-e4c7-4681-945b-a012aec58aa8 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:52.464250 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6e432f4f-e4c7-4681-945b-a012aec58aa8 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 200 len: 1506 microversion: 2.1 time: 0.179624 Jul 20 05:08:52.464888 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3458/7151] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:52 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:52.494297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5ccc804a-ff34-4391-bdc1-82c0ee5e90f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:52.494788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5ccc804a-ff34-4391-bdc1-82c0ee5e90f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:52.502505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ccc804a-ff34-4391-bdc1-82c0ee5e90f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:52.502874 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ccc804a-ff34-4391-bdc1-82c0ee5e90f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:52.504027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ccc804a-ff34-4391-bdc1-82c0ee5e90f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:52.504503 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5ccc804a-ff34-4391-bdc1-82c0ee5e90f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:52.519043 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-5ccc804a-ff34-4391-bdc1-82c0ee5e90f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] HTTP exception thrown: Instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e could not be found. Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5ccc804a-ff34-4391-bdc1-82c0ee5e90f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Request method failure captured: Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e HTTP/1.1 Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi143HDvk2L3JsMg3UkMr4xL0AhMJxUgkBEtSMtHHrBZfcvV6p6fIk1kE5503u3UtWZJFqn5FqdtaOyfOBbsGo9jtdGUrMs4goHICnog2J9rxwcRx4wJZMmjqk2QE_rxVfbKQgi-KlmyXE-o0uJyV3t-Qg7vbGEQtevBnnU1n5oV8JIiw Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: eb82e748c26647f0a65e411660159a39 Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb82e748c26647f0a65e411660159a39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb82e748c26647f0a65e411660159a39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb82e748c26647f0a65e411660159a39", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb82e748c26647f0a65e411660159a39"}]}] Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: eb82e748c26647f0a65e411660159a39 Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1054196334-project Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c7f400eda70b4d5988617eebe12b4aaa Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1054196334-project Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e could not be found. Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '8b153ef6-9253-48df-9d1e-dca5dd3d9e9e'} Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e could not be found. Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:08:52.520824 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:08:52.524834 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e could not be found. Jul 20 05:08:52.524834 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:52.524834 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:52.524834 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:52.524834 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:52.524834 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:52.524834 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:52.524834 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:52.524834 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:52.524834 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e could not be found. Jul 20 05:08:52.524834 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:52.524834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5ccc804a-ff34-4391-bdc1-82c0ee5e90f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Returning 404 to user: Instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:52.524834 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5ccc804a-ff34-4391-bdc1-82c0ee5e90f5 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e" status: 404 len: 111 microversion: 2.1 time: 0.033316 Jul 20 05:08:52.524834 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3694/7152] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:08:52 2022] DELETE /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:08:52.531405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9963c458-ba26-46ca-a394-ee936338ba7e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:52.532034 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9963c458-ba26-46ca-a394-ee936338ba7e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:52.538742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9963c458-ba26-46ca-a394-ee936338ba7e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:52.539201 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9963c458-ba26-46ca-a394-ee936338ba7e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:52.539989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9963c458-ba26-46ca-a394-ee936338ba7e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:52.540473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9963c458-ba26-46ca-a394-ee936338ba7e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:52.556704 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-9963c458-ba26-46ca-a394-ee936338ba7e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] HTTP exception thrown: Instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e could not be found. Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9963c458-ba26-46ca-a394-ee936338ba7e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Request method failure captured: Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e HTTP/1.1 Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi143HDvk2L3JsMg3UkMr4xL0AhMJxUgkBEtSMtHHrBZfcvV6p6fIk1kE5503u3UtWZJFqn5FqdtaOyfOBbsGo9jtdGUrMs4goHICnog2J9rxwcRx4wJZMmjqk2QE_rxVfbKQgi-KlmyXE-o0uJyV3t-Qg7vbGEQtevBnnU1n5oV8JIiw Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: eb82e748c26647f0a65e411660159a39 Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb82e748c26647f0a65e411660159a39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb82e748c26647f0a65e411660159a39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb82e748c26647f0a65e411660159a39", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb82e748c26647f0a65e411660159a39"}]}] Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: eb82e748c26647f0a65e411660159a39 Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-ServersNegativeTestJSON-1054196334-project Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: c7f400eda70b4d5988617eebe12b4aaa Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-ServersNegativeTestJSON-1054196334-project Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e could not be found. Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '8b153ef6-9253-48df-9d1e-dca5dd3d9e9e'} Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e could not be found. Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e could not be found. Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:52.558904 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:52.566145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:52.566145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:52.566145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:52.566145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:52.566145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:52.566145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e could not be found. Jul 20 05:08:52.566145 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:08:52.566145 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9963c458-ba26-46ca-a394-ee936338ba7e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Returning 404 to user: Instance 8b153ef6-9253-48df-9d1e-dca5dd3d9e9e could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:52.566145 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9963c458-ba26-46ca-a394-ee936338ba7e tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e" status: 404 len: 111 microversion: 2.1 time: 0.033002 Jul 20 05:08:52.566145 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3459/7153] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:52 2022] GET /compute/v2.1/servers/8b153ef6-9253-48df-9d1e-dca5dd3d9e9e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:08:52.574519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7d78129e-05a3-486a-bceb-0878052ca1a1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:52.574721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7d78129e-05a3-486a-bceb-0878052ca1a1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:52.581808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d78129e-05a3-486a-bceb-0878052ca1a1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:52.582452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d78129e-05a3-486a-bceb-0878052ca1a1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:52.583634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d78129e-05a3-486a-bceb-0878052ca1a1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:52.584312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7d78129e-05a3-486a-bceb-0878052ca1a1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:52.611494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7d78129e-05a3-486a-bceb-0878052ca1a1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:08:52.669517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:52.705242 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7d78129e-05a3-486a-bceb-0878052ca1a1 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "DELETE /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 204 len: 0 microversion: 2.1 time: 0.135144 Jul 20 05:08:52.706400 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3695/7154] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:08:52 2022] DELETE /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:08:52.714927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d9813f4f-5499-4be1-9b6f-6edc73707a7d tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:52.715551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d9813f4f-5499-4be1-9b6f-6edc73707a7d tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:52.722821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9813f4f-5499-4be1-9b6f-6edc73707a7d tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:52.722821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9813f4f-5499-4be1-9b6f-6edc73707a7d tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:52.723947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9813f4f-5499-4be1-9b6f-6edc73707a7d tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:52.724090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9813f4f-5499-4be1-9b6f-6edc73707a7d tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:52.867403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d9813f4f-5499-4be1-9b6f-6edc73707a7d tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:52.876365 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d9813f4f-5499-4be1-9b6f-6edc73707a7d tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 200 len: 1512 microversion: 2.1 time: 0.165326 Jul 20 05:08:52.876930 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3460/7155] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:52 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:53.896100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-26aac47c-5e6f-4a46-9ba1-769f5e8f0123 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:53.896821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-26aac47c-5e6f-4a46-9ba1-769f5e8f0123 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:53.904298 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26aac47c-5e6f-4a46-9ba1-769f5e8f0123 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:53.904785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26aac47c-5e6f-4a46-9ba1-769f5e8f0123 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:53.905561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26aac47c-5e6f-4a46-9ba1-769f5e8f0123 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:53.906113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-26aac47c-5e6f-4a46-9ba1-769f5e8f0123 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:54.041962 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-26aac47c-5e6f-4a46-9ba1-769f5e8f0123 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f400eda70b4d5988617eebe12b4aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82e748c26647f0a65e411660159a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:54.050259 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-26aac47c-5e6f-4a46-9ba1-769f5e8f0123 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 200 len: 1512 microversion: 2.1 time: 0.158590 Jul 20 05:08:54.050887 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3696/7156] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:53 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:54.519594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-40881d33-09df-4d5f-b919-6dbe5b81a5c1 req-e5a9a40b-953d-4c89-8dbf-dec7a0a02b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701cc382-e22f-4613-9ca8-0331f38b1b3e", "name": "network-vif-deleted", "tag": "98cd3a83-abfb-4aeb-b1e0-cb9ad702caa2"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:54.535728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-40881d33-09df-4d5f-b919-6dbe5b81a5c1 req-e5a9a40b-953d-4c89-8dbf-dec7a0a02b79 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:54.536186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-40881d33-09df-4d5f-b919-6dbe5b81a5c1 req-e5a9a40b-953d-4c89-8dbf-dec7a0a02b79 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:54.548641 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-40881d33-09df-4d5f-b919-6dbe5b81a5c1 req-e5a9a40b-953d-4c89-8dbf-dec7a0a02b79 service nova] Creating event network-vif-deleted:98cd3a83-abfb-4aeb-b1e0-cb9ad702caa2 for instance 701cc382-e22f-4613-9ca8-0331f38b1b3e on n-h1-826526-5 Jul 20 05:08:54.555115 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-40881d33-09df-4d5f-b919-6dbe5b81a5c1 req-e5a9a40b-953d-4c89-8dbf-dec7a0a02b79 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038896 Jul 20 05:08:54.555912 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3461/7157] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:08:55.069297 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2743aaf4-9046-4df0-bd47-399c9bc499f6 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:55.070377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2743aaf4-9046-4df0-bd47-399c9bc499f6 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] [instance: 701cc382-e22f-4613-9ca8-0331f38b1b3e] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:55.073434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:55.079572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2743aaf4-9046-4df0-bd47-399c9bc499f6 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:55.080024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2743aaf4-9046-4df0-bd47-399c9bc499f6 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:55.080846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2743aaf4-9046-4df0-bd47-399c9bc499f6 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:55.081289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2743aaf4-9046-4df0-bd47-399c9bc499f6 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:55.096872 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-2743aaf4-9046-4df0-bd47-399c9bc499f6 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] HTTP exception thrown: Instance 701cc382-e22f-4613-9ca8-0331f38b1b3e could not be found. Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2743aaf4-9046-4df0-bd47-399c9bc499f6 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Request method failure captured: Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e HTTP/1.1 Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi143HDvk2L3JsMg3UkMr4xL0AhMJxUgkBEtSMtHHrBZfcvV6p6fIk1kE5503u3UtWZJFqn5FqdtaOyfOBbsGo9jtdGUrMs4goHICnog2J9rxwcRx4wJZMmjqk2QE_rxVfbKQgi-KlmyXE-o0uJyV3t-Qg7vbGEQtevBnnU1n5oV8JIiw Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: eb82e748c26647f0a65e411660159a39 Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb82e748c26647f0a65e411660159a39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb82e748c26647f0a65e411660159a39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb82e748c26647f0a65e411660159a39", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb82e748c26647f0a65e411660159a39"}]}] Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: eb82e748c26647f0a65e411660159a39 Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1054196334 Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-ServersNegativeTestJSON-1054196334-project Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: c7f400eda70b4d5988617eebe12b4aaa Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-ServersNegativeTestJSON-1054196334-project Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 701cc382-e22f-4613-9ca8-0331f38b1b3e could not be found. Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '701cc382-e22f-4613-9ca8-0331f38b1b3e'} Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 701cc382-e22f-4613-9ca8-0331f38b1b3e could not be found. Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 701cc382-e22f-4613-9ca8-0331f38b1b3e could not be found. Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:55.098587 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:55.103067 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:55.103067 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:55.103067 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:55.103067 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:55.103067 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:55.103067 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 701cc382-e22f-4613-9ca8-0331f38b1b3e could not be found. Jul 20 05:08:55.103067 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:08:55.103067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2743aaf4-9046-4df0-bd47-399c9bc499f6 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] Returning 404 to user: Instance 701cc382-e22f-4613-9ca8-0331f38b1b3e could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:55.103067 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2743aaf4-9046-4df0-bd47-399c9bc499f6 tempest-ServersNegativeTestJSON-1054196334 tempest-ServersNegativeTestJSON-1054196334-project] 10.222.0.17 "GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e" status: 404 len: 111 microversion: 2.1 time: 0.035705 Jul 20 05:08:55.103067 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3697/7158] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:55 2022] GET /compute/v2.1/servers/701cc382-e22f-4613-9ca8-0331f38b1b3e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:09:01.693963 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:09:01.694640 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:09:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:09:30.585989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:30.587658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=28 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:30.819514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8ad32a73-a000-4926-8753-dce25ff5bcf9 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Action: 'create', calling method: .version_select at 0x7f06c73b3430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1630249204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/xHILyXVe4D4LOsOj/EAXxfBn8YcgRTuGptQnjpls4gKPTrIu7h/uc2ZeYeL6e+nUaUFRoVl8eI2Cnnv9A3D9ryJkTYSGPP7yWSG2WfpB8nXenk0YwVXHYJaoh7EhwIA=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:30.841098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8ad32a73-a000-4926-8753-dce25ff5bcf9 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Getting quotas for project a7c18a1a84804563b7be3b6eb8832563. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:09:30.846996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-8ad32a73-a000-4926-8753-dce25ff5bcf9 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Getting quotas for user 8b693e0429394d2d9f748ccb96123672 and project a7c18a1a84804563b7be3b6eb8832563. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:09:30.876203 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8ad32a73-a000-4926-8753-dce25ff5bcf9 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.293303 Jul 20 05:09:30.876915 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3462/7159] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 05:09:30 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:30.932043 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-38358531-de75-4546-8605-10a80f0f6089 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1260404632", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1630249204", "networks": [{"uuid": "e2065d26-08d0-4f13-a679-324f6e01b64d"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:30.939277 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=8 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:30.939926 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:30.986662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-38358531-de75-4546-8605-10a80f0f6089 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] validate_networks() for [('e2065d26-08d0-4f13-a679-324f6e01b64d', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:09:31.396448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-38358531-de75-4546-8605-10a80f0f6089 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:09:31.396994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-38358531-de75-4546-8605-10a80f0f6089 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:09:31.397656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-38358531-de75-4546-8605-10a80f0f6089 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:09:31.398064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-38358531-de75-4546-8605-10a80f0f6089 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:09:31.398473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-38358531-de75-4546-8605-10a80f0f6089 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:09:31.407944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38358531-de75-4546-8605-10a80f0f6089 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:31.408429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38358531-de75-4546-8605-10a80f0f6089 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:31.409251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38358531-de75-4546-8605-10a80f0f6089 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:31.409687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-38358531-de75-4546-8605-10a80f0f6089 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:31.427082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-38358531-de75-4546-8605-10a80f0f6089 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Getting quotas for project a7c18a1a84804563b7be3b6eb8832563. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:09:31.432836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-38358531-de75-4546-8605-10a80f0f6089 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Getting quotas for user 8b693e0429394d2d9f748ccb96123672 and project a7c18a1a84804563b7be3b6eb8832563. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:09:31.445983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-38358531-de75-4546-8605-10a80f0f6089 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:09:31.448375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-38358531-de75-4546-8605-10a80f0f6089 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:09:31.500124 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-38358531-de75-4546-8605-10a80f0f6089 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572423 Jul 20 05:09:31.500815 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3698/7160] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:09:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:09:31.511403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-078ab1d8-f7ce-4b8f-b568-c9af453dd950 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:31.512237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-078ab1d8-f7ce-4b8f-b568-c9af453dd950 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:31.577284 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-078ab1d8-f7ce-4b8f-b568-c9af453dd950 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:31.585841 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-078ab1d8-f7ce-4b8f-b568-c9af453dd950 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5" status: 200 len: 1263 microversion: 2.1 time: 0.078487 Jul 20 05:09:31.586716 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3463/7161] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:31 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5 => generated 1263 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:32.603849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dffda782-19b6-4321-8eae-15bde1eb980d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:32.605474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dffda782-19b6-4321-8eae-15bde1eb980d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:32.622226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dffda782-19b6-4321-8eae-15bde1eb980d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:32.623029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dffda782-19b6-4321-8eae-15bde1eb980d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:32.624038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dffda782-19b6-4321-8eae-15bde1eb980d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:32.624711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dffda782-19b6-4321-8eae-15bde1eb980d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:32.750989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dffda782-19b6-4321-8eae-15bde1eb980d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:32.763651 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dffda782-19b6-4321-8eae-15bde1eb980d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5" status: 200 len: 1315 microversion: 2.1 time: 0.161875 Jul 20 05:09:32.763651 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3699/7162] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:32 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:33.783032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-90175e3b-a505-48e3-ba47-49f6b787bd9a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:33.784702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-90175e3b-a505-48e3-ba47-49f6b787bd9a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:33.792253 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90175e3b-a505-48e3-ba47-49f6b787bd9a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:33.792880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90175e3b-a505-48e3-ba47-49f6b787bd9a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:33.794688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90175e3b-a505-48e3-ba47-49f6b787bd9a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:33.795284 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90175e3b-a505-48e3-ba47-49f6b787bd9a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:33.982767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-90175e3b-a505-48e3-ba47-49f6b787bd9a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:33.994656 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-90175e3b-a505-48e3-ba47-49f6b787bd9a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5" status: 200 len: 1363 microversion: 2.1 time: 0.218298 Jul 20 05:09:34.009587 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3464/7163] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:33 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:34.792537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-878a360f-f530-4c53-baf8-2446f6b9bebc req-c1da3ff5-81f9-4b07-bd2e-6925ba54ed8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85040fcb-0040-428c-820f-7f61f23005e5", "tag": "38b94bca-5859-4395-9f24-59bb1e678142"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:34.801687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-878a360f-f530-4c53-baf8-2446f6b9bebc req-c1da3ff5-81f9-4b07-bd2e-6925ba54ed8d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:34.802124 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-878a360f-f530-4c53-baf8-2446f6b9bebc req-c1da3ff5-81f9-4b07-bd2e-6925ba54ed8d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:34.815145 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-878a360f-f530-4c53-baf8-2446f6b9bebc req-c1da3ff5-81f9-4b07-bd2e-6925ba54ed8d service nova] Creating event network-changed:38b94bca-5859-4395-9f24-59bb1e678142 for instance 85040fcb-0040-428c-820f-7f61f23005e5 on n-h2-826526-5 Jul 20 05:09:34.821135 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-878a360f-f530-4c53-baf8-2446f6b9bebc req-c1da3ff5-81f9-4b07-bd2e-6925ba54ed8d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098094 Jul 20 05:09:34.822322 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3700/7164] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:35.018251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f38c58a5-848f-4510-883d-a5a6c2337709 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:35.018874 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f38c58a5-848f-4510-883d-a5a6c2337709 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:35.026856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f38c58a5-848f-4510-883d-a5a6c2337709 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:35.027680 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f38c58a5-848f-4510-883d-a5a6c2337709 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:35.028642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f38c58a5-848f-4510-883d-a5a6c2337709 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:35.029085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f38c58a5-848f-4510-883d-a5a6c2337709 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:35.174902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f38c58a5-848f-4510-883d-a5a6c2337709 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:35.184845 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f38c58a5-848f-4510-883d-a5a6c2337709 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5" status: 200 len: 1363 microversion: 2.1 time: 0.170997 Jul 20 05:09:35.185716 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3465/7165] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:35 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:36.207828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-82d6476a-c152-4eca-8ef3-62975f82c367 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:36.208576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-82d6476a-c152-4eca-8ef3-62975f82c367 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:36.215887 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82d6476a-c152-4eca-8ef3-62975f82c367 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:36.216373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82d6476a-c152-4eca-8ef3-62975f82c367 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:36.217206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82d6476a-c152-4eca-8ef3-62975f82c367 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:36.217790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-82d6476a-c152-4eca-8ef3-62975f82c367 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:36.470408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-82d6476a-c152-4eca-8ef3-62975f82c367 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:36.479033 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-82d6476a-c152-4eca-8ef3-62975f82c367 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5" status: 200 len: 1363 microversion: 2.1 time: 0.276725 Jul 20 05:09:36.479731 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3701/7166] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:36 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5 => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:37.497269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a7e4a994-6690-4f5a-a519-e7afd21d35ec tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:37.497894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a7e4a994-6690-4f5a-a519-e7afd21d35ec tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:37.505602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7e4a994-6690-4f5a-a519-e7afd21d35ec tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:37.506075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7e4a994-6690-4f5a-a519-e7afd21d35ec tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:37.506859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7e4a994-6690-4f5a-a519-e7afd21d35ec tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:37.507306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a7e4a994-6690-4f5a-a519-e7afd21d35ec tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:37.661140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a7e4a994-6690-4f5a-a519-e7afd21d35ec tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:37.669456 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a7e4a994-6690-4f5a-a519-e7afd21d35ec tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5" status: 200 len: 1363 microversion: 2.1 time: 0.176156 Jul 20 05:09:37.670398 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3466/7167] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:37 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:38.686829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a3d11eba-2376-4e22-a953-d5db609eb618 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:38.687433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a3d11eba-2376-4e22-a953-d5db609eb618 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:38.695220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a3d11eba-2376-4e22-a953-d5db609eb618 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:38.695659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a3d11eba-2376-4e22-a953-d5db609eb618 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:38.696514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a3d11eba-2376-4e22-a953-d5db609eb618 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:38.696956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a3d11eba-2376-4e22-a953-d5db609eb618 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:38.856697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a3d11eba-2376-4e22-a953-d5db609eb618 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:38.866511 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a3d11eba-2376-4e22-a953-d5db609eb618 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5" status: 200 len: 1363 microversion: 2.1 time: 0.183610 Jul 20 05:09:38.867111 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3702/7168] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:38 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:39.369045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f704c52b-f9de-4e5d-873b-de55cb6dccd0 req-ab3b52fd-b299-462b-b851-410a6eb0eb6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85040fcb-0040-428c-820f-7f61f23005e5", "name": "network-vif-plugged", "status": "completed", "tag": "38b94bca-5859-4395-9f24-59bb1e678142"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:39.378469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f704c52b-f9de-4e5d-873b-de55cb6dccd0 req-ab3b52fd-b299-462b-b851-410a6eb0eb6a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:39.378928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f704c52b-f9de-4e5d-873b-de55cb6dccd0 req-ab3b52fd-b299-462b-b851-410a6eb0eb6a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:39.391452 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f704c52b-f9de-4e5d-873b-de55cb6dccd0 req-ab3b52fd-b299-462b-b851-410a6eb0eb6a service nova] Creating event network-vif-plugged:38b94bca-5859-4395-9f24-59bb1e678142 for instance 85040fcb-0040-428c-820f-7f61f23005e5 on n-h2-826526-5 Jul 20 05:09:39.396808 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f704c52b-f9de-4e5d-873b-de55cb6dccd0 req-ab3b52fd-b299-462b-b851-410a6eb0eb6a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031754 Jul 20 05:09:39.397469 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3467/7169] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:39.884595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cf77eb9a-8d28-4aa2-8465-4b1eaae8dca5 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:39.885243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cf77eb9a-8d28-4aa2-8465-4b1eaae8dca5 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:39.894008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf77eb9a-8d28-4aa2-8465-4b1eaae8dca5 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:39.894610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf77eb9a-8d28-4aa2-8465-4b1eaae8dca5 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:39.895390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf77eb9a-8d28-4aa2-8465-4b1eaae8dca5 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:39.895821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cf77eb9a-8d28-4aa2-8465-4b1eaae8dca5 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:40.039142 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cf77eb9a-8d28-4aa2-8465-4b1eaae8dca5 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:40.047227 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cf77eb9a-8d28-4aa2-8465-4b1eaae8dca5 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5" status: 200 len: 1363 microversion: 2.1 time: 0.167250 Jul 20 05:09:40.047814 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3703/7170] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:39 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:41.071056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6442e805-3a10-416a-a200-60081a409f3e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:41.072152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6442e805-3a10-416a-a200-60081a409f3e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:41.083066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6442e805-3a10-416a-a200-60081a409f3e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.083857 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6442e805-3a10-416a-a200-60081a409f3e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.085275 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6442e805-3a10-416a-a200-60081a409f3e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.085997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6442e805-3a10-416a-a200-60081a409f3e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.239307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6442e805-3a10-416a-a200-60081a409f3e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:41.247910 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6442e805-3a10-416a-a200-60081a409f3e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5" status: 200 len: 1556 microversion: 2.1 time: 0.185930 Jul 20 05:09:41.248525 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3468/7171] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:41 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5 => generated 1556 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:41.265779 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ac1e4a5c-9e3a-4e98-84da-beb6870e4c7a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:41.266365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ac1e4a5c-9e3a-4e98-84da-beb6870e4c7a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:41.273706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac1e4a5c-9e3a-4e98-84da-beb6870e4c7a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.274154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac1e4a5c-9e3a-4e98-84da-beb6870e4c7a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.275082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac1e4a5c-9e3a-4e98-84da-beb6870e4c7a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.275489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ac1e4a5c-9e3a-4e98-84da-beb6870e4c7a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.416656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:41.427713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ac1e4a5c-9e3a-4e98-84da-beb6870e4c7a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:41.435683 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ac1e4a5c-9e3a-4e98-84da-beb6870e4c7a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5" status: 200 len: 1556 microversion: 2.1 time: 0.173812 Jul 20 05:09:41.436198 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3704/7172] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:41 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5 => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:43.048531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eaece459-5d2f-41a9-abe3-c09a48662f8e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee862f60-8426-4669-a093-e0156da0d571"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:43.049586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eaece459-5d2f-41a9-abe3-c09a48662f8e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:43.051743 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:43.058604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eaece459-5d2f-41a9-abe3-c09a48662f8e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:43.059087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eaece459-5d2f-41a9-abe3-c09a48662f8e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:43.059886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eaece459-5d2f-41a9-abe3-c09a48662f8e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:43.060374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eaece459-5d2f-41a9-abe3-c09a48662f8e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:43.309300 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eaece459-5d2f-41a9-abe3-c09a48662f8e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "POST /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264834 Jul 20 05:09:43.309936 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3469/7173] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 05:09:43 2022] POST /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:54.041671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6dd5ddd5-a487-4d5e-9021-ab6267ddc2b4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:54.042221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6dd5ddd5-a487-4d5e-9021-ab6267ddc2b4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:54.044138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:54.045857 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:54.046656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=34 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:54.055854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6dd5ddd5-a487-4d5e-9021-ab6267ddc2b4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:54.056736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6dd5ddd5-a487-4d5e-9021-ab6267ddc2b4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:54.058026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6dd5ddd5-a487-4d5e-9021-ab6267ddc2b4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:54.058732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6dd5ddd5-a487-4d5e-9021-ab6267ddc2b4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:54.152589 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-6dd5ddd5-a487-4d5e-9021-ab6267ddc2b4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lazy-loading 'services' on Instance uuid 85040fcb-0040-428c-820f-7f61f23005e5 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:09:54.230240 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6dd5ddd5-a487-4d5e-9021-ab6267ddc2b4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "DELETE /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments/ee862f60-8426-4669-a093-e0156da0d571" status: 202 len: 0 microversion: 2.1 time: 0.192610 Jul 20 05:09:54.230878 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3705/7174] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 05:09:54 2022] DELETE /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments/ee862f60-8426-4669-a093-e0156da0d571 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:09:54.237602 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:54.238483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:54.242861 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8b2f520e-971e-44d4-94c8-70fe521747ed tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:54.244167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8b2f520e-971e-44d4-94c8-70fe521747ed tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:54.252419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b2f520e-971e-44d4-94c8-70fe521747ed tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:54.252997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b2f520e-971e-44d4-94c8-70fe521747ed tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:54.253790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b2f520e-971e-44d4-94c8-70fe521747ed tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:54.254233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b2f520e-971e-44d4-94c8-70fe521747ed tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:54.292577 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8b2f520e-971e-44d4-94c8-70fe521747ed tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056841 Jul 20 05:09:54.293191 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3470/7175] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:09:54 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:55.306074 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2f22f596-ee9c-4226-981d-7956940fb0cd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:55.307626 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2f22f596-ee9c-4226-981d-7956940fb0cd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:55.314781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f22f596-ee9c-4226-981d-7956940fb0cd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:55.315237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f22f596-ee9c-4226-981d-7956940fb0cd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:55.316010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f22f596-ee9c-4226-981d-7956940fb0cd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:55.316490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2f22f596-ee9c-4226-981d-7956940fb0cd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:55.348278 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2f22f596-ee9c-4226-981d-7956940fb0cd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047590 Jul 20 05:09:55.352181 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3706/7176] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:09:55 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:56.360751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-488f8c49-3a78-48eb-8f7d-93d5e3d64b2e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:56.361669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-488f8c49-3a78-48eb-8f7d-93d5e3d64b2e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:56.369136 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-488f8c49-3a78-48eb-8f7d-93d5e3d64b2e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:56.369601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-488f8c49-3a78-48eb-8f7d-93d5e3d64b2e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:56.370405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-488f8c49-3a78-48eb-8f7d-93d5e3d64b2e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:56.370864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-488f8c49-3a78-48eb-8f7d-93d5e3d64b2e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:56.402851 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-488f8c49-3a78-48eb-8f7d-93d5e3d64b2e tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046376 Jul 20 05:09:56.403450 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3471/7177] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:09:56 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:57.415265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cc4fd8d1-eaa8-492c-81b7-33f2f595ac34 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:57.416223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cc4fd8d1-eaa8-492c-81b7-33f2f595ac34 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:57.423917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc4fd8d1-eaa8-492c-81b7-33f2f595ac34 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:57.424409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc4fd8d1-eaa8-492c-81b7-33f2f595ac34 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:57.425195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc4fd8d1-eaa8-492c-81b7-33f2f595ac34 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:57.425639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cc4fd8d1-eaa8-492c-81b7-33f2f595ac34 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:57.456716 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cc4fd8d1-eaa8-492c-81b7-33f2f595ac34 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045717 Jul 20 05:09:57.457284 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3707/7178] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:09:57 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:58.467934 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-358470f9-43c9-49ac-bee4-7733aa9646e6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:58.469049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-358470f9-43c9-49ac-bee4-7733aa9646e6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:58.477056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-358470f9-43c9-49ac-bee4-7733aa9646e6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:58.477524 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-358470f9-43c9-49ac-bee4-7733aa9646e6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:58.478322 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-358470f9-43c9-49ac-bee4-7733aa9646e6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:58.478775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-358470f9-43c9-49ac-bee4-7733aa9646e6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:58.514437 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-358470f9-43c9-49ac-bee4-7733aa9646e6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050397 Jul 20 05:09:58.515089 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3472/7179] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:09:58 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:59.527383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a1b1a68f-e3e9-4676-95ef-01c00929d9a6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:59.528479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a1b1a68f-e3e9-4676-95ef-01c00929d9a6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:59.536417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1b1a68f-e3e9-4676-95ef-01c00929d9a6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:59.536898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1b1a68f-e3e9-4676-95ef-01c00929d9a6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:59.537713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1b1a68f-e3e9-4676-95ef-01c00929d9a6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:59.538178 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a1b1a68f-e3e9-4676-95ef-01c00929d9a6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:59.569224 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a1b1a68f-e3e9-4676-95ef-01c00929d9a6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046219 Jul 20 05:09:59.569803 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3708/7180] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:09:59 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 05:09:59.580913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5ac97900-8a54-47a7-b51e-4d46d47be183 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:59.581417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5ac97900-8a54-47a7-b51e-4d46d47be183 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:59.589019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ac97900-8a54-47a7-b51e-4d46d47be183 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:59.589481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ac97900-8a54-47a7-b51e-4d46d47be183 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:59.590253 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ac97900-8a54-47a7-b51e-4d46d47be183 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:59.590699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ac97900-8a54-47a7-b51e-4d46d47be183 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:59.667023 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-5ac97900-8a54-47a7-b51e-4d46d47be183 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] HTTP exception thrown: Instance 85040fcb-0040-428c-820f-7f61f23005e5 is not attached to volume ee862f60-8426-4669-a093-e0156da0d571 Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5ac97900-8a54-47a7-b51e-4d46d47be183 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Request method failure captured: Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments/ee862f60-8426-4669-a093-e0156da0d571 HTTP/1.1 Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi144EY0i8ZeXCJK2Mtcf4h6YlJcBIEYwULOmfhtvqo2jGYLyHOqGZWr34pCFKpxgXbpKwqfUMGyFlZ1pZ4Oxuk69asFBRW_0ztmfSAiv1hrZpSjzdAwEV7QqN12TEYdMOehizx6rQiNtT5Ktk1w6hy5NuxBXb2O53ACfOe0c7sdrygQA Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: a7c18a1a84804563b7be3b6eb8832563 Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestEncryptedCinderVolumes-406773130 Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7c18a1a84804563b7be3b6eb8832563"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a7c18a1a84804563b7be3b6eb8832563"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a7c18a1a84804563b7be3b6eb8832563", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7c18a1a84804563b7be3b6eb8832563"}]}] Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestEncryptedCinderVolumes-406773130 Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: a7c18a1a84804563b7be3b6eb8832563 Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-406773130 Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestEncryptedCinderVolumes-406773130-project Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 8b693e0429394d2d9f748ccb96123672 Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestEncryptedCinderVolumes-406773130-project Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 85040fcb-0040-428c-820f-7f61f23005e5 is not attached to volume ee862f60-8426-4669-a093-e0156da0d571 Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'server_id': '85040fcb-0040-428c-820f-7f61f23005e5', 'id': 'ee862f60-8426-4669-a093-e0156da0d571'} Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ee862f60-8426-4669-a093-e0156da0d571. Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85040fcb-0040-428c-820f-7f61f23005e5 is not attached to volume ee862f60-8426-4669-a093-e0156da0d571 Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:59.675844 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:59.680205 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:59.680205 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:59.680205 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85040fcb-0040-428c-820f-7f61f23005e5 is not attached to volume ee862f60-8426-4669-a093-e0156da0d571 Jul 20 05:09:59.680205 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:09:59.680205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5ac97900-8a54-47a7-b51e-4d46d47be183 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Returning 404 to user: Instance 85040fcb-0040-428c-820f-7f61f23005e5 is not attached to volume ee862f60-8426-4669-a093-e0156da0d571 {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:59.680205 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5ac97900-8a54-47a7-b51e-4d46d47be183 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "DELETE /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments/ee862f60-8426-4669-a093-e0156da0d571" status: 404 len: 154 microversion: 2.1 time: 0.100585 Jul 20 05:09:59.680205 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3473/7181] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 05:09:59 2022] DELETE /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5/os-volume_attachments/ee862f60-8426-4669-a093-e0156da0d571 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:10:03.216187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c7ca78d6-33fe-418b-a4cc-9abf326d8279 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:03.216847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c7ca78d6-33fe-418b-a4cc-9abf326d8279 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:03.224194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7ca78d6-33fe-418b-a4cc-9abf326d8279 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:03.224814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7ca78d6-33fe-418b-a4cc-9abf326d8279 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:03.225706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7ca78d6-33fe-418b-a4cc-9abf326d8279 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:03.226216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c7ca78d6-33fe-418b-a4cc-9abf326d8279 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:03.253115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c7ca78d6-33fe-418b-a4cc-9abf326d8279 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:10:03.339665 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c7ca78d6-33fe-418b-a4cc-9abf326d8279 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "DELETE /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5" status: 204 len: 0 microversion: 2.1 time: 0.126963 Jul 20 05:10:03.340716 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3709/7182] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:10:03 2022] DELETE /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:10:03.351022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b2e36964-1b78-4dc1-8df2-748f293b6d3b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:03.351689 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b2e36964-1b78-4dc1-8df2-748f293b6d3b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:03.360292 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2e36964-1b78-4dc1-8df2-748f293b6d3b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:03.360958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2e36964-1b78-4dc1-8df2-748f293b6d3b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:03.361945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2e36964-1b78-4dc1-8df2-748f293b6d3b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:03.362492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2e36964-1b78-4dc1-8df2-748f293b6d3b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:03.507244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b2e36964-1b78-4dc1-8df2-748f293b6d3b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:03.515956 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b2e36964-1b78-4dc1-8df2-748f293b6d3b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5" status: 200 len: 1562 microversion: 2.1 time: 0.169841 Jul 20 05:10:03.516707 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3474/7183] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:03 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5 => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:04.534677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-21255380-9a75-4972-b4b3-467cb77594e5 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:04.535367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-21255380-9a75-4972-b4b3-467cb77594e5 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:04.543296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-21255380-9a75-4972-b4b3-467cb77594e5 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:04.543754 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-21255380-9a75-4972-b4b3-467cb77594e5 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:04.544576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-21255380-9a75-4972-b4b3-467cb77594e5 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:04.545036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-21255380-9a75-4972-b4b3-467cb77594e5 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:04.691362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-21255380-9a75-4972-b4b3-467cb77594e5 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:04.699285 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-21255380-9a75-4972-b4b3-467cb77594e5 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5" status: 200 len: 1562 microversion: 2.1 time: 0.169143 Jul 20 05:10:04.699907 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3710/7184] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:04 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5 => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:05.418435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-df273824-95ef-4212-9b36-4be3b050bc3a req-60ea6bef-0b01-4006-9de6-b9f17cd53ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85040fcb-0040-428c-820f-7f61f23005e5", "name": "network-vif-deleted", "tag": "38b94bca-5859-4395-9f24-59bb1e678142"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:05.432213 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-df273824-95ef-4212-9b36-4be3b050bc3a req-60ea6bef-0b01-4006-9de6-b9f17cd53ced service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:05.437824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-df273824-95ef-4212-9b36-4be3b050bc3a req-60ea6bef-0b01-4006-9de6-b9f17cd53ced service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:05.458732 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-df273824-95ef-4212-9b36-4be3b050bc3a req-60ea6bef-0b01-4006-9de6-b9f17cd53ced service nova] Creating event network-vif-deleted:38b94bca-5859-4395-9f24-59bb1e678142 for instance 85040fcb-0040-428c-820f-7f61f23005e5 on n-h2-826526-5 Jul 20 05:10:05.465282 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-df273824-95ef-4212-9b36-4be3b050bc3a req-60ea6bef-0b01-4006-9de6-b9f17cd53ced service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051128 Jul 20 05:10:05.465905 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3475/7185] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:05.717546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-83223677-dfd8-47fa-9a59-4d8d2f4d198b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:05.718419 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-83223677-dfd8-47fa-9a59-4d8d2f4d198b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:05.727057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83223677-dfd8-47fa-9a59-4d8d2f4d198b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:05.727798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83223677-dfd8-47fa-9a59-4d8d2f4d198b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:05.728928 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83223677-dfd8-47fa-9a59-4d8d2f4d198b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:05.729521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83223677-dfd8-47fa-9a59-4d8d2f4d198b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:05.770005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83223677-dfd8-47fa-9a59-4d8d2f4d198b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:05.770468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83223677-dfd8-47fa-9a59-4d8d2f4d198b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:05.770943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-83223677-dfd8-47fa-9a59-4d8d2f4d198b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lazy-loading 'fault' on Instance uuid 85040fcb-0040-428c-820f-7f61f23005e5 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:10:05.815936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-83223677-dfd8-47fa-9a59-4d8d2f4d198b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:05.828748 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-83223677-dfd8-47fa-9a59-4d8d2f4d198b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5" status: 200 len: 1353 microversion: 2.1 time: 0.115094 Jul 20 05:10:05.829522 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3711/7186] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:05 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5 => generated 1353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:06.853233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-802f3403-c053-488c-b772-803273ad96c6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:06.854395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-802f3403-c053-488c-b772-803273ad96c6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 85040fcb-0040-428c-820f-7f61f23005e5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:06.867003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-802f3403-c053-488c-b772-803273ad96c6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:06.867460 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-802f3403-c053-488c-b772-803273ad96c6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:06.868297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-802f3403-c053-488c-b772-803273ad96c6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:06.868723 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-802f3403-c053-488c-b772-803273ad96c6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:06.883125 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-802f3403-c053-488c-b772-803273ad96c6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] HTTP exception thrown: Instance 85040fcb-0040-428c-820f-7f61f23005e5 could not be found. Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-802f3403-c053-488c-b772-803273ad96c6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Request method failure captured: Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5 HTTP/1.1 Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi144EY0i8ZeXCJK2Mtcf4h6YlJcBIEYwULOmfhtvqo2jGYLyHOqGZWr34pCFKpxgXbpKwqfUMGyFlZ1pZ4Oxuk69asFBRW_0ztmfSAiv1hrZpSjzdAwEV7QqN12TEYdMOehizx6rQiNtT5Ktk1w6hy5NuxBXb2O53ACfOe0c7sdrygQA Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: a7c18a1a84804563b7be3b6eb8832563 Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestEncryptedCinderVolumes-406773130 Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7c18a1a84804563b7be3b6eb8832563"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a7c18a1a84804563b7be3b6eb8832563"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a7c18a1a84804563b7be3b6eb8832563", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7c18a1a84804563b7be3b6eb8832563"}]}] Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestEncryptedCinderVolumes-406773130 Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: a7c18a1a84804563b7be3b6eb8832563 Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-406773130 Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestEncryptedCinderVolumes-406773130-project Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 8b693e0429394d2d9f748ccb96123672 Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestEncryptedCinderVolumes-406773130-project Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 85040fcb-0040-428c-820f-7f61f23005e5 could not be found. Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '85040fcb-0040-428c-820f-7f61f23005e5'} Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85040fcb-0040-428c-820f-7f61f23005e5 could not be found. Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85040fcb-0040-428c-820f-7f61f23005e5 could not be found. Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:10:06.884755 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:10:06.889295 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:10:06.889295 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:10:06.889295 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:10:06.889295 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:10:06.889295 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:10:06.889295 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85040fcb-0040-428c-820f-7f61f23005e5 could not be found. Jul 20 05:10:06.889295 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:10:06.889295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-802f3403-c053-488c-b772-803273ad96c6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Returning 404 to user: Instance 85040fcb-0040-428c-820f-7f61f23005e5 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:10:06.889295 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-802f3403-c053-488c-b772-803273ad96c6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5" status: 404 len: 111 microversion: 2.1 time: 0.041834 Jul 20 05:10:06.889295 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3476/7187] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:06 2022] GET /compute/v2.1/servers/85040fcb-0040-428c-820f-7f61f23005e5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:10:06.895465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9d6a9ad6-c710-471f-8bde-1f9a6ee90b63 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '.version_select at 0x7f06bd319e50>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:06.923910 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9d6a9ad6-c710-471f-8bde-1f9a6ee90b63 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1630249204" status: 202 len: 0 microversion: 2.1 time: 0.032394 Jul 20 05:10:06.924560 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3712/7188] 10.222.0.17 () {58 vars in 1277 bytes} [Wed Jul 20 05:10:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1630249204 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:10:06.941645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d186dd36-630a-47be-8ac3-828c62723afd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Action: 'create', calling method: .version_select at 0x7f06be062b80>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1564282103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZ2iipdQncBuPnrVpnfJ9dPEC/JAoE1w/tJCqRMPki5pzF0Fplb2PKZhCyosTza94R2209qRDb6MJYtN8/5/ElP82kX/+uqZcD/RX5dwV7RjCA+CbjEiowtoa3qf5XZCw=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:06.956595 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-d186dd36-630a-47be-8ac3-828c62723afd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Getting quotas for project a7c18a1a84804563b7be3b6eb8832563. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:10:06.962141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-d186dd36-630a-47be-8ac3-828c62723afd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Getting quotas for user 8b693e0429394d2d9f748ccb96123672 and project a7c18a1a84804563b7be3b6eb8832563. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:10:06.987371 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d186dd36-630a-47be-8ac3-828c62723afd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049561 Jul 20 05:10:06.988014 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3477/7189] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 05:10:06 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:07.037000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-03f30511-5498-48e7-ac9b-84e0d8e20ab4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1733563350", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1564282103", "networks": [{"uuid": "e2065d26-08d0-4f13-a679-324f6e01b64d"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:07.089829 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-03f30511-5498-48e7-ac9b-84e0d8e20ab4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] validate_networks() for [('e2065d26-08d0-4f13-a679-324f6e01b64d', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:10:07.496973 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-03f30511-5498-48e7-ac9b-84e0d8e20ab4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:10:07.497566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-03f30511-5498-48e7-ac9b-84e0d8e20ab4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:10:07.498267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-03f30511-5498-48e7-ac9b-84e0d8e20ab4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:10:07.498763 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-03f30511-5498-48e7-ac9b-84e0d8e20ab4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:10:07.499172 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-03f30511-5498-48e7-ac9b-84e0d8e20ab4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:10:07.509642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03f30511-5498-48e7-ac9b-84e0d8e20ab4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:07.510082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03f30511-5498-48e7-ac9b-84e0d8e20ab4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:07.510872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03f30511-5498-48e7-ac9b-84e0d8e20ab4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:07.511303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-03f30511-5498-48e7-ac9b-84e0d8e20ab4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:07.528746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-03f30511-5498-48e7-ac9b-84e0d8e20ab4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Getting quotas for project a7c18a1a84804563b7be3b6eb8832563. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:10:07.535175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-03f30511-5498-48e7-ac9b-84e0d8e20ab4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Getting quotas for user 8b693e0429394d2d9f748ccb96123672 and project a7c18a1a84804563b7be3b6eb8832563. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:10:07.548315 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-03f30511-5498-48e7-ac9b-84e0d8e20ab4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:10:07.550688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-03f30511-5498-48e7-ac9b-84e0d8e20ab4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:10:07.611249 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-03f30511-5498-48e7-ac9b-84e0d8e20ab4 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578150 Jul 20 05:10:07.612949 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3713/7190] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:10:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:10:07.622448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e71a59db-40d5-4344-9106-fa3ca25f45ff tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:07.623408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e71a59db-40d5-4344-9106-fa3ca25f45ff tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:07.679073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e71a59db-40d5-4344-9106-fa3ca25f45ff tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:07.687165 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e71a59db-40d5-4344-9106-fa3ca25f45ff tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295" status: 200 len: 1263 microversion: 2.1 time: 0.068839 Jul 20 05:10:07.687762 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3478/7191] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:07 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295 => generated 1263 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:08.703950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-df0130f0-7db0-4ed7-a393-5efb1d9dce37 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:08.704599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-df0130f0-7db0-4ed7-a393-5efb1d9dce37 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:08.712932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df0130f0-7db0-4ed7-a393-5efb1d9dce37 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:08.713394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df0130f0-7db0-4ed7-a393-5efb1d9dce37 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:08.714362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df0130f0-7db0-4ed7-a393-5efb1d9dce37 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:08.714965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-df0130f0-7db0-4ed7-a393-5efb1d9dce37 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:08.783054 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-df0130f0-7db0-4ed7-a393-5efb1d9dce37 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:08.790896 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-df0130f0-7db0-4ed7-a393-5efb1d9dce37 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295" status: 200 len: 1321 microversion: 2.1 time: 0.091067 Jul 20 05:10:08.791481 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3714/7192] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:08 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295 => generated 1321 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:09.807658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-33e60fff-65a4-453f-b8f9-975fd00c1e3c tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:09.808454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-33e60fff-65a4-453f-b8f9-975fd00c1e3c tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:09.816070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33e60fff-65a4-453f-b8f9-975fd00c1e3c tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:09.816840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33e60fff-65a4-453f-b8f9-975fd00c1e3c tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:09.817735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33e60fff-65a4-453f-b8f9-975fd00c1e3c tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:09.818550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33e60fff-65a4-453f-b8f9-975fd00c1e3c tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:10.027611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-ca9e6a4b-9f29-47e1-9fe3-adf4f816e751 req-de1d2b40-1b18-457e-9720-933e72aba136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "828f5456-ea0f-4425-9c12-0caf560af295", "tag": "8a452d8c-331b-49df-be87-001d13eb3cb8"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:10.044414 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ca9e6a4b-9f29-47e1-9fe3-adf4f816e751 req-de1d2b40-1b18-457e-9720-933e72aba136 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:10.045478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ca9e6a4b-9f29-47e1-9fe3-adf4f816e751 req-de1d2b40-1b18-457e-9720-933e72aba136 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:10.058231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-33e60fff-65a4-453f-b8f9-975fd00c1e3c tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:10.064604 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-ca9e6a4b-9f29-47e1-9fe3-adf4f816e751 req-de1d2b40-1b18-457e-9720-933e72aba136 service nova] Creating event network-changed:8a452d8c-331b-49df-be87-001d13eb3cb8 for instance 828f5456-ea0f-4425-9c12-0caf560af295 on n-h1-826526-5 Jul 20 05:10:10.069775 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-33e60fff-65a4-453f-b8f9-975fd00c1e3c tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295" status: 200 len: 1363 microversion: 2.1 time: 0.265996 Jul 20 05:10:10.070591 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3479/7193] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:09 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:10.074271 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-ca9e6a4b-9f29-47e1-9fe3-adf4f816e751 req-de1d2b40-1b18-457e-9720-933e72aba136 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051712 Jul 20 05:10:10.075410 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3715/7194] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:11.090809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3f7ad1a4-e0d1-4be8-8409-b318120ef2ae tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:11.091831 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3f7ad1a4-e0d1-4be8-8409-b318120ef2ae tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:11.100067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f7ad1a4-e0d1-4be8-8409-b318120ef2ae tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:11.100557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f7ad1a4-e0d1-4be8-8409-b318120ef2ae tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:11.101334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f7ad1a4-e0d1-4be8-8409-b318120ef2ae tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:11.101778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3f7ad1a4-e0d1-4be8-8409-b318120ef2ae tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:11.258044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3f7ad1a4-e0d1-4be8-8409-b318120ef2ae tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:11.267853 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3f7ad1a4-e0d1-4be8-8409-b318120ef2ae tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295" status: 200 len: 1363 microversion: 2.1 time: 0.183636 Jul 20 05:10:11.268474 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3480/7195] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:11 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:12.290264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bdd04559-430a-4237-86f4-f69b34681b1b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:12.291359 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bdd04559-430a-4237-86f4-f69b34681b1b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:12.301326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bdd04559-430a-4237-86f4-f69b34681b1b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:12.301781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bdd04559-430a-4237-86f4-f69b34681b1b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:12.302538 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bdd04559-430a-4237-86f4-f69b34681b1b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:12.302977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bdd04559-430a-4237-86f4-f69b34681b1b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:12.454307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bdd04559-430a-4237-86f4-f69b34681b1b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:12.462426 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bdd04559-430a-4237-86f4-f69b34681b1b tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295" status: 200 len: 1363 microversion: 2.1 time: 0.179396 Jul 20 05:10:12.463011 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3716/7196] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:12 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:13.482465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3951df1a-88ea-4464-bbbc-1db3ce3907cf tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:13.483295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3951df1a-88ea-4464-bbbc-1db3ce3907cf tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:13.494505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3951df1a-88ea-4464-bbbc-1db3ce3907cf tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:13.495110 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3951df1a-88ea-4464-bbbc-1db3ce3907cf tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:13.496326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3951df1a-88ea-4464-bbbc-1db3ce3907cf tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:13.497050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3951df1a-88ea-4464-bbbc-1db3ce3907cf tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:13.636543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3951df1a-88ea-4464-bbbc-1db3ce3907cf tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:13.645138 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3951df1a-88ea-4464-bbbc-1db3ce3907cf tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295" status: 200 len: 1363 microversion: 2.1 time: 0.168723 Jul 20 05:10:13.645733 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3481/7197] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:13 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:14.662925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d0ff37ab-dc4f-453e-8efb-0d9a49593ec6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:14.663546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d0ff37ab-dc4f-453e-8efb-0d9a49593ec6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:14.671153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0ff37ab-dc4f-453e-8efb-0d9a49593ec6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:14.671604 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0ff37ab-dc4f-453e-8efb-0d9a49593ec6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:14.672409 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0ff37ab-dc4f-453e-8efb-0d9a49593ec6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:14.672838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d0ff37ab-dc4f-453e-8efb-0d9a49593ec6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:14.809461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d0ff37ab-dc4f-453e-8efb-0d9a49593ec6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:14.818418 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d0ff37ab-dc4f-453e-8efb-0d9a49593ec6 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295" status: 200 len: 1363 microversion: 2.1 time: 0.159523 Jul 20 05:10:14.819239 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3717/7198] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:14 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:14.915919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-659446b1-84fe-4df2-89d0-3db198e00b29 req-21a0b746-6fef-44ed-8ab6-175de6d2f303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828f5456-ea0f-4425-9c12-0caf560af295", "name": "network-vif-plugged", "status": "completed", "tag": "8a452d8c-331b-49df-be87-001d13eb3cb8"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:14.925858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-659446b1-84fe-4df2-89d0-3db198e00b29 req-21a0b746-6fef-44ed-8ab6-175de6d2f303 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:14.926312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-659446b1-84fe-4df2-89d0-3db198e00b29 req-21a0b746-6fef-44ed-8ab6-175de6d2f303 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:14.939157 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-659446b1-84fe-4df2-89d0-3db198e00b29 req-21a0b746-6fef-44ed-8ab6-175de6d2f303 service nova] Creating event network-vif-plugged:8a452d8c-331b-49df-be87-001d13eb3cb8 for instance 828f5456-ea0f-4425-9c12-0caf560af295 on n-h1-826526-5 Jul 20 05:10:14.944358 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-659446b1-84fe-4df2-89d0-3db198e00b29 req-21a0b746-6fef-44ed-8ab6-175de6d2f303 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032224 Jul 20 05:10:14.945142 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3482/7199] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:15.838279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ae9a7e28-2132-4a7d-a2aa-81ecd6427cea tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:15.839064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ae9a7e28-2132-4a7d-a2aa-81ecd6427cea tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:15.848922 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae9a7e28-2132-4a7d-a2aa-81ecd6427cea tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:15.849566 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae9a7e28-2132-4a7d-a2aa-81ecd6427cea tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:15.850622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae9a7e28-2132-4a7d-a2aa-81ecd6427cea tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:15.851225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ae9a7e28-2132-4a7d-a2aa-81ecd6427cea tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:16.001889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ae9a7e28-2132-4a7d-a2aa-81ecd6427cea tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:16.012555 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ae9a7e28-2132-4a7d-a2aa-81ecd6427cea tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295" status: 200 len: 1363 microversion: 2.1 time: 0.179397 Jul 20 05:10:16.013300 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3718/7200] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:15 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:17.034119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f8241ab0-22cc-427f-b579-307e6fed92d8 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:17.035100 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f8241ab0-22cc-427f-b579-307e6fed92d8 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:17.042876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8241ab0-22cc-427f-b579-307e6fed92d8 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:17.043340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8241ab0-22cc-427f-b579-307e6fed92d8 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:17.044127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8241ab0-22cc-427f-b579-307e6fed92d8 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:17.044601 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f8241ab0-22cc-427f-b579-307e6fed92d8 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:17.188919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f8241ab0-22cc-427f-b579-307e6fed92d8 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:17.196982 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f8241ab0-22cc-427f-b579-307e6fed92d8 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295" status: 200 len: 1556 microversion: 2.1 time: 0.168994 Jul 20 05:10:17.197565 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3483/7201] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:17 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:17.213751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-111e7c42-8e7f-4c02-a0f1-8c6f02334817 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:17.214368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-111e7c42-8e7f-4c02-a0f1-8c6f02334817 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:17.221745 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-111e7c42-8e7f-4c02-a0f1-8c6f02334817 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:17.222207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-111e7c42-8e7f-4c02-a0f1-8c6f02334817 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:17.222981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-111e7c42-8e7f-4c02-a0f1-8c6f02334817 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:17.223416 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-111e7c42-8e7f-4c02-a0f1-8c6f02334817 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:17.367789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-111e7c42-8e7f-4c02-a0f1-8c6f02334817 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:17.380836 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-111e7c42-8e7f-4c02-a0f1-8c6f02334817 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295" status: 200 len: 1556 microversion: 2.1 time: 0.170258 Jul 20 05:10:17.381761 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3719/7202] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:17 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295 => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:18.898929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4f8ec1f3-1018-42b8-ba19-e605aafab60d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20226137-55d4-49a5-89c4-9eb75d652773"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:18.900024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4f8ec1f3-1018-42b8-ba19-e605aafab60d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:18.902163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:18.909146 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f8ec1f3-1018-42b8-ba19-e605aafab60d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:18.909613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f8ec1f3-1018-42b8-ba19-e605aafab60d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:18.910398 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f8ec1f3-1018-42b8-ba19-e605aafab60d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:18.910841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f8ec1f3-1018-42b8-ba19-e605aafab60d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:19.162536 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4f8ec1f3-1018-42b8-ba19-e605aafab60d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "POST /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267665 Jul 20 05:10:19.163363 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3484/7203] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 05:10:18 2022] POST /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:29.899998 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3a218f89-fe65-47d8-b86d-90498e2660c3 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:29.900617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3a218f89-fe65-47d8-b86d-90498e2660c3 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:29.903306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:29.904010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:29.906120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:29.906796 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:29.913813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a218f89-fe65-47d8-b86d-90498e2660c3 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:29.914269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a218f89-fe65-47d8-b86d-90498e2660c3 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:29.915061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a218f89-fe65-47d8-b86d-90498e2660c3 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:29.915482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a218f89-fe65-47d8-b86d-90498e2660c3 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:30.000589 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-3a218f89-fe65-47d8-b86d-90498e2660c3 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lazy-loading 'services' on Instance uuid 828f5456-ea0f-4425-9c12-0caf560af295 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:10:30.089245 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3a218f89-fe65-47d8-b86d-90498e2660c3 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "DELETE /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments/20226137-55d4-49a5-89c4-9eb75d652773" status: 202 len: 0 microversion: 2.1 time: 0.194811 Jul 20 05:10:30.090186 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3720/7204] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 05:10:29 2022] DELETE /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments/20226137-55d4-49a5-89c4-9eb75d652773 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:10:30.102580 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-424e38f8-5fef-4295-9beb-6fc9bab36fbe tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:30.104014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-424e38f8-5fef-4295-9beb-6fc9bab36fbe tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:30.107926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:30.109315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:30.114760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-424e38f8-5fef-4295-9beb-6fc9bab36fbe tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:30.115227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-424e38f8-5fef-4295-9beb-6fc9bab36fbe tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:30.116032 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-424e38f8-5fef-4295-9beb-6fc9bab36fbe tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:30.116501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-424e38f8-5fef-4295-9beb-6fc9bab36fbe tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:30.158536 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-424e38f8-5fef-4295-9beb-6fc9bab36fbe tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062961 Jul 20 05:10:30.159102 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3485/7205] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:10:30 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:31.172952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-14ae12f9-effe-49d4-8b1d-59689c5a8763 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:31.174116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-14ae12f9-effe-49d4-8b1d-59689c5a8763 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:31.181064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14ae12f9-effe-49d4-8b1d-59689c5a8763 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:31.181585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14ae12f9-effe-49d4-8b1d-59689c5a8763 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:31.182429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14ae12f9-effe-49d4-8b1d-59689c5a8763 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:31.182936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-14ae12f9-effe-49d4-8b1d-59689c5a8763 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:31.214891 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-14ae12f9-effe-49d4-8b1d-59689c5a8763 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047392 Jul 20 05:10:31.215689 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3721/7206] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:10:31 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:32.227849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a1764491-1079-449a-81d7-a67a60625f96 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:32.229139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a1764491-1079-449a-81d7-a67a60625f96 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:32.238597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1764491-1079-449a-81d7-a67a60625f96 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:32.239056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1764491-1079-449a-81d7-a67a60625f96 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:32.239858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1764491-1079-449a-81d7-a67a60625f96 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:32.240350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1764491-1079-449a-81d7-a67a60625f96 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:32.277087 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a1764491-1079-449a-81d7-a67a60625f96 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053535 Jul 20 05:10:32.277677 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3486/7207] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:10:32 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:33.289412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9f943626-8ee4-41b2-b581-38f4583f600a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:33.290385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9f943626-8ee4-41b2-b581-38f4583f600a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:33.297951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f943626-8ee4-41b2-b581-38f4583f600a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:33.298391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f943626-8ee4-41b2-b581-38f4583f600a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:33.299165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f943626-8ee4-41b2-b581-38f4583f600a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:33.299606 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9f943626-8ee4-41b2-b581-38f4583f600a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:33.331176 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9f943626-8ee4-41b2-b581-38f4583f600a tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045767 Jul 20 05:10:33.331813 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3722/7208] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:10:33 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:34.345479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4ccedd23-c2fd-4633-aaae-6c72dc99f709 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:34.346472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4ccedd23-c2fd-4633-aaae-6c72dc99f709 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:34.354261 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ccedd23-c2fd-4633-aaae-6c72dc99f709 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:34.354695 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ccedd23-c2fd-4633-aaae-6c72dc99f709 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:34.355478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ccedd23-c2fd-4633-aaae-6c72dc99f709 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:34.355922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ccedd23-c2fd-4633-aaae-6c72dc99f709 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:34.390193 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4ccedd23-c2fd-4633-aaae-6c72dc99f709 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050640 Jul 20 05:10:34.390687 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3487/7209] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:10:34 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:35.402518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-59ad0450-a41c-4054-8888-1a4a74b4728f tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:35.403463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-59ad0450-a41c-4054-8888-1a4a74b4728f tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:35.411522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59ad0450-a41c-4054-8888-1a4a74b4728f tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:35.412057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59ad0450-a41c-4054-8888-1a4a74b4728f tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:35.413219 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59ad0450-a41c-4054-8888-1a4a74b4728f tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:35.413831 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-59ad0450-a41c-4054-8888-1a4a74b4728f tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:35.451274 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-59ad0450-a41c-4054-8888-1a4a74b4728f tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052979 Jul 20 05:10:35.451841 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3723/7210] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:10:35 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 05:10:35.464626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eb5ed964-8f62-4e20-bc35-46fa4ead795f tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:35.465210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eb5ed964-8f62-4e20-bc35-46fa4ead795f tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:35.472819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb5ed964-8f62-4e20-bc35-46fa4ead795f tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:35.473249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb5ed964-8f62-4e20-bc35-46fa4ead795f tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:35.474039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb5ed964-8f62-4e20-bc35-46fa4ead795f tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:35.474486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb5ed964-8f62-4e20-bc35-46fa4ead795f tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:35.563951 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-eb5ed964-8f62-4e20-bc35-46fa4ead795f tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] HTTP exception thrown: Instance 828f5456-ea0f-4425-9c12-0caf560af295 is not attached to volume 20226137-55d4-49a5-89c4-9eb75d652773 Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eb5ed964-8f62-4e20-bc35-46fa4ead795f tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Request method failure captured: Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments/20226137-55d4-49a5-89c4-9eb75d652773 HTTP/1.1 Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi144EY0i8ZeXCJK2Mtcf4h6YlJcBIEYwULOmfhtvqo2jGYLyHOqGZWr34pCFKpxgXbpKwqfUMGyFlZ1pZ4Oxuk69asFBRW_0ztmfSAiv1hrZpSjzdAwEV7QqN12TEYdMOehizx6rQiNtT5Ktk1w6hy5NuxBXb2O53ACfOe0c7sdrygQA Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: a7c18a1a84804563b7be3b6eb8832563 Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestEncryptedCinderVolumes-406773130 Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7c18a1a84804563b7be3b6eb8832563"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a7c18a1a84804563b7be3b6eb8832563"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a7c18a1a84804563b7be3b6eb8832563", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7c18a1a84804563b7be3b6eb8832563"}]}] Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestEncryptedCinderVolumes-406773130 Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: a7c18a1a84804563b7be3b6eb8832563 Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-406773130 Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestEncryptedCinderVolumes-406773130-project Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 8b693e0429394d2d9f748ccb96123672 Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestEncryptedCinderVolumes-406773130-project Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 828f5456-ea0f-4425-9c12-0caf560af295 is not attached to volume 20226137-55d4-49a5-89c4-9eb75d652773 Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'server_id': '828f5456-ea0f-4425-9c12-0caf560af295', 'id': '20226137-55d4-49a5-89c4-9eb75d652773'} Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 20226137-55d4-49a5-89c4-9eb75d652773. Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 828f5456-ea0f-4425-9c12-0caf560af295 is not attached to volume 20226137-55d4-49a5-89c4-9eb75d652773 Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:10:35.565674 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:10:35.570096 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:10:35.570096 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:10:35.570096 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 828f5456-ea0f-4425-9c12-0caf560af295 is not attached to volume 20226137-55d4-49a5-89c4-9eb75d652773 Jul 20 05:10:35.570096 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:10:35.570096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eb5ed964-8f62-4e20-bc35-46fa4ead795f tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Returning 404 to user: Instance 828f5456-ea0f-4425-9c12-0caf560af295 is not attached to volume 20226137-55d4-49a5-89c4-9eb75d652773 {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:10:35.570096 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eb5ed964-8f62-4e20-bc35-46fa4ead795f tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "DELETE /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments/20226137-55d4-49a5-89c4-9eb75d652773" status: 404 len: 154 microversion: 2.1 time: 0.108522 Jul 20 05:10:35.570096 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3488/7211] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 05:10:35 2022] DELETE /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295/os-volume_attachments/20226137-55d4-49a5-89c4-9eb75d652773 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:10:38.914821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-84697409-1adb-4048-95f3-13fca88113ce tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:38.915314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-84697409-1adb-4048-95f3-13fca88113ce tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:38.922577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84697409-1adb-4048-95f3-13fca88113ce tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:38.923068 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84697409-1adb-4048-95f3-13fca88113ce tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:38.923841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84697409-1adb-4048-95f3-13fca88113ce tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:38.924414 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-84697409-1adb-4048-95f3-13fca88113ce tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:38.949762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-84697409-1adb-4048-95f3-13fca88113ce tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:10:39.039417 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-84697409-1adb-4048-95f3-13fca88113ce tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "DELETE /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295" status: 204 len: 0 microversion: 2.1 time: 0.128064 Jul 20 05:10:39.040369 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3724/7212] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:10:38 2022] DELETE /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:10:39.050394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-380edb0b-4c11-4243-9498-94fbc42d8012 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:39.050952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-380edb0b-4c11-4243-9498-94fbc42d8012 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:39.059613 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-380edb0b-4c11-4243-9498-94fbc42d8012 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:39.060082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-380edb0b-4c11-4243-9498-94fbc42d8012 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:39.060919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-380edb0b-4c11-4243-9498-94fbc42d8012 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:39.061370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-380edb0b-4c11-4243-9498-94fbc42d8012 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:39.197751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-380edb0b-4c11-4243-9498-94fbc42d8012 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:39.205826 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-380edb0b-4c11-4243-9498-94fbc42d8012 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295" status: 200 len: 1562 microversion: 2.1 time: 0.160013 Jul 20 05:10:39.206425 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3489/7213] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:39 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:40.224307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-880d4baf-2d31-48dc-ab80-46ef3da425fd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:40.225028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-880d4baf-2d31-48dc-ab80-46ef3da425fd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:40.232844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-880d4baf-2d31-48dc-ab80-46ef3da425fd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:40.233295 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-880d4baf-2d31-48dc-ab80-46ef3da425fd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:40.234250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-880d4baf-2d31-48dc-ab80-46ef3da425fd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:40.234656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-880d4baf-2d31-48dc-ab80-46ef3da425fd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:40.374285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-880d4baf-2d31-48dc-ab80-46ef3da425fd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:40.383184 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-880d4baf-2d31-48dc-ab80-46ef3da425fd tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295" status: 200 len: 1562 microversion: 2.1 time: 0.163439 Jul 20 05:10:40.383716 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3725/7214] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:40 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:41.059481 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-59fa1e07-1f02-4e74-88e4-fa153e91b8fb req-70a888cb-df34-4d07-bbe6-8d3ff5cb3bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828f5456-ea0f-4425-9c12-0caf560af295", "name": "network-vif-deleted", "tag": "8a452d8c-331b-49df-be87-001d13eb3cb8"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:41.071452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-59fa1e07-1f02-4e74-88e4-fa153e91b8fb req-70a888cb-df34-4d07-bbe6-8d3ff5cb3bfe service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:41.072456 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-59fa1e07-1f02-4e74-88e4-fa153e91b8fb req-70a888cb-df34-4d07-bbe6-8d3ff5cb3bfe service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:41.088380 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-59fa1e07-1f02-4e74-88e4-fa153e91b8fb req-70a888cb-df34-4d07-bbe6-8d3ff5cb3bfe service nova] Creating event network-vif-deleted:8a452d8c-331b-49df-be87-001d13eb3cb8 for instance 828f5456-ea0f-4425-9c12-0caf560af295 on n-h1-826526-5 Jul 20 05:10:41.094723 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-59fa1e07-1f02-4e74-88e4-fa153e91b8fb req-70a888cb-df34-4d07-bbe6-8d3ff5cb3bfe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041385 Jul 20 05:10:41.095853 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3490/7215] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:41.401823 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-924e0898-4934-4f01-b895-3c83054514f9 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:41.402421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-924e0898-4934-4f01-b895-3c83054514f9 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:41.409731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-924e0898-4934-4f01-b895-3c83054514f9 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:41.410393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-924e0898-4934-4f01-b895-3c83054514f9 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:41.411259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-924e0898-4934-4f01-b895-3c83054514f9 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:41.411789 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-924e0898-4934-4f01-b895-3c83054514f9 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:41.447404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-924e0898-4934-4f01-b895-3c83054514f9 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:41.447855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-924e0898-4934-4f01-b895-3c83054514f9 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:41.448371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-924e0898-4934-4f01-b895-3c83054514f9 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lazy-loading 'fault' on Instance uuid 828f5456-ea0f-4425-9c12-0caf560af295 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:10:41.491732 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-924e0898-4934-4f01-b895-3c83054514f9 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b693e0429394d2d9f748ccb96123672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c18a1a84804563b7be3b6eb8832563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:41.500612 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-924e0898-4934-4f01-b895-3c83054514f9 tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295" status: 200 len: 1353 microversion: 2.1 time: 0.102994 Jul 20 05:10:41.501446 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3726/7216] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:41 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295 => generated 1353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:10:42.522542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-684355db-c9e8-4820-9dec-038112d07d2d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:42.523129 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-684355db-c9e8-4820-9dec-038112d07d2d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] [instance: 828f5456-ea0f-4425-9c12-0caf560af295] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:42.530875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-684355db-c9e8-4820-9dec-038112d07d2d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:42.531336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-684355db-c9e8-4820-9dec-038112d07d2d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:42.532110 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-684355db-c9e8-4820-9dec-038112d07d2d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:42.532595 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-684355db-c9e8-4820-9dec-038112d07d2d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:42.546612 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-684355db-c9e8-4820-9dec-038112d07d2d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] HTTP exception thrown: Instance 828f5456-ea0f-4425-9c12-0caf560af295 could not be found. Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-684355db-c9e8-4820-9dec-038112d07d2d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Request method failure captured: Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295 HTTP/1.1 Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi144EY0i8ZeXCJK2Mtcf4h6YlJcBIEYwULOmfhtvqo2jGYLyHOqGZWr34pCFKpxgXbpKwqfUMGyFlZ1pZ4Oxuk69asFBRW_0ztmfSAiv1hrZpSjzdAwEV7QqN12TEYdMOehizx6rQiNtT5Ktk1w6hy5NuxBXb2O53ACfOe0c7sdrygQA Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: a7c18a1a84804563b7be3b6eb8832563 Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestEncryptedCinderVolumes-406773130 Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7c18a1a84804563b7be3b6eb8832563"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a7c18a1a84804563b7be3b6eb8832563"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a7c18a1a84804563b7be3b6eb8832563", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7c18a1a84804563b7be3b6eb8832563"}]}] Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestEncryptedCinderVolumes-406773130 Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: a7c18a1a84804563b7be3b6eb8832563 Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-406773130 Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestEncryptedCinderVolumes-406773130-project Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 8b693e0429394d2d9f748ccb96123672 Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestEncryptedCinderVolumes-406773130-project Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 828f5456-ea0f-4425-9c12-0caf560af295 could not be found. Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '828f5456-ea0f-4425-9c12-0caf560af295'} Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 828f5456-ea0f-4425-9c12-0caf560af295 could not be found. Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 828f5456-ea0f-4425-9c12-0caf560af295 could not be found. Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:10:42.548453 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:10:42.552335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:10:42.552335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:10:42.552335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:10:42.552335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:10:42.552335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:10:42.552335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 828f5456-ea0f-4425-9c12-0caf560af295 could not be found. Jul 20 05:10:42.552335 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:10:42.552335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-684355db-c9e8-4820-9dec-038112d07d2d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Returning 404 to user: Instance 828f5456-ea0f-4425-9c12-0caf560af295 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:10:42.552335 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-684355db-c9e8-4820-9dec-038112d07d2d tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295" status: 404 len: 111 microversion: 2.1 time: 0.031850 Jul 20 05:10:42.552335 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3491/7217] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:42 2022] GET /compute/v2.1/servers/828f5456-ea0f-4425-9c12-0caf560af295 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:10:42.559034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3686be51-3d6f-4140-874b-0dd91f8a78ca tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] Calling method '.version_select at 0x7f06bd286550>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:42.579549 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3686be51-3d6f-4140-874b-0dd91f8a78ca tempest-TestEncryptedCinderVolumes-406773130 tempest-TestEncryptedCinderVolumes-406773130-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1564282103" status: 202 len: 0 microversion: 2.1 time: 0.024440 Jul 20 05:10:42.580129 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3727/7218] 10.222.0.17 () {58 vars in 1277 bytes} [Wed Jul 20 05:10:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1564282103 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:11:10.608631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=14 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:10.611255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=34 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:10.616623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6d817a57-4be6-4da9-9bf9-0e7d79710470 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Action: 'create', calling method: .version_select at 0x7f06be6f71f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-403244640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9BngTg+uSVx2JiLmfI0xCv4eVyh31VXbmE/jP7FkvE8+wvyt4fj8miAFoMg3J9VPjYSElCTnVfFDpGSVEma0OtPAionz3wC67LUjmhPq+yIOwtvlnbUdspjPtNbtTPwg=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:10.638397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-6d817a57-4be6-4da9-9bf9-0e7d79710470 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Getting quotas for project b081448fa8564c72b3c9276382a825a4. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:11:10.644248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-6d817a57-4be6-4da9-9bf9-0e7d79710470 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Getting quotas for user 4ca155584b04400e9c95b4f17a4461f6 and project b081448fa8564c72b3c9276382a825a4. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:11:10.674310 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6d817a57-4be6-4da9-9bf9-0e7d79710470 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.067556 Jul 20 05:11:10.674939 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3492/7219] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 05:11:10 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:10.723532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:10.724318 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:10.728322 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6b2713da-5f65-4a31-905a-c7fb8b98d139 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2128352918", "imageRef": "9e95d3ac-51ff-44d0-a4a6-0b90a5518c94", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-403244640", "networks": [{"uuid": "10e32802-7142-489b-8fb3-aed8f1146518"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:10.787710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-6b2713da-5f65-4a31-905a-c7fb8b98d139 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] validate_networks() for [('10e32802-7142-489b-8fb3-aed8f1146518', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:11:11.200771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-6b2713da-5f65-4a31-905a-c7fb8b98d139 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:11:11.201192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-6b2713da-5f65-4a31-905a-c7fb8b98d139 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:11:11.201663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-6b2713da-5f65-4a31-905a-c7fb8b98d139 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:11:11.202096 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-6b2713da-5f65-4a31-905a-c7fb8b98d139 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:11:11.202505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-6b2713da-5f65-4a31-905a-c7fb8b98d139 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:11:11.212670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6b2713da-5f65-4a31-905a-c7fb8b98d139 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:11.213110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6b2713da-5f65-4a31-905a-c7fb8b98d139 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:11.213900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6b2713da-5f65-4a31-905a-c7fb8b98d139 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:11.214365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6b2713da-5f65-4a31-905a-c7fb8b98d139 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:11.232043 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-6b2713da-5f65-4a31-905a-c7fb8b98d139 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Getting quotas for project b081448fa8564c72b3c9276382a825a4. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:11:11.237811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-6b2713da-5f65-4a31-905a-c7fb8b98d139 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Getting quotas for user 4ca155584b04400e9c95b4f17a4461f6 and project b081448fa8564c72b3c9276382a825a4. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:11:11.250993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6b2713da-5f65-4a31-905a-c7fb8b98d139 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:11:11.253313 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6b2713da-5f65-4a31-905a-c7fb8b98d139 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e95d3ac-51ff-44d0-a4a6-0b90a5518c94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:11:11.300694 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6b2713da-5f65-4a31-905a-c7fb8b98d139 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578883 Jul 20 05:11:11.301357 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3728/7220] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:11:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:11:11.313930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-87abfd4e-5ccc-4ac6-9150-fcd4a5d54ddb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:11.314572 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-87abfd4e-5ccc-4ac6-9150-fcd4a5d54ddb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:11.370092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-87abfd4e-5ccc-4ac6-9150-fcd4a5d54ddb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:11.379367 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-87abfd4e-5ccc-4ac6-9150-fcd4a5d54ddb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1258 microversion: 2.1 time: 0.071102 Jul 20 05:11:11.380547 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3493/7221] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:11 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:12.398153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5785ce35-2578-4931-a5a5-90491736c83e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:12.398996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5785ce35-2578-4931-a5a5-90491736c83e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:12.409753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5785ce35-2578-4931-a5a5-90491736c83e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:12.410115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5785ce35-2578-4931-a5a5-90491736c83e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:12.411087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5785ce35-2578-4931-a5a5-90491736c83e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:12.411685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5785ce35-2578-4931-a5a5-90491736c83e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:12.484809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5785ce35-2578-4931-a5a5-90491736c83e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:12.494979 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5785ce35-2578-4931-a5a5-90491736c83e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1328 microversion: 2.1 time: 0.101004 Jul 20 05:11:12.496348 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3729/7222] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:12 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1328 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:13.513236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a8770045-27af-40b5-b0b5-b8029077f840 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:13.515220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a8770045-27af-40b5-b0b5-b8029077f840 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:13.528872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8770045-27af-40b5-b0b5-b8029077f840 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:13.530417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8770045-27af-40b5-b0b5-b8029077f840 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:13.532172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8770045-27af-40b5-b0b5-b8029077f840 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:13.533335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8770045-27af-40b5-b0b5-b8029077f840 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:13.725599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a8770045-27af-40b5-b0b5-b8029077f840 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:13.739631 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a8770045-27af-40b5-b0b5-b8029077f840 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1358 microversion: 2.1 time: 0.230407 Jul 20 05:11:13.740735 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3494/7223] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:13 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:14.758890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-83563e65-eaaf-4306-9007-373eccdad8de tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:14.760303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-83563e65-eaaf-4306-9007-373eccdad8de tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:14.768171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83563e65-eaaf-4306-9007-373eccdad8de tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:14.768912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83563e65-eaaf-4306-9007-373eccdad8de tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:14.769698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83563e65-eaaf-4306-9007-373eccdad8de tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:14.770141 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83563e65-eaaf-4306-9007-373eccdad8de tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:14.923011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-83563e65-eaaf-4306-9007-373eccdad8de tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:14.932127 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-83563e65-eaaf-4306-9007-373eccdad8de tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1358 microversion: 2.1 time: 0.177520 Jul 20 05:11:14.933193 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3730/7224] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:14 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:15.950430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-14968ed3-f481-48fa-a49d-04783b3ccbc9 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:15.951218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-14968ed3-f481-48fa-a49d-04783b3ccbc9 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:15.959902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14968ed3-f481-48fa-a49d-04783b3ccbc9 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:15.960101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14968ed3-f481-48fa-a49d-04783b3ccbc9 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:15.960929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14968ed3-f481-48fa-a49d-04783b3ccbc9 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:15.961376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-14968ed3-f481-48fa-a49d-04783b3ccbc9 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:16.142946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-14968ed3-f481-48fa-a49d-04783b3ccbc9 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:16.168120 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-14968ed3-f481-48fa-a49d-04783b3ccbc9 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1358 microversion: 2.1 time: 0.220867 Jul 20 05:11:16.169349 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3495/7225] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:15 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:17.189446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-09fa9496-a5ee-45cf-92e0-1f23c7de0ea6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:17.190901 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-09fa9496-a5ee-45cf-92e0-1f23c7de0ea6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:17.199385 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09fa9496-a5ee-45cf-92e0-1f23c7de0ea6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:17.200212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09fa9496-a5ee-45cf-92e0-1f23c7de0ea6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:17.201282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09fa9496-a5ee-45cf-92e0-1f23c7de0ea6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:17.201948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09fa9496-a5ee-45cf-92e0-1f23c7de0ea6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:17.372241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-09fa9496-a5ee-45cf-92e0-1f23c7de0ea6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:17.381210 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-09fa9496-a5ee-45cf-92e0-1f23c7de0ea6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1358 microversion: 2.1 time: 0.195893 Jul 20 05:11:17.388058 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3731/7226] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:17 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:18.411510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6ee82131-79b4-4a5d-b5ce-3c997eb7c6d6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:18.411510 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6ee82131-79b4-4a5d-b5ce-3c997eb7c6d6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:18.413140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6ee82131-79b4-4a5d-b5ce-3c997eb7c6d6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:18.413630 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6ee82131-79b4-4a5d-b5ce-3c997eb7c6d6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:18.415064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6ee82131-79b4-4a5d-b5ce-3c997eb7c6d6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:18.421534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6ee82131-79b4-4a5d-b5ce-3c997eb7c6d6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:18.607471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6ee82131-79b4-4a5d-b5ce-3c997eb7c6d6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:18.616588 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6ee82131-79b4-4a5d-b5ce-3c997eb7c6d6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1358 microversion: 2.1 time: 0.220380 Jul 20 05:11:18.617200 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3496/7227] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:18 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:19.635454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3b4fbe17-f28f-46cb-8287-128c0ec992ac tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:19.635454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3b4fbe17-f28f-46cb-8287-128c0ec992ac tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:19.642820 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b4fbe17-f28f-46cb-8287-128c0ec992ac tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:19.643245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b4fbe17-f28f-46cb-8287-128c0ec992ac tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:19.644044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b4fbe17-f28f-46cb-8287-128c0ec992ac tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:19.644520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3b4fbe17-f28f-46cb-8287-128c0ec992ac tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:19.818784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3b4fbe17-f28f-46cb-8287-128c0ec992ac tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:19.830900 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3b4fbe17-f28f-46cb-8287-128c0ec992ac tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1358 microversion: 2.1 time: 0.198903 Jul 20 05:11:19.831227 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3732/7228] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:19 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:20.856338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-53e37655-72c4-4e93-aec7-eadf6e3203fc tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:20.857124 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-53e37655-72c4-4e93-aec7-eadf6e3203fc tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:20.865473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53e37655-72c4-4e93-aec7-eadf6e3203fc tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:20.865898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53e37655-72c4-4e93-aec7-eadf6e3203fc tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:20.866697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53e37655-72c4-4e93-aec7-eadf6e3203fc tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:20.867142 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-53e37655-72c4-4e93-aec7-eadf6e3203fc tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:21.078247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-53e37655-72c4-4e93-aec7-eadf6e3203fc tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:21.087296 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-53e37655-72c4-4e93-aec7-eadf6e3203fc tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1358 microversion: 2.1 time: 0.235140 Jul 20 05:11:21.088093 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3497/7229] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:20 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:21.373725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:21.382613 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:21.392916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e3479d3f-b98a-477c-b1d6-6eaa4107627b req-80f7a07e-c46c-4c0f-8d11-773ac475f04d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db58b0f-fe5b-4546-8e0d-4ed7a60044c1", "tag": "a711e382-20e2-4f9b-ad83-92285cfce315"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:21.417530 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e3479d3f-b98a-477c-b1d6-6eaa4107627b req-80f7a07e-c46c-4c0f-8d11-773ac475f04d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:21.418002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e3479d3f-b98a-477c-b1d6-6eaa4107627b req-80f7a07e-c46c-4c0f-8d11-773ac475f04d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:21.440819 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e3479d3f-b98a-477c-b1d6-6eaa4107627b req-80f7a07e-c46c-4c0f-8d11-773ac475f04d service nova] Creating event network-changed:a711e382-20e2-4f9b-ad83-92285cfce315 for instance 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 on n-h1-826526-5 Jul 20 05:11:21.449040 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e3479d3f-b98a-477c-b1d6-6eaa4107627b req-80f7a07e-c46c-4c0f-8d11-773ac475f04d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076408 Jul 20 05:11:21.449649 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3733/7230] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:22.105356 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3db2076b-6ca7-494c-8082-d35ffae50a07 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:22.105984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3db2076b-6ca7-494c-8082-d35ffae50a07 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:22.108871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:22.115532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3db2076b-6ca7-494c-8082-d35ffae50a07 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:22.115996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3db2076b-6ca7-494c-8082-d35ffae50a07 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:22.116844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3db2076b-6ca7-494c-8082-d35ffae50a07 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:22.117297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3db2076b-6ca7-494c-8082-d35ffae50a07 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:22.274144 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3db2076b-6ca7-494c-8082-d35ffae50a07 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:22.282427 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3db2076b-6ca7-494c-8082-d35ffae50a07 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1358 microversion: 2.1 time: 0.181096 Jul 20 05:11:22.283012 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3498/7231] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:22 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:23.301706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-04ed628c-04ac-4285-8329-c6e7c287a3ab tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:23.303148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-04ed628c-04ac-4285-8329-c6e7c287a3ab tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:23.311574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-04ed628c-04ac-4285-8329-c6e7c287a3ab tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:23.312320 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-04ed628c-04ac-4285-8329-c6e7c287a3ab tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:23.313382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-04ed628c-04ac-4285-8329-c6e7c287a3ab tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:23.314088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-04ed628c-04ac-4285-8329-c6e7c287a3ab tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:23.459154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-04ed628c-04ac-4285-8329-c6e7c287a3ab tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:23.469486 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-04ed628c-04ac-4285-8329-c6e7c287a3ab tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1358 microversion: 2.1 time: 0.172989 Jul 20 05:11:23.470103 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3734/7232] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:23 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:24.488495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-00e5f634-32f0-4e77-9778-5dbef58e3d8c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:24.489066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-00e5f634-32f0-4e77-9778-5dbef58e3d8c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:24.496612 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00e5f634-32f0-4e77-9778-5dbef58e3d8c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:24.497074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00e5f634-32f0-4e77-9778-5dbef58e3d8c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:24.497845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00e5f634-32f0-4e77-9778-5dbef58e3d8c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:24.498295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00e5f634-32f0-4e77-9778-5dbef58e3d8c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:24.639952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-00e5f634-32f0-4e77-9778-5dbef58e3d8c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:24.648052 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-00e5f634-32f0-4e77-9778-5dbef58e3d8c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1358 microversion: 2.1 time: 0.164004 Jul 20 05:11:24.648679 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3499/7233] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:24 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:25.665918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bd8f93bf-8b6e-45fa-bab9-93f5a68e7c25 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:25.666487 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bd8f93bf-8b6e-45fa-bab9-93f5a68e7c25 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:25.674256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd8f93bf-8b6e-45fa-bab9-93f5a68e7c25 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:25.674734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd8f93bf-8b6e-45fa-bab9-93f5a68e7c25 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:25.675875 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd8f93bf-8b6e-45fa-bab9-93f5a68e7c25 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:25.676578 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bd8f93bf-8b6e-45fa-bab9-93f5a68e7c25 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:25.833808 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bd8f93bf-8b6e-45fa-bab9-93f5a68e7c25 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:25.846003 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bd8f93bf-8b6e-45fa-bab9-93f5a68e7c25 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1358 microversion: 2.1 time: 0.184076 Jul 20 05:11:25.846959 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3735/7234] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:25 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:26.871583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-33b1acf0-bf85-4673-b895-23b0047e3906 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:26.872681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-33b1acf0-bf85-4673-b895-23b0047e3906 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:26.885525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33b1acf0-bf85-4673-b895-23b0047e3906 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:26.886183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33b1acf0-bf85-4673-b895-23b0047e3906 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:26.887499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33b1acf0-bf85-4673-b895-23b0047e3906 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:26.888246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33b1acf0-bf85-4673-b895-23b0047e3906 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:27.028661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-33b1acf0-bf85-4673-b895-23b0047e3906 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:27.036794 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-33b1acf0-bf85-4673-b895-23b0047e3906 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1358 microversion: 2.1 time: 0.172072 Jul 20 05:11:27.037382 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3500/7235] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:26 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:27.316729 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-8b0f505e-a4a6-4be6-b1ee-cc37ee03b9f3 req-86141a1f-69f0-4919-bf5d-9691f656aef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db58b0f-fe5b-4546-8e0d-4ed7a60044c1", "name": "network-vif-plugged", "status": "completed", "tag": "a711e382-20e2-4f9b-ad83-92285cfce315"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:27.326773 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8b0f505e-a4a6-4be6-b1ee-cc37ee03b9f3 req-86141a1f-69f0-4919-bf5d-9691f656aef3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:27.327690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8b0f505e-a4a6-4be6-b1ee-cc37ee03b9f3 req-86141a1f-69f0-4919-bf5d-9691f656aef3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:27.341703 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-8b0f505e-a4a6-4be6-b1ee-cc37ee03b9f3 req-86141a1f-69f0-4919-bf5d-9691f656aef3 service nova] Creating event network-vif-plugged:a711e382-20e2-4f9b-ad83-92285cfce315 for instance 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 on n-h1-826526-5 Jul 20 05:11:27.346731 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-8b0f505e-a4a6-4be6-b1ee-cc37ee03b9f3 req-86141a1f-69f0-4919-bf5d-9691f656aef3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033909 Jul 20 05:11:27.347346 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3736/7236] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:28.059064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0b85fbfa-7c12-4aef-b170-d51bc82bfe70 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:28.060141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0b85fbfa-7c12-4aef-b170-d51bc82bfe70 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:28.068827 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b85fbfa-7c12-4aef-b170-d51bc82bfe70 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:28.069296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b85fbfa-7c12-4aef-b170-d51bc82bfe70 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:28.070083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b85fbfa-7c12-4aef-b170-d51bc82bfe70 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:28.070533 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b85fbfa-7c12-4aef-b170-d51bc82bfe70 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:28.213357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0b85fbfa-7c12-4aef-b170-d51bc82bfe70 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:28.225512 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0b85fbfa-7c12-4aef-b170-d51bc82bfe70 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1358 microversion: 2.1 time: 0.173015 Jul 20 05:11:28.226364 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3501/7237] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:28 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:29.251531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-cb6c6b39-7011-4f64-ad0d-6143ea601e58 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:29.252255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-cb6c6b39-7011-4f64-ad0d-6143ea601e58 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:29.259557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb6c6b39-7011-4f64-ad0d-6143ea601e58 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:29.260016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb6c6b39-7011-4f64-ad0d-6143ea601e58 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:29.260929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb6c6b39-7011-4f64-ad0d-6143ea601e58 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:29.261418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-cb6c6b39-7011-4f64-ad0d-6143ea601e58 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:29.404199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-cb6c6b39-7011-4f64-ad0d-6143ea601e58 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:29.412280 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-cb6c6b39-7011-4f64-ad0d-6143ea601e58 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1548 microversion: 2.1 time: 0.168714 Jul 20 05:11:29.412871 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3737/7238] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:29 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:29.432186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-091407d3-19b8-4fda-b788-886996f35097 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:29.433105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-091407d3-19b8-4fda-b788-886996f35097 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:29.442368 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-091407d3-19b8-4fda-b788-886996f35097 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:29.442842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-091407d3-19b8-4fda-b788-886996f35097 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:29.443648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-091407d3-19b8-4fda-b788-886996f35097 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:29.444104 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-091407d3-19b8-4fda-b788-886996f35097 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:29.603240 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-091407d3-19b8-4fda-b788-886996f35097 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:29.613298 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-091407d3-19b8-4fda-b788-886996f35097 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1548 microversion: 2.1 time: 0.187820 Jul 20 05:11:29.614225 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3502/7239] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:29 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1548 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:29.629334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-70ff3676-a21f-44ad-900b-5acc0657d4b8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:29.633018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-70ff3676-a21f-44ad-900b-5acc0657d4b8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:29.633788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-70ff3676-a21f-44ad-900b-5acc0657d4b8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Searching by: {'deleted': False, 'project_id': 'b081448fa8564c72b3c9276382a825a4'} {{(pid=127871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 05:11:29.639472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70ff3676-a21f-44ad-900b-5acc0657d4b8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:29.639923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70ff3676-a21f-44ad-900b-5acc0657d4b8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:29.640767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70ff3676-a21f-44ad-900b-5acc0657d4b8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:29.641207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-70ff3676-a21f-44ad-900b-5acc0657d4b8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:29.667940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.multi_cell_list [None req-70ff3676-a21f-44ad-900b-5acc0657d4b8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 05:11:29.695672 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-70ff3676-a21f-44ad-900b-5acc0657d4b8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070210 Jul 20 05:11:29.696289 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3738/7240] 10.222.0.17 () {58 vars in 1124 bytes} [Wed Jul 20 05:11:29 2022] GET /compute/v2.1/servers => generated 343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:29.707161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f1137e0f-7543-4a88-894a-a9ac088a6bb6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:29.707786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f1137e0f-7543-4a88-894a-a9ac088a6bb6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:29.714642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1137e0f-7543-4a88-894a-a9ac088a6bb6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:29.715103 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1137e0f-7543-4a88-894a-a9ac088a6bb6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:29.715872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1137e0f-7543-4a88-894a-a9ac088a6bb6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:29.716355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1137e0f-7543-4a88-894a-a9ac088a6bb6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:29.858297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f1137e0f-7543-4a88-894a-a9ac088a6bb6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:29.867166 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f1137e0f-7543-4a88-894a-a9ac088a6bb6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1548 microversion: 2.1 time: 0.164025 Jul 20 05:11:29.867773 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3503/7241] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:29 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:31.434735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1e8ba783-a351-4a47-b266-526009fc63d7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3082e61e-3c64-4602-a160-21f58699c5cb"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:31.435814 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1e8ba783-a351-4a47-b266-526009fc63d7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:31.443635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e8ba783-a351-4a47-b266-526009fc63d7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:31.444091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e8ba783-a351-4a47-b266-526009fc63d7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:31.444908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e8ba783-a351-4a47-b266-526009fc63d7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:31.445342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e8ba783-a351-4a47-b266-526009fc63d7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:31.705350 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1e8ba783-a351-4a47-b266-526009fc63d7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "POST /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274639 Jul 20 05:11:31.705976 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3739/7242] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 05:11:31 2022] POST /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:44.782583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0711f749-c3bb-4f20-9e31-78a6eea3cb19 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:44.783177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0711f749-c3bb-4f20-9e31-78a6eea3cb19 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:44.785592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:44.786276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=60 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:44.792483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0711f749-c3bb-4f20-9e31-78a6eea3cb19 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:44.792943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0711f749-c3bb-4f20-9e31-78a6eea3cb19 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:44.793718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0711f749-c3bb-4f20-9e31-78a6eea3cb19 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:44.794166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0711f749-c3bb-4f20-9e31-78a6eea3cb19 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:44.940747 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0711f749-c3bb-4f20-9e31-78a6eea3cb19 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:44.950079 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0711f749-c3bb-4f20-9e31-78a6eea3cb19 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1594 microversion: 2.1 time: 0.171681 Jul 20 05:11:44.950687 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3504/7243] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:44 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1594 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:47.081577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:47.082514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:47.083312 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:47.090939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-73b20e46-884c-4af9-a891-86a3247e269d req-83414851-fe35-4076-a673-595d109b4400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db58b0f-fe5b-4546-8e0d-4ed7a60044c1", "tag": "a711e382-20e2-4f9b-ad83-92285cfce315"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:47.101580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-73b20e46-884c-4af9-a891-86a3247e269d req-83414851-fe35-4076-a673-595d109b4400 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:47.102120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-73b20e46-884c-4af9-a891-86a3247e269d req-83414851-fe35-4076-a673-595d109b4400 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:47.119109 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-73b20e46-884c-4af9-a891-86a3247e269d req-83414851-fe35-4076-a673-595d109b4400 service nova] Creating event network-changed:a711e382-20e2-4f9b-ad83-92285cfce315 for instance 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 on n-h1-826526-5 Jul 20 05:11:47.125698 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-73b20e46-884c-4af9-a891-86a3247e269d req-83414851-fe35-4076-a673-595d109b4400 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046584 Jul 20 05:11:47.126888 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3740/7244] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:11:48.275929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-569a419c-3f4a-4743-81a5-395f3c7619ae tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-616556869"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:48.276540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-569a419c-3f4a-4743-81a5-395f3c7619ae tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:48.284105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-569a419c-3f4a-4743-81a5-395f3c7619ae tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:48.284600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-569a419c-3f4a-4743-81a5-395f3c7619ae tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:48.285429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-569a419c-3f4a-4743-81a5-395f3c7619ae tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:48.285873 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-569a419c-3f4a-4743-81a5-395f3c7619ae tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:48.425607 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.network.security_group_api [None req-569a419c-3f4a-4743-81a5-395f3c7619ae tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Adding security group acebfa5c-fd0d-4cc6-aca9-1301aa7b71b2 to port a711e382-20e2-4f9b-ad83-92285cfce315 Jul 20 05:11:48.799986 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-569a419c-3f4a-4743-81a5-395f3c7619ae tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "POST /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/action" status: 202 len: 0 microversion: 2.1 time: 0.528145 Jul 20 05:11:48.800956 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3505/7245] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:11:48 2022] POST /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:11:48.812199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-73dd33fb-305b-4498-a4c0-7a1960518feb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:48.814595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-73dd33fb-305b-4498-a4c0-7a1960518feb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:48.814823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-45252ef2-0281-4018-b0f2-c5721e93892b req-6c776182-a748-4245-8585-cbc063ea95b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db58b0f-fe5b-4546-8e0d-4ed7a60044c1", "tag": "a711e382-20e2-4f9b-ad83-92285cfce315"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:48.824586 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-45252ef2-0281-4018-b0f2-c5721e93892b req-6c776182-a748-4245-8585-cbc063ea95b8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:48.825333 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-45252ef2-0281-4018-b0f2-c5721e93892b req-6c776182-a748-4245-8585-cbc063ea95b8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:48.827204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73dd33fb-305b-4498-a4c0-7a1960518feb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:48.828802 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73dd33fb-305b-4498-a4c0-7a1960518feb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:48.829737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73dd33fb-305b-4498-a4c0-7a1960518feb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:48.830986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-73dd33fb-305b-4498-a4c0-7a1960518feb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:48.863167 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-45252ef2-0281-4018-b0f2-c5721e93892b req-6c776182-a748-4245-8585-cbc063ea95b8 service nova] Creating event network-changed:a711e382-20e2-4f9b-ad83-92285cfce315 for instance 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 on n-h1-826526-5 Jul 20 05:11:48.872045 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-45252ef2-0281-4018-b0f2-c5721e93892b req-6c776182-a748-4245-8585-cbc063ea95b8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062199 Jul 20 05:11:48.874877 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3506/7246] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:49.044642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-73dd33fb-305b-4498-a4c0-7a1960518feb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:49.056518 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-73dd33fb-305b-4498-a4c0-7a1960518feb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1759 microversion: 2.1 time: 0.250009 Jul 20 05:11:49.057411 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3741/7247] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:48 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1759 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:13:27.073896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:13:27.074659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=12 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:13:27.079819 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c4de1ac7-d767-4673-9c9d-8d4f183bed03 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:13:27.080949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c4de1ac7-d767-4673-9c9d-8d4f183bed03 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:27.088209 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4de1ac7-d767-4673-9c9d-8d4f183bed03 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:27.088709 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4de1ac7-d767-4673-9c9d-8d4f183bed03 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:27.089494 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4de1ac7-d767-4673-9c9d-8d4f183bed03 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:27.089945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4de1ac7-d767-4673-9c9d-8d4f183bed03 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:27.166432 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c4de1ac7-d767-4673-9c9d-8d4f183bed03 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "POST /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/action" status: 202 len: 0 microversion: 2.1 time: 0.094958 Jul 20 05:13:27.167339 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3507/7248] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:13:27 2022] POST /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:13:27.174024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:13:27.174937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=8 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:13:27.179366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-423dce0d-03ec-4510-bb5e-71894272aa2c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:27.180094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-423dce0d-03ec-4510-bb5e-71894272aa2c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:27.188736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-423dce0d-03ec-4510-bb5e-71894272aa2c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:27.189289 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-423dce0d-03ec-4510-bb5e-71894272aa2c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:27.190158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-423dce0d-03ec-4510-bb5e-71894272aa2c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:27.190758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-423dce0d-03ec-4510-bb5e-71894272aa2c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:27.469221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-423dce0d-03ec-4510-bb5e-71894272aa2c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:27.477861 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-423dce0d-03ec-4510-bb5e-71894272aa2c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1761 microversion: 2.1 time: 0.305899 Jul 20 05:13:27.478542 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3742/7249] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:27 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1761 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:13:28.498216 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c105f268-a990-4e49-9b2f-277b3c911e6d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:28.499233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c105f268-a990-4e49-9b2f-277b3c911e6d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:28.510262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c105f268-a990-4e49-9b2f-277b3c911e6d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:28.510902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c105f268-a990-4e49-9b2f-277b3c911e6d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:28.512223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c105f268-a990-4e49-9b2f-277b3c911e6d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:28.513063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c105f268-a990-4e49-9b2f-277b3c911e6d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:28.730582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c105f268-a990-4e49-9b2f-277b3c911e6d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:28.739186 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c105f268-a990-4e49-9b2f-277b3c911e6d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1759 microversion: 2.1 time: 0.247610 Jul 20 05:13:28.739770 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3508/7250] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:28 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1759 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:13:55.258217 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:13:55.259075 n-d-826526-5 devstack@n-api.service[127870]: Wed Jul 20 05:13:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:13:55.300107 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:13:55.300347 n-d-826526-5 devstack@n-api.service[127870]: Wed Jul 20 05:13:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:13:57.201041 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:13:57.201635 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:13:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:14:01.715679 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:14:01.716520 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:14:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:14:08.682697 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:14:08.683635 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:14:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:14:41.723351 n-d-826526-5 devstack@n-api.service[127871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [18f52317-25d4-47c7-8a42-88d448614a79] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:14:41.724149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:41.724551 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:41.728707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0d9ac7e2-160d-4ce6-a12f-80daded0cde9 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-616556869"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:14:41.729247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0d9ac7e2-160d-4ce6-a12f-80daded0cde9 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:41.738319 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d9ac7e2-160d-4ce6-a12f-80daded0cde9 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:41.738767 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d9ac7e2-160d-4ce6-a12f-80daded0cde9 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:41.739794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d9ac7e2-160d-4ce6-a12f-80daded0cde9 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:41.740652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d9ac7e2-160d-4ce6-a12f-80daded0cde9 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:41.893715 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.network.security_group_api [None req-0d9ac7e2-160d-4ce6-a12f-80daded0cde9 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Removing security group acebfa5c-fd0d-4cc6-aca9-1301aa7b71b2 from port a711e382-20e2-4f9b-ad83-92285cfce315 Jul 20 05:14:42.297350 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0d9ac7e2-160d-4ce6-a12f-80daded0cde9 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "POST /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/action" status: 202 len: 0 microversion: 2.1 time: 0.580112 Jul 20 05:14:42.298230 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3743/7251] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:14:41 2022] POST /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:14:42.311753 n-d-826526-5 devstack@n-api.service[127870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b840de8d-74a7-4811-99d3-e95c689ad04d] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:14:42.312422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:42.313393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:42.404410 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-292c2693-a462-41d5-bbb7-90e62e3cba26 req-a7f63f0c-6e14-4469-88bc-2d0aa3bd2ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db58b0f-fe5b-4546-8e0d-4ed7a60044c1", "tag": "a711e382-20e2-4f9b-ad83-92285cfce315"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:14:42.414258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-292c2693-a462-41d5-bbb7-90e62e3cba26 req-a7f63f0c-6e14-4469-88bc-2d0aa3bd2ad0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:42.414988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-292c2693-a462-41d5-bbb7-90e62e3cba26 req-a7f63f0c-6e14-4469-88bc-2d0aa3bd2ad0 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:42.428948 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-292c2693-a462-41d5-bbb7-90e62e3cba26 req-a7f63f0c-6e14-4469-88bc-2d0aa3bd2ad0 service nova] Creating event network-changed:a711e382-20e2-4f9b-ad83-92285cfce315 for instance 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 on n-h1-826526-5 Jul 20 05:14:42.436832 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-292c2693-a462-41d5-bbb7-90e62e3cba26 req-a7f63f0c-6e14-4469-88bc-2d0aa3bd2ad0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130615 Jul 20 05:14:42.438255 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3509/7252] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:14:43.537269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f617bd38-b58d-4593-8e06-ea1618f8eb7e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:43.538101 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f617bd38-b58d-4593-8e06-ea1618f8eb7e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:43.544983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f617bd38-b58d-4593-8e06-ea1618f8eb7e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:43.545431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f617bd38-b58d-4593-8e06-ea1618f8eb7e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:43.546204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f617bd38-b58d-4593-8e06-ea1618f8eb7e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:43.546646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f617bd38-b58d-4593-8e06-ea1618f8eb7e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:43.552209 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] [18f52317-25d4-47c7-8a42-88d448614a79] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 39066. Jul 20 05:14:43.630413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-f617bd38-b58d-4593-8e06-ea1618f8eb7e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lazy-loading 'services' on Instance uuid 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:14:43.704376 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f617bd38-b58d-4593-8e06-ea1618f8eb7e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments/3082e61e-3c64-4602-a160-21f58699c5cb" status: 202 len: 0 microversion: 2.1 time: 0.172081 Jul 20 05:14:43.705204 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3744/7253] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 05:14:43 2022] DELETE /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments/3082e61e-3c64-4602-a160-21f58699c5cb => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:14:43.713951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-33c55832-9e0b-49cd-a2bf-3f2290cabfd4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:43.715007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-33c55832-9e0b-49cd-a2bf-3f2290cabfd4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:43.722944 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33c55832-9e0b-49cd-a2bf-3f2290cabfd4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:43.723419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33c55832-9e0b-49cd-a2bf-3f2290cabfd4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:43.724498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33c55832-9e0b-49cd-a2bf-3f2290cabfd4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:43.724672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33c55832-9e0b-49cd-a2bf-3f2290cabfd4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:43.747328 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] [b840de8d-74a7-4811-99d3-e95c689ad04d] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 39074. Jul 20 05:14:43.761365 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-33c55832-9e0b-49cd-a2bf-3f2290cabfd4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051674 Jul 20 05:14:43.761952 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3510/7254] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:14:43 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:14:44.454091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-7ed16865-66da-4310-89df-bfa50b9dd889 req-a1ff306f-617f-431a-81eb-8bd1e3f05c78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db58b0f-fe5b-4546-8e0d-4ed7a60044c1", "tag": "a711e382-20e2-4f9b-ad83-92285cfce315"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:14:44.463706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7ed16865-66da-4310-89df-bfa50b9dd889 req-a1ff306f-617f-431a-81eb-8bd1e3f05c78 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:44.464186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7ed16865-66da-4310-89df-bfa50b9dd889 req-a1ff306f-617f-431a-81eb-8bd1e3f05c78 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:44.477044 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-7ed16865-66da-4310-89df-bfa50b9dd889 req-a1ff306f-617f-431a-81eb-8bd1e3f05c78 service nova] Creating event network-changed:a711e382-20e2-4f9b-ad83-92285cfce315 for instance 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 on n-h1-826526-5 Jul 20 05:14:44.482678 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-7ed16865-66da-4310-89df-bfa50b9dd889 req-a1ff306f-617f-431a-81eb-8bd1e3f05c78 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032496 Jul 20 05:14:44.483981 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3745/7255] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:14:44.773860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5c6d7091-f8e9-4fbb-a4f9-8bdc7871b085 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:44.775166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5c6d7091-f8e9-4fbb-a4f9-8bdc7871b085 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:44.783171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c6d7091-f8e9-4fbb-a4f9-8bdc7871b085 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:44.784006 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c6d7091-f8e9-4fbb-a4f9-8bdc7871b085 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:44.785005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c6d7091-f8e9-4fbb-a4f9-8bdc7871b085 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:44.785518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c6d7091-f8e9-4fbb-a4f9-8bdc7871b085 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:44.817201 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5c6d7091-f8e9-4fbb-a4f9-8bdc7871b085 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047359 Jul 20 05:14:44.821271 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3511/7256] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:14:44 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:14:45.832386 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3ab95aff-f003-4a35-9703-cf12e6bc3288 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:45.833445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3ab95aff-f003-4a35-9703-cf12e6bc3288 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:45.840461 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ab95aff-f003-4a35-9703-cf12e6bc3288 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:45.840917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ab95aff-f003-4a35-9703-cf12e6bc3288 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:45.841744 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ab95aff-f003-4a35-9703-cf12e6bc3288 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:45.842206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3ab95aff-f003-4a35-9703-cf12e6bc3288 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:45.872107 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3ab95aff-f003-4a35-9703-cf12e6bc3288 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045187 Jul 20 05:14:45.872708 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3746/7257] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:14:45 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:14:46.884137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b6f78a5a-3744-4704-a4e9-ced0ff44fda0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:46.885026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b6f78a5a-3744-4704-a4e9-ced0ff44fda0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:46.892247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6f78a5a-3744-4704-a4e9-ced0ff44fda0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:46.892778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6f78a5a-3744-4704-a4e9-ced0ff44fda0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:46.893567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6f78a5a-3744-4704-a4e9-ced0ff44fda0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:46.894030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6f78a5a-3744-4704-a4e9-ced0ff44fda0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:46.925538 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b6f78a5a-3744-4704-a4e9-ced0ff44fda0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045431 Jul 20 05:14:46.925990 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3512/7258] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:14:46 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:14:47.937640 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-94a8183f-6966-4f1c-b00a-e3425d05e365 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:47.938595 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-94a8183f-6966-4f1c-b00a-e3425d05e365 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:47.946099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-94a8183f-6966-4f1c-b00a-e3425d05e365 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:47.946546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-94a8183f-6966-4f1c-b00a-e3425d05e365 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:47.947325 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-94a8183f-6966-4f1c-b00a-e3425d05e365 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:47.947760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-94a8183f-6966-4f1c-b00a-e3425d05e365 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:47.982505 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-94a8183f-6966-4f1c-b00a-e3425d05e365 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048863 Jul 20 05:14:47.983362 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3747/7259] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:14:47 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:14:48.999675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7f704de1-8cc7-4f4e-8e44-cbf429442232 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:49.001147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7f704de1-8cc7-4f4e-8e44-cbf429442232 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:49.009335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f704de1-8cc7-4f4e-8e44-cbf429442232 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:49.009823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f704de1-8cc7-4f4e-8e44-cbf429442232 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:49.010615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f704de1-8cc7-4f4e-8e44-cbf429442232 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:49.011063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f704de1-8cc7-4f4e-8e44-cbf429442232 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:49.041690 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7f704de1-8cc7-4f4e-8e44-cbf429442232 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049098 Jul 20 05:14:49.042267 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3513/7260] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:14:48 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 05:14:49.055198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b2918aa-a5a8-44af-8380-23edd3eef394 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:49.055742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9b2918aa-a5a8-44af-8380-23edd3eef394 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:49.065607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b2918aa-a5a8-44af-8380-23edd3eef394 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:49.066053 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b2918aa-a5a8-44af-8380-23edd3eef394 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:49.066860 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b2918aa-a5a8-44af-8380-23edd3eef394 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:49.067307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9b2918aa-a5a8-44af-8380-23edd3eef394 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:49.159398 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-9b2918aa-a5a8-44af-8380-23edd3eef394 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] HTTP exception thrown: Instance 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 is not attached to volume 3082e61e-3c64-4602-a160-21f58699c5cb Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b2918aa-a5a8-44af-8380-23edd3eef394 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Request method failure captured: Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments/3082e61e-3c64-4602-a160-21f58699c5cb HTTP/1.1 Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi145f5LgL7UUnpblNTobYZKKGD-AZxO8z19DTurU4K9rrF99wa9HkwFU5ZA7xMEfTV472Hnzo4Q6YOMDVSy8OX74yXoyUQkyRwlseTBuDJibRZGZv_qdB8n35V8wCHHrs6mtfhyHFnNV2kWFOUUS-iwewA4O1rXS64MJX8DmpFMMn994 Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b081448fa8564c72b3c9276382a825a4 Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestMinimumBasicScenario-1987827669 Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b081448fa8564c72b3c9276382a825a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b081448fa8564c72b3c9276382a825a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b081448fa8564c72b3c9276382a825a4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b081448fa8564c72b3c9276382a825a4"}]}] Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestMinimumBasicScenario-1987827669 Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b081448fa8564c72b3c9276382a825a4 Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1987827669 Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestMinimumBasicScenario-1987827669-project Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 4ca155584b04400e9c95b4f17a4461f6 Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestMinimumBasicScenario-1987827669-project Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 is not attached to volume 3082e61e-3c64-4602-a160-21f58699c5cb Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'server_id': '8db58b0f-fe5b-4546-8e0d-4ed7a60044c1', 'id': '3082e61e-3c64-4602-a160-21f58699c5cb'} Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3082e61e-3c64-4602-a160-21f58699c5cb. Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 is not attached to volume 3082e61e-3c64-4602-a160-21f58699c5cb Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:14:49.161494 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:14:49.165854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:14:49.165854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:14:49.165854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 is not attached to volume 3082e61e-3c64-4602-a160-21f58699c5cb Jul 20 05:14:49.165854 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:14:49.165854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9b2918aa-a5a8-44af-8380-23edd3eef394 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Returning 404 to user: Instance 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 is not attached to volume 3082e61e-3c64-4602-a160-21f58699c5cb {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:14:49.165854 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9b2918aa-a5a8-44af-8380-23edd3eef394 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments/3082e61e-3c64-4602-a160-21f58699c5cb" status: 404 len: 154 microversion: 2.1 time: 0.114272 Jul 20 05:14:49.165854 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3748/7261] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 05:14:49 2022] DELETE /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1/os-volume_attachments/3082e61e-3c64-4602-a160-21f58699c5cb => generated 154 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:14:52.414224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-20dbfb86-4a49-44f4-9219-ae3a933afbe2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:52.414804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-20dbfb86-4a49-44f4-9219-ae3a933afbe2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:52.422423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-20dbfb86-4a49-44f4-9219-ae3a933afbe2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:52.422972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-20dbfb86-4a49-44f4-9219-ae3a933afbe2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:52.423924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-20dbfb86-4a49-44f4-9219-ae3a933afbe2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:52.424423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-20dbfb86-4a49-44f4-9219-ae3a933afbe2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:52.451532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-20dbfb86-4a49-44f4-9219-ae3a933afbe2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:14:52.530717 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-20dbfb86-4a49-44f4-9219-ae3a933afbe2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 204 len: 0 microversion: 2.1 time: 0.120251 Jul 20 05:14:52.531334 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3514/7262] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:14:52 2022] DELETE /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:14:52.540561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4b8db6a3-ea3b-4a37-95a3-dde20ae9872d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:52.541183 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4b8db6a3-ea3b-4a37-95a3-dde20ae9872d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:52.548851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b8db6a3-ea3b-4a37-95a3-dde20ae9872d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:52.549306 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b8db6a3-ea3b-4a37-95a3-dde20ae9872d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:52.550088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b8db6a3-ea3b-4a37-95a3-dde20ae9872d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:52.550488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b8db6a3-ea3b-4a37-95a3-dde20ae9872d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:52.697651 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4b8db6a3-ea3b-4a37-95a3-dde20ae9872d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:52.705927 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4b8db6a3-ea3b-4a37-95a3-dde20ae9872d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1554 microversion: 2.1 time: 0.169471 Jul 20 05:14:52.706441 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3749/7263] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:52 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:53.729634 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c7f94d78-5ed6-42eb-88cc-c1bf26445ab2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:53.730824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c7f94d78-5ed6-42eb-88cc-c1bf26445ab2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:53.743965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7f94d78-5ed6-42eb-88cc-c1bf26445ab2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:53.744793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7f94d78-5ed6-42eb-88cc-c1bf26445ab2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:53.746111 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7f94d78-5ed6-42eb-88cc-c1bf26445ab2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:53.746984 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7f94d78-5ed6-42eb-88cc-c1bf26445ab2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:53.890635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c7f94d78-5ed6-42eb-88cc-c1bf26445ab2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:53.899464 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c7f94d78-5ed6-42eb-88cc-c1bf26445ab2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1554 microversion: 2.1 time: 0.177756 Jul 20 05:14:53.900067 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3515/7264] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:53 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:54.643490 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-141a06ea-970a-4d56-b41e-90a65f9a8f23 req-b175555d-db0a-4028-9af0-9e84ae26e106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db58b0f-fe5b-4546-8e0d-4ed7a60044c1", "name": "network-vif-deleted", "tag": "a711e382-20e2-4f9b-ad83-92285cfce315"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:14:54.658610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-141a06ea-970a-4d56-b41e-90a65f9a8f23 req-b175555d-db0a-4028-9af0-9e84ae26e106 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:54.659063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-141a06ea-970a-4d56-b41e-90a65f9a8f23 req-b175555d-db0a-4028-9af0-9e84ae26e106 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:54.671215 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-141a06ea-970a-4d56-b41e-90a65f9a8f23 req-b175555d-db0a-4028-9af0-9e84ae26e106 service nova] Creating event network-vif-deleted:a711e382-20e2-4f9b-ad83-92285cfce315 for instance 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 on n-h1-826526-5 Jul 20 05:14:54.676220 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-141a06ea-970a-4d56-b41e-90a65f9a8f23 req-b175555d-db0a-4028-9af0-9e84ae26e106 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107866 Jul 20 05:14:54.676958 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3750/7265] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:14:54.916748 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9cfd9ea0-3c28-4aa3-888a-6674b7ca3557 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:54.917357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9cfd9ea0-3c28-4aa3-888a-6674b7ca3557 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:54.925237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cfd9ea0-3c28-4aa3-888a-6674b7ca3557 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:54.925714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cfd9ea0-3c28-4aa3-888a-6674b7ca3557 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:54.926531 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cfd9ea0-3c28-4aa3-888a-6674b7ca3557 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:54.926997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cfd9ea0-3c28-4aa3-888a-6674b7ca3557 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:54.962584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cfd9ea0-3c28-4aa3-888a-6674b7ca3557 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:54.963343 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cfd9ea0-3c28-4aa3-888a-6674b7ca3557 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:54.963790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-9cfd9ea0-3c28-4aa3-888a-6674b7ca3557 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lazy-loading 'fault' on Instance uuid 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:14:55.011207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9cfd9ea0-3c28-4aa3-888a-6674b7ca3557 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:55.025096 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9cfd9ea0-3c28-4aa3-888a-6674b7ca3557 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 200 len: 1348 microversion: 2.1 time: 0.112298 Jul 20 05:14:55.025945 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3516/7266] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:54 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 1348 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:56.045514 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fee2541d-002b-44ff-bbc4-3e34e0a3ecee tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:56.046089 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fee2541d-002b-44ff-bbc4-3e34e0a3ecee tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:56.053255 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fee2541d-002b-44ff-bbc4-3e34e0a3ecee tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:56.053707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fee2541d-002b-44ff-bbc4-3e34e0a3ecee tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:56.054494 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fee2541d-002b-44ff-bbc4-3e34e0a3ecee tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:56.054930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fee2541d-002b-44ff-bbc4-3e34e0a3ecee tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:56.070968 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-fee2541d-002b-44ff-bbc4-3e34e0a3ecee tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] HTTP exception thrown: Instance 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 could not be found. Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fee2541d-002b-44ff-bbc4-3e34e0a3ecee tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Request method failure captured: Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 HTTP/1.1 Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi145f5LgL7UUnpblNTobYZKKGD-AZxO8z19DTurU4K9rrF99wa9HkwFU5ZA7xMEfTV472Hnzo4Q6YOMDVSy8OX74yXoyUQkyRwlseTBuDJibRZGZv_qdB8n35V8wCHHrs6mtfhyHFnNV2kWFOUUS-iwewA4O1rXS64MJX8DmpFMMn994 Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b081448fa8564c72b3c9276382a825a4 Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestMinimumBasicScenario-1987827669 Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b081448fa8564c72b3c9276382a825a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b081448fa8564c72b3c9276382a825a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b081448fa8564c72b3c9276382a825a4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b081448fa8564c72b3c9276382a825a4"}]}] Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestMinimumBasicScenario-1987827669 Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b081448fa8564c72b3c9276382a825a4 Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1987827669 Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestMinimumBasicScenario-1987827669-project Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 4ca155584b04400e9c95b4f17a4461f6 Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestMinimumBasicScenario-1987827669-project Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 could not be found. Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '8db58b0f-fe5b-4546-8e0d-4ed7a60044c1'} Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 could not be found. Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 could not be found. Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:14:56.073652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:14:56.078401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:14:56.078401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:14:56.078401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:14:56.078401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:14:56.078401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:14:56.078401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 could not be found. Jul 20 05:14:56.078401 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:14:56.078401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fee2541d-002b-44ff-bbc4-3e34e0a3ecee tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Returning 404 to user: Instance 8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:14:56.078401 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fee2541d-002b-44ff-bbc4-3e34e0a3ecee tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1" status: 404 len: 111 microversion: 2.1 time: 0.035213 Jul 20 05:14:56.078401 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3751/7267] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:56 2022] GET /compute/v2.1/servers/8db58b0f-fe5b-4546-8e0d-4ed7a60044c1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:14:56.086233 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f65d50c4-2e8b-4f64-8478-c562e917fcb2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '.version_select at 0x7f06be86baf0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:56.117540 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f65d50c4-2e8b-4f64-8478-c562e917fcb2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-403244640" status: 202 len: 0 microversion: 2.1 time: 0.035147 Jul 20 05:14:56.118193 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3517/7268] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 05:14:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-403244640 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:15:04.945060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-35640867-d04c-4f44-bf06-64ee1a81c27e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Action: 'create', calling method: .version_select at 0x7f06bd286700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-481006089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnv94hvujY8PXQGK0REC9bGpjNNch3owUQWXFPHBhyNE0EOXwp9tiTShpoW7BXAFUPqlCBmkA0CDekopmDQ1hp+tL6MuX90tcY+tA1MGs1VFbmvhw3/08eHfFqbWOWooA=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:04.959937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-35640867-d04c-4f44-bf06-64ee1a81c27e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Getting quotas for project b081448fa8564c72b3c9276382a825a4. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:15:04.966013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-35640867-d04c-4f44-bf06-64ee1a81c27e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Getting quotas for user 4ca155584b04400e9c95b4f17a4461f6 and project b081448fa8564c72b3c9276382a825a4. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:15:04.995063 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-35640867-d04c-4f44-bf06-64ee1a81c27e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053900 Jul 20 05:15:04.995696 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3752/7269] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 05:15:04 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:05.046537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:05.051591 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e5333d47-af3e-42c0-a52c-a7880b7badf8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1108958897", "imageRef": "1f53db53-92a6-4815-836d-1c99c462620a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-481006089", "networks": [{"uuid": "10e32802-7142-489b-8fb3-aed8f1146518"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:05.106715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-e5333d47-af3e-42c0-a52c-a7880b7badf8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] validate_networks() for [('10e32802-7142-489b-8fb3-aed8f1146518', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:15:05.906927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e5333d47-af3e-42c0-a52c-a7880b7badf8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:15:05.907371 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e5333d47-af3e-42c0-a52c-a7880b7badf8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:15:05.907863 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e5333d47-af3e-42c0-a52c-a7880b7badf8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:15:05.908300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e5333d47-af3e-42c0-a52c-a7880b7badf8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:15:05.908741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-e5333d47-af3e-42c0-a52c-a7880b7badf8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:15:05.918381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5333d47-af3e-42c0-a52c-a7880b7badf8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:05.918843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5333d47-af3e-42c0-a52c-a7880b7badf8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:05.919683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5333d47-af3e-42c0-a52c-a7880b7badf8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:05.920127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5333d47-af3e-42c0-a52c-a7880b7badf8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:05.940783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-e5333d47-af3e-42c0-a52c-a7880b7badf8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Getting quotas for project b081448fa8564c72b3c9276382a825a4. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:15:05.946061 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-e5333d47-af3e-42c0-a52c-a7880b7badf8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Getting quotas for user 4ca155584b04400e9c95b4f17a4461f6 and project b081448fa8564c72b3c9276382a825a4. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:15:05.958276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e5333d47-af3e-42c0-a52c-a7880b7badf8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:15:05.960636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e5333d47-af3e-42c0-a52c-a7880b7badf8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f53db53-92a6-4815-836d-1c99c462620a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:15:06.008176 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e5333d47-af3e-42c0-a52c-a7880b7badf8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.963664 Jul 20 05:15:06.008885 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3518/7270] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:15:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:15:06.020581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1b70345c-05d5-469f-87b5-0edc8cc45318 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:06.021588 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1b70345c-05d5-469f-87b5-0edc8cc45318 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:06.059685 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:06.077989 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1b70345c-05d5-469f-87b5-0edc8cc45318 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:06.085308 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1b70345c-05d5-469f-87b5-0edc8cc45318 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1258 microversion: 2.1 time: 0.070071 Jul 20 05:15:06.085878 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3753/7271] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:06 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:07.104158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9249b756-254d-46ef-9c5e-7cfc7be27a27 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:07.104920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9249b756-254d-46ef-9c5e-7cfc7be27a27 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:07.162769 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9249b756-254d-46ef-9c5e-7cfc7be27a27 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:07.172046 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9249b756-254d-46ef-9c5e-7cfc7be27a27 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1258 microversion: 2.1 time: 0.072876 Jul 20 05:15:07.173034 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3519/7272] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:07 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:08.195492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-87d1ac47-65e9-47e8-8c54-9b42c9e44a6b tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:08.196283 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-87d1ac47-65e9-47e8-8c54-9b42c9e44a6b tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:08.256294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-87d1ac47-65e9-47e8-8c54-9b42c9e44a6b tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:08.263352 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-87d1ac47-65e9-47e8-8c54-9b42c9e44a6b tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1258 microversion: 2.1 time: 0.073287 Jul 20 05:15:08.263833 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3754/7273] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:08 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:09.283625 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9aeda85b-600a-4031-86cd-cd32a90cc8a5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:09.284230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9aeda85b-600a-4031-86cd-cd32a90cc8a5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:09.338672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9aeda85b-600a-4031-86cd-cd32a90cc8a5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:09.345814 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9aeda85b-600a-4031-86cd-cd32a90cc8a5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1258 microversion: 2.1 time: 0.068426 Jul 20 05:15:09.346421 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3520/7274] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:09 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:10.365052 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-358cb20c-13ab-4860-8f09-68cccdf00e25 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:10.365620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-358cb20c-13ab-4860-8f09-68cccdf00e25 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:10.375083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-358cb20c-13ab-4860-8f09-68cccdf00e25 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:10.375529 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-358cb20c-13ab-4860-8f09-68cccdf00e25 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:10.376332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-358cb20c-13ab-4860-8f09-68cccdf00e25 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:10.376799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-358cb20c-13ab-4860-8f09-68cccdf00e25 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:10.451480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-358cb20c-13ab-4860-8f09-68cccdf00e25 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:10.459900 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-358cb20c-13ab-4860-8f09-68cccdf00e25 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1262 microversion: 2.1 time: 0.098989 Jul 20 05:15:10.460543 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3755/7275] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:10 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1262 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:11.477722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-109bcda5-32fd-4685-9d15-bfc72d77b7da tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:11.478458 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-109bcda5-32fd-4685-9d15-bfc72d77b7da tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:11.489387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-109bcda5-32fd-4685-9d15-bfc72d77b7da tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:11.489902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-109bcda5-32fd-4685-9d15-bfc72d77b7da tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:11.490913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-109bcda5-32fd-4685-9d15-bfc72d77b7da tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:11.491599 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-109bcda5-32fd-4685-9d15-bfc72d77b7da tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:12.071205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-109bcda5-32fd-4685-9d15-bfc72d77b7da tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:12.079658 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-109bcda5-32fd-4685-9d15-bfc72d77b7da tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1358 microversion: 2.1 time: 0.606216 Jul 20 05:15:12.080812 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3521/7276] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:11 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1358 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:13.101854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0bb75e44-8add-4465-9ced-fbca76be968e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:13.102430 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0bb75e44-8add-4465-9ced-fbca76be968e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:13.105239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:13.111203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0bb75e44-8add-4465-9ced-fbca76be968e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:13.111673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0bb75e44-8add-4465-9ced-fbca76be968e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:13.112513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0bb75e44-8add-4465-9ced-fbca76be968e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:13.112953 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0bb75e44-8add-4465-9ced-fbca76be968e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:13.262117 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0bb75e44-8add-4465-9ced-fbca76be968e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:13.270264 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0bb75e44-8add-4465-9ced-fbca76be968e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1358 microversion: 2.1 time: 0.173684 Jul 20 05:15:13.270872 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3756/7277] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:13 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:14.289774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-19e6b1a4-3e5b-4188-8f16-09c068bbb7d8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:14.290518 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-19e6b1a4-3e5b-4188-8f16-09c068bbb7d8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:14.293179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:14.298917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19e6b1a4-3e5b-4188-8f16-09c068bbb7d8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:14.299670 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19e6b1a4-3e5b-4188-8f16-09c068bbb7d8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:14.300148 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19e6b1a4-3e5b-4188-8f16-09c068bbb7d8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:14.300620 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-19e6b1a4-3e5b-4188-8f16-09c068bbb7d8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:14.458194 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-19e6b1a4-3e5b-4188-8f16-09c068bbb7d8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:14.470256 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-19e6b1a4-3e5b-4188-8f16-09c068bbb7d8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1358 microversion: 2.1 time: 0.185619 Jul 20 05:15:14.471114 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3522/7278] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:14 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:15.491812 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-89a8f6ba-4b68-421a-956d-5e26e72e81e5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:15.493504 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-89a8f6ba-4b68-421a-956d-5e26e72e81e5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:15.503898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89a8f6ba-4b68-421a-956d-5e26e72e81e5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:15.505111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89a8f6ba-4b68-421a-956d-5e26e72e81e5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:15.505909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89a8f6ba-4b68-421a-956d-5e26e72e81e5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:15.506352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-89a8f6ba-4b68-421a-956d-5e26e72e81e5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:15.653280 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-89a8f6ba-4b68-421a-956d-5e26e72e81e5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:15.661733 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-89a8f6ba-4b68-421a-956d-5e26e72e81e5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1358 microversion: 2.1 time: 0.175901 Jul 20 05:15:15.672051 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3757/7279] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:15 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:16.679198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-96335e81-5ee1-4e49-b64c-928b45b7f50d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:16.679869 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-96335e81-5ee1-4e49-b64c-928b45b7f50d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:16.682704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:16.688635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96335e81-5ee1-4e49-b64c-928b45b7f50d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:16.689105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96335e81-5ee1-4e49-b64c-928b45b7f50d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:16.689902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96335e81-5ee1-4e49-b64c-928b45b7f50d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:16.690334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96335e81-5ee1-4e49-b64c-928b45b7f50d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:16.831859 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-96335e81-5ee1-4e49-b64c-928b45b7f50d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:16.839967 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-96335e81-5ee1-4e49-b64c-928b45b7f50d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1358 microversion: 2.1 time: 0.164822 Jul 20 05:15:16.840616 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3523/7280] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:16 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:17.861458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c5a363a0-c5d8-49fb-9810-20399612bc68 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:17.862299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c5a363a0-c5d8-49fb-9810-20399612bc68 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:17.871308 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5a363a0-c5d8-49fb-9810-20399612bc68 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:17.871759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5a363a0-c5d8-49fb-9810-20399612bc68 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:17.872569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5a363a0-c5d8-49fb-9810-20399612bc68 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:17.873010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c5a363a0-c5d8-49fb-9810-20399612bc68 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:18.022357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c5a363a0-c5d8-49fb-9810-20399612bc68 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:18.030354 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c5a363a0-c5d8-49fb-9810-20399612bc68 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1358 microversion: 2.1 time: 0.175317 Jul 20 05:15:18.030941 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3758/7281] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:17 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:19.047807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fcddaf7e-70a2-43a7-9ac5-f0b1476b3c85 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:19.048417 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fcddaf7e-70a2-43a7-9ac5-f0b1476b3c85 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:19.056001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fcddaf7e-70a2-43a7-9ac5-f0b1476b3c85 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:19.056499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fcddaf7e-70a2-43a7-9ac5-f0b1476b3c85 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:19.057288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fcddaf7e-70a2-43a7-9ac5-f0b1476b3c85 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:19.057744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fcddaf7e-70a2-43a7-9ac5-f0b1476b3c85 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:19.228133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fcddaf7e-70a2-43a7-9ac5-f0b1476b3c85 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:19.237787 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fcddaf7e-70a2-43a7-9ac5-f0b1476b3c85 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1358 microversion: 2.1 time: 0.193974 Jul 20 05:15:19.238391 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3524/7282] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:19 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:20.259589 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-51c72cdf-f344-4c99-bddd-083fb760ee5c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:20.260545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-51c72cdf-f344-4c99-bddd-083fb760ee5c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:20.262215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=8 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:20.269138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51c72cdf-f344-4c99-bddd-083fb760ee5c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:20.269878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51c72cdf-f344-4c99-bddd-083fb760ee5c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:20.270571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51c72cdf-f344-4c99-bddd-083fb760ee5c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:20.271016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51c72cdf-f344-4c99-bddd-083fb760ee5c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:20.411418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-51c72cdf-f344-4c99-bddd-083fb760ee5c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:20.419830 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-51c72cdf-f344-4c99-bddd-083fb760ee5c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1358 microversion: 2.1 time: 0.166949 Jul 20 05:15:20.420639 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3759/7283] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:20 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:21.090125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-d8556afb-fb77-4245-9867-5692be626bfe req-0f392e9e-61be-4525-be07-ccc39d897d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0486f431-b292-4d7e-90ec-2e70a4c45081", "tag": "1380a6d6-b380-4a48-8551-9037ae67d389"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:21.096730 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=10 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:21.113031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d8556afb-fb77-4245-9867-5692be626bfe req-0f392e9e-61be-4525-be07-ccc39d897d48 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:21.114668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-d8556afb-fb77-4245-9867-5692be626bfe req-0f392e9e-61be-4525-be07-ccc39d897d48 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:21.133648 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-d8556afb-fb77-4245-9867-5692be626bfe req-0f392e9e-61be-4525-be07-ccc39d897d48 service nova] Creating event network-changed:1380a6d6-b380-4a48-8551-9037ae67d389 for instance 0486f431-b292-4d7e-90ec-2e70a4c45081 on n-h1-826526-5 Jul 20 05:15:21.142225 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-d8556afb-fb77-4245-9867-5692be626bfe req-0f392e9e-61be-4525-be07-ccc39d897d48 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058086 Jul 20 05:15:21.142867 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3525/7284] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:21.438772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-35fa3129-b14d-40b5-92e0-6ec687657bc6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:21.439450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35fa3129-b14d-40b5-92e0-6ec687657bc6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:21.447038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35fa3129-b14d-40b5-92e0-6ec687657bc6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:21.447488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35fa3129-b14d-40b5-92e0-6ec687657bc6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:21.448252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35fa3129-b14d-40b5-92e0-6ec687657bc6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:21.448743 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35fa3129-b14d-40b5-92e0-6ec687657bc6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:21.596447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-35fa3129-b14d-40b5-92e0-6ec687657bc6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:21.604661 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-35fa3129-b14d-40b5-92e0-6ec687657bc6 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1358 microversion: 2.1 time: 0.171242 Jul 20 05:15:21.605476 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3760/7285] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:21 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:22.624807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-85fd7559-bf22-480d-80ca-5c55c9f1f89d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:22.626179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-85fd7559-bf22-480d-80ca-5c55c9f1f89d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:22.633702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85fd7559-bf22-480d-80ca-5c55c9f1f89d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:22.634248 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85fd7559-bf22-480d-80ca-5c55c9f1f89d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:22.635091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85fd7559-bf22-480d-80ca-5c55c9f1f89d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:22.635492 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85fd7559-bf22-480d-80ca-5c55c9f1f89d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:22.852036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-85fd7559-bf22-480d-80ca-5c55c9f1f89d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:22.860458 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-85fd7559-bf22-480d-80ca-5c55c9f1f89d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1358 microversion: 2.1 time: 0.240983 Jul 20 05:15:22.861075 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3526/7286] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:22 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:23.879370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fdcf0d06-ca54-426b-9485-e465b20da30c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:23.879995 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fdcf0d06-ca54-426b-9485-e465b20da30c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:23.886920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fdcf0d06-ca54-426b-9485-e465b20da30c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:23.887373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fdcf0d06-ca54-426b-9485-e465b20da30c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:23.888166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fdcf0d06-ca54-426b-9485-e465b20da30c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:23.888648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fdcf0d06-ca54-426b-9485-e465b20da30c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:24.031050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fdcf0d06-ca54-426b-9485-e465b20da30c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:24.039386 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fdcf0d06-ca54-426b-9485-e465b20da30c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1358 microversion: 2.1 time: 0.165393 Jul 20 05:15:24.040161 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3761/7287] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:23 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:25.057045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2ab966dc-58ca-4416-b66b-3a245363fdcf tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:25.057667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2ab966dc-58ca-4416-b66b-3a245363fdcf tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:25.065199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ab966dc-58ca-4416-b66b-3a245363fdcf tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:25.065647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ab966dc-58ca-4416-b66b-3a245363fdcf tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:25.066468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ab966dc-58ca-4416-b66b-3a245363fdcf tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:25.066922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ab966dc-58ca-4416-b66b-3a245363fdcf tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:25.213529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2ab966dc-58ca-4416-b66b-3a245363fdcf tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:25.221529 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2ab966dc-58ca-4416-b66b-3a245363fdcf tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1358 microversion: 2.1 time: 0.168483 Jul 20 05:15:25.222145 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3527/7288] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:25 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:26.239055 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e5510b6a-5a8f-4642-b87f-12d9db463970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:26.239774 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e5510b6a-5a8f-4642-b87f-12d9db463970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:26.247590 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5510b6a-5a8f-4642-b87f-12d9db463970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:26.248158 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5510b6a-5a8f-4642-b87f-12d9db463970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:26.249405 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5510b6a-5a8f-4642-b87f-12d9db463970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:26.249865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e5510b6a-5a8f-4642-b87f-12d9db463970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:26.404734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e5510b6a-5a8f-4642-b87f-12d9db463970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:26.413465 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e5510b6a-5a8f-4642-b87f-12d9db463970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1358 microversion: 2.1 time: 0.178522 Jul 20 05:15:26.415105 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3762/7289] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:26 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:26.440605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-2261cb00-9b94-4666-bb31-8f8e0318ec05 req-7a0f6e22-8581-406b-838e-b5d2928099d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0486f431-b292-4d7e-90ec-2e70a4c45081", "name": "network-vif-plugged", "status": "completed", "tag": "1380a6d6-b380-4a48-8551-9037ae67d389"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:26.449346 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2261cb00-9b94-4666-bb31-8f8e0318ec05 req-7a0f6e22-8581-406b-838e-b5d2928099d1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:26.449804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2261cb00-9b94-4666-bb31-8f8e0318ec05 req-7a0f6e22-8581-406b-838e-b5d2928099d1 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:26.463494 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-2261cb00-9b94-4666-bb31-8f8e0318ec05 req-7a0f6e22-8581-406b-838e-b5d2928099d1 service nova] Creating event network-vif-plugged:1380a6d6-b380-4a48-8551-9037ae67d389 for instance 0486f431-b292-4d7e-90ec-2e70a4c45081 on n-h1-826526-5 Jul 20 05:15:26.468882 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-2261cb00-9b94-4666-bb31-8f8e0318ec05 req-7a0f6e22-8581-406b-838e-b5d2928099d1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101612 Jul 20 05:15:26.469502 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3528/7290] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:15:27.432422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c8cecb01-e426-41ae-b09e-1e665f094fd0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:27.433019 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c8cecb01-e426-41ae-b09e-1e665f094fd0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:27.440061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8cecb01-e426-41ae-b09e-1e665f094fd0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:27.440547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8cecb01-e426-41ae-b09e-1e665f094fd0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:27.441310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8cecb01-e426-41ae-b09e-1e665f094fd0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:27.441746 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c8cecb01-e426-41ae-b09e-1e665f094fd0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:27.592287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c8cecb01-e426-41ae-b09e-1e665f094fd0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:27.600436 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c8cecb01-e426-41ae-b09e-1e665f094fd0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1358 microversion: 2.1 time: 0.172338 Jul 20 05:15:27.601044 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3763/7291] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:27 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:28.623416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-856d75c3-b107-4c0c-9478-7b56e82c7839 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:28.624567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-856d75c3-b107-4c0c-9478-7b56e82c7839 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:28.634005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-856d75c3-b107-4c0c-9478-7b56e82c7839 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:28.634847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-856d75c3-b107-4c0c-9478-7b56e82c7839 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:28.635635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-856d75c3-b107-4c0c-9478-7b56e82c7839 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:28.636084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-856d75c3-b107-4c0c-9478-7b56e82c7839 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:28.789016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-856d75c3-b107-4c0c-9478-7b56e82c7839 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:28.797230 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-856d75c3-b107-4c0c-9478-7b56e82c7839 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1548 microversion: 2.1 time: 0.180897 Jul 20 05:15:28.797782 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3529/7292] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:28 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1548 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:28.816692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bcf4ac36-981b-480b-ace7-6bb634520142 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:28.817375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bcf4ac36-981b-480b-ace7-6bb634520142 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:28.827908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bcf4ac36-981b-480b-ace7-6bb634520142 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:28.828532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bcf4ac36-981b-480b-ace7-6bb634520142 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:28.829644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bcf4ac36-981b-480b-ace7-6bb634520142 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:28.830206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bcf4ac36-981b-480b-ace7-6bb634520142 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:28.967442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bcf4ac36-981b-480b-ace7-6bb634520142 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:28.977306 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bcf4ac36-981b-480b-ace7-6bb634520142 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1548 microversion: 2.1 time: 0.167155 Jul 20 05:15:28.977912 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3764/7293] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:28 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:28.996997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6c29b6c2-fc47-4652-9db4-0dd8be8231ed tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:29.002162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6c29b6c2-fc47-4652-9db4-0dd8be8231ed tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:29.004242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6c29b6c2-fc47-4652-9db4-0dd8be8231ed tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Searching by: {'deleted': False, 'project_id': 'b081448fa8564c72b3c9276382a825a4'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 05:15:29.012282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c29b6c2-fc47-4652-9db4-0dd8be8231ed tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:29.012282 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c29b6c2-fc47-4652-9db4-0dd8be8231ed tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:29.012542 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c29b6c2-fc47-4652-9db4-0dd8be8231ed tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:29.012912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c29b6c2-fc47-4652-9db4-0dd8be8231ed tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:29.039381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-6c29b6c2-fc47-4652-9db4-0dd8be8231ed tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 05:15:29.067737 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6c29b6c2-fc47-4652-9db4-0dd8be8231ed tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.077699 Jul 20 05:15:29.068369 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3530/7294] 10.222.0.17 () {58 vars in 1124 bytes} [Wed Jul 20 05:15:28 2022] GET /compute/v2.1/servers => generated 343 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:29.079383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1602dc78-392f-4f75-82ea-ad119318d7c8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:29.080021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1602dc78-392f-4f75-82ea-ad119318d7c8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:29.087073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1602dc78-392f-4f75-82ea-ad119318d7c8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:29.087510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1602dc78-392f-4f75-82ea-ad119318d7c8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:29.088301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1602dc78-392f-4f75-82ea-ad119318d7c8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:29.088766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1602dc78-392f-4f75-82ea-ad119318d7c8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:29.233662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1602dc78-392f-4f75-82ea-ad119318d7c8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:29.241685 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1602dc78-392f-4f75-82ea-ad119318d7c8 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1548 microversion: 2.1 time: 0.166469 Jul 20 05:15:29.242263 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3765/7295] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:29 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:30.762943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5761fe14-f0e7-46a1-b5c5-fe22a8ecf9f7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50888dbc-3c75-4c55-950f-e7c54ba3c566"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:30.764090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5761fe14-f0e7-46a1-b5c5-fe22a8ecf9f7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:30.771381 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5761fe14-f0e7-46a1-b5c5-fe22a8ecf9f7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:30.771843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5761fe14-f0e7-46a1-b5c5-fe22a8ecf9f7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:30.772758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5761fe14-f0e7-46a1-b5c5-fe22a8ecf9f7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:30.773220 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5761fe14-f0e7-46a1-b5c5-fe22a8ecf9f7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:31.031464 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5761fe14-f0e7-46a1-b5c5-fe22a8ecf9f7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "POST /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272552 Jul 20 05:15:31.032149 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3531/7296] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 05:15:30 2022] POST /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:41.791591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f7baf517-d11c-408a-b4e0-c7c44e646157 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:41.792162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f7baf517-d11c-408a-b4e0-c7c44e646157 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:41.794757 n-d-826526-5 devstack@n-api.service[127871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82756c74-7ff1-4946-aaad-2fa7aa912700] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:15:41.795730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=19 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:41.796408 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=66 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:41.801952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7baf517-d11c-408a-b4e0-c7c44e646157 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:41.802406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7baf517-d11c-408a-b4e0-c7c44e646157 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:41.803179 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7baf517-d11c-408a-b4e0-c7c44e646157 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:41.803614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f7baf517-d11c-408a-b4e0-c7c44e646157 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:41.953073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f7baf517-d11c-408a-b4e0-c7c44e646157 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:41.961526 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f7baf517-d11c-408a-b4e0-c7c44e646157 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1594 microversion: 2.1 time: 0.173840 Jul 20 05:15:41.962121 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3766/7297] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:41 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1594 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:43.725508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:43.727318 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=19 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:43.727886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:43.733967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-43147f13-a57b-48b6-8653-9134fd778c23 req-14f61944-ab48-4826-b38c-9d7f7a3dae6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0486f431-b292-4d7e-90ec-2e70a4c45081", "tag": "1380a6d6-b380-4a48-8551-9037ae67d389"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:43.746939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-43147f13-a57b-48b6-8653-9134fd778c23 req-14f61944-ab48-4826-b38c-9d7f7a3dae6d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:43.747508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-43147f13-a57b-48b6-8653-9134fd778c23 req-14f61944-ab48-4826-b38c-9d7f7a3dae6d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:43.762228 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-43147f13-a57b-48b6-8653-9134fd778c23 req-14f61944-ab48-4826-b38c-9d7f7a3dae6d service nova] Creating event network-changed:1380a6d6-b380-4a48-8551-9037ae67d389 for instance 0486f431-b292-4d7e-90ec-2e70a4c45081 on n-h1-826526-5 Jul 20 05:15:43.768189 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-43147f13-a57b-48b6-8653-9134fd778c23 req-14f61944-ab48-4826-b38c-9d7f7a3dae6d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044857 Jul 20 05:15:43.769286 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3532/7298] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:44.744783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4b366aed-2e0f-4c4b-9e45-2d195e29144e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1868958256"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:44.745342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4b366aed-2e0f-4c4b-9e45-2d195e29144e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:44.759690 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] [82756c74-7ff1-4946-aaad-2fa7aa912700] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 39390. Jul 20 05:15:44.761862 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b366aed-2e0f-4c4b-9e45-2d195e29144e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:44.762343 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b366aed-2e0f-4c4b-9e45-2d195e29144e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:44.763144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b366aed-2e0f-4c4b-9e45-2d195e29144e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:44.763580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4b366aed-2e0f-4c4b-9e45-2d195e29144e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:44.900986 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.network.security_group_api [None req-4b366aed-2e0f-4c4b-9e45-2d195e29144e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Adding security group 49a62078-b324-43aa-84e1-c94959d1c6c1 to port 1380a6d6-b380-4a48-8551-9037ae67d389 Jul 20 05:15:45.275635 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4b366aed-2e0f-4c4b-9e45-2d195e29144e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "POST /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/action" status: 202 len: 0 microversion: 2.1 time: 0.534508 Jul 20 05:15:45.277033 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3767/7299] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:15:44 2022] POST /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:15:45.288399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eec0251b-856b-4253-b98b-5b608a89f5ca tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:45.289472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-c2cb3809-3ff7-46e1-be8f-68f225c549af req-6d1a8cf2-a3ad-4c4a-bb55-99da10dec312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0486f431-b292-4d7e-90ec-2e70a4c45081", "tag": "1380a6d6-b380-4a48-8551-9037ae67d389"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:45.290058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eec0251b-856b-4253-b98b-5b608a89f5ca tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:45.309229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c2cb3809-3ff7-46e1-be8f-68f225c549af req-6d1a8cf2-a3ad-4c4a-bb55-99da10dec312 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:45.310015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c2cb3809-3ff7-46e1-be8f-68f225c549af req-6d1a8cf2-a3ad-4c4a-bb55-99da10dec312 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:45.322791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eec0251b-856b-4253-b98b-5b608a89f5ca tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:45.323250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eec0251b-856b-4253-b98b-5b608a89f5ca tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:45.327898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eec0251b-856b-4253-b98b-5b608a89f5ca tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:45.328284 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-c2cb3809-3ff7-46e1-be8f-68f225c549af req-6d1a8cf2-a3ad-4c4a-bb55-99da10dec312 service nova] Creating event network-changed:1380a6d6-b380-4a48-8551-9037ae67d389 for instance 0486f431-b292-4d7e-90ec-2e70a4c45081 on n-h1-826526-5 Jul 20 05:15:45.328622 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eec0251b-856b-4253-b98b-5b608a89f5ca tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:45.335881 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-c2cb3809-3ff7-46e1-be8f-68f225c549af req-6d1a8cf2-a3ad-4c4a-bb55-99da10dec312 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053365 Jul 20 05:15:45.336553 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3768/7300] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:45.966070 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eec0251b-856b-4253-b98b-5b608a89f5ca tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:45.975878 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eec0251b-856b-4253-b98b-5b608a89f5ca tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1760 microversion: 2.1 time: 0.694664 Jul 20 05:15:45.981260 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3533/7301] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:45 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1760 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:01.006009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:01.006778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=12 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:01.058099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c29e4f88-cf10-4b92-a4c1-787b6688a477 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:01.059272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c29e4f88-cf10-4b92-a4c1-787b6688a477 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:01.066233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c29e4f88-cf10-4b92-a4c1-787b6688a477 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:01.066697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c29e4f88-cf10-4b92-a4c1-787b6688a477 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:01.067517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c29e4f88-cf10-4b92-a4c1-787b6688a477 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:01.067964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c29e4f88-cf10-4b92-a4c1-787b6688a477 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:01.150622 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c29e4f88-cf10-4b92-a4c1-787b6688a477 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "POST /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/action" status: 202 len: 0 microversion: 2.1 time: 0.152810 Jul 20 05:16:01.151289 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3769/7302] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:16:00 2022] POST /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:16:01.159631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e4098ed5-6140-4057-9dc6-be2a0d6701f7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:01.160317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e4098ed5-6140-4057-9dc6-be2a0d6701f7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:01.163362 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:01.164029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:01.170755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4098ed5-6140-4057-9dc6-be2a0d6701f7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:01.171224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4098ed5-6140-4057-9dc6-be2a0d6701f7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:01.172045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4098ed5-6140-4057-9dc6-be2a0d6701f7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:01.172629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e4098ed5-6140-4057-9dc6-be2a0d6701f7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:01.418820 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e4098ed5-6140-4057-9dc6-be2a0d6701f7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:01.427383 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e4098ed5-6140-4057-9dc6-be2a0d6701f7 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1752 microversion: 2.1 time: 0.271697 Jul 20 05:16:01.428017 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3534/7303] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:01 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1752 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:02.449712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e05808e3-821a-487d-8c5e-f05f661f02b3 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:02.450834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e05808e3-821a-487d-8c5e-f05f661f02b3 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:02.461104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e05808e3-821a-487d-8c5e-f05f661f02b3 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:02.461796 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e05808e3-821a-487d-8c5e-f05f661f02b3 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:02.463082 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e05808e3-821a-487d-8c5e-f05f661f02b3 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:02.463794 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e05808e3-821a-487d-8c5e-f05f661f02b3 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:02.623177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e05808e3-821a-487d-8c5e-f05f661f02b3 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:02.633761 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e05808e3-821a-487d-8c5e-f05f661f02b3 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1757 microversion: 2.1 time: 0.192205 Jul 20 05:16:02.634348 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3770/7304] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:02 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:03.652380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6899b6c6-c1a1-461b-8134-5b60e4f8917a tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:03.653018 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6899b6c6-c1a1-461b-8134-5b60e4f8917a tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:03.660729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6899b6c6-c1a1-461b-8134-5b60e4f8917a tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:03.661221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6899b6c6-c1a1-461b-8134-5b60e4f8917a tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:03.662016 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6899b6c6-c1a1-461b-8134-5b60e4f8917a tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:03.662474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6899b6c6-c1a1-461b-8134-5b60e4f8917a tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:03.831811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6899b6c6-c1a1-461b-8134-5b60e4f8917a tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:03.841597 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6899b6c6-c1a1-461b-8134-5b60e4f8917a tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1757 microversion: 2.1 time: 0.193300 Jul 20 05:16:03.842194 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3535/7305] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:03 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:04.859464 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ceb54d07-d57f-4b48-a192-71bcba1f614e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:04.860072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ceb54d07-d57f-4b48-a192-71bcba1f614e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:04.868023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ceb54d07-d57f-4b48-a192-71bcba1f614e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:04.868484 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ceb54d07-d57f-4b48-a192-71bcba1f614e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:04.869259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ceb54d07-d57f-4b48-a192-71bcba1f614e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:04.869696 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ceb54d07-d57f-4b48-a192-71bcba1f614e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:05.036030 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ceb54d07-d57f-4b48-a192-71bcba1f614e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:05.045426 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ceb54d07-d57f-4b48-a192-71bcba1f614e tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1757 microversion: 2.1 time: 0.189508 Jul 20 05:16:05.046122 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3771/7306] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:04 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:06.066416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-89f9238e-48b4-45fa-926a-75a7b18ebd3c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:06.067084 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-89f9238e-48b4-45fa-926a-75a7b18ebd3c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:06.075138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89f9238e-48b4-45fa-926a-75a7b18ebd3c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:06.075593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89f9238e-48b4-45fa-926a-75a7b18ebd3c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:06.076427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89f9238e-48b4-45fa-926a-75a7b18ebd3c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:06.076910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89f9238e-48b4-45fa-926a-75a7b18ebd3c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:06.238679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-89f9238e-48b4-45fa-926a-75a7b18ebd3c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:06.249382 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-89f9238e-48b4-45fa-926a-75a7b18ebd3c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1757 microversion: 2.1 time: 0.187003 Jul 20 05:16:06.249991 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3536/7307] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:06 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:07.267377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bee021e9-b345-4dd5-853f-579cd4b0180d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:07.268164 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bee021e9-b345-4dd5-853f-579cd4b0180d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:07.275563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bee021e9-b345-4dd5-853f-579cd4b0180d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:07.276012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bee021e9-b345-4dd5-853f-579cd4b0180d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:07.276841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bee021e9-b345-4dd5-853f-579cd4b0180d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:07.277282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bee021e9-b345-4dd5-853f-579cd4b0180d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:07.432330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bee021e9-b345-4dd5-853f-579cd4b0180d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:07.441146 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bee021e9-b345-4dd5-853f-579cd4b0180d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1757 microversion: 2.1 time: 0.177835 Jul 20 05:16:07.441790 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3772/7308] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:07 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:08.460106 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3ce5f1c9-f986-47fb-85d1-1aa6f6f93627 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:08.460767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3ce5f1c9-f986-47fb-85d1-1aa6f6f93627 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:08.469485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ce5f1c9-f986-47fb-85d1-1aa6f6f93627 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:08.469989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ce5f1c9-f986-47fb-85d1-1aa6f6f93627 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:08.470794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ce5f1c9-f986-47fb-85d1-1aa6f6f93627 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:08.471245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ce5f1c9-f986-47fb-85d1-1aa6f6f93627 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:08.620689 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3ce5f1c9-f986-47fb-85d1-1aa6f6f93627 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:08.629828 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3ce5f1c9-f986-47fb-85d1-1aa6f6f93627 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1757 microversion: 2.1 time: 0.174072 Jul 20 05:16:08.630433 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3537/7309] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:08 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:09.647383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8aa2138c-9dac-4c59-b2b3-17d31ed9d0d4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:09.648000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8aa2138c-9dac-4c59-b2b3-17d31ed9d0d4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:09.655657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8aa2138c-9dac-4c59-b2b3-17d31ed9d0d4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:09.656111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8aa2138c-9dac-4c59-b2b3-17d31ed9d0d4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:09.656917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8aa2138c-9dac-4c59-b2b3-17d31ed9d0d4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:09.657352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8aa2138c-9dac-4c59-b2b3-17d31ed9d0d4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:09.804840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8aa2138c-9dac-4c59-b2b3-17d31ed9d0d4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:09.813150 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8aa2138c-9dac-4c59-b2b3-17d31ed9d0d4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1757 microversion: 2.1 time: 0.169826 Jul 20 05:16:09.813733 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3773/7310] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:09 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:10.831066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fad5bdbf-dce7-460e-97d9-e351a39c024b tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:10.831705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fad5bdbf-dce7-460e-97d9-e351a39c024b tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:10.839171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fad5bdbf-dce7-460e-97d9-e351a39c024b tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:10.839638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fad5bdbf-dce7-460e-97d9-e351a39c024b tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:10.840468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fad5bdbf-dce7-460e-97d9-e351a39c024b tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:10.840919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fad5bdbf-dce7-460e-97d9-e351a39c024b tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:10.993431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fad5bdbf-dce7-460e-97d9-e351a39c024b tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:11.001884 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fad5bdbf-dce7-460e-97d9-e351a39c024b tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1757 microversion: 2.1 time: 0.174899 Jul 20 05:16:11.002834 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3538/7311] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:10 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:12.021051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c58edd0e-b656-4904-888e-020a7dc8eaac tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:12.021663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c58edd0e-b656-4904-888e-020a7dc8eaac tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:12.029258 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c58edd0e-b656-4904-888e-020a7dc8eaac tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:12.034056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c58edd0e-b656-4904-888e-020a7dc8eaac tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:12.037818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c58edd0e-b656-4904-888e-020a7dc8eaac tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:12.038273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c58edd0e-b656-4904-888e-020a7dc8eaac tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:12.190776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c58edd0e-b656-4904-888e-020a7dc8eaac tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:12.199539 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c58edd0e-b656-4904-888e-020a7dc8eaac tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1757 microversion: 2.1 time: 0.182640 Jul 20 05:16:12.200206 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3774/7312] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:12 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:13.218365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-60f2d2e2-9006-4424-a305-f5ac853561b0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:13.218980 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-60f2d2e2-9006-4424-a305-f5ac853561b0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:13.226764 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-60f2d2e2-9006-4424-a305-f5ac853561b0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:13.227224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-60f2d2e2-9006-4424-a305-f5ac853561b0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:13.228003 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-60f2d2e2-9006-4424-a305-f5ac853561b0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:13.228490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-60f2d2e2-9006-4424-a305-f5ac853561b0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:13.378901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-60f2d2e2-9006-4424-a305-f5ac853561b0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:13.389639 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-60f2d2e2-9006-4424-a305-f5ac853561b0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1760 microversion: 2.1 time: 0.175070 Jul 20 05:16:13.390381 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3539/7313] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:13 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1760 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:45.892841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f0b5b008-ab49-417b-b2fe-da9dfcaae6f4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1868958256"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:45.893450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f0b5b008-ab49-417b-b2fe-da9dfcaae6f4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:45.895479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=12 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:45.896126 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:45.902540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0b5b008-ab49-417b-b2fe-da9dfcaae6f4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:45.902983 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0b5b008-ab49-417b-b2fe-da9dfcaae6f4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:45.903758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0b5b008-ab49-417b-b2fe-da9dfcaae6f4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:45.904185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0b5b008-ab49-417b-b2fe-da9dfcaae6f4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:46.050350 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.network.security_group_api [None req-f0b5b008-ab49-417b-b2fe-da9dfcaae6f4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Removing security group 49a62078-b324-43aa-84e1-c94959d1c6c1 from port 1380a6d6-b380-4a48-8551-9037ae67d389 Jul 20 05:16:46.418834 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f0b5b008-ab49-417b-b2fe-da9dfcaae6f4 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "POST /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/action" status: 202 len: 0 microversion: 2.1 time: 0.531288 Jul 20 05:16:46.420715 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3775/7314] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:16:45 2022] POST /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:16:46.429198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-06d75524-f275-4c98-a38f-3f50a5321ef8 req-48cfef32-a067-43c1-8e67-6c05974d50c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0486f431-b292-4d7e-90ec-2e70a4c45081", "tag": "1380a6d6-b380-4a48-8551-9037ae67d389"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:46.433562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=12 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:46.434258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=36 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:46.446562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-06d75524-f275-4c98-a38f-3f50a5321ef8 req-48cfef32-a067-43c1-8e67-6c05974d50c8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:46.446993 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-06d75524-f275-4c98-a38f-3f50a5321ef8 req-48cfef32-a067-43c1-8e67-6c05974d50c8 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:46.462009 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-06d75524-f275-4c98-a38f-3f50a5321ef8 req-48cfef32-a067-43c1-8e67-6c05974d50c8 service nova] Creating event network-changed:1380a6d6-b380-4a48-8551-9037ae67d389 for instance 0486f431-b292-4d7e-90ec-2e70a4c45081 on n-h1-826526-5 Jul 20 05:16:46.469334 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-06d75524-f275-4c98-a38f-3f50a5321ef8 req-48cfef32-a067-43c1-8e67-6c05974d50c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043806 Jul 20 05:16:46.470316 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3540/7315] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:16:48.025005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7469562d-7ff1-4715-bf92-daad0423aa2c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:48.025545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7469562d-7ff1-4715-bf92-daad0423aa2c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:48.032103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7469562d-7ff1-4715-bf92-daad0423aa2c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:48.032669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7469562d-7ff1-4715-bf92-daad0423aa2c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:48.033585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7469562d-7ff1-4715-bf92-daad0423aa2c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:48.033996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7469562d-7ff1-4715-bf92-daad0423aa2c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:48.123972 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-7469562d-7ff1-4715-bf92-daad0423aa2c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lazy-loading 'services' on Instance uuid 0486f431-b292-4d7e-90ec-2e70a4c45081 {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:16:48.203568 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7469562d-7ff1-4715-bf92-daad0423aa2c tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments/50888dbc-3c75-4c55-950f-e7c54ba3c566" status: 202 len: 0 microversion: 2.1 time: 0.183605 Jul 20 05:16:48.207548 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3776/7316] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 05:16:48 2022] DELETE /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments/50888dbc-3c75-4c55-950f-e7c54ba3c566 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:16:48.214914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bef96a40-c623-4b1d-a71f-b45d229785b5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:48.215998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bef96a40-c623-4b1d-a71f-b45d229785b5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:48.222901 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bef96a40-c623-4b1d-a71f-b45d229785b5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:48.223295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bef96a40-c623-4b1d-a71f-b45d229785b5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:48.224147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bef96a40-c623-4b1d-a71f-b45d229785b5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:48.224624 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bef96a40-c623-4b1d-a71f-b45d229785b5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:48.261898 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bef96a40-c623-4b1d-a71f-b45d229785b5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052488 Jul 20 05:16:48.262484 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3541/7317] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:16:48 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:16:48.494682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-c1e3f8df-7bca-4b7f-b715-d15b49e48f48 req-79b50752-2b8f-471c-90cb-5fd265a2029b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0486f431-b292-4d7e-90ec-2e70a4c45081", "tag": "1380a6d6-b380-4a48-8551-9037ae67d389"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:48.506232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c1e3f8df-7bca-4b7f-b715-d15b49e48f48 req-79b50752-2b8f-471c-90cb-5fd265a2029b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:48.506585 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c1e3f8df-7bca-4b7f-b715-d15b49e48f48 req-79b50752-2b8f-471c-90cb-5fd265a2029b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:48.518782 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-c1e3f8df-7bca-4b7f-b715-d15b49e48f48 req-79b50752-2b8f-471c-90cb-5fd265a2029b service nova] Creating event network-changed:1380a6d6-b380-4a48-8551-9037ae67d389 for instance 0486f431-b292-4d7e-90ec-2e70a4c45081 on n-h1-826526-5 Jul 20 05:16:48.524107 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-c1e3f8df-7bca-4b7f-b715-d15b49e48f48 req-79b50752-2b8f-471c-90cb-5fd265a2029b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036972 Jul 20 05:16:48.524784 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3777/7318] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:16:49.274436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4d98ce44-a437-4c29-9a3c-646e1da72178 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:49.275424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4d98ce44-a437-4c29-9a3c-646e1da72178 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:49.283281 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d98ce44-a437-4c29-9a3c-646e1da72178 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:49.284038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d98ce44-a437-4c29-9a3c-646e1da72178 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:49.284886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d98ce44-a437-4c29-9a3c-646e1da72178 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:49.285357 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d98ce44-a437-4c29-9a3c-646e1da72178 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:49.315807 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4d98ce44-a437-4c29-9a3c-646e1da72178 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045434 Jul 20 05:16:49.316326 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3542/7319] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:16:49 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:16:50.328788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c2825413-d78e-4154-997c-0e4200902acb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:50.330015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c2825413-d78e-4154-997c-0e4200902acb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:50.337878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2825413-d78e-4154-997c-0e4200902acb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:50.338326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2825413-d78e-4154-997c-0e4200902acb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:50.339165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2825413-d78e-4154-997c-0e4200902acb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:50.339755 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2825413-d78e-4154-997c-0e4200902acb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:50.372735 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c2825413-d78e-4154-997c-0e4200902acb tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048824 Jul 20 05:16:50.373335 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3778/7320] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:16:50 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:16:51.387615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3bf8b3a0-8346-472a-be9c-0c5b82783dba tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:51.389661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3bf8b3a0-8346-472a-be9c-0c5b82783dba tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:51.397986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3bf8b3a0-8346-472a-be9c-0c5b82783dba tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:51.398856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3bf8b3a0-8346-472a-be9c-0c5b82783dba tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:51.400045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3bf8b3a0-8346-472a-be9c-0c5b82783dba tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:51.400754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3bf8b3a0-8346-472a-be9c-0c5b82783dba tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:51.435844 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3bf8b3a0-8346-472a-be9c-0c5b82783dba tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054135 Jul 20 05:16:51.437443 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3543/7321] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:16:51 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:16:52.448961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2e6b9dbe-7c38-4e5c-ab1d-b295c46720e2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:52.449956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2e6b9dbe-7c38-4e5c-ab1d-b295c46720e2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:52.459561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e6b9dbe-7c38-4e5c-ab1d-b295c46720e2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:52.460147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e6b9dbe-7c38-4e5c-ab1d-b295c46720e2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:52.461413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e6b9dbe-7c38-4e5c-ab1d-b295c46720e2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:52.462024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2e6b9dbe-7c38-4e5c-ab1d-b295c46720e2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:52.495098 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2e6b9dbe-7c38-4e5c-ab1d-b295c46720e2 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050320 Jul 20 05:16:52.495679 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3779/7322] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:16:52 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:16:53.512076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9af8cb8b-b994-4778-927b-83256acdb399 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:53.513666 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9af8cb8b-b994-4778-927b-83256acdb399 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:53.525804 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9af8cb8b-b994-4778-927b-83256acdb399 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:53.526662 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9af8cb8b-b994-4778-927b-83256acdb399 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:53.527449 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9af8cb8b-b994-4778-927b-83256acdb399 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:53.527900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9af8cb8b-b994-4778-927b-83256acdb399 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:53.557488 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9af8cb8b-b994-4778-927b-83256acdb399 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052275 Jul 20 05:16:53.558110 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3544/7323] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 05:16:53 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 05:16:53.568392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9af89438-bdef-41c2-a48b-1700c3f71c0d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:53.568923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9af89438-bdef-41c2-a48b-1700c3f71c0d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:53.576478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9af89438-bdef-41c2-a48b-1700c3f71c0d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:53.576932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9af89438-bdef-41c2-a48b-1700c3f71c0d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:53.577704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9af89438-bdef-41c2-a48b-1700c3f71c0d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:53.578143 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9af89438-bdef-41c2-a48b-1700c3f71c0d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:53.664359 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-9af89438-bdef-41c2-a48b-1700c3f71c0d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] HTTP exception thrown: Instance 0486f431-b292-4d7e-90ec-2e70a4c45081 is not attached to volume 50888dbc-3c75-4c55-950f-e7c54ba3c566 Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9af89438-bdef-41c2-a48b-1700c3f71c0d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Request method failure captured: Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: request: DELETE /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments/50888dbc-3c75-4c55-950f-e7c54ba3c566 HTTP/1.1 Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi145f5LgL7UUnpblNTobYZKKGD-AZxO8z19DTurU4K9rrF99wa9HkwFU5ZA7xMEfTV472Hnzo4Q6YOMDVSy8OX74yXoyUQkyRwlseTBuDJibRZGZv_qdB8n35V8wCHHrs6mtfhyHFnNV2kWFOUUS-iwewA4O1rXS64MJX8DmpFMMn994 Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b081448fa8564c72b3c9276382a825a4 Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestMinimumBasicScenario-1987827669 Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b081448fa8564c72b3c9276382a825a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b081448fa8564c72b3c9276382a825a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b081448fa8564c72b3c9276382a825a4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b081448fa8564c72b3c9276382a825a4"}]}] Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestMinimumBasicScenario-1987827669 Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b081448fa8564c72b3c9276382a825a4 Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1987827669 Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestMinimumBasicScenario-1987827669-project Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 4ca155584b04400e9c95b4f17a4461f6 Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestMinimumBasicScenario-1987827669-project Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 0486f431-b292-4d7e-90ec-2e70a4c45081 is not attached to volume 50888dbc-3c75-4c55-950f-e7c54ba3c566 Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'server_id': '0486f431-b292-4d7e-90ec-2e70a4c45081', 'id': '50888dbc-3c75-4c55-950f-e7c54ba3c566'} Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 50888dbc-3c75-4c55-950f-e7c54ba3c566. Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0486f431-b292-4d7e-90ec-2e70a4c45081 is not attached to volume 50888dbc-3c75-4c55-950f-e7c54ba3c566 Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:16:53.665984 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:16:53.670653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:16:53.670653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:16:53.670653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0486f431-b292-4d7e-90ec-2e70a4c45081 is not attached to volume 50888dbc-3c75-4c55-950f-e7c54ba3c566 Jul 20 05:16:53.670653 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:16:53.670653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9af89438-bdef-41c2-a48b-1700c3f71c0d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Returning 404 to user: Instance 0486f431-b292-4d7e-90ec-2e70a4c45081 is not attached to volume 50888dbc-3c75-4c55-950f-e7c54ba3c566 {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:16:53.670653 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9af89438-bdef-41c2-a48b-1700c3f71c0d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments/50888dbc-3c75-4c55-950f-e7c54ba3c566" status: 404 len: 154 microversion: 2.1 time: 0.103184 Jul 20 05:16:53.670653 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3780/7324] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 05:16:53 2022] DELETE /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081/os-volume_attachments/50888dbc-3c75-4c55-950f-e7c54ba3c566 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:16:56.925154 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b736bd46-733f-485c-a883-2d92b36ea35d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:56.925661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b736bd46-733f-485c-a883-2d92b36ea35d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:56.935962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b736bd46-733f-485c-a883-2d92b36ea35d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:56.936450 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b736bd46-733f-485c-a883-2d92b36ea35d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:56.937242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b736bd46-733f-485c-a883-2d92b36ea35d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:56.937701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b736bd46-733f-485c-a883-2d92b36ea35d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:56.967669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b736bd46-733f-485c-a883-2d92b36ea35d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:16:57.057537 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b736bd46-733f-485c-a883-2d92b36ea35d tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 204 len: 0 microversion: 2.1 time: 0.136173 Jul 20 05:16:57.058377 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3545/7325] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:16:56 2022] DELETE /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:16:57.069252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e4ae70b8-56cc-4366-8788-6600756a8612 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:57.070130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e4ae70b8-56cc-4366-8788-6600756a8612 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:57.078136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4ae70b8-56cc-4366-8788-6600756a8612 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:57.078586 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4ae70b8-56cc-4366-8788-6600756a8612 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:57.079565 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4ae70b8-56cc-4366-8788-6600756a8612 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:57.079991 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4ae70b8-56cc-4366-8788-6600756a8612 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:57.235693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e4ae70b8-56cc-4366-8788-6600756a8612 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:57.244197 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e4ae70b8-56cc-4366-8788-6600756a8612 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1554 microversion: 2.1 time: 0.180310 Jul 20 05:16:57.244850 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3781/7326] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:57 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:58.266706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-068be17b-e6fd-47a7-b3cf-ed8a0db483f5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:58.267448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-068be17b-e6fd-47a7-b3cf-ed8a0db483f5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:58.278473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-068be17b-e6fd-47a7-b3cf-ed8a0db483f5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:58.278945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-068be17b-e6fd-47a7-b3cf-ed8a0db483f5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:58.280354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-068be17b-e6fd-47a7-b3cf-ed8a0db483f5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:58.281214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-068be17b-e6fd-47a7-b3cf-ed8a0db483f5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:58.427798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-068be17b-e6fd-47a7-b3cf-ed8a0db483f5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:58.439608 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-068be17b-e6fd-47a7-b3cf-ed8a0db483f5 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1554 microversion: 2.1 time: 0.179222 Jul 20 05:16:58.440198 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3546/7327] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:58 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:59.159058 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-4220fcad-a977-4878-ac6e-9ca2cf9c110b req-72429b9b-7a7b-4996-9d08-82bb6d66bbc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0486f431-b292-4d7e-90ec-2e70a4c45081", "name": "network-vif-deleted", "tag": "1380a6d6-b380-4a48-8551-9037ae67d389"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:59.169302 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4220fcad-a977-4878-ac6e-9ca2cf9c110b req-72429b9b-7a7b-4996-9d08-82bb6d66bbc7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:59.169748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-4220fcad-a977-4878-ac6e-9ca2cf9c110b req-72429b9b-7a7b-4996-9d08-82bb6d66bbc7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:59.182687 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-4220fcad-a977-4878-ac6e-9ca2cf9c110b req-72429b9b-7a7b-4996-9d08-82bb6d66bbc7 service nova] Creating event network-vif-deleted:1380a6d6-b380-4a48-8551-9037ae67d389 for instance 0486f431-b292-4d7e-90ec-2e70a4c45081 on n-h1-826526-5 Jul 20 05:16:59.187754 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-4220fcad-a977-4878-ac6e-9ca2cf9c110b req-72429b9b-7a7b-4996-9d08-82bb6d66bbc7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032896 Jul 20 05:16:59.188412 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3782/7328] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:16:59.458135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eb30cdab-9dea-4cdf-af1e-b375b19d4970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:59.458750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eb30cdab-9dea-4cdf-af1e-b375b19d4970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:59.467186 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb30cdab-9dea-4cdf-af1e-b375b19d4970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:59.468087 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb30cdab-9dea-4cdf-af1e-b375b19d4970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:59.468946 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb30cdab-9dea-4cdf-af1e-b375b19d4970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:59.469550 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb30cdab-9dea-4cdf-af1e-b375b19d4970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:59.508979 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb30cdab-9dea-4cdf-af1e-b375b19d4970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:59.509228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb30cdab-9dea-4cdf-af1e-b375b19d4970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:59.509713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-eb30cdab-9dea-4cdf-af1e-b375b19d4970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lazy-loading 'fault' on Instance uuid 0486f431-b292-4d7e-90ec-2e70a4c45081 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:16:59.566235 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eb30cdab-9dea-4cdf-af1e-b375b19d4970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca155584b04400e9c95b4f17a4461f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081448fa8564c72b3c9276382a825a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:59.575193 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eb30cdab-9dea-4cdf-af1e-b375b19d4970 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 200 len: 1348 microversion: 2.1 time: 0.121032 Jul 20 05:16:59.576318 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3547/7329] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:59 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 1348 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:00.599723 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c4c8fc56-5a16-4b3b-9381-56c150c45cd0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:00.600693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c4c8fc56-5a16-4b3b-9381-56c150c45cd0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] [instance: 0486f431-b292-4d7e-90ec-2e70a4c45081] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:00.609294 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4c8fc56-5a16-4b3b-9381-56c150c45cd0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:00.609750 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4c8fc56-5a16-4b3b-9381-56c150c45cd0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:00.610552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4c8fc56-5a16-4b3b-9381-56c150c45cd0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:00.610993 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c4c8fc56-5a16-4b3b-9381-56c150c45cd0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:00.625311 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-c4c8fc56-5a16-4b3b-9381-56c150c45cd0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] HTTP exception thrown: Instance 0486f431-b292-4d7e-90ec-2e70a4c45081 could not be found. Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c4c8fc56-5a16-4b3b-9381-56c150c45cd0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Request method failure captured: Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 HTTP/1.1 Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi145f5LgL7UUnpblNTobYZKKGD-AZxO8z19DTurU4K9rrF99wa9HkwFU5ZA7xMEfTV472Hnzo4Q6YOMDVSy8OX74yXoyUQkyRwlseTBuDJibRZGZv_qdB8n35V8wCHHrs6mtfhyHFnNV2kWFOUUS-iwewA4O1rXS64MJX8DmpFMMn994 Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: b081448fa8564c72b3c9276382a825a4 Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestMinimumBasicScenario-1987827669 Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b081448fa8564c72b3c9276382a825a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b081448fa8564c72b3c9276382a825a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b081448fa8564c72b3c9276382a825a4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b081448fa8564c72b3c9276382a825a4"}]}] Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestMinimumBasicScenario-1987827669 Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: b081448fa8564c72b3c9276382a825a4 Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1987827669 Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestMinimumBasicScenario-1987827669-project Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 4ca155584b04400e9c95b4f17a4461f6 Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestMinimumBasicScenario-1987827669-project Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 0486f431-b292-4d7e-90ec-2e70a4c45081 could not be found. Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '0486f431-b292-4d7e-90ec-2e70a4c45081'} Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0486f431-b292-4d7e-90ec-2e70a4c45081 could not be found. Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0486f431-b292-4d7e-90ec-2e70a4c45081 could not be found. Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:00.627443 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:17:00.631217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:00.631217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:00.631217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:00.631217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:17:00.631217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:17:00.631217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0486f431-b292-4d7e-90ec-2e70a4c45081 could not be found. Jul 20 05:17:00.631217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:17:00.631217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c4c8fc56-5a16-4b3b-9381-56c150c45cd0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Returning 404 to user: Instance 0486f431-b292-4d7e-90ec-2e70a4c45081 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:17:00.631217 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c4c8fc56-5a16-4b3b-9381-56c150c45cd0 tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081" status: 404 len: 111 microversion: 2.1 time: 0.037958 Jul 20 05:17:00.631217 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3783/7330] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:00 2022] GET /compute/v2.1/servers/0486f431-b292-4d7e-90ec-2e70a4c45081 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:17:00.638305 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-72084019-979c-4a69-ab74-9278098ecd9a tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] Calling method '.version_select at 0x7f06bd4dbb80>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:00.660090 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-72084019-979c-4a69-ab74-9278098ecd9a tempest-TestMinimumBasicScenario-1987827669 tempest-TestMinimumBasicScenario-1987827669-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-481006089" status: 202 len: 0 microversion: 2.1 time: 0.025828 Jul 20 05:17:00.660723 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3548/7331] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 05:17:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-481006089 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:17:10.504636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d7ac679a-7528-4595-9fee-6ab09fa1fcfe tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'create', calling method: .version_select at 0x7f06bcd0e5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1692478284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSJgs/g71x1jWvrvuzXwSHvETAwtKoy9bXZkEk2x6pFDoxi2iL9A6/TdzVT/3kDi0CDH1UD6DA1LlL93r6PnxyRh77L5ffMdZLgOW7fm6JvyNf9iCL21bDVn4nfzkLNfg=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:10.520352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-d7ac679a-7528-4595-9fee-6ab09fa1fcfe tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:17:10.525970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-d7ac679a-7528-4595-9fee-6ab09fa1fcfe tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for user 1630a34d53714c0e9476578c711c87ac and project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:17:10.554309 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d7ac679a-7528-4595-9fee-6ab09fa1fcfe tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.250049 Jul 20 05:17:10.554932 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3784/7332] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 05:17:10 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:16.162521 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:16.163400 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:16.167685 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d01fcea-d51f-4cdc-9a7b-a1847cd9fc77 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1305629717", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "2bcff7a4-f5df-461e-ab39-f346929689fa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1692478284", "security_groups": [{"name": "tempest-secgroup-smoke-2075382032"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:16.292835 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-1d01fcea-d51f-4cdc-9a7b-a1847cd9fc77 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] validate_networks() for [('2bcff7a4-f5df-461e-ab39-f346929689fa', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:17:17.137790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1d01fcea-d51f-4cdc-9a7b-a1847cd9fc77 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:17:17.138296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1d01fcea-d51f-4cdc-9a7b-a1847cd9fc77 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:17:17.138856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1d01fcea-d51f-4cdc-9a7b-a1847cd9fc77 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:17:17.139343 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1d01fcea-d51f-4cdc-9a7b-a1847cd9fc77 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:17:17.139822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1d01fcea-d51f-4cdc-9a7b-a1847cd9fc77 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:17:17.149598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d01fcea-d51f-4cdc-9a7b-a1847cd9fc77 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:17.150054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d01fcea-d51f-4cdc-9a7b-a1847cd9fc77 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:17.150872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d01fcea-d51f-4cdc-9a7b-a1847cd9fc77 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:17.151327 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d01fcea-d51f-4cdc-9a7b-a1847cd9fc77 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:17.169149 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-1d01fcea-d51f-4cdc-9a7b-a1847cd9fc77 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:17:17.174991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-1d01fcea-d51f-4cdc-9a7b-a1847cd9fc77 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for user 1630a34d53714c0e9476578c711c87ac and project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:17:17.187623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d01fcea-d51f-4cdc-9a7b-a1847cd9fc77 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:17:17.190195 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d01fcea-d51f-4cdc-9a7b-a1847cd9fc77 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:17:17.211616 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:17:17.212174 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:17:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:17:17.242838 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d01fcea-d51f-4cdc-9a7b-a1847cd9fc77 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.082388 Jul 20 05:17:17.243686 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3549/7333] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:17:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:17:17.250426 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:17.255951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1d7784ed-58c0-4e77-9927-5a03fb901f7d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:17.256803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1d7784ed-58c0-4e77-9927-5a03fb901f7d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:17.258687 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:17.319424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1d7784ed-58c0-4e77-9927-5a03fb901f7d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:17.329411 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1d7784ed-58c0-4e77-9927-5a03fb901f7d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 200 len: 1267 microversion: 2.1 time: 0.079639 Jul 20 05:17:17.330022 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3785/7334] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:17 2022] GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 1267 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:18.349008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9f9a7204-4f01-4149-b860-16089c453a3e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:18.349787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9f9a7204-4f01-4149-b860-16089c453a3e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:18.424807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9f9a7204-4f01-4149-b860-16089c453a3e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:18.442616 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9f9a7204-4f01-4149-b860-16089c453a3e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 200 len: 1267 microversion: 2.1 time: 0.097747 Jul 20 05:17:18.451090 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3550/7335] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:18 2022] GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 1267 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:19.460134 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-74ff998d-f66e-4fde-80ef-97306de8e99f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:19.460803 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-74ff998d-f66e-4fde-80ef-97306de8e99f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:19.468572 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-74ff998d-f66e-4fde-80ef-97306de8e99f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:19.469014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-74ff998d-f66e-4fde-80ef-97306de8e99f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:19.469776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-74ff998d-f66e-4fde-80ef-97306de8e99f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:19.470240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-74ff998d-f66e-4fde-80ef-97306de8e99f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:19.554470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-74ff998d-f66e-4fde-80ef-97306de8e99f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:19.568880 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-74ff998d-f66e-4fde-80ef-97306de8e99f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 200 len: 1319 microversion: 2.1 time: 0.113978 Jul 20 05:17:19.570587 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3786/7336] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:19 2022] GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 1319 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:20.587706 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-857e1f82-3ae9-4d76-a568-ed19a30d9f0e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:20.589353 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-857e1f82-3ae9-4d76-a568-ed19a30d9f0e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:20.598683 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-857e1f82-3ae9-4d76-a568-ed19a30d9f0e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:20.599584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-857e1f82-3ae9-4d76-a568-ed19a30d9f0e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:20.600648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-857e1f82-3ae9-4d76-a568-ed19a30d9f0e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:20.601319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-857e1f82-3ae9-4d76-a568-ed19a30d9f0e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:20.747290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-857e1f82-3ae9-4d76-a568-ed19a30d9f0e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:20.756596 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-857e1f82-3ae9-4d76-a568-ed19a30d9f0e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 200 len: 1393 microversion: 2.1 time: 0.172881 Jul 20 05:17:20.757256 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3551/7337] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:20 2022] GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:21.097197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-790f256b-333b-4869-bcf6-d5f734e64029 req-c92fb9fa-57bb-45f8-b285-37c43ff71c8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6df0eb9-ee25-4112-b943-364556de0f30", "tag": "8b336a7e-dc7f-4941-ad3c-e3ebeb8a4126"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:21.110435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-790f256b-333b-4869-bcf6-d5f734e64029 req-c92fb9fa-57bb-45f8-b285-37c43ff71c8a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:21.111123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-790f256b-333b-4869-bcf6-d5f734e64029 req-c92fb9fa-57bb-45f8-b285-37c43ff71c8a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:21.133470 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-790f256b-333b-4869-bcf6-d5f734e64029 req-c92fb9fa-57bb-45f8-b285-37c43ff71c8a service nova] Creating event network-changed:8b336a7e-dc7f-4941-ad3c-e3ebeb8a4126 for instance d6df0eb9-ee25-4112-b943-364556de0f30 on n-h2-826526-5 Jul 20 05:17:21.138550 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-790f256b-333b-4869-bcf6-d5f734e64029 req-c92fb9fa-57bb-45f8-b285-37c43ff71c8a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046817 Jul 20 05:17:21.139270 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3787/7338] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:21.778806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5a34c18b-ca1c-4898-9a8e-3d0ca971ae63 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:21.779762 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5a34c18b-ca1c-4898-9a8e-3d0ca971ae63 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:21.790707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a34c18b-ca1c-4898-9a8e-3d0ca971ae63 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:21.791385 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a34c18b-ca1c-4898-9a8e-3d0ca971ae63 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:21.792544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a34c18b-ca1c-4898-9a8e-3d0ca971ae63 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:21.793074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a34c18b-ca1c-4898-9a8e-3d0ca971ae63 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:21.932289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5a34c18b-ca1c-4898-9a8e-3d0ca971ae63 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:21.941107 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5a34c18b-ca1c-4898-9a8e-3d0ca971ae63 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 200 len: 1393 microversion: 2.1 time: 0.168679 Jul 20 05:17:21.941683 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3552/7339] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:21 2022] GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:22.966024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6354a484-61a6-4784-af87-b4268fad8daf tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:22.966643 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6354a484-61a6-4784-af87-b4268fad8daf tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:22.973766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6354a484-61a6-4784-af87-b4268fad8daf tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:22.974213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6354a484-61a6-4784-af87-b4268fad8daf tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:22.975078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6354a484-61a6-4784-af87-b4268fad8daf tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:22.975575 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6354a484-61a6-4784-af87-b4268fad8daf tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:23.427243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6354a484-61a6-4784-af87-b4268fad8daf tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:23.435073 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6354a484-61a6-4784-af87-b4268fad8daf tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 200 len: 1393 microversion: 2.1 time: 0.477895 Jul 20 05:17:23.435542 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3788/7340] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:22 2022] GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 1393 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:24.452643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b37cdcd1-5acc-4f19-bd17-f0bf478d3913 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:24.453265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b37cdcd1-5acc-4f19-bd17-f0bf478d3913 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:24.460909 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b37cdcd1-5acc-4f19-bd17-f0bf478d3913 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:24.461379 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b37cdcd1-5acc-4f19-bd17-f0bf478d3913 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:24.462168 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b37cdcd1-5acc-4f19-bd17-f0bf478d3913 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:24.462621 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b37cdcd1-5acc-4f19-bd17-f0bf478d3913 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:24.610609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b37cdcd1-5acc-4f19-bd17-f0bf478d3913 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:24.618868 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b37cdcd1-5acc-4f19-bd17-f0bf478d3913 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 200 len: 1393 microversion: 2.1 time: 0.170245 Jul 20 05:17:24.619457 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3553/7341] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:24 2022] GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:25.357264 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-94d49287-c685-47b1-bfda-bb4bf4598bbf req-2383bfa5-368e-4f4b-918c-4a768c1ba469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6df0eb9-ee25-4112-b943-364556de0f30", "name": "network-vif-plugged", "status": "completed", "tag": "8b336a7e-dc7f-4941-ad3c-e3ebeb8a4126"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:25.372229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-94d49287-c685-47b1-bfda-bb4bf4598bbf req-2383bfa5-368e-4f4b-918c-4a768c1ba469 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:25.372777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-94d49287-c685-47b1-bfda-bb4bf4598bbf req-2383bfa5-368e-4f4b-918c-4a768c1ba469 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:25.385359 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-94d49287-c685-47b1-bfda-bb4bf4598bbf req-2383bfa5-368e-4f4b-918c-4a768c1ba469 service nova] Creating event network-vif-plugged:8b336a7e-dc7f-4941-ad3c-e3ebeb8a4126 for instance d6df0eb9-ee25-4112-b943-364556de0f30 on n-h2-826526-5 Jul 20 05:17:25.390586 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-94d49287-c685-47b1-bfda-bb4bf4598bbf req-2383bfa5-368e-4f4b-918c-4a768c1ba469 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037111 Jul 20 05:17:25.391279 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3789/7342] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:25.639238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-922cace3-24d1-4d40-92dc-c23f06808004 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:25.639860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-922cace3-24d1-4d40-92dc-c23f06808004 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:25.647454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-922cace3-24d1-4d40-92dc-c23f06808004 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:25.647947 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-922cace3-24d1-4d40-92dc-c23f06808004 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:25.648783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-922cace3-24d1-4d40-92dc-c23f06808004 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:25.649234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-922cace3-24d1-4d40-92dc-c23f06808004 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:25.809140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-922cace3-24d1-4d40-92dc-c23f06808004 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:25.817752 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-922cace3-24d1-4d40-92dc-c23f06808004 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 200 len: 1393 microversion: 2.1 time: 0.182582 Jul 20 05:17:25.819046 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3554/7343] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:25 2022] GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 1393 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:26.838369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b33c6b66-d744-49b7-b313-cf0b5add3824 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:26.839473 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b33c6b66-d744-49b7-b313-cf0b5add3824 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:26.849186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b33c6b66-d744-49b7-b313-cf0b5add3824 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:26.849832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b33c6b66-d744-49b7-b313-cf0b5add3824 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:26.850704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b33c6b66-d744-49b7-b313-cf0b5add3824 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:26.851144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b33c6b66-d744-49b7-b313-cf0b5add3824 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:27.017594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b33c6b66-d744-49b7-b313-cf0b5add3824 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:27.030739 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b33c6b66-d744-49b7-b313-cf0b5add3824 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 200 len: 1565 microversion: 2.1 time: 0.198620 Jul 20 05:17:27.032245 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3790/7344] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:26 2022] GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 1565 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:27.048575 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-455227a9-3e33-40dd-a41d-99d422c22911 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:27.049229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-455227a9-3e33-40dd-a41d-99d422c22911 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:27.056699 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-455227a9-3e33-40dd-a41d-99d422c22911 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:27.057171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-455227a9-3e33-40dd-a41d-99d422c22911 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:27.057972 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-455227a9-3e33-40dd-a41d-99d422c22911 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:27.058433 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-455227a9-3e33-40dd-a41d-99d422c22911 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:27.158047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:27.204676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-455227a9-3e33-40dd-a41d-99d422c22911 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:27.213426 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-455227a9-3e33-40dd-a41d-99d422c22911 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 200 len: 1565 microversion: 2.1 time: 0.168984 Jul 20 05:17:27.214074 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3555/7345] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:27 2022] GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:28.918920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-5a0cb271-4fc5-43af-95dd-dac1195c1ce5 req-566dfef5-8950-48dd-aedd-2779e7ab1ecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6df0eb9-ee25-4112-b943-364556de0f30", "tag": "8b336a7e-dc7f-4941-ad3c-e3ebeb8a4126"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:28.923067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f0e30532-e7c2-4b39-a196-4a9f5f631397 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:28.923757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f0e30532-e7c2-4b39-a196-4a9f5f631397 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:28.925936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:28.930022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:28.938110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0e30532-e7c2-4b39-a196-4a9f5f631397 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:28.938559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0e30532-e7c2-4b39-a196-4a9f5f631397 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:28.939332 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0e30532-e7c2-4b39-a196-4a9f5f631397 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:28.939765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f0e30532-e7c2-4b39-a196-4a9f5f631397 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:28.948244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5a0cb271-4fc5-43af-95dd-dac1195c1ce5 req-566dfef5-8950-48dd-aedd-2779e7ab1ecf service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:28.948734 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-5a0cb271-4fc5-43af-95dd-dac1195c1ce5 req-566dfef5-8950-48dd-aedd-2779e7ab1ecf service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:28.966464 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-5a0cb271-4fc5-43af-95dd-dac1195c1ce5 req-566dfef5-8950-48dd-aedd-2779e7ab1ecf service nova] Creating event network-changed:8b336a7e-dc7f-4941-ad3c-e3ebeb8a4126 for instance d6df0eb9-ee25-4112-b943-364556de0f30 on n-h2-826526-5 Jul 20 05:17:28.972182 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-5a0cb271-4fc5-43af-95dd-dac1195c1ce5 req-566dfef5-8950-48dd-aedd-2779e7ab1ecf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057083 Jul 20 05:17:28.973166 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3556/7346] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:29.176617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f0e30532-e7c2-4b39-a196-4a9f5f631397 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:29.187111 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f0e30532-e7c2-4b39-a196-4a9f5f631397 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 200 len: 1565 microversion: 2.1 time: 0.275435 Jul 20 05:17:29.188061 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3791/7347] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:28 2022] GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 1565 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:50.465141 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:50.465868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=34 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:50.470576 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e63719f5-12d4-487d-8767-460e73d7b97a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:50.471620 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e63719f5-12d4-487d-8767-460e73d7b97a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:50.479855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e63719f5-12d4-487d-8767-460e73d7b97a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:50.480330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e63719f5-12d4-487d-8767-460e73d7b97a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:50.481135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e63719f5-12d4-487d-8767-460e73d7b97a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:50.481578 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e63719f5-12d4-487d-8767-460e73d7b97a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:50.537453 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e63719f5-12d4-487d-8767-460e73d7b97a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30/action" status: 200 len: 24564 microversion: 2.1 time: 0.074085 Jul 20 05:17:50.538264 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3557/7348] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:17:50 2022] POST /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30/action => generated 24564 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:18:01.453742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-51f8ef63-360d-45b2-9d6c-8d5feedbaeb5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:01.454463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-51f8ef63-360d-45b2-9d6c-8d5feedbaeb5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:01.456708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=15 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:01.457479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=28 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:01.465451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51f8ef63-360d-45b2-9d6c-8d5feedbaeb5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:01.465897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51f8ef63-360d-45b2-9d6c-8d5feedbaeb5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:01.466676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51f8ef63-360d-45b2-9d6c-8d5feedbaeb5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:01.467112 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-51f8ef63-360d-45b2-9d6c-8d5feedbaeb5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:01.546952 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-51f8ef63-360d-45b2-9d6c-8d5feedbaeb5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30/action" status: 202 len: 0 microversion: 2.1 time: 0.098001 Jul 20 05:18:01.547648 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3792/7349] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:18:01 2022] POST /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:18:01.556818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-46ddb62f-2e3d-4f5d-bbcb-0a91628bd180 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:01.557661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-46ddb62f-2e3d-4f5d-bbcb-0a91628bd180 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:01.560677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:01.561377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:01.568043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46ddb62f-2e3d-4f5d-bbcb-0a91628bd180 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:01.568605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46ddb62f-2e3d-4f5d-bbcb-0a91628bd180 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:01.569409 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46ddb62f-2e3d-4f5d-bbcb-0a91628bd180 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:01.569867 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46ddb62f-2e3d-4f5d-bbcb-0a91628bd180 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:01.718042 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-46ddb62f-2e3d-4f5d-bbcb-0a91628bd180 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:01.728329 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-46ddb62f-2e3d-4f5d-bbcb-0a91628bd180 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 200 len: 1689 microversion: 2.1 time: 0.175863 Jul 20 05:18:01.728995 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3558/7350] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:01 2022] GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:02.747333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-09e6510c-a9ea-4755-8418-e1d8720cde04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:02.747959 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-09e6510c-a9ea-4755-8418-e1d8720cde04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:02.756496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09e6510c-a9ea-4755-8418-e1d8720cde04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:02.756952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09e6510c-a9ea-4755-8418-e1d8720cde04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:02.757730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09e6510c-a9ea-4755-8418-e1d8720cde04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:02.758170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09e6510c-a9ea-4755-8418-e1d8720cde04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:02.900215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-09e6510c-a9ea-4755-8418-e1d8720cde04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:02.909004 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-09e6510c-a9ea-4755-8418-e1d8720cde04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 200 len: 1669 microversion: 2.1 time: 0.166255 Jul 20 05:18:02.909562 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3793/7351] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:02 2022] GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 1669 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:03.997650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3d59fbf5-4527-4c11-9f8c-e437732935cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:03.998560 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3d59fbf5-4527-4c11-9f8c-e437732935cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:04.007394 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d59fbf5-4527-4c11-9f8c-e437732935cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:04.007854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d59fbf5-4527-4c11-9f8c-e437732935cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:04.008663 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d59fbf5-4527-4c11-9f8c-e437732935cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:04.009116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d59fbf5-4527-4c11-9f8c-e437732935cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:04.057987 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3d59fbf5-4527-4c11-9f8c-e437732935cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30/action" status: 200 len: 32640 microversion: 2.1 time: 0.064306 Jul 20 05:18:04.058745 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3559/7352] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:18:03 2022] POST /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30/action => generated 32640 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:18:04.071709 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ba9e4b2d-d766-48dd-987f-bfc232d98954 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:04.072552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ba9e4b2d-d766-48dd-987f-bfc232d98954 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:04.080345 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba9e4b2d-d766-48dd-987f-bfc232d98954 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:04.080791 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba9e4b2d-d766-48dd-987f-bfc232d98954 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:04.081552 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba9e4b2d-d766-48dd-987f-bfc232d98954 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:04.081984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba9e4b2d-d766-48dd-987f-bfc232d98954 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:04.150449 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ba9e4b2d-d766-48dd-987f-bfc232d98954 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30/action" status: 202 len: 0 microversion: 2.1 time: 0.084170 Jul 20 05:18:04.151132 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3794/7353] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:18:04 2022] POST /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:18:04.160354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2297a83f-b516-40a5-a129-62a08bfeb861 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:04.161312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2297a83f-b516-40a5-a129-62a08bfeb861 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:04.168930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2297a83f-b516-40a5-a129-62a08bfeb861 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:04.169402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2297a83f-b516-40a5-a129-62a08bfeb861 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:04.170196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2297a83f-b516-40a5-a129-62a08bfeb861 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:04.170688 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2297a83f-b516-40a5-a129-62a08bfeb861 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:04.315406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2297a83f-b516-40a5-a129-62a08bfeb861 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:04.323411 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2297a83f-b516-40a5-a129-62a08bfeb861 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 200 len: 1676 microversion: 2.1 time: 0.167457 Jul 20 05:18:04.324233 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3560/7354] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:04 2022] GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:05.343603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c9dd5e7b-5499-4371-aca7-1ed39f2b4e96 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:05.344187 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c9dd5e7b-5499-4371-aca7-1ed39f2b4e96 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:05.351239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9dd5e7b-5499-4371-aca7-1ed39f2b4e96 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:05.351747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9dd5e7b-5499-4371-aca7-1ed39f2b4e96 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:05.352567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9dd5e7b-5499-4371-aca7-1ed39f2b4e96 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:05.353013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c9dd5e7b-5499-4371-aca7-1ed39f2b4e96 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:05.497722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c9dd5e7b-5499-4371-aca7-1ed39f2b4e96 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:05.506018 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c9dd5e7b-5499-4371-aca7-1ed39f2b4e96 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 200 len: 1684 microversion: 2.1 time: 0.167723 Jul 20 05:18:05.506629 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3795/7355] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:05 2022] GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:05.599190 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-73cd31ce-8632-4b1b-9342-03cc5a9284af tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:05.600071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-73cd31ce-8632-4b1b-9342-03cc5a9284af tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:05.613767 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73cd31ce-8632-4b1b-9342-03cc5a9284af tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:05.614271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73cd31ce-8632-4b1b-9342-03cc5a9284af tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:05.615465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73cd31ce-8632-4b1b-9342-03cc5a9284af tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:05.615608 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73cd31ce-8632-4b1b-9342-03cc5a9284af tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:05.672453 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-73cd31ce-8632-4b1b-9342-03cc5a9284af tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30/action" status: 200 len: 38456 microversion: 2.1 time: 0.077003 Jul 20 05:18:05.673162 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3561/7356] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:18:05 2022] POST /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30/action => generated 38456 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:18:06.722884 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-683335f6-8bae-404e-92c3-f76528889b37 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:06.723619 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-683335f6-8bae-404e-92c3-f76528889b37 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:06.725346 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-392022ae-3b86-4127-bbff-b99b4c28c428 req-49c22278-c507-4c0b-a415-afdcd7dd8ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6df0eb9-ee25-4112-b943-364556de0f30", "tag": "8b336a7e-dc7f-4941-ad3c-e3ebeb8a4126"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:06.730909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-683335f6-8bae-404e-92c3-f76528889b37 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:06.731367 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-683335f6-8bae-404e-92c3-f76528889b37 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:06.732138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-683335f6-8bae-404e-92c3-f76528889b37 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:06.732961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-683335f6-8bae-404e-92c3-f76528889b37 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:06.735522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-392022ae-3b86-4127-bbff-b99b4c28c428 req-49c22278-c507-4c0b-a415-afdcd7dd8ceb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:06.736178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-392022ae-3b86-4127-bbff-b99b4c28c428 req-49c22278-c507-4c0b-a415-afdcd7dd8ceb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:06.748974 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-392022ae-3b86-4127-bbff-b99b4c28c428 req-49c22278-c507-4c0b-a415-afdcd7dd8ceb service nova] Creating event network-changed:8b336a7e-dc7f-4941-ad3c-e3ebeb8a4126 for instance d6df0eb9-ee25-4112-b943-364556de0f30 on n-h2-826526-5 Jul 20 05:18:06.755048 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-392022ae-3b86-4127-bbff-b99b4c28c428 req-49c22278-c507-4c0b-a415-afdcd7dd8ceb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034168 Jul 20 05:18:06.755763 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3562/7357] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:18:06.763371 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-683335f6-8bae-404e-92c3-f76528889b37 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:18:06.854747 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-683335f6-8bae-404e-92c3-f76528889b37 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 204 len: 0 microversion: 2.1 time: 0.136094 Jul 20 05:18:06.855918 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3796/7358] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:18:06 2022] DELETE /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:18:06.870137 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9f484734-1183-4822-a02c-28d402a439f6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:06.870855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9f484734-1183-4822-a02c-28d402a439f6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:06.877898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f484734-1183-4822-a02c-28d402a439f6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:06.878498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f484734-1183-4822-a02c-28d402a439f6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:06.879329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f484734-1183-4822-a02c-28d402a439f6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:06.879784 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9f484734-1183-4822-a02c-28d402a439f6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:07.054537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-9f484734-1183-4822-a02c-28d402a439f6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:07.062697 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9f484734-1183-4822-a02c-28d402a439f6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 200 len: 1690 microversion: 2.1 time: 0.198386 Jul 20 05:18:07.063501 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3563/7359] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:06 2022] GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 1690 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:08.081712 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0e7b225a-e30c-4ac2-8ae9-3ad31a64aff4 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:08.082659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0e7b225a-e30c-4ac2-8ae9-3ad31a64aff4 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:08.090209 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0e7b225a-e30c-4ac2-8ae9-3ad31a64aff4 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:08.090668 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0e7b225a-e30c-4ac2-8ae9-3ad31a64aff4 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:08.091457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0e7b225a-e30c-4ac2-8ae9-3ad31a64aff4 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:08.091965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0e7b225a-e30c-4ac2-8ae9-3ad31a64aff4 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:08.270522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0e7b225a-e30c-4ac2-8ae9-3ad31a64aff4 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:08.278805 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0e7b225a-e30c-4ac2-8ae9-3ad31a64aff4 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 200 len: 1690 microversion: 2.1 time: 0.201383 Jul 20 05:18:08.279382 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3797/7360] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:08 2022] GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 1690 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:08.848842 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-c00fde24-165c-4dd2-87ca-21cb6109335f req-dc925c95-8da0-441b-8029-ea0126d5b22d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6df0eb9-ee25-4112-b943-364556de0f30", "name": "network-vif-deleted", "tag": "8b336a7e-dc7f-4941-ad3c-e3ebeb8a4126"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:08.857895 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c00fde24-165c-4dd2-87ca-21cb6109335f req-dc925c95-8da0-441b-8029-ea0126d5b22d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:08.858907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c00fde24-165c-4dd2-87ca-21cb6109335f req-dc925c95-8da0-441b-8029-ea0126d5b22d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:08.871870 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-c00fde24-165c-4dd2-87ca-21cb6109335f req-dc925c95-8da0-441b-8029-ea0126d5b22d service nova] Creating event network-vif-deleted:8b336a7e-dc7f-4941-ad3c-e3ebeb8a4126 for instance d6df0eb9-ee25-4112-b943-364556de0f30 on n-h2-826526-5 Jul 20 05:18:08.878093 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-c00fde24-165c-4dd2-87ca-21cb6109335f req-dc925c95-8da0-441b-8029-ea0126d5b22d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034782 Jul 20 05:18:08.878714 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3564/7361] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:18:09.296992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c42d5d20-ead1-4c8e-9581-edfc92508a15 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:09.297865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c42d5d20-ead1-4c8e-9581-edfc92508a15 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: d6df0eb9-ee25-4112-b943-364556de0f30] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:09.306468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c42d5d20-ead1-4c8e-9581-edfc92508a15 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:09.306911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c42d5d20-ead1-4c8e-9581-edfc92508a15 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:09.307713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c42d5d20-ead1-4c8e-9581-edfc92508a15 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:09.308151 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c42d5d20-ead1-4c8e-9581-edfc92508a15 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:09.329110 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-c42d5d20-ead1-4c8e-9581-edfc92508a15 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] HTTP exception thrown: Instance d6df0eb9-ee25-4112-b943-364556de0f30 could not be found. Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c42d5d20-ead1-4c8e-9581-edfc92508a15 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Request method failure captured: Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 HTTP/1.1 Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14_VCFjjVcTDMCOBzB1_dpwx5DVZGShtyV9aNSxFwqN91bfAZLspYUqpOuFY60lfwoTX92LAvzu4_lVXiuAI6bCcZR72Uk33EVYPdRaTam7Sy1z7ptYj007ryXZcviRzbeELD7jp-BgLMPFOM6y6Fr8V8hDQb9L5gP558auLEGITPuw Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4fb789b41bf4456da732c16f4f4a8b7f Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-337819042 Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4fb789b41bf4456da732c16f4f4a8b7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4fb789b41bf4456da732c16f4f4a8b7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4fb789b41bf4456da732c16f4f4a8b7f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4fb789b41bf4456da732c16f4f4a8b7f"}]}] Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestNetworkAdvancedServerOps-337819042 Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4fb789b41bf4456da732c16f4f4a8b7f Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-337819042 Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestNetworkAdvancedServerOps-337819042-project Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1630a34d53714c0e9476578c711c87ac Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestNetworkAdvancedServerOps-337819042-project Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance d6df0eb9-ee25-4112-b943-364556de0f30 could not be found. Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'd6df0eb9-ee25-4112-b943-364556de0f30'} Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6df0eb9-ee25-4112-b943-364556de0f30 could not be found. Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6df0eb9-ee25-4112-b943-364556de0f30 could not be found. Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:09.330852 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:18:09.335652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:09.335652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:09.335652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:09.335652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:18:09.335652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:18:09.335652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6df0eb9-ee25-4112-b943-364556de0f30 could not be found. Jul 20 05:18:09.335652 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:18:09.335652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c42d5d20-ead1-4c8e-9581-edfc92508a15 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Returning 404 to user: Instance d6df0eb9-ee25-4112-b943-364556de0f30 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:18:09.335652 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c42d5d20-ead1-4c8e-9581-edfc92508a15 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30" status: 404 len: 111 microversion: 2.1 time: 0.039902 Jul 20 05:18:09.335652 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3798/7362] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:09 2022] GET /compute/v2.1/servers/d6df0eb9-ee25-4112-b943-364556de0f30 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:18:12.549619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-67d05eb6-535b-490b-8766-d9ce0afc055a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '.version_select at 0x7f06bd1ba550>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:12.576105 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-67d05eb6-535b-490b-8766-d9ce0afc055a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1692478284" status: 202 len: 0 microversion: 2.1 time: 0.031467 Jul 20 05:18:12.576759 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3565/7363] 10.222.0.17 () {58 vars in 1283 bytes} [Wed Jul 20 05:18:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1692478284 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:18:12.605299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9a677b11-4b8c-4483-b7e0-dbadde17b572 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'create', calling method: .version_select at 0x7f06bdf39700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2052258495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw1XNFkponOxqrfvv2YzoLBg1vitf+sSzz/v2IAWBegEbAj6Hr9WJiSOl/B2SLSNiiQRhQfQ06XhowEjPi8IKsw4mo+E8wTNXQe/qejMilTkzJ5T11vdnR6T/8V9Qi5Fg=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:12.623046 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-9a677b11-4b8c-4483-b7e0-dbadde17b572 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:18:12.631284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-9a677b11-4b8c-4483-b7e0-dbadde17b572 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for user 1630a34d53714c0e9476578c711c87ac and project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:18:12.664520 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9a677b11-4b8c-4483-b7e0-dbadde17b572 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.061397 Jul 20 05:18:12.668459 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3799/7364] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 05:18:12 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:18:19.043876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=30 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:19.048969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4a474077-b07d-4638-9648-429281de8fa0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-175048217", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "46ba845c-e5ea-4ee0-83d8-9326b654b7b0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2052258495", "security_groups": [{"name": "tempest-secgroup-smoke-1682390457"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:19.158894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-4a474077-b07d-4638-9648-429281de8fa0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] validate_networks() for [('46ba845c-e5ea-4ee0-83d8-9326b654b7b0', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:18:19.596208 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-4a474077-b07d-4638-9648-429281de8fa0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:18:19.597004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-4a474077-b07d-4638-9648-429281de8fa0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:18:19.597566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-4a474077-b07d-4638-9648-429281de8fa0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:18:19.598054 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-4a474077-b07d-4638-9648-429281de8fa0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:18:19.598698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-4a474077-b07d-4638-9648-429281de8fa0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:18:19.608802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a474077-b07d-4638-9648-429281de8fa0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:19.609290 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a474077-b07d-4638-9648-429281de8fa0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:19.610307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a474077-b07d-4638-9648-429281de8fa0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:19.610749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a474077-b07d-4638-9648-429281de8fa0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:19.638500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-4a474077-b07d-4638-9648-429281de8fa0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:18:19.646263 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-4a474077-b07d-4638-9648-429281de8fa0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for user 1630a34d53714c0e9476578c711c87ac and project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:18:19.662047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4a474077-b07d-4638-9648-429281de8fa0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:18:19.664618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4a474077-b07d-4638-9648-429281de8fa0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:18:19.720550 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4a474077-b07d-4638-9648-429281de8fa0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.678643 Jul 20 05:18:19.726544 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3566/7365] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:18:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:18:19.730747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:19.749569 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-118c97b2-fc45-4316-9374-5fdd9eb49256 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:19.771400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-118c97b2-fc45-4316-9374-5fdd9eb49256 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:19.846548 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-118c97b2-fc45-4316-9374-5fdd9eb49256 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:19.856545 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-118c97b2-fc45-4316-9374-5fdd9eb49256 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1266 microversion: 2.1 time: 0.126313 Jul 20 05:18:19.859455 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3800/7366] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:19 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:20.879453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c568ed54-0dbc-46bd-9b13-fa9723a0eb3d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:20.880904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c568ed54-0dbc-46bd-9b13-fa9723a0eb3d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:20.913271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c568ed54-0dbc-46bd-9b13-fa9723a0eb3d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:20.914969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c568ed54-0dbc-46bd-9b13-fa9723a0eb3d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:20.915475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c568ed54-0dbc-46bd-9b13-fa9723a0eb3d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:20.916011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c568ed54-0dbc-46bd-9b13-fa9723a0eb3d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:21.047453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c568ed54-0dbc-46bd-9b13-fa9723a0eb3d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:21.063796 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c568ed54-0dbc-46bd-9b13-fa9723a0eb3d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1326 microversion: 2.1 time: 0.189761 Jul 20 05:18:21.067448 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3567/7367] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:20 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1326 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:22.084786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fa4e7207-b500-455e-9cbd-b7cf4a9375e5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:22.085402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fa4e7207-b500-455e-9cbd-b7cf4a9375e5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:22.094147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa4e7207-b500-455e-9cbd-b7cf4a9375e5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:22.094602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa4e7207-b500-455e-9cbd-b7cf4a9375e5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:22.095420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa4e7207-b500-455e-9cbd-b7cf4a9375e5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:22.095844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fa4e7207-b500-455e-9cbd-b7cf4a9375e5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:22.255446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fa4e7207-b500-455e-9cbd-b7cf4a9375e5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:22.263943 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fa4e7207-b500-455e-9cbd-b7cf4a9375e5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1392 microversion: 2.1 time: 0.183259 Jul 20 05:18:22.264586 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3801/7368] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:22 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:22.659715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-af26b6e4-af6f-4f2e-8162-379ff97528f9 req-64867f81-d11f-4cac-835d-a4bd79ffab22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a72505ce-50c1-414e-a8f4-e457b4742132", "tag": "2da3fb8f-1d87-4381-ac4c-a42d334d1dca"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:22.674035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-af26b6e4-af6f-4f2e-8162-379ff97528f9 req-64867f81-d11f-4cac-835d-a4bd79ffab22 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:22.674396 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-af26b6e4-af6f-4f2e-8162-379ff97528f9 req-64867f81-d11f-4cac-835d-a4bd79ffab22 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:22.696502 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-af26b6e4-af6f-4f2e-8162-379ff97528f9 req-64867f81-d11f-4cac-835d-a4bd79ffab22 service nova] Creating event network-changed:2da3fb8f-1d87-4381-ac4c-a42d334d1dca for instance a72505ce-50c1-414e-a8f4-e457b4742132 on n-h1-826526-5 Jul 20 05:18:22.704134 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-af26b6e4-af6f-4f2e-8162-379ff97528f9 req-64867f81-d11f-4cac-835d-a4bd79ffab22 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049518 Jul 20 05:18:22.705180 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3568/7369] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:18:23.283787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-abf9e488-8849-4eb4-a8e9-16688c8de692 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:23.284614 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-abf9e488-8849-4eb4-a8e9-16688c8de692 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:23.296356 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abf9e488-8849-4eb4-a8e9-16688c8de692 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:23.297093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abf9e488-8849-4eb4-a8e9-16688c8de692 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:23.298228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abf9e488-8849-4eb4-a8e9-16688c8de692 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:23.299128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-abf9e488-8849-4eb4-a8e9-16688c8de692 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:23.446086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-abf9e488-8849-4eb4-a8e9-16688c8de692 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:23.454737 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-abf9e488-8849-4eb4-a8e9-16688c8de692 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1392 microversion: 2.1 time: 0.176344 Jul 20 05:18:23.455487 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3802/7370] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:23 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:24.476571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-85f4f14f-ebc5-48ec-b4fe-315c72c00396 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:24.477266 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-85f4f14f-ebc5-48ec-b4fe-315c72c00396 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:24.484935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85f4f14f-ebc5-48ec-b4fe-315c72c00396 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:24.485408 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85f4f14f-ebc5-48ec-b4fe-315c72c00396 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:24.486204 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85f4f14f-ebc5-48ec-b4fe-315c72c00396 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:24.486660 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85f4f14f-ebc5-48ec-b4fe-315c72c00396 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:24.644834 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-85f4f14f-ebc5-48ec-b4fe-315c72c00396 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:24.654311 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-85f4f14f-ebc5-48ec-b4fe-315c72c00396 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1392 microversion: 2.1 time: 0.182628 Jul 20 05:18:24.655063 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3569/7371] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:24 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:25.675739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1af1b2b0-7bb6-49f4-85d5-e1fef4135a6f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:25.676384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1af1b2b0-7bb6-49f4-85d5-e1fef4135a6f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:25.685433 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1af1b2b0-7bb6-49f4-85d5-e1fef4135a6f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:25.686384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1af1b2b0-7bb6-49f4-85d5-e1fef4135a6f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:25.686855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1af1b2b0-7bb6-49f4-85d5-e1fef4135a6f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:25.687293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1af1b2b0-7bb6-49f4-85d5-e1fef4135a6f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:25.828381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1af1b2b0-7bb6-49f4-85d5-e1fef4135a6f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:25.836534 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1af1b2b0-7bb6-49f4-85d5-e1fef4135a6f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1392 microversion: 2.1 time: 0.166463 Jul 20 05:18:25.837131 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3803/7372] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:25 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:26.855616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1590787f-19d4-4510-a92c-e22407688e65 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:26.856221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1590787f-19d4-4510-a92c-e22407688e65 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:26.863529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1590787f-19d4-4510-a92c-e22407688e65 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:26.863973 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1590787f-19d4-4510-a92c-e22407688e65 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:26.864783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1590787f-19d4-4510-a92c-e22407688e65 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:26.865230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1590787f-19d4-4510-a92c-e22407688e65 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:27.017179 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1590787f-19d4-4510-a92c-e22407688e65 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:27.029687 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1590787f-19d4-4510-a92c-e22407688e65 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1392 microversion: 2.1 time: 0.178670 Jul 20 05:18:27.030920 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3570/7373] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:26 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:27.142671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-e2db8c67-1055-4510-bca7-8b400f6581c8 req-c7abf0ae-0344-43a2-9e2b-012b81beba45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72505ce-50c1-414e-a8f4-e457b4742132", "name": "network-vif-plugged", "status": "completed", "tag": "2da3fb8f-1d87-4381-ac4c-a42d334d1dca"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:27.152412 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e2db8c67-1055-4510-bca7-8b400f6581c8 req-c7abf0ae-0344-43a2-9e2b-012b81beba45 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:27.152858 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-e2db8c67-1055-4510-bca7-8b400f6581c8 req-c7abf0ae-0344-43a2-9e2b-012b81beba45 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:27.167806 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-e2db8c67-1055-4510-bca7-8b400f6581c8 req-c7abf0ae-0344-43a2-9e2b-012b81beba45 service nova] Creating event network-vif-plugged:2da3fb8f-1d87-4381-ac4c-a42d334d1dca for instance a72505ce-50c1-414e-a8f4-e457b4742132 on n-h1-826526-5 Jul 20 05:18:27.173463 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-e2db8c67-1055-4510-bca7-8b400f6581c8 req-c7abf0ae-0344-43a2-9e2b-012b81beba45 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034194 Jul 20 05:18:27.174084 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3804/7374] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:18:28.049375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bb4cec6f-4f48-4a31-8b9e-ee6eb687970d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:28.049987 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bb4cec6f-4f48-4a31-8b9e-ee6eb687970d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:28.057554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb4cec6f-4f48-4a31-8b9e-ee6eb687970d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:28.058020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb4cec6f-4f48-4a31-8b9e-ee6eb687970d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:28.058856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb4cec6f-4f48-4a31-8b9e-ee6eb687970d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:28.059392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb4cec6f-4f48-4a31-8b9e-ee6eb687970d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:28.266449 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bb4cec6f-4f48-4a31-8b9e-ee6eb687970d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:28.277978 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bb4cec6f-4f48-4a31-8b9e-ee6eb687970d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1392 microversion: 2.1 time: 0.232587 Jul 20 05:18:28.278684 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3571/7375] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:28 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1392 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:29.295557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e9b48a0e-7c4b-4de1-b5fa-4e0677184f04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:29.296284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e9b48a0e-7c4b-4de1-b5fa-4e0677184f04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:29.304373 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9b48a0e-7c4b-4de1-b5fa-4e0677184f04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:29.304869 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9b48a0e-7c4b-4de1-b5fa-4e0677184f04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:29.305658 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9b48a0e-7c4b-4de1-b5fa-4e0677184f04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:29.306104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9b48a0e-7c4b-4de1-b5fa-4e0677184f04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:29.505136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e9b48a0e-7c4b-4de1-b5fa-4e0677184f04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:29.513678 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e9b48a0e-7c4b-4de1-b5fa-4e0677184f04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1564 microversion: 2.1 time: 0.222537 Jul 20 05:18:29.522430 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3805/7376] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:29 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1564 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:29.532415 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6e10730f-f084-41f8-8976-08d73eb76e1c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:29.533051 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6e10730f-f084-41f8-8976-08d73eb76e1c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:29.540722 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e10730f-f084-41f8-8976-08d73eb76e1c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:29.541193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e10730f-f084-41f8-8976-08d73eb76e1c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:29.542126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e10730f-f084-41f8-8976-08d73eb76e1c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:29.542571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e10730f-f084-41f8-8976-08d73eb76e1c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:29.626158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:29.654903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:29.697420 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6e10730f-f084-41f8-8976-08d73eb76e1c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:29.706266 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6e10730f-f084-41f8-8976-08d73eb76e1c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1564 microversion: 2.1 time: 0.177848 Jul 20 05:18:29.706856 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3572/7377] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:29 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1564 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:31.783103 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ba8e2402-5b3a-4865-ac58-d06f1ba02b29 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:31.783681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ba8e2402-5b3a-4865-ac58-d06f1ba02b29 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:31.785996 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:31.787951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-99b2e95d-10e3-4f9b-8820-3a9e9c06301e req-38c00c1e-870f-4ebe-ab28-0ff8ed19634b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a72505ce-50c1-414e-a8f4-e457b4742132", "tag": "2da3fb8f-1d87-4381-ac4c-a42d334d1dca"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:31.788984 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:31.793541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:31.795362 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba8e2402-5b3a-4865-ac58-d06f1ba02b29 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:31.795868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba8e2402-5b3a-4865-ac58-d06f1ba02b29 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:31.796896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba8e2402-5b3a-4865-ac58-d06f1ba02b29 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:31.797520 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ba8e2402-5b3a-4865-ac58-d06f1ba02b29 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:31.798397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-99b2e95d-10e3-4f9b-8820-3a9e9c06301e req-38c00c1e-870f-4ebe-ab28-0ff8ed19634b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:31.798856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-99b2e95d-10e3-4f9b-8820-3a9e9c06301e req-38c00c1e-870f-4ebe-ab28-0ff8ed19634b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:31.813287 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-99b2e95d-10e3-4f9b-8820-3a9e9c06301e req-38c00c1e-870f-4ebe-ab28-0ff8ed19634b service nova] Creating event network-changed:2da3fb8f-1d87-4381-ac4c-a42d334d1dca for instance a72505ce-50c1-414e-a8f4-e457b4742132 on n-h1-826526-5 Jul 20 05:18:31.819729 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-99b2e95d-10e3-4f9b-8820-3a9e9c06301e req-38c00c1e-870f-4ebe-ab28-0ff8ed19634b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035473 Jul 20 05:18:31.820447 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3573/7378] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:18:31.965929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ba8e2402-5b3a-4865-ac58-d06f1ba02b29 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:31.974180 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ba8e2402-5b3a-4865-ac58-d06f1ba02b29 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1564 microversion: 2.1 time: 0.195352 Jul 20 05:18:31.974947 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3806/7379] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:31 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1564 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:53.258673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=36 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:53.263516 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e869267b-3556-4a6b-b277-4dfc94deb548 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:53.264794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e869267b-3556-4a6b-b277-4dfc94deb548 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:53.271647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e869267b-3556-4a6b-b277-4dfc94deb548 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:53.272116 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e869267b-3556-4a6b-b277-4dfc94deb548 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:53.272942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e869267b-3556-4a6b-b277-4dfc94deb548 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:53.273390 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e869267b-3556-4a6b-b277-4dfc94deb548 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:53.325320 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e869267b-3556-4a6b-b277-4dfc94deb548 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132/action" status: 200 len: 24563 microversion: 2.1 time: 0.068547 Jul 20 05:18:53.326158 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3574/7380] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:18:53 2022] POST /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132/action => generated 24563 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:19:04.381476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-86955dbc-3bae-4c3f-b3cf-238b202f97d1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:04.382488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-86955dbc-3bae-4c3f-b3cf-238b202f97d1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:04.385710 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:04.386352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=32 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:04.401147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86955dbc-3bae-4c3f-b3cf-238b202f97d1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:04.401601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86955dbc-3bae-4c3f-b3cf-238b202f97d1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:04.402476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86955dbc-3bae-4c3f-b3cf-238b202f97d1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:04.402913 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86955dbc-3bae-4c3f-b3cf-238b202f97d1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:04.487296 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-86955dbc-3bae-4c3f-b3cf-238b202f97d1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132/action" status: 202 len: 0 microversion: 2.1 time: 0.110127 Jul 20 05:19:04.488178 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3807/7381] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:19:04 2022] POST /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:19:04.498925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-02aafd31-d709-4da9-9eb1-64fa585b559d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:04.499744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-02aafd31-d709-4da9-9eb1-64fa585b559d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:04.507574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:04.508346 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:04.510218 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02aafd31-d709-4da9-9eb1-64fa585b559d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:04.510745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02aafd31-d709-4da9-9eb1-64fa585b559d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:04.511805 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02aafd31-d709-4da9-9eb1-64fa585b559d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:04.512324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02aafd31-d709-4da9-9eb1-64fa585b559d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:04.767924 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-02aafd31-d709-4da9-9eb1-64fa585b559d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:04.776463 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-02aafd31-d709-4da9-9eb1-64fa585b559d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1675 microversion: 2.1 time: 0.283069 Jul 20 05:19:04.777486 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3575/7382] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:04 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1675 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:05.800795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5bd6dfb3-a57a-4451-b17d-6865dfe56631 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:05.801885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5bd6dfb3-a57a-4451-b17d-6865dfe56631 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:05.815102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5bd6dfb3-a57a-4451-b17d-6865dfe56631 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:05.815551 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5bd6dfb3-a57a-4451-b17d-6865dfe56631 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:05.816377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5bd6dfb3-a57a-4451-b17d-6865dfe56631 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:05.816821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5bd6dfb3-a57a-4451-b17d-6865dfe56631 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:05.955092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5bd6dfb3-a57a-4451-b17d-6865dfe56631 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:05.963153 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5bd6dfb3-a57a-4451-b17d-6865dfe56631 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1680 microversion: 2.1 time: 0.169893 Jul 20 05:19:05.963741 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3808/7383] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:05 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:06.983508 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-762ffafa-5ff6-4b7c-b6e6-a860e4cf7a09 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:06.984690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-762ffafa-5ff6-4b7c-b6e6-a860e4cf7a09 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:06.993338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-762ffafa-5ff6-4b7c-b6e6-a860e4cf7a09 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:06.993800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-762ffafa-5ff6-4b7c-b6e6-a860e4cf7a09 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:06.994589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-762ffafa-5ff6-4b7c-b6e6-a860e4cf7a09 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:06.995043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-762ffafa-5ff6-4b7c-b6e6-a860e4cf7a09 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:07.139250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-762ffafa-5ff6-4b7c-b6e6-a860e4cf7a09 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:07.148518 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-762ffafa-5ff6-4b7c-b6e6-a860e4cf7a09 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1680 microversion: 2.1 time: 0.171277 Jul 20 05:19:07.149071 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3576/7384] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:06 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:08.170226 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-53e00cc6-579b-4ff6-bc5a-cc84ac41ea15 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:08.171228 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-53e00cc6-579b-4ff6-bc5a-cc84ac41ea15 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:08.183040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-53e00cc6-579b-4ff6-bc5a-cc84ac41ea15 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:08.183788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-53e00cc6-579b-4ff6-bc5a-cc84ac41ea15 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:08.185232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-53e00cc6-579b-4ff6-bc5a-cc84ac41ea15 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:08.185964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-53e00cc6-579b-4ff6-bc5a-cc84ac41ea15 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:08.337707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-53e00cc6-579b-4ff6-bc5a-cc84ac41ea15 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:08.345690 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-53e00cc6-579b-4ff6-bc5a-cc84ac41ea15 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1680 microversion: 2.1 time: 0.182121 Jul 20 05:19:08.346288 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3809/7385] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:08 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:09.364324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d41f947-ed2f-4a1e-a89e-215e92c54843 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:09.365026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d41f947-ed2f-4a1e-a89e-215e92c54843 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:09.373744 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d41f947-ed2f-4a1e-a89e-215e92c54843 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:09.374296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d41f947-ed2f-4a1e-a89e-215e92c54843 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:09.375211 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d41f947-ed2f-4a1e-a89e-215e92c54843 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:09.375741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d41f947-ed2f-4a1e-a89e-215e92c54843 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:09.516348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d41f947-ed2f-4a1e-a89e-215e92c54843 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:09.527314 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d41f947-ed2f-4a1e-a89e-215e92c54843 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1680 microversion: 2.1 time: 0.167326 Jul 20 05:19:09.528019 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3577/7386] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:09 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:10.548904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e22da034-9fd2-4176-b6e5-32653d687a3f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:10.549498 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e22da034-9fd2-4176-b6e5-32653d687a3f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:10.557098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e22da034-9fd2-4176-b6e5-32653d687a3f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:10.557571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e22da034-9fd2-4176-b6e5-32653d687a3f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:10.558350 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e22da034-9fd2-4176-b6e5-32653d687a3f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:10.558798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e22da034-9fd2-4176-b6e5-32653d687a3f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:10.711535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e22da034-9fd2-4176-b6e5-32653d687a3f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:10.719892 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e22da034-9fd2-4176-b6e5-32653d687a3f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1680 microversion: 2.1 time: 0.176637 Jul 20 05:19:10.720522 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3810/7387] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:10 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:11.741677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e40b2556-3531-469e-82a6-1d94923cf822 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:11.742463 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e40b2556-3531-469e-82a6-1d94923cf822 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:11.753537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e40b2556-3531-469e-82a6-1d94923cf822 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:11.754015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e40b2556-3531-469e-82a6-1d94923cf822 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:11.754785 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e40b2556-3531-469e-82a6-1d94923cf822 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:11.755301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e40b2556-3531-469e-82a6-1d94923cf822 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:11.908026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e40b2556-3531-469e-82a6-1d94923cf822 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:11.916115 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e40b2556-3531-469e-82a6-1d94923cf822 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1680 microversion: 2.1 time: 0.181417 Jul 20 05:19:11.916727 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3578/7388] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:11 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:12.938482 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6e152aeb-d063-4729-9211-2c13440e97ba tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:12.939500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6e152aeb-d063-4729-9211-2c13440e97ba tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:12.951501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e152aeb-d063-4729-9211-2c13440e97ba tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:12.952253 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e152aeb-d063-4729-9211-2c13440e97ba tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:12.953627 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e152aeb-d063-4729-9211-2c13440e97ba tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:12.954351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e152aeb-d063-4729-9211-2c13440e97ba tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:13.098437 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6e152aeb-d063-4729-9211-2c13440e97ba tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:13.106620 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6e152aeb-d063-4729-9211-2c13440e97ba tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1680 microversion: 2.1 time: 0.174987 Jul 20 05:19:13.107221 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3811/7389] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:12 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:14.128871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1fd5c7f8-91ca-40ff-af11-efa9634a9618 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:14.129499 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1fd5c7f8-91ca-40ff-af11-efa9634a9618 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:14.136540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1fd5c7f8-91ca-40ff-af11-efa9634a9618 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:14.137008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1fd5c7f8-91ca-40ff-af11-efa9634a9618 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:14.137745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1fd5c7f8-91ca-40ff-af11-efa9634a9618 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:14.138323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1fd5c7f8-91ca-40ff-af11-efa9634a9618 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:14.277619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1fd5c7f8-91ca-40ff-af11-efa9634a9618 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:14.290445 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1fd5c7f8-91ca-40ff-af11-efa9634a9618 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1680 microversion: 2.1 time: 0.168107 Jul 20 05:19:14.291306 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3579/7390] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:14 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:15.316110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-54f30a41-a7aa-438b-bfb8-ba0b9cff348c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:15.317486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-54f30a41-a7aa-438b-bfb8-ba0b9cff348c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:15.327524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54f30a41-a7aa-438b-bfb8-ba0b9cff348c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:15.328131 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54f30a41-a7aa-438b-bfb8-ba0b9cff348c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:15.329205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54f30a41-a7aa-438b-bfb8-ba0b9cff348c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:15.329781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-54f30a41-a7aa-438b-bfb8-ba0b9cff348c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:15.471165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-54f30a41-a7aa-438b-bfb8-ba0b9cff348c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:15.479446 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-54f30a41-a7aa-438b-bfb8-ba0b9cff348c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1680 microversion: 2.1 time: 0.169457 Jul 20 05:19:15.480056 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3812/7391] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:15 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:16.499809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c4298abc-4f77-435e-852e-24874d57f6cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:16.500737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c4298abc-4f77-435e-852e-24874d57f6cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:16.512182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4298abc-4f77-435e-852e-24874d57f6cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:16.513232 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4298abc-4f77-435e-852e-24874d57f6cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:16.514022 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4298abc-4f77-435e-852e-24874d57f6cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:16.514779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4298abc-4f77-435e-852e-24874d57f6cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:16.659490 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c4298abc-4f77-435e-852e-24874d57f6cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:16.667569 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c4298abc-4f77-435e-852e-24874d57f6cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1680 microversion: 2.1 time: 0.173890 Jul 20 05:19:16.668164 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3580/7392] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:16 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:17.687275 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-13a5deea-4ddd-4fe9-b767-0bd80aa1f023 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:17.687880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-13a5deea-4ddd-4fe9-b767-0bd80aa1f023 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:17.695783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13a5deea-4ddd-4fe9-b767-0bd80aa1f023 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:17.696235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13a5deea-4ddd-4fe9-b767-0bd80aa1f023 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:17.697026 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13a5deea-4ddd-4fe9-b767-0bd80aa1f023 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:17.697468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13a5deea-4ddd-4fe9-b767-0bd80aa1f023 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:17.836990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-13a5deea-4ddd-4fe9-b767-0bd80aa1f023 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:17.848499 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-13a5deea-4ddd-4fe9-b767-0bd80aa1f023 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1680 microversion: 2.1 time: 0.165278 Jul 20 05:19:17.849063 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3813/7393] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:17 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:18.868139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4d413917-6df6-424e-9018-0005e47d12eb tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:18.868807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4d413917-6df6-424e-9018-0005e47d12eb tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:18.876930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d413917-6df6-424e-9018-0005e47d12eb tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:18.877389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d413917-6df6-424e-9018-0005e47d12eb tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:18.878163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d413917-6df6-424e-9018-0005e47d12eb tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:18.878606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4d413917-6df6-424e-9018-0005e47d12eb tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:19.029169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4d413917-6df6-424e-9018-0005e47d12eb tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:19.040506 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4d413917-6df6-424e-9018-0005e47d12eb tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1680 microversion: 2.1 time: 0.176390 Jul 20 05:19:19.041307 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3581/7394] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:18 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:20.063365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-13ecc9dd-a5a4-4e99-8839-0368b16ceb63 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:20.063930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-13ecc9dd-a5a4-4e99-8839-0368b16ceb63 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:20.071625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13ecc9dd-a5a4-4e99-8839-0368b16ceb63 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:20.072071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13ecc9dd-a5a4-4e99-8839-0368b16ceb63 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:20.072908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13ecc9dd-a5a4-4e99-8839-0368b16ceb63 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:20.073342 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-13ecc9dd-a5a4-4e99-8839-0368b16ceb63 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:20.221348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-13ecc9dd-a5a4-4e99-8839-0368b16ceb63 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:20.229664 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-13ecc9dd-a5a4-4e99-8839-0368b16ceb63 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1680 microversion: 2.1 time: 0.170483 Jul 20 05:19:20.230252 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3814/7395] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:20 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:21.249343 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cc4267c7-7308-42b6-80cf-86309163a89d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:21.249928 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cc4267c7-7308-42b6-80cf-86309163a89d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:21.258096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc4267c7-7308-42b6-80cf-86309163a89d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:21.258585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc4267c7-7308-42b6-80cf-86309163a89d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:21.259370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc4267c7-7308-42b6-80cf-86309163a89d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:21.259821 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc4267c7-7308-42b6-80cf-86309163a89d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:21.409094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-cc4267c7-7308-42b6-80cf-86309163a89d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:21.417649 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cc4267c7-7308-42b6-80cf-86309163a89d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1683 microversion: 2.1 time: 0.172352 Jul 20 05:19:21.418229 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3582/7396] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:21 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:45.646610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2c11087a-4cad-4549-9273-e44e4828ce2a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:45.647576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2c11087a-4cad-4549-9273-e44e4828ce2a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:45.649975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=16 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:45.650677 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:45.658245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c11087a-4cad-4549-9273-e44e4828ce2a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:45.658827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c11087a-4cad-4549-9273-e44e4828ce2a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:45.659611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c11087a-4cad-4549-9273-e44e4828ce2a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:45.660050 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c11087a-4cad-4549-9273-e44e4828ce2a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:45.724924 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2c11087a-4cad-4549-9273-e44e4828ce2a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132/action" status: 200 len: 68884 microversion: 2.1 time: 0.082182 Jul 20 05:19:45.725530 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3815/7397] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:19:45 2022] POST /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132/action => generated 68884 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:19:52.898536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-a7439fb5-bbdb-4b88-9911-40fe7fbbf9dd req-b7e04c54-6764-4676-879a-f3e95fd763c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a72505ce-50c1-414e-a8f4-e457b4742132", "tag": "2da3fb8f-1d87-4381-ac4c-a42d334d1dca"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:52.905832 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-31d2ecd2-1c1a-4636-ab42-03c86d3e813f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:52.906347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-31d2ecd2-1c1a-4636-ab42-03c86d3e813f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:52.908943 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=16 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:52.909609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=48 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:52.915795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31d2ecd2-1c1a-4636-ab42-03c86d3e813f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:52.916555 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31d2ecd2-1c1a-4636-ab42-03c86d3e813f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:52.917124 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a7439fb5-bbdb-4b88-9911-40fe7fbbf9dd req-b7e04c54-6764-4676-879a-f3e95fd763c3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:52.917334 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31d2ecd2-1c1a-4636-ab42-03c86d3e813f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:52.917724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a7439fb5-bbdb-4b88-9911-40fe7fbbf9dd req-b7e04c54-6764-4676-879a-f3e95fd763c3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:52.918019 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31d2ecd2-1c1a-4636-ab42-03c86d3e813f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:52.930760 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-a7439fb5-bbdb-4b88-9911-40fe7fbbf9dd req-b7e04c54-6764-4676-879a-f3e95fd763c3 service nova] Creating event network-changed:2da3fb8f-1d87-4381-ac4c-a42d334d1dca for instance a72505ce-50c1-414e-a8f4-e457b4742132 on n-h1-826526-5 Jul 20 05:19:52.936628 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-a7439fb5-bbdb-4b88-9911-40fe7fbbf9dd req-b7e04c54-6764-4676-879a-f3e95fd763c3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042222 Jul 20 05:19:52.938422 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3816/7398] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:52.949520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-31d2ecd2-1c1a-4636-ab42-03c86d3e813f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:19:53.053815 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-31d2ecd2-1c1a-4636-ab42-03c86d3e813f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 204 len: 0 microversion: 2.1 time: 0.161796 Jul 20 05:19:53.058365 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3583/7399] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:19:52 2022] DELETE /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:19:53.065107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9a9ffbfe-d5cb-4090-b9d8-f24e6a442552 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:53.066116 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9a9ffbfe-d5cb-4090-b9d8-f24e6a442552 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:53.073817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a9ffbfe-d5cb-4090-b9d8-f24e6a442552 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:53.074602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a9ffbfe-d5cb-4090-b9d8-f24e6a442552 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:53.075596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a9ffbfe-d5cb-4090-b9d8-f24e6a442552 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:53.076041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9a9ffbfe-d5cb-4090-b9d8-f24e6a442552 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:53.216822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9a9ffbfe-d5cb-4090-b9d8-f24e6a442552 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:53.224984 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9a9ffbfe-d5cb-4090-b9d8-f24e6a442552 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1689 microversion: 2.1 time: 0.164808 Jul 20 05:19:53.235546 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3817/7400] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:53 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:54.244554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d8529acc-a959-4c06-a309-bab4f553d11e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:54.245185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d8529acc-a959-4c06-a309-bab4f553d11e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:54.253795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8529acc-a959-4c06-a309-bab4f553d11e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:54.254461 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8529acc-a959-4c06-a309-bab4f553d11e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:54.255431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8529acc-a959-4c06-a309-bab4f553d11e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:54.255883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8529acc-a959-4c06-a309-bab4f553d11e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:54.430577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d8529acc-a959-4c06-a309-bab4f553d11e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:54.438536 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d8529acc-a959-4c06-a309-bab4f553d11e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1689 microversion: 2.1 time: 0.198549 Jul 20 05:19:54.439148 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3584/7401] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:54 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1689 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:55.145641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-5543c4a2-4a55-4115-94bf-b2ee2fa5fcce req-df9e7049-df0b-43c0-a533-1e04c3c008a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72505ce-50c1-414e-a8f4-e457b4742132", "name": "network-vif-deleted", "tag": "2da3fb8f-1d87-4381-ac4c-a42d334d1dca"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:55.157162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5543c4a2-4a55-4115-94bf-b2ee2fa5fcce req-df9e7049-df0b-43c0-a533-1e04c3c008a2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:55.157607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-5543c4a2-4a55-4115-94bf-b2ee2fa5fcce req-df9e7049-df0b-43c0-a533-1e04c3c008a2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:55.169395 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-5543c4a2-4a55-4115-94bf-b2ee2fa5fcce req-df9e7049-df0b-43c0-a533-1e04c3c008a2 service nova] Creating event network-vif-deleted:2da3fb8f-1d87-4381-ac4c-a42d334d1dca for instance a72505ce-50c1-414e-a8f4-e457b4742132 on n-h1-826526-5 Jul 20 05:19:55.174658 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-5543c4a2-4a55-4115-94bf-b2ee2fa5fcce req-df9e7049-df0b-43c0-a533-1e04c3c008a2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116038 Jul 20 05:19:55.175380 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3818/7402] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:55.457215 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fc7645d9-f771-441b-977e-eb2739e87b16 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:55.458000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fc7645d9-f771-441b-977e-eb2739e87b16 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:55.465912 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc7645d9-f771-441b-977e-eb2739e87b16 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:55.466488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc7645d9-f771-441b-977e-eb2739e87b16 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:55.467338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc7645d9-f771-441b-977e-eb2739e87b16 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:55.467890 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc7645d9-f771-441b-977e-eb2739e87b16 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:55.501454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc7645d9-f771-441b-977e-eb2739e87b16 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:55.502005 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc7645d9-f771-441b-977e-eb2739e87b16 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:55.502472 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-fc7645d9-f771-441b-977e-eb2739e87b16 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lazy-loading 'fault' on Instance uuid a72505ce-50c1-414e-a8f4-e457b4742132 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:19:55.548366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-fc7645d9-f771-441b-977e-eb2739e87b16 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:55.559436 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fc7645d9-f771-441b-977e-eb2739e87b16 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 200 len: 1356 microversion: 2.1 time: 0.106448 Jul 20 05:19:55.560070 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3585/7403] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:55 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:56.582605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4958bd88-c926-4916-bfb6-405e9f100a21 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:56.583341 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4958bd88-c926-4916-bfb6-405e9f100a21 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: a72505ce-50c1-414e-a8f4-e457b4742132] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:56.591435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4958bd88-c926-4916-bfb6-405e9f100a21 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:56.591885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4958bd88-c926-4916-bfb6-405e9f100a21 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:56.592693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4958bd88-c926-4916-bfb6-405e9f100a21 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:56.593132 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4958bd88-c926-4916-bfb6-405e9f100a21 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:56.607097 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-4958bd88-c926-4916-bfb6-405e9f100a21 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] HTTP exception thrown: Instance a72505ce-50c1-414e-a8f4-e457b4742132 could not be found. Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4958bd88-c926-4916-bfb6-405e9f100a21 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Request method failure captured: Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 HTTP/1.1 Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14_VCFjjVcTDMCOBzB1_dpwx5DVZGShtyV9aNSxFwqN91bfAZLspYUqpOuFY60lfwoTX92LAvzu4_lVXiuAI6bCcZR72Uk33EVYPdRaTam7Sy1z7ptYj007ryXZcviRzbeELD7jp-BgLMPFOM6y6Fr8V8hDQb9L5gP558auLEGITPuw Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4fb789b41bf4456da732c16f4f4a8b7f Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-337819042 Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4fb789b41bf4456da732c16f4f4a8b7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4fb789b41bf4456da732c16f4f4a8b7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4fb789b41bf4456da732c16f4f4a8b7f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4fb789b41bf4456da732c16f4f4a8b7f"}]}] Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestNetworkAdvancedServerOps-337819042 Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4fb789b41bf4456da732c16f4f4a8b7f Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-337819042 Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestNetworkAdvancedServerOps-337819042-project Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1630a34d53714c0e9476578c711c87ac Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestNetworkAdvancedServerOps-337819042-project Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance a72505ce-50c1-414e-a8f4-e457b4742132 could not be found. Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': 'a72505ce-50c1-414e-a8f4-e457b4742132'} Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a72505ce-50c1-414e-a8f4-e457b4742132 could not be found. Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a72505ce-50c1-414e-a8f4-e457b4742132 could not be found. Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:19:56.608753 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:19:56.613400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:19:56.613400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:19:56.613400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:19:56.613400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:19:56.613400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:19:56.613400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a72505ce-50c1-414e-a8f4-e457b4742132 could not be found. Jul 20 05:19:56.613400 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:19:56.613400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4958bd88-c926-4916-bfb6-405e9f100a21 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Returning 404 to user: Instance a72505ce-50c1-414e-a8f4-e457b4742132 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:19:56.613400 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4958bd88-c926-4916-bfb6-405e9f100a21 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132" status: 404 len: 111 microversion: 2.1 time: 0.034106 Jul 20 05:19:56.613400 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3819/7404] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:56 2022] GET /compute/v2.1/servers/a72505ce-50c1-414e-a8f4-e457b4742132 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:20:00.031991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c842ce27-0ba9-4673-8a05-8ed47f389f9b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '.version_select at 0x7f06bd2dfee0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:00.054960 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c842ce27-0ba9-4673-8a05-8ed47f389f9b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2052258495" status: 202 len: 0 microversion: 2.1 time: 0.026833 Jul 20 05:20:00.055700 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3586/7405] 10.222.0.17 () {58 vars in 1283 bytes} [Wed Jul 20 05:20:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2052258495 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:20:00.085372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d7108411-3f9d-4de2-ba82-67a9d85efc25 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'create', calling method: .version_select at 0x7f06bcb50280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1540171449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrE1ImNsZljfDIkqaawU+K0UDsbAwWI3L1EDg1bmhd/juu3khdWE1ePjD/8a8yaLMt+fC6KcYCR8F9+tTAnzwE08RFV7wDiMmF2EbTYU08h+wG6E/QigFQ/S7kCJjU3Mw=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:00.101399 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-d7108411-3f9d-4de2-ba82-67a9d85efc25 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:20:00.106781 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-d7108411-3f9d-4de2-ba82-67a9d85efc25 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for user 1630a34d53714c0e9476578c711c87ac and project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:20:00.133820 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d7108411-3f9d-4de2-ba82-67a9d85efc25 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052447 Jul 20 05:20:00.134390 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3820/7406] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 05:20:00 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:20:06.124658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:06.129926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7afb4315-97ac-4f4b-b7d5-f842db6027cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2081493386", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "1a832de1-23d1-4bbb-b65b-12c645ee8d3f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1540171449", "security_groups": [{"name": "tempest-secgroup-smoke-1202507504"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:06.265798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-7afb4315-97ac-4f4b-b7d5-f842db6027cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] validate_networks() for [('1a832de1-23d1-4bbb-b65b-12c645ee8d3f', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:20:06.769099 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-7afb4315-97ac-4f4b-b7d5-f842db6027cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:20:06.769543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-7afb4315-97ac-4f4b-b7d5-f842db6027cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:20:06.770031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-7afb4315-97ac-4f4b-b7d5-f842db6027cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:20:06.770455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-7afb4315-97ac-4f4b-b7d5-f842db6027cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:20:06.770877 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-7afb4315-97ac-4f4b-b7d5-f842db6027cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:20:06.782320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7afb4315-97ac-4f4b-b7d5-f842db6027cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:06.783043 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7afb4315-97ac-4f4b-b7d5-f842db6027cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:06.784076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7afb4315-97ac-4f4b-b7d5-f842db6027cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:06.784724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7afb4315-97ac-4f4b-b7d5-f842db6027cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:06.802559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-7afb4315-97ac-4f4b-b7d5-f842db6027cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:20:06.808297 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-7afb4315-97ac-4f4b-b7d5-f842db6027cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for user 1630a34d53714c0e9476578c711c87ac and project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:20:06.820952 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7afb4315-97ac-4f4b-b7d5-f842db6027cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:20:06.823517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7afb4315-97ac-4f4b-b7d5-f842db6027cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:20:06.872114 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7afb4315-97ac-4f4b-b7d5-f842db6027cc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.749243 Jul 20 05:20:06.878236 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3587/7407] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:20:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:20:06.881636 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=16 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:06.885824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7a0513c7-29fd-4d19-b634-3d99005e5a0e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:06.886462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7a0513c7-29fd-4d19-b634-3d99005e5a0e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:06.946941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7a0513c7-29fd-4d19-b634-3d99005e5a0e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:06.957713 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7a0513c7-29fd-4d19-b634-3d99005e5a0e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1267 microversion: 2.1 time: 0.077911 Jul 20 05:20:06.958317 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3821/7408] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:06 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1267 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:07.987541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8863298c-6cfe-448e-bb35-31ee0337e145 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:07.989504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8863298c-6cfe-448e-bb35-31ee0337e145 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:08.001534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8863298c-6cfe-448e-bb35-31ee0337e145 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:08.002504 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8863298c-6cfe-448e-bb35-31ee0337e145 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:08.004571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8863298c-6cfe-448e-bb35-31ee0337e145 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:08.005500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8863298c-6cfe-448e-bb35-31ee0337e145 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:08.137592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8863298c-6cfe-448e-bb35-31ee0337e145 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:08.150664 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8863298c-6cfe-448e-bb35-31ee0337e145 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1325 microversion: 2.1 time: 0.178140 Jul 20 05:20:08.161545 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3588/7409] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:07 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1325 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:09.168574 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-590b01a3-3830-4d62-b7e1-c63c96e6d065 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:09.169390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-590b01a3-3830-4d62-b7e1-c63c96e6d065 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:09.177269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-590b01a3-3830-4d62-b7e1-c63c96e6d065 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:09.177689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-590b01a3-3830-4d62-b7e1-c63c96e6d065 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:09.178715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-590b01a3-3830-4d62-b7e1-c63c96e6d065 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:09.179217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-590b01a3-3830-4d62-b7e1-c63c96e6d065 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:09.342478 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-590b01a3-3830-4d62-b7e1-c63c96e6d065 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:09.356088 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-590b01a3-3830-4d62-b7e1-c63c96e6d065 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1393 microversion: 2.1 time: 0.191350 Jul 20 05:20:09.358517 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3822/7410] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:09 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1393 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:09.699111 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e5691097-9e58-48f3-b66e-999542250386 req-0da60dd8-ffd3-4332-9d65-98ddce402006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13dfbdeb-5221-41f6-b07f-efc83eada675", "tag": "f3a42a59-0fb4-438c-ab01-b24ac6e00934"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:09.709926 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e5691097-9e58-48f3-b66e-999542250386 req-0da60dd8-ffd3-4332-9d65-98ddce402006 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:09.710650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e5691097-9e58-48f3-b66e-999542250386 req-0da60dd8-ffd3-4332-9d65-98ddce402006 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:09.724869 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e5691097-9e58-48f3-b66e-999542250386 req-0da60dd8-ffd3-4332-9d65-98ddce402006 service nova] Creating event network-changed:f3a42a59-0fb4-438c-ab01-b24ac6e00934 for instance 13dfbdeb-5221-41f6-b07f-efc83eada675 on n-h2-826526-5 Jul 20 05:20:09.731054 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e5691097-9e58-48f3-b66e-999542250386 req-0da60dd8-ffd3-4332-9d65-98ddce402006 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121930 Jul 20 05:20:09.732685 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3589/7411] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:20:10.376772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-20600ca1-53a2-429a-bb92-016bfcb8e5dd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:10.377432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-20600ca1-53a2-429a-bb92-016bfcb8e5dd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:10.385459 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20600ca1-53a2-429a-bb92-016bfcb8e5dd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:10.385916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20600ca1-53a2-429a-bb92-016bfcb8e5dd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:10.386706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20600ca1-53a2-429a-bb92-016bfcb8e5dd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:10.387146 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-20600ca1-53a2-429a-bb92-016bfcb8e5dd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:10.536748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-20600ca1-53a2-429a-bb92-016bfcb8e5dd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:10.544934 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-20600ca1-53a2-429a-bb92-016bfcb8e5dd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1393 microversion: 2.1 time: 0.173017 Jul 20 05:20:10.545495 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3823/7412] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:10 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:20:11.563996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8094be78-444a-499d-9819-9e9520cfb98d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:11.564755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8094be78-444a-499d-9819-9e9520cfb98d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:11.573142 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8094be78-444a-499d-9819-9e9520cfb98d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:11.573643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8094be78-444a-499d-9819-9e9520cfb98d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:11.574452 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8094be78-444a-499d-9819-9e9520cfb98d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:11.574903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8094be78-444a-499d-9819-9e9520cfb98d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:11.792803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8094be78-444a-499d-9819-9e9520cfb98d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:11.801238 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8094be78-444a-499d-9819-9e9520cfb98d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1393 microversion: 2.1 time: 0.241691 Jul 20 05:20:11.801847 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3590/7413] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:11 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1393 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:12.818844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d89d07bd-4a03-4895-9cec-d539fcd1cdc1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:12.819466 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d89d07bd-4a03-4895-9cec-d539fcd1cdc1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:12.827024 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d89d07bd-4a03-4895-9cec-d539fcd1cdc1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:12.827474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d89d07bd-4a03-4895-9cec-d539fcd1cdc1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:12.828249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d89d07bd-4a03-4895-9cec-d539fcd1cdc1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:12.828706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d89d07bd-4a03-4895-9cec-d539fcd1cdc1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:12.968225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d89d07bd-4a03-4895-9cec-d539fcd1cdc1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:12.976224 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d89d07bd-4a03-4895-9cec-d539fcd1cdc1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1393 microversion: 2.1 time: 0.161340 Jul 20 05:20:12.976866 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3824/7414] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:12 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:13.994995 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a02269cd-a945-4356-aa96-4951b07ecede tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:13.995756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a02269cd-a945-4356-aa96-4951b07ecede tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:14.004101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a02269cd-a945-4356-aa96-4951b07ecede tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:14.004920 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a02269cd-a945-4356-aa96-4951b07ecede tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:14.006191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a02269cd-a945-4356-aa96-4951b07ecede tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:14.007690 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a02269cd-a945-4356-aa96-4951b07ecede tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:14.180547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a02269cd-a945-4356-aa96-4951b07ecede tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:14.189161 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a02269cd-a945-4356-aa96-4951b07ecede tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1393 microversion: 2.1 time: 0.198971 Jul 20 05:20:14.190047 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3591/7415] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:13 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1393 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:14.207607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-8e6dda10-293d-4969-9684-aff36439fa8e req-91d3ef0d-ff1e-4959-a5df-3eea36674d4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13dfbdeb-5221-41f6-b07f-efc83eada675", "name": "network-vif-plugged", "status": "completed", "tag": "f3a42a59-0fb4-438c-ab01-b24ac6e00934"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:14.217792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8e6dda10-293d-4969-9684-aff36439fa8e req-91d3ef0d-ff1e-4959-a5df-3eea36674d4a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:14.218241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8e6dda10-293d-4969-9684-aff36439fa8e req-91d3ef0d-ff1e-4959-a5df-3eea36674d4a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:14.231151 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-8e6dda10-293d-4969-9684-aff36439fa8e req-91d3ef0d-ff1e-4959-a5df-3eea36674d4a service nova] Creating event network-vif-plugged:f3a42a59-0fb4-438c-ab01-b24ac6e00934 for instance 13dfbdeb-5221-41f6-b07f-efc83eada675 on n-h2-826526-5 Jul 20 05:20:14.236844 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-8e6dda10-293d-4969-9684-aff36439fa8e req-91d3ef0d-ff1e-4959-a5df-3eea36674d4a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034891 Jul 20 05:20:14.237738 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3825/7416] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:20:15.214320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-01e9e343-32dc-44e5-b843-3ac9f4e15fef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:15.214990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-01e9e343-32dc-44e5-b843-3ac9f4e15fef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:15.225791 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01e9e343-32dc-44e5-b843-3ac9f4e15fef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:15.226293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01e9e343-32dc-44e5-b843-3ac9f4e15fef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:15.227275 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01e9e343-32dc-44e5-b843-3ac9f4e15fef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:15.227772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01e9e343-32dc-44e5-b843-3ac9f4e15fef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:15.371678 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-01e9e343-32dc-44e5-b843-3ac9f4e15fef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:15.380476 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-01e9e343-32dc-44e5-b843-3ac9f4e15fef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1393 microversion: 2.1 time: 0.170856 Jul 20 05:20:15.381096 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3592/7417] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:15 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:16.401828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-33869f1a-8903-48e1-89bc-e8e75398a722 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:16.402347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-33869f1a-8903-48e1-89bc-e8e75398a722 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:16.405366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:16.415105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33869f1a-8903-48e1-89bc-e8e75398a722 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:16.415105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33869f1a-8903-48e1-89bc-e8e75398a722 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:16.415105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33869f1a-8903-48e1-89bc-e8e75398a722 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:16.415105 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-33869f1a-8903-48e1-89bc-e8e75398a722 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:16.555349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-33869f1a-8903-48e1-89bc-e8e75398a722 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:16.563749 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-33869f1a-8903-48e1-89bc-e8e75398a722 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1565 microversion: 2.1 time: 0.169241 Jul 20 05:20:16.564393 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3826/7418] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:16 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:16.583386 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4e5a5e58-2a84-4e91-ba57-6080b6cfc07f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:16.584112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4e5a5e58-2a84-4e91-ba57-6080b6cfc07f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:16.594554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e5a5e58-2a84-4e91-ba57-6080b6cfc07f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:16.595162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e5a5e58-2a84-4e91-ba57-6080b6cfc07f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:16.596402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e5a5e58-2a84-4e91-ba57-6080b6cfc07f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:16.597018 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e5a5e58-2a84-4e91-ba57-6080b6cfc07f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:16.745674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4e5a5e58-2a84-4e91-ba57-6080b6cfc07f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:16.754034 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4e5a5e58-2a84-4e91-ba57-6080b6cfc07f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1565 microversion: 2.1 time: 0.177130 Jul 20 05:20:16.754614 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3593/7419] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:16 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:18.455355 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bab57672-ba69-4f27-9c53-16c24a995ddc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:18.458110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bab57672-ba69-4f27-9c53-16c24a995ddc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:18.459577 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-a410e15c-ea54-48ed-a61c-0046802e48fb req-d615e374-ce2f-487c-99d6-a9110d7fe14e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13dfbdeb-5221-41f6-b07f-efc83eada675", "tag": "f3a42a59-0fb4-438c-ab01-b24ac6e00934"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:18.463473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:18.465062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:18.466254 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:18.469018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bab57672-ba69-4f27-9c53-16c24a995ddc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:18.469311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bab57672-ba69-4f27-9c53-16c24a995ddc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:18.470382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bab57672-ba69-4f27-9c53-16c24a995ddc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:18.472421 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a410e15c-ea54-48ed-a61c-0046802e48fb req-d615e374-ce2f-487c-99d6-a9110d7fe14e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:18.472821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bab57672-ba69-4f27-9c53-16c24a995ddc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:18.473079 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a410e15c-ea54-48ed-a61c-0046802e48fb req-d615e374-ce2f-487c-99d6-a9110d7fe14e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:18.488167 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-a410e15c-ea54-48ed-a61c-0046802e48fb req-d615e374-ce2f-487c-99d6-a9110d7fe14e service nova] Creating event network-changed:f3a42a59-0fb4-438c-ab01-b24ac6e00934 for instance 13dfbdeb-5221-41f6-b07f-efc83eada675 on n-h2-826526-5 Jul 20 05:20:18.493584 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-a410e15c-ea54-48ed-a61c-0046802e48fb req-d615e374-ce2f-487c-99d6-a9110d7fe14e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037830 Jul 20 05:20:18.494398 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3594/7420] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:20:18.629966 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bab57672-ba69-4f27-9c53-16c24a995ddc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:18.638290 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bab57672-ba69-4f27-9c53-16c24a995ddc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1565 microversion: 2.1 time: 0.186936 Jul 20 05:20:18.639757 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3827/7421] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:18 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1565 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:37.221751 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:20:37.222518 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:20:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:20:39.907466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:39.908177 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=36 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:39.915718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8d511061-8ffd-4e00-be38-f442ff7bfafb tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:39.916853 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8d511061-8ffd-4e00-be38-f442ff7bfafb tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:39.924988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d511061-8ffd-4e00-be38-f442ff7bfafb tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:39.925487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d511061-8ffd-4e00-be38-f442ff7bfafb tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:39.926286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d511061-8ffd-4e00-be38-f442ff7bfafb tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:39.926742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d511061-8ffd-4e00-be38-f442ff7bfafb tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:39.984529 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8d511061-8ffd-4e00-be38-f442ff7bfafb tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675/action" status: 200 len: 24574 microversion: 2.1 time: 0.078636 Jul 20 05:20:39.985257 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3595/7422] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:20:39 2022] POST /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675/action => generated 24574 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:20:51.053155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f78e5d2d-3d6e-484c-bb2e-ad0caaa0a4e2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:51.054182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f78e5d2d-3d6e-484c-bb2e-ad0caaa0a4e2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:51.056372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:51.057029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=32 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:51.063896 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f78e5d2d-3d6e-484c-bb2e-ad0caaa0a4e2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:51.064372 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f78e5d2d-3d6e-484c-bb2e-ad0caaa0a4e2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:51.065148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f78e5d2d-3d6e-484c-bb2e-ad0caaa0a4e2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:51.065584 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f78e5d2d-3d6e-484c-bb2e-ad0caaa0a4e2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:51.152411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f78e5d2d-3d6e-484c-bb2e-ad0caaa0a4e2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:51.159463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f78e5d2d-3d6e-484c-bb2e-ad0caaa0a4e2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Old instance type m1.heat2, new instance type m1.heat {{(pid=127871) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:20:51.166098 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f78e5d2d-3d6e-484c-bb2e-ad0caaa0a4e2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:20:51.166534 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f78e5d2d-3d6e-484c-bb2e-ad0caaa0a4e2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:20:51.167005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f78e5d2d-3d6e-484c-bb2e-ad0caaa0a4e2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:20:51.167410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f78e5d2d-3d6e-484c-bb2e-ad0caaa0a4e2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:20:51.167836 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-f78e5d2d-3d6e-484c-bb2e-ad0caaa0a4e2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:20:51.237011 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f78e5d2d-3d6e-484c-bb2e-ad0caaa0a4e2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675/action" status: 202 len: 0 microversion: 2.1 time: 0.187945 Jul 20 05:20:51.237645 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3828/7423] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:20:51 2022] POST /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:20:51.247007 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-af45c822-3ac8-41d6-a3f7-33f186d97964 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:51.247724 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-af45c822-3ac8-41d6-a3f7-33f186d97964 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:51.251868 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:51.252982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:51.258582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af45c822-3ac8-41d6-a3f7-33f186d97964 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:51.259089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af45c822-3ac8-41d6-a3f7-33f186d97964 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:51.260063 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af45c822-3ac8-41d6-a3f7-33f186d97964 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:51.261125 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af45c822-3ac8-41d6-a3f7-33f186d97964 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:51.407515 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-af45c822-3ac8-41d6-a3f7-33f186d97964 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:51.415190 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-af45c822-3ac8-41d6-a3f7-33f186d97964 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1693 microversion: 2.1 time: 0.172767 Jul 20 05:20:51.415789 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3596/7424] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:51 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:52.433340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0ed4b037-e475-4ea5-88c6-44035a08670a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:52.433964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0ed4b037-e475-4ea5-88c6-44035a08670a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:52.441456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ed4b037-e475-4ea5-88c6-44035a08670a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:52.441948 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ed4b037-e475-4ea5-88c6-44035a08670a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:52.442688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ed4b037-e475-4ea5-88c6-44035a08670a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:52.443138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ed4b037-e475-4ea5-88c6-44035a08670a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:52.588441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0ed4b037-e475-4ea5-88c6-44035a08670a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:52.596090 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0ed4b037-e475-4ea5-88c6-44035a08670a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1693 microversion: 2.1 time: 0.166695 Jul 20 05:20:52.596731 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3829/7425] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:52 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:53.614414 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-20d2a267-1dba-45b3-a3d8-73b4f8d4510d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:53.615229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-20d2a267-1dba-45b3-a3d8-73b4f8d4510d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:53.625298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-20d2a267-1dba-45b3-a3d8-73b4f8d4510d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:53.625803 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-20d2a267-1dba-45b3-a3d8-73b4f8d4510d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:53.626797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-20d2a267-1dba-45b3-a3d8-73b4f8d4510d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:53.627250 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-20d2a267-1dba-45b3-a3d8-73b4f8d4510d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:53.788770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-20d2a267-1dba-45b3-a3d8-73b4f8d4510d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:53.798326 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-20d2a267-1dba-45b3-a3d8-73b4f8d4510d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1698 microversion: 2.1 time: 0.188267 Jul 20 05:20:53.798903 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3597/7426] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:53 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1698 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:54.818121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b3e72243-3eff-4a76-ade3-47952e7ea90c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:54.818697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b3e72243-3eff-4a76-ade3-47952e7ea90c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:54.826895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b3e72243-3eff-4a76-ade3-47952e7ea90c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:54.827691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b3e72243-3eff-4a76-ade3-47952e7ea90c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:54.828518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b3e72243-3eff-4a76-ade3-47952e7ea90c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:54.828960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b3e72243-3eff-4a76-ade3-47952e7ea90c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:54.967670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b3e72243-3eff-4a76-ade3-47952e7ea90c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:54.975726 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b3e72243-3eff-4a76-ade3-47952e7ea90c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1698 microversion: 2.1 time: 0.163125 Jul 20 05:20:54.976315 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3830/7427] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:54 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:55.993171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a2fe6843-19b3-4f20-b9d8-6c0ae3191b0a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:55.993738 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a2fe6843-19b3-4f20-b9d8-6c0ae3191b0a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:56.001766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2fe6843-19b3-4f20-b9d8-6c0ae3191b0a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:56.002496 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2fe6843-19b3-4f20-b9d8-6c0ae3191b0a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:56.003712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2fe6843-19b3-4f20-b9d8-6c0ae3191b0a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:56.004460 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2fe6843-19b3-4f20-b9d8-6c0ae3191b0a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:56.157057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a2fe6843-19b3-4f20-b9d8-6c0ae3191b0a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:56.167400 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a2fe6843-19b3-4f20-b9d8-6c0ae3191b0a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1698 microversion: 2.1 time: 0.178112 Jul 20 05:20:56.168356 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3598/7428] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:55 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1698 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:57.189133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-69a23b7b-ceb1-40c1-a43b-24ba445bee49 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:57.189776 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-69a23b7b-ceb1-40c1-a43b-24ba445bee49 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:57.197323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69a23b7b-ceb1-40c1-a43b-24ba445bee49 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:57.197782 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69a23b7b-ceb1-40c1-a43b-24ba445bee49 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:57.198560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69a23b7b-ceb1-40c1-a43b-24ba445bee49 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:57.198979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-69a23b7b-ceb1-40c1-a43b-24ba445bee49 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:57.346159 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-69a23b7b-ceb1-40c1-a43b-24ba445bee49 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:57.354007 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-69a23b7b-ceb1-40c1-a43b-24ba445bee49 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1698 microversion: 2.1 time: 0.170139 Jul 20 05:20:57.354589 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3831/7429] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:57 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1698 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:58.375468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dea99015-c9d6-4ea4-b6c3-c372f191d663 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:58.376528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dea99015-c9d6-4ea4-b6c3-c372f191d663 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:58.386917 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dea99015-c9d6-4ea4-b6c3-c372f191d663 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:58.387380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dea99015-c9d6-4ea4-b6c3-c372f191d663 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:58.388172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dea99015-c9d6-4ea4-b6c3-c372f191d663 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:58.388960 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dea99015-c9d6-4ea4-b6c3-c372f191d663 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:58.532736 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dea99015-c9d6-4ea4-b6c3-c372f191d663 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:58.540948 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dea99015-c9d6-4ea4-b6c3-c372f191d663 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1698 microversion: 2.1 time: 0.172510 Jul 20 05:20:58.541599 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3599/7430] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:58 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1698 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:59.561161 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ef302e2c-bbb4-457a-ad2d-39962fd7a714 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:59.561821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ef302e2c-bbb4-457a-ad2d-39962fd7a714 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:59.571133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef302e2c-bbb4-457a-ad2d-39962fd7a714 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:59.571816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef302e2c-bbb4-457a-ad2d-39962fd7a714 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:59.573153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef302e2c-bbb4-457a-ad2d-39962fd7a714 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:59.573605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef302e2c-bbb4-457a-ad2d-39962fd7a714 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:59.721656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ef302e2c-bbb4-457a-ad2d-39962fd7a714 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:59.729912 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ef302e2c-bbb4-457a-ad2d-39962fd7a714 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1698 microversion: 2.1 time: 0.172761 Jul 20 05:20:59.730798 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3832/7431] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:59 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1698 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:00.749189 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-72626a59-e947-44f9-acd0-64f42d4a95f2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:00.749754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-72626a59-e947-44f9-acd0-64f42d4a95f2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:00.757574 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-72626a59-e947-44f9-acd0-64f42d4a95f2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:00.758035 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-72626a59-e947-44f9-acd0-64f42d4a95f2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:00.758813 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-72626a59-e947-44f9-acd0-64f42d4a95f2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:00.759552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-72626a59-e947-44f9-acd0-64f42d4a95f2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:00.922143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-72626a59-e947-44f9-acd0-64f42d4a95f2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:00.930112 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-72626a59-e947-44f9-acd0-64f42d4a95f2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1698 microversion: 2.1 time: 0.185013 Jul 20 05:21:00.930669 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3600/7432] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:00 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1698 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:01.950979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6df113c0-37cb-4f38-94e3-e56d4a7f6371 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:01.951903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6df113c0-37cb-4f38-94e3-e56d4a7f6371 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:01.960479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6df113c0-37cb-4f38-94e3-e56d4a7f6371 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:01.960924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6df113c0-37cb-4f38-94e3-e56d4a7f6371 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:01.961688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6df113c0-37cb-4f38-94e3-e56d4a7f6371 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:01.962122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6df113c0-37cb-4f38-94e3-e56d4a7f6371 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:02.099692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6df113c0-37cb-4f38-94e3-e56d4a7f6371 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:02.109403 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6df113c0-37cb-4f38-94e3-e56d4a7f6371 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1698 microversion: 2.1 time: 0.163558 Jul 20 05:21:02.109994 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3833/7433] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:01 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1698 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:03.127789 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-50b2049e-cd1a-426a-bbaa-932231db7211 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:03.128462 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-50b2049e-cd1a-426a-bbaa-932231db7211 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:03.135897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50b2049e-cd1a-426a-bbaa-932231db7211 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:03.136402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50b2049e-cd1a-426a-bbaa-932231db7211 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:03.137240 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50b2049e-cd1a-426a-bbaa-932231db7211 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:03.137694 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-50b2049e-cd1a-426a-bbaa-932231db7211 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:03.276557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-50b2049e-cd1a-426a-bbaa-932231db7211 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:03.284648 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-50b2049e-cd1a-426a-bbaa-932231db7211 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1698 microversion: 2.1 time: 0.161460 Jul 20 05:21:03.285220 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3601/7434] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:03 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1698 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:04.302130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ef79559c-1f34-4030-894c-044eab2626bd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:04.302944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ef79559c-1f34-4030-894c-044eab2626bd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:04.312921 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef79559c-1f34-4030-894c-044eab2626bd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:04.313447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef79559c-1f34-4030-894c-044eab2626bd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:04.314496 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef79559c-1f34-4030-894c-044eab2626bd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:04.314947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ef79559c-1f34-4030-894c-044eab2626bd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:04.480654 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ef79559c-1f34-4030-894c-044eab2626bd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:04.489221 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ef79559c-1f34-4030-894c-044eab2626bd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1698 microversion: 2.1 time: 0.191015 Jul 20 05:21:04.489839 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3834/7435] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:04 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1698 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:05.507725 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6f405194-3756-4ffe-9f4d-8e301b2f915a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:05.508378 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6f405194-3756-4ffe-9f4d-8e301b2f915a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:05.515903 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f405194-3756-4ffe-9f4d-8e301b2f915a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:05.516409 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f405194-3756-4ffe-9f4d-8e301b2f915a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:05.517199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f405194-3756-4ffe-9f4d-8e301b2f915a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:05.517654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f405194-3756-4ffe-9f4d-8e301b2f915a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:05.674413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6f405194-3756-4ffe-9f4d-8e301b2f915a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:05.683075 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6f405194-3756-4ffe-9f4d-8e301b2f915a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1698 microversion: 2.1 time: 0.179273 Jul 20 05:21:05.683688 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3602/7436] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:05 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1698 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:06.701881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b6cea746-07a8-4581-8795-8068bdc9b33d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:06.702452 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b6cea746-07a8-4581-8795-8068bdc9b33d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:06.710104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b6cea746-07a8-4581-8795-8068bdc9b33d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:06.710554 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b6cea746-07a8-4581-8795-8068bdc9b33d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:06.711318 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b6cea746-07a8-4581-8795-8068bdc9b33d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:06.711771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b6cea746-07a8-4581-8795-8068bdc9b33d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:06.872307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b6cea746-07a8-4581-8795-8068bdc9b33d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:06.882574 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b6cea746-07a8-4581-8795-8068bdc9b33d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1698 microversion: 2.1 time: 0.184611 Jul 20 05:21:06.883200 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3835/7437] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:06 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1698 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:07.904773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8eb5b8b6-4832-45e7-93df-561ffe50bc83 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:07.905532 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8eb5b8b6-4832-45e7-93df-561ffe50bc83 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:07.914239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8eb5b8b6-4832-45e7-93df-561ffe50bc83 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:07.914705 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8eb5b8b6-4832-45e7-93df-561ffe50bc83 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:07.915483 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8eb5b8b6-4832-45e7-93df-561ffe50bc83 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:07.915935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8eb5b8b6-4832-45e7-93df-561ffe50bc83 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:08.063480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8eb5b8b6-4832-45e7-93df-561ffe50bc83 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:08.071217 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8eb5b8b6-4832-45e7-93df-561ffe50bc83 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1698 microversion: 2.1 time: 0.171291 Jul 20 05:21:08.071829 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3603/7438] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:07 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1698 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:09.089890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-fe1be188-6b43-47b0-bf86-7224adddcdab tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:09.090793 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-fe1be188-6b43-47b0-bf86-7224adddcdab tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:09.098218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe1be188-6b43-47b0-bf86-7224adddcdab tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:09.098653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe1be188-6b43-47b0-bf86-7224adddcdab tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:09.099447 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe1be188-6b43-47b0-bf86-7224adddcdab tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:09.099881 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-fe1be188-6b43-47b0-bf86-7224adddcdab tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:09.237847 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-fe1be188-6b43-47b0-bf86-7224adddcdab tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:09.246494 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-fe1be188-6b43-47b0-bf86-7224adddcdab tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1698 microversion: 2.1 time: 0.160536 Jul 20 05:21:09.247079 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3836/7439] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:09 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:10.265395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dd2caa94-6a4d-4dba-85a9-fc24e4024ca5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:10.266175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dd2caa94-6a4d-4dba-85a9-fc24e4024ca5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:10.277506 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd2caa94-6a4d-4dba-85a9-fc24e4024ca5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:10.277964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd2caa94-6a4d-4dba-85a9-fc24e4024ca5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:10.279967 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd2caa94-6a4d-4dba-85a9-fc24e4024ca5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:10.280464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd2caa94-6a4d-4dba-85a9-fc24e4024ca5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:10.423446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-dd2caa94-6a4d-4dba-85a9-fc24e4024ca5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:10.431327 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dd2caa94-6a4d-4dba-85a9-fc24e4024ca5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1697 microversion: 2.1 time: 0.170323 Jul 20 05:21:10.432140 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3604/7440] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:10 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:10.732182 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-bdd86a0c-732f-45a9-aa56-a0bca63138a1 req-2056a3e8-ffb8-42c0-b55d-b69800120e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13dfbdeb-5221-41f6-b07f-efc83eada675", "name": "network-vif-unplugged", "status": "completed", "tag": "f3a42a59-0fb4-438c-ab01-b24ac6e00934"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:10.742307 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bdd86a0c-732f-45a9-aa56-a0bca63138a1 req-2056a3e8-ffb8-42c0-b55d-b69800120e46 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:10.742749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-bdd86a0c-732f-45a9-aa56-a0bca63138a1 req-2056a3e8-ffb8-42c0-b55d-b69800120e46 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:10.757144 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-bdd86a0c-732f-45a9-aa56-a0bca63138a1 req-2056a3e8-ffb8-42c0-b55d-b69800120e46 service nova] Creating event network-vif-unplugged:f3a42a59-0fb4-438c-ab01-b24ac6e00934 for instance 13dfbdeb-5221-41f6-b07f-efc83eada675 on n-h1-826526-5 Jul 20 05:21:10.763043 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [req-bdd86a0c-732f-45a9-aa56-a0bca63138a1 req-2056a3e8-ffb8-42c0-b55d-b69800120e46 service nova] Instance 13dfbdeb-5221-41f6-b07f-efc83eada675 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:21:10.775482 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-bdd86a0c-732f-45a9-aa56-a0bca63138a1 req-2056a3e8-ffb8-42c0-b55d-b69800120e46 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047614 Jul 20 05:21:10.776102 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3837/7441] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:21:11.451773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0164b881-2111-4114-86b4-044595a3d887 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:11.452498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0164b881-2111-4114-86b4-044595a3d887 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:11.460163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0164b881-2111-4114-86b4-044595a3d887 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:11.460604 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0164b881-2111-4114-86b4-044595a3d887 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:11.461571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0164b881-2111-4114-86b4-044595a3d887 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:11.462025 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0164b881-2111-4114-86b4-044595a3d887 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:11.616991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-0164b881-2111-4114-86b4-044595a3d887 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:11.626661 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0164b881-2111-4114-86b4-044595a3d887 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1697 microversion: 2.1 time: 0.179137 Jul 20 05:21:11.627668 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3605/7442] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:11 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1697 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:12.646243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8b893787-3fde-4797-be37-e634a252ce5f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:12.646943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8b893787-3fde-4797-be37-e634a252ce5f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:12.655593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b893787-3fde-4797-be37-e634a252ce5f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:12.656035 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b893787-3fde-4797-be37-e634a252ce5f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:12.656851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b893787-3fde-4797-be37-e634a252ce5f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:12.657324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8b893787-3fde-4797-be37-e634a252ce5f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:12.791028 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-22ae944b-fb70-49a1-bc2c-d289cac7ac6a req-92ffe9a1-d44b-4a69-bef7-05b067d5795b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13dfbdeb-5221-41f6-b07f-efc83eada675", "tag": "f3a42a59-0fb4-438c-ab01-b24ac6e00934"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:12.800797 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-22ae944b-fb70-49a1-bc2c-d289cac7ac6a req-92ffe9a1-d44b-4a69-bef7-05b067d5795b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:12.801254 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-22ae944b-fb70-49a1-bc2c-d289cac7ac6a req-92ffe9a1-d44b-4a69-bef7-05b067d5795b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:12.820214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8b893787-3fde-4797-be37-e634a252ce5f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:12.823258 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-22ae944b-fb70-49a1-bc2c-d289cac7ac6a req-92ffe9a1-d44b-4a69-bef7-05b067d5795b service nova] Creating event network-changed:f3a42a59-0fb4-438c-ab01-b24ac6e00934 for instance 13dfbdeb-5221-41f6-b07f-efc83eada675 on n-h1-826526-5 Jul 20 05:21:12.832638 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8b893787-3fde-4797-be37-e634a252ce5f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1695 microversion: 2.1 time: 0.190556 Jul 20 05:21:12.833375 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [req-22ae944b-fb70-49a1-bc2c-d289cac7ac6a req-92ffe9a1-d44b-4a69-bef7-05b067d5795b service nova] Instance 13dfbdeb-5221-41f6-b07f-efc83eada675 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826526-5', 'n-h2-826526-5'} {{(pid=127870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:21:12.833625 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3838/7443] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:12 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1695 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:21:12.850191 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-22ae944b-fb70-49a1-bc2c-d289cac7ac6a req-92ffe9a1-d44b-4a69-bef7-05b067d5795b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062847 Jul 20 05:21:12.850984 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3606/7444] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:21:13.855090 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a3bf32a3-0264-4ceb-96ac-b1504ef03b58 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:13.855722 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a3bf32a3-0264-4ceb-96ac-b1504ef03b58 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:13.863114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a3bf32a3-0264-4ceb-96ac-b1504ef03b58 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:13.863676 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a3bf32a3-0264-4ceb-96ac-b1504ef03b58 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:13.864622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a3bf32a3-0264-4ceb-96ac-b1504ef03b58 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:13.865061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a3bf32a3-0264-4ceb-96ac-b1504ef03b58 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:14.026304 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a3bf32a3-0264-4ceb-96ac-b1504ef03b58 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:14.034065 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a3bf32a3-0264-4ceb-96ac-b1504ef03b58 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1692 microversion: 2.1 time: 0.184270 Jul 20 05:21:14.034654 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3839/7445] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:13 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1692 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:14.052547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-71009488-dc51-48f1-9fb7-93a6b9935a35 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:14.053652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-71009488-dc51-48f1-9fb7-93a6b9935a35 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:14.061199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71009488-dc51-48f1-9fb7-93a6b9935a35 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:14.061902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71009488-dc51-48f1-9fb7-93a6b9935a35 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:14.062800 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71009488-dc51-48f1-9fb7-93a6b9935a35 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:14.063286 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71009488-dc51-48f1-9fb7-93a6b9935a35 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:14.125860 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-71009488-dc51-48f1-9fb7-93a6b9935a35 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675/action" status: 204 len: 0 microversion: 2.1 time: 0.078298 Jul 20 05:21:14.126526 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3607/7446] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:21:14 2022] POST /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:21:14.134760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e94c5b86-77b5-4337-b9fb-cde6f31a713f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:14.135717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e94c5b86-77b5-4337-b9fb-cde6f31a713f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:14.142631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e94c5b86-77b5-4337-b9fb-cde6f31a713f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:14.142790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e94c5b86-77b5-4337-b9fb-cde6f31a713f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:14.143765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e94c5b86-77b5-4337-b9fb-cde6f31a713f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:14.144276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e94c5b86-77b5-4337-b9fb-cde6f31a713f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:14.301106 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e94c5b86-77b5-4337-b9fb-cde6f31a713f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:14.310919 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e94c5b86-77b5-4337-b9fb-cde6f31a713f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1692 microversion: 2.1 time: 0.179322 Jul 20 05:21:14.312147 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3840/7447] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:14 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:14.335062 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e0ec5180-5661-4581-a756-3ba2cee9f855 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:14.336127 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e0ec5180-5661-4581-a756-3ba2cee9f855 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:14.344753 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0ec5180-5661-4581-a756-3ba2cee9f855 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:14.345255 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0ec5180-5661-4581-a756-3ba2cee9f855 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:14.346098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0ec5180-5661-4581-a756-3ba2cee9f855 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:14.346592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0ec5180-5661-4581-a756-3ba2cee9f855 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:14.578777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e0ec5180-5661-4581-a756-3ba2cee9f855 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:14.587097 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e0ec5180-5661-4581-a756-3ba2cee9f855 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1692 microversion: 2.1 time: 0.258951 Jul 20 05:21:14.587950 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3608/7448] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:14 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1692 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:15.606646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-15b46b44-44f0-45a5-b2b2-a21aa0d0b52e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:15.607281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-15b46b44-44f0-45a5-b2b2-a21aa0d0b52e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:15.615033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-15b46b44-44f0-45a5-b2b2-a21aa0d0b52e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:15.615485 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-15b46b44-44f0-45a5-b2b2-a21aa0d0b52e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:15.616236 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-15b46b44-44f0-45a5-b2b2-a21aa0d0b52e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:15.616889 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-15b46b44-44f0-45a5-b2b2-a21aa0d0b52e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:15.765076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-15b46b44-44f0-45a5-b2b2-a21aa0d0b52e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:15.773288 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-15b46b44-44f0-45a5-b2b2-a21aa0d0b52e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1692 microversion: 2.1 time: 0.172148 Jul 20 05:21:15.774036 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3841/7449] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:15 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:16.178894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f57a538b-805d-4737-a40e-bf1f5fb3edad req-ca46a7c8-ed77-4d3a-95bd-97aed7137b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13dfbdeb-5221-41f6-b07f-efc83eada675", "name": "network-vif-plugged", "status": "completed", "tag": "f3a42a59-0fb4-438c-ab01-b24ac6e00934"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:16.187395 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f57a538b-805d-4737-a40e-bf1f5fb3edad req-ca46a7c8-ed77-4d3a-95bd-97aed7137b12 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:16.187847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f57a538b-805d-4737-a40e-bf1f5fb3edad req-ca46a7c8-ed77-4d3a-95bd-97aed7137b12 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:16.199652 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f57a538b-805d-4737-a40e-bf1f5fb3edad req-ca46a7c8-ed77-4d3a-95bd-97aed7137b12 service nova] Creating event network-vif-plugged:f3a42a59-0fb4-438c-ab01-b24ac6e00934 for instance 13dfbdeb-5221-41f6-b07f-efc83eada675 on n-h1-826526-5 Jul 20 05:21:16.204747 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f57a538b-805d-4737-a40e-bf1f5fb3edad req-ca46a7c8-ed77-4d3a-95bd-97aed7137b12 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088862 Jul 20 05:21:16.205349 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3609/7450] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:21:16.794427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-86c3449e-fd77-4c9b-b37c-8107bf27db6f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:16.794985 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-86c3449e-fd77-4c9b-b37c-8107bf27db6f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:16.802483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86c3449e-fd77-4c9b-b37c-8107bf27db6f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:16.802932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86c3449e-fd77-4c9b-b37c-8107bf27db6f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:16.803693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86c3449e-fd77-4c9b-b37c-8107bf27db6f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:16.804128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-86c3449e-fd77-4c9b-b37c-8107bf27db6f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:16.950721 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-86c3449e-fd77-4c9b-b37c-8107bf27db6f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:16.959303 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-86c3449e-fd77-4c9b-b37c-8107bf27db6f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1684 microversion: 2.1 time: 0.168889 Jul 20 05:21:16.959902 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3842/7451] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:16 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:39.163238 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=28 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:39.164036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:39.168210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f434c1f3-fef2-429d-868d-efc7f74dfe73 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:39.169278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f434c1f3-fef2-429d-868d-efc7f74dfe73 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:39.176605 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f434c1f3-fef2-429d-868d-efc7f74dfe73 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:39.177064 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f434c1f3-fef2-429d-868d-efc7f74dfe73 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:39.177835 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f434c1f3-fef2-429d-868d-efc7f74dfe73 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:39.178276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f434c1f3-fef2-429d-868d-efc7f74dfe73 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:39.233017 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f434c1f3-fef2-429d-868d-efc7f74dfe73 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675/action" status: 200 len: 24573 microversion: 2.1 time: 0.071446 Jul 20 05:21:39.233766 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3610/7452] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:21:39 2022] POST /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675/action => generated 24573 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:21:46.417591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0498ac9c-43a8-48ee-83d8-4ca37ea328dc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:46.418309 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0498ac9c-43a8-48ee-83d8-4ca37ea328dc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:46.421750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-0a777238-f4c8-47e5-8525-8d1186f0ccfd req-1482547f-0756-44ce-a7df-73bdc6f54b65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13dfbdeb-5221-41f6-b07f-efc83eada675", "tag": "f3a42a59-0fb4-438c-ab01-b24ac6e00934"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:46.425265 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=34 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:46.426088 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:46.427917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0498ac9c-43a8-48ee-83d8-4ca37ea328dc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:46.428486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0498ac9c-43a8-48ee-83d8-4ca37ea328dc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:46.429358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0498ac9c-43a8-48ee-83d8-4ca37ea328dc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:46.429804 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0498ac9c-43a8-48ee-83d8-4ca37ea328dc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:46.434713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0a777238-f4c8-47e5-8525-8d1186f0ccfd req-1482547f-0756-44ce-a7df-73bdc6f54b65 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:46.435445 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0a777238-f4c8-47e5-8525-8d1186f0ccfd req-1482547f-0756-44ce-a7df-73bdc6f54b65 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:46.451130 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-0a777238-f4c8-47e5-8525-8d1186f0ccfd req-1482547f-0756-44ce-a7df-73bdc6f54b65 service nova] Creating event network-changed:f3a42a59-0fb4-438c-ab01-b24ac6e00934 for instance 13dfbdeb-5221-41f6-b07f-efc83eada675 on n-h1-826526-5 Jul 20 05:21:46.457063 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-0a777238-f4c8-47e5-8525-8d1186f0ccfd req-1482547f-0756-44ce-a7df-73bdc6f54b65 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040621 Jul 20 05:21:46.458435 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3611/7453] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:21:46.460063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0498ac9c-43a8-48ee-83d8-4ca37ea328dc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:21:46.551293 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0498ac9c-43a8-48ee-83d8-4ca37ea328dc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "DELETE /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 204 len: 0 microversion: 2.1 time: 0.139493 Jul 20 05:21:46.552219 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3843/7454] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:21:46 2022] DELETE /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:21:46.561652 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2b20be07-e864-4398-b77d-946f623c64ef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:46.562374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2b20be07-e864-4398-b77d-946f623c64ef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:46.569672 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b20be07-e864-4398-b77d-946f623c64ef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:46.570143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b20be07-e864-4398-b77d-946f623c64ef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:46.570942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b20be07-e864-4398-b77d-946f623c64ef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:46.571432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b20be07-e864-4398-b77d-946f623c64ef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:46.714691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-2b20be07-e864-4398-b77d-946f623c64ef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:46.722727 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2b20be07-e864-4398-b77d-946f623c64ef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1690 microversion: 2.1 time: 0.165825 Jul 20 05:21:46.723340 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3612/7455] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:46 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:47.741665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-364fc0f5-4963-4377-91ce-7e3a0037e8da tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:47.742247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-364fc0f5-4963-4377-91ce-7e3a0037e8da tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:47.750291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-364fc0f5-4963-4377-91ce-7e3a0037e8da tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:47.750751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-364fc0f5-4963-4377-91ce-7e3a0037e8da tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:47.751561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-364fc0f5-4963-4377-91ce-7e3a0037e8da tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:47.751999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-364fc0f5-4963-4377-91ce-7e3a0037e8da tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:47.965766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-364fc0f5-4963-4377-91ce-7e3a0037e8da tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:47.973715 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-364fc0f5-4963-4377-91ce-7e3a0037e8da tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 200 len: 1690 microversion: 2.1 time: 0.236537 Jul 20 05:21:47.974315 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3844/7456] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:47 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 1690 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:48.281935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-fb66a9bf-7875-4353-8456-f8fcd9f68291 req-0cf01674-3ea8-4868-a707-833d00559ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13dfbdeb-5221-41f6-b07f-efc83eada675", "name": "network-vif-deleted", "tag": "f3a42a59-0fb4-438c-ab01-b24ac6e00934"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:48.291687 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-fb66a9bf-7875-4353-8456-f8fcd9f68291 req-0cf01674-3ea8-4868-a707-833d00559ccb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:48.292123 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-fb66a9bf-7875-4353-8456-f8fcd9f68291 req-0cf01674-3ea8-4868-a707-833d00559ccb service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:48.306463 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-fb66a9bf-7875-4353-8456-f8fcd9f68291 req-0cf01674-3ea8-4868-a707-833d00559ccb service nova] Creating event network-vif-deleted:f3a42a59-0fb4-438c-ab01-b24ac6e00934 for instance 13dfbdeb-5221-41f6-b07f-efc83eada675 on n-h1-826526-5 Jul 20 05:21:48.311483 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-fb66a9bf-7875-4353-8456-f8fcd9f68291 req-0cf01674-3ea8-4868-a707-833d00559ccb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033317 Jul 20 05:21:48.312101 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3613/7457] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:21:48.993699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1fe8247f-ae5e-4208-bca7-d182899f0ce3 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:48.994474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1fe8247f-ae5e-4208-bca7-d182899f0ce3 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 13dfbdeb-5221-41f6-b07f-efc83eada675] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:49.003135 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1fe8247f-ae5e-4208-bca7-d182899f0ce3 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:49.003594 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1fe8247f-ae5e-4208-bca7-d182899f0ce3 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:49.004396 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1fe8247f-ae5e-4208-bca7-d182899f0ce3 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:49.004834 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1fe8247f-ae5e-4208-bca7-d182899f0ce3 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:49.019103 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-1fe8247f-ae5e-4208-bca7-d182899f0ce3 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] HTTP exception thrown: Instance 13dfbdeb-5221-41f6-b07f-efc83eada675 could not be found. Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1fe8247f-ae5e-4208-bca7-d182899f0ce3 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Request method failure captured: Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 HTTP/1.1 Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi14_VCFjjVcTDMCOBzB1_dpwx5DVZGShtyV9aNSxFwqN91bfAZLspYUqpOuFY60lfwoTX92LAvzu4_lVXiuAI6bCcZR72Uk33EVYPdRaTam7Sy1z7ptYj007ryXZcviRzbeELD7jp-BgLMPFOM6y6Fr8V8hDQb9L5gP558auLEGITPuw Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 4fb789b41bf4456da732c16f4f4a8b7f Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-337819042 Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4fb789b41bf4456da732c16f4f4a8b7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4fb789b41bf4456da732c16f4f4a8b7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4fb789b41bf4456da732c16f4f4a8b7f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4fb789b41bf4456da732c16f4f4a8b7f"}]}] Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestNetworkAdvancedServerOps-337819042 Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 4fb789b41bf4456da732c16f4f4a8b7f Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-337819042 Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestNetworkAdvancedServerOps-337819042-project Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 1630a34d53714c0e9476578c711c87ac Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestNetworkAdvancedServerOps-337819042-project Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 13dfbdeb-5221-41f6-b07f-efc83eada675 could not be found. Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '13dfbdeb-5221-41f6-b07f-efc83eada675'} Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13dfbdeb-5221-41f6-b07f-efc83eada675 could not be found. Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13dfbdeb-5221-41f6-b07f-efc83eada675 could not be found. Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:21:49.020799 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:21:49.025612 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:21:49.025612 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:21:49.025612 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:21:49.025612 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:21:49.025612 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:21:49.025612 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13dfbdeb-5221-41f6-b07f-efc83eada675 could not be found. Jul 20 05:21:49.025612 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:21:49.025612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1fe8247f-ae5e-4208-bca7-d182899f0ce3 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Returning 404 to user: Instance 13dfbdeb-5221-41f6-b07f-efc83eada675 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:21:49.025612 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1fe8247f-ae5e-4208-bca7-d182899f0ce3 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675" status: 404 len: 111 microversion: 2.1 time: 0.033434 Jul 20 05:21:49.025612 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3845/7458] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:48 2022] GET /compute/v2.1/servers/13dfbdeb-5221-41f6-b07f-efc83eada675 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:21:52.396240 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8c18b397-fdf8-4781-ac5b-cc7f4d7801c5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '.version_select at 0x7f06bcc75670>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:52.417030 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8c18b397-fdf8-4781-ac5b-cc7f4d7801c5 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1540171449" status: 202 len: 0 microversion: 2.1 time: 0.026436 Jul 20 05:21:52.417629 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3614/7459] 10.222.0.17 () {58 vars in 1283 bytes} [Wed Jul 20 05:21:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1540171449 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:21:52.444339 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6ab11a92-3ee4-4cb6-9149-445e77032dab tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'create', calling method: .version_select at 0x7f06bcb04040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1538531142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHcp200fIfE3GrnUkXzHNMFhF7a0sdS3gt3TZn4DxV7STcC2Cd4rG5NLm1wDz5VeXQ2Jf5uVoDcLDSiMHKj5aA6pMqUyVh5audI/EeJTmm3Os0uJxTvMdKpnMKIwBmU7Q=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:52.460639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-6ab11a92-3ee4-4cb6-9149-445e77032dab tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:21:52.465945 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-6ab11a92-3ee4-4cb6-9149-445e77032dab tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for user 1630a34d53714c0e9476578c711c87ac and project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:21:52.496007 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6ab11a92-3ee4-4cb6-9149-445e77032dab tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055517 Jul 20 05:21:52.496583 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3846/7460] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 05:21:52 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:21:58.306278 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=14 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:58.312474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9d2768b3-39d9-4c3d-aa10-96034ac51f22 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1659699529", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "886933a1-9d9b-46c8-b718-e89dadbf94c0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1538531142", "security_groups": [{"name": "tempest-secgroup-smoke-937350455"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:58.444298 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-9d2768b3-39d9-4c3d-aa10-96034ac51f22 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] validate_networks() for [('886933a1-9d9b-46c8-b718-e89dadbf94c0', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:21:58.898745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-9d2768b3-39d9-4c3d-aa10-96034ac51f22 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:21:58.899684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-9d2768b3-39d9-4c3d-aa10-96034ac51f22 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:21:58.900626 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-9d2768b3-39d9-4c3d-aa10-96034ac51f22 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:21:58.901300 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-9d2768b3-39d9-4c3d-aa10-96034ac51f22 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:21:58.901968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-9d2768b3-39d9-4c3d-aa10-96034ac51f22 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:21:58.913205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d2768b3-39d9-4c3d-aa10-96034ac51f22 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:58.914243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d2768b3-39d9-4c3d-aa10-96034ac51f22 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:58.915714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d2768b3-39d9-4c3d-aa10-96034ac51f22 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:58.916649 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9d2768b3-39d9-4c3d-aa10-96034ac51f22 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:58.939029 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-9d2768b3-39d9-4c3d-aa10-96034ac51f22 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:21:58.946411 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-9d2768b3-39d9-4c3d-aa10-96034ac51f22 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for user 1630a34d53714c0e9476578c711c87ac and project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:21:58.968620 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9d2768b3-39d9-4c3d-aa10-96034ac51f22 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:21:58.971260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9d2768b3-39d9-4c3d-aa10-96034ac51f22 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:21:59.055628 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9d2768b3-39d9-4c3d-aa10-96034ac51f22 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.750880 Jul 20 05:21:59.056356 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3615/7461] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:21:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:21:59.065423 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:59.071346 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3f19196c-4855-49d9-a4ac-c9c8b7f7ca84 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:59.072965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3f19196c-4855-49d9-a4ac-c9c8b7f7ca84 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:59.160988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3f19196c-4855-49d9-a4ac-c9c8b7f7ca84 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:59.175208 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3f19196c-4855-49d9-a4ac-c9c8b7f7ca84 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1267 microversion: 2.1 time: 0.112173 Jul 20 05:21:59.185474 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3847/7462] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:59 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1267 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:00.193038 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-57f3bfb7-7cee-4d29-9011-275ff0f3352a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:00.194454 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-57f3bfb7-7cee-4d29-9011-275ff0f3352a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:00.212525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57f3bfb7-7cee-4d29-9011-275ff0f3352a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:00.213422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57f3bfb7-7cee-4d29-9011-275ff0f3352a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:00.214654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57f3bfb7-7cee-4d29-9011-275ff0f3352a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:00.215438 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57f3bfb7-7cee-4d29-9011-275ff0f3352a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:00.323296 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-57f3bfb7-7cee-4d29-9011-275ff0f3352a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:00.338706 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-57f3bfb7-7cee-4d29-9011-275ff0f3352a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1337 microversion: 2.1 time: 0.149762 Jul 20 05:22:00.340121 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3616/7463] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:00 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1337 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:01.357057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-78804e8d-bd1c-4674-bfe3-5a0628178ea7 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:01.357691 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-78804e8d-bd1c-4674-bfe3-5a0628178ea7 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:01.366617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78804e8d-bd1c-4674-bfe3-5a0628178ea7 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:01.367140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78804e8d-bd1c-4674-bfe3-5a0628178ea7 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:01.368162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78804e8d-bd1c-4674-bfe3-5a0628178ea7 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:01.368856 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-78804e8d-bd1c-4674-bfe3-5a0628178ea7 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:01.537152 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-78804e8d-bd1c-4674-bfe3-5a0628178ea7 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:01.550373 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-78804e8d-bd1c-4674-bfe3-5a0628178ea7 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1392 microversion: 2.1 time: 0.197171 Jul 20 05:22:01.551961 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3848/7464] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:01 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1392 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:01.703855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-6effdb51-b7aa-41d5-9be4-388fd5c2953f req-fd90d819-efe5-4cb7-94a6-fca722cf51c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18156aa6-e195-452b-aa8a-f303749a8124", "tag": "e6cc1eca-ff93-4474-a207-cccb6f719d89"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:01.714094 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6effdb51-b7aa-41d5-9be4-388fd5c2953f req-fd90d819-efe5-4cb7-94a6-fca722cf51c2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:01.714554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6effdb51-b7aa-41d5-9be4-388fd5c2953f req-fd90d819-efe5-4cb7-94a6-fca722cf51c2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:01.726753 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-6effdb51-b7aa-41d5-9be4-388fd5c2953f req-fd90d819-efe5-4cb7-94a6-fca722cf51c2 service nova] Creating event network-changed:e6cc1eca-ff93-4474-a207-cccb6f719d89 for instance 18156aa6-e195-452b-aa8a-f303749a8124 on n-h1-826526-5 Jul 20 05:22:01.738893 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-6effdb51-b7aa-41d5-9be4-388fd5c2953f req-fd90d819-efe5-4cb7-94a6-fca722cf51c2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041435 Jul 20 05:22:01.739583 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3617/7465] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:22:02.570083 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5dda8255-8cb3-4aeb-8708-1fa4c7567e92 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:02.573036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5dda8255-8cb3-4aeb-8708-1fa4c7567e92 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:02.581006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dda8255-8cb3-4aeb-8708-1fa4c7567e92 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:02.581458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dda8255-8cb3-4aeb-8708-1fa4c7567e92 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:02.582232 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dda8255-8cb3-4aeb-8708-1fa4c7567e92 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:02.582662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5dda8255-8cb3-4aeb-8708-1fa4c7567e92 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:02.720458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5dda8255-8cb3-4aeb-8708-1fa4c7567e92 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:02.731780 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5dda8255-8cb3-4aeb-8708-1fa4c7567e92 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1392 microversion: 2.1 time: 0.165708 Jul 20 05:22:02.732598 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3849/7466] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:02 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:03.757265 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-725ac40d-908e-4c73-b459-d4446216b4b2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:03.758435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-725ac40d-908e-4c73-b459-d4446216b4b2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:03.766206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-725ac40d-908e-4c73-b459-d4446216b4b2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:03.766669 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-725ac40d-908e-4c73-b459-d4446216b4b2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:03.767447 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-725ac40d-908e-4c73-b459-d4446216b4b2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:03.767898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-725ac40d-908e-4c73-b459-d4446216b4b2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:03.918854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-725ac40d-908e-4c73-b459-d4446216b4b2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:03.927279 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-725ac40d-908e-4c73-b459-d4446216b4b2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1392 microversion: 2.1 time: 0.176121 Jul 20 05:22:03.927861 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3618/7467] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:03 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:04.946323 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-eee4fe9f-49f4-43eb-8e26-51b5842dfffc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:04.947041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-eee4fe9f-49f4-43eb-8e26-51b5842dfffc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:04.954758 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eee4fe9f-49f4-43eb-8e26-51b5842dfffc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:04.955218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eee4fe9f-49f4-43eb-8e26-51b5842dfffc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:04.956001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eee4fe9f-49f4-43eb-8e26-51b5842dfffc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:04.956479 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-eee4fe9f-49f4-43eb-8e26-51b5842dfffc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:05.104532 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-eee4fe9f-49f4-43eb-8e26-51b5842dfffc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:05.113262 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-eee4fe9f-49f4-43eb-8e26-51b5842dfffc tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1392 microversion: 2.1 time: 0.171009 Jul 20 05:22:05.113825 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3850/7468] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:04 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:06.132198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-96855e5d-40bf-48c9-992f-8635226fc067 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:06.133014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-96855e5d-40bf-48c9-992f-8635226fc067 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:06.141365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96855e5d-40bf-48c9-992f-8635226fc067 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:06.141852 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96855e5d-40bf-48c9-992f-8635226fc067 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:06.142662 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96855e5d-40bf-48c9-992f-8635226fc067 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:06.143119 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96855e5d-40bf-48c9-992f-8635226fc067 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:06.247734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-04975b5b-bef1-4ff9-ae6c-3f4996fbfb24 req-8aa97fa3-ae2a-4d76-90d4-f8bc3eb19b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18156aa6-e195-452b-aa8a-f303749a8124", "name": "network-vif-plugged", "status": "completed", "tag": "e6cc1eca-ff93-4474-a207-cccb6f719d89"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:06.260290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-04975b5b-bef1-4ff9-ae6c-3f4996fbfb24 req-8aa97fa3-ae2a-4d76-90d4-f8bc3eb19b9e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:06.260678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-04975b5b-bef1-4ff9-ae6c-3f4996fbfb24 req-8aa97fa3-ae2a-4d76-90d4-f8bc3eb19b9e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:06.273748 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-04975b5b-bef1-4ff9-ae6c-3f4996fbfb24 req-8aa97fa3-ae2a-4d76-90d4-f8bc3eb19b9e service nova] Creating event network-vif-plugged:e6cc1eca-ff93-4474-a207-cccb6f719d89 for instance 18156aa6-e195-452b-aa8a-f303749a8124 on n-h1-826526-5 Jul 20 05:22:06.279585 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-04975b5b-bef1-4ff9-ae6c-3f4996fbfb24 req-8aa97fa3-ae2a-4d76-90d4-f8bc3eb19b9e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035550 Jul 20 05:22:06.280621 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3851/7469] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:22:06.302030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-96855e5d-40bf-48c9-992f-8635226fc067 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:06.310994 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-96855e5d-40bf-48c9-992f-8635226fc067 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1392 microversion: 2.1 time: 0.183415 Jul 20 05:22:06.311895 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3619/7470] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:06 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:07.330021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a34b2218-39df-421d-8eeb-a5b77b4aa26b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:07.330735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a34b2218-39df-421d-8eeb-a5b77b4aa26b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:07.337703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a34b2218-39df-421d-8eeb-a5b77b4aa26b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:07.338156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a34b2218-39df-421d-8eeb-a5b77b4aa26b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:07.338930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a34b2218-39df-421d-8eeb-a5b77b4aa26b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:07.339377 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a34b2218-39df-421d-8eeb-a5b77b4aa26b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:07.493486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a34b2218-39df-421d-8eeb-a5b77b4aa26b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:07.502662 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a34b2218-39df-421d-8eeb-a5b77b4aa26b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1392 microversion: 2.1 time: 0.178029 Jul 20 05:22:07.503618 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3852/7471] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:07 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:08.523166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-33b56269-ca2f-4a16-8e1b-b9339b7c41f2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:08.523846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-33b56269-ca2f-4a16-8e1b-b9339b7c41f2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:08.533631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33b56269-ca2f-4a16-8e1b-b9339b7c41f2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:08.534269 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33b56269-ca2f-4a16-8e1b-b9339b7c41f2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:08.535551 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33b56269-ca2f-4a16-8e1b-b9339b7c41f2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:08.535902 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-33b56269-ca2f-4a16-8e1b-b9339b7c41f2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:08.689547 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-33b56269-ca2f-4a16-8e1b-b9339b7c41f2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:08.699580 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-33b56269-ca2f-4a16-8e1b-b9339b7c41f2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1564 microversion: 2.1 time: 0.181793 Jul 20 05:22:08.700297 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3620/7472] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:08 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:08.716988 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5eb03cff-b69a-4c78-95c1-d904d0e4b311 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:08.717914 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5eb03cff-b69a-4c78-95c1-d904d0e4b311 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:08.726196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eb03cff-b69a-4c78-95c1-d904d0e4b311 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:08.726771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eb03cff-b69a-4c78-95c1-d904d0e4b311 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:08.727821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eb03cff-b69a-4c78-95c1-d904d0e4b311 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:08.728351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5eb03cff-b69a-4c78-95c1-d904d0e4b311 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:08.878806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5eb03cff-b69a-4c78-95c1-d904d0e4b311 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:08.887077 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5eb03cff-b69a-4c78-95c1-d904d0e4b311 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1564 microversion: 2.1 time: 0.173879 Jul 20 05:22:08.887810 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3853/7473] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:08 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:10.592794 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:10.594133 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:10.594936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-8b87cbe1-e6dc-4986-a8ad-671884182ee2 req-618c0ba6-1fbf-4235-a12f-27423e6a6278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18156aa6-e195-452b-aa8a-f303749a8124", "tag": "e6cc1eca-ff93-4474-a207-cccb6f719d89"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:10.598702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:10.605757 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8b87cbe1-e6dc-4986-a8ad-671884182ee2 req-618c0ba6-1fbf-4235-a12f-27423e6a6278 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:10.606495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8b87cbe1-e6dc-4986-a8ad-671884182ee2 req-618c0ba6-1fbf-4235-a12f-27423e6a6278 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:10.619606 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-8b87cbe1-e6dc-4986-a8ad-671884182ee2 req-618c0ba6-1fbf-4235-a12f-27423e6a6278 service nova] Creating event network-changed:e6cc1eca-ff93-4474-a207-cccb6f719d89 for instance 18156aa6-e195-452b-aa8a-f303749a8124 on n-h1-826526-5 Jul 20 05:22:10.628159 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-8b87cbe1-e6dc-4986-a8ad-671884182ee2 req-618c0ba6-1fbf-4235-a12f-27423e6a6278 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034940 Jul 20 05:22:10.628159 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3854/7474] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:22:10.661193 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-74736dbb-6641-4be8-9ac6-9f4ac9b12189 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:10.662401 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-74736dbb-6641-4be8-9ac6-9f4ac9b12189 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:10.664894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:10.670162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74736dbb-6641-4be8-9ac6-9f4ac9b12189 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:10.670856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74736dbb-6641-4be8-9ac6-9f4ac9b12189 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:10.671658 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74736dbb-6641-4be8-9ac6-9f4ac9b12189 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:10.672315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-74736dbb-6641-4be8-9ac6-9f4ac9b12189 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:10.923640 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-74736dbb-6641-4be8-9ac6-9f4ac9b12189 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:10.932564 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-74736dbb-6641-4be8-9ac6-9f4ac9b12189 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1564 microversion: 2.1 time: 0.344592 Jul 20 05:22:10.944333 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3621/7475] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:10 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1564 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:32.224121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:32.224978 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=34 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:32.229222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e9264391-03ba-4ff6-9e22-956a6baf65fa tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:32.230269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e9264391-03ba-4ff6-9e22-956a6baf65fa tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:32.238602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9264391-03ba-4ff6-9e22-956a6baf65fa tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:32.239057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9264391-03ba-4ff6-9e22-956a6baf65fa tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:32.239798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9264391-03ba-4ff6-9e22-956a6baf65fa tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:32.240276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e9264391-03ba-4ff6-9e22-956a6baf65fa tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:32.293542 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e9264391-03ba-4ff6-9e22-956a6baf65fa tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124/action" status: 200 len: 24563 microversion: 2.1 time: 0.070914 Jul 20 05:22:32.294416 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3855/7476] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:22:32 2022] POST /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124/action => generated 24563 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:22:43.431277 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5bb83b23-9989-4e93-a7b8-3712af72ae41 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:43.433830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:43.434495 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=34 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:43.440801 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5bb83b23-9989-4e93-a7b8-3712af72ae41 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:43.441277 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5bb83b23-9989-4e93-a7b8-3712af72ae41 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:43.464913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5bb83b23-9989-4e93-a7b8-3712af72ae41 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Going to try to stop instance {{(pid=127870) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 05:22:43.512879 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5bb83b23-9989-4e93-a7b8-3712af72ae41 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124/action" status: 202 len: 0 microversion: 2.1 time: 0.085816 Jul 20 05:22:43.513521 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3622/7477] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:22:43 2022] POST /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:22:43.524243 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-62443ff6-227a-482c-836f-9816cdadc451 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:43.524977 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-62443ff6-227a-482c-836f-9816cdadc451 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:43.528108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:43.528673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:43.539368 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62443ff6-227a-482c-836f-9816cdadc451 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:43.539822 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62443ff6-227a-482c-836f-9816cdadc451 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:43.540657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62443ff6-227a-482c-836f-9816cdadc451 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:43.541100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62443ff6-227a-482c-836f-9816cdadc451 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:43.691692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-62443ff6-227a-482c-836f-9816cdadc451 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:43.699738 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-62443ff6-227a-482c-836f-9816cdadc451 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1692 microversion: 2.1 time: 0.179936 Jul 20 05:22:43.700316 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3856/7478] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:43 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:44.725543 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-47558a2e-7859-48ee-96c1-fd8dec425783 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:44.726279 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-47558a2e-7859-48ee-96c1-fd8dec425783 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:44.733173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-47558a2e-7859-48ee-96c1-fd8dec425783 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:44.733639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-47558a2e-7859-48ee-96c1-fd8dec425783 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:44.734422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-47558a2e-7859-48ee-96c1-fd8dec425783 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:44.734875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-47558a2e-7859-48ee-96c1-fd8dec425783 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:44.884227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-47558a2e-7859-48ee-96c1-fd8dec425783 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:44.895978 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-47558a2e-7859-48ee-96c1-fd8dec425783 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1692 microversion: 2.1 time: 0.179591 Jul 20 05:22:44.896698 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3623/7479] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:44 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:45.916835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e85c83c1-b431-4644-a012-e38daf382f29 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:45.917455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e85c83c1-b431-4644-a012-e38daf382f29 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:45.925010 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e85c83c1-b431-4644-a012-e38daf382f29 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:45.925458 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e85c83c1-b431-4644-a012-e38daf382f29 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:45.926222 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e85c83c1-b431-4644-a012-e38daf382f29 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:45.926655 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e85c83c1-b431-4644-a012-e38daf382f29 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:46.068513 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e85c83c1-b431-4644-a012-e38daf382f29 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:46.079442 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e85c83c1-b431-4644-a012-e38daf382f29 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1692 microversion: 2.1 time: 0.167048 Jul 20 05:22:46.080197 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3857/7480] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:45 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:47.099850 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6c937c94-024a-4f18-bb96-a9d4f0d6dd4f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:47.100659 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6c937c94-024a-4f18-bb96-a9d4f0d6dd4f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:47.110770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c937c94-024a-4f18-bb96-a9d4f0d6dd4f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:47.111423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c937c94-024a-4f18-bb96-a9d4f0d6dd4f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:47.112583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c937c94-024a-4f18-bb96-a9d4f0d6dd4f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:47.113214 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6c937c94-024a-4f18-bb96-a9d4f0d6dd4f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:47.250138 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6c937c94-024a-4f18-bb96-a9d4f0d6dd4f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:47.258210 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6c937c94-024a-4f18-bb96-a9d4f0d6dd4f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1692 microversion: 2.1 time: 0.164153 Jul 20 05:22:47.258761 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3624/7481] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:47 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:48.276688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ec23b56e-3586-4e00-999e-b6ab6d391431 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:48.277268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ec23b56e-3586-4e00-999e-b6ab6d391431 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:48.284882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec23b56e-3586-4e00-999e-b6ab6d391431 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:48.285326 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec23b56e-3586-4e00-999e-b6ab6d391431 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:48.286092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec23b56e-3586-4e00-999e-b6ab6d391431 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:48.286525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec23b56e-3586-4e00-999e-b6ab6d391431 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:48.425515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ec23b56e-3586-4e00-999e-b6ab6d391431 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:48.433234 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ec23b56e-3586-4e00-999e-b6ab6d391431 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1692 microversion: 2.1 time: 0.160518 Jul 20 05:22:48.433820 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3858/7482] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:48 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:49.454200 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-044d9230-f5f4-4720-a8a3-cd3de148eb5d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:49.455223 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-044d9230-f5f4-4720-a8a3-cd3de148eb5d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:49.464606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-044d9230-f5f4-4720-a8a3-cd3de148eb5d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:49.465071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-044d9230-f5f4-4720-a8a3-cd3de148eb5d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:49.465856 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-044d9230-f5f4-4720-a8a3-cd3de148eb5d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:49.466308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-044d9230-f5f4-4720-a8a3-cd3de148eb5d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:49.627112 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-044d9230-f5f4-4720-a8a3-cd3de148eb5d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:49.635359 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-044d9230-f5f4-4720-a8a3-cd3de148eb5d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1692 microversion: 2.1 time: 0.187777 Jul 20 05:22:49.635945 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3625/7483] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:49 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1692 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:50.656136 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4a951aa1-8bf1-4ccb-a585-f18a6d1bdd9d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:50.657041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4a951aa1-8bf1-4ccb-a585-f18a6d1bdd9d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:50.666908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4a951aa1-8bf1-4ccb-a585-f18a6d1bdd9d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:50.667355 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4a951aa1-8bf1-4ccb-a585-f18a6d1bdd9d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:50.668115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4a951aa1-8bf1-4ccb-a585-f18a6d1bdd9d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:50.668582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4a951aa1-8bf1-4ccb-a585-f18a6d1bdd9d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:50.811800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4a951aa1-8bf1-4ccb-a585-f18a6d1bdd9d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:50.823946 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4a951aa1-8bf1-4ccb-a585-f18a6d1bdd9d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1692 microversion: 2.1 time: 0.173509 Jul 20 05:22:50.824835 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3859/7484] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:50 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:51.847892 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aae6f10a-8d44-49d7-8bc1-f4652efc7ff1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:51.848548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aae6f10a-8d44-49d7-8bc1-f4652efc7ff1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:51.858564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aae6f10a-8d44-49d7-8bc1-f4652efc7ff1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:51.859230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aae6f10a-8d44-49d7-8bc1-f4652efc7ff1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:51.860427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aae6f10a-8d44-49d7-8bc1-f4652efc7ff1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:51.861132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aae6f10a-8d44-49d7-8bc1-f4652efc7ff1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:52.004479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-aae6f10a-8d44-49d7-8bc1-f4652efc7ff1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:52.013909 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aae6f10a-8d44-49d7-8bc1-f4652efc7ff1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1692 microversion: 2.1 time: 0.172764 Jul 20 05:22:52.014513 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3626/7485] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:51 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:53.035060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4cf5bb26-74a3-47cf-b23f-85bdbec2dc04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:53.035693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4cf5bb26-74a3-47cf-b23f-85bdbec2dc04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:53.045719 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4cf5bb26-74a3-47cf-b23f-85bdbec2dc04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:53.046188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4cf5bb26-74a3-47cf-b23f-85bdbec2dc04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:53.047087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4cf5bb26-74a3-47cf-b23f-85bdbec2dc04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:53.047537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4cf5bb26-74a3-47cf-b23f-85bdbec2dc04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:53.193865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4cf5bb26-74a3-47cf-b23f-85bdbec2dc04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:53.202076 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4cf5bb26-74a3-47cf-b23f-85bdbec2dc04 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1692 microversion: 2.1 time: 0.173217 Jul 20 05:22:53.202657 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3860/7486] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:53 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:54.223593 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c81cd652-c725-4b44-b925-ca37102f8497 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:54.224650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c81cd652-c725-4b44-b925-ca37102f8497 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:54.233294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c81cd652-c725-4b44-b925-ca37102f8497 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:54.233758 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c81cd652-c725-4b44-b925-ca37102f8497 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:54.234541 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c81cd652-c725-4b44-b925-ca37102f8497 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:54.234990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c81cd652-c725-4b44-b925-ca37102f8497 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:54.382041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c81cd652-c725-4b44-b925-ca37102f8497 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:54.394639 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c81cd652-c725-4b44-b925-ca37102f8497 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1692 microversion: 2.1 time: 0.177402 Jul 20 05:22:54.395447 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3627/7487] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:54 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:55.419213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b4f4056b-a1dd-40fa-a8d4-dec4ddf61187 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:55.419837 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b4f4056b-a1dd-40fa-a8d4-dec4ddf61187 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:55.427688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4f4056b-a1dd-40fa-a8d4-dec4ddf61187 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:55.428033 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4f4056b-a1dd-40fa-a8d4-dec4ddf61187 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:55.429013 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4f4056b-a1dd-40fa-a8d4-dec4ddf61187 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:55.429456 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4f4056b-a1dd-40fa-a8d4-dec4ddf61187 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:55.574824 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b4f4056b-a1dd-40fa-a8d4-dec4ddf61187 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:55.582908 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b4f4056b-a1dd-40fa-a8d4-dec4ddf61187 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1692 microversion: 2.1 time: 0.168147 Jul 20 05:22:55.583586 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3861/7488] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:55 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:56.602631 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d555c01a-a5a2-43ab-b5ad-b4d33ad2d1cd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:56.603262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d555c01a-a5a2-43ab-b5ad-b4d33ad2d1cd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:56.610915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d555c01a-a5a2-43ab-b5ad-b4d33ad2d1cd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:56.611434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d555c01a-a5a2-43ab-b5ad-b4d33ad2d1cd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:56.612240 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d555c01a-a5a2-43ab-b5ad-b4d33ad2d1cd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:56.612735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d555c01a-a5a2-43ab-b5ad-b4d33ad2d1cd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:56.757097 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d555c01a-a5a2-43ab-b5ad-b4d33ad2d1cd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:56.765155 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d555c01a-a5a2-43ab-b5ad-b4d33ad2d1cd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1692 microversion: 2.1 time: 0.167800 Jul 20 05:22:56.765733 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3628/7489] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:56 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:57.787418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e94ed935-6b4b-4e09-beec-57bf1a2981de tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:57.788415 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e94ed935-6b4b-4e09-beec-57bf1a2981de tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:57.801060 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e94ed935-6b4b-4e09-beec-57bf1a2981de tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:57.801817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e94ed935-6b4b-4e09-beec-57bf1a2981de tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:57.803102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e94ed935-6b4b-4e09-beec-57bf1a2981de tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:57.803927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e94ed935-6b4b-4e09-beec-57bf1a2981de tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:57.955446 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e94ed935-6b4b-4e09-beec-57bf1a2981de tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:57.963793 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e94ed935-6b4b-4e09-beec-57bf1a2981de tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1692 microversion: 2.1 time: 0.183060 Jul 20 05:22:57.964451 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3862/7490] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:57 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1692 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:58.981382 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-434fd88a-2223-43a4-921a-35454ac2b16b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:58.982000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-434fd88a-2223-43a4-921a-35454ac2b16b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:58.989558 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-434fd88a-2223-43a4-921a-35454ac2b16b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:58.990247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-434fd88a-2223-43a4-921a-35454ac2b16b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:58.990823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-434fd88a-2223-43a4-921a-35454ac2b16b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:58.991315 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-434fd88a-2223-43a4-921a-35454ac2b16b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:59.131153 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-434fd88a-2223-43a4-921a-35454ac2b16b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:59.139055 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-434fd88a-2223-43a4-921a-35454ac2b16b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1669 microversion: 2.1 time: 0.161864 Jul 20 05:22:59.139673 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3629/7491] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:58 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:00.247045 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3a0b26d2-681a-453f-984b-a5c1140059ef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:00.248652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3a0b26d2-681a-453f-984b-a5c1140059ef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:00.259393 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a0b26d2-681a-453f-984b-a5c1140059ef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:00.259851 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a0b26d2-681a-453f-984b-a5c1140059ef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:00.260670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a0b26d2-681a-453f-984b-a5c1140059ef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:00.261154 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a0b26d2-681a-453f-984b-a5c1140059ef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:00.315139 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3a0b26d2-681a-453f-984b-a5c1140059ef tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124/action" status: 200 len: 38382 microversion: 2.1 time: 0.074877 Jul 20 05:23:00.315817 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3863/7492] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:23:00 2022] POST /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124/action => generated 38382 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:23:00.327648 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d72eeef7-b3eb-4401-af76-a8127ff9fbb0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:00.335242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d72eeef7-b3eb-4401-af76-a8127ff9fbb0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:00.335740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d72eeef7-b3eb-4401-af76-a8127ff9fbb0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:00.358464 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d72eeef7-b3eb-4401-af76-a8127ff9fbb0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Going to try to start instance {{(pid=127870) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 05:23:00.407586 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d72eeef7-b3eb-4401-af76-a8127ff9fbb0 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124/action" status: 202 len: 0 microversion: 2.1 time: 0.083408 Jul 20 05:23:00.408235 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3630/7493] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:23:00 2022] POST /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:23:00.417463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dfc319a5-e8ee-4100-a682-82308745341c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:00.418162 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dfc319a5-e8ee-4100-a682-82308745341c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:00.426208 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dfc319a5-e8ee-4100-a682-82308745341c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:00.426682 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dfc319a5-e8ee-4100-a682-82308745341c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:00.427880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dfc319a5-e8ee-4100-a682-82308745341c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:00.428009 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dfc319a5-e8ee-4100-a682-82308745341c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:00.574546 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dfc319a5-e8ee-4100-a682-82308745341c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:00.582591 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dfc319a5-e8ee-4100-a682-82308745341c tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1678 microversion: 2.1 time: 0.169519 Jul 20 05:23:00.583273 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3864/7494] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:00 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:01.602122 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-db3cf427-f3b8-4814-b61c-19474db75693 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:01.602876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-db3cf427-f3b8-4814-b61c-19474db75693 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:01.609413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db3cf427-f3b8-4814-b61c-19474db75693 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:01.609862 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db3cf427-f3b8-4814-b61c-19474db75693 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:01.610636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db3cf427-f3b8-4814-b61c-19474db75693 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:01.611081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db3cf427-f3b8-4814-b61c-19474db75693 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:01.767487 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-db3cf427-f3b8-4814-b61c-19474db75693 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:01.775279 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-db3cf427-f3b8-4814-b61c-19474db75693 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1682 microversion: 2.1 time: 0.178719 Jul 20 05:23:01.775861 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3631/7495] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:01 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:25.992730 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e6628a60-831e-4eca-a99c-6db8aef4269f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:25.993631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e6628a60-831e-4eca-a99c-6db8aef4269f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:25.997242 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=18 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:25.997895 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=52 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:26.005542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6628a60-831e-4eca-a99c-6db8aef4269f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:26.006218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6628a60-831e-4eca-a99c-6db8aef4269f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:26.007410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6628a60-831e-4eca-a99c-6db8aef4269f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:26.007848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e6628a60-831e-4eca-a99c-6db8aef4269f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:26.074514 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e6628a60-831e-4eca-a99c-6db8aef4269f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124/action" status: 200 len: 62946 microversion: 2.1 time: 0.085273 Jul 20 05:23:26.075418 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3865/7496] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:23:25 2022] POST /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124/action => generated 62946 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:23:33.670188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2be2bff8-6880-4514-946b-c598e128558f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:33.671627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2be2bff8-6880-4514-946b-c598e128558f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:33.672383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-233c1d39-f197-4d4c-9ebc-633c41958ebe req-b22c47e9-2117-4dd8-b405-2cfaffd88100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18156aa6-e195-452b-aa8a-f303749a8124", "tag": "e6cc1eca-ff93-4474-a207-cccb6f719d89"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:33.674505 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=20 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:33.675485 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:33.682818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-233c1d39-f197-4d4c-9ebc-633c41958ebe req-b22c47e9-2117-4dd8-b405-2cfaffd88100 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:33.683185 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2be2bff8-6880-4514-946b-c598e128558f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:33.683318 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-233c1d39-f197-4d4c-9ebc-633c41958ebe req-b22c47e9-2117-4dd8-b405-2cfaffd88100 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:33.683655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2be2bff8-6880-4514-946b-c598e128558f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:33.684611 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2be2bff8-6880-4514-946b-c598e128558f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:33.685059 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2be2bff8-6880-4514-946b-c598e128558f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:33.696830 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-233c1d39-f197-4d4c-9ebc-633c41958ebe req-b22c47e9-2117-4dd8-b405-2cfaffd88100 service nova] Creating event network-changed:e6cc1eca-ff93-4474-a207-cccb6f719d89 for instance 18156aa6-e195-452b-aa8a-f303749a8124 on n-h1-826526-5 Jul 20 05:23:33.702324 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-233c1d39-f197-4d4c-9ebc-633c41958ebe req-b22c47e9-2117-4dd8-b405-2cfaffd88100 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034176 Jul 20 05:23:33.703069 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3866/7497] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:23:33.713642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2be2bff8-6880-4514-946b-c598e128558f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:23:33.806781 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2be2bff8-6880-4514-946b-c598e128558f tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "DELETE /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 204 len: 0 microversion: 2.1 time: 0.140348 Jul 20 05:23:33.808423 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3632/7498] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:23:33 2022] DELETE /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:23:33.817800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-778bce10-71c6-48c4-aab7-af257dfcc77e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:33.818536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-778bce10-71c6-48c4-aab7-af257dfcc77e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:33.828634 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-778bce10-71c6-48c4-aab7-af257dfcc77e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:33.829078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-778bce10-71c6-48c4-aab7-af257dfcc77e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:33.829846 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-778bce10-71c6-48c4-aab7-af257dfcc77e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:33.830276 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-778bce10-71c6-48c4-aab7-af257dfcc77e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:34.037599 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-778bce10-71c6-48c4-aab7-af257dfcc77e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:34.046122 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-778bce10-71c6-48c4-aab7-af257dfcc77e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1688 microversion: 2.1 time: 0.232947 Jul 20 05:23:34.046730 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3867/7499] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:33 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1688 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:35.065507 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a52d2eae-8aa7-4946-ac78-2977e48ed388 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:35.066231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a52d2eae-8aa7-4946-ac78-2977e48ed388 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:35.073754 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a52d2eae-8aa7-4946-ac78-2977e48ed388 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:35.074142 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a52d2eae-8aa7-4946-ac78-2977e48ed388 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:35.074931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a52d2eae-8aa7-4946-ac78-2977e48ed388 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:35.075377 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a52d2eae-8aa7-4946-ac78-2977e48ed388 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:35.342392 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a52d2eae-8aa7-4946-ac78-2977e48ed388 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:35.351403 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a52d2eae-8aa7-4946-ac78-2977e48ed388 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 200 len: 1688 microversion: 2.1 time: 0.290229 Jul 20 05:23:35.356427 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3633/7500] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:35 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 1688 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:35.825612 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-c518f894-f44b-4214-be61-d401dae342dd req-a69233c3-6043-4398-a173-8fc58b06065f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18156aa6-e195-452b-aa8a-f303749a8124", "name": "network-vif-deleted", "tag": "e6cc1eca-ff93-4474-a207-cccb6f719d89"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:35.836303 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c518f894-f44b-4214-be61-d401dae342dd req-a69233c3-6043-4398-a173-8fc58b06065f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:35.836753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-c518f894-f44b-4214-be61-d401dae342dd req-a69233c3-6043-4398-a173-8fc58b06065f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:35.848466 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-c518f894-f44b-4214-be61-d401dae342dd req-a69233c3-6043-4398-a173-8fc58b06065f service nova] Creating event network-vif-deleted:e6cc1eca-ff93-4474-a207-cccb6f719d89 for instance 18156aa6-e195-452b-aa8a-f303749a8124 on n-h1-826526-5 Jul 20 05:23:35.853253 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-c518f894-f44b-4214-be61-d401dae342dd req-a69233c3-6043-4398-a173-8fc58b06065f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031393 Jul 20 05:23:35.853845 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3868/7501] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:23:36.370745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-518dabba-a73b-43bc-a254-dcac36e07d13 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:36.371319 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-518dabba-a73b-43bc-a254-dcac36e07d13 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 18156aa6-e195-452b-aa8a-f303749a8124] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:36.379320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-518dabba-a73b-43bc-a254-dcac36e07d13 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:36.379788 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-518dabba-a73b-43bc-a254-dcac36e07d13 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:36.380610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-518dabba-a73b-43bc-a254-dcac36e07d13 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:36.381046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-518dabba-a73b-43bc-a254-dcac36e07d13 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:36.398768 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-518dabba-a73b-43bc-a254-dcac36e07d13 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] HTTP exception thrown: Instance 18156aa6-e195-452b-aa8a-f303749a8124 could not be found. Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-518dabba-a73b-43bc-a254-dcac36e07d13 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Request method failure captured: Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 HTTP/1.1 Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14_VCFjjVcTDMCOBzB1_dpwx5DVZGShtyV9aNSxFwqN91bfAZLspYUqpOuFY60lfwoTX92LAvzu4_lVXiuAI6bCcZR72Uk33EVYPdRaTam7Sy1z7ptYj007ryXZcviRzbeELD7jp-BgLMPFOM6y6Fr8V8hDQb9L5gP558auLEGITPuw Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4fb789b41bf4456da732c16f4f4a8b7f Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-337819042 Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4fb789b41bf4456da732c16f4f4a8b7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4fb789b41bf4456da732c16f4f4a8b7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4fb789b41bf4456da732c16f4f4a8b7f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4fb789b41bf4456da732c16f4f4a8b7f"}]}] Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestNetworkAdvancedServerOps-337819042 Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4fb789b41bf4456da732c16f4f4a8b7f Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-337819042 Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestNetworkAdvancedServerOps-337819042-project Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 1630a34d53714c0e9476578c711c87ac Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestNetworkAdvancedServerOps-337819042-project Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 18156aa6-e195-452b-aa8a-f303749a8124 could not be found. Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '18156aa6-e195-452b-aa8a-f303749a8124'} Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18156aa6-e195-452b-aa8a-f303749a8124 could not be found. Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18156aa6-e195-452b-aa8a-f303749a8124 could not be found. Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:23:36.401271 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:23:36.406046 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:23:36.406046 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:23:36.406046 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:23:36.406046 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:23:36.406046 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:23:36.406046 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18156aa6-e195-452b-aa8a-f303749a8124 could not be found. Jul 20 05:23:36.406046 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:23:36.406046 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-518dabba-a73b-43bc-a254-dcac36e07d13 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Returning 404 to user: Instance 18156aa6-e195-452b-aa8a-f303749a8124 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:23:36.406046 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-518dabba-a73b-43bc-a254-dcac36e07d13 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124" status: 404 len: 111 microversion: 2.1 time: 0.036106 Jul 20 05:23:36.406046 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3634/7502] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:36 2022] GET /compute/v2.1/servers/18156aa6-e195-452b-aa8a-f303749a8124 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:23:39.464022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c7d4ec54-923d-4979-ae77-f8ace4d2fb3a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '.version_select at 0x7f06bcd4f5e0>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:39.498986 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c7d4ec54-923d-4979-ae77-f8ace4d2fb3a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1538531142" status: 202 len: 0 microversion: 2.1 time: 0.040262 Jul 20 05:23:39.499599 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3869/7503] 10.222.0.17 () {58 vars in 1283 bytes} [Wed Jul 20 05:23:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1538531142 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:23:39.532896 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aed053bb-270a-4639-b484-96409d4caecf tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'create', calling method: .version_select at 0x7f06bcd74280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1374339553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHQEVXzzwsOm3U0rw/+V/ByJZ5MrRaDm2C+ZXXQrdaARrglOy0KjxlJ88urAqD06l4e5tHGtW7LWmIeSIUS4RRf7VKhdIeiwW+SHJBCJTM4kEzyjwOkzWiSOn0SnF8glg=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:39.548822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-aed053bb-270a-4639-b484-96409d4caecf tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:23:39.559707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-aed053bb-270a-4639-b484-96409d4caecf tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for user 1630a34d53714c0e9476578c711c87ac and project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:23:39.588637 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aed053bb-270a-4639-b484-96409d4caecf tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.059704 Jul 20 05:23:39.589281 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3635/7504] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 05:23:39 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:23:45.742524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-06257978-9487-4dad-81a7-1ed9495b1cda tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-185051766", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "networks": [{"uuid": "ed97eab7-b4b1-4165-b58b-c71025109b80"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1374339553", "security_groups": [{"name": "tempest-secgroup-smoke-1251771755"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:45.841918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=14 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:45.883944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-06257978-9487-4dad-81a7-1ed9495b1cda tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] validate_networks() for [('ed97eab7-b4b1-4165-b58b-c71025109b80', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:23:46.344817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-06257978-9487-4dad-81a7-1ed9495b1cda tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:23:46.345241 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-06257978-9487-4dad-81a7-1ed9495b1cda tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:23:46.345711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-06257978-9487-4dad-81a7-1ed9495b1cda tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:23:46.346118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-06257978-9487-4dad-81a7-1ed9495b1cda tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:23:46.346527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-06257978-9487-4dad-81a7-1ed9495b1cda tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:23:46.355717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06257978-9487-4dad-81a7-1ed9495b1cda tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:46.356171 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06257978-9487-4dad-81a7-1ed9495b1cda tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:46.357099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06257978-9487-4dad-81a7-1ed9495b1cda tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:46.357762 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-06257978-9487-4dad-81a7-1ed9495b1cda tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:46.377806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-06257978-9487-4dad-81a7-1ed9495b1cda tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:23:46.384205 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-06257978-9487-4dad-81a7-1ed9495b1cda tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Getting quotas for user 1630a34d53714c0e9476578c711c87ac and project 4fb789b41bf4456da732c16f4f4a8b7f. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:23:46.397602 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-06257978-9487-4dad-81a7-1ed9495b1cda tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:23:46.400006 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-06257978-9487-4dad-81a7-1ed9495b1cda tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:23:46.449574 n-d-826526-5 devstack@n-api.service[127871]: ERROR oslo.messaging._drivers.impl_rabbit [None req-06257978-9487-4dad-81a7-1ed9495b1cda tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [777b901c-dc85-4112-8e27-cf3eaeb92aa2] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:23:47.459397 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [None req-06257978-9487-4dad-81a7-1ed9495b1cda tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [777b901c-dc85-4112-8e27-cf3eaeb92aa2] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 40470. Jul 20 05:23:47.465095 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-06257978-9487-4dad-81a7-1ed9495b1cda tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.728619 Jul 20 05:23:47.471534 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3870/7505] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:23:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:23:47.474592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:47.479232 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-17583732-23c1-4642-a4cd-2cf1f44d0d0d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:47.480090 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-17583732-23c1-4642-a4cd-2cf1f44d0d0d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:47.546603 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-17583732-23c1-4642-a4cd-2cf1f44d0d0d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:47.556468 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-17583732-23c1-4642-a4cd-2cf1f44d0d0d tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1266 microversion: 2.1 time: 0.083627 Jul 20 05:23:47.557084 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3636/7506] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:47 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:48.574286 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8c7985e9-6709-4716-8e2d-903e416689bf tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:48.576169 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8c7985e9-6709-4716-8e2d-903e416689bf tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:48.641299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8c7985e9-6709-4716-8e2d-903e416689bf tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:48.650664 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8c7985e9-6709-4716-8e2d-903e416689bf tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1266 microversion: 2.1 time: 0.081208 Jul 20 05:23:48.651377 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3871/7507] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:48 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:49.668157 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3f983035-e379-4303-b349-33431e2c8ce1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:49.668810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3f983035-e379-4303-b349-33431e2c8ce1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:49.725466 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3f983035-e379-4303-b349-33431e2c8ce1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:49.732724 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3f983035-e379-4303-b349-33431e2c8ce1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1266 microversion: 2.1 time: 0.068438 Jul 20 05:23:49.733379 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3637/7508] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:49 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1266 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:50.755976 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b78672c6-c14d-420b-bf8c-30055cded966 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:50.757124 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b78672c6-c14d-420b-bf8c-30055cded966 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:50.821662 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b78672c6-c14d-420b-bf8c-30055cded966 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:50.828797 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b78672c6-c14d-420b-bf8c-30055cded966 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1266 microversion: 2.1 time: 0.080695 Jul 20 05:23:50.829675 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3872/7509] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:50 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:51.846990 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-27a4722d-2f86-4f50-8e79-899eb2907ba6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:51.847825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-27a4722d-2f86-4f50-8e79-899eb2907ba6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:51.855775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27a4722d-2f86-4f50-8e79-899eb2907ba6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:51.856247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27a4722d-2f86-4f50-8e79-899eb2907ba6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:51.857075 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27a4722d-2f86-4f50-8e79-899eb2907ba6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:51.857526 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-27a4722d-2f86-4f50-8e79-899eb2907ba6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:51.930760 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-27a4722d-2f86-4f50-8e79-899eb2907ba6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:51.939658 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-27a4722d-2f86-4f50-8e79-899eb2907ba6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1270 microversion: 2.1 time: 0.096712 Jul 20 05:23:51.940232 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3638/7510] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:51 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:52.957108 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-edcb26cc-3703-4ab9-9e52-29ce47789fbd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:52.957693 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-edcb26cc-3703-4ab9-9e52-29ce47789fbd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:52.965454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edcb26cc-3703-4ab9-9e52-29ce47789fbd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:52.965943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edcb26cc-3703-4ab9-9e52-29ce47789fbd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:52.966716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edcb26cc-3703-4ab9-9e52-29ce47789fbd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:52.967153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-edcb26cc-3703-4ab9-9e52-29ce47789fbd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:53.031656 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-edcb26cc-3703-4ab9-9e52-29ce47789fbd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:53.040781 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-edcb26cc-3703-4ab9-9e52-29ce47789fbd tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1324 microversion: 2.1 time: 0.087972 Jul 20 05:23:53.041429 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3873/7511] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:52 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1324 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:53.887562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-61c86367-b701-4da2-be5d-2041722cd262 req-baac9576-f842-4f74-90c6-40c935d2f28f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8029b058-59f2-4855-a8a9-533929787d2d", "tag": "1a195d6a-644d-444f-800e-a0db8a017b0f"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:53.902173 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-61c86367-b701-4da2-be5d-2041722cd262 req-baac9576-f842-4f74-90c6-40c935d2f28f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:53.902638 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-61c86367-b701-4da2-be5d-2041722cd262 req-baac9576-f842-4f74-90c6-40c935d2f28f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:53.915346 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-61c86367-b701-4da2-be5d-2041722cd262 req-baac9576-f842-4f74-90c6-40c935d2f28f service nova] Creating event network-changed:1a195d6a-644d-444f-800e-a0db8a017b0f for instance 8029b058-59f2-4855-a8a9-533929787d2d on n-h2-826526-5 Jul 20 05:23:53.920538 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-61c86367-b701-4da2-be5d-2041722cd262 req-baac9576-f842-4f74-90c6-40c935d2f28f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036739 Jul 20 05:23:53.921185 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3639/7512] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:23:54.059854 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c2775bed-7b0c-4664-b69c-83d649deedff tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:54.061316 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-c2775bed-7b0c-4664-b69c-83d649deedff tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:54.068334 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2775bed-7b0c-4664-b69c-83d649deedff tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:54.068786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2775bed-7b0c-4664-b69c-83d649deedff tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:54.069681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2775bed-7b0c-4664-b69c-83d649deedff tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:54.070120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-c2775bed-7b0c-4664-b69c-83d649deedff tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:54.230358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-c2775bed-7b0c-4664-b69c-83d649deedff tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:54.239034 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c2775bed-7b0c-4664-b69c-83d649deedff tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1392 microversion: 2.1 time: 0.184109 Jul 20 05:23:54.239618 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3874/7513] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:54 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:55.258635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d6be1ef5-d805-435f-95e6-0ec2f84fecb1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:55.259387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d6be1ef5-d805-435f-95e6-0ec2f84fecb1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:55.266076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6be1ef5-d805-435f-95e6-0ec2f84fecb1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:55.266539 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6be1ef5-d805-435f-95e6-0ec2f84fecb1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:55.267314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6be1ef5-d805-435f-95e6-0ec2f84fecb1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:55.267773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6be1ef5-d805-435f-95e6-0ec2f84fecb1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:55.489371 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d6be1ef5-d805-435f-95e6-0ec2f84fecb1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:55.498544 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d6be1ef5-d805-435f-95e6-0ec2f84fecb1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1392 microversion: 2.1 time: 0.245074 Jul 20 05:23:55.499156 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3640/7514] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:55 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1392 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:56.519724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-bf793d27-d2f9-4d72-a6f9-bbe479f2c940 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:56.520424 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-bf793d27-d2f9-4d72-a6f9-bbe479f2c940 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:56.523170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:56.523880 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:56.529632 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf793d27-d2f9-4d72-a6f9-bbe479f2c940 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:56.530078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf793d27-d2f9-4d72-a6f9-bbe479f2c940 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:56.530840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf793d27-d2f9-4d72-a6f9-bbe479f2c940 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:56.531268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-bf793d27-d2f9-4d72-a6f9-bbe479f2c940 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:56.672137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-bf793d27-d2f9-4d72-a6f9-bbe479f2c940 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:56.680458 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-bf793d27-d2f9-4d72-a6f9-bbe479f2c940 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1392 microversion: 2.1 time: 0.164675 Jul 20 05:23:56.681045 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3875/7515] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:56 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:57.699074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1f07c997-1f2e-4827-ae16-8a8c5cf9fc8b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:57.699750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1f07c997-1f2e-4827-ae16-8a8c5cf9fc8b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:57.708954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f07c997-1f2e-4827-ae16-8a8c5cf9fc8b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:57.709424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f07c997-1f2e-4827-ae16-8a8c5cf9fc8b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:57.710252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f07c997-1f2e-4827-ae16-8a8c5cf9fc8b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:57.710711 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f07c997-1f2e-4827-ae16-8a8c5cf9fc8b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:57.851243 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1f07c997-1f2e-4827-ae16-8a8c5cf9fc8b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:57.859341 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1f07c997-1f2e-4827-ae16-8a8c5cf9fc8b tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1392 microversion: 2.1 time: 0.164820 Jul 20 05:23:57.859898 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3641/7516] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:57 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:58.880310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3105fd83-a287-4132-8dbd-7cd0382857d7 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:58.880964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3105fd83-a287-4132-8dbd-7cd0382857d7 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:58.891800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3105fd83-a287-4132-8dbd-7cd0382857d7 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:58.892580 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3105fd83-a287-4132-8dbd-7cd0382857d7 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:58.893797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3105fd83-a287-4132-8dbd-7cd0382857d7 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:58.894488 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3105fd83-a287-4132-8dbd-7cd0382857d7 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:59.039792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3105fd83-a287-4132-8dbd-7cd0382857d7 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:59.051934 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3105fd83-a287-4132-8dbd-7cd0382857d7 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1392 microversion: 2.1 time: 0.176776 Jul 20 05:23:59.052697 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3876/7517] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:58 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:59.388355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-b4fff71c-58d6-4605-9efd-37641bfb9921 req-a9ecef3f-6282-4cde-a371-8b11acff940d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8029b058-59f2-4855-a8a9-533929787d2d", "name": "network-vif-plugged", "status": "completed", "tag": "1a195d6a-644d-444f-800e-a0db8a017b0f"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:59.397918 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b4fff71c-58d6-4605-9efd-37641bfb9921 req-a9ecef3f-6282-4cde-a371-8b11acff940d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:59.398295 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b4fff71c-58d6-4605-9efd-37641bfb9921 req-a9ecef3f-6282-4cde-a371-8b11acff940d service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:59.409933 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-b4fff71c-58d6-4605-9efd-37641bfb9921 req-a9ecef3f-6282-4cde-a371-8b11acff940d service nova] Creating event network-vif-plugged:1a195d6a-644d-444f-800e-a0db8a017b0f for instance 8029b058-59f2-4855-a8a9-533929787d2d on n-h2-826526-5 Jul 20 05:23:59.414999 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-b4fff71c-58d6-4605-9efd-37641bfb9921 req-a9ecef3f-6282-4cde-a371-8b11acff940d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030491 Jul 20 05:23:59.415601 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3642/7518] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:24:00.076912 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2ee06753-a840-4414-8a3e-d3c0d3092f99 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:00.077666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2ee06753-a840-4414-8a3e-d3c0d3092f99 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:00.085008 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ee06753-a840-4414-8a3e-d3c0d3092f99 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:00.085436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ee06753-a840-4414-8a3e-d3c0d3092f99 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:00.086204 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ee06753-a840-4414-8a3e-d3c0d3092f99 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:00.086642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2ee06753-a840-4414-8a3e-d3c0d3092f99 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:00.224994 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2ee06753-a840-4414-8a3e-d3c0d3092f99 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:00.235624 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2ee06753-a840-4414-8a3e-d3c0d3092f99 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1392 microversion: 2.1 time: 0.165303 Jul 20 05:24:00.236235 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3877/7519] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:00 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:01.253012 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:01.260691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-554d02a2-9280-469c-90d8-8bd47fa9d3ad tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:01.261811 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-554d02a2-9280-469c-90d8-8bd47fa9d3ad tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:01.271066 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-554d02a2-9280-469c-90d8-8bd47fa9d3ad tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:01.271786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-554d02a2-9280-469c-90d8-8bd47fa9d3ad tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:01.273040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-554d02a2-9280-469c-90d8-8bd47fa9d3ad tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:01.273651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-554d02a2-9280-469c-90d8-8bd47fa9d3ad tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:01.422554 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-554d02a2-9280-469c-90d8-8bd47fa9d3ad tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:01.434279 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-554d02a2-9280-469c-90d8-8bd47fa9d3ad tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1563 microversion: 2.1 time: 0.182754 Jul 20 05:24:01.435099 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3643/7520] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:01 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1563 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:01.450944 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-988e7342-64c3-4be9-b839-c56adcf9f640 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:01.451573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-988e7342-64c3-4be9-b839-c56adcf9f640 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:01.453678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=10 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:01.459747 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-988e7342-64c3-4be9-b839-c56adcf9f640 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:01.460196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-988e7342-64c3-4be9-b839-c56adcf9f640 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:01.461022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-988e7342-64c3-4be9-b839-c56adcf9f640 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:01.461453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-988e7342-64c3-4be9-b839-c56adcf9f640 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:01.603519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-988e7342-64c3-4be9-b839-c56adcf9f640 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:01.612304 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-988e7342-64c3-4be9-b839-c56adcf9f640 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1563 microversion: 2.1 time: 0.165112 Jul 20 05:24:01.613258 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3878/7521] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:01 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:03.596081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ae2f30fe-1fb3-4283-b7f2-9e8bed53ee76 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:03.597624 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ae2f30fe-1fb3-4283-b7f2-9e8bed53ee76 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:03.598832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-ad817c63-bd4c-404c-afb6-ef129af1967e req-7be309cc-7116-4192-b0af-07b4b163b45c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8029b058-59f2-4855-a8a9-533929787d2d", "tag": "1a195d6a-644d-444f-800e-a0db8a017b0f"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:03.604585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae2f30fe-1fb3-4283-b7f2-9e8bed53ee76 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:03.605397 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae2f30fe-1fb3-4283-b7f2-9e8bed53ee76 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:03.606293 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae2f30fe-1fb3-4283-b7f2-9e8bed53ee76 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:03.607027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae2f30fe-1fb3-4283-b7f2-9e8bed53ee76 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:03.614489 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ad817c63-bd4c-404c-afb6-ef129af1967e req-7be309cc-7116-4192-b0af-07b4b163b45c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:03.615216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ad817c63-bd4c-404c-afb6-ef129af1967e req-7be309cc-7116-4192-b0af-07b4b163b45c service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:03.629678 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-ad817c63-bd4c-404c-afb6-ef129af1967e req-7be309cc-7116-4192-b0af-07b4b163b45c service nova] Creating event network-changed:1a195d6a-644d-444f-800e-a0db8a017b0f for instance 8029b058-59f2-4855-a8a9-533929787d2d on n-h2-826526-5 Jul 20 05:24:03.635399 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-ad817c63-bd4c-404c-afb6-ef129af1967e req-7be309cc-7116-4192-b0af-07b4b163b45c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041393 Jul 20 05:24:03.636013 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3879/7522] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:24:03.839964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-ae2f30fe-1fb3-4283-b7f2-9e8bed53ee76 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:03.848213 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ae2f30fe-1fb3-4283-b7f2-9e8bed53ee76 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1563 microversion: 2.1 time: 0.256592 Jul 20 05:24:03.860168 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3644/7523] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:03 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1563 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:25.130671 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=9 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:25.131401 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=40 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:25.135890 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b344be32-b3b0-4d1a-bd47-6864c2e9d95a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:25.136967 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b344be32-b3b0-4d1a-bd47-6864c2e9d95a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:25.144734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b344be32-b3b0-4d1a-bd47-6864c2e9d95a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:25.145203 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b344be32-b3b0-4d1a-bd47-6864c2e9d95a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:25.145968 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b344be32-b3b0-4d1a-bd47-6864c2e9d95a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:25.146407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b344be32-b3b0-4d1a-bd47-6864c2e9d95a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:25.197446 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b344be32-b3b0-4d1a-bd47-6864c2e9d95a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d/action" status: 200 len: 24578 microversion: 2.1 time: 0.068864 Jul 20 05:24:25.198131 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3880/7524] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:24:25 2022] POST /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d/action => generated 24578 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:24:36.243872 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c8268d4e-514d-4dd9-9041-57d368c9b58e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:36.244565 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c8268d4e-514d-4dd9-9041-57d368c9b58e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:36.247101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:36.248160 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=34 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:36.259015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8268d4e-514d-4dd9-9041-57d368c9b58e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:36.259668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8268d4e-514d-4dd9-9041-57d368c9b58e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:36.261057 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8268d4e-514d-4dd9-9041-57d368c9b58e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:36.261670 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8268d4e-514d-4dd9-9041-57d368c9b58e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:36.287488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-c8268d4e-514d-4dd9-9041-57d368c9b58e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lazy-loading 'flavor' on Instance uuid 8029b058-59f2-4855-a8a9-533929787d2d {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:24:36.362368 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c8268d4e-514d-4dd9-9041-57d368c9b58e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d/action" status: 202 len: 0 microversion: 2.1 time: 0.123913 Jul 20 05:24:36.363037 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3645/7525] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:24:36 2022] POST /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:24:36.373573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b4cd2d91-8631-4c44-acbf-0294d495d46e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:36.374603 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b4cd2d91-8631-4c44-acbf-0294d495d46e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:36.377778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:36.378474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=4 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:36.385268 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4cd2d91-8631-4c44-acbf-0294d495d46e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:36.385725 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4cd2d91-8631-4c44-acbf-0294d495d46e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:36.386510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4cd2d91-8631-4c44-acbf-0294d495d46e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:36.386954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b4cd2d91-8631-4c44-acbf-0294d495d46e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:36.533940 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b4cd2d91-8631-4c44-acbf-0294d495d46e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:36.544469 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b4cd2d91-8631-4c44-acbf-0294d495d46e tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1690 microversion: 2.1 time: 0.175498 Jul 20 05:24:36.545153 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3881/7526] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:36 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:37.568253 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e67a49a6-cfe7-4111-9621-6a75d023a276 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:37.569236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e67a49a6-cfe7-4111-9621-6a75d023a276 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:37.578306 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e67a49a6-cfe7-4111-9621-6a75d023a276 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:37.578770 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e67a49a6-cfe7-4111-9621-6a75d023a276 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:37.579564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e67a49a6-cfe7-4111-9621-6a75d023a276 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:37.580014 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e67a49a6-cfe7-4111-9621-6a75d023a276 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:37.725938 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e67a49a6-cfe7-4111-9621-6a75d023a276 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:37.735848 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e67a49a6-cfe7-4111-9621-6a75d023a276 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1673 microversion: 2.1 time: 0.174600 Jul 20 05:24:37.736499 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3646/7527] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:37 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:38.840317 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4fb596a1-24bd-4996-8c80-70cef78a7c00 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:38.841850 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4fb596a1-24bd-4996-8c80-70cef78a7c00 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:38.851375 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4fb596a1-24bd-4996-8c80-70cef78a7c00 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:38.851816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4fb596a1-24bd-4996-8c80-70cef78a7c00 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:38.852609 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4fb596a1-24bd-4996-8c80-70cef78a7c00 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:38.853067 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4fb596a1-24bd-4996-8c80-70cef78a7c00 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:38.904208 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4fb596a1-24bd-4996-8c80-70cef78a7c00 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d/action" status: 200 len: 38380 microversion: 2.1 time: 0.070278 Jul 20 05:24:38.904817 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3882/7528] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:24:38 2022] POST /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d/action => generated 38380 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:24:38.916745 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-12f4a1cf-a0cc-41ba-8bfe-45d0794465c9 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:38.917307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-12f4a1cf-a0cc-41ba-8bfe-45d0794465c9 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:38.924925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12f4a1cf-a0cc-41ba-8bfe-45d0794465c9 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:38.925399 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12f4a1cf-a0cc-41ba-8bfe-45d0794465c9 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:38.926191 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12f4a1cf-a0cc-41ba-8bfe-45d0794465c9 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:38.926643 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12f4a1cf-a0cc-41ba-8bfe-45d0794465c9 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:38.998887 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-12f4a1cf-a0cc-41ba-8bfe-45d0794465c9 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d/action" status: 202 len: 0 microversion: 2.1 time: 0.086305 Jul 20 05:24:38.999690 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3647/7529] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:24:38 2022] POST /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:24:39.009442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7485b2b3-ced5-4c04-b0db-be5f15ae4338 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:39.010145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7485b2b3-ced5-4c04-b0db-be5f15ae4338 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:39.018020 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7485b2b3-ced5-4c04-b0db-be5f15ae4338 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:39.018467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7485b2b3-ced5-4c04-b0db-be5f15ae4338 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:39.019273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7485b2b3-ced5-4c04-b0db-be5f15ae4338 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:39.019704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7485b2b3-ced5-4c04-b0db-be5f15ae4338 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:39.160225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7485b2b3-ced5-4c04-b0db-be5f15ae4338 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:39.168128 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7485b2b3-ced5-4c04-b0db-be5f15ae4338 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1679 microversion: 2.1 time: 0.163081 Jul 20 05:24:39.168748 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3883/7530] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:39 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:40.192081 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-08d878fa-641a-4ef2-848f-b0f318379c74 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:40.192885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-08d878fa-641a-4ef2-848f-b0f318379c74 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:40.200172 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08d878fa-641a-4ef2-848f-b0f318379c74 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:40.200692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08d878fa-641a-4ef2-848f-b0f318379c74 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:40.201523 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08d878fa-641a-4ef2-848f-b0f318379c74 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:40.202001 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08d878fa-641a-4ef2-848f-b0f318379c74 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:40.373585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-08d878fa-641a-4ef2-848f-b0f318379c74 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:40.381564 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-08d878fa-641a-4ef2-848f-b0f318379c74 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1679 microversion: 2.1 time: 0.197317 Jul 20 05:24:40.382150 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3648/7531] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:40 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:41.402848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-2c1fc9b6-e8d8-45f2-851a-fe79821736c4 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:41.403501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-2c1fc9b6-e8d8-45f2-851a-fe79821736c4 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:41.413421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c1fc9b6-e8d8-45f2-851a-fe79821736c4 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:41.413903 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c1fc9b6-e8d8-45f2-851a-fe79821736c4 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:41.414694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c1fc9b6-e8d8-45f2-851a-fe79821736c4 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:41.415133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-2c1fc9b6-e8d8-45f2-851a-fe79821736c4 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:41.552145 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-2c1fc9b6-e8d8-45f2-851a-fe79821736c4 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:41.560053 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-2c1fc9b6-e8d8-45f2-851a-fe79821736c4 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1682 microversion: 2.1 time: 0.163921 Jul 20 05:24:41.560731 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3884/7532] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:41 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:41.659681 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-939c92e2-a33c-4787-a185-cccc5ff9631a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:41.660568 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-939c92e2-a33c-4787-a185-cccc5ff9631a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:41.667647 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-939c92e2-a33c-4787-a185-cccc5ff9631a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:41.668104 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-939c92e2-a33c-4787-a185-cccc5ff9631a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:41.668898 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-939c92e2-a33c-4787-a185-cccc5ff9631a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:41.669344 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-939c92e2-a33c-4787-a185-cccc5ff9631a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:41.723157 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-939c92e2-a33c-4787-a185-cccc5ff9631a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "POST /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d/action" status: 200 len: 38380 microversion: 2.1 time: 0.067370 Jul 20 05:24:41.723847 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3649/7533] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:24:41 2022] POST /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d/action => generated 38380 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:24:42.746366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f17bc6c5-201b-4b30-be47-a1a04f8e4a7a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:42.747049 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f17bc6c5-201b-4b30-be47-a1a04f8e4a7a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:42.749221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e88fb927-c1ac-41ce-83ff-a51fef638927 req-dfb68b85-3c16-4097-94b2-6b692e0372d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8029b058-59f2-4855-a8a9-533929787d2d", "tag": "1a195d6a-644d-444f-800e-a0db8a017b0f"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:42.755349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f17bc6c5-201b-4b30-be47-a1a04f8e4a7a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:42.755807 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f17bc6c5-201b-4b30-be47-a1a04f8e4a7a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:42.756618 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f17bc6c5-201b-4b30-be47-a1a04f8e4a7a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:42.757087 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f17bc6c5-201b-4b30-be47-a1a04f8e4a7a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:42.759514 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e88fb927-c1ac-41ce-83ff-a51fef638927 req-dfb68b85-3c16-4097-94b2-6b692e0372d9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:42.760083 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e88fb927-c1ac-41ce-83ff-a51fef638927 req-dfb68b85-3c16-4097-94b2-6b692e0372d9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:42.771765 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e88fb927-c1ac-41ce-83ff-a51fef638927 req-dfb68b85-3c16-4097-94b2-6b692e0372d9 service nova] Creating event network-changed:1a195d6a-644d-444f-800e-a0db8a017b0f for instance 8029b058-59f2-4855-a8a9-533929787d2d on n-h2-826526-5 Jul 20 05:24:42.776796 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e88fb927-c1ac-41ce-83ff-a51fef638927 req-dfb68b85-3c16-4097-94b2-6b692e0372d9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032244 Jul 20 05:24:42.777590 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3650/7534] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:24:42.786165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f17bc6c5-201b-4b30-be47-a1a04f8e4a7a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:24:42.874815 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f17bc6c5-201b-4b30-be47-a1a04f8e4a7a tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 204 len: 0 microversion: 2.1 time: 0.132080 Jul 20 05:24:42.876360 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3885/7535] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:24:42 2022] DELETE /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:24:42.885308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f9f2997c-2819-426f-94b9-703a87193395 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:42.886039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f9f2997c-2819-426f-94b9-703a87193395 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:42.893128 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9f2997c-2819-426f-94b9-703a87193395 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:42.893596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9f2997c-2819-426f-94b9-703a87193395 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:42.894403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9f2997c-2819-426f-94b9-703a87193395 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:42.894855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9f2997c-2819-426f-94b9-703a87193395 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:43.051909 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f9f2997c-2819-426f-94b9-703a87193395 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:43.059753 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f9f2997c-2819-426f-94b9-703a87193395 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1688 microversion: 2.1 time: 0.178772 Jul 20 05:24:43.060532 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3651/7536] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:42 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:24:44.082487 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d554fa0-884f-4de1-bea0-bd3dc03ccdb1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:44.083207 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4d554fa0-884f-4de1-bea0-bd3dc03ccdb1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:44.090250 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d554fa0-884f-4de1-bea0-bd3dc03ccdb1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:44.090701 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d554fa0-884f-4de1-bea0-bd3dc03ccdb1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:44.091467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d554fa0-884f-4de1-bea0-bd3dc03ccdb1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:44.091900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d554fa0-884f-4de1-bea0-bd3dc03ccdb1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:44.230952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4d554fa0-884f-4de1-bea0-bd3dc03ccdb1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:44.241436 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4d554fa0-884f-4de1-bea0-bd3dc03ccdb1 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1688 microversion: 2.1 time: 0.165728 Jul 20 05:24:44.242015 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3886/7537] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:44 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:44.833989 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-047e2932-8274-4e59-b2ea-4cefb9a2a3ff req-b85aab53-27f6-430b-a13b-bd3b67c38087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8029b058-59f2-4855-a8a9-533929787d2d", "name": "network-vif-deleted", "tag": "1a195d6a-644d-444f-800e-a0db8a017b0f"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:44.842858 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-047e2932-8274-4e59-b2ea-4cefb9a2a3ff req-b85aab53-27f6-430b-a13b-bd3b67c38087 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:44.843323 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-047e2932-8274-4e59-b2ea-4cefb9a2a3ff req-b85aab53-27f6-430b-a13b-bd3b67c38087 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:44.855016 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-047e2932-8274-4e59-b2ea-4cefb9a2a3ff req-b85aab53-27f6-430b-a13b-bd3b67c38087 service nova] Creating event network-vif-deleted:1a195d6a-644d-444f-800e-a0db8a017b0f for instance 8029b058-59f2-4855-a8a9-533929787d2d on n-h2-826526-5 Jul 20 05:24:44.860053 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-047e2932-8274-4e59-b2ea-4cefb9a2a3ff req-b85aab53-27f6-430b-a13b-bd3b67c38087 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030136 Jul 20 05:24:44.860709 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3652/7538] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:24:45.259137 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-41f75fbc-f7f6-4df3-b08a-6ae5bc56d403 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:45.259819 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-41f75fbc-f7f6-4df3-b08a-6ae5bc56d403 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:45.266806 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41f75fbc-f7f6-4df3-b08a-6ae5bc56d403 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:45.267434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41f75fbc-f7f6-4df3-b08a-6ae5bc56d403 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:45.268287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41f75fbc-f7f6-4df3-b08a-6ae5bc56d403 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:45.268787 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41f75fbc-f7f6-4df3-b08a-6ae5bc56d403 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:45.300956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41f75fbc-f7f6-4df3-b08a-6ae5bc56d403 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:45.301392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-41f75fbc-f7f6-4df3-b08a-6ae5bc56d403 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:45.301838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-41f75fbc-f7f6-4df3-b08a-6ae5bc56d403 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lazy-loading 'fault' on Instance uuid 8029b058-59f2-4855-a8a9-533929787d2d {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:24:45.345646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-41f75fbc-f7f6-4df3-b08a-6ae5bc56d403 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1630a34d53714c0e9476578c711c87ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb789b41bf4456da732c16f4f4a8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:45.352631 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-41f75fbc-f7f6-4df3-b08a-6ae5bc56d403 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 200 len: 1356 microversion: 2.1 time: 0.097413 Jul 20 05:24:45.353122 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3887/7539] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:45 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 1356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:46.376056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7f3e9a9e-8d1b-4b82-b7d7-659128911de6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:46.377470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7f3e9a9e-8d1b-4b82-b7d7-659128911de6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] [instance: 8029b058-59f2-4855-a8a9-533929787d2d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:46.384222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f3e9a9e-8d1b-4b82-b7d7-659128911de6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:46.384707 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f3e9a9e-8d1b-4b82-b7d7-659128911de6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:46.385486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f3e9a9e-8d1b-4b82-b7d7-659128911de6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:46.385930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f3e9a9e-8d1b-4b82-b7d7-659128911de6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:46.399937 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-7f3e9a9e-8d1b-4b82-b7d7-659128911de6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] HTTP exception thrown: Instance 8029b058-59f2-4855-a8a9-533929787d2d could not be found. Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7f3e9a9e-8d1b-4b82-b7d7-659128911de6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Request method failure captured: Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d HTTP/1.1 Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi14_VCFjjVcTDMCOBzB1_dpwx5DVZGShtyV9aNSxFwqN91bfAZLspYUqpOuFY60lfwoTX92LAvzu4_lVXiuAI6bCcZR72Uk33EVYPdRaTam7Sy1z7ptYj007ryXZcviRzbeELD7jp-BgLMPFOM6y6Fr8V8hDQb9L5gP558auLEGITPuw Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 4fb789b41bf4456da732c16f4f4a8b7f Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-337819042 Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4fb789b41bf4456da732c16f4f4a8b7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4fb789b41bf4456da732c16f4f4a8b7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4fb789b41bf4456da732c16f4f4a8b7f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4fb789b41bf4456da732c16f4f4a8b7f"}]}] Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestNetworkAdvancedServerOps-337819042 Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 4fb789b41bf4456da732c16f4f4a8b7f Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-337819042 Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestNetworkAdvancedServerOps-337819042-project Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 1630a34d53714c0e9476578c711c87ac Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestNetworkAdvancedServerOps-337819042-project Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance 8029b058-59f2-4855-a8a9-533929787d2d could not be found. Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': '8029b058-59f2-4855-a8a9-533929787d2d'} Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8029b058-59f2-4855-a8a9-533929787d2d could not be found. Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8029b058-59f2-4855-a8a9-533929787d2d could not be found. Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:24:46.401615 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:24:46.407026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:24:46.407026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:24:46.407026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:24:46.407026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:24:46.407026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:24:46.407026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8029b058-59f2-4855-a8a9-533929787d2d could not be found. Jul 20 05:24:46.407026 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:24:46.407026 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7f3e9a9e-8d1b-4b82-b7d7-659128911de6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Returning 404 to user: Instance 8029b058-59f2-4855-a8a9-533929787d2d could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:24:46.407026 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7f3e9a9e-8d1b-4b82-b7d7-659128911de6 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d" status: 404 len: 111 microversion: 2.1 time: 0.035477 Jul 20 05:24:46.407026 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3653/7540] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:46 2022] GET /compute/v2.1/servers/8029b058-59f2-4855-a8a9-533929787d2d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:24:49.802001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9edd5fd8-2749-4e02-abfc-33e228b37db2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] Calling method '.version_select at 0x7f06bcb15f70>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:49.828124 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9edd5fd8-2749-4e02-abfc-33e228b37db2 tempest-TestNetworkAdvancedServerOps-337819042 tempest-TestNetworkAdvancedServerOps-337819042-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1374339553" status: 202 len: 0 microversion: 2.1 time: 0.030343 Jul 20 05:24:49.828887 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3888/7541] 10.222.0.17 () {58 vars in 1283 bytes} [Wed Jul 20 05:24:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1374339553 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:25:01.021486 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=18 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:01.022904 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:01.206086 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-768af009-258a-457e-b51f-8e1936a1bf4c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Action: 'create', calling method: .version_select at 0x7f06be699b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1379504059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAeI4Ky6HMcJbhc1USoy5XlFpDCekZ+tHct+0WNGrt2sP3DrAdainDpBX/SzVGBGKIq1Zo5NK61rSbRmhFQrsTxAqBIg5e9NhLQZ8luDqtmiujc6IeySAG1o9ppnZ/6GQ=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:01.222270 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-768af009-258a-457e-b51f-8e1936a1bf4c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Getting quotas for project 648abb554ebf439fb69d231109a1249d. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:25:01.229260 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-768af009-258a-457e-b51f-8e1936a1bf4c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Getting quotas for user 4e8f0227fab542549209162a4dde421a and project 648abb554ebf439fb69d231109a1249d. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:25:01.259880 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-768af009-258a-457e-b51f-8e1936a1bf4c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.244538 Jul 20 05:25:01.261165 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3654/7542] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 05:25:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:25:02.491524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:02.492422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:02.498391 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e40bd697-e13d-4ec3-9b55-3ca0b53bf91c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1753211341", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1379504059", "security_groups": [{"name": "tempest-secgroup-smoke-2122865193"}], "networks": [{"uuid": "13029c59-f4b0-4f85-b7af-66e433cb999f"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:02.608610 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-e40bd697-e13d-4ec3-9b55-3ca0b53bf91c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] validate_networks() for [('13029c59-f4b0-4f85-b7af-66e433cb999f', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:25:03.027501 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-e40bd697-e13d-4ec3-9b55-3ca0b53bf91c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:25:03.027939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-e40bd697-e13d-4ec3-9b55-3ca0b53bf91c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:25:03.028442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-e40bd697-e13d-4ec3-9b55-3ca0b53bf91c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:25:03.028848 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-e40bd697-e13d-4ec3-9b55-3ca0b53bf91c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:25:03.029259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-e40bd697-e13d-4ec3-9b55-3ca0b53bf91c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:25:03.038293 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e40bd697-e13d-4ec3-9b55-3ca0b53bf91c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:03.038736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e40bd697-e13d-4ec3-9b55-3ca0b53bf91c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:03.039522 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e40bd697-e13d-4ec3-9b55-3ca0b53bf91c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:03.039954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e40bd697-e13d-4ec3-9b55-3ca0b53bf91c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:03.057340 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-e40bd697-e13d-4ec3-9b55-3ca0b53bf91c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Getting quotas for project 648abb554ebf439fb69d231109a1249d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:25:03.062786 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-e40bd697-e13d-4ec3-9b55-3ca0b53bf91c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Getting quotas for user 4e8f0227fab542549209162a4dde421a and project 648abb554ebf439fb69d231109a1249d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:25:03.075897 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e40bd697-e13d-4ec3-9b55-3ca0b53bf91c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:25:03.078240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e40bd697-e13d-4ec3-9b55-3ca0b53bf91c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:25:03.134164 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e40bd697-e13d-4ec3-9b55-3ca0b53bf91c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.644282 Jul 20 05:25:03.135018 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3889/7543] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:25:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:25:03.146158 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-56d1390f-6186-4d67-b9d8-1f04d95c120e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:03.146911 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-56d1390f-6186-4d67-b9d8-1f04d95c120e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:03.211272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-56d1390f-6186-4d67-b9d8-1f04d95c120e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:03.218796 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-56d1390f-6186-4d67-b9d8-1f04d95c120e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1247 microversion: 2.1 time: 0.077647 Jul 20 05:25:03.219369 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3655/7544] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:03 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1247 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:04.236811 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-34b584ae-ee6a-4122-ac07-773ea1f678de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:04.237474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-34b584ae-ee6a-4122-ac07-773ea1f678de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:04.245635 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-34b584ae-ee6a-4122-ac07-773ea1f678de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:04.246357 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-34b584ae-ee6a-4122-ac07-773ea1f678de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:04.247144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-34b584ae-ee6a-4122-ac07-773ea1f678de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:04.248072 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-34b584ae-ee6a-4122-ac07-773ea1f678de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:04.337260 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-34b584ae-ee6a-4122-ac07-773ea1f678de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:04.348646 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-34b584ae-ee6a-4122-ac07-773ea1f678de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1299 microversion: 2.1 time: 0.115766 Jul 20 05:25:04.369376 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3890/7545] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:04 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1299 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:05.386875 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4585624d-09a4-4127-8ef0-e0a360ad96fa tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:05.388098 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4585624d-09a4-4127-8ef0-e0a360ad96fa tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:05.401498 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4585624d-09a4-4127-8ef0-e0a360ad96fa tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:05.403949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4585624d-09a4-4127-8ef0-e0a360ad96fa tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:05.404830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4585624d-09a4-4127-8ef0-e0a360ad96fa tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:05.405321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4585624d-09a4-4127-8ef0-e0a360ad96fa tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:05.617424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4585624d-09a4-4127-8ef0-e0a360ad96fa tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:05.638922 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4585624d-09a4-4127-8ef0-e0a360ad96fa tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1373 microversion: 2.1 time: 0.256118 Jul 20 05:25:05.640167 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3656/7546] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:05 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1373 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:06.217403 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-7a5ae6c7-fe7f-407e-b205-5dbe2d7a899f req-d5473444-76b9-49aa-bf90-b970dd5641b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d623a359-591c-4fc2-920f-e3f7267b459a", "tag": "3e917aad-f41a-4af8-92d3-038be19eb239"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:06.226227 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7a5ae6c7-fe7f-407e-b205-5dbe2d7a899f req-d5473444-76b9-49aa-bf90-b970dd5641b9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:06.227523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-7a5ae6c7-fe7f-407e-b205-5dbe2d7a899f req-d5473444-76b9-49aa-bf90-b970dd5641b9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:06.240236 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-7a5ae6c7-fe7f-407e-b205-5dbe2d7a899f req-d5473444-76b9-49aa-bf90-b970dd5641b9 service nova] Creating event network-changed:3e917aad-f41a-4af8-92d3-038be19eb239 for instance d623a359-591c-4fc2-920f-e3f7267b459a on n-h1-826526-5 Jul 20 05:25:06.245665 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-7a5ae6c7-fe7f-407e-b205-5dbe2d7a899f req-d5473444-76b9-49aa-bf90-b970dd5641b9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113780 Jul 20 05:25:06.246289 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3891/7547] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:25:06.656650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-967198ea-940a-4c64-9de2-1c0a61dfd8a7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:06.660326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-967198ea-940a-4c64-9de2-1c0a61dfd8a7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:06.665335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-967198ea-940a-4c64-9de2-1c0a61dfd8a7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:06.666203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-967198ea-940a-4c64-9de2-1c0a61dfd8a7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:06.667391 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-967198ea-940a-4c64-9de2-1c0a61dfd8a7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:06.667849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-967198ea-940a-4c64-9de2-1c0a61dfd8a7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:06.808389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-967198ea-940a-4c64-9de2-1c0a61dfd8a7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:06.816330 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-967198ea-940a-4c64-9de2-1c0a61dfd8a7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1373 microversion: 2.1 time: 0.163917 Jul 20 05:25:06.816926 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3657/7548] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:06 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:07.835094 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dcb7624c-0d01-4046-be74-62548470f3d3 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:07.835797 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dcb7624c-0d01-4046-be74-62548470f3d3 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:07.842611 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcb7624c-0d01-4046-be74-62548470f3d3 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:07.843064 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcb7624c-0d01-4046-be74-62548470f3d3 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:07.843840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcb7624c-0d01-4046-be74-62548470f3d3 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:07.844296 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dcb7624c-0d01-4046-be74-62548470f3d3 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:07.987177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dcb7624c-0d01-4046-be74-62548470f3d3 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:07.997999 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dcb7624c-0d01-4046-be74-62548470f3d3 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1373 microversion: 2.1 time: 0.167471 Jul 20 05:25:07.999031 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3892/7549] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:07 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:09.023712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6f449de2-8498-410c-be15-5dca5c2da4e0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:09.024968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6f449de2-8498-410c-be15-5dca5c2da4e0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:09.035702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f449de2-8498-410c-be15-5dca5c2da4e0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:09.036165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f449de2-8498-410c-be15-5dca5c2da4e0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:09.036998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f449de2-8498-410c-be15-5dca5c2da4e0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:09.037453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f449de2-8498-410c-be15-5dca5c2da4e0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:09.182055 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-6f449de2-8498-410c-be15-5dca5c2da4e0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:09.190587 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6f449de2-8498-410c-be15-5dca5c2da4e0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1373 microversion: 2.1 time: 0.174337 Jul 20 05:25:09.191308 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3658/7550] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:09 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:10.210742 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d7fdf5e4-bef5-4c90-a590-a313fc40a3f3 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:10.211364 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d7fdf5e4-bef5-4c90-a590-a313fc40a3f3 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:10.221330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7fdf5e4-bef5-4c90-a590-a313fc40a3f3 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:10.221765 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7fdf5e4-bef5-4c90-a590-a313fc40a3f3 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:10.222741 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7fdf5e4-bef5-4c90-a590-a313fc40a3f3 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:10.223291 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d7fdf5e4-bef5-4c90-a590-a313fc40a3f3 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:10.370540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d7fdf5e4-bef5-4c90-a590-a313fc40a3f3 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:10.379560 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d7fdf5e4-bef5-4c90-a590-a313fc40a3f3 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1373 microversion: 2.1 time: 0.174252 Jul 20 05:25:10.380372 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3893/7551] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:10 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:11.253050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e2de4da3-d672-4bb9-9937-6411bd146169 req-7ee9195f-7b08-410b-adcf-1182e38bfa8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d623a359-591c-4fc2-920f-e3f7267b459a", "name": "network-vif-plugged", "status": "completed", "tag": "3e917aad-f41a-4af8-92d3-038be19eb239"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:11.263823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e2de4da3-d672-4bb9-9937-6411bd146169 req-7ee9195f-7b08-410b-adcf-1182e38bfa8b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:11.264135 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e2de4da3-d672-4bb9-9937-6411bd146169 req-7ee9195f-7b08-410b-adcf-1182e38bfa8b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:11.276175 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e2de4da3-d672-4bb9-9937-6411bd146169 req-7ee9195f-7b08-410b-adcf-1182e38bfa8b service nova] Creating event network-vif-plugged:3e917aad-f41a-4af8-92d3-038be19eb239 for instance d623a359-591c-4fc2-920f-e3f7267b459a on n-h1-826526-5 Jul 20 05:25:11.281361 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e2de4da3-d672-4bb9-9937-6411bd146169 req-7ee9195f-7b08-410b-adcf-1182e38bfa8b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032100 Jul 20 05:25:11.281949 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3659/7552] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:25:11.397545 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-88e9eac3-17f6-48ca-9963-f7aed1150d94 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:11.398259 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-88e9eac3-17f6-48ca-9963-f7aed1150d94 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:11.405551 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88e9eac3-17f6-48ca-9963-f7aed1150d94 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:11.406262 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88e9eac3-17f6-48ca-9963-f7aed1150d94 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:11.407018 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88e9eac3-17f6-48ca-9963-f7aed1150d94 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:11.407440 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-88e9eac3-17f6-48ca-9963-f7aed1150d94 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:11.553220 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-88e9eac3-17f6-48ca-9963-f7aed1150d94 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:11.563957 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-88e9eac3-17f6-48ca-9963-f7aed1150d94 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1373 microversion: 2.1 time: 0.170151 Jul 20 05:25:11.564902 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3894/7553] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:11 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:12.583152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-898c95dc-ad49-41c2-aca5-2330c8cb0975 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:12.583886 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-898c95dc-ad49-41c2-aca5-2330c8cb0975 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:12.590740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-898c95dc-ad49-41c2-aca5-2330c8cb0975 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:12.591202 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-898c95dc-ad49-41c2-aca5-2330c8cb0975 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:12.591983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-898c95dc-ad49-41c2-aca5-2330c8cb0975 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:12.592467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-898c95dc-ad49-41c2-aca5-2330c8cb0975 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:12.733477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-898c95dc-ad49-41c2-aca5-2330c8cb0975 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:12.745300 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-898c95dc-ad49-41c2-aca5-2330c8cb0975 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1557 microversion: 2.1 time: 0.167017 Jul 20 05:25:12.746095 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3660/7554] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:12 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:12.766933 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d8e72e51-5d5b-4acb-a6bd-6ee9aeaec71d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:12.767576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d8e72e51-5d5b-4acb-a6bd-6ee9aeaec71d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:12.777570 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8e72e51-5d5b-4acb-a6bd-6ee9aeaec71d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:12.778186 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8e72e51-5d5b-4acb-a6bd-6ee9aeaec71d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:12.779269 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8e72e51-5d5b-4acb-a6bd-6ee9aeaec71d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:12.779705 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d8e72e51-5d5b-4acb-a6bd-6ee9aeaec71d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:12.925961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-d8e72e51-5d5b-4acb-a6bd-6ee9aeaec71d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:12.934350 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d8e72e51-5d5b-4acb-a6bd-6ee9aeaec71d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1557 microversion: 2.1 time: 0.173760 Jul 20 05:25:12.934971 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3895/7555] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:12 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1557 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:15.077453 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-335cef5e-a5a3-40f1-b206-361bef286ebf req-1bbe2011-d136-4d0b-9ec8-c3c1db54bf0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d623a359-591c-4fc2-920f-e3f7267b459a", "tag": "3e917aad-f41a-4af8-92d3-038be19eb239"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:15.081227 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:15.088413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-335cef5e-a5a3-40f1-b206-361bef286ebf req-1bbe2011-d136-4d0b-9ec8-c3c1db54bf0a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:15.089049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-335cef5e-a5a3-40f1-b206-361bef286ebf req-1bbe2011-d136-4d0b-9ec8-c3c1db54bf0a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:15.100630 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-335cef5e-a5a3-40f1-b206-361bef286ebf req-1bbe2011-d136-4d0b-9ec8-c3c1db54bf0a service nova] Creating event network-changed:3e917aad-f41a-4af8-92d3-038be19eb239 for instance d623a359-591c-4fc2-920f-e3f7267b459a on n-h1-826526-5 Jul 20 05:25:15.105830 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-335cef5e-a5a3-40f1-b206-361bef286ebf req-1bbe2011-d136-4d0b-9ec8-c3c1db54bf0a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032293 Jul 20 05:25:15.106587 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3661/7556] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:27:09.885762 n-d-826526-5 devstack@n-api.service[127871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [18f52317-25d4-47c7-8a42-88d448614a79] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:27:09.886688 n-d-826526-5 devstack@n-api.service[127871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82756c74-7ff1-4946-aaad-2fa7aa912700] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:27:09.887057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:09.887853 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:09.888617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:09.889245 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=34 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:09.893864 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a9f308b6-c68a-48ac-b0ca-14ada7575092 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:27:09.894400 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a9f308b6-c68a-48ac-b0ca-14ada7575092 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:09.902524 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9f308b6-c68a-48ac-b0ca-14ada7575092 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:09.903000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9f308b6-c68a-48ac-b0ca-14ada7575092 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:09.903764 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9f308b6-c68a-48ac-b0ca-14ada7575092 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:09.904199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9f308b6-c68a-48ac-b0ca-14ada7575092 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:09.927167 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.objects.instance [None req-a9f308b6-c68a-48ac-b0ca-14ada7575092 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lazy-loading 'flavor' on Instance uuid d623a359-591c-4fc2-920f-e3f7267b459a {{(pid=127871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:27:10.202566 n-d-826526-5 devstack@n-api.service[127871]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a9f308b6-c68a-48ac-b0ca-14ada7575092 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [0e473342-8da2-4b1e-be22-14bcdee704e0] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:27:10.899138 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] [18f52317-25d4-47c7-8a42-88d448614a79] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 40796. Jul 20 05:27:10.903669 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] [82756c74-7ff1-4946-aaad-2fa7aa912700] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 40798. Jul 20 05:27:11.213945 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [None req-a9f308b6-c68a-48ac-b0ca-14ada7575092 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [0e473342-8da2-4b1e-be22-14bcdee704e0] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 40800. Jul 20 05:27:11.217595 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a9f308b6-c68a-48ac-b0ca-14ada7575092 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "POST /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a/action" status: 202 len: 0 microversion: 2.1 time: 1.334974 Jul 20 05:27:11.218263 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3896/7557] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:27:09 2022] POST /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a/action => generated 0 bytes in 1337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:27:11.225161 n-d-826526-5 devstack@n-api.service[127870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b840de8d-74a7-4811-99d3-e95c689ad04d] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:27:11.226071 n-d-826526-5 devstack@n-api.service[127870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [56c2cea1-3165-4980-b3a4-cf0ea167ce39] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:27:11.226727 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:11.227986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=28 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:11.232742 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eb292ed1-86e3-4b06-a1ad-a74531307ab1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:11.233217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eb292ed1-86e3-4b06-a1ad-a74531307ab1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:11.240988 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb292ed1-86e3-4b06-a1ad-a74531307ab1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:11.241540 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb292ed1-86e3-4b06-a1ad-a74531307ab1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:11.242340 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb292ed1-86e3-4b06-a1ad-a74531307ab1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:11.242871 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb292ed1-86e3-4b06-a1ad-a74531307ab1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:11.401272 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-eb292ed1-86e3-4b06-a1ad-a74531307ab1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:11.413095 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eb292ed1-86e3-4b06-a1ad-a74531307ab1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1681 microversion: 2.1 time: 0.189789 Jul 20 05:27:11.413882 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3662/7558] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:11 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:12.434015 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ce9e565f-0585-412c-9c8a-637faf05bd83 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:12.434683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ce9e565f-0585-412c-9c8a-637faf05bd83 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:12.442457 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce9e565f-0585-412c-9c8a-637faf05bd83 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:12.442908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce9e565f-0585-412c-9c8a-637faf05bd83 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:12.443667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce9e565f-0585-412c-9c8a-637faf05bd83 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:12.444100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ce9e565f-0585-412c-9c8a-637faf05bd83 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:12.603099 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ce9e565f-0585-412c-9c8a-637faf05bd83 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:12.615980 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ce9e565f-0585-412c-9c8a-637faf05bd83 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1681 microversion: 2.1 time: 0.186667 Jul 20 05:27:12.616655 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3897/7559] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:12 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:13.634326 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4ff3de03-0194-4655-9e27-a46c3918f49d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:13.635253 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4ff3de03-0194-4655-9e27-a46c3918f49d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:13.647919 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ff3de03-0194-4655-9e27-a46c3918f49d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:13.648403 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ff3de03-0194-4655-9e27-a46c3918f49d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:13.649228 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ff3de03-0194-4655-9e27-a46c3918f49d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:13.649679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ff3de03-0194-4655-9e27-a46c3918f49d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:13.655976 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] [b840de8d-74a7-4811-99d3-e95c689ad04d] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 40814. Jul 20 05:27:13.667998 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] [56c2cea1-3165-4980-b3a4-cf0ea167ce39] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 40816. Jul 20 05:27:13.808537 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-4ff3de03-0194-4655-9e27-a46c3918f49d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:13.821614 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4ff3de03-0194-4655-9e27-a46c3918f49d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1681 microversion: 2.1 time: 0.191223 Jul 20 05:27:13.822562 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3663/7560] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:13 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:14.842449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e25210d8-4ddb-4b3a-8c59-6d520967752b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:14.843211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e25210d8-4ddb-4b3a-8c59-6d520967752b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:14.852505 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e25210d8-4ddb-4b3a-8c59-6d520967752b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:14.853078 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e25210d8-4ddb-4b3a-8c59-6d520967752b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:14.854040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e25210d8-4ddb-4b3a-8c59-6d520967752b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:14.854607 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e25210d8-4ddb-4b3a-8c59-6d520967752b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:15.008997 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e25210d8-4ddb-4b3a-8c59-6d520967752b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:15.018094 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e25210d8-4ddb-4b3a-8c59-6d520967752b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1681 microversion: 2.1 time: 0.181460 Jul 20 05:27:15.018648 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3898/7561] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:14 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:15.320039 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:27:15.320645 n-d-826526-5 devstack@n-api.service[127870]: Wed Jul 20 05:27:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:27:16.043257 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-522793e5-23ec-4c9e-bb23-8221656f77e4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:16.043780 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-522793e5-23ec-4c9e-bb23-8221656f77e4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:16.051317 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-522793e5-23ec-4c9e-bb23-8221656f77e4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:16.051778 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-522793e5-23ec-4c9e-bb23-8221656f77e4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:16.052624 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-522793e5-23ec-4c9e-bb23-8221656f77e4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:16.053076 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-522793e5-23ec-4c9e-bb23-8221656f77e4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:16.203051 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-522793e5-23ec-4c9e-bb23-8221656f77e4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:16.210775 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-522793e5-23ec-4c9e-bb23-8221656f77e4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1681 microversion: 2.1 time: 0.174152 Jul 20 05:27:16.211349 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3664/7562] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:16 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:17.234092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-870256cd-6024-4ca5-9da1-8ca4d789b8e1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:17.234952 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-870256cd-6024-4ca5-9da1-8ca4d789b8e1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:17.247194 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-870256cd-6024-4ca5-9da1-8ca4d789b8e1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:17.247652 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-870256cd-6024-4ca5-9da1-8ca4d789b8e1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:17.248444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-870256cd-6024-4ca5-9da1-8ca4d789b8e1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:17.248885 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-870256cd-6024-4ca5-9da1-8ca4d789b8e1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:17.403063 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-870256cd-6024-4ca5-9da1-8ca4d789b8e1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:17.411648 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-870256cd-6024-4ca5-9da1-8ca4d789b8e1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1681 microversion: 2.1 time: 0.184400 Jul 20 05:27:17.412233 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3899/7563] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:17 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:18.431230 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f5c3c51c-e3ca-4549-883c-5bc4ed56de85 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:18.431838 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f5c3c51c-e3ca-4549-883c-5bc4ed56de85 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:18.439714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5c3c51c-e3ca-4549-883c-5bc4ed56de85 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:18.440240 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5c3c51c-e3ca-4549-883c-5bc4ed56de85 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:18.441425 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5c3c51c-e3ca-4549-883c-5bc4ed56de85 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:18.441964 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5c3c51c-e3ca-4549-883c-5bc4ed56de85 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:18.591367 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f5c3c51c-e3ca-4549-883c-5bc4ed56de85 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:18.599360 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f5c3c51c-e3ca-4549-883c-5bc4ed56de85 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1681 microversion: 2.1 time: 0.172081 Jul 20 05:27:18.599937 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3665/7564] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:18 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:19.618562 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f2f611a2-c735-4e41-9f61-64e95eb309e6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:19.619689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f2f611a2-c735-4e41-9f61-64e95eb309e6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:19.629278 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2f611a2-c735-4e41-9f61-64e95eb309e6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:19.629975 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2f611a2-c735-4e41-9f61-64e95eb309e6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:19.631199 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2f611a2-c735-4e41-9f61-64e95eb309e6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:19.631892 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f2f611a2-c735-4e41-9f61-64e95eb309e6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:19.777920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f2f611a2-c735-4e41-9f61-64e95eb309e6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:19.785905 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f2f611a2-c735-4e41-9f61-64e95eb309e6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1681 microversion: 2.1 time: 0.173001 Jul 20 05:27:19.786459 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3900/7565] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:19 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:20.808111 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-66901fe7-03e4-4e7a-ae74-f2adf9708ba5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:20.809132 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-66901fe7-03e4-4e7a-ae74-f2adf9708ba5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:20.816698 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66901fe7-03e4-4e7a-ae74-f2adf9708ba5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:20.817170 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66901fe7-03e4-4e7a-ae74-f2adf9708ba5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:20.817956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66901fe7-03e4-4e7a-ae74-f2adf9708ba5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:20.818407 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66901fe7-03e4-4e7a-ae74-f2adf9708ba5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:20.965134 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-66901fe7-03e4-4e7a-ae74-f2adf9708ba5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:20.973385 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-66901fe7-03e4-4e7a-ae74-f2adf9708ba5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1681 microversion: 2.1 time: 0.171912 Jul 20 05:27:20.973943 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3666/7566] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:20 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:21.736642 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:27:21.737191 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:27:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:27:21.990521 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5cb3a10e-47d7-40a4-8450-9d4d7efd14da tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:21.991272 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5cb3a10e-47d7-40a4-8450-9d4d7efd14da tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:21.998256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5cb3a10e-47d7-40a4-8450-9d4d7efd14da tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:21.998684 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5cb3a10e-47d7-40a4-8450-9d4d7efd14da tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:21.999455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5cb3a10e-47d7-40a4-8450-9d4d7efd14da tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:21.999908 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5cb3a10e-47d7-40a4-8450-9d4d7efd14da tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:22.139148 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5cb3a10e-47d7-40a4-8450-9d4d7efd14da tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:22.146862 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5cb3a10e-47d7-40a4-8450-9d4d7efd14da tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1702 microversion: 2.1 time: 0.160319 Jul 20 05:27:22.147463 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3901/7567] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:21 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1702 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:23.169740 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-836a12b4-6142-4348-aa00-d367206f51b4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:23.170822 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-836a12b4-6142-4348-aa00-d367206f51b4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:23.183015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-836a12b4-6142-4348-aa00-d367206f51b4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:23.183775 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-836a12b4-6142-4348-aa00-d367206f51b4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:23.185143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-836a12b4-6142-4348-aa00-d367206f51b4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:23.185864 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-836a12b4-6142-4348-aa00-d367206f51b4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:23.339614 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-836a12b4-6142-4348-aa00-d367206f51b4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:23.351895 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-836a12b4-6142-4348-aa00-d367206f51b4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1702 microversion: 2.1 time: 0.189139 Jul 20 05:27:23.352765 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3667/7568] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:23 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1702 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:24.029737 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-8cea6230-7080-466c-850a-196d7c6ac6c1 req-29c9c33b-cb35-4d26-acf5-6c549488257f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d623a359-591c-4fc2-920f-e3f7267b459a", "name": "network-vif-plugged", "status": "completed", "tag": "3e917aad-f41a-4af8-92d3-038be19eb239"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:27:24.038587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8cea6230-7080-466c-850a-196d7c6ac6c1 req-29c9c33b-cb35-4d26-acf5-6c549488257f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:24.039107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-8cea6230-7080-466c-850a-196d7c6ac6c1 req-29c9c33b-cb35-4d26-acf5-6c549488257f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:24.050999 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-8cea6230-7080-466c-850a-196d7c6ac6c1 req-29c9c33b-cb35-4d26-acf5-6c549488257f service nova] Creating event network-vif-plugged:3e917aad-f41a-4af8-92d3-038be19eb239 for instance d623a359-591c-4fc2-920f-e3f7267b459a on n-h1-826526-5 Jul 20 05:27:24.056595 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-8cea6230-7080-466c-850a-196d7c6ac6c1 req-29c9c33b-cb35-4d26-acf5-6c549488257f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130294 Jul 20 05:27:24.057430 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3902/7569] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:27:24.371033 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a8454df4-afbd-4a9a-86b4-0afa7327b71e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:24.371786 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a8454df4-afbd-4a9a-86b4-0afa7327b71e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:24.380031 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8454df4-afbd-4a9a-86b4-0afa7327b71e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:24.380808 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8454df4-afbd-4a9a-86b4-0afa7327b71e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:24.381841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8454df4-afbd-4a9a-86b4-0afa7327b71e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:24.382363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8454df4-afbd-4a9a-86b4-0afa7327b71e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:24.522585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a8454df4-afbd-4a9a-86b4-0afa7327b71e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:24.533041 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a8454df4-afbd-4a9a-86b4-0afa7327b71e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1697 microversion: 2.1 time: 0.165880 Jul 20 05:27:24.534329 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3668/7570] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:24 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:25.554005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0a16a98b-433c-4187-a494-a3d31853a747 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:25.554686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0a16a98b-433c-4187-a494-a3d31853a747 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:25.562467 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a16a98b-433c-4187-a494-a3d31853a747 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:25.563474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a16a98b-433c-4187-a494-a3d31853a747 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:25.566034 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a16a98b-433c-4187-a494-a3d31853a747 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:25.566731 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0a16a98b-433c-4187-a494-a3d31853a747 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:25.735645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0a16a98b-433c-4187-a494-a3d31853a747 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:25.744878 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0a16a98b-433c-4187-a494-a3d31853a747 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1697 microversion: 2.1 time: 0.197348 Jul 20 05:27:25.745750 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3903/7571] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:25 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1697 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:26.763691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-61188f6f-df0d-40d2-a5fd-b15c561849b0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:26.765165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-61188f6f-df0d-40d2-a5fd-b15c561849b0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:26.773781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61188f6f-df0d-40d2-a5fd-b15c561849b0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:26.774642 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61188f6f-df0d-40d2-a5fd-b15c561849b0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:26.775684 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61188f6f-df0d-40d2-a5fd-b15c561849b0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:26.776307 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61188f6f-df0d-40d2-a5fd-b15c561849b0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:26.934229 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-61188f6f-df0d-40d2-a5fd-b15c561849b0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:26.942649 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-61188f6f-df0d-40d2-a5fd-b15c561849b0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1697 microversion: 2.1 time: 0.183462 Jul 20 05:27:26.943530 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3669/7572] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:26 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:27.960733 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-8bef9ef4-0c54-4503-b4e3-de1305757496 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:27.961281 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-8bef9ef4-0c54-4503-b4e3-de1305757496 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:27.968114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8bef9ef4-0c54-4503-b4e3-de1305757496 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:27.968876 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8bef9ef4-0c54-4503-b4e3-de1305757496 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:27.969646 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8bef9ef4-0c54-4503-b4e3-de1305757496 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:27.970282 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-8bef9ef4-0c54-4503-b4e3-de1305757496 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:28.119979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-8bef9ef4-0c54-4503-b4e3-de1305757496 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:28.128501 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-8bef9ef4-0c54-4503-b4e3-de1305757496 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1697 microversion: 2.1 time: 0.171772 Jul 20 05:27:28.129628 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3904/7573] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:27 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:29.146289 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-85521c8d-4177-44ea-b078-deb593e011c8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:29.147274 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-85521c8d-4177-44ea-b078-deb593e011c8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:29.155299 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85521c8d-4177-44ea-b078-deb593e011c8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:29.155768 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85521c8d-4177-44ea-b078-deb593e011c8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:29.159020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85521c8d-4177-44ea-b078-deb593e011c8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:29.159020 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85521c8d-4177-44ea-b078-deb593e011c8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:29.307213 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-85521c8d-4177-44ea-b078-deb593e011c8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:29.318606 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-85521c8d-4177-44ea-b078-deb593e011c8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1697 microversion: 2.1 time: 0.176294 Jul 20 05:27:29.319213 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3670/7574] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:29 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:30.336311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7dc4099f-5211-4134-a913-50d0c1be5dd6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:30.336929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7dc4099f-5211-4134-a913-50d0c1be5dd6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:30.344459 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7dc4099f-5211-4134-a913-50d0c1be5dd6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:30.344917 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7dc4099f-5211-4134-a913-50d0c1be5dd6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:30.345690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7dc4099f-5211-4134-a913-50d0c1be5dd6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:30.346131 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7dc4099f-5211-4134-a913-50d0c1be5dd6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:30.485299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7dc4099f-5211-4134-a913-50d0c1be5dd6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:30.494590 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7dc4099f-5211-4134-a913-50d0c1be5dd6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1697 microversion: 2.1 time: 0.162040 Jul 20 05:27:30.505040 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3905/7575] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:30 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:31.512585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d2265879-6fec-4935-80d5-97d99b11ac06 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:31.513258 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d2265879-6fec-4935-80d5-97d99b11ac06 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:31.521376 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2265879-6fec-4935-80d5-97d99b11ac06 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:31.521844 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2265879-6fec-4935-80d5-97d99b11ac06 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:31.522645 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2265879-6fec-4935-80d5-97d99b11ac06 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:31.523096 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2265879-6fec-4935-80d5-97d99b11ac06 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:31.685162 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d2265879-6fec-4935-80d5-97d99b11ac06 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:31.705318 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d2265879-6fec-4935-80d5-97d99b11ac06 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1697 microversion: 2.1 time: 0.194654 Jul 20 05:27:31.706145 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3671/7576] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:31 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1697 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:32.725449 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-397063b4-03a0-4099-a7b8-ac6713735ebb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:32.725946 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-397063b4-03a0-4099-a7b8-ac6713735ebb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:32.733717 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-397063b4-03a0-4099-a7b8-ac6713735ebb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:32.734177 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-397063b4-03a0-4099-a7b8-ac6713735ebb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:32.734950 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-397063b4-03a0-4099-a7b8-ac6713735ebb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:32.735476 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-397063b4-03a0-4099-a7b8-ac6713735ebb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:32.872418 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-397063b4-03a0-4099-a7b8-ac6713735ebb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:32.884990 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-397063b4-03a0-4099-a7b8-ac6713735ebb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1697 microversion: 2.1 time: 0.163259 Jul 20 05:27:32.885935 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3906/7577] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:32 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:33.913673 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f2519880-fc91-4f4b-8a2d-2edc7286e18e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:33.914668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f2519880-fc91-4f4b-8a2d-2edc7286e18e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:33.925712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2519880-fc91-4f4b-8a2d-2edc7286e18e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:33.926182 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2519880-fc91-4f4b-8a2d-2edc7286e18e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:33.926956 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2519880-fc91-4f4b-8a2d-2edc7286e18e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:33.927500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2519880-fc91-4f4b-8a2d-2edc7286e18e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:34.069246 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f2519880-fc91-4f4b-8a2d-2edc7286e18e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:34.078470 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f2519880-fc91-4f4b-8a2d-2edc7286e18e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1679 microversion: 2.1 time: 0.171557 Jul 20 05:27:34.079059 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3672/7578] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:33 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:35.097301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-917216c0-e4ad-44ee-b868-cba2859a6c38 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:35.098057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-917216c0-e4ad-44ee-b868-cba2859a6c38 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:35.105483 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-917216c0-e4ad-44ee-b868-cba2859a6c38 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:35.105937 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-917216c0-e4ad-44ee-b868-cba2859a6c38 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:35.106728 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-917216c0-e4ad-44ee-b868-cba2859a6c38 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:35.108191 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-917216c0-e4ad-44ee-b868-cba2859a6c38 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:35.255681 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-917216c0-e4ad-44ee-b868-cba2859a6c38 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:35.263460 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-917216c0-e4ad-44ee-b868-cba2859a6c38 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1679 microversion: 2.1 time: 0.171299 Jul 20 05:27:35.264041 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3907/7579] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:35 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:35.927389 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-fa0b7248-51b5-4f8a-b349-0cc9f131bf67 req-02f6b1a2-808f-4eaa-9f98-bbe7e499710b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d623a359-591c-4fc2-920f-e3f7267b459a", "name": "network-vif-unplugged", "status": "completed", "tag": "3e917aad-f41a-4af8-92d3-038be19eb239"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:27:35.937143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-fa0b7248-51b5-4f8a-b349-0cc9f131bf67 req-02f6b1a2-808f-4eaa-9f98-bbe7e499710b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:35.938741 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-fa0b7248-51b5-4f8a-b349-0cc9f131bf67 req-02f6b1a2-808f-4eaa-9f98-bbe7e499710b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:35.950636 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.compute.server_external_events [req-fa0b7248-51b5-4f8a-b349-0cc9f131bf67 req-02f6b1a2-808f-4eaa-9f98-bbe7e499710b service nova] Unable to find a host for instance d623a359-591c-4fc2-920f-e3f7267b459a. Dropping event network-vif-unplugged {{(pid=127870) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 05:27:35.951522 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-fa0b7248-51b5-4f8a-b349-0cc9f131bf67 req-02f6b1a2-808f-4eaa-9f98-bbe7e499710b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028231 Jul 20 05:27:35.952108 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3673/7580] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 05:27:36.284629 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9768adb0-7569-431b-a5dc-955ed93d014e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:36.285234 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9768adb0-7569-431b-a5dc-955ed93d014e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:36.292601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9768adb0-7569-431b-a5dc-955ed93d014e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:36.293046 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9768adb0-7569-431b-a5dc-955ed93d014e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:36.293805 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9768adb0-7569-431b-a5dc-955ed93d014e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:36.294267 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9768adb0-7569-431b-a5dc-955ed93d014e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:36.435771 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9768adb0-7569-431b-a5dc-955ed93d014e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:36.443945 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9768adb0-7569-431b-a5dc-955ed93d014e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1622 microversion: 2.1 time: 0.165363 Jul 20 05:27:36.444578 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3908/7581] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:36 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1622 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:36.472594 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-36db5b92-4092-4a70-a4c8-a416ebfdb3aa tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:27:36.473667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-36db5b92-4092-4a70-a4c8-a416ebfdb3aa tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:36.481733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36db5b92-4092-4a70-a4c8-a416ebfdb3aa tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:36.482199 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36db5b92-4092-4a70-a4c8-a416ebfdb3aa tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:36.482996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36db5b92-4092-4a70-a4c8-a416ebfdb3aa tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:36.483455 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36db5b92-4092-4a70-a4c8-a416ebfdb3aa tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:36.643248 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-36db5b92-4092-4a70-a4c8-a416ebfdb3aa tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "POST /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a/action" status: 202 len: 0 microversion: 2.1 time: 0.178176 Jul 20 05:27:36.644287 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3674/7582] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:27:36 2022] POST /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:27:36.652249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-254456fc-630e-442e-903a-6c3c1240e037 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:36.653123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-254456fc-630e-442e-903a-6c3c1240e037 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:36.659509 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-254456fc-630e-442e-903a-6c3c1240e037 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:36.659964 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-254456fc-630e-442e-903a-6c3c1240e037 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:36.660795 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-254456fc-630e-442e-903a-6c3c1240e037 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:36.661239 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-254456fc-630e-442e-903a-6c3c1240e037 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:36.796698 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-254456fc-630e-442e-903a-6c3c1240e037 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:36.805044 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-254456fc-630e-442e-903a-6c3c1240e037 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1630 microversion: 2.1 time: 0.156784 Jul 20 05:27:36.805860 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3909/7583] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:36 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1630 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:37.824702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1429a4f1-5f98-497c-aa3d-f8d1e1d84a99 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:37.825774 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1429a4f1-5f98-497c-aa3d-f8d1e1d84a99 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:37.835849 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1429a4f1-5f98-497c-aa3d-f8d1e1d84a99 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:37.836252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1429a4f1-5f98-497c-aa3d-f8d1e1d84a99 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:37.837073 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1429a4f1-5f98-497c-aa3d-f8d1e1d84a99 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:37.837500 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1429a4f1-5f98-497c-aa3d-f8d1e1d84a99 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:37.982715 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1429a4f1-5f98-497c-aa3d-f8d1e1d84a99 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:37.990554 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1429a4f1-5f98-497c-aa3d-f8d1e1d84a99 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1688 microversion: 2.1 time: 0.171388 Jul 20 05:27:37.991168 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3675/7584] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:37 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:38.808625 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-d9a4cbdc-c87b-4b6d-b0eb-97769f422811 req-3a6b1687-acab-40da-a43c-213396ce79b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d623a359-591c-4fc2-920f-e3f7267b459a", "tag": "3e917aad-f41a-4af8-92d3-038be19eb239"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:27:38.821708 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d9a4cbdc-c87b-4b6d-b0eb-97769f422811 req-3a6b1687-acab-40da-a43c-213396ce79b9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:38.822428 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d9a4cbdc-c87b-4b6d-b0eb-97769f422811 req-3a6b1687-acab-40da-a43c-213396ce79b9 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:38.838495 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-d9a4cbdc-c87b-4b6d-b0eb-97769f422811 req-3a6b1687-acab-40da-a43c-213396ce79b9 service nova] Creating event network-changed:3e917aad-f41a-4af8-92d3-038be19eb239 for instance d623a359-591c-4fc2-920f-e3f7267b459a on n-h2-826526-5 Jul 20 05:27:38.843962 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-d9a4cbdc-c87b-4b6d-b0eb-97769f422811 req-3a6b1687-acab-40da-a43c-213396ce79b9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040227 Jul 20 05:27:38.844819 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3910/7585] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:27:39.009004 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-604eec3b-eb28-4d87-aab0-c27993ce7756 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:39.009630 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-604eec3b-eb28-4d87-aab0-c27993ce7756 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:39.016971 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-604eec3b-eb28-4d87-aab0-c27993ce7756 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:39.017585 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-604eec3b-eb28-4d87-aab0-c27993ce7756 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:39.018783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-604eec3b-eb28-4d87-aab0-c27993ce7756 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:39.020951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-604eec3b-eb28-4d87-aab0-c27993ce7756 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:39.158823 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-604eec3b-eb28-4d87-aab0-c27993ce7756 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:39.166835 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-604eec3b-eb28-4d87-aab0-c27993ce7756 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1688 microversion: 2.1 time: 0.161831 Jul 20 05:27:39.167411 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3676/7586] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:39 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:40.185110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-35335645-5cfe-4279-9f87-dd05974d2c73 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:40.186041 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35335645-5cfe-4279-9f87-dd05974d2c73 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:40.190541 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=31 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:40.194601 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35335645-5cfe-4279-9f87-dd05974d2c73 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:40.195062 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35335645-5cfe-4279-9f87-dd05974d2c73 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:40.195894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35335645-5cfe-4279-9f87-dd05974d2c73 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:40.196358 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35335645-5cfe-4279-9f87-dd05974d2c73 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:40.199835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:40.347065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-35335645-5cfe-4279-9f87-dd05974d2c73 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:40.355831 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-35335645-5cfe-4279-9f87-dd05974d2c73 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1688 microversion: 2.1 time: 0.175034 Jul 20 05:27:40.356441 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3911/7587] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:40 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:41.375131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-232ed3e6-3280-4da0-b1f7-3f8b9404d78d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:41.376024 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-232ed3e6-3280-4da0-b1f7-3f8b9404d78d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:41.380308 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=33 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:41.387936 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-232ed3e6-3280-4da0-b1f7-3f8b9404d78d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:41.388559 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-232ed3e6-3280-4da0-b1f7-3f8b9404d78d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:41.389350 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-232ed3e6-3280-4da0-b1f7-3f8b9404d78d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:41.390011 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-232ed3e6-3280-4da0-b1f7-3f8b9404d78d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:41.394423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:41.566242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-232ed3e6-3280-4da0-b1f7-3f8b9404d78d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:41.574279 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-232ed3e6-3280-4da0-b1f7-3f8b9404d78d tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1688 microversion: 2.1 time: 0.203093 Jul 20 05:27:41.574878 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3677/7588] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:41 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1688 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:42.592894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-17464869-da5b-4d5e-bec2-c0e6e52d6ae1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:42.594756 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-17464869-da5b-4d5e-bec2-c0e6e52d6ae1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:42.604459 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17464869-da5b-4d5e-bec2-c0e6e52d6ae1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:42.605114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17464869-da5b-4d5e-bec2-c0e6e52d6ae1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:42.606077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17464869-da5b-4d5e-bec2-c0e6e52d6ae1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:42.606617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17464869-da5b-4d5e-bec2-c0e6e52d6ae1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:42.756441 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-17464869-da5b-4d5e-bec2-c0e6e52d6ae1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:42.765144 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-17464869-da5b-4d5e-bec2-c0e6e52d6ae1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1688 microversion: 2.1 time: 0.176843 Jul 20 05:27:42.765743 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3912/7589] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:42 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:43.784502 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bfb9858d-88f9-432f-8b38-461e7ea38f65 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:43.785253 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bfb9858d-88f9-432f-8b38-461e7ea38f65 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:43.792161 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bfb9858d-88f9-432f-8b38-461e7ea38f65 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:43.792653 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bfb9858d-88f9-432f-8b38-461e7ea38f65 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:43.793477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bfb9858d-88f9-432f-8b38-461e7ea38f65 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:43.793930 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bfb9858d-88f9-432f-8b38-461e7ea38f65 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:43.943639 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bfb9858d-88f9-432f-8b38-461e7ea38f65 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:43.951915 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bfb9858d-88f9-432f-8b38-461e7ea38f65 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1688 microversion: 2.1 time: 0.171842 Jul 20 05:27:43.952782 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3678/7590] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:43 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:44.969965 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-07deaa03-fd55-4acd-9a0f-57628253cc24 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:44.970540 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-07deaa03-fd55-4acd-9a0f-57628253cc24 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:44.978012 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07deaa03-fd55-4acd-9a0f-57628253cc24 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:44.978465 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07deaa03-fd55-4acd-9a0f-57628253cc24 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:44.979235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07deaa03-fd55-4acd-9a0f-57628253cc24 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:44.979673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-07deaa03-fd55-4acd-9a0f-57628253cc24 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:45.139198 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-07deaa03-fd55-4acd-9a0f-57628253cc24 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:45.147515 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-07deaa03-fd55-4acd-9a0f-57628253cc24 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1688 microversion: 2.1 time: 0.181610 Jul 20 05:27:45.148355 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3913/7591] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:44 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:46.165619 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-851ca09e-eae7-4257-a260-5ec1ef9ee1a5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:46.166597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-851ca09e-eae7-4257-a260-5ec1ef9ee1a5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:46.174180 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-851ca09e-eae7-4257-a260-5ec1ef9ee1a5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:46.174732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-851ca09e-eae7-4257-a260-5ec1ef9ee1a5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:46.175579 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-851ca09e-eae7-4257-a260-5ec1ef9ee1a5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:46.176030 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-851ca09e-eae7-4257-a260-5ec1ef9ee1a5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:46.318358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-851ca09e-eae7-4257-a260-5ec1ef9ee1a5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:46.328516 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-851ca09e-eae7-4257-a260-5ec1ef9ee1a5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1688 microversion: 2.1 time: 0.166620 Jul 20 05:27:46.341779 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3679/7592] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:46 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:47.350381 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4379f68c-ee3e-4751-bfec-6369958517b4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:47.351022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4379f68c-ee3e-4751-bfec-6369958517b4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:47.358213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4379f68c-ee3e-4751-bfec-6369958517b4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:47.358663 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4379f68c-ee3e-4751-bfec-6369958517b4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:47.359453 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4379f68c-ee3e-4751-bfec-6369958517b4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:47.359882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4379f68c-ee3e-4751-bfec-6369958517b4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:47.505932 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4379f68c-ee3e-4751-bfec-6369958517b4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:47.514040 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4379f68c-ee3e-4751-bfec-6369958517b4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1688 microversion: 2.1 time: 0.167789 Jul 20 05:27:47.514625 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3914/7593] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:47 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:48.531273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5cee5c6d-0542-424a-a2cf-78a6df2738b7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:48.531907 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5cee5c6d-0542-424a-a2cf-78a6df2738b7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:48.539908 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5cee5c6d-0542-424a-a2cf-78a6df2738b7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:48.540383 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5cee5c6d-0542-424a-a2cf-78a6df2738b7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:48.541212 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5cee5c6d-0542-424a-a2cf-78a6df2738b7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:48.541657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5cee5c6d-0542-424a-a2cf-78a6df2738b7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:48.688251 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5cee5c6d-0542-424a-a2cf-78a6df2738b7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:48.696132 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5cee5c6d-0542-424a-a2cf-78a6df2738b7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1688 microversion: 2.1 time: 0.168967 Jul 20 05:27:48.696752 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3680/7594] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:48 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:49.718563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-e4a2a208-0850-41a1-9269-5e2f998625ef tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:49.719468 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-e4a2a208-0850-41a1-9269-5e2f998625ef tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:49.731115 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4a2a208-0850-41a1-9269-5e2f998625ef tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:49.731868 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4a2a208-0850-41a1-9269-5e2f998625ef tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:49.734092 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4a2a208-0850-41a1-9269-5e2f998625ef tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:49.734832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-e4a2a208-0850-41a1-9269-5e2f998625ef tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:49.878470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-e4a2a208-0850-41a1-9269-5e2f998625ef tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:49.886835 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-e4a2a208-0850-41a1-9269-5e2f998625ef tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1688 microversion: 2.1 time: 0.174996 Jul 20 05:27:49.887417 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3915/7595] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:49 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:50.498661 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-8126a99f-3b79-4f76-8678-8c6bf0acb74e req-46eeff4c-6633-4552-8c1e-a63547228efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d623a359-591c-4fc2-920f-e3f7267b459a", "name": "network-vif-plugged", "status": "completed", "tag": "3e917aad-f41a-4af8-92d3-038be19eb239"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:27:50.509419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8126a99f-3b79-4f76-8678-8c6bf0acb74e req-46eeff4c-6633-4552-8c1e-a63547228efd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:50.509879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8126a99f-3b79-4f76-8678-8c6bf0acb74e req-46eeff4c-6633-4552-8c1e-a63547228efd service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:50.522576 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-8126a99f-3b79-4f76-8678-8c6bf0acb74e req-46eeff4c-6633-4552-8c1e-a63547228efd service nova] Creating event network-vif-plugged:3e917aad-f41a-4af8-92d3-038be19eb239 for instance d623a359-591c-4fc2-920f-e3f7267b459a on n-h2-826526-5 Jul 20 05:27:50.527844 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-8126a99f-3b79-4f76-8678-8c6bf0acb74e req-46eeff4c-6633-4552-8c1e-a63547228efd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032997 Jul 20 05:27:50.528460 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3681/7596] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:27:50.906138 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ec84df2a-cd35-4211-8699-a1b24992743a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:50.906761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ec84df2a-cd35-4211-8699-a1b24992743a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:50.914027 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec84df2a-cd35-4211-8699-a1b24992743a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:50.914480 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec84df2a-cd35-4211-8699-a1b24992743a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:50.915256 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec84df2a-cd35-4211-8699-a1b24992743a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:50.915688 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ec84df2a-cd35-4211-8699-a1b24992743a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:51.060519 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ec84df2a-cd35-4211-8699-a1b24992743a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:51.072027 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ec84df2a-cd35-4211-8699-a1b24992743a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1688 microversion: 2.1 time: 0.169774 Jul 20 05:27:51.072875 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3916/7597] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:50 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:52.091763 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5ccba63d-c84c-4b78-8efe-6af1dd9e1766 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:52.092708 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5ccba63d-c84c-4b78-8efe-6af1dd9e1766 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:52.100968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ccba63d-c84c-4b78-8efe-6af1dd9e1766 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:52.101484 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ccba63d-c84c-4b78-8efe-6af1dd9e1766 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:52.102474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ccba63d-c84c-4b78-8efe-6af1dd9e1766 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:52.102929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5ccba63d-c84c-4b78-8efe-6af1dd9e1766 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:52.244940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5ccba63d-c84c-4b78-8efe-6af1dd9e1766 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:52.254310 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5ccba63d-c84c-4b78-8efe-6af1dd9e1766 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1688 microversion: 2.1 time: 0.166904 Jul 20 05:27:52.255033 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3682/7598] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:52 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:53.276065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-061c1903-7909-4f4d-8152-4212eccda1fe tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:53.276849 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-061c1903-7909-4f4d-8152-4212eccda1fe tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:53.286525 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-061c1903-7909-4f4d-8152-4212eccda1fe tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:53.287093 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-061c1903-7909-4f4d-8152-4212eccda1fe tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:53.288051 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-061c1903-7909-4f4d-8152-4212eccda1fe tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:53.288642 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-061c1903-7909-4f4d-8152-4212eccda1fe tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:53.440397 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-061c1903-7909-4f4d-8152-4212eccda1fe tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:53.452679 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-061c1903-7909-4f4d-8152-4212eccda1fe tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1675 microversion: 2.1 time: 0.181569 Jul 20 05:27:53.453492 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3917/7599] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:53 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:06.569450 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=13 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:06.570582 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-853d4976-2b82-484e-8753-f56623289191 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:06.570999 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=41 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:06.571095 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-853d4976-2b82-484e-8753-f56623289191 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:06.574348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=11 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:06.575037 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=31 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:06.577351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-9e155c11-6421-418e-b147-203d1cb2098e req-2ad01af2-e202-4194-a27c-3f620e5fd9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d623a359-591c-4fc2-920f-e3f7267b459a", "tag": "3e917aad-f41a-4af8-92d3-038be19eb239"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:06.581590 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-853d4976-2b82-484e-8753-f56623289191 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:06.582869 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-853d4976-2b82-484e-8753-f56623289191 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:06.583000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-853d4976-2b82-484e-8753-f56623289191 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:06.583366 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-853d4976-2b82-484e-8753-f56623289191 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:06.587544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9e155c11-6421-418e-b147-203d1cb2098e req-2ad01af2-e202-4194-a27c-3f620e5fd9e7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:06.588001 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9e155c11-6421-418e-b147-203d1cb2098e req-2ad01af2-e202-4194-a27c-3f620e5fd9e7 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:06.599039 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9e155c11-6421-418e-b147-203d1cb2098e req-2ad01af2-e202-4194-a27c-3f620e5fd9e7 service nova] Creating event network-changed:3e917aad-f41a-4af8-92d3-038be19eb239 for instance d623a359-591c-4fc2-920f-e3f7267b459a on n-h2-826526-5 Jul 20 05:29:06.605476 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-9e155c11-6421-418e-b147-203d1cb2098e req-2ad01af2-e202-4194-a27c-3f620e5fd9e7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037876 Jul 20 05:29:06.606727 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3918/7600] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:29:06.614841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-853d4976-2b82-484e-8753-f56623289191 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:29:06.704861 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-853d4976-2b82-484e-8753-f56623289191 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 204 len: 0 microversion: 2.1 time: 0.138902 Jul 20 05:29:06.708353 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3683/7601] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:29:06 2022] DELETE /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:29:06.716379 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-679efc47-1847-43e8-9c57-114fcfbb8606 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:06.717104 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-679efc47-1847-43e8-9c57-114fcfbb8606 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:06.725284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-679efc47-1847-43e8-9c57-114fcfbb8606 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:06.725740 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-679efc47-1847-43e8-9c57-114fcfbb8606 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:06.726510 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-679efc47-1847-43e8-9c57-114fcfbb8606 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:06.726954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-679efc47-1847-43e8-9c57-114fcfbb8606 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:06.930165 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-679efc47-1847-43e8-9c57-114fcfbb8606 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:06.937952 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-679efc47-1847-43e8-9c57-114fcfbb8606 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1681 microversion: 2.1 time: 0.227517 Jul 20 05:29:06.938541 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3919/7602] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:06 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1681 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:07.956836 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a61d12fb-26b7-4778-8948-9e10ef0366fd tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:07.957571 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a61d12fb-26b7-4778-8948-9e10ef0366fd tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:07.965139 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a61d12fb-26b7-4778-8948-9e10ef0366fd tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:07.965618 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a61d12fb-26b7-4778-8948-9e10ef0366fd tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:07.966402 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a61d12fb-26b7-4778-8948-9e10ef0366fd tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:07.966846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a61d12fb-26b7-4778-8948-9e10ef0366fd tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:08.605716 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a61d12fb-26b7-4778-8948-9e10ef0366fd tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:08.623367 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a61d12fb-26b7-4778-8948-9e10ef0366fd tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 200 len: 1681 microversion: 2.1 time: 0.668265 Jul 20 05:29:08.623367 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3684/7603] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:07 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 1681 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:08.958591 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-a9574135-3cc8-4848-9062-f42e8ebbdb2d req-ed987e47-2459-470a-8302-00977e208a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d623a359-591c-4fc2-920f-e3f7267b459a", "name": "network-vif-deleted", "tag": "3e917aad-f41a-4af8-92d3-038be19eb239"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:08.967605 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a9574135-3cc8-4848-9062-f42e8ebbdb2d req-ed987e47-2459-470a-8302-00977e208a1e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:08.968149 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-a9574135-3cc8-4848-9062-f42e8ebbdb2d req-ed987e47-2459-470a-8302-00977e208a1e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:08.980230 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-a9574135-3cc8-4848-9062-f42e8ebbdb2d req-ed987e47-2459-470a-8302-00977e208a1e service nova] Creating event network-vif-deleted:3e917aad-f41a-4af8-92d3-038be19eb239 for instance d623a359-591c-4fc2-920f-e3f7267b459a on n-h2-826526-5 Jul 20 05:29:08.985483 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-a9574135-3cc8-4848-9062-f42e8ebbdb2d req-ed987e47-2459-470a-8302-00977e208a1e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095749 Jul 20 05:29:08.986074 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3920/7604] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:29:09.642807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1ec9fa56-56f6-47bd-85d5-258b91074ae5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:09.643720 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1ec9fa56-56f6-47bd-85d5-258b91074ae5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: d623a359-591c-4fc2-920f-e3f7267b459a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:09.654432 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ec9fa56-56f6-47bd-85d5-258b91074ae5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:09.655171 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ec9fa56-56f6-47bd-85d5-258b91074ae5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:09.656475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ec9fa56-56f6-47bd-85d5-258b91074ae5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:09.657216 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ec9fa56-56f6-47bd-85d5-258b91074ae5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:09.673456 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-1ec9fa56-56f6-47bd-85d5-258b91074ae5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] HTTP exception thrown: Instance d623a359-591c-4fc2-920f-e3f7267b459a could not be found. Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1ec9fa56-56f6-47bd-85d5-258b91074ae5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Request method failure captured: Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a HTTP/1.1 Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: Accept: application/json Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: Accept-Encoding: identity Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: Connection: close Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: Content-Length: 0 Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: Content-Type: application/json Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: Host: 10.222.0.17 Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: Openstack-System-Scope: None Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.9 Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-Auth-Token: gAAAAABi15GoCF7rsf8_ethgfhsUkS7ZPhz4KNygJGQ52GD0ImvxlotWonMqsHCqdORHwLSWV48Hl2TLQzS7S1n2aGPzOYWEtksGjcqcc19eOEpQqqBOwtl5eU02jzlsyAC3mo4ZsYS5VcTDnxwGtF0_DAkntTMoI8EXejGhtaGrt_Y0zdSB7co Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Id: None Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-Domain-Name: None Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-Identity-Status: Confirmed Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-Is-Admin-Project: True Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Id: default Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Domain-Name: Default Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Id: 648abb554ebf439fb69d231109a1249d Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-Project-Name: tempest-TestShelveInstance-1243929517 Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-Role: reader,member Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-Roles: reader,member Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/648abb554ebf439fb69d231109a1249d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/648abb554ebf439fb69d231109a1249d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_648abb554ebf439fb69d231109a1249d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/648abb554ebf439fb69d231109a1249d"}]}] Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant: tempest-TestShelveInstance-1243929517 Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Id: 648abb554ebf439fb69d231109a1249d Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestShelveInstance-1243929517 Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-User: tempest-TestShelveInstance-1243929517-project Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Id: default Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-User-Domain-Name: Default Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-User-Id: 4e8f0227fab542549209162a4dde421a Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: X-User-Name: tempest-TestShelveInstance-1243929517-project Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: method: > Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: exception: Instance d623a359-591c-4fc2-920f-e3f7267b459a could not be found. Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: action_args: {'id': 'd623a359-591c-4fc2-920f-e3f7267b459a'} Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d623a359-591c-4fc2-920f-e3f7267b459a could not be found. Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d623a359-591c-4fc2-920f-e3f7267b459a could not be found. Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:29:09.675165 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:29:09.680345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:29:09.680345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:29:09.680345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:29:09.680345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:29:09.680345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:29:09.680345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d623a359-591c-4fc2-920f-e3f7267b459a could not be found. Jul 20 05:29:09.680345 n-d-826526-5 devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Jul 20 05:29:09.680345 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1ec9fa56-56f6-47bd-85d5-258b91074ae5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Returning 404 to user: Instance d623a359-591c-4fc2-920f-e3f7267b459a could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:29:09.680345 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1ec9fa56-56f6-47bd-85d5-258b91074ae5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a" status: 404 len: 111 microversion: 2.1 time: 0.040533 Jul 20 05:29:09.680345 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3685/7605] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:09 2022] GET /compute/v2.1/servers/d623a359-591c-4fc2-920f-e3f7267b459a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:29:09.853956 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-c963a52d-4ac8-45d5-85e3-946eb64bd183 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '.version_select at 0x7f06bcb18160>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:09.883318 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-c963a52d-4ac8-45d5-85e3-946eb64bd183 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1379504059" status: 202 len: 0 microversion: 2.1 time: 0.033686 Jul 20 05:29:09.884173 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3921/7606] 10.222.0.17 () {58 vars in 1253 bytes} [Wed Jul 20 05:29:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1379504059 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:29:09.906047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5aab0736-b5d1-4511-ac3c-bb74d1f4482c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Action: 'create', calling method: .version_select at 0x7f06bc2e05e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1914910317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeifxy7u7zm11fQ2p/Fx6Go0y5/GZ7Q3x2Q18IdzFnrfB5WDNbotKxAmZlyKrWEWf/UuyZB3oJiFcDO39MEGzq07Lo8DPUF6gyQh6iZ5WS0CaimsZ767/l6DcuDPpq9iA=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:09.920714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-5aab0736-b5d1-4511-ac3c-bb74d1f4482c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Getting quotas for project 648abb554ebf439fb69d231109a1249d. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:29:09.926175 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-5aab0736-b5d1-4511-ac3c-bb74d1f4482c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Getting quotas for user 4e8f0227fab542549209162a4dde421a and project 648abb554ebf439fb69d231109a1249d. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:29:09.954919 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5aab0736-b5d1-4511-ac3c-bb74d1f4482c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.052570 Jul 20 05:29:09.955724 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3686/7607] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 05:29:09 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:29:27.304163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=10 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:27.304970 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:27.309286 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-05624d6f-fa85-45d4-9aa9-de786e86d77e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1801097329", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1914910317", "security_groups": [{"name": "tempest-secgroup-smoke-1816862428"}], "networks": [{"uuid": "13029c59-f4b0-4f85-b7af-66e433cb999f"}], "block_device_mapping_v2": [{"uuid": "6b06cd9e-c554-4de3-afbb-1ec211a5779a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:27.438197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-05624d6f-fa85-45d4-9aa9-de786e86d77e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] validate_networks() for [('13029c59-f4b0-4f85-b7af-66e433cb999f', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:29:27.893894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-05624d6f-fa85-45d4-9aa9-de786e86d77e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:29:27.894344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-05624d6f-fa85-45d4-9aa9-de786e86d77e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:29:27.894828 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-05624d6f-fa85-45d4-9aa9-de786e86d77e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:29:27.895351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-05624d6f-fa85-45d4-9aa9-de786e86d77e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:29:27.895913 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-05624d6f-fa85-45d4-9aa9-de786e86d77e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:29:27.908048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-05624d6f-fa85-45d4-9aa9-de786e86d77e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:27.908706 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-05624d6f-fa85-45d4-9aa9-de786e86d77e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:27.909576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-05624d6f-fa85-45d4-9aa9-de786e86d77e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:27.910016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-05624d6f-fa85-45d4-9aa9-de786e86d77e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:27.928037 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-05624d6f-fa85-45d4-9aa9-de786e86d77e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Getting quotas for project 648abb554ebf439fb69d231109a1249d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:29:27.933644 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-05624d6f-fa85-45d4-9aa9-de786e86d77e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Getting quotas for user 4e8f0227fab542549209162a4dde421a and project 648abb554ebf439fb69d231109a1249d. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:29:27.995120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-05624d6f-fa85-45d4-9aa9-de786e86d77e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:29:27.997495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-05624d6f-fa85-45d4-9aa9-de786e86d77e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b06cd9e-c554-4de3-afbb-1ec211a5779a',volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:29:28.135140 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-05624d6f-fa85-45d4-9aa9-de786e86d77e tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.832920 Jul 20 05:29:28.135797 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3922/7608] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:29:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:29:28.144434 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:28.145126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:28.146121 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:28.150671 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-98c4ee90-b888-43bb-8648-c78e57c26249 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:28.151312 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-98c4ee90-b888-43bb-8648-c78e57c26249 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:28.213810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-98c4ee90-b888-43bb-8648-c78e57c26249 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:28.221204 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-98c4ee90-b888-43bb-8648-c78e57c26249 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1089 microversion: 2.1 time: 0.078815 Jul 20 05:29:28.221787 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3687/7609] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:28 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1089 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:29.239930 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-b5fe3632-ec88-492a-a42f-d98b67bdb98b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:29.240770 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-b5fe3632-ec88-492a-a42f-d98b67bdb98b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:29.249509 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5fe3632-ec88-492a-a42f-d98b67bdb98b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:29.250206 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5fe3632-ec88-492a-a42f-d98b67bdb98b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:29.251274 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5fe3632-ec88-492a-a42f-d98b67bdb98b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:29.251718 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-b5fe3632-ec88-492a-a42f-d98b67bdb98b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:29.354986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-b5fe3632-ec88-492a-a42f-d98b67bdb98b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:29.364233 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-b5fe3632-ec88-492a-a42f-d98b67bdb98b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1205 microversion: 2.1 time: 0.129236 Jul 20 05:29:29.365294 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3923/7610] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:29 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1205 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:30.382824 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-daf7026c-a3ac-42f0-a06e-23def6ef75c5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:30.383412 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-daf7026c-a3ac-42f0-a06e-23def6ef75c5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:30.390880 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-daf7026c-a3ac-42f0-a06e-23def6ef75c5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:30.391354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-daf7026c-a3ac-42f0-a06e-23def6ef75c5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:30.392147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-daf7026c-a3ac-42f0-a06e-23def6ef75c5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:30.392616 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-daf7026c-a3ac-42f0-a06e-23def6ef75c5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:30.553702 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-daf7026c-a3ac-42f0-a06e-23def6ef75c5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:30.563510 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-daf7026c-a3ac-42f0-a06e-23def6ef75c5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1273 microversion: 2.1 time: 0.184923 Jul 20 05:29:30.566241 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3688/7611] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:30 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:30.732238 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-278303d2-ff22-46e8-8d2c-a57941b59346 req-a80ccc86-0ddc-45f5-abc8-4e3613c23905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "798784e6-c885-4301-b640-2851477dfb5f", "tag": "954d9c0e-53e5-46fc-a277-03e2362bbc2c"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:30.744500 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-278303d2-ff22-46e8-8d2c-a57941b59346 req-a80ccc86-0ddc-45f5-abc8-4e3613c23905 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:30.745432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-278303d2-ff22-46e8-8d2c-a57941b59346 req-a80ccc86-0ddc-45f5-abc8-4e3613c23905 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:30.768197 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-278303d2-ff22-46e8-8d2c-a57941b59346 req-a80ccc86-0ddc-45f5-abc8-4e3613c23905 service nova] Creating event network-changed:954d9c0e-53e5-46fc-a277-03e2362bbc2c for instance 798784e6-c885-4301-b640-2851477dfb5f on n-h1-826526-5 Jul 20 05:29:30.774504 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-278303d2-ff22-46e8-8d2c-a57941b59346 req-a80ccc86-0ddc-45f5-abc8-4e3613c23905 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047169 Jul 20 05:29:30.775675 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3924/7612] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:29:31.583060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a1241f0d-e705-4be8-a8b4-e5793542e3bb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:31.583932 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a1241f0d-e705-4be8-a8b4-e5793542e3bb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:31.592446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1241f0d-e705-4be8-a8b4-e5793542e3bb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:31.593997 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1241f0d-e705-4be8-a8b4-e5793542e3bb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:31.594931 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1241f0d-e705-4be8-a8b4-e5793542e3bb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:31.595480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1241f0d-e705-4be8-a8b4-e5793542e3bb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:31.764596 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a1241f0d-e705-4be8-a8b4-e5793542e3bb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:31.772648 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a1241f0d-e705-4be8-a8b4-e5793542e3bb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1273 microversion: 2.1 time: 0.193922 Jul 20 05:29:31.773242 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3689/7613] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:31 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:32.791056 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-424744df-23f3-4740-abe1-9254a3aaf3b8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:32.791702 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-424744df-23f3-4740-abe1-9254a3aaf3b8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:32.799384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-424744df-23f3-4740-abe1-9254a3aaf3b8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:32.799838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-424744df-23f3-4740-abe1-9254a3aaf3b8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:32.800665 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-424744df-23f3-4740-abe1-9254a3aaf3b8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:32.801133 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-424744df-23f3-4740-abe1-9254a3aaf3b8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:32.944153 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-424744df-23f3-4740-abe1-9254a3aaf3b8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:32.953791 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-424744df-23f3-4740-abe1-9254a3aaf3b8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1273 microversion: 2.1 time: 0.167080 Jul 20 05:29:32.954362 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3925/7614] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:32 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:33.975691 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e6a000de-1156-4488-8c09-297503762b49 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:33.976321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e6a000de-1156-4488-8c09-297503762b49 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:33.984996 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6a000de-1156-4488-8c09-297503762b49 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:33.985641 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6a000de-1156-4488-8c09-297503762b49 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:33.986476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6a000de-1156-4488-8c09-297503762b49 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:33.986922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6a000de-1156-4488-8c09-297503762b49 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:34.151994 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e6a000de-1156-4488-8c09-297503762b49 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:34.161777 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e6a000de-1156-4488-8c09-297503762b49 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1273 microversion: 2.1 time: 0.190324 Jul 20 05:29:34.162382 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3690/7615] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:33 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:35.183394 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-903c9dbc-c20e-44df-975f-0c79a8affbca tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:35.184366 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-903c9dbc-c20e-44df-975f-0c79a8affbca tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:35.193076 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-903c9dbc-c20e-44df-975f-0c79a8affbca tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:35.193497 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-903c9dbc-c20e-44df-975f-0c79a8affbca tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:35.194285 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-903c9dbc-c20e-44df-975f-0c79a8affbca tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:35.194716 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-903c9dbc-c20e-44df-975f-0c79a8affbca tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:35.335821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-903c9dbc-c20e-44df-975f-0c79a8affbca tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:35.345880 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-903c9dbc-c20e-44df-975f-0c79a8affbca tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1261 microversion: 2.1 time: 0.169281 Jul 20 05:29:35.346462 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3926/7616] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:35 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:36.370178 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-807cc7f5-20a7-4d7f-a2dc-777345c8285a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:36.370969 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-807cc7f5-20a7-4d7f-a2dc-777345c8285a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:36.380196 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-807cc7f5-20a7-4d7f-a2dc-777345c8285a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:36.380816 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-807cc7f5-20a7-4d7f-a2dc-777345c8285a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:36.381795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-807cc7f5-20a7-4d7f-a2dc-777345c8285a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:36.382729 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-807cc7f5-20a7-4d7f-a2dc-777345c8285a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:36.527435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-807cc7f5-20a7-4d7f-a2dc-777345c8285a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:36.536077 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-807cc7f5-20a7-4d7f-a2dc-777345c8285a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1261 microversion: 2.1 time: 0.170922 Jul 20 05:29:36.536736 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3691/7617] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:36 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:37.554697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-7c895ed2-6826-424f-a82a-f4c6f7834d97 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:37.556029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-7c895ed2-6826-424f-a82a-f4c6f7834d97 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:37.564422 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c895ed2-6826-424f-a82a-f4c6f7834d97 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:37.564877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c895ed2-6826-424f-a82a-f4c6f7834d97 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:37.565670 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c895ed2-6826-424f-a82a-f4c6f7834d97 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:37.566102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-7c895ed2-6826-424f-a82a-f4c6f7834d97 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:37.714249 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-7c895ed2-6826-424f-a82a-f4c6f7834d97 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:37.725042 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-7c895ed2-6826-424f-a82a-f4c6f7834d97 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1261 microversion: 2.1 time: 0.174703 Jul 20 05:29:37.725753 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3927/7618] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:37 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:38.748473 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c0966a2a-5cf8-400e-922d-1d0f6e9ec04b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:38.749446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c0966a2a-5cf8-400e-922d-1d0f6e9ec04b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:38.753370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:38.759457 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0966a2a-5cf8-400e-922d-1d0f6e9ec04b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:38.759921 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0966a2a-5cf8-400e-922d-1d0f6e9ec04b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:38.760737 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0966a2a-5cf8-400e-922d-1d0f6e9ec04b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:38.761188 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0966a2a-5cf8-400e-922d-1d0f6e9ec04b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:38.905091 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c0966a2a-5cf8-400e-922d-1d0f6e9ec04b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:38.913012 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c0966a2a-5cf8-400e-922d-1d0f6e9ec04b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1261 microversion: 2.1 time: 0.171096 Jul 20 05:29:38.913580 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3692/7619] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:38 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:39.931790 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-35d6e601-7fbb-4ab4-a645-8dfa23f02f1a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:39.933402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-35d6e601-7fbb-4ab4-a645-8dfa23f02f1a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:39.934927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:39.935690 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:39.943095 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35d6e601-7fbb-4ab4-a645-8dfa23f02f1a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:39.943542 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35d6e601-7fbb-4ab4-a645-8dfa23f02f1a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:39.944333 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35d6e601-7fbb-4ab4-a645-8dfa23f02f1a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:39.944783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-35d6e601-7fbb-4ab4-a645-8dfa23f02f1a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:40.098923 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-35d6e601-7fbb-4ab4-a645-8dfa23f02f1a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:40.106801 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-35d6e601-7fbb-4ab4-a645-8dfa23f02f1a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1261 microversion: 2.1 time: 0.179510 Jul 20 05:29:40.107374 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3928/7620] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:39 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:29:41.128143 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-63d96786-e275-4839-9509-e126fab35e84 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:41.128879 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-63d96786-e275-4839-9509-e126fab35e84 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:41.136679 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63d96786-e275-4839-9509-e126fab35e84 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:41.137142 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63d96786-e275-4839-9509-e126fab35e84 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:41.137927 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63d96786-e275-4839-9509-e126fab35e84 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:41.138374 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63d96786-e275-4839-9509-e126fab35e84 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:41.275548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-63d96786-e275-4839-9509-e126fab35e84 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:41.286394 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-63d96786-e275-4839-9509-e126fab35e84 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1261 microversion: 2.1 time: 0.164372 Jul 20 05:29:41.286979 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3693/7621] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:41 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:42.308140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-adc52983-3ac0-4ac1-8fc0-38730bbcf11b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:42.309044 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-adc52983-3ac0-4ac1-8fc0-38730bbcf11b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:42.316435 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adc52983-3ac0-4ac1-8fc0-38730bbcf11b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:42.316935 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adc52983-3ac0-4ac1-8fc0-38730bbcf11b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:42.317759 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adc52983-3ac0-4ac1-8fc0-38730bbcf11b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:42.318233 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-adc52983-3ac0-4ac1-8fc0-38730bbcf11b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:42.455413 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-adc52983-3ac0-4ac1-8fc0-38730bbcf11b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:42.463939 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-adc52983-3ac0-4ac1-8fc0-38730bbcf11b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1261 microversion: 2.1 time: 0.160342 Jul 20 05:29:42.464570 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3929/7622] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:42 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:43.480847 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-58736210-6491-4a35-83f9-feb15c4cd67b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:43.481501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-58736210-6491-4a35-83f9-feb15c4cd67b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:43.489040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58736210-6491-4a35-83f9-feb15c4cd67b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:43.489809 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58736210-6491-4a35-83f9-feb15c4cd67b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:43.490393 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58736210-6491-4a35-83f9-feb15c4cd67b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:43.490751 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58736210-6491-4a35-83f9-feb15c4cd67b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:43.642152 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-58736210-6491-4a35-83f9-feb15c4cd67b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:43.650573 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-58736210-6491-4a35-83f9-feb15c4cd67b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1261 microversion: 2.1 time: 0.173707 Jul 20 05:29:43.651161 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3694/7623] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:43 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:44.606582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-abd973b3-f447-4d4a-8ee4-688486700f7f req-8cfdfa96-9420-452d-81a0-d062184bd77b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "798784e6-c885-4301-b640-2851477dfb5f", "name": "network-vif-plugged", "status": "completed", "tag": "954d9c0e-53e5-46fc-a277-03e2362bbc2c"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:44.616951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-abd973b3-f447-4d4a-8ee4-688486700f7f req-8cfdfa96-9420-452d-81a0-d062184bd77b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:44.617434 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-abd973b3-f447-4d4a-8ee4-688486700f7f req-8cfdfa96-9420-452d-81a0-d062184bd77b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:44.630049 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-abd973b3-f447-4d4a-8ee4-688486700f7f req-8cfdfa96-9420-452d-81a0-d062184bd77b service nova] Creating event network-vif-plugged:954d9c0e-53e5-46fc-a277-03e2362bbc2c for instance 798784e6-c885-4301-b640-2851477dfb5f on n-h1-826526-5 Jul 20 05:29:44.635605 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-abd973b3-f447-4d4a-8ee4-688486700f7f req-8cfdfa96-9420-452d-81a0-d062184bd77b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032856 Jul 20 05:29:44.636216 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3930/7624] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:29:44.669790 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f433fb54-2c4e-4731-90a9-b881abef87bb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:44.670413 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f433fb54-2c4e-4731-90a9-b881abef87bb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:44.678958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f433fb54-2c4e-4731-90a9-b881abef87bb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:44.679430 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f433fb54-2c4e-4731-90a9-b881abef87bb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:44.680231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f433fb54-2c4e-4731-90a9-b881abef87bb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:44.680712 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f433fb54-2c4e-4731-90a9-b881abef87bb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:44.817968 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f433fb54-2c4e-4731-90a9-b881abef87bb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:44.826191 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f433fb54-2c4e-4731-90a9-b881abef87bb tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1261 microversion: 2.1 time: 0.161968 Jul 20 05:29:44.826758 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3695/7625] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:44 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:45.845081 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-83ca9ca0-23cb-481f-a6b7-03181f23f9cc tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:45.845810 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-83ca9ca0-23cb-481f-a6b7-03181f23f9cc tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:45.852229 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83ca9ca0-23cb-481f-a6b7-03181f23f9cc tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:45.852707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83ca9ca0-23cb-481f-a6b7-03181f23f9cc tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:45.853471 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83ca9ca0-23cb-481f-a6b7-03181f23f9cc tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:45.854559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-83ca9ca0-23cb-481f-a6b7-03181f23f9cc tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:46.008816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-83ca9ca0-23cb-481f-a6b7-03181f23f9cc tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:46.020829 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-83ca9ca0-23cb-481f-a6b7-03181f23f9cc tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1445 microversion: 2.1 time: 0.180911 Jul 20 05:29:46.021411 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3931/7626] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:45 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1445 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:46.037262 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5120f4a1-96ff-4664-826f-f398484a69da tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:46.037883 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5120f4a1-96ff-4664-826f-f398484a69da tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:46.045244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5120f4a1-96ff-4664-826f-f398484a69da tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:46.045701 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5120f4a1-96ff-4664-826f-f398484a69da tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:46.046469 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5120f4a1-96ff-4664-826f-f398484a69da tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:46.046913 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5120f4a1-96ff-4664-826f-f398484a69da tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:46.187925 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-5120f4a1-96ff-4664-826f-f398484a69da tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:46.196185 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5120f4a1-96ff-4664-826f-f398484a69da tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1445 microversion: 2.1 time: 0.163001 Jul 20 05:29:46.196802 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3696/7627] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:46 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1445 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:47.898451 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-2a11bac1-6319-442a-adf3-2b2b61d08022 req-1dcd750c-5bc2-4dee-a95d-4f2fbdf97ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "798784e6-c885-4301-b640-2851477dfb5f", "tag": "954d9c0e-53e5-46fc-a277-03e2362bbc2c"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:47.907697 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-2a11bac1-6319-442a-adf3-2b2b61d08022 req-1dcd750c-5bc2-4dee-a95d-4f2fbdf97ff2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:47.908147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-2a11bac1-6319-442a-adf3-2b2b61d08022 req-1dcd750c-5bc2-4dee-a95d-4f2fbdf97ff2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:47.920250 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-2a11bac1-6319-442a-adf3-2b2b61d08022 req-1dcd750c-5bc2-4dee-a95d-4f2fbdf97ff2 service nova] Creating event network-changed:954d9c0e-53e5-46fc-a277-03e2362bbc2c for instance 798784e6-c885-4301-b640-2851477dfb5f on n-h1-826526-5 Jul 20 05:29:47.925804 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-2a11bac1-6319-442a-adf3-2b2b61d08022 req-1dcd750c-5bc2-4dee-a95d-4f2fbdf97ff2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031088 Jul 20 05:29:47.926417 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3932/7628] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:30:35.329584 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:30:35.330575 n-d-826526-5 devstack@n-api.service[127870]: Wed Jul 20 05:30:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:31:45.208690 n-d-826526-5 devstack@n-api.service[127870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [56c2cea1-3165-4980-b3a4-cf0ea167ce39] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:31:45.209733 n-d-826526-5 devstack@n-api.service[127870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b840de8d-74a7-4811-99d3-e95c689ad04d] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:31:45.210321 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=22 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:31:45.211089 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=54 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:31:45.272623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-546fc92b-f9e7-4481-905b-7bf3f57e8765 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:31:45.273222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-546fc92b-f9e7-4481-905b-7bf3f57e8765 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:45.279651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-546fc92b-f9e7-4481-905b-7bf3f57e8765 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:45.280117 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-546fc92b-f9e7-4481-905b-7bf3f57e8765 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:45.280970 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-546fc92b-f9e7-4481-905b-7bf3f57e8765 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:45.281380 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-546fc92b-f9e7-4481-905b-7bf3f57e8765 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:45.305314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-546fc92b-f9e7-4481-905b-7bf3f57e8765 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lazy-loading 'flavor' on Instance uuid 798784e6-c885-4301-b640-2851477dfb5f {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:31:45.394551 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-546fc92b-f9e7-4481-905b-7bf3f57e8765 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "POST /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f/action" status: 202 len: 0 microversion: 2.1 time: 0.187623 Jul 20 05:31:45.395678 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3697/7629] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:31:45 2022] POST /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:31:45.403006 n-d-826526-5 devstack@n-api.service[127871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [18f52317-25d4-47c7-8a42-88d448614a79] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:31:45.407251 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1e2cdcf6-4243-4368-b423-f4e37fee34e5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:45.408016 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1e2cdcf6-4243-4368-b423-f4e37fee34e5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:45.410663 n-d-826526-5 devstack@n-api.service[127871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82756c74-7ff1-4946-aaad-2fa7aa912700] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:31:45.411311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:31:45.412007 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=50 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:31:45.419533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e2cdcf6-4243-4368-b423-f4e37fee34e5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:45.419979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e2cdcf6-4243-4368-b423-f4e37fee34e5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:45.420821 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e2cdcf6-4243-4368-b423-f4e37fee34e5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:45.421317 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1e2cdcf6-4243-4368-b423-f4e37fee34e5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:45.573969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1e2cdcf6-4243-4368-b423-f4e37fee34e5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:45.582309 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1e2cdcf6-4243-4368-b423-f4e37fee34e5 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1570 microversion: 2.1 time: 0.182561 Jul 20 05:31:45.582899 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3933/7630] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:45 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:46.603176 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d99eb120-1b69-4e58-b862-201a85c63382 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:46.603843 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d99eb120-1b69-4e58-b862-201a85c63382 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:46.614217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d99eb120-1b69-4e58-b862-201a85c63382 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:46.614697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d99eb120-1b69-4e58-b862-201a85c63382 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:46.615488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d99eb120-1b69-4e58-b862-201a85c63382 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:46.615935 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d99eb120-1b69-4e58-b862-201a85c63382 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:46.624799 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] [b840de8d-74a7-4811-99d3-e95c689ad04d] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 41358. Jul 20 05:31:46.624799 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] [56c2cea1-3165-4980-b3a4-cf0ea167ce39] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 41356. Jul 20 05:31:46.776677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d99eb120-1b69-4e58-b862-201a85c63382 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:46.785048 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d99eb120-1b69-4e58-b862-201a85c63382 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1570 microversion: 2.1 time: 0.188148 Jul 20 05:31:46.785650 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3698/7631] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:46 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1570 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:47.803046 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-585cfd56-ce23-4413-a549-19dc7916507c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:47.803703 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-585cfd56-ce23-4413-a549-19dc7916507c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:47.813215 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-585cfd56-ce23-4413-a549-19dc7916507c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:47.813645 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-585cfd56-ce23-4413-a549-19dc7916507c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:47.814560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-585cfd56-ce23-4413-a549-19dc7916507c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:47.814990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-585cfd56-ce23-4413-a549-19dc7916507c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:47.832131 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] [18f52317-25d4-47c7-8a42-88d448614a79] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 41364. Jul 20 05:31:47.832870 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] [82756c74-7ff1-4946-aaad-2fa7aa912700] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 41366. Jul 20 05:31:47.952727 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-585cfd56-ce23-4413-a549-19dc7916507c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:47.961097 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-585cfd56-ce23-4413-a549-19dc7916507c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1570 microversion: 2.1 time: 0.162195 Jul 20 05:31:47.961682 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3934/7632] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:47 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:48.979387 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-803073b8-c4f0-40e8-8c81-e58651dbb48f tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:48.979976 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-803073b8-c4f0-40e8-8c81-e58651dbb48f tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:48.987522 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-803073b8-c4f0-40e8-8c81-e58651dbb48f tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:48.987986 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-803073b8-c4f0-40e8-8c81-e58651dbb48f tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:48.988802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-803073b8-c4f0-40e8-8c81-e58651dbb48f tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:48.989252 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-803073b8-c4f0-40e8-8c81-e58651dbb48f tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:49.126115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-803073b8-c4f0-40e8-8c81-e58651dbb48f tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:49.134440 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-803073b8-c4f0-40e8-8c81-e58651dbb48f tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1570 microversion: 2.1 time: 0.159339 Jul 20 05:31:49.134994 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3699/7633] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:48 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:50.158448 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0ca3603e-310f-4e62-93bc-87353c32398a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:50.159225 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0ca3603e-310f-4e62-93bc-87353c32398a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:50.169395 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ca3603e-310f-4e62-93bc-87353c32398a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:50.169920 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ca3603e-310f-4e62-93bc-87353c32398a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:50.170938 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ca3603e-310f-4e62-93bc-87353c32398a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:50.171518 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0ca3603e-310f-4e62-93bc-87353c32398a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:50.320038 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0ca3603e-310f-4e62-93bc-87353c32398a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:50.332142 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0ca3603e-310f-4e62-93bc-87353c32398a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1570 microversion: 2.1 time: 0.178766 Jul 20 05:31:50.332769 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3935/7634] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:50 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:51.351131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-40ed6050-2058-4cc3-b1dd-d8d67efe10f7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:51.351732 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-40ed6050-2058-4cc3-b1dd-d8d67efe10f7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:51.359309 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40ed6050-2058-4cc3-b1dd-d8d67efe10f7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:51.359773 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40ed6050-2058-4cc3-b1dd-d8d67efe10f7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:51.360592 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40ed6050-2058-4cc3-b1dd-d8d67efe10f7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:51.361044 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40ed6050-2058-4cc3-b1dd-d8d67efe10f7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:51.500501 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-40ed6050-2058-4cc3-b1dd-d8d67efe10f7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:51.509384 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-40ed6050-2058-4cc3-b1dd-d8d67efe10f7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1570 microversion: 2.1 time: 0.163064 Jul 20 05:31:51.509972 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3700/7635] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:51 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:52.528388 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ab85d444-f604-49ad-b60b-5c80b637c1cf tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:52.528960 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ab85d444-f604-49ad-b60b-5c80b637c1cf tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:52.536330 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab85d444-f604-49ad-b60b-5c80b637c1cf tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:52.536815 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab85d444-f604-49ad-b60b-5c80b637c1cf tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:52.537561 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab85d444-f604-49ad-b60b-5c80b637c1cf tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:52.538029 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ab85d444-f604-49ad-b60b-5c80b637c1cf tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:52.681216 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ab85d444-f604-49ad-b60b-5c80b637c1cf tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:52.689835 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ab85d444-f604-49ad-b60b-5c80b637c1cf tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1570 microversion: 2.1 time: 0.165646 Jul 20 05:31:52.690400 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3936/7636] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:52 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:53.707692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f2316bef-cd01-4e89-b8b7-4324a3a803d1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:53.708365 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f2316bef-cd01-4e89-b8b7-4324a3a803d1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:53.715985 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2316bef-cd01-4e89-b8b7-4324a3a803d1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:53.716488 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2316bef-cd01-4e89-b8b7-4324a3a803d1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:53.717283 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2316bef-cd01-4e89-b8b7-4324a3a803d1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:53.717747 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2316bef-cd01-4e89-b8b7-4324a3a803d1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:53.862629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f2316bef-cd01-4e89-b8b7-4324a3a803d1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:53.870923 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f2316bef-cd01-4e89-b8b7-4324a3a803d1 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1570 microversion: 2.1 time: 0.167350 Jul 20 05:31:53.871508 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3701/7637] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:53 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:54.892707 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ffde7ada-e1e1-4c03-a334-a65ea4fbc0db tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:54.893344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ffde7ada-e1e1-4c03-a334-a65ea4fbc0db tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:54.900865 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffde7ada-e1e1-4c03-a334-a65ea4fbc0db tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:54.902120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffde7ada-e1e1-4c03-a334-a65ea4fbc0db tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:54.902120 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffde7ada-e1e1-4c03-a334-a65ea4fbc0db tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:54.902527 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffde7ada-e1e1-4c03-a334-a65ea4fbc0db tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:55.049287 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ffde7ada-e1e1-4c03-a334-a65ea4fbc0db tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:55.060688 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ffde7ada-e1e1-4c03-a334-a65ea4fbc0db tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1570 microversion: 2.1 time: 0.172244 Jul 20 05:31:55.061261 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3937/7638] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:54 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:56.078910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a8a3ee33-e952-4ee3-8c13-22000d5e07e0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:56.079535 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a8a3ee33-e952-4ee3-8c13-22000d5e07e0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:56.087471 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8a3ee33-e952-4ee3-8c13-22000d5e07e0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:56.087945 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8a3ee33-e952-4ee3-8c13-22000d5e07e0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:56.088772 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8a3ee33-e952-4ee3-8c13-22000d5e07e0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:56.089192 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8a3ee33-e952-4ee3-8c13-22000d5e07e0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:56.231320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-a8a3ee33-e952-4ee3-8c13-22000d5e07e0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:56.239271 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a8a3ee33-e952-4ee3-8c13-22000d5e07e0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1570 microversion: 2.1 time: 0.164545 Jul 20 05:31:56.239904 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3702/7639] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:56 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:57.257170 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-dfeb0ab5-d8ce-4dc5-a970-b7af2cd6ca6b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:57.257769 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-dfeb0ab5-d8ce-4dc5-a970-b7af2cd6ca6b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:57.265692 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dfeb0ab5-d8ce-4dc5-a970-b7af2cd6ca6b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:57.266144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dfeb0ab5-d8ce-4dc5-a970-b7af2cd6ca6b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:57.266925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dfeb0ab5-d8ce-4dc5-a970-b7af2cd6ca6b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:57.267363 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-dfeb0ab5-d8ce-4dc5-a970-b7af2cd6ca6b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:57.407292 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-dfeb0ab5-d8ce-4dc5-a970-b7af2cd6ca6b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:57.415778 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-dfeb0ab5-d8ce-4dc5-a970-b7af2cd6ca6b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1570 microversion: 2.1 time: 0.162676 Jul 20 05:31:57.416398 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3938/7640] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:57 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:58.433840 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-61c64417-dd5b-4d33-9ed7-210319e509ad tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:58.434477 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-61c64417-dd5b-4d33-9ed7-210319e509ad tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:58.441949 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61c64417-dd5b-4d33-9ed7-210319e509ad tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:58.442419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61c64417-dd5b-4d33-9ed7-210319e509ad tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:58.443183 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61c64417-dd5b-4d33-9ed7-210319e509ad tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:58.443633 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61c64417-dd5b-4d33-9ed7-210319e509ad tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:58.613239 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-61c64417-dd5b-4d33-9ed7-210319e509ad tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:58.626018 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-61c64417-dd5b-4d33-9ed7-210319e509ad tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1570 microversion: 2.1 time: 0.196121 Jul 20 05:31:58.626755 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3703/7641] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:58 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1570 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:59.644166 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-80850496-9a4d-4d78-b2ca-74bda20432f9 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:59.644818 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-80850496-9a4d-4d78-b2ca-74bda20432f9 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:59.652065 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-80850496-9a4d-4d78-b2ca-74bda20432f9 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:59.652550 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-80850496-9a4d-4d78-b2ca-74bda20432f9 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:59.653311 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-80850496-9a4d-4d78-b2ca-74bda20432f9 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:59.653739 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-80850496-9a4d-4d78-b2ca-74bda20432f9 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:00.099121 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-80850496-9a4d-4d78-b2ca-74bda20432f9 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:00.107171 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-80850496-9a4d-4d78-b2ca-74bda20432f9 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1571 microversion: 2.1 time: 0.467216 Jul 20 05:32:00.107753 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3939/7642] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:59 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1571 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:00.124147 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-57a50b9c-ad7e-43c0-a050-2b5cf8f05489 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:00.124750 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-57a50b9c-ad7e-43c0-a050-2b5cf8f05489 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:00.132423 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57a50b9c-ad7e-43c0-a050-2b5cf8f05489 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:00.132885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57a50b9c-ad7e-43c0-a050-2b5cf8f05489 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:00.133718 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57a50b9c-ad7e-43c0-a050-2b5cf8f05489 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:00.134169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-57a50b9c-ad7e-43c0-a050-2b5cf8f05489 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:00.222637 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-57a50b9c-ad7e-43c0-a050-2b5cf8f05489 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "POST /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f/action" status: 202 len: 0 microversion: 2.1 time: 0.102599 Jul 20 05:32:00.223630 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3704/7643] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:32:00 2022] POST /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:32:00.232057 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3aef5513-76b0-45b5-a698-c679e38797a4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:00.232694 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3aef5513-76b0-45b5-a698-c679e38797a4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:00.239144 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3aef5513-76b0-45b5-a698-c679e38797a4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:00.239734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3aef5513-76b0-45b5-a698-c679e38797a4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:00.240421 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3aef5513-76b0-45b5-a698-c679e38797a4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:00.240900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3aef5513-76b0-45b5-a698-c679e38797a4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:00.476939 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3aef5513-76b0-45b5-a698-c679e38797a4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:00.486046 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3aef5513-76b0-45b5-a698-c679e38797a4 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1519 microversion: 2.1 time: 0.258059 Jul 20 05:32:00.486653 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3940/7644] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:00 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1519 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:01.226210 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-7648119d-483a-4fc0-8fea-472f04cd1884 req-7fddb8b9-70b3-4c27-b38e-0918db53a266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "798784e6-c885-4301-b640-2851477dfb5f", "name": "network-vif-unplugged", "status": "completed", "tag": "954d9c0e-53e5-46fc-a277-03e2362bbc2c"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:01.242067 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7648119d-483a-4fc0-8fea-472f04cd1884 req-7fddb8b9-70b3-4c27-b38e-0918db53a266 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:01.242855 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7648119d-483a-4fc0-8fea-472f04cd1884 req-7fddb8b9-70b3-4c27-b38e-0918db53a266 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:01.256058 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.compute.server_external_events [req-7648119d-483a-4fc0-8fea-472f04cd1884 req-7fddb8b9-70b3-4c27-b38e-0918db53a266 service nova] Unable to find a host for instance 798784e6-c885-4301-b640-2851477dfb5f. Dropping event network-vif-unplugged {{(pid=127870) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 05:32:01.257076 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-7648119d-483a-4fc0-8fea-472f04cd1884 req-7fddb8b9-70b3-4c27-b38e-0918db53a266 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036447 Jul 20 05:32:01.257918 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3705/7645] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 05:32:01.504581 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-582f54d1-1506-49f7-9b96-bc5b2fec7567 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:01.505128 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-582f54d1-1506-49f7-9b96-bc5b2fec7567 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:01.513957 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-582f54d1-1506-49f7-9b96-bc5b2fec7567 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:01.514593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-582f54d1-1506-49f7-9b96-bc5b2fec7567 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:01.515711 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-582f54d1-1506-49f7-9b96-bc5b2fec7567 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:01.516252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-582f54d1-1506-49f7-9b96-bc5b2fec7567 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:01.673445 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-582f54d1-1506-49f7-9b96-bc5b2fec7567 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:01.682044 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-582f54d1-1506-49f7-9b96-bc5b2fec7567 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1521 microversion: 2.1 time: 0.181609 Jul 20 05:32:01.682652 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3941/7646] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:01 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:02.700245 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1c641495-ac2a-4798-bc75-91f4ba698949 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:02.700867 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1c641495-ac2a-4798-bc75-91f4ba698949 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:02.708203 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c641495-ac2a-4798-bc75-91f4ba698949 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:02.708714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c641495-ac2a-4798-bc75-91f4ba698949 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:02.709527 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c641495-ac2a-4798-bc75-91f4ba698949 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:02.710041 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c641495-ac2a-4798-bc75-91f4ba698949 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:02.843914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-1c641495-ac2a-4798-bc75-91f4ba698949 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:02.851989 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1c641495-ac2a-4798-bc75-91f4ba698949 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1521 microversion: 2.1 time: 0.155886 Jul 20 05:32:02.852602 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3706/7647] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:02 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:03.871235 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-291b7251-7742-41a6-8a10-248850960c36 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:03.872011 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-291b7251-7742-41a6-8a10-248850960c36 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:03.879454 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-291b7251-7742-41a6-8a10-248850960c36 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:03.879835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-291b7251-7742-41a6-8a10-248850960c36 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:03.880683 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-291b7251-7742-41a6-8a10-248850960c36 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:03.881130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-291b7251-7742-41a6-8a10-248850960c36 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:04.024904 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-291b7251-7742-41a6-8a10-248850960c36 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:04.033667 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-291b7251-7742-41a6-8a10-248850960c36 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1521 microversion: 2.1 time: 0.167561 Jul 20 05:32:04.034616 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3942/7648] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:03 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:05.058068 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-65ecf8e1-100b-479f-a7c8-e246de53236a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:05.058704 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-65ecf8e1-100b-479f-a7c8-e246de53236a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:05.066589 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65ecf8e1-100b-479f-a7c8-e246de53236a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:05.067224 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65ecf8e1-100b-479f-a7c8-e246de53236a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:05.068330 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65ecf8e1-100b-479f-a7c8-e246de53236a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:05.068922 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65ecf8e1-100b-479f-a7c8-e246de53236a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:05.212544 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-65ecf8e1-100b-479f-a7c8-e246de53236a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:05.221459 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-65ecf8e1-100b-479f-a7c8-e246de53236a tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1521 microversion: 2.1 time: 0.167682 Jul 20 05:32:05.222200 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3707/7649] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:05 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:06.242118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0d7a139d-a21d-43ec-81fa-03cbdedc7437 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:06.242777 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0d7a139d-a21d-43ec-81fa-03cbdedc7437 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:06.250431 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d7a139d-a21d-43ec-81fa-03cbdedc7437 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:06.250961 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d7a139d-a21d-43ec-81fa-03cbdedc7437 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:06.251772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d7a139d-a21d-43ec-81fa-03cbdedc7437 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:06.252221 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0d7a139d-a21d-43ec-81fa-03cbdedc7437 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:06.395486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0d7a139d-a21d-43ec-81fa-03cbdedc7437 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:06.403653 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0d7a139d-a21d-43ec-81fa-03cbdedc7437 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1577 microversion: 2.1 time: 0.165472 Jul 20 05:32:06.404244 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3943/7650] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:06 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:07.069167 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-a567dee6-9c8b-4e3a-9041-2e055fd2dd4f req-91795533-ce88-43f2-aafa-4360257eb61a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "798784e6-c885-4301-b640-2851477dfb5f", "tag": "954d9c0e-53e5-46fc-a277-03e2362bbc2c"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:07.080047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a567dee6-9c8b-4e3a-9041-2e055fd2dd4f req-91795533-ce88-43f2-aafa-4360257eb61a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:07.080610 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a567dee6-9c8b-4e3a-9041-2e055fd2dd4f req-91795533-ce88-43f2-aafa-4360257eb61a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:07.102910 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-a567dee6-9c8b-4e3a-9041-2e055fd2dd4f req-91795533-ce88-43f2-aafa-4360257eb61a service nova] Creating event network-changed:954d9c0e-53e5-46fc-a277-03e2362bbc2c for instance 798784e6-c885-4301-b640-2851477dfb5f on n-h2-826526-5 Jul 20 05:32:07.109000 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-a567dee6-9c8b-4e3a-9041-2e055fd2dd4f req-91795533-ce88-43f2-aafa-4360257eb61a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043757 Jul 20 05:32:07.110593 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3708/7651] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:32:07.421436 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-22f97e88-192c-4838-acfe-7ecdf76d59ae tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:07.422049 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-22f97e88-192c-4838-acfe-7ecdf76d59ae tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:07.429838 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22f97e88-192c-4838-acfe-7ecdf76d59ae tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:07.430301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22f97e88-192c-4838-acfe-7ecdf76d59ae tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:07.431086 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22f97e88-192c-4838-acfe-7ecdf76d59ae tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:07.431533 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-22f97e88-192c-4838-acfe-7ecdf76d59ae tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:07.570351 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-22f97e88-192c-4838-acfe-7ecdf76d59ae tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:07.578405 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-22f97e88-192c-4838-acfe-7ecdf76d59ae tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1577 microversion: 2.1 time: 0.161085 Jul 20 05:32:07.579229 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3944/7652] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:07 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:08.597714 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-99ce3581-ccae-46ea-b95b-e9629029c3dc tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:08.598779 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-99ce3581-ccae-46ea-b95b-e9629029c3dc tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:08.610015 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-99ce3581-ccae-46ea-b95b-e9629029c3dc tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:08.610480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-99ce3581-ccae-46ea-b95b-e9629029c3dc tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:08.611314 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-99ce3581-ccae-46ea-b95b-e9629029c3dc tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:08.611798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-99ce3581-ccae-46ea-b95b-e9629029c3dc tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:08.766637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-99ce3581-ccae-46ea-b95b-e9629029c3dc tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:08.774887 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-99ce3581-ccae-46ea-b95b-e9629029c3dc tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1577 microversion: 2.1 time: 0.182794 Jul 20 05:32:08.775467 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3709/7653] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:08 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:09.793059 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-1fcc1ecc-3cab-4d5d-a50c-0b603c11dc46 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:09.793624 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-1fcc1ecc-3cab-4d5d-a50c-0b603c11dc46 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:09.800982 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1fcc1ecc-3cab-4d5d-a50c-0b603c11dc46 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:09.801432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1fcc1ecc-3cab-4d5d-a50c-0b603c11dc46 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:09.802188 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1fcc1ecc-3cab-4d5d-a50c-0b603c11dc46 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:09.802620 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-1fcc1ecc-3cab-4d5d-a50c-0b603c11dc46 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:09.959667 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-1fcc1ecc-3cab-4d5d-a50c-0b603c11dc46 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:09.967446 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-1fcc1ecc-3cab-4d5d-a50c-0b603c11dc46 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1577 microversion: 2.1 time: 0.178578 Jul 20 05:32:09.968023 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3945/7654] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:09 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:10.988047 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-609b36e7-56c5-4b23-b8ec-aaf0e77cf456 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:10.988761 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-609b36e7-56c5-4b23-b8ec-aaf0e77cf456 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:10.997328 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-609b36e7-56c5-4b23-b8ec-aaf0e77cf456 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:10.997798 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-609b36e7-56c5-4b23-b8ec-aaf0e77cf456 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:10.998588 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-609b36e7-56c5-4b23-b8ec-aaf0e77cf456 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:10.999039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-609b36e7-56c5-4b23-b8ec-aaf0e77cf456 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:11.141733 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-609b36e7-56c5-4b23-b8ec-aaf0e77cf456 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:11.150876 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-609b36e7-56c5-4b23-b8ec-aaf0e77cf456 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1577 microversion: 2.1 time: 0.168666 Jul 20 05:32:11.151441 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3710/7655] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:10 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:12.169535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9009f8fb-a3d0-4d19-8e3c-2645a91d8cc8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:12.170168 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9009f8fb-a3d0-4d19-8e3c-2645a91d8cc8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:12.178180 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9009f8fb-a3d0-4d19-8e3c-2645a91d8cc8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:12.178798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9009f8fb-a3d0-4d19-8e3c-2645a91d8cc8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:12.179429 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9009f8fb-a3d0-4d19-8e3c-2645a91d8cc8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:12.179872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9009f8fb-a3d0-4d19-8e3c-2645a91d8cc8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:12.320699 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9009f8fb-a3d0-4d19-8e3c-2645a91d8cc8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:12.329020 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9009f8fb-a3d0-4d19-8e3c-2645a91d8cc8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1577 microversion: 2.1 time: 0.163544 Jul 20 05:32:12.329607 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3946/7656] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:12 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:13.352082 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c48ff038-2af0-4078-9460-9b2f39a648de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:13.352796 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c48ff038-2af0-4078-9460-9b2f39a648de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:13.361354 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c48ff038-2af0-4078-9460-9b2f39a648de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:13.361900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c48ff038-2af0-4078-9460-9b2f39a648de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:13.362806 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c48ff038-2af0-4078-9460-9b2f39a648de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:13.363329 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c48ff038-2af0-4078-9460-9b2f39a648de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:13.523205 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c48ff038-2af0-4078-9460-9b2f39a648de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:13.526962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:13.531801 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c48ff038-2af0-4078-9460-9b2f39a648de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1577 microversion: 2.1 time: 0.184466 Jul 20 05:32:13.532425 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3711/7657] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:13 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:14.559324 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-0c0f283e-0f9f-42a6-b586-2ae6b4bdcf22 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:14.560211 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-0c0f283e-0f9f-42a6-b586-2ae6b4bdcf22 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:14.571071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c0f283e-0f9f-42a6-b586-2ae6b4bdcf22 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:14.571547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c0f283e-0f9f-42a6-b586-2ae6b4bdcf22 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:14.572336 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c0f283e-0f9f-42a6-b586-2ae6b4bdcf22 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:14.572784 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-0c0f283e-0f9f-42a6-b586-2ae6b4bdcf22 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:14.716559 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-0c0f283e-0f9f-42a6-b586-2ae6b4bdcf22 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:14.728471 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-0c0f283e-0f9f-42a6-b586-2ae6b4bdcf22 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1577 microversion: 2.1 time: 0.175595 Jul 20 05:32:14.729353 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3947/7658] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:14 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:15.292858 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:32:15.293705 n-d-826526-5 devstack@n-api.service[127870]: Wed Jul 20 05:32:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:32:15.750793 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-32465ed9-b697-4378-a763-bd1487bc2aad tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:15.751424 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-32465ed9-b697-4378-a763-bd1487bc2aad tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:15.754598 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=33 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:15.761657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32465ed9-b697-4378-a763-bd1487bc2aad tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:15.762474 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32465ed9-b697-4378-a763-bd1487bc2aad tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:15.763264 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32465ed9-b697-4378-a763-bd1487bc2aad tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:15.763713 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32465ed9-b697-4378-a763-bd1487bc2aad tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:15.904371 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-32465ed9-b697-4378-a763-bd1487bc2aad tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:15.912234 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-32465ed9-b697-4378-a763-bd1487bc2aad tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1577 microversion: 2.1 time: 0.165490 Jul 20 05:32:15.912925 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3712/7659] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:15 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:16.932077 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-47f289aa-1a34-4826-a3da-503f680bade0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:16.932941 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-47f289aa-1a34-4826-a3da-503f680bade0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:16.935536 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=31 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:16.942061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47f289aa-1a34-4826-a3da-503f680bade0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:16.942517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47f289aa-1a34-4826-a3da-503f680bade0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:16.943310 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47f289aa-1a34-4826-a3da-503f680bade0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:16.943749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-47f289aa-1a34-4826-a3da-503f680bade0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:16.948778 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=91 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:17.091528 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-47f289aa-1a34-4826-a3da-503f680bade0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:17.099461 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-47f289aa-1a34-4826-a3da-503f680bade0 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1577 microversion: 2.1 time: 0.173131 Jul 20 05:32:17.100041 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3948/7660] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:16 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:17.257824 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:32:17.258442 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:32:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:32:18.117958 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3abe2c24-6563-42ed-895a-5b6da2f9c92c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:18.118584 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3abe2c24-6563-42ed-895a-5b6da2f9c92c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:18.125347 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3abe2c24-6563-42ed-895a-5b6da2f9c92c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:18.125810 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3abe2c24-6563-42ed-895a-5b6da2f9c92c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:18.126609 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3abe2c24-6563-42ed-895a-5b6da2f9c92c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:18.127056 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3abe2c24-6563-42ed-895a-5b6da2f9c92c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:18.277548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3abe2c24-6563-42ed-895a-5b6da2f9c92c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:18.285588 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3abe2c24-6563-42ed-895a-5b6da2f9c92c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1577 microversion: 2.1 time: 0.172119 Jul 20 05:32:18.286123 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3713/7661] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:18 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:19.307279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ffd36542-b732-4610-a2dd-f7b16075351c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:19.307918 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ffd36542-b732-4610-a2dd-f7b16075351c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:19.315175 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffd36542-b732-4610-a2dd-f7b16075351c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:19.315523 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffd36542-b732-4610-a2dd-f7b16075351c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:19.316365 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffd36542-b732-4610-a2dd-f7b16075351c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:19.316783 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ffd36542-b732-4610-a2dd-f7b16075351c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:19.459827 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ffd36542-b732-4610-a2dd-f7b16075351c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:19.469582 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ffd36542-b732-4610-a2dd-f7b16075351c tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1577 microversion: 2.1 time: 0.167886 Jul 20 05:32:19.470206 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3949/7662] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:19 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:19.624677 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e55395d1-0a96-46bd-bb18-402f85d72842 req-f59edcf9-9d04-4c4a-b9a9-a879945ecb90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "798784e6-c885-4301-b640-2851477dfb5f", "name": "network-vif-plugged", "status": "completed", "tag": "954d9c0e-53e5-46fc-a277-03e2362bbc2c"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:19.634198 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e55395d1-0a96-46bd-bb18-402f85d72842 req-f59edcf9-9d04-4c4a-b9a9-a879945ecb90 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:19.634881 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e55395d1-0a96-46bd-bb18-402f85d72842 req-f59edcf9-9d04-4c4a-b9a9-a879945ecb90 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:19.647682 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e55395d1-0a96-46bd-bb18-402f85d72842 req-f59edcf9-9d04-4c4a-b9a9-a879945ecb90 service nova] Creating event network-vif-plugged:954d9c0e-53e5-46fc-a277-03e2362bbc2c for instance 798784e6-c885-4301-b640-2851477dfb5f on n-h2-826526-5 Jul 20 05:32:19.652847 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e55395d1-0a96-46bd-bb18-402f85d72842 req-f59edcf9-9d04-4c4a-b9a9-a879945ecb90 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032054 Jul 20 05:32:19.653494 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3714/7663] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:32:20.491073 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-62afe384-9eec-434f-9489-6e8d1b94b049 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:20.491882 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-62afe384-9eec-434f-9489-6e8d1b94b049 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:20.503475 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62afe384-9eec-434f-9489-6e8d1b94b049 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:20.504301 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62afe384-9eec-434f-9489-6e8d1b94b049 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:20.505575 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62afe384-9eec-434f-9489-6e8d1b94b049 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:20.506299 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-62afe384-9eec-434f-9489-6e8d1b94b049 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:20.647563 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-62afe384-9eec-434f-9489-6e8d1b94b049 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:20.655842 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-62afe384-9eec-434f-9489-6e8d1b94b049 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1577 microversion: 2.1 time: 0.171546 Jul 20 05:32:20.656456 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3950/7664] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:20 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:21.674897 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d6b312c3-8ee2-415e-974e-99bf0f8518de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:21.675606 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d6b312c3-8ee2-415e-974e-99bf0f8518de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:21.682548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6b312c3-8ee2-415e-974e-99bf0f8518de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:21.683008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6b312c3-8ee2-415e-974e-99bf0f8518de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:21.683787 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6b312c3-8ee2-415e-974e-99bf0f8518de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:21.684237 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6b312c3-8ee2-415e-974e-99bf0f8518de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:21.749338 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:32:21.749953 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:32:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:32:21.841766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d6b312c3-8ee2-415e-974e-99bf0f8518de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:21.853058 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d6b312c3-8ee2-415e-974e-99bf0f8518de tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1564 microversion: 2.1 time: 0.183327 Jul 20 05:32:21.853647 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3715/7665] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:21 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1564 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:28.712329 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:32:28.712965 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:32:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:33:38.375816 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=5 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:33:38.377217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=17 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:33:38.378914 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=7 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:33:38.380242 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=20 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:33:38.381659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-d3f9b0ac-b37e-4344-a648-e82506a3b6a2 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:38.382156 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d3f9b0ac-b37e-4344-a648-e82506a3b6a2 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:38.386288 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-0468082e-27f5-4e32-ab9a-a9331b6c6d38 req-241c414c-fec1-4751-8dc3-62970c354c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "798784e6-c885-4301-b640-2851477dfb5f", "tag": "954d9c0e-53e5-46fc-a277-03e2362bbc2c"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:33:38.389872 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3f9b0ac-b37e-4344-a648-e82506a3b6a2 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:38.390321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3f9b0ac-b37e-4344-a648-e82506a3b6a2 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:38.391100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3f9b0ac-b37e-4344-a648-e82506a3b6a2 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:38.391531 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-d3f9b0ac-b37e-4344-a648-e82506a3b6a2 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:38.397406 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0468082e-27f5-4e32-ab9a-a9331b6c6d38 req-241c414c-fec1-4751-8dc3-62970c354c82 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:38.397991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0468082e-27f5-4e32-ab9a-a9331b6c6d38 req-241c414c-fec1-4751-8dc3-62970c354c82 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:38.412046 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-0468082e-27f5-4e32-ab9a-a9331b6c6d38 req-241c414c-fec1-4751-8dc3-62970c354c82 service nova] Creating event network-changed:954d9c0e-53e5-46fc-a277-03e2362bbc2c for instance 798784e6-c885-4301-b640-2851477dfb5f on n-h2-826526-5 Jul 20 05:33:38.418172 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-0468082e-27f5-4e32-ab9a-a9331b6c6d38 req-241c414c-fec1-4751-8dc3-62970c354c82 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041780 Jul 20 05:33:38.419053 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3716/7666] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:33:38.420844 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-d3f9b0ac-b37e-4344-a648-e82506a3b6a2 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Going to try to terminate instance {{(pid=127871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:33:38.525891 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-d3f9b0ac-b37e-4344-a648-e82506a3b6a2 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "DELETE /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 204 len: 0 microversion: 2.1 time: 0.151994 Jul 20 05:33:38.528243 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3951/7667] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:33:38 2022] DELETE /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:33:38.540700 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e8785c95-91fd-4546-b892-e22c49f6bc70 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:38.541478 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e8785c95-91fd-4546-b892-e22c49f6bc70 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:38.548600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8785c95-91fd-4546-b892-e22c49f6bc70 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:38.549352 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8785c95-91fd-4546-b892-e22c49f6bc70 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:38.550155 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8785c95-91fd-4546-b892-e22c49f6bc70 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:38.550756 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8785c95-91fd-4546-b892-e22c49f6bc70 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:38.706962 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-e8785c95-91fd-4546-b892-e22c49f6bc70 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:38.715443 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e8785c95-91fd-4546-b892-e22c49f6bc70 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1570 microversion: 2.1 time: 0.181108 Jul 20 05:33:38.716075 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3717/7668] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:38 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:33:39.734118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4d90be7f-b95c-4acc-95ce-a6a4eb9ac8e8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:39.734894 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4d90be7f-b95c-4acc-95ce-a6a4eb9ac8e8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:39.742979 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d90be7f-b95c-4acc-95ce-a6a4eb9ac8e8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:39.743420 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d90be7f-b95c-4acc-95ce-a6a4eb9ac8e8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:39.744185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d90be7f-b95c-4acc-95ce-a6a4eb9ac8e8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:39.744650 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4d90be7f-b95c-4acc-95ce-a6a4eb9ac8e8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:39.880472 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4d90be7f-b95c-4acc-95ce-a6a4eb9ac8e8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:39.889053 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4d90be7f-b95c-4acc-95ce-a6a4eb9ac8e8 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1570 microversion: 2.1 time: 0.159149 Jul 20 05:33:39.889647 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3952/7669] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:39 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:40.571525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-c68b8c97-0eb1-4655-914e-0f94aa333aff req-64a3ab18-c12e-4f0c-9eea-e52d6b7538b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "798784e6-c885-4301-b640-2851477dfb5f", "name": "network-vif-deleted", "tag": "954d9c0e-53e5-46fc-a277-03e2362bbc2c"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:33:40.580692 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c68b8c97-0eb1-4655-914e-0f94aa333aff req-64a3ab18-c12e-4f0c-9eea-e52d6b7538b3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:40.581234 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c68b8c97-0eb1-4655-914e-0f94aa333aff req-64a3ab18-c12e-4f0c-9eea-e52d6b7538b3 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:40.593325 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-c68b8c97-0eb1-4655-914e-0f94aa333aff req-64a3ab18-c12e-4f0c-9eea-e52d6b7538b3 service nova] Creating event network-vif-deleted:954d9c0e-53e5-46fc-a277-03e2362bbc2c for instance 798784e6-c885-4301-b640-2851477dfb5f on n-h2-826526-5 Jul 20 05:33:40.598500 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-c68b8c97-0eb1-4655-914e-0f94aa333aff req-64a3ab18-c12e-4f0c-9eea-e52d6b7538b3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098171 Jul 20 05:33:40.599229 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3718/7670] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:33:40.907240 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ea110c53-93b4-4c71-9124-e0572f7d31d7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:40.908855 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ea110c53-93b4-4c71-9124-e0572f7d31d7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:40.916924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea110c53-93b4-4c71-9124-e0572f7d31d7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:40.917349 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea110c53-93b4-4c71-9124-e0572f7d31d7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:40.918492 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea110c53-93b4-4c71-9124-e0572f7d31d7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:40.918878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ea110c53-93b4-4c71-9124-e0572f7d31d7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:40.991114 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ea110c53-93b4-4c71-9124-e0572f7d31d7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:40.999968 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ea110c53-93b4-4c71-9124-e0572f7d31d7 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1220 microversion: 2.1 time: 0.096794 Jul 20 05:33:41.000503 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3953/7671] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:40 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:42.019448 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-54bd07a7-dfa9-495a-9b02-39a1bfca8813 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:42.020131 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-54bd07a7-dfa9-495a-9b02-39a1bfca8813 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:42.027429 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54bd07a7-dfa9-495a-9b02-39a1bfca8813 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:42.028623 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54bd07a7-dfa9-495a-9b02-39a1bfca8813 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:42.029418 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54bd07a7-dfa9-495a-9b02-39a1bfca8813 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:42.029866 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54bd07a7-dfa9-495a-9b02-39a1bfca8813 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:42.097929 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-54bd07a7-dfa9-495a-9b02-39a1bfca8813 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:42.107333 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-54bd07a7-dfa9-495a-9b02-39a1bfca8813 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1220 microversion: 2.1 time: 0.093387 Jul 20 05:33:42.107994 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3719/7672] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:42 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:43.135911 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5c429953-1daa-4b18-a61c-78024daeec39 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:43.136596 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5c429953-1daa-4b18-a61c-78024daeec39 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:43.144616 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5c429953-1daa-4b18-a61c-78024daeec39 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:43.145071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5c429953-1daa-4b18-a61c-78024daeec39 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:43.145840 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5c429953-1daa-4b18-a61c-78024daeec39 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:43.146273 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5c429953-1daa-4b18-a61c-78024daeec39 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:43.209870 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-5c429953-1daa-4b18-a61c-78024daeec39 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:43.218061 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5c429953-1daa-4b18-a61c-78024daeec39 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1220 microversion: 2.1 time: 0.086193 Jul 20 05:33:43.218644 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3954/7673] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:43 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:44.236301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f3cd9686-c3a2-44d9-80e5-4f21457f3c65 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:44.236851 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f3cd9686-c3a2-44d9-80e5-4f21457f3c65 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:44.244071 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3cd9686-c3a2-44d9-80e5-4f21457f3c65 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:44.244566 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3cd9686-c3a2-44d9-80e5-4f21457f3c65 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:44.245349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3cd9686-c3a2-44d9-80e5-4f21457f3c65 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:44.246276 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f3cd9686-c3a2-44d9-80e5-4f21457f3c65 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:44.309845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-f3cd9686-c3a2-44d9-80e5-4f21457f3c65 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8f0227fab542549209162a4dde421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648abb554ebf439fb69d231109a1249d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:44.318036 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f3cd9686-c3a2-44d9-80e5-4f21457f3c65 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 200 len: 1220 microversion: 2.1 time: 0.086098 Jul 20 05:33:44.318654 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3720/7674] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:44 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:45.335404 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a0155b89-dd58-4f56-a877-618359c14cb6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:45.336290 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a0155b89-dd58-4f56-a877-618359c14cb6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] [instance: 798784e6-c885-4301-b640-2851477dfb5f] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:45.344005 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0155b89-dd58-4f56-a877-618359c14cb6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:45.344495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0155b89-dd58-4f56-a877-618359c14cb6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:45.345279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0155b89-dd58-4f56-a877-618359c14cb6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:45.345715 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a0155b89-dd58-4f56-a877-618359c14cb6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:45.359800 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-a0155b89-dd58-4f56-a877-618359c14cb6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] HTTP exception thrown: Instance 798784e6-c885-4301-b640-2851477dfb5f could not be found. Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a0155b89-dd58-4f56-a877-618359c14cb6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Request method failure captured: Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f HTTP/1.1 Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi15GoCF7rsf8_ethgfhsUkS7ZPhz4KNygJGQ52GD0ImvxlotWonMqsHCqdORHwLSWV48Hl2TLQzS7S1n2aGPzOYWEtksGjcqcc19eOEpQqqBOwtl5eU02jzlsyAC3mo4ZsYS5VcTDnxwGtF0_DAkntTMoI8EXejGhtaGrt_Y0zdSB7co Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 648abb554ebf439fb69d231109a1249d Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestShelveInstance-1243929517 Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/648abb554ebf439fb69d231109a1249d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/648abb554ebf439fb69d231109a1249d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_648abb554ebf439fb69d231109a1249d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/648abb554ebf439fb69d231109a1249d"}]}] Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestShelveInstance-1243929517 Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 648abb554ebf439fb69d231109a1249d Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestShelveInstance-1243929517 Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestShelveInstance-1243929517-project Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: 4e8f0227fab542549209162a4dde421a Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestShelveInstance-1243929517-project Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 798784e6-c885-4301-b640-2851477dfb5f could not be found. Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '798784e6-c885-4301-b640-2851477dfb5f'} Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 798784e6-c885-4301-b640-2851477dfb5f could not be found. Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 798784e6-c885-4301-b640-2851477dfb5f could not be found. Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:33:45.361582 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:33:45.365943 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:33:45.365943 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:33:45.365943 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:33:45.365943 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:33:45.365943 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:33:45.365943 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 798784e6-c885-4301-b640-2851477dfb5f could not be found. Jul 20 05:33:45.365943 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:33:45.365943 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a0155b89-dd58-4f56-a877-618359c14cb6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Returning 404 to user: Instance 798784e6-c885-4301-b640-2851477dfb5f could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:33:45.365943 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a0155b89-dd58-4f56-a877-618359c14cb6 tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f" status: 404 len: 111 microversion: 2.1 time: 0.031693 Jul 20 05:33:45.365943 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3955/7675] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:45 2022] GET /compute/v2.1/servers/798784e6-c885-4301-b640-2851477dfb5f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:33:45.545830 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aa205536-741e-41c8-b246-14574c38bc2b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] Calling method '.version_select at 0x7f06bd537790>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:45.578387 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aa205536-741e-41c8-b246-14574c38bc2b tempest-TestShelveInstance-1243929517 tempest-TestShelveInstance-1243929517-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1914910317" status: 202 len: 0 microversion: 2.1 time: 0.036135 Jul 20 05:33:45.579191 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3721/7676] 10.222.0.17 () {58 vars in 1253 bytes} [Wed Jul 20 05:33:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1914910317 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:34:03.867751 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:03.868713 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:04.060835 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a55639ac-6ff5-4d89-885e-3fd315329ea2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Action: 'create', calling method: .version_select at 0x7f06bd30cf70>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1304471394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvh7QnzX3QeE31dJJQGCTejWk/717vaSXVX0FxFECmRnuWOERQn6f01w6ntOq+ppR1jgdW+cYLjn+lFPfeI+ykLAGicjbGFYCFO+NYUhVBAIHSDVXHZHFaud1Y/0MOXZw=="}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:34:04.075382 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-a55639ac-6ff5-4d89-885e-3fd315329ea2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Getting quotas for project 109e3640b516417cb7e37c164ae86aad. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:34:04.080925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-a55639ac-6ff5-4d89-885e-3fd315329ea2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Getting quotas for user ffc2747b9fc3424c82d85699c348368a and project 109e3640b516417cb7e37c164ae86aad. Resources: {'key_pairs'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:34:04.112424 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a55639ac-6ff5-4d89-885e-3fd315329ea2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.249894 Jul 20 05:34:04.126232 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3956/7677] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 05:34:03 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:34:05.353954 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ec1b6cc4-40fe-451d-bdd7-e466fdc86e6e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-505330563", "imageRef": "dd295612-2ec2-458d-9fdf-8704437a5c0b", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1304471394", "security_groups": [{"name": "tempest-secgroup-smoke-852372259"}], "networks": [{"uuid": "3d972543-f4c8-497a-85b3-0c8100b6d6c4"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:34:05.364825 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=22 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:05.369950 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:05.495885 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-ec1b6cc4-40fe-451d-bdd7-e466fdc86e6e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] validate_networks() for [('3d972543-f4c8-497a-85b3-0c8100b6d6c4', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:34:06.025998 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ec1b6cc4-40fe-451d-bdd7-e466fdc86e6e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:34:06.026600 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ec1b6cc4-40fe-451d-bdd7-e466fdc86e6e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:34:06.027222 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ec1b6cc4-40fe-451d-bdd7-e466fdc86e6e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:34:06.027755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ec1b6cc4-40fe-451d-bdd7-e466fdc86e6e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:34:06.028294 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ec1b6cc4-40fe-451d-bdd7-e466fdc86e6e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:34:06.038739 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec1b6cc4-40fe-451d-bdd7-e466fdc86e6e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:06.039027 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec1b6cc4-40fe-451d-bdd7-e466fdc86e6e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:06.039846 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec1b6cc4-40fe-451d-bdd7-e466fdc86e6e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:06.040320 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec1b6cc4-40fe-451d-bdd7-e466fdc86e6e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:06.062654 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-ec1b6cc4-40fe-451d-bdd7-e466fdc86e6e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Getting quotas for project 109e3640b516417cb7e37c164ae86aad. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:34:06.068511 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.quota [None req-ec1b6cc4-40fe-451d-bdd7-e466fdc86e6e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Getting quotas for user ffc2747b9fc3424c82d85699c348368a and project 109e3640b516417cb7e37c164ae86aad. Resources: {'ram', 'cores', 'instances'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:34:06.081965 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ec1b6cc4-40fe-451d-bdd7-e466fdc86e6e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:34:06.084372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ec1b6cc4-40fe-451d-bdd7-e466fdc86e6e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd295612-2ec2-458d-9fdf-8704437a5c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:34:06.132907 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ec1b6cc4-40fe-451d-bdd7-e466fdc86e6e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.783603 Jul 20 05:34:06.133651 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3722/7678] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:34:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:34:06.144673 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6734ac92-304f-48b3-8998-38114c349fd2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:06.146432 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6734ac92-304f-48b3-8998-38114c349fd2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:06.209444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6734ac92-304f-48b3-8998-38114c349fd2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:06.216659 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6734ac92-304f-48b3-8998-38114c349fd2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5" status: 200 len: 1248 microversion: 2.1 time: 0.076996 Jul 20 05:34:06.217335 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3957/7679] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:06 2022] GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5 => generated 1248 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:07.238562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-782e0987-7d3c-4c87-9f21-d4c1886ab60d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:07.238562 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-782e0987-7d3c-4c87-9f21-d4c1886ab60d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:07.247040 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-782e0987-7d3c-4c87-9f21-d4c1886ab60d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:07.247783 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-782e0987-7d3c-4c87-9f21-d4c1886ab60d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:07.248900 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-782e0987-7d3c-4c87-9f21-d4c1886ab60d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:07.249529 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-782e0987-7d3c-4c87-9f21-d4c1886ab60d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:07.345983 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-782e0987-7d3c-4c87-9f21-d4c1886ab60d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:07.360359 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-782e0987-7d3c-4c87-9f21-d4c1886ab60d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5" status: 200 len: 1300 microversion: 2.1 time: 0.128225 Jul 20 05:34:07.361749 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3723/7680] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:07 2022] GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5 => generated 1300 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:08.379123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-4eb639d2-85b9-414d-b13b-a1cf6239cd3d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:08.380760 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-4eb639d2-85b9-414d-b13b-a1cf6239cd3d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:08.388495 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4eb639d2-85b9-414d-b13b-a1cf6239cd3d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:08.388954 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4eb639d2-85b9-414d-b13b-a1cf6239cd3d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:08.390411 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4eb639d2-85b9-414d-b13b-a1cf6239cd3d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:08.391185 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-4eb639d2-85b9-414d-b13b-a1cf6239cd3d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:08.668748 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-4eb639d2-85b9-414d-b13b-a1cf6239cd3d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:08.679583 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-4eb639d2-85b9-414d-b13b-a1cf6239cd3d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5" status: 200 len: 1373 microversion: 2.1 time: 0.304562 Jul 20 05:34:08.688220 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3958/7681] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:08 2022] GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5 => generated 1373 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:09.332446 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-86d829bd-9f2d-41c1-8179-c1a2aa4be6ae req-3aaab0b4-9f1a-4978-a230-bc8b7a09e426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08c52778-601a-41e6-814e-6c455753a3b5", "tag": "be60ae56-0e25-4eaf-850e-4bb39bb4dd91"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:34:09.351404 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-86d829bd-9f2d-41c1-8179-c1a2aa4be6ae req-3aaab0b4-9f1a-4978-a230-bc8b7a09e426 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:09.351915 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-86d829bd-9f2d-41c1-8179-c1a2aa4be6ae req-3aaab0b4-9f1a-4978-a230-bc8b7a09e426 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:09.365717 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-86d829bd-9f2d-41c1-8179-c1a2aa4be6ae req-3aaab0b4-9f1a-4978-a230-bc8b7a09e426 service nova] Creating event network-changed:be60ae56-0e25-4eaf-850e-4bb39bb4dd91 for instance 08c52778-601a-41e6-814e-6c455753a3b5 on n-h1-826526-5 Jul 20 05:34:09.371670 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-86d829bd-9f2d-41c1-8179-c1a2aa4be6ae req-3aaab0b4-9f1a-4978-a230-bc8b7a09e426 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049205 Jul 20 05:34:09.372668 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3724/7682] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:34:09.697792 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ad4c892f-47e1-4519-b2b9-e453c16ae428 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:09.698735 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ad4c892f-47e1-4519-b2b9-e453c16ae428 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:09.706369 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad4c892f-47e1-4519-b2b9-e453c16ae428 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:09.706830 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad4c892f-47e1-4519-b2b9-e453c16ae428 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:09.707617 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad4c892f-47e1-4519-b2b9-e453c16ae428 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:09.708071 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ad4c892f-47e1-4519-b2b9-e453c16ae428 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:09.865678 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ad4c892f-47e1-4519-b2b9-e453c16ae428 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:09.873639 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ad4c892f-47e1-4519-b2b9-e453c16ae428 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5" status: 200 len: 1373 microversion: 2.1 time: 0.179902 Jul 20 05:34:09.874307 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3959/7683] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:09 2022] GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5 => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:10.892731 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b43f2a35-5478-490e-9c4e-d7432a5b479a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:10.893509 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b43f2a35-5478-490e-9c4e-d7432a5b479a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:10.901479 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b43f2a35-5478-490e-9c4e-d7432a5b479a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:10.901959 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b43f2a35-5478-490e-9c4e-d7432a5b479a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:10.902870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b43f2a35-5478-490e-9c4e-d7432a5b479a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:10.903273 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b43f2a35-5478-490e-9c4e-d7432a5b479a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:11.104476 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b43f2a35-5478-490e-9c4e-d7432a5b479a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:11.112802 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b43f2a35-5478-490e-9c4e-d7432a5b479a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5" status: 200 len: 1373 microversion: 2.1 time: 0.225026 Jul 20 05:34:11.113402 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3725/7684] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:10 2022] GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5 => generated 1373 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:12.134653 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-46df276e-eba3-4ff7-b152-45aa08cb5743 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:12.135555 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-46df276e-eba3-4ff7-b152-45aa08cb5743 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:12.147817 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46df276e-eba3-4ff7-b152-45aa08cb5743 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:12.148669 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46df276e-eba3-4ff7-b152-45aa08cb5743 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:12.149958 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46df276e-eba3-4ff7-b152-45aa08cb5743 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:12.150672 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-46df276e-eba3-4ff7-b152-45aa08cb5743 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:12.292197 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-46df276e-eba3-4ff7-b152-45aa08cb5743 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:12.300231 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-46df276e-eba3-4ff7-b152-45aa08cb5743 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5" status: 200 len: 1373 microversion: 2.1 time: 0.172180 Jul 20 05:34:12.301024 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3960/7685] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:12 2022] GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5 => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:13.322697 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-90f33d43-ae97-4c65-8fb1-48c4156b8c29 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:13.323951 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-90f33d43-ae97-4c65-8fb1-48c4156b8c29 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:13.333667 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90f33d43-ae97-4c65-8fb1-48c4156b8c29 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:13.334247 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90f33d43-ae97-4c65-8fb1-48c4156b8c29 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:13.335355 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90f33d43-ae97-4c65-8fb1-48c4156b8c29 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:13.335818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-90f33d43-ae97-4c65-8fb1-48c4156b8c29 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:13.482151 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-90f33d43-ae97-4c65-8fb1-48c4156b8c29 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:13.491039 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-90f33d43-ae97-4c65-8fb1-48c4156b8c29 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5" status: 200 len: 1373 microversion: 2.1 time: 0.175119 Jul 20 05:34:13.491714 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3726/7686] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:13 2022] GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5 => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:14.512927 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-072eb7ea-cc20-4271-9d77-d9402d67fe9f tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:14.513813 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-072eb7ea-cc20-4271-9d77-d9402d67fe9f tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:14.524174 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-072eb7ea-cc20-4271-9d77-d9402d67fe9f tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:14.524859 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-072eb7ea-cc20-4271-9d77-d9402d67fe9f tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:14.525951 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-072eb7ea-cc20-4271-9d77-d9402d67fe9f tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:14.526573 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-072eb7ea-cc20-4271-9d77-d9402d67fe9f tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:14.684832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-072eb7ea-cc20-4271-9d77-d9402d67fe9f tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:14.694007 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-072eb7ea-cc20-4271-9d77-d9402d67fe9f tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5" status: 200 len: 1373 microversion: 2.1 time: 0.187005 Jul 20 05:34:14.694591 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3961/7687] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:14 2022] GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5 => generated 1373 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:15.711583 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c6c63d19-4214-4e84-898a-51459efedf10 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:15.712419 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c6c63d19-4214-4e84-898a-51459efedf10 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:15.719906 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6c63d19-4214-4e84-898a-51459efedf10 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:15.720468 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6c63d19-4214-4e84-898a-51459efedf10 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:15.721249 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6c63d19-4214-4e84-898a-51459efedf10 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:15.721693 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6c63d19-4214-4e84-898a-51459efedf10 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:15.837877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-ddb5d459-d30f-4248-9078-cf0abc175d2e req-7c21d80e-051e-4a18-90b7-e07ee2b3d550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c52778-601a-41e6-814e-6c455753a3b5", "name": "network-vif-plugged", "status": "completed", "tag": "be60ae56-0e25-4eaf-850e-4bb39bb4dd91"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:34:15.847129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ddb5d459-d30f-4248-9078-cf0abc175d2e req-7c21d80e-051e-4a18-90b7-e07ee2b3d550 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:15.847129 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-ddb5d459-d30f-4248-9078-cf0abc175d2e req-7c21d80e-051e-4a18-90b7-e07ee2b3d550 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:15.858868 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-ddb5d459-d30f-4248-9078-cf0abc175d2e req-7c21d80e-051e-4a18-90b7-e07ee2b3d550 service nova] Creating event network-vif-plugged:be60ae56-0e25-4eaf-850e-4bb39bb4dd91 for instance 08c52778-601a-41e6-814e-6c455753a3b5 on n-h1-826526-5 Jul 20 05:34:15.861668 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-c6c63d19-4214-4e84-898a-51459efedf10 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:15.864508 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-ddb5d459-d30f-4248-9078-cf0abc175d2e req-7c21d80e-051e-4a18-90b7-e07ee2b3d550 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091085 Jul 20 05:34:15.865128 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3962/7688] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:34:15.874258 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c6c63d19-4214-4e84-898a-51459efedf10 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5" status: 200 len: 1373 microversion: 2.1 time: 0.165561 Jul 20 05:34:15.875216 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3727/7689] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:15 2022] GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:16.890924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:16.896410 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-27100641-aea0-4740-bfea-33331a177ac1 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:16.897163 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-27100641-aea0-4740-bfea-33331a177ac1 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:16.904347 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27100641-aea0-4740-bfea-33331a177ac1 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:16.904809 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27100641-aea0-4740-bfea-33331a177ac1 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:16.905589 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27100641-aea0-4740-bfea-33331a177ac1 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:16.906036 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-27100641-aea0-4740-bfea-33331a177ac1 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:17.052576 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-27100641-aea0-4740-bfea-33331a177ac1 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:17.064022 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-27100641-aea0-4740-bfea-33331a177ac1 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5" status: 200 len: 1373 microversion: 2.1 time: 0.174315 Jul 20 05:34:17.064869 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3963/7690] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:16 2022] GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:18.085870 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:18.086894 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:18.093373 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-09f6e6b9-0c94-4e2a-bdef-da4195c74c5a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:18.094244 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-09f6e6b9-0c94-4e2a-bdef-da4195c74c5a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:18.104049 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09f6e6b9-0c94-4e2a-bdef-da4195c74c5a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:18.104553 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09f6e6b9-0c94-4e2a-bdef-da4195c74c5a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:18.105349 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09f6e6b9-0c94-4e2a-bdef-da4195c74c5a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:18.105802 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09f6e6b9-0c94-4e2a-bdef-da4195c74c5a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:18.248817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-09f6e6b9-0c94-4e2a-bdef-da4195c74c5a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:18.256962 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-09f6e6b9-0c94-4e2a-bdef-da4195c74c5a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5" status: 200 len: 1559 microversion: 2.1 time: 0.173127 Jul 20 05:34:18.257550 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3728/7691] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:18 2022] GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:18.279736 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a9435f5e-0d50-48c4-80d1-f4d01ec67470 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:18.280474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a9435f5e-0d50-48c4-80d1-f4d01ec67470 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:18.287427 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9435f5e-0d50-48c4-80d1-f4d01ec67470 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:18.287877 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9435f5e-0d50-48c4-80d1-f4d01ec67470 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:18.288689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9435f5e-0d50-48c4-80d1-f4d01ec67470 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:18.289122 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a9435f5e-0d50-48c4-80d1-f4d01ec67470 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:18.437314 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a9435f5e-0d50-48c4-80d1-f4d01ec67470 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:18.445435 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a9435f5e-0d50-48c4-80d1-f4d01ec67470 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5" status: 200 len: 1559 microversion: 2.1 time: 0.169864 Jul 20 05:34:18.446018 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3964/7692] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:18 2022] GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:20.187665 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-2dd84a57-a3c6-4f2f-90f2-69665953e363 req-efb36773-51ec-4507-a205-130b0be98e66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08c52778-601a-41e6-814e-6c455753a3b5", "tag": "be60ae56-0e25-4eaf-850e-4bb39bb4dd91"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:34:20.197159 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2dd84a57-a3c6-4f2f-90f2-69665953e363 req-efb36773-51ec-4507-a205-130b0be98e66 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:20.197637 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2dd84a57-a3c6-4f2f-90f2-69665953e363 req-efb36773-51ec-4507-a205-130b0be98e66 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:20.209523 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-2dd84a57-a3c6-4f2f-90f2-69665953e363 req-efb36773-51ec-4507-a205-130b0be98e66 service nova] Creating event network-changed:be60ae56-0e25-4eaf-850e-4bb39bb4dd91 for instance 08c52778-601a-41e6-814e-6c455753a3b5 on n-h1-826526-5 Jul 20 05:34:20.215701 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-2dd84a57-a3c6-4f2f-90f2-69665953e363 req-efb36773-51ec-4507-a205-130b0be98e66 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031826 Jul 20 05:34:20.216967 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3729/7693] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:35:37.271106 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:35:37.272047 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:35:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:36:15.388735 n-d-826526-5 devstack@n-api.service[127871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [18f52317-25d4-47c7-8a42-88d448614a79] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:36:15.389630 n-d-826526-5 devstack@n-api.service[127871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82756c74-7ff1-4946-aaad-2fa7aa912700] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:36:15.390463 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:15.391247 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=38 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:15.396091 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-09c43eca-078e-4bb4-830c-4c28874a947a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-341648499"}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:15.397196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-09c43eca-078e-4bb4-830c-4c28874a947a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:15.405147 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09c43eca-078e-4bb4-830c-4c28874a947a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:15.405593 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09c43eca-078e-4bb4-830c-4c28874a947a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:15.406352 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09c43eca-078e-4bb4-830c-4c28874a947a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:15.406788 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-09c43eca-078e-4bb4-830c-4c28874a947a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:15.689338 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-09c43eca-078e-4bb4-830c-4c28874a947a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "POST /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5/action" status: 202 len: 0 microversion: 2.1 time: 0.302134 Jul 20 05:36:15.689898 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3965/7694] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:36:15 2022] POST /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 05:36:22.379848 n-d-826526-5 devstack@n-api.service[127870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b840de8d-74a7-4811-99d3-e95c689ad04d] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:36:22.381509 n-d-826526-5 devstack@n-api.service[127870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [56c2cea1-3165-4980-b3a4-cf0ea167ce39] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:36:22.385817 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f8a55cc3-49a5-4884-90bd-ccd321944141 req-e3a98c12-0b14-41e7-9f2b-1a9e17efee8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c52778-601a-41e6-814e-6c455753a3b5", "name": "network-vif-plugged", "status": "completed", "tag": "be60ae56-0e25-4eaf-850e-4bb39bb4dd91"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:22.390436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:22.391548 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=36 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:22.404363 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f8a55cc3-49a5-4884-90bd-ccd321944141 req-e3a98c12-0b14-41e7-9f2b-1a9e17efee8b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:22.405163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f8a55cc3-49a5-4884-90bd-ccd321944141 req-e3a98c12-0b14-41e7-9f2b-1a9e17efee8b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:22.423717 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f8a55cc3-49a5-4884-90bd-ccd321944141 req-e3a98c12-0b14-41e7-9f2b-1a9e17efee8b service nova] Creating event network-vif-plugged:be60ae56-0e25-4eaf-850e-4bb39bb4dd91 for instance 08c52778-601a-41e6-814e-6c455753a3b5 on n-h1-826526-5 Jul 20 05:36:22.430975 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f8a55cc3-49a5-4884-90bd-ccd321944141 req-e3a98c12-0b14-41e7-9f2b-1a9e17efee8b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053255 Jul 20 05:36:22.434044 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3730/7695] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:36:29.252000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:29.252924 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:29.257237 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-34b913f6-00af-4017-a57b-9375c178ad40 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-9682100", "imageRef": "78a82c72-4c40-4c32-aa1a-1eaa73fa564e", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1304471394", "security_groups": [{"name": "tempest-secgroup-smoke-852372259"}], "networks": [{"uuid": "3d972543-f4c8-497a-85b3-0c8100b6d6c4"}]}} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:29.284856 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] [82756c74-7ff1-4946-aaad-2fa7aa912700] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 41880. Jul 20 05:36:29.286115 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] [18f52317-25d4-47c7-8a42-88d448614a79] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 41878. Jul 20 05:36:29.377196 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.network.neutron [None req-34b913f6-00af-4017-a57b-9375c178ad40 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] validate_networks() for [('3d972543-f4c8-497a-85b3-0c8100b6d6c4', None, None, None, None, None)] {{(pid=127871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:36:29.861470 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-34b913f6-00af-4017-a57b-9375c178ad40 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Flavor limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:36:29.862081 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-34b913f6-00af-4017-a57b-9375c178ad40 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Image limits 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:36:29.862567 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-34b913f6-00af-4017-a57b-9375c178ad40 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Flavor pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:36:29.862969 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-34b913f6-00af-4017-a57b-9375c178ad40 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Image pref 0:0:0 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:36:29.863417 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.virt.hardware [None req-34b913f6-00af-4017-a57b-9375c178ad40 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:36:29.873657 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-34b913f6-00af-4017-a57b-9375c178ad40 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:29.874107 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-34b913f6-00af-4017-a57b-9375c178ad40 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:29.874909 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-34b913f6-00af-4017-a57b-9375c178ad40 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:29.875344 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-34b913f6-00af-4017-a57b-9375c178ad40 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:29.894007 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-34b913f6-00af-4017-a57b-9375c178ad40 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Getting quotas for project 109e3640b516417cb7e37c164ae86aad. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:36:29.899648 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.quota [None req-34b913f6-00af-4017-a57b-9375c178ad40 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Getting quotas for user ffc2747b9fc3424c82d85699c348368a and project 109e3640b516417cb7e37c164ae86aad. Resources: {'ram', 'cores', 'instances'} {{(pid=127871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:36:29.913560 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-34b913f6-00af-4017-a57b-9375c178ad40 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Going to run 1 instances... {{(pid=127871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:36:29.916040 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-34b913f6-00af-4017-a57b-9375c178ad40 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78a82c72-4c40-4c32-aa1a-1eaa73fa564e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:36:29.968866 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-34b913f6-00af-4017-a57b-9375c178ad40 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.718850 Jul 20 05:36:29.969761 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3966/7696] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 05:36:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:36:29.983520 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b6783efd-5758-4b20-a686-6afca503f804 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:29.984372 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b6783efd-5758-4b20-a686-6afca503f804 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:29.999245 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] [56c2cea1-3165-4980-b3a4-cf0ea167ce39] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 41896. Jul 20 05:36:30.001592 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] [b840de8d-74a7-4811-99d3-e95c689ad04d] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 41894. Jul 20 05:36:30.057595 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b6783efd-5758-4b20-a686-6afca503f804 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:30.065039 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b6783efd-5758-4b20-a686-6afca503f804 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1246 microversion: 2.1 time: 0.088108 Jul 20 05:36:30.065590 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3731/7697] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:29 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:31.083210 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-019f3643-1e4a-46c5-8e0d-4e0c0705e6a2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:31.084517 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-019f3643-1e4a-46c5-8e0d-4e0c0705e6a2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:31.091195 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-019f3643-1e4a-46c5-8e0d-4e0c0705e6a2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:31.091639 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-019f3643-1e4a-46c5-8e0d-4e0c0705e6a2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:31.092442 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-019f3643-1e4a-46c5-8e0d-4e0c0705e6a2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:31.092878 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-019f3643-1e4a-46c5-8e0d-4e0c0705e6a2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:31.173258 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-019f3643-1e4a-46c5-8e0d-4e0c0705e6a2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:31.182793 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-019f3643-1e4a-46c5-8e0d-4e0c0705e6a2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1316 microversion: 2.1 time: 0.104412 Jul 20 05:36:31.187370 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3967/7698] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:31 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1316 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:32.213436 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d0439bda-24d5-48b4-b9f2-2302a0edeb9b tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:32.216815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d0439bda-24d5-48b4-b9f2-2302a0edeb9b tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:32.225422 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0439bda-24d5-48b4-b9f2-2302a0edeb9b tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:32.225876 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0439bda-24d5-48b4-b9f2-2302a0edeb9b tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:32.226674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0439bda-24d5-48b4-b9f2-2302a0edeb9b tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:32.227126 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0439bda-24d5-48b4-b9f2-2302a0edeb9b tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:32.385674 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d0439bda-24d5-48b4-b9f2-2302a0edeb9b tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:32.398282 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d0439bda-24d5-48b4-b9f2-2302a0edeb9b tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1371 microversion: 2.1 time: 0.190629 Jul 20 05:36:32.399134 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3732/7699] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:32 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:32.414288 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-9f61597c-02ec-49d8-8f0c-8c38b516c3c8 req-cfc23bbf-2e4c-4933-b2bd-89abebc75ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c52778-601a-41e6-814e-6c455753a3b5", "name": "network-vif-unplugged", "status": "completed", "tag": "be60ae56-0e25-4eaf-850e-4bb39bb4dd91"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:32.424390 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9f61597c-02ec-49d8-8f0c-8c38b516c3c8 req-cfc23bbf-2e4c-4933-b2bd-89abebc75ee2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:32.425130 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-9f61597c-02ec-49d8-8f0c-8c38b516c3c8 req-cfc23bbf-2e4c-4933-b2bd-89abebc75ee2 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:32.438687 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-9f61597c-02ec-49d8-8f0c-8c38b516c3c8 req-cfc23bbf-2e4c-4933-b2bd-89abebc75ee2 service nova] Creating event network-vif-unplugged:be60ae56-0e25-4eaf-850e-4bb39bb4dd91 for instance 08c52778-601a-41e6-814e-6c455753a3b5 on n-h1-826526-5 Jul 20 05:36:32.445742 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-9f61597c-02ec-49d8-8f0c-8c38b516c3c8 req-cfc23bbf-2e4c-4933-b2bd-89abebc75ee2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038052 Jul 20 05:36:32.447539 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3968/7700] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:36:33.417517 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-24eb598b-07f0-4696-ba23-c4546ebefae2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:33.424217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-24eb598b-07f0-4696-ba23-c4546ebefae2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:33.431865 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24eb598b-07f0-4696-ba23-c4546ebefae2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:33.432370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24eb598b-07f0-4696-ba23-c4546ebefae2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:33.433169 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24eb598b-07f0-4696-ba23-c4546ebefae2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:33.433627 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24eb598b-07f0-4696-ba23-c4546ebefae2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:33.589781 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-24eb598b-07f0-4696-ba23-c4546ebefae2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:33.599026 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-24eb598b-07f0-4696-ba23-c4546ebefae2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1371 microversion: 2.1 time: 0.185068 Jul 20 05:36:33.599795 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3733/7701] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:33 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:34.621079 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-42fd4069-1a90-43c1-b7e3-bc50f3d53c29 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:34.622724 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-42fd4069-1a90-43c1-b7e3-bc50f3d53c29 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:34.631666 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42fd4069-1a90-43c1-b7e3-bc50f3d53c29 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:34.632118 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42fd4069-1a90-43c1-b7e3-bc50f3d53c29 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:34.633002 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42fd4069-1a90-43c1-b7e3-bc50f3d53c29 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:34.633544 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-42fd4069-1a90-43c1-b7e3-bc50f3d53c29 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:34.782936 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-42fd4069-1a90-43c1-b7e3-bc50f3d53c29 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:34.792490 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-42fd4069-1a90-43c1-b7e3-bc50f3d53c29 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1371 microversion: 2.1 time: 0.178996 Jul 20 05:36:34.793324 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3969/7702] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:34 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:35.811650 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-61e04765-3ebd-43c6-9ea8-e88df49b024c tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:35.812343 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-61e04765-3ebd-43c6-9ea8-e88df49b024c tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:35.825336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61e04765-3ebd-43c6-9ea8-e88df49b024c tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:35.825336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61e04765-3ebd-43c6-9ea8-e88df49b024c tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:35.825336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61e04765-3ebd-43c6-9ea8-e88df49b024c tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:35.825336 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-61e04765-3ebd-43c6-9ea8-e88df49b024c tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:35.975348 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-61e04765-3ebd-43c6-9ea8-e88df49b024c tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:35.984534 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-61e04765-3ebd-43c6-9ea8-e88df49b024c tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1371 microversion: 2.1 time: 0.176645 Jul 20 05:36:35.985135 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3734/7703] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:35 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:37.002252 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-3a36d40d-01aa-450f-a059-65b7d4fc2c88 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:37.002947 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-3a36d40d-01aa-450f-a059-65b7d4fc2c88 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:37.012925 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a36d40d-01aa-450f-a059-65b7d4fc2c88 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:37.013402 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a36d40d-01aa-450f-a059-65b7d4fc2c88 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:37.014192 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a36d40d-01aa-450f-a059-65b7d4fc2c88 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:37.014659 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-3a36d40d-01aa-450f-a059-65b7d4fc2c88 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:37.168406 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-3a36d40d-01aa-450f-a059-65b7d4fc2c88 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:37.177340 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-3a36d40d-01aa-450f-a059-65b7d4fc2c88 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1371 microversion: 2.1 time: 0.179224 Jul 20 05:36:37.178228 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3970/7704] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:36 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:38.195467 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-48255607-e0e7-4e32-ba0f-b12d411038c9 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:38.196231 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-48255607-e0e7-4e32-ba0f-b12d411038c9 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:38.202966 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48255607-e0e7-4e32-ba0f-b12d411038c9 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:38.203427 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48255607-e0e7-4e32-ba0f-b12d411038c9 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:38.204217 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48255607-e0e7-4e32-ba0f-b12d411038c9 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:38.204676 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48255607-e0e7-4e32-ba0f-b12d411038c9 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:38.361995 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-48255607-e0e7-4e32-ba0f-b12d411038c9 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:38.370583 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-48255607-e0e7-4e32-ba0f-b12d411038c9 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1371 microversion: 2.1 time: 0.179198 Jul 20 05:36:38.381172 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3735/7705] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:38 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:39.388111 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-6e4df02d-c285-488a-9d62-be15931a4ec8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:39.388798 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-6e4df02d-c285-488a-9d62-be15931a4ec8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:39.397023 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e4df02d-c285-488a-9d62-be15931a4ec8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:39.397537 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e4df02d-c285-488a-9d62-be15931a4ec8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:39.398641 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e4df02d-c285-488a-9d62-be15931a4ec8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:39.399184 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-6e4df02d-c285-488a-9d62-be15931a4ec8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:39.600021 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-6e4df02d-c285-488a-9d62-be15931a4ec8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:39.610449 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-6e4df02d-c285-488a-9d62-be15931a4ec8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1371 microversion: 2.1 time: 0.224916 Jul 20 05:36:39.619498 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3971/7706] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:39 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:39.816635 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f6b1f439-d132-4237-9729-5a7e82ddce8c req-d13e6496-4749-4daf-857d-24e5d121726b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "932b5456-3954-4de2-a4bf-431855237ad8", "tag": "cab55f48-4897-4d8e-9ecf-73b914146f1f"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:39.831163 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f6b1f439-d132-4237-9729-5a7e82ddce8c req-d13e6496-4749-4daf-857d-24e5d121726b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:39.832023 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f6b1f439-d132-4237-9729-5a7e82ddce8c req-d13e6496-4749-4daf-857d-24e5d121726b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:39.847109 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f6b1f439-d132-4237-9729-5a7e82ddce8c req-d13e6496-4749-4daf-857d-24e5d121726b service nova] Creating event network-changed:cab55f48-4897-4d8e-9ecf-73b914146f1f for instance 932b5456-3954-4de2-a4bf-431855237ad8 on n-h2-826526-5 Jul 20 05:36:39.852866 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f6b1f439-d132-4237-9729-5a7e82ddce8c req-d13e6496-4749-4daf-857d-24e5d121726b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040049 Jul 20 05:36:39.853809 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3736/7707] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:36:40.627061 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-a91f970e-8cb0-4bfe-874d-c860e727bd78 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:40.627689 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-a91f970e-8cb0-4bfe-874d-c860e727bd78 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:40.629832 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=2 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:40.630622 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell0:SELECT=6 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:40.638444 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a91f970e-8cb0-4bfe-874d-c860e727bd78 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:40.638898 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a91f970e-8cb0-4bfe-874d-c860e727bd78 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:40.639686 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a91f970e-8cb0-4bfe-874d-c860e727bd78 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:40.640124 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-a91f970e-8cb0-4bfe-874d-c860e727bd78 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:40.784384 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-a91f970e-8cb0-4bfe-874d-c860e727bd78 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:40.792130 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-a91f970e-8cb0-4bfe-874d-c860e727bd78 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1371 microversion: 2.1 time: 0.169284 Jul 20 05:36:40.792755 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3972/7708] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:40 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:41.809281 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:41.817039 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-79f4e27f-7b19-4c69-a5bb-47a244694bad tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:41.817755 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-79f4e27f-7b19-4c69-a5bb-47a244694bad tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:41.824747 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79f4e27f-7b19-4c69-a5bb-47a244694bad tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:41.825207 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79f4e27f-7b19-4c69-a5bb-47a244694bad tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:41.825982 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79f4e27f-7b19-4c69-a5bb-47a244694bad tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:41.826426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79f4e27f-7b19-4c69-a5bb-47a244694bad tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:41.968735 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-79f4e27f-7b19-4c69-a5bb-47a244694bad tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:41.976379 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-79f4e27f-7b19-4c69-a5bb-47a244694bad tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1371 microversion: 2.1 time: 0.168783 Jul 20 05:36:41.976962 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3737/7709] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:41 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:43.002981 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-9e1e18eb-696f-437e-8884-45bb08f99c50 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:43.003571 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-9e1e18eb-696f-437e-8884-45bb08f99c50 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:43.011348 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e1e18eb-696f-437e-8884-45bb08f99c50 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:43.011845 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e1e18eb-696f-437e-8884-45bb08f99c50 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:43.012734 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e1e18eb-696f-437e-8884-45bb08f99c50 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:43.013212 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-9e1e18eb-696f-437e-8884-45bb08f99c50 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:43.160753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-9e1e18eb-696f-437e-8884-45bb08f99c50 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:43.169096 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-9e1e18eb-696f-437e-8884-45bb08f99c50 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1371 microversion: 2.1 time: 0.170203 Jul 20 05:36:43.169796 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3973/7710] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:42 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:44.191206 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b08a7f20-783d-4c26-a275-c06e1d1258ff tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:44.192088 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b08a7f20-783d-4c26-a275-c06e1d1258ff tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:44.199664 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b08a7f20-783d-4c26-a275-c06e1d1258ff tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:44.200130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b08a7f20-783d-4c26-a275-c06e1d1258ff tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:44.200948 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b08a7f20-783d-4c26-a275-c06e1d1258ff tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:44.201398 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b08a7f20-783d-4c26-a275-c06e1d1258ff tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:44.341818 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-b08a7f20-783d-4c26-a275-c06e1d1258ff tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:44.350212 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b08a7f20-783d-4c26-a275-c06e1d1258ff tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1371 microversion: 2.1 time: 0.165754 Jul 20 05:36:44.350793 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3738/7711] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:44 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:45.005992 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-0d3847b8-c5a5-43f0-8fb7-70c6149a3f0b req-8e92fc60-6f28-415f-9200-ce2e264f258b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "932b5456-3954-4de2-a4bf-431855237ad8", "name": "network-vif-plugged", "status": "completed", "tag": "cab55f48-4897-4d8e-9ecf-73b914146f1f"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:45.015547 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-0d3847b8-c5a5-43f0-8fb7-70c6149a3f0b req-8e92fc60-6f28-415f-9200-ce2e264f258b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:45.016028 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-0d3847b8-c5a5-43f0-8fb7-70c6149a3f0b req-8e92fc60-6f28-415f-9200-ce2e264f258b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:45.029561 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-0d3847b8-c5a5-43f0-8fb7-70c6149a3f0b req-8e92fc60-6f28-415f-9200-ce2e264f258b service nova] Creating event network-vif-plugged:cab55f48-4897-4d8e-9ecf-73b914146f1f for instance 932b5456-3954-4de2-a4bf-431855237ad8 on n-h2-826526-5 Jul 20 05:36:45.034736 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-0d3847b8-c5a5-43f0-8fb7-70c6149a3f0b req-8e92fc60-6f28-415f-9200-ce2e264f258b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032615 Jul 20 05:36:45.035350 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3974/7712] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:36:45.367815 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-12c3f8d2-8126-45eb-ae1c-e869962564f8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:45.368435 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-12c3f8d2-8126-45eb-ae1c-e869962564f8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:45.375957 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12c3f8d2-8126-45eb-ae1c-e869962564f8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:45.376440 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12c3f8d2-8126-45eb-ae1c-e869962564f8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:45.377221 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12c3f8d2-8126-45eb-ae1c-e869962564f8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:45.377795 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-12c3f8d2-8126-45eb-ae1c-e869962564f8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:45.523939 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-12c3f8d2-8126-45eb-ae1c-e869962564f8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:45.532248 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-12c3f8d2-8126-45eb-ae1c-e869962564f8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1371 microversion: 2.1 time: 0.168511 Jul 20 05:36:45.532861 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3739/7713] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:45 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:46.553761 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-99dcee07-ebb4-4714-b57d-12a88042347a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:46.554474 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-99dcee07-ebb4-4714-b57d-12a88042347a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:46.561515 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-99dcee07-ebb4-4714-b57d-12a88042347a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:46.561986 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-99dcee07-ebb4-4714-b57d-12a88042347a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:46.562766 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-99dcee07-ebb4-4714-b57d-12a88042347a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:46.563213 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-99dcee07-ebb4-4714-b57d-12a88042347a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:46.704123 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-99dcee07-ebb4-4714-b57d-12a88042347a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:46.712841 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-99dcee07-ebb4-4714-b57d-12a88042347a tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1556 microversion: 2.1 time: 0.166074 Jul 20 05:36:46.713428 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3975/7714] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:46 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:46.730036 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf6a817c-dc91-4816-8644-62c5dd632f87 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:46.730655 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf6a817c-dc91-4816-8644-62c5dd632f87 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:46.737905 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf6a817c-dc91-4816-8644-62c5dd632f87 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:46.738360 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf6a817c-dc91-4816-8644-62c5dd632f87 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:46.739166 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf6a817c-dc91-4816-8644-62c5dd632f87 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:46.739629 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf6a817c-dc91-4816-8644-62c5dd632f87 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:46.875480 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-bf6a817c-dc91-4816-8644-62c5dd632f87 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:46.885796 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf6a817c-dc91-4816-8644-62c5dd632f87 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1556 microversion: 2.1 time: 0.159295 Jul 20 05:36:46.886521 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3740/7715] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:46 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:48.910321 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-d5c11ace-70e3-40fa-b546-dcde25bc744c req-7972a8da-d8e1-4d84-bff3-cfb1e91a349a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "932b5456-3954-4de2-a4bf-431855237ad8", "tag": "cab55f48-4897-4d8e-9ecf-73b914146f1f"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:48.919557 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d5c11ace-70e3-40fa-b546-dcde25bc744c req-7972a8da-d8e1-4d84-bff3-cfb1e91a349a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:48.920014 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-d5c11ace-70e3-40fa-b546-dcde25bc744c req-7972a8da-d8e1-4d84-bff3-cfb1e91a349a service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:48.933101 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-d5c11ace-70e3-40fa-b546-dcde25bc744c req-7972a8da-d8e1-4d84-bff3-cfb1e91a349a service nova] Creating event network-changed:cab55f48-4897-4d8e-9ecf-73b914146f1f for instance 932b5456-3954-4de2-a4bf-431855237ad8 on n-h2-826526-5 Jul 20 05:36:48.938286 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-d5c11ace-70e3-40fa-b546-dcde25bc744c req-7972a8da-d8e1-4d84-bff3-cfb1e91a349a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031941 Jul 20 05:36:48.939260 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3976/7716] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:37:15.343573 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:37:15.344638 n-d-826526-5 devstack@n-api.service[127870]: Wed Jul 20 05:37:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:37:21.761838 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:37:21.762450 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:37:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:38:16.249338 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=24 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:38:16.250426 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=52 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:38:16.255911 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b10502ca-fa0e-442c-aaee-859ed05ba553 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1062355746"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:38:16.256991 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b10502ca-fa0e-442c-aaee-859ed05ba553 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:16.264092 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b10502ca-fa0e-442c-aaee-859ed05ba553 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:16.264617 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b10502ca-fa0e-442c-aaee-859ed05ba553 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:16.265416 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b10502ca-fa0e-442c-aaee-859ed05ba553 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:16.265940 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b10502ca-fa0e-442c-aaee-859ed05ba553 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:16.554199 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b10502ca-fa0e-442c-aaee-859ed05ba553 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "POST /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8/action" status: 202 len: 0 microversion: 2.1 time: 0.308056 Jul 20 05:38:16.554793 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3741/7717] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 05:38:16 2022] POST /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 05:38:21.439486 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:38:21.440800 n-d-826526-5 devstack@n-api.service[127871]: DEBUG dbcounter [-] [127871] Writing DB stats nova_cell1:SELECT=50 {{(pid=127871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:38:21.446916 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-819306c3-9f2d-4b7a-996d-385502ee347d req-30419db8-4678-4750-aef2-26dd6d2b7e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "932b5456-3954-4de2-a4bf-431855237ad8", "name": "network-vif-plugged", "status": "completed", "tag": "cab55f48-4897-4d8e-9ecf-73b914146f1f"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:38:21.469392 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-819306c3-9f2d-4b7a-996d-385502ee347d req-30419db8-4678-4750-aef2-26dd6d2b7e11 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:21.470214 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-819306c3-9f2d-4b7a-996d-385502ee347d req-30419db8-4678-4750-aef2-26dd6d2b7e11 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:21.486336 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-819306c3-9f2d-4b7a-996d-385502ee347d req-30419db8-4678-4750-aef2-26dd6d2b7e11 service nova] Creating event network-vif-plugged:cab55f48-4897-4d8e-9ecf-73b914146f1f for instance 932b5456-3954-4de2-a4bf-431855237ad8 on n-h2-826526-5 Jul 20 05:38:21.492566 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-819306c3-9f2d-4b7a-996d-385502ee347d req-30419db8-4678-4750-aef2-26dd6d2b7e11 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055557 Jul 20 05:38:21.493927 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3977/7718] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:38:31.293405 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:38:31.294465 n-d-826526-5 devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:38:31.298807 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a12e5410-f09a-40e3-b26a-a5a336680238 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:38:31.299525 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a12e5410-f09a-40e3-b26a-a5a336680238 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:31.301587 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-45214eae-029d-49bf-97cb-b41ce9baa9cd req-5833113d-6028-43a8-8b5d-7d80c41b718b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "932b5456-3954-4de2-a4bf-431855237ad8", "tag": "cab55f48-4897-4d8e-9ecf-73b914146f1f"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:38:31.308749 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a12e5410-f09a-40e3-b26a-a5a336680238 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:31.309528 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a12e5410-f09a-40e3-b26a-a5a336680238 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:31.310431 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a12e5410-f09a-40e3-b26a-a5a336680238 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:31.311115 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a12e5410-f09a-40e3-b26a-a5a336680238 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:31.311284 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-45214eae-029d-49bf-97cb-b41ce9baa9cd req-5833113d-6028-43a8-8b5d-7d80c41b718b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:31.312155 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-45214eae-029d-49bf-97cb-b41ce9baa9cd req-5833113d-6028-43a8-8b5d-7d80c41b718b service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:31.340842 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-45214eae-029d-49bf-97cb-b41ce9baa9cd req-5833113d-6028-43a8-8b5d-7d80c41b718b service nova] Creating event network-changed:cab55f48-4897-4d8e-9ecf-73b914146f1f for instance 932b5456-3954-4de2-a4bf-431855237ad8 on n-h2-826526-5 Jul 20 05:38:31.341074 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a12e5410-f09a-40e3-b26a-a5a336680238 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:38:31.347131 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-45214eae-029d-49bf-97cb-b41ce9baa9cd req-5833113d-6028-43a8-8b5d-7d80c41b718b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051180 Jul 20 05:38:31.347984 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3978/7719] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:38:31.437663 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a12e5410-f09a-40e3-b26a-a5a336680238 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "DELETE /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 204 len: 0 microversion: 2.1 time: 0.145987 Jul 20 05:38:31.439356 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3742/7720] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:38:31 2022] DELETE /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:38:31.460140 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-f818229c-3732-4fa5-91bf-a1a0b4acfdb9 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:38:31.461100 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-f818229c-3732-4fa5-91bf-a1a0b4acfdb9 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:31.468022 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f818229c-3732-4fa5-91bf-a1a0b4acfdb9 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:31.468664 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f818229c-3732-4fa5-91bf-a1a0b4acfdb9 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:31.469564 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f818229c-3732-4fa5-91bf-a1a0b4acfdb9 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:31.470110 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-f818229c-3732-4fa5-91bf-a1a0b4acfdb9 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:31.636772 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-f818229c-3732-4fa5-91bf-a1a0b4acfdb9 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:38:31.645792 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-f818229c-3732-4fa5-91bf-a1a0b4acfdb9 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1680 microversion: 2.1 time: 0.201113 Jul 20 05:38:31.646379 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3979/7721] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:38:31 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:38:32.664052 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8cd96800-92a4-4aec-9adb-93279886f300 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:38:32.664675 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8cd96800-92a4-4aec-9adb-93279886f300 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:32.672060 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8cd96800-92a4-4aec-9adb-93279886f300 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:32.672552 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8cd96800-92a4-4aec-9adb-93279886f300 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:32.673335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8cd96800-92a4-4aec-9adb-93279886f300 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:32.673777 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8cd96800-92a4-4aec-9adb-93279886f300 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:32.818854 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-8cd96800-92a4-4aec-9adb-93279886f300 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:38:32.827221 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8cd96800-92a4-4aec-9adb-93279886f300 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1680 microversion: 2.1 time: 0.167798 Jul 20 05:38:32.827766 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3743/7722] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:38:32 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:38:33.505990 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-1c5614c0-3758-4deb-a0a4-ee42d3825153 req-4ba0cea8-145b-492b-82a1-92056f98766f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "932b5456-3954-4de2-a4bf-431855237ad8", "name": "network-vif-deleted", "tag": "cab55f48-4897-4d8e-9ecf-73b914146f1f"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:38:33.515879 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1c5614c0-3758-4deb-a0a4-ee42d3825153 req-4ba0cea8-145b-492b-82a1-92056f98766f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:33.516383 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-1c5614c0-3758-4deb-a0a4-ee42d3825153 req-4ba0cea8-145b-492b-82a1-92056f98766f service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:33.528434 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-1c5614c0-3758-4deb-a0a4-ee42d3825153 req-4ba0cea8-145b-492b-82a1-92056f98766f service nova] Creating event network-vif-deleted:cab55f48-4897-4d8e-9ecf-73b914146f1f for instance 932b5456-3954-4de2-a4bf-431855237ad8 on n-h2-826526-5 Jul 20 05:38:33.533241 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-1c5614c0-3758-4deb-a0a4-ee42d3825153 req-4ba0cea8-145b-492b-82a1-92056f98766f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091550 Jul 20 05:38:33.534040 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3980/7723] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:38:33.845324 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3553740f-f4dd-4512-b2e1-bfc4c65acfd6 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:38:33.846000 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3553740f-f4dd-4512-b2e1-bfc4c65acfd6 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:33.854710 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3553740f-f4dd-4512-b2e1-bfc4c65acfd6 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:33.855140 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3553740f-f4dd-4512-b2e1-bfc4c65acfd6 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:33.856534 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3553740f-f4dd-4512-b2e1-bfc4c65acfd6 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:33.857130 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3553740f-f4dd-4512-b2e1-bfc4c65acfd6 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:33.893910 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3553740f-f4dd-4512-b2e1-bfc4c65acfd6 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:33.894470 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3553740f-f4dd-4512-b2e1-bfc4c65acfd6 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:33.894942 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-3553740f-f4dd-4512-b2e1-bfc4c65acfd6 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lazy-loading 'fault' on Instance uuid 932b5456-3954-4de2-a4bf-431855237ad8 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:38:33.939567 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3553740f-f4dd-4512-b2e1-bfc4c65acfd6 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:38:33.946704 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3553740f-f4dd-4512-b2e1-bfc4c65acfd6 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 200 len: 1336 microversion: 2.1 time: 0.105534 Jul 20 05:38:33.947313 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3744/7724] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:38:33 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 1336 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:38:34.970900 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5744d8e6-7e31-475b-a51d-9b2061daa5a2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:38:34.972102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-5744d8e6-7e31-475b-a51d-9b2061daa5a2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 932b5456-3954-4de2-a4bf-431855237ad8] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:34.979119 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5744d8e6-7e31-475b-a51d-9b2061daa5a2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:34.979577 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5744d8e6-7e31-475b-a51d-9b2061daa5a2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:34.980398 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5744d8e6-7e31-475b-a51d-9b2061daa5a2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:34.980841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-5744d8e6-7e31-475b-a51d-9b2061daa5a2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:34.994566 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-5744d8e6-7e31-475b-a51d-9b2061daa5a2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] HTTP exception thrown: Instance 932b5456-3954-4de2-a4bf-431855237ad8 could not be found. Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5744d8e6-7e31-475b-a51d-9b2061daa5a2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Request method failure captured: Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 HTTP/1.1 Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi15PGhY9Gy7SCyoxJ3c-y6TG6SKO5molyNKkDapw-fHavUpdj6ntqC00pWSHC48Q0HWL4RILpqvMtvXrsoFyJgS0ySbKSgcyFxA7SxCPhwPyVjy02e1Wf4YHHuC9KysN4DCHSAjKfwa2Wl5VbQzL6YK34s59v7B3JnzpnJE-KbTUUY4c Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 109e3640b516417cb7e37c164ae86aad Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestSnapshotPattern-1818989097 Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/109e3640b516417cb7e37c164ae86aad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/109e3640b516417cb7e37c164ae86aad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_109e3640b516417cb7e37c164ae86aad", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/109e3640b516417cb7e37c164ae86aad"}]}] Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestSnapshotPattern-1818989097 Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 109e3640b516417cb7e37c164ae86aad Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestSnapshotPattern-1818989097 Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestSnapshotPattern-1818989097-project Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: ffc2747b9fc3424c82d85699c348368a Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestSnapshotPattern-1818989097-project Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 932b5456-3954-4de2-a4bf-431855237ad8 could not be found. Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '932b5456-3954-4de2-a4bf-431855237ad8'} Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 932b5456-3954-4de2-a4bf-431855237ad8 could not be found. Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 932b5456-3954-4de2-a4bf-431855237ad8 could not be found. Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:38:34.996217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:38:35.001102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:38:35.001102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:38:35.001102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:38:35.001102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:38:35.001102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:38:35.001102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 932b5456-3954-4de2-a4bf-431855237ad8 could not be found. Jul 20 05:38:35.001102 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:38:35.001102 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-5744d8e6-7e31-475b-a51d-9b2061daa5a2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Returning 404 to user: Instance 932b5456-3954-4de2-a4bf-431855237ad8 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:38:35.001102 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-5744d8e6-7e31-475b-a51d-9b2061daa5a2 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8" status: 404 len: 111 microversion: 2.1 time: 0.035453 Jul 20 05:38:35.001102 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3981/7725] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:38:34 2022] GET /compute/v2.1/servers/932b5456-3954-4de2-a4bf-431855237ad8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:38:36.772045 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-71aebf16-c161-47ea-a6fe-70f7dc904d16 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:38:36.772597 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-71aebf16-c161-47ea-a6fe-70f7dc904d16 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:36.774535 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-2e6e2979-f33e-4b0d-90a4-e63d54cfbe88 req-89594f2e-64e6-4877-8a15-1ff48b7a9624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08c52778-601a-41e6-814e-6c455753a3b5", "tag": "be60ae56-0e25-4eaf-850e-4bb39bb4dd91"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:38:36.780291 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71aebf16-c161-47ea-a6fe-70f7dc904d16 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:36.780766 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71aebf16-c161-47ea-a6fe-70f7dc904d16 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:36.781557 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71aebf16-c161-47ea-a6fe-70f7dc904d16 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:36.782008 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71aebf16-c161-47ea-a6fe-70f7dc904d16 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:36.784749 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-2e6e2979-f33e-4b0d-90a4-e63d54cfbe88 req-89594f2e-64e6-4877-8a15-1ff48b7a9624 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:36.785218 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-2e6e2979-f33e-4b0d-90a4-e63d54cfbe88 req-89594f2e-64e6-4877-8a15-1ff48b7a9624 service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:36.797621 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-2e6e2979-f33e-4b0d-90a4-e63d54cfbe88 req-89594f2e-64e6-4877-8a15-1ff48b7a9624 service nova] Creating event network-changed:be60ae56-0e25-4eaf-850e-4bb39bb4dd91 for instance 08c52778-601a-41e6-814e-6c455753a3b5 on n-h1-826526-5 Jul 20 05:38:36.803288 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-2e6e2979-f33e-4b0d-90a4-e63d54cfbe88 req-89594f2e-64e6-4877-8a15-1ff48b7a9624 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032403 Jul 20 05:38:36.804200 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3982/7726] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:38:36.814728 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-71aebf16-c161-47ea-a6fe-70f7dc904d16 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:38:36.909104 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-71aebf16-c161-47ea-a6fe-70f7dc904d16 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "DELETE /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5" status: 204 len: 0 microversion: 2.1 time: 0.141269 Jul 20 05:38:36.913613 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3745/7727] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 05:38:36 2022] DELETE /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:38:36.920000 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-ca9f2a2f-c3de-4e8d-8937-e75238af20d8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:38:36.920753 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-ca9f2a2f-c3de-4e8d-8937-e75238af20d8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:36.927407 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca9f2a2f-c3de-4e8d-8937-e75238af20d8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:36.928113 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca9f2a2f-c3de-4e8d-8937-e75238af20d8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:36.928929 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca9f2a2f-c3de-4e8d-8937-e75238af20d8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:36.929370 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-ca9f2a2f-c3de-4e8d-8937-e75238af20d8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:37.087631 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.policy [None req-ca9f2a2f-c3de-4e8d-8937-e75238af20d8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:38:37.095735 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-ca9f2a2f-c3de-4e8d-8937-e75238af20d8 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5" status: 200 len: 1684 microversion: 2.1 time: 0.180768 Jul 20 05:38:37.096402 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3983/7728] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:38:36 2022] GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5 => generated 1684 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:38:38.118475 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d6113c92-00fa-4b9c-a225-0a28e535da48 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:38:38.119657 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d6113c92-00fa-4b9c-a225-0a28e535da48 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:38.130370 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6113c92-00fa-4b9c-a225-0a28e535da48 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:38.130860 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6113c92-00fa-4b9c-a225-0a28e535da48 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:38.131651 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6113c92-00fa-4b9c-a225-0a28e535da48 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:38.132101 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d6113c92-00fa-4b9c-a225-0a28e535da48 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:38.274841 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-d6113c92-00fa-4b9c-a225-0a28e535da48 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:38:38.282900 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d6113c92-00fa-4b9c-a225-0a28e535da48 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5" status: 200 len: 1684 microversion: 2.1 time: 0.171605 Jul 20 05:38:38.283490 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3746/7729] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:38:38 2022] GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5 => generated 1684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:38:38.927279 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [req-58b50ece-f9fc-413e-9911-8a9d42e05500 req-ec53c1bf-3050-46e4-9a68-b0e8214c925e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c52778-601a-41e6-814e-6c455753a3b5", "name": "network-vif-deleted", "tag": "be60ae56-0e25-4eaf-850e-4bb39bb4dd91"}]} {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:38:38.938246 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-58b50ece-f9fc-413e-9911-8a9d42e05500 req-ec53c1bf-3050-46e4-9a68-b0e8214c925e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:38.938704 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [req-58b50ece-f9fc-413e-9911-8a9d42e05500 req-ec53c1bf-3050-46e4-9a68-b0e8214c925e service nova] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:38.951008 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.compute.server_external_events [req-58b50ece-f9fc-413e-9911-8a9d42e05500 req-ec53c1bf-3050-46e4-9a68-b0e8214c925e service nova] Creating event network-vif-deleted:be60ae56-0e25-4eaf-850e-4bb39bb4dd91 for instance 08c52778-601a-41e6-814e-6c455753a3b5 on n-h1-826526-5 Jul 20 05:38:38.957056 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [req-58b50ece-f9fc-413e-9911-8a9d42e05500 req-ec53c1bf-3050-46e4-9a68-b0e8214c925e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033612 Jul 20 05:38:38.957713 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3984/7730] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 05:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:38:39.303335 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3fdfbf0b-fdbd-406c-908f-ca9d4d31978e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:38:39.304050 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3fdfbf0b-fdbd-406c-908f-ca9d4d31978e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:39.312236 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3fdfbf0b-fdbd-406c-908f-ca9d4d31978e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:39.313301 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3fdfbf0b-fdbd-406c-908f-ca9d4d31978e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:39.314105 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3fdfbf0b-fdbd-406c-908f-ca9d4d31978e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:39.314564 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3fdfbf0b-fdbd-406c-908f-ca9d4d31978e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:39.350358 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3fdfbf0b-fdbd-406c-908f-ca9d4d31978e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:39.350845 n-d-826526-5 devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3fdfbf0b-fdbd-406c-908f-ca9d4d31978e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:39.351384 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-3fdfbf0b-fdbd-406c-908f-ca9d4d31978e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lazy-loading 'fault' on Instance uuid 08c52778-601a-41e6-814e-6c455753a3b5 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:38:39.398085 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.policy [None req-3fdfbf0b-fdbd-406c-908f-ca9d4d31978e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2747b9fc3424c82d85699c348368a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109e3640b516417cb7e37c164ae86aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:38:39.405073 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3fdfbf0b-fdbd-406c-908f-ca9d4d31978e tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5" status: 200 len: 1338 microversion: 2.1 time: 0.107409 Jul 20 05:38:39.405658 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3747/7731] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:38:39 2022] GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5 => generated 1338 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:38:40.428223 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-17c7c31a-9d06-48af-abc3-198990fe256d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '>' {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:38:40.429455 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.compute.api [None req-17c7c31a-9d06-48af-abc3-198990fe256d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [instance: 08c52778-601a-41e6-814e-6c455753a3b5] Fetching instance by UUID {{(pid=127871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:40.441785 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17c7c31a-9d06-48af-abc3-198990fe256d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:40.442244 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17c7c31a-9d06-48af-abc3-198990fe256d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:40.443048 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17c7c31a-9d06-48af-abc3-198990fe256d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:40.443462 n-d-826526-5 devstack@n-api.service[127871]: DEBUG oslo_concurrency.lockutils [None req-17c7c31a-9d06-48af-abc3-198990fe256d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Lock "fbf41b76-8148-4f7f-88f5-d6fd988c2859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:40.457563 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.wsgi [None req-17c7c31a-9d06-48af-abc3-198990fe256d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] HTTP exception thrown: Instance 08c52778-601a-41e6-814e-6c455753a3b5 could not be found. Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-17c7c31a-9d06-48af-abc3-198990fe256d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Request method failure captured: Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: request: GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5 HTTP/1.1 Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: Accept: application/json Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: Accept-Encoding: identity Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: Connection: close Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: Content-Length: 0 Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: Content-Type: application/json Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: Host: 10.222.0.17 Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: Openstack-System-Scope: None Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: User-Agent: python-urllib3/1.26.9 Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-Auth-Token: gAAAAABi15PGhY9Gy7SCyoxJ3c-y6TG6SKO5molyNKkDapw-fHavUpdj6ntqC00pWSHC48Q0HWL4RILpqvMtvXrsoFyJgS0ySbKSgcyFxA7SxCPhwPyVjy02e1Wf4YHHuC9KysN4DCHSAjKfwa2Wl5VbQzL6YK34s59v7B3JnzpnJE-KbTUUY4c Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Id: None Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-Domain-Name: None Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-Identity-Status: Confirmed Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-Is-Admin-Project: True Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Id: default Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Domain-Name: Default Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Id: 109e3640b516417cb7e37c164ae86aad Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-Project-Name: tempest-TestSnapshotPattern-1818989097 Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-Role: reader,member Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-Roles: reader,member Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/109e3640b516417cb7e37c164ae86aad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/109e3640b516417cb7e37c164ae86aad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_109e3640b516417cb7e37c164ae86aad", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/109e3640b516417cb7e37c164ae86aad"}]}] Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant: tempest-TestSnapshotPattern-1818989097 Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Id: 109e3640b516417cb7e37c164ae86aad Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-Tenant-Name: tempest-TestSnapshotPattern-1818989097 Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-User: tempest-TestSnapshotPattern-1818989097-project Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Id: default Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-User-Domain-Name: Default Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-User-Id: ffc2747b9fc3424c82d85699c348368a Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: X-User-Name: tempest-TestSnapshotPattern-1818989097-project Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: method: > Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: exception: Instance 08c52778-601a-41e6-814e-6c455753a3b5 could not be found. Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: action_args: {'id': '08c52778-601a-41e6-814e-6c455753a3b5'} Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: {{(pid=127871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08c52778-601a-41e6-814e-6c455753a3b5 could not be found. Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08c52778-601a-41e6-814e-6c455753a3b5 could not be found. Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:38:40.459217 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:38:40.463841 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:38:40.463841 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:38:40.463841 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:38:40.463841 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:38:40.463841 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:38:40.463841 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08c52778-601a-41e6-814e-6c455753a3b5 could not be found. Jul 20 05:38:40.463841 n-d-826526-5 devstack@n-api.service[127871]: ERROR nova.api.openstack.wsgi Jul 20 05:38:40.463841 n-d-826526-5 devstack@n-api.service[127871]: DEBUG nova.api.openstack.wsgi [None req-17c7c31a-9d06-48af-abc3-198990fe256d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Returning 404 to user: Instance 08c52778-601a-41e6-814e-6c455753a3b5 could not be found. {{(pid=127871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:38:40.463841 n-d-826526-5 devstack@n-api.service[127871]: INFO nova.api.openstack.requestlog [None req-17c7c31a-9d06-48af-abc3-198990fe256d tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5" status: 404 len: 111 microversion: 2.1 time: 0.039832 Jul 20 05:38:40.463841 n-d-826526-5 devstack@n-api.service[127871]: [pid: 127871|app: 0|req: 3985/7732] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 05:38:40 2022] GET /compute/v2.1/servers/08c52778-601a-41e6-814e-6c455753a3b5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:38:40.637923 n-d-826526-5 devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-23372256-f95a-4072-a783-1195671b98e7 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] Calling method '.version_select at 0x7f06bc382550>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:38:40.641404 n-d-826526-5 devstack@n-api.service[127870]: ERROR oslo.messaging._drivers.impl_rabbit [None req-23372256-f95a-4072-a783-1195671b98e7 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [1ddb70cf-107b-4290-bf60-70f0682d1625] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:38:41.650788 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [None req-23372256-f95a-4072-a783-1195671b98e7 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] [1ddb70cf-107b-4290-bf60-70f0682d1625] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 42258. Jul 20 05:38:41.673212 n-d-826526-5 devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-23372256-f95a-4072-a783-1195671b98e7 tempest-TestSnapshotPattern-1818989097 tempest-TestSnapshotPattern-1818989097-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1304471394" status: 202 len: 0 microversion: 2.1 time: 1.039358 Jul 20 05:38:41.673798 n-d-826526-5 devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3748/7733] 10.222.0.17 () {58 vars in 1256 bytes} [Wed Jul 20 05:38:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1304471394 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:38:57.282063 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:38:57.282915 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:38:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:40:35.357582 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:40:35.358238 n-d-826526-5 devstack@n-api.service[127870]: Wed Jul 20 05:40:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:40:41.771907 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:40:41.772532 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:40:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:42:17.294088 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:42:17.294710 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:42:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:43:55.317295 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:43:55.318119 n-d-826526-5 devstack@n-api.service[127870]: Wed Jul 20 05:43:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:43:55.366597 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:43:55.366785 n-d-826526-5 devstack@n-api.service[127870]: Wed Jul 20 05:43:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:44:01.781606 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:44:01.782233 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:44:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:44:08.733068 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:44:08.734081 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:44:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:44:09.266291 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:44:09.267172 n-d-826526-5 devstack@n-api.service[127870]: Wed Jul 20 05:44:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:45:37.303554 n-d-826526-5 devstack@n-api.service[127871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:45:37.304049 n-d-826526-5 devstack@n-api.service[127871]: Wed Jul 20 05:45:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:47:15.329016 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:47:15.329656 n-d-826526-5 devstack@n-api.service[127870]: Wed Jul 20 05:47:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:47:15.375271 n-d-826526-5 devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:47:15.375519 n-d-826526-5 devstack@n-api.service[127870]: Wed Jul 20 05:47:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!